-- Logs begin at Sat 2022-08-27 03:41:11 UTC, end at Sat 2022-08-27 05:23:46 UTC. -- Aug 27 04:16:18.328506 n-d-852088-5 systemd[1]: Starting Devstack devstack@keystone.service... Aug 27 04:16:18.338912 n-d-852088-5 devstack@keystone.service[82070]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 27 04:16:18.340812 n-d-852088-5 devstack@keystone.service[82070]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 27 04:16:18 2022] *** Aug 27 04:16:18.340812 n-d-852088-5 devstack@keystone.service[82070]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 04:16:18.340812 n-d-852088-5 devstack@keystone.service[82070]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 04:16:18.340812 n-d-852088-5 devstack@keystone.service[82070]: nodename: n-d-852088-5 Aug 27 04:16:18.340812 n-d-852088-5 devstack@keystone.service[82070]: machine: x86_64 Aug 27 04:16:18.340812 n-d-852088-5 devstack@keystone.service[82070]: clock source: unix Aug 27 04:16:18.340812 n-d-852088-5 devstack@keystone.service[82070]: pcre jit disabled Aug 27 04:16:18.340812 n-d-852088-5 devstack@keystone.service[82070]: detected number of CPU cores: 4 Aug 27 04:16:18.340812 n-d-852088-5 devstack@keystone.service[82070]: current working directory: / Aug 27 04:16:18.340812 n-d-852088-5 devstack@keystone.service[82070]: detected binary path: /usr/bin/uwsgi-core Aug 27 04:16:18.340812 n-d-852088-5 devstack@keystone.service[82070]: your processes number limit is 47680 Aug 27 04:16:18.341405 n-d-852088-5 devstack@keystone.service[82070]: your memory page size is 4096 bytes Aug 27 04:16:18.341405 n-d-852088-5 devstack@keystone.service[82070]: detected max file descriptor number: 2048 Aug 27 04:16:18.341405 n-d-852088-5 devstack@keystone.service[82070]: lock engine: pthread robust mutexes Aug 27 04:16:18.341405 n-d-852088-5 devstack@keystone.service[82070]: thunder lock: enabled Aug 27 04:16:18.341405 n-d-852088-5 devstack@keystone.service[82070]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 27 04:16:18.341405 n-d-852088-5 devstack@keystone.service[82070]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 27 04:16:18.381374 n-d-852088-5 devstack@keystone.service[82070]: Python main interpreter initialized at 0x55d81265b9c0 Aug 27 04:16:18.381374 n-d-852088-5 devstack@keystone.service[82070]: python threads support enabled Aug 27 04:16:18.381374 n-d-852088-5 devstack@keystone.service[82070]: your server socket listen backlog is limited to 100 connections Aug 27 04:16:18.381374 n-d-852088-5 devstack@keystone.service[82070]: your mercy for graceful operations on workers is 90 seconds Aug 27 04:16:18.381741 n-d-852088-5 devstack@keystone.service[82070]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 04:16:18.381818 n-d-852088-5 devstack@keystone.service[82070]: *** Operational MODE: preforking *** Aug 27 04:16:18.382063 n-d-852088-5 devstack@keystone.service[82070]: *** uWSGI is running in multiple interpreter mode *** Aug 27 04:16:18.382063 n-d-852088-5 devstack@keystone.service[82070]: spawned uWSGI master process (pid: 82070) Aug 27 04:16:18.382263 n-d-852088-5 systemd[1]: Started Devstack devstack@keystone.service. Aug 27 04:16:18.383755 n-d-852088-5 devstack@keystone.service[82070]: spawned uWSGI worker 1 (pid: 82082, cores: 1) Aug 27 04:16:18.383755 n-d-852088-5 devstack@keystone.service[82070]: spawned uWSGI worker 2 (pid: 82083, cores: 1) Aug 27 04:16:18.383755 n-d-852088-5 devstack@keystone.service[82070]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 04:16:22.810169 n-d-852088-5 devstack@keystone.service[82083]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:16:22.810169 n-d-852088-5 devstack@keystone.service[82083]: from cryptography.utils import int_from_bytes Aug 27 04:16:22.810955 n-d-852088-5 devstack@keystone.service[82083]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:16:22.810955 n-d-852088-5 devstack@keystone.service[82083]: from cryptography.utils import int_from_bytes Aug 27 04:16:22.811105 n-d-852088-5 devstack@keystone.service[82082]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:16:22.811105 n-d-852088-5 devstack@keystone.service[82082]: from cryptography.utils import int_from_bytes Aug 27 04:16:22.811105 n-d-852088-5 devstack@keystone.service[82082]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:16:22.811105 n-d-852088-5 devstack@keystone.service[82082]: from cryptography.utils import int_from_bytes Aug 27 04:16:22.871194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:16:22.871390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:16:22.871568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] command line args: [] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:16:22.871836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:16:22.872014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ================================================================================ {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:16:22.872300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] admin_token = **** {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.872382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:16:22.872550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] config_dir = [] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.872643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:16:22.872739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.872818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] command line args: [] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:16:22.872920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] config_source = [] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.873003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:16:22.873100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] debug = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.873329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ================================================================================ {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:16:22.873417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.874583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] admin_token = **** {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.874651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.874709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] config_dir = [] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.874779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.874844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.874844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] config_source = [] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.874957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.875020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] debug = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.875091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.875156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.875241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] list_limit = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.875301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.875368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] log_config_append = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.875427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.875492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.875492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] log_dir = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.875599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.875662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] log_file = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.875724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.875783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.875849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] list_limit = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.875912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.875969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] log_config_append = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.875969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.876079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.876145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] log_dir = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.881216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.881385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] log_file = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.881494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.881494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.881639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.881719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.881719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.881853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.881924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.881999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.882075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.882156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.882231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.882301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.882301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.882440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.882511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.882591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.882663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.882734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.882803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.882872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.882950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.882950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.883096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.883168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.883237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] publish_errors = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.883314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.883392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.883462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.883541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.883541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.883675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.883759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.883759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.883887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.883958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] standard_threads = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.884074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] publish_errors = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.884147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.884268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.884348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.884427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.884504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.884581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.884652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] use_journal = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.884652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] use_json = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.884839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.884925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] use_stderr = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.885003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.885080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] use_syslog = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.885152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] standard_threads = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.885221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.885296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.885377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.885456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.885527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.885597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.885666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.885741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] use_journal = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.885741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] use_json = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.885877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.885947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] use_stderr = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.886017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.886086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] use_syslog = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.886161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.886558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:16:22.886636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.886712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.886788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.886865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.886941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.887021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.887093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.887167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.887239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.887315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.887386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.887481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.887560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.887633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.887708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.887779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.887854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.887936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.888008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.888081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.888265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.888353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.888490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.888569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.888646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.888719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.888795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.888871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.888954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.889026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.889102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.889173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.889243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.889312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.889393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.889474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.889545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.889670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.889752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.889824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.889905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.889983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.890059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.890136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.890207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.890207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.890415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.890489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.890559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.890628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.890698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.890773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.890853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.890978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.891055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.891125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.891194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.891263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.891343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.891420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.891497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.891569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.891638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.891707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.891788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.891859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.891948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.892025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.892596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.892683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.892772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.892853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.892932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.893004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.893080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.893151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.893151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.893297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.893370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.893473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.893557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.893637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.893713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.893790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.893862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.893939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.894063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.894153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.894227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.894299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.894368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.894444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.894517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.894662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.894745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.894890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.894971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.895122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.895209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.895353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.895432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.895578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.895657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.895817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.895894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.896046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.896123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.896304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.896386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.896533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.896621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.896769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.896854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.897005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.897084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.897232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.897316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.897463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.897543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.897693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.897772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.897950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.898029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.898184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.898262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.898420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.898505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.898655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.898778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.898885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.898983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.899087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.899184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.899372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.899485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.899590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.899687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.899814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.899914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.900043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.900123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.900309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.900391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.900539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.900622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.900776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.900857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.901011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.901141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.901266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.901390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.901554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.901674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.901778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.901904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.902029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.902157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.902273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.902388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.902512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.902619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.902733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.902860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.902979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.903095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.903210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.903325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.903440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.903563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.903679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.903806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.903923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.904038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.904154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.904306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.904424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.904540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.904662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.904783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.904899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.905022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.905139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.905255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.905370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.905493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.905610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.905733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.905850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.905956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.906069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.906183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.906304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.906428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.906585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.906711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.906826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.906941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.907054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.907177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.907294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] auth.external = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.907409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.907522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.908255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.908853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.909000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.909121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.909121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] auth.password = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.909368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.909496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] auth.token = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.909614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.909730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.909846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.909970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.910087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.910203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.910319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.910436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.910552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.910681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.910807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] auth.external = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.910924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.911052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.911307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.911307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] credential.caching = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.911566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.911687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.911811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.911811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] auth.password = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.912030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.912030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.912280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] auth.token = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.912401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.912519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.912636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.912752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.912868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.912994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.913112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.913229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.913344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.913467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.913586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.913712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.913844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.913962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.914078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.914194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] credential.caching = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.914347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.914467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.914589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.914708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.914815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.914933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.915058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.915177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.915293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] federation.caching = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.915442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.915567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.915695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.915888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.916008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.916124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.916295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.916412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.916541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.916669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.916790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.916912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.917030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.917145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.917268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.917394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.917512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.917627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.917744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.917860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.917976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.918100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.922943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] federation.caching = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.923076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] identity.caching = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.923246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.924378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.924512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.924654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.924654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.924880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.925025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.925148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.925148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.925388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.925506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.925622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.925738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.925855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.925971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.926095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.926095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.926317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.926433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.926555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.926672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.926797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.926915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.927031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] identity.caching = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.927147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.927265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.927382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.927507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.927626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.927743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.927859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.927976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.928092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.928236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.928358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.928475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.928868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.928989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.929106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.929230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.929349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.929466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.929582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.929697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.929822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.929940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.930057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.930173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.930296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.930414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.930539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.930665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.930783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.930898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.931021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.931139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.931263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.931381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.931498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.931498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.931715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.931831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.931955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.931955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.932222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.932344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.932461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.932577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.932705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.932824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.932940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.933063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.933180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.933296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.933420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.933539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.933656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.933771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.933886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.934003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.934126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.934234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.934331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.934435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.934534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.934534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.934723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.934830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.934930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.935028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.935125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.935221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.935328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.935427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.935525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.935623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.935719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.935817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.935922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.936021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.936128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.936251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.936351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.936447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.936564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.936665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.936762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.936865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.936971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.937074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.937182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.937282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.937385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.937483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.937580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.937677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.937783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.937889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.937987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.938084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.938180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.938284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.938391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.938490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.938587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.938689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.938803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.939301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.939301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.939584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.939690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.939816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.939935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.940051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.940192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.940313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.940434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.940551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.940681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.940800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.940927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.941045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.941162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.941278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.941394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.941510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.941635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.941753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.941870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.941987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.942104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.942220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.942345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.942463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.942580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.942696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.942813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.942943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.943063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.943181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.943297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.943413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.943529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.943655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.943772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.943889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.944007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.944124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.944253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.944449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.944570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.944687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.944804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] resource.caching = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.944920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.945037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.945163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.945281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.945397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.945514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.945630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.945746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.945746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.945976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.946093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.946210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.946326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.946326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.946551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.946670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.946787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.946903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] role.caching = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.947019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.947134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] role.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.947240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.947341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.947438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.947535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.947535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.947714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.947714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.947905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.948002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.948099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.948225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] resource.caching = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.948330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.951378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.951486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.951486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.951676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.951676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.951812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.951812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.951953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.952025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.952096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.952189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.952267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.952352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.952428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.952500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.952572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.952572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.952751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.952838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] role.caching = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.952913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.952985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] role.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.953061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.953133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.953204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.953284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.953358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.953431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.953503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.953574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.955168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.959112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.959262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.959373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.959478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.959581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.959693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.959798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.959898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.959998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.960097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.960214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.960334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.960437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.960535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.960633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.960731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.960830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.960937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.961037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.961135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.961135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.961316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.961414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.961520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.961619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] token.caching = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.961619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.961800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.961899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.961997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.962103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.962203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.962309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.962409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.962506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.962603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.962709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.962812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.963411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.963501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.963576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.963658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.963733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.963805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.963877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.963949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.964021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.964101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.964192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.964268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.964340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.964412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.964484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.964570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.964645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.964726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.964808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.964883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.964955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.965027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.965108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.connection = **** {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.965182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] token.caching = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.965254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.965326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.965398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.965470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.965550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.965625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.965697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.965769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.965842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.965914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.965994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.966068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.966139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.966211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.966283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.966283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.966423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.966497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.966569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.966640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.966712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.966783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.966863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.966936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:16:22.967898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.connection = **** {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.967898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.968659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.968659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.968659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.968659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.968659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.968659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.968659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.968659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.968659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.969221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.969221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:16:22.969221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82082) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:16:22.988914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:22.989143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:22.989368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:22.990467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:22.990741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:22.990977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:22.997714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:22.999429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.026461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.026680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.028866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.029102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.084409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.085494 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.137581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.137813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.138261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.138500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.212916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.213127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.213355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.213573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.213790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.214007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.244999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.245231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.245461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.245684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.245900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.246113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.246323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.258635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.308944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.309153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.309381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.309598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.309813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.310028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.330737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.330969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.331182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.331410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.331634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.331853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.332070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.340519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.353595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.353830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.354058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.354280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.354497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.354711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.354948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82082) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.360349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.360585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.361407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.361636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.361850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.362072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.362278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 04:16:23.384932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.385150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 04:16:23.385320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.385497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.385580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 04:16:23.385700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 04:16:23.385857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.385978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.386058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 04:16:23.386498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.386584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.386764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.386854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.387055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.387143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.387309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.397112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.397228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.397306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.397379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.397554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.397636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.397837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.397927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.404813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.405022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.408316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.408596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.411614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.411697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.411771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.411843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.411915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.411996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.412071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.412143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.412239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.412313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.412384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.412469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.412544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.412544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.412674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.412735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.412816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.412880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.412939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.412939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.434180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.435046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.435768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.435967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.436563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.436857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.440747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.441030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.441427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.441620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.441912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.442199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.447792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.448069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.448894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.449191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.452056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.452379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.452663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.453059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.453306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.453410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.453573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.453674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.453852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.453934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.454120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.454202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.454442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.456591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.456886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.457176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.470680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.471040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.473618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.473906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.474868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.477814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.477995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.478354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.480928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.481231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.482577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.485717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.486394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.489445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.489615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.489753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.490038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.490427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.490707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.490996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.492722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.493028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.493318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.493606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.493959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.494352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.507019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.507302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.507565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.507822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.510725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.511021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.511550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.511822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.514809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.517792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.518854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.519328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.519600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.520571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.522121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.522275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.522480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.522574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.522849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.523112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.523397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.525329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.525633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.525931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.526220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.526506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.535259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.535538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.535813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.536090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.536397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.536672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.536944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.538617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.538908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.539194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.539481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.539770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.540057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.540372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.552908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.555930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.556694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.558831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.559740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.560298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.561773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.562053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.562332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.562664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.564348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.565850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.566140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.566428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.568835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.570299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.573023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.573187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.573473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.573752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.574037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.574515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.577455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.577756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.578052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.578355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.581994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.582281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.582557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.586531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.586834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.587122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.589457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.589738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.590014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.590286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.590602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.590826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.591118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.591383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.591647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.591910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.592199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.592474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.592744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.593015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.594105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82082) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 04:16:23.594396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.594684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.594967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.595846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.596240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.596539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.596833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.597110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.597387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.597665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.597953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.598225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.598509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82082) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 04:16:23.634410 n-d-852088-5 devstack@keystone.service[82082]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d81265b9c0 pid: 82082 (default app) Aug 27 04:16:23.637631 n-d-852088-5 devstack@keystone.service[82083]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d81265b9c0 pid: 82083 (default app) Aug 27 04:16:23.638491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561dbd8-ed17-490f-ae10-41a9c8110146 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:23.638785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561dbd8-ed17-490f-ae10-41a9c8110146 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:23.639176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561dbd8-ed17-490f-ae10-41a9c8110146 None None] PATH_INFO: `/v3` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:23.644062 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 791 bytes} [Sat Aug 27 04:16:23 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:31.338134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8da5b-8cad-4b86-ba52-c73b32c39408 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:31.338611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8da5b-8cad-4b86-ba52-c73b32c39408 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:31.338611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8da5b-8cad-4b86-ba52-c73b32c39408 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:31.342812 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1/2] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:16:31.348363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba55f7-5757-4cba-a496-c5e66904e3ff None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:31.348782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba55f7-5757-4cba-a496-c5e66904e3ff None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:31.348907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba55f7-5757-4cba-a496-c5e66904e3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:31.419202 n-d-852088-5 devstack@keystone.service[82082]: INFO dbcounter [None req-e4ba55f7-5757-4cba-a496-c5e66904e3ff None None] Registered counter for database keystone Aug 27 04:16:31.439258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG oslo_db.sqlalchemy.engines [None req-e4ba55f7-5757-4cba-a496-c5e66904e3ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82082) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:16:31.445613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writer thread running {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:16:31.625234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG passlib.handlers.bcrypt [None req-e4ba55f7-5757-4cba-a496-c5e66904e3ff None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=82082) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 27 04:16:31.625580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG passlib.handlers.bcrypt [None req-e4ba55f7-5757-4cba-a496-c5e66904e3ff None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82082) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 27 04:16:31.680311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e4ba55f7-5757-4cba-a496-c5e66904e3ff None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:31.681879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e4ba55f7-5757-4cba-a496-c5e66904e3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:31.816960 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2/3] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 27 04:16:32.256254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8da5b-8cad-4b86-ba52-c73b32c39408 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:32.325867 n-d-852088-5 devstack@keystone.service[82083]: INFO dbcounter [None req-bbc8da5b-8cad-4b86-ba52-c73b32c39408 None None] Registered counter for database keystone Aug 27 04:16:32.347509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG oslo_db.sqlalchemy.engines [None req-bbc8da5b-8cad-4b86-ba52-c73b32c39408 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:16:32.353574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writer thread running {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 04:16:32.471495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8da5b-8cad-4b86-ba52-c73b32c39408 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:32.475712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3315e4d-2b45-4f74-9b3e-c3957815f7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:32.476353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3315e4d-2b45-4f74-9b3e-c3957815f7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:32.476629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3315e4d-2b45-4f74-9b3e-c3957815f7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:32.476893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3315e4d-2b45-4f74-9b3e-c3957815f7c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:32.484825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3315e4d-2b45-4f74-9b3e-c3957815f7c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:32.537036 n-d-852088-5 devstack@keystone.service[82083]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a3315e4d-2b45-4f74-9b3e-c3957815f7c2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 27 04:16:32.537316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3315e4d-2b45-4f74-9b3e-c3957815f7c2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:32.546548 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2/4] 10.222.0.76 () {58 vars in 1324 bytes} [Sat Aug 27 04:16:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:16:32.553162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba55f7-5757-4cba-a496-c5e66904e3ff None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:32.567795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba55f7-5757-4cba-a496-c5e66904e3ff None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:32.572296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a914b89-59d2-426e-8e92-8427c42821dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:32.573384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914b89-59d2-426e-8e92-8427c42821dd admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:32.573668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914b89-59d2-426e-8e92-8427c42821dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:32.573953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914b89-59d2-426e-8e92-8427c42821dd admin admin] PATH_INFO: `/v3/projects/4935ddf6dc2a4bbea15d24b9f9bae471` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:32.575527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a914b89-59d2-426e-8e92-8427c42821dd admin admin] RBAC: Authorizing `identity:get_project(project_id=4935ddf6dc2a4bbea15d24b9f9bae471)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:32.629184 n-d-852088-5 devstack@keystone.service[82082]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8a914b89-59d2-426e-8e92-8427c42821dd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 27 04:16:32.629528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a914b89-59d2-426e-8e92-8427c42821dd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:32.634054 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3/5] 10.222.0.76 () {56 vars in 1207 bytes} [Sat Aug 27 04:16:32 2022] GET /identity/v3/projects/4935ddf6dc2a4bbea15d24b9f9bae471 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:34.530394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b1d6e-b680-43c2-9897-7e6fe776bfd0 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:34.530897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b1d6e-b680-43c2-9897-7e6fe776bfd0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:34.530982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b1d6e-b680-43c2-9897-7e6fe776bfd0 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:34.535781 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3/6] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:34.541459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1df18e-b1f5-42cd-9d56-093e453424af None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:34.541933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1df18e-b1f5-42cd-9d56-093e453424af None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:34.542023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1df18e-b1f5-42cd-9d56-093e453424af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:34.561431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-cb1df18e-b1f5-42cd-9d56-093e453424af None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:34.562942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cb1df18e-b1f5-42cd-9d56-093e453424af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:34.571394 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4/7] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 27 04:16:34.846082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b1d6e-b680-43c2-9897-7e6fe776bfd0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:34.858083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b1d6e-b680-43c2-9897-7e6fe776bfd0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:34.862501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97c772-a98c-4ae4-8d61-2b81cb27aaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:34.863096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97c772-a98c-4ae4-8d61-2b81cb27aaec admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:34.863377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97c772-a98c-4ae4-8d61-2b81cb27aaec admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:34.863652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97c772-a98c-4ae4-8d61-2b81cb27aaec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:34.871223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97c772-a98c-4ae4-8d61-2b81cb27aaec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:34.873021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97c772-a98c-4ae4-8d61-2b81cb27aaec admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:34.882361 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4/8] 10.222.0.76 () {58 vars in 1324 bytes} [Sat Aug 27 04:16:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:16:34.888047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1df18e-b1f5-42cd-9d56-093e453424af None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:34.897741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1df18e-b1f5-42cd-9d56-093e453424af None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:34.902091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80213813-459e-496b-8e39-fc36420c753c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:34.902712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80213813-459e-496b-8e39-fc36420c753c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:34.902994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80213813-459e-496b-8e39-fc36420c753c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:34.903268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80213813-459e-496b-8e39-fc36420c753c admin admin] PATH_INFO: `/v3/users/f2cd24054e9f47928421e1d9e1889453` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:34.904600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80213813-459e-496b-8e39-fc36420c753c admin admin] RBAC: Authorizing `identity:get_user(user_id=f2cd24054e9f47928421e1d9e1889453)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:34.906422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80213813-459e-496b-8e39-fc36420c753c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:34.907925 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 5/9] 10.222.0.76 () {56 vars in 1198 bytes} [Sat Aug 27 04:16:34 2022] GET /identity/v3/users/f2cd24054e9f47928421e1d9e1889453 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:36.926812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f6677-725a-483f-9770-6cfb9e2450c9 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:36.927385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f6677-725a-483f-9770-6cfb9e2450c9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:36.927385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f6677-725a-483f-9770-6cfb9e2450c9 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:36.928819 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 5/10] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:36.934007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2a6a-1d93-49fe-bec1-ee53118c6a50 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:36.934444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2a6a-1d93-49fe-bec1-ee53118c6a50 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:36.937102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2a6a-1d93-49fe-bec1-ee53118c6a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:36.953404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bfaa2a6a-1d93-49fe-bec1-ee53118c6a50 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:36.955788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bfaa2a6a-1d93-49fe-bec1-ee53118c6a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:37.049257 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 6/11] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:37.165130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98af64-bf4b-46a3-8aa3-ea0808993876 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:37.165524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98af64-bf4b-46a3-8aa3-ea0808993876 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:37.165805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98af64-bf4b-46a3-8aa3-ea0808993876 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:37.167130 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 6/12] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:37.172533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9136c-6ef6-4daf-820f-3349ea8458a5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:37.173337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9136c-6ef6-4daf-820f-3349ea8458a5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:37.173676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9136c-6ef6-4daf-820f-3349ea8458a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:37.193194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-44c9136c-6ef6-4daf-820f-3349ea8458a5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:37.194323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-44c9136c-6ef6-4daf-820f-3349ea8458a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:37.217392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:37.278632 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 7/13] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:37.340443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98af64-bf4b-46a3-8aa3-ea0808993876 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:37.489062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98af64-bf4b-46a3-8aa3-ea0808993876 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:37.525577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d072f5-cd1e-483e-897c-48178f09a155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:37.526779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d072f5-cd1e-483e-897c-48178f09a155 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:37.527058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d072f5-cd1e-483e-897c-48178f09a155 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:37.527329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d072f5-cd1e-483e-897c-48178f09a155 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:37.538733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d072f5-cd1e-483e-897c-48178f09a155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:16:37.546471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9136c-6ef6-4daf-820f-3349ea8458a5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:37.548261 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-f5d072f5-cd1e-483e-897c-48178f09a155 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:16:37.548261 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:16:37.548261 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:16:37.548261 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:16:37.548261 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:16:37.548261 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:16:37.548261 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:16:37.548261 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:16:37.548261 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:16:37.548261 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:16:37.548261 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:16:37.548261 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:16:37.548261 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:16:37.548261 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:16:37.548261 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:16:37.548261 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:16:37.549220 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:16:37.549220 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:16:37.549220 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:16:37.549220 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:16:37.549220 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:16:37.549220 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:16:37.549220 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:16:37.549220 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:16:37.549220 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:16:37.549220 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:16:37.549220 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:16:37.549220 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:16:37.549220 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:16:37.549220 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:16:37.549220 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:16:37.549220 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:16:37.550116 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:16:37.550116 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:16:37.550116 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:16:37.550116 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:16:37.550116 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:16:37.550116 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:16:37.550116 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:16:37.550116 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:16:37.550116 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:16:37.550116 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:16:37.550116 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:16:37.550116 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:16:37.550116 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 7/14] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:16:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:16:37.555390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d072f5-cd1e-483e-897c-48178f09a155 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:37.591261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:37.657493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9136c-6ef6-4daf-820f-3349ea8458a5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:37.661950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d072f5-cd1e-483e-897c-48178f09a155 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:37.693229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05d0ae-3152-4d75-9b93-14c9a26cfec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:37.693837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05d0ae-3152-4d75-9b93-14c9a26cfec3 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:37.694114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05d0ae-3152-4d75-9b93-14c9a26cfec3 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:37.694382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05d0ae-3152-4d75-9b93-14c9a26cfec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:37.696418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e59c2-0285-4597-8b2a-817c4c9f8966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:37.697032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e59c2-0285-4597-8b2a-817c4c9f8966 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:37.697308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e59c2-0285-4597-8b2a-817c4c9f8966 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:37.697580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e59c2-0285-4597-8b2a-817c4c9f8966 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:37.698253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e59c2-0285-4597-8b2a-817c4c9f8966 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:37.698571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e59c2-0285-4597-8b2a-817c4c9f8966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:37.699933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e59c2-0285-4597-8b2a-817c4c9f8966 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:37.711858 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 8/15] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:16:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:16:37.716113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:37.717604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e59c2-0285-4597-8b2a-817c4c9f8966 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:37.763775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05d0ae-3152-4d75-9b93-14c9a26cfec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:37.765231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05d0ae-3152-4d75-9b93-14c9a26cfec3 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:37.827780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:37.833945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e59c2-0285-4597-8b2a-817c4c9f8966 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:37.868822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec17ee6-4c0a-49cb-be6d-c1845c06bdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:37.869458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec17ee6-4c0a-49cb-be6d-c1845c06bdb2 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:37.869738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec17ee6-4c0a-49cb-be6d-c1845c06bdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:37.870009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec17ee6-4c0a-49cb-be6d-c1845c06bdb2 None admin] PATH_INFO: `/v3/users/f2cd24054e9f47928421e1d9e1889453` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:37.870454 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 8/16] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:16:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 27 04:16:37.871700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec17ee6-4c0a-49cb-be6d-c1845c06bdb2 None admin] RBAC: Authorizing `identity:get_user(user_id=f2cd24054e9f47928421e1d9e1889453)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:37.873670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec17ee6-4c0a-49cb-be6d-c1845c06bdb2 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:37.876092 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 9/17] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:16:37 2022] GET /identity/v3/users/f2cd24054e9f47928421e1d9e1889453 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:37.876562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05d0ae-3152-4d75-9b93-14c9a26cfec3 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:37.881511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec17ee6-4c0a-49cb-be6d-c1845c06bdb2 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:37.929950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:37.978269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05d0ae-3152-4d75-9b93-14c9a26cfec3 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:37.981142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec17ee6-4c0a-49cb-be6d-c1845c06bdb2 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:38.013515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed499a34-7221-464c-858a-f26fac484402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:38.014083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d28fe-0848-4e31-a03b-8771ec4420fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:38.014212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed499a34-7221-464c-858a-f26fac484402 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:38.014424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed499a34-7221-464c-858a-f26fac484402 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:38.014684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed499a34-7221-464c-858a-f26fac484402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:38.014776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d28fe-0848-4e31-a03b-8771ec4420fe None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:38.014990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d28fe-0848-4e31-a03b-8771ec4420fe None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:38.015264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d28fe-0848-4e31-a03b-8771ec4420fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:38.017182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d28fe-0848-4e31-a03b-8771ec4420fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:38.018617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d28fe-0848-4e31-a03b-8771ec4420fe None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:38.020156 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 10/18] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:16:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:16:38.025895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d28fe-0848-4e31-a03b-8771ec4420fe None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:38.029321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed499a34-7221-464c-858a-f26fac484402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:38.030798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed499a34-7221-464c-858a-f26fac484402 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:38.050854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-ed499a34-7221-464c-858a-f26fac484402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:16:38.050854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:16:38.050854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:16:38.050854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:16:38.050854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:16:38.050854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:16:38.050854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:16:38.050854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:16:38.050854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:16:38.050854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:16:38.050854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:16:38.050854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:16:38.050854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:16:38.050854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:16:38.050854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:16:38.050854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:16:38.051938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:16:38.051938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:16:38.051938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:16:38.051938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:16:38.051938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:16:38.051938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:16:38.051938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:16:38.051938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:16:38.051938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:16:38.051938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:16:38.051938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:16:38.051938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:16:38.051938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:16:38.051938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:16:38.051938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:16:38.051938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:16:38.051938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:16:38.053159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:16:38.053159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:16:38.053159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:16:38.053159 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 9/19] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:16:38.057673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed499a34-7221-464c-858a-f26fac484402 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:38.059901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:38.134660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d28fe-0848-4e31-a03b-8771ec4420fe None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:38.179582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed499a34-7221-464c-858a-f26fac484402 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:38.181739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6d7d2-781d-433d-abb1-224933fc6d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:38.181878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:38.182350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6d7d2-781d-433d-abb1-224933fc6d5d None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:38.182788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6d7d2-781d-433d-abb1-224933fc6d5d None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:38.183060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6d7d2-781d-433d-abb1-224933fc6d5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:38.183782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6d7d2-781d-433d-abb1-224933fc6d5d None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.domain.id=default, user.id=f2cd24054e9f47928421e1d9e1889453) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:38.184089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6d7d2-781d-433d-abb1-224933fc6d5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:38.185565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6d7d2-781d-433d-abb1-224933fc6d5d None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:38.194512 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 11/20] 10.222.0.76 () {56 vars in 1322 bytes} [Sat Aug 27 04:16:38 2022] GET /identity/v3/role_assignments?user.id=f2cd24054e9f47928421e1d9e1889453&scope.domain.id=default&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 233 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:16:38.213652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538b8c0-b387-443d-b85c-28bcadb6e7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:38.214299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538b8c0-b387-443d-b85c-28bcadb6e7c7 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:38.214586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538b8c0-b387-443d-b85c-28bcadb6e7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:38.214855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538b8c0-b387-443d-b85c-28bcadb6e7c7 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:38.215515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538b8c0-b387-443d-b85c-28bcadb6e7c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:38.215818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538b8c0-b387-443d-b85c-28bcadb6e7c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:38.217293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538b8c0-b387-443d-b85c-28bcadb6e7c7 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:38.236878 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 10/21] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:16:40.455146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352de4-a1d5-49ab-ac87-000d281c3538 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:40.455950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352de4-a1d5-49ab-ac87-000d281c3538 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:40.456405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352de4-a1d5-49ab-ac87-000d281c3538 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:40.458182 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 12/22] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:40.474896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42044817-878b-4cc3-a00c-41df4fc9af30 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:40.475417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42044817-878b-4cc3-a00c-41df4fc9af30 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:40.475498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42044817-878b-4cc3-a00c-41df4fc9af30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:40.501542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-42044817-878b-4cc3-a00c-41df4fc9af30 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:40.502694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-42044817-878b-4cc3-a00c-41df4fc9af30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:40.586791 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 11/23] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:40.628903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412b58b-4ecc-48ba-ad2f-e5dbd1cb33ca None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:40.629486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412b58b-4ecc-48ba-ad2f-e5dbd1cb33ca None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:40.629935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412b58b-4ecc-48ba-ad2f-e5dbd1cb33ca None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:40.631436 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 13/24] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:40.637340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c2726-1412-401c-aaa8-7f4908def1f0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:40.637625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c2726-1412-401c-aaa8-7f4908def1f0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:40.637898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c2726-1412-401c-aaa8-7f4908def1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:40.665147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e25c2726-1412-401c-aaa8-7f4908def1f0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:40.666329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e25c2726-1412-401c-aaa8-7f4908def1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:40.757836 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 12/25] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:40.804280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83e30b-d85d-40f8-bb5f-d53bb486d38c None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:40.804904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83e30b-d85d-40f8-bb5f-d53bb486d38c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:40.805366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83e30b-d85d-40f8-bb5f-d53bb486d38c None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:40.806930 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 14/26] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:40.812257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef5a48-2603-42af-96e3-08ad287fc801 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:40.812551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef5a48-2603-42af-96e3-08ad287fc801 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:40.812829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef5a48-2603-42af-96e3-08ad287fc801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:40.818367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc8696-3ad1-446d-8965-9995c93d7640 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:40.818883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc8696-3ad1-446d-8965-9995c93d7640 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:40.819357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc8696-3ad1-446d-8965-9995c93d7640 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:40.820883 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 15/27] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:16:40.826455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c438bc-27ac-4172-9b3a-6e18841a633f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:40.826996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c438bc-27ac-4172-9b3a-6e18841a633f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:40.827455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c438bc-27ac-4172-9b3a-6e18841a633f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:40.849701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-70ef5a48-2603-42af-96e3-08ad287fc801 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:40.860411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-70ef5a48-2603-42af-96e3-08ad287fc801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:40.871201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG passlib.handlers.bcrypt [None req-73c438bc-27ac-4172-9b3a-6e18841a633f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=82083) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 27 04:16:40.871934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG passlib.handlers.bcrypt [None req-73c438bc-27ac-4172-9b3a-6e18841a633f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82083) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 27 04:16:40.904516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:40.950523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-73c438bc-27ac-4172-9b3a-6e18841a633f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:40.952091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-73c438bc-27ac-4172-9b3a-6e18841a633f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:40.998783 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 13/28] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:16:41.081891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef5a48-2603-42af-96e3-08ad287fc801 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:41.105073 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 16/29] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:41.124101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c438bc-27ac-4172-9b3a-6e18841a633f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:41.182254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:41.307928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef5a48-2603-42af-96e3-08ad287fc801 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:41.329839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c438bc-27ac-4172-9b3a-6e18841a633f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:41.380935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef236e97-7b53-44ba-bd5b-0e087ba3094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:41.381927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef236e97-7b53-44ba-bd5b-0e087ba3094b None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:41.382416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef236e97-7b53-44ba-bd5b-0e087ba3094b None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:41.382895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef236e97-7b53-44ba-bd5b-0e087ba3094b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:41.401003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32abbe-fac3-475b-80b8-6eef33fc093b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:41.402144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32abbe-fac3-475b-80b8-6eef33fc093b None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:41.402582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32abbe-fac3-475b-80b8-6eef33fc093b None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:41.402984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32abbe-fac3-475b-80b8-6eef33fc093b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:41.403462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef236e97-7b53-44ba-bd5b-0e087ba3094b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:41.405341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef236e97-7b53-44ba-bd5b-0e087ba3094b None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:41.429186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32abbe-fac3-475b-80b8-6eef33fc093b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:16:41.434584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-ef236e97-7b53-44ba-bd5b-0e087ba3094b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:16:41.434584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:16:41.434584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:16:41.434584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:16:41.434584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:16:41.434584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:16:41.434584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:16:41.434584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:16:41.434584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:16:41.434584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:16:41.434584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:16:41.434584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:16:41.434584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:16:41.434584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:16:41.434584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:16:41.434584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:16:41.435501 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:16:41.435501 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:16:41.435501 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:16:41.435501 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:16:41.435501 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:16:41.435501 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:16:41.435501 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:16:41.435501 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:16:41.435501 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:16:41.435501 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:16:41.435501 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:16:41.435501 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:16:41.435501 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:16:41.435501 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:16:41.435501 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:16:41.435501 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:16:41.435501 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:16:41.436315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:16:41.436315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:16:41.436315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:16:41.442986 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-5b32abbe-fac3-475b-80b8-6eef33fc093b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:16:41.442986 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:16:41.442986 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:16:41.442986 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:16:41.442986 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:16:41.442986 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:16:41.442986 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:16:41.442986 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:16:41.442986 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:16:41.442986 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:16:41.442986 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:16:41.442986 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:16:41.442986 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:16:41.442986 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:16:41.442986 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:16:41.442986 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:16:41.443820 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:16:41.443820 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:16:41.443820 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:16:41.443820 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:16:41.443820 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:16:41.443820 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:16:41.443820 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:16:41.443820 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:16:41.443820 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:16:41.443820 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:16:41.443820 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:16:41.443820 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:16:41.443820 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:16:41.443820 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:16:41.443820 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:16:41.443820 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:16:41.444605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:16:41.444605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:16:41.444605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:16:41.444605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:16:41.444605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:16:41.444605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:16:41.444605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:16:41.444605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:16:41.444605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:16:41.444605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:16:41.444605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:16:41.444605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:16:41.447127 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 17/30] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:16:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:16:41.448203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32abbe-fac3-475b-80b8-6eef33fc093b None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:41.449487 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 14/31] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:16:41.456527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef236e97-7b53-44ba-bd5b-0e087ba3094b None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:41.472029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:41.582310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:41.599516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32abbe-fac3-475b-80b8-6eef33fc093b None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:41.599824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef236e97-7b53-44ba-bd5b-0e087ba3094b None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:41.636006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a02caf-c567-40d1-8df7-2363148b397b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:41.637100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a02caf-c567-40d1-8df7-2363148b397b None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:41.637532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a02caf-c567-40d1-8df7-2363148b397b None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:41.637936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a02caf-c567-40d1-8df7-2363148b397b None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:41.638153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a472bd-d132-46ab-9fa7-074d683a2ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:41.638862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a472bd-d132-46ab-9fa7-074d683a2ddc None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:41.639018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a02caf-c567-40d1-8df7-2363148b397b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:41.639325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a472bd-d132-46ab-9fa7-074d683a2ddc None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:41.639601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a02caf-c567-40d1-8df7-2363148b397b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:41.639787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a472bd-d132-46ab-9fa7-074d683a2ddc None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:41.640587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a472bd-d132-46ab-9fa7-074d683a2ddc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:41.641484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a02caf-c567-40d1-8df7-2363148b397b None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:41.642536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a472bd-d132-46ab-9fa7-074d683a2ddc None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:41.654093 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 15/32] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:16:41.655199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a02caf-c567-40d1-8df7-2363148b397b None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:41.729700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:41.767566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a02caf-c567-40d1-8df7-2363148b397b None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:41.805184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34670bb4-8040-4f75-a92a-cc578092dba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:41.806299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34670bb4-8040-4f75-a92a-cc578092dba1 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:41.814511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34670bb4-8040-4f75-a92a-cc578092dba1 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:41.815152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34670bb4-8040-4f75-a92a-cc578092dba1 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:41.816102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34670bb4-8040-4f75-a92a-cc578092dba1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:41.816598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34670bb4-8040-4f75-a92a-cc578092dba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:41.818263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34670bb4-8040-4f75-a92a-cc578092dba1 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:41.831518 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 16/33] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:16:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:41.832739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34670bb4-8040-4f75-a92a-cc578092dba1 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:41.833229 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 18/34] 10.222.0.76 () {60 vars in 1131 bytes} [Sat Aug 27 04:16:41 2022] POST /identity/v3/roles => generated 225 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:16:41.834350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a472bd-d132-46ab-9fa7-074d683a2ddc None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:41.966228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a472bd-d132-46ab-9fa7-074d683a2ddc None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:41.993888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34670bb4-8040-4f75-a92a-cc578092dba1 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:42.006712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07e50e-21f7-421d-9386-b217761c796c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:42.007343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07e50e-21f7-421d-9386-b217761c796c None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:42.007623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07e50e-21f7-421d-9386-b217761c796c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:42.007898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07e50e-21f7-421d-9386-b217761c796c None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:42.008879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07e50e-21f7-421d-9386-b217761c796c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:42.010599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07e50e-21f7-421d-9386-b217761c796c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:42.029858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:42.040728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303f1da-65dd-4092-a746-467cc205588f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:42.044551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303f1da-65dd-4092-a746-467cc205588f None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:42.044551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303f1da-65dd-4092-a746-467cc205588f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:42.044551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303f1da-65dd-4092-a746-467cc205588f None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:42.044551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303f1da-65dd-4092-a746-467cc205588f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:42.044793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303f1da-65dd-4092-a746-467cc205588f None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:42.135378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:42.143065 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 19/35] 10.222.0.76 () {60 vars in 1141 bytes} [Sat Aug 27 04:16:41 2022] POST /identity/v3/projects => generated 301 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:16:42.144141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07e50e-21f7-421d-9386-b217761c796c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:42.268028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07e50e-21f7-421d-9386-b217761c796c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:42.307219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00d66d-16ed-4082-94f8-49a85ce05f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:42.308215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00d66d-16ed-4082-94f8-49a85ce05f51 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:42.308713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00d66d-16ed-4082-94f8-49a85ce05f51 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:42.309150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00d66d-16ed-4082-94f8-49a85ce05f51 None admin] PATH_INFO: `/v3/users/f2cd24054e9f47928421e1d9e1889453` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:42.310704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00d66d-16ed-4082-94f8-49a85ce05f51 None admin] RBAC: Authorizing `identity:get_user(user_id=f2cd24054e9f47928421e1d9e1889453)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:42.311617 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 17/36] 10.222.0.76 () {60 vars in 1131 bytes} [Sat Aug 27 04:16:41 2022] POST /identity/v3/roles => generated 219 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:16:42.313746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5ed3f-2469-42d0-8aa8-2b1e96666880 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:42.314131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5ed3f-2469-42d0-8aa8-2b1e96666880 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:42.314504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5ed3f-2469-42d0-8aa8-2b1e96666880 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:42.315963 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 18/37] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:42.320063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00d66d-16ed-4082-94f8-49a85ce05f51 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:42.321461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eda54f-da86-409e-8db1-2d516a08170e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:42.321756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eda54f-da86-409e-8db1-2d516a08170e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:42.321919 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 20/38] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:16:42 2022] GET /identity/v3/users/f2cd24054e9f47928421e1d9e1889453 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:42.322301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eda54f-da86-409e-8db1-2d516a08170e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:42.333742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00d66d-16ed-4082-94f8-49a85ce05f51 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:42.351374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-67eda54f-da86-409e-8db1-2d516a08170e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:42.353864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-67eda54f-da86-409e-8db1-2d516a08170e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:42.436581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:42.461292 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 19/39] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:16:42.462553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18623a30-586c-4d3f-823a-aa607610c768 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:42.462853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18623a30-586c-4d3f-823a-aa607610c768 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:42.463136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18623a30-586c-4d3f-823a-aa607610c768 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:42.464496 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 20/40] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:42.470852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55971916-01c3-4293-bc5a-46638eba402d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:42.471138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55971916-01c3-4293-bc5a-46638eba402d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:42.471423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55971916-01c3-4293-bc5a-46638eba402d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:42.482211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00d66d-16ed-4082-94f8-49a85ce05f51 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:42.527539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a76072-468d-4dc4-99d4-00958ad81b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:42.528249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a76072-468d-4dc4-99d4-00958ad81b9f None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:42.528523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a76072-468d-4dc4-99d4-00958ad81b9f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:42.528794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a76072-468d-4dc4-99d4-00958ad81b9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:42.529996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a76072-468d-4dc4-99d4-00958ad81b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:42.531487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a76072-468d-4dc4-99d4-00958ad81b9f None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:42.534140 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 21/41] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:16:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:16:42.540341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a76072-468d-4dc4-99d4-00958ad81b9f None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:42.606522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-55971916-01c3-4293-bc5a-46638eba402d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:42.607835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-55971916-01c3-4293-bc5a-46638eba402d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:42.659929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a76072-468d-4dc4-99d4-00958ad81b9f None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:42.677839 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 21/42] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:42.694368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ab60a-cb00-4ed8-b02a-35fa909082c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:42.695034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ab60a-cb00-4ed8-b02a-35fa909082c3 None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:42.695311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ab60a-cb00-4ed8-b02a-35fa909082c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:42.695585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ab60a-cb00-4ed8-b02a-35fa909082c3 None admin] PATH_INFO: `/v3/domains/default/users/f2cd24054e9f47928421e1d9e1889453/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:42.697502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ab60a-cb00-4ed8-b02a-35fa909082c3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f2cd24054e9f47928421e1d9e1889453, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:42.698948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ab60a-cb00-4ed8-b02a-35fa909082c3 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:42.701295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:42.733711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55971916-01c3-4293-bc5a-46638eba402d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:42.783553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:42.787486 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 22/43] 10.222.0.76 () {58 vars in 1361 bytes} [Sat Aug 27 04:16:42 2022] PUT /identity/v3/domains/default/users/f2cd24054e9f47928421e1d9e1889453/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:16:42.841787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55971916-01c3-4293-bc5a-46638eba402d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:42.878847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9879e4-f359-4477-b976-ec4191ce364a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:42.879478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9879e4-f359-4477-b976-ec4191ce364a None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:42.879762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9879e4-f359-4477-b976-ec4191ce364a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:42.880035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9879e4-f359-4477-b976-ec4191ce364a None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:42.880747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9879e4-f359-4477-b976-ec4191ce364a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:42.882382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9879e4-f359-4477-b976-ec4191ce364a None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:42.959512 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 22/44] 10.222.0.76 () {60 vars in 1131 bytes} [Sat Aug 27 04:16:42 2022] POST /identity/v3/roles => generated 223 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:16:42.961795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ab60a-cb00-4ed8-b02a-35fa909082c3 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:43.078017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ab60a-cb00-4ed8-b02a-35fa909082c3 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:43.116911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982e98-c009-4131-ab46-8bab07da6b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:43.117552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982e98-c009-4131-ab46-8bab07da6b99 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:43.117832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982e98-c009-4131-ab46-8bab07da6b99 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:43.118107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982e98-c009-4131-ab46-8bab07da6b99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:43.119241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982e98-c009-4131-ab46-8bab07da6b99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:43.120735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982e98-c009-4131-ab46-8bab07da6b99 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:43.122309 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 23/45] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:16:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:43.128510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9879e4-f359-4477-b976-ec4191ce364a None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:43.238659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9879e4-f359-4477-b976-ec4191ce364a None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:43.248382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:43.284298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc067f-ca5d-46f9-93fb-4870ed6efa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:43.284961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc067f-ca5d-46f9-93fb-4870ed6efa1c None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:43.286927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc067f-ca5d-46f9-93fb-4870ed6efa1c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:43.286927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc067f-ca5d-46f9-93fb-4870ed6efa1c None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:43.286927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc067f-ca5d-46f9-93fb-4870ed6efa1c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:43.287682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc067f-ca5d-46f9-93fb-4870ed6efa1c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:43.400345 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 23/46] 10.222.0.76 () {60 vars in 1141 bytes} [Sat Aug 27 04:16:43 2022] POST /identity/v3/projects => generated 312 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:16:44.730386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b63df7-9013-4845-876f-04e192260e32 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:44.730903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b63df7-9013-4845-876f-04e192260e32 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:44.730987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b63df7-9013-4845-876f-04e192260e32 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:44.732300 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 24/47] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:44.738116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec6bd5-7316-4d4f-bc32-32430f3de683 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:44.738560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec6bd5-7316-4d4f-bc32-32430f3de683 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:44.738683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec6bd5-7316-4d4f-bc32-32430f3de683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:44.757592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0aec6bd5-7316-4d4f-bc32-32430f3de683 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:44.758790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0aec6bd5-7316-4d4f-bc32-32430f3de683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:44.824450 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 24/48] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:16:45.105937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b63df7-9013-4845-876f-04e192260e32 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:45.167845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:45.207461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b63df7-9013-4845-876f-04e192260e32 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:45.242047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f682e2a-0e67-477b-95a5-2cec86a832b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:45.242678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f682e2a-0e67-477b-95a5-2cec86a832b2 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:45.242960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f682e2a-0e67-477b-95a5-2cec86a832b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:45.243233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f682e2a-0e67-477b-95a5-2cec86a832b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:45.254333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f682e2a-0e67-477b-95a5-2cec86a832b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:16:45.259671 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-9f682e2a-0e67-477b-95a5-2cec86a832b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:16:45.259671 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:16:45.259671 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:16:45.259671 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:16:45.259671 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:16:45.259671 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:16:45.259671 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:16:45.259671 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:16:45.259671 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:16:45.259671 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:16:45.259671 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:16:45.259671 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:16:45.259671 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:16:45.259671 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:16:45.259671 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:16:45.259671 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:16:45.260611 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:16:45.260611 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:16:45.260611 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:16:45.260611 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:16:45.260611 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:16:45.260611 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:16:45.260611 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:16:45.260611 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:16:45.260611 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:16:45.260611 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:16:45.260611 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:16:45.260611 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:16:45.260611 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:16:45.260611 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:16:45.260611 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:16:45.260611 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:16:45.261632 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:16:45.261632 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:16:45.261632 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:16:45.261632 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:16:45.261632 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:16:45.261632 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:16:45.261632 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:16:45.261632 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:16:45.261632 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:16:45.261632 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:16:45.261632 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:16:45.261632 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:16:45.261632 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 25/49] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:16:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:16:45.267423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec6bd5-7316-4d4f-bc32-32430f3de683 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:45.328126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cb6cb-c799-407d-9e63-5562cbf5284c None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:45.328584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cb6cb-c799-407d-9e63-5562cbf5284c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:45.329003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cb6cb-c799-407d-9e63-5562cbf5284c None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:45.330373 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 26/50] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:16:45.335801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c76f4-09d7-4b29-9f52-52d551d98ba9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:45.336087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c76f4-09d7-4b29-9f52-52d551d98ba9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:45.336420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c76f4-09d7-4b29-9f52-52d551d98ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:45.355626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0e8c76f4-09d7-4b29-9f52-52d551d98ba9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:45.357240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0e8c76f4-09d7-4b29-9f52-52d551d98ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:45.363074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:45.372573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec6bd5-7316-4d4f-bc32-32430f3de683 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:45.408022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae2e2e-65b6-4460-ace4-0d16da58cfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:45.408682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae2e2e-65b6-4460-ace4-0d16da58cfcb None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:45.408973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae2e2e-65b6-4460-ace4-0d16da58cfcb None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:45.409311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae2e2e-65b6-4460-ace4-0d16da58cfcb None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:45.409989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae2e2e-65b6-4460-ace4-0d16da58cfcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:45.410322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae2e2e-65b6-4460-ace4-0d16da58cfcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:45.411727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae2e2e-65b6-4460-ace4-0d16da58cfcb None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:45.419796 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 25/51] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:16:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:45.426152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae2e2e-65b6-4460-ace4-0d16da58cfcb None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:45.429348 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 27/52] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:16:45.526999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae2e2e-65b6-4460-ace4-0d16da58cfcb None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:45.560987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511eee6-707f-4af6-904f-05d29d585f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:45.561705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511eee6-707f-4af6-904f-05d29d585f6b None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:45.561996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511eee6-707f-4af6-904f-05d29d585f6b None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:45.562275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511eee6-707f-4af6-904f-05d29d585f6b None admin] PATH_INFO: `/v3/users/f2cd24054e9f47928421e1d9e1889453` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:45.563490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511eee6-707f-4af6-904f-05d29d585f6b None admin] RBAC: Authorizing `identity:get_user(user_id=f2cd24054e9f47928421e1d9e1889453)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:45.564982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511eee6-707f-4af6-904f-05d29d585f6b None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:45.566541 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 26/53] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:16:45 2022] GET /identity/v3/users/f2cd24054e9f47928421e1d9e1889453 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:16:45.572348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c76f4-09d7-4b29-9f52-52d551d98ba9 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:45.626594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:45.673156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c76f4-09d7-4b29-9f52-52d551d98ba9 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:45.702570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511eee6-707f-4af6-904f-05d29d585f6b None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:45.706758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19c3f0-e2f7-445d-8ff4-7df0fca1f07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:45.707403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19c3f0-e2f7-445d-8ff4-7df0fca1f07a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:45.707792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19c3f0-e2f7-445d-8ff4-7df0fca1f07a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:45.708284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19c3f0-e2f7-445d-8ff4-7df0fca1f07a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:45.709389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19c3f0-e2f7-445d-8ff4-7df0fca1f07a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:45.710911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19c3f0-e2f7-445d-8ff4-7df0fca1f07a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:45.712509 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 28/54] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:16:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:45.718319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19c3f0-e2f7-445d-8ff4-7df0fca1f07a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:45.726842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:45.803896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511eee6-707f-4af6-904f-05d29d585f6b None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:45.819372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19c3f0-e2f7-445d-8ff4-7df0fca1f07a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:45.838852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6800cc2-efd1-4eec-bdc6-7cab696c2a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:45.839486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6800cc2-efd1-4eec-bdc6-7cab696c2a95 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:45.839873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:45.840217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6800cc2-efd1-4eec-bdc6-7cab696c2a95 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:45.840514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6800cc2-efd1-4eec-bdc6-7cab696c2a95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:45.841687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6800cc2-efd1-4eec-bdc6-7cab696c2a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:45.843147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6800cc2-efd1-4eec-bdc6-7cab696c2a95 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:45.845929 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 27/55] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:16:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:45.852890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6800cc2-efd1-4eec-bdc6-7cab696c2a95 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:45.854951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c0f65-9cfd-445e-adca-fa15629e2bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:45.855559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c0f65-9cfd-445e-adca-fa15629e2bc9 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:45.855840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c0f65-9cfd-445e-adca-fa15629e2bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:45.856110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c0f65-9cfd-445e-adca-fa15629e2bc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:45.856881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c0f65-9cfd-445e-adca-fa15629e2bc9 None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.domain.id=default, user.id=f2cd24054e9f47928421e1d9e1889453) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:45.857185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c0f65-9cfd-445e-adca-fa15629e2bc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:45.858616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c0f65-9cfd-445e-adca-fa15629e2bc9 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:45.868313 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 29/56] 10.222.0.76 () {56 vars in 1322 bytes} [Sat Aug 27 04:16:45 2022] GET /identity/v3/role_assignments?user.id=f2cd24054e9f47928421e1d9e1889453&scope.domain.id=default&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:16:45.952752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:45.967972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6800cc2-efd1-4eec-bdc6-7cab696c2a95 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:46.006029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783a96f-8195-44b5-a674-8217c90f9ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:46.006649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a96f-8195-44b5-a674-8217c90f9ce2 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:46.006939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a96f-8195-44b5-a674-8217c90f9ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:46.007215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a96f-8195-44b5-a674-8217c90f9ce2 None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:46.007871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783a96f-8195-44b5-a674-8217c90f9ce2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:46.009367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783a96f-8195-44b5-a674-8217c90f9ce2 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:46.096622 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 28/57] 10.222.0.76 () {60 vars in 1140 bytes} [Sat Aug 27 04:16:45 2022] POST /identity/v3/projects => generated 298 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:16:48.006896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa1167-a19d-497f-9d7a-99cf995ddff5 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:48.007350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa1167-a19d-497f-9d7a-99cf995ddff5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:48.007457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa1167-a19d-497f-9d7a-99cf995ddff5 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:48.008838 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 30/58] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:48.014299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c49c1e-5622-44a5-a28d-8900b2a19509 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:48.014697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c49c1e-5622-44a5-a28d-8900b2a19509 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:48.014860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c49c1e-5622-44a5-a28d-8900b2a19509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:48.032580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-89c49c1e-5622-44a5-a28d-8900b2a19509 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:48.033771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-89c49c1e-5622-44a5-a28d-8900b2a19509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:48.098978 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 29/59] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:48.372697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa1167-a19d-497f-9d7a-99cf995ddff5 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:48.472617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa1167-a19d-497f-9d7a-99cf995ddff5 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:48.504680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a0400-743f-4023-b737-c9c418f1f6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:48.505294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a0400-743f-4023-b737-c9c418f1f6a6 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:48.505576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a0400-743f-4023-b737-c9c418f1f6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:48.505848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a0400-743f-4023-b737-c9c418f1f6a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:48.506976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a0400-743f-4023-b737-c9c418f1f6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:48.508488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a0400-743f-4023-b737-c9c418f1f6a6 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:48.510033 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 31/60] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:16:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:48.516247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c49c1e-5622-44a5-a28d-8900b2a19509 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:48.582862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:48.612176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c49c1e-5622-44a5-a28d-8900b2a19509 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:48.645459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90498f2e-46f2-4cc1-a20a-fed6cc1787d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:48.645999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90498f2e-46f2-4cc1-a20a-fed6cc1787d5 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:48.646287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90498f2e-46f2-4cc1-a20a-fed6cc1787d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:48.646557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90498f2e-46f2-4cc1-a20a-fed6cc1787d5 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:48.647214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90498f2e-46f2-4cc1-a20a-fed6cc1787d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:48.648730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90498f2e-46f2-4cc1-a20a-fed6cc1787d5 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:48.739806 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 30/61] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:16:48 2022] POST /identity/v3/users => generated 275 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:16:51.846065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3df6a2-f548-4bc9-9c19-ce30568dc7ff None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:51.846607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3df6a2-f548-4bc9-9c19-ce30568dc7ff None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:51.846607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3df6a2-f548-4bc9-9c19-ce30568dc7ff None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:51.847968 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 32/62] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:51.853565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f796b-54ca-45f1-8363-20c47e0a480c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:51.854332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f796b-54ca-45f1-8363-20c47e0a480c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:51.854753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f796b-54ca-45f1-8363-20c47e0a480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:51.885323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c47f796b-54ca-45f1-8363-20c47e0a480c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:51.886838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404fc1b-72ec-4411-acee-e844a37d13c0 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:51.887065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c47f796b-54ca-45f1-8363-20c47e0a480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:51.887542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404fc1b-72ec-4411-acee-e844a37d13c0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:51.888014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404fc1b-72ec-4411-acee-e844a37d13c0 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:51.889731 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 33/63] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:51.896255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bb155-8259-4fab-8af6-1f49082fab0a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:51.896846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bb155-8259-4fab-8af6-1f49082fab0a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:51.897326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bb155-8259-4fab-8af6-1f49082fab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:51.930721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-682bb155-8259-4fab-8af6-1f49082fab0a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:51.933860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-682bb155-8259-4fab-8af6-1f49082fab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:52.020542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:52.027440 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 31/64] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:52.047455 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 34/65] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:52.084445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e404b78-e085-434b-9da4-d94f46908567 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:52.084733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e404b78-e085-434b-9da4-d94f46908567 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:52.085013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e404b78-e085-434b-9da4-d94f46908567 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:52.086527 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 32/66] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:52.091953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28af43-9538-424f-99d4-521cbf81c721 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:52.092275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28af43-9538-424f-99d4-521cbf81c721 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:52.092560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28af43-9538-424f-99d4-521cbf81c721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:52.120524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7a28af43-9538-424f-99d4-521cbf81c721 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:52.121655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7a28af43-9538-424f-99d4-521cbf81c721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:52.210755 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 35/67] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:52.282261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171eab15-4a47-44a9-ae83-1f2bf1064f6e None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:52.282597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171eab15-4a47-44a9-ae83-1f2bf1064f6e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:52.282813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171eab15-4a47-44a9-ae83-1f2bf1064f6e None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:52.284420 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 33/68] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:52.289696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7cddc-6fa7-4b77-a68e-f189e5119f01 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:52.289885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7cddc-6fa7-4b77-a68e-f189e5119f01 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:52.290104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7cddc-6fa7-4b77-a68e-f189e5119f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:52.314308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-57f7cddc-6fa7-4b77-a68e-f189e5119f01 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:52.315533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-57f7cddc-6fa7-4b77-a68e-f189e5119f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:52.390168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171eab15-4a47-44a9-ae83-1f2bf1064f6e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:52.403890 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 36/69] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:52.474830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:52.476987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47407d-740b-4c84-9ea2-673fe70a9538 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:52.477488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47407d-740b-4c84-9ea2-673fe70a9538 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:52.477956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47407d-740b-4c84-9ea2-673fe70a9538 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:52.479489 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 37/70] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:52.489421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c320a6c-78e6-48f8-bf9f-c711814dae20 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:52.501857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c320a6c-78e6-48f8-bf9f-c711814dae20 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:52.501857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c320a6c-78e6-48f8-bf9f-c711814dae20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:52.519586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5c320a6c-78e6-48f8-bf9f-c711814dae20 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:52.521285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5c320a6c-78e6-48f8-bf9f-c711814dae20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:52.521562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171eab15-4a47-44a9-ae83-1f2bf1064f6e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:52.560767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:52.563397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3209917-b064-4ff7-8ad4-e3902b87d8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:52.564033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3209917-b064-4ff7-8ad4-e3902b87d8d7 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:52.564475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3209917-b064-4ff7-8ad4-e3902b87d8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:52.564756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3209917-b064-4ff7-8ad4-e3902b87d8d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:52.576623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3209917-b064-4ff7-8ad4-e3902b87d8d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:16:52.584916 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-b3209917-b064-4ff7-8ad4-e3902b87d8d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:16:52.584916 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:16:52.584916 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:16:52.584916 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:16:52.584916 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:16:52.584916 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:16:52.584916 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:16:52.584916 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:16:52.584916 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:16:52.584916 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:16:52.584916 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:16:52.584916 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:16:52.584916 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:16:52.584916 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:16:52.584916 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:16:52.584916 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:16:52.585927 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:16:52.585927 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:16:52.585927 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:16:52.585927 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:16:52.585927 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:16:52.585927 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:16:52.585927 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:16:52.585927 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:16:52.585927 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:16:52.585927 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:16:52.585927 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:16:52.585927 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:16:52.585927 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:16:52.585927 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:16:52.585927 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:16:52.585927 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:16:52.586755 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:16:52.586755 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:16:52.586755 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:16:52.586755 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:16:52.586755 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:16:52.586755 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:16:52.586755 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:16:52.586755 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:16:52.586755 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:16:52.586755 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:16:52.586755 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:16:52.586755 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:16:52.586755 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 34/71] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:16:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:16:52.587382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3209917-b064-4ff7-8ad4-e3902b87d8d7 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:52.604227 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 38/72] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:52.604227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c320a6c-78e6-48f8-bf9f-c711814dae20 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:52.704922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c320a6c-78e6-48f8-bf9f-c711814dae20 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:52.716423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3209917-b064-4ff7-8ad4-e3902b87d8d7 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:52.733540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:52.741227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a23fb-2c3b-41fa-aa35-5cfd504a2414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:52.741833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a23fb-2c3b-41fa-aa35-5cfd504a2414 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:52.748689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a23fb-2c3b-41fa-aa35-5cfd504a2414 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:52.748689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a23fb-2c3b-41fa-aa35-5cfd504a2414 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:52.753432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b9092-c746-4e37-b55a-698c6da5479b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:52.754065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b9092-c746-4e37-b55a-698c6da5479b None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:52.754347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b9092-c746-4e37-b55a-698c6da5479b None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:52.754457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a23fb-2c3b-41fa-aa35-5cfd504a2414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:16:52.754629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b9092-c746-4e37-b55a-698c6da5479b None admin] PATH_INFO: `/v3/roles/member` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:52.759354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-a89a23fb-2c3b-41fa-aa35-5cfd504a2414 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:16:52.759354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:16:52.759354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:16:52.759354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:16:52.759354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:16:52.759354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:16:52.759354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:16:52.759354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:16:52.759354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:16:52.759354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:16:52.759354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:16:52.759354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:16:52.759354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:16:52.759354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:16:52.759354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:16:52.759354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:16:52.760269 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:16:52.760269 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:16:52.760269 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:16:52.760269 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:16:52.760269 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:16:52.760269 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:16:52.760269 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:16:52.760269 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:16:52.760269 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:16:52.760269 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:16:52.760269 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:16:52.760269 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:16:52.760269 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:16:52.760269 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:16:52.760269 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:16:52.760269 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:16:52.761583 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:16:52.761583 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:16:52.761583 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:16:52.761583 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:16:52.761583 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:16:52.761583 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:16:52.761583 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:16:52.761583 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:16:52.761583 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:16:52.761583 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:16:52.761583 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:16:52.761583 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:16:52.761583 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 39/73] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:16:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:16:52.761583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a23fb-2c3b-41fa-aa35-5cfd504a2414 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:52.769075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b9092-c746-4e37-b55a-698c6da5479b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:16:52.774822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-dc4b9092-c746-4e37-b55a-698c6da5479b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:16:52.774822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:16:52.774822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:16:52.774822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:16:52.774822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:16:52.774822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:16:52.774822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:16:52.774822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:16:52.774822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:16:52.774822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:16:52.774822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:16:52.774822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:16:52.774822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:16:52.774822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:16:52.774822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:16:52.774822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:16:52.775656 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:16:52.775656 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:16:52.775656 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:16:52.775656 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:16:52.775656 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:16:52.775656 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:16:52.775656 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:16:52.775656 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:16:52.775656 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:16:52.775656 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:16:52.775656 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:16:52.775656 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:16:52.775656 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:16:52.775656 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:16:52.775656 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:16:52.775656 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:16:52.776431 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:16:52.776431 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:16:52.776431 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:16:52.776431 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:16:52.776431 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:16:52.776431 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:16:52.776431 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:16:52.776431 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:16:52.776431 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:16:52.776431 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:16:52.776431 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:16:52.776431 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:16:52.776431 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 35/74] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:16:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:16:52.777517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b9092-c746-4e37-b55a-698c6da5479b None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:52.798641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:52.871358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a23fb-2c3b-41fa-aa35-5cfd504a2414 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:52.882506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b9092-c746-4e37-b55a-698c6da5479b None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:52.907249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f9d70-3d59-4fb9-baa4-9fd6ae0ff9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:52.907865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f9d70-3d59-4fb9-baa4-9fd6ae0ff9ff None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:52.908147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f9d70-3d59-4fb9-baa4-9fd6ae0ff9ff None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:52.908452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f9d70-3d59-4fb9-baa4-9fd6ae0ff9ff None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:52.909121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f9d70-3d59-4fb9-baa4-9fd6ae0ff9ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:52.909432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f9d70-3d59-4fb9-baa4-9fd6ae0ff9ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:52.910811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f9d70-3d59-4fb9-baa4-9fd6ae0ff9ff None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:52.917753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a1c8d-34d5-40ba-8a90-a04825e5a8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:52.918382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a1c8d-34d5-40ba-8a90-a04825e5a8dc None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:52.918667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a1c8d-34d5-40ba-8a90-a04825e5a8dc None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:52.922540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a1c8d-34d5-40ba-8a90-a04825e5a8dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:52.922665 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 40/75] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:16:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:52.922665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f9d70-3d59-4fb9-baa4-9fd6ae0ff9ff None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:52.923884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a1c8d-34d5-40ba-8a90-a04825e5a8dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:52.925203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a1c8d-34d5-40ba-8a90-a04825e5a8dc None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:52.926806 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 36/76] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:16:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:52.931813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a1c8d-34d5-40ba-8a90-a04825e5a8dc None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:52.980467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:53.017518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:53.024128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f9d70-3d59-4fb9-baa4-9fd6ae0ff9ff None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:53.036143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a1c8d-34d5-40ba-8a90-a04825e5a8dc None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:53.058021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f562b-4f27-478c-bf4c-b95402fa8e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:53.058629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f562b-4f27-478c-bf4c-b95402fa8e9a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:53.058910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f562b-4f27-478c-bf4c-b95402fa8e9a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:53.059193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f562b-4f27-478c-bf4c-b95402fa8e9a None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:53.059848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f562b-4f27-478c-bf4c-b95402fa8e9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:53.060151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f562b-4f27-478c-bf4c-b95402fa8e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:53.061581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f562b-4f27-478c-bf4c-b95402fa8e9a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:53.070049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13031cd-7851-4e96-8386-a442b677ff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:53.070451 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 41/77] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:16:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:53.070740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13031cd-7851-4e96-8386-a442b677ff5f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:53.071031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13031cd-7851-4e96-8386-a442b677ff5f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:53.071119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f562b-4f27-478c-bf4c-b95402fa8e9a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:53.071374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13031cd-7851-4e96-8386-a442b677ff5f None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:53.072053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13031cd-7851-4e96-8386-a442b677ff5f None admin] RBAC: Adding query filter params (name=member) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:53.072388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13031cd-7851-4e96-8386-a442b677ff5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:53.073795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13031cd-7851-4e96-8386-a442b677ff5f None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:53.082253 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 37/78] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:16:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:53.083139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13031cd-7851-4e96-8386-a442b677ff5f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:53.174577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f562b-4f27-478c-bf4c-b95402fa8e9a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:53.187670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13031cd-7851-4e96-8386-a442b677ff5f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:53.194721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:53.208894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c192d84-5e7b-4683-974b-765bf38ef5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:53.209529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c192d84-5e7b-4683-974b-765bf38ef5a4 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:53.209812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c192d84-5e7b-4683-974b-765bf38ef5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:53.210086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c192d84-5e7b-4683-974b-765bf38ef5a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:53.221164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c192d84-5e7b-4683-974b-765bf38ef5a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:16:53.222836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2216f89-0ede-45b2-a235-6426a51f3f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:53.223463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2216f89-0ede-45b2-a235-6426a51f3f32 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:53.223746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2216f89-0ede-45b2-a235-6426a51f3f32 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:53.224022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2216f89-0ede-45b2-a235-6426a51f3f32 None admin] PATH_INFO: `/v3/users/3762df846f914b0aa04761bfc47afef2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:53.226400 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-8c192d84-5e7b-4683-974b-765bf38ef5a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:16:53.226400 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:16:53.226400 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:16:53.226400 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:16:53.226400 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:16:53.226400 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:16:53.226400 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:16:53.226400 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:16:53.226400 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:16:53.226400 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:16:53.226400 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:16:53.226400 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:16:53.226400 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:16:53.226400 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:16:53.226400 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:16:53.226400 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:16:53.227257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:16:53.227257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:16:53.227257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:16:53.227257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:16:53.227257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:16:53.227257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:16:53.227257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:16:53.227257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:16:53.227257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:16:53.227257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:16:53.227257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:16:53.227257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:16:53.227257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:16:53.227257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:16:53.227257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:16:53.227257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:16:53.228025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:16:53.228025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:16:53.228025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:16:53.228025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:16:53.228025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:16:53.228025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:16:53.228025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:16:53.228025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:16:53.228025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:16:53.228025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:16:53.228025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:16:53.228025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:16:53.228025 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 42/79] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:16:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:16:53.228698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c192d84-5e7b-4683-974b-765bf38ef5a4 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:53.240238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2216f89-0ede-45b2-a235-6426a51f3f32 None admin] RBAC: Authorizing `identity:get_user(user_id=3762df846f914b0aa04761bfc47afef2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:53.241728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2216f89-0ede-45b2-a235-6426a51f3f32 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:53.243379 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 38/80] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:16:53 2022] GET /identity/v3/users/3762df846f914b0aa04761bfc47afef2 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:53.245314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2216f89-0ede-45b2-a235-6426a51f3f32 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:53.246237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:53.331115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c192d84-5e7b-4683-974b-765bf38ef5a4 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:53.349536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2216f89-0ede-45b2-a235-6426a51f3f32 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:53.373923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a069a2-6e3a-4f46-9f5b-a828152554be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:53.374537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a069a2-6e3a-4f46-9f5b-a828152554be None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:53.375488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a069a2-6e3a-4f46-9f5b-a828152554be None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:53.376060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a069a2-6e3a-4f46-9f5b-a828152554be None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:53.376400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a069a2-6e3a-4f46-9f5b-a828152554be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:53.377914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a069a2-6e3a-4f46-9f5b-a828152554be None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:53.383524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f2c88-374d-4e46-8b78-e7b201a62fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:53.384150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f2c88-374d-4e46-8b78-e7b201a62fd8 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:53.384459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f2c88-374d-4e46-8b78-e7b201a62fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:53.384731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f2c88-374d-4e46-8b78-e7b201a62fd8 None admin] PATH_INFO: `/v3/users/f2cd24054e9f47928421e1d9e1889453` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:53.385843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f2c88-374d-4e46-8b78-e7b201a62fd8 None admin] RBAC: Authorizing `identity:get_user(user_id=f2cd24054e9f47928421e1d9e1889453)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:53.387546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f2c88-374d-4e46-8b78-e7b201a62fd8 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:53.389140 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 39/81] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:16:53 2022] GET /identity/v3/users/f2cd24054e9f47928421e1d9e1889453 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:53.389893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f2c88-374d-4e46-8b78-e7b201a62fd8 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:53.423176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:53.466201 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 43/82] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:16:53 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:16:53.466201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a069a2-6e3a-4f46-9f5b-a828152554be None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:53.497276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f2c88-374d-4e46-8b78-e7b201a62fd8 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:53.540017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c76bf4-2234-407a-8f6d-1892b20c780f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:53.540865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c76bf4-2234-407a-8f6d-1892b20c780f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:53.541276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c76bf4-2234-407a-8f6d-1892b20c780f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:53.541561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c76bf4-2234-407a-8f6d-1892b20c780f None admin] PATH_INFO: `/v3/users/3762df846f914b0aa04761bfc47afef2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:53.542807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c76bf4-2234-407a-8f6d-1892b20c780f None admin] RBAC: Authorizing `identity:get_user(user_id=3762df846f914b0aa04761bfc47afef2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:53.544357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c76bf4-2234-407a-8f6d-1892b20c780f None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:53.546341 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 40/83] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:16:53 2022] GET /identity/v3/users/3762df846f914b0aa04761bfc47afef2 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:53.547871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c76bf4-2234-407a-8f6d-1892b20c780f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:53.555889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:53.589416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a069a2-6e3a-4f46-9f5b-a828152554be None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:53.631134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7317139-f0a1-4b47-bce0-c366f03afce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:53.631766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7317139-f0a1-4b47-bce0-c366f03afce6 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:53.632048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7317139-f0a1-4b47-bce0-c366f03afce6 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:53.632354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7317139-f0a1-4b47-bce0-c366f03afce6 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:53.633028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7317139-f0a1-4b47-bce0-c366f03afce6 None admin] RBAC: Adding query filter params (name=member) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:53.633337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7317139-f0a1-4b47-bce0-c366f03afce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:53.634733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7317139-f0a1-4b47-bce0-c366f03afce6 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:53.647092 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 44/84] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:16:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:53.647967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7317139-f0a1-4b47-bce0-c366f03afce6 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:53.673039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:53.676423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c76bf4-2234-407a-8f6d-1892b20c780f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:53.723071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea26db-bbce-41a6-8151-9580424ab2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:53.723967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea26db-bbce-41a6-8151-9580424ab2d2 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:53.725055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea26db-bbce-41a6-8151-9580424ab2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:53.725339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea26db-bbce-41a6-8151-9580424ab2d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:53.784088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7317139-f0a1-4b47-bce0-c366f03afce6 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:53.821788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea26db-bbce-41a6-8151-9580424ab2d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:53.823284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea26db-bbce-41a6-8151-9580424ab2d2 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:53.825221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee990d1-2922-4b0f-99e9-b3fd36eb50a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:53.825961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee990d1-2922-4b0f-99e9-b3fd36eb50a1 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:53.826338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee990d1-2922-4b0f-99e9-b3fd36eb50a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:53.826706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee990d1-2922-4b0f-99e9-b3fd36eb50a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:53.829777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:53.941388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee990d1-2922-4b0f-99e9-b3fd36eb50a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:53.946725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee990d1-2922-4b0f-99e9-b3fd36eb50a1 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:53.957776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:53.966858 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 41/85] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:53.967418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea26db-bbce-41a6-8151-9580424ab2d2 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:54.071205 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 45/86] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:54.072466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee990d1-2922-4b0f-99e9-b3fd36eb50a1 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:54.086672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea26db-bbce-41a6-8151-9580424ab2d2 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:54.110597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:54.124499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b45e01-d958-41c1-a10f-981a8f9a5143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:54.125231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b45e01-d958-41c1-a10f-981a8f9a5143 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:54.125519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b45e01-d958-41c1-a10f-981a8f9a5143 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:54.125885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b45e01-d958-41c1-a10f-981a8f9a5143 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:54.205025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:54.206217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b45e01-d958-41c1-a10f-981a8f9a5143 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:54.207757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b45e01-d958-41c1-a10f-981a8f9a5143 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:54.291835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee990d1-2922-4b0f-99e9-b3fd36eb50a1 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:54.329071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981bb00-33bb-4b82-8c21-4da9c0966879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:54.330123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981bb00-33bb-4b82-8c21-4da9c0966879 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:54.330602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981bb00-33bb-4b82-8c21-4da9c0966879 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:54.331069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981bb00-33bb-4b82-8c21-4da9c0966879 None admin] PATH_INFO: `/v3/users/3762df846f914b0aa04761bfc47afef2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:54.332408 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 42/87] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:54.332772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981bb00-33bb-4b82-8c21-4da9c0966879 None admin] RBAC: Authorizing `identity:get_user(user_id=3762df846f914b0aa04761bfc47afef2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:54.333334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b45e01-d958-41c1-a10f-981a8f9a5143 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:54.334719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981bb00-33bb-4b82-8c21-4da9c0966879 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:54.336937 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 46/88] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:16:54 2022] GET /identity/v3/users/3762df846f914b0aa04761bfc47afef2 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:54.337993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981bb00-33bb-4b82-8c21-4da9c0966879 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:54.441141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:54.443224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981bb00-33bb-4b82-8c21-4da9c0966879 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:54.444627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b45e01-d958-41c1-a10f-981a8f9a5143 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:54.445214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:54.481141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885ef08-e05d-4293-b3c4-22a1b756ece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:54.481346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d9bb6-40b5-4999-a7e1-ea0e748f0bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:54.482325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885ef08-e05d-4293-b3c4-22a1b756ece7 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:54.482798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885ef08-e05d-4293-b3c4-22a1b756ece7 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:54.483072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d9bb6-40b5-4999-a7e1-ea0e748f0bd7 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:54.483384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d9bb6-40b5-4999-a7e1-ea0e748f0bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:54.483557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885ef08-e05d-4293-b3c4-22a1b756ece7 None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:54.483659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d9bb6-40b5-4999-a7e1-ea0e748f0bd7 None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:54.485121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d9bb6-40b5-4999-a7e1-ea0e748f0bd7 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:54.485645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885ef08-e05d-4293-b3c4-22a1b756ece7 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:54.486575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d9bb6-40b5-4999-a7e1-ea0e748f0bd7 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:54.487406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885ef08-e05d-4293-b3c4-22a1b756ece7 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:54.489463 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 47/90] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:16:54 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:54.490420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885ef08-e05d-4293-b3c4-22a1b756ece7 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:54.492616 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 43/90] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:16:54 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:54.493533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d9bb6-40b5-4999-a7e1-ea0e748f0bd7 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:54.598567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885ef08-e05d-4293-b3c4-22a1b756ece7 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:54.610807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d9bb6-40b5-4999-a7e1-ea0e748f0bd7 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:54.645786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1d460-94ae-4993-a319-5e0daae2b8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:54.646790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1d460-94ae-4993-a319-5e0daae2b8ee None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:54.647273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1d460-94ae-4993-a319-5e0daae2b8ee None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:54.647746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1d460-94ae-4993-a319-5e0daae2b8ee None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:54.649180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1d460-94ae-4993-a319-5e0daae2b8ee None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:54.650941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1d460-94ae-4993-a319-5e0daae2b8ee None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:54.653002 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 48/91] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:16:54 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:54.654046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1d460-94ae-4993-a319-5e0daae2b8ee None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:54.659916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdb86f-2338-4a78-bd76-efb68f1141d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:54.660567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdb86f-2338-4a78-bd76-efb68f1141d2 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:54.660855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdb86f-2338-4a78-bd76-efb68f1141d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:54.661134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdb86f-2338-4a78-bd76-efb68f1141d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:54.699296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:54.701175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:54.738856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdb86f-2338-4a78-bd76-efb68f1141d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:54.740803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdb86f-2338-4a78-bd76-efb68f1141d2 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:54.767948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1d460-94ae-4993-a319-5e0daae2b8ee None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:54.804941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab4aa1-655f-41a8-9856-d12392fcaa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:54.805720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab4aa1-655f-41a8-9856-d12392fcaa96 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:54.806107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab4aa1-655f-41a8-9856-d12392fcaa96 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:54.806558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab4aa1-655f-41a8-9856-d12392fcaa96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:54.807322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab4aa1-655f-41a8-9856-d12392fcaa96 None admin] RBAC: Adding query filter params (role.id=d78f86d36ded425d9148c0b5781ab7b2, scope.project.id=b8a63babe747425e956f165dd09383c5, user.id=3762df846f914b0aa04761bfc47afef2) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:54.807810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab4aa1-655f-41a8-9856-d12392fcaa96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:54.809465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab4aa1-655f-41a8-9856-d12392fcaa96 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:54.824319 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 49/92] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:16:54 2022] GET /identity/v3/role_assignments?user.id=3762df846f914b0aa04761bfc47afef2&scope.project.id=b8a63babe747425e956f165dd09383c5&role.id=d78f86d36ded425d9148c0b5781ab7b2 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:54.825543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab4aa1-655f-41a8-9856-d12392fcaa96 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:54.858457 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 44/93] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:16:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:54.860513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdb86f-2338-4a78-bd76-efb68f1141d2 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:54.994071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:55.041865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab4aa1-655f-41a8-9856-d12392fcaa96 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:55.043466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:55.062387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdb86f-2338-4a78-bd76-efb68f1141d2 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:55.113730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ca5f3-1eec-496c-b4b8-92de62ea63e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:55.114258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ca5f3-1eec-496c-b4b8-92de62ea63e0 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:55.114537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ca5f3-1eec-496c-b4b8-92de62ea63e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:55.114814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ca5f3-1eec-496c-b4b8-92de62ea63e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:55.115548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ca5f3-1eec-496c-b4b8-92de62ea63e0 None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=b8a63babe747425e956f165dd09383c5, user.id=f2cd24054e9f47928421e1d9e1889453) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:55.115861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ca5f3-1eec-496c-b4b8-92de62ea63e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:55.117334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ca5f3-1eec-496c-b4b8-92de62ea63e0 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:55.125390 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 50/94] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:16:54 2022] GET /identity/v3/role_assignments?user.id=f2cd24054e9f47928421e1d9e1889453&scope.project.id=b8a63babe747425e956f165dd09383c5&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:55.127371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ca5f3-1eec-496c-b4b8-92de62ea63e0 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:55.128385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a44494-2b0e-4981-a6c5-8b37ee563c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:55.129015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a44494-2b0e-4981-a6c5-8b37ee563c89 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:55.129300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a44494-2b0e-4981-a6c5-8b37ee563c89 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:55.129574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a44494-2b0e-4981-a6c5-8b37ee563c89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:55.130334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a44494-2b0e-4981-a6c5-8b37ee563c89 None admin] RBAC: Adding query filter params (role.id=5a4c2cf9b8d849398625913504b4b172, scope.project.id=b8a63babe747425e956f165dd09383c5, user.id=3762df846f914b0aa04761bfc47afef2) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:55.130644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a44494-2b0e-4981-a6c5-8b37ee563c89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:55.132193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a44494-2b0e-4981-a6c5-8b37ee563c89 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:55.150076 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 45/95] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:16:54 2022] GET /identity/v3/role_assignments?user.id=3762df846f914b0aa04761bfc47afef2&scope.project.id=b8a63babe747425e956f165dd09383c5&role.id=5a4c2cf9b8d849398625913504b4b172 => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:55.294139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ca5f3-1eec-496c-b4b8-92de62ea63e0 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:55.344388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424eba5a-c7bd-4956-99a1-624bf81e89e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:55.344981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424eba5a-c7bd-4956-99a1-624bf81e89e8 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:55.345229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424eba5a-c7bd-4956-99a1-624bf81e89e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:55.345389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424eba5a-c7bd-4956-99a1-624bf81e89e8 None admin] PATH_INFO: `/v3/projects/bc6f829c69694312be80573b85e42df8` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:55.348983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424eba5a-c7bd-4956-99a1-624bf81e89e8 None admin] RBAC: Authorizing `identity:get_project(project_id=bc6f829c69694312be80573b85e42df8)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:55.350456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424eba5a-c7bd-4956-99a1-624bf81e89e8 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:55.352177 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 51/96] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:16:55 2022] GET /identity/v3/projects/bc6f829c69694312be80573b85e42df8 => generated 312 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:55.358170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a44494-2b0e-4981-a6c5-8b37ee563c89 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:55.532952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a44494-2b0e-4981-a6c5-8b37ee563c89 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:55.594477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:55.604440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe043545-c775-4291-980a-d397a7e4c5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:55.605363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe043545-c775-4291-980a-d397a7e4c5fa None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:55.605848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe043545-c775-4291-980a-d397a7e4c5fa None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:55.606402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe043545-c775-4291-980a-d397a7e4c5fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:55.613414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe043545-c775-4291-980a-d397a7e4c5fa None admin] RBAC: Adding query filter params (role.id=5a4c2cf9b8d849398625913504b4b172, scope.project.id=bc6f829c69694312be80573b85e42df8, user.id=3762df846f914b0aa04761bfc47afef2) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:55.613414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe043545-c775-4291-980a-d397a7e4c5fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:55.613414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe043545-c775-4291-980a-d397a7e4c5fa None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:55.618135 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 46/97] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:16:55 2022] GET /identity/v3/role_assignments?user.id=3762df846f914b0aa04761bfc47afef2&scope.project.id=bc6f829c69694312be80573b85e42df8&role.id=5a4c2cf9b8d849398625913504b4b172 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:56.080626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d88985-c6fa-43de-91eb-24d08ca74112 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:56.081129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d88985-c6fa-43de-91eb-24d08ca74112 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:56.081202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d88985-c6fa-43de-91eb-24d08ca74112 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:56.082867 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 52/98] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:56.088908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511cfd5-dc8c-4401-8e5e-3ce02bd4826d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:56.089386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511cfd5-dc8c-4401-8e5e-3ce02bd4826d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:56.089753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511cfd5-dc8c-4401-8e5e-3ce02bd4826d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:56.117155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3511cfd5-dc8c-4401-8e5e-3ce02bd4826d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:56.118364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3511cfd5-dc8c-4401-8e5e-3ce02bd4826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:56.130624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564ae27-4b16-479a-a28b-16a916bbdce8 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:56.130915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564ae27-4b16-479a-a28b-16a916bbdce8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:56.131187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564ae27-4b16-479a-a28b-16a916bbdce8 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:56.132560 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 53/99] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:16:56.138288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f1916-b5ae-4f0a-ac44-11d3832dfbfe None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:56.138575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f1916-b5ae-4f0a-ac44-11d3832dfbfe None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:56.138854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f1916-b5ae-4f0a-ac44-11d3832dfbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:56.170416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d27f1916-b5ae-4f0a-ac44-11d3832dfbfe None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:56.170416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d27f1916-b5ae-4f0a-ac44-11d3832dfbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:56.238382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:56.290725 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 47/101] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:56.290966 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 54/101] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:16:56.678081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511cfd5-dc8c-4401-8e5e-3ce02bd4826d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:56.801079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511cfd5-dc8c-4401-8e5e-3ce02bd4826d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:56.841846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:56.851502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c1a0a-cd05-431a-bee5-6f50f6bacb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:56.852143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c1a0a-cd05-431a-bee5-6f50f6bacb52 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:56.852448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c1a0a-cd05-431a-bee5-6f50f6bacb52 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:56.852724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c1a0a-cd05-431a-bee5-6f50f6bacb52 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:56.859404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f1916-b5ae-4f0a-ac44-11d3832dfbfe None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:56.882074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c1a0a-cd05-431a-bee5-6f50f6bacb52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:16:56.887247 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-4e0c1a0a-cd05-431a-bee5-6f50f6bacb52 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:16:56.887247 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:16:56.887247 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:16:56.887247 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:16:56.887247 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:16:56.887247 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:16:56.887247 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:16:56.887247 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:16:56.887247 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:16:56.887247 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:16:56.887247 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:16:56.887247 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:16:56.887247 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:16:56.887247 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:16:56.887247 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:16:56.887247 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:16:56.888081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:16:56.888081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:16:56.888081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:16:56.888081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:16:56.888081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:16:56.888081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:16:56.888081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:16:56.888081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:16:56.888081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:16:56.888081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:16:56.888081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:16:56.888081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:16:56.888081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:16:56.888081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:16:56.888081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:16:56.888081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:16:56.888885 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:16:56.888885 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:16:56.888885 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:16:56.888885 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:16:56.888885 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:16:56.888885 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:16:56.888885 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:16:56.888885 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:16:56.888885 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:16:56.888885 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:16:56.888885 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:16:56.888885 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:16:56.890149 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 48/102] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:16:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:16:56.901279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c1a0a-cd05-431a-bee5-6f50f6bacb52 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:57.052098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f1916-b5ae-4f0a-ac44-11d3832dfbfe None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:57.097583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c1a0a-cd05-431a-bee5-6f50f6bacb52 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:57.118293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7043c-28b1-49dd-8e4d-1a3e2f356de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:57.119045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7043c-28b1-49dd-8e4d-1a3e2f356de4 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:57.119400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7043c-28b1-49dd-8e4d-1a3e2f356de4 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:57.119745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7043c-28b1-49dd-8e4d-1a3e2f356de4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:57.126032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7043c-28b1-49dd-8e4d-1a3e2f356de4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:57.127500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7043c-28b1-49dd-8e4d-1a3e2f356de4 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:57.129501 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 55/103] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:16:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:16:57.135570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7043c-28b1-49dd-8e4d-1a3e2f356de4 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:57.144086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40f715-79d6-4255-8f5e-0823c790ae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:57.145037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40f715-79d6-4255-8f5e-0823c790ae3a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:57.146400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40f715-79d6-4255-8f5e-0823c790ae3a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:57.146879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40f715-79d6-4255-8f5e-0823c790ae3a None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:57.147750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40f715-79d6-4255-8f5e-0823c790ae3a None admin] RBAC: Adding query filter params (name=reader) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:57.148299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40f715-79d6-4255-8f5e-0823c790ae3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:57.149905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40f715-79d6-4255-8f5e-0823c790ae3a None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:57.165487 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 49/104] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:16:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:57.171139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40f715-79d6-4255-8f5e-0823c790ae3a None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:57.199707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:57.255649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:57.351943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7043c-28b1-49dd-8e4d-1a3e2f356de4 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:57.358280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40f715-79d6-4255-8f5e-0823c790ae3a None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:57.431612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361903dd-4199-4294-95bf-5c37a7f6f48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:57.432334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361903dd-4199-4294-95bf-5c37a7f6f48a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:57.432722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361903dd-4199-4294-95bf-5c37a7f6f48a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:57.433058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361903dd-4199-4294-95bf-5c37a7f6f48a None admin] PATH_INFO: `/v3/users/a213cfd3715c43339289b4120f601c03` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:57.433226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e85cf7-09de-4e89-9dd9-16b98afd11ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:57.434030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e85cf7-09de-4e89-9dd9-16b98afd11ed None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:57.434325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e85cf7-09de-4e89-9dd9-16b98afd11ed None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:57.434595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e85cf7-09de-4e89-9dd9-16b98afd11ed None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:57.435273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e85cf7-09de-4e89-9dd9-16b98afd11ed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:57.436763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e85cf7-09de-4e89-9dd9-16b98afd11ed None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:57.476880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361903dd-4199-4294-95bf-5c37a7f6f48a None admin] RBAC: Authorizing `identity:get_user(user_id=a213cfd3715c43339289b4120f601c03)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:57.478406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361903dd-4199-4294-95bf-5c37a7f6f48a None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:57.480667 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 50/105] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:16:57 2022] GET /identity/v3/users/a213cfd3715c43339289b4120f601c03 => generated 289 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:16:57.481853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cf11e-4e57-41b4-9c69-d774d4e5fed3 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:57.482139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cf11e-4e57-41b4-9c69-d774d4e5fed3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:57.482413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cf11e-4e57-41b4-9c69-d774d4e5fed3 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:57.483832 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 51/106] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:57.486958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5cf11e-4e57-41b4-9c69-d774d4e5fed3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:57.570939 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 56/107] 10.222.0.76 () {60 vars in 1141 bytes} [Sat Aug 27 04:16:57 2022] POST /identity/v3/projects => generated 302 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:16:57.572028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973bcc7-d463-48c0-b9f2-e1a45f6ee2aa None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:57.572351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973bcc7-d463-48c0-b9f2-e1a45f6ee2aa None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:57.572685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973bcc7-d463-48c0-b9f2-e1a45f6ee2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:57.617853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c973bcc7-d463-48c0-b9f2-e1a45f6ee2aa None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:57.619079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c973bcc7-d463-48c0-b9f2-e1a45f6ee2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:57.658451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5cf11e-4e57-41b4-9c69-d774d4e5fed3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:57.671528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:57.712443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fa4c1-531a-43bf-876a-5e95d1a4c813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:57.713179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fa4c1-531a-43bf-876a-5e95d1a4c813 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:57.713470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fa4c1-531a-43bf-876a-5e95d1a4c813 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:57.713749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fa4c1-531a-43bf-876a-5e95d1a4c813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:57.745152 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 57/108] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:57.793011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fa4c1-531a-43bf-876a-5e95d1a4c813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:57.794520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fa4c1-531a-43bf-876a-5e95d1a4c813 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:57.912753 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 52/109] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:16:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:57.918301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973bcc7-d463-48c0-b9f2-e1a45f6ee2aa None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:57.935501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:58.037618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973bcc7-d463-48c0-b9f2-e1a45f6ee2aa None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:58.075368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02682a8d-f2be-43b6-9df6-c99de47601ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:58.076009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02682a8d-f2be-43b6-9df6-c99de47601ac None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:58.076323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02682a8d-f2be-43b6-9df6-c99de47601ac None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:58.076613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02682a8d-f2be-43b6-9df6-c99de47601ac None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:58.078395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02682a8d-f2be-43b6-9df6-c99de47601ac None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:58.080434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02682a8d-f2be-43b6-9df6-c99de47601ac None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:58.082082 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 58/110] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:16:57 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:58.088132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fa4c1-531a-43bf-876a-5e95d1a4c813 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:58.100560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:58.196473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fa4c1-531a-43bf-876a-5e95d1a4c813 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:58.234907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076e2db-8dfd-45cd-8190-598ce9e494c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:58.235542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076e2db-8dfd-45cd-8190-598ce9e494c4 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:58.235831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076e2db-8dfd-45cd-8190-598ce9e494c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:58.236112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076e2db-8dfd-45cd-8190-598ce9e494c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:58.236882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076e2db-8dfd-45cd-8190-598ce9e494c4 None admin] RBAC: Adding query filter params (role.id=fb32d9ff656c423591f4b6227e950f99, scope.project.id=b8a63babe747425e956f165dd09383c5, user.id=a213cfd3715c43339289b4120f601c03) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:58.237197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076e2db-8dfd-45cd-8190-598ce9e494c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:58.238660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076e2db-8dfd-45cd-8190-598ce9e494c4 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:58.244845 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 53/111] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:16:58 2022] GET /identity/v3/role_assignments?user.id=a213cfd3715c43339289b4120f601c03&scope.project.id=b8a63babe747425e956f165dd09383c5&role.id=fb32d9ff656c423591f4b6227e950f99 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:58.246464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62b53-6cf2-4b7e-8276-450b130514c2 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:58.246884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62b53-6cf2-4b7e-8276-450b130514c2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:58.247058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62b53-6cf2-4b7e-8276-450b130514c2 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:58.248381 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 59/112] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:58.254940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea948777-b95b-49b2-8f03-9bc9db843e93 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:58.255559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea948777-b95b-49b2-8f03-9bc9db843e93 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:58.255845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea948777-b95b-49b2-8f03-9bc9db843e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:58.280846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e62b53-6cf2-4b7e-8276-450b130514c2 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:58.282875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ea948777-b95b-49b2-8f03-9bc9db843e93 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:58.284108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ea948777-b95b-49b2-8f03-9bc9db843e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:58.388597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:58.392985 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 54/113] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:58.405237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77577b55-4cab-4b83-85b1-95e35511c3de None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:58.405598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77577b55-4cab-4b83-85b1-95e35511c3de None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:58.413055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77577b55-4cab-4b83-85b1-95e35511c3de None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:58.413055 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 55/114] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:58 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:58.414300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808d596-d710-4e54-b4ce-e9b6e1d9e7f6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:58.414591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808d596-d710-4e54-b4ce-e9b6e1d9e7f6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:58.414864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808d596-d710-4e54-b4ce-e9b6e1d9e7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:58.415796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:58.450634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7808d596-d710-4e54-b4ce-e9b6e1d9e7f6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:58.450634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7808d596-d710-4e54-b4ce-e9b6e1d9e7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:58.473277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e62b53-6cf2-4b7e-8276-450b130514c2 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:58.517546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1aec1f-9b55-460c-8009-102e40d50cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:58.518437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1aec1f-9b55-460c-8009-102e40d50cf5 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:58.518745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1aec1f-9b55-460c-8009-102e40d50cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:58.519010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1aec1f-9b55-460c-8009-102e40d50cf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:58.532466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1aec1f-9b55-460c-8009-102e40d50cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:16:58.538455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-aa1aec1f-9b55-460c-8009-102e40d50cf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:16:58.538455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:16:58.538455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:16:58.538455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:16:58.538455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:16:58.538455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:16:58.538455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:16:58.538455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:16:58.538455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:16:58.538455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:16:58.538455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:16:58.538455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:16:58.538455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:16:58.538455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:16:58.538455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:16:58.538455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:16:58.539585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:16:58.539585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:16:58.539585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:16:58.539585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:16:58.539585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:16:58.539585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:16:58.539585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:16:58.539585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:16:58.539585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:16:58.539585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:16:58.539585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:16:58.539585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:16:58.539585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:16:58.539585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:16:58.539585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:16:58.539585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:16:58.540578 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:16:58.540578 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:16:58.540578 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:16:58.540578 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:16:58.540578 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:16:58.540578 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:16:58.540578 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:16:58.540578 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:16:58.540578 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:16:58.540578 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:16:58.540578 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:16:58.540578 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:16:58.542684 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 60/115] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:16:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:16:58.544420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a25a2b-eecb-494f-aae6-d7266451185d None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:58.544754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a25a2b-eecb-494f-aae6-d7266451185d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:58.545028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a25a2b-eecb-494f-aae6-d7266451185d None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:58.546609 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 61/116] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:16:58.549418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a25a2b-eecb-494f-aae6-d7266451185d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:58.621907 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 56/117] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:16:58.622936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f375d4-aa70-459b-bb29-d6135609564d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:58.623224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f375d4-aa70-459b-bb29-d6135609564d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:58.623555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f375d4-aa70-459b-bb29-d6135609564d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:58.665166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a8f375d4-aa70-459b-bb29-d6135609564d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:16:58.666761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a8f375d4-aa70-459b-bb29-d6135609564d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:16:58.678216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a25a2b-eecb-494f-aae6-d7266451185d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:58.721201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b500bd-6f2f-4e52-8f9d-2b18988a244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:58.722148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b500bd-6f2f-4e52-8f9d-2b18988a244e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:58.722439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b500bd-6f2f-4e52-8f9d-2b18988a244e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:58.722719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b500bd-6f2f-4e52-8f9d-2b18988a244e None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:58.725586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b500bd-6f2f-4e52-8f9d-2b18988a244e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:58.725586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b500bd-6f2f-4e52-8f9d-2b18988a244e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:58.725586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b500bd-6f2f-4e52-8f9d-2b18988a244e None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:58.741112 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 62/118] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:16:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:16:58.742714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b500bd-6f2f-4e52-8f9d-2b18988a244e None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:58.746959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:58.805950 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 57/119] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:58.806783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f375d4-aa70-459b-bb29-d6135609564d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:58.886717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b500bd-6f2f-4e52-8f9d-2b18988a244e None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:58.929583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8089aaa-98fd-41c1-9af1-357e9c85c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:58.930725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8089aaa-98fd-41c1-9af1-357e9c85c67a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:58.931230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8089aaa-98fd-41c1-9af1-357e9c85c67a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:58.931706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8089aaa-98fd-41c1-9af1-357e9c85c67a None admin] PATH_INFO: `/v3/users/f2cd24054e9f47928421e1d9e1889453` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:58.932079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:58.933741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8089aaa-98fd-41c1-9af1-357e9c85c67a None admin] RBAC: Authorizing `identity:get_user(user_id=f2cd24054e9f47928421e1d9e1889453)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:58.935514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8089aaa-98fd-41c1-9af1-357e9c85c67a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:58.938952 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 63/120] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:16:58 2022] GET /identity/v3/users/f2cd24054e9f47928421e1d9e1889453 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:16:58.945573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8089aaa-98fd-41c1-9af1-357e9c85c67a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:59.034056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f375d4-aa70-459b-bb29-d6135609564d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:59.071187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:59.102250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf4ba1-546d-4e7a-b3a2-fb92739cc7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:59.102892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf4ba1-546d-4e7a-b3a2-fb92739cc7c8 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:59.103184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf4ba1-546d-4e7a-b3a2-fb92739cc7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:59.103370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8089aaa-98fd-41c1-9af1-357e9c85c67a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:59.103463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf4ba1-546d-4e7a-b3a2-fb92739cc7c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:59.132507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf4ba1-546d-4e7a-b3a2-fb92739cc7c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:16:59.140788 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-badf4ba1-546d-4e7a-b3a2-fb92739cc7c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:16:59.140788 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:16:59.140788 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:16:59.140788 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:16:59.140788 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:16:59.140788 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:16:59.140788 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:16:59.140788 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:16:59.140788 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:16:59.140788 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:16:59.140788 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:16:59.140788 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:16:59.140788 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:16:59.140788 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:16:59.140788 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:16:59.140788 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:16:59.141646 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:16:59.141646 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:16:59.141646 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:16:59.141646 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:16:59.141646 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:16:59.141646 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:16:59.141646 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:16:59.141646 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:16:59.141646 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:16:59.141646 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:16:59.141646 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:16:59.141646 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:16:59.141646 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:16:59.141646 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:16:59.141646 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:16:59.141646 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:16:59.142394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:16:59.142394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:16:59.142394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:16:59.142394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:16:59.142394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:16:59.142394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:16:59.142394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:16:59.142394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:16:59.142394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:16:59.142394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:16:59.142394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:16:59.142394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:16:59.148957 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 58/121] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:16:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:16:59.156964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf4ba1-546d-4e7a-b3a2-fb92739cc7c8 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:59.166723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d239d3-b7a1-4909-af43-bc6bf3b88efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:59.167674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d239d3-b7a1-4909-af43-bc6bf3b88efd None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:59.168207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d239d3-b7a1-4909-af43-bc6bf3b88efd None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:59.168715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d239d3-b7a1-4909-af43-bc6bf3b88efd None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:59.169995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d239d3-b7a1-4909-af43-bc6bf3b88efd None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:59.171555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d239d3-b7a1-4909-af43-bc6bf3b88efd None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:59.173592 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 64/122] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:16:58 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:16:59.174306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d239d3-b7a1-4909-af43-bc6bf3b88efd None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:59.280195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d239d3-b7a1-4909-af43-bc6bf3b88efd None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:59.281533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf4ba1-546d-4e7a-b3a2-fb92739cc7c8 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:59.316314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16cce9-8e90-4cdd-b1d3-82fdb5d0df1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:59.316973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16cce9-8e90-4cdd-b1d3-82fdb5d0df1a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:59.317394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16cce9-8e90-4cdd-b1d3-82fdb5d0df1a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:59.317539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:59.317680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16cce9-8e90-4cdd-b1d3-82fdb5d0df1a None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:59.318577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16cce9-8e90-4cdd-b1d3-82fdb5d0df1a None admin] RBAC: Adding query filter params (name=member) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:59.318982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16cce9-8e90-4cdd-b1d3-82fdb5d0df1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:59.320607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16cce9-8e90-4cdd-b1d3-82fdb5d0df1a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:59.321360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bf095-e249-4c7e-a92f-057f5e70cae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:59.322304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bf095-e249-4c7e-a92f-057f5e70cae9 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:59.322766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bf095-e249-4c7e-a92f-057f5e70cae9 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:59.323266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bf095-e249-4c7e-a92f-057f5e70cae9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:59.329955 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 65/123] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:16:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:59.331028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16cce9-8e90-4cdd-b1d3-82fdb5d0df1a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:59.337357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:59.337545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bf095-e249-4c7e-a92f-057f5e70cae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:16:59.342154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-6a4bf095-e249-4c7e-a92f-057f5e70cae9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:16:59.342154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:16:59.342154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:16:59.342154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:16:59.342154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:16:59.342154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:16:59.342154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:16:59.342154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:16:59.342154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:16:59.342154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:16:59.342154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:16:59.342154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:16:59.342154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:16:59.342154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:16:59.342154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:16:59.342154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:16:59.342981 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:16:59.342981 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:16:59.342981 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:16:59.342981 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:16:59.342981 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:16:59.342981 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:16:59.342981 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:16:59.342981 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:16:59.342981 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:16:59.342981 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:16:59.342981 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:16:59.342981 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:16:59.342981 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:16:59.342981 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:16:59.342981 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:16:59.342981 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:16:59.345001 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:16:59.345001 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:16:59.345001 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:16:59.345001 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:16:59.345001 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:16:59.345001 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:16:59.345001 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:16:59.345001 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:16:59.345001 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:16:59.345001 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:16:59.345001 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:16:59.345001 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:16:59.347344 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 59/124] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:16:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:16:59.348408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bf095-e249-4c7e-a92f-057f5e70cae9 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:59.437432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16cce9-8e90-4cdd-b1d3-82fdb5d0df1a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:59.464244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bf095-e249-4c7e-a92f-057f5e70cae9 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:59.472104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adf313-2bd8-4cf8-9c55-5cc9b4cddac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:59.472812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adf313-2bd8-4cf8-9c55-5cc9b4cddac1 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:59.473094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adf313-2bd8-4cf8-9c55-5cc9b4cddac1 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:59.473372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adf313-2bd8-4cf8-9c55-5cc9b4cddac1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:59.488594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adf313-2bd8-4cf8-9c55-5cc9b4cddac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:16:59.494427 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-b2adf313-2bd8-4cf8-9c55-5cc9b4cddac1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:16:59.494427 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:16:59.494427 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:16:59.494427 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:16:59.494427 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:16:59.494427 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:16:59.494427 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:16:59.494427 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:16:59.494427 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:16:59.494427 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:16:59.494427 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:16:59.494427 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:16:59.494427 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:16:59.494427 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:16:59.494427 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:16:59.494427 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:16:59.495284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:16:59.495284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:16:59.495284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:16:59.495284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:16:59.495284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:16:59.495284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:16:59.495284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:16:59.495284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:16:59.495284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:16:59.495284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:16:59.495284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:16:59.495284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:16:59.495284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:16:59.495284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:16:59.495284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:16:59.495284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:16:59.496155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:16:59.496155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:16:59.496155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:16:59.496155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:16:59.496155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:16:59.496155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:16:59.496155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:16:59.496155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:16:59.496155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:16:59.496155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:16:59.496155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:16:59.496155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:16:59.498390 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 66/125] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:16:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:16:59.499459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adf313-2bd8-4cf8-9c55-5cc9b4cddac1 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:59.514773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81c98a-4868-440b-b15e-b025beb0b8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:59.516563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81c98a-4868-440b-b15e-b025beb0b8bf None admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:59.516563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81c98a-4868-440b-b15e-b025beb0b8bf None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:59.516869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81c98a-4868-440b-b15e-b025beb0b8bf None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5/users/f2cd24054e9f47928421e1d9e1889453/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:59.520093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81c98a-4868-440b-b15e-b025beb0b8bf None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a63babe747425e956f165dd09383c5, user_id=f2cd24054e9f47928421e1d9e1889453, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:59.526144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81c98a-4868-440b-b15e-b025beb0b8bf None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:59.571837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:59.598567 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 60/126] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:16:59 2022] PUT /identity/v3/projects/b8a63babe747425e956f165dd09383c5/users/f2cd24054e9f47928421e1d9e1889453/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:16:59.599693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81c98a-4868-440b-b15e-b025beb0b8bf None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:59.631311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adf313-2bd8-4cf8-9c55-5cc9b4cddac1 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:59.676559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:59.701313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f417348-d72d-4f02-9ecd-7754599e97da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:59.701952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f417348-d72d-4f02-9ecd-7754599e97da None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:59.702233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f417348-d72d-4f02-9ecd-7754599e97da None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:59.703036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f417348-d72d-4f02-9ecd-7754599e97da None admin] PATH_INFO: `/v3/users/3762df846f914b0aa04761bfc47afef2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:59.705295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f417348-d72d-4f02-9ecd-7754599e97da None admin] RBAC: Authorizing `identity:get_user(user_id=3762df846f914b0aa04761bfc47afef2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:59.706784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f417348-d72d-4f02-9ecd-7754599e97da None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:59.708695 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 67/127] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:16:59 2022] GET /identity/v3/users/3762df846f914b0aa04761bfc47afef2 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:59.709635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f417348-d72d-4f02-9ecd-7754599e97da None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:59.737276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81c98a-4868-440b-b15e-b025beb0b8bf None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:59.779503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1a51c-94ed-4dbb-aec2-4b5e53f0f708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:59.781257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1a51c-94ed-4dbb-aec2-4b5e53f0f708 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:59.781750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1a51c-94ed-4dbb-aec2-4b5e53f0f708 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:59.782424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1a51c-94ed-4dbb-aec2-4b5e53f0f708 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:59.783498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1a51c-94ed-4dbb-aec2-4b5e53f0f708 None admin] RBAC: Adding query filter params (name=member) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:59.784007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1a51c-94ed-4dbb-aec2-4b5e53f0f708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:59.786135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1a51c-94ed-4dbb-aec2-4b5e53f0f708 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:59.796399 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 61/128] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:16:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:59.797817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1a51c-94ed-4dbb-aec2-4b5e53f0f708 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:59.876809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f417348-d72d-4f02-9ecd-7754599e97da None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:59.908640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:59.915005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3a594-4855-4ea2-96e2-1e1ffca88929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:59.915621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3a594-4855-4ea2-96e2-1e1ffca88929 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:59.915919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3a594-4855-4ea2-96e2-1e1ffca88929 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:59.916210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3a594-4855-4ea2-96e2-1e1ffca88929 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:59.916877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3a594-4855-4ea2-96e2-1e1ffca88929 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:16:59.917184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3a594-4855-4ea2-96e2-1e1ffca88929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:59.918618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3a594-4855-4ea2-96e2-1e1ffca88929 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:59.919259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1a51c-94ed-4dbb-aec2-4b5e53f0f708 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:16:59.929695 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 68/129] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:16:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:59.930629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3a594-4855-4ea2-96e2-1e1ffca88929 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:16:59.936546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:16:59.978175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223dfe7-82d4-4bdf-bbee-28eff9da2400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:16:59.978825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223dfe7-82d4-4bdf-bbee-28eff9da2400 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:16:59.979113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223dfe7-82d4-4bdf-bbee-28eff9da2400 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:16:59.979493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223dfe7-82d4-4bdf-bbee-28eff9da2400 None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:16:59.985074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223dfe7-82d4-4bdf-bbee-28eff9da2400 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:16:59.986662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223dfe7-82d4-4bdf-bbee-28eff9da2400 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:16:59.988561 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 62/130] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:16:59 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:16:59.989341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223dfe7-82d4-4bdf-bbee-28eff9da2400 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:00.044098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3a594-4855-4ea2-96e2-1e1ffca88929 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:00.086489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95815523-16c9-43c5-8566-24d95a797d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:00.086489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95815523-16c9-43c5-8566-24d95a797d4d None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:00.086489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95815523-16c9-43c5-8566-24d95a797d4d None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:00.086489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95815523-16c9-43c5-8566-24d95a797d4d None admin] PATH_INFO: `/v3/users/3762df846f914b0aa04761bfc47afef2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:00.089953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95815523-16c9-43c5-8566-24d95a797d4d None admin] RBAC: Authorizing `identity:get_user(user_id=3762df846f914b0aa04761bfc47afef2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:00.091418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95815523-16c9-43c5-8566-24d95a797d4d None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:00.093048 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 69/131] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:16:59 2022] GET /identity/v3/users/3762df846f914b0aa04761bfc47afef2 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:00.095420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95815523-16c9-43c5-8566-24d95a797d4d None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:00.164630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:00.203184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223dfe7-82d4-4bdf-bbee-28eff9da2400 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:00.216211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95815523-16c9-43c5-8566-24d95a797d4d None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:00.271939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8f2f6-9344-4b51-8ad2-235b9b1b7cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:00.272637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8f2f6-9344-4b51-8ad2-235b9b1b7cc6 None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:00.272922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8f2f6-9344-4b51-8ad2-235b9b1b7cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:00.273200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8f2f6-9344-4b51-8ad2-235b9b1b7cc6 None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5/users/3762df846f914b0aa04761bfc47afef2/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:00.276349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8f2f6-9344-4b51-8ad2-235b9b1b7cc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a63babe747425e956f165dd09383c5, user_id=3762df846f914b0aa04761bfc47afef2, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:00.277831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8f2f6-9344-4b51-8ad2-235b9b1b7cc6 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:00.287987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781ef59-9d23-4618-b7ee-add7289846d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:00.288760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781ef59-9d23-4618-b7ee-add7289846d4 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:00.289049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781ef59-9d23-4618-b7ee-add7289846d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:00.289331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781ef59-9d23-4618-b7ee-add7289846d4 None admin] PATH_INFO: `/v3/users/3762df846f914b0aa04761bfc47afef2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:00.290562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781ef59-9d23-4618-b7ee-add7289846d4 None admin] RBAC: Authorizing `identity:get_user(user_id=3762df846f914b0aa04761bfc47afef2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:00.292205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781ef59-9d23-4618-b7ee-add7289846d4 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:00.293872 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 63/132] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:16:59 2022] GET /identity/v3/users/3762df846f914b0aa04761bfc47afef2 => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:00.294723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781ef59-9d23-4618-b7ee-add7289846d4 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:00.343718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:00.408438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781ef59-9d23-4618-b7ee-add7289846d4 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:00.418784 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 70/133] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:17:00 2022] PUT /identity/v3/projects/b8a63babe747425e956f165dd09383c5/users/3762df846f914b0aa04761bfc47afef2/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:17:00.419702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8f2f6-9344-4b51-8ad2-235b9b1b7cc6 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:00.467849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857a708-9cb9-4940-bbf0-e6af36a87729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:00.468604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857a708-9cb9-4940-bbf0-e6af36a87729 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:00.468897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857a708-9cb9-4940-bbf0-e6af36a87729 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:00.469180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857a708-9cb9-4940-bbf0-e6af36a87729 None admin] PATH_INFO: `/v3/projects/bc6f829c69694312be80573b85e42df8` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:00.473018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857a708-9cb9-4940-bbf0-e6af36a87729 None admin] RBAC: Authorizing `identity:get_project(project_id=bc6f829c69694312be80573b85e42df8)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:00.474517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857a708-9cb9-4940-bbf0-e6af36a87729 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:00.476595 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 64/134] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:00 2022] GET /identity/v3/projects/bc6f829c69694312be80573b85e42df8 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:00.480845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cce44-30ad-4482-b567-8001145d34e2 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:00.481135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cce44-30ad-4482-b567-8001145d34e2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:00.481416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cce44-30ad-4482-b567-8001145d34e2 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:00.482778 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 65/135] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:17:00.486427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cce44-30ad-4482-b567-8001145d34e2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:00.624563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8f2f6-9344-4b51-8ad2-235b9b1b7cc6 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:00.652337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:00.677894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086e3a1-5592-4fec-af8d-1cb0409aadec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:00.678459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086e3a1-5592-4fec-af8d-1cb0409aadec None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:00.678739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086e3a1-5592-4fec-af8d-1cb0409aadec None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:00.679013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086e3a1-5592-4fec-af8d-1cb0409aadec None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:00.680150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086e3a1-5592-4fec-af8d-1cb0409aadec None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:00.681908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086e3a1-5592-4fec-af8d-1cb0409aadec None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:00.688368 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 71/136] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:00 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:00.689766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689faff5-dfe3-4402-a652-fb7bdc9e2008 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:00.690056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689faff5-dfe3-4402-a652-fb7bdc9e2008 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:00.690332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689faff5-dfe3-4402-a652-fb7bdc9e2008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:00.690428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cce44-30ad-4482-b567-8001145d34e2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:00.699293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:00.709418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-689faff5-dfe3-4402-a652-fb7bdc9e2008 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:00.711272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-689faff5-dfe3-4402-a652-fb7bdc9e2008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:00.737797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03def8f4-f0db-4991-a23c-2a08c420cf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:00.739051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03def8f4-f0db-4991-a23c-2a08c420cf1e None admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:00.739551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03def8f4-f0db-4991-a23c-2a08c420cf1e None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:00.740042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03def8f4-f0db-4991-a23c-2a08c420cf1e None admin] PATH_INFO: `/v3/projects/bc6f829c69694312be80573b85e42df8/users/3762df846f914b0aa04761bfc47afef2/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:00.745364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03def8f4-f0db-4991-a23c-2a08c420cf1e None admin] RBAC: Authorizing `identity:create_grant(project_id=bc6f829c69694312be80573b85e42df8, user_id=3762df846f914b0aa04761bfc47afef2, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:00.747292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03def8f4-f0db-4991-a23c-2a08c420cf1e None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:00.795283 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 72/137] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:00.796068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689faff5-dfe3-4402-a652-fb7bdc9e2008 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:00.818400 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 66/138] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:17:00 2022] PUT /identity/v3/projects/bc6f829c69694312be80573b85e42df8/users/3762df846f914b0aa04761bfc47afef2/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:17:00.944282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689faff5-dfe3-4402-a652-fb7bdc9e2008 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:00.961728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:00.965723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a25d2b-c282-4cad-b3ce-fa5318b6c72f None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:00.966008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a25d2b-c282-4cad-b3ce-fa5318b6c72f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:00.966276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a25d2b-c282-4cad-b3ce-fa5318b6c72f None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:00.967782 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 67/139] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:00.986129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091bc6f-d4e8-4b85-89a7-a56a5866ece8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:00.986460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091bc6f-d4e8-4b85-89a7-a56a5866ece8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:00.986709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091bc6f-d4e8-4b85-89a7-a56a5866ece8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:00.993194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b14e12-03dd-4970-8fd4-1ac957cc261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:00.993991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b14e12-03dd-4970-8fd4-1ac957cc261b None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:00.994281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b14e12-03dd-4970-8fd4-1ac957cc261b None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:00.994638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b14e12-03dd-4970-8fd4-1ac957cc261b None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5/users/3762df846f914b0aa04761bfc47afef2/roles/d78f86d36ded425d9148c0b5781ab7b2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:00.997053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b14e12-03dd-4970-8fd4-1ac957cc261b None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a63babe747425e956f165dd09383c5, user_id=3762df846f914b0aa04761bfc47afef2, role_id=d78f86d36ded425d9148c0b5781ab7b2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:00.998674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b14e12-03dd-4970-8fd4-1ac957cc261b None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:01.024429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3091bc6f-d4e8-4b85-89a7-a56a5866ece8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:01.025692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3091bc6f-d4e8-4b85-89a7-a56a5866ece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:01.086813 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 73/140] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:17:00 2022] PUT /identity/v3/projects/b8a63babe747425e956f165dd09383c5/users/3762df846f914b0aa04761bfc47afef2/roles/d78f86d36ded425d9148c0b5781ab7b2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:17:01.113878 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 68/141] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:01.261416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b14e12-03dd-4970-8fd4-1ac957cc261b None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:01.372091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b14e12-03dd-4970-8fd4-1ac957cc261b None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:01.408139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356fac8-5d41-4984-8953-45bdcd6da12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:01.408800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356fac8-5d41-4984-8953-45bdcd6da12c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:01.409074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356fac8-5d41-4984-8953-45bdcd6da12c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:01.409340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356fac8-5d41-4984-8953-45bdcd6da12c None admin] PATH_INFO: `/v3/domains/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:01.410519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356fac8-5d41-4984-8953-45bdcd6da12c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:01.412015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356fac8-5d41-4984-8953-45bdcd6da12c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:01.413909 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 74/142] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:01.419357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091bc6f-d4e8-4b85-89a7-a56a5866ece8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:01.545235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:01.552021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091bc6f-d4e8-4b85-89a7-a56a5866ece8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:01.590183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356fac8-5d41-4984-8953-45bdcd6da12c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:01.605956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4762e0-73b8-4402-984c-b937e7115cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:01.606581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4762e0-73b8-4402-984c-b937e7115cf0 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:01.606878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4762e0-73b8-4402-984c-b937e7115cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:01.607124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4762e0-73b8-4402-984c-b937e7115cf0 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:01.607796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4762e0-73b8-4402-984c-b937e7115cf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:01.610185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4762e0-73b8-4402-984c-b937e7115cf0 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:01.720538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:01.722635 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 69/143] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:17:01 2022] POST /identity/v3/users => generated 283 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:17:01.825306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356fac8-5d41-4984-8953-45bdcd6da12c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:01.877919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffb9d6-7223-434d-9a32-4ceabe6f0290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:01.878566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffb9d6-7223-434d-9a32-4ceabe6f0290 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:01.878847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffb9d6-7223-434d-9a32-4ceabe6f0290 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:01.879174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffb9d6-7223-434d-9a32-4ceabe6f0290 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:01.897179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffb9d6-7223-434d-9a32-4ceabe6f0290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:01.902266 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-75ffb9d6-7223-434d-9a32-4ceabe6f0290 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:17:01.902266 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:01.902266 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:01.902266 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:01.902266 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:01.902266 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:01.902266 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:01.902266 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:01.902266 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:01.902266 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:01.902266 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:01.902266 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:01.902266 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:01.902266 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:01.902266 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:01.902266 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:01.903120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:01.903120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:01.903120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:01.903120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:01.903120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:01.903120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:01.903120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:01.903120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:01.903120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:01.903120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:01.903120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:01.903120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:01.903120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:01.903120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:01.903120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:01.903120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:01.903873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:01.903873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:01.903873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:01.903873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:01.903873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:01.903873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:01.903873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:01.903873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:01.903873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:01.903873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:01.903873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:17:01.903873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:01.903873 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 75/144] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:17:01.910847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4762e0-73b8-4402-984c-b937e7115cf0 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:02.105535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4762e0-73b8-4402-984c-b937e7115cf0 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:02.146061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5137f-b5df-4246-b8a4-e7f2d32b6d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:02.146738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5137f-b5df-4246-b8a4-e7f2d32b6d9c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:02.147088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5137f-b5df-4246-b8a4-e7f2d32b6d9c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:02.147419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5137f-b5df-4246-b8a4-e7f2d32b6d9c None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:02.148418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5137f-b5df-4246-b8a4-e7f2d32b6d9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:02.148731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5137f-b5df-4246-b8a4-e7f2d32b6d9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:02.150128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5137f-b5df-4246-b8a4-e7f2d32b6d9c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:02.159478 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 70/145] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:02.165072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffb9d6-7223-434d-9a32-4ceabe6f0290 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:02.323779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffb9d6-7223-434d-9a32-4ceabe6f0290 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:02.332005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:02.361345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc3663-8dce-4c22-8d8a-d5c270735c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:02.361903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc3663-8dce-4c22-8d8a-d5c270735c4c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:02.362178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc3663-8dce-4c22-8d8a-d5c270735c4c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:02.362448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc3663-8dce-4c22-8d8a-d5c270735c4c None admin] PATH_INFO: `/v3/users/a213cfd3715c43339289b4120f601c03` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:02.368860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc3663-8dce-4c22-8d8a-d5c270735c4c None admin] RBAC: Authorizing `identity:get_user(user_id=a213cfd3715c43339289b4120f601c03)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:02.370332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc3663-8dce-4c22-8d8a-d5c270735c4c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:02.372268 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 76/146] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:02 2022] GET /identity/v3/users/a213cfd3715c43339289b4120f601c03 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:02.378700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5137f-b5df-4246-b8a4-e7f2d32b6d9c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:02.407251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:02.513893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5137f-b5df-4246-b8a4-e7f2d32b6d9c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:02.550169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17134acf-bda0-4c79-adb9-0335a45a145c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:02.550811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134acf-bda0-4c79-adb9-0335a45a145c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:02.551092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134acf-bda0-4c79-adb9-0335a45a145c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:02.551370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134acf-bda0-4c79-adb9-0335a45a145c None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:02.552539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17134acf-bda0-4c79-adb9-0335a45a145c None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:02.554004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17134acf-bda0-4c79-adb9-0335a45a145c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:02.555816 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 71/147] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:02 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:02.561631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc3663-8dce-4c22-8d8a-d5c270735c4c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:02.677467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc3663-8dce-4c22-8d8a-d5c270735c4c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:02.698659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f299ce-c6de-4ed2-b8d7-71bd7843f541 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:02.698948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f299ce-c6de-4ed2-b8d7-71bd7843f541 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:02.699212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f299ce-c6de-4ed2-b8d7-71bd7843f541 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:02.700653 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 72/148] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:17:02.709905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f20e2-facb-422f-89e8-46d8d7f21ae2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:02.710184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f20e2-facb-422f-89e8-46d8d7f21ae2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:02.710463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f20e2-facb-422f-89e8-46d8d7f21ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:02.735131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-523f20e2-facb-422f-89e8-46d8d7f21ae2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:02.736355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-523f20e2-facb-422f-89e8-46d8d7f21ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:02.741309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b1440-ad3e-48d0-a439-9a4e5d2c49d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:02.741980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b1440-ad3e-48d0-a439-9a4e5d2c49d4 None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:02.742259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b1440-ad3e-48d0-a439-9a4e5d2c49d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:02.742530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b1440-ad3e-48d0-a439-9a4e5d2c49d4 None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5/users/a213cfd3715c43339289b4120f601c03/roles/fb32d9ff656c423591f4b6227e950f99` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:02.747118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b1440-ad3e-48d0-a439-9a4e5d2c49d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a63babe747425e956f165dd09383c5, user_id=a213cfd3715c43339289b4120f601c03, role_id=fb32d9ff656c423591f4b6227e950f99)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:02.748687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b1440-ad3e-48d0-a439-9a4e5d2c49d4 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:02.824611 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 73/149] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:02.861382 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 77/150] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:17:02 2022] PUT /identity/v3/projects/b8a63babe747425e956f165dd09383c5/users/a213cfd3715c43339289b4120f601c03/roles/fb32d9ff656c423591f4b6227e950f99 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:17:03.012812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa90d68-304e-41b8-809c-8af0faaef9e5 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:03.013129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa90d68-304e-41b8-809c-8af0faaef9e5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:03.013401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa90d68-304e-41b8-809c-8af0faaef9e5 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:03.015348 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 74/151] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:03.025669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae615da-5d5c-47e1-a787-fd09119c2341 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:03.025995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae615da-5d5c-47e1-a787-fd09119c2341 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:03.026213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae615da-5d5c-47e1-a787-fd09119c2341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:03.053382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bae615da-5d5c-47e1-a787-fd09119c2341 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:03.054612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bae615da-5d5c-47e1-a787-fd09119c2341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:03.086664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:03.142467 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 78/152] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:03.203964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa90d68-304e-41b8-809c-8af0faaef9e5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:03.221391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:03.341932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa90d68-304e-41b8-809c-8af0faaef9e5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:03.380629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0efaa9-9d7e-4fa5-ab18-aabccb0d307a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:03.381282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0efaa9-9d7e-4fa5-ab18-aabccb0d307a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:03.381560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0efaa9-9d7e-4fa5-ab18-aabccb0d307a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:03.381833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0efaa9-9d7e-4fa5-ab18-aabccb0d307a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:03.401244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0efaa9-9d7e-4fa5-ab18-aabccb0d307a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:03.407051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-4e0efaa9-9d7e-4fa5-ab18-aabccb0d307a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:17:03.407051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:03.407051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:03.407051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:03.407051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:03.407051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:03.407051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:03.407051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:03.407051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:03.407051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:03.407051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:03.407051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:03.407051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:03.407051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:03.407051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:03.407051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:03.407896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:03.407896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:03.407896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:03.407896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:03.407896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:03.407896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:03.407896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:03.407896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:03.407896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:03.407896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:03.407896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:03.407896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:03.407896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:03.407896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:03.407896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:03.407896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:03.408716 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:03.408716 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:03.408716 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:03.408716 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:03.408716 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:03.408716 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:03.408716 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:03.408716 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:03.408716 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:03.408716 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:03.408716 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:17:03.408716 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:03.408716 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 75/153] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:17:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:03.415282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae615da-5d5c-47e1-a787-fd09119c2341 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:03.529218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe7b49-ed07-475d-8178-afb22f4cf6be None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:03.529677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe7b49-ed07-475d-8178-afb22f4cf6be None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:03.529677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe7b49-ed07-475d-8178-afb22f4cf6be None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:03.531946 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 76/154] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:17:03.537645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733f045-4912-4163-8dc4-4937c1ed6ad9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:03.537904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733f045-4912-4163-8dc4-4937c1ed6ad9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:03.538179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733f045-4912-4163-8dc4-4937c1ed6ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:03.570915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d733f045-4912-4163-8dc4-4937c1ed6ad9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:03.572120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d733f045-4912-4163-8dc4-4937c1ed6ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:03.583263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae615da-5d5c-47e1-a787-fd09119c2341 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:03.643517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd7367-2b1c-4eee-a6c8-8621e564cf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:03.644133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd7367-2b1c-4eee-a6c8-8621e564cf39 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:03.644460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd7367-2b1c-4eee-a6c8-8621e564cf39 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:03.644691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd7367-2b1c-4eee-a6c8-8621e564cf39 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:03.645346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd7367-2b1c-4eee-a6c8-8621e564cf39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:03.645643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd7367-2b1c-4eee-a6c8-8621e564cf39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:03.647016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd7367-2b1c-4eee-a6c8-8621e564cf39 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:03.663666 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 79/155] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:03.664627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd7367-2b1c-4eee-a6c8-8621e564cf39 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:03.696973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:03.718857 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 77/156] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:03.720089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733f045-4912-4163-8dc4-4937c1ed6ad9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:03.723040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:03.797680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd7367-2b1c-4eee-a6c8-8621e564cf39 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:03.862317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b285118-764b-4d2c-89da-e32c328cdf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:03.862997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b285118-764b-4d2c-89da-e32c328cdf38 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:03.863275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b285118-764b-4d2c-89da-e32c328cdf38 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:03.863552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b285118-764b-4d2c-89da-e32c328cdf38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:03.882939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733f045-4912-4163-8dc4-4937c1ed6ad9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:03.887150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b285118-764b-4d2c-89da-e32c328cdf38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:03.894214 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-8b285118-764b-4d2c-89da-e32c328cdf38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:03.894214 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:03.894214 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:03.894214 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:03.894214 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:03.894214 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:03.894214 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:03.894214 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:03.894214 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:03.894214 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:03.894214 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:03.894214 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:03.894214 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:03.894214 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:03.894214 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:03.894214 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:03.895098 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:03.895098 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:03.895098 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:03.895098 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:03.895098 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:03.895098 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:03.895098 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:03.895098 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:03.895098 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:03.895098 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:03.895098 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:03.895098 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:03.895098 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:03.895098 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:03.895098 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:03.895098 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:03.895875 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:03.895875 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:03.895875 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:03.895875 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:03.895875 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:03.895875 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:03.895875 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:03.895875 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:03.895875 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:03.895875 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:03.895875 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:03.895875 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:03.895875 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 80/157] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:03.901043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b285118-764b-4d2c-89da-e32c328cdf38 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:03.948332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748243af-d535-4632-8231-3656ecb3f334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:03.949342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748243af-d535-4632-8231-3656ecb3f334 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:03.949853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748243af-d535-4632-8231-3656ecb3f334 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:03.950316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748243af-d535-4632-8231-3656ecb3f334 None admin] PATH_INFO: `/v3/users/f2cd24054e9f47928421e1d9e1889453` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:03.951697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748243af-d535-4632-8231-3656ecb3f334 None admin] RBAC: Authorizing `identity:get_user(user_id=f2cd24054e9f47928421e1d9e1889453)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:03.955191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748243af-d535-4632-8231-3656ecb3f334 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:03.960317 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 78/158] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:03 2022] GET /identity/v3/users/f2cd24054e9f47928421e1d9e1889453 => generated 247 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:03.965167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748243af-d535-4632-8231-3656ecb3f334 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:04.079173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:04.104050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:04.105572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b285118-764b-4d2c-89da-e32c328cdf38 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:04.158641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748243af-d535-4632-8231-3656ecb3f334 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:04.193420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb765059-8ec7-449b-9dab-25a73ef9a4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:04.194038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb765059-8ec7-449b-9dab-25a73ef9a4d8 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:04.194309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb765059-8ec7-449b-9dab-25a73ef9a4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:04.194620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb765059-8ec7-449b-9dab-25a73ef9a4d8 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:04.195285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb765059-8ec7-449b-9dab-25a73ef9a4d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:04.195579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb765059-8ec7-449b-9dab-25a73ef9a4d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:04.196969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb765059-8ec7-449b-9dab-25a73ef9a4d8 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:04.211421 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 81/159] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:04.222495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb765059-8ec7-449b-9dab-25a73ef9a4d8 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:04.228851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0996fe-b97d-4f58-9aa7-dd48cadd5e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:04.229722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0996fe-b97d-4f58-9aa7-dd48cadd5e6d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:04.230203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0996fe-b97d-4f58-9aa7-dd48cadd5e6d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:04.230679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0996fe-b97d-4f58-9aa7-dd48cadd5e6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:04.354785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0996fe-b97d-4f58-9aa7-dd48cadd5e6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:04.356686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0996fe-b97d-4f58-9aa7-dd48cadd5e6d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:04.417805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb765059-8ec7-449b-9dab-25a73ef9a4d8 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:04.487427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:04.489019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68a369-b9e9-4398-b6ea-632c539a0819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:04.489676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a369-b9e9-4398-b6ea-632c539a0819 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:04.489952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a369-b9e9-4398-b6ea-632c539a0819 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:04.490221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a369-b9e9-4398-b6ea-632c539a0819 None admin] PATH_INFO: `/v3/users/3762df846f914b0aa04761bfc47afef2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:04.491404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68a369-b9e9-4398-b6ea-632c539a0819 None admin] RBAC: Authorizing `identity:get_user(user_id=3762df846f914b0aa04761bfc47afef2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:04.492879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68a369-b9e9-4398-b6ea-632c539a0819 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:04.494832 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 82/160] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:04 2022] GET /identity/v3/users/3762df846f914b0aa04761bfc47afef2 => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:04.495607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68a369-b9e9-4398-b6ea-632c539a0819 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:04.530271 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 79/161] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:04.532243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:04.534418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0996fe-b97d-4f58-9aa7-dd48cadd5e6d None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:04.644997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0996fe-b97d-4f58-9aa7-dd48cadd5e6d None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:04.679960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68a369-b9e9-4398-b6ea-632c539a0819 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:04.702096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4200a8-9aaf-43f8-b7fb-4984a469efec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:04.703340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4200a8-9aaf-43f8-b7fb-4984a469efec None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:04.703828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4200a8-9aaf-43f8-b7fb-4984a469efec None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:04.704353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4200a8-9aaf-43f8-b7fb-4984a469efec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:04.749582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1b83b-c3d8-4c64-bd55-075350a860da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:04.750321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1b83b-c3d8-4c64-bd55-075350a860da None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:04.750462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1b83b-c3d8-4c64-bd55-075350a860da None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:04.750734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1b83b-c3d8-4c64-bd55-075350a860da None admin] PATH_INFO: `/v3/roles/member` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:04.767359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:04.780271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1b83b-c3d8-4c64-bd55-075350a860da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:04.804374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-f6b1b83b-c3d8-4c64-bd55-075350a860da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:04.804374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:04.804374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:04.804374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:04.804374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:04.804374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:04.804374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:04.804374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:04.804374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:04.804374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:04.804374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:04.804374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:04.804374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:04.804374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:04.804374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:04.804374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:04.805244 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:04.805244 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:04.805244 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:04.805244 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:04.805244 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:04.805244 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:04.805244 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:04.805244 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:04.805244 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:04.805244 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:04.805244 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:04.805244 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:04.805244 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:04.805244 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:04.805244 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:04.805244 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:04.806099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:04.806099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:04.806099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:04.806099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:04.806099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:04.806099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:04.806099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:04.806099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:04.806099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:04.806099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:04.806099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:04.806099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:04.806099 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 83/162] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:04.806099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1b83b-c3d8-4c64-bd55-075350a860da None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:04.813380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4200a8-9aaf-43f8-b7fb-4984a469efec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:04.815159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4200a8-9aaf-43f8-b7fb-4984a469efec None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:04.940826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:04.952201 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 80/163] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:04.953956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4200a8-9aaf-43f8-b7fb-4984a469efec None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:04.998626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1b83b-c3d8-4c64-bd55-075350a860da None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:05.043711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:05.078350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f8317-d22d-4f4b-8ba8-1eed64e9feaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:05.078987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f8317-d22d-4f4b-8ba8-1eed64e9feaa None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:05.079260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f8317-d22d-4f4b-8ba8-1eed64e9feaa None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:05.079528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f8317-d22d-4f4b-8ba8-1eed64e9feaa None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:05.080208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4200a8-9aaf-43f8-b7fb-4984a469efec None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:05.081999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f8317-d22d-4f4b-8ba8-1eed64e9feaa None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:05.083523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f8317-d22d-4f4b-8ba8-1eed64e9feaa None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:05.085487 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 84/164] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:04 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:05.086325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f8317-d22d-4f4b-8ba8-1eed64e9feaa None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:05.119833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fd7b4-f0ea-4d30-ba97-744dc9ce18fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:05.120833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fd7b4-f0ea-4d30-ba97-744dc9ce18fe None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:05.121317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fd7b4-f0ea-4d30-ba97-744dc9ce18fe None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:05.121809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fd7b4-f0ea-4d30-ba97-744dc9ce18fe None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:05.122668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fd7b4-f0ea-4d30-ba97-744dc9ce18fe None admin] RBAC: Adding query filter params (name=member) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:05.123166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fd7b4-f0ea-4d30-ba97-744dc9ce18fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:05.125161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fd7b4-f0ea-4d30-ba97-744dc9ce18fe None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:05.134332 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 81/165] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:05.135643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fd7b4-f0ea-4d30-ba97-744dc9ce18fe None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:05.255442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fd7b4-f0ea-4d30-ba97-744dc9ce18fe None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:05.256965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f8317-d22d-4f4b-8ba8-1eed64e9feaa None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:05.300560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:05.311357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a067e-21db-46c2-bf6f-7a417350b01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:05.312944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a067e-21db-46c2-bf6f-7a417350b01c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:05.313521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a067e-21db-46c2-bf6f-7a417350b01c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:05.313962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a067e-21db-46c2-bf6f-7a417350b01c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:05.314865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a067e-21db-46c2-bf6f-7a417350b01c None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=b8a63babe747425e956f165dd09383c5, user.id=f2cd24054e9f47928421e1d9e1889453) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:05.315336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a067e-21db-46c2-bf6f-7a417350b01c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:05.320725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a067e-21db-46c2-bf6f-7a417350b01c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:05.323718 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 82/166] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:05 2022] GET /identity/v3/role_assignments?user.id=f2cd24054e9f47928421e1d9e1889453&scope.project.id=b8a63babe747425e956f165dd09383c5&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:05.324745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a067e-21db-46c2-bf6f-7a417350b01c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:05.352892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71e64d-2362-4ee3-b70a-a05c5284b2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:05.353544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71e64d-2362-4ee3-b70a-a05c5284b2d2 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:05.353820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71e64d-2362-4ee3-b70a-a05c5284b2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:05.354091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71e64d-2362-4ee3-b70a-a05c5284b2d2 None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:05.355246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71e64d-2362-4ee3-b70a-a05c5284b2d2 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:05.356727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71e64d-2362-4ee3-b70a-a05c5284b2d2 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:05.358375 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 85/167] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:05 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:05.367170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34609ed6-4505-4b39-9795-93027d6de921 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:05.367170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34609ed6-4505-4b39-9795-93027d6de921 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:05.367170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34609ed6-4505-4b39-9795-93027d6de921 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:05.367170 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 86/168] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:17:05.367170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34609ed6-4505-4b39-9795-93027d6de921 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:05.411152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:05.507337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a067e-21db-46c2-bf6f-7a417350b01c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:05.570169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdde225-90e6-418c-8389-d76832429daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:05.571593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdde225-90e6-418c-8389-d76832429daa None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:05.572087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdde225-90e6-418c-8389-d76832429daa None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:05.572598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdde225-90e6-418c-8389-d76832429daa None admin] PATH_INFO: `/v3/users/3762df846f914b0aa04761bfc47afef2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:05.573947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdde225-90e6-418c-8389-d76832429daa None admin] RBAC: Authorizing `identity:get_user(user_id=3762df846f914b0aa04761bfc47afef2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:05.575721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdde225-90e6-418c-8389-d76832429daa None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:05.578593 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 83/169] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:05 2022] GET /identity/v3/users/3762df846f914b0aa04761bfc47afef2 => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:05.580002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2be9c-318d-4235-915c-d53419acd16c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:05.580648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2be9c-318d-4235-915c-d53419acd16c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:05.581110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2be9c-318d-4235-915c-d53419acd16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:05.600359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-76d2be9c-318d-4235-915c-d53419acd16c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:05.602004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-76d2be9c-318d-4235-915c-d53419acd16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:05.642427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34609ed6-4505-4b39-9795-93027d6de921 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:05.689087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:05.701924 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 84/170] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:05.703602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2be9c-318d-4235-915c-d53419acd16c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:05.718083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7efe07-92ac-48ff-b487-6966b183ae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:05.719100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7efe07-92ac-48ff-b487-6966b183ae34 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:05.719558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7efe07-92ac-48ff-b487-6966b183ae34 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:05.720083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7efe07-92ac-48ff-b487-6966b183ae34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:05.721042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7efe07-92ac-48ff-b487-6966b183ae34 None admin] RBAC: Adding query filter params (role.id=5a4c2cf9b8d849398625913504b4b172, scope.project.id=b8a63babe747425e956f165dd09383c5, user.id=3762df846f914b0aa04761bfc47afef2) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:05.721522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7efe07-92ac-48ff-b487-6966b183ae34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:05.723130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7efe07-92ac-48ff-b487-6966b183ae34 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:05.738605 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 87/171] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:05 2022] GET /identity/v3/role_assignments?user.id=3762df846f914b0aa04761bfc47afef2&scope.project.id=b8a63babe747425e956f165dd09383c5&role.id=5a4c2cf9b8d849398625913504b4b172 => generated 608 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:05.867117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2be9c-318d-4235-915c-d53419acd16c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:05.915470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a50144-672c-4dca-a4b5-5c56366ea8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:05.916090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a50144-672c-4dca-a4b5-5c56366ea8e7 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:05.916397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a50144-672c-4dca-a4b5-5c56366ea8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:05.916671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a50144-672c-4dca-a4b5-5c56366ea8e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:05.993320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:06.001259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a50144-672c-4dca-a4b5-5c56366ea8e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:06.002778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a50144-672c-4dca-a4b5-5c56366ea8e7 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:06.091603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7efe07-92ac-48ff-b487-6966b183ae34 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:06.152704 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 85/172] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:06.158882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a50144-672c-4dca-a4b5-5c56366ea8e7 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:06.189423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:06.215702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7efe07-92ac-48ff-b487-6966b183ae34 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:06.252656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c49f2-5019-4704-ba3a-eddc01ac070a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:06.253693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c49f2-5019-4704-ba3a-eddc01ac070a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:06.254169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c49f2-5019-4704-ba3a-eddc01ac070a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:06.254637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c49f2-5019-4704-ba3a-eddc01ac070a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:06.269070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c49f2-5019-4704-ba3a-eddc01ac070a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:06.274405 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-637c49f2-5019-4704-ba3a-eddc01ac070a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:06.274405 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:06.274405 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:06.274405 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:06.274405 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:06.274405 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:06.274405 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:06.274405 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:06.274405 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:06.274405 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:06.274405 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:06.274405 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:06.274405 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:06.274405 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:06.274405 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:06.274405 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:06.275264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:06.275264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:06.275264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:06.275264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:06.275264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:06.275264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:06.275264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:06.275264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:06.275264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:06.275264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:06.275264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:06.275264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:06.275264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:06.275264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:06.275264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:06.275264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:06.276050 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:06.276050 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:06.276050 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:06.276050 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:06.276050 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:06.276050 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:06.276050 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:06.276050 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:06.276050 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:06.276050 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:06.276050 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:06.276050 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:06.281732 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 88/173] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:17:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:17:06.285430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c49f2-5019-4704-ba3a-eddc01ac070a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:06.371862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:06.383217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a50144-672c-4dca-a4b5-5c56366ea8e7 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:06.395488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c49f2-5019-4704-ba3a-eddc01ac070a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:06.468993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65f662-1260-4b83-ac08-dcb90b88716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:06.468993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65f662-1260-4b83-ac08-dcb90b88716c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:06.468993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65f662-1260-4b83-ac08-dcb90b88716c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:06.468993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65f662-1260-4b83-ac08-dcb90b88716c None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:06.469526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65f662-1260-4b83-ac08-dcb90b88716c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:06.469526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65f662-1260-4b83-ac08-dcb90b88716c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:06.469526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65f662-1260-4b83-ac08-dcb90b88716c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:06.469753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e48c3-77e1-4936-acd1-ecba5e4c1640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:06.469753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e48c3-77e1-4936-acd1-ecba5e4c1640 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:06.469753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e48c3-77e1-4936-acd1-ecba5e4c1640 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:06.469753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e48c3-77e1-4936-acd1-ecba5e4c1640 None admin] PATH_INFO: `/v3/projects/bc6f829c69694312be80573b85e42df8` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:06.470070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e48c3-77e1-4936-acd1-ecba5e4c1640 None admin] RBAC: Authorizing `identity:get_project(project_id=bc6f829c69694312be80573b85e42df8)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:06.470070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e48c3-77e1-4936-acd1-ecba5e4c1640 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:06.470070 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 86/174] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:06 2022] GET /identity/v3/projects/bc6f829c69694312be80573b85e42df8 => generated 312 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:06.470302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:06.470390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e48c3-77e1-4936-acd1-ecba5e4c1640 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:06.470474 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 89/175] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:06.473710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65f662-1260-4b83-ac08-dcb90b88716c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:06.602725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e48c3-77e1-4936-acd1-ecba5e4c1640 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:06.662274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77d6c6-6a09-4db4-bf7b-494cde835f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:06.662889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77d6c6-6a09-4db4-bf7b-494cde835f8e None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:06.663168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77d6c6-6a09-4db4-bf7b-494cde835f8e None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:06.663442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77d6c6-6a09-4db4-bf7b-494cde835f8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:06.664189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77d6c6-6a09-4db4-bf7b-494cde835f8e None admin] RBAC: Adding query filter params (role.id=5a4c2cf9b8d849398625913504b4b172, scope.project.id=bc6f829c69694312be80573b85e42df8, user.id=3762df846f914b0aa04761bfc47afef2) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:06.664509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77d6c6-6a09-4db4-bf7b-494cde835f8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:06.665959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77d6c6-6a09-4db4-bf7b-494cde835f8e None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:06.672992 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 87/176] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:06 2022] GET /identity/v3/role_assignments?user.id=3762df846f914b0aa04761bfc47afef2&scope.project.id=bc6f829c69694312be80573b85e42df8&role.id=5a4c2cf9b8d849398625913504b4b172 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:06.674237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530da60-748e-4db2-b623-0defbfd8fbaf None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:06.674524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530da60-748e-4db2-b623-0defbfd8fbaf None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:06.674798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530da60-748e-4db2-b623-0defbfd8fbaf None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:06.676015 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 88/177] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:06.701780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7a497-6e6c-4553-8471-8488dd7e3209 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:06.702103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7a497-6e6c-4553-8471-8488dd7e3209 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:06.702988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7a497-6e6c-4553-8471-8488dd7e3209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:06.706835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65f662-1260-4b83-ac08-dcb90b88716c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:06.735717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-10b7a497-6e6c-4553-8471-8488dd7e3209 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:06.736878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-10b7a497-6e6c-4553-8471-8488dd7e3209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:06.750242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0c16d-5668-4155-bb97-b58829b32e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:06.753018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0c16d-5668-4155-bb97-b58829b32e15 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:06.753337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0c16d-5668-4155-bb97-b58829b32e15 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:06.753615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0c16d-5668-4155-bb97-b58829b32e15 None admin] PATH_INFO: `/v3/users/3762df846f914b0aa04761bfc47afef2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:06.755671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0c16d-5668-4155-bb97-b58829b32e15 None admin] RBAC: Authorizing `identity:get_user(user_id=3762df846f914b0aa04761bfc47afef2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:06.757770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0c16d-5668-4155-bb97-b58829b32e15 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:06.766679 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 90/178] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:06 2022] GET /identity/v3/users/3762df846f914b0aa04761bfc47afef2 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:06.782883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0c16d-5668-4155-bb97-b58829b32e15 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:06.788546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:06.865618 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 89/179] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:06.866944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd77a92-1892-4087-96ac-34f64d356294 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:06.867234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd77a92-1892-4087-96ac-34f64d356294 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:06.867512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd77a92-1892-4087-96ac-34f64d356294 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:06.872517 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 90/180] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:06.875554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a71e8-5ed3-485d-9ad1-44cc359abbf3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:06.875834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a71e8-5ed3-485d-9ad1-44cc359abbf3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:06.876106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a71e8-5ed3-485d-9ad1-44cc359abbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:06.907187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0f8a71e8-5ed3-485d-9ad1-44cc359abbf3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:06.907856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:06.908708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0f8a71e8-5ed3-485d-9ad1-44cc359abbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:06.988668 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 91/181] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:06.989750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0c16d-5668-4155-bb97-b58829b32e15 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:07.026062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6bb8c-4022-4bbe-bf31-049a328b5c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:07.026670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6bb8c-4022-4bbe-bf31-049a328b5c2a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:07.026946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6bb8c-4022-4bbe-bf31-049a328b5c2a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:07.027216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6bb8c-4022-4bbe-bf31-049a328b5c2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:07.043984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f55604-2003-482f-af79-cec461a1d8f4 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:07.044350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f55604-2003-482f-af79-cec461a1d8f4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:07.044633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f55604-2003-482f-af79-cec461a1d8f4 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:07.046190 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 92/182] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:07.063433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bead29-f16b-4b5c-b1c6-4b9f6f91e765 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:07.063713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bead29-f16b-4b5c-b1c6-4b9f6f91e765 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:07.063988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bead29-f16b-4b5c-b1c6-4b9f6f91e765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:07.097053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6bb8c-4022-4bbe-bf31-049a328b5c2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:07.098636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6bb8c-4022-4bbe-bf31-049a328b5c2a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:07.101155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-12bead29-f16b-4b5c-b1c6-4b9f6f91e765 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:07.102426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-12bead29-f16b-4b5c-b1c6-4b9f6f91e765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:07.173618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:07.205863 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 93/183] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:07.206579 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 91/184] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:07.212198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bead29-f16b-4b5c-b1c6-4b9f6f91e765 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:07.249988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:07.333155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3df33-d4d4-4c43-a44a-a2f39e455f0a None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:07.333542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3df33-d4d4-4c43-a44a-a2f39e455f0a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:07.333894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3df33-d4d4-4c43-a44a-a2f39e455f0a None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:07.339054 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 92/185] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:07.340518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aa151-6f01-478f-8851-fcc0c480ecad None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:07.340890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aa151-6f01-478f-8851-fcc0c480ecad None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:07.341267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aa151-6f01-478f-8851-fcc0c480ecad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:07.360678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bead29-f16b-4b5c-b1c6-4b9f6f91e765 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:07.369362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-277aa151-6f01-478f-8851-fcc0c480ecad None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:07.370755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-277aa151-6f01-478f-8851-fcc0c480ecad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:07.404655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033714d-e10e-4880-bc72-0f0a55cd58c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:07.405759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033714d-e10e-4880-bc72-0f0a55cd58c4 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:07.406302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033714d-e10e-4880-bc72-0f0a55cd58c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:07.406763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033714d-e10e-4880-bc72-0f0a55cd58c4 None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:07.407965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033714d-e10e-4880-bc72-0f0a55cd58c4 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:07.410432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033714d-e10e-4880-bc72-0f0a55cd58c4 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:07.412064 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 94/186] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:07 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:07.414045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033714d-e10e-4880-bc72-0f0a55cd58c4 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:07.445583 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 93/187] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:07.454271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277aa151-6f01-478f-8851-fcc0c480ecad None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:07.508850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:07.528175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033714d-e10e-4880-bc72-0f0a55cd58c4 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:07.564806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:07.565821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd75d6-3465-435f-b1b4-e5b389eca3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:07.566446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd75d6-3465-435f-b1b4-e5b389eca3e2 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:07.566721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd75d6-3465-435f-b1b4-e5b389eca3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:07.566990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd75d6-3465-435f-b1b4-e5b389eca3e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:07.571658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277aa151-6f01-478f-8851-fcc0c480ecad None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:07.578129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd75d6-3465-435f-b1b4-e5b389eca3e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:07.582982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-3efd75d6-3465-435f-b1b4-e5b389eca3e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:07.582982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:07.582982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:07.582982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:07.582982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:07.582982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:07.582982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:07.582982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:07.582982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:07.582982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:07.582982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:07.582982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:07.582982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:07.582982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:07.582982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:07.582982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:07.583985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:07.583985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:07.583985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:07.583985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:07.583985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:07.583985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:07.583985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:07.583985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:07.583985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:07.583985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:07.583985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:07.583985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:07.583985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:07.583985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:07.583985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:07.583985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:07.589295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:07.589295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:07.589295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:07.589295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:07.589295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:07.589295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:07.589295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:07.589295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:07.589295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:07.589295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:07.589295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:07.589295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:07.589295 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 95/188] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:17:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:07.589295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd75d6-3465-435f-b1b4-e5b389eca3e2 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:07.614907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185e6d1-7ac9-4385-b98c-035f5f7b035b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:07.615603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185e6d1-7ac9-4385-b98c-035f5f7b035b None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:07.615896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185e6d1-7ac9-4385-b98c-035f5f7b035b None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:07.616153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185e6d1-7ac9-4385-b98c-035f5f7b035b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:07.626602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185e6d1-7ac9-4385-b98c-035f5f7b035b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:07.631428 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-9185e6d1-7ac9-4385-b98c-035f5f7b035b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:17:07.631428 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:07.631428 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:07.631428 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:07.631428 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:07.631428 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:07.631428 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:07.631428 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:07.631428 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:07.631428 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:07.631428 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:07.631428 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:07.631428 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:07.631428 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:07.631428 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:07.631428 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:07.632354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:07.632354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:07.632354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:07.632354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:07.632354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:07.632354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:07.632354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:07.632354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:07.632354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:07.632354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:07.632354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:07.632354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:07.632354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:07.632354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:07.632354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:07.632354 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:07.633163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:07.633163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:07.633163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:07.633163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:07.633163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:07.633163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:07.633163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:07.633163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:07.633163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:07.633163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:07.633163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:17:07.633163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:07.637647 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 94/189] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:17:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:07.638246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185e6d1-7ac9-4385-b98c-035f5f7b035b None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:07.697080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd75d6-3465-435f-b1b4-e5b389eca3e2 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:07.733683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea80de5-2bec-4143-8f4c-70e2393caf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:07.734220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea80de5-2bec-4143-8f4c-70e2393caf1d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:07.734462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea80de5-2bec-4143-8f4c-70e2393caf1d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:07.734720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea80de5-2bec-4143-8f4c-70e2393caf1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:07.735448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea80de5-2bec-4143-8f4c-70e2393caf1d None admin] RBAC: Adding query filter params (role.id=d78f86d36ded425d9148c0b5781ab7b2, scope.project.id=b8a63babe747425e956f165dd09383c5, user.id=3762df846f914b0aa04761bfc47afef2) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:07.735757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea80de5-2bec-4143-8f4c-70e2393caf1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:07.737321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea80de5-2bec-4143-8f4c-70e2393caf1d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:07.743228 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 96/190] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:07 2022] GET /identity/v3/role_assignments?user.id=3762df846f914b0aa04761bfc47afef2&scope.project.id=b8a63babe747425e956f165dd09383c5&role.id=d78f86d36ded425d9148c0b5781ab7b2 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:07.743863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea80de5-2bec-4143-8f4c-70e2393caf1d None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:07.744345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185e6d1-7ac9-4385-b98c-035f5f7b035b None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:07.755827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:07.792814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57991d-63eb-4e5c-ab4d-e011d0f30995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:07.793439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57991d-63eb-4e5c-ab4d-e011d0f30995 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:07.793656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57991d-63eb-4e5c-ab4d-e011d0f30995 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:07.793922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57991d-63eb-4e5c-ab4d-e011d0f30995 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:07.806267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57991d-63eb-4e5c-ab4d-e011d0f30995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:07.812016 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-ac57991d-63eb-4e5c-ab4d-e011d0f30995 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:17:07.812016 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:07.812016 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:07.812016 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:07.812016 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:07.812016 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:07.812016 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:07.812016 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:07.812016 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:07.812016 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:07.812016 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:07.812016 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:07.812016 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:07.812016 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:07.812016 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:07.812016 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:07.813159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:07.813159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:07.813159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:07.813159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:07.813159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:07.813159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:07.813159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:07.813159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:07.813159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:07.813159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:07.813159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:07.813159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:07.813159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:07.813159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:07.813159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:07.813159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:07.813949 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:07.813949 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:07.813949 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:07.813949 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:07.813949 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:07.813949 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:07.813949 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:07.813949 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:07.813949 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:07.813949 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:07.813949 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:17:07.813949 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:07.813949 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 95/191] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:07.814621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57991d-63eb-4e5c-ab4d-e011d0f30995 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:07.836009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:07.864304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea80de5-2bec-4143-8f4c-70e2393caf1d None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:07.906451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb87e6-4f76-4433-8a6e-aadc43ac38d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:07.907054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb87e6-4f76-4433-8a6e-aadc43ac38d2 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:07.907333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb87e6-4f76-4433-8a6e-aadc43ac38d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:07.907599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb87e6-4f76-4433-8a6e-aadc43ac38d2 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:07.908325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb87e6-4f76-4433-8a6e-aadc43ac38d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:07.908609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb87e6-4f76-4433-8a6e-aadc43ac38d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:07.909982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb87e6-4f76-4433-8a6e-aadc43ac38d2 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:07.920226 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 97/192] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:07.920226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb87e6-4f76-4433-8a6e-aadc43ac38d2 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:07.936245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57991d-63eb-4e5c-ab4d-e011d0f30995 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:07.983123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab058829-84f4-4fe6-b9a5-3bc344d6f080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:07.984894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab058829-84f4-4fe6-b9a5-3bc344d6f080 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:07.985181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab058829-84f4-4fe6-b9a5-3bc344d6f080 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:07.985483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab058829-84f4-4fe6-b9a5-3bc344d6f080 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:07.986149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab058829-84f4-4fe6-b9a5-3bc344d6f080 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:07.986455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab058829-84f4-4fe6-b9a5-3bc344d6f080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:07.987825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab058829-84f4-4fe6-b9a5-3bc344d6f080 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:07.996049 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 96/193] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:07.996750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab058829-84f4-4fe6-b9a5-3bc344d6f080 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:08.002687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:08.042624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb87e6-4f76-4433-8a6e-aadc43ac38d2 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:08.080635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:08.086715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ff9bf-ad07-4ffd-986a-e4b102992388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:08.087342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ff9bf-ad07-4ffd-986a-e4b102992388 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:08.087620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ff9bf-ad07-4ffd-986a-e4b102992388 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:08.087889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ff9bf-ad07-4ffd-986a-e4b102992388 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:08.089065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ff9bf-ad07-4ffd-986a-e4b102992388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:08.092420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ff9bf-ad07-4ffd-986a-e4b102992388 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:08.093136 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 98/194] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:08.094610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ff9bf-ad07-4ffd-986a-e4b102992388 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:08.104035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab058829-84f4-4fe6-b9a5-3bc344d6f080 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:08.140526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a903ec4-d27d-41b5-b985-d350bbf728a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:08.141150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a903ec4-d27d-41b5-b985-d350bbf728a3 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:08.141430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a903ec4-d27d-41b5-b985-d350bbf728a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:08.141698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a903ec4-d27d-41b5-b985-d350bbf728a3 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:08.142493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a903ec4-d27d-41b5-b985-d350bbf728a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:08.142791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a903ec4-d27d-41b5-b985-d350bbf728a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:08.144154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a903ec4-d27d-41b5-b985-d350bbf728a3 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:08.152512 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 97/195] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:08.153327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a903ec4-d27d-41b5-b985-d350bbf728a3 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:08.201308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ff9bf-ad07-4ffd-986a-e4b102992388 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:08.234383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afd146-df2e-4a45-985c-9402628e01cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:08.235013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afd146-df2e-4a45-985c-9402628e01cc None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:08.235293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afd146-df2e-4a45-985c-9402628e01cc None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:08.235564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afd146-df2e-4a45-985c-9402628e01cc None admin] PATH_INFO: `/v3/users/b6d106e531e3473fbe6156ebfe08005d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:08.243819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:08.250290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81afd146-df2e-4a45-985c-9402628e01cc None admin] RBAC: Authorizing `identity:get_user(user_id=b6d106e531e3473fbe6156ebfe08005d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:08.251754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81afd146-df2e-4a45-985c-9402628e01cc None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:08.253564 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 99/196] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:08 2022] GET /identity/v3/users/b6d106e531e3473fbe6156ebfe08005d => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:08.253668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a903ec4-d27d-41b5-b985-d350bbf728a3 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:08.254203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afd146-df2e-4a45-985c-9402628e01cc None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:08.287575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa1f5f-37ca-461a-ab88-88c542df1142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:08.288224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa1f5f-37ca-461a-ab88-88c542df1142 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:08.288506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa1f5f-37ca-461a-ab88-88c542df1142 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:08.288773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa1f5f-37ca-461a-ab88-88c542df1142 None admin] PATH_INFO: `/v3/users/b6d106e531e3473fbe6156ebfe08005d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:08.289887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa1f5f-37ca-461a-ab88-88c542df1142 None admin] RBAC: Authorizing `identity:get_user(user_id=b6d106e531e3473fbe6156ebfe08005d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:08.291318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa1f5f-37ca-461a-ab88-88c542df1142 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:08.292916 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 98/197] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:08 2022] GET /identity/v3/users/b6d106e531e3473fbe6156ebfe08005d => generated 283 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:08.293672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa1f5f-37ca-461a-ab88-88c542df1142 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:08.304760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:08.358340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afd146-df2e-4a45-985c-9402628e01cc None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:08.394975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919f5d8-37c5-4484-87e5-6ec69e34d88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:08.395588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919f5d8-37c5-4484-87e5-6ec69e34d88c None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:08.395869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919f5d8-37c5-4484-87e5-6ec69e34d88c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:08.396140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919f5d8-37c5-4484-87e5-6ec69e34d88c None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:08.396833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919f5d8-37c5-4484-87e5-6ec69e34d88c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:08.398291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919f5d8-37c5-4484-87e5-6ec69e34d88c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:08.401645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa1f5f-37ca-461a-ab88-88c542df1142 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:08.435652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968b639-7ae8-4d2c-944e-43c01fdc40ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:08.436290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968b639-7ae8-4d2c-944e-43c01fdc40ee None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:08.436697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968b639-7ae8-4d2c-944e-43c01fdc40ee None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:08.436974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968b639-7ae8-4d2c-944e-43c01fdc40ee None admin] PATH_INFO: `/v3/users/a213cfd3715c43339289b4120f601c03` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:08.438091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968b639-7ae8-4d2c-944e-43c01fdc40ee None admin] RBAC: Authorizing `identity:get_user(user_id=a213cfd3715c43339289b4120f601c03)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:08.439502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968b639-7ae8-4d2c-944e-43c01fdc40ee None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:08.441098 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 99/198] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:08 2022] GET /identity/v3/users/a213cfd3715c43339289b4120f601c03 => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:08.441844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968b639-7ae8-4d2c-944e-43c01fdc40ee None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:08.482361 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 100/199] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:17:08 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:17:08.483199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919f5d8-37c5-4484-87e5-6ec69e34d88c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:08.533815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:08.545320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:08.565964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968b639-7ae8-4d2c-944e-43c01fdc40ee None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:08.596292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919f5d8-37c5-4484-87e5-6ec69e34d88c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:08.609325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffcdc7-cf6d-4364-a81d-81835d2c6274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:08.609863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffcdc7-cf6d-4364-a81d-81835d2c6274 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:08.610127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffcdc7-cf6d-4364-a81d-81835d2c6274 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:08.610395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffcdc7-cf6d-4364-a81d-81835d2c6274 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:08.634417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27949d94-0954-4bc3-bb53-2ca65a9d8eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:08.635288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27949d94-0954-4bc3-bb53-2ca65a9d8eb8 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:08.635711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27949d94-0954-4bc3-bb53-2ca65a9d8eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:08.636435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27949d94-0954-4bc3-bb53-2ca65a9d8eb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:08.691201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffcdc7-cf6d-4364-a81d-81835d2c6274 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:08.692733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffcdc7-cf6d-4364-a81d-81835d2c6274 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:08.714192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27949d94-0954-4bc3-bb53-2ca65a9d8eb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:08.716138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27949d94-0954-4bc3-bb53-2ca65a9d8eb8 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:08.787185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:08.787723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:08.815077 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 100/200] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:08.815856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffcdc7-cf6d-4364-a81d-81835d2c6274 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:08.851799 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 101/201] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:08.853014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27949d94-0954-4bc3-bb53-2ca65a9d8eb8 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:08.947195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffcdc7-cf6d-4364-a81d-81835d2c6274 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:08.977599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27949d94-0954-4bc3-bb53-2ca65a9d8eb8 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:08.995322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05a3c3-4d00-4dc2-9a71-28c0352504f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:08.996480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05a3c3-4d00-4dc2-9a71-28c0352504f2 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:08.997419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05a3c3-4d00-4dc2-9a71-28c0352504f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:08.997890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05a3c3-4d00-4dc2-9a71-28c0352504f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:09.015956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21920d1-c875-4ba4-af4b-759448fe55cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:09.016648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21920d1-c875-4ba4-af4b-759448fe55cc None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:09.016951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21920d1-c875-4ba4-af4b-759448fe55cc None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:09.017200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21920d1-c875-4ba4-af4b-759448fe55cc None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:09.018425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21920d1-c875-4ba4-af4b-759448fe55cc None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:09.020326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21920d1-c875-4ba4-af4b-759448fe55cc None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:09.022042 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 102/202] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:08 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:09.027944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21920d1-c875-4ba4-af4b-759448fe55cc None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:09.054668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:09.059955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:09.085281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05a3c3-4d00-4dc2-9a71-28c0352504f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:09.087130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05a3c3-4d00-4dc2-9a71-28c0352504f2 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:09.154469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21920d1-c875-4ba4-af4b-759448fe55cc None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:09.198727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39001e41-b142-44a9-9c2d-0e5d954ccfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:09.199287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39001e41-b142-44a9-9c2d-0e5d954ccfa1 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:09.199694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39001e41-b142-44a9-9c2d-0e5d954ccfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:09.200100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39001e41-b142-44a9-9c2d-0e5d954ccfa1 None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:09.201262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39001e41-b142-44a9-9c2d-0e5d954ccfa1 None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:09.202987 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 101/203] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:09.203506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39001e41-b142-44a9-9c2d-0e5d954ccfa1 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:09.204706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05a3c3-4d00-4dc2-9a71-28c0352504f2 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:09.204830 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 103/204] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:09 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:09.209470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39001e41-b142-44a9-9c2d-0e5d954ccfa1 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:09.307002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:09.307971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:09.322017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39001e41-b142-44a9-9c2d-0e5d954ccfa1 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:09.335882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05a3c3-4d00-4dc2-9a71-28c0352504f2 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:09.360505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e674a-5af7-4032-9967-8d0dc8d069bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:09.362730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e674a-5af7-4032-9967-8d0dc8d069bd None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:09.363211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e674a-5af7-4032-9967-8d0dc8d069bd None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:09.363709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e674a-5af7-4032-9967-8d0dc8d069bd None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:09.365181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e674a-5af7-4032-9967-8d0dc8d069bd None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:09.366939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e674a-5af7-4032-9967-8d0dc8d069bd None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:09.369019 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 104/205] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:09 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:09.370165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e674a-5af7-4032-9967-8d0dc8d069bd None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:09.377578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13ac35-8a6d-4a8e-9ae3-d32dc22084a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:09.378190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13ac35-8a6d-4a8e-9ae3-d32dc22084a3 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:09.378463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13ac35-8a6d-4a8e-9ae3-d32dc22084a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:09.378729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13ac35-8a6d-4a8e-9ae3-d32dc22084a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:09.379453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13ac35-8a6d-4a8e-9ae3-d32dc22084a3 None admin] RBAC: Adding query filter params (role.id=d78f86d36ded425d9148c0b5781ab7b2, scope.project.id=c208601ac0cf4699975b00ec4d6d766e, user.id=b6d106e531e3473fbe6156ebfe08005d) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:09.379755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13ac35-8a6d-4a8e-9ae3-d32dc22084a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:09.381343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13ac35-8a6d-4a8e-9ae3-d32dc22084a3 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:09.389078 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 102/206] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:09 2022] GET /identity/v3/role_assignments?user.id=b6d106e531e3473fbe6156ebfe08005d&scope.project.id=c208601ac0cf4699975b00ec4d6d766e&role.id=d78f86d36ded425d9148c0b5781ab7b2 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:09.392342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13ac35-8a6d-4a8e-9ae3-d32dc22084a3 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:09.519092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e674a-5af7-4032-9967-8d0dc8d069bd None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:09.555224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c52028-88a8-4bfe-b52a-9a85afb6da7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:09.556143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c52028-88a8-4bfe-b52a-9a85afb6da7b None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:09.556143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c52028-88a8-4bfe-b52a-9a85afb6da7b None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:09.556419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c52028-88a8-4bfe-b52a-9a85afb6da7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:09.557303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c52028-88a8-4bfe-b52a-9a85afb6da7b None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=c208601ac0cf4699975b00ec4d6d766e, user.id=b6d106e531e3473fbe6156ebfe08005d) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:09.557622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c52028-88a8-4bfe-b52a-9a85afb6da7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:09.559103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c52028-88a8-4bfe-b52a-9a85afb6da7b None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:09.566279 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 105/207] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:09 2022] GET /identity/v3/role_assignments?user.id=b6d106e531e3473fbe6156ebfe08005d&scope.project.id=c208601ac0cf4699975b00ec4d6d766e&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:09.579102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13ac35-8a6d-4a8e-9ae3-d32dc22084a3 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:09.619014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a822c-a54d-4fa1-8475-a367cf8399fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:09.619878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a822c-a54d-4fa1-8475-a367cf8399fb None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:09.620327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a822c-a54d-4fa1-8475-a367cf8399fb None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:09.620895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a822c-a54d-4fa1-8475-a367cf8399fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:09.621950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a822c-a54d-4fa1-8475-a367cf8399fb None admin] RBAC: Adding query filter params (role.id=fb32d9ff656c423591f4b6227e950f99, scope.project.id=b8a63babe747425e956f165dd09383c5, user.id=a213cfd3715c43339289b4120f601c03) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:09.622538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a822c-a54d-4fa1-8475-a367cf8399fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:09.624382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a822c-a54d-4fa1-8475-a367cf8399fb None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:09.631629 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 103/208] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:09 2022] GET /identity/v3/role_assignments?user.id=a213cfd3715c43339289b4120f601c03&scope.project.id=b8a63babe747425e956f165dd09383c5&role.id=fb32d9ff656c423591f4b6227e950f99 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:10.649985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cc0e5-17e2-4c2f-9bae-3a51defa48e9 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:10.651029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cc0e5-17e2-4c2f-9bae-3a51defa48e9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:10.651510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cc0e5-17e2-4c2f-9bae-3a51defa48e9 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:10.653169 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 106/209] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:10.659076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e62094-f8f8-485f-8b58-0fdf25f5473a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:10.659910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e62094-f8f8-485f-8b58-0fdf25f5473a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:10.660438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e62094-f8f8-485f-8b58-0fdf25f5473a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:10.669180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:10.680038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c8e62094-f8f8-485f-8b58-0fdf25f5473a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:10.681527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c8e62094-f8f8-485f-8b58-0fdf25f5473a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:10.760434 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 104/210] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:10.867107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858de3c5-5bb5-42f8-8253-42e302556a56 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:10.867450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858de3c5-5bb5-42f8-8253-42e302556a56 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:10.867660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858de3c5-5bb5-42f8-8253-42e302556a56 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:10.869337 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 107/211] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:10.875400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd7049-695b-4847-9afb-9ecae246116b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:10.875690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd7049-695b-4847-9afb-9ecae246116b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:10.875966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd7049-695b-4847-9afb-9ecae246116b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:10.895253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-61cd7049-695b-4847-9afb-9ecae246116b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:10.896461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-61cd7049-695b-4847-9afb-9ecae246116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:10.966392 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 105/212] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:11.038725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858de3c5-5bb5-42f8-8253-42e302556a56 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:11.062927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:11.145678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858de3c5-5bb5-42f8-8253-42e302556a56 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:11.181710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b1420-7d68-417f-a3ec-419ed5cb6476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:11.182346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b1420-7d68-417f-a3ec-419ed5cb6476 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:11.182626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b1420-7d68-417f-a3ec-419ed5cb6476 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:11.182898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b1420-7d68-417f-a3ec-419ed5cb6476 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:11.194309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b1420-7d68-417f-a3ec-419ed5cb6476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:11.199717 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-636b1420-7d68-417f-a3ec-419ed5cb6476 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:11.199717 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:11.199717 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:11.199717 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:11.199717 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:11.199717 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:11.199717 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:11.199717 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:11.199717 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:11.199717 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:11.199717 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:11.199717 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:11.199717 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:11.199717 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:11.199717 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:11.199717 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:11.200620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:11.200620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:11.200620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:11.200620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:11.200620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:11.200620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:11.200620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:11.200620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:11.200620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:11.200620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:11.200620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:11.200620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:11.200620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:11.200620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:11.200620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:11.200620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:11.202248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:11.202248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:11.202248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:11.202248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:11.202248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:11.202248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:11.202248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:11.202248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:11.202248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:11.202248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:11.202248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:11.202248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:11.202248 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 108/213] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:11.206934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd7049-695b-4847-9afb-9ecae246116b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:11.244090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b1420-7d68-417f-a3ec-419ed5cb6476 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:11.274596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:11.317642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd7049-695b-4847-9afb-9ecae246116b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:11.333314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:11.355198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b1420-7d68-417f-a3ec-419ed5cb6476 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:11.355729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05716f-0f68-4b2e-9bc1-3933007e3457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:11.356591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05716f-0f68-4b2e-9bc1-3933007e3457 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:11.357062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05716f-0f68-4b2e-9bc1-3933007e3457 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:11.357538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05716f-0f68-4b2e-9bc1-3933007e3457 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:11.359012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05716f-0f68-4b2e-9bc1-3933007e3457 None admin] RBAC: Adding query filter params (name=member) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:11.359510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05716f-0f68-4b2e-9bc1-3933007e3457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:11.361120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05716f-0f68-4b2e-9bc1-3933007e3457 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:11.371397 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 106/214] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:11.376982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05716f-0f68-4b2e-9bc1-3933007e3457 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:11.396474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83b1ae-ce16-4aea-ad55-b9cd03d33dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:11.397883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83b1ae-ce16-4aea-ad55-b9cd03d33dbb None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:11.398370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83b1ae-ce16-4aea-ad55-b9cd03d33dbb None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:11.398840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83b1ae-ce16-4aea-ad55-b9cd03d33dbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:11.400287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83b1ae-ce16-4aea-ad55-b9cd03d33dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:11.402730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83b1ae-ce16-4aea-ad55-b9cd03d33dbb None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:11.410632 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 109/215] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:11.411319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83b1ae-ce16-4aea-ad55-b9cd03d33dbb None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:11.496298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05716f-0f68-4b2e-9bc1-3933007e3457 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:11.525263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83b1ae-ce16-4aea-ad55-b9cd03d33dbb None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:11.525899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:11.536492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903145-fedb-49a9-84f5-6b75a95854da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:11.537468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903145-fedb-49a9-84f5-6b75a95854da None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:11.538060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903145-fedb-49a9-84f5-6b75a95854da None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:11.538599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903145-fedb-49a9-84f5-6b75a95854da None admin] PATH_INFO: `/v3/users/4195235c8288463da527fe8b25c0ca84` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:11.556335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3903145-fedb-49a9-84f5-6b75a95854da None admin] RBAC: Authorizing `identity:get_user(user_id=4195235c8288463da527fe8b25c0ca84)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:11.558328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3903145-fedb-49a9-84f5-6b75a95854da None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:11.560874 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 107/216] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:11 2022] GET /identity/v3/users/4195235c8288463da527fe8b25c0ca84 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:11.566681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903145-fedb-49a9-84f5-6b75a95854da None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:11.568473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc37ef-f550-4417-b83e-97a28799b444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:11.569317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc37ef-f550-4417-b83e-97a28799b444 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:11.570070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc37ef-f550-4417-b83e-97a28799b444 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:11.571624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc37ef-f550-4417-b83e-97a28799b444 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:11.572538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc37ef-f550-4417-b83e-97a28799b444 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:11.574207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc37ef-f550-4417-b83e-97a28799b444 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:11.665391 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 110/217] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:17:11 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:17:11.666735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd41e8a-7593-47a1-870f-3a3c2f2046f4 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:11.667228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd41e8a-7593-47a1-870f-3a3c2f2046f4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:11.667350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd41e8a-7593-47a1-870f-3a3c2f2046f4 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:11.669086 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 111/218] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:11.678927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68450-59db-4dea-9763-32a8bb965e83 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:11.679335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68450-59db-4dea-9763-32a8bb965e83 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:11.679498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68450-59db-4dea-9763-32a8bb965e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:11.688012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903145-fedb-49a9-84f5-6b75a95854da None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:11.693624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:11.714101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-33e68450-59db-4dea-9763-32a8bb965e83 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:11.715918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-33e68450-59db-4dea-9763-32a8bb965e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:11.742724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445f3ef-a970-407d-8cfe-bddfe78fed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:11.743578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445f3ef-a970-407d-8cfe-bddfe78fed5b None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:11.743833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445f3ef-a970-407d-8cfe-bddfe78fed5b None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:11.744289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445f3ef-a970-407d-8cfe-bddfe78fed5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:11.809530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:11.819968 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 112/219] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:11.824442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853e0da-bd74-4640-8307-fc072ba88356 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:11.824442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853e0da-bd74-4640-8307-fc072ba88356 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:11.824442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853e0da-bd74-4640-8307-fc072ba88356 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:11.824442 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 113/220] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:11.830809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7256dd-189b-49b6-850c-6bdd3c0c5b3f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:11.831089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7256dd-189b-49b6-850c-6bdd3c0c5b3f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:11.831361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7256dd-189b-49b6-850c-6bdd3c0c5b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:11.836204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445f3ef-a970-407d-8cfe-bddfe78fed5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:11.837679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445f3ef-a970-407d-8cfe-bddfe78fed5b None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:11.853351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-be7256dd-189b-49b6-850c-6bdd3c0c5b3f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:11.854894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-be7256dd-189b-49b6-850c-6bdd3c0c5b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:11.951493 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 114/221] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:11.977951 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 108/222] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 27 04:17:11.984094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7256dd-189b-49b6-850c-6bdd3c0c5b3f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:12.050390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:12.097164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7256dd-189b-49b6-850c-6bdd3c0c5b3f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:12.106761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445f3ef-a970-407d-8cfe-bddfe78fed5b None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:12.137426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677b6c1-0476-4e4a-8f75-4b2d6972ad59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:12.138396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677b6c1-0476-4e4a-8f75-4b2d6972ad59 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:12.138896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677b6c1-0476-4e4a-8f75-4b2d6972ad59 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:12.139312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677b6c1-0476-4e4a-8f75-4b2d6972ad59 None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:12.141232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677b6c1-0476-4e4a-8f75-4b2d6972ad59 None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:12.145545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677b6c1-0476-4e4a-8f75-4b2d6972ad59 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:12.148558 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 115/223] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:11 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:12.159118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677b6c1-0476-4e4a-8f75-4b2d6972ad59 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:12.228597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:12.237336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445f3ef-a970-407d-8cfe-bddfe78fed5b None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:12.283540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677b6c1-0476-4e4a-8f75-4b2d6972ad59 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:12.288374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da6b1f-28ca-49f0-a634-c525272d8e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:12.289017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da6b1f-28ca-49f0-a634-c525272d8e1f None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:12.289291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da6b1f-28ca-49f0-a634-c525272d8e1f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:12.289557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da6b1f-28ca-49f0-a634-c525272d8e1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:12.303749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da6b1f-28ca-49f0-a634-c525272d8e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:12.310158 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-94da6b1f-28ca-49f0-a634-c525272d8e1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:12.310158 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:12.310158 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:12.310158 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:12.310158 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:12.310158 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:12.310158 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:12.310158 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:12.310158 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:12.310158 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:12.310158 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:12.310158 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:12.310158 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:12.310158 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:12.310158 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:12.310158 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:12.311035 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:12.311035 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:12.311035 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:12.311035 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:12.311035 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:12.311035 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:12.311035 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:12.311035 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:12.311035 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:12.311035 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:12.311035 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:12.311035 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:12.311035 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:12.311035 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:12.311035 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:12.311035 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:12.312265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:12.312265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:12.312265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:12.312265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:12.312265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:12.312265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:12.312265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:12.312265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:12.312265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:12.312265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:12.312265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:12.312265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:12.312265 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 109/224] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:17:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:12.313170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da6b1f-28ca-49f0-a634-c525272d8e1f None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:12.325558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:12.331492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897c3f4-f077-48c9-bf13-0de01d3c08a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:12.332236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897c3f4-f077-48c9-bf13-0de01d3c08a3 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:12.332689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897c3f4-f077-48c9-bf13-0de01d3c08a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:12.333071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897c3f4-f077-48c9-bf13-0de01d3c08a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:12.334004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897c3f4-f077-48c9-bf13-0de01d3c08a3 None admin] RBAC: Adding query filter params (role.id=5a4c2cf9b8d849398625913504b4b172, scope.project.id=c208601ac0cf4699975b00ec4d6d766e, user.id=4195235c8288463da527fe8b25c0ca84) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:12.334383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897c3f4-f077-48c9-bf13-0de01d3c08a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:12.336142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897c3f4-f077-48c9-bf13-0de01d3c08a3 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:12.343005 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 116/225] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:12 2022] GET /identity/v3/role_assignments?user.id=4195235c8288463da527fe8b25c0ca84&scope.project.id=c208601ac0cf4699975b00ec4d6d766e&role.id=5a4c2cf9b8d849398625913504b4b172 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:12.344509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897c3f4-f077-48c9-bf13-0de01d3c08a3 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:12.478794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da6b1f-28ca-49f0-a634-c525272d8e1f None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:12.533255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897c3f4-f077-48c9-bf13-0de01d3c08a3 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:12.539676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9bb8-1e1b-47e3-80c5-1febcb0b1430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:12.540340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9bb8-1e1b-47e3-80c5-1febcb0b1430 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:12.540619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9bb8-1e1b-47e3-80c5-1febcb0b1430 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:12.540886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9bb8-1e1b-47e3-80c5-1febcb0b1430 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:12.551809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca9bb8-1e1b-47e3-80c5-1febcb0b1430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:12.557218 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-30ca9bb8-1e1b-47e3-80c5-1febcb0b1430 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:17:12.557218 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:12.557218 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:12.557218 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:12.557218 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:12.557218 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:12.557218 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:12.557218 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:12.557218 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:12.557218 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:12.557218 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:12.557218 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:12.557218 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:12.557218 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:12.557218 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:12.557218 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:12.558091 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:12.558091 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:12.558091 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:12.558091 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:12.558091 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:12.558091 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:12.558091 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:12.558091 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:12.558091 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:12.558091 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:12.558091 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:12.558091 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:12.558091 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:12.558091 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:12.558091 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:12.558091 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:12.559092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:12.559092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:12.559092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:12.559092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:12.559092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:12.559092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:12.559092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:12.559092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:12.559092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:12.559092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:12.559092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:17:12.559092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:12.559092 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 110/226] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:17:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:12.564441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9bb8-1e1b-47e3-80c5-1febcb0b1430 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:12.568483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:12.631757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db71613-6bb6-422f-84a9-3f487a26d428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:12.634010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db71613-6bb6-422f-84a9-3f487a26d428 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:12.634010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db71613-6bb6-422f-84a9-3f487a26d428 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:12.634010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db71613-6bb6-422f-84a9-3f487a26d428 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:12.634010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db71613-6bb6-422f-84a9-3f487a26d428 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:12.634010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db71613-6bb6-422f-84a9-3f487a26d428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:12.635232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db71613-6bb6-422f-84a9-3f487a26d428 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:12.645024 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 117/227] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:12.650522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db71613-6bb6-422f-84a9-3f487a26d428 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:12.711053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9bb8-1e1b-47e3-80c5-1febcb0b1430 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:12.750394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bc7d6-fe78-487f-9217-7186e2b37442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:12.750923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bc7d6-fe78-487f-9217-7186e2b37442 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:12.751195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bc7d6-fe78-487f-9217-7186e2b37442 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:12.751459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bc7d6-fe78-487f-9217-7186e2b37442 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:12.752117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bc7d6-fe78-487f-9217-7186e2b37442 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:12.752441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bc7d6-fe78-487f-9217-7186e2b37442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:12.753804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bc7d6-fe78-487f-9217-7186e2b37442 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:12.772842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:12.774926 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 111/228] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:12.782342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bc7d6-fe78-487f-9217-7186e2b37442 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:12.824400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db71613-6bb6-422f-84a9-3f487a26d428 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:12.870257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c7d64-8a7e-4a26-a186-abae628fae61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:12.870903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c7d64-8a7e-4a26-a186-abae628fae61 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:12.871182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c7d64-8a7e-4a26-a186-abae628fae61 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:12.871455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c7d64-8a7e-4a26-a186-abae628fae61 None admin] PATH_INFO: `/v3/users/b6d106e531e3473fbe6156ebfe08005d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:12.876073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c7d64-8a7e-4a26-a186-abae628fae61 None admin] RBAC: Authorizing `identity:get_user(user_id=b6d106e531e3473fbe6156ebfe08005d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:12.877678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c7d64-8a7e-4a26-a186-abae628fae61 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:12.879348 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 118/229] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:12 2022] GET /identity/v3/users/b6d106e531e3473fbe6156ebfe08005d => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:12.890652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c7d64-8a7e-4a26-a186-abae628fae61 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:12.905578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:12.942175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bc7d6-fe78-487f-9217-7186e2b37442 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:12.978917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952438c-38b6-413b-a876-56e917d96c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:12.979974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952438c-38b6-413b-a876-56e917d96c5a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:12.980482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952438c-38b6-413b-a876-56e917d96c5a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:12.981001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952438c-38b6-413b-a876-56e917d96c5a None admin] PATH_INFO: `/v3/users/b6d106e531e3473fbe6156ebfe08005d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:12.982342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952438c-38b6-413b-a876-56e917d96c5a None admin] RBAC: Authorizing `identity:get_user(user_id=b6d106e531e3473fbe6156ebfe08005d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:12.984124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952438c-38b6-413b-a876-56e917d96c5a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:12.986007 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 112/230] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:12 2022] GET /identity/v3/users/b6d106e531e3473fbe6156ebfe08005d => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:12.991624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952438c-38b6-413b-a876-56e917d96c5a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:13.099063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952438c-38b6-413b-a876-56e917d96c5a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:13.121199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c7d64-8a7e-4a26-a186-abae628fae61 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:13.136980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e6aca-2688-4267-b0bc-9cdcb85e5a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:13.138058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e6aca-2688-4267-b0bc-9cdcb85e5a4d None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:13.138548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e6aca-2688-4267-b0bc-9cdcb85e5a4d None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:13.139007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e6aca-2688-4267-b0bc-9cdcb85e5a4d None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:13.141192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e6aca-2688-4267-b0bc-9cdcb85e5a4d None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:13.143167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e6aca-2688-4267-b0bc-9cdcb85e5a4d None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:13.145599 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 113/231] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:12 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:13.151335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e6aca-2688-4267-b0bc-9cdcb85e5a4d None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:13.154754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:13.174427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:13.190839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937f893-4b57-4df3-b187-91dc003ea313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:13.191524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937f893-4b57-4df3-b187-91dc003ea313 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:13.191806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937f893-4b57-4df3-b187-91dc003ea313 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:13.192082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937f893-4b57-4df3-b187-91dc003ea313 None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:13.196017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937f893-4b57-4df3-b187-91dc003ea313 None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:13.197536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937f893-4b57-4df3-b187-91dc003ea313 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:13.200316 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 119/232] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:12 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:13.206230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937f893-4b57-4df3-b187-91dc003ea313 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:13.318743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e6aca-2688-4267-b0bc-9cdcb85e5a4d None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:13.373312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937f893-4b57-4df3-b187-91dc003ea313 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:13.378584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad491c-05ef-4a8c-ad13-7c8a00d1dccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:13.383449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad491c-05ef-4a8c-ad13-7c8a00d1dccd None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:13.383881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad491c-05ef-4a8c-ad13-7c8a00d1dccd None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:13.384381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad491c-05ef-4a8c-ad13-7c8a00d1dccd None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e/users/b6d106e531e3473fbe6156ebfe08005d/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:13.388461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad491c-05ef-4a8c-ad13-7c8a00d1dccd None admin] RBAC: Authorizing `identity:create_grant(project_id=c208601ac0cf4699975b00ec4d6d766e, user_id=b6d106e531e3473fbe6156ebfe08005d, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:13.390167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad491c-05ef-4a8c-ad13-7c8a00d1dccd None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:13.419067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecea70a-710b-4c7b-b6bb-e94089d76eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:13.420010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecea70a-710b-4c7b-b6bb-e94089d76eca None admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:13.420467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecea70a-710b-4c7b-b6bb-e94089d76eca None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:13.421623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecea70a-710b-4c7b-b6bb-e94089d76eca None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e/users/b6d106e531e3473fbe6156ebfe08005d/roles/d78f86d36ded425d9148c0b5781ab7b2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:13.424340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecea70a-710b-4c7b-b6bb-e94089d76eca None admin] RBAC: Authorizing `identity:create_grant(project_id=c208601ac0cf4699975b00ec4d6d766e, user_id=b6d106e531e3473fbe6156ebfe08005d, role_id=d78f86d36ded425d9148c0b5781ab7b2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:13.426032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecea70a-710b-4c7b-b6bb-e94089d76eca None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:13.474932 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 114/233] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:17:13 2022] PUT /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e/users/b6d106e531e3473fbe6156ebfe08005d/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:17:13.506957 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 120/234] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:17:13 2022] PUT /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e/users/b6d106e531e3473fbe6156ebfe08005d/roles/d78f86d36ded425d9148c0b5781ab7b2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:17:14.356796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc3b2f-a180-43f5-806e-ffbded26e07b None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:14.357735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc3b2f-a180-43f5-806e-ffbded26e07b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:14.358901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc3b2f-a180-43f5-806e-ffbded26e07b None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:14.360555 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 115/235] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:14.366207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a2dea-5926-4558-8789-89620063278c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:14.366675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a2dea-5926-4558-8789-89620063278c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:14.366751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a2dea-5926-4558-8789-89620063278c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:14.393147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d71a2dea-5926-4558-8789-89620063278c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:14.394337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d71a2dea-5926-4558-8789-89620063278c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:14.462129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:14.475364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22097c2f-a98e-4fd9-ad35-0b0f503de50f None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:14.475981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22097c2f-a98e-4fd9-ad35-0b0f503de50f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:14.476513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22097c2f-a98e-4fd9-ad35-0b0f503de50f None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:14.478344 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 116/236] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:14.484924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19315547-a498-4c0a-9f9a-6376eb0a1e85 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:14.485475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19315547-a498-4c0a-9f9a-6376eb0a1e85 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:14.485597 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 121/237] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:14.486059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19315547-a498-4c0a-9f9a-6376eb0a1e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:14.527166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-19315547-a498-4c0a-9f9a-6376eb0a1e85 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:14.528743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-19315547-a498-4c0a-9f9a-6376eb0a1e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:14.558085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0ed99-6b67-45e0-b6bf-14160a7628df None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:14.558431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0ed99-6b67-45e0-b6bf-14160a7628df None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:14.558651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0ed99-6b67-45e0-b6bf-14160a7628df None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:14.560010 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 122/238] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:17:14.566217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa943a-df5e-49ba-b9c0-6f2cc32ce865 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:14.566516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa943a-df5e-49ba-b9c0-6f2cc32ce865 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:14.567057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa943a-df5e-49ba-b9c0-6f2cc32ce865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:14.587043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ffaa943a-df5e-49ba-b9c0-6f2cc32ce865 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:14.587713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ffaa943a-df5e-49ba-b9c0-6f2cc32ce865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:14.612668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:14.628632 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 117/239] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:14.681398 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 123/240] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:14.800734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19315547-a498-4c0a-9f9a-6376eb0a1e85 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:14.930347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19315547-a498-4c0a-9f9a-6376eb0a1e85 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:14.978001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bd7f3-e8ff-4f86-993c-11db1d62c5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:14.978643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bd7f3-e8ff-4f86-993c-11db1d62c5b2 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:14.979023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bd7f3-e8ff-4f86-993c-11db1d62c5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:14.979292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bd7f3-e8ff-4f86-993c-11db1d62c5b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:14.994062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bd7f3-e8ff-4f86-993c-11db1d62c5b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:14.998966 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-f31bd7f3-e8ff-4f86-993c-11db1d62c5b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:17:14.998966 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:14.998966 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:14.998966 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:14.998966 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:14.998966 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:14.998966 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:14.998966 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:14.998966 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:14.998966 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:14.998966 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:14.998966 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:14.998966 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:14.998966 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:14.998966 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:14.998966 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:14.999860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:14.999860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:14.999860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:14.999860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:14.999860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:14.999860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:14.999860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:14.999860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:14.999860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:14.999860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:14.999860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:14.999860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:14.999860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:14.999860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:14.999860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:14.999860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:15.000689 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:15.000689 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:15.000689 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:15.000689 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:15.000689 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:15.000689 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:15.000689 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:15.000689 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:15.000689 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:15.000689 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:15.000689 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:17:15.000689 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:15.004278 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 118/241] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:15.006751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa943a-df5e-49ba-b9c0-6f2cc32ce865 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:15.022570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bd7f3-e8ff-4f86-993c-11db1d62c5b2 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:15.098093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:15.139009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa943a-df5e-49ba-b9c0-6f2cc32ce865 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:15.155432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:15.160890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bd7f3-e8ff-4f86-993c-11db1d62c5b2 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:15.179770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352612cc-5ccf-488e-b5e8-5d478dacf268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:15.180765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352612cc-5ccf-488e-b5e8-5d478dacf268 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:15.181237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352612cc-5ccf-488e-b5e8-5d478dacf268 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:15.181712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352612cc-5ccf-488e-b5e8-5d478dacf268 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:15.182591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352612cc-5ccf-488e-b5e8-5d478dacf268 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:15.183080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352612cc-5ccf-488e-b5e8-5d478dacf268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:15.184842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352612cc-5ccf-488e-b5e8-5d478dacf268 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:15.197594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6baad65-c24e-4468-b38e-7eaeac27fbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:15.198509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baad65-c24e-4468-b38e-7eaeac27fbe1 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:15.199014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baad65-c24e-4468-b38e-7eaeac27fbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:15.199600 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 124/242] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:15.199937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baad65-c24e-4468-b38e-7eaeac27fbe1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:15.200467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352612cc-5ccf-488e-b5e8-5d478dacf268 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:15.201645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6baad65-c24e-4468-b38e-7eaeac27fbe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:15.204130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6baad65-c24e-4468-b38e-7eaeac27fbe1 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:15.206347 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 119/243] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:15.207365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6baad65-c24e-4468-b38e-7eaeac27fbe1 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:15.306526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352612cc-5ccf-488e-b5e8-5d478dacf268 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:15.316137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6baad65-c24e-4468-b38e-7eaeac27fbe1 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:15.338779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:15.345107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14242-5a6a-4f2c-b871-b2eca176ea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:15.345748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14242-5a6a-4f2c-b871-b2eca176ea7a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:15.346024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14242-5a6a-4f2c-b871-b2eca176ea7a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:15.346296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14242-5a6a-4f2c-b871-b2eca176ea7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:15.355789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01e004-0638-4778-910b-26b3301c4b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:15.356808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01e004-0638-4778-910b-26b3301c4b33 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:15.357336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd14242-5a6a-4f2c-b871-b2eca176ea7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:15.357811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01e004-0638-4778-910b-26b3301c4b33 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:15.358713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01e004-0638-4778-910b-26b3301c4b33 None admin] PATH_INFO: `/v3/users/71d2a5fb05e441c6a98c74f3c6afa60d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:15.363039 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-efd14242-5a6a-4f2c-b871-b2eca176ea7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:15.363039 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:15.363039 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:15.363039 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:15.363039 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:15.363039 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:15.363039 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:15.363039 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:15.363039 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:15.363039 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:15.363039 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:15.363039 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:15.363039 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:15.363039 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:15.363039 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:15.363039 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:15.363944 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:15.363944 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:15.363944 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:15.363944 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:15.363944 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:15.363944 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:15.363944 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:15.363944 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:15.363944 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:15.363944 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:15.363944 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:15.363944 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:15.363944 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:15.363944 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:15.363944 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:15.363944 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:15.364845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:15.364845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:15.364845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:15.364845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:15.364845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:15.364845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:15.364845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:15.364845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:15.364845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:15.364845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:15.364845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:15.364845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:15.364845 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 125/244] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:15.365495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14242-5a6a-4f2c-b871-b2eca176ea7a None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:15.378284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01e004-0638-4778-910b-26b3301c4b33 None admin] RBAC: Authorizing `identity:get_user(user_id=71d2a5fb05e441c6a98c74f3c6afa60d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:15.380234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01e004-0638-4778-910b-26b3301c4b33 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:15.382560 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 120/245] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:15 2022] GET /identity/v3/users/71d2a5fb05e441c6a98c74f3c6afa60d => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:15.383623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01e004-0638-4778-910b-26b3301c4b33 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:15.413124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:15.484335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14242-5a6a-4f2c-b871-b2eca176ea7a None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:15.495704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01e004-0638-4778-910b-26b3301c4b33 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:15.522195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960f783-ec11-4661-97a0-ee784cb8e28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:15.522952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960f783-ec11-4661-97a0-ee784cb8e28c None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:15.531525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960f783-ec11-4661-97a0-ee784cb8e28c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:15.531525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960f783-ec11-4661-97a0-ee784cb8e28c None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:15.531525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960f783-ec11-4661-97a0-ee784cb8e28c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:15.531525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960f783-ec11-4661-97a0-ee784cb8e28c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:15.536115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103545e7-f561-43df-b832-9e058b19484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:15.536985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103545e7-f561-43df-b832-9e058b19484d None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:15.537265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103545e7-f561-43df-b832-9e058b19484d None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:15.537539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103545e7-f561-43df-b832-9e058b19484d None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:15.538209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103545e7-f561-43df-b832-9e058b19484d None admin] RBAC: Adding query filter params (name=member) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:15.538615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103545e7-f561-43df-b832-9e058b19484d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:15.539981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103545e7-f561-43df-b832-9e058b19484d None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:15.553727 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 121/246] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:15.553727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103545e7-f561-43df-b832-9e058b19484d None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:15.596748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:15.644617 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 126/247] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:17:15 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:17:15.645994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960f783-ec11-4661-97a0-ee784cb8e28c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:15.665614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103545e7-f561-43df-b832-9e058b19484d None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:15.716949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3965471-f403-4c16-acc6-e27866726dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:15.717778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3965471-f403-4c16-acc6-e27866726dca None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:15.718516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3965471-f403-4c16-acc6-e27866726dca None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:15.718793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3965471-f403-4c16-acc6-e27866726dca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:15.760088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:15.770378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960f783-ec11-4661-97a0-ee784cb8e28c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:15.803019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3965471-f403-4c16-acc6-e27866726dca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:15.804526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3965471-f403-4c16-acc6-e27866726dca None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:15.812066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61ee1e-26f1-4b60-b25f-d37fe4fcd9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:15.812755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61ee1e-26f1-4b60-b25f-d37fe4fcd9c7 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:15.813047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61ee1e-26f1-4b60-b25f-d37fe4fcd9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:15.813700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61ee1e-26f1-4b60-b25f-d37fe4fcd9c7 None admin] PATH_INFO: `/v3/users/4195235c8288463da527fe8b25c0ca84` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:15.815341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61ee1e-26f1-4b60-b25f-d37fe4fcd9c7 None admin] RBAC: Authorizing `identity:get_user(user_id=4195235c8288463da527fe8b25c0ca84)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:15.817194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61ee1e-26f1-4b60-b25f-d37fe4fcd9c7 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:15.819115 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 127/248] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:15 2022] GET /identity/v3/users/4195235c8288463da527fe8b25c0ca84 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:15.824819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61ee1e-26f1-4b60-b25f-d37fe4fcd9c7 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:15.879239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:15.945460 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 122/249] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:15.965235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3965471-f403-4c16-acc6-e27866726dca None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:15.970675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61ee1e-26f1-4b60-b25f-d37fe4fcd9c7 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:16.023359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf2feb-3914-4d2a-a3c8-d293fa74fddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:16.023925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf2feb-3914-4d2a-a3c8-d293fa74fddd None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:16.024242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf2feb-3914-4d2a-a3c8-d293fa74fddd None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:16.024522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf2feb-3914-4d2a-a3c8-d293fa74fddd None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:16.025773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf2feb-3914-4d2a-a3c8-d293fa74fddd None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:16.027362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf2feb-3914-4d2a-a3c8-d293fa74fddd None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:16.029360 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 128/250] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:15 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:16.031383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff112ce-8b1c-46b7-9223-e306dc6c43f7 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:16.031787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff112ce-8b1c-46b7-9223-e306dc6c43f7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:16.032068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff112ce-8b1c-46b7-9223-e306dc6c43f7 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:16.033409 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 129/251] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:16.038854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff112ce-8b1c-46b7-9223-e306dc6c43f7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:16.075818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:16.095192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3965471-f403-4c16-acc6-e27866726dca None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:16.140736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e06315-67a3-499b-8f5a-aec71a5cdd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:16.141733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e06315-67a3-499b-8f5a-aec71a5cdd67 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:16.142227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e06315-67a3-499b-8f5a-aec71a5cdd67 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:16.142684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e06315-67a3-499b-8f5a-aec71a5cdd67 None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:16.144043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e06315-67a3-499b-8f5a-aec71a5cdd67 None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:16.145730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e06315-67a3-499b-8f5a-aec71a5cdd67 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:16.147755 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 123/252] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:15 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:16.149036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e513d7b-d76f-4ddf-9ce5-96494fc6261d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:16.149314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e513d7b-d76f-4ddf-9ce5-96494fc6261d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:16.149582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e513d7b-d76f-4ddf-9ce5-96494fc6261d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:16.166427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff112ce-8b1c-46b7-9223-e306dc6c43f7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:16.171087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7e513d7b-d76f-4ddf-9ce5-96494fc6261d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:16.171087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7e513d7b-d76f-4ddf-9ce5-96494fc6261d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:16.173603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:16.228908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4063c7-45b5-4c66-a60f-4df3d1ec700c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:16.229784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4063c7-45b5-4c66-a60f-4df3d1ec700c None admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:16.230131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4063c7-45b5-4c66-a60f-4df3d1ec700c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:16.230474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4063c7-45b5-4c66-a60f-4df3d1ec700c None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e/users/4195235c8288463da527fe8b25c0ca84/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:16.232629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4063c7-45b5-4c66-a60f-4df3d1ec700c None admin] RBAC: Authorizing `identity:create_grant(project_id=c208601ac0cf4699975b00ec4d6d766e, user_id=4195235c8288463da527fe8b25c0ca84, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:16.234864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4063c7-45b5-4c66-a60f-4df3d1ec700c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:16.260966 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 124/253] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:16.262959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06983b23-a92f-424f-8ccb-426258cdc44c None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:16.263401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06983b23-a92f-424f-8ccb-426258cdc44c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:16.268823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06983b23-a92f-424f-8ccb-426258cdc44c None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:16.268823 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 125/254] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:16.270510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06983b23-a92f-424f-8ccb-426258cdc44c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:16.331471 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 130/255] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:17:16 2022] PUT /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e/users/4195235c8288463da527fe8b25c0ca84/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:17:16.332859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6bef3-bd07-4ed6-996b-d5c7eca1635d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:16.333209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6bef3-bd07-4ed6-996b-d5c7eca1635d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:16.333553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6bef3-bd07-4ed6-996b-d5c7eca1635d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:16.368046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-fcb6bef3-bd07-4ed6-996b-d5c7eca1635d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:16.369345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fcb6bef3-bd07-4ed6-996b-d5c7eca1635d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:16.459569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06983b23-a92f-424f-8ccb-426258cdc44c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:16.522629 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 131/256] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:16.533845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95cbe9-8b98-4a12-a97f-389627eb4596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:16.534807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95cbe9-8b98-4a12-a97f-389627eb4596 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:16.535337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95cbe9-8b98-4a12-a97f-389627eb4596 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:16.535807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95cbe9-8b98-4a12-a97f-389627eb4596 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:16.536899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95cbe9-8b98-4a12-a97f-389627eb4596 None admin] RBAC: Adding query filter params (role.id=fb32d9ff656c423591f4b6227e950f99, scope.project.id=c208601ac0cf4699975b00ec4d6d766e, user.id=71d2a5fb05e441c6a98c74f3c6afa60d) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:16.537406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95cbe9-8b98-4a12-a97f-389627eb4596 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:16.539166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95cbe9-8b98-4a12-a97f-389627eb4596 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:16.545659 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 126/257] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:16 2022] GET /identity/v3/role_assignments?user.id=71d2a5fb05e441c6a98c74f3c6afa60d&scope.project.id=c208601ac0cf4699975b00ec4d6d766e&role.id=fb32d9ff656c423591f4b6227e950f99 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:16.759813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6bef3-bd07-4ed6-996b-d5c7eca1635d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:16.782976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:16.880349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6bef3-bd07-4ed6-996b-d5c7eca1635d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:16.920966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206c3f0-7f9d-4b54-82a0-d224603d0ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:16.922183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206c3f0-7f9d-4b54-82a0-d224603d0ec5 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:16.922463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206c3f0-7f9d-4b54-82a0-d224603d0ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:16.922732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206c3f0-7f9d-4b54-82a0-d224603d0ec5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:16.933432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206c3f0-7f9d-4b54-82a0-d224603d0ec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:16.939251 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-9206c3f0-7f9d-4b54-82a0-d224603d0ec5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:16.939251 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:16.939251 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:16.939251 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:16.939251 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:16.939251 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:16.939251 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:16.939251 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:16.939251 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:16.939251 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:16.939251 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:16.939251 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:16.939251 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:16.939251 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:16.939251 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:16.939251 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:16.940148 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:16.940148 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:16.940148 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:16.940148 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:16.940148 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:16.940148 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:16.940148 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:16.940148 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:16.940148 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:16.940148 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:16.940148 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:16.940148 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:16.940148 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:16.940148 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:16.940148 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:16.940148 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:16.940964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:16.940964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:16.940964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:16.940964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:16.940964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:16.940964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:16.940964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:16.940964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:16.940964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:16.940964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:16.940964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:16.940964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:16.940964 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 132/258] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:17:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:16.949621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95cbe9-8b98-4a12-a97f-389627eb4596 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:16.953121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:16.997905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206c3f0-7f9d-4b54-82a0-d224603d0ec5 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:17.145237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95cbe9-8b98-4a12-a97f-389627eb4596 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:17.161362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:17.203256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206c3f0-7f9d-4b54-82a0-d224603d0ec5 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:17.204885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcbfcd-7809-48be-84af-e94e76cca6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:17.205509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcbfcd-7809-48be-84af-e94e76cca6a6 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:17.205788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcbfcd-7809-48be-84af-e94e76cca6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:17.206164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcbfcd-7809-48be-84af-e94e76cca6a6 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:17.206853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcbfcd-7809-48be-84af-e94e76cca6a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:17.207154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcbfcd-7809-48be-84af-e94e76cca6a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:17.208565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcbfcd-7809-48be-84af-e94e76cca6a6 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:17.221658 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 127/259] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:17.231239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcbfcd-7809-48be-84af-e94e76cca6a6 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:17.267022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19a1a4-d896-4c18-9037-09e1dd973e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:17.267724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19a1a4-d896-4c18-9037-09e1dd973e00 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:17.268010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19a1a4-d896-4c18-9037-09e1dd973e00 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:17.268313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19a1a4-d896-4c18-9037-09e1dd973e00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:17.289129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19a1a4-d896-4c18-9037-09e1dd973e00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:17.294225 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-0c19a1a4-d896-4c18-9037-09e1dd973e00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:17:17.294225 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:17.294225 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:17.294225 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:17.294225 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:17.294225 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:17.294225 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:17.294225 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:17.294225 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:17.294225 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:17.294225 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:17.294225 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:17.294225 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:17.294225 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:17.294225 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:17.294225 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:17.295078 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:17.295078 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:17.295078 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:17.295078 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:17.295078 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:17.295078 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:17.295078 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:17.295078 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:17.295078 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:17.295078 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:17.295078 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:17.295078 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:17.295078 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:17.295078 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:17.295078 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:17.295078 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:17.296019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:17.296019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:17.296019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:17.296019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:17.296019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:17.296019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:17.296019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:17.296019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:17.296019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:17.296019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:17.296019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:17:17.296019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:17.296716 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 133/260] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:17:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:17.301708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19a1a4-d896-4c18-9037-09e1dd973e00 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:17.337309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:17.408553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcbfcd-7809-48be-84af-e94e76cca6a6 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:17.462911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e0a39-9ffe-4bb5-bafc-718570875ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:17.463684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e0a39-9ffe-4bb5-bafc-718570875ac0 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:17.463846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e0a39-9ffe-4bb5-bafc-718570875ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:17.464059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e0a39-9ffe-4bb5-bafc-718570875ac0 None admin] PATH_INFO: `/v3/users/b6d106e531e3473fbe6156ebfe08005d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:17.465223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e0a39-9ffe-4bb5-bafc-718570875ac0 None admin] RBAC: Authorizing `identity:get_user(user_id=b6d106e531e3473fbe6156ebfe08005d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:17.466653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e0a39-9ffe-4bb5-bafc-718570875ac0 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:17.468580 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 128/261] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:17 2022] GET /identity/v3/users/b6d106e531e3473fbe6156ebfe08005d => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:17.478446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e0a39-9ffe-4bb5-bafc-718570875ac0 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:17.533391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19a1a4-d896-4c18-9037-09e1dd973e00 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:17.593871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30692689-4648-4d96-92d0-ad0af8c072d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:17.594482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30692689-4648-4d96-92d0-ad0af8c072d1 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:17.594763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30692689-4648-4d96-92d0-ad0af8c072d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:17.595034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30692689-4648-4d96-92d0-ad0af8c072d1 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:17.595769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30692689-4648-4d96-92d0-ad0af8c072d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:17.596076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30692689-4648-4d96-92d0-ad0af8c072d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:17.597778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30692689-4648-4d96-92d0-ad0af8c072d1 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:17.607087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:17.612960 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 134/262] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:17.618921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30692689-4648-4d96-92d0-ad0af8c072d1 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:17.717298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e0a39-9ffe-4bb5-bafc-718570875ac0 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:17.764883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30692689-4648-4d96-92d0-ad0af8c072d1 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:17.794553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:17.803484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec5d43-a92d-48f4-9142-59bbc8a47234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:17.804126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec5d43-a92d-48f4-9142-59bbc8a47234 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:17.804440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec5d43-a92d-48f4-9142-59bbc8a47234 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:17.806651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec5d43-a92d-48f4-9142-59bbc8a47234 None admin] PATH_INFO: `/v3/users/b6d106e531e3473fbe6156ebfe08005d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:17.806651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec5d43-a92d-48f4-9142-59bbc8a47234 None admin] RBAC: Authorizing `identity:get_user(user_id=b6d106e531e3473fbe6156ebfe08005d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:17.807498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec5d43-a92d-48f4-9142-59bbc8a47234 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:17.809288 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 135/263] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:17 2022] GET /identity/v3/users/b6d106e531e3473fbe6156ebfe08005d => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:17.811741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77035136-78bf-4c83-a9be-ddd918a29287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:17.812491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77035136-78bf-4c83-a9be-ddd918a29287 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:17.812776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77035136-78bf-4c83-a9be-ddd918a29287 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:17.813054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77035136-78bf-4c83-a9be-ddd918a29287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:17.814968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec5d43-a92d-48f4-9142-59bbc8a47234 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:17.888527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:17.927286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec5d43-a92d-48f4-9142-59bbc8a47234 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:17.971150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95936b-5f14-442c-8b53-a6b3125b835b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:17.972151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95936b-5f14-442c-8b53-a6b3125b835b None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:17.972718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95936b-5f14-442c-8b53-a6b3125b835b None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:17.973099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95936b-5f14-442c-8b53-a6b3125b835b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:18.002192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77035136-78bf-4c83-a9be-ddd918a29287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:18.003838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77035136-78bf-4c83-a9be-ddd918a29287 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:18.074291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95936b-5f14-442c-8b53-a6b3125b835b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:18.076040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95936b-5f14-442c-8b53-a6b3125b835b None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:18.187507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:18.255199 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 129/264] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:18.260776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77035136-78bf-4c83-a9be-ddd918a29287 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:18.267833 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 136/265] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 27 04:17:18.273492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95936b-5f14-442c-8b53-a6b3125b835b None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:18.325484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:18.467934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77035136-78bf-4c83-a9be-ddd918a29287 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:18.502378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95936b-5f14-442c-8b53-a6b3125b835b None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:18.544957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93082550-898b-4661-875b-f54d5592fb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:18.546742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93082550-898b-4661-875b-f54d5592fb4c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:18.547232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93082550-898b-4661-875b-f54d5592fb4c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:18.547770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93082550-898b-4661-875b-f54d5592fb4c None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:18.549224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93082550-898b-4661-875b-f54d5592fb4c None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:18.550926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93082550-898b-4661-875b-f54d5592fb4c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:18.552940 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 130/266] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:18 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:18.559792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93082550-898b-4661-875b-f54d5592fb4c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:18.567296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9baf85-4905-4fa8-bf8c-6b46fe517889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:18.567935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9baf85-4905-4fa8-bf8c-6b46fe517889 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:18.569085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9baf85-4905-4fa8-bf8c-6b46fe517889 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:18.569381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9baf85-4905-4fa8-bf8c-6b46fe517889 None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:18.576189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9baf85-4905-4fa8-bf8c-6b46fe517889 None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:18.576577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9baf85-4905-4fa8-bf8c-6b46fe517889 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:18.578546 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 137/267] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:18 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:18.585342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9baf85-4905-4fa8-bf8c-6b46fe517889 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:18.665948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:18.766681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93082550-898b-4661-875b-f54d5592fb4c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:18.768467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:18.790308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9baf85-4905-4fa8-bf8c-6b46fe517889 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:18.827645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ef31c-adb2-4786-bc71-8f818d79f154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:18.829329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ef31c-adb2-4786-bc71-8f818d79f154 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:18.829597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ef31c-adb2-4786-bc71-8f818d79f154 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:18.829860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ef31c-adb2-4786-bc71-8f818d79f154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:18.830579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ef31c-adb2-4786-bc71-8f818d79f154 None admin] RBAC: Adding query filter params (role.id=d78f86d36ded425d9148c0b5781ab7b2, scope.project.id=c208601ac0cf4699975b00ec4d6d766e, user.id=b6d106e531e3473fbe6156ebfe08005d) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:18.830882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ef31c-adb2-4786-bc71-8f818d79f154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:18.832328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ef31c-adb2-4786-bc71-8f818d79f154 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:18.840794 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 131/268] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:18 2022] GET /identity/v3/role_assignments?user.id=b6d106e531e3473fbe6156ebfe08005d&scope.project.id=c208601ac0cf4699975b00ec4d6d766e&role.id=d78f86d36ded425d9148c0b5781ab7b2 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:18.842065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2f197-4ba7-460d-bf2f-208cca9344e0 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:18.843042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2f197-4ba7-460d-bf2f-208cca9344e0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:18.843801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2f197-4ba7-460d-bf2f-208cca9344e0 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:18.845728 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 132/269] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:18.847063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51780ad0-0d75-4890-af0f-d45c01a56608 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:18.847348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51780ad0-0d75-4890-af0f-d45c01a56608 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:18.847618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51780ad0-0d75-4890-af0f-d45c01a56608 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:18.849083 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 133/270] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:18.852262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da2f5c-ab61-4608-99fe-5984e77ec50b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:18.852799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da2f5c-ab61-4608-99fe-5984e77ec50b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:18.853272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da2f5c-ab61-4608-99fe-5984e77ec50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:18.878380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-06da2f5c-ab61-4608-99fe-5984e77ec50b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:18.880112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-06da2f5c-ab61-4608-99fe-5984e77ec50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:18.880902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c363bc-700b-4a2a-bcc6-3bf5bd748795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:18.881535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c363bc-700b-4a2a-bcc6-3bf5bd748795 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:18.881811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c363bc-700b-4a2a-bcc6-3bf5bd748795 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:18.882081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c363bc-700b-4a2a-bcc6-3bf5bd748795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:18.882815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c363bc-700b-4a2a-bcc6-3bf5bd748795 None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=c208601ac0cf4699975b00ec4d6d766e, user.id=b6d106e531e3473fbe6156ebfe08005d) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:18.883118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c363bc-700b-4a2a-bcc6-3bf5bd748795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:18.884606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c363bc-700b-4a2a-bcc6-3bf5bd748795 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:18.902795 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 138/271] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:18 2022] GET /identity/v3/role_assignments?user.id=b6d106e531e3473fbe6156ebfe08005d&scope.project.id=c208601ac0cf4699975b00ec4d6d766e&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:18.904120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0c5c2-67c1-4c68-9dad-fd57cb6081e8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:18.904501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0c5c2-67c1-4c68-9dad-fd57cb6081e8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:18.905338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0c5c2-67c1-4c68-9dad-fd57cb6081e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:18.952233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-dfd0c5c2-67c1-4c68-9dad-fd57cb6081e8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:18.952233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dfd0c5c2-67c1-4c68-9dad-fd57cb6081e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:18.989965 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 134/272] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:19.074546 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 139/273] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:19.289853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b978364-1e8b-49c5-8c61-38d815e47bcb None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:19.290176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b978364-1e8b-49c5-8c61-38d815e47bcb None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:19.290397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b978364-1e8b-49c5-8c61-38d815e47bcb None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:19.292061 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 135/274] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:19.297682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11237f-efa1-400d-bfac-1fa3fe123400 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:19.297970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11237f-efa1-400d-bfac-1fa3fe123400 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:19.298243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11237f-efa1-400d-bfac-1fa3fe123400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:19.323845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bb11237f-efa1-400d-bfac-1fa3fe123400 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:19.325108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bb11237f-efa1-400d-bfac-1fa3fe123400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:19.357704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:19.396270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b978364-1e8b-49c5-8c61-38d815e47bcb None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:19.417004 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 140/275] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:19.418549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4c2da-62c7-40a3-9a2c-48868d6752a8 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:19.418836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4c2da-62c7-40a3-9a2c-48868d6752a8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:19.419111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4c2da-62c7-40a3-9a2c-48868d6752a8 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:19.420452 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 141/276] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:19.421147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4c2da-62c7-40a3-9a2c-48868d6752a8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:19.544249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:19.553506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4c2da-62c7-40a3-9a2c-48868d6752a8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:19.557365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b978364-1e8b-49c5-8c61-38d815e47bcb None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:19.597294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bf902-096b-4c38-a2aa-a364f19ff2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:19.598230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bf902-096b-4c38-a2aa-a364f19ff2b6 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:19.598508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bf902-096b-4c38-a2aa-a364f19ff2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:19.598816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bf902-096b-4c38-a2aa-a364f19ff2b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:19.600069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bf902-096b-4c38-a2aa-a364f19ff2b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:19.601566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bf902-096b-4c38-a2aa-a364f19ff2b6 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:19.602414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ef313-4044-4734-b886-75ac914803f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:19.603045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ef313-4044-4734-b886-75ac914803f4 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:19.603318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ef313-4044-4734-b886-75ac914803f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:19.603596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ef313-4044-4734-b886-75ac914803f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:19.608269 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 136/277] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:19.608269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5a5a9-9c26-46ee-ba8e-ffbaa92d7dfd None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:19.608269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5a5a9-9c26-46ee-ba8e-ffbaa92d7dfd None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:19.608269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5a5a9-9c26-46ee-ba8e-ffbaa92d7dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:19.619479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ef313-4044-4734-b886-75ac914803f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:19.626647 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-846ef313-4044-4734-b886-75ac914803f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:19.626647 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:19.626647 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:19.626647 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:19.626647 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:19.626647 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:19.626647 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:19.626647 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:19.626647 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:19.626647 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:19.626647 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:19.626647 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:19.626647 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:19.626647 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:19.626647 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:19.626647 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:19.627639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:19.627639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:19.627639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:19.627639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:19.627639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:19.627639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:19.627639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:19.627639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:19.627639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:19.627639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:19.627639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:19.627639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:19.627639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:19.627639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:19.627639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:19.627639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:19.633069 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:19.633069 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:19.633069 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:19.633069 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:19.633069 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:19.633069 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:19.633069 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:19.633069 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:19.633069 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:19.633069 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:19.633069 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:19.633069 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:19.633069 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 142/278] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:19.633069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ef313-4044-4734-b886-75ac914803f4 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:19.633806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9cc5a5a9-9c26-46ee-ba8e-ffbaa92d7dfd None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:19.633806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9cc5a5a9-9c26-46ee-ba8e-ffbaa92d7dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:19.657135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:19.726601 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 137/279] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:19.727454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5a5a9-9c26-46ee-ba8e-ffbaa92d7dfd None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:19.759875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ef313-4044-4734-b886-75ac914803f4 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:19.804785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6989d4-d38e-4afa-83d3-635c813951df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:19.806203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6989d4-d38e-4afa-83d3-635c813951df None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:19.806478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6989d4-d38e-4afa-83d3-635c813951df None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:19.806749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6989d4-d38e-4afa-83d3-635c813951df None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:19.807411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6989d4-d38e-4afa-83d3-635c813951df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:19.809285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6989d4-d38e-4afa-83d3-635c813951df None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:19.832340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:19.843475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5a5a9-9c26-46ee-ba8e-ffbaa92d7dfd None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:19.879929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8de9ad-3db0-4a51-9935-2e922428fef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:19.880647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8de9ad-3db0-4a51-9935-2e922428fef5 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:19.880927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8de9ad-3db0-4a51-9935-2e922428fef5 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:19.881199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8de9ad-3db0-4a51-9935-2e922428fef5 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:19.881863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8de9ad-3db0-4a51-9935-2e922428fef5 None admin] RBAC: Adding query filter params (name=member) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:19.882201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8de9ad-3db0-4a51-9935-2e922428fef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:19.886996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8de9ad-3db0-4a51-9935-2e922428fef5 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:19.894594 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 138/280] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:19.895439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8de9ad-3db0-4a51-9935-2e922428fef5 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:19.923704 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 143/281] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:17:19 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:17:19.923704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6989d4-d38e-4afa-83d3-635c813951df None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:20.059748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8de9ad-3db0-4a51-9935-2e922428fef5 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:20.064068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:20.091063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6989d4-d38e-4afa-83d3-635c813951df None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:20.106312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220be2f3-1699-4f54-9619-88dc89185d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:20.106950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220be2f3-1699-4f54-9619-88dc89185d15 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:20.107235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220be2f3-1699-4f54-9619-88dc89185d15 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:20.107506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220be2f3-1699-4f54-9619-88dc89185d15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:20.120263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220be2f3-1699-4f54-9619-88dc89185d15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:20.128344 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-220be2f3-1699-4f54-9619-88dc89185d15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:20.128344 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:20.128344 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:20.128344 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:20.128344 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:20.128344 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:20.128344 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:20.128344 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:20.128344 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:20.128344 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:20.128344 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:20.128344 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:20.128344 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:20.128344 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:20.128344 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:20.128344 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:20.129274 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:20.129274 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:20.129274 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:20.129274 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:20.129274 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:20.129274 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:20.129274 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:20.129274 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:20.129274 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:20.129274 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:20.129274 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:20.129274 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:20.129274 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:20.129274 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:20.129274 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:20.129274 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:20.130301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:20.130301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:20.130301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:20.130301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:20.130301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:20.130301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:20.130301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:20.130301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:20.130301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:20.130301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:20.130301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:20.130301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:20.130301 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 139/282] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:20.131488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220be2f3-1699-4f54-9619-88dc89185d15 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:20.145888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93039321-f647-40ad-bc2a-f91d97bd968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:20.146538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93039321-f647-40ad-bc2a-f91d97bd968e None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:20.146818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93039321-f647-40ad-bc2a-f91d97bd968e None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:20.147091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93039321-f647-40ad-bc2a-f91d97bd968e None admin] PATH_INFO: `/v3/users/1159c32c1dd3477aab1afa48197558cc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:20.152462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:20.164502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93039321-f647-40ad-bc2a-f91d97bd968e None admin] RBAC: Authorizing `identity:get_user(user_id=1159c32c1dd3477aab1afa48197558cc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:20.165316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93039321-f647-40ad-bc2a-f91d97bd968e None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:20.167109 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 144/283] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:19 2022] GET /identity/v3/users/1159c32c1dd3477aab1afa48197558cc => generated 293 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:20.170872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93039321-f647-40ad-bc2a-f91d97bd968e None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:20.297278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220be2f3-1699-4f54-9619-88dc89185d15 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:20.347839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93039321-f647-40ad-bc2a-f91d97bd968e None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:20.350054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204434ca-95f4-4528-bb6d-a21865b9f12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:20.352214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204434ca-95f4-4528-bb6d-a21865b9f12e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:20.352591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204434ca-95f4-4528-bb6d-a21865b9f12e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:20.352861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204434ca-95f4-4528-bb6d-a21865b9f12e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:20.367146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204434ca-95f4-4528-bb6d-a21865b9f12e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:20.373779 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-204434ca-95f4-4528-bb6d-a21865b9f12e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:17:20.373779 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:20.373779 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:20.373779 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:20.373779 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:20.373779 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:20.373779 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:20.373779 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:20.373779 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:20.373779 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:20.373779 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:20.373779 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:20.373779 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:20.373779 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:20.373779 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:20.373779 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:20.375045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:20.375045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:20.375045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:20.375045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:20.375045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:20.375045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:20.375045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:20.375045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:20.375045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:20.375045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:20.375045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:20.375045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:20.375045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:20.375045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:20.375045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:20.375045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:20.376399 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:20.376399 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:20.376399 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:20.376399 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:20.376399 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:20.376399 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:20.376399 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:20.376399 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:20.376399 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:20.376399 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:20.376399 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:17:20.376399 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:20.376399 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 140/284] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:20.382260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204434ca-95f4-4528-bb6d-a21865b9f12e None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:20.395474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4f112-484c-4bc7-bfc6-70f9601c6cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:20.397014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4f112-484c-4bc7-bfc6-70f9601c6cee None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:20.398055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4f112-484c-4bc7-bfc6-70f9601c6cee None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:20.398380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4f112-484c-4bc7-bfc6-70f9601c6cee None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:20.399683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4f112-484c-4bc7-bfc6-70f9601c6cee None admin] RBAC: Adding query filter params (name=member) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:20.399996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4f112-484c-4bc7-bfc6-70f9601c6cee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:20.401437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4f112-484c-4bc7-bfc6-70f9601c6cee None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:20.403441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:20.419949 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 145/285] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:20.422027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4f112-484c-4bc7-bfc6-70f9601c6cee None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:20.483759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:20.512076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204434ca-95f4-4528-bb6d-a21865b9f12e None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:20.550565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4f112-484c-4bc7-bfc6-70f9601c6cee None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:20.551648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1c52c-5347-4e22-8e34-ae5ee53a1a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:20.552923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1c52c-5347-4e22-8e34-ae5ee53a1a8e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:20.553453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1c52c-5347-4e22-8e34-ae5ee53a1a8e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:20.553875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1c52c-5347-4e22-8e34-ae5ee53a1a8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:20.554745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1c52c-5347-4e22-8e34-ae5ee53a1a8e None admin] RBAC: Adding query filter params (role.id=5a4c2cf9b8d849398625913504b4b172, user.id=1159c32c1dd3477aab1afa48197558cc, scope.system=all) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:20.555199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1c52c-5347-4e22-8e34-ae5ee53a1a8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:20.556933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1c52c-5347-4e22-8e34-ae5ee53a1a8e None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:20.564918 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 141/286] 10.222.0.76 () {56 vars in 1308 bytes} [Sat Aug 27 04:17:20 2022] GET /identity/v3/role_assignments?user.id=1159c32c1dd3477aab1afa48197558cc&scope.system=all&role.id=5a4c2cf9b8d849398625913504b4b172 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:20.566951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1c52c-5347-4e22-8e34-ae5ee53a1a8e None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:20.626851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b1d55-cd58-4043-b81c-9075df3a9821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:20.627562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b1d55-cd58-4043-b81c-9075df3a9821 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:20.627960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b1d55-cd58-4043-b81c-9075df3a9821 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:20.628386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b1d55-cd58-4043-b81c-9075df3a9821 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:20.629176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b1d55-cd58-4043-b81c-9075df3a9821 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:20.629577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b1d55-cd58-4043-b81c-9075df3a9821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:20.631116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b1d55-cd58-4043-b81c-9075df3a9821 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:20.658578 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 146/287] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:20.664348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b1d55-cd58-4043-b81c-9075df3a9821 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:20.731430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1c52c-5347-4e22-8e34-ae5ee53a1a8e None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:20.765139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:20.773455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6963f-c29e-4f91-b46a-b5fde02cce01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:20.774277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6963f-c29e-4f91-b46a-b5fde02cce01 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:20.774773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6963f-c29e-4f91-b46a-b5fde02cce01 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:20.775166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6963f-c29e-4f91-b46a-b5fde02cce01 None admin] PATH_INFO: `/v3/users/4195235c8288463da527fe8b25c0ca84` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:20.782969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6963f-c29e-4f91-b46a-b5fde02cce01 None admin] RBAC: Authorizing `identity:get_user(user_id=4195235c8288463da527fe8b25c0ca84)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:20.782969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6963f-c29e-4f91-b46a-b5fde02cce01 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:20.782969 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 142/288] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:20 2022] GET /identity/v3/users/4195235c8288463da527fe8b25c0ca84 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:20.787466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6963f-c29e-4f91-b46a-b5fde02cce01 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:20.798089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:20.862931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b1d55-cd58-4043-b81c-9075df3a9821 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:20.917807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6963f-c29e-4f91-b46a-b5fde02cce01 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:20.948869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa08b55-1806-45f2-8efd-e3a97604a57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:20.949518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa08b55-1806-45f2-8efd-e3a97604a57d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:20.949797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa08b55-1806-45f2-8efd-e3a97604a57d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:20.950071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa08b55-1806-45f2-8efd-e3a97604a57d None admin] PATH_INFO: `/v3/users/71d2a5fb05e441c6a98c74f3c6afa60d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:20.951221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa08b55-1806-45f2-8efd-e3a97604a57d None admin] RBAC: Authorizing `identity:get_user(user_id=71d2a5fb05e441c6a98c74f3c6afa60d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:20.952929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa08b55-1806-45f2-8efd-e3a97604a57d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:20.958866 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 147/289] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:20 2022] GET /identity/v3/users/71d2a5fb05e441c6a98c74f3c6afa60d => generated 297 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:20.961128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa08b55-1806-45f2-8efd-e3a97604a57d None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:20.974187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94864b10-d57f-4d5a-a093-13f080f16b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:20.975073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94864b10-d57f-4d5a-a093-13f080f16b2b None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:20.975588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94864b10-d57f-4d5a-a093-13f080f16b2b None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:20.976055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94864b10-d57f-4d5a-a093-13f080f16b2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:21.078877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94864b10-d57f-4d5a-a093-13f080f16b2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:21.080623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94864b10-d57f-4d5a-a093-13f080f16b2b None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:21.094843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:21.186963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa08b55-1806-45f2-8efd-e3a97604a57d None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:21.226945 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 143/290] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 27 04:17:21.232496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94864b10-d57f-4d5a-a093-13f080f16b2b None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:21.254548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:21.283702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c746e-c985-4f29-96e2-509601ad98f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:21.284379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c746e-c985-4f29-96e2-509601ad98f7 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:21.284659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c746e-c985-4f29-96e2-509601ad98f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:21.284927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c746e-c985-4f29-96e2-509601ad98f7 None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:21.288873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c746e-c985-4f29-96e2-509601ad98f7 None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:21.290333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c746e-c985-4f29-96e2-509601ad98f7 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:21.292318 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 148/291] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:20 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:21.298087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c746e-c985-4f29-96e2-509601ad98f7 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:21.351084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94864b10-d57f-4d5a-a093-13f080f16b2b None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:21.359915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:21.395211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c4667-ca9e-4ad9-875a-6c448095f84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:21.395850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c4667-ca9e-4ad9-875a-6c448095f84a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:21.396130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c4667-ca9e-4ad9-875a-6c448095f84a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:21.396488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c4667-ca9e-4ad9-875a-6c448095f84a None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:21.398628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c4667-ca9e-4ad9-875a-6c448095f84a None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:21.400067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c4667-ca9e-4ad9-875a-6c448095f84a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:21.401951 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 144/292] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:21 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:21.409580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c4667-ca9e-4ad9-875a-6c448095f84a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:21.482159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c746e-c985-4f29-96e2-509601ad98f7 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:21.539347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c4667-ca9e-4ad9-875a-6c448095f84a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:21.555247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d6614-f77a-479b-97e6-b13df076fcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:21.556002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d6614-f77a-479b-97e6-b13df076fcad None admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:21.556312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d6614-f77a-479b-97e6-b13df076fcad None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:21.556640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d6614-f77a-479b-97e6-b13df076fcad None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e/users/71d2a5fb05e441c6a98c74f3c6afa60d/roles/fb32d9ff656c423591f4b6227e950f99` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:21.558551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d6614-f77a-479b-97e6-b13df076fcad None admin] RBAC: Authorizing `identity:create_grant(project_id=c208601ac0cf4699975b00ec4d6d766e, user_id=71d2a5fb05e441c6a98c74f3c6afa60d, role_id=fb32d9ff656c423591f4b6227e950f99)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:21.559998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d6614-f77a-479b-97e6-b13df076fcad None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:21.601719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b8ff9-fb43-458a-8f29-95c65b2892f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:21.602383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b8ff9-fb43-458a-8f29-95c65b2892f9 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:21.602658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b8ff9-fb43-458a-8f29-95c65b2892f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:21.602930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b8ff9-fb43-458a-8f29-95c65b2892f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:21.603753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b8ff9-fb43-458a-8f29-95c65b2892f9 None admin] RBAC: Adding query filter params (role.id=5a4c2cf9b8d849398625913504b4b172, scope.project.id=c208601ac0cf4699975b00ec4d6d766e, user.id=4195235c8288463da527fe8b25c0ca84) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:21.604065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b8ff9-fb43-458a-8f29-95c65b2892f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:21.605626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b8ff9-fb43-458a-8f29-95c65b2892f9 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:21.613113 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 145/293] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:21 2022] GET /identity/v3/role_assignments?user.id=4195235c8288463da527fe8b25c0ca84&scope.project.id=c208601ac0cf4699975b00ec4d6d766e&role.id=5a4c2cf9b8d849398625913504b4b172 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:21.638331 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 149/294] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:17:21 2022] PUT /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e/users/71d2a5fb05e441c6a98c74f3c6afa60d/roles/fb32d9ff656c423591f4b6227e950f99 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:17:22.112882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5c9a7-700e-4346-88e4-49a132eb506e None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:22.113247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5c9a7-700e-4346-88e4-49a132eb506e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:22.113413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5c9a7-700e-4346-88e4-49a132eb506e None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:22.115022 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 146/295] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:22.120536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9d2f-1d20-4cca-9395-afb6cb50545e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:22.120821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9d2f-1d20-4cca-9395-afb6cb50545e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:22.121096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9d2f-1d20-4cca-9395-afb6cb50545e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:22.140542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-827f9d2f-1d20-4cca-9395-afb6cb50545e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:22.141722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-827f9d2f-1d20-4cca-9395-afb6cb50545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:22.199492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:22.227331 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 150/296] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:22.341292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97f34a-a680-47fa-b864-06daa521c162 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:22.341568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97f34a-a680-47fa-b864-06daa521c162 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:22.341840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97f34a-a680-47fa-b864-06daa521c162 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:22.344052 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 147/297] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:22.349709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497468e0-ca7e-49ed-b68d-489c838cd967 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:22.350124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497468e0-ca7e-49ed-b68d-489c838cd967 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:22.350505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497468e0-ca7e-49ed-b68d-489c838cd967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:22.368961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-497468e0-ca7e-49ed-b68d-489c838cd967 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:22.370120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-497468e0-ca7e-49ed-b68d-489c838cd967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:22.439215 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 151/298] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:22.521108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97f34a-a680-47fa-b864-06daa521c162 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:22.627314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:22.692881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97f34a-a680-47fa-b864-06daa521c162 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:22.727785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49a398-0fa0-49ff-8d40-247b690cb43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:22.728442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49a398-0fa0-49ff-8d40-247b690cb43c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:22.728723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49a398-0fa0-49ff-8d40-247b690cb43c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:22.728995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49a398-0fa0-49ff-8d40-247b690cb43c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:22.737894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497468e0-ca7e-49ed-b68d-489c838cd967 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:22.741392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49a398-0fa0-49ff-8d40-247b690cb43c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:22.746482 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-7d49a398-0fa0-49ff-8d40-247b690cb43c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:17:22.746482 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:22.746482 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:22.746482 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:22.746482 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:22.746482 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:22.746482 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:22.746482 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:22.746482 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:22.746482 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:22.746482 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:22.746482 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:22.746482 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:22.746482 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:22.746482 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:22.746482 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:22.747548 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:22.747548 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:22.747548 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:22.747548 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:22.747548 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:22.747548 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:22.747548 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:22.747548 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:22.747548 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:22.747548 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:22.747548 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:22.747548 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:22.747548 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:22.747548 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:22.747548 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:22.747548 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:22.748914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:22.748914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:22.748914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:22.748914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:22.748914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:22.748914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:22.748914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:22.748914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:22.748914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:22.748914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:22.748914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:17:22.748914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:22.748914 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 148/299] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:22.753838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49a398-0fa0-49ff-8d40-247b690cb43c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:22.855307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:22.860140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49a398-0fa0-49ff-8d40-247b690cb43c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:22.865835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497468e0-ca7e-49ed-b68d-489c838cd967 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:22.881286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:22.893663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cca191-3689-46ca-bbc1-700118531f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:22.894273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cca191-3689-46ca-bbc1-700118531f9c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:22.894552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cca191-3689-46ca-bbc1-700118531f9c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:22.894821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cca191-3689-46ca-bbc1-700118531f9c None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:22.895477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cca191-3689-46ca-bbc1-700118531f9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:22.895777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cca191-3689-46ca-bbc1-700118531f9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:22.897265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cca191-3689-46ca-bbc1-700118531f9c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:22.903001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68548805-ebdb-4162-b80b-d97850ee3a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:22.903307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68548805-ebdb-4162-b80b-d97850ee3a93 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:22.903591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68548805-ebdb-4162-b80b-d97850ee3a93 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:22.903867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68548805-ebdb-4162-b80b-d97850ee3a93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:22.905582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68548805-ebdb-4162-b80b-d97850ee3a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:22.907016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68548805-ebdb-4162-b80b-d97850ee3a93 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:22.907996 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 149/300] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:22.908618 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 152/301] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:22.911264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d6531-9f91-470a-9f05-b61c3302d481 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:22.911264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d6531-9f91-470a-9f05-b61c3302d481 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:22.911264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d6531-9f91-470a-9f05-b61c3302d481 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:22.911264 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 150/302] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:22.916664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68548805-ebdb-4162-b80b-d97850ee3a93 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:22.916962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f50a18-3381-4bc4-9ec7-29279f0feda6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:22.917243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f50a18-3381-4bc4-9ec7-29279f0feda6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:22.917509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f50a18-3381-4bc4-9ec7-29279f0feda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:22.936243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-13f50a18-3381-4bc4-9ec7-29279f0feda6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:22.937531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-13f50a18-3381-4bc4-9ec7-29279f0feda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:23.015359 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 151/303] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:23.016236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f50a18-3381-4bc4-9ec7-29279f0feda6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:23.033838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68548805-ebdb-4162-b80b-d97850ee3a93 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:23.079507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f3cbd-057c-4405-b1a3-269c964e5ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:23.081110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f3cbd-057c-4405-b1a3-269c964e5ae7 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:23.081613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f3cbd-057c-4405-b1a3-269c964e5ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:23.082314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f3cbd-057c-4405-b1a3-269c964e5ae7 None admin] PATH_INFO: `/v3/users/f5b801462eeb4df6aa7785dd6cdf220c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:23.100711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f3cbd-057c-4405-b1a3-269c964e5ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=f5b801462eeb4df6aa7785dd6cdf220c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:23.102206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f3cbd-057c-4405-b1a3-269c964e5ae7 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:23.109001 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 153/304] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:22 2022] GET /identity/v3/users/f5b801462eeb4df6aa7785dd6cdf220c => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:23.109637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f3cbd-057c-4405-b1a3-269c964e5ae7 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:23.124025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:23.133988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f50a18-3381-4bc4-9ec7-29279f0feda6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:23.167243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:23.173902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6780552-89e0-4a51-89b7-ec7ad9bc70b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:23.174777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6780552-89e0-4a51-89b7-ec7ad9bc70b9 None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:23.175231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6780552-89e0-4a51-89b7-ec7ad9bc70b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:23.175667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6780552-89e0-4a51-89b7-ec7ad9bc70b9 None admin] PATH_INFO: `/v3/groups` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:23.176545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6780552-89e0-4a51-89b7-ec7ad9bc70b9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:23.178221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6780552-89e0-4a51-89b7-ec7ad9bc70b9 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:23.229815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f3cbd-057c-4405-b1a3-269c964e5ae7 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:23.260305 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 152/305] 10.222.0.76 () {60 vars in 1134 bytes} [Sat Aug 27 04:17:23 2022] POST /identity/v3/groups => generated 229 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:17:23.273240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22eccc-b2ff-44e9-b252-1898af43fff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:23.273862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22eccc-b2ff-44e9-b252-1898af43fff2 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:23.274145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22eccc-b2ff-44e9-b252-1898af43fff2 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:23.274473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22eccc-b2ff-44e9-b252-1898af43fff2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:23.275297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22eccc-b2ff-44e9-b252-1898af43fff2 None admin] RBAC: Adding query filter params (role.id=fb32d9ff656c423591f4b6227e950f99, user.id=f5b801462eeb4df6aa7785dd6cdf220c, scope.system=all) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:23.275613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22eccc-b2ff-44e9-b252-1898af43fff2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:23.277192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22eccc-b2ff-44e9-b252-1898af43fff2 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:23.284543 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 154/306] 10.222.0.76 () {56 vars in 1308 bytes} [Sat Aug 27 04:17:23 2022] GET /identity/v3/role_assignments?user.id=f5b801462eeb4df6aa7785dd6cdf220c&scope.system=all&role.id=fb32d9ff656c423591f4b6227e950f99 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:23.294708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6780552-89e0-4a51-89b7-ec7ad9bc70b9 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:23.416509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6780552-89e0-4a51-89b7-ec7ad9bc70b9 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:23.462707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4b484-0016-40bc-8e5c-85011c305116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:23.463691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4b484-0016-40bc-8e5c-85011c305116 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:23.463969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4b484-0016-40bc-8e5c-85011c305116 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:23.464272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4b484-0016-40bc-8e5c-85011c305116 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:23.475813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4b484-0016-40bc-8e5c-85011c305116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:23.481371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-40a4b484-0016-40bc-8e5c-85011c305116 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:23.481371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:23.481371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:23.481371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:23.481371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:23.481371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:23.481371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:23.481371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:23.481371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:23.481371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:23.481371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:23.481371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:23.481371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:23.481371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:23.481371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:23.481371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:23.486284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:23.486284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:23.486284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:23.486284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:23.486284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:23.486284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:23.486284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:23.486284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:23.486284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:23.486284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:23.486284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:23.486284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:23.486284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:23.486284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:23.486284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:23.486284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:23.487120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:23.487120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:23.487120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:23.487120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:23.487120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:23.487120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:23.487120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:23.487120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:23.487120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:23.487120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:23.487120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:23.487120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:23.487120 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 153/307] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:23.488692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22eccc-b2ff-44e9-b252-1898af43fff2 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:23.659119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22eccc-b2ff-44e9-b252-1898af43fff2 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:23.661465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:23.695368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54171fe2-23ab-42b4-a15d-ea74d4c77536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:23.695897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54171fe2-23ab-42b4-a15d-ea74d4c77536 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:23.696184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54171fe2-23ab-42b4-a15d-ea74d4c77536 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:23.696516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54171fe2-23ab-42b4-a15d-ea74d4c77536 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:23.697185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54171fe2-23ab-42b4-a15d-ea74d4c77536 None admin] RBAC: Adding query filter params (name=member) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:23.697484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54171fe2-23ab-42b4-a15d-ea74d4c77536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:23.698864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54171fe2-23ab-42b4-a15d-ea74d4c77536 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:23.712288 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 155/308] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:23.714154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4b484-0016-40bc-8e5c-85011c305116 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:23.728426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:23.834672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4b484-0016-40bc-8e5c-85011c305116 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:23.871841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644243f-6242-478c-90a6-1a791c7bea3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:23.872495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644243f-6242-478c-90a6-1a791c7bea3d None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:23.872769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644243f-6242-478c-90a6-1a791c7bea3d None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:23.873034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644243f-6242-478c-90a6-1a791c7bea3d None admin] PATH_INFO: `/v3/users/1159c32c1dd3477aab1afa48197558cc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:23.874864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644243f-6242-478c-90a6-1a791c7bea3d None admin] RBAC: Authorizing `identity:get_user(user_id=1159c32c1dd3477aab1afa48197558cc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:23.876330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644243f-6242-478c-90a6-1a791c7bea3d None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:23.878196 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 154/309] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:23 2022] GET /identity/v3/users/1159c32c1dd3477aab1afa48197558cc => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:23.883599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54171fe2-23ab-42b4-a15d-ea74d4c77536 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:23.888387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31ee1-3be1-4f28-89ac-674d1377ec67 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:23.888387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31ee1-3be1-4f28-89ac-674d1377ec67 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:23.888387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31ee1-3be1-4f28-89ac-674d1377ec67 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:23.888387 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 155/310] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:23.894677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412ec93-2154-42e7-bb94-3f0f838e145f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:23.895232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412ec93-2154-42e7-bb94-3f0f838e145f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:23.895728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412ec93-2154-42e7-bb94-3f0f838e145f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:23.918638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b412ec93-2154-42e7-bb94-3f0f838e145f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:23.921530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b412ec93-2154-42e7-bb94-3f0f838e145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:24.003599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54171fe2-23ab-42b4-a15d-ea74d4c77536 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:24.013357 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 156/311] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:24.040298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ea3a2-c83e-4237-8cde-d9e3e954a89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:24.040945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ea3a2-c83e-4237-8cde-d9e3e954a89f None admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:24.041223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ea3a2-c83e-4237-8cde-d9e3e954a89f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:24.041497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ea3a2-c83e-4237-8cde-d9e3e954a89f None admin] PATH_INFO: `/v3/system/users/1159c32c1dd3477aab1afa48197558cc/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:24.042884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ea3a2-c83e-4237-8cde-d9e3e954a89f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1159c32c1dd3477aab1afa48197558cc, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:24.044299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ea3a2-c83e-4237-8cde-d9e3e954a89f None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:24.141074 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 156/312] 10.222.0.76 () {58 vars in 1334 bytes} [Sat Aug 27 04:17:23 2022] PUT /identity/v3/system/users/1159c32c1dd3477aab1afa48197558cc/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:17:24.301653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412ec93-2154-42e7-bb94-3f0f838e145f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:24.313803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:24.412553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412ec93-2154-42e7-bb94-3f0f838e145f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:24.449957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f7da0-cfda-4d60-a69d-02f37be2e33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:24.450587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f7da0-cfda-4d60-a69d-02f37be2e33e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:24.450865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f7da0-cfda-4d60-a69d-02f37be2e33e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:24.451137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f7da0-cfda-4d60-a69d-02f37be2e33e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:24.462944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f7da0-cfda-4d60-a69d-02f37be2e33e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:24.469038 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-d33f7da0-cfda-4d60-a69d-02f37be2e33e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:17:24.469038 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:24.469038 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:24.469038 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:24.469038 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:24.469038 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:24.469038 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:24.469038 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:24.469038 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:24.469038 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:24.469038 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:24.469038 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:24.469038 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:24.469038 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:24.469038 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:24.469038 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:24.469916 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:24.469916 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:24.469916 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:24.469916 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:24.469916 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:24.469916 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:24.469916 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:24.469916 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:24.469916 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:24.469916 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:24.469916 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:24.469916 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:24.469916 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:24.469916 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:24.469916 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:24.469916 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:24.471301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:24.471301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:24.471301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:24.471301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:24.471301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:24.471301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:24.471301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:24.471301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:24.471301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:24.471301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:24.471301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:17:24.471301 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:24.471301 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 157/313] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:24.477262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ea3a2-c83e-4237-8cde-d9e3e954a89f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:24.515874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:24.590142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ea3a2-c83e-4237-8cde-d9e3e954a89f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:24.625685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63513aee-602e-45a2-ad45-4301f11d6bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:24.626288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513aee-602e-45a2-ad45-4301f11d6bc4 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:24.626565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513aee-602e-45a2-ad45-4301f11d6bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:24.626834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513aee-602e-45a2-ad45-4301f11d6bc4 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:24.627496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63513aee-602e-45a2-ad45-4301f11d6bc4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:24.627794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63513aee-602e-45a2-ad45-4301f11d6bc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:24.629200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63513aee-602e-45a2-ad45-4301f11d6bc4 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:24.638050 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 157/314] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:24.643829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f7da0-cfda-4d60-a69d-02f37be2e33e None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:24.719296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:24.755069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f7da0-cfda-4d60-a69d-02f37be2e33e None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:24.791718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c386979-7350-4c29-818b-1578ee3c08a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:24.792379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c386979-7350-4c29-818b-1578ee3c08a3 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:24.792657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c386979-7350-4c29-818b-1578ee3c08a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:24.792928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c386979-7350-4c29-818b-1578ee3c08a3 None admin] PATH_INFO: `/v3/users/71d2a5fb05e441c6a98c74f3c6afa60d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:24.794068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c386979-7350-4c29-818b-1578ee3c08a3 None admin] RBAC: Authorizing `identity:get_user(user_id=71d2a5fb05e441c6a98c74f3c6afa60d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:24.796690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c386979-7350-4c29-818b-1578ee3c08a3 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:24.798589 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 158/315] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:24 2022] GET /identity/v3/users/71d2a5fb05e441c6a98c74f3c6afa60d => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:24.805461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63513aee-602e-45a2-ad45-4301f11d6bc4 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:24.902630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:24.911940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63513aee-602e-45a2-ad45-4301f11d6bc4 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:24.950893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e898d-b201-4549-9267-9d6bbd6e0c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:24.951624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e898d-b201-4549-9267-9d6bbd6e0c62 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:24.952242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e898d-b201-4549-9267-9d6bbd6e0c62 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:24.952242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e898d-b201-4549-9267-9d6bbd6e0c62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:25.023587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e898d-b201-4549-9267-9d6bbd6e0c62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:25.025083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e898d-b201-4549-9267-9d6bbd6e0c62 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:25.117409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:25.126561 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 158/316] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:25.132188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c386979-7350-4c29-818b-1578ee3c08a3 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:25.242793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c386979-7350-4c29-818b-1578ee3c08a3 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:25.281262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bd4c5-8493-48e0-a8c7-ccb28faec90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:25.282261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bd4c5-8493-48e0-a8c7-ccb28faec90d None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:25.282739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bd4c5-8493-48e0-a8c7-ccb28faec90d None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:25.283226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bd4c5-8493-48e0-a8c7-ccb28faec90d None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:25.284585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bd4c5-8493-48e0-a8c7-ccb28faec90d None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:25.286204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bd4c5-8493-48e0-a8c7-ccb28faec90d None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:25.288370 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 159/317] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:25 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:25.293905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e898d-b201-4549-9267-9d6bbd6e0c62 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:25.396732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e898d-b201-4549-9267-9d6bbd6e0c62 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:25.432572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba2f95-7f8e-48aa-95bd-04cedc0b44ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:25.433620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba2f95-7f8e-48aa-95bd-04cedc0b44ba None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:25.434108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba2f95-7f8e-48aa-95bd-04cedc0b44ba None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:25.434651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba2f95-7f8e-48aa-95bd-04cedc0b44ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:25.435622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba2f95-7f8e-48aa-95bd-04cedc0b44ba None admin] RBAC: Adding query filter params (role.id=fb32d9ff656c423591f4b6227e950f99, scope.project.id=c208601ac0cf4699975b00ec4d6d766e, user.id=71d2a5fb05e441c6a98c74f3c6afa60d) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:25.436227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba2f95-7f8e-48aa-95bd-04cedc0b44ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:25.436996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eeed9-fccb-46b2-b374-2c228df9fcdc None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:25.437519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eeed9-fccb-46b2-b374-2c228df9fcdc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:25.437892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba2f95-7f8e-48aa-95bd-04cedc0b44ba None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:25.438211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eeed9-fccb-46b2-b374-2c228df9fcdc None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:25.440088 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 160/318] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:25.445445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f80b46-303b-48a6-95d7-4d68681e0daa None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:25.445998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f80b46-303b-48a6-95d7-4d68681e0daa None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:25.446500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f80b46-303b-48a6-95d7-4d68681e0daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:25.448485 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 159/319] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:25 2022] GET /identity/v3/role_assignments?user.id=71d2a5fb05e441c6a98c74f3c6afa60d&scope.project.id=c208601ac0cf4699975b00ec4d6d766e&role.id=fb32d9ff656c423591f4b6227e950f99 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:25.456348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:25.469078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-69f80b46-303b-48a6-95d7-4d68681e0daa None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:25.470769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-69f80b46-303b-48a6-95d7-4d68681e0daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:25.473868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcc923-3777-499a-ac9f-c863e024caf5 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:25.474370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcc923-3777-499a-ac9f-c863e024caf5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:25.474791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcc923-3777-499a-ac9f-c863e024caf5 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:25.476692 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 160/320] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:17:25.482743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e30f34-d8a8-403f-8be8-9e7507d3ca51 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:25.483219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e30f34-d8a8-403f-8be8-9e7507d3ca51 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:25.483627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e30f34-d8a8-403f-8be8-9e7507d3ca51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:25.502918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-56e30f34-d8a8-403f-8be8-9e7507d3ca51 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:25.504364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-56e30f34-d8a8-403f-8be8-9e7507d3ca51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:25.553178 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 161/321] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:25.568599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:25.583932 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 161/322] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:25.839106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f80b46-303b-48a6-95d7-4d68681e0daa None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:25.861634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e30f34-d8a8-403f-8be8-9e7507d3ca51 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:25.959551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f80b46-303b-48a6-95d7-4d68681e0daa None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:25.974063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e30f34-d8a8-403f-8be8-9e7507d3ca51 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:26.001013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cc375-b58b-4953-a7f6-32e2388468b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:26.001893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cc375-b58b-4953-a7f6-32e2388468b3 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:26.002414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cc375-b58b-4953-a7f6-32e2388468b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:26.002893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cc375-b58b-4953-a7f6-32e2388468b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:26.005647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:26.013900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cf065-209a-4de2-b025-50a6e98fb718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:26.014635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cf065-209a-4de2-b025-50a6e98fb718 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:26.014912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cf065-209a-4de2-b025-50a6e98fb718 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:26.015188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cf065-209a-4de2-b025-50a6e98fb718 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:26.016351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805cf065-209a-4de2-b025-50a6e98fb718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:26.017505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cc375-b58b-4953-a7f6-32e2388468b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:26.017820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805cf065-209a-4de2-b025-50a6e98fb718 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:26.019688 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 162/323] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:26.028689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cf065-209a-4de2-b025-50a6e98fb718 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:26.028854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-244cc375-b58b-4953-a7f6-32e2388468b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:17:26.028854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:26.028854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:26.028854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:26.028854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:26.028854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:26.028854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:26.028854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:26.028854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:26.028854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:26.028854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:26.028854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:26.028854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:26.028854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:26.028854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:26.028854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:26.029952 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:26.029952 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:26.029952 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:26.029952 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:26.029952 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:26.029952 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:26.029952 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:26.029952 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:26.029952 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:26.029952 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:26.029952 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:26.029952 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:26.029952 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:26.029952 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:26.029952 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:26.029952 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:26.030935 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:26.030935 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:26.030935 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:26.030935 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:26.030935 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:26.030935 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:26.030935 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:26.030935 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:26.030935 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:26.030935 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:26.030935 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:17:26.030935 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:26.030935 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 162/324] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:26.034041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cc375-b58b-4953-a7f6-32e2388468b3 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:26.088766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:26.133210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cf065-209a-4de2-b025-50a6e98fb718 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:26.136613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cc375-b58b-4953-a7f6-32e2388468b3 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:26.166379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d392c2-95cb-4272-a4c6-eead2abf8a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:26.166970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d392c2-95cb-4272-a4c6-eead2abf8a02 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:26.167244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d392c2-95cb-4272-a4c6-eead2abf8a02 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:26.167512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d392c2-95cb-4272-a4c6-eead2abf8a02 None admin] PATH_INFO: `/v3/groups` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:26.168130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d392c2-95cb-4272-a4c6-eead2abf8a02 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:26.169585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d392c2-95cb-4272-a4c6-eead2abf8a02 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:26.169743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6bd5f-c25f-4931-b850-f2c57b392f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:26.171140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6bd5f-c25f-4931-b850-f2c57b392f8e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:26.171505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6bd5f-c25f-4931-b850-f2c57b392f8e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:26.171779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6bd5f-c25f-4931-b850-f2c57b392f8e None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:26.172470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6bd5f-c25f-4931-b850-f2c57b392f8e None admin] RBAC: Adding query filter params (name=reader) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:26.172773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6bd5f-c25f-4931-b850-f2c57b392f8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:26.174136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6bd5f-c25f-4931-b850-f2c57b392f8e None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:26.182519 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 163/325] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:26.183712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b7aa-a665-44ea-af82-aaba1ecfab2e None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:26.183962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b7aa-a665-44ea-af82-aaba1ecfab2e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:26.184266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b7aa-a665-44ea-af82-aaba1ecfab2e None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:26.185461 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 164/326] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:26.188821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46b7aa-a665-44ea-af82-aaba1ecfab2e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:26.244685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:26.258432 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 163/327] 10.222.0.76 () {60 vars in 1134 bytes} [Sat Aug 27 04:17:26 2022] POST /identity/v3/groups => generated 226 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:17:26.259781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c778d2e-e1fe-483e-9796-718fb48f6382 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:26.260066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c778d2e-e1fe-483e-9796-718fb48f6382 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:26.260361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c778d2e-e1fe-483e-9796-718fb48f6382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:26.279526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9c778d2e-e1fe-483e-9796-718fb48f6382 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:26.280800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9c778d2e-e1fe-483e-9796-718fb48f6382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:26.300662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46b7aa-a665-44ea-af82-aaba1ecfab2e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:26.341557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34cf612-4b9e-40bc-9b0f-5b3771eacc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:26.343575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cf612-4b9e-40bc-9b0f-5b3771eacc13 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:26.344064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cf612-4b9e-40bc-9b0f-5b3771eacc13 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:26.344567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cf612-4b9e-40bc-9b0f-5b3771eacc13 None admin] PATH_INFO: `/v3/users/f5b801462eeb4df6aa7785dd6cdf220c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:26.346335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34cf612-4b9e-40bc-9b0f-5b3771eacc13 None admin] RBAC: Authorizing `identity:get_user(user_id=f5b801462eeb4df6aa7785dd6cdf220c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:26.348198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34cf612-4b9e-40bc-9b0f-5b3771eacc13 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:26.356577 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 165/328] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:26 2022] GET /identity/v3/users/f5b801462eeb4df6aa7785dd6cdf220c => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:26.360293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34cf612-4b9e-40bc-9b0f-5b3771eacc13 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:26.372536 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 164/329] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:26.471467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34cf612-4b9e-40bc-9b0f-5b3771eacc13 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:26.497027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:26.509485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c249c1-9b94-4a26-a17c-4156fdba16bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:26.510139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c249c1-9b94-4a26-a17c-4156fdba16bc None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:26.510416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c249c1-9b94-4a26-a17c-4156fdba16bc None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:26.510684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c249c1-9b94-4a26-a17c-4156fdba16bc None admin] PATH_INFO: `/v3/system/users/f5b801462eeb4df6aa7785dd6cdf220c/roles/fb32d9ff656c423591f4b6227e950f99` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:26.512394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c249c1-9b94-4a26-a17c-4156fdba16bc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f5b801462eeb4df6aa7785dd6cdf220c, role_id=fb32d9ff656c423591f4b6227e950f99)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:26.514452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c249c1-9b94-4a26-a17c-4156fdba16bc None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:26.608471 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 166/330] 10.222.0.76 () {58 vars in 1334 bytes} [Sat Aug 27 04:17:26 2022] PUT /identity/v3/system/users/f5b801462eeb4df6aa7785dd6cdf220c/roles/fb32d9ff656c423591f4b6227e950f99 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:17:26.646688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c778d2e-e1fe-483e-9796-718fb48f6382 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:26.702551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:26.772950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c778d2e-e1fe-483e-9796-718fb48f6382 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:26.813521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828b378-b0d8-45f6-9834-708df7a3f293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:26.814183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828b378-b0d8-45f6-9834-708df7a3f293 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:26.814445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828b378-b0d8-45f6-9834-708df7a3f293 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:26.814708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828b378-b0d8-45f6-9834-708df7a3f293 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:26.825446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828b378-b0d8-45f6-9834-708df7a3f293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:26.830536 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-9828b378-b0d8-45f6-9834-708df7a3f293 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:26.830536 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:26.830536 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:26.830536 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:26.830536 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:26.830536 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:26.830536 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:26.830536 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:26.830536 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:26.830536 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:26.830536 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:26.830536 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:26.830536 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:26.830536 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:26.830536 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:26.830536 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:26.831585 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:26.831585 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:26.831585 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:26.831585 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:26.831585 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:26.831585 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:26.831585 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:26.831585 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:26.831585 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:26.831585 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:26.831585 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:26.831585 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:26.831585 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:26.831585 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:26.831585 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:26.831585 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:26.832621 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:26.832621 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:26.832621 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:26.832621 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:26.832621 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:26.832621 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:26.832621 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:26.832621 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:26.832621 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:26.832621 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:26.832621 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:26.832621 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:26.832621 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 165/331] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:26.837489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c249c1-9b94-4a26-a17c-4156fdba16bc None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:26.952121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c249c1-9b94-4a26-a17c-4156fdba16bc None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:26.990879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52974820-2ae6-4847-acea-69516fec7fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:26.991491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974820-2ae6-4847-acea-69516fec7fef None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:26.991771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974820-2ae6-4847-acea-69516fec7fef None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:26.992043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974820-2ae6-4847-acea-69516fec7fef None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:26.992753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52974820-2ae6-4847-acea-69516fec7fef None admin] RBAC: Adding query filter params (name=member) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:26.993103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52974820-2ae6-4847-acea-69516fec7fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:26.994482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52974820-2ae6-4847-acea-69516fec7fef None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:27.004225 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 167/332] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:27.010112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828b378-b0d8-45f6-9834-708df7a3f293 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:27.126477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828b378-b0d8-45f6-9834-708df7a3f293 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:27.129468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:27.171435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69db96-99c8-4db2-8911-fd7c52b0f78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:27.172200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69db96-99c8-4db2-8911-fd7c52b0f78f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:27.172492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69db96-99c8-4db2-8911-fd7c52b0f78f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:27.172767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69db96-99c8-4db2-8911-fd7c52b0f78f None admin] PATH_INFO: `/v3/users/1159c32c1dd3477aab1afa48197558cc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:27.173935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69db96-99c8-4db2-8911-fd7c52b0f78f None admin] RBAC: Authorizing `identity:get_user(user_id=1159c32c1dd3477aab1afa48197558cc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:27.175410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69db96-99c8-4db2-8911-fd7c52b0f78f None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:27.177042 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 166/333] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:27 2022] GET /identity/v3/users/1159c32c1dd3477aab1afa48197558cc => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:27.182991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52974820-2ae6-4847-acea-69516fec7fef None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:27.249746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:27.314561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52974820-2ae6-4847-acea-69516fec7fef None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:27.363309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96848f-9d63-4427-aa89-88d359e25c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:27.363932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96848f-9d63-4427-aa89-88d359e25c6d None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:27.364233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96848f-9d63-4427-aa89-88d359e25c6d None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:27.364511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96848f-9d63-4427-aa89-88d359e25c6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:27.365248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96848f-9d63-4427-aa89-88d359e25c6d None admin] RBAC: Adding query filter params (role.id=5a4c2cf9b8d849398625913504b4b172, user.id=1159c32c1dd3477aab1afa48197558cc, scope.system=all) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:27.365551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96848f-9d63-4427-aa89-88d359e25c6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:27.367004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96848f-9d63-4427-aa89-88d359e25c6d None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:27.385195 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 168/334] 10.222.0.76 () {56 vars in 1308 bytes} [Sat Aug 27 04:17:27 2022] GET /identity/v3/role_assignments?user.id=1159c32c1dd3477aab1afa48197558cc&scope.system=all&role.id=5a4c2cf9b8d849398625913504b4b172 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:28.914561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b02e3a-52a3-49d0-a978-1d4050a84a54 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:28.915587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b02e3a-52a3-49d0-a978-1d4050a84a54 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:28.916095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b02e3a-52a3-49d0-a978-1d4050a84a54 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:28.917942 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 167/335] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:28.923764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27563ff6-8dae-40b0-8773-5f596f025426 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:28.924686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27563ff6-8dae-40b0-8773-5f596f025426 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:28.925158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27563ff6-8dae-40b0-8773-5f596f025426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:28.949216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-27563ff6-8dae-40b0-8773-5f596f025426 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:28.950772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-27563ff6-8dae-40b0-8773-5f596f025426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:29.036268 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 169/336] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:29.187258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1cdca-61e2-4d9d-ad02-5689832a2b6e None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:29.187557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1cdca-61e2-4d9d-ad02-5689832a2b6e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:29.187720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1cdca-61e2-4d9d-ad02-5689832a2b6e None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:29.190504 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 168/337] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:29.192798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17084f62-7b10-4245-b2c5-c90189c3ff46 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:29.193285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17084f62-7b10-4245-b2c5-c90189c3ff46 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:29.193702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17084f62-7b10-4245-b2c5-c90189c3ff46 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:29.197438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c7b46-a5c2-4cee-9519-6b2819a32f66 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:29.197872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c7b46-a5c2-4cee-9519-6b2819a32f66 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:29.198306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c7b46-a5c2-4cee-9519-6b2819a32f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:29.202288 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 170/338] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:29 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:29.209264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011d8e8-fe51-45c0-a606-668981323f57 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:29.210797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011d8e8-fe51-45c0-a606-668981323f57 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:29.213451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011d8e8-fe51-45c0-a606-668981323f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:29.240213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-716c7b46-a5c2-4cee-9519-6b2819a32f66 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:29.243308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-716c7b46-a5c2-4cee-9519-6b2819a32f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:29.250732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2011d8e8-fe51-45c0-a606-668981323f57 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:29.256598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2011d8e8-fe51-45c0-a606-668981323f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:29.346303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:29.379064 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 169/339] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:29.426341 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 171/340] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:29.570900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c7b46-a5c2-4cee-9519-6b2819a32f66 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:29.615439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6519c-4ff7-4f60-9d8d-f77309f3a2e5 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:29.616064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6519c-4ff7-4f60-9d8d-f77309f3a2e5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:29.616554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6519c-4ff7-4f60-9d8d-f77309f3a2e5 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:29.618176 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 172/341] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:17:29.624095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446da08-818b-41a1-9d8b-e074bc5746f6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:29.624682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446da08-818b-41a1-9d8b-e074bc5746f6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:29.625195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446da08-818b-41a1-9d8b-e074bc5746f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:29.658385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7446da08-818b-41a1-9d8b-e074bc5746f6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:29.660669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7446da08-818b-41a1-9d8b-e074bc5746f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:29.751907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c7b46-a5c2-4cee-9519-6b2819a32f66 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:29.754218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:29.783918 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 173/342] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:29.815012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d5147-86be-4be1-b3de-80c16f1a0897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:29.815640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d5147-86be-4be1-b3de-80c16f1a0897 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:29.819423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d5147-86be-4be1-b3de-80c16f1a0897 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:29.819423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d5147-86be-4be1-b3de-80c16f1a0897 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:29.831342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d5147-86be-4be1-b3de-80c16f1a0897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:29.836067 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-741d5147-86be-4be1-b3de-80c16f1a0897 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:29.836067 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:29.836067 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:29.836067 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:29.836067 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:29.836067 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:29.836067 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:29.836067 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:29.836067 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:29.836067 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:29.836067 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:29.836067 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:29.836067 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:29.836067 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:29.836067 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:29.836067 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:29.836970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:29.836970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:29.836970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:29.836970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:29.836970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:29.836970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:29.836970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:29.836970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:29.836970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:29.836970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:29.836970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:29.836970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:29.836970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:29.836970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:29.836970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:29.836970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:29.837744 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:29.837744 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:29.837744 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:29.837744 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:29.837744 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:29.837744 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:29.837744 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:29.837744 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:29.837744 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:29.837744 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:29.837744 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:29.837744 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:29.837744 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 170/343] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:29.845201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446da08-818b-41a1-9d8b-e074bc5746f6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:29.851552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d5147-86be-4be1-b3de-80c16f1a0897 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:30.002902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d5147-86be-4be1-b3de-80c16f1a0897 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:30.025370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:30.033716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446da08-818b-41a1-9d8b-e074bc5746f6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:30.062917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5ffd2-3575-491f-9ed2-839170b51804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:30.063552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ffd2-3575-491f-9ed2-839170b51804 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:30.063912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ffd2-3575-491f-9ed2-839170b51804 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:30.064208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ffd2-3575-491f-9ed2-839170b51804 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:30.085061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5ffd2-3575-491f-9ed2-839170b51804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:30.090865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-f3d5ffd2-3575-491f-9ed2-839170b51804 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:17:30.090865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:30.090865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:30.090865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:30.090865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:30.090865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:30.090865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:30.090865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:30.090865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:30.090865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:30.090865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:30.090865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:30.090865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:30.090865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:30.090865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:30.090865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:30.092333 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:30.092333 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:30.092333 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:30.092333 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:30.092333 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:30.092333 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:30.092333 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:30.092333 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:30.092333 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:30.092333 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:30.092333 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:30.092333 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:30.092333 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:30.092333 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:30.092333 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:30.092333 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:30.093318 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:30.093318 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:30.093318 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:30.093318 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:30.093318 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:30.093318 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:30.093318 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:30.093318 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:30.093318 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:30.093318 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:30.093318 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 04:17:30.093318 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:30.093318 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 171/344] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:17:30.093969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5ffd2-3575-491f-9ed2-839170b51804 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:30.108902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781230b-16fc-48dc-b0a5-9174cd1dee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:30.109520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781230b-16fc-48dc-b0a5-9174cd1dee48 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:30.109796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781230b-16fc-48dc-b0a5-9174cd1dee48 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:30.110081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781230b-16fc-48dc-b0a5-9174cd1dee48 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:30.110734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781230b-16fc-48dc-b0a5-9174cd1dee48 None admin] RBAC: Adding query filter params (name=member) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:30.111033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781230b-16fc-48dc-b0a5-9174cd1dee48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:30.113410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781230b-16fc-48dc-b0a5-9174cd1dee48 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:30.131499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:30.134030 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 174/345] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:30.135757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781230b-16fc-48dc-b0a5-9174cd1dee48 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:30.236952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5ffd2-3575-491f-9ed2-839170b51804 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:30.283525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0ff8a-edb1-428b-8b3b-3ce8c8540b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:30.283890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0ff8a-edb1-428b-8b3b-3ce8c8540b87 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:30.284152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0ff8a-edb1-428b-8b3b-3ce8c8540b87 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:30.284447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0ff8a-edb1-428b-8b3b-3ce8c8540b87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:30.307573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0ff8a-edb1-428b-8b3b-3ce8c8540b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:30.313508 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-f0f0ff8a-edb1-428b-8b3b-3ce8c8540b87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:30.313508 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:30.313508 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:30.313508 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:30.313508 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:30.313508 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:30.313508 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:30.313508 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:30.313508 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:30.313508 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:30.313508 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:30.313508 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:30.313508 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:30.313508 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:30.313508 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:30.313508 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:30.314517 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:30.314517 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:30.314517 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:30.314517 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:30.314517 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:30.314517 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:30.314517 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:30.314517 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:30.314517 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:30.314517 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:30.314517 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:30.314517 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:30.314517 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:30.314517 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:30.314517 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:30.314517 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:30.315330 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:30.315330 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:30.315330 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:30.315330 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:30.315330 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:30.315330 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:30.315330 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:30.315330 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:30.315330 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:30.315330 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:30.315330 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:30.315330 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:30.315936 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 172/346] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:17:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:30.320429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0ff8a-edb1-428b-8b3b-3ce8c8540b87 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:30.328721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781230b-16fc-48dc-b0a5-9174cd1dee48 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:30.369130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7922d-9af9-451d-86d3-edb373171101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:30.370145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7922d-9af9-451d-86d3-edb373171101 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:30.370658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7922d-9af9-451d-86d3-edb373171101 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:30.371128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7922d-9af9-451d-86d3-edb373171101 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:30.371997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7922d-9af9-451d-86d3-edb373171101 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:30.372524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7922d-9af9-451d-86d3-edb373171101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:30.374916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7922d-9af9-451d-86d3-edb373171101 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:30.384132 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 175/347] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:30.386275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7922d-9af9-451d-86d3-edb373171101 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:30.418095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:30.423614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:30.442887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0ff8a-edb1-428b-8b3b-3ce8c8540b87 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:30.480453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27658a0-52db-40a5-a984-be8a10c22cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:30.480990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27658a0-52db-40a5-a984-be8a10c22cb0 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:30.481255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27658a0-52db-40a5-a984-be8a10c22cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:30.481525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27658a0-52db-40a5-a984-be8a10c22cb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:30.505227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7922d-9af9-451d-86d3-edb373171101 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:30.543274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50911a7c-28d0-41ba-9894-7d8ab188b83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:30.544319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50911a7c-28d0-41ba-9894-7d8ab188b83b None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:30.545392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50911a7c-28d0-41ba-9894-7d8ab188b83b None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:30.545908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50911a7c-28d0-41ba-9894-7d8ab188b83b None admin] PATH_INFO: `/v3/roles/member` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:30.557515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50911a7c-28d0-41ba-9894-7d8ab188b83b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:30.558941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27658a0-52db-40a5-a984-be8a10c22cb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:30.560505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27658a0-52db-40a5-a984-be8a10c22cb0 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:30.563858 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-50911a7c-28d0-41ba-9894-7d8ab188b83b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:30.563858 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:30.563858 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:30.563858 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:30.563858 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:30.563858 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:30.563858 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:30.563858 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:30.563858 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:30.563858 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:30.563858 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:30.563858 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:30.563858 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:30.563858 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:30.563858 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:30.563858 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:30.564772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:30.564772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:30.564772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:30.564772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:30.564772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:30.564772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:30.564772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:30.564772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:30.564772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:30.564772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:30.564772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:30.564772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:30.564772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:30.564772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:30.564772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:30.564772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:30.565590 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:30.565590 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:30.565590 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:30.565590 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:30.565590 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:30.565590 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:30.565590 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:30.565590 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:30.565590 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:30.565590 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:30.565590 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:30.565590 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:30.567866 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 176/348] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:30.568882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50911a7c-28d0-41ba-9894-7d8ab188b83b None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:30.649596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:30.663797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:30.670243 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 173/349] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:30.670986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27658a0-52db-40a5-a984-be8a10c22cb0 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:30.681027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50911a7c-28d0-41ba-9894-7d8ab188b83b None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:30.728935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82062a17-49ea-49ed-9fd8-9840d684cf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:30.729557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82062a17-49ea-49ed-9fd8-9840d684cf40 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:30.729833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82062a17-49ea-49ed-9fd8-9840d684cf40 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:30.730102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82062a17-49ea-49ed-9fd8-9840d684cf40 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:30.730765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82062a17-49ea-49ed-9fd8-9840d684cf40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:30.731068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82062a17-49ea-49ed-9fd8-9840d684cf40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:30.733533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82062a17-49ea-49ed-9fd8-9840d684cf40 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:30.744987 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 177/350] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:30.746172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82062a17-49ea-49ed-9fd8-9840d684cf40 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:30.795220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27658a0-52db-40a5-a984-be8a10c22cb0 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:30.839792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc473c-f5a8-4e76-b758-ab546e794fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:30.840484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc473c-f5a8-4e76-b758-ab546e794fb3 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:30.840765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc473c-f5a8-4e76-b758-ab546e794fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:30.841037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc473c-f5a8-4e76-b758-ab546e794fb3 None admin] PATH_INFO: `/v3/users/f5b801462eeb4df6aa7785dd6cdf220c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:30.843897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc473c-f5a8-4e76-b758-ab546e794fb3 None admin] RBAC: Authorizing `identity:get_user(user_id=f5b801462eeb4df6aa7785dd6cdf220c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:30.845423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc473c-f5a8-4e76-b758-ab546e794fb3 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:30.847190 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 174/351] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:17:30 2022] GET /identity/v3/users/f5b801462eeb4df6aa7785dd6cdf220c => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:30.848196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa04791-7cf0-4392-9a16-a9b5e4e2cd9d None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:30.848470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa04791-7cf0-4392-9a16-a9b5e4e2cd9d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:30.848748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa04791-7cf0-4392-9a16-a9b5e4e2cd9d None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:30.850069 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 175/352] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:30.851154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa04791-7cf0-4392-9a16-a9b5e4e2cd9d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:30.880648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82062a17-49ea-49ed-9fd8-9840d684cf40 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:30.914993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:30.930499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a76d4-8cbe-467a-9d27-5be0b19eeeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:30.931907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a76d4-8cbe-467a-9d27-5be0b19eeeb6 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:30.932213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a76d4-8cbe-467a-9d27-5be0b19eeeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:30.932491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a76d4-8cbe-467a-9d27-5be0b19eeeb6 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:30.933412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a76d4-8cbe-467a-9d27-5be0b19eeeb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:30.933717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a76d4-8cbe-467a-9d27-5be0b19eeeb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:30.935090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a76d4-8cbe-467a-9d27-5be0b19eeeb6 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:30.946798 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 178/353] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:30.947648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a76d4-8cbe-467a-9d27-5be0b19eeeb6 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:30.963406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:30.983978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa04791-7cf0-4392-9a16-a9b5e4e2cd9d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:31.035924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73573392-3c09-467a-918b-4a0450c42f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:31.036603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73573392-3c09-467a-918b-4a0450c42f52 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:31.036861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73573392-3c09-467a-918b-4a0450c42f52 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:31.037137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73573392-3c09-467a-918b-4a0450c42f52 None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:31.039103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73573392-3c09-467a-918b-4a0450c42f52 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:31.041543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73573392-3c09-467a-918b-4a0450c42f52 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:31.043351 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 176/354] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:30 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:31.044036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73573392-3c09-467a-918b-4a0450c42f52 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:31.083892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a76d4-8cbe-467a-9d27-5be0b19eeeb6 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:31.127678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d8839-7a73-4051-8b09-c6e6d8d4f369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:31.129386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d8839-7a73-4051-8b09-c6e6d8d4f369 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:31.130005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d8839-7a73-4051-8b09-c6e6d8d4f369 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:31.130396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d8839-7a73-4051-8b09-c6e6d8d4f369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:31.178781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73573392-3c09-467a-918b-4a0450c42f52 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:31.201125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:31.219159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d8839-7a73-4051-8b09-c6e6d8d4f369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:31.220735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d8839-7a73-4051-8b09-c6e6d8d4f369 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:31.222048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503c6c1-a54c-4aa4-85f3-1b59f64a52a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:31.222658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503c6c1-a54c-4aa4-85f3-1b59f64a52a8 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:31.222937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503c6c1-a54c-4aa4-85f3-1b59f64a52a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:31.223273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503c6c1-a54c-4aa4-85f3-1b59f64a52a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:31.224002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503c6c1-a54c-4aa4-85f3-1b59f64a52a8 None admin] RBAC: Adding query filter params (role.id=fb32d9ff656c423591f4b6227e950f99, user.id=f5b801462eeb4df6aa7785dd6cdf220c, scope.system=all) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:31.224335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503c6c1-a54c-4aa4-85f3-1b59f64a52a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:31.225772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503c6c1-a54c-4aa4-85f3-1b59f64a52a8 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:31.230782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:31.239652 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 177/355] 10.222.0.76 () {56 vars in 1308 bytes} [Sat Aug 27 04:17:31 2022] GET /identity/v3/role_assignments?user.id=f5b801462eeb4df6aa7785dd6cdf220c&scope.system=all&role.id=fb32d9ff656c423591f4b6227e950f99 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:31.240952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8806e9d-fce3-47f2-ab47-08d04b1e989c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:31.241298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8806e9d-fce3-47f2-ab47-08d04b1e989c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:31.241567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8806e9d-fce3-47f2-ab47-08d04b1e989c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:31.263177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e8806e9d-fce3-47f2-ab47-08d04b1e989c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:31.264606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e8806e9d-fce3-47f2-ab47-08d04b1e989c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:31.346881 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 179/356] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:31.352227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d8839-7a73-4051-8b09-c6e6d8d4f369 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:31.371500 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 178/357] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:31.372477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8806e9d-fce3-47f2-ab47-08d04b1e989c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:31.500329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d8839-7a73-4051-8b09-c6e6d8d4f369 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:31.511305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8806e9d-fce3-47f2-ab47-08d04b1e989c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:31.523347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:31.533495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:31.549105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983792bc-55f8-447c-bfb0-313e74f9b751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:31.549715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983792bc-55f8-447c-bfb0-313e74f9b751 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:31.549990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983792bc-55f8-447c-bfb0-313e74f9b751 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:31.550258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983792bc-55f8-447c-bfb0-313e74f9b751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:31.557425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0708aa-b97f-4a01-97ae-95c28f6ddd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:31.558353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0708aa-b97f-4a01-97ae-95c28f6ddd7c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:31.558845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0708aa-b97f-4a01-97ae-95c28f6ddd7c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:31.559178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0708aa-b97f-4a01-97ae-95c28f6ddd7c None admin] PATH_INFO: `/v3/groups/d0b901492380456e8637befba20bc345` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:31.566747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0708aa-b97f-4a01-97ae-95c28f6ddd7c None admin] RBAC: Authorizing `identity:get_group(group_id=d0b901492380456e8637befba20bc345)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:31.568581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0708aa-b97f-4a01-97ae-95c28f6ddd7c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:31.571215 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 179/358] 10.222.0.76 () {56 vars in 1180 bytes} [Sat Aug 27 04:17:31 2022] GET /identity/v3/groups/d0b901492380456e8637befba20bc345 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:31.573028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb689e65-83a1-4293-86e3-51138d68a1cd None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:31.573028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb689e65-83a1-4293-86e3-51138d68a1cd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:31.573218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb689e65-83a1-4293-86e3-51138d68a1cd None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:31.580272 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 180/359] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:31.581376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb689e65-83a1-4293-86e3-51138d68a1cd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:31.639366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983792bc-55f8-447c-bfb0-313e74f9b751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:31.641310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983792bc-55f8-447c-bfb0-313e74f9b751 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:31.718159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb689e65-83a1-4293-86e3-51138d68a1cd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:31.756741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0947155-dd4c-4ec2-9598-f3e201c707e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:31.757712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0947155-dd4c-4ec2-9598-f3e201c707e4 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:31.758005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0947155-dd4c-4ec2-9598-f3e201c707e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:31.758268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0947155-dd4c-4ec2-9598-f3e201c707e4 None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:31.759411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0947155-dd4c-4ec2-9598-f3e201c707e4 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:31.760910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0947155-dd4c-4ec2-9598-f3e201c707e4 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:31.762797 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 181/360] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:31 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:31.763605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0947155-dd4c-4ec2-9598-f3e201c707e4 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:31.784055 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 180/361] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:31.787122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8139df1-e053-46cf-a6df-6482ffaa7572 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:31.787409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8139df1-e053-46cf-a6df-6482ffaa7572 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:31.787681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8139df1-e053-46cf-a6df-6482ffaa7572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:31.801188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:31.807378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c8139df1-e053-46cf-a6df-6482ffaa7572 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:31.808623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c8139df1-e053-46cf-a6df-6482ffaa7572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:31.814302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:31.883859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0947155-dd4c-4ec2-9598-f3e201c707e4 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:31.885874 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 181/362] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:31.886926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8139df1-e053-46cf-a6df-6482ffaa7572 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:31.928458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267e467-6b8d-48f4-a69a-7f82b773690f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:31.929057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267e467-6b8d-48f4-a69a-7f82b773690f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:31.929342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267e467-6b8d-48f4-a69a-7f82b773690f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:31.929613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267e467-6b8d-48f4-a69a-7f82b773690f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:31.930346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267e467-6b8d-48f4-a69a-7f82b773690f None admin] RBAC: Adding query filter params (group.id=d0b901492380456e8637befba20bc345, role.id=5a4c2cf9b8d849398625913504b4b172, scope.project.id=b8a63babe747425e956f165dd09383c5) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:31.930638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267e467-6b8d-48f4-a69a-7f82b773690f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:31.932075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267e467-6b8d-48f4-a69a-7f82b773690f None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:31.938651 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 182/363] 10.222.0.76 () {56 vars in 1376 bytes} [Sat Aug 27 04:17:31 2022] GET /identity/v3/role_assignments?group.id=d0b901492380456e8637befba20bc345&scope.project.id=b8a63babe747425e956f165dd09383c5&role.id=5a4c2cf9b8d849398625913504b4b172 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:31.939484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267e467-6b8d-48f4-a69a-7f82b773690f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:32.062264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8139df1-e053-46cf-a6df-6482ffaa7572 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:32.090242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267e467-6b8d-48f4-a69a-7f82b773690f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:32.093632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:32.128785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161f8d2-b0ad-4da2-834e-9c692c021cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:32.131036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161f8d2-b0ad-4da2-834e-9c692c021cd5 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:32.131317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161f8d2-b0ad-4da2-834e-9c692c021cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:32.132487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161f8d2-b0ad-4da2-834e-9c692c021cd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:32.139699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:32.148943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c2188-db71-4d83-a23e-6c4317d9e603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:32.149579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c2188-db71-4d83-a23e-6c4317d9e603 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:32.149857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c2188-db71-4d83-a23e-6c4317d9e603 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:32.150128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c2188-db71-4d83-a23e-6c4317d9e603 None admin] PATH_INFO: `/v3/groups/d0b901492380456e8637befba20bc345` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:32.153160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c2188-db71-4d83-a23e-6c4317d9e603 None admin] RBAC: Authorizing `identity:get_group(group_id=d0b901492380456e8637befba20bc345)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:32.153504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161f8d2-b0ad-4da2-834e-9c692c021cd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:32.155229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c2188-db71-4d83-a23e-6c4317d9e603 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:32.160490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-5161f8d2-b0ad-4da2-834e-9c692c021cd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:32.160490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:32.160490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:32.160490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:32.160490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:32.160490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:32.160490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:32.160490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:32.160490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:32.160490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:32.160490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:32.160490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:32.160490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:32.160490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:32.160490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:32.160490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:32.161397 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:32.161397 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:32.161397 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:32.161397 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:32.161397 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:32.161397 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:32.161397 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:32.161397 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:32.161397 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:32.161397 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:32.161397 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:32.161397 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:32.161397 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:32.161397 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:32.161397 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:32.161397 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:32.162243 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:32.162243 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:32.162243 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:32.162243 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:32.162243 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:32.162243 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:32.162243 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:32.162243 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:32.162243 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:32.162243 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:32.162243 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:32.162243 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:32.162243 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 182/365] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:17:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:32.162243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161f8d2-b0ad-4da2-834e-9c692c021cd5 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:32.163656 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 183/365] 10.222.0.76 () {56 vars in 1180 bytes} [Sat Aug 27 04:17:31 2022] GET /identity/v3/groups/d0b901492380456e8637befba20bc345 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:32.167723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c2188-db71-4d83-a23e-6c4317d9e603 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:32.286719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161f8d2-b0ad-4da2-834e-9c692c021cd5 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:32.302117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c2188-db71-4d83-a23e-6c4317d9e603 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:32.334864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bf690-89a8-4bd1-b937-7a19976d3024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:32.335436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bf690-89a8-4bd1-b937-7a19976d3024 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:32.335698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bf690-89a8-4bd1-b937-7a19976d3024 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:32.335968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bf690-89a8-4bd1-b937-7a19976d3024 None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:32.338573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bf690-89a8-4bd1-b937-7a19976d3024 None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:32.339417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bf690-89a8-4bd1-b937-7a19976d3024 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:32.341088 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 183/366] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:32 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:32.343118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bf690-89a8-4bd1-b937-7a19976d3024 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:32.349377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0090b1-be24-48f9-8bb1-85ae38ed717c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:32.350004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0090b1-be24-48f9-8bb1-85ae38ed717c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:32.350286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0090b1-be24-48f9-8bb1-85ae38ed717c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:32.350563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0090b1-be24-48f9-8bb1-85ae38ed717c None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:32.351241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0090b1-be24-48f9-8bb1-85ae38ed717c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:32.351547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0090b1-be24-48f9-8bb1-85ae38ed717c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:32.352965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0090b1-be24-48f9-8bb1-85ae38ed717c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:32.365458 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 184/367] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:32.366317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0090b1-be24-48f9-8bb1-85ae38ed717c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:32.417998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:32.429692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:32.483927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bf690-89a8-4bd1-b937-7a19976d3024 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:32.520923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0090b1-be24-48f9-8bb1-85ae38ed717c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:32.542858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9d4d8-fe75-40d1-a5c3-e9b0d0cf8a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:32.543470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9d4d8-fe75-40d1-a5c3-e9b0d0cf8a2b None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:32.543742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9d4d8-fe75-40d1-a5c3-e9b0d0cf8a2b None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:32.544006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9d4d8-fe75-40d1-a5c3-e9b0d0cf8a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:32.547366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9d4d8-fe75-40d1-a5c3-e9b0d0cf8a2b None admin] RBAC: Adding query filter params (group.id=d0b901492380456e8637befba20bc345, role.id=d78f86d36ded425d9148c0b5781ab7b2, scope.project.id=b8a63babe747425e956f165dd09383c5) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:32.547366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9d4d8-fe75-40d1-a5c3-e9b0d0cf8a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:32.547366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9d4d8-fe75-40d1-a5c3-e9b0d0cf8a2b None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:32.553606 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 184/368] 10.222.0.76 () {56 vars in 1376 bytes} [Sat Aug 27 04:17:32 2022] GET /identity/v3/role_assignments?group.id=d0b901492380456e8637befba20bc345&scope.project.id=b8a63babe747425e956f165dd09383c5&role.id=d78f86d36ded425d9148c0b5781ab7b2 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:32.557197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9d4d8-fe75-40d1-a5c3-e9b0d0cf8a2b None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:32.567618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2da15-39d3-4e3f-88b4-bb8490a517b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:32.568620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2da15-39d3-4e3f-88b4-bb8490a517b2 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:32.569752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2da15-39d3-4e3f-88b4-bb8490a517b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:32.570234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2da15-39d3-4e3f-88b4-bb8490a517b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:32.587060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2da15-39d3-4e3f-88b4-bb8490a517b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:32.596730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-9bf2da15-39d3-4e3f-88b4-bb8490a517b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:17:32.596730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:32.596730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:32.596730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:32.596730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:32.596730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:32.596730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:32.596730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:32.596730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:32.596730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:32.596730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:32.596730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:32.596730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:32.596730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:32.596730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:32.596730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:32.597688 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:32.597688 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:32.597688 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:32.597688 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:32.597688 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:32.597688 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:32.597688 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:32.597688 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:32.597688 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:32.597688 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:32.597688 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:32.597688 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:32.597688 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:32.597688 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:32.597688 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:32.597688 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:32.598462 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:32.598462 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:32.598462 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:32.598462 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:32.598462 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:32.598462 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:32.598462 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:32.598462 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:32.598462 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:32.598462 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:32.598462 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:17:32.598462 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:32.599132 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 185/369] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:17:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:32.599819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2da15-39d3-4e3f-88b4-bb8490a517b2 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:32.698748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9d4d8-fe75-40d1-a5c3-e9b0d0cf8a2b None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:32.720359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:32.729708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2da15-39d3-4e3f-88b4-bb8490a517b2 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:32.737168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:32.746770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fcd37-306a-49d5-91c9-5b38c095ceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:32.748123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fcd37-306a-49d5-91c9-5b38c095ceb1 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:32.748757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fcd37-306a-49d5-91c9-5b38c095ceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:32.749272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fcd37-306a-49d5-91c9-5b38c095ceb1 None admin] PATH_INFO: `/v3/groups/d0b901492380456e8637befba20bc345` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:32.750886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fcd37-306a-49d5-91c9-5b38c095ceb1 None admin] RBAC: Authorizing `identity:get_group(group_id=d0b901492380456e8637befba20bc345)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:32.753025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fcd37-306a-49d5-91c9-5b38c095ceb1 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:32.754853 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 185/370] 10.222.0.76 () {56 vars in 1180 bytes} [Sat Aug 27 04:17:32 2022] GET /identity/v3/groups/d0b901492380456e8637befba20bc345 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:32.755884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fcd37-306a-49d5-91c9-5b38c095ceb1 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:32.777318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770c9b5-38da-4aad-8757-1f093bcaf976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:32.778179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770c9b5-38da-4aad-8757-1f093bcaf976 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:32.778551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770c9b5-38da-4aad-8757-1f093bcaf976 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:32.778930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770c9b5-38da-4aad-8757-1f093bcaf976 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:32.867699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770c9b5-38da-4aad-8757-1f093bcaf976 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:32.869453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770c9b5-38da-4aad-8757-1f093bcaf976 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:32.886963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fcd37-306a-49d5-91c9-5b38c095ceb1 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:32.930473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeed6f-58e9-40fa-89bb-50506363fac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:32.931080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeed6f-58e9-40fa-89bb-50506363fac4 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:32.931356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeed6f-58e9-40fa-89bb-50506363fac4 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:32.931686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeed6f-58e9-40fa-89bb-50506363fac4 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:32.932693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeed6f-58e9-40fa-89bb-50506363fac4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:32.932798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeed6f-58e9-40fa-89bb-50506363fac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:32.934149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeed6f-58e9-40fa-89bb-50506363fac4 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:32.946142 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 186/371] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:32.947698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeed6f-58e9-40fa-89bb-50506363fac4 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:32.998515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:33.008943 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 186/372] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:33.014040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770c9b5-38da-4aad-8757-1f093bcaf976 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:33.032886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:33.078894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeed6f-58e9-40fa-89bb-50506363fac4 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:33.117625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d87a1e-d921-49fe-8f02-e7bd6608d99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:33.118285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d87a1e-d921-49fe-8f02-e7bd6608d99c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:33.118499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d87a1e-d921-49fe-8f02-e7bd6608d99c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:33.118766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d87a1e-d921-49fe-8f02-e7bd6608d99c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:33.119481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d87a1e-d921-49fe-8f02-e7bd6608d99c None admin] RBAC: Adding query filter params (group.id=d0b901492380456e8637befba20bc345, role.id=5a4c2cf9b8d849398625913504b4b172, scope.project.id=c208601ac0cf4699975b00ec4d6d766e) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:33.119785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d87a1e-d921-49fe-8f02-e7bd6608d99c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:33.120381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770c9b5-38da-4aad-8757-1f093bcaf976 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:33.121287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d87a1e-d921-49fe-8f02-e7bd6608d99c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:33.132313 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 187/373] 10.222.0.76 () {56 vars in 1376 bytes} [Sat Aug 27 04:17:32 2022] GET /identity/v3/role_assignments?group.id=d0b901492380456e8637befba20bc345&scope.project.id=c208601ac0cf4699975b00ec4d6d766e&role.id=5a4c2cf9b8d849398625913504b4b172 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:33.133301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d87a1e-d921-49fe-8f02-e7bd6608d99c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:33.160225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c7584-148d-4bdb-be75-37ee2c2966db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:33.160861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c7584-148d-4bdb-be75-37ee2c2966db None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:33.161187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c7584-148d-4bdb-be75-37ee2c2966db None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:33.161460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c7584-148d-4bdb-be75-37ee2c2966db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:33.230382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:33.241343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c7584-148d-4bdb-be75-37ee2c2966db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:33.242929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c7584-148d-4bdb-be75-37ee2c2966db None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:33.254417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d87a1e-d921-49fe-8f02-e7bd6608d99c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:33.280023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:33.292405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae946fe0-d12f-4f17-87ca-00b2a69bba02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:33.293033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae946fe0-d12f-4f17-87ca-00b2a69bba02 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:33.293307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae946fe0-d12f-4f17-87ca-00b2a69bba02 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:33.293574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae946fe0-d12f-4f17-87ca-00b2a69bba02 None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:33.294741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae946fe0-d12f-4f17-87ca-00b2a69bba02 None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:33.296281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae946fe0-d12f-4f17-87ca-00b2a69bba02 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:33.298140 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 188/374] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:33 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:33.304179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae946fe0-d12f-4f17-87ca-00b2a69bba02 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:33.377565 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 187/375] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:33.383234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c7584-148d-4bdb-be75-37ee2c2966db None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:33.475713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae946fe0-d12f-4f17-87ca-00b2a69bba02 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:33.495219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:33.511887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c7584-148d-4bdb-be75-37ee2c2966db None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:33.537109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5dfee-a9f9-4e1e-b6e5-29a24445c573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:33.537750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5dfee-a9f9-4e1e-b6e5-29a24445c573 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:33.538027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5dfee-a9f9-4e1e-b6e5-29a24445c573 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:33.538302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5dfee-a9f9-4e1e-b6e5-29a24445c573 None admin] PATH_INFO: `/v3/groups/d0b901492380456e8637befba20bc345` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:33.540449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5dfee-a9f9-4e1e-b6e5-29a24445c573 None admin] RBAC: Authorizing `identity:get_group(group_id=d0b901492380456e8637befba20bc345)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:33.542341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5dfee-a9f9-4e1e-b6e5-29a24445c573 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:33.544977 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 189/376] 10.222.0.76 () {56 vars in 1180 bytes} [Sat Aug 27 04:17:33 2022] GET /identity/v3/groups/d0b901492380456e8637befba20bc345 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:33.553108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5dfee-a9f9-4e1e-b6e5-29a24445c573 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:33.557259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e29faa-6e5f-498a-a56f-f74b48ae8d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:33.558804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e29faa-6e5f-498a-a56f-f74b48ae8d13 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:33.559082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e29faa-6e5f-498a-a56f-f74b48ae8d13 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:33.559356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e29faa-6e5f-498a-a56f-f74b48ae8d13 None admin] PATH_INFO: `/v3/projects/4935ddf6dc2a4bbea15d24b9f9bae471` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:33.560651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e29faa-6e5f-498a-a56f-f74b48ae8d13 None admin] RBAC: Authorizing `identity:get_project(project_id=4935ddf6dc2a4bbea15d24b9f9bae471)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:33.562161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e29faa-6e5f-498a-a56f-f74b48ae8d13 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:33.564260 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 188/377] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:33 2022] GET /identity/v3/projects/4935ddf6dc2a4bbea15d24b9f9bae471 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:33.570931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e29faa-6e5f-498a-a56f-f74b48ae8d13 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:33.642932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:33.691760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5dfee-a9f9-4e1e-b6e5-29a24445c573 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:33.742997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf34ab-141d-4254-b608-4d75910e8f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:33.743620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf34ab-141d-4254-b608-4d75910e8f43 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:33.743899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf34ab-141d-4254-b608-4d75910e8f43 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:33.744188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf34ab-141d-4254-b608-4d75910e8f43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:33.744948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf34ab-141d-4254-b608-4d75910e8f43 None admin] RBAC: Adding query filter params (group.id=d0b901492380456e8637befba20bc345, role.id=d78f86d36ded425d9148c0b5781ab7b2, scope.project.id=c208601ac0cf4699975b00ec4d6d766e) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:33.745258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf34ab-141d-4254-b608-4d75910e8f43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:33.748700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf34ab-141d-4254-b608-4d75910e8f43 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:33.759521 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 190/378] 10.222.0.76 () {56 vars in 1376 bytes} [Sat Aug 27 04:17:33 2022] GET /identity/v3/role_assignments?group.id=d0b901492380456e8637befba20bc345&scope.project.id=c208601ac0cf4699975b00ec4d6d766e&role.id=d78f86d36ded425d9148c0b5781ab7b2 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:33.790084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e29faa-6e5f-498a-a56f-f74b48ae8d13 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:33.849416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57eced6-8d33-47e2-bf8e-5829da1a9564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:33.850444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eced6-8d33-47e2-bf8e-5829da1a9564 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:33.850917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eced6-8d33-47e2-bf8e-5829da1a9564 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:33.851381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eced6-8d33-47e2-bf8e-5829da1a9564 None admin] PATH_INFO: `/v3/groups/3b50e6f2757b483d8b3f47cde76b71a7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:33.865740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57eced6-8d33-47e2-bf8e-5829da1a9564 None admin] RBAC: Authorizing `identity:get_group(group_id=3b50e6f2757b483d8b3f47cde76b71a7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:33.867545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57eced6-8d33-47e2-bf8e-5829da1a9564 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:33.869476 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 189/379] 10.222.0.76 () {56 vars in 1180 bytes} [Sat Aug 27 04:17:33 2022] GET /identity/v3/groups/3b50e6f2757b483d8b3f47cde76b71a7 => generated 229 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:33.875882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf34ab-141d-4254-b608-4d75910e8f43 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:34.034935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf34ab-141d-4254-b608-4d75910e8f43 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:34.065440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:34.085427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d96a3-6f55-4cef-884a-97d4d8f748b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:34.086105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d96a3-6f55-4cef-884a-97d4d8f748b5 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:34.086384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d96a3-6f55-4cef-884a-97d4d8f748b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:34.086651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d96a3-6f55-4cef-884a-97d4d8f748b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:34.087381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d96a3-6f55-4cef-884a-97d4d8f748b5 None admin] RBAC: Adding query filter params (group.id=3b50e6f2757b483d8b3f47cde76b71a7, role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=4935ddf6dc2a4bbea15d24b9f9bae471) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:34.087729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d96a3-6f55-4cef-884a-97d4d8f748b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:34.089308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d96a3-6f55-4cef-884a-97d4d8f748b5 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:34.096358 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 191/380] 10.222.0.76 () {56 vars in 1376 bytes} [Sat Aug 27 04:17:33 2022] GET /identity/v3/role_assignments?group.id=3b50e6f2757b483d8b3f47cde76b71a7&scope.project.id=4935ddf6dc2a4bbea15d24b9f9bae471&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:34.262484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be410fa-cc6e-4abc-891b-20f9bd17ac7d None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:34.263950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be410fa-cc6e-4abc-891b-20f9bd17ac7d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:34.264469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be410fa-cc6e-4abc-891b-20f9bd17ac7d None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:34.266420 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 190/381] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:34.272695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249585c4-cb23-461f-956f-37e1c3699e39 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:34.273611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249585c4-cb23-461f-956f-37e1c3699e39 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:34.274086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249585c4-cb23-461f-956f-37e1c3699e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:34.294969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-249585c4-cb23-461f-956f-37e1c3699e39 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:34.299111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-249585c4-cb23-461f-956f-37e1c3699e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:34.385876 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 192/382] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:34.774083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be410fa-cc6e-4abc-891b-20f9bd17ac7d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:34.803583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:34.903421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be410fa-cc6e-4abc-891b-20f9bd17ac7d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:34.948918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35b194-2e26-4da0-bcb8-08d5670cb392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:34.949570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35b194-2e26-4da0-bcb8-08d5670cb392 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:34.949853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35b194-2e26-4da0-bcb8-08d5670cb392 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:34.950124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35b194-2e26-4da0-bcb8-08d5670cb392 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:34.965576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35b194-2e26-4da0-bcb8-08d5670cb392 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:34.970596 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-0e35b194-2e26-4da0-bcb8-08d5670cb392 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:34.970596 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:34.970596 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:34.970596 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:34.970596 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:34.970596 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:34.970596 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:34.970596 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:34.970596 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:34.970596 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:34.970596 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:34.970596 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:34.970596 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:34.970596 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:34.970596 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:34.970596 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:34.971490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:34.971490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:34.971490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:34.971490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:34.971490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:34.971490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:34.971490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:34.971490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:34.971490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:34.971490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:34.971490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:34.971490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:34.971490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:34.971490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:34.971490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:34.971490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:34.972320 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:34.972320 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:34.972320 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:34.972320 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:34.972320 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:34.972320 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:34.972320 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:34.972320 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:34.972320 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:34.972320 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:34.972320 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:34.972320 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:34.976289 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 191/383] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:34.981238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249585c4-cb23-461f-956f-37e1c3699e39 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:35.123663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249585c4-cb23-461f-956f-37e1c3699e39 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:35.128748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752cd7-ed45-4847-928c-bd62ccc79a26 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:35.129036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752cd7-ed45-4847-928c-bd62ccc79a26 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:35.129310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752cd7-ed45-4847-928c-bd62ccc79a26 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:35.130922 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 192/384] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:17:35.135898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5f160-188c-4607-89bb-737ae39a7519 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:35.136474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5f160-188c-4607-89bb-737ae39a7519 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:35.136741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5f160-188c-4607-89bb-737ae39a7519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:35.151907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:35.160653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283f0df-1f92-49d7-bcce-507525427334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:35.161466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283f0df-1f92-49d7-bcce-507525427334 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:35.161742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283f0df-1f92-49d7-bcce-507525427334 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:35.162011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283f0df-1f92-49d7-bcce-507525427334 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:35.162723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283f0df-1f92-49d7-bcce-507525427334 None admin] RBAC: Adding query filter params (name=member) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:35.163123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283f0df-1f92-49d7-bcce-507525427334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:35.164565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283f0df-1f92-49d7-bcce-507525427334 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:35.174366 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 193/385] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:35.179574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b7e5f160-188c-4607-89bb-737ae39a7519 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:35.179809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283f0df-1f92-49d7-bcce-507525427334 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:35.180801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b7e5f160-188c-4607-89bb-737ae39a7519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:35.287183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283f0df-1f92-49d7-bcce-507525427334 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:35.309852 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 193/386] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:35.324996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e90304-19f3-4e97-bbdb-993c3649346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:35.326003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e90304-19f3-4e97-bbdb-993c3649346f None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:35.326603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e90304-19f3-4e97-bbdb-993c3649346f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:35.327100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e90304-19f3-4e97-bbdb-993c3649346f None admin] PATH_INFO: `/v3/groups/d0b901492380456e8637befba20bc345` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:35.328550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e90304-19f3-4e97-bbdb-993c3649346f None admin] RBAC: Authorizing `identity:get_group(group_id=d0b901492380456e8637befba20bc345)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:35.330293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e90304-19f3-4e97-bbdb-993c3649346f None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:35.332437 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 194/387] 10.222.0.76 () {56 vars in 1180 bytes} [Sat Aug 27 04:17:35 2022] GET /identity/v3/groups/d0b901492380456e8637befba20bc345 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:35.339760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5f160-188c-4607-89bb-737ae39a7519 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:35.365398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:35.457939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5f160-188c-4607-89bb-737ae39a7519 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:35.492687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62698e-22dc-489e-8bea-d16fe47c17de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:35.493312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62698e-22dc-489e-8bea-d16fe47c17de None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:35.493592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62698e-22dc-489e-8bea-d16fe47c17de None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:35.493862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62698e-22dc-489e-8bea-d16fe47c17de None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:35.494992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62698e-22dc-489e-8bea-d16fe47c17de None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:35.496509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62698e-22dc-489e-8bea-d16fe47c17de None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:35.499110 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 194/388] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:35 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:35.504469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e90304-19f3-4e97-bbdb-993c3649346f None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:35.552782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c7a53-c726-49ee-a811-c9017ea80fdd None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:35.553043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c7a53-c726-49ee-a811-c9017ea80fdd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:35.553316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c7a53-c726-49ee-a811-c9017ea80fdd None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:35.554932 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 195/389] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:35.559477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671798dd-4856-4ac4-90eb-b51caba09b57 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:35.559760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671798dd-4856-4ac4-90eb-b51caba09b57 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:35.560086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671798dd-4856-4ac4-90eb-b51caba09b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:35.578400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-671798dd-4856-4ac4-90eb-b51caba09b57 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:35.579585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-671798dd-4856-4ac4-90eb-b51caba09b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:35.596524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:35.652340 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 196/390] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:35.653715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671798dd-4856-4ac4-90eb-b51caba09b57 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:35.668830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:35.694049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e90304-19f3-4e97-bbdb-993c3649346f None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:35.741555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02beac59-fcfc-46fb-9ce8-cce475c9feb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:35.744632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02beac59-fcfc-46fb-9ce8-cce475c9feb3 None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:35.745144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02beac59-fcfc-46fb-9ce8-cce475c9feb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:35.746797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02beac59-fcfc-46fb-9ce8-cce475c9feb3 None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5/groups/d0b901492380456e8637befba20bc345/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:35.750403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02beac59-fcfc-46fb-9ce8-cce475c9feb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a63babe747425e956f165dd09383c5, group_id=d0b901492380456e8637befba20bc345, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:35.753013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02beac59-fcfc-46fb-9ce8-cce475c9feb3 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:35.801034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671798dd-4856-4ac4-90eb-b51caba09b57 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:35.838022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e65684-9ba6-4ff9-94c7-2e72913b2a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:35.838988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e65684-9ba6-4ff9-94c7-2e72913b2a4f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:35.839467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e65684-9ba6-4ff9-94c7-2e72913b2a4f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:35.839934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e65684-9ba6-4ff9-94c7-2e72913b2a4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:35.850999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e65684-9ba6-4ff9-94c7-2e72913b2a4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:35.856195 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-f4e65684-9ba6-4ff9-94c7-2e72913b2a4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:35.856195 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:35.856195 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:35.856195 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:35.856195 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:35.856195 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:35.856195 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:35.856195 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:35.856195 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:35.856195 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:35.856195 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:35.856195 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:35.856195 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:35.856195 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:35.856195 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:35.856195 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:35.857791 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:35.857791 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:35.857791 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:35.857791 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:35.857791 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:35.857791 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:35.857791 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:35.857791 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:35.857791 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:35.857791 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:35.857791 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:35.857791 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:35.857791 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:35.857791 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:35.857791 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:35.857791 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:35.858771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:35.858771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:35.858771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:35.858771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:35.858771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:35.858771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:35.858771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:35.858771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:35.858771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:35.858771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:35.858771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:35.858771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:35.867015 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 195/391] 10.222.0.76 () {58 vars in 1442 bytes} [Sat Aug 27 04:17:35 2022] PUT /identity/v3/projects/b8a63babe747425e956f165dd09383c5/groups/d0b901492380456e8637befba20bc345/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:17:35.872397 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 197/392] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:17:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:35.875270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02beac59-fcfc-46fb-9ce8-cce475c9feb3 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:35.971189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e65684-9ba6-4ff9-94c7-2e72913b2a4f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:36.002054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02beac59-fcfc-46fb-9ce8-cce475c9feb3 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:36.020190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:36.062424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404a8df-7dbf-4924-bed6-e807f7774fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:36.063128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404a8df-7dbf-4924-bed6-e807f7774fab None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:36.063409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404a8df-7dbf-4924-bed6-e807f7774fab None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:36.063676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404a8df-7dbf-4924-bed6-e807f7774fab None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:36.064371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404a8df-7dbf-4924-bed6-e807f7774fab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:36.064677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404a8df-7dbf-4924-bed6-e807f7774fab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:36.066276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404a8df-7dbf-4924-bed6-e807f7774fab None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:36.084195 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 196/393] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:36.085501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404a8df-7dbf-4924-bed6-e807f7774fab None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:36.103865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:36.149822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e65684-9ba6-4ff9-94c7-2e72913b2a4f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:36.199396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579de73-4690-47c7-9f1b-a3f74c8f2240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:36.201283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579de73-4690-47c7-9f1b-a3f74c8f2240 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:36.201776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579de73-4690-47c7-9f1b-a3f74c8f2240 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:36.202506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579de73-4690-47c7-9f1b-a3f74c8f2240 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:36.214264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579de73-4690-47c7-9f1b-a3f74c8f2240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:36.215329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404a8df-7dbf-4924-bed6-e807f7774fab None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:36.219800 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-f579de73-4690-47c7-9f1b-a3f74c8f2240 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:36.219800 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:36.219800 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:36.219800 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:36.219800 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:36.219800 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:36.219800 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:36.219800 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:36.219800 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:36.219800 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:36.219800 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:36.219800 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:36.219800 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:36.219800 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:36.219800 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:36.219800 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:36.220734 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:36.220734 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:36.220734 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:36.220734 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:36.220734 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:36.220734 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:36.220734 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:36.220734 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:36.220734 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:36.220734 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:36.220734 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:36.220734 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:36.220734 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:36.220734 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:36.220734 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:36.220734 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:36.221623 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:36.221623 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:36.221623 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:36.221623 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:36.221623 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:36.221623 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:36.221623 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:36.221623 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:36.221623 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:36.221623 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:36.221623 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:36.221623 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:36.221623 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 198/394] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:17:36.233257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579de73-4690-47c7-9f1b-a3f74c8f2240 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:36.258947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b0451-d095-4b21-aa2a-113825dac212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:36.260151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b0451-d095-4b21-aa2a-113825dac212 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:36.260636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b0451-d095-4b21-aa2a-113825dac212 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:36.261348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b0451-d095-4b21-aa2a-113825dac212 None admin] PATH_INFO: `/v3/groups/d0b901492380456e8637befba20bc345` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:36.262845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b0451-d095-4b21-aa2a-113825dac212 None admin] RBAC: Authorizing `identity:get_group(group_id=d0b901492380456e8637befba20bc345)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:36.265903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b0451-d095-4b21-aa2a-113825dac212 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:36.268243 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 197/395] 10.222.0.76 () {56 vars in 1180 bytes} [Sat Aug 27 04:17:36 2022] GET /identity/v3/groups/d0b901492380456e8637befba20bc345 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:36.273860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b0451-d095-4b21-aa2a-113825dac212 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:36.313310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:36.385517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579de73-4690-47c7-9f1b-a3f74c8f2240 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:36.387499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b0451-d095-4b21-aa2a-113825dac212 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:36.420925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:36.426329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47182462-154c-4bf6-bc2e-2564052ba379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:36.427062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47182462-154c-4bf6-bc2e-2564052ba379 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:36.433850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47182462-154c-4bf6-bc2e-2564052ba379 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:36.433850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47182462-154c-4bf6-bc2e-2564052ba379 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:36.433850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47182462-154c-4bf6-bc2e-2564052ba379 None admin] RBAC: Adding query filter params (name=member) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:36.433850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47182462-154c-4bf6-bc2e-2564052ba379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:36.433850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47182462-154c-4bf6-bc2e-2564052ba379 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:36.438185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fc51a-b865-46ed-b8cc-9f770fcc8cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:36.439060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fc51a-b865-46ed-b8cc-9f770fcc8cd4 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:36.439511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fc51a-b865-46ed-b8cc-9f770fcc8cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:36.439973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fc51a-b865-46ed-b8cc-9f770fcc8cd4 None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:36.440577 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 199/396] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:36.441724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fc51a-b865-46ed-b8cc-9f770fcc8cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:36.441902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41473030-ab61-4896-b7e4-86fab1ae08ae None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:36.442143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41473030-ab61-4896-b7e4-86fab1ae08ae None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:36.442469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41473030-ab61-4896-b7e4-86fab1ae08ae None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:36.444208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fc51a-b865-46ed-b8cc-9f770fcc8cd4 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:36.444346 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 200/397] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:36.445878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41473030-ab61-4896-b7e4-86fab1ae08ae None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:36.451645 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 198/398] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:36 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:36.453117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577d336-c4fc-41a2-9bec-7c0d3f81a3a1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:36.453509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577d336-c4fc-41a2-9bec-7c0d3f81a3a1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:36.453907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577d336-c4fc-41a2-9bec-7c0d3f81a3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:36.474480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c577d336-c4fc-41a2-9bec-7c0d3f81a3a1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:36.475895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c577d336-c4fc-41a2-9bec-7c0d3f81a3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:36.563800 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 199/399] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:36.569476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41473030-ab61-4896-b7e4-86fab1ae08ae None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:36.573002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577d336-c4fc-41a2-9bec-7c0d3f81a3a1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:36.607799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec05a58-57f9-4b6e-9fc1-72a7e83c4896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:36.608808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05a58-57f9-4b6e-9fc1-72a7e83c4896 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:36.609325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05a58-57f9-4b6e-9fc1-72a7e83c4896 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:36.609811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05a58-57f9-4b6e-9fc1-72a7e83c4896 None admin] PATH_INFO: `/v3/groups/d0b901492380456e8637befba20bc345` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:36.611159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec05a58-57f9-4b6e-9fc1-72a7e83c4896 None admin] RBAC: Authorizing `identity:get_group(group_id=d0b901492380456e8637befba20bc345)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:36.613130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec05a58-57f9-4b6e-9fc1-72a7e83c4896 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:36.616081 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 201/400] 10.222.0.76 () {56 vars in 1180 bytes} [Sat Aug 27 04:17:36 2022] GET /identity/v3/groups/d0b901492380456e8637befba20bc345 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:36.621214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec05a58-57f9-4b6e-9fc1-72a7e83c4896 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:36.630173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:36.712600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:36.721530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577d336-c4fc-41a2-9bec-7c0d3f81a3a1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:36.744785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec05a58-57f9-4b6e-9fc1-72a7e83c4896 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:36.768148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a49512-b142-45fd-bdc2-7cf68aa01d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:36.769796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a49512-b142-45fd-bdc2-7cf68aa01d01 None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:36.770553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a49512-b142-45fd-bdc2-7cf68aa01d01 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:36.771005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a49512-b142-45fd-bdc2-7cf68aa01d01 None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5/groups/d0b901492380456e8637befba20bc345/roles/d78f86d36ded425d9148c0b5781ab7b2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:36.774140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a49512-b142-45fd-bdc2-7cf68aa01d01 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a63babe747425e956f165dd09383c5, group_id=d0b901492380456e8637befba20bc345, role_id=d78f86d36ded425d9148c0b5781ab7b2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:36.776534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a49512-b142-45fd-bdc2-7cf68aa01d01 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:36.784455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce29968-79bb-4a42-aa5d-2201e5952e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:36.785204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce29968-79bb-4a42-aa5d-2201e5952e69 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:36.785553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce29968-79bb-4a42-aa5d-2201e5952e69 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:36.785901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce29968-79bb-4a42-aa5d-2201e5952e69 None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:36.787091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce29968-79bb-4a42-aa5d-2201e5952e69 None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:36.788715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce29968-79bb-4a42-aa5d-2201e5952e69 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:36.790940 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 202/401] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:36 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:36.792078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f986c2c-9ca1-49e1-951b-1fa2a5d30cdb None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:36.792653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f986c2c-9ca1-49e1-951b-1fa2a5d30cdb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:36.793568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f986c2c-9ca1-49e1-951b-1fa2a5d30cdb None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:36.795052 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 203/402] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:36.796365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f986c2c-9ca1-49e1-951b-1fa2a5d30cdb None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:36.824233 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 200/403] 10.222.0.76 () {58 vars in 1442 bytes} [Sat Aug 27 04:17:36 2022] PUT /identity/v3/projects/b8a63babe747425e956f165dd09383c5/groups/d0b901492380456e8637befba20bc345/roles/d78f86d36ded425d9148c0b5781ab7b2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:17:36.826266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71aeba-5eab-42e7-ad6e-8291b4e43fb8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:36.826830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71aeba-5eab-42e7-ad6e-8291b4e43fb8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:36.827266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71aeba-5eab-42e7-ad6e-8291b4e43fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:36.859507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-eb71aeba-5eab-42e7-ad6e-8291b4e43fb8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:36.861837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-eb71aeba-5eab-42e7-ad6e-8291b4e43fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:36.953154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f986c2c-9ca1-49e1-951b-1fa2a5d30cdb None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:36.961999 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 201/404] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:36.963164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71aeba-5eab-42e7-ad6e-8291b4e43fb8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:36.994239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:37.002506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8d84a-85d4-434f-b217-2b71f50f87ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:37.003184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8d84a-85d4-434f-b217-2b71f50f87ef None admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:37.007856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8d84a-85d4-434f-b217-2b71f50f87ef None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:37.007856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8d84a-85d4-434f-b217-2b71f50f87ef None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e/groups/d0b901492380456e8637befba20bc345/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:37.008225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:37.009649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8d84a-85d4-434f-b217-2b71f50f87ef None admin] RBAC: Authorizing `identity:create_grant(project_id=c208601ac0cf4699975b00ec4d6d766e, group_id=d0b901492380456e8637befba20bc345, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:37.016063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8d84a-85d4-434f-b217-2b71f50f87ef None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:37.107398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71aeba-5eab-42e7-ad6e-8291b4e43fb8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:37.135460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37684917-edc5-4668-b3b0-0298b4113cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:37.136386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37684917-edc5-4668-b3b0-0298b4113cd4 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:37.136661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37684917-edc5-4668-b3b0-0298b4113cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:37.136927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37684917-edc5-4668-b3b0-0298b4113cd4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:37.148209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37684917-edc5-4668-b3b0-0298b4113cd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:37.153102 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-37684917-edc5-4668-b3b0-0298b4113cd4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:37.153102 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:37.153102 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:37.153102 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:37.153102 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:37.153102 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:37.153102 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:37.153102 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:37.153102 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:37.153102 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:37.153102 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:37.153102 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:37.153102 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:37.153102 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:37.153102 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:37.153102 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:37.154387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:37.154387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:37.154387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:37.154387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:37.154387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:37.154387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:37.154387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:37.154387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:37.154387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:37.154387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:37.154387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:37.154387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:37.154387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:37.154387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:37.154387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:37.154387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:37.155327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:37.155327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:37.155327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:37.155327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:37.155327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:37.155327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:37.155327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:37.155327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:37.155327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:37.155327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:37.155327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:37.155327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:37.155327 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 202/405] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:17:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:37.159939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37684917-edc5-4668-b3b0-0298b4113cd4 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:37.208029 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 204/406] 10.222.0.76 () {58 vars in 1442 bytes} [Sat Aug 27 04:17:36 2022] PUT /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e/groups/d0b901492380456e8637befba20bc345/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:17:37.257017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8d84a-85d4-434f-b217-2b71f50f87ef None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:37.277254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37684917-edc5-4668-b3b0-0298b4113cd4 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:37.295432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:37.322614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4487a98-1b03-453e-90e7-83e6d38edeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:37.324018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4487a98-1b03-453e-90e7-83e6d38edeac None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:37.324706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4487a98-1b03-453e-90e7-83e6d38edeac None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:37.325189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4487a98-1b03-453e-90e7-83e6d38edeac None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:37.326284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4487a98-1b03-453e-90e7-83e6d38edeac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:37.326788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4487a98-1b03-453e-90e7-83e6d38edeac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:37.328591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4487a98-1b03-453e-90e7-83e6d38edeac None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:37.338806 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 203/407] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:37.349527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4487a98-1b03-453e-90e7-83e6d38edeac None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:37.414386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8d84a-85d4-434f-b217-2b71f50f87ef None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:37.451856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d07b3-2c7d-444f-b037-a40f63727965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:37.452520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d07b3-2c7d-444f-b037-a40f63727965 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:37.452800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d07b3-2c7d-444f-b037-a40f63727965 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:37.453127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d07b3-2c7d-444f-b037-a40f63727965 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:37.463469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d07b3-2c7d-444f-b037-a40f63727965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:37.469632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-de1d07b3-2c7d-444f-b037-a40f63727965 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:17:37.469632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:37.469632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:37.469632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:37.469632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:37.469632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:37.469632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:37.469632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:37.469632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:37.469632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:37.469632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:37.469632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:37.469632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:37.469632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:37.469632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:37.469632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:37.470569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:37.470569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:37.470569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:37.470569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:37.470569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:37.470569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:37.470569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:37.470569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:37.470569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:37.470569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:37.470569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:37.470569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:37.470569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:37.470569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:37.470569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:37.470569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:37.471366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:37.471366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:37.471366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:37.471366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:37.471366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:37.471366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:37.471366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:37.471366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:37.471366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:37.471366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:37.471366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:17:37.471366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:37.471366 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 205/408] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:17:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:37.483901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d07b3-2c7d-444f-b037-a40f63727965 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:37.498483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4487a98-1b03-453e-90e7-83e6d38edeac None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:37.537901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa844a-8658-4c59-8042-b10ff18b060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:37.538940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:37.539762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa844a-8658-4c59-8042-b10ff18b060c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:37.540264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa844a-8658-4c59-8042-b10ff18b060c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:37.540737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa844a-8658-4c59-8042-b10ff18b060c None admin] PATH_INFO: `/v3/groups/d0b901492380456e8637befba20bc345` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:37.542094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa844a-8658-4c59-8042-b10ff18b060c None admin] RBAC: Authorizing `identity:get_group(group_id=d0b901492380456e8637befba20bc345)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:37.543782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa844a-8658-4c59-8042-b10ff18b060c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:37.546608 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 204/409] 10.222.0.76 () {56 vars in 1180 bytes} [Sat Aug 27 04:17:37 2022] GET /identity/v3/groups/d0b901492380456e8637befba20bc345 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:37.553555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa844a-8658-4c59-8042-b10ff18b060c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:37.586508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:37.619611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d07b3-2c7d-444f-b037-a40f63727965 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:37.661419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f84321-dcd4-438d-ac15-812170683d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:37.662034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f84321-dcd4-438d-ac15-812170683d4b None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:37.662310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f84321-dcd4-438d-ac15-812170683d4b None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:37.662581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f84321-dcd4-438d-ac15-812170683d4b None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:37.663248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f84321-dcd4-438d-ac15-812170683d4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:37.663547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f84321-dcd4-438d-ac15-812170683d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:37.665017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f84321-dcd4-438d-ac15-812170683d4b None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:37.680783 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 206/410] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:37.686792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f84321-dcd4-438d-ac15-812170683d4b None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:37.727803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa844a-8658-4c59-8042-b10ff18b060c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:37.765585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37e5a2-85bd-4416-98b3-c4e7ef5e8eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:37.767573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37e5a2-85bd-4416-98b3-c4e7ef5e8eb7 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:37.767573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37e5a2-85bd-4416-98b3-c4e7ef5e8eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:37.767573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37e5a2-85bd-4416-98b3-c4e7ef5e8eb7 None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:37.768195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37e5a2-85bd-4416-98b3-c4e7ef5e8eb7 None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:37.769809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37e5a2-85bd-4416-98b3-c4e7ef5e8eb7 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:37.771892 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 205/411] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:37 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:37.777039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37e5a2-85bd-4416-98b3-c4e7ef5e8eb7 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:37.877396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:37.888843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37e5a2-85bd-4416-98b3-c4e7ef5e8eb7 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:37.929130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08731236-6f9a-4380-9405-82bd441f45b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:37.930218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08731236-6f9a-4380-9405-82bd441f45b5 None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:37.930503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08731236-6f9a-4380-9405-82bd441f45b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:37.930774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08731236-6f9a-4380-9405-82bd441f45b5 None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e/groups/d0b901492380456e8637befba20bc345/roles/d78f86d36ded425d9148c0b5781ab7b2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:37.933379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08731236-6f9a-4380-9405-82bd441f45b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c208601ac0cf4699975b00ec4d6d766e, group_id=d0b901492380456e8637befba20bc345, role_id=d78f86d36ded425d9148c0b5781ab7b2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:37.936520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08731236-6f9a-4380-9405-82bd441f45b5 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:37.957933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f84321-dcd4-438d-ac15-812170683d4b None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:37.973319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:37.998119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8429e8a-7084-42ce-8e0d-2d035055a55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:37.998747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8429e8a-7084-42ce-8e0d-2d035055a55a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:37.999022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8429e8a-7084-42ce-8e0d-2d035055a55a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:37.999291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8429e8a-7084-42ce-8e0d-2d035055a55a None admin] PATH_INFO: `/v3/groups/3b50e6f2757b483d8b3f47cde76b71a7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:38.001486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8429e8a-7084-42ce-8e0d-2d035055a55a None admin] RBAC: Authorizing `identity:get_group(group_id=3b50e6f2757b483d8b3f47cde76b71a7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:38.007396 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 206/412] 10.222.0.76 () {58 vars in 1442 bytes} [Sat Aug 27 04:17:37 2022] PUT /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e/groups/d0b901492380456e8637befba20bc345/roles/d78f86d36ded425d9148c0b5781ab7b2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:17:38.008661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8429e8a-7084-42ce-8e0d-2d035055a55a None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:38.010619 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 207/413] 10.222.0.76 () {56 vars in 1180 bytes} [Sat Aug 27 04:17:37 2022] GET /identity/v3/groups/3b50e6f2757b483d8b3f47cde76b71a7 => generated 229 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:38.017361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08731236-6f9a-4380-9405-82bd441f45b5 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:38.146481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08731236-6f9a-4380-9405-82bd441f45b5 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:38.192588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85142f-67ae-4487-8a3b-5869cb012aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:38.193160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85142f-67ae-4487-8a3b-5869cb012aff None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:38.193439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85142f-67ae-4487-8a3b-5869cb012aff None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:38.193713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85142f-67ae-4487-8a3b-5869cb012aff None admin] PATH_INFO: `/v3/projects/4935ddf6dc2a4bbea15d24b9f9bae471` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:38.194886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85142f-67ae-4487-8a3b-5869cb012aff None admin] RBAC: Authorizing `identity:get_project(project_id=4935ddf6dc2a4bbea15d24b9f9bae471)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:38.196400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85142f-67ae-4487-8a3b-5869cb012aff None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:38.198270 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 207/414] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:38 2022] GET /identity/v3/projects/4935ddf6dc2a4bbea15d24b9f9bae471 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:38.204835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8429e8a-7084-42ce-8e0d-2d035055a55a None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:38.225181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55b72-5159-4e19-969b-d17c9a7d76e6 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:38.225461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55b72-5159-4e19-969b-d17c9a7d76e6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:38.225737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55b72-5159-4e19-969b-d17c9a7d76e6 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:38.227341 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 208/415] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:38.232498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a571bc-a729-48a7-a022-97fd3d5ec3ca None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:38.232887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a571bc-a729-48a7-a022-97fd3d5ec3ca None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:38.233264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a571bc-a729-48a7-a022-97fd3d5ec3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:38.251916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-49a571bc-a729-48a7-a022-97fd3d5ec3ca None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:38.253311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-49a571bc-a729-48a7-a022-97fd3d5ec3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:38.256566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:38.334218 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 209/416] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:38.379144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8429e8a-7084-42ce-8e0d-2d035055a55a None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:38.417532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d10469-ddd9-4aed-a544-fc55169ae716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:38.418969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d10469-ddd9-4aed-a544-fc55169ae716 None admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:38.419600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d10469-ddd9-4aed-a544-fc55169ae716 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:38.420018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d10469-ddd9-4aed-a544-fc55169ae716 None admin] PATH_INFO: `/v3/projects/4935ddf6dc2a4bbea15d24b9f9bae471/groups/3b50e6f2757b483d8b3f47cde76b71a7/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:38.422569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d10469-ddd9-4aed-a544-fc55169ae716 None admin] RBAC: Authorizing `identity:create_grant(project_id=4935ddf6dc2a4bbea15d24b9f9bae471, group_id=3b50e6f2757b483d8b3f47cde76b71a7, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:38.424384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d10469-ddd9-4aed-a544-fc55169ae716 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:38.493886 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 208/417] 10.222.0.76 () {58 vars in 1442 bytes} [Sat Aug 27 04:17:38 2022] PUT /identity/v3/projects/4935ddf6dc2a4bbea15d24b9f9bae471/groups/3b50e6f2757b483d8b3f47cde76b71a7/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:17:38.646463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a571bc-a729-48a7-a022-97fd3d5ec3ca None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:38.767811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a571bc-a729-48a7-a022-97fd3d5ec3ca None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:38.811949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c323a-c737-4c36-84e1-d1d086631fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:38.812613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c323a-c737-4c36-84e1-d1d086631fab None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:38.812889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c323a-c737-4c36-84e1-d1d086631fab None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:38.813157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c323a-c737-4c36-84e1-d1d086631fab None admin] PATH_INFO: `/v3/roles/member` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:38.821567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:38.824514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c323a-c737-4c36-84e1-d1d086631fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:38.829412 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-893c323a-c737-4c36-84e1-d1d086631fab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:38.829412 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:38.829412 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:38.829412 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:38.829412 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:38.829412 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:38.829412 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:38.829412 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:38.829412 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:38.829412 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:38.829412 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:38.829412 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:38.829412 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:38.829412 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:38.829412 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:38.829412 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:38.830282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:38.830282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:38.830282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:38.830282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:38.830282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:38.830282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:38.830282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:38.830282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:38.830282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:38.830282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:38.830282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:38.830282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:38.830282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:38.830282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:38.830282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:38.830282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:38.831120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:38.831120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:38.831120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:38.831120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:38.831120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:38.831120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:38.831120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:38.831120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:38.831120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:38.831120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:38.831120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:38.831120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:38.831120 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 210/418] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:38.836203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d10469-ddd9-4aed-a544-fc55169ae716 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:38.896489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:38.977888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d10469-ddd9-4aed-a544-fc55169ae716 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:39.012748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4ddfb-6f8e-4703-9469-271d5d4be1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:39.013895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4ddfb-6f8e-4703-9469-271d5d4be1f5 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:39.014262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4ddfb-6f8e-4703-9469-271d5d4be1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:39.014584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4ddfb-6f8e-4703-9469-271d5d4be1f5 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:39.015260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4ddfb-6f8e-4703-9469-271d5d4be1f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:39.015561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4ddfb-6f8e-4703-9469-271d5d4be1f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:39.016990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4ddfb-6f8e-4703-9469-271d5d4be1f5 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:39.025964 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 209/419] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:39.033241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c323a-c737-4c36-84e1-d1d086631fab None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:39.150893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c323a-c737-4c36-84e1-d1d086631fab None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:39.170029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13601b8e-f748-480b-b255-cff36b23d9f0 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:39.170333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13601b8e-f748-480b-b255-cff36b23d9f0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:39.170579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13601b8e-f748-480b-b255-cff36b23d9f0 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:39.172157 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 210/420] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:39.187568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfb23b-2225-4a79-b77d-92cbe44db4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:39.188523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfb23b-2225-4a79-b77d-92cbe44db4aa None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:39.188884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774fcb4-fa1f-4ba6-bacc-add2ed333d58 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:39.189168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774fcb4-fa1f-4ba6-bacc-add2ed333d58 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:39.189441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774fcb4-fa1f-4ba6-bacc-add2ed333d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:39.189554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfb23b-2225-4a79-b77d-92cbe44db4aa None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:39.190011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfb23b-2225-4a79-b77d-92cbe44db4aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:39.221578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7774fcb4-fa1f-4ba6-bacc-add2ed333d58 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:39.222876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7774fcb4-fa1f-4ba6-bacc-add2ed333d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:39.260844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:39.264071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfb23b-2225-4a79-b77d-92cbe44db4aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:39.265890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfb23b-2225-4a79-b77d-92cbe44db4aa None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:39.350814 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 211/421] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:39.370350 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 211/422] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:39.377123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774fcb4-fa1f-4ba6-bacc-add2ed333d58 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:39.410287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:39.488357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774fcb4-fa1f-4ba6-bacc-add2ed333d58 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:39.526073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aea6e3-830d-412a-bfcb-8725bef460f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:39.526950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aea6e3-830d-412a-bfcb-8725bef460f2 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:39.536306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aea6e3-830d-412a-bfcb-8725bef460f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:39.536306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aea6e3-830d-412a-bfcb-8725bef460f2 None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:39.536306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aea6e3-830d-412a-bfcb-8725bef460f2 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:39.536306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aea6e3-830d-412a-bfcb-8725bef460f2 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:39.536306 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 212/423] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:39 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:39.538681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfb23b-2225-4a79-b77d-92cbe44db4aa None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:39.643249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:39.648844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfb23b-2225-4a79-b77d-92cbe44db4aa None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:39.684387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ffd78-4725-4ff3-8818-8dc489e2930b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:39.685574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ffd78-4725-4ff3-8818-8dc489e2930b None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:39.685853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ffd78-4725-4ff3-8818-8dc489e2930b None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:39.686128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ffd78-4725-4ff3-8818-8dc489e2930b None admin] PATH_INFO: `/v3/groups/d0b901492380456e8637befba20bc345` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:39.687245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ffd78-4725-4ff3-8818-8dc489e2930b None admin] RBAC: Authorizing `identity:get_group(group_id=d0b901492380456e8637befba20bc345)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:39.688875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ffd78-4725-4ff3-8818-8dc489e2930b None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:39.690793 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 212/424] 10.222.0.76 () {56 vars in 1180 bytes} [Sat Aug 27 04:17:39 2022] GET /identity/v3/groups/d0b901492380456e8637befba20bc345 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:39.696621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aea6e3-830d-412a-bfcb-8725bef460f2 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:39.757047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ffd78-4725-4ff3-8818-8dc489e2930b None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:39.813593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aea6e3-830d-412a-bfcb-8725bef460f2 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:39.815708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:39.854077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae244d4-7fb2-4226-8ead-e0f6741b908f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:39.855116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae244d4-7fb2-4226-8ead-e0f6741b908f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:39.856452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae244d4-7fb2-4226-8ead-e0f6741b908f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:39.857532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae244d4-7fb2-4226-8ead-e0f6741b908f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:39.858513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae244d4-7fb2-4226-8ead-e0f6741b908f None admin] RBAC: Adding query filter params (group.id=d0b901492380456e8637befba20bc345, role.id=5a4c2cf9b8d849398625913504b4b172, scope.project.id=b8a63babe747425e956f165dd09383c5) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:39.858926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae244d4-7fb2-4226-8ead-e0f6741b908f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:39.860669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae244d4-7fb2-4226-8ead-e0f6741b908f None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:39.868186 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 213/425] 10.222.0.76 () {56 vars in 1376 bytes} [Sat Aug 27 04:17:39 2022] GET /identity/v3/role_assignments?group.id=d0b901492380456e8637befba20bc345&scope.project.id=b8a63babe747425e956f165dd09383c5&role.id=5a4c2cf9b8d849398625913504b4b172 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:40.010452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ffd78-4725-4ff3-8818-8dc489e2930b None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:40.054059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc152d-efcf-4c2a-b1b9-70f4e047edcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:40.054695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc152d-efcf-4c2a-b1b9-70f4e047edcd None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:40.054976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc152d-efcf-4c2a-b1b9-70f4e047edcd None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:40.055310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc152d-efcf-4c2a-b1b9-70f4e047edcd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:40.066865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc152d-efcf-4c2a-b1b9-70f4e047edcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:40.071694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-02bc152d-efcf-4c2a-b1b9-70f4e047edcd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:40.071694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:40.071694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:40.071694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:40.071694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:40.071694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:40.071694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:40.071694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:40.071694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:40.071694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:40.071694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:40.071694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:40.071694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:40.071694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:40.071694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:40.071694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:40.072616 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:40.072616 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:40.072616 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:40.072616 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:40.072616 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:40.072616 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:40.072616 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:40.072616 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:40.072616 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:40.072616 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:40.072616 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:40.072616 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:40.072616 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:40.072616 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:40.072616 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:40.072616 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:40.073387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:40.073387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:40.073387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:40.073387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:40.073387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:40.073387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:40.073387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:40.073387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:40.073387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:40.073387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:40.073387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:40.073387 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:40.073387 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 213/426] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:17:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:17:40.080237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae244d4-7fb2-4226-8ead-e0f6741b908f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:40.087771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6b125-4a15-4c87-8d94-c24084aec10a None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:40.088066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6b125-4a15-4c87-8d94-c24084aec10a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:40.088388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6b125-4a15-4c87-8d94-c24084aec10a None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:40.089982 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 214/427] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:17:40.095474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f393ac-e274-4727-b44d-4fe7b870ca1d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:40.095758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f393ac-e274-4727-b44d-4fe7b870ca1d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:40.096030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f393ac-e274-4727-b44d-4fe7b870ca1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:40.120346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-81f393ac-e274-4727-b44d-4fe7b870ca1d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:40.121548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-81f393ac-e274-4727-b44d-4fe7b870ca1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:40.153958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:40.218572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae244d4-7fb2-4226-8ead-e0f6741b908f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:40.219707 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 215/428] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:40.258152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fab2df-f74e-4224-9355-98f9baf8e3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:40.258762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fab2df-f74e-4224-9355-98f9baf8e3ff None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:40.259046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fab2df-f74e-4224-9355-98f9baf8e3ff None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:40.259321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fab2df-f74e-4224-9355-98f9baf8e3ff None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:40.259988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fab2df-f74e-4224-9355-98f9baf8e3ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:40.260324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fab2df-f74e-4224-9355-98f9baf8e3ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:40.261986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fab2df-f74e-4224-9355-98f9baf8e3ff None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:40.270847 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 214/429] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:40.276276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f393ac-e274-4727-b44d-4fe7b870ca1d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:40.396490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f393ac-e274-4727-b44d-4fe7b870ca1d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:40.446922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d828e17-5bcb-4427-ac33-f07bac71f210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:40.447524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d828e17-5bcb-4427-ac33-f07bac71f210 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:40.447795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d828e17-5bcb-4427-ac33-f07bac71f210 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:40.448059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d828e17-5bcb-4427-ac33-f07bac71f210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:40.484283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:40.519030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fab2df-f74e-4224-9355-98f9baf8e3ff None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:40.533851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d828e17-5bcb-4427-ac33-f07bac71f210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:40.535308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d828e17-5bcb-4427-ac33-f07bac71f210 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:40.573568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:40.664124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fab2df-f74e-4224-9355-98f9baf8e3ff None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:40.677757 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 216/430] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:40.679336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2de941-2ff8-4587-9ec6-9e736117f4b8 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:40.679627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2de941-2ff8-4587-9ec6-9e736117f4b8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:40.679899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2de941-2ff8-4587-9ec6-9e736117f4b8 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:40.681719 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 217/431] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:40.683198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2de941-2ff8-4587-9ec6-9e736117f4b8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:40.715611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62ee3e-6708-4936-926c-0705922d85e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:40.716662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62ee3e-6708-4936-926c-0705922d85e2 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:40.717252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62ee3e-6708-4936-926c-0705922d85e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:40.717538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62ee3e-6708-4936-926c-0705922d85e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:40.730541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62ee3e-6708-4936-926c-0705922d85e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:40.737620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-dd62ee3e-6708-4936-926c-0705922d85e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:40.737620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:40.737620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:40.737620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:40.737620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:40.737620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:40.737620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:40.737620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:40.737620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:40.737620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:40.737620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:40.737620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:40.737620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:40.737620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:40.737620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:40.737620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:40.738529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:40.738529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:40.738529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:40.738529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:40.738529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:40.738529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:40.738529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:40.738529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:40.738529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:40.738529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:40.738529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:40.738529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:40.738529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:40.738529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:40.738529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:40.738529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:40.739315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:40.739315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:40.739315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:40.739315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:40.739315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:40.739315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:40.739315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:40.739315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:40.739315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:40.739315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:40.739315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 04:17:40.739315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:40.743926 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 215/432] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:17:40.745681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1d428-fc21-445d-9e82-96b38d01930e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:40.745968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1d428-fc21-445d-9e82-96b38d01930e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:40.746528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1d428-fc21-445d-9e82-96b38d01930e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:40.758136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:40.770207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-61f1d428-fc21-445d-9e82-96b38d01930e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:40.777651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-61f1d428-fc21-445d-9e82-96b38d01930e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:40.799899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2de941-2ff8-4587-9ec6-9e736117f4b8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:40.833929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145aa1ed-74eb-4c76-8e83-ef1f00f05f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:40.834546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145aa1ed-74eb-4c76-8e83-ef1f00f05f80 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:40.834818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145aa1ed-74eb-4c76-8e83-ef1f00f05f80 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:40.835081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145aa1ed-74eb-4c76-8e83-ef1f00f05f80 None admin] PATH_INFO: `/v3/projects/b8a63babe747425e956f165dd09383c5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:40.836207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145aa1ed-74eb-4c76-8e83-ef1f00f05f80 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a63babe747425e956f165dd09383c5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:40.837616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145aa1ed-74eb-4c76-8e83-ef1f00f05f80 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:40.837717 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 216/433] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:40.838554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1d428-fc21-445d-9e82-96b38d01930e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:40.844144 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 218/434] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:40 2022] GET /identity/v3/projects/b8a63babe747425e956f165dd09383c5 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:40.844144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0cd33-404c-42bf-a6ab-286900ab33d3 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:40.844144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0cd33-404c-42bf-a6ab-286900ab33d3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:40.844144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0cd33-404c-42bf-a6ab-286900ab33d3 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:40.844144 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 219/435] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:40.845004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0cd33-404c-42bf-a6ab-286900ab33d3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:40.863506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:40.949559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1d428-fc21-445d-9e82-96b38d01930e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:40.958509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0cd33-404c-42bf-a6ab-286900ab33d3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:40.986648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:40.986912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad2ab7-eea7-42d8-9aae-e0232801b329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:40.987453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad2ab7-eea7-42d8-9aae-e0232801b329 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:40.987851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad2ab7-eea7-42d8-9aae-e0232801b329 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:40.988465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad2ab7-eea7-42d8-9aae-e0232801b329 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:40.989133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad2ab7-eea7-42d8-9aae-e0232801b329 None admin] RBAC: Adding query filter params (name=member) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:40.989437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad2ab7-eea7-42d8-9aae-e0232801b329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:40.990851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad2ab7-eea7-42d8-9aae-e0232801b329 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:40.996765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdeb772-2a21-49ef-a858-f077b7e6589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:40.997660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeb772-2a21-49ef-a858-f077b7e6589a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:40.998119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeb772-2a21-49ef-a858-f077b7e6589a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:40.998561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeb772-2a21-49ef-a858-f077b7e6589a None admin] PATH_INFO: `/v3/groups/d0b901492380456e8637befba20bc345` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:40.999157 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 217/436] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:17:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:41.000353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c7c16-6dd7-4769-9552-ebd3463c834e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:41.000638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c7c16-6dd7-4769-9552-ebd3463c834e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:41.000909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c7c16-6dd7-4769-9552-ebd3463c834e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:41.004521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdeb772-2a21-49ef-a858-f077b7e6589a None admin] RBAC: Authorizing `identity:get_group(group_id=d0b901492380456e8637befba20bc345)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:41.006577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdeb772-2a21-49ef-a858-f077b7e6589a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:41.008820 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 220/437] 10.222.0.76 () {56 vars in 1180 bytes} [Sat Aug 27 04:17:40 2022] GET /identity/v3/groups/d0b901492380456e8637befba20bc345 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:41.009244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdeb772-2a21-49ef-a858-f077b7e6589a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:41.023754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-396c7c16-6dd7-4769-9552-ebd3463c834e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:41.024969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-396c7c16-6dd7-4769-9552-ebd3463c834e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:41.100257 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 218/438] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:41.100257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c7c16-6dd7-4769-9552-ebd3463c834e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:41.112077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:41.122068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdeb772-2a21-49ef-a858-f077b7e6589a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:41.159786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb016c6b-1464-467c-83a0-aa941b19b8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:41.160414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb016c6b-1464-467c-83a0-aa941b19b8d7 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:41.160695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb016c6b-1464-467c-83a0-aa941b19b8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:41.160967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb016c6b-1464-467c-83a0-aa941b19b8d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:41.213099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c7c16-6dd7-4769-9552-ebd3463c834e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:41.226789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:41.234952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb016c6b-1464-467c-83a0-aa941b19b8d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:41.236752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb016c6b-1464-467c-83a0-aa941b19b8d7 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:41.248472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f2483-96e9-4582-8587-311970908ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:41.249010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f2483-96e9-4582-8587-311970908ed1 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:41.249287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f2483-96e9-4582-8587-311970908ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:41.249559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f2483-96e9-4582-8587-311970908ed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:41.250277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f2483-96e9-4582-8587-311970908ed1 None admin] RBAC: Adding query filter params (group.id=d0b901492380456e8637befba20bc345, role.id=d78f86d36ded425d9148c0b5781ab7b2, scope.project.id=b8a63babe747425e956f165dd09383c5) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:41.250581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f2483-96e9-4582-8587-311970908ed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:41.252049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f2483-96e9-4582-8587-311970908ed1 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:41.257703 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 219/439] 10.222.0.76 () {56 vars in 1376 bytes} [Sat Aug 27 04:17:41 2022] GET /identity/v3/role_assignments?group.id=d0b901492380456e8637befba20bc345&scope.project.id=b8a63babe747425e956f165dd09383c5&role.id=d78f86d36ded425d9148c0b5781ab7b2 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:41.258472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f2483-96e9-4582-8587-311970908ed1 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:41.359510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:41.378960 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 221/440] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:41.379982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb016c6b-1464-467c-83a0-aa941b19b8d7 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:41.398660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f2483-96e9-4582-8587-311970908ed1 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:41.444599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0ce5b-3a05-4875-931a-660d63ede5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:41.445301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0ce5b-3a05-4875-931a-660d63ede5a8 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:41.445568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0ce5b-3a05-4875-931a-660d63ede5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:41.445876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0ce5b-3a05-4875-931a-660d63ede5a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:41.459229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0ce5b-3a05-4875-931a-660d63ede5a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:41.464276 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-14c0ce5b-3a05-4875-931a-660d63ede5a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:41.464276 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:41.464276 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:41.464276 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:41.464276 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:41.464276 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:41.464276 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:41.464276 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:41.464276 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:41.464276 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:41.464276 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:41.464276 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:41.464276 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:41.464276 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:41.464276 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:41.464276 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:41.465140 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:41.465140 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:41.465140 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:41.465140 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:41.465140 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:41.465140 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:41.465140 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:41.465140 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:41.465140 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:41.465140 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:41.465140 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:41.465140 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:41.465140 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:41.465140 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:41.465140 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:41.465140 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:41.465925 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:41.465925 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:41.465925 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:41.465925 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:41.465925 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:41.465925 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:41.465925 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:41.465925 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:41.465925 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:41.465925 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:41.465925 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:41.465925 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:41.470373 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 220/441] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:17:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:41.471346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0ce5b-3a05-4875-931a-660d63ede5a8 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:41.500054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:41.508387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb016c6b-1464-467c-83a0-aa941b19b8d7 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:41.552778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeafa6-f81e-4ddf-85ec-cde3b5003885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:41.552778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeafa6-f81e-4ddf-85ec-cde3b5003885 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:41.552778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeafa6-f81e-4ddf-85ec-cde3b5003885 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:41.552778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeafa6-f81e-4ddf-85ec-cde3b5003885 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:41.568827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbeafa6-f81e-4ddf-85ec-cde3b5003885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:41.573636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-1bbeafa6-f81e-4ddf-85ec-cde3b5003885 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:17:41.573636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:41.573636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:41.573636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:41.573636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:41.573636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:41.573636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:41.573636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:41.573636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:41.573636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:41.573636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:41.573636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:41.573636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:41.573636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:41.573636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:41.573636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:41.574542 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:41.574542 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:41.574542 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:41.574542 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:41.574542 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:41.574542 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:41.574542 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:41.574542 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:41.574542 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:41.574542 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:41.574542 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:41.574542 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:41.574542 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:41.574542 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:41.574542 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:41.574542 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:41.575435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:41.575435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:41.575435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:41.575435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:41.575435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:41.575435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:41.575435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:41.575435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:41.575435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:41.575435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:41.575435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:17:41.575435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:41.575435 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 222/442] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:17:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:41.576124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeafa6-f81e-4ddf-85ec-cde3b5003885 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:41.589704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0ce5b-3a05-4875-931a-660d63ede5a8 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:41.630935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:41.637085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcd595-017b-464b-a460-4918abe181e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:41.642746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcd595-017b-464b-a460-4918abe181e7 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:41.642746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcd595-017b-464b-a460-4918abe181e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:41.642746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcd595-017b-464b-a460-4918abe181e7 None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:41.642746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcd595-017b-464b-a460-4918abe181e7 None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:41.642746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcd595-017b-464b-a460-4918abe181e7 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:41.643265 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 221/443] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:41 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:41.644010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcd595-017b-464b-a460-4918abe181e7 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:41.685506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeafa6-f81e-4ddf-85ec-cde3b5003885 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:41.718990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3d253-c160-47a3-bd0d-b5a5d51d1219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:41.719581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3d253-c160-47a3-bd0d-b5a5d51d1219 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:41.719873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3d253-c160-47a3-bd0d-b5a5d51d1219 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:41.720125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3d253-c160-47a3-bd0d-b5a5d51d1219 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:41.720810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3d253-c160-47a3-bd0d-b5a5d51d1219 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:41.721107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3d253-c160-47a3-bd0d-b5a5d51d1219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:41.723201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3d253-c160-47a3-bd0d-b5a5d51d1219 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:41.732083 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 223/444] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:41.733163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3d253-c160-47a3-bd0d-b5a5d51d1219 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:41.754097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:41.756813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcd595-017b-464b-a460-4918abe181e7 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:41.790856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bdf71-7f28-4613-b2ef-b2e7920015c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:41.791469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bdf71-7f28-4613-b2ef-b2e7920015c9 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:41.791751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bdf71-7f28-4613-b2ef-b2e7920015c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:41.792022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bdf71-7f28-4613-b2ef-b2e7920015c9 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:41.792715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bdf71-7f28-4613-b2ef-b2e7920015c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:41.793018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bdf71-7f28-4613-b2ef-b2e7920015c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:41.794951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bdf71-7f28-4613-b2ef-b2e7920015c9 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:41.803275 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 222/445] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:41.803889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bdf71-7f28-4613-b2ef-b2e7920015c9 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:41.842630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3d253-c160-47a3-bd0d-b5a5d51d1219 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:41.865809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:41.877239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbd202-cacd-40a0-960c-b35aa91a412a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:41.877860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbd202-cacd-40a0-960c-b35aa91a412a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:41.888883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbd202-cacd-40a0-960c-b35aa91a412a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:41.888883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbd202-cacd-40a0-960c-b35aa91a412a None admin] PATH_INFO: `/v3/groups/d0b901492380456e8637befba20bc345` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:41.888883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbd202-cacd-40a0-960c-b35aa91a412a None admin] RBAC: Authorizing `identity:get_group(group_id=d0b901492380456e8637befba20bc345)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:41.888883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbd202-cacd-40a0-960c-b35aa91a412a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:41.888883 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 224/446] 10.222.0.76 () {56 vars in 1180 bytes} [Sat Aug 27 04:17:41 2022] GET /identity/v3/groups/d0b901492380456e8637befba20bc345 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:41.888883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbd202-cacd-40a0-960c-b35aa91a412a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:41.904833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bdf71-7f28-4613-b2ef-b2e7920015c9 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:41.940048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8e03b-7d61-40e4-92eb-03ba109a442c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:41.940681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8e03b-7d61-40e4-92eb-03ba109a442c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:41.940963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8e03b-7d61-40e4-92eb-03ba109a442c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:41.941235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8e03b-7d61-40e4-92eb-03ba109a442c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:41.971396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:41.987602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbd202-cacd-40a0-960c-b35aa91a412a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:42.016251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8e03b-7d61-40e4-92eb-03ba109a442c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:42.017712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8e03b-7d61-40e4-92eb-03ba109a442c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:42.022848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e1ab6-ad8f-419e-baa3-b8f6911bfaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:42.023449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e1ab6-ad8f-419e-baa3-b8f6911bfaf8 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:42.023727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e1ab6-ad8f-419e-baa3-b8f6911bfaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:42.023997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e1ab6-ad8f-419e-baa3-b8f6911bfaf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:42.078614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:42.092407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e1ab6-ad8f-419e-baa3-b8f6911bfaf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:42.093872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e1ab6-ad8f-419e-baa3-b8f6911bfaf8 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:42.131810 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 223/447] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:42.132686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8e03b-7d61-40e4-92eb-03ba109a442c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:42.195483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:42.211451 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 225/448] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:42.212314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e1ab6-ad8f-419e-baa3-b8f6911bfaf8 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:42.234957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8e03b-7d61-40e4-92eb-03ba109a442c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:42.269657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e12ae3-403a-40ff-9b13-005e5b2edd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:42.270214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e12ae3-403a-40ff-9b13-005e5b2edd3a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:42.270485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e12ae3-403a-40ff-9b13-005e5b2edd3a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:42.270759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e12ae3-403a-40ff-9b13-005e5b2edd3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:42.271497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e12ae3-403a-40ff-9b13-005e5b2edd3a None admin] RBAC: Adding query filter params (group.id=d0b901492380456e8637befba20bc345, role.id=5a4c2cf9b8d849398625913504b4b172, scope.project.id=c208601ac0cf4699975b00ec4d6d766e) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:42.271804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e12ae3-403a-40ff-9b13-005e5b2edd3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:42.273280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e12ae3-403a-40ff-9b13-005e5b2edd3a None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:42.279442 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 224/449] 10.222.0.76 () {56 vars in 1376 bytes} [Sat Aug 27 04:17:42 2022] GET /identity/v3/role_assignments?group.id=d0b901492380456e8637befba20bc345&scope.project.id=c208601ac0cf4699975b00ec4d6d766e&role.id=5a4c2cf9b8d849398625913504b4b172 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:42.280385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e12ae3-403a-40ff-9b13-005e5b2edd3a None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:42.310912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:42.317451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e1ab6-ad8f-419e-baa3-b8f6911bfaf8 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:42.357794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac15f33-a83e-44df-80c8-cf50a2a05db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:42.358514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac15f33-a83e-44df-80c8-cf50a2a05db6 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:42.358787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac15f33-a83e-44df-80c8-cf50a2a05db6 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:42.359065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac15f33-a83e-44df-80c8-cf50a2a05db6 None admin] PATH_INFO: `/v3/projects/c208601ac0cf4699975b00ec4d6d766e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:42.360358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac15f33-a83e-44df-80c8-cf50a2a05db6 None admin] RBAC: Authorizing `identity:get_project(project_id=c208601ac0cf4699975b00ec4d6d766e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:42.361822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac15f33-a83e-44df-80c8-cf50a2a05db6 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:42.363721 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 226/450] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:42 2022] GET /identity/v3/projects/c208601ac0cf4699975b00ec4d6d766e => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:42.369165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac15f33-a83e-44df-80c8-cf50a2a05db6 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:42.392598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e12ae3-403a-40ff-9b13-005e5b2edd3a None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:42.427392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:42.433801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9724b-9265-4398-a91a-801f1ed966af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:42.434435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9724b-9265-4398-a91a-801f1ed966af None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:42.434754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9724b-9265-4398-a91a-801f1ed966af None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:42.435035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9724b-9265-4398-a91a-801f1ed966af None admin] PATH_INFO: `/v3/projects/4935ddf6dc2a4bbea15d24b9f9bae471` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:42.436889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9724b-9265-4398-a91a-801f1ed966af None admin] RBAC: Authorizing `identity:get_project(project_id=4935ddf6dc2a4bbea15d24b9f9bae471)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:42.438526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9724b-9265-4398-a91a-801f1ed966af None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:42.444283 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 225/451] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:17:42 2022] GET /identity/v3/projects/4935ddf6dc2a4bbea15d24b9f9bae471 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:42.445666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9724b-9265-4398-a91a-801f1ed966af None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:42.484414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac15f33-a83e-44df-80c8-cf50a2a05db6 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:42.533974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d6b30-a168-4baa-87f7-bab9c4dab86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:42.535251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d6b30-a168-4baa-87f7-bab9c4dab86f None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:42.535534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d6b30-a168-4baa-87f7-bab9c4dab86f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:42.535833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d6b30-a168-4baa-87f7-bab9c4dab86f None admin] PATH_INFO: `/v3/groups/d0b901492380456e8637befba20bc345` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:42.537025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d6b30-a168-4baa-87f7-bab9c4dab86f None admin] RBAC: Authorizing `identity:get_group(group_id=d0b901492380456e8637befba20bc345)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:42.538475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d6b30-a168-4baa-87f7-bab9c4dab86f None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:42.540051 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 227/452] 10.222.0.76 () {56 vars in 1180 bytes} [Sat Aug 27 04:17:42 2022] GET /identity/v3/groups/d0b901492380456e8637befba20bc345 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:42.546327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d6b30-a168-4baa-87f7-bab9c4dab86f None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:42.572897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:42.585624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9724b-9265-4398-a91a-801f1ed966af None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:42.623532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986e187-1b18-4cb8-9195-ba6ec14925a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:42.624351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986e187-1b18-4cb8-9195-ba6ec14925a3 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:42.624655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986e187-1b18-4cb8-9195-ba6ec14925a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:42.624933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986e187-1b18-4cb8-9195-ba6ec14925a3 None admin] PATH_INFO: `/v3/groups/3b50e6f2757b483d8b3f47cde76b71a7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:42.627309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986e187-1b18-4cb8-9195-ba6ec14925a3 None admin] RBAC: Authorizing `identity:get_group(group_id=3b50e6f2757b483d8b3f47cde76b71a7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:42.627713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986e187-1b18-4cb8-9195-ba6ec14925a3 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:42.632216 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 226/453] 10.222.0.76 () {56 vars in 1180 bytes} [Sat Aug 27 04:17:42 2022] GET /identity/v3/groups/3b50e6f2757b483d8b3f47cde76b71a7 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:42.635918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986e187-1b18-4cb8-9195-ba6ec14925a3 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:42.662673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d6b30-a168-4baa-87f7-bab9c4dab86f None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:42.682803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:42.696625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e93168-e237-46ec-b4ed-fd1765db5590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:42.697249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e93168-e237-46ec-b4ed-fd1765db5590 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:42.697515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e93168-e237-46ec-b4ed-fd1765db5590 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:42.697783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e93168-e237-46ec-b4ed-fd1765db5590 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:42.698495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e93168-e237-46ec-b4ed-fd1765db5590 None admin] RBAC: Adding query filter params (group.id=d0b901492380456e8637befba20bc345, role.id=d78f86d36ded425d9148c0b5781ab7b2, scope.project.id=c208601ac0cf4699975b00ec4d6d766e) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:42.698795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e93168-e237-46ec-b4ed-fd1765db5590 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:42.700215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e93168-e237-46ec-b4ed-fd1765db5590 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:42.708859 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 228/454] 10.222.0.76 () {56 vars in 1376 bytes} [Sat Aug 27 04:17:42 2022] GET /identity/v3/role_assignments?group.id=d0b901492380456e8637befba20bc345&scope.project.id=c208601ac0cf4699975b00ec4d6d766e&role.id=d78f86d36ded425d9148c0b5781ab7b2 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:42.739096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986e187-1b18-4cb8-9195-ba6ec14925a3 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:42.776398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403f875-d12c-4e65-8c0d-ac948f130799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:42.777008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403f875-d12c-4e65-8c0d-ac948f130799 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:42.777291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403f875-d12c-4e65-8c0d-ac948f130799 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:42.777566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403f875-d12c-4e65-8c0d-ac948f130799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:42.778304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403f875-d12c-4e65-8c0d-ac948f130799 None admin] RBAC: Adding query filter params (group.id=3b50e6f2757b483d8b3f47cde76b71a7, role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=4935ddf6dc2a4bbea15d24b9f9bae471) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:42.779295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403f875-d12c-4e65-8c0d-ac948f130799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:42.780795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403f875-d12c-4e65-8c0d-ac948f130799 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:42.787507 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 227/455] 10.222.0.76 () {56 vars in 1376 bytes} [Sat Aug 27 04:17:42 2022] GET /identity/v3/role_assignments?group.id=3b50e6f2757b483d8b3f47cde76b71a7&scope.project.id=4935ddf6dc2a4bbea15d24b9f9bae471&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:45.210227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772272e-eb11-40ed-b768-875bc35a612d None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:45.211143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772272e-eb11-40ed-b768-875bc35a612d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:45.211554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772272e-eb11-40ed-b768-875bc35a612d None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:45.213157 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 229/456] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:45.219063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45070fe-db6e-480d-9b9d-f519fb3d7074 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:45.219847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45070fe-db6e-480d-9b9d-f519fb3d7074 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:45.220314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45070fe-db6e-480d-9b9d-f519fb3d7074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:45.245390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a45070fe-db6e-480d-9b9d-f519fb3d7074 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:45.246793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a45070fe-db6e-480d-9b9d-f519fb3d7074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:45.271687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:45.333512 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 228/457] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:45.387473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716e260-c43c-42bf-b4f3-5701f91a6175 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:45.389115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716e260-c43c-42bf-b4f3-5701f91a6175 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:45.389589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716e260-c43c-42bf-b4f3-5701f91a6175 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:45.391362 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 230/458] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:45.396930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c65425-511b-4c3d-b398-a3017f754daf None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:45.397442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c65425-511b-4c3d-b398-a3017f754daf None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:45.397928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c65425-511b-4c3d-b398-a3017f754daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:45.416225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-95c65425-511b-4c3d-b398-a3017f754daf None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:45.417696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-95c65425-511b-4c3d-b398-a3017f754daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:45.488265 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 229/459] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:45.753905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716e260-c43c-42bf-b4f3-5701f91a6175 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:45.801769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30ed77-b87d-4d28-bddd-4c85d5c07df9 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:45.802399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30ed77-b87d-4d28-bddd-4c85d5c07df9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:45.802888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30ed77-b87d-4d28-bddd-4c85d5c07df9 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:45.804735 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 230/460] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:45.811349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7ecc0-2156-4877-b32d-1edf857be7f2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:45.811925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7ecc0-2156-4877-b32d-1edf857be7f2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:45.812435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7ecc0-2156-4877-b32d-1edf857be7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:45.833272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-63c7ecc0-2156-4877-b32d-1edf857be7f2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:45.834796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-63c7ecc0-2156-4877-b32d-1edf857be7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:45.884039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716e260-c43c-42bf-b4f3-5701f91a6175 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:45.922176 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 231/461] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:45.923797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7ecc0-2156-4877-b32d-1edf857be7f2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:45.926759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25141b34-5f50-4878-848e-be18c67b3a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:45.927507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25141b34-5f50-4878-848e-be18c67b3a87 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:45.928809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25141b34-5f50-4878-848e-be18c67b3a87 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:45.929317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25141b34-5f50-4878-848e-be18c67b3a87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:45.955578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25141b34-5f50-4878-848e-be18c67b3a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:45.958245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25141b34-5f50-4878-848e-be18c67b3a87 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:45.964959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:45.988776 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-25141b34-5f50-4878-848e-be18c67b3a87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:45.988776 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:45.988776 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:45.988776 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:45.988776 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:45.988776 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:45.988776 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:45.988776 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:45.988776 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:45.988776 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:45.988776 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:45.988776 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:45.988776 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:45.988776 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:45.988776 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:45.988776 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:45.989733 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:45.989733 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:45.989733 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:45.989733 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:45.989733 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:45.989733 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:45.989733 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:45.989733 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:45.989733 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:45.989733 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:45.989733 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:45.989733 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:45.989733 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:45.989733 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:45.989733 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:45.989733 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:45.989733 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:45.990580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:45.990580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:45.990580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:45.994686 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 231/462] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:45.997537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25141b34-5f50-4878-848e-be18c67b3a87 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:46.035562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:46.105098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25141b34-5f50-4878-848e-be18c67b3a87 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:46.107189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7ecc0-2156-4877-b32d-1edf857be7f2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:46.142404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb3351-58a9-416a-8d0d-f0f9c90423f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:46.143447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3351-58a9-416a-8d0d-f0f9c90423f6 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:46.143924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3351-58a9-416a-8d0d-f0f9c90423f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:46.144431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3351-58a9-416a-8d0d-f0f9c90423f6 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:46.145252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb3351-58a9-416a-8d0d-f0f9c90423f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:46.145740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb3351-58a9-416a-8d0d-f0f9c90423f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:46.147296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb3351-58a9-416a-8d0d-f0f9c90423f6 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:46.165910 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 232/463] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:46.172383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb3351-58a9-416a-8d0d-f0f9c90423f6 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:46.181388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e98e43-f899-48f2-b1c0-a23eabec9759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:46.182087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e98e43-f899-48f2-b1c0-a23eabec9759 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:46.182368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e98e43-f899-48f2-b1c0-a23eabec9759 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:46.182642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e98e43-f899-48f2-b1c0-a23eabec9759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:46.201816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e98e43-f899-48f2-b1c0-a23eabec9759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:46.203925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e98e43-f899-48f2-b1c0-a23eabec9759 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:46.223266 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-93e98e43-f899-48f2-b1c0-a23eabec9759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:46.223266 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:46.223266 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:46.223266 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:46.223266 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:46.223266 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:46.223266 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:46.223266 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:46.223266 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:46.223266 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:46.223266 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:46.223266 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:46.223266 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:46.223266 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:46.223266 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:46.223266 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:46.224689 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:46.224689 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:46.224689 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:46.224689 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:46.224689 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:46.224689 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:46.224689 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:46.224689 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:46.224689 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:46.224689 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:46.224689 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:46.224689 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:46.224689 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:46.224689 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:46.224689 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:46.224689 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:46.224689 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:46.225525 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:46.225525 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:46.225525 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:46.227715 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 232/464] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:46.229059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e98e43-f899-48f2-b1c0-a23eabec9759 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:46.297565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:46.304156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb3351-58a9-416a-8d0d-f0f9c90423f6 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:46.313356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:46.341853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69c017-922b-47b2-a938-ab76eec83637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:46.342457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69c017-922b-47b2-a938-ab76eec83637 None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:46.342733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69c017-922b-47b2-a938-ab76eec83637 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:46.342998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69c017-922b-47b2-a938-ab76eec83637 None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:46.343689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69c017-922b-47b2-a938-ab76eec83637 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:46.345148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69c017-922b-47b2-a938-ab76eec83637 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:46.346905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e98e43-f899-48f2-b1c0-a23eabec9759 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:46.381878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734104c6-8444-4497-a6ed-bed8b0a66211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:46.382533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734104c6-8444-4497-a6ed-bed8b0a66211 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:46.382817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734104c6-8444-4497-a6ed-bed8b0a66211 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:46.383090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734104c6-8444-4497-a6ed-bed8b0a66211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:46.394084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734104c6-8444-4497-a6ed-bed8b0a66211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:46.395529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734104c6-8444-4497-a6ed-bed8b0a66211 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:46.409445 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-734104c6-8444-4497-a6ed-bed8b0a66211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:46.409445 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:46.409445 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:46.409445 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:46.409445 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:46.409445 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:46.409445 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:46.409445 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:46.409445 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:46.409445 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:46.409445 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:46.409445 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:46.409445 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:46.409445 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:46.409445 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:46.409445 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:46.410329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:46.410329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:46.410329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:46.410329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:46.410329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:46.410329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:46.410329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:46.410329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:46.410329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:46.410329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:46.410329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:46.410329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:46.410329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:46.410329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:46.410329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:46.410329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:46.410329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:46.411481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:46.411481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:46.411481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:46.411481 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 233/465] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:46.411481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734104c6-8444-4497-a6ed-bed8b0a66211 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:46.448279 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 233/466] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:17:46 2022] POST /identity/v3/users => generated 246 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:17:46.448279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2b09a-9c9d-4d6c-809b-7813ac5868af None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:46.448279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2b09a-9c9d-4d6c-809b-7813ac5868af None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:46.448279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2b09a-9c9d-4d6c-809b-7813ac5868af None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:46.448279 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 234/467] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:46.448279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2b09a-9c9d-4d6c-809b-7813ac5868af None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:46.542717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734104c6-8444-4497-a6ed-bed8b0a66211 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:46.586411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2b09a-9c9d-4d6c-809b-7813ac5868af None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:46.615986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:46.648438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd395c7-a063-443b-9929-17ab57257168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:46.648754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd395c7-a063-443b-9929-17ab57257168 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:46.648964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd395c7-a063-443b-9929-17ab57257168 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:46.651261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd395c7-a063-443b-9929-17ab57257168 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:46.651261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd395c7-a063-443b-9929-17ab57257168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:46.651261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd395c7-a063-443b-9929-17ab57257168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:46.654354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd395c7-a063-443b-9929-17ab57257168 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:46.662795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfc33a-5a31-419e-b7cf-2ee9abec251d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:46.664506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfc33a-5a31-419e-b7cf-2ee9abec251d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:46.664797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfc33a-5a31-419e-b7cf-2ee9abec251d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:46.668705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfc33a-5a31-419e-b7cf-2ee9abec251d None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:46.674604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfc33a-5a31-419e-b7cf-2ee9abec251d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:46.674925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfc33a-5a31-419e-b7cf-2ee9abec251d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:46.680212 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 235/468] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:46.680347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfc33a-5a31-419e-b7cf-2ee9abec251d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:46.680420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cb2cd-1065-4259-bd23-133af36c55b8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:46.680420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cb2cd-1065-4259-bd23-133af36c55b8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:46.680420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cb2cd-1065-4259-bd23-133af36c55b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:46.697006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-416cb2cd-1065-4259-bd23-133af36c55b8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:46.698881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-416cb2cd-1065-4259-bd23-133af36c55b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:46.710218 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 234/469] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:46.710666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:46.711165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfc33a-5a31-419e-b7cf-2ee9abec251d None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:46.802234 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 236/470] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:46.803076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cb2cd-1065-4259-bd23-133af36c55b8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:46.875517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfc33a-5a31-419e-b7cf-2ee9abec251d None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:46.915692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c08bf-ddc5-4a43-9305-54ff6e030437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:46.916393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c08bf-ddc5-4a43-9305-54ff6e030437 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:46.920184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c08bf-ddc5-4a43-9305-54ff6e030437 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:46.920184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c08bf-ddc5-4a43-9305-54ff6e030437 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:46.920184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c08bf-ddc5-4a43-9305-54ff6e030437 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:46.920427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c08bf-ddc5-4a43-9305-54ff6e030437 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:46.952193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cb2cd-1065-4259-bd23-133af36c55b8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:46.988183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3e966-1d2b-40ba-961a-22684ca2ad81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:46.992196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3e966-1d2b-40ba-961a-22684ca2ad81 None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:46.992196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3e966-1d2b-40ba-961a-22684ca2ad81 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:46.992196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3e966-1d2b-40ba-961a-22684ca2ad81 None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:46.992196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3e966-1d2b-40ba-961a-22684ca2ad81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:46.992196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3e966-1d2b-40ba-961a-22684ca2ad81 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:47.058673 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 235/471] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:17:46 2022] POST /identity/v3/users => generated 248 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:17:47.059973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c51192-98a1-45de-bdb5-d6a6b2a90c78 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:47.060291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c51192-98a1-45de-bdb5-d6a6b2a90c78 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:47.060589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c51192-98a1-45de-bdb5-d6a6b2a90c78 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:47.062554 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 236/472] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:47.068298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31498e5-cbb3-4f01-9494-05058da22c6b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:47.069005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31498e5-cbb3-4f01-9494-05058da22c6b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:47.069477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31498e5-cbb3-4f01-9494-05058da22c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:47.082038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:47.091821 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 237/473] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:17:46 2022] POST /identity/v3/users => generated 248 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:17:47.092883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3e966-1d2b-40ba-961a-22684ca2ad81 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:47.096721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a31498e5-cbb3-4f01-9494-05058da22c6b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:47.097983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a31498e5-cbb3-4f01-9494-05058da22c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:47.163203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:47.250730 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 237/474] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:47.278409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3e966-1d2b-40ba-961a-22684ca2ad81 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:47.317421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d5900-d418-4a54-a220-b6829562f93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:47.318811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d5900-d418-4a54-a220-b6829562f93b None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:47.319437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d5900-d418-4a54-a220-b6829562f93b None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:47.319921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d5900-d418-4a54-a220-b6829562f93b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:47.331621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d5900-d418-4a54-a220-b6829562f93b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:47.333373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d5900-d418-4a54-a220-b6829562f93b None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:47.349032 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-902d5900-d418-4a54-a220-b6829562f93b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:47.349032 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:47.349032 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:47.349032 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:47.349032 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:47.349032 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:47.349032 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:47.349032 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:47.349032 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:47.349032 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:47.349032 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:47.349032 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:47.349032 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:47.349032 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:47.349032 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:47.349032 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:47.349934 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:47.349934 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:47.349934 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:47.349934 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:47.349934 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:47.349934 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:47.349934 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:47.349934 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:47.349934 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:47.349934 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:47.349934 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:47.349934 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:47.349934 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:47.349934 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:47.349934 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:47.349934 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:47.349934 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:47.350848 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:47.350848 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:47.350848 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:47.351421 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 238/475] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:47.357620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31498e5-cbb3-4f01-9494-05058da22c6b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:47.495222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31498e5-cbb3-4f01-9494-05058da22c6b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:47.537680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d5900-d418-4a54-a220-b6829562f93b None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:47.542552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd8056-c7ec-4b51-99ee-848088c33bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:47.543225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd8056-c7ec-4b51-99ee-848088c33bb3 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:47.543499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd8056-c7ec-4b51-99ee-848088c33bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:47.543824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd8056-c7ec-4b51-99ee-848088c33bb3 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:47.549827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd8056-c7ec-4b51-99ee-848088c33bb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:47.550133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd8056-c7ec-4b51-99ee-848088c33bb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:47.551529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd8056-c7ec-4b51-99ee-848088c33bb3 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:47.571553 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 238/476] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:47.575375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd8056-c7ec-4b51-99ee-848088c33bb3 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:47.625491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:47.626101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:47.719582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d5900-d418-4a54-a220-b6829562f93b None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:47.775661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd8056-c7ec-4b51-99ee-848088c33bb3 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:47.804442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56f11e-6229-4cf5-9983-28d0e134022e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:47.805057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56f11e-6229-4cf5-9983-28d0e134022e None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:47.805334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56f11e-6229-4cf5-9983-28d0e134022e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:47.805603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56f11e-6229-4cf5-9983-28d0e134022e None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:47.806291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56f11e-6229-4cf5-9983-28d0e134022e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:47.807656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56f11e-6229-4cf5-9983-28d0e134022e None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:47.833972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe7486-45f2-4ea5-9733-bcb8872a9c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:47.834580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe7486-45f2-4ea5-9733-bcb8872a9c34 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:47.834861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe7486-45f2-4ea5-9733-bcb8872a9c34 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:47.835130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe7486-45f2-4ea5-9733-bcb8872a9c34 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:47.835781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe7486-45f2-4ea5-9733-bcb8872a9c34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:47.837378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe7486-45f2-4ea5-9733-bcb8872a9c34 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:47.869512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.sql.core [None req-6d56f11e-6229-4cf5-9983-28d0e134022e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 27 04:17:47.869512 n-d-852088-5 devstack@keystone.service[82083]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 27 04:17:47.869512 n-d-852088-5 devstack@keystone.service[82083]: [parameters: {'id': '1e8fdd7dd3ee42829f1386c8930fd3a1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 27 04:17:47.869512 n-d-852088-5 devstack@keystone.service[82083]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82083) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 04:17:47.887381 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-6d56f11e-6229-4cf5-9983-28d0e134022e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 27 04:17:47.887381 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:47.887381 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:17:47.887381 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 04:17:47.887381 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:17:47.887381 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 04:17:47.887381 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:17:47.887381 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 04:17:47.887381 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:17:47.887381 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application conn.query(q) Aug 27 04:17:47.887381 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:17:47.887381 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:17:47.887381 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:17:47.887381 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application result.read() Aug 27 04:17:47.887381 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return ref.to_dict() Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 04:17:47.888852 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application next(self.gen) Aug 27 04:17:47.889736 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 27 04:17:47.889736 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application yield resource Aug 27 04:17:47.889736 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 04:17:47.889736 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application next(self.gen) Aug 27 04:17:47.889736 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 27 04:17:47.889736 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.session.rollback() Aug 27 04:17:47.889736 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:17:47.889736 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.force_reraise() Aug 27 04:17:47.889736 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:17:47.889736 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise self.value Aug 27 04:17:47.889736 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 27 04:17:47.889736 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 27 04:17:47.889736 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 27 04:17:47.889736 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application session.commit() Aug 27 04:17:47.889736 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 27 04:17:47.889736 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 27 04:17:47.889736 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 27 04:17:47.890599 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._prepare_impl() Aug 27 04:17:47.890599 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 27 04:17:47.890599 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.session.flush() Aug 27 04:17:47.890599 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 04:17:47.890599 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._flush(objects) Aug 27 04:17:47.890599 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 04:17:47.890599 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 27 04:17:47.890599 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 04:17:47.890599 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application compat.raise_( Aug 27 04:17:47.890599 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:17:47.890599 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception Aug 27 04:17:47.890599 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 04:17:47.890599 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application flush_context.execute() Aug 27 04:17:47.890599 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 04:17:47.890599 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rec.execute(self) Aug 27 04:17:47.890599 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 04:17:47.890599 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 27 04:17:47.891491 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 04:17:47.891491 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 27 04:17:47.891491 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 27 04:17:47.891491 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 27 04:17:47.891491 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 04:17:47.891491 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 04:17:47.891491 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 04:17:47.891491 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 27 04:17:47.891491 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 04:17:47.891491 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 27 04:17:47.891491 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 04:17:47.891491 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 27 04:17:47.891491 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 04:17:47.891491 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 04:17:47.891491 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:17:47.891491 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception Aug 27 04:17:47.892474 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:17:47.892474 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 04:17:47.892474 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:17:47.892474 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 04:17:47.892474 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:17:47.892474 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 04:17:47.892474 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:17:47.892474 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application conn.query(q) Aug 27 04:17:47.892474 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:17:47.892474 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:17:47.892474 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:17:47.892474 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application result.read() Aug 27 04:17:47.892474 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:17:47.892474 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 04:17:47.892474 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:17:47.892474 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 04:17:47.893293 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:17:47.893293 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 04:17:47.893293 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:17:47.893293 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 04:17:47.893293 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 27 04:17:47.893293 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 27 04:17:47.893293 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [parameters: {'id': '1e8fdd7dd3ee42829f1386c8930fd3a1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 27 04:17:47.893293 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 04:17:47.893293 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:47.893293 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:17:47.893293 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:47.893293 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:47.893293 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:47.893293 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:47.893293 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:47.893293 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:47.894228 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:47.894228 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:47.894228 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:47.894228 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:47.894228 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:47.894228 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:47.894228 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 27 04:17:47.894228 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 27 04:17:47.894228 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:47.894228 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:47.894228 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 27 04:17:47.894228 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 27 04:17:47.894228 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 27 04:17:47.894228 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 27 04:17:47.894228 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 27 04:17:47.894228 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:47.895021 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 239/477] 10.222.0.76 () {60 vars in 1131 bytes} [Sat Aug 27 04:17:47 2022] POST /identity/v3/roles => generated 144 bytes in 352 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:17:47.897163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56f11e-6229-4cf5-9983-28d0e134022e None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:47.935859 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 239/478] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:17:47 2022] POST /identity/v3/users => generated 249 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:17:48.019500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56f11e-6229-4cf5-9983-28d0e134022e None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:48.035660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:48.057206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d16139-570c-466b-bd85-398f8f3f353c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:48.057843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d16139-570c-466b-bd85-398f8f3f353c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:48.058118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d16139-570c-466b-bd85-398f8f3f353c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:48.058382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d16139-570c-466b-bd85-398f8f3f353c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:48.072421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d16139-570c-466b-bd85-398f8f3f353c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:48.078343 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-34d16139-570c-466b-bd85-398f8f3f353c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:48.078343 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:48.078343 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:48.078343 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:48.078343 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:48.078343 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:48.078343 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:48.078343 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:48.078343 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:48.078343 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:48.078343 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:48.078343 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:48.078343 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:48.078343 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:48.078343 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:48.078343 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:48.079275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:48.079275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:48.079275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:48.079275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:48.079275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:48.079275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:48.079275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:48.079275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:48.079275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:48.079275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:48.079275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:48.079275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:48.079275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:48.079275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:48.079275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:48.079275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:48.080069 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:48.080069 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:48.080069 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:48.080069 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:48.080069 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:48.080069 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:48.080069 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:48.080069 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:48.080069 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:48.080069 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:48.080069 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 04:17:48.080069 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:48.080720 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 240/479] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:17:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:17:48.086396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe7486-45f2-4ea5-9733-bcb8872a9c34 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:48.183287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:48.202396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe7486-45f2-4ea5-9733-bcb8872a9c34 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:48.238296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10f981-3430-443a-9810-ef7f2864bea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:48.238908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10f981-3430-443a-9810-ef7f2864bea5 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:48.239183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10f981-3430-443a-9810-ef7f2864bea5 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:48.239453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10f981-3430-443a-9810-ef7f2864bea5 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:48.240178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10f981-3430-443a-9810-ef7f2864bea5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:48.240738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10f981-3430-443a-9810-ef7f2864bea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:48.242113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10f981-3430-443a-9810-ef7f2864bea5 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:48.252027 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 240/480] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:48.790797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea3f95-56f2-4894-9cfd-a588d57f8f0a None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:48.791339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea3f95-56f2-4894-9cfd-a588d57f8f0a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:48.791339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea3f95-56f2-4894-9cfd-a588d57f8f0a None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:48.792965 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 241/481] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:48.798765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c566de-b002-49b6-b963-b0df81f88208 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:48.799059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c566de-b002-49b6-b963-b0df81f88208 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:48.799340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c566de-b002-49b6-b963-b0df81f88208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:48.825124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-88c566de-b002-49b6-b963-b0df81f88208 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:48.826446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-88c566de-b002-49b6-b963-b0df81f88208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:48.923441 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 241/482] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:49.326141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea3f95-56f2-4894-9cfd-a588d57f8f0a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:49.421229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4807ba-2b94-4a5f-ae74-9753323b6749 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:49.422177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4807ba-2b94-4a5f-ae74-9753323b6749 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:49.422645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4807ba-2b94-4a5f-ae74-9753323b6749 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:49.428470 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 242/483] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:49.429756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eda2a-7b94-4c30-9001-5c8ed380807c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:49.430249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eda2a-7b94-4c30-9001-5c8ed380807c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:49.430742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eda2a-7b94-4c30-9001-5c8ed380807c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:49.458675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a82eda2a-7b94-4c30-9001-5c8ed380807c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:49.460864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a82eda2a-7b94-4c30-9001-5c8ed380807c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:49.474382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea3f95-56f2-4894-9cfd-a588d57f8f0a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:49.529187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db030a-e52f-47b6-9437-381200edabf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:49.530172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db030a-e52f-47b6-9437-381200edabf5 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:49.531806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db030a-e52f-47b6-9437-381200edabf5 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:49.532293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db030a-e52f-47b6-9437-381200edabf5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:49.560725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db030a-e52f-47b6-9437-381200edabf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:49.565849 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-d3db030a-e52f-47b6-9437-381200edabf5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:49.565849 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:49.565849 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:49.565849 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:49.565849 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:49.565849 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:49.565849 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:49.565849 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:49.565849 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:49.565849 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:49.565849 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:49.565849 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:49.565849 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:49.565849 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:49.565849 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:49.565849 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:49.566684 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:49.566684 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:49.566684 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:49.566684 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:49.566684 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:49.566684 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:49.566684 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:49.566684 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:49.566684 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:49.566684 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:49.566684 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:49.566684 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:49.566684 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:49.566684 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:49.566684 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:49.566684 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:49.567476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:49.567476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:49.567476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:49.567476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:49.567476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:49.567476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:49.567476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:49.567476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:49.567476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:49.567476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:49.567476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:49.567476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:49.569967 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 242/484] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:17:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:49.571387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7f6f8-8fad-4767-b2b3-3b3c9f972002 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:49.571858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7f6f8-8fad-4767-b2b3-3b3c9f972002 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:49.572364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7f6f8-8fad-4767-b2b3-3b3c9f972002 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:49.574012 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 243/485] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:49.577165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7f6f8-8fad-4767-b2b3-3b3c9f972002 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:49.585107 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 243/486] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:49.586680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09325ddc-510c-40b1-964a-ae693ba03ddb None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:49.587180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09325ddc-510c-40b1-964a-ae693ba03ddb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:49.587638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09325ddc-510c-40b1-964a-ae693ba03ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:49.594947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:49.610360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-09325ddc-510c-40b1-964a-ae693ba03ddb None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:49.611652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-09325ddc-510c-40b1-964a-ae693ba03ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:49.652521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:49.748272 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 244/487] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:49.772100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7f6f8-8fad-4767-b2b3-3b3c9f972002 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:49.829918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cfa7b-b13f-4af3-85f0-2ca2f734434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:49.830530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cfa7b-b13f-4af3-85f0-2ca2f734434e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:49.830743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cfa7b-b13f-4af3-85f0-2ca2f734434e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:49.830981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cfa7b-b13f-4af3-85f0-2ca2f734434e None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:49.831644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cfa7b-b13f-4af3-85f0-2ca2f734434e None admin] RBAC: Adding query filter params (name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:49.831943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cfa7b-b13f-4af3-85f0-2ca2f734434e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:49.833341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cfa7b-b13f-4af3-85f0-2ca2f734434e None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:49.846562 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 244/488] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:17:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:49.852138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09325ddc-510c-40b1-964a-ae693ba03ddb None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:49.867268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cfa7b-b13f-4af3-85f0-2ca2f734434e None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:49.989493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:49.996230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cfa7b-b13f-4af3-85f0-2ca2f734434e None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:50.039523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d4a76-9ee8-4aa3-9689-5f8ee6c7a27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:50.040155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d4a76-9ee8-4aa3-9689-5f8ee6c7a27d None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:50.040460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d4a76-9ee8-4aa3-9689-5f8ee6c7a27d None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:50.041203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d4a76-9ee8-4aa3-9689-5f8ee6c7a27d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:50.054172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d4a76-9ee8-4aa3-9689-5f8ee6c7a27d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:50.060892 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-c88d4a76-9ee8-4aa3-9689-5f8ee6c7a27d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:50.060892 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:50.060892 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:50.060892 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:50.060892 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:50.060892 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:50.060892 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:50.060892 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:50.060892 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:50.060892 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:50.060892 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:50.060892 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:50.060892 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:50.060892 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:50.060892 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:50.060892 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:50.061814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:50.061814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:50.061814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:50.061814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:50.061814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:50.061814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:50.061814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:50.061814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:50.061814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:50.061814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:50.061814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:50.061814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:50.061814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:50.061814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:50.061814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:50.061814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:50.062609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:50.062609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:50.062609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:50.062609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:50.062609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:50.062609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:50.062609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:50.062609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:50.062609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:50.062609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:50.062609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:50.062609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:50.063197 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 245/489] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:17:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:17:50.070620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d4a76-9ee8-4aa3-9689-5f8ee6c7a27d None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:50.091716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09325ddc-510c-40b1-964a-ae693ba03ddb None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:50.147001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad2962-c7b7-4861-8305-3547bd9d0766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:50.147669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad2962-c7b7-4861-8305-3547bd9d0766 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:50.148184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad2962-c7b7-4861-8305-3547bd9d0766 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:50.148475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad2962-c7b7-4861-8305-3547bd9d0766 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:50.151167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:50.163826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad2962-c7b7-4861-8305-3547bd9d0766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:50.165457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad2962-c7b7-4861-8305-3547bd9d0766 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:50.187675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-12ad2962-c7b7-4861-8305-3547bd9d0766 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:50.187675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:50.187675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:50.187675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:50.187675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:50.187675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:50.187675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:50.187675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:50.187675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:50.187675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:50.187675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:50.187675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:50.187675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:50.187675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:50.187675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:50.187675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:50.188809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:50.188809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:50.188809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:50.188809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:50.188809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:50.188809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:50.188809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:50.188809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:50.188809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:50.188809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:50.188809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:50.188809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:50.188809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:50.188809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:50.188809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:50.188809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:50.188809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:50.189758 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:50.189758 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:50.189758 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:50.189758 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 245/490] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:50.196214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad2962-c7b7-4861-8305-3547bd9d0766 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:50.201589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d4a76-9ee8-4aa3-9689-5f8ee6c7a27d None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:50.238520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10d2ba-46f4-4082-a917-e6dba97e691f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:50.239285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10d2ba-46f4-4082-a917-e6dba97e691f None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:50.239688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10d2ba-46f4-4082-a917-e6dba97e691f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:50.240093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10d2ba-46f4-4082-a917-e6dba97e691f None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:50.240877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10d2ba-46f4-4082-a917-e6dba97e691f None admin] RBAC: Adding query filter params (name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:50.241273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10d2ba-46f4-4082-a917-e6dba97e691f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:50.242734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10d2ba-46f4-4082-a917-e6dba97e691f None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:50.254235 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 246/491] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:17:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:50.255170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10d2ba-46f4-4082-a917-e6dba97e691f None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:50.281972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:50.319087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad2962-c7b7-4861-8305-3547bd9d0766 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:50.358507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efa430-132c-4dda-b5c0-9a3933ade76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:50.359270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efa430-132c-4dda-b5c0-9a3933ade76f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:50.359649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efa430-132c-4dda-b5c0-9a3933ade76f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:50.360023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efa430-132c-4dda-b5c0-9a3933ade76f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:50.371695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efa430-132c-4dda-b5c0-9a3933ade76f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:50.377718 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-d9efa430-132c-4dda-b5c0-9a3933ade76f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:50.377718 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:50.377718 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:50.377718 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:50.377718 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:50.377718 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:50.377718 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:50.377718 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:50.377718 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:50.377718 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:50.377718 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:50.377718 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:50.377718 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:50.377718 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:50.377718 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:50.377718 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:50.378950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:50.378950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:50.378950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:50.378950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:50.378950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:50.378950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:50.378950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:50.378950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:50.378950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:50.378950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:50.378950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:50.378950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:50.378950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:50.378950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:50.378950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:50.378950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:50.379948 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:50.379948 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:50.379948 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:50.379948 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:50.379948 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:50.379948 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:50.379948 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:50.379948 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:50.379948 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:50.379948 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:50.379948 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:50.379948 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:50.386605 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 246/492] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:17:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:50.388040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efa430-132c-4dda-b5c0-9a3933ade76f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:50.393892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10d2ba-46f4-4082-a917-e6dba97e691f None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:50.451196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36cf4d-ac66-4b72-b6fb-d2d4c08a0b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:50.452504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36cf4d-ac66-4b72-b6fb-d2d4c08a0b00 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:50.453021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36cf4d-ac66-4b72-b6fb-d2d4c08a0b00 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:50.453752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36cf4d-ac66-4b72-b6fb-d2d4c08a0b00 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:50.454998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:50.456730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36cf4d-ac66-4b72-b6fb-d2d4c08a0b00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:50.457331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36cf4d-ac66-4b72-b6fb-d2d4c08a0b00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:50.459589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36cf4d-ac66-4b72-b6fb-d2d4c08a0b00 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:50.477591 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 247/493] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:50.478867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36cf4d-ac66-4b72-b6fb-d2d4c08a0b00 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:50.518143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efa430-132c-4dda-b5c0-9a3933ade76f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:50.555153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea6d0a-123c-4e8a-ab08-5a8931931df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:50.555808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea6d0a-123c-4e8a-ab08-5a8931931df4 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:50.556050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea6d0a-123c-4e8a-ab08-5a8931931df4 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:50.556470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea6d0a-123c-4e8a-ab08-5a8931931df4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:50.569824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea6d0a-123c-4e8a-ab08-5a8931931df4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:50.571421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea6d0a-123c-4e8a-ab08-5a8931931df4 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:50.579969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:50.586978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-82ea6d0a-123c-4e8a-ab08-5a8931931df4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:50.586978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:50.586978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:50.586978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:50.586978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:50.586978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:50.586978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:50.586978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:50.586978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:50.586978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:50.586978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:50.586978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:50.586978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:50.586978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:50.586978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:50.586978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:50.591827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:50.591827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:50.591827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:50.591827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:50.591827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:50.591827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:50.591827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:50.591827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:50.591827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:50.591827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:50.591827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:50.591827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:50.591827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:50.591827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:50.591827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:50.591827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:50.591827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:50.592982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:50.592982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:50.592982 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:50.593962 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 247/494] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:50.594847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea6d0a-123c-4e8a-ab08-5a8931931df4 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:50.607081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36cf4d-ac66-4b72-b6fb-d2d4c08a0b00 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:50.650437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d5e01-f3cf-4e1f-b036-7eaec3a528f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:50.651407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d5e01-f3cf-4e1f-b036-7eaec3a528f5 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:50.651903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d5e01-f3cf-4e1f-b036-7eaec3a528f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:50.652401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d5e01-f3cf-4e1f-b036-7eaec3a528f5 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:50.653378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d5e01-f3cf-4e1f-b036-7eaec3a528f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:50.653971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d5e01-f3cf-4e1f-b036-7eaec3a528f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:50.655556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d5e01-f3cf-4e1f-b036-7eaec3a528f5 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:50.665449 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 248/495] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:17:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:50.666822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d5e01-f3cf-4e1f-b036-7eaec3a528f5 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:50.712655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:50.717369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea6d0a-123c-4e8a-ab08-5a8931931df4 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:50.751268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f730ac-804d-4322-b98f-67be17f15522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:50.751890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f730ac-804d-4322-b98f-67be17f15522 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:50.752178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f730ac-804d-4322-b98f-67be17f15522 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:50.752482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f730ac-804d-4322-b98f-67be17f15522 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:50.759882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f730ac-804d-4322-b98f-67be17f15522 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:50.761750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f730ac-804d-4322-b98f-67be17f15522 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:50.774610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-98f730ac-804d-4322-b98f-67be17f15522 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:17:50.774610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:50.774610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:50.774610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:50.774610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:50.774610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:50.774610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:50.774610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:50.774610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:50.774610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:50.774610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:50.774610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:50.774610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:17:50.774610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:17:50.774610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:17:50.774610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:50.775514 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:50.776465 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:50.776465 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:50.776465 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:17:50.776465 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:17:50.776465 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:17:50.776465 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:17:50.776465 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:17:50.776465 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:17:50.776465 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:17:50.776465 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:50.776985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d5e01-f3cf-4e1f-b036-7eaec3a528f5 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:50.777059 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 248/496] 10.222.0.76 () {56 vars in 1093 bytes} [Sat Aug 27 04:17:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:50.777628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afc7f5-8f29-41e5-9576-5e7617fa4567 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:50.777628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afc7f5-8f29-41e5-9576-5e7617fa4567 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:50.777803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afc7f5-8f29-41e5-9576-5e7617fa4567 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:50.779056 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 249/497] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:50.780957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afc7f5-8f29-41e5-9576-5e7617fa4567 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:50.811827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad1d39-5d3d-4daa-b6d7-f84f32794ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:50.812466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad1d39-5d3d-4daa-b6d7-f84f32794ff8 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:50.812744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad1d39-5d3d-4daa-b6d7-f84f32794ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:50.813008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad1d39-5d3d-4daa-b6d7-f84f32794ff8 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:50.813639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad1d39-5d3d-4daa-b6d7-f84f32794ff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:50.813935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad1d39-5d3d-4daa-b6d7-f84f32794ff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:50.815332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad1d39-5d3d-4daa-b6d7-f84f32794ff8 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:50.823854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:50.827082 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 249/498] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:50.828335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a329d19-f90d-4ec9-9a2f-9f070374e917 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:50.828618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a329d19-f90d-4ec9-9a2f-9f070374e917 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:50.828893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a329d19-f90d-4ec9-9a2f-9f070374e917 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:50.830223 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 250/499] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:50.830814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a329d19-f90d-4ec9-9a2f-9f070374e917 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:50.885682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afc7f5-8f29-41e5-9576-5e7617fa4567 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:50.920074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d328d-275c-4caf-b112-d34349bd072b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:50.920642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d328d-275c-4caf-b112-d34349bd072b None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:50.920918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d328d-275c-4caf-b112-d34349bd072b None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:50.921195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d328d-275c-4caf-b112-d34349bd072b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:50.930044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a329d19-f90d-4ec9-9a2f-9f070374e917 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:50.931410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d328d-275c-4caf-b112-d34349bd072b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:50.932915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d328d-275c-4caf-b112-d34349bd072b None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:50.947284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-ff7d328d-275c-4caf-b112-d34349bd072b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:50.947284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:50.947284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:50.947284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:50.947284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:50.947284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:50.947284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:50.947284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:50.947284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:50.947284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:50.947284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:50.947284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:50.947284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:50.947284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:50.947284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:50.947284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:50.954204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:50.954204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:50.954204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:50.954204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:50.954204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:50.954204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:50.954204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:50.954204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:50.954204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:50.954204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:50.954204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:50.954204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:50.954204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:50.954204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:50.954204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:50.954204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:50.954204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:50.955248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:50.955248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:50.955248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:50.955248 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 250/500] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:50.955248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1274584-1ae3-4124-a70b-4a78fefe0057 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:50.955248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1274584-1ae3-4124-a70b-4a78fefe0057 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:50.955248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1274584-1ae3-4124-a70b-4a78fefe0057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:50.964648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705c78a-8b91-4ee6-8703-ad83e43eeb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:50.965245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705c78a-8b91-4ee6-8703-ad83e43eeb3a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:50.966141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705c78a-8b91-4ee6-8703-ad83e43eeb3a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:50.966465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705c78a-8b91-4ee6-8703-ad83e43eeb3a None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:50.967192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705c78a-8b91-4ee6-8703-ad83e43eeb3a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:50.967489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705c78a-8b91-4ee6-8703-ad83e43eeb3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:50.968923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705c78a-8b91-4ee6-8703-ad83e43eeb3a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:50.972173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c1274584-1ae3-4124-a70b-4a78fefe0057 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:50.973382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c1274584-1ae3-4124-a70b-4a78fefe0057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:50.976241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:51.004980 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 251/501] 10.222.0.76 () {56 vars in 1133 bytes} [Sat Aug 27 04:17:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:51.005812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705c78a-8b91-4ee6-8703-ad83e43eeb3a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:51.039792 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 251/502] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:51.041058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c7fc-8f7e-48e6-8953-797d044bd9ac None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:51.041337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c7fc-8f7e-48e6-8953-797d044bd9ac None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:51.041610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c7fc-8f7e-48e6-8953-797d044bd9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:51.060530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7940c7fc-8f7e-48e6-8953-797d044bd9ac None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:51.061820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7940c7fc-8f7e-48e6-8953-797d044bd9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:51.067277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:51.110752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705c78a-8b91-4ee6-8703-ad83e43eeb3a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:51.134254 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 252/503] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:51.135122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940c7fc-8f7e-48e6-8953-797d044bd9ac None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:51.158102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f959cbe-2107-449e-a5de-3c004d6e4a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:51.159245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f959cbe-2107-449e-a5de-3c004d6e4a74 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:51.159720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f959cbe-2107-449e-a5de-3c004d6e4a74 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:51.160290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f959cbe-2107-449e-a5de-3c004d6e4a74 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:51.168376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f959cbe-2107-449e-a5de-3c004d6e4a74 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:51.170401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f959cbe-2107-449e-a5de-3c004d6e4a74 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:51.185251 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-3f959cbe-2107-449e-a5de-3c004d6e4a74 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 04:17:51.185251 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:51.185251 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:51.185251 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:51.185251 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:51.185251 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:51.185251 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:51.185251 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:51.185251 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:51.185251 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:51.185251 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:51.185251 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:51.185251 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:17:51.185251 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:17:51.185251 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:17:51.185251 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:51.186165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:51.187088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:51.187088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:51.187088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:17:51.187088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:17:51.187088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:17:51.187088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:17:51.187088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:17:51.187088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:17:51.187088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 27 04:17:51.187088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:51.193976 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 252/504] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:51.195161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f959cbe-2107-449e-a5de-3c004d6e4a74 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:51.221188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:51.254441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940c7fc-8f7e-48e6-8953-797d044bd9ac None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:51.292448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7da97f-ba7f-4ffd-87bd-795ccdd63263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:51.293416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7da97f-ba7f-4ffd-87bd-795ccdd63263 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:51.293929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7da97f-ba7f-4ffd-87bd-795ccdd63263 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:51.294502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7da97f-ba7f-4ffd-87bd-795ccdd63263 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:51.295386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7da97f-ba7f-4ffd-87bd-795ccdd63263 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:51.295983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7da97f-ba7f-4ffd-87bd-795ccdd63263 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:51.297668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7da97f-ba7f-4ffd-87bd-795ccdd63263 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:51.310517 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 253/505] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:51.311590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7da97f-ba7f-4ffd-87bd-795ccdd63263 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:51.319410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f959cbe-2107-449e-a5de-3c004d6e4a74 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:51.338065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:51.355637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48357a55-2aaa-4936-bce0-8815c273fded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:51.356311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48357a55-2aaa-4936-bce0-8815c273fded None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:51.356592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48357a55-2aaa-4936-bce0-8815c273fded None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:51.356866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48357a55-2aaa-4936-bce0-8815c273fded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:51.417961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7da97f-ba7f-4ffd-87bd-795ccdd63263 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:51.427878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48357a55-2aaa-4936-bce0-8815c273fded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:51.429320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48357a55-2aaa-4936-bce0-8815c273fded None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:51.447106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:51.453130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a257b-18a0-447d-ba27-28630b38870f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:51.453728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a257b-18a0-447d-ba27-28630b38870f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:51.457955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a257b-18a0-447d-ba27-28630b38870f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:51.457955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a257b-18a0-447d-ba27-28630b38870f None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:51.457955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a257b-18a0-447d-ba27-28630b38870f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:51.457955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a257b-18a0-447d-ba27-28630b38870f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:51.457955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a257b-18a0-447d-ba27-28630b38870f None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:51.494298 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 254/506] 10.222.0.76 () {56 vars in 1137 bytes} [Sat Aug 27 04:17:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:51.494936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a257b-18a0-447d-ba27-28630b38870f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:51.528743 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 253/507] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:51.529602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48357a55-2aaa-4936-bce0-8815c273fded None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:51.548260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:51.596729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a257b-18a0-447d-ba27-28630b38870f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:51.627382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48357a55-2aaa-4936-bce0-8815c273fded None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:51.630871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823097d6-e730-4f94-889a-7ad4d3df5241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:51.631490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823097d6-e730-4f94-889a-7ad4d3df5241 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:51.631763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823097d6-e730-4f94-889a-7ad4d3df5241 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:51.632031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823097d6-e730-4f94-889a-7ad4d3df5241 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:51.639301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823097d6-e730-4f94-889a-7ad4d3df5241 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:51.640803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823097d6-e730-4f94-889a-7ad4d3df5241 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:51.652427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-823097d6-e730-4f94-889a-7ad4d3df5241 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 04:17:51.652427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:51.652427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:51.652427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:51.652427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:51.652427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:51.652427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:51.652427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:51.652427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:51.652427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:51.652427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:51.652427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:51.652427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:17:51.652427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:17:51.652427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:17:51.652427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:51.653356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:51.654906 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:51.654906 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:51.654906 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:17:51.654906 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:17:51.654906 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:17:51.654906 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:17:51.654906 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:17:51.654906 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:17:51.654906 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 04:17:51.654906 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:51.654906 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 255/508] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:51.654906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823097d6-e730-4f94-889a-7ad4d3df5241 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:51.665184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f2eaf-1c9c-4a94-a46d-e68fc61ebbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:51.665801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f2eaf-1c9c-4a94-a46d-e68fc61ebbfc None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:51.666076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f2eaf-1c9c-4a94-a46d-e68fc61ebbfc None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:51.666341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f2eaf-1c9c-4a94-a46d-e68fc61ebbfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:51.676666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f2eaf-1c9c-4a94-a46d-e68fc61ebbfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:51.681530 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-a17f2eaf-1c9c-4a94-a46d-e68fc61ebbfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:51.681530 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:51.681530 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:51.681530 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:51.681530 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:51.681530 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:51.681530 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:51.681530 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:51.681530 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:51.681530 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:51.681530 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:51.681530 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:51.681530 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:51.681530 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:51.681530 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:51.681530 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:51.682592 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:51.682592 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:51.682592 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:51.682592 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:51.682592 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:51.682592 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:51.682592 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:51.682592 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:51.682592 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:51.682592 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:51.682592 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:51.682592 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:51.682592 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:51.682592 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:51.682592 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:51.682592 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:51.683574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:51.683574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:51.683574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:51.683574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:51.683574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:51.683574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:51.683574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:51.683574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:51.683574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:51.683574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:51.683574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:51.683574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:51.683574 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 254/509] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:17:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:51.683574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f2eaf-1c9c-4a94-a46d-e68fc61ebbfc None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:51.706131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:51.756600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823097d6-e730-4f94-889a-7ad4d3df5241 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:51.758470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:51.780583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f2eaf-1c9c-4a94-a46d-e68fc61ebbfc None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:51.791088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387a237-5740-474d-b48b-ad6c19a1a93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:51.791706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387a237-5740-474d-b48b-ad6c19a1a93c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:51.791981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387a237-5740-474d-b48b-ad6c19a1a93c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:51.792285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387a237-5740-474d-b48b-ad6c19a1a93c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:51.802641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387a237-5740-474d-b48b-ad6c19a1a93c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:51.804083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387a237-5740-474d-b48b-ad6c19a1a93c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:51.813876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f1c7e-3828-46e9-b7b5-a45a9430e5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:51.814464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f1c7e-3828-46e9-b7b5-a45a9430e5a7 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:51.814738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f1c7e-3828-46e9-b7b5-a45a9430e5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:51.815005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f1c7e-3828-46e9-b7b5-a45a9430e5a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:51.818494 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-a387a237-5740-474d-b48b-ad6c19a1a93c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:51.818494 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:51.818494 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:51.818494 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:51.818494 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:51.818494 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:51.818494 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:51.818494 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:51.818494 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:51.818494 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:51.818494 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:51.818494 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:51.818494 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:51.818494 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:51.818494 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:51.818494 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:51.819422 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:51.819422 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:51.819422 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:51.819422 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:51.819422 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:51.819422 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:51.819422 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:51.819422 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:51.819422 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:51.819422 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:51.819422 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:51.819422 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:51.819422 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:51.819422 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:51.819422 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:51.819422 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:51.819422 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:51.820328 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:51.820328 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:51.820328 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:51.820328 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 256/510] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:51.820853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387a237-5740-474d-b48b-ad6c19a1a93c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:51.883437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f1c7e-3828-46e9-b7b5-a45a9430e5a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:51.884933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f1c7e-3828-46e9-b7b5-a45a9430e5a7 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:51.918228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:51.921134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387a237-5740-474d-b48b-ad6c19a1a93c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:51.955527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfc30b-6b09-4978-a737-c4ffd0f422a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:51.956070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfc30b-6b09-4978-a737-c4ffd0f422a2 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:51.956374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfc30b-6b09-4978-a737-c4ffd0f422a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:51.956646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfc30b-6b09-4978-a737-c4ffd0f422a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:51.965529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:51.968176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfc30b-6b09-4978-a737-c4ffd0f422a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:51.969724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfc30b-6b09-4978-a737-c4ffd0f422a2 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:51.984399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-ecdfc30b-6b09-4978-a737-c4ffd0f422a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:51.984399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:51.984399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:51.984399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:51.984399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:51.984399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:51.984399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:51.984399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:51.984399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:51.984399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:51.984399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:51.984399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:51.984399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:51.984399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:51.984399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:51.984399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:51.985481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:51.985481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:51.985481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:51.985481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:51.985481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:51.985481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:51.985481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:51.985481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:51.985481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:51.985481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:51.985481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:51.985481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:51.985481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:51.985481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:51.985481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:51.985481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:51.985481 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:51.986324 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:51.986324 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:51.986324 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:51.986324 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 257/511] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:51.986663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfc30b-6b09-4978-a737-c4ffd0f422a2 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:51.987403 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 255/512] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:51.988280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f1c7e-3828-46e9-b7b5-a45a9430e5a7 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:52.089145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f1c7e-3828-46e9-b7b5-a45a9430e5a7 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:52.089939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfc30b-6b09-4978-a737-c4ffd0f422a2 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:52.122636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e2356-6fa5-44cc-a297-c2424941f7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:52.123145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80244e-7000-409b-9b8e-5e55386e2488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:52.123270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e2356-6fa5-44cc-a297-c2424941f7cc None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:52.123364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80244e-7000-409b-9b8e-5e55386e2488 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:52.123481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e2356-6fa5-44cc-a297-c2424941f7cc None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:52.123646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80244e-7000-409b-9b8e-5e55386e2488 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:52.123756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e2356-6fa5-44cc-a297-c2424941f7cc None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:52.123914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80244e-7000-409b-9b8e-5e55386e2488 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:52.124424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e2356-6fa5-44cc-a297-c2424941f7cc None admin] RBAC: Adding query filter params (name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:52.124673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80244e-7000-409b-9b8e-5e55386e2488 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:52.124762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e2356-6fa5-44cc-a297-c2424941f7cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:52.124973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80244e-7000-409b-9b8e-5e55386e2488 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:52.126086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e2356-6fa5-44cc-a297-c2424941f7cc None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:52.126376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80244e-7000-409b-9b8e-5e55386e2488 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:52.133918 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 256/513] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:17:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:52.134703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e2356-6fa5-44cc-a297-c2424941f7cc None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:52.144530 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 258/514] 10.222.0.76 () {56 vars in 1137 bytes} [Sat Aug 27 04:17:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:52.145214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80244e-7000-409b-9b8e-5e55386e2488 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:52.156698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:52.181663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:52.240469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e2356-6fa5-44cc-a297-c2424941f7cc None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:52.242445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80244e-7000-409b-9b8e-5e55386e2488 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:52.274986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f2142-1ef9-44a5-bb90-9c1da9ff035c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:52.275592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f2142-1ef9-44a5-bb90-9c1da9ff035c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:52.275873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f2142-1ef9-44a5-bb90-9c1da9ff035c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:52.276143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f2142-1ef9-44a5-bb90-9c1da9ff035c None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:52.276805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f2142-1ef9-44a5-bb90-9c1da9ff035c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:52.277105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f2142-1ef9-44a5-bb90-9c1da9ff035c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:52.277192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712989a-e814-43c7-bae1-9bc5bafc8644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:52.277708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712989a-e814-43c7-bae1-9bc5bafc8644 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:52.278039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712989a-e814-43c7-bae1-9bc5bafc8644 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:52.278391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712989a-e814-43c7-bae1-9bc5bafc8644 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:52.278493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f2142-1ef9-44a5-bb90-9c1da9ff035c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:52.279115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712989a-e814-43c7-bae1-9bc5bafc8644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:52.279413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712989a-e814-43c7-bae1-9bc5bafc8644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:52.280828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712989a-e814-43c7-bae1-9bc5bafc8644 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:52.290355 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 257/515] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:52.291065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f2142-1ef9-44a5-bb90-9c1da9ff035c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:52.296725 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 259/516] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:52.296725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712989a-e814-43c7-bae1-9bc5bafc8644 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:52.364792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:52.388314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:52.391147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f2142-1ef9-44a5-bb90-9c1da9ff035c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:52.394786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712989a-e814-43c7-bae1-9bc5bafc8644 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:52.425467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e228d4-f583-4423-aba8-34bd632eff2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:52.426084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e228d4-f583-4423-aba8-34bd632eff2b None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:52.426359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e228d4-f583-4423-aba8-34bd632eff2b None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:52.426629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e228d4-f583-4423-aba8-34bd632eff2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:52.429113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44127461-ba8f-4685-b3ef-c24299d83019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:52.429726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127461-ba8f-4685-b3ef-c24299d83019 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:52.430004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127461-ba8f-4685-b3ef-c24299d83019 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:52.430272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127461-ba8f-4685-b3ef-c24299d83019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:52.437170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e228d4-f583-4423-aba8-34bd632eff2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:52.438601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e228d4-f583-4423-aba8-34bd632eff2b None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:52.441517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44127461-ba8f-4685-b3ef-c24299d83019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:52.442968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44127461-ba8f-4685-b3ef-c24299d83019 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:52.455252 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-32e228d4-f583-4423-aba8-34bd632eff2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:52.455252 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:52.455252 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:52.455252 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:52.455252 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:52.455252 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:52.455252 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:52.455252 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:52.455252 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:52.455252 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:52.455252 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:52.455252 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:52.455252 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:52.455252 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:52.455252 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:52.455252 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:52.456349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:52.456349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:52.456349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:52.456349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:52.456349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:52.456349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:52.456349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:52.456349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:52.456349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:52.456349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:52.456349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:52.456349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:52.456349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:52.456349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:52.456349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:52.456349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:52.456349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:52.457392 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:52.457392 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:52.457392 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:52.457863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-44127461-ba8f-4685-b3ef-c24299d83019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:52.457863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:52.457863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:52.457863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:52.457863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:52.457863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:52.457863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:52.457863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:52.457863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:52.457863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:52.457863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:52.457863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:52.457863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:52.457863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:52.457863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:52.457863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:52.459270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:52.459270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:52.459270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:52.459270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:52.459270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:52.459270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:52.459270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:52.459270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:52.459270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:52.459270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:52.459270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:52.459270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:52.459270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:52.459270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:52.459270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:52.459270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:52.459270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:52.460397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:52.460397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:52.460397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:52.460971 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 258/517] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:52.461679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e228d4-f583-4423-aba8-34bd632eff2b None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:52.463473 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 260/518] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:52.464269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44127461-ba8f-4685-b3ef-c24299d83019 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:52.562026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e228d4-f583-4423-aba8-34bd632eff2b None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:52.563447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44127461-ba8f-4685-b3ef-c24299d83019 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:52.584899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:52.595818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8be02-3436-4771-9afe-53cba5e737ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:52.596445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8be02-3436-4771-9afe-53cba5e737ad None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:52.596719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8be02-3436-4771-9afe-53cba5e737ad None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:52.596809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a265fc-d1ee-441b-b7f9-73dfe675b903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:52.602965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8be02-3436-4771-9afe-53cba5e737ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:52.603077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a265fc-d1ee-441b-b7f9-73dfe675b903 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:52.603077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a265fc-d1ee-441b-b7f9-73dfe675b903 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:52.603077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a265fc-d1ee-441b-b7f9-73dfe675b903 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:52.603077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a265fc-d1ee-441b-b7f9-73dfe675b903 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:52.603077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a265fc-d1ee-441b-b7f9-73dfe675b903 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:52.619145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:52.663835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8be02-3436-4771-9afe-53cba5e737ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:52.665303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8be02-3436-4771-9afe-53cba5e737ad None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:52.681387 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 261/519] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:17:52 2022] POST /identity/v3/users => generated 247 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:17:52.682316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a265fc-d1ee-441b-b7f9-73dfe675b903 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:52.792764 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 259/520] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:52.792764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8be02-3436-4771-9afe-53cba5e737ad None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:52.820993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a265fc-d1ee-441b-b7f9-73dfe675b903 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:52.858205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:52.864500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a71d9-5d81-47e1-adb5-2aa2d79a0b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:52.864500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a71d9-5d81-47e1-adb5-2aa2d79a0b8f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:52.864739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a71d9-5d81-47e1-adb5-2aa2d79a0b8f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:52.864955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a71d9-5d81-47e1-adb5-2aa2d79a0b8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:52.873048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a71d9-5d81-47e1-adb5-2aa2d79a0b8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:52.874499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a71d9-5d81-47e1-adb5-2aa2d79a0b8f None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:52.892038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-972a71d9-5d81-47e1-adb5-2aa2d79a0b8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:17:52.892038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:52.892038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:52.892038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:52.892038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:52.892038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:52.892038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:52.892038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:52.892038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:52.892038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:52.892038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:52.892038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:52.892038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:17:52.892038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:17:52.892038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:17:52.893177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:17:52.893177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:52.893177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:52.893177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:52.893177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:52.893177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:52.893177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:52.893177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:52.893177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:52.893177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:52.893177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:52.893177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:52.893177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:52.893177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:52.893177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:52.893177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:52.893177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:52.894135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:17:52.894135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:17:52.894135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:17:52.894135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:17:52.894135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:17:52.894135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:17:52.894135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:17:52.894135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:52.894135 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 262/521] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:52.894135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a71d9-5d81-47e1-adb5-2aa2d79a0b8f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:52.915021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8be02-3436-4771-9afe-53cba5e737ad None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:52.938322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:52.954191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35a03c-e54e-4462-802d-dc80c5f05d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:52.954951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35a03c-e54e-4462-802d-dc80c5f05d45 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:52.955331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35a03c-e54e-4462-802d-dc80c5f05d45 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:52.955706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35a03c-e54e-4462-802d-dc80c5f05d45 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:52.956490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35a03c-e54e-4462-802d-dc80c5f05d45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:52.956891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35a03c-e54e-4462-802d-dc80c5f05d45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:52.958406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35a03c-e54e-4462-802d-dc80c5f05d45 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:52.971133 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 260/522] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:52.971991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35a03c-e54e-4462-802d-dc80c5f05d45 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:53.014133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a71d9-5d81-47e1-adb5-2aa2d79a0b8f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:53.061948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c0c61-1aee-4863-b910-bfd9e8d36031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:53.062721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c0c61-1aee-4863-b910-bfd9e8d36031 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:53.063102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c0c61-1aee-4863-b910-bfd9e8d36031 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:53.063481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c0c61-1aee-4863-b910-bfd9e8d36031 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:53.064281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c0c61-1aee-4863-b910-bfd9e8d36031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:53.064683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c0c61-1aee-4863-b910-bfd9e8d36031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:53.066173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c0c61-1aee-4863-b910-bfd9e8d36031 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:53.081431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35a03c-e54e-4462-802d-dc80c5f05d45 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:53.081685 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 263/523] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:53.082578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c0c61-1aee-4863-b910-bfd9e8d36031 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:53.100369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:53.124755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b332426-070a-48ab-94a0-d1cbbf6805a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:53.125462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b332426-070a-48ab-94a0-d1cbbf6805a3 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:53.125748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b332426-070a-48ab-94a0-d1cbbf6805a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:53.132649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b332426-070a-48ab-94a0-d1cbbf6805a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:53.139111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b332426-070a-48ab-94a0-d1cbbf6805a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:53.141140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b332426-070a-48ab-94a0-d1cbbf6805a3 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:53.158543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-1b332426-070a-48ab-94a0-d1cbbf6805a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:53.158543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:53.158543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:53.158543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:53.158543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:53.158543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:53.158543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:53.158543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:53.158543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:53.158543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:53.158543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:53.158543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:53.158543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:53.158543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:53.158543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:53.158543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:53.159780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:53.159780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:53.159780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:53.159780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:53.159780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:53.159780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:53.159780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:53.159780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:53.159780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:53.159780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:53.159780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:53.159780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:53.159780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:53.159780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:53.159780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:53.159780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:53.159780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:53.160690 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:53.160690 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:53.160690 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:53.160690 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 261/524] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:53.160906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b332426-070a-48ab-94a0-d1cbbf6805a3 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:53.196087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:53.199825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c0c61-1aee-4863-b910-bfd9e8d36031 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:53.238194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ec208-6cd7-4eeb-a7dc-1e833c8bc90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:53.238833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ec208-6cd7-4eeb-a7dc-1e833c8bc90e None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:53.239113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ec208-6cd7-4eeb-a7dc-1e833c8bc90e None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:53.239443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ec208-6cd7-4eeb-a7dc-1e833c8bc90e None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:53.240146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ec208-6cd7-4eeb-a7dc-1e833c8bc90e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:53.240534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ec208-6cd7-4eeb-a7dc-1e833c8bc90e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:53.241976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ec208-6cd7-4eeb-a7dc-1e833c8bc90e None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:53.262856 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 264/525] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:17:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:53.264418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ec208-6cd7-4eeb-a7dc-1e833c8bc90e None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:53.278682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b332426-070a-48ab-94a0-d1cbbf6805a3 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:53.315772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7f328-f399-4fbf-92b4-09d76848142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:53.316425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7f328-f399-4fbf-92b4-09d76848142f None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:53.316701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7f328-f399-4fbf-92b4-09d76848142f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:53.316966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7f328-f399-4fbf-92b4-09d76848142f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:53.323503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7f328-f399-4fbf-92b4-09d76848142f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:53.325759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7f328-f399-4fbf-92b4-09d76848142f None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:53.337606 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-a4d7f328-f399-4fbf-92b4-09d76848142f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:17:53.337606 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:53.337606 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:53.337606 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:53.337606 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:53.337606 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:53.337606 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:53.337606 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:53.337606 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:53.337606 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:53.337606 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:53.337606 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:53.337606 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:17:53.337606 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:17:53.337606 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:17:53.338711 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:17:53.338711 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:53.338711 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:53.338711 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:53.338711 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:53.338711 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:53.338711 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:53.338711 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:53.338711 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:53.338711 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:53.338711 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:53.338711 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:53.338711 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:53.338711 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:53.338711 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:53.338711 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:53.338711 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:53.339789 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:17:53.339789 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:17:53.339789 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:17:53.339789 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:17:53.339789 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:17:53.339789 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:17:53.339789 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:17:53.339789 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:53.339789 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 262/526] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:53.339789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7f328-f399-4fbf-92b4-09d76848142f None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:53.365520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:53.381518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ec208-6cd7-4eeb-a7dc-1e833c8bc90e None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:53.418011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c8a81-9771-443c-9e0a-9ea33bc6bf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:53.418953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c8a81-9771-443c-9e0a-9ea33bc6bf1d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:53.419333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c8a81-9771-443c-9e0a-9ea33bc6bf1d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:53.419716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c8a81-9771-443c-9e0a-9ea33bc6bf1d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:53.426972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c8a81-9771-443c-9e0a-9ea33bc6bf1d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:53.428500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c8a81-9771-443c-9e0a-9ea33bc6bf1d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:53.440558 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-2e5c8a81-9771-443c-9e0a-9ea33bc6bf1d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 04:17:53.440558 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:53.440558 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:53.440558 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:53.440558 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:53.440558 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:53.440558 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:53.440558 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:53.440558 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:53.440558 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:53.440558 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:53.440558 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:53.440558 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:17:53.440558 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:17:53.440558 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:17:53.440558 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:53.441638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:53.447600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:53.447600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:53.447600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:17:53.447600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:17:53.447600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:17:53.447600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:17:53.447600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:17:53.447600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:17:53.447600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 04:17:53.447600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:53.447600 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 265/527] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:17:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:53.447600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c8a81-9771-443c-9e0a-9ea33bc6bf1d None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:53.456729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7f328-f399-4fbf-92b4-09d76848142f None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:53.466414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:53.491001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8df14-8a47-459a-8854-c1432775437f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:53.491642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8df14-8a47-459a-8854-c1432775437f None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:53.491918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8df14-8a47-459a-8854-c1432775437f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:53.492208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8df14-8a47-459a-8854-c1432775437f None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:53.492848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8df14-8a47-459a-8854-c1432775437f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:53.493146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8df14-8a47-459a-8854-c1432775437f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:53.494512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8df14-8a47-459a-8854-c1432775437f None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:53.512256 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 263/528] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:53.512256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8df14-8a47-459a-8854-c1432775437f None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:53.558742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c8a81-9771-443c-9e0a-9ea33bc6bf1d None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:53.596762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f875a3-e9e1-4c10-9151-54181f520c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:53.597281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f875a3-e9e1-4c10-9151-54181f520c55 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:53.597558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f875a3-e9e1-4c10-9151-54181f520c55 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:53.597832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f875a3-e9e1-4c10-9151-54181f520c55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:53.598562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f875a3-e9e1-4c10-9151-54181f520c55 None admin] RBAC: Adding query filter params (role.id=127770d936b94a5da885e721233e7f7b, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=0e5ddcf00a184aa0ac0e7194f1c72425) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:53.598866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f875a3-e9e1-4c10-9151-54181f520c55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:53.599757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:53.600318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f875a3-e9e1-4c10-9151-54181f520c55 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:53.616197 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 266/529] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:53 2022] GET /identity/v3/role_assignments?user.id=0e5ddcf00a184aa0ac0e7194f1c72425&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=127770d936b94a5da885e721233e7f7b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:53.616197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f875a3-e9e1-4c10-9151-54181f520c55 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:53.629242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8df14-8a47-459a-8854-c1432775437f None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:53.680504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06a9ef-3780-45e2-817e-c9839adf3243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:53.681169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06a9ef-3780-45e2-817e-c9839adf3243 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:53.681451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06a9ef-3780-45e2-817e-c9839adf3243 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:53.681723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06a9ef-3780-45e2-817e-c9839adf3243 None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:53.682708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06a9ef-3780-45e2-817e-c9839adf3243 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:53.683696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06a9ef-3780-45e2-817e-c9839adf3243 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:53.685660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06a9ef-3780-45e2-817e-c9839adf3243 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:53.702780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:53.719157 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 264/530] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:17:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:53.720618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06a9ef-3780-45e2-817e-c9839adf3243 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:53.725125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f875a3-e9e1-4c10-9151-54181f520c55 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:53.764416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da0dcc-2437-4775-a1a0-613dc146c3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:53.765130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da0dcc-2437-4775-a1a0-613dc146c3b8 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:53.765482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da0dcc-2437-4775-a1a0-613dc146c3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:53.765822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da0dcc-2437-4775-a1a0-613dc146c3b8 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:53.766614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da0dcc-2437-4775-a1a0-613dc146c3b8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:53.767054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da0dcc-2437-4775-a1a0-613dc146c3b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:53.768624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da0dcc-2437-4775-a1a0-613dc146c3b8 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:53.790546 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 267/531] 10.222.0.76 () {56 vars in 1139 bytes} [Sat Aug 27 04:17:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:53.791389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da0dcc-2437-4775-a1a0-613dc146c3b8 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:53.853423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06a9ef-3780-45e2-817e-c9839adf3243 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:53.889485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197134fa-f909-44fb-9127-159539c26aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:53.890116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197134fa-f909-44fb-9127-159539c26aac None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:53.890394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197134fa-f909-44fb-9127-159539c26aac None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:53.890664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197134fa-f909-44fb-9127-159539c26aac None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:53.898038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197134fa-f909-44fb-9127-159539c26aac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:53.899583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197134fa-f909-44fb-9127-159539c26aac None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:53.905874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da0dcc-2437-4775-a1a0-613dc146c3b8 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:53.911970 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-197134fa-f909-44fb-9127-159539c26aac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:17:53.911970 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:53.911970 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:53.911970 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:53.911970 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:53.911970 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:53.911970 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:53.911970 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:53.911970 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:53.911970 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:53.911970 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:53.911970 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:53.911970 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:17:53.911970 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:17:53.911970 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:17:53.912845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:17:53.912845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:53.912845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:53.912845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:53.912845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:53.912845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:53.912845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:53.912845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:53.912845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:53.912845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:53.912845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:53.912845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:53.912845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:53.912845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:53.912845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:53.912845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:53.912845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:53.913685 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:17:53.913685 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:17:53.913685 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:17:53.913685 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:17:53.913685 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:17:53.913685 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:17:53.913685 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:17:53.913685 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:53.913685 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 265/532] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:53.914562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197134fa-f909-44fb-9127-159539c26aac None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:53.918179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:53.947651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018062e-7341-4398-ae99-e06215c82c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:53.948654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018062e-7341-4398-ae99-e06215c82c0e None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:53.949139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018062e-7341-4398-ae99-e06215c82c0e None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:53.950180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018062e-7341-4398-ae99-e06215c82c0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:53.951285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018062e-7341-4398-ae99-e06215c82c0e None admin] RBAC: Adding query filter params (role.id=127770d936b94a5da885e721233e7f7b, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=f9cd48a297bf498e88ce722f74154354) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:53.951812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018062e-7341-4398-ae99-e06215c82c0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:53.953522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018062e-7341-4398-ae99-e06215c82c0e None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:53.964573 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 268/533] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:53 2022] GET /identity/v3/role_assignments?user.id=f9cd48a297bf498e88ce722f74154354&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=127770d936b94a5da885e721233e7f7b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:53.966419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018062e-7341-4398-ae99-e06215c82c0e None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:53.974951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:54.037345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197134fa-f909-44fb-9127-159539c26aac None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:54.088915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a63000-5d4d-478a-a0a0-6c683e98919f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:54.091277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a63000-5d4d-478a-a0a0-6c683e98919f None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:54.092016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a63000-5d4d-478a-a0a0-6c683e98919f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:54.093161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a63000-5d4d-478a-a0a0-6c683e98919f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:54.172072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a63000-5d4d-478a-a0a0-6c683e98919f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:54.173883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a63000-5d4d-478a-a0a0-6c683e98919f None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:54.177295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:54.203055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018062e-7341-4398-ae99-e06215c82c0e None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:54.252045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585f525-f091-4630-b938-b570f6f23d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:54.253077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585f525-f091-4630-b938-b570f6f23d28 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:54.253556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585f525-f091-4630-b938-b570f6f23d28 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:54.254026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585f525-f091-4630-b938-b570f6f23d28 None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:54.254919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585f525-f091-4630-b938-b570f6f23d28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:54.255440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585f525-f091-4630-b938-b570f6f23d28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:54.257248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585f525-f091-4630-b938-b570f6f23d28 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:54.283206 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 269/534] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:17:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:54.287095 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 266/535] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:54.289028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585f525-f091-4630-b938-b570f6f23d28 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:54.289141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a63000-5d4d-478a-a0a0-6c683e98919f None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:54.393367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a63000-5d4d-478a-a0a0-6c683e98919f None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:54.395682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:54.429434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa7c80-a0e3-4a1b-9819-9f72270421dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:54.429994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa7c80-a0e3-4a1b-9819-9f72270421dc None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:54.430276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa7c80-a0e3-4a1b-9819-9f72270421dc None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:54.430552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa7c80-a0e3-4a1b-9819-9f72270421dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:54.440675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:54.441997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa7c80-a0e3-4a1b-9819-9f72270421dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:54.443435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa7c80-a0e3-4a1b-9819-9f72270421dc None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:54.459314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-b2aa7c80-a0e3-4a1b-9819-9f72270421dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:54.459314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:54.459314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:54.459314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:54.459314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:54.459314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:54.459314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:54.459314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:54.459314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:54.459314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:54.459314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:54.459314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:54.459314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:54.459314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:54.459314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:54.459314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:54.460365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:54.460365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:54.460365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:54.460365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:54.460365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:54.460365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:54.460365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:54.460365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:54.460365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:54.460365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:54.460365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:54.460365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:54.460365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:54.460365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:54.460365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:54.460365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:54.460365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:54.461238 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:54.461238 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:54.461238 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:54.461238 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 267/536] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:17:54.466479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa7c80-a0e3-4a1b-9819-9f72270421dc None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:54.531327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585f525-f091-4630-b938-b570f6f23d28 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:54.603575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310d53a-c623-4ac3-be83-67bcb4f46fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:54.604215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310d53a-c623-4ac3-be83-67bcb4f46fd7 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:54.604594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310d53a-c623-4ac3-be83-67bcb4f46fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:54.605007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310d53a-c623-4ac3-be83-67bcb4f46fd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:54.606440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310d53a-c623-4ac3-be83-67bcb4f46fd7 None admin] RBAC: Adding query filter params (role.id=127770d936b94a5da885e721233e7f7b, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=dfcccc451b4b443f9b2428cc207211ad) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:54.606756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310d53a-c623-4ac3-be83-67bcb4f46fd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:54.608433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310d53a-c623-4ac3-be83-67bcb4f46fd7 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:54.621247 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 270/537] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:54 2022] GET /identity/v3/role_assignments?user.id=dfcccc451b4b443f9b2428cc207211ad&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=127770d936b94a5da885e721233e7f7b => generated 259 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:54.625478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa7c80-a0e3-4a1b-9819-9f72270421dc None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:54.665411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0a3fa-75e3-4e53-9f8b-d8e5b8c57941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:54.666027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0a3fa-75e3-4e53-9f8b-d8e5b8c57941 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:54.666308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0a3fa-75e3-4e53-9f8b-d8e5b8c57941 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:54.666576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0a3fa-75e3-4e53-9f8b-d8e5b8c57941 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:54.667222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0a3fa-75e3-4e53-9f8b-d8e5b8c57941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:54.667684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0a3fa-75e3-4e53-9f8b-d8e5b8c57941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:54.669978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0a3fa-75e3-4e53-9f8b-d8e5b8c57941 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:54.684016 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 268/538] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:54.690070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310d53a-c623-4ac3-be83-67bcb4f46fd7 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:54.789613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2336df5-ae3a-4079-a635-5c9d39faa30e None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:54.789941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2336df5-ae3a-4079-a635-5c9d39faa30e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:54.790164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2336df5-ae3a-4079-a635-5c9d39faa30e None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:54.791748 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 269/539] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:54.798543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81838599-43d3-44ce-bfcc-03b088d63089 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:54.798845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81838599-43d3-44ce-bfcc-03b088d63089 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:54.799079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81838599-43d3-44ce-bfcc-03b088d63089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:54.816030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310d53a-c623-4ac3-be83-67bcb4f46fd7 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:54.838404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-81838599-43d3-44ce-bfcc-03b088d63089 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:54.839690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-81838599-43d3-44ce-bfcc-03b088d63089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:54.868899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:54.876566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:54.890650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ec40d-a661-439e-9ee0-1ae30d2578ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:54.891292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ec40d-a661-439e-9ee0-1ae30d2578ac None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:54.891574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ec40d-a661-439e-9ee0-1ae30d2578ac None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:54.891857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ec40d-a661-439e-9ee0-1ae30d2578ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:54.899085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ec40d-a661-439e-9ee0-1ae30d2578ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:54.900751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ec40d-a661-439e-9ee0-1ae30d2578ac None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:54.920662 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-3e1ec40d-a661-439e-9ee0-1ae30d2578ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:17:54.920662 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:54.920662 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:54.920662 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:54.920662 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:54.920662 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:54.920662 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:54.920662 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:54.920662 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:54.920662 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:54.920662 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:54.920662 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:54.920662 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:17:54.920662 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:17:54.920662 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:17:54.924118 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:17:54.924118 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:54.924118 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:54.924118 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:54.924118 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:54.924118 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:54.924118 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:54.924118 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:54.924118 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:54.924118 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:54.924118 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:54.924118 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:54.924118 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:54.924118 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:54.924118 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:54.924118 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:54.924118 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:54.925178 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:17:54.925178 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:17:54.925178 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:17:54.925178 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:17:54.925178 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:17:54.925178 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:17:54.925178 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:17:54.925178 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:54.925178 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 271/540] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:54.928565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ec40d-a661-439e-9ee0-1ae30d2578ac None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:54.975188 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 270/541] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:55.063913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ec40d-a661-439e-9ee0-1ae30d2578ac None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:55.114995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d796c40-e7dd-459d-b9f5-08382fb377bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:55.115777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d796c40-e7dd-459d-b9f5-08382fb377bb None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:55.116171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d796c40-e7dd-459d-b9f5-08382fb377bb None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:55.116555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d796c40-e7dd-459d-b9f5-08382fb377bb None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:55.117358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d796c40-e7dd-459d-b9f5-08382fb377bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:55.117769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d796c40-e7dd-459d-b9f5-08382fb377bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:55.119295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d796c40-e7dd-459d-b9f5-08382fb377bb None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:55.132512 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 272/542] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:17:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:55.141498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81838599-43d3-44ce-bfcc-03b088d63089 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:55.268719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81838599-43d3-44ce-bfcc-03b088d63089 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:55.272679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d796c40-e7dd-459d-b9f5-08382fb377bb None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:55.311765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156529e-2a2d-4e61-a16d-814fa797a056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:55.320185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156529e-2a2d-4e61-a16d-814fa797a056 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:55.320185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156529e-2a2d-4e61-a16d-814fa797a056 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:55.320185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156529e-2a2d-4e61-a16d-814fa797a056 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:55.320185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156529e-2a2d-4e61-a16d-814fa797a056 None admin] RBAC: Adding query filter params (role.id=127770d936b94a5da885e721233e7f7b, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=0547461f91aa423381430eda35fe6b74) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:55.320185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156529e-2a2d-4e61-a16d-814fa797a056 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:55.320185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156529e-2a2d-4e61-a16d-814fa797a056 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:55.322340 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 271/543] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:55 2022] GET /identity/v3/role_assignments?user.id=0547461f91aa423381430eda35fe6b74&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=127770d936b94a5da885e721233e7f7b => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:55.333071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:55.400204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d796c40-e7dd-459d-b9f5-08382fb377bb None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:55.455452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3577c5-66de-4d17-aae2-89a2ca701a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:55.456109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3577c5-66de-4d17-aae2-89a2ca701a79 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:55.456421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3577c5-66de-4d17-aae2-89a2ca701a79 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:55.456692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3577c5-66de-4d17-aae2-89a2ca701a79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:55.481004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3577c5-66de-4d17-aae2-89a2ca701a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:55.486349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-6d3577c5-66de-4d17-aae2-89a2ca701a79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:55.486349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:55.486349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:55.486349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:55.486349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:55.486349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:55.486349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:55.486349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:55.486349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:55.486349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:55.486349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:55.486349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:55.486349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:55.486349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:55.486349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:55.486349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:55.487271 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:55.487271 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:55.487271 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:55.487271 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:55.487271 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:55.487271 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:55.487271 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:55.487271 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:55.487271 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:55.487271 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:55.487271 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:55.487271 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:55.487271 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:55.487271 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:55.487271 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:55.487271 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:55.488057 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:55.488057 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:55.488057 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:55.488057 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:55.488057 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:55.488057 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:55.488057 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:55.488057 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:55.488057 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:55.488057 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:55.488057 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:55.488057 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:55.488057 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 273/544] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:17:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:17:55.496121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156529e-2a2d-4e61-a16d-814fa797a056 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:55.509748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:55.609005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156529e-2a2d-4e61-a16d-814fa797a056 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:55.645087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca4e56-0d68-44d5-99f8-c36c28659c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:55.645697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4e56-0d68-44d5-99f8-c36c28659c7e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:55.645975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4e56-0d68-44d5-99f8-c36c28659c7e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:55.646246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4e56-0d68-44d5-99f8-c36c28659c7e None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:55.646903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca4e56-0d68-44d5-99f8-c36c28659c7e None admin] RBAC: Adding query filter params (name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:55.647205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca4e56-0d68-44d5-99f8-c36c28659c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:55.648661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca4e56-0d68-44d5-99f8-c36c28659c7e None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:55.657759 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 272/545] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:17:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:55.665249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3577c5-66de-4d17-aae2-89a2ca701a79 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:55.788352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3577c5-66de-4d17-aae2-89a2ca701a79 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:55.801918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:55.840995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbb0f0-7d4d-40d8-aebc-5c65a346e78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:55.841646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbb0f0-7d4d-40d8-aebc-5c65a346e78d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:55.841927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbb0f0-7d4d-40d8-aebc-5c65a346e78d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:55.842201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbb0f0-7d4d-40d8-aebc-5c65a346e78d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:55.852908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbb0f0-7d4d-40d8-aebc-5c65a346e78d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:55.857818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbb0f0-7d4d-40d8-aebc-5c65a346e78d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:55.862878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fed87-b6c8-4a66-8944-5953ae5bc246 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:55.863389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fed87-b6c8-4a66-8944-5953ae5bc246 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:55.863851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fed87-b6c8-4a66-8944-5953ae5bc246 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:55.865668 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 273/546] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:17:55.872066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f6167-1668-48df-9df0-86bf880fcbd1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:55.873159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f6167-1668-48df-9df0-86bf880fcbd1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:55.873635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f6167-1668-48df-9df0-86bf880fcbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:55.879577 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-97fbb0f0-7d4d-40d8-aebc-5c65a346e78d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:55.879577 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:55.879577 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:55.879577 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:55.879577 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:55.879577 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:55.879577 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:55.879577 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:55.879577 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:55.879577 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:55.879577 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:55.879577 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:55.879577 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:55.879577 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:55.879577 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:55.879577 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:55.880606 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:55.880606 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:55.880606 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:55.880606 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:55.880606 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:55.880606 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:55.880606 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:55.880606 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:55.880606 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:55.880606 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:55.880606 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:55.880606 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:55.880606 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:55.880606 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:55.880606 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:55.880606 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:55.880606 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:55.881438 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:55.881438 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:55.881438 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:55.881438 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 274/547] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:55.889382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbb0f0-7d4d-40d8-aebc-5c65a346e78d None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:55.904108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-260f6167-1668-48df-9df0-86bf880fcbd1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:55.905887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-260f6167-1668-48df-9df0-86bf880fcbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:56.030902 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 274/548] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:17:56.098863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbb0f0-7d4d-40d8-aebc-5c65a346e78d None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:56.133604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee0338-1c71-4bd5-b9d5-902d1f8c4feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:56.134417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee0338-1c71-4bd5-b9d5-902d1f8c4feb None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:56.134840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee0338-1c71-4bd5-b9d5-902d1f8c4feb None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:56.135253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee0338-1c71-4bd5-b9d5-902d1f8c4feb None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:56.136350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee0338-1c71-4bd5-b9d5-902d1f8c4feb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:56.136822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee0338-1c71-4bd5-b9d5-902d1f8c4feb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:56.138383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee0338-1c71-4bd5-b9d5-902d1f8c4feb None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:56.150490 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 275/549] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:17:56.155787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f6167-1668-48df-9df0-86bf880fcbd1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:56.162552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:56.304567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f6167-1668-48df-9df0-86bf880fcbd1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:56.358838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a2624-9038-4a17-acb4-1046a209be70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:56.359466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a2624-9038-4a17-acb4-1046a209be70 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:56.359736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a2624-9038-4a17-acb4-1046a209be70 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:56.359999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a2624-9038-4a17-acb4-1046a209be70 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:56.367320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a2624-9038-4a17-acb4-1046a209be70 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:56.368780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a2624-9038-4a17-acb4-1046a209be70 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:56.381099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-931a2624-9038-4a17-acb4-1046a209be70 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:17:56.381099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:56.381099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:56.381099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:56.381099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:56.381099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:56.381099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:56.381099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:56.381099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:56.381099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:56.381099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:56.381099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:56.381099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:17:56.381099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:17:56.381099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:17:56.381099 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:56.382081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:56.382997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:56.382997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:56.382997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:17:56.382997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:17:56.382997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:17:56.382997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:17:56.382997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:17:56.382997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:17:56.382997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:17:56.382997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:56.382997 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 275/550] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:17:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:56.388861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee0338-1c71-4bd5-b9d5-902d1f8c4feb None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:56.416518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:56.443613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338809d5-874e-43db-a45c-56410d1d34d9 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:56.443914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338809d5-874e-43db-a45c-56410d1d34d9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:56.444154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338809d5-874e-43db-a45c-56410d1d34d9 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:56.445724 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 276/551] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:56.451881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479addf-4a55-43d3-b03d-f8c31e0c96ef None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:56.452192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479addf-4a55-43d3-b03d-f8c31e0c96ef None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:56.452480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479addf-4a55-43d3-b03d-f8c31e0c96ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:56.481677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6479addf-4a55-43d3-b03d-f8c31e0c96ef None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:56.483153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6479addf-4a55-43d3-b03d-f8c31e0c96ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:56.528604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee0338-1c71-4bd5-b9d5-902d1f8c4feb None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:56.564550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59e28a-96fa-4bb9-b818-5af5c6629f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:56.565251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59e28a-96fa-4bb9-b818-5af5c6629f92 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:56.565594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59e28a-96fa-4bb9-b818-5af5c6629f92 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:56.566251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59e28a-96fa-4bb9-b818-5af5c6629f92 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:56.566735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59e28a-96fa-4bb9-b818-5af5c6629f92 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:56.567127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59e28a-96fa-4bb9-b818-5af5c6629f92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:56.568681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59e28a-96fa-4bb9-b818-5af5c6629f92 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:56.580502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:56.589324 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 276/552] 10.222.0.76 () {56 vars in 1135 bytes} [Sat Aug 27 04:17:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:56.590348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59e28a-96fa-4bb9-b818-5af5c6629f92 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:56.593421 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 277/553] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:56.602810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479addf-4a55-43d3-b03d-f8c31e0c96ef None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:56.721055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479addf-4a55-43d3-b03d-f8c31e0c96ef None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:56.763757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f5eae-71d1-49ca-b498-688abff1cdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:56.764489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f5eae-71d1-49ca-b498-688abff1cdfc None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:56.764776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f5eae-71d1-49ca-b498-688abff1cdfc None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:56.765055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f5eae-71d1-49ca-b498-688abff1cdfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:56.835108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:56.848871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f5eae-71d1-49ca-b498-688abff1cdfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:56.850916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f5eae-71d1-49ca-b498-688abff1cdfc None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:56.875425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:56.897924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59e28a-96fa-4bb9-b818-5af5c6629f92 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:56.949617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ed392-e0c0-4414-805a-f3eea4c093b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:56.950547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ed392-e0c0-4414-805a-f3eea4c093b7 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:56.950816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ed392-e0c0-4414-805a-f3eea4c093b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:56.951100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ed392-e0c0-4414-805a-f3eea4c093b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:56.966082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ed392-e0c0-4414-805a-f3eea4c093b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:56.972248 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 278/554] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:17:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:56.972248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f5eae-71d1-49ca-b498-688abff1cdfc None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:56.972453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-e29ed392-e0c0-4414-805a-f3eea4c093b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:56.972453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:56.972453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:56.972453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:56.972453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:56.972453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:56.972453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:56.972453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:56.972453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:56.972453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:56.972453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:56.972453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:56.972453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:56.972453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:56.972453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:56.972453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:56.973372 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:56.973372 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:56.973372 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:56.973372 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:56.973372 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:56.973372 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:56.973372 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:56.973372 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:56.973372 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:56.973372 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:56.973372 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:56.973372 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:56.973372 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:56.973372 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:56.973372 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:56.973372 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:56.974196 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:56.974196 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:56.974196 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:56.974196 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:56.974196 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:56.974196 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:56.974196 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:56.974196 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:56.974196 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:56.974196 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:56.974196 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:56.974196 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:56.974196 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 277/555] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:17:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:56.978754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ed392-e0c0-4414-805a-f3eea4c093b7 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:57.065944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:57.075696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f5eae-71d1-49ca-b498-688abff1cdfc None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:57.094453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ed392-e0c0-4414-805a-f3eea4c093b7 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:57.112861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd30268-8a8c-460d-928d-937a5a6c25d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:57.113534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd30268-8a8c-460d-928d-937a5a6c25d8 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:57.113907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd30268-8a8c-460d-928d-937a5a6c25d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:57.114182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd30268-8a8c-460d-928d-937a5a6c25d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:57.125754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd30268-8a8c-460d-928d-937a5a6c25d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:57.131048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-efd30268-8a8c-460d-928d-937a5a6c25d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:57.131048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:57.131048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:57.131048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:57.131048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:57.131048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:57.131048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:57.131048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:57.131048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:57.131048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:57.131048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:57.131048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:57.131048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:57.131048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:57.131048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:57.131048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:57.131987 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:57.131987 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:57.131987 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:57.131987 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:57.131987 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:57.131987 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:57.131987 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:57.131987 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:57.131987 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:57.131987 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:57.131987 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:57.131987 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:57.131987 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:57.131987 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:57.131987 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:57.131987 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:57.132923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:57.132923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:57.132923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:57.132923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:57.132923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:57.132923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:57.132923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:57.132923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:57.132923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:57.132923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:57.132923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:57.132923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:57.132923 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 279/556] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:17:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:57.133604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd30268-8a8c-460d-928d-937a5a6c25d8 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:57.135115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd6cb0-c6b4-4b1c-be7d-2d535589a8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:57.136246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd6cb0-c6b4-4b1c-be7d-2d535589a8be None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:57.136246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd6cb0-c6b4-4b1c-be7d-2d535589a8be None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:57.136444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd6cb0-c6b4-4b1c-be7d-2d535589a8be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:57.144811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:57.148984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd6cb0-c6b4-4b1c-be7d-2d535589a8be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:57.150644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd6cb0-c6b4-4b1c-be7d-2d535589a8be None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:57.166830 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-f7bd6cb0-c6b4-4b1c-be7d-2d535589a8be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:57.166830 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:57.166830 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:57.166830 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:57.166830 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:57.166830 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:57.166830 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:57.166830 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:57.166830 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:57.166830 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:57.166830 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:57.166830 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:57.166830 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:57.166830 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:57.166830 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:57.166830 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:57.169458 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:57.169458 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:57.169458 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:57.169458 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:57.169458 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:57.169458 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:57.169458 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:57.169458 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:57.169458 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:57.169458 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:57.169458 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:57.169458 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:57.169458 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:57.169458 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:57.169458 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:57.169458 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:57.169458 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:57.170530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:57.170530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:57.170530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:57.170530 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 278/557] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:57.170530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd6cb0-c6b4-4b1c-be7d-2d535589a8be None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:57.248487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd30268-8a8c-460d-928d-937a5a6c25d8 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:57.284461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ffe74-fa32-418b-8c3c-eb55d8c93188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:57.284919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd6cb0-c6b4-4b1c-be7d-2d535589a8be None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:57.285601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ffe74-fa32-418b-8c3c-eb55d8c93188 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:57.286066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ffe74-fa32-418b-8c3c-eb55d8c93188 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:57.286520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ffe74-fa32-418b-8c3c-eb55d8c93188 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:57.287444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ffe74-fa32-418b-8c3c-eb55d8c93188 None admin] RBAC: Adding query filter params (name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:57.287748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ffe74-fa32-418b-8c3c-eb55d8c93188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:57.289153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ffe74-fa32-418b-8c3c-eb55d8c93188 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:57.302234 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 280/558] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:17:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:57.302234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ffe74-fa32-418b-8c3c-eb55d8c93188 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:57.319565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:57.330122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548dc6c-b418-433e-84c9-fe5ce0b9fefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:57.333081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548dc6c-b418-433e-84c9-fe5ce0b9fefb None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:57.333081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548dc6c-b418-433e-84c9-fe5ce0b9fefb None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:57.333081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548dc6c-b418-433e-84c9-fe5ce0b9fefb None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:57.333081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548dc6c-b418-433e-84c9-fe5ce0b9fefb None admin] RBAC: Adding query filter params (name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:57.333081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548dc6c-b418-433e-84c9-fe5ce0b9fefb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:57.333686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548dc6c-b418-433e-84c9-fe5ce0b9fefb None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:57.342931 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 279/559] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:17:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:57.344129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b353e3-1079-48bd-99b5-ccdf3a10c602 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:57.344441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b353e3-1079-48bd-99b5-ccdf3a10c602 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:57.344720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b353e3-1079-48bd-99b5-ccdf3a10c602 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:57.346082 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 280/560] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:57.350584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b353e3-1079-48bd-99b5-ccdf3a10c602 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:57.408643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:57.413463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ffe74-fa32-418b-8c3c-eb55d8c93188 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:57.451784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6f3b3-66cc-4dc8-84bb-0fa31fd25bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:57.452425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6f3b3-66cc-4dc8-84bb-0fa31fd25bf7 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:57.452702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6f3b3-66cc-4dc8-84bb-0fa31fd25bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:57.452974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6f3b3-66cc-4dc8-84bb-0fa31fd25bf7 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:57.453616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6f3b3-66cc-4dc8-84bb-0fa31fd25bf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:57.453920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6f3b3-66cc-4dc8-84bb-0fa31fd25bf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:57.455270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6f3b3-66cc-4dc8-84bb-0fa31fd25bf7 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:57.462987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b353e3-1079-48bd-99b5-ccdf3a10c602 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:57.467408 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 281/561] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:57.468255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6f3b3-66cc-4dc8-84bb-0fa31fd25bf7 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:57.502333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb6126-a6d0-4d2d-ae58-d8d236ce8759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:57.503223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb6126-a6d0-4d2d-ae58-d8d236ce8759 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:57.503654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb6126-a6d0-4d2d-ae58-d8d236ce8759 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:57.504076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb6126-a6d0-4d2d-ae58-d8d236ce8759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:57.516431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb6126-a6d0-4d2d-ae58-d8d236ce8759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:57.518070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb6126-a6d0-4d2d-ae58-d8d236ce8759 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:57.534034 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-8bcb6126-a6d0-4d2d-ae58-d8d236ce8759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:57.534034 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:57.534034 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:57.534034 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:57.534034 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:57.534034 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:57.534034 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:57.534034 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:57.534034 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:57.534034 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:57.534034 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:57.534034 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:57.534034 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:57.534034 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:57.534034 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:57.534034 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:57.539939 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:57.539939 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:57.539939 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:57.539939 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:57.539939 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:57.539939 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:57.539939 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:57.539939 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:57.539939 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:57.539939 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:57.539939 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:57.539939 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:57.539939 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:57.539939 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:57.539939 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:57.539939 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:57.539939 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:57.540950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:57.540950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:57.540950 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:57.540950 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 281/562] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:57.540950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08082c-1140-4f11-98b8-374eab1448a7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:57.540950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08082c-1140-4f11-98b8-374eab1448a7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:57.540950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08082c-1140-4f11-98b8-374eab1448a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:57.552483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:57.578195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6f3b3-66cc-4dc8-84bb-0fa31fd25bf7 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:57.616560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7b08082c-1140-4f11-98b8-374eab1448a7 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:57.617760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7b08082c-1140-4f11-98b8-374eab1448a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:57.640551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37076d4b-b9a6-4169-a9f2-b1fc91b9b1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:57.641179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37076d4b-b9a6-4169-a9f2-b1fc91b9b1f7 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:57.641455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37076d4b-b9a6-4169-a9f2-b1fc91b9b1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:57.641720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37076d4b-b9a6-4169-a9f2-b1fc91b9b1f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:57.652077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37076d4b-b9a6-4169-a9f2-b1fc91b9b1f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:57.653683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37076d4b-b9a6-4169-a9f2-b1fc91b9b1f7 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:57.669727 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-37076d4b-b9a6-4169-a9f2-b1fc91b9b1f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:57.669727 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:57.669727 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:57.669727 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:57.669727 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:57.669727 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:57.669727 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:57.669727 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:57.669727 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:57.669727 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:57.669727 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:57.669727 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:57.669727 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:57.669727 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:57.669727 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:57.669727 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:57.670696 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:57.670696 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:57.670696 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:57.670696 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:57.670696 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:57.670696 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:57.670696 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:57.670696 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:57.670696 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:57.670696 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:57.670696 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:57.670696 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:57.670696 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:57.670696 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:57.670696 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:57.670696 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:57.670696 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:57.671573 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:57.671573 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:57.671573 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:57.671573 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 282/563] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:57.672272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37076d4b-b9a6-4169-a9f2-b1fc91b9b1f7 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:57.693997 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 282/564] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:57.694903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08082c-1140-4f11-98b8-374eab1448a7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:57.729081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:57.776792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37076d4b-b9a6-4169-a9f2-b1fc91b9b1f7 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:57.804076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:57.804263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08082c-1140-4f11-98b8-374eab1448a7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:57.813013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c82d2b-2ec7-4e67-8197-b016a400fe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:57.813642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c82d2b-2ec7-4e67-8197-b016a400fe18 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:57.813955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c82d2b-2ec7-4e67-8197-b016a400fe18 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:57.819992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c82d2b-2ec7-4e67-8197-b016a400fe18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:57.821203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c82d2b-2ec7-4e67-8197-b016a400fe18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:57.822665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c82d2b-2ec7-4e67-8197-b016a400fe18 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:57.835844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-c3c82d2b-2ec7-4e67-8197-b016a400fe18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:17:57.835844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:57.835844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:57.835844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:57.835844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:57.835844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:57.835844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:57.835844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:57.835844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:57.835844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:57.835844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:57.835844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:57.835844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:17:57.835844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:17:57.835844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:17:57.836939 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:17:57.836939 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:57.836939 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:57.836939 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:57.836939 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:57.836939 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:57.836939 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:57.836939 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:57.836939 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:57.836939 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:57.836939 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:57.836939 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:57.836939 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:57.836939 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:57.836939 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:57.836939 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:57.836939 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:57.837812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:17:57.837812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:17:57.837812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:17:57.837812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:17:57.837812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:17:57.837812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:17:57.837812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:17:57.837812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:57.837812 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 283/565] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:57.837812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c82d2b-2ec7-4e67-8197-b016a400fe18 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:57.846237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533030bb-ede1-45d4-81c8-43edb66b75c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:57.846849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533030bb-ede1-45d4-81c8-43edb66b75c4 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:57.847137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533030bb-ede1-45d4-81c8-43edb66b75c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:57.847401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533030bb-ede1-45d4-81c8-43edb66b75c4 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:57.848049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533030bb-ede1-45d4-81c8-43edb66b75c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:57.848456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533030bb-ede1-45d4-81c8-43edb66b75c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:57.849830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533030bb-ede1-45d4-81c8-43edb66b75c4 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:57.861539 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 283/566] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:57.862715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023231a-533f-4cb8-b6fd-21cffec17cd8 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:57.863001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023231a-533f-4cb8-b6fd-21cffec17cd8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:57.863279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023231a-533f-4cb8-b6fd-21cffec17cd8 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:57.868224 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 284/567] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:17:57.868224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023231a-533f-4cb8-b6fd-21cffec17cd8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:57.967839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c82d2b-2ec7-4e67-8197-b016a400fe18 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:57.974581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:57.982474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023231a-533f-4cb8-b6fd-21cffec17cd8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:58.007572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9967dc-f778-4232-8561-6f8ff9ea449b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:58.008189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9967dc-f778-4232-8561-6f8ff9ea449b None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:58.008482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9967dc-f778-4232-8561-6f8ff9ea449b None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:58.008754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9967dc-f778-4232-8561-6f8ff9ea449b None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:58.009379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9967dc-f778-4232-8561-6f8ff9ea449b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:58.009685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9967dc-f778-4232-8561-6f8ff9ea449b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:58.011293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9967dc-f778-4232-8561-6f8ff9ea449b None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:58.021148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42981f8-fafd-4440-af99-b2b757978150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:58.021775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42981f8-fafd-4440-af99-b2b757978150 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:58.022058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42981f8-fafd-4440-af99-b2b757978150 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:58.022332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42981f8-fafd-4440-af99-b2b757978150 None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:58.023024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42981f8-fafd-4440-af99-b2b757978150 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:58.023329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42981f8-fafd-4440-af99-b2b757978150 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:58.023531 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 284/568] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:58.024356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9967dc-f778-4232-8561-6f8ff9ea449b None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:58.024792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42981f8-fafd-4440-af99-b2b757978150 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:58.038454 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 285/569] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:17:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:58.039535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ebf46-de2c-46c5-991d-ba0cc28d496b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:58.039819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ebf46-de2c-46c5-991d-ba0cc28d496b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:58.040094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ebf46-de2c-46c5-991d-ba0cc28d496b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:58.057277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5b0ebf46-de2c-46c5-991d-ba0cc28d496b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:17:58.058444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5b0ebf46-de2c-46c5-991d-ba0cc28d496b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:17:58.072432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:58.124891 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 286/570] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:17:58.125393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9967dc-f778-4232-8561-6f8ff9ea449b None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:58.125712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ebf46-de2c-46c5-991d-ba0cc28d496b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:58.161958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534004a-c7c7-4701-9a42-a3cd0a6dad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:58.163007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534004a-c7c7-4701-9a42-a3cd0a6dad1a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:58.163288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534004a-c7c7-4701-9a42-a3cd0a6dad1a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:58.163793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534004a-c7c7-4701-9a42-a3cd0a6dad1a None admin] PATH_INFO: `/v3/users/nova` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:58.171618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534004a-c7c7-4701-9a42-a3cd0a6dad1a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:58.173081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534004a-c7c7-4701-9a42-a3cd0a6dad1a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:58.185178 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-b534004a-c7c7-4701-9a42-a3cd0a6dad1a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:17:58.185178 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:58.185178 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:58.185178 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:58.185178 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:58.185178 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:58.185178 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:58.185178 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:58.185178 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:58.185178 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:58.185178 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:58.185178 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:58.185178 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:17:58.185178 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:17:58.185178 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:17:58.185178 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:58.186195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:58.187164 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:58.187164 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:58.187164 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:17:58.187164 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:17:58.187164 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:17:58.187164 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:17:58.187164 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:17:58.187164 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:17:58.187164 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:17:58.187164 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:58.187164 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 285/571] 10.222.0.76 () {56 vars in 1093 bytes} [Sat Aug 27 04:17:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:58.187784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534004a-c7c7-4701-9a42-a3cd0a6dad1a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:58.237855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:58.256125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ebf46-de2c-46c5-991d-ba0cc28d496b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:58.295850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534004a-c7c7-4701-9a42-a3cd0a6dad1a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:58.297929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace7633-dd81-4015-80fe-8fa98884e87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:58.299368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace7633-dd81-4015-80fe-8fa98884e87e None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:58.299651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace7633-dd81-4015-80fe-8fa98884e87e None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:58.299924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace7633-dd81-4015-80fe-8fa98884e87e None admin] PATH_INFO: `/v3/roles/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:58.303277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:58.311903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace7633-dd81-4015-80fe-8fa98884e87e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:58.316970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-1ace7633-dd81-4015-80fe-8fa98884e87e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:58.316970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:58.316970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:58.316970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:58.316970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:58.316970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:58.316970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:58.316970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:58.316970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:58.316970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:58.316970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:58.316970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:58.316970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:58.316970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:58.316970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:58.316970 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:58.323143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:58.323143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:58.323143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:58.323143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:58.323143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:58.323143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:58.323143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:58.323143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:58.323143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:58.323143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:58.323143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:58.323143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:58.323143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:58.323143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:58.323143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:58.323143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:58.326893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:58.326893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:58.326893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:58.326893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:58.326893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:58.326893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:58.326893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:58.326893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:58.326893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:58.326893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:58.326893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:58.326893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:58.326893 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 287/572] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:17:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:58.326893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace7633-dd81-4015-80fe-8fa98884e87e None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:58.343158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26737ed-fd16-4790-b2fa-b00d75bce39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:58.343807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26737ed-fd16-4790-b2fa-b00d75bce39d None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:58.344087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26737ed-fd16-4790-b2fa-b00d75bce39d None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:58.344386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26737ed-fd16-4790-b2fa-b00d75bce39d None admin] PATH_INFO: `/v3/users/glance` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:58.352069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26737ed-fd16-4790-b2fa-b00d75bce39d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:58.353527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26737ed-fd16-4790-b2fa-b00d75bce39d None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:58.366338 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-b26737ed-fd16-4790-b2fa-b00d75bce39d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 04:17:58.366338 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:58.366338 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:58.366338 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:58.366338 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:58.366338 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:58.366338 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:58.366338 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:58.366338 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:58.366338 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:58.366338 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:58.366338 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:58.366338 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:17:58.366338 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:17:58.366338 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:17:58.366338 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:58.367324 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:58.368306 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:58.368306 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:58.368306 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:17:58.368306 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:17:58.368306 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:17:58.368306 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:17:58.368306 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:17:58.368306 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:17:58.368306 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 27 04:17:58.368306 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:58.368306 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 286/573] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:58.368918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26737ed-fd16-4790-b2fa-b00d75bce39d None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:58.433587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace7633-dd81-4015-80fe-8fa98884e87e None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:58.466490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfc1b5-bfff-483d-ad6f-b071ea56fad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:58.467102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfc1b5-bfff-483d-ad6f-b071ea56fad7 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:58.467379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfc1b5-bfff-483d-ad6f-b071ea56fad7 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:58.467651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfc1b5-bfff-483d-ad6f-b071ea56fad7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:58.468409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfc1b5-bfff-483d-ad6f-b071ea56fad7 None admin] RBAC: Adding query filter params (role.id=127770d936b94a5da885e721233e7f7b, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=cc067131b0d84c7c9da1a33ecb7a9d02) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:58.468713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfc1b5-bfff-483d-ad6f-b071ea56fad7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:58.470147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfc1b5-bfff-483d-ad6f-b071ea56fad7 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:58.470395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26737ed-fd16-4790-b2fa-b00d75bce39d None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:58.475424 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 288/574] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:17:58 2022] GET /identity/v3/role_assignments?user.id=cc067131b0d84c7c9da1a33ecb7a9d02&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=127770d936b94a5da885e721233e7f7b => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:58.476215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfc1b5-bfff-483d-ad6f-b071ea56fad7 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:58.487982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:58.522385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2f7d0-38a4-48fd-993d-2ec4b6694813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:58.523012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2f7d0-38a4-48fd-993d-2ec4b6694813 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:58.523311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2f7d0-38a4-48fd-993d-2ec4b6694813 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:58.523561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2f7d0-38a4-48fd-993d-2ec4b6694813 None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:58.524346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2f7d0-38a4-48fd-993d-2ec4b6694813 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:58.524652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2f7d0-38a4-48fd-993d-2ec4b6694813 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:58.526126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2f7d0-38a4-48fd-993d-2ec4b6694813 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:58.552151 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 287/575] 10.222.0.76 () {56 vars in 1133 bytes} [Sat Aug 27 04:17:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:58.552151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2f7d0-38a4-48fd-993d-2ec4b6694813 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:58.578754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:58.600069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfc1b5-bfff-483d-ad6f-b071ea56fad7 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:58.638688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5e9e6-cc5e-461f-b022-08e17a3f9bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:58.639551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5e9e6-cc5e-461f-b022-08e17a3f9bae None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:58.639828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5e9e6-cc5e-461f-b022-08e17a3f9bae None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:58.640096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5e9e6-cc5e-461f-b022-08e17a3f9bae None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:58.640850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5e9e6-cc5e-461f-b022-08e17a3f9bae None admin] RBAC: Adding query filter params (name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:58.641152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5e9e6-cc5e-461f-b022-08e17a3f9bae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:58.642684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5e9e6-cc5e-461f-b022-08e17a3f9bae None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:58.656344 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 289/576] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:17:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:58.656344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5e9e6-cc5e-461f-b022-08e17a3f9bae None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:58.664006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2f7d0-38a4-48fd-993d-2ec4b6694813 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:58.704314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25faf6-40e4-4851-8217-00269503db33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:58.705731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25faf6-40e4-4851-8217-00269503db33 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:58.706006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25faf6-40e4-4851-8217-00269503db33 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:58.706273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25faf6-40e4-4851-8217-00269503db33 None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:58.706999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25faf6-40e4-4851-8217-00269503db33 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:58.707301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25faf6-40e4-4851-8217-00269503db33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:58.708747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25faf6-40e4-4851-8217-00269503db33 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:58.727623 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 288/577] 10.222.0.76 () {56 vars in 1137 bytes} [Sat Aug 27 04:17:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:58.728475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25faf6-40e4-4851-8217-00269503db33 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:58.749822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:58.792142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5e9e6-cc5e-461f-b022-08e17a3f9bae None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:58.821872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:58.829991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329273a-97f4-4d12-8e95-d44e26a7ed1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:58.830677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329273a-97f4-4d12-8e95-d44e26a7ed1c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:58.830956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329273a-97f4-4d12-8e95-d44e26a7ed1c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:58.831225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329273a-97f4-4d12-8e95-d44e26a7ed1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:58.841892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25faf6-40e4-4851-8217-00269503db33 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:58.842255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329273a-97f4-4d12-8e95-d44e26a7ed1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:17:58.847424 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-e329273a-97f4-4d12-8e95-d44e26a7ed1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:58.847424 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:58.847424 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:58.847424 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:58.847424 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:58.847424 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:58.847424 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:58.847424 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:58.847424 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:58.847424 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:58.847424 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:58.847424 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:58.847424 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:17:58.847424 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:17:58.847424 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:17:58.847424 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:17:58.848369 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:17:58.848369 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:17:58.848369 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:17:58.848369 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:17:58.848369 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:58.848369 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:58.848369 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:58.848369 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:58.848369 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:58.848369 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:58.848369 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:58.848369 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:58.848369 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:58.848369 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:58.848369 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:58.848369 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:58.849212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:58.849212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:58.849212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:58.849212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:58.849212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:17:58.849212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:17:58.849212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:17:58.849212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:17:58.849212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:17:58.849212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:17:58.849212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:17:58.849212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:58.852498 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 290/578] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:17:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:58.853908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329273a-97f4-4d12-8e95-d44e26a7ed1c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:58.879151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788b208-c9e4-4142-b8da-d45bd9a182c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:58.879775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788b208-c9e4-4142-b8da-d45bd9a182c3 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:58.880048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788b208-c9e4-4142-b8da-d45bd9a182c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:58.880353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788b208-c9e4-4142-b8da-d45bd9a182c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:58.892416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788b208-c9e4-4142-b8da-d45bd9a182c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:58.893856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788b208-c9e4-4142-b8da-d45bd9a182c3 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:58.910341 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-2788b208-c9e4-4142-b8da-d45bd9a182c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:58.910341 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:58.910341 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:58.910341 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:58.910341 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:58.910341 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:58.910341 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:58.910341 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:58.910341 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:58.910341 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:58.910341 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:58.910341 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:58.910341 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:58.910341 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:58.910341 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:58.910341 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:58.911316 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:58.911316 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:58.911316 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:58.911316 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:58.911316 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:58.911316 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:58.911316 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:58.911316 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:58.911316 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:58.911316 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:58.911316 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:58.911316 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:58.911316 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:58.911316 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:58.911316 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:58.911316 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:58.911316 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:58.912238 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:58.912238 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:58.912238 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:58.912238 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 289/579] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:58.912238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788b208-c9e4-4142-b8da-d45bd9a182c3 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:58.978727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329273a-97f4-4d12-8e95-d44e26a7ed1c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:59.011674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:59.019020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd917963-3b64-4b3c-8e70-c25dca6ea224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:59.019738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd917963-3b64-4b3c-8e70-c25dca6ea224 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:59.020280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd917963-3b64-4b3c-8e70-c25dca6ea224 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:59.024304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd917963-3b64-4b3c-8e70-c25dca6ea224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:59.024595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788b208-c9e4-4142-b8da-d45bd9a182c3 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:59.036548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd917963-3b64-4b3c-8e70-c25dca6ea224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:59.038296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd917963-3b64-4b3c-8e70-c25dca6ea224 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:59.061177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3488efc-0136-4283-94a3-ad22891495ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:59.061804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3488efc-0136-4283-94a3-ad22891495ec None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:59.062080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3488efc-0136-4283-94a3-ad22891495ec None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:59.062348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3488efc-0136-4283-94a3-ad22891495ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:59.064425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-dd917963-3b64-4b3c-8e70-c25dca6ea224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:59.064425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:59.064425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:59.064425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:59.064425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:59.064425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:59.064425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:59.064425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:59.064425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:59.064425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:59.064425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:59.064425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:59.064425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:59.064425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:59.064425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:59.064425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:59.065421 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:59.065421 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:59.065421 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:59.065421 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:59.065421 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:59.065421 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:59.065421 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:59.065421 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:59.065421 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:59.065421 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:59.065421 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:59.065421 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:59.065421 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:59.065421 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:59.065421 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:59.065421 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:59.065421 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:59.066313 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:59.066313 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:59.066313 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:59.066313 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 291/580] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:59.067065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd917963-3b64-4b3c-8e70-c25dca6ea224 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:59.067297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:59.081481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3488efc-0136-4283-94a3-ad22891495ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:59.082104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3488efc-0136-4283-94a3-ad22891495ec None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:59.096893 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-e3488efc-0136-4283-94a3-ad22891495ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:59.096893 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:59.096893 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:59.096893 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:59.096893 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:59.096893 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:59.096893 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:59.096893 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:59.096893 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:59.096893 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:59.096893 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:59.096893 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:59.096893 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:59.096893 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:59.096893 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:59.096893 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:59.098046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:59.098046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:59.098046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:59.098046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:59.098046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:59.098046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:59.098046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:59.098046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:59.098046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:59.098046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:59.098046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:59.098046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:59.098046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:59.098046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:59.098046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:59.098046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:59.098046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:59.099128 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:59.099128 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:59.099128 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:59.099128 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 290/581] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:59.099672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3488efc-0136-4283-94a3-ad22891495ec None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:59.178431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd917963-3b64-4b3c-8e70-c25dca6ea224 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:59.213178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba7ee1-8f6e-4d31-b1e4-326322e97bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:59.213779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7ee1-8f6e-4d31-b1e4-326322e97bd0 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:59.214055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7ee1-8f6e-4d31-b1e4-326322e97bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:59.214419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7ee1-8f6e-4d31-b1e4-326322e97bd0 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:59.215657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba7ee1-8f6e-4d31-b1e4-326322e97bd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:59.215965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba7ee1-8f6e-4d31-b1e4-326322e97bd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:59.217012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3488efc-0136-4283-94a3-ad22891495ec None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:59.217372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba7ee1-8f6e-4d31-b1e4-326322e97bd0 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:59.230229 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 292/582] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:17:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:59.230229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba7ee1-8f6e-4d31-b1e4-326322e97bd0 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:59.256489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9046b5-493c-4ea2-aa7f-af9de0a90af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:59.257372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9046b5-493c-4ea2-aa7f-af9de0a90af9 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:59.257653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9046b5-493c-4ea2-aa7f-af9de0a90af9 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:59.257931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9046b5-493c-4ea2-aa7f-af9de0a90af9 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:59.258567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9046b5-493c-4ea2-aa7f-af9de0a90af9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:59.258895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9046b5-493c-4ea2-aa7f-af9de0a90af9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:59.260261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9046b5-493c-4ea2-aa7f-af9de0a90af9 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:59.273255 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 291/583] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:59.274056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9046b5-493c-4ea2-aa7f-af9de0a90af9 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:59.283444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:59.322623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:59.340780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba7ee1-8f6e-4d31-b1e4-326322e97bd0 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:59.377747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d3333-f9aa-4ef0-b014-5eb363d60855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:59.378352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d3333-f9aa-4ef0-b014-5eb363d60855 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:59.378630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d3333-f9aa-4ef0-b014-5eb363d60855 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:59.378901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d3333-f9aa-4ef0-b014-5eb363d60855 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:59.379070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9046b5-493c-4ea2-aa7f-af9de0a90af9 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:59.379546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d3333-f9aa-4ef0-b014-5eb363d60855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:59.379845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d3333-f9aa-4ef0-b014-5eb363d60855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:59.381274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d3333-f9aa-4ef0-b014-5eb363d60855 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:59.393812 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 293/584] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:59.394609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d3333-f9aa-4ef0-b014-5eb363d60855 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:59.421083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c521-80f5-4943-a581-33b0ca6b3d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:59.422099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c521-80f5-4943-a581-33b0ca6b3d6e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:59.422649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c521-80f5-4943-a581-33b0ca6b3d6e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:59.423091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c521-80f5-4943-a581-33b0ca6b3d6e None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:59.423878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67c521-80f5-4943-a581-33b0ca6b3d6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:59.424447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67c521-80f5-4943-a581-33b0ca6b3d6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:59.426034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67c521-80f5-4943-a581-33b0ca6b3d6e None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:59.438698 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 292/585] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:59.439512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c521-80f5-4943-a581-33b0ca6b3d6e None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:59.500884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d3333-f9aa-4ef0-b014-5eb363d60855 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:59.503654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:59.539469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096ff96-9788-4c39-ad6b-1b9bd80f26ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:59.540098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096ff96-9788-4c39-ad6b-1b9bd80f26ca None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:59.540410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096ff96-9788-4c39-ad6b-1b9bd80f26ca None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:59.540688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096ff96-9788-4c39-ad6b-1b9bd80f26ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:59.548034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c521-80f5-4943-a581-33b0ca6b3d6e None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:59.551611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096ff96-9788-4c39-ad6b-1b9bd80f26ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:59.553089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096ff96-9788-4c39-ad6b-1b9bd80f26ca None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:59.569152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-d096ff96-9788-4c39-ad6b-1b9bd80f26ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:59.569152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:59.569152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:59.569152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:59.569152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:59.569152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:59.569152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:59.569152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:59.569152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:59.569152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:59.569152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:59.569152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:59.569152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:17:59.569152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:17:59.569152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:17:59.569152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:17:59.570186 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:59.570186 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:59.570186 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:59.570186 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:59.570186 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:59.570186 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:59.570186 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:59.570186 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:59.570186 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:59.570186 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:59.570186 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:59.570186 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:59.570186 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:59.570186 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:59.570186 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:59.570186 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:59.570186 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:17:59.571079 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:17:59.571079 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:17:59.571079 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:59.571079 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 294/586] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:59.573076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096ff96-9788-4c39-ad6b-1b9bd80f26ca None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:59.573472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:59.603730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860bd41-6c76-4fc3-8fa5-d9d6537cd23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:59.604312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860bd41-6c76-4fc3-8fa5-d9d6537cd23f None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:59.604594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860bd41-6c76-4fc3-8fa5-d9d6537cd23f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:59.604871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860bd41-6c76-4fc3-8fa5-d9d6537cd23f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:59.611789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2860bd41-6c76-4fc3-8fa5-d9d6537cd23f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:59.613250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2860bd41-6c76-4fc3-8fa5-d9d6537cd23f None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:59.625528 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-2860bd41-6c76-4fc3-8fa5-d9d6537cd23f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:17:59.625528 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:59.625528 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:59.625528 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:59.625528 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:59.625528 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:59.625528 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:59.625528 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:59.625528 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:59.625528 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:59.625528 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:59.625528 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:59.625528 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:17:59.625528 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:17:59.625528 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:17:59.626442 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:17:59.626442 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:59.626442 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:59.626442 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:59.626442 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:59.626442 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:59.626442 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:59.626442 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:59.626442 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:59.626442 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:59.626442 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:59.626442 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:59.626442 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:59.626442 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:59.626442 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:59.626442 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:59.626442 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:59.627329 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:17:59.627329 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:17:59.627329 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:17:59.627329 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:17:59.627329 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:17:59.627329 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:17:59.627329 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:17:59.627329 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:59.627329 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 293/587] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:59.627820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860bd41-6c76-4fc3-8fa5-d9d6537cd23f None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:59.682932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096ff96-9788-4c39-ad6b-1b9bd80f26ca None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:59.721147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63dbcd-f93c-421d-b781-a3690d6cdb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:59.721781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63dbcd-f93c-421d-b781-a3690d6cdb61 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:59.722057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63dbcd-f93c-421d-b781-a3690d6cdb61 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:59.722353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63dbcd-f93c-421d-b781-a3690d6cdb61 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:59.732258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63dbcd-f93c-421d-b781-a3690d6cdb61 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:59.733720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63dbcd-f93c-421d-b781-a3690d6cdb61 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:59.740006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860bd41-6c76-4fc3-8fa5-d9d6537cd23f None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:59.751353 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-4e63dbcd-f93c-421d-b781-a3690d6cdb61 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 04:17:59.751353 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:59.751353 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:59.751353 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:59.751353 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:59.751353 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:59.751353 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:59.751353 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:59.751353 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:59.751353 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:59.751353 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:59.751353 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:59.751353 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:17:59.751353 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:17:59.751353 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:17:59.751353 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:59.752329 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:59.753375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:59.753375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:59.753375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:17:59.753375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:17:59.753375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:17:59.753375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:17:59.753375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:17:59.753375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:17:59.753375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 04:17:59.753375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:17:59.753375 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 295/588] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:17:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:59.753966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63dbcd-f93c-421d-b781-a3690d6cdb61 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:59.779145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:59.786560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fd7e2-d4ac-4e16-908f-47efc5953249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:59.787368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fd7e2-d4ac-4e16-908f-47efc5953249 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:59.792355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fd7e2-d4ac-4e16-908f-47efc5953249 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:59.792355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fd7e2-d4ac-4e16-908f-47efc5953249 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:59.796098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fd7e2-d4ac-4e16-908f-47efc5953249 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:59.797557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fd7e2-d4ac-4e16-908f-47efc5953249 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:59.809770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-7e3fd7e2-d4ac-4e16-908f-47efc5953249 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:17:59.809770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:17:59.809770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:17:59.809770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:17:59.809770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:17:59.809770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:17:59.809770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:17:59.809770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:17:59.809770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:17:59.809770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:17:59.809770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:17:59.809770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:17:59.809770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:17:59.809770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:17:59.809770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:17:59.810793 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:17:59.810793 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:17:59.810793 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:17:59.810793 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:17:59.810793 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:17:59.810793 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:17:59.810793 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:17:59.810793 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:17:59.810793 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:17:59.810793 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:17:59.810793 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:17:59.810793 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:17:59.810793 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:17:59.810793 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:17:59.810793 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:17:59.810793 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:17:59.810793 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:17:59.811723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:17:59.811723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:17:59.811723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:17:59.811723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:17:59.811723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:17:59.811723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:17:59.811723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:17:59.811723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:17:59.811723 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 294/589] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:17:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:17:59.811723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fd7e2-d4ac-4e16-908f-47efc5953249 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:59.845774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:17:59.874817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63dbcd-f93c-421d-b781-a3690d6cdb61 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:59.910717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81ca72-d222-49f8-8253-507bc45cd132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:59.911315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81ca72-d222-49f8-8253-507bc45cd132 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:59.911592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81ca72-d222-49f8-8253-507bc45cd132 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:59.911858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81ca72-d222-49f8-8253-507bc45cd132 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:59.912548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81ca72-d222-49f8-8253-507bc45cd132 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:59.912925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81ca72-d222-49f8-8253-507bc45cd132 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:59.914570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81ca72-d222-49f8-8253-507bc45cd132 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:59.924217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fd7e2-d4ac-4e16-908f-47efc5953249 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:17:59.931646 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 296/590] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:59.931646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81ca72-d222-49f8-8253-507bc45cd132 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:17:59.972004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d816e9-cbb0-4230-b957-0c4d892a1b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:17:59.972687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d816e9-cbb0-4230-b957-0c4d892a1b08 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:17:59.972975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d816e9-cbb0-4230-b957-0c4d892a1b08 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:17:59.973245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d816e9-cbb0-4230-b957-0c4d892a1b08 None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:17:59.973935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d816e9-cbb0-4230-b957-0c4d892a1b08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:17:59.974239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d816e9-cbb0-4230-b957-0c4d892a1b08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:17:59.975763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d816e9-cbb0-4230-b957-0c4d892a1b08 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:17:59.988807 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 295/591] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:17:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:17:59.989628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d816e9-cbb0-4230-b957-0c4d892a1b08 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:00.023086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:00.049267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81ca72-d222-49f8-8253-507bc45cd132 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:00.098069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6e051-96c4-48ff-a062-3fdefdad1bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:00.098743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6e051-96c4-48ff-a062-3fdefdad1bad None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:00.099109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6e051-96c4-48ff-a062-3fdefdad1bad None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:00.099461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6e051-96c4-48ff-a062-3fdefdad1bad None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:00.099920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:00.100504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6e051-96c4-48ff-a062-3fdefdad1bad None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:00.100760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6e051-96c4-48ff-a062-3fdefdad1bad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:00.102218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6e051-96c4-48ff-a062-3fdefdad1bad None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:00.125305 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 297/592] 10.222.0.76 () {56 vars in 1137 bytes} [Sat Aug 27 04:17:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:00.126536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6e051-96c4-48ff-a062-3fdefdad1bad None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:00.134204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d816e9-cbb0-4230-b957-0c4d892a1b08 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:00.181569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157ed8a-6a25-45ed-ab95-b778ce682b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:00.182360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157ed8a-6a25-45ed-ab95-b778ce682b5e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:00.182680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157ed8a-6a25-45ed-ab95-b778ce682b5e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:00.183041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157ed8a-6a25-45ed-ab95-b778ce682b5e None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:00.183840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157ed8a-6a25-45ed-ab95-b778ce682b5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:00.184759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157ed8a-6a25-45ed-ab95-b778ce682b5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:00.186272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157ed8a-6a25-45ed-ab95-b778ce682b5e None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:00.198558 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 296/593] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:17:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:00.199571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157ed8a-6a25-45ed-ab95-b778ce682b5e None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:00.239913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6e051-96c4-48ff-a062-3fdefdad1bad None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:00.274119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527d10e-2faa-49e7-a239-66985c947850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:00.274728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527d10e-2faa-49e7-a239-66985c947850 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:00.275009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527d10e-2faa-49e7-a239-66985c947850 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:00.275277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527d10e-2faa-49e7-a239-66985c947850 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:00.277339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:00.284152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527d10e-2faa-49e7-a239-66985c947850 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:00.285642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527d10e-2faa-49e7-a239-66985c947850 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:00.298257 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-a527d10e-2faa-49e7-a239-66985c947850 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 04:18:00.298257 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:00.298257 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:00.298257 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:00.298257 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:00.298257 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:00.298257 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:00.298257 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:00.298257 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:00.298257 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:00.298257 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:00.298257 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:00.298257 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:00.298257 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:00.298257 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:00.298257 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:00.299249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:00.300231 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:00.300231 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:00.300231 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:00.300231 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:00.300231 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:00.300231 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:00.300231 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:00.300231 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:00.300231 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 04:18:00.300231 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:00.300231 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 298/594] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:18:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:00.300231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527d10e-2faa-49e7-a239-66985c947850 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:00.313827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157ed8a-6a25-45ed-ab95-b778ce682b5e None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:00.348310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d37565-b53b-489f-aa5e-14a39687ece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:00.349135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d37565-b53b-489f-aa5e-14a39687ece0 None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:00.349442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d37565-b53b-489f-aa5e-14a39687ece0 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:00.349779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d37565-b53b-489f-aa5e-14a39687ece0 None admin] PATH_INFO: `/v3/projects/5632b718c3aa48458247661045e99e5f/users/0e5ddcf00a184aa0ac0e7194f1c72425/roles/127770d936b94a5da885e721233e7f7b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:00.365065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d37565-b53b-489f-aa5e-14a39687ece0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5632b718c3aa48458247661045e99e5f, user_id=0e5ddcf00a184aa0ac0e7194f1c72425, role_id=127770d936b94a5da885e721233e7f7b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:00.366584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d37565-b53b-489f-aa5e-14a39687ece0 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:00.370038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:00.409665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527d10e-2faa-49e7-a239-66985c947850 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:00.446710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c757414-ab71-4182-9cab-92d9f9122eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:00.447698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c757414-ab71-4182-9cab-92d9f9122eee None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:00.448149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c757414-ab71-4182-9cab-92d9f9122eee None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:00.448729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c757414-ab71-4182-9cab-92d9f9122eee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:00.461306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c757414-ab71-4182-9cab-92d9f9122eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:00.462827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c757414-ab71-4182-9cab-92d9f9122eee None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:00.463601 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 297/595] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:18:00 2022] PUT /identity/v3/projects/5632b718c3aa48458247661045e99e5f/users/0e5ddcf00a184aa0ac0e7194f1c72425/roles/127770d936b94a5da885e721233e7f7b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:18:00.464446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d37565-b53b-489f-aa5e-14a39687ece0 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:00.484417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-8c757414-ab71-4182-9cab-92d9f9122eee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:00.484417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:00.484417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:00.484417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:00.484417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:00.484417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:00.484417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:00.484417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:00.484417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:00.484417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:00.484417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:00.484417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:00.484417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:00.484417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:00.484417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:00.484417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:00.486448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:00.486448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:00.486448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:00.486448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:00.486448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:00.486448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:00.486448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:00.486448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:00.486448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:00.486448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:00.486448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:00.486448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:00.486448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:00.486448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:00.486448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:00.486448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:00.486448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:00.487319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:00.487319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:00.487319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:00.487319 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 299/596] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:00.487319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c757414-ab71-4182-9cab-92d9f9122eee None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:00.552473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:00.584338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d37565-b53b-489f-aa5e-14a39687ece0 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:00.618823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c757414-ab71-4182-9cab-92d9f9122eee None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:00.625145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a19a1d-d1f1-4811-9ac8-68d2580d6ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:00.625804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a19a1d-d1f1-4811-9ac8-68d2580d6ef5 None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:00.626080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a19a1d-d1f1-4811-9ac8-68d2580d6ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:00.626351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a19a1d-d1f1-4811-9ac8-68d2580d6ef5 None admin] PATH_INFO: `/v3/projects/5632b718c3aa48458247661045e99e5f/users/f9cd48a297bf498e88ce722f74154354/roles/127770d936b94a5da885e721233e7f7b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:00.641998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a19a1d-d1f1-4811-9ac8-68d2580d6ef5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5632b718c3aa48458247661045e99e5f, user_id=f9cd48a297bf498e88ce722f74154354, role_id=127770d936b94a5da885e721233e7f7b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:00.643581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a19a1d-d1f1-4811-9ac8-68d2580d6ef5 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:00.654782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3ec10-f7a2-4aa0-bd06-bba3accd3a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:00.655376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3ec10-f7a2-4aa0-bd06-bba3accd3a67 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:00.655654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3ec10-f7a2-4aa0-bd06-bba3accd3a67 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:00.655927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3ec10-f7a2-4aa0-bd06-bba3accd3a67 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:00.659095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3ec10-f7a2-4aa0-bd06-bba3accd3a67 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:00.659095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3ec10-f7a2-4aa0-bd06-bba3accd3a67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:00.659095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3ec10-f7a2-4aa0-bd06-bba3accd3a67 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:00.675845 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 300/597] 10.222.0.76 () {56 vars in 1139 bytes} [Sat Aug 27 04:18:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:00.677154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a963134-06b9-4bf3-a9a1-a17e513d75ff None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:00.677450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a963134-06b9-4bf3-a9a1-a17e513d75ff None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:00.677725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a963134-06b9-4bf3-a9a1-a17e513d75ff None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:00.680731 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 301/598] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:00.680731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a963134-06b9-4bf3-a9a1-a17e513d75ff None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:00.716031 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 298/599] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:18:00 2022] PUT /identity/v3/projects/5632b718c3aa48458247661045e99e5f/users/f9cd48a297bf498e88ce722f74154354/roles/127770d936b94a5da885e721233e7f7b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:18:00.717245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a19a1d-d1f1-4811-9ac8-68d2580d6ef5 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:00.786572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:00.811747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a963134-06b9-4bf3-a9a1-a17e513d75ff None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:00.816308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:00.863565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80826cc-34d6-4888-b272-2e2de45ded51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:00.864744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80826cc-34d6-4888-b272-2e2de45ded51 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:00.865203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80826cc-34d6-4888-b272-2e2de45ded51 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:00.865634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80826cc-34d6-4888-b272-2e2de45ded51 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:00.866448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80826cc-34d6-4888-b272-2e2de45ded51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:00.866645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a19a1d-d1f1-4811-9ac8-68d2580d6ef5 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:00.867121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80826cc-34d6-4888-b272-2e2de45ded51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:00.868967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80826cc-34d6-4888-b272-2e2de45ded51 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:00.885782 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 302/600] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:00.888800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf73ce6-a310-45e0-a776-8003b2ee890a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:00.889245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf73ce6-a310-45e0-a776-8003b2ee890a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:00.889722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf73ce6-a310-45e0-a776-8003b2ee890a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:00.909957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-daf73ce6-a310-45e0-a776-8003b2ee890a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:00.911175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-daf73ce6-a310-45e0-a776-8003b2ee890a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:00.922069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd82e40-cd6d-4979-9c40-f35b8a36f946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:00.922715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd82e40-cd6d-4979-9c40-f35b8a36f946 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:00.922991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd82e40-cd6d-4979-9c40-f35b8a36f946 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:00.923258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd82e40-cd6d-4979-9c40-f35b8a36f946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:00.937631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd82e40-cd6d-4979-9c40-f35b8a36f946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:00.939519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd82e40-cd6d-4979-9c40-f35b8a36f946 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:00.955596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-2dd82e40-cd6d-4979-9c40-f35b8a36f946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:00.955596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:00.955596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:00.955596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:00.955596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:00.955596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:00.955596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:00.955596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:00.955596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:00.955596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:00.955596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:00.955596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:00.955596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:00.955596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:00.955596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:00.955596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:00.956824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:00.956824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:00.956824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:00.956824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:00.956824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:00.956824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:00.956824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:00.956824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:00.956824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:00.956824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:00.956824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:00.956824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:00.956824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:00.956824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:00.956824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:00.956824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:00.956824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:00.957877 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:00.957877 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:00.957877 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:00.959546 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 299/601] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:00.960610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd82e40-cd6d-4979-9c40-f35b8a36f946 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:00.991983 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 303/602] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:18:00.993162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf73ce6-a310-45e0-a776-8003b2ee890a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:01.125571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:01.133278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf73ce6-a310-45e0-a776-8003b2ee890a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:01.177785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046fabb-ca66-4618-9851-64fe4abb529f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:01.178641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046fabb-ca66-4618-9851-64fe4abb529f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:01.181799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046fabb-ca66-4618-9851-64fe4abb529f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:01.182263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046fabb-ca66-4618-9851-64fe4abb529f None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:01.183067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046fabb-ca66-4618-9851-64fe4abb529f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:01.183523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046fabb-ca66-4618-9851-64fe4abb529f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:01.187084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046fabb-ca66-4618-9851-64fe4abb529f None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:01.204283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:01.205037 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 304/603] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:01.206694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046fabb-ca66-4618-9851-64fe4abb529f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:01.215345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd82e40-cd6d-4979-9c40-f35b8a36f946 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:01.288094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e63f4-4002-4d41-a58c-8b494b392fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:01.288846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e63f4-4002-4d41-a58c-8b494b392fcb None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:01.289122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e63f4-4002-4d41-a58c-8b494b392fcb None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:01.289391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e63f4-4002-4d41-a58c-8b494b392fcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:01.297448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e63f4-4002-4d41-a58c-8b494b392fcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:01.298828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e63f4-4002-4d41-a58c-8b494b392fcb None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:01.311840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-0e1e63f4-4002-4d41-a58c-8b494b392fcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:01.311840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:01.311840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:01.311840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:01.311840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:01.311840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:01.311840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:01.311840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:01.311840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:01.311840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:01.311840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:01.311840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:01.311840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:01.311840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:01.311840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:01.313021 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:01.313021 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:01.313021 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:01.313021 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:01.313021 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:01.313021 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:01.313021 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:01.313021 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:01.313021 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:01.313021 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:01.313021 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:01.313021 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:01.313021 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:01.313021 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:01.313021 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:01.313021 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:01.313021 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:01.314112 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:01.314112 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:01.314112 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:01.314112 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:01.314112 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:01.314112 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:01.314112 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:01.314112 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:01.317612 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 300/604] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:01.318542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e63f4-4002-4d41-a58c-8b494b392fcb None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:01.357223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046fabb-ca66-4618-9851-64fe4abb529f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:01.394742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049bfa2d-287e-4cf6-a347-9ca42f171db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:01.395631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bfa2d-287e-4cf6-a347-9ca42f171db6 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:01.396076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bfa2d-287e-4cf6-a347-9ca42f171db6 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:01.396648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bfa2d-287e-4cf6-a347-9ca42f171db6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:01.404578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049bfa2d-287e-4cf6-a347-9ca42f171db6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:01.406365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049bfa2d-287e-4cf6-a347-9ca42f171db6 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:01.419675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-049bfa2d-287e-4cf6-a347-9ca42f171db6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:01.419675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:01.419675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:01.419675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:01.419675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:01.419675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:01.419675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:01.419675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:01.419675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:01.419675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:01.419675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:01.419675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:01.419675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:01.419675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:01.419675 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:01.420825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:01.420825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:01.420825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:01.420825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:01.420825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:01.420825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:01.420825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:01.420825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:01.420825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:01.420825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:01.420825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:01.420825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:01.420825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:01.420825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:01.420825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:01.420825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:01.420825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:01.421915 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:01.421915 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:01.421915 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:01.421915 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:01.421915 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:01.421915 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:01.421915 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:01.421915 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:01.428291 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 305/605] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:01.428471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e63f4-4002-4d41-a58c-8b494b392fcb None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:01.429448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049bfa2d-287e-4cf6-a347-9ca42f171db6 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:01.448491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:01.475011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d7b4-9d14-4010-842f-9c3ff65dd5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:01.476120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d7b4-9d14-4010-842f-9c3ff65dd5ea None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:01.476473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d7b4-9d14-4010-842f-9c3ff65dd5ea None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:01.476746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d7b4-9d14-4010-842f-9c3ff65dd5ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:01.492693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67d7b4-9d14-4010-842f-9c3ff65dd5ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:01.500138 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-0b67d7b4-9d14-4010-842f-9c3ff65dd5ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:01.500138 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:01.500138 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:01.500138 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:01.500138 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:01.500138 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:01.500138 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:01.500138 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:01.500138 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:01.500138 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:01.500138 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:01.500138 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:01.500138 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:01.500138 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:01.500138 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:01.500138 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:01.501264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:01.501264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:01.501264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:01.501264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:01.501264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:01.501264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:01.501264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:01.501264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:01.501264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:01.501264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:01.501264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:01.501264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:01.501264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:01.501264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:01.501264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:01.501264 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:01.502207 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:01.502207 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:01.502207 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:01.502207 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:01.502207 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:01.502207 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:01.502207 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:01.502207 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:01.502207 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:01.502207 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:01.502207 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:01.502207 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:01.504232 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 301/606] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:18:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:01.505193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d7b4-9d14-4010-842f-9c3ff65dd5ea None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:01.531794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:01.552359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049bfa2d-287e-4cf6-a347-9ca42f171db6 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:01.590699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512ac76-eed0-403b-84fc-2667953700b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:01.591636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ac76-eed0-403b-84fc-2667953700b9 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:01.592069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ac76-eed0-403b-84fc-2667953700b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:01.592619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ac76-eed0-403b-84fc-2667953700b9 None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:01.593573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512ac76-eed0-403b-84fc-2667953700b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:01.594069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512ac76-eed0-403b-84fc-2667953700b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:01.595821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512ac76-eed0-403b-84fc-2667953700b9 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:01.611294 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 306/607] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:01.612592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512ac76-eed0-403b-84fc-2667953700b9 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:01.644680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d7b4-9d14-4010-842f-9c3ff65dd5ea None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:01.690351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797a183-3938-40a8-9057-4eb5791f83a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:01.691212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797a183-3938-40a8-9057-4eb5791f83a0 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:01.691491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797a183-3938-40a8-9057-4eb5791f83a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:01.691764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797a183-3938-40a8-9057-4eb5791f83a0 None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:01.692494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797a183-3938-40a8-9057-4eb5791f83a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:01.692782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797a183-3938-40a8-9057-4eb5791f83a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:01.695372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797a183-3938-40a8-9057-4eb5791f83a0 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:01.699668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:01.717575 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 302/608] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:01.717575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797a183-3938-40a8-9057-4eb5791f83a0 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:01.735376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512ac76-eed0-403b-84fc-2667953700b9 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:01.772906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25445fa-f83f-451b-9ff5-787d4a614889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:01.773784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25445fa-f83f-451b-9ff5-787d4a614889 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:01.774293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25445fa-f83f-451b-9ff5-787d4a614889 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:01.774725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25445fa-f83f-451b-9ff5-787d4a614889 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:01.775719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25445fa-f83f-451b-9ff5-787d4a614889 None admin] RBAC: Adding query filter params (name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:01.776292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25445fa-f83f-451b-9ff5-787d4a614889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:01.779003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25445fa-f83f-451b-9ff5-787d4a614889 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:01.792867 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 307/609] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:18:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:01.795219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25445fa-f83f-451b-9ff5-787d4a614889 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:01.809968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:01.837650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797a183-3938-40a8-9057-4eb5791f83a0 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:01.884121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a875991-3d41-4dfd-be91-b891cec8a540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:01.885061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a875991-3d41-4dfd-be91-b891cec8a540 None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:01.885518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a875991-3d41-4dfd-be91-b891cec8a540 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:01.886732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a875991-3d41-4dfd-be91-b891cec8a540 None admin] PATH_INFO: `/v3/projects/5632b718c3aa48458247661045e99e5f/users/dfcccc451b4b443f9b2428cc207211ad/roles/127770d936b94a5da885e721233e7f7b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:01.906589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a875991-3d41-4dfd-be91-b891cec8a540 None admin] RBAC: Authorizing `identity:create_grant(project_id=5632b718c3aa48458247661045e99e5f, user_id=dfcccc451b4b443f9b2428cc207211ad, role_id=127770d936b94a5da885e721233e7f7b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:01.908826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a875991-3d41-4dfd-be91-b891cec8a540 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:01.915832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25445fa-f83f-451b-9ff5-787d4a614889 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:01.957743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15d9af-6918-43cc-bc45-db3c7fd4b397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:01.958417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15d9af-6918-43cc-bc45-db3c7fd4b397 None admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:01.958703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15d9af-6918-43cc-bc45-db3c7fd4b397 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:01.958986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15d9af-6918-43cc-bc45-db3c7fd4b397 None admin] PATH_INFO: `/v3/projects/5632b718c3aa48458247661045e99e5f/users/0547461f91aa423381430eda35fe6b74/roles/127770d936b94a5da885e721233e7f7b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:01.966890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:01.978423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15d9af-6918-43cc-bc45-db3c7fd4b397 None admin] RBAC: Authorizing `identity:create_grant(project_id=5632b718c3aa48458247661045e99e5f, user_id=0547461f91aa423381430eda35fe6b74, role_id=127770d936b94a5da885e721233e7f7b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:01.979910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15d9af-6918-43cc-bc45-db3c7fd4b397 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:02.019500 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 303/610] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:18:01 2022] PUT /identity/v3/projects/5632b718c3aa48458247661045e99e5f/users/dfcccc451b4b443f9b2428cc207211ad/roles/127770d936b94a5da885e721233e7f7b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:18:02.020624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a875991-3d41-4dfd-be91-b891cec8a540 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:02.111121 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 308/611] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:18:01 2022] PUT /identity/v3/projects/5632b718c3aa48458247661045e99e5f/users/0547461f91aa423381430eda35fe6b74/roles/127770d936b94a5da885e721233e7f7b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:18:02.160625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a875991-3d41-4dfd-be91-b891cec8a540 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:02.194751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:02.204802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9e1b0-56f7-48f9-a9fb-3ebca25e40c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:02.205452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9e1b0-56f7-48f9-a9fb-3ebca25e40c0 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:02.208518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9e1b0-56f7-48f9-a9fb-3ebca25e40c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:02.208518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9e1b0-56f7-48f9-a9fb-3ebca25e40c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:02.219037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9e1b0-56f7-48f9-a9fb-3ebca25e40c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:02.220560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9e1b0-56f7-48f9-a9fb-3ebca25e40c0 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:02.239699 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-3db9e1b0-56f7-48f9-a9fb-3ebca25e40c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:02.239699 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:02.239699 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:02.239699 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:02.239699 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:02.239699 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:02.239699 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:02.239699 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:02.239699 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:02.239699 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:02.239699 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:02.239699 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:02.239699 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:02.239699 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:02.239699 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:02.239699 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:02.240953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:02.240953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:02.240953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:02.240953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:02.240953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:02.240953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:02.240953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:02.240953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:02.240953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:02.240953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:02.240953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:02.240953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:02.240953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:02.240953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:02.240953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:02.240953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:02.240953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:02.242242 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:02.242242 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:02.242242 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:02.242242 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 304/612] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:02.248156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15d9af-6918-43cc-bc45-db3c7fd4b397 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:02.370725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15d9af-6918-43cc-bc45-db3c7fd4b397 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:02.409589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf971ef5-75b0-420b-ac1f-fa80426ca725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:02.410435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf971ef5-75b0-420b-ac1f-fa80426ca725 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:02.410887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf971ef5-75b0-420b-ac1f-fa80426ca725 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:02.411303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf971ef5-75b0-420b-ac1f-fa80426ca725 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:02.412087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf971ef5-75b0-420b-ac1f-fa80426ca725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:02.412585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf971ef5-75b0-420b-ac1f-fa80426ca725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:02.414096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf971ef5-75b0-420b-ac1f-fa80426ca725 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:02.428231 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 309/613] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:02.436309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9e1b0-56f7-48f9-a9fb-3ebca25e40c0 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:02.512879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c3d48-d663-442e-8702-3ddc59d6557c None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:02.513771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c3d48-d663-442e-8702-3ddc59d6557c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:02.514338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c3d48-d663-442e-8702-3ddc59d6557c None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:02.516155 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 310/614] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:18:02.521750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a36644-f4d1-4ac4-bb38-ad504229315b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:02.522202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a36644-f4d1-4ac4-bb38-ad504229315b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:02.522646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a36644-f4d1-4ac4-bb38-ad504229315b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:02.545695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-88a36644-f4d1-4ac4-bb38-ad504229315b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:02.548955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-88a36644-f4d1-4ac4-bb38-ad504229315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:02.641824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9e1b0-56f7-48f9-a9fb-3ebca25e40c0 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:02.643421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:02.678882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee18f77-629f-434c-bd19-3aecdfabe0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:02.679746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee18f77-629f-434c-bd19-3aecdfabe0d7 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:02.680078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee18f77-629f-434c-bd19-3aecdfabe0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:02.680396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee18f77-629f-434c-bd19-3aecdfabe0d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:02.690401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee18f77-629f-434c-bd19-3aecdfabe0d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:02.691869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee18f77-629f-434c-bd19-3aecdfabe0d7 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:02.704717 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-4ee18f77-629f-434c-bd19-3aecdfabe0d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:18:02.704717 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:02.704717 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:02.704717 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:02.704717 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:02.704717 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:02.704717 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:02.704717 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:02.704717 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:02.704717 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:02.704717 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:02.704717 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:02.704717 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:02.704717 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:02.704717 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:02.704717 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:02.705746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:02.706698 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:02.706698 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:02.706698 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:02.706698 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:02.706698 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:02.706698 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:02.706698 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:02.706698 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:02.706698 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:18:02.706698 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:02.706698 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 305/615] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:18:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:02.711362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee18f77-629f-434c-bd19-3aecdfabe0d7 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:02.727382 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 311/616] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:18:02.790651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:02.876187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee18f77-629f-434c-bd19-3aecdfabe0d7 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:02.921830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b304fea-b14c-4c85-9f4f-c792e6dc290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:02.922363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b304fea-b14c-4c85-9f4f-c792e6dc290e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:02.922644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b304fea-b14c-4c85-9f4f-c792e6dc290e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:02.922917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b304fea-b14c-4c85-9f4f-c792e6dc290e None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:02.923652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b304fea-b14c-4c85-9f4f-c792e6dc290e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:02.923957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b304fea-b14c-4c85-9f4f-c792e6dc290e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:02.925416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b304fea-b14c-4c85-9f4f-c792e6dc290e None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:02.954692 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 306/617] 10.222.0.76 () {56 vars in 1135 bytes} [Sat Aug 27 04:18:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:02.962531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a36644-f4d1-4ac4-bb38-ad504229315b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:02.973929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7641a-5096-4f95-ad13-179e8317b1f8 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:02.974216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7641a-5096-4f95-ad13-179e8317b1f8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:02.974492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7641a-5096-4f95-ad13-179e8317b1f8 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:02.980269 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 307/618] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:02.983607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d55ed-a746-44d3-a173-f0bd5c7a425e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:02.983889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d55ed-a746-44d3-a173-f0bd5c7a425e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:02.984186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d55ed-a746-44d3-a173-f0bd5c7a425e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:03.033267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f69d55ed-a746-44d3-a173-f0bd5c7a425e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:03.034495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f69d55ed-a746-44d3-a173-f0bd5c7a425e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:03.108697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a36644-f4d1-4ac4-bb38-ad504229315b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:03.133511 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 308/619] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:18:03.134697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d55ed-a746-44d3-a173-f0bd5c7a425e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:03.157502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdee2fa-f9c8-4296-a7fc-e5cb0410e923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:03.158136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdee2fa-f9c8-4296-a7fc-e5cb0410e923 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:03.158416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdee2fa-f9c8-4296-a7fc-e5cb0410e923 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:03.158686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdee2fa-f9c8-4296-a7fc-e5cb0410e923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:03.178286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdee2fa-f9c8-4296-a7fc-e5cb0410e923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:03.179693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdee2fa-f9c8-4296-a7fc-e5cb0410e923 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:03.184608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:03.211240 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-bcdee2fa-f9c8-4296-a7fc-e5cb0410e923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:03.211240 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:03.211240 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:03.211240 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:03.211240 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:03.211240 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:03.211240 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:03.211240 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:03.211240 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:03.211240 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:03.211240 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:03.211240 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:03.211240 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:03.211240 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:03.211240 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:03.211240 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:03.212530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:03.212530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:03.212530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:03.212530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:03.212530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:03.212530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:03.212530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:03.212530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:03.212530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:03.212530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:03.212530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:03.212530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:03.212530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:03.212530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:03.212530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:03.212530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:03.212530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:03.213441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:03.213441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:03.213441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:03.217103 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 312/620] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:03.218820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdee2fa-f9c8-4296-a7fc-e5cb0410e923 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:03.280984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:03.328496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d55ed-a746-44d3-a173-f0bd5c7a425e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:03.387943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51116bb1-a8dd-43b7-8e52-83de1d7bf016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:03.389006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51116bb1-a8dd-43b7-8e52-83de1d7bf016 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:03.389519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51116bb1-a8dd-43b7-8e52-83de1d7bf016 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:03.390016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51116bb1-a8dd-43b7-8e52-83de1d7bf016 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:03.410015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51116bb1-a8dd-43b7-8e52-83de1d7bf016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:03.421574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-51116bb1-a8dd-43b7-8e52-83de1d7bf016 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:03.421574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:03.421574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:03.421574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:03.421574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:03.421574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:03.421574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:03.421574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:03.421574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:03.421574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:03.421574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:03.421574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:03.421574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:03.421574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:03.421574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:03.421574 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:03.422566 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:03.422566 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:03.422566 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:03.422566 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:03.422566 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:03.422566 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:03.422566 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:03.422566 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:03.422566 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:03.422566 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:03.422566 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:03.422566 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:03.422566 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:03.422566 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:03.422566 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:03.422566 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:03.423437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:03.423437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:03.423437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:03.423437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:03.423437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:03.423437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:03.423437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:03.423437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:03.423437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:03.423437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:03.423437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:03.423437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:03.427636 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 309/621] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:18:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:03.433640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51116bb1-a8dd-43b7-8e52-83de1d7bf016 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:03.456851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdee2fa-f9c8-4296-a7fc-e5cb0410e923 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:03.506183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36817259-bdf6-4929-8178-3402730a3690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:03.507794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36817259-bdf6-4929-8178-3402730a3690 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:03.508290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36817259-bdf6-4929-8178-3402730a3690 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:03.508848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36817259-bdf6-4929-8178-3402730a3690 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:03.509673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36817259-bdf6-4929-8178-3402730a3690 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:03.510417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36817259-bdf6-4929-8178-3402730a3690 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:03.513624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36817259-bdf6-4929-8178-3402730a3690 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:03.531171 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 313/622] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:03.532352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36817259-bdf6-4929-8178-3402730a3690 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:03.541879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:03.565486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51116bb1-a8dd-43b7-8e52-83de1d7bf016 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:03.617826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ffa78-9add-4c1f-8274-7396eb86acce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:03.618501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ffa78-9add-4c1f-8274-7396eb86acce None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:03.620713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ffa78-9add-4c1f-8274-7396eb86acce None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:03.622323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ffa78-9add-4c1f-8274-7396eb86acce None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:03.624401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ffa78-9add-4c1f-8274-7396eb86acce None admin] RBAC: Adding query filter params (name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:03.624884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ffa78-9add-4c1f-8274-7396eb86acce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:03.626940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ffa78-9add-4c1f-8274-7396eb86acce None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:03.638079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:03.641751 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 310/623] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:18:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:03.642722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ffa78-9add-4c1f-8274-7396eb86acce None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:03.655362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36817259-bdf6-4929-8178-3402730a3690 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:03.694251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c699e4-5a8c-4190-886b-db25e709bd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:03.695820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c699e4-5a8c-4190-886b-db25e709bd78 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:03.696295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c699e4-5a8c-4190-886b-db25e709bd78 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:03.696715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c699e4-5a8c-4190-886b-db25e709bd78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:03.711196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c699e4-5a8c-4190-886b-db25e709bd78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:03.718864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-23c699e4-5a8c-4190-886b-db25e709bd78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:03.718864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:03.718864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:03.718864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:03.718864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:03.718864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:03.718864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:03.718864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:03.718864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:03.718864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:03.718864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:03.718864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:03.718864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:03.718864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:03.718864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:03.718864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:03.719998 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:03.719998 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:03.719998 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:03.719998 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:03.719998 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:03.719998 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:03.719998 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:03.719998 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:03.719998 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:03.719998 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:03.719998 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:03.719998 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:03.719998 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:03.719998 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:03.719998 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:03.719998 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:03.721089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:03.721089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:03.721089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:03.721089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:03.721089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:03.721089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:03.721089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:03.721089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:03.721089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:03.721089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:03.721089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:03.721089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:03.724107 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 314/624] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:18:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:03.725064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c699e4-5a8c-4190-886b-db25e709bd78 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:03.764987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ffa78-9add-4c1f-8274-7396eb86acce None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:03.803296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32ed9a-e9c1-4d47-b396-84f64bb86cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:03.804629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32ed9a-e9c1-4d47-b396-84f64bb86cd1 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:03.805364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32ed9a-e9c1-4d47-b396-84f64bb86cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:03.805788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32ed9a-e9c1-4d47-b396-84f64bb86cd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:03.816834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32ed9a-e9c1-4d47-b396-84f64bb86cd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:03.819014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32ed9a-e9c1-4d47-b396-84f64bb86cd1 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:03.832202 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-bf32ed9a-e9c1-4d47-b396-84f64bb86cd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:03.832202 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:03.832202 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:03.832202 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:03.832202 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:03.832202 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:03.832202 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:03.832202 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:03.832202 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:03.832202 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:03.832202 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:03.832202 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:03.832202 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:03.832202 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:03.832202 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:03.833336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:03.833336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:03.833336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:03.833336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:03.833336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:03.833336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:03.833336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:03.833336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:03.833336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:03.833336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:03.833336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:03.833336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:03.833336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:03.833336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:03.833336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:03.833336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:03.833336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:03.834439 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:03.834439 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:03.834439 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:03.834439 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:03.834439 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:03.834439 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:03.834439 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:03.834439 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:03.841492 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 311/625] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:03.842437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32ed9a-e9c1-4d47-b396-84f64bb86cd1 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:03.855873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:03.862563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c699e4-5a8c-4190-886b-db25e709bd78 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:03.904399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d63039-fcaf-493b-9b0b-7fdf9f4ca09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:03.905326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d63039-fcaf-493b-9b0b-7fdf9f4ca09b None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:03.905545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d63039-fcaf-493b-9b0b-7fdf9f4ca09b None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:03.905919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d63039-fcaf-493b-9b0b-7fdf9f4ca09b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:03.919325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d63039-fcaf-493b-9b0b-7fdf9f4ca09b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:03.921070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d63039-fcaf-493b-9b0b-7fdf9f4ca09b None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:03.930513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:03.938028 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-12d63039-fcaf-493b-9b0b-7fdf9f4ca09b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:03.938028 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:03.938028 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:03.938028 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:03.938028 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:03.938028 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:03.938028 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:03.938028 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:03.938028 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:03.938028 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:03.938028 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:03.938028 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:03.938028 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:03.938028 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:03.938028 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:03.938028 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:03.939166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:03.939166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:03.939166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:03.939166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:03.939166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:03.939166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:03.939166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:03.939166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:03.939166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:03.939166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:03.939166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:03.939166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:03.939166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:03.939166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:03.939166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:03.939166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:03.939166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:03.940282 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:03.940282 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:03.940282 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:03.948268 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 315/626] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:03.948268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d63039-fcaf-493b-9b0b-7fdf9f4ca09b None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:03.980344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32ed9a-e9c1-4d47-b396-84f64bb86cd1 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:04.029903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a3a4e-924e-40d7-b82e-2f6bfde78b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:04.030663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a3a4e-924e-40d7-b82e-2f6bfde78b14 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:04.031039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a3a4e-924e-40d7-b82e-2f6bfde78b14 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:04.031412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a3a4e-924e-40d7-b82e-2f6bfde78b14 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:04.032762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a3a4e-924e-40d7-b82e-2f6bfde78b14 None admin] RBAC: Adding query filter params (name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:04.032762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a3a4e-924e-40d7-b82e-2f6bfde78b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:04.034054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a3a4e-924e-40d7-b82e-2f6bfde78b14 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:04.043277 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 312/627] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:18:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:04.044468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a3a4e-924e-40d7-b82e-2f6bfde78b14 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:04.078090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d63039-fcaf-493b-9b0b-7fdf9f4ca09b None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:04.122081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:04.125229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856970b-0442-4b27-aa80-b221bfd88b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:04.126003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856970b-0442-4b27-aa80-b221bfd88b6c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:04.126429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856970b-0442-4b27-aa80-b221bfd88b6c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:04.126799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856970b-0442-4b27-aa80-b221bfd88b6c None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:04.127678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856970b-0442-4b27-aa80-b221bfd88b6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:04.128083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856970b-0442-4b27-aa80-b221bfd88b6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:04.129648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856970b-0442-4b27-aa80-b221bfd88b6c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:04.148209 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 316/628] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:04.149274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856970b-0442-4b27-aa80-b221bfd88b6c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:04.161254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a3a4e-924e-40d7-b82e-2f6bfde78b14 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:04.206703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8e953-886e-445c-a357-cee9a9787f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:04.207568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8e953-886e-445c-a357-cee9a9787f3b None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:04.208295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8e953-886e-445c-a357-cee9a9787f3b None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:04.208742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8e953-886e-445c-a357-cee9a9787f3b None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:04.209545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8e953-886e-445c-a357-cee9a9787f3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:04.209996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8e953-886e-445c-a357-cee9a9787f3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:04.212378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8e953-886e-445c-a357-cee9a9787f3b None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:04.214887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:04.232004 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 313/629] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:04.233205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8e953-886e-445c-a357-cee9a9787f3b None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:04.278472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856970b-0442-4b27-aa80-b221bfd88b6c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:04.322190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416bfbe-35f6-4393-a434-ca7261c316d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:04.322850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416bfbe-35f6-4393-a434-ca7261c316d5 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:04.323173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416bfbe-35f6-4393-a434-ca7261c316d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:04.323454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416bfbe-35f6-4393-a434-ca7261c316d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:04.335325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416bfbe-35f6-4393-a434-ca7261c316d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:04.336837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416bfbe-35f6-4393-a434-ca7261c316d5 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:04.348475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8e953-886e-445c-a357-cee9a9787f3b None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:04.351649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-0416bfbe-35f6-4393-a434-ca7261c316d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:04.351649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:04.351649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:04.351649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:04.351649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:04.351649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:04.351649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:04.351649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:04.351649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:04.351649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:04.351649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:04.351649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:04.351649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:04.351649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:04.351649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:04.351649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:04.352644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:04.352644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:04.352644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:04.352644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:04.352644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:04.352644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:04.352644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:04.352644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:04.352644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:04.352644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:04.352644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:04.352644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:04.352644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:04.352644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:04.352644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:04.352644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:04.352644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:04.353576 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:04.353576 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:04.353576 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:04.356346 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 317/630] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:04.357898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416bfbe-35f6-4393-a434-ca7261c316d5 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:04.380477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:04.385305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ecab0-ed70-4907-a54e-7153e3052bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:04.386229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ecab0-ed70-4907-a54e-7153e3052bae None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:04.386516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ecab0-ed70-4907-a54e-7153e3052bae None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:04.386824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ecab0-ed70-4907-a54e-7153e3052bae None admin] PATH_INFO: `/v3/projects/5632b718c3aa48458247661045e99e5f/users/cc067131b0d84c7c9da1a33ecb7a9d02/roles/127770d936b94a5da885e721233e7f7b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:04.402149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ecab0-ed70-4907-a54e-7153e3052bae None admin] RBAC: Authorizing `identity:create_grant(project_id=5632b718c3aa48458247661045e99e5f, user_id=cc067131b0d84c7c9da1a33ecb7a9d02, role_id=127770d936b94a5da885e721233e7f7b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:04.405938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ecab0-ed70-4907-a54e-7153e3052bae None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:04.463010 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 314/631] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:18:04 2022] PUT /identity/v3/projects/5632b718c3aa48458247661045e99e5f/users/cc067131b0d84c7c9da1a33ecb7a9d02/roles/127770d936b94a5da885e721233e7f7b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:18:04.464313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b507b9-0943-467f-9d50-280a1ad1159c None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:04.464597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b507b9-0943-467f-9d50-280a1ad1159c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:04.464917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b507b9-0943-467f-9d50-280a1ad1159c None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:04.466291 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 315/632] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:04.467032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b507b9-0943-467f-9d50-280a1ad1159c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:04.468338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416bfbe-35f6-4393-a434-ca7261c316d5 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:04.485041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:04.512676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950cd28-ab94-4019-889d-bbf8272b90b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:04.513362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950cd28-ab94-4019-889d-bbf8272b90b4 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:04.513655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950cd28-ab94-4019-889d-bbf8272b90b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:04.514014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950cd28-ab94-4019-889d-bbf8272b90b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:04.523223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950cd28-ab94-4019-889d-bbf8272b90b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:04.525152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950cd28-ab94-4019-889d-bbf8272b90b4 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:04.539032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-9950cd28-ab94-4019-889d-bbf8272b90b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:18:04.539032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:04.539032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:04.539032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:04.539032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:04.539032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:04.539032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:04.539032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:04.539032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:04.539032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:04.539032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:04.539032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:04.539032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:04.539032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:04.539032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:04.539032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:04.540236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:04.541351 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:04.541351 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:04.541351 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:04.541351 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:04.541351 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:04.541351 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:04.541351 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:04.541351 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:04.541351 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:18:04.541351 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:04.546309 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 318/633] 10.222.0.76 () {56 vars in 1093 bytes} [Sat Aug 27 04:18:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:04.547765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c473fb-fadc-4874-86c5-ad3c4e7f14ea None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:04.548101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c473fb-fadc-4874-86c5-ad3c4e7f14ea None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:04.548397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c473fb-fadc-4874-86c5-ad3c4e7f14ea None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:04.550015 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 319/634] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:04.551149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370bcbb-641f-49ce-ab9b-2075e2978e10 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:04.551441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370bcbb-641f-49ce-ab9b-2075e2978e10 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:04.551718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370bcbb-641f-49ce-ab9b-2075e2978e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:04.571168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6370bcbb-641f-49ce-ab9b-2075e2978e10 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:04.572617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6370bcbb-641f-49ce-ab9b-2075e2978e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:04.603665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b507b9-0943-467f-9d50-280a1ad1159c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:04.645719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3498d-d8bb-48dd-96cf-3d5c9d43607a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:04.646442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3498d-d8bb-48dd-96cf-3d5c9d43607a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:04.646712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3498d-d8bb-48dd-96cf-3d5c9d43607a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:04.646981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3498d-d8bb-48dd-96cf-3d5c9d43607a None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:04.647619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3498d-d8bb-48dd-96cf-3d5c9d43607a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:04.647943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3498d-d8bb-48dd-96cf-3d5c9d43607a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:04.649362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3498d-d8bb-48dd-96cf-3d5c9d43607a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:04.651929 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 320/635] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:18:04.653965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370bcbb-641f-49ce-ab9b-2075e2978e10 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:04.666054 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 316/636] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:04.667728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff93947-f7e7-4b69-9d51-3d329936c665 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:04.672310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff93947-f7e7-4b69-9d51-3d329936c665 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:04.672855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff93947-f7e7-4b69-9d51-3d329936c665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:04.698019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7ff93947-f7e7-4b69-9d51-3d329936c665 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:04.699621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7ff93947-f7e7-4b69-9d51-3d329936c665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:04.739154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:04.773596 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 317/637] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:18:04.774591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff93947-f7e7-4b69-9d51-3d329936c665 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:04.776748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370bcbb-641f-49ce-ab9b-2075e2978e10 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:04.779786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:04.853646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4b999-b244-409f-972c-5a9b1a066657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:04.854640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4b999-b244-409f-972c-5a9b1a066657 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:04.855139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4b999-b244-409f-972c-5a9b1a066657 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:04.856871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4b999-b244-409f-972c-5a9b1a066657 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:04.857885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4b999-b244-409f-972c-5a9b1a066657 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:04.858409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4b999-b244-409f-972c-5a9b1a066657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:04.860072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4b999-b244-409f-972c-5a9b1a066657 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:04.894385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff93947-f7e7-4b69-9d51-3d329936c665 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:04.898416 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 321/638] 10.222.0.76 () {56 vars in 1133 bytes} [Sat Aug 27 04:18:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:04.905097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4b999-b244-409f-972c-5a9b1a066657 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:04.931053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e17db-a45e-4a59-a558-f12718d22168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:04.931777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e17db-a45e-4a59-a558-f12718d22168 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:04.932127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e17db-a45e-4a59-a558-f12718d22168 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:04.932495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e17db-a45e-4a59-a558-f12718d22168 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:04.944194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e17db-a45e-4a59-a558-f12718d22168 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:04.944194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e17db-a45e-4a59-a558-f12718d22168 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:04.958417 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-018e17db-a45e-4a59-a558-f12718d22168 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 04:18:04.958417 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:04.958417 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:04.958417 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:04.958417 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:04.958417 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:04.958417 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:04.958417 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:04.958417 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:04.958417 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:04.958417 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:04.958417 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:04.958417 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:04.958417 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:04.958417 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:04.958417 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:04.959415 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:04.960484 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:04.960484 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:04.960484 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:04.960484 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:04.960484 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:04.960484 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:04.960484 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:04.960484 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:04.960484 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 27 04:18:04.960484 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:04.960484 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 318/639] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:18:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:04.964063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e17db-a45e-4a59-a558-f12718d22168 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:05.012364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:05.043688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4b999-b244-409f-972c-5a9b1a066657 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:05.082903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828b8b9-4482-46a3-a733-2e582372a78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:05.083616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828b8b9-4482-46a3-a733-2e582372a78f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:05.083897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828b8b9-4482-46a3-a733-2e582372a78f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:05.084208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828b8b9-4482-46a3-a733-2e582372a78f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:05.085261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e17db-a45e-4a59-a558-f12718d22168 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:05.115133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:05.121010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49334d04-3669-426e-82a8-e2e95d0d3b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:05.122224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334d04-3669-426e-82a8-e2e95d0d3b1c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:05.122497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334d04-3669-426e-82a8-e2e95d0d3b1c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:05.124853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334d04-3669-426e-82a8-e2e95d0d3b1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:05.133780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49334d04-3669-426e-82a8-e2e95d0d3b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:05.139673 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-49334d04-3669-426e-82a8-e2e95d0d3b1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:05.139673 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:05.139673 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:05.139673 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:05.139673 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:05.139673 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:05.139673 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:05.139673 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:05.139673 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:05.139673 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:05.139673 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:05.139673 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:05.139673 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:05.139673 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:05.139673 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:05.139673 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:05.140631 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:05.140631 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:05.140631 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:05.140631 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:05.140631 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:05.140631 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:05.140631 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:05.140631 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:05.140631 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:05.140631 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:05.140631 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:05.140631 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:05.140631 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:05.140631 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:05.140631 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:05.140631 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:05.141460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:05.141460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:05.141460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:05.141460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:05.141460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:05.141460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:05.141460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:05.141460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:05.141460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:05.141460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:05.141460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:05.141460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:05.141460 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 319/640] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:18:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:05.142844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49334d04-3669-426e-82a8-e2e95d0d3b1c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:05.161832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828b8b9-4482-46a3-a733-2e582372a78f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:05.163284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828b8b9-4482-46a3-a733-2e582372a78f None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:05.235986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:05.248119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49334d04-3669-426e-82a8-e2e95d0d3b1c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:05.271684 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 322/641] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:18:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:05.271684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828b8b9-4482-46a3-a733-2e582372a78f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:05.289129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26444d07-27fc-4d69-9cf8-e6d51a72a6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:05.289840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26444d07-27fc-4d69-9cf8-e6d51a72a6e0 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:05.290152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26444d07-27fc-4d69-9cf8-e6d51a72a6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:05.290420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26444d07-27fc-4d69-9cf8-e6d51a72a6e0 None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:05.291140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26444d07-27fc-4d69-9cf8-e6d51a72a6e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:05.291440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26444d07-27fc-4d69-9cf8-e6d51a72a6e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:05.293544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26444d07-27fc-4d69-9cf8-e6d51a72a6e0 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:05.312467 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 320/642] 10.222.0.76 () {56 vars in 1137 bytes} [Sat Aug 27 04:18:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:05.314279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26444d07-27fc-4d69-9cf8-e6d51a72a6e0 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:05.335947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:05.381378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828b8b9-4482-46a3-a733-2e582372a78f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:05.418901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30a279-0364-4775-a7a6-ea777fdd1f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:05.419537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30a279-0364-4775-a7a6-ea777fdd1f53 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:05.419814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30a279-0364-4775-a7a6-ea777fdd1f53 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:05.420088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30a279-0364-4775-a7a6-ea777fdd1f53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:05.422761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26444d07-27fc-4d69-9cf8-e6d51a72a6e0 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:05.431344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30a279-0364-4775-a7a6-ea777fdd1f53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:05.437845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-1f30a279-0364-4775-a7a6-ea777fdd1f53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:05.437845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:05.437845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:05.437845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:05.437845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:05.437845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:05.437845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:05.437845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:05.437845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:05.437845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:05.437845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:05.437845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:05.437845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:05.437845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:05.437845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:05.437845 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:05.438864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:05.438864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:05.438864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:05.438864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:05.438864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:05.438864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:05.438864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:05.438864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:05.438864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:05.438864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:05.438864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:05.438864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:05.438864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:05.438864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:05.438864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:05.438864 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:05.444974 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:05.444974 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:05.444974 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:05.444974 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:05.444974 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:05.444974 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:05.444974 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:05.444974 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:05.444974 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:05.444974 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:05.444974 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:05.444974 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:05.444974 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 323/643] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:18:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:05.444974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30a279-0364-4775-a7a6-ea777fdd1f53 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:05.458474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668b284-3434-4d06-8fa3-148917bec502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:05.459079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668b284-3434-4d06-8fa3-148917bec502 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:05.459356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668b284-3434-4d06-8fa3-148917bec502 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:05.459625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668b284-3434-4d06-8fa3-148917bec502 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:05.460467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668b284-3434-4d06-8fa3-148917bec502 None admin] RBAC: Adding query filter params (name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:05.460887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668b284-3434-4d06-8fa3-148917bec502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:05.462130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668b284-3434-4d06-8fa3-148917bec502 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:05.470539 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 321/644] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:18:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:05.471413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668b284-3434-4d06-8fa3-148917bec502 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:05.488690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:05.556198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30a279-0364-4775-a7a6-ea777fdd1f53 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:05.580345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:05.580685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668b284-3434-4d06-8fa3-148917bec502 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:05.595015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df8d73-6e09-4ab7-bcba-2d9517392f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:05.595641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df8d73-6e09-4ab7-bcba-2d9517392f05 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:05.595912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df8d73-6e09-4ab7-bcba-2d9517392f05 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:05.596208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df8d73-6e09-4ab7-bcba-2d9517392f05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:05.606433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df8d73-6e09-4ab7-bcba-2d9517392f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:05.607834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df8d73-6e09-4ab7-bcba-2d9517392f05 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:05.621442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce213cb-2ecb-43b5-b249-c52acdfe9637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:05.622289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce213cb-2ecb-43b5-b249-c52acdfe9637 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:05.622552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce213cb-2ecb-43b5-b249-c52acdfe9637 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:05.623030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce213cb-2ecb-43b5-b249-c52acdfe9637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:05.624639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-d9df8d73-6e09-4ab7-bcba-2d9517392f05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:05.624639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:05.624639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:05.624639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:05.624639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:05.624639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:05.624639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:05.624639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:05.624639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:05.624639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:05.624639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:05.624639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:05.624639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:05.624639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:05.624639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:05.624639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:05.625583 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:05.625583 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:05.625583 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:05.625583 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:05.625583 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:05.625583 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:05.625583 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:05.625583 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:05.625583 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:05.625583 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:05.625583 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:05.625583 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:05.625583 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:05.625583 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:05.625583 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:05.625583 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:05.625583 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:05.626643 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:05.626643 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:05.626643 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:05.630344 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 324/645] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:05.631173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df8d73-6e09-4ab7-bcba-2d9517392f05 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:05.699708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce213cb-2ecb-43b5-b249-c52acdfe9637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:05.701228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce213cb-2ecb-43b5-b249-c52acdfe9637 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:05.715031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:05.743036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df8d73-6e09-4ab7-bcba-2d9517392f05 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:05.783301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f301d6-14d7-4450-a5a2-4f93f20588bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:05.783906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f301d6-14d7-4450-a5a2-4f93f20588bc None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:05.784211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f301d6-14d7-4450-a5a2-4f93f20588bc None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:05.784517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f301d6-14d7-4450-a5a2-4f93f20588bc None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:05.785149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f301d6-14d7-4450-a5a2-4f93f20588bc None admin] RBAC: Adding query filter params (name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:05.785648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f301d6-14d7-4450-a5a2-4f93f20588bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:05.786812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f301d6-14d7-4450-a5a2-4f93f20588bc None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:05.800387 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 325/646] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:18:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:05.801228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f301d6-14d7-4450-a5a2-4f93f20588bc None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:05.805342 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 322/647] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:18:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:05.806164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce213cb-2ecb-43b5-b249-c52acdfe9637 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:05.839580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:05.907761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f301d6-14d7-4450-a5a2-4f93f20588bc None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:05.917025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce213cb-2ecb-43b5-b249-c52acdfe9637 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:05.938005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:05.951009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b3b93-a83e-4efa-82b0-278d901379f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:05.951236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b3b93-a83e-4efa-82b0-278d901379f0 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:05.952035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b3b93-a83e-4efa-82b0-278d901379f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:05.952035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b3b93-a83e-4efa-82b0-278d901379f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:05.966662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335593f-47fb-48ab-9b5e-170805a688e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:05.967284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335593f-47fb-48ab-9b5e-170805a688e9 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:05.967468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b3b93-a83e-4efa-82b0-278d901379f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:05.967570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335593f-47fb-48ab-9b5e-170805a688e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:05.967821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335593f-47fb-48ab-9b5e-170805a688e9 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:05.968499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335593f-47fb-48ab-9b5e-170805a688e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:05.968804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335593f-47fb-48ab-9b5e-170805a688e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:05.969860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b3b93-a83e-4efa-82b0-278d901379f0 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:05.970150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335593f-47fb-48ab-9b5e-170805a688e9 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:05.984268 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 323/648] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:05.985084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335593f-47fb-48ab-9b5e-170805a688e9 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:05.990237 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-ac5b3b93-a83e-4efa-82b0-278d901379f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:05.990237 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:05.990237 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:05.990237 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:05.990237 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:05.990237 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:05.990237 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:05.990237 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:05.990237 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:05.990237 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:05.990237 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:05.990237 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:05.990237 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:05.990237 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:05.990237 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:05.990237 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:05.991164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:05.991164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:05.991164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:05.991164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:05.991164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:05.991164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:05.991164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:05.991164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:05.991164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:05.991164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:05.991164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:05.991164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:05.991164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:05.991164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:05.991164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:05.991164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:05.991164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:05.992200 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:05.992200 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:05.992200 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:05.996040 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 326/649] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:05.997440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b3b93-a83e-4efa-82b0-278d901379f0 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:06.084635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:06.098039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335593f-47fb-48ab-9b5e-170805a688e9 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:06.101101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b3b93-a83e-4efa-82b0-278d901379f0 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:06.134620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49c08f-b496-4675-b4a1-e39abc6922fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:06.135245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49c08f-b496-4675-b4a1-e39abc6922fd None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:06.135523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49c08f-b496-4675-b4a1-e39abc6922fd None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:06.135796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49c08f-b496-4675-b4a1-e39abc6922fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:06.139612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a431ce9-1b7c-46a6-8cad-787ab83c7228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:06.140290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a431ce9-1b7c-46a6-8cad-787ab83c7228 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:06.140548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a431ce9-1b7c-46a6-8cad-787ab83c7228 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:06.140792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a431ce9-1b7c-46a6-8cad-787ab83c7228 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:06.147543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49c08f-b496-4675-b4a1-e39abc6922fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:06.149026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49c08f-b496-4675-b4a1-e39abc6922fd None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:06.151713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a431ce9-1b7c-46a6-8cad-787ab83c7228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:06.153729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a431ce9-1b7c-46a6-8cad-787ab83c7228 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:06.164638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-cc49c08f-b496-4675-b4a1-e39abc6922fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:06.164638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:06.164638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:06.164638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:06.164638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:06.164638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:06.164638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:06.164638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:06.164638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:06.164638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:06.164638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:06.164638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:06.164638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:06.164638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:06.164638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:06.164638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:06.165603 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:06.165603 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:06.165603 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:06.165603 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:06.165603 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:06.165603 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:06.165603 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:06.165603 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:06.165603 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:06.165603 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:06.165603 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:06.165603 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:06.165603 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:06.165603 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:06.165603 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:06.165603 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:06.165603 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:06.172296 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:06.172296 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:06.172296 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:06.172296 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 324/650] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:06.172296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49c08f-b496-4675-b4a1-e39abc6922fd None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:06.172595 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-9a431ce9-1b7c-46a6-8cad-787ab83c7228 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:06.172595 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:06.172595 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:06.172595 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:06.172595 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:06.172595 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:06.172595 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:06.172595 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:06.172595 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:06.172595 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:06.172595 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:06.172595 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:06.172595 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:06.172595 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:06.172595 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:06.172595 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:06.173453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:06.173453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:06.173453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:06.173453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:06.173453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:06.173453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:06.173453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:06.173453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:06.173453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:06.173453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:06.173453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:06.173453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:06.173453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:06.173453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:06.173453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:06.173453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:06.173453 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:06.174366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:06.174366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:06.174366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:06.174366 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 327/651] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:06.174366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a431ce9-1b7c-46a6-8cad-787ab83c7228 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:06.201446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:06.284298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49c08f-b496-4675-b4a1-e39abc6922fd None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:06.296089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a431ce9-1b7c-46a6-8cad-787ab83c7228 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:06.321022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2102c-e3bb-45f1-afd9-334730fed654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:06.321962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2102c-e3bb-45f1-afd9-334730fed654 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:06.322252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2102c-e3bb-45f1-afd9-334730fed654 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:06.322513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2102c-e3bb-45f1-afd9-334730fed654 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:06.329605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2102c-e3bb-45f1-afd9-334730fed654 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:06.331053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2102c-e3bb-45f1-afd9-334730fed654 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:06.334592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66775bf-8b9c-47e8-a59f-80f0c27a08e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:06.335202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66775bf-8b9c-47e8-a59f-80f0c27a08e0 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:06.335482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66775bf-8b9c-47e8-a59f-80f0c27a08e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:06.335757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66775bf-8b9c-47e8-a59f-80f0c27a08e0 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:06.336445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66775bf-8b9c-47e8-a59f-80f0c27a08e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:06.336977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66775bf-8b9c-47e8-a59f-80f0c27a08e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:06.338422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66775bf-8b9c-47e8-a59f-80f0c27a08e0 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:06.343645 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-39d2102c-e3bb-45f1-afd9-334730fed654 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:06.343645 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:06.343645 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:06.343645 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:06.343645 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:06.343645 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:06.343645 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:06.343645 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:06.343645 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:06.343645 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:06.343645 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:06.343645 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:06.343645 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:06.343645 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:06.343645 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:06.344580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:06.344580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:06.344580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:06.344580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:06.344580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:06.344580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:06.344580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:06.344580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:06.344580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:06.344580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:06.344580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:06.344580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:06.344580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:06.344580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:06.344580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:06.344580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:06.344580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:06.351124 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:06.351124 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:06.351124 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:06.351124 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:06.351124 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:06.351124 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:06.351124 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:06.351124 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:06.351124 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 325/652] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:06.351124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2102c-e3bb-45f1-afd9-334730fed654 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:06.351676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:06.356690 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 328/653] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:06.361489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66775bf-8b9c-47e8-a59f-80f0c27a08e0 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:06.441983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:06.461868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2102c-e3bb-45f1-afd9-334730fed654 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:06.482544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66775bf-8b9c-47e8-a59f-80f0c27a08e0 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:06.499808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2aeb4-5fc4-40f8-858d-4dcab031d8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:06.500452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2aeb4-5fc4-40f8-858d-4dcab031d8b9 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:06.500731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2aeb4-5fc4-40f8-858d-4dcab031d8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:06.500998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2aeb4-5fc4-40f8-858d-4dcab031d8b9 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:06.501644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2aeb4-5fc4-40f8-858d-4dcab031d8b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:06.501943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2aeb4-5fc4-40f8-858d-4dcab031d8b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:06.503396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2aeb4-5fc4-40f8-858d-4dcab031d8b9 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:06.516466 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 326/654] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:06.517295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2aeb4-5fc4-40f8-858d-4dcab031d8b9 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:06.523944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac333c02-e83c-4a45-b558-fc02197702ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:06.524606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac333c02-e83c-4a45-b558-fc02197702ac None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:06.524890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac333c02-e83c-4a45-b558-fc02197702ac None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:06.531762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac333c02-e83c-4a45-b558-fc02197702ac None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:06.531762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac333c02-e83c-4a45-b558-fc02197702ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:06.531762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac333c02-e83c-4a45-b558-fc02197702ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:06.531762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac333c02-e83c-4a45-b558-fc02197702ac None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:06.540501 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 329/655] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:06.541044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac333c02-e83c-4a45-b558-fc02197702ac None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:06.600099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:06.623932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2aeb4-5fc4-40f8-858d-4dcab031d8b9 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:06.643563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac333c02-e83c-4a45-b558-fc02197702ac None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:06.660832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175fa4e-faeb-49f7-923a-4a1102b4a1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:06.661437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175fa4e-faeb-49f7-923a-4a1102b4a1dd None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:06.661718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175fa4e-faeb-49f7-923a-4a1102b4a1dd None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:06.661991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175fa4e-faeb-49f7-923a-4a1102b4a1dd None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:06.662682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175fa4e-faeb-49f7-923a-4a1102b4a1dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:06.662986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175fa4e-faeb-49f7-923a-4a1102b4a1dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:06.664438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175fa4e-faeb-49f7-923a-4a1102b4a1dd None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:06.676582 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 327/656] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:06.677832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc3afc-309d-43bb-a435-967297a9d607 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:06.678116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc3afc-309d-43bb-a435-967297a9d607 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:06.678390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc3afc-309d-43bb-a435-967297a9d607 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:06.678487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b3423-4612-4e37-89b4-a3c7d3ab2d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:06.679389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b3423-4612-4e37-89b4-a3c7d3ab2d6c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:06.683964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b3423-4612-4e37-89b4-a3c7d3ab2d6c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:06.684098 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 328/657] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:06.684211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b3423-4612-4e37-89b4-a3c7d3ab2d6c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:06.684293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc3afc-309d-43bb-a435-967297a9d607 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:06.687346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:06.691644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b3423-4612-4e37-89b4-a3c7d3ab2d6c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:06.693136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b3423-4612-4e37-89b4-a3c7d3ab2d6c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:06.704896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-008b3423-4612-4e37-89b4-a3c7d3ab2d6c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 04:18:06.704896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:06.704896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:06.704896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:06.704896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:06.704896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:06.704896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:06.704896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:06.704896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:06.704896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:06.704896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:06.704896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:06.704896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:06.704896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:06.704896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:06.704896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:06.706043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:06.711822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:06.711822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:06.711822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:06.711822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:06.711822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:06.711822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:06.711822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:06.711822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:06.711822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 04:18:06.711822 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:06.711822 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 330/658] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:18:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:06.711822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b3423-4612-4e37-89b4-a3c7d3ab2d6c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:06.794608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc3afc-309d-43bb-a435-967297a9d607 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:06.807874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b3423-4612-4e37-89b4-a3c7d3ab2d6c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:06.825727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:06.828713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c3a53-ee1c-469f-8089-30f2ce3a3db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:06.829339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3a53-ee1c-469f-8089-30f2ce3a3db0 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:06.829616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3a53-ee1c-469f-8089-30f2ce3a3db0 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:06.829885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3a53-ee1c-469f-8089-30f2ce3a3db0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:06.838152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c3a53-ee1c-469f-8089-30f2ce3a3db0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:06.839618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c3a53-ee1c-469f-8089-30f2ce3a3db0 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:06.842109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588a719-8874-4e8b-a5e9-74605ef57d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:06.842731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588a719-8874-4e8b-a5e9-74605ef57d4d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:06.843011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588a719-8874-4e8b-a5e9-74605ef57d4d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:06.843281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588a719-8874-4e8b-a5e9-74605ef57d4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:06.849904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588a719-8874-4e8b-a5e9-74605ef57d4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:06.850718 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-3a5c3a53-ee1c-469f-8089-30f2ce3a3db0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 04:18:06.850718 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:06.850718 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:06.850718 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:06.850718 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:06.850718 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:06.850718 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:06.850718 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:06.850718 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:06.850718 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:06.850718 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:06.850718 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:06.850718 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:06.850718 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:06.850718 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:06.850718 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:06.851796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:06.853374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:06.853374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:06.853374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:06.853374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:06.853374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:06.853374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:06.853374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:06.853374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:06.853374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 04:18:06.853374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:06.853937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588a719-8874-4e8b-a5e9-74605ef57d4d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:06.854016 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 329/659] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:18:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:06.854016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c3a53-ee1c-469f-8089-30f2ce3a3db0 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:06.877121 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-e588a719-8874-4e8b-a5e9-74605ef57d4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:06.877121 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:06.877121 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:06.877121 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:06.877121 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:06.877121 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:06.877121 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:06.877121 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:06.877121 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:06.877121 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:06.877121 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:06.877121 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:06.877121 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:06.877121 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:06.877121 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:06.878234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:06.878234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:06.878234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:06.878234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:06.878234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:06.878234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:06.878234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:06.878234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:06.878234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:06.878234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:06.878234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:06.878234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:06.878234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:06.878234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:06.878234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:06.878234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:06.878234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:06.879150 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:06.879150 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:06.879150 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:06.879150 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:06.879150 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:06.879150 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:06.879150 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:06.879150 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:06.879767 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 331/660] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:06.881378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc24f-eeb5-4eb7-88fb-106495484559 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:06.881667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc24f-eeb5-4eb7-88fb-106495484559 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:06.881942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc24f-eeb5-4eb7-88fb-106495484559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:06.901419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d83dc24f-eeb5-4eb7-88fb-106495484559 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:06.902815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d83dc24f-eeb5-4eb7-88fb-106495484559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:06.926003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:06.966351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c3a53-ee1c-469f-8089-30f2ce3a3db0 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:06.973120 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 332/661] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:18:06.973976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dc24f-eeb5-4eb7-88fb-106495484559 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:07.004692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae8197-40bd-498f-af0f-4c1dd7ab0d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:07.005771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae8197-40bd-498f-af0f-4c1dd7ab0d7c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:07.006348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae8197-40bd-498f-af0f-4c1dd7ab0d7c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:07.006823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae8197-40bd-498f-af0f-4c1dd7ab0d7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:07.007744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae8197-40bd-498f-af0f-4c1dd7ab0d7c None admin] RBAC: Adding query filter params (role.id=127770d936b94a5da885e721233e7f7b, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=0e5ddcf00a184aa0ac0e7194f1c72425) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:07.008387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae8197-40bd-498f-af0f-4c1dd7ab0d7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:07.010292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae8197-40bd-498f-af0f-4c1dd7ab0d7c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:07.017880 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 330/662] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:18:06 2022] GET /identity/v3/role_assignments?user.id=0e5ddcf00a184aa0ac0e7194f1c72425&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=127770d936b94a5da885e721233e7f7b => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:07.018683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae8197-40bd-498f-af0f-4c1dd7ab0d7c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:07.097683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dc24f-eeb5-4eb7-88fb-106495484559 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:07.109431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:07.139964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d55684-0e26-42c3-9619-0a97a646877d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:07.140682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d55684-0e26-42c3-9619-0a97a646877d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:07.141147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d55684-0e26-42c3-9619-0a97a646877d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:07.141524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d55684-0e26-42c3-9619-0a97a646877d None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:07.142145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae8197-40bd-498f-af0f-4c1dd7ab0d7c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:07.142501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d55684-0e26-42c3-9619-0a97a646877d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:07.142910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d55684-0e26-42c3-9619-0a97a646877d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:07.144648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d55684-0e26-42c3-9619-0a97a646877d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:07.169565 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 333/663] 10.222.0.76 () {56 vars in 1137 bytes} [Sat Aug 27 04:18:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:07.169565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d55684-0e26-42c3-9619-0a97a646877d None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:07.178727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:07.188576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d62543-6f25-4786-b512-1bd7a0e6d71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:07.189480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d62543-6f25-4786-b512-1bd7a0e6d71a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:07.189932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d62543-6f25-4786-b512-1bd7a0e6d71a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:07.190375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d62543-6f25-4786-b512-1bd7a0e6d71a None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:07.191713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d62543-6f25-4786-b512-1bd7a0e6d71a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:07.192263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d62543-6f25-4786-b512-1bd7a0e6d71a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:07.193874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d62543-6f25-4786-b512-1bd7a0e6d71a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:07.214661 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 331/664] 10.222.0.76 () {56 vars in 1139 bytes} [Sat Aug 27 04:18:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:07.216428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d62543-6f25-4786-b512-1bd7a0e6d71a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:07.292585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d55684-0e26-42c3-9619-0a97a646877d None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:07.332403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf815c-d9a7-465c-98e8-736716c70e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:07.333006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf815c-d9a7-465c-98e8-736716c70e30 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:07.333285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf815c-d9a7-465c-98e8-736716c70e30 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:07.333557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf815c-d9a7-465c-98e8-736716c70e30 None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:07.334248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf815c-d9a7-465c-98e8-736716c70e30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:07.334553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf815c-d9a7-465c-98e8-736716c70e30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:07.335984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf815c-d9a7-465c-98e8-736716c70e30 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:07.336543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d62543-6f25-4786-b512-1bd7a0e6d71a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:07.351172 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 334/665] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:07.352011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf815c-d9a7-465c-98e8-736716c70e30 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:07.383316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:07.384946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9f979-8400-4c92-90de-0df4254f9c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:07.385563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9f979-8400-4c92-90de-0df4254f9c3b None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:07.386096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9f979-8400-4c92-90de-0df4254f9c3b None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:07.386378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9f979-8400-4c92-90de-0df4254f9c3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:07.446389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:07.459889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf815c-d9a7-465c-98e8-736716c70e30 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:07.462212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9f979-8400-4c92-90de-0df4254f9c3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:07.463869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9f979-8400-4c92-90de-0df4254f9c3b None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:07.495197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408d9b7-d4c2-4802-882a-a22cd84d1881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:07.495826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408d9b7-d4c2-4802-882a-a22cd84d1881 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:07.496303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408d9b7-d4c2-4802-882a-a22cd84d1881 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:07.496823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408d9b7-d4c2-4802-882a-a22cd84d1881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:07.567014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408d9b7-d4c2-4802-882a-a22cd84d1881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:07.568507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408d9b7-d4c2-4802-882a-a22cd84d1881 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:07.571387 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 332/666] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:18:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:07.572439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9f979-8400-4c92-90de-0df4254f9c3b None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:07.604860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:07.672996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:07.686995 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 335/667] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:18:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:07.686995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408d9b7-d4c2-4802-882a-a22cd84d1881 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:07.694385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9f979-8400-4c92-90de-0df4254f9c3b None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:07.732772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1ca6a-fea3-4b3f-b7ca-691e2285d3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:07.733401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ca6a-fea3-4b3f-b7ca-691e2285d3bf None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:07.733682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ca6a-fea3-4b3f-b7ca-691e2285d3bf None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:07.733953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ca6a-fea3-4b3f-b7ca-691e2285d3bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:07.744854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1ca6a-fea3-4b3f-b7ca-691e2285d3bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:07.749819 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-39c1ca6a-fea3-4b3f-b7ca-691e2285d3bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:07.749819 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:07.749819 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:07.749819 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:07.749819 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:07.749819 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:07.749819 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:07.749819 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:07.749819 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:07.749819 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:07.749819 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:07.749819 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:07.749819 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:07.749819 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:07.749819 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:07.749819 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:07.750955 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:07.750955 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:07.750955 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:07.750955 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:07.750955 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:07.750955 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:07.750955 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:07.750955 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:07.750955 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:07.750955 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:07.750955 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:07.750955 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:07.750955 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:07.750955 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:07.750955 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:07.750955 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:07.751806 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:07.751806 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:07.751806 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:07.751806 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:07.751806 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:07.751806 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:07.751806 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:07.751806 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:07.751806 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:07.751806 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:07.751806 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:07.751806 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:07.751806 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 333/668] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:18:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:07.752528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1ca6a-fea3-4b3f-b7ca-691e2285d3bf None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:07.790830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408d9b7-d4c2-4802-882a-a22cd84d1881 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:07.822837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:07.836481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545fd54-14fd-4b7b-92e7-a8ddaee66242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:07.856549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545fd54-14fd-4b7b-92e7-a8ddaee66242 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:07.856549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545fd54-14fd-4b7b-92e7-a8ddaee66242 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:07.856549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545fd54-14fd-4b7b-92e7-a8ddaee66242 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:07.856549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545fd54-14fd-4b7b-92e7-a8ddaee66242 None admin] RBAC: Adding query filter params (role.id=127770d936b94a5da885e721233e7f7b, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=f9cd48a297bf498e88ce722f74154354) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:07.856549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545fd54-14fd-4b7b-92e7-a8ddaee66242 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:07.856549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545fd54-14fd-4b7b-92e7-a8ddaee66242 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:07.857153 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 336/669] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:18:07 2022] GET /identity/v3/role_assignments?user.id=f9cd48a297bf498e88ce722f74154354&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=127770d936b94a5da885e721233e7f7b => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:07.857153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545fd54-14fd-4b7b-92e7-a8ddaee66242 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:07.875796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1ca6a-fea3-4b3f-b7ca-691e2285d3bf None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:07.915688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91276d-8df3-4884-aba1-0616c415bd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:07.916659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91276d-8df3-4884-aba1-0616c415bd28 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:07.916952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91276d-8df3-4884-aba1-0616c415bd28 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:07.917228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91276d-8df3-4884-aba1-0616c415bd28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:07.933231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91276d-8df3-4884-aba1-0616c415bd28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:07.937556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91276d-8df3-4884-aba1-0616c415bd28 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:07.952590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:07.968995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-0d91276d-8df3-4884-aba1-0616c415bd28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:07.968995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:07.968995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:07.968995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:07.968995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:07.968995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:07.968995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:07.968995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:07.968995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:07.968995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:07.968995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:07.968995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:07.968995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:07.968995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:07.968995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:07.968995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:07.970330 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:07.970330 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:07.970330 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:07.970330 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:07.970330 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:07.970330 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:07.970330 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:07.970330 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:07.970330 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:07.970330 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:07.970330 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:07.970330 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:07.970330 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:07.970330 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:07.970330 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:07.970330 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:07.970330 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:07.972066 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:07.972066 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:07.972066 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:07.975615 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 334/670] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:07.976965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91276d-8df3-4884-aba1-0616c415bd28 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:07.990010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545fd54-14fd-4b7b-92e7-a8ddaee66242 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:08.027214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725187f8-6e6b-4137-8ba6-d1a3d1b84bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:08.028493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725187f8-6e6b-4137-8ba6-d1a3d1b84bdc None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:08.028768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725187f8-6e6b-4137-8ba6-d1a3d1b84bdc None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:08.029037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725187f8-6e6b-4137-8ba6-d1a3d1b84bdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:08.040601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725187f8-6e6b-4137-8ba6-d1a3d1b84bdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:08.042046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725187f8-6e6b-4137-8ba6-d1a3d1b84bdc None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:08.056753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-725187f8-6e6b-4137-8ba6-d1a3d1b84bdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:08.056753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:08.056753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:08.056753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:08.056753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:08.056753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:08.056753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:08.056753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:08.056753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:08.056753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:08.056753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:08.056753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:08.056753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:08.056753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:08.056753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:08.056753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:08.057919 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:08.057919 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:08.057919 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:08.057919 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:08.057919 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:08.057919 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:08.057919 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:08.057919 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:08.057919 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:08.057919 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:08.057919 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:08.057919 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:08.057919 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:08.057919 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:08.057919 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:08.057919 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:08.057919 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:08.058896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:08.058896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:08.058896 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:08.058896 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 337/671] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:08.058896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725187f8-6e6b-4137-8ba6-d1a3d1b84bdc None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:08.118161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91276d-8df3-4884-aba1-0616c415bd28 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:08.158960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971c7cd-c5ad-48ad-9c71-2b4d94dee493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:08.160359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971c7cd-c5ad-48ad-9c71-2b4d94dee493 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:08.160830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971c7cd-c5ad-48ad-9c71-2b4d94dee493 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:08.161597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971c7cd-c5ad-48ad-9c71-2b4d94dee493 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:08.162751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971c7cd-c5ad-48ad-9c71-2b4d94dee493 None admin] RBAC: Adding query filter params (name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:08.163244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971c7cd-c5ad-48ad-9c71-2b4d94dee493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:08.165830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971c7cd-c5ad-48ad-9c71-2b4d94dee493 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:08.167185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:08.181183 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 335/672] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:18:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:08.182239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971c7cd-c5ad-48ad-9c71-2b4d94dee493 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:08.195096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725187f8-6e6b-4137-8ba6-d1a3d1b84bdc None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:08.234996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98f841-56ac-4a78-afcd-0121a7fb3ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:08.235719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98f841-56ac-4a78-afcd-0121a7fb3ac6 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:08.236389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98f841-56ac-4a78-afcd-0121a7fb3ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:08.236733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98f841-56ac-4a78-afcd-0121a7fb3ac6 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:08.237514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98f841-56ac-4a78-afcd-0121a7fb3ac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:08.237893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98f841-56ac-4a78-afcd-0121a7fb3ac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:08.239907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98f841-56ac-4a78-afcd-0121a7fb3ac6 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:08.253326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:08.256106 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 338/673] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:08.257020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98f841-56ac-4a78-afcd-0121a7fb3ac6 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:08.301147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971c7cd-c5ad-48ad-9c71-2b4d94dee493 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:08.337511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab57550-82b7-4ae5-a157-772c86774616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:08.338124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab57550-82b7-4ae5-a157-772c86774616 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:08.338401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab57550-82b7-4ae5-a157-772c86774616 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:08.338669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab57550-82b7-4ae5-a157-772c86774616 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:08.340122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab57550-82b7-4ae5-a157-772c86774616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:08.340608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab57550-82b7-4ae5-a157-772c86774616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:08.341973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab57550-82b7-4ae5-a157-772c86774616 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:08.354685 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 336/674] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:08.356245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab57550-82b7-4ae5-a157-772c86774616 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:08.365320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98f841-56ac-4a78-afcd-0121a7fb3ac6 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:08.368767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:08.400783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c5b6b-61a3-424f-9d8f-62f0e013a04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:08.401803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c5b6b-61a3-424f-9d8f-62f0e013a04e None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:08.402987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c5b6b-61a3-424f-9d8f-62f0e013a04e None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:08.403660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c5b6b-61a3-424f-9d8f-62f0e013a04e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:08.414534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c5b6b-61a3-424f-9d8f-62f0e013a04e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:08.416332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c5b6b-61a3-424f-9d8f-62f0e013a04e None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:08.435909 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-333c5b6b-61a3-424f-9d8f-62f0e013a04e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:08.435909 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:08.435909 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:08.435909 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:08.435909 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:08.435909 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:08.435909 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:08.435909 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:08.435909 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:08.435909 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:08.435909 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:08.435909 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:08.435909 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:08.435909 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:08.435909 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:08.435909 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:08.436964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:08.436964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:08.436964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:08.436964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:08.436964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:08.436964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:08.436964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:08.436964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:08.436964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:08.436964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:08.436964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:08.436964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:08.436964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:08.436964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:08.436964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:08.436964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:08.436964 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:08.437857 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:08.437857 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:08.437857 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:08.440095 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 339/675] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:08.441498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c5b6b-61a3-424f-9d8f-62f0e013a04e None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:08.466602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab57550-82b7-4ae5-a157-772c86774616 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:08.486661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:08.502474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056094bd-f577-4953-8caf-79ae43ffdfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:08.503217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056094bd-f577-4953-8caf-79ae43ffdfc6 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:08.503549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056094bd-f577-4953-8caf-79ae43ffdfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:08.503769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056094bd-f577-4953-8caf-79ae43ffdfc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:08.511529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056094bd-f577-4953-8caf-79ae43ffdfc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:08.513551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056094bd-f577-4953-8caf-79ae43ffdfc6 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:08.528081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-056094bd-f577-4953-8caf-79ae43ffdfc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:08.528081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:08.528081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:08.528081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:08.528081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:08.528081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:08.528081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:08.528081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:08.528081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:08.528081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:08.528081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:08.528081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:08.528081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:08.528081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:08.528081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:08.530851 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:08.530851 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:08.530851 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:08.530851 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:08.530851 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:08.530851 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:08.530851 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:08.530851 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:08.530851 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:08.530851 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:08.530851 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:08.530851 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:08.530851 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:08.530851 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:08.530851 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:08.530851 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:08.530851 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:08.531855 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:08.531855 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:08.531855 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:08.531855 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:08.531855 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:08.531855 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:08.531855 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:08.531855 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:08.531855 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 337/676] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:08.531855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056094bd-f577-4953-8caf-79ae43ffdfc6 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:08.569740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c5b6b-61a3-424f-9d8f-62f0e013a04e None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:08.617142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2008c3-417a-4b62-89fc-027310b4d831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:08.618214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2008c3-417a-4b62-89fc-027310b4d831 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:08.618840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2008c3-417a-4b62-89fc-027310b4d831 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:08.619213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2008c3-417a-4b62-89fc-027310b4d831 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:08.629040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2008c3-417a-4b62-89fc-027310b4d831 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:08.630968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2008c3-417a-4b62-89fc-027310b4d831 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:08.642271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056094bd-f577-4953-8caf-79ae43ffdfc6 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:08.646898 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-ea2008c3-417a-4b62-89fc-027310b4d831 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:08.646898 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:08.646898 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:08.646898 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:08.646898 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:08.646898 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:08.646898 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:08.646898 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:08.646898 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:08.646898 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:08.646898 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:08.646898 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:08.646898 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:08.646898 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:08.646898 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:08.647957 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:08.647957 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:08.647957 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:08.647957 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:08.647957 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:08.647957 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:08.647957 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:08.647957 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:08.647957 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:08.647957 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:08.647957 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:08.647957 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:08.647957 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:08.647957 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:08.647957 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:08.647957 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:08.647957 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:08.649077 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:08.649077 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:08.649077 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:08.649077 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:08.649077 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:08.649077 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:08.649077 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:08.649077 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:08.656186 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 340/677] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:08.656186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2008c3-417a-4b62-89fc-027310b4d831 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:08.673791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:08.680638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42430e-79b8-4e0d-ba96-6ca30c879238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:08.681498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42430e-79b8-4e0d-ba96-6ca30c879238 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:08.682078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42430e-79b8-4e0d-ba96-6ca30c879238 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:08.682506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42430e-79b8-4e0d-ba96-6ca30c879238 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:08.683331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42430e-79b8-4e0d-ba96-6ca30c879238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:08.684325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42430e-79b8-4e0d-ba96-6ca30c879238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:08.689991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42430e-79b8-4e0d-ba96-6ca30c879238 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:08.699039 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 338/678] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:08.700136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42430e-79b8-4e0d-ba96-6ca30c879238 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:08.747164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:08.793946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2008c3-417a-4b62-89fc-027310b4d831 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:08.810709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42430e-79b8-4e0d-ba96-6ca30c879238 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:08.841521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc81f9-6dbc-470e-b84f-24f7eca0f0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:08.842346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc81f9-6dbc-470e-b84f-24f7eca0f0e3 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:08.842725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc81f9-6dbc-470e-b84f-24f7eca0f0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:08.843119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc81f9-6dbc-470e-b84f-24f7eca0f0e3 None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:08.844556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc81f9-6dbc-470e-b84f-24f7eca0f0e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:08.844974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc81f9-6dbc-470e-b84f-24f7eca0f0e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:08.846793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc81f9-6dbc-470e-b84f-24f7eca0f0e3 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:08.849505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358c38e-077c-4eed-8ea9-9dd47a243522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:08.850325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358c38e-077c-4eed-8ea9-9dd47a243522 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:08.850787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358c38e-077c-4eed-8ea9-9dd47a243522 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:08.851241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358c38e-077c-4eed-8ea9-9dd47a243522 None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:08.852097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358c38e-077c-4eed-8ea9-9dd47a243522 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:08.852631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358c38e-077c-4eed-8ea9-9dd47a243522 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:08.854235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358c38e-077c-4eed-8ea9-9dd47a243522 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:08.861796 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 341/679] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:08.862770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc81f9-6dbc-470e-b84f-24f7eca0f0e3 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:08.873208 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 339/680] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:08.875253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358c38e-077c-4eed-8ea9-9dd47a243522 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:08.953864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:08.979983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc81f9-6dbc-470e-b84f-24f7eca0f0e3 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:08.994301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:08.998575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358c38e-077c-4eed-8ea9-9dd47a243522 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:09.017374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777fec9-d58c-49b3-ab14-873d40327342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:09.018424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777fec9-d58c-49b3-ab14-873d40327342 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:09.019343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777fec9-d58c-49b3-ab14-873d40327342 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:09.019715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777fec9-d58c-49b3-ab14-873d40327342 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:09.027818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777fec9-d58c-49b3-ab14-873d40327342 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:09.029621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777fec9-d58c-49b3-ab14-873d40327342 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:09.037716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c99ad-e227-4653-b23d-7e82f3f80e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:09.038538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c99ad-e227-4653-b23d-7e82f3f80e6a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:09.038986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c99ad-e227-4653-b23d-7e82f3f80e6a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:09.039407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c99ad-e227-4653-b23d-7e82f3f80e6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:09.040319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c99ad-e227-4653-b23d-7e82f3f80e6a None admin] RBAC: Adding query filter params (role.id=127770d936b94a5da885e721233e7f7b, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=dfcccc451b4b443f9b2428cc207211ad) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:09.040788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c99ad-e227-4653-b23d-7e82f3f80e6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:09.042154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-9777fec9-d58c-49b3-ab14-873d40327342 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:18:09.042154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:09.042154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:09.042154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:09.042154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:09.042154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:09.042154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:09.042154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:09.042154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:09.042154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:09.042154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:09.042154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:09.042154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:09.042154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:09.042154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:09.042154 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:09.044002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:09.045638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:09.045638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:09.045638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:09.045638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:09.045638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:09.045638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:09.045638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:09.045638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:09.045638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:18:09.045638 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:09.048099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c99ad-e227-4653-b23d-7e82f3f80e6a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:09.048244 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 342/681] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:18:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:09.048244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777fec9-d58c-49b3-ab14-873d40327342 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:09.068354 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 340/682] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:18:08 2022] GET /identity/v3/role_assignments?user.id=dfcccc451b4b443f9b2428cc207211ad&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=127770d936b94a5da885e721233e7f7b => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:09.069745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c99ad-e227-4653-b23d-7e82f3f80e6a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:09.200053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c99ad-e227-4653-b23d-7e82f3f80e6a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:09.222164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777fec9-d58c-49b3-ab14-873d40327342 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:09.242998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fc46b-3b49-48bc-b5e4-89c5d723e814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:09.243610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fc46b-3b49-48bc-b5e4-89c5d723e814 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:09.243892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fc46b-3b49-48bc-b5e4-89c5d723e814 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:09.244185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fc46b-3b49-48bc-b5e4-89c5d723e814 None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:09.244924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fc46b-3b49-48bc-b5e4-89c5d723e814 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:09.245274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fc46b-3b49-48bc-b5e4-89c5d723e814 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:09.247395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fc46b-3b49-48bc-b5e4-89c5d723e814 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:09.268248 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 341/683] 10.222.0.76 () {56 vars in 1135 bytes} [Sat Aug 27 04:18:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:09.269637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbbe0a-801e-4d5e-859b-045ad9879e4a None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:09.269900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbbe0a-801e-4d5e-859b-045ad9879e4a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:09.270175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbbe0a-801e-4d5e-859b-045ad9879e4a None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:09.271423 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 342/684] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:09.273117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbbe0a-801e-4d5e-859b-045ad9879e4a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:09.276504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50920c43-303a-47f0-9ee3-c4705d8f295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:09.276504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50920c43-303a-47f0-9ee3-c4705d8f295c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:09.276504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50920c43-303a-47f0-9ee3-c4705d8f295c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:09.276504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50920c43-303a-47f0-9ee3-c4705d8f295c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:09.278924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50920c43-303a-47f0-9ee3-c4705d8f295c None admin] RBAC: Adding query filter params (role.id=127770d936b94a5da885e721233e7f7b, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=0547461f91aa423381430eda35fe6b74) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:09.279243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50920c43-303a-47f0-9ee3-c4705d8f295c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:09.280742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50920c43-303a-47f0-9ee3-c4705d8f295c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:09.283902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:09.299667 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 343/685] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:18:09 2022] GET /identity/v3/role_assignments?user.id=0547461f91aa423381430eda35fe6b74&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=127770d936b94a5da885e721233e7f7b => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:09.299667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64837f1-82c5-4ede-939a-7cd33f29d570 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:09.299667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64837f1-82c5-4ede-939a-7cd33f29d570 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:09.299667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64837f1-82c5-4ede-939a-7cd33f29d570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:09.311923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:09.315380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d64837f1-82c5-4ede-939a-7cd33f29d570 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:09.317271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d64837f1-82c5-4ede-939a-7cd33f29d570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:09.408317 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 344/686] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:18:09.410326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbbe0a-801e-4d5e-859b-045ad9879e4a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:09.450383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291a48-b4d8-4480-9821-ca62c145c7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:09.451001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291a48-b4d8-4480-9821-ca62c145c7e0 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:09.451278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291a48-b4d8-4480-9821-ca62c145c7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:09.451545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291a48-b4d8-4480-9821-ca62c145c7e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:09.525459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6291a48-b4d8-4480-9821-ca62c145c7e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:09.527320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6291a48-b4d8-4480-9821-ca62c145c7e0 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:09.557461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:09.642674 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 343/687] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:18:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:09.648094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64837f1-82c5-4ede-939a-7cd33f29d570 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:09.721425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291a48-b4d8-4480-9821-ca62c145c7e0 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:09.772757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64837f1-82c5-4ede-939a-7cd33f29d570 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:09.804128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:09.814904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb043f-18cc-4796-a372-f865d24c85a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:09.815478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb043f-18cc-4796-a372-f865d24c85a3 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:09.815760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb043f-18cc-4796-a372-f865d24c85a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:09.816036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb043f-18cc-4796-a372-f865d24c85a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:09.836529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb043f-18cc-4796-a372-f865d24c85a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:09.837999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb043f-18cc-4796-a372-f865d24c85a3 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:09.862566 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-a2fb043f-18cc-4796-a372-f865d24c85a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:09.862566 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:09.862566 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:09.862566 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:09.862566 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:09.862566 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:09.862566 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:09.862566 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:09.862566 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:09.862566 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:09.862566 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:09.862566 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:09.862566 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:09.862566 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:09.862566 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:09.862566 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:09.863589 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:09.863589 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:09.863589 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:09.863589 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:09.863589 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:09.863589 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:09.863589 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:09.863589 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:09.863589 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:09.863589 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:09.863589 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:09.863589 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:09.863589 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:09.863589 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:09.863589 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:09.863589 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:09.863589 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:09.864943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:09.864943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:09.864943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:09.864943 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 345/688] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:09.868599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291a48-b4d8-4480-9821-ca62c145c7e0 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:09.872920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb043f-18cc-4796-a372-f865d24c85a3 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:09.896225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:09.912738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165de57-e7b6-479b-8137-2276c2a9d5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:09.913406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165de57-e7b6-479b-8137-2276c2a9d5c4 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:09.913705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165de57-e7b6-479b-8137-2276c2a9d5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:09.913978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165de57-e7b6-479b-8137-2276c2a9d5c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:09.944794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165de57-e7b6-479b-8137-2276c2a9d5c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:09.950891 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-8165de57-e7b6-479b-8137-2276c2a9d5c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:18:09.950891 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:09.950891 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:09.950891 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:09.950891 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:09.950891 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:09.950891 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:09.950891 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:09.950891 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:09.950891 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:09.950891 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:09.950891 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:09.950891 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:09.950891 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:09.950891 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:09.950891 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:09.951938 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:09.951938 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:09.951938 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:09.951938 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:09.951938 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:09.951938 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:09.951938 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:09.951938 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:09.951938 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:09.951938 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:09.951938 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:09.951938 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:09.951938 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:09.951938 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:09.951938 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:09.951938 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:09.953216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:09.953216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:09.953216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:09.953216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:09.953216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:09.953216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:09.953216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:09.953216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:09.953216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:09.953216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:09.953216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:18:09.953216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:09.953216 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 344/689] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:18:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:09.965865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165de57-e7b6-479b-8137-2276c2a9d5c4 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:10.023512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb043f-18cc-4796-a372-f865d24c85a3 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:10.060631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9f840-2579-48dd-8e29-dbf9a77be79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:10.061248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9f840-2579-48dd-8e29-dbf9a77be79f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:10.061530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9f840-2579-48dd-8e29-dbf9a77be79f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:10.061805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9f840-2579-48dd-8e29-dbf9a77be79f None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:10.062457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9f840-2579-48dd-8e29-dbf9a77be79f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:10.062764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9f840-2579-48dd-8e29-dbf9a77be79f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:10.064147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9f840-2579-48dd-8e29-dbf9a77be79f None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:10.077021 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 346/690] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:10.078206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b709406-448e-4cf2-897b-038b16914a99 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:10.078491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b709406-448e-4cf2-897b-038b16914a99 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:10.078761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b709406-448e-4cf2-897b-038b16914a99 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:10.080226 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 347/691] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:10.085004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b709406-448e-4cf2-897b-038b16914a99 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:10.128737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165de57-e7b6-479b-8137-2276c2a9d5c4 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:10.137209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:10.174981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c81271-11b7-43d9-bd95-b97b58ffed94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:10.175896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c81271-11b7-43d9-bd95-b97b58ffed94 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:10.176187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c81271-11b7-43d9-bd95-b97b58ffed94 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:10.176660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c81271-11b7-43d9-bd95-b97b58ffed94 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:10.177445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c81271-11b7-43d9-bd95-b97b58ffed94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:10.177753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c81271-11b7-43d9-bd95-b97b58ffed94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:10.179631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c81271-11b7-43d9-bd95-b97b58ffed94 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:10.190649 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 345/692] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:18:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:10.191980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c40ff0-3e14-435f-90d9-7b19f5ac0ba1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:10.192289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c40ff0-3e14-435f-90d9-7b19f5ac0ba1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:10.192558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c40ff0-3e14-435f-90d9-7b19f5ac0ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:10.203899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b709406-448e-4cf2-897b-038b16914a99 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:10.213586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d0c40ff0-3e14-435f-90d9-7b19f5ac0ba1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:10.215749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d0c40ff0-3e14-435f-90d9-7b19f5ac0ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:10.251461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854c1f1-e283-47c8-92cc-05e059cd71e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:10.252357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854c1f1-e283-47c8-92cc-05e059cd71e9 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:10.252640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854c1f1-e283-47c8-92cc-05e059cd71e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:10.252907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854c1f1-e283-47c8-92cc-05e059cd71e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:10.258543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:10.264661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854c1f1-e283-47c8-92cc-05e059cd71e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:10.266486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854c1f1-e283-47c8-92cc-05e059cd71e9 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:10.281617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-a854c1f1-e283-47c8-92cc-05e059cd71e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:10.281617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:10.281617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:10.281617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:10.281617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:10.281617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:10.281617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:10.281617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:10.281617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:10.281617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:10.281617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:10.281617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:10.281617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:10.281617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:10.281617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:10.282546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:10.282546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:10.282546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:10.282546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:10.282546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:10.282546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:10.282546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:10.282546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:10.282546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:10.282546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:10.282546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:10.282546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:10.282546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:10.282546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:10.282546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:10.282546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:10.282546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:10.283694 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:10.283694 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:10.283694 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:10.283694 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:10.283694 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:10.283694 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:10.283694 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:10.283694 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:10.284310 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 348/693] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:10.285180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854c1f1-e283-47c8-92cc-05e059cd71e9 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:10.300548 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 346/694] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:18:10.303018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c40ff0-3e14-435f-90d9-7b19f5ac0ba1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:10.425886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:10.429142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854c1f1-e283-47c8-92cc-05e059cd71e9 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:10.471102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42eb4c-8745-4248-8af8-1d72515fa674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:10.471743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42eb4c-8745-4248-8af8-1d72515fa674 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:10.472019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42eb4c-8745-4248-8af8-1d72515fa674 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:10.472335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42eb4c-8745-4248-8af8-1d72515fa674 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:10.488988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42eb4c-8745-4248-8af8-1d72515fa674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:10.490458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42eb4c-8745-4248-8af8-1d72515fa674 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:10.516237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c40ff0-3e14-435f-90d9-7b19f5ac0ba1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:10.522559 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-9c42eb4c-8745-4248-8af8-1d72515fa674 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:10.522559 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:10.522559 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:10.522559 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:10.522559 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:10.522559 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:10.522559 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:10.522559 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:10.522559 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:10.522559 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:10.522559 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:10.522559 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:10.522559 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:10.522559 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:10.522559 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:10.522559 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:10.523495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:10.523495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:10.523495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:10.523495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:10.523495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:10.523495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:10.523495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:10.523495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:10.523495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:10.523495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:10.523495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:10.523495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:10.523495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:10.523495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:10.523495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:10.523495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:10.523495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:10.524483 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:10.524483 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:10.524483 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:10.525978 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 349/695] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:10.531576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42eb4c-8745-4248-8af8-1d72515fa674 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:10.569247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df639659-32be-4bf3-a902-9ae97e89d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:10.570682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df639659-32be-4bf3-a902-9ae97e89d8b7 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:10.571188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df639659-32be-4bf3-a902-9ae97e89d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:10.571725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df639659-32be-4bf3-a902-9ae97e89d8b7 None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:10.572655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df639659-32be-4bf3-a902-9ae97e89d8b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:10.573177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df639659-32be-4bf3-a902-9ae97e89d8b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:10.575487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df639659-32be-4bf3-a902-9ae97e89d8b7 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:10.588762 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 347/696] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:10.594717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df639659-32be-4bf3-a902-9ae97e89d8b7 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:10.638694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:10.662916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42eb4c-8745-4248-8af8-1d72515fa674 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:10.701724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853adb0-a8dc-4d11-b069-9221eb4a079e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:10.702284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853adb0-a8dc-4d11-b069-9221eb4a079e None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:10.702529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853adb0-a8dc-4d11-b069-9221eb4a079e None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:10.702813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853adb0-a8dc-4d11-b069-9221eb4a079e None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:10.703462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853adb0-a8dc-4d11-b069-9221eb4a079e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:10.703765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853adb0-a8dc-4d11-b069-9221eb4a079e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:10.705195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853adb0-a8dc-4d11-b069-9221eb4a079e None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:10.718559 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 350/697] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:10.719456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853adb0-a8dc-4d11-b069-9221eb4a079e None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:10.721399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df639659-32be-4bf3-a902-9ae97e89d8b7 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:10.734976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:10.757053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38482fe-9b0e-4713-9e23-616fe46f4229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:10.757745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38482fe-9b0e-4713-9e23-616fe46f4229 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:10.758088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38482fe-9b0e-4713-9e23-616fe46f4229 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:10.758427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38482fe-9b0e-4713-9e23-616fe46f4229 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:10.759253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38482fe-9b0e-4713-9e23-616fe46f4229 None admin] RBAC: Adding query filter params (role.id=127770d936b94a5da885e721233e7f7b, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=cc067131b0d84c7c9da1a33ecb7a9d02) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:10.759625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38482fe-9b0e-4713-9e23-616fe46f4229 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:10.761919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38482fe-9b0e-4713-9e23-616fe46f4229 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:10.768283 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 348/698] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:18:10 2022] GET /identity/v3/role_assignments?user.id=cc067131b0d84c7c9da1a33ecb7a9d02&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=127770d936b94a5da885e721233e7f7b => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:10.769188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38482fe-9b0e-4713-9e23-616fe46f4229 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:10.878945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:10.889499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38482fe-9b0e-4713-9e23-616fe46f4229 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:10.925472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853adb0-a8dc-4d11-b069-9221eb4a079e None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:10.948187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23e484-c8db-42e1-8c43-55f84fe7350e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:10.948187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23e484-c8db-42e1-8c43-55f84fe7350e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:10.948187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23e484-c8db-42e1-8c43-55f84fe7350e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:10.948187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23e484-c8db-42e1-8c43-55f84fe7350e None admin] PATH_INFO: `/v3/users/nova` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:10.954702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23e484-c8db-42e1-8c43-55f84fe7350e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:10.956098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23e484-c8db-42e1-8c43-55f84fe7350e None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:10.978212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-7f23e484-c8db-42e1-8c43-55f84fe7350e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:18:10.978212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:10.978212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:10.978212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:10.978212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:10.978212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:10.978212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:10.978212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:10.978212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:10.978212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:10.978212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:10.978212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:10.978212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:10.978212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:10.978212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:10.978212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:10.979314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:10.981087 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:10.981087 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:10.981087 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:10.981087 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:10.981087 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:10.981087 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:10.981087 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:10.981087 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:10.981087 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:18:10.981087 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:10.983292 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 349/699] 10.222.0.76 () {56 vars in 1093 bytes} [Sat Aug 27 04:18:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:10.988540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23e484-c8db-42e1-8c43-55f84fe7350e None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:11.002463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996802ad-7e85-409b-8603-e6dc3e2da272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:11.003244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996802ad-7e85-409b-8603-e6dc3e2da272 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:11.003986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996802ad-7e85-409b-8603-e6dc3e2da272 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:11.004468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996802ad-7e85-409b-8603-e6dc3e2da272 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:11.018612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996802ad-7e85-409b-8603-e6dc3e2da272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:11.020974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996802ad-7e85-409b-8603-e6dc3e2da272 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:11.040061 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-996802ad-7e85-409b-8603-e6dc3e2da272 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:11.040061 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:11.040061 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:11.040061 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:11.040061 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:11.040061 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:11.040061 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:11.040061 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:11.040061 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:11.040061 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:11.040061 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:11.040061 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:11.040061 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:11.040061 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:11.040061 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:11.040061 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:11.041293 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:11.041293 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:11.041293 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:11.041293 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:11.041293 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:11.041293 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:11.041293 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:11.041293 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:11.041293 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:11.041293 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:11.041293 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:11.041293 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:11.041293 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:11.041293 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:11.041293 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:11.041293 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:11.041293 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:11.042229 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:11.042229 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:11.042229 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:11.047759 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 351/700] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:11.049157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996802ad-7e85-409b-8603-e6dc3e2da272 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:11.125753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23e484-c8db-42e1-8c43-55f84fe7350e None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:11.129732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:11.169467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd851e-e2a6-477a-9a45-36e3b9f18a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:11.170930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd851e-e2a6-477a-9a45-36e3b9f18a01 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:11.171426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd851e-e2a6-477a-9a45-36e3b9f18a01 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:11.171924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd851e-e2a6-477a-9a45-36e3b9f18a01 None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:11.172946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd851e-e2a6-477a-9a45-36e3b9f18a01 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:11.173590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd851e-e2a6-477a-9a45-36e3b9f18a01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:11.175221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd851e-e2a6-477a-9a45-36e3b9f18a01 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:11.177916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996802ad-7e85-409b-8603-e6dc3e2da272 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:11.206017 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 350/701] 10.222.0.76 () {56 vars in 1133 bytes} [Sat Aug 27 04:18:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:11.211657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd851e-e2a6-477a-9a45-36e3b9f18a01 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:11.224418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def5c1c-505b-4d81-9a0a-6c533b3b2b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:11.225247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def5c1c-505b-4d81-9a0a-6c533b3b2b59 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:11.225678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def5c1c-505b-4d81-9a0a-6c533b3b2b59 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:11.226098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def5c1c-505b-4d81-9a0a-6c533b3b2b59 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:11.226944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def5c1c-505b-4d81-9a0a-6c533b3b2b59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:11.227420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def5c1c-505b-4d81-9a0a-6c533b3b2b59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:11.229034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def5c1c-505b-4d81-9a0a-6c533b3b2b59 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:11.236520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:11.244608 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 352/702] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:11.251772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def5c1c-505b-4d81-9a0a-6c533b3b2b59 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:11.333081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd851e-e2a6-477a-9a45-36e3b9f18a01 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:11.372659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb243042-fdbc-4adc-b38c-5dfbbc889156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:11.373626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb243042-fdbc-4adc-b38c-5dfbbc889156 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:11.374117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb243042-fdbc-4adc-b38c-5dfbbc889156 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:11.374727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb243042-fdbc-4adc-b38c-5dfbbc889156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:11.445760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def5c1c-505b-4d81-9a0a-6c533b3b2b59 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:11.502600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:11.504030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb243042-fdbc-4adc-b38c-5dfbbc889156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:11.506435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb243042-fdbc-4adc-b38c-5dfbbc889156 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:11.521290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd966ebd-0c3a-41c6-8892-3b2af3668cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:11.522615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd966ebd-0c3a-41c6-8892-3b2af3668cc2 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:11.523106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd966ebd-0c3a-41c6-8892-3b2af3668cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:11.523871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd966ebd-0c3a-41c6-8892-3b2af3668cc2 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:11.525159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd966ebd-0c3a-41c6-8892-3b2af3668cc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:11.528151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd966ebd-0c3a-41c6-8892-3b2af3668cc2 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:11.530108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:11.625339 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 351/704] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:18:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 27 04:18:11.625969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf40f3-67f6-4e87-9cce-01ac3571784a None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:11.626055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf40f3-67f6-4e87-9cce-01ac3571784a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:11.626349 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 353/704] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:18:11 2022] POST /identity/v3/users => generated 254 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:18:11.626450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf40f3-67f6-4e87-9cce-01ac3571784a None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:11.627637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd966ebd-0c3a-41c6-8892-3b2af3668cc2 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:11.629397 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 352/705] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:11.634240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9b930-cd7c-4aee-8612-2640e3122fd0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:11.634613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9b930-cd7c-4aee-8612-2640e3122fd0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:11.634956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9b930-cd7c-4aee-8612-2640e3122fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:11.681105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-cec9b930-cd7c-4aee-8612-2640e3122fd0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:11.682348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cec9b930-cd7c-4aee-8612-2640e3122fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:11.823858 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 353/706] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:18:11.825260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e265a84-ab70-4e32-a5e7-832193c79c57 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:11.825546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e265a84-ab70-4e32-a5e7-832193c79c57 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:11.825822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e265a84-ab70-4e32-a5e7-832193c79c57 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:11.827429 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 354/707] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:11.833619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd966ebd-0c3a-41c6-8892-3b2af3668cc2 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:11.850218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3d8d9-897d-443d-bc8a-fb118aeb983d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:11.850504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3d8d9-897d-443d-bc8a-fb118aeb983d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:11.850797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3d8d9-897d-443d-bc8a-fb118aeb983d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:11.872812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-37b3d8d9-897d-443d-bc8a-fb118aeb983d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:11.873260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615a2a5-1706-4170-8d5f-2f5ead2cc387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:11.874049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-37b3d8d9-897d-443d-bc8a-fb118aeb983d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:11.874308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615a2a5-1706-4170-8d5f-2f5ead2cc387 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:11.874770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615a2a5-1706-4170-8d5f-2f5ead2cc387 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:11.875236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615a2a5-1706-4170-8d5f-2f5ead2cc387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:11.888913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615a2a5-1706-4170-8d5f-2f5ead2cc387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:11.890525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615a2a5-1706-4170-8d5f-2f5ead2cc387 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:11.906798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-6615a2a5-1706-4170-8d5f-2f5ead2cc387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:11.906798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:11.906798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:11.906798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:11.906798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:11.906798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:11.906798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:11.906798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:11.906798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:11.906798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:11.906798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:11.906798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:11.906798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:11.906798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:11.906798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:11.906798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:11.907990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:11.907990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:11.907990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:11.907990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:11.907990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:11.907990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:11.907990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:11.907990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:11.907990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:11.907990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:11.907990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:11.907990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:11.907990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:11.907990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:11.907990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:11.907990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:11.907990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:11.909150 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:11.909150 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:11.909150 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:11.909835 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 354/708] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:11.915909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615a2a5-1706-4170-8d5f-2f5ead2cc387 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:11.940445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:11.965219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:11.992315 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 355/709] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:18:12.057705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615a2a5-1706-4170-8d5f-2f5ead2cc387 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:12.101142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eff732-6fbd-47bd-aaf0-e0102b5e32ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:12.101725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eff732-6fbd-47bd-aaf0-e0102b5e32ff None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:12.102109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eff732-6fbd-47bd-aaf0-e0102b5e32ff None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:12.102434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eff732-6fbd-47bd-aaf0-e0102b5e32ff None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:12.103090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eff732-6fbd-47bd-aaf0-e0102b5e32ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:12.103444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eff732-6fbd-47bd-aaf0-e0102b5e32ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:12.104906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eff732-6fbd-47bd-aaf0-e0102b5e32ff None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:12.120810 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 355/710] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:12.124043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3d8d9-897d-443d-bc8a-fb118aeb983d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:12.125745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eff732-6fbd-47bd-aaf0-e0102b5e32ff None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:12.239076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3d8d9-897d-443d-bc8a-fb118aeb983d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:12.259460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:12.277807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb67ba4-d475-4557-8b18-35acc00d0e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:12.279347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb67ba4-d475-4557-8b18-35acc00d0e1a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:12.279347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb67ba4-d475-4557-8b18-35acc00d0e1a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:12.279347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb67ba4-d475-4557-8b18-35acc00d0e1a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:12.279729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb67ba4-d475-4557-8b18-35acc00d0e1a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:12.280595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eff732-6fbd-47bd-aaf0-e0102b5e32ff None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:12.281143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb67ba4-d475-4557-8b18-35acc00d0e1a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:12.292360 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-efb67ba4-d475-4557-8b18-35acc00d0e1a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 04:18:12.292360 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:12.292360 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:12.292360 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:12.292360 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:12.292360 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:12.292360 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:12.292360 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:12.292360 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 04:18:12.292360 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:12.292360 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:12.292360 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:12.292360 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:12.292360 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:12.292360 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:12.292360 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:12.292360 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:12.294119 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:12.294119 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:12.294119 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:12.294119 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:12.294119 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:12.294119 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:12.294119 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:12.294119 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:12.294119 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:12.294119 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:12.294119 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:12.294119 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:12.294119 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:12.294119 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:12.294119 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:12.294119 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:12.295582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:12.295582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:12.295582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:12.295582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:12.295582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:12.295582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:12.295582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:12.295582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:12.295582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:12.295582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:12.295582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:12.295582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:12.295582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 04:18:12.295582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:12.295582 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 356/711] 10.222.0.76 () {56 vars in 1129 bytes} [Sat Aug 27 04:18:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:12.300873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb67ba4-d475-4557-8b18-35acc00d0e1a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:12.363210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:12.363391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16519a9f-35a9-44e7-82e2-fc9dacbf1fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:12.363391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16519a9f-35a9-44e7-82e2-fc9dacbf1fe5 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:12.363391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16519a9f-35a9-44e7-82e2-fc9dacbf1fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:12.363391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16519a9f-35a9-44e7-82e2-fc9dacbf1fe5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:12.372568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16519a9f-35a9-44e7-82e2-fc9dacbf1fe5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:12.374709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16519a9f-35a9-44e7-82e2-fc9dacbf1fe5 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:12.390165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-16519a9f-35a9-44e7-82e2-fc9dacbf1fe5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:12.390165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:12.390165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:12.390165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:12.390165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:12.390165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:12.390165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:12.390165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:12.390165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:12.390165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:12.390165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:12.390165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:12.390165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:12.390165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:12.390165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:12.391144 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:12.391144 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:12.391144 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:12.391144 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:12.391144 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:12.391144 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:12.391144 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:12.391144 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:12.391144 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:12.391144 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:12.391144 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:12.391144 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:12.391144 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:12.391144 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:12.391144 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:12.391144 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:12.391144 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:12.392044 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:12.392044 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:12.392044 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:12.392044 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:12.392044 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:12.392044 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:12.392044 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:12.392044 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:12.399615 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 356/712] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:12.399615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16519a9f-35a9-44e7-82e2-fc9dacbf1fe5 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:12.450390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb67ba4-d475-4557-8b18-35acc00d0e1a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:12.497947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8366a6-ca21-4917-a72c-ca928615180b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:12.502599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8366a6-ca21-4917-a72c-ca928615180b None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:12.502599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8366a6-ca21-4917-a72c-ca928615180b None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:12.502599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8366a6-ca21-4917-a72c-ca928615180b None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:12.502599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8366a6-ca21-4917-a72c-ca928615180b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:12.502599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8366a6-ca21-4917-a72c-ca928615180b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:12.503550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8366a6-ca21-4917-a72c-ca928615180b None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:12.510708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16519a9f-35a9-44e7-82e2-fc9dacbf1fe5 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:12.515497 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 357/713] 10.222.0.76 () {56 vars in 1124 bytes} [Sat Aug 27 04:18:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:12.516583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8366a6-ca21-4917-a72c-ca928615180b None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:12.571129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13349fde-bdc1-4a43-98ed-a9939197d8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:12.571765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13349fde-bdc1-4a43-98ed-a9939197d8e9 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:12.572043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13349fde-bdc1-4a43-98ed-a9939197d8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:12.572363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13349fde-bdc1-4a43-98ed-a9939197d8e9 None admin] PATH_INFO: `/v3/services/network` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:12.573421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13349fde-bdc1-4a43-98ed-a9939197d8e9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:12.574830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13349fde-bdc1-4a43-98ed-a9939197d8e9 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:12.590226 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-13349fde-bdc1-4a43-98ed-a9939197d8e9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 04:18:12.590226 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:12.590226 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:12.590226 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:12.590226 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:12.590226 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:12.590226 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:12.590226 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:12.590226 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 04:18:12.590226 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:12.590226 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:12.590226 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:12.590226 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:12.590226 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:12.590226 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:12.590226 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:12.590226 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:12.591295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:12.591295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:12.591295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:12.591295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:12.591295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:12.591295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:12.591295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:12.591295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:12.591295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:12.591295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:12.591295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:12.591295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:12.591295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:12.591295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:12.591295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:12.591295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:12.597114 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:12.597114 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:12.597114 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:12.597114 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:12.597114 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:12.597114 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:12.597114 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:12.597114 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:12.597114 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:12.597114 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:12.597114 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:12.597114 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:12.597114 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 04:18:12.597114 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:12.597114 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 357/714] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:12 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:12.597916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13349fde-bdc1-4a43-98ed-a9939197d8e9 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:12.616666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:12.658366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8366a6-ca21-4917-a72c-ca928615180b None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:12.661375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:12.704720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac1791-e0b6-4abf-9c00-a37f90ce7235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:12.705677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac1791-e0b6-4abf-9c00-a37f90ce7235 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:12.705966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac1791-e0b6-4abf-9c00-a37f90ce7235 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:12.706240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac1791-e0b6-4abf-9c00-a37f90ce7235 None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:12.706945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac1791-e0b6-4abf-9c00-a37f90ce7235 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:12.707252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac1791-e0b6-4abf-9c00-a37f90ce7235 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:12.709292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac1791-e0b6-4abf-9c00-a37f90ce7235 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:12.731392 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 358/715] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:12.731392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac1791-e0b6-4abf-9c00-a37f90ce7235 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:12.731646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13349fde-bdc1-4a43-98ed-a9939197d8e9 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:12.775201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866c140-6d2b-4c45-a23b-ff91620dca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:12.775810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866c140-6d2b-4c45-a23b-ff91620dca99 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:12.776094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866c140-6d2b-4c45-a23b-ff91620dca99 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:12.776399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866c140-6d2b-4c45-a23b-ff91620dca99 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:12.777597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866c140-6d2b-4c45-a23b-ff91620dca99 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:12.777597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866c140-6d2b-4c45-a23b-ff91620dca99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:12.779939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866c140-6d2b-4c45-a23b-ff91620dca99 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:12.788238 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 358/716] 10.222.0.76 () {56 vars in 1124 bytes} [Sat Aug 27 04:18:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:12.789408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866c140-6d2b-4c45-a23b-ff91620dca99 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:12.942367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:12.961582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac1791-e0b6-4abf-9c00-a37f90ce7235 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:12.982258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866c140-6d2b-4c45-a23b-ff91620dca99 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:13.009807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439b869-2624-4d32-a131-ec2885d82bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:13.010428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439b869-2624-4d32-a131-ec2885d82bac None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:13.010706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439b869-2624-4d32-a131-ec2885d82bac None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:13.011336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439b869-2624-4d32-a131-ec2885d82bac None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:13.012625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439b869-2624-4d32-a131-ec2885d82bac None admin] RBAC: Adding query filter params (name=network) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:13.012918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439b869-2624-4d32-a131-ec2885d82bac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:13.014329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439b869-2624-4d32-a131-ec2885d82bac None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:13.024188 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 359/717] 10.222.0.76 () {56 vars in 1112 bytes} [Sat Aug 27 04:18:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:13.026558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439b869-2624-4d32-a131-ec2885d82bac None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:13.044497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f75b6-9e35-4470-924b-213a5c204c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:13.045691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f75b6-9e35-4470-924b-213a5c204c73 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:13.046178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f75b6-9e35-4470-924b-213a5c204c73 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:13.047189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f75b6-9e35-4470-924b-213a5c204c73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:13.048530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f75b6-9e35-4470-924b-213a5c204c73 None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=0e5ddcf00a184aa0ac0e7194f1c72425) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:13.049394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f75b6-9e35-4470-924b-213a5c204c73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:13.051452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f75b6-9e35-4470-924b-213a5c204c73 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:13.065646 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 359/718] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:18:12 2022] GET /identity/v3/role_assignments?user.id=0e5ddcf00a184aa0ac0e7194f1c72425&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:13.068564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:13.211967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439b869-2624-4d32-a131-ec2885d82bac None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:13.222124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053650f-0502-46f5-b9d0-35c8bb1ff561 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:13.222433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053650f-0502-46f5-b9d0-35c8bb1ff561 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:13.222667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053650f-0502-46f5-b9d0-35c8bb1ff561 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:13.228196 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 360/719] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:18:13.229645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d08e8-38db-4192-95ca-c8091926cc76 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:13.229973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d08e8-38db-4192-95ca-c8091926cc76 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:13.230298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d08e8-38db-4192-95ca-c8091926cc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:13.252126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1b0d08e8-38db-4192-95ca-c8091926cc76 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:13.253892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1b0d08e8-38db-4192-95ca-c8091926cc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:13.283883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fb7a3-265c-4c75-bd0f-88f8975760af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:13.284562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fb7a3-265c-4c75-bd0f-88f8975760af None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:13.284846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fb7a3-265c-4c75-bd0f-88f8975760af None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:13.285117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fb7a3-265c-4c75-bd0f-88f8975760af None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:13.285828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fb7a3-265c-4c75-bd0f-88f8975760af None admin] RBAC: Adding query filter params (type=network) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:13.286138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fb7a3-265c-4c75-bd0f-88f8975760af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:13.287542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fb7a3-265c-4c75-bd0f-88f8975760af None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:13.294681 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 360/720] 10.222.0.76 () {56 vars in 1112 bytes} [Sat Aug 27 04:18:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:13.359185 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 361/721] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:18:13.734502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fb7a3-265c-4c75-bd0f-88f8975760af None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:13.831595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:13.840450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fb7a3-265c-4c75-bd0f-88f8975760af None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:13.876261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cd1bc-1d34-4a05-9506-7bafd693a587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:13.876890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cd1bc-1d34-4a05-9506-7bafd693a587 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:13.877169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cd1bc-1d34-4a05-9506-7bafd693a587 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:13.877442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cd1bc-1d34-4a05-9506-7bafd693a587 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:13.888977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9cd1bc-1d34-4a05-9506-7bafd693a587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:13.894199 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-8e9cd1bc-1d34-4a05-9506-7bafd693a587 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:18:13.894199 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:13.894199 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:13.894199 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:13.894199 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:13.894199 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:13.894199 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:13.894199 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:13.894199 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:13.894199 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:13.894199 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:13.894199 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:13.894199 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:13.894199 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:13.894199 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:13.894199 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:13.895136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:13.895136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:13.895136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:13.895136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:13.895136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:13.895136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:13.895136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:13.895136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:13.895136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:13.895136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:13.895136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:13.895136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:13.895136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:13.895136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:13.895136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:13.895136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:13.896015 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:13.896015 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:13.896015 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:13.896015 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:13.896015 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:13.896015 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:13.896015 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:13.896015 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:13.896015 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:13.896015 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:13.896015 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:18:13.896015 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:13.896015 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 361/722] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:18:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:13.901323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d08e8-38db-4192-95ca-c8091926cc76 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:14.008426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:14.043860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d08e8-38db-4192-95ca-c8091926cc76 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:14.093473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8218732-a5df-4eb8-aae7-a826ea68228d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:14.094481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8218732-a5df-4eb8-aae7-a826ea68228d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:14.095006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8218732-a5df-4eb8-aae7-a826ea68228d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:14.095504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8218732-a5df-4eb8-aae7-a826ea68228d None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:14.096403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8218732-a5df-4eb8-aae7-a826ea68228d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:14.096926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8218732-a5df-4eb8-aae7-a826ea68228d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:14.098530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8218732-a5df-4eb8-aae7-a826ea68228d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:14.110917 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 362/723] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:18:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:14.116805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cd1bc-1d34-4a05-9506-7bafd693a587 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:14.225447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cd1bc-1d34-4a05-9506-7bafd693a587 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:14.262224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44c5fd-e343-4560-b1c5-b40b6c665af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:14.263175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44c5fd-e343-4560-b1c5-b40b6c665af0 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:14.263655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44c5fd-e343-4560-b1c5-b40b6c665af0 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:14.264145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44c5fd-e343-4560-b1c5-b40b6c665af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:14.275327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44c5fd-e343-4560-b1c5-b40b6c665af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:14.277205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44c5fd-e343-4560-b1c5-b40b6c665af0 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:14.291725 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-cc44c5fd-e343-4560-b1c5-b40b6c665af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:14.291725 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:14.291725 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:14.291725 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:14.291725 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:14.291725 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:14.291725 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:14.291725 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:14.291725 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:14.291725 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:14.291725 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:14.291725 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:14.291725 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:14.291725 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:14.291725 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:14.291725 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:14.293498 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:14.293498 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:14.293498 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:14.293498 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:14.293498 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:14.293498 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:14.293498 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:14.293498 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:14.293498 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:14.293498 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:14.293498 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:14.293498 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:14.293498 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:14.293498 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:14.293498 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:14.293498 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:14.293498 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:14.294410 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:14.294410 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:14.294410 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:14.299842 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 362/724] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:14.302418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8218732-a5df-4eb8-aae7-a826ea68228d None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:14.314165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401fda9-03a4-45c9-b260-39fa0f7d959c None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:14.314768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401fda9-03a4-45c9-b260-39fa0f7d959c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:14.315334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401fda9-03a4-45c9-b260-39fa0f7d959c None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:14.319050 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 363/725] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:14 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:14.324110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4a918-0166-4280-bb8a-73aec3a280e9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:14.324656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4a918-0166-4280-bb8a-73aec3a280e9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:14.325148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4a918-0166-4280-bb8a-73aec3a280e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:14.337236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:14.354925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3fd4a918-0166-4280-bb8a-73aec3a280e9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:14.359161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3fd4a918-0166-4280-bb8a-73aec3a280e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:14.453974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8218732-a5df-4eb8-aae7-a826ea68228d None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:14.507710 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 364/726] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:18:14.528046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acb630-4fc0-4e75-b33f-c837112d45dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:14.528953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acb630-4fc0-4e75-b33f-c837112d45dc None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:14.529391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acb630-4fc0-4e75-b33f-c837112d45dc None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:14.529807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acb630-4fc0-4e75-b33f-c837112d45dc None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:14.530606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acb630-4fc0-4e75-b33f-c837112d45dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:14.531079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acb630-4fc0-4e75-b33f-c837112d45dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:14.532678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acb630-4fc0-4e75-b33f-c837112d45dc None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:14.541195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:14.557444 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 363/727] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:14.562971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4a918-0166-4280-bb8a-73aec3a280e9 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:14.690577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4a918-0166-4280-bb8a-73aec3a280e9 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:14.726828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3638b-6575-4d99-9120-b37a99548cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:14.727457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3638b-6575-4d99-9120-b37a99548cad None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:14.727734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3638b-6575-4d99-9120-b37a99548cad None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:14.728002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3638b-6575-4d99-9120-b37a99548cad None admin] PATH_INFO: `/v3/users/swift` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:14.730047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:14.736922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3638b-6575-4d99-9120-b37a99548cad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:14.738411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3638b-6575-4d99-9120-b37a99548cad None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:14.750088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-70e3638b-6575-4d99-9120-b37a99548cad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:18:14.750088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:14.750088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:14.750088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:14.750088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:14.750088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:14.750088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:14.750088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:14.750088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:14.750088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:14.750088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:14.750088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:14.750088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:14.750088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:14.750088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:14.750088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:14.751046 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:14.752005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:14.752005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:14.752005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:14.752005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:14.752005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:14.752005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:14.752005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:14.752005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:14.752005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:18:14.752005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:14.752005 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 365/728] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:18:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:14.757094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acb630-4fc0-4e75-b33f-c837112d45dc None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:14.870192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acb630-4fc0-4e75-b33f-c837112d45dc None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:14.889167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3638b-6575-4d99-9120-b37a99548cad None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:14.932244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b2338-a91a-4fdb-b5cd-f09310960fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:14.932950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b2338-a91a-4fdb-b5cd-f09310960fcb None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:14.933224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b2338-a91a-4fdb-b5cd-f09310960fcb None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:14.933702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b2338-a91a-4fdb-b5cd-f09310960fcb None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:14.934648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b2338-a91a-4fdb-b5cd-f09310960fcb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:14.934965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b2338-a91a-4fdb-b5cd-f09310960fcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:14.936616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b2338-a91a-4fdb-b5cd-f09310960fcb None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:14.973768 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 364/729] 10.222.0.76 () {56 vars in 1135 bytes} [Sat Aug 27 04:18:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:14.985283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b2338-a91a-4fdb-b5cd-f09310960fcb None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:15.041243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3638b-6575-4d99-9120-b37a99548cad None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:15.090594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:15.094422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3823488-ccd1-4fb3-942f-36fe70174594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:15.095118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3823488-ccd1-4fb3-942f-36fe70174594 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:15.095403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3823488-ccd1-4fb3-942f-36fe70174594 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:15.095672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3823488-ccd1-4fb3-942f-36fe70174594 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:15.100681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b2338-a91a-4fdb-b5cd-f09310960fcb None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:15.113779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3823488-ccd1-4fb3-942f-36fe70174594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:15.124958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-e3823488-ccd1-4fb3-942f-36fe70174594 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:15.124958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:15.124958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:15.124958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:15.124958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:15.124958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:15.124958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:15.124958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:15.124958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:15.124958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:15.124958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:15.124958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:15.124958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:15.124958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:15.124958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:15.124958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:15.125882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:15.125882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:15.125882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:15.125882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:15.125882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:15.125882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:15.125882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:15.125882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:15.125882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:15.125882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:15.125882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:15.125882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:15.125882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:15.125882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:15.125882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:15.125882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:15.126732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:15.126732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:15.126732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:15.126732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:15.126732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:15.126732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:15.126732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:15.126732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:15.126732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:15.126732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:15.126732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:15.126732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:15.126732 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 366/730] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:18:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:15.131857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3823488-ccd1-4fb3-942f-36fe70174594 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:15.149328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f9819-fced-43b9-9fd2-b98b0e3417da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:15.150254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f9819-fced-43b9-9fd2-b98b0e3417da None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:15.150708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f9819-fced-43b9-9fd2-b98b0e3417da None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:15.151152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f9819-fced-43b9-9fd2-b98b0e3417da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:15.198009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:15.222360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f9819-fced-43b9-9fd2-b98b0e3417da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:15.224177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f9819-fced-43b9-9fd2-b98b0e3417da None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:15.249308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3823488-ccd1-4fb3-942f-36fe70174594 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:15.280094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:15.287934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793153f4-fc76-43c8-a2d2-8193570d7804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:15.288568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793153f4-fc76-43c8-a2d2-8193570d7804 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:15.288851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793153f4-fc76-43c8-a2d2-8193570d7804 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:15.296297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793153f4-fc76-43c8-a2d2-8193570d7804 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:15.296297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793153f4-fc76-43c8-a2d2-8193570d7804 None admin] RBAC: Adding query filter params (name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:15.296297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793153f4-fc76-43c8-a2d2-8193570d7804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:15.296297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793153f4-fc76-43c8-a2d2-8193570d7804 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:15.301050 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 367/731] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:18:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:15.302459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3bd6c-c81e-41a4-ab12-659f0056d97f None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:15.302813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3bd6c-c81e-41a4-ab12-659f0056d97f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:15.303163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3bd6c-c81e-41a4-ab12-659f0056d97f None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:15.309617 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 368/732] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:15.310722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3bd6c-c81e-41a4-ab12-659f0056d97f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:15.329220 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 365/733] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:18:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:15.330462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7b40c-1e14-4b3c-a5aa-88e14d4e60e8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:15.330742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7b40c-1e14-4b3c-a5aa-88e14d4e60e8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:15.331013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7b40c-1e14-4b3c-a5aa-88e14d4e60e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:15.348579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c9b7b40c-1e14-4b3c-a5aa-88e14d4e60e8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:15.349767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c9b7b40c-1e14-4b3c-a5aa-88e14d4e60e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:15.420582 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 366/734] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:18:15.421358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7b40c-1e14-4b3c-a5aa-88e14d4e60e8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:15.441385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3bd6c-c81e-41a4-ab12-659f0056d97f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:15.471716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:15.514960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc8320-0adf-4847-8856-381bea39ba7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:15.515613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc8320-0adf-4847-8856-381bea39ba7e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:15.515955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc8320-0adf-4847-8856-381bea39ba7e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:15.516258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc8320-0adf-4847-8856-381bea39ba7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:15.516710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:15.528707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc8320-0adf-4847-8856-381bea39ba7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:15.530177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc8320-0adf-4847-8856-381bea39ba7e None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:15.539472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7b40c-1e14-4b3c-a5aa-88e14d4e60e8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:15.546433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-cefc8320-0adf-4847-8856-381bea39ba7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:15.546433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:15.546433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:15.546433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:15.546433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:15.546433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:15.546433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:15.546433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:15.546433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:15.546433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:15.546433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:15.546433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:15.546433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:15.546433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:15.546433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:15.546433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:15.547475 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:15.547475 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:15.547475 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:15.547475 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:15.547475 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:15.547475 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:15.547475 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:15.547475 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:15.547475 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:15.547475 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:15.547475 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:15.547475 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:15.547475 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:15.547475 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:15.547475 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:15.547475 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:15.547475 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:15.548409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:15.548409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:15.548409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:15.548409 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 369/735] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:15.553381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc8320-0adf-4847-8856-381bea39ba7e None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:15.616368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edfa5d-7f31-442a-b39a-0cea0cafccbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:15.617015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edfa5d-7f31-442a-b39a-0cea0cafccbe None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:15.617293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edfa5d-7f31-442a-b39a-0cea0cafccbe None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:15.617564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edfa5d-7f31-442a-b39a-0cea0cafccbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:15.629022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23edfa5d-7f31-442a-b39a-0cea0cafccbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:15.630473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23edfa5d-7f31-442a-b39a-0cea0cafccbe None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:15.645991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-23edfa5d-7f31-442a-b39a-0cea0cafccbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:15.645991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:15.645991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:15.645991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:15.645991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:15.645991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:15.645991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:15.645991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:15.645991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:15.645991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:15.645991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:15.645991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:15.645991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:15.645991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:15.645991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:15.645991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:15.647013 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:15.647013 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:15.647013 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:15.647013 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:15.647013 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:15.647013 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:15.647013 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:15.647013 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:15.647013 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:15.647013 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:15.647013 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:15.647013 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:15.647013 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:15.647013 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:15.647013 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:15.647013 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:15.647013 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:15.647892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:15.647892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:15.647892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:15.647892 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 367/736] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:15.649793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d4b36-b8eb-4a5c-a953-80eb97313ee1 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:15.649793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d4b36-b8eb-4a5c-a953-80eb97313ee1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:15.649793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d4b36-b8eb-4a5c-a953-80eb97313ee1 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:15.654939 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 368/737] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:15.655756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d4b36-b8eb-4a5c-a953-80eb97313ee1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:15.663868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc8320-0adf-4847-8856-381bea39ba7e None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:15.700619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da443259-0eab-4fc6-b085-2cea45c635f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:15.701153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da443259-0eab-4fc6-b085-2cea45c635f1 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:15.701431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da443259-0eab-4fc6-b085-2cea45c635f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:15.701707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da443259-0eab-4fc6-b085-2cea45c635f1 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:15.702353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da443259-0eab-4fc6-b085-2cea45c635f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:15.702658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da443259-0eab-4fc6-b085-2cea45c635f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:15.704039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da443259-0eab-4fc6-b085-2cea45c635f1 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:15.717019 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 370/738] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:15.718269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225eef7-4b6e-4205-9a22-955fc7d95e99 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:15.718550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225eef7-4b6e-4205-9a22-955fc7d95e99 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:15.718820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225eef7-4b6e-4205-9a22-955fc7d95e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:15.749356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c225eef7-4b6e-4205-9a22-955fc7d95e99 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:15.751069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c225eef7-4b6e-4205-9a22-955fc7d95e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:15.775347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d4b36-b8eb-4a5c-a953-80eb97313ee1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:15.784033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:15.817560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36167137-068f-4944-9f98-69369fedba69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:15.819985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36167137-068f-4944-9f98-69369fedba69 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:15.820447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36167137-068f-4944-9f98-69369fedba69 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:15.821235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36167137-068f-4944-9f98-69369fedba69 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:15.822266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36167137-068f-4944-9f98-69369fedba69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:15.823404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36167137-068f-4944-9f98-69369fedba69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:15.825598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36167137-068f-4944-9f98-69369fedba69 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:15.829000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:15.844496 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 369/739] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:15.845570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36167137-068f-4944-9f98-69369fedba69 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:15.859325 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 371/740] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:18:15.861420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225eef7-4b6e-4205-9a22-955fc7d95e99 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:15.982877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36167137-068f-4944-9f98-69369fedba69 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:15.997506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225eef7-4b6e-4205-9a22-955fc7d95e99 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:16.019954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ef421-c0eb-48c1-96a8-158c7c0a73db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:16.020617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ef421-c0eb-48c1-96a8-158c7c0a73db None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:16.020903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ef421-c0eb-48c1-96a8-158c7c0a73db None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:16.021178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ef421-c0eb-48c1-96a8-158c7c0a73db None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:16.029963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ef421-c0eb-48c1-96a8-158c7c0a73db None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:16.031403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ef421-c0eb-48c1-96a8-158c7c0a73db None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:16.036765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf956bdf-62e0-41cf-931b-9ccd37bf1cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:16.037372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf956bdf-62e0-41cf-931b-9ccd37bf1cbd None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:16.037653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf956bdf-62e0-41cf-931b-9ccd37bf1cbd None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:16.037924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf956bdf-62e0-41cf-931b-9ccd37bf1cbd None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:16.038571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf956bdf-62e0-41cf-931b-9ccd37bf1cbd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:16.039919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf956bdf-62e0-41cf-931b-9ccd37bf1cbd None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:16.044698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-300ef421-c0eb-48c1-96a8-158c7c0a73db None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:18:16.044698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:16.044698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:16.044698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:16.044698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:16.044698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:16.044698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:16.044698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:16.044698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:16.044698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:16.044698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:16.044698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:16.044698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:16.044698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:16.044698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:16.044698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:16.045614 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:16.046545 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:16.046545 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:16.046545 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:16.046545 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:16.046545 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:16.046545 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:16.046545 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:16.046545 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:16.046545 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:18:16.046545 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:16.046545 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 370/741] 10.222.0.76 () {56 vars in 1117 bytes} [Sat Aug 27 04:18:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:16.046545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ef421-c0eb-48c1-96a8-158c7c0a73db None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:16.104004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:16.149818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ef421-c0eb-48c1-96a8-158c7c0a73db None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:16.165681 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 372/742] 10.222.0.76 () {60 vars in 1141 bytes} [Sat Aug 27 04:18:15 2022] POST /identity/v3/services => generated 251 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:18:16.166901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c5006-60fb-4dd9-acd9-19c8d4208394 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:16.167180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c5006-60fb-4dd9-acd9-19c8d4208394 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:16.168017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c5006-60fb-4dd9-acd9-19c8d4208394 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:16.169247 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 373/743] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:16.169944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c5006-60fb-4dd9-acd9-19c8d4208394 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:16.195791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff331b-0fea-4aaa-a81c-1157457edba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:16.196747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff331b-0fea-4aaa-a81c-1157457edba8 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:16.197033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff331b-0fea-4aaa-a81c-1157457edba8 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:16.197306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff331b-0fea-4aaa-a81c-1157457edba8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:16.200698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:16.211723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff331b-0fea-4aaa-a81c-1157457edba8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:16.213660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff331b-0fea-4aaa-a81c-1157457edba8 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:16.229159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-46ff331b-0fea-4aaa-a81c-1157457edba8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:16.229159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:16.229159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:16.229159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:16.229159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:16.229159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:16.229159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:16.229159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:16.229159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:16.229159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:16.229159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:16.229159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:16.229159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:16.229159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:16.229159 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:16.230165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:16.230165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:16.230165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:16.230165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:16.230165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:16.230165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:16.230165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:16.230165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:16.230165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:16.230165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:16.230165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:16.230165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:16.230165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:16.230165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:16.230165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:16.230165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:16.230165 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:16.231071 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:16.231071 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:16.231071 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:16.231071 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:16.231071 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:16.231071 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:16.231071 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:16.231071 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:16.231071 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 371/744] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:16.234055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff331b-0fea-4aaa-a81c-1157457edba8 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:16.309861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c5006-60fb-4dd9-acd9-19c8d4208394 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:16.352324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd0371-c6aa-4da1-b4c7-24c43cb6413e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:16.352565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff331b-0fea-4aaa-a81c-1157457edba8 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:16.352936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd0371-c6aa-4da1-b4c7-24c43cb6413e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:16.353214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd0371-c6aa-4da1-b4c7-24c43cb6413e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:16.353486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd0371-c6aa-4da1-b4c7-24c43cb6413e None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:16.354343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd0371-c6aa-4da1-b4c7-24c43cb6413e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:16.356232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd0371-c6aa-4da1-b4c7-24c43cb6413e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:16.356477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd0371-c6aa-4da1-b4c7-24c43cb6413e None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:16.368544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:16.374142 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 374/745] 10.222.0.76 () {56 vars in 1149 bytes} [Sat Aug 27 04:18:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:16.375235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edb86b-6c22-45dd-91d8-ee2820ed93cf None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:16.375524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edb86b-6c22-45dd-91d8-ee2820ed93cf None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:16.375797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edb86b-6c22-45dd-91d8-ee2820ed93cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:16.393065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b687b5c-3cb3-4da6-94f3-0aa209c25531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:16.393717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b687b5c-3cb3-4da6-94f3-0aa209c25531 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:16.393998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b687b5c-3cb3-4da6-94f3-0aa209c25531 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:16.394263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b687b5c-3cb3-4da6-94f3-0aa209c25531 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:16.394375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f4edb86b-6c22-45dd-91d8-ee2820ed93cf None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:16.395591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f4edb86b-6c22-45dd-91d8-ee2820ed93cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:16.406043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b687b5c-3cb3-4da6-94f3-0aa209c25531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:16.410926 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-0b687b5c-3cb3-4da6-94f3-0aa209c25531 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:18:16.410926 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:16.410926 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:16.410926 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:16.410926 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:16.410926 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:16.410926 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:16.410926 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:16.410926 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:16.410926 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:16.410926 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:16.410926 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:16.410926 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:16.410926 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:16.410926 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:16.410926 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:16.411893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:16.411893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:16.411893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:16.411893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:16.411893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:16.411893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:16.411893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:16.411893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:16.411893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:16.411893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:16.411893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:16.411893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:16.411893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:16.411893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:16.411893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:16.411893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:16.412804 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:16.412804 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:16.412804 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:16.412804 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:16.412804 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:16.412804 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:16.412804 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:16.412804 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:16.412804 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:16.412804 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:16.412804 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:18:16.412804 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:16.412804 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 372/746] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:18:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:16.413496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b687b5c-3cb3-4da6-94f3-0aa209c25531 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:16.475710 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 375/747] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:18:16.481403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edb86b-6c22-45dd-91d8-ee2820ed93cf None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:16.493040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:16.524084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b687b5c-3cb3-4da6-94f3-0aa209c25531 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:16.562766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4098cbd-bdf9-4d4a-a774-cb89eeff72d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:16.563337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098cbd-bdf9-4d4a-a774-cb89eeff72d6 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:16.563628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098cbd-bdf9-4d4a-a774-cb89eeff72d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:16.563903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098cbd-bdf9-4d4a-a774-cb89eeff72d6 None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:16.564849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4098cbd-bdf9-4d4a-a774-cb89eeff72d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:16.564959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4098cbd-bdf9-4d4a-a774-cb89eeff72d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:16.566374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4098cbd-bdf9-4d4a-a774-cb89eeff72d6 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:16.580369 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 373/748] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:16.581282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4098cbd-bdf9-4d4a-a774-cb89eeff72d6 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:16.615957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:16.620956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edb86b-6c22-45dd-91d8-ee2820ed93cf None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:16.665449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856509d-a766-4597-959f-c74c4e760a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:16.666443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856509d-a766-4597-959f-c74c4e760a31 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:16.666920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856509d-a766-4597-959f-c74c4e760a31 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:16.667983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856509d-a766-4597-959f-c74c4e760a31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:16.700790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4098cbd-bdf9-4d4a-a774-cb89eeff72d6 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:16.738249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631b4c5-8a0a-4fae-8c63-2a1abdb873f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:16.739171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631b4c5-8a0a-4fae-8c63-2a1abdb873f7 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:16.739671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631b4c5-8a0a-4fae-8c63-2a1abdb873f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:16.740152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631b4c5-8a0a-4fae-8c63-2a1abdb873f7 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:16.741099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631b4c5-8a0a-4fae-8c63-2a1abdb873f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:16.741612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631b4c5-8a0a-4fae-8c63-2a1abdb873f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:16.743279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631b4c5-8a0a-4fae-8c63-2a1abdb873f7 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:16.751728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856509d-a766-4597-959f-c74c4e760a31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:16.753310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856509d-a766-4597-959f-c74c4e760a31 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:16.753681 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 374/749] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:18:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:16.754648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631b4c5-8a0a-4fae-8c63-2a1abdb873f7 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:16.763124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:16.863807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:16.868777 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 376/750] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:18:16 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:16.869442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856509d-a766-4597-959f-c74c4e760a31 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:16.871065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631b4c5-8a0a-4fae-8c63-2a1abdb873f7 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:16.907459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6c1bc-dc64-4c49-bdb1-1dcb71f53ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:16.908052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6c1bc-dc64-4c49-bdb1-1dcb71f53ecb None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:16.908359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6c1bc-dc64-4c49-bdb1-1dcb71f53ecb None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:16.908629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6c1bc-dc64-4c49-bdb1-1dcb71f53ecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:16.909349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6c1bc-dc64-4c49-bdb1-1dcb71f53ecb None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=cc067131b0d84c7c9da1a33ecb7a9d02) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:16.909649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6c1bc-dc64-4c49-bdb1-1dcb71f53ecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:16.911064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6c1bc-dc64-4c49-bdb1-1dcb71f53ecb None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:16.924191 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 375/751] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:18:16 2022] GET /identity/v3/role_assignments?user.id=cc067131b0d84c7c9da1a33ecb7a9d02&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:16.924191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6c1bc-dc64-4c49-bdb1-1dcb71f53ecb None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:16.999494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856509d-a766-4597-959f-c74c4e760a31 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:17.008873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:17.041732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519cec8-3bac-4b1f-906a-6ae88676b769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:17.043364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519cec8-3bac-4b1f-906a-6ae88676b769 None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:17.043654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519cec8-3bac-4b1f-906a-6ae88676b769 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:17.044048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519cec8-3bac-4b1f-906a-6ae88676b769 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:17.045028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519cec8-3bac-4b1f-906a-6ae88676b769 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:17.047014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519cec8-3bac-4b1f-906a-6ae88676b769 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:17.067095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6c1bc-dc64-4c49-bdb1-1dcb71f53ecb None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:17.106430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769504cf-0b3a-41fd-b2a1-92bd31f1d505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:17.106752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769504cf-0b3a-41fd-b2a1-92bd31f1d505 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:17.107022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769504cf-0b3a-41fd-b2a1-92bd31f1d505 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:17.107295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769504cf-0b3a-41fd-b2a1-92bd31f1d505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:17.119458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769504cf-0b3a-41fd-b2a1-92bd31f1d505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:17.121847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769504cf-0b3a-41fd-b2a1-92bd31f1d505 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:17.136719 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 377/752] 10.222.0.76 () {60 vars in 1141 bytes} [Sat Aug 27 04:18:16 2022] POST /identity/v3/services => generated 240 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:18:17.138221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519cec8-3bac-4b1f-906a-6ae88676b769 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:17.140234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-769504cf-0b3a-41fd-b2a1-92bd31f1d505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:17.140234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:17.140234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:17.140234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:17.140234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:17.140234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:17.140234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:17.140234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:17.140234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:17.140234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:17.140234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:17.140234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:17.140234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:17.140234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:17.140234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:17.140234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:17.141207 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:17.141207 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:17.141207 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:17.141207 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:17.141207 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:17.141207 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:17.141207 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:17.141207 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:17.141207 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:17.141207 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:17.141207 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:17.141207 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:17.141207 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:17.141207 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:17.141207 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:17.141207 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:17.141207 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:17.142098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:17.142098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:17.142098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:17.142098 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 376/753] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:17.147649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769504cf-0b3a-41fd-b2a1-92bd31f1d505 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:17.165407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:17.331331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769504cf-0b3a-41fd-b2a1-92bd31f1d505 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:17.361751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519cec8-3bac-4b1f-906a-6ae88676b769 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:17.377330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7e4c1-dd1f-42a3-bcaa-84828662d044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:17.377950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7e4c1-dd1f-42a3-bcaa-84828662d044 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:17.378233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7e4c1-dd1f-42a3-bcaa-84828662d044 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:17.378510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7e4c1-dd1f-42a3-bcaa-84828662d044 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:17.379566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7e4c1-dd1f-42a3-bcaa-84828662d044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:17.380151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7e4c1-dd1f-42a3-bcaa-84828662d044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:17.381733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7e4c1-dd1f-42a3-bcaa-84828662d044 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:17.399456 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 377/754] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:17.404807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7e4c1-dd1f-42a3-bcaa-84828662d044 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:17.405727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34c283-0259-4809-a50a-85bbd187d7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:17.406378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34c283-0259-4809-a50a-85bbd187d7ae None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:17.406652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34c283-0259-4809-a50a-85bbd187d7ae None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:17.406916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34c283-0259-4809-a50a-85bbd187d7ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:17.419667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34c283-0259-4809-a50a-85bbd187d7ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:17.421224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34c283-0259-4809-a50a-85bbd187d7ae None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:17.438707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-fd34c283-0259-4809-a50a-85bbd187d7ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:17.438707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:17.438707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:17.438707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:17.438707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:17.438707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:17.438707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:17.438707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:17.438707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:17.438707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:17.438707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:17.438707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:17.438707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:17.438707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:17.438707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:17.438707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:17.439691 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:17.439691 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:17.439691 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:17.439691 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:17.439691 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:17.439691 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:17.439691 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:17.439691 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:17.439691 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:17.439691 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:17.439691 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:17.439691 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:17.439691 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:17.439691 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:17.439691 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:17.439691 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:17.439691 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:17.440610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:17.440610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:17.440610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:17.440610 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 378/755] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:17.446824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34c283-0259-4809-a50a-85bbd187d7ae None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:17.469115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:17.491084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:17.534647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7e4c1-dd1f-42a3-bcaa-84828662d044 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:17.599448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b07f2-5461-4b90-94f6-fd2f31435710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:17.600003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b07f2-5461-4b90-94f6-fd2f31435710 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:17.600307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b07f2-5461-4b90-94f6-fd2f31435710 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:17.600575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b07f2-5461-4b90-94f6-fd2f31435710 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:17.616401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b07f2-5461-4b90-94f6-fd2f31435710 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:17.617861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b07f2-5461-4b90-94f6-fd2f31435710 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:17.630406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34c283-0259-4809-a50a-85bbd187d7ae None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:17.640534 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-197b07f2-5461-4b90-94f6-fd2f31435710 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:18:17.640534 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:17.640534 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:17.640534 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:17.640534 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:17.640534 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:17.640534 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:17.640534 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:17.640534 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:17.640534 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:17.640534 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:17.640534 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:17.640534 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:17.640534 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:17.640534 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:17.640534 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:17.642360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:17.643299 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:17.643299 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:17.643299 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:17.643299 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:17.643299 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:17.643299 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:17.643299 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:17.643299 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:17.643299 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:18:17.643299 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:17.643299 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 378/756] 10.222.0.76 () {56 vars in 1093 bytes} [Sat Aug 27 04:18:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:17.656593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b07f2-5461-4b90-94f6-fd2f31435710 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:17.684613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2111b-1ed9-47da-8e9b-d994a185384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:17.685221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2111b-1ed9-47da-8e9b-d994a185384a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:17.686235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2111b-1ed9-47da-8e9b-d994a185384a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:17.686506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2111b-1ed9-47da-8e9b-d994a185384a None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:17.687143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2111b-1ed9-47da-8e9b-d994a185384a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:17.687442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2111b-1ed9-47da-8e9b-d994a185384a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:17.688833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2111b-1ed9-47da-8e9b-d994a185384a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:17.713622 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 379/757] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:17.720151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2111b-1ed9-47da-8e9b-d994a185384a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:17.824943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:17.854132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b07f2-5461-4b90-94f6-fd2f31435710 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:17.869711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2111b-1ed9-47da-8e9b-d994a185384a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:17.913156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:17.924886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36287477-1b18-4b05-a574-f38ccc0162a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:17.929852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36287477-1b18-4b05-a574-f38ccc0162a5 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:17.929852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36287477-1b18-4b05-a574-f38ccc0162a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:17.929852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36287477-1b18-4b05-a574-f38ccc0162a5 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:17.929852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36287477-1b18-4b05-a574-f38ccc0162a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:17.929852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36287477-1b18-4b05-a574-f38ccc0162a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:17.929852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36287477-1b18-4b05-a574-f38ccc0162a5 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:17.931585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea98071-48d6-4c32-b2b4-410df6ba6485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:17.932232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea98071-48d6-4c32-b2b4-410df6ba6485 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:17.932509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea98071-48d6-4c32-b2b4-410df6ba6485 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:17.932830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea98071-48d6-4c32-b2b4-410df6ba6485 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:17.947225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea98071-48d6-4c32-b2b4-410df6ba6485 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:17.948730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea98071-48d6-4c32-b2b4-410df6ba6485 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:17.966429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-9ea98071-48d6-4c32-b2b4-410df6ba6485 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:17.966429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:17.966429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:17.966429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:17.966429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:17.966429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:17.966429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:17.966429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:17.966429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:17.966429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:17.966429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:17.966429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:17.966429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:17.966429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:17.966429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:17.967322 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:17.967322 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:17.967322 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:17.967322 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:17.967322 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:17.967322 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:17.967322 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:17.967322 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:17.967322 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:17.967322 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:17.967322 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:17.967322 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:17.967322 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:17.967322 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:17.967322 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:17.967322 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:17.967322 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:17.968265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:17.968265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:17.968265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:17.968265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:17.968265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:17.968265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:17.968265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:17.968265 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:17.969744 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 379/758] 10.222.0.76 () {56 vars in 1133 bytes} [Sat Aug 27 04:18:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:17.969937 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 380/759] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:17.974965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36287477-1b18-4b05-a574-f38ccc0162a5 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:17.978391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea98071-48d6-4c32-b2b4-410df6ba6485 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:18.098523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea98071-48d6-4c32-b2b4-410df6ba6485 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:18.139720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e1007-d146-489b-b9a7-ea840fc101e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:18.140294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e1007-d146-489b-b9a7-ea840fc101e3 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:18.141968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e1007-d146-489b-b9a7-ea840fc101e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:18.142242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e1007-d146-489b-b9a7-ea840fc101e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:18.145095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:18.159751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36287477-1b18-4b05-a574-f38ccc0162a5 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:18.172512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e1007-d146-489b-b9a7-ea840fc101e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:18.173974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e1007-d146-489b-b9a7-ea840fc101e3 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:18.202034 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-e86e1007-d146-489b-b9a7-ea840fc101e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:18.202034 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:18.202034 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:18.202034 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:18.202034 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:18.202034 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:18.202034 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:18.202034 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:18.202034 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:18.202034 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:18.202034 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:18.202034 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:18.202034 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:18.202034 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:18.202034 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:18.202034 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:18.203071 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:18.203071 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:18.203071 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:18.203071 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:18.203071 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:18.203071 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:18.203071 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:18.203071 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:18.203071 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:18.203071 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:18.203071 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:18.203071 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:18.203071 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:18.203071 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:18.203071 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:18.203071 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:18.203071 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:18.203968 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:18.203968 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:18.203968 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:18.203968 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 381/760] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:18.209172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e1007-d146-489b-b9a7-ea840fc101e3 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:18.230790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15184025-ccb7-46a0-96e7-8f4ef97d5de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:18.231415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15184025-ccb7-46a0-96e7-8f4ef97d5de0 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:18.231691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15184025-ccb7-46a0-96e7-8f4ef97d5de0 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:18.231958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15184025-ccb7-46a0-96e7-8f4ef97d5de0 None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:18.232708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15184025-ccb7-46a0-96e7-8f4ef97d5de0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:18.233012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15184025-ccb7-46a0-96e7-8f4ef97d5de0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:18.234518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15184025-ccb7-46a0-96e7-8f4ef97d5de0 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:18.261678 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 380/761] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:18.267700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15184025-ccb7-46a0-96e7-8f4ef97d5de0 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:18.347390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:18.389090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e1007-d146-489b-b9a7-ea840fc101e3 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:18.405236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15184025-ccb7-46a0-96e7-8f4ef97d5de0 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:18.439687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a099d19-05ec-4fd5-893f-fb7fe30d1c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:18.440314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a099d19-05ec-4fd5-893f-fb7fe30d1c6a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:18.440593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a099d19-05ec-4fd5-893f-fb7fe30d1c6a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:18.441038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a099d19-05ec-4fd5-893f-fb7fe30d1c6a None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:18.441685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a099d19-05ec-4fd5-893f-fb7fe30d1c6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:18.441987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a099d19-05ec-4fd5-893f-fb7fe30d1c6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:18.443344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a099d19-05ec-4fd5-893f-fb7fe30d1c6a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:18.447738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98f932-ba02-4e03-9dd8-7be4a2ecd67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:18.448899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98f932-ba02-4e03-9dd8-7be4a2ecd67e None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:18.449187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98f932-ba02-4e03-9dd8-7be4a2ecd67e None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:18.449562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98f932-ba02-4e03-9dd8-7be4a2ecd67e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:18.450357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98f932-ba02-4e03-9dd8-7be4a2ecd67e None admin] RBAC: Adding query filter params (role.id=127770d936b94a5da885e721233e7f7b, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=7aa8f9ba9e854c7abc4237eb72c55590) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:18.450660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98f932-ba02-4e03-9dd8-7be4a2ecd67e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:18.453036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98f932-ba02-4e03-9dd8-7be4a2ecd67e None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:18.456127 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 382/762] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:18.457592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20fc2c-6f3b-495a-b7fe-26df21ef49f9 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:18.457952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20fc2c-6f3b-495a-b7fe-26df21ef49f9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:18.458302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20fc2c-6f3b-495a-b7fe-26df21ef49f9 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:18.459706 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 383/763] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:18.463755 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 381/764] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:18:18 2022] GET /identity/v3/role_assignments?user.id=7aa8f9ba9e854c7abc4237eb72c55590&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=127770d936b94a5da885e721233e7f7b => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:18.465013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20fc2c-6f3b-495a-b7fe-26df21ef49f9 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:18.466506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608162bc-fa02-481f-9b4e-5334d797f16a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:18.466861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608162bc-fa02-481f-9b4e-5334d797f16a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:18.467232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608162bc-fa02-481f-9b4e-5334d797f16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:18.505059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-608162bc-fa02-481f-9b4e-5334d797f16a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:18.510298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-608162bc-fa02-481f-9b4e-5334d797f16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:18.560543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:18.644456 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 382/765] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:18.649651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20fc2c-6f3b-495a-b7fe-26df21ef49f9 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:18.686369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936054a-52a3-47d3-836a-db79757501c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:18.687353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936054a-52a3-47d3-836a-db79757501c8 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:18.687907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936054a-52a3-47d3-836a-db79757501c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:18.688412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936054a-52a3-47d3-836a-db79757501c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:18.703111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936054a-52a3-47d3-836a-db79757501c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:18.704957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936054a-52a3-47d3-836a-db79757501c8 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:18.721216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-6936054a-52a3-47d3-836a-db79757501c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:18.721216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:18.721216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:18.721216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:18.721216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:18.721216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:18.721216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:18.721216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:18.721216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:18.721216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:18.721216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:18.721216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:18.721216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:18.721216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:18.721216 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:18.722117 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:18.722117 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:18.722117 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:18.722117 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:18.722117 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:18.722117 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:18.722117 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:18.722117 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:18.722117 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:18.722117 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:18.722117 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:18.722117 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:18.722117 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:18.722117 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:18.722117 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:18.722117 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:18.722117 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:18.723097 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:18.723097 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:18.723097 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:18.723097 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:18.723097 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:18.723097 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:18.723097 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:18.723097 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:18.725505 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 384/766] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:18.730817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608162bc-fa02-481f-9b4e-5334d797f16a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:18.808337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:18.882848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608162bc-fa02-481f-9b4e-5334d797f16a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:18.930082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ea6e-c0a9-49ae-99cc-fc7165e5dda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:18.930688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ea6e-c0a9-49ae-99cc-fc7165e5dda7 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:18.930961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ea6e-c0a9-49ae-99cc-fc7165e5dda7 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:18.931225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ea6e-c0a9-49ae-99cc-fc7165e5dda7 None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:18.931909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785ea6e-c0a9-49ae-99cc-fc7165e5dda7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:18.932227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785ea6e-c0a9-49ae-99cc-fc7165e5dda7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:18.933748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785ea6e-c0a9-49ae-99cc-fc7165e5dda7 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:18.955582 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 383/767] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:18.968271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936054a-52a3-47d3-836a-db79757501c8 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:19.061975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ea6e-c0a9-49ae-99cc-fc7165e5dda7 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:19.150287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936054a-52a3-47d3-836a-db79757501c8 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:19.160851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:19.189327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7868c4b-7b4a-4c4e-b533-87a81365c099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:19.190374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7868c4b-7b4a-4c4e-b533-87a81365c099 None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:19.190915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7868c4b-7b4a-4c4e-b533-87a81365c099 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:19.191381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7868c4b-7b4a-4c4e-b533-87a81365c099 None admin] PATH_INFO: `/v3/projects/5632b718c3aa48458247661045e99e5f/users/0e5ddcf00a184aa0ac0e7194f1c72425/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:19.193764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7868c4b-7b4a-4c4e-b533-87a81365c099 None admin] RBAC: Authorizing `identity:create_grant(project_id=5632b718c3aa48458247661045e99e5f, user_id=0e5ddcf00a184aa0ac0e7194f1c72425, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:19.195432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7868c4b-7b4a-4c4e-b533-87a81365c099 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:19.206665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ea6e-c0a9-49ae-99cc-fc7165e5dda7 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:19.208362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:19.241273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c916cc5-4282-480d-a2fd-1c028cf5523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:19.241890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c916cc5-4282-480d-a2fd-1c028cf5523b None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:19.242217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c916cc5-4282-480d-a2fd-1c028cf5523b None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:19.242483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c916cc5-4282-480d-a2fd-1c028cf5523b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:19.243053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c916cc5-4282-480d-a2fd-1c028cf5523b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:19.244505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c916cc5-4282-480d-a2fd-1c028cf5523b None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:19.253616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-4c916cc5-4282-480d-a2fd-1c028cf5523b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 04:18:19.253616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:19.253616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:19.253616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:19.253616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:19.253616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:19.253616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:19.253616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:19.253616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 04:18:19.253616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:19.253616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:19.253616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:19.253616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:19.253616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:19.253616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:19.253616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:19.253616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:19.254709 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:19.254709 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:19.254709 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:19.254709 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:19.254709 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:19.254709 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:19.254709 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:19.254709 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:19.254709 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:19.254709 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:19.254709 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:19.254709 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:19.254709 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:19.254709 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:19.254709 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:19.254709 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:19.255560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:19.255560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:19.255560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:19.255560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:19.255560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:19.255560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:19.255560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:19.255560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:19.255560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:19.255560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:19.255560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:19.255560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:19.255560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 04:18:19.255560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:19.255560 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 384/768] 10.222.0.76 () {56 vars in 1129 bytes} [Sat Aug 27 04:18:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:19.257012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824beb5-ac6b-4d85-9942-d93f616bae99 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:19.257095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824beb5-ac6b-4d85-9942-d93f616bae99 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:19.257374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824beb5-ac6b-4d85-9942-d93f616bae99 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:19.263487 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 385/769] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:19.264566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824beb5-ac6b-4d85-9942-d93f616bae99 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:19.316707 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 385/770] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:18:18 2022] PUT /identity/v3/projects/5632b718c3aa48458247661045e99e5f/users/0e5ddcf00a184aa0ac0e7194f1c72425/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:18:19.319195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c861f-62cc-4afc-a1a4-ae3595d8e075 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:19.319959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c861f-62cc-4afc-a1a4-ae3595d8e075 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:19.321897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c861f-62cc-4afc-a1a4-ae3595d8e075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:19.365480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-fe2c861f-62cc-4afc-a1a4-ae3595d8e075 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:19.368952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fe2c861f-62cc-4afc-a1a4-ae3595d8e075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:19.407387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824beb5-ac6b-4d85-9942-d93f616bae99 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:19.446439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ca798-84cd-4328-b3e2-3c789a932e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:19.447053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ca798-84cd-4328-b3e2-3c789a932e59 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:19.447330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ca798-84cd-4328-b3e2-3c789a932e59 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:19.447630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ca798-84cd-4328-b3e2-3c789a932e59 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:19.448841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ca798-84cd-4328-b3e2-3c789a932e59 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:19.449205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ca798-84cd-4328-b3e2-3c789a932e59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:19.450896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ca798-84cd-4328-b3e2-3c789a932e59 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:19.456603 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 386/771] 10.222.0.76 () {56 vars in 1124 bytes} [Sat Aug 27 04:18:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:19.463805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ca798-84cd-4328-b3e2-3c789a932e59 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:19.514435 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 386/772] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:19.516930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d51297-7cd5-48e6-a05a-4e858e4ea649 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:19.517520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d51297-7cd5-48e6-a05a-4e858e4ea649 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:19.517962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d51297-7cd5-48e6-a05a-4e858e4ea649 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:19.519697 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 387/773] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:19.521067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:19.526661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cef52-8f4f-427e-a4a6-d4779a06feec None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:19.527192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cef52-8f4f-427e-a4a6-d4779a06feec None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:19.527707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cef52-8f4f-427e-a4a6-d4779a06feec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:19.548912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8f7cef52-8f4f-427e-a4a6-d4779a06feec None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:19.550394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8f7cef52-8f4f-427e-a4a6-d4779a06feec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:19.609381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ca798-84cd-4328-b3e2-3c789a932e59 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:19.646839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4aa320-bdf0-472d-be12-b9f520f577c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:19.648704 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 388/774] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:18:19.648979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4aa320-bdf0-472d-be12-b9f520f577c0 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:19.649334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4aa320-bdf0-472d-be12-b9f520f577c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:19.652433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4aa320-bdf0-472d-be12-b9f520f577c0 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:19.653391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4aa320-bdf0-472d-be12-b9f520f577c0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:19.653864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4aa320-bdf0-472d-be12-b9f520f577c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:19.655410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4aa320-bdf0-472d-be12-b9f520f577c0 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:19.661200 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 387/775] 10.222.0.76 () {56 vars in 1124 bytes} [Sat Aug 27 04:18:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:19.669249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cef52-8f4f-427e-a4a6-d4779a06feec None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:19.698813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:19.799473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cef52-8f4f-427e-a4a6-d4779a06feec None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:19.847838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cab566-a16c-4aeb-84df-633dd0f41b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:19.848500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cab566-a16c-4aeb-84df-633dd0f41b3c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:19.848774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cab566-a16c-4aeb-84df-633dd0f41b3c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:19.849044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cab566-a16c-4aeb-84df-633dd0f41b3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:19.849766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cab566-a16c-4aeb-84df-633dd0f41b3c None admin] RBAC: Adding query filter params (interface=public, service_id=bf5f08824d03414fae8823363b769e3d, region_id=RegionOne) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:19.850071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cab566-a16c-4aeb-84df-633dd0f41b3c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:19.851468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cab566-a16c-4aeb-84df-633dd0f41b3c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:19.862747 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 389/776] 10.222.0.76 () {56 vars in 1251 bytes} [Sat Aug 27 04:18:19 2022] GET /identity/v3/endpoints?service_id=bf5f08824d03414fae8823363b769e3d&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:19.865008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4aa320-bdf0-472d-be12-b9f520f577c0 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:19.877596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cab566-a16c-4aeb-84df-633dd0f41b3c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:20.013541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:20.026251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cab566-a16c-4aeb-84df-633dd0f41b3c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:20.031894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:20.039195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4aa320-bdf0-472d-be12-b9f520f577c0 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:20.071631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54752a62-ae82-4394-b6e7-2fdc2f9684ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:20.072562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54752a62-ae82-4394-b6e7-2fdc2f9684ac None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:20.072995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54752a62-ae82-4394-b6e7-2fdc2f9684ac None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:20.074620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54752a62-ae82-4394-b6e7-2fdc2f9684ac None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:20.075523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54752a62-ae82-4394-b6e7-2fdc2f9684ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:20.077295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54752a62-ae82-4394-b6e7-2fdc2f9684ac None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:20.080534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be85b7-5c25-4c1a-83ae-172c3166f405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:20.081441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be85b7-5c25-4c1a-83ae-172c3166f405 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:20.081722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be85b7-5c25-4c1a-83ae-172c3166f405 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:20.081998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be85b7-5c25-4c1a-83ae-172c3166f405 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:20.084560 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 390/777] 10.222.0.76 () {56 vars in 1087 bytes} [Sat Aug 27 04:18:19 2022] GET /identity/v3/services => generated 772 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:20.085504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54752a62-ae82-4394-b6e7-2fdc2f9684ac None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:20.111510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be85b7-5c25-4c1a-83ae-172c3166f405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:20.117273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-a9be85b7-5c25-4c1a-83ae-172c3166f405 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:18:20.117273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:20.117273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:20.117273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:20.117273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:20.117273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:20.117273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:20.117273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:20.117273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:20.117273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:20.117273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:20.117273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:20.117273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:20.117273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:20.117273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:20.117273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:20.118489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:20.118489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:20.118489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:20.118489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:20.118489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:20.118489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:20.118489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:20.118489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:20.118489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:20.118489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:20.118489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:20.118489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:20.118489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:20.118489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:20.118489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:20.118489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:20.119398 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:20.119398 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:20.119398 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:20.119398 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:20.119398 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:20.119398 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:20.119398 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:20.119398 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:20.119398 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:20.119398 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:20.119398 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:18:20.119398 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:20.124872 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 388/778] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:18:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:20.131201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be85b7-5c25-4c1a-83ae-172c3166f405 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:20.281839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54752a62-ae82-4394-b6e7-2fdc2f9684ac None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:20.303317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be85b7-5c25-4c1a-83ae-172c3166f405 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:20.321554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c607eb-b40c-40e9-b9b8-889c423f0761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:20.322587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c607eb-b40c-40e9-b9b8-889c423f0761 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:20.323064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c607eb-b40c-40e9-b9b8-889c423f0761 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:20.324259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c607eb-b40c-40e9-b9b8-889c423f0761 None admin] PATH_INFO: `/v3/services/network` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:20.325287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c607eb-b40c-40e9-b9b8-889c423f0761 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:20.326884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c607eb-b40c-40e9-b9b8-889c423f0761 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:20.339085 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-34c607eb-b40c-40e9-b9b8-889c423f0761 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 04:18:20.339085 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:20.339085 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:20.339085 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:20.339085 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:20.339085 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:20.339085 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:20.339085 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:20.339085 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 04:18:20.339085 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:20.339085 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:20.339085 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:20.339085 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:20.339085 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:20.339085 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:20.339085 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:20.339085 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:20.340143 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:20.340143 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:20.340143 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:20.340143 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:20.340143 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:20.340143 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:20.340143 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:20.340143 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:20.340143 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:20.340143 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:20.340143 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:20.340143 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:20.340143 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:20.340143 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:20.340143 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:20.340143 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:20.341037 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:20.341037 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:20.341037 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:20.341037 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:20.341037 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:20.341037 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:20.341037 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:20.341037 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:20.341037 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:20.341037 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:20.341037 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:20.341037 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:20.341037 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 04:18:20.341037 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:20.342376 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 391/779] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:20 2022] GET /identity/v3/services/network => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:20.346627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c607eb-b40c-40e9-b9b8-889c423f0761 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:20.348299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ddda9-7764-44de-a9e0-7da7137e5bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:20.348928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ddda9-7764-44de-a9e0-7da7137e5bfc None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:20.349213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ddda9-7764-44de-a9e0-7da7137e5bfc None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:20.349480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ddda9-7764-44de-a9e0-7da7137e5bfc None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:20.350140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ddda9-7764-44de-a9e0-7da7137e5bfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:20.350439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ddda9-7764-44de-a9e0-7da7137e5bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:20.351866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ddda9-7764-44de-a9e0-7da7137e5bfc None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:20.371823 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 389/780] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:18:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:20.379207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:20.379923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ddda9-7764-44de-a9e0-7da7137e5bfc None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:20.401070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:20.502828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c607eb-b40c-40e9-b9b8-889c423f0761 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:20.509140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ddda9-7764-44de-a9e0-7da7137e5bfc None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:20.564189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a54a8-7475-4ba4-84c8-d8a76573dec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:20.564189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a54a8-7475-4ba4-84c8-d8a76573dec6 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:20.564189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a54a8-7475-4ba4-84c8-d8a76573dec6 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:20.564189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a54a8-7475-4ba4-84c8-d8a76573dec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:20.584471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a54a8-7475-4ba4-84c8-d8a76573dec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:20.587746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a54a8-7475-4ba4-84c8-d8a76573dec6 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:20.589439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc63db-1883-4ecc-bc0a-f23cb77ab707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:20.590143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc63db-1883-4ecc-bc0a-f23cb77ab707 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:20.590417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc63db-1883-4ecc-bc0a-f23cb77ab707 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:20.590684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc63db-1883-4ecc-bc0a-f23cb77ab707 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:20.591313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc63db-1883-4ecc-bc0a-f23cb77ab707 None admin] RBAC: Adding query filter params (name=network) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:20.591612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc63db-1883-4ecc-bc0a-f23cb77ab707 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:20.592989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc63db-1883-4ecc-bc0a-f23cb77ab707 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:20.599319 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 392/781] 10.222.0.76 () {56 vars in 1112 bytes} [Sat Aug 27 04:18:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:20.607367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc63db-1883-4ecc-bc0a-f23cb77ab707 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:20.628234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-281a54a8-7475-4ba4-84c8-d8a76573dec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:20.628234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:20.628234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:20.628234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:20.628234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:20.628234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:20.628234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:20.628234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:20.628234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:20.628234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:20.628234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:20.628234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:20.628234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:20.628234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:20.628234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:20.628234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:20.629360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:20.629360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:20.629360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:20.629360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:20.629360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:20.629360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:20.629360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:20.629360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:20.629360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:20.629360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:20.629360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:20.629360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:20.629360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:20.629360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:20.629360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:20.629360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:20.629360 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:20.630505 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:20.630505 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:20.630505 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:20.634989 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 390/782] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:20.641763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a54a8-7475-4ba4-84c8-d8a76573dec6 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:20.807667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:20.819020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:20.839197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc63db-1883-4ecc-bc0a-f23cb77ab707 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:20.865878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a54a8-7475-4ba4-84c8-d8a76573dec6 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:20.882733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b379f8-6980-4d21-afc5-42b7d13a17c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:20.883491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b379f8-6980-4d21-afc5-42b7d13a17c1 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:20.883832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b379f8-6980-4d21-afc5-42b7d13a17c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:20.884116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b379f8-6980-4d21-afc5-42b7d13a17c1 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:20.884785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b379f8-6980-4d21-afc5-42b7d13a17c1 None admin] RBAC: Adding query filter params (type=network) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:20.885138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b379f8-6980-4d21-afc5-42b7d13a17c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:20.887037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b379f8-6980-4d21-afc5-42b7d13a17c1 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:20.894041 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 393/783] 10.222.0.76 () {56 vars in 1112 bytes} [Sat Aug 27 04:18:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:20.895313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42e1c3-30c6-4863-b2b3-267b4214b29f None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:20.895603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42e1c3-30c6-4863-b2b3-267b4214b29f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:20.895884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42e1c3-30c6-4863-b2b3-267b4214b29f None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:20.897944 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 394/784] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:20.904880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8a79e-829f-4b97-9ebe-4cdde8d6c819 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:20.905709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8a79e-829f-4b97-9ebe-4cdde8d6c819 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:20.906047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8a79e-829f-4b97-9ebe-4cdde8d6c819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:20.928191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494d97c-2fc4-43d0-9a7b-8ba1d40dfd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:20.928191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494d97c-2fc4-43d0-9a7b-8ba1d40dfd9f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:20.928191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494d97c-2fc4-43d0-9a7b-8ba1d40dfd9f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:20.928191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494d97c-2fc4-43d0-9a7b-8ba1d40dfd9f None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:20.928612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494d97c-2fc4-43d0-9a7b-8ba1d40dfd9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:20.928612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494d97c-2fc4-43d0-9a7b-8ba1d40dfd9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:20.928736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-fca8a79e-829f-4b97-9ebe-4cdde8d6c819 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:20.928736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fca8a79e-829f-4b97-9ebe-4cdde8d6c819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:20.929069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494d97c-2fc4-43d0-9a7b-8ba1d40dfd9f None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:20.951261 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 391/785] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:20.952208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494d97c-2fc4-43d0-9a7b-8ba1d40dfd9f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:21.017639 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 395/786] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:21.018499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8a79e-829f-4b97-9ebe-4cdde8d6c819 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:21.132807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:21.139787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8a79e-829f-4b97-9ebe-4cdde8d6c819 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:21.182914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b22629-4003-44b4-a64e-da5cf465d0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:21.184115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b22629-4003-44b4-a64e-da5cf465d0a3 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:21.184952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b22629-4003-44b4-a64e-da5cf465d0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:21.185428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b22629-4003-44b4-a64e-da5cf465d0a3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:21.193530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b22629-4003-44b4-a64e-da5cf465d0a3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:21.195321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b22629-4003-44b4-a64e-da5cf465d0a3 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:21.209814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-11b22629-4003-44b4-a64e-da5cf465d0a3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:18:21.209814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:21.209814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:21.209814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:21.209814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:21.209814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:21.209814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:21.209814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:21.209814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:21.209814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:21.209814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:21.209814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:21.209814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:21.209814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:21.209814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:21.209814 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:21.210835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:21.211791 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:21.211791 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:21.211791 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:21.211791 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:21.211791 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:21.211791 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:21.211791 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:21.211791 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:21.211791 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:18:21.211791 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:21.215241 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 396/787] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:18:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:21.223122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494d97c-2fc4-43d0-9a7b-8ba1d40dfd9f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:21.224616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b22629-4003-44b4-a64e-da5cf465d0a3 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:21.265440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:21.320104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d8b97-95bf-4e57-83ae-a683daf63e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:21.321080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d8b97-95bf-4e57-83ae-a683daf63e25 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:21.321366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d8b97-95bf-4e57-83ae-a683daf63e25 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:21.321643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d8b97-95bf-4e57-83ae-a683daf63e25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:21.322825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d8b97-95bf-4e57-83ae-a683daf63e25 None admin] RBAC: Adding query filter params (interface=public, service_id=26290c3433d54e8db4fdc78c6a3e4916, region_id=RegionOne) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:21.323328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d8b97-95bf-4e57-83ae-a683daf63e25 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:21.324788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d8b97-95bf-4e57-83ae-a683daf63e25 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:21.354210 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 392/788] 10.222.0.76 () {56 vars in 1251 bytes} [Sat Aug 27 04:18:20 2022] GET /identity/v3/endpoints?service_id=26290c3433d54e8db4fdc78c6a3e4916&interface=public®ion_id=RegionOne => generated 194 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:21.359254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b22629-4003-44b4-a64e-da5cf465d0a3 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:21.360503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d8b97-95bf-4e57-83ae-a683daf63e25 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:21.419519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ab2e8-d54d-422b-a5e8-9f4113b706cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:21.420051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ab2e8-d54d-422b-a5e8-9f4113b706cf None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:21.420355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ab2e8-d54d-422b-a5e8-9f4113b706cf None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:21.420623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ab2e8-d54d-422b-a5e8-9f4113b706cf None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:21.421358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ab2e8-d54d-422b-a5e8-9f4113b706cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:21.421660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ab2e8-d54d-422b-a5e8-9f4113b706cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:21.423084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ab2e8-d54d-422b-a5e8-9f4113b706cf None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:21.436205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:21.445845 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 397/789] 10.222.0.76 () {56 vars in 1135 bytes} [Sat Aug 27 04:18:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:21.451883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ab2e8-d54d-422b-a5e8-9f4113b706cf None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:21.533371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d8b97-95bf-4e57-83ae-a683daf63e25 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:21.578768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6bff1-55ef-4c2b-9be7-941dcace2862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:21.579377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6bff1-55ef-4c2b-9be7-941dcace2862 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:21.579659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6bff1-55ef-4c2b-9be7-941dcace2862 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:21.579931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6bff1-55ef-4c2b-9be7-941dcace2862 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:21.580568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6bff1-55ef-4c2b-9be7-941dcace2862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:21.582026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6bff1-55ef-4c2b-9be7-941dcace2862 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:21.584573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ab2e8-d54d-422b-a5e8-9f4113b706cf None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:21.588125 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 393/790] 10.222.0.76 () {56 vars in 1087 bytes} [Sat Aug 27 04:18:21 2022] GET /identity/v3/services => generated 772 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:21.588773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6bff1-55ef-4c2b-9be7-941dcace2862 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:21.635640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db28821-4bf2-4e56-a44f-87f1088780f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:21.637371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db28821-4bf2-4e56-a44f-87f1088780f7 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:21.638202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db28821-4bf2-4e56-a44f-87f1088780f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:21.638984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db28821-4bf2-4e56-a44f-87f1088780f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:21.652535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:21.655247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db28821-4bf2-4e56-a44f-87f1088780f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:21.662620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-9db28821-4bf2-4e56-a44f-87f1088780f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:21.662620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:21.662620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:21.662620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:21.662620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:21.662620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:21.662620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:21.662620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:21.662620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:21.662620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:21.662620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:21.662620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:21.662620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:21.662620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:21.662620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:21.662620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:21.663944 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:21.663944 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:21.663944 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:21.663944 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:21.663944 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:21.663944 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:21.663944 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:21.663944 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:21.663944 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:21.663944 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:21.663944 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:21.663944 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:21.663944 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:21.663944 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:21.663944 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:21.663944 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:21.664843 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:21.664843 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:21.664843 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:21.664843 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:21.664843 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:21.664843 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:21.664843 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:21.664843 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:21.664843 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:21.664843 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:21.664843 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:21.664843 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:21.668584 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 398/791] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:18:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:21.677584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db28821-4bf2-4e56-a44f-87f1088780f7 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:21.714484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6bff1-55ef-4c2b-9be7-941dcace2862 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:21.750339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48a5bf-53f7-4c83-87fb-2f5ce30aee92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:21.751080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48a5bf-53f7-4c83-87fb-2f5ce30aee92 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:21.751432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48a5bf-53f7-4c83-87fb-2f5ce30aee92 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:21.751778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48a5bf-53f7-4c83-87fb-2f5ce30aee92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:21.764614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48a5bf-53f7-4c83-87fb-2f5ce30aee92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:21.766266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48a5bf-53f7-4c83-87fb-2f5ce30aee92 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:21.773105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:21.782712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-8b48a5bf-53f7-4c83-87fb-2f5ce30aee92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:21.782712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:21.782712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:21.782712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:21.782712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:21.782712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:21.782712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:21.782712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:21.782712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:21.782712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:21.782712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:21.782712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:21.782712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:21.782712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:21.782712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:21.782712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:21.790265 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:21.790265 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:21.790265 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:21.790265 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:21.790265 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:21.790265 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:21.790265 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:21.790265 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:21.790265 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:21.790265 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:21.790265 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:21.790265 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:21.790265 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:21.790265 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:21.790265 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:21.790265 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:21.790265 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:21.791219 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:21.791219 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:21.791219 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:21.791219 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 394/792] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:21.791219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72184e-3e23-4c7f-87eb-46f6adf07bc2 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:21.791219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72184e-3e23-4c7f-87eb-46f6adf07bc2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:21.791219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72184e-3e23-4c7f-87eb-46f6adf07bc2 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:21.791219 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 395/793] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:21.792580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72184e-3e23-4c7f-87eb-46f6adf07bc2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:21.838218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db28821-4bf2-4e56-a44f-87f1088780f7 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:21.884741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28edc25-75f0-4651-8b91-a393d17df1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:21.886550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28edc25-75f0-4651-8b91-a393d17df1d6 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:21.887165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28edc25-75f0-4651-8b91-a393d17df1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:21.887666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28edc25-75f0-4651-8b91-a393d17df1d6 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:21.888941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28edc25-75f0-4651-8b91-a393d17df1d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:21.889255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28edc25-75f0-4651-8b91-a393d17df1d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:21.890606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28edc25-75f0-4651-8b91-a393d17df1d6 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:21.902020 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 399/794] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:18:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:21.903698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624548a5-bc04-4e63-808f-226d9fc07553 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:21.903906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624548a5-bc04-4e63-808f-226d9fc07553 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:21.904134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624548a5-bc04-4e63-808f-226d9fc07553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:21.921258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72184e-3e23-4c7f-87eb-46f6adf07bc2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:21.922816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-624548a5-bc04-4e63-808f-226d9fc07553 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:21.924872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-624548a5-bc04-4e63-808f-226d9fc07553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:21.932157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:21.960128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1a020-999b-4d07-8788-4f0fd41638cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:21.961004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1a020-999b-4d07-8788-4f0fd41638cf None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:21.961424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1a020-999b-4d07-8788-4f0fd41638cf None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:21.961867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1a020-999b-4d07-8788-4f0fd41638cf None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:21.962769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1a020-999b-4d07-8788-4f0fd41638cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:21.963274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1a020-999b-4d07-8788-4f0fd41638cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:21.972782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1a020-999b-4d07-8788-4f0fd41638cf None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:21.981049 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 396/795] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:21.982064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1a020-999b-4d07-8788-4f0fd41638cf None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:22.019087 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 400/796] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:22.020649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624548a5-bc04-4e63-808f-226d9fc07553 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:22.087302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:22.103034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1a020-999b-4d07-8788-4f0fd41638cf None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:22.146586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624548a5-bc04-4e63-808f-226d9fc07553 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:22.148223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dabe90-620f-4376-90ac-95a31e76dcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:22.149020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dabe90-620f-4376-90ac-95a31e76dcbe None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:22.149507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dabe90-620f-4376-90ac-95a31e76dcbe None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:22.149992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dabe90-620f-4376-90ac-95a31e76dcbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:22.162491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dabe90-620f-4376-90ac-95a31e76dcbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:22.164464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dabe90-620f-4376-90ac-95a31e76dcbe None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:22.181796 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-28dabe90-620f-4376-90ac-95a31e76dcbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:22.181796 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:22.181796 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:22.181796 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:22.181796 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:22.181796 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:22.181796 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:22.181796 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:22.181796 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:22.181796 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:22.181796 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:22.181796 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:22.181796 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:22.181796 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:22.181796 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:22.181796 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:22.182988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:22.182988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:22.182988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:22.182988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:22.182988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:22.182988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:22.182988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:22.182988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:22.182988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:22.182988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:22.182988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:22.182988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:22.182988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:22.182988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:22.182988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:22.182988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:22.182988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:22.184043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:22.184043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:22.184043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:22.184998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287acb9-d62b-4630-ae11-02c35b950fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:22.185684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287acb9-d62b-4630-ae11-02c35b950fba None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:22.185902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287acb9-d62b-4630-ae11-02c35b950fba None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:22.186159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287acb9-d62b-4630-ae11-02c35b950fba None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:22.186310 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 397/797] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:22.193241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287acb9-d62b-4630-ae11-02c35b950fba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:22.194428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dabe90-620f-4376-90ac-95a31e76dcbe None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:22.194752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287acb9-d62b-4630-ae11-02c35b950fba None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:22.206763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-3287acb9-d62b-4630-ae11-02c35b950fba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:22.206763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:22.206763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:22.206763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:22.206763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:22.206763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:22.206763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:22.206763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:22.206763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:22.206763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:22.206763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:22.206763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:22.206763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:22.206763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:22.206763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:22.207957 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:22.207957 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:22.207957 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:22.207957 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:22.207957 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:22.207957 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:22.207957 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:22.207957 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:22.207957 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:22.207957 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:22.207957 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:22.207957 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:22.207957 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:22.207957 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:22.207957 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:22.207957 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:22.207957 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:22.209080 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:22.209080 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:22.209080 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:22.209080 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:22.209080 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:22.209080 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:22.209080 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:22.209080 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:22.209080 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 401/798] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:22.216758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287acb9-d62b-4630-ae11-02c35b950fba None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:22.240379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:22.349478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287acb9-d62b-4630-ae11-02c35b950fba None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:22.360255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:22.388323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030645d-1c09-4939-bc47-97493c4a776e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:22.389187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030645d-1c09-4939-bc47-97493c4a776e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:22.389558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030645d-1c09-4939-bc47-97493c4a776e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:22.389971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030645d-1c09-4939-bc47-97493c4a776e None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:22.390859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030645d-1c09-4939-bc47-97493c4a776e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:22.391229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030645d-1c09-4939-bc47-97493c4a776e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:22.392801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030645d-1c09-4939-bc47-97493c4a776e None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:22.407338 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 402/799] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:22.413163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030645d-1c09-4939-bc47-97493c4a776e None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:22.428910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dabe90-620f-4376-90ac-95a31e76dcbe None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:22.472862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8385f4-0c2a-4cb2-9b25-aac8a63f1be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:22.473818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8385f4-0c2a-4cb2-9b25-aac8a63f1be5 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:22.474301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8385f4-0c2a-4cb2-9b25-aac8a63f1be5 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:22.475359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8385f4-0c2a-4cb2-9b25-aac8a63f1be5 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:22.476539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8385f4-0c2a-4cb2-9b25-aac8a63f1be5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:22.477050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8385f4-0c2a-4cb2-9b25-aac8a63f1be5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:22.479628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8385f4-0c2a-4cb2-9b25-aac8a63f1be5 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:22.497272 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 398/800] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:22.498970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8385f4-0c2a-4cb2-9b25-aac8a63f1be5 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:22.527143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030645d-1c09-4939-bc47-97493c4a776e None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:22.571232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901698d-b748-4cc9-9242-8688f1c4b4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:22.572918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901698d-b748-4cc9-9242-8688f1c4b4b0 None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:22.573999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901698d-b748-4cc9-9242-8688f1c4b4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:22.574800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901698d-b748-4cc9-9242-8688f1c4b4b0 None admin] PATH_INFO: `/v3/projects/5632b718c3aa48458247661045e99e5f/users/cc067131b0d84c7c9da1a33ecb7a9d02/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:22.577955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901698d-b748-4cc9-9242-8688f1c4b4b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5632b718c3aa48458247661045e99e5f, user_id=cc067131b0d84c7c9da1a33ecb7a9d02, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:22.579568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901698d-b748-4cc9-9242-8688f1c4b4b0 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:22.597968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:22.616364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8385f4-0c2a-4cb2-9b25-aac8a63f1be5 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:22.650251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0791b6-fd8d-42c4-a475-94ec5667c605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:22.650903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0791b6-fd8d-42c4-a475-94ec5667c605 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:22.651183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0791b6-fd8d-42c4-a475-94ec5667c605 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:22.660450 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 403/801] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:18:22 2022] PUT /identity/v3/projects/5632b718c3aa48458247661045e99e5f/users/cc067131b0d84c7c9da1a33ecb7a9d02/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:18:22.660588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0791b6-fd8d-42c4-a475-94ec5667c605 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:22.660700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901698d-b748-4cc9-9242-8688f1c4b4b0 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:22.673019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0791b6-fd8d-42c4-a475-94ec5667c605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:22.678250 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-1d0791b6-fd8d-42c4-a475-94ec5667c605 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:18:22.678250 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:22.678250 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:22.678250 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:22.678250 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:22.678250 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:22.678250 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:22.678250 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:22.678250 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:22.678250 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:22.678250 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:22.678250 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:22.678250 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:22.678250 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:22.678250 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:22.678250 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:22.679245 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:22.679245 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:22.679245 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:22.679245 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:22.679245 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:22.679245 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:22.679245 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:22.679245 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:22.679245 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:22.679245 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:22.679245 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:22.679245 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:22.679245 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:22.679245 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:22.679245 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:22.679245 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:22.680072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:22.680072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:22.680072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:22.680072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:22.680072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:22.680072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:22.680072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:22.680072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:22.680072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:22.680072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:22.680072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:18:22.680072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:22.680072 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 399/802] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:18:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:22.680783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f95554-2f58-4536-b11b-2fd4f31bb4bb None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:22.681190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f95554-2f58-4536-b11b-2fd4f31bb4bb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:22.681379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f95554-2f58-4536-b11b-2fd4f31bb4bb None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:22.684145 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 400/803] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:22.687460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f95554-2f58-4536-b11b-2fd4f31bb4bb None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:22.702605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:22.798238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901698d-b748-4cc9-9242-8688f1c4b4b0 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:22.818600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f95554-2f58-4536-b11b-2fd4f31bb4bb None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:22.848660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03954e0-499c-43c5-9ca8-b23d405ccab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:22.849302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03954e0-499c-43c5-9ca8-b23d405ccab8 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:22.849664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03954e0-499c-43c5-9ca8-b23d405ccab8 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:22.849935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03954e0-499c-43c5-9ca8-b23d405ccab8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:22.858924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03954e0-499c-43c5-9ca8-b23d405ccab8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:22.859189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5c24a-ed22-4d79-a0f1-dd22d98c77e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:22.859801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5c24a-ed22-4d79-a0f1-dd22d98c77e5 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:22.860079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5c24a-ed22-4d79-a0f1-dd22d98c77e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:22.860380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5c24a-ed22-4d79-a0f1-dd22d98c77e5 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:22.860593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03954e0-499c-43c5-9ca8-b23d405ccab8 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:22.861041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5c24a-ed22-4d79-a0f1-dd22d98c77e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:22.861346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5c24a-ed22-4d79-a0f1-dd22d98c77e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:22.862711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5c24a-ed22-4d79-a0f1-dd22d98c77e5 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:22.872394 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 401/804] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:18:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:22.874265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae23d4d-cce9-491e-a408-ef1237ea915b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:22.874265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae23d4d-cce9-491e-a408-ef1237ea915b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:22.874265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae23d4d-cce9-491e-a408-ef1237ea915b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:22.874515 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-d03954e0-499c-43c5-9ca8-b23d405ccab8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:18:22.874515 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:22.874515 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:22.874515 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:22.874515 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:22.874515 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:22.874515 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:22.874515 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:22.874515 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:22.874515 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:22.874515 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:22.874515 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:22.874515 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:22.874515 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:22.874515 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:22.874515 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:22.875394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:22.876371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:22.876371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:22.876371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:22.876371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:22.876371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:22.876371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:22.876371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:22.876371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:22.876371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:18:22.876371 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:22.876371 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 404/805] 10.222.0.76 () {56 vars in 1117 bytes} [Sat Aug 27 04:18:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:22.881338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03954e0-499c-43c5-9ca8-b23d405ccab8 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:22.885175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:22.902246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-dae23d4d-cce9-491e-a408-ef1237ea915b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:22.903820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dae23d4d-cce9-491e-a408-ef1237ea915b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:22.987611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:23.004060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03954e0-499c-43c5-9ca8-b23d405ccab8 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:23.009588 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 402/806] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:23.010519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae23d4d-cce9-491e-a408-ef1237ea915b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:23.042815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68db6b-0d6b-41bc-9584-ee638c628186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:23.044237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68db6b-0d6b-41bc-9584-ee638c628186 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:23.044713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68db6b-0d6b-41bc-9584-ee638c628186 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:23.045174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68db6b-0d6b-41bc-9584-ee638c628186 None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:23.046124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68db6b-0d6b-41bc-9584-ee638c628186 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:23.046634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68db6b-0d6b-41bc-9584-ee638c628186 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:23.048405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68db6b-0d6b-41bc-9584-ee638c628186 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:23.071568 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 405/807] 10.222.0.76 () {56 vars in 1149 bytes} [Sat Aug 27 04:18:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:23.078302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68db6b-0d6b-41bc-9584-ee638c628186 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:23.183357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae23d4d-cce9-491e-a408-ef1237ea915b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:23.240553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:23.249204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27963fd-9966-4327-adcc-d024d348ad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:23.249840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27963fd-9966-4327-adcc-d024d348ad77 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:23.261257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27963fd-9966-4327-adcc-d024d348ad77 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:23.261257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27963fd-9966-4327-adcc-d024d348ad77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:23.265644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27963fd-9966-4327-adcc-d024d348ad77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:23.267107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27963fd-9966-4327-adcc-d024d348ad77 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:23.270584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68db6b-0d6b-41bc-9584-ee638c628186 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:23.300085 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-d27963fd-9966-4327-adcc-d024d348ad77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:23.300085 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:23.300085 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:23.300085 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:23.300085 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:23.300085 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:23.300085 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:23.300085 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:23.300085 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:23.300085 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:23.300085 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:23.300085 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:23.300085 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:23.300085 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:23.300085 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:23.300085 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:23.301098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:23.301098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:23.301098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:23.301098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:23.301098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:23.301098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:23.301098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:23.301098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:23.301098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:23.301098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:23.301098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:23.301098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:23.301098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:23.301098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:23.301098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:23.301098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:23.301098 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:23.301988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:23.301988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:23.301988 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:23.301988 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 403/808] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:23.309931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27963fd-9966-4327-adcc-d024d348ad77 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:23.335950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e4465-147b-463c-b411-ac1f1d1185cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:23.336679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e4465-147b-463c-b411-ac1f1d1185cb None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:23.336961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e4465-147b-463c-b411-ac1f1d1185cb None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:23.337231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e4465-147b-463c-b411-ac1f1d1185cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:23.350074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e4465-147b-463c-b411-ac1f1d1185cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:23.352093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e4465-147b-463c-b411-ac1f1d1185cb None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:23.356537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:23.374192 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-da3e4465-147b-463c-b411-ac1f1d1185cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:23.374192 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:23.374192 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:23.374192 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:23.374192 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:23.374192 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:23.374192 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:23.374192 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:23.374192 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:23.374192 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:23.374192 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:23.374192 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:23.374192 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:23.374192 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:23.374192 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:23.374192 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:23.382701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:23.382701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:23.382701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:23.382701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:23.382701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:23.382701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:23.382701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:23.382701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:23.382701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:23.382701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:23.382701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:23.382701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:23.382701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:23.382701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:23.382701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:23.382701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:23.382701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:23.383591 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:23.383591 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:23.383591 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:23.383591 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 406/809] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:23.383591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e4465-147b-463c-b411-ac1f1d1185cb None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:23.445860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27963fd-9966-4327-adcc-d024d348ad77 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:23.485644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe40b7-a8e3-4a05-b17b-e2314f096c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:23.486565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe40b7-a8e3-4a05-b17b-e2314f096c1b None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:23.486990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe40b7-a8e3-4a05-b17b-e2314f096c1b None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:23.487432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe40b7-a8e3-4a05-b17b-e2314f096c1b None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:23.488244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe40b7-a8e3-4a05-b17b-e2314f096c1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:23.488713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe40b7-a8e3-4a05-b17b-e2314f096c1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:23.490574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe40b7-a8e3-4a05-b17b-e2314f096c1b None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:23.504532 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 404/810] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:23.505777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe40b7-a8e3-4a05-b17b-e2314f096c1b None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:23.520718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e4465-147b-463c-b411-ac1f1d1185cb None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:23.560326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d409a9c-1aff-4c60-a0d9-d46dce967256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:23.561382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d409a9c-1aff-4c60-a0d9-d46dce967256 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:23.561865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d409a9c-1aff-4c60-a0d9-d46dce967256 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:23.562334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d409a9c-1aff-4c60-a0d9-d46dce967256 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:23.563113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d409a9c-1aff-4c60-a0d9-d46dce967256 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:23.563268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:23.564926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d409a9c-1aff-4c60-a0d9-d46dce967256 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:23.575159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-0d409a9c-1aff-4c60-a0d9-d46dce967256 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 04:18:23.575159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:23.575159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:23.575159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:23.575159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:23.575159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:23.575159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:23.575159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:23.575159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 04:18:23.575159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:23.575159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:23.575159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:23.575159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:23.575159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:23.575159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:23.575159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:23.575159 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:23.576444 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:23.576444 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:23.576444 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:23.576444 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:23.576444 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:23.576444 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:23.576444 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:23.576444 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:23.576444 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:23.576444 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:23.576444 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:23.576444 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:23.576444 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:23.576444 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:23.576444 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:23.576444 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:23.577476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:23.577476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:23.577476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:23.577476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:23.577476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:23.577476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:23.577476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:23.577476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:23.577476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:23.577476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:23.577476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:23.577476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:23.577476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 04:18:23.577476 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:23.584182 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 407/811] 10.222.0.76 () {56 vars in 1129 bytes} [Sat Aug 27 04:18:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:23.585143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d409a9c-1aff-4c60-a0d9-d46dce967256 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:23.634858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe40b7-a8e3-4a05-b17b-e2314f096c1b None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:23.654184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:23.687286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9803e-3109-492e-8c7c-a39391a4759b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:23.688298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9803e-3109-492e-8c7c-a39391a4759b None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:23.688786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9803e-3109-492e-8c7c-a39391a4759b None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:23.689262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9803e-3109-492e-8c7c-a39391a4759b None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:23.690489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9803e-3109-492e-8c7c-a39391a4759b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:23.691229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9803e-3109-492e-8c7c-a39391a4759b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:23.693302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9803e-3109-492e-8c7c-a39391a4759b None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:23.702450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d409a9c-1aff-4c60-a0d9-d46dce967256 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:23.713615 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 405/812] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:23.713615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9803e-3109-492e-8c7c-a39391a4759b None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:23.744304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c5535-21b6-4001-9bb0-10bede0e9b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:23.744999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c5535-21b6-4001-9bb0-10bede0e9b54 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:23.745886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c5535-21b6-4001-9bb0-10bede0e9b54 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:23.746157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c5535-21b6-4001-9bb0-10bede0e9b54 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:23.754917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c5535-21b6-4001-9bb0-10bede0e9b54 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:23.756587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c5535-21b6-4001-9bb0-10bede0e9b54 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:23.769984 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-6a5c5535-21b6-4001-9bb0-10bede0e9b54 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:18:23.769984 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:23.769984 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:23.769984 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:23.769984 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:23.769984 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:23.769984 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:23.769984 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:23.769984 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:23.769984 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:23.769984 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:23.769984 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:23.769984 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:23.769984 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:23.769984 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:23.769984 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:23.771051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:23.772025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:23.772025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:23.772025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:23.772025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:23.772025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:23.772025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:23.772025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:23.772025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:23.772025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:18:23.772025 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:23.772025 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 408/813] 10.222.0.76 () {56 vars in 1093 bytes} [Sat Aug 27 04:18:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:23.773343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c5535-21b6-4001-9bb0-10bede0e9b54 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:23.847471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9803e-3109-492e-8c7c-a39391a4759b None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:23.851131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:23.889422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6f8bf-9b29-4520-8113-b17df371bd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:23.890281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6f8bf-9b29-4520-8113-b17df371bd36 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:23.890665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6f8bf-9b29-4520-8113-b17df371bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:23.891223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6f8bf-9b29-4520-8113-b17df371bd36 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:23.891894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6f8bf-9b29-4520-8113-b17df371bd36 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:23.892361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6f8bf-9b29-4520-8113-b17df371bd36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:23.893806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6f8bf-9b29-4520-8113-b17df371bd36 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:23.894504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c5535-21b6-4001-9bb0-10bede0e9b54 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:23.903884 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 406/814] 10.222.0.76 () {56 vars in 1124 bytes} [Sat Aug 27 04:18:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:23.904946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6f8bf-9b29-4520-8113-b17df371bd36 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:23.920494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:23.939190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94425ffb-4f27-4f12-b895-3ba72919f8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:23.939829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94425ffb-4f27-4f12-b895-3ba72919f8fe None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:23.940111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94425ffb-4f27-4f12-b895-3ba72919f8fe None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:23.940744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94425ffb-4f27-4f12-b895-3ba72919f8fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:23.949630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94425ffb-4f27-4f12-b895-3ba72919f8fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:23.951369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94425ffb-4f27-4f12-b895-3ba72919f8fe None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:23.963155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-94425ffb-4f27-4f12-b895-3ba72919f8fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:23.963155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:23.963155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:23.963155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:23.963155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:23.963155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:23.963155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:23.963155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:23.963155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:23.963155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:23.963155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:23.963155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:23.963155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:23.963155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:23.963155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:23.965068 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:23.965068 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:23.965068 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:23.965068 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:23.965068 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:23.965068 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:23.965068 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:23.965068 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:23.965068 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:23.965068 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:23.965068 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:23.965068 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:23.965068 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:23.965068 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:23.965068 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:23.965068 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:23.965068 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:23.966471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:23.966471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:23.966471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:23.966471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:23.966471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:23.966471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:23.966471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:23.966471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:23.966471 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 409/815] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:23.966471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94425ffb-4f27-4f12-b895-3ba72919f8fe None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:24.020443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6f8bf-9b29-4520-8113-b17df371bd36 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:24.053842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ab46d-1840-46fe-82b7-9a95f274129a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:24.054442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ab46d-1840-46fe-82b7-9a95f274129a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:24.054718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ab46d-1840-46fe-82b7-9a95f274129a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:24.054987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ab46d-1840-46fe-82b7-9a95f274129a None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:24.055703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ab46d-1840-46fe-82b7-9a95f274129a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:24.056004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ab46d-1840-46fe-82b7-9a95f274129a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:24.058123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ab46d-1840-46fe-82b7-9a95f274129a None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:24.076782 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 407/816] 10.222.0.76 () {56 vars in 1133 bytes} [Sat Aug 27 04:18:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:24.076782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c62994-8025-4df3-95d9-ed2e66b52c69 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:24.076782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c62994-8025-4df3-95d9-ed2e66b52c69 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:24.076782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c62994-8025-4df3-95d9-ed2e66b52c69 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:24.084360 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 408/817] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:24.085166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c62994-8025-4df3-95d9-ed2e66b52c69 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:24.085441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94425ffb-4f27-4f12-b895-3ba72919f8fe None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:24.115286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:24.125895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231e5d8-89dd-41a0-b806-e33a39d0d62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:24.126500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231e5d8-89dd-41a0-b806-e33a39d0d62e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:24.126774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231e5d8-89dd-41a0-b806-e33a39d0d62e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:24.127042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231e5d8-89dd-41a0-b806-e33a39d0d62e None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:24.127762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231e5d8-89dd-41a0-b806-e33a39d0d62e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:24.128062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231e5d8-89dd-41a0-b806-e33a39d0d62e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:24.129458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231e5d8-89dd-41a0-b806-e33a39d0d62e None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:24.136216 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 410/818] 10.222.0.76 () {56 vars in 1124 bytes} [Sat Aug 27 04:18:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:24.136216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231e5d8-89dd-41a0-b806-e33a39d0d62e None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:24.187439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:24.196645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c62994-8025-4df3-95d9-ed2e66b52c69 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:24.251948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231e5d8-89dd-41a0-b806-e33a39d0d62e None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:24.290717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1ef09-9c83-43ac-983d-94c0043ef648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:24.291346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1ef09-9c83-43ac-983d-94c0043ef648 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:24.291627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1ef09-9c83-43ac-983d-94c0043ef648 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:24.292528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1ef09-9c83-43ac-983d-94c0043ef648 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:24.347732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6f7b7-a6b4-46d8-866e-089a660cf503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:24.348368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6f7b7-a6b4-46d8-866e-089a660cf503 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:24.348645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6f7b7-a6b4-46d8-866e-089a660cf503 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:24.348912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6f7b7-a6b4-46d8-866e-089a660cf503 None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:24.349599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6f7b7-a6b4-46d8-866e-089a660cf503 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:24.349897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6f7b7-a6b4-46d8-866e-089a660cf503 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:24.351318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6f7b7-a6b4-46d8-866e-089a660cf503 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:24.364149 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 409/819] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:24.365403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce1800-3f6b-4e0a-936a-e7102f44d0b3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:24.365629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce1800-3f6b-4e0a-936a-e7102f44d0b3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:24.365896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce1800-3f6b-4e0a-936a-e7102f44d0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:24.376020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1ef09-9c83-43ac-983d-94c0043ef648 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:24.377883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1ef09-9c83-43ac-983d-94c0043ef648 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:24.388135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-60ce1800-3f6b-4e0a-936a-e7102f44d0b3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:24.389352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-60ce1800-3f6b-4e0a-936a-e7102f44d0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:24.434066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:24.472236 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 410/820] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:24.473778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce1800-3f6b-4e0a-936a-e7102f44d0b3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:24.501655 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 411/821] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:18:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 04:18:24.502576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:24.502981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1ef09-9c83-43ac-983d-94c0043ef648 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:24.616135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce1800-3f6b-4e0a-936a-e7102f44d0b3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:24.640481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1ef09-9c83-43ac-983d-94c0043ef648 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:24.660031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab585da-6443-4363-bbd8-af391041f8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:24.660914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab585da-6443-4363-bbd8-af391041f8ad None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:24.661354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab585da-6443-4363-bbd8-af391041f8ad None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:24.661769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab585da-6443-4363-bbd8-af391041f8ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:24.662575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab585da-6443-4363-bbd8-af391041f8ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:24.664099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab585da-6443-4363-bbd8-af391041f8ad None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:24.679616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee46cf6-a76d-401c-947e-ac031c057567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:24.680519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee46cf6-a76d-401c-947e-ac031c057567 None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:24.680909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee46cf6-a76d-401c-947e-ac031c057567 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:24.681255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee46cf6-a76d-401c-947e-ac031c057567 None admin] PATH_INFO: `/v3/projects/5632b718c3aa48458247661045e99e5f/users/7aa8f9ba9e854c7abc4237eb72c55590/roles/127770d936b94a5da885e721233e7f7b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:24.697711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee46cf6-a76d-401c-947e-ac031c057567 None admin] RBAC: Authorizing `identity:create_grant(project_id=5632b718c3aa48458247661045e99e5f, user_id=7aa8f9ba9e854c7abc4237eb72c55590, role_id=127770d936b94a5da885e721233e7f7b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:24.700148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee46cf6-a76d-401c-947e-ac031c057567 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:24.702498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:24.754929 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 411/822] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:18:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:18:24.755617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab585da-6443-4363-bbd8-af391041f8ad None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:24.780123 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 412/823] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:18:24 2022] PUT /identity/v3/projects/5632b718c3aa48458247661045e99e5f/users/7aa8f9ba9e854c7abc4237eb72c55590/roles/127770d936b94a5da885e721233e7f7b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:18:24.781341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516dfa2f-a7df-4de1-8d2e-97bc60447782 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:24.781635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516dfa2f-a7df-4de1-8d2e-97bc60447782 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:24.781913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516dfa2f-a7df-4de1-8d2e-97bc60447782 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:24.783495 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 413/824] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:24.788651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516dfa2f-a7df-4de1-8d2e-97bc60447782 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:24.865241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:24.911493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab585da-6443-4363-bbd8-af391041f8ad None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:24.941164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516dfa2f-a7df-4de1-8d2e-97bc60447782 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:24.974906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d7ceb-4bc1-4fc8-95a3-cfde34e955f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:24.975566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d7ceb-4bc1-4fc8-95a3-cfde34e955f1 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:24.975827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d7ceb-4bc1-4fc8-95a3-cfde34e955f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:24.976102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d7ceb-4bc1-4fc8-95a3-cfde34e955f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:24.988556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d7ceb-4bc1-4fc8-95a3-cfde34e955f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:24.990075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d7ceb-4bc1-4fc8-95a3-cfde34e955f1 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:24.993116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb471bd-7cf7-4dae-9e68-4e6a49d7b991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:24.993755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb471bd-7cf7-4dae-9e68-4e6a49d7b991 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:24.994077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb471bd-7cf7-4dae-9e68-4e6a49d7b991 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:24.994307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb471bd-7cf7-4dae-9e68-4e6a49d7b991 None admin] PATH_INFO: `/v3/services/network` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:24.995470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb471bd-7cf7-4dae-9e68-4e6a49d7b991 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:24.996968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb471bd-7cf7-4dae-9e68-4e6a49d7b991 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:25.005645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-247d7ceb-4bc1-4fc8-95a3-cfde34e955f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:25.005645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:25.005645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:25.005645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:25.005645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:25.005645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:25.005645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:25.005645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:25.005645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:25.005645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:25.005645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:25.005645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:25.005645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:25.005645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:25.005645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:25.005645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:25.006640 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:25.006640 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:25.006640 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:25.006640 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:25.006640 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:25.006640 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:25.006640 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:25.006640 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:25.006640 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:25.006640 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:25.006640 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:25.006640 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:25.006640 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:25.006640 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:25.006640 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:25.006640 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:25.006640 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:25.007539 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:25.007539 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:25.007539 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:25.007539 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 412/825] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:25.008224 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-9bb471bd-7cf7-4dae-9e68-4e6a49d7b991 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 04:18:25.008224 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:25.008224 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:25.008224 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:25.008224 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:25.008224 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:25.008224 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:25.008224 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:25.008224 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 04:18:25.008224 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:25.008224 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:25.008224 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:25.008224 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:25.008224 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:25.008224 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:25.008224 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:25.008224 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:25.009163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:25.009163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:25.009163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:25.009163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:25.009163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:25.009163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:25.009163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:25.009163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:25.009163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:25.009163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:25.009163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:25.009163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:25.009163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:25.009163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:25.009163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:25.009163 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:25.010012 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:25.010012 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:25.010012 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:25.010012 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:25.010012 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:25.010012 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:25.010012 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:25.010012 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:25.010012 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:25.010012 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:25.010012 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:25.010012 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:25.010012 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 04:18:25.010012 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:25.011355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd1d1-087f-404e-9012-c55165e8fee0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:25.011355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd1d1-087f-404e-9012-c55165e8fee0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:25.011355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd1d1-087f-404e-9012-c55165e8fee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:25.011788 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 414/826] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:24 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:25.016081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb471bd-7cf7-4dae-9e68-4e6a49d7b991 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:25.041212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-df4bd1d1-087f-404e-9012-c55165e8fee0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:25.042824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-df4bd1d1-087f-404e-9012-c55165e8fee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:25.087239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:25.138047 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 413/827] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:25.138047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bd1d1-087f-404e-9012-c55165e8fee0 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:25.154853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb471bd-7cf7-4dae-9e68-4e6a49d7b991 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:25.223642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc16c2-5118-49cb-93df-3ccbb314933d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:25.224273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc16c2-5118-49cb-93df-3ccbb314933d None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:25.224556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc16c2-5118-49cb-93df-3ccbb314933d None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:25.224830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc16c2-5118-49cb-93df-3ccbb314933d None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:25.225456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc16c2-5118-49cb-93df-3ccbb314933d None admin] RBAC: Adding query filter params (name=network) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:25.225756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc16c2-5118-49cb-93df-3ccbb314933d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:25.227118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc16c2-5118-49cb-93df-3ccbb314933d None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:25.230917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:25.240900 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 415/828] 10.222.0.76 () {56 vars in 1112 bytes} [Sat Aug 27 04:18:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:25.247276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc16c2-5118-49cb-93df-3ccbb314933d None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:25.327401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bd1d1-087f-404e-9012-c55165e8fee0 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:25.368857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78527f3-7610-4326-b30d-9e135b19d074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:25.369470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78527f3-7610-4326-b30d-9e135b19d074 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:25.369747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78527f3-7610-4326-b30d-9e135b19d074 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:25.370155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78527f3-7610-4326-b30d-9e135b19d074 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:25.372630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78527f3-7610-4326-b30d-9e135b19d074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:25.372938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78527f3-7610-4326-b30d-9e135b19d074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:25.374319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78527f3-7610-4326-b30d-9e135b19d074 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:25.397121 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 414/829] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:25.402759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78527f3-7610-4326-b30d-9e135b19d074 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:25.442952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc16c2-5118-49cb-93df-3ccbb314933d None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:25.475966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:25.490807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b6446-75ab-4ba4-9134-67904aa8554a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:25.491481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b6446-75ab-4ba4-9134-67904aa8554a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:25.491763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b6446-75ab-4ba4-9134-67904aa8554a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:25.492042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b6446-75ab-4ba4-9134-67904aa8554a None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:25.492864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b6446-75ab-4ba4-9134-67904aa8554a None admin] RBAC: Adding query filter params (type=network) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:25.493177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b6446-75ab-4ba4-9134-67904aa8554a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:25.495126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b6446-75ab-4ba4-9134-67904aa8554a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:25.502537 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 416/830] 10.222.0.76 () {56 vars in 1112 bytes} [Sat Aug 27 04:18:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:25.503372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b6446-75ab-4ba4-9134-67904aa8554a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:25.544435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78527f3-7610-4326-b30d-9e135b19d074 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:25.556639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:25.590748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523958c-0732-4658-a33a-d209c11fe0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:25.592243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523958c-0732-4658-a33a-d209c11fe0e5 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:25.592523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523958c-0732-4658-a33a-d209c11fe0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:25.592795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523958c-0732-4658-a33a-d209c11fe0e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:25.601018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523958c-0732-4658-a33a-d209c11fe0e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:25.602775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523958c-0732-4658-a33a-d209c11fe0e5 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:25.618222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-0523958c-0732-4658-a33a-d209c11fe0e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:25.618222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:25.618222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:25.618222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:25.618222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:25.618222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:25.618222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:25.618222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:25.618222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:25.618222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:25.618222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:25.618222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:25.618222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:25.618222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:25.618222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:25.619152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:25.619152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:25.619152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:25.619152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:25.619152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:25.619152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:25.619152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:25.619152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:25.619152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:25.619152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:25.619152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:25.619152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:25.619152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:25.619152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:25.619152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:25.619152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:25.619152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:25.620727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:25.620727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:25.620727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:25.620727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:25.620727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:25.620727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:25.620727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:25.620727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:25.620727 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 415/831] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:25.621213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523958c-0732-4658-a33a-d209c11fe0e5 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:25.627628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b6446-75ab-4ba4-9134-67904aa8554a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:25.667853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a005b-268d-49d8-80c0-6a7ccef5a54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:25.668939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a005b-268d-49d8-80c0-6a7ccef5a54c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:25.669467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a005b-268d-49d8-80c0-6a7ccef5a54c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:25.669930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a005b-268d-49d8-80c0-6a7ccef5a54c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:25.680903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a005b-268d-49d8-80c0-6a7ccef5a54c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:25.687435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-398a005b-268d-49d8-80c0-6a7ccef5a54c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:18:25.687435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:25.687435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:25.687435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:25.687435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:25.687435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:25.687435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:25.687435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:25.687435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:25.687435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:25.687435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:25.687435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:25.687435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:25.687435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:25.687435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:25.687435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:25.688386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:25.688386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:25.688386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:25.688386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:25.688386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:25.688386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:25.688386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:25.688386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:25.688386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:25.688386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:25.688386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:25.688386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:25.688386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:25.688386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:25.688386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:25.688386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:25.689226 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:25.689226 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:25.689226 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:25.689226 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:25.689226 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:25.689226 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:25.689226 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:25.689226 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:25.689226 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:25.689226 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:25.689226 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:18:25.689226 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:25.696412 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 417/832] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:18:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:25.697428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a005b-268d-49d8-80c0-6a7ccef5a54c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:25.749073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:25.753866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523958c-0732-4658-a33a-d209c11fe0e5 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:25.799258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be3259-1117-4843-bb50-332620f8b63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:25.800096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be3259-1117-4843-bb50-332620f8b63f None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:25.800409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be3259-1117-4843-bb50-332620f8b63f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:25.800683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be3259-1117-4843-bb50-332620f8b63f None admin] PATH_INFO: `/v3/endpoints` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:25.801347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be3259-1117-4843-bb50-332620f8b63f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:25.803237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be3259-1117-4843-bb50-332620f8b63f None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:25.805442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a005b-268d-49d8-80c0-6a7ccef5a54c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:25.842192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5c2dd-56b5-400b-b84d-a6f3d269514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:25.842951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5c2dd-56b5-400b-b84d-a6f3d269514b None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:25.843291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5c2dd-56b5-400b-b84d-a6f3d269514b None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:25.843567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5c2dd-56b5-400b-b84d-a6f3d269514b None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:25.844286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5c2dd-56b5-400b-b84d-a6f3d269514b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:25.844584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5c2dd-56b5-400b-b84d-a6f3d269514b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:25.845998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5c2dd-56b5-400b-b84d-a6f3d269514b None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:25.859101 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 418/833] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:25.859857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5c2dd-56b5-400b-b84d-a6f3d269514b None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:25.890825 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 416/834] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:18:25 2022] POST /identity/v3/endpoints => generated 337 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:18:25.892492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be3259-1117-4843-bb50-332620f8b63f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:25.937570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:25.978544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5c2dd-56b5-400b-b84d-a6f3d269514b None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:25.988211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:26.031773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a639b-3c2f-4f76-a42b-682fd9b9380c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:26.032452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a639b-3c2f-4f76-a42b-682fd9b9380c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:26.032843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a639b-3c2f-4f76-a42b-682fd9b9380c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:26.033127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a639b-3c2f-4f76-a42b-682fd9b9380c None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:26.033879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a639b-3c2f-4f76-a42b-682fd9b9380c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:26.034245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a639b-3c2f-4f76-a42b-682fd9b9380c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:26.035838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a639b-3c2f-4f76-a42b-682fd9b9380c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:26.048444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be3259-1117-4843-bb50-332620f8b63f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:26.052682 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 419/835] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:18:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:26.060652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a639b-3c2f-4f76-a42b-682fd9b9380c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:26.148967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de57d22-65ee-4938-8436-bf2cb07feea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:26.149612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de57d22-65ee-4938-8436-bf2cb07feea0 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:26.149883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de57d22-65ee-4938-8436-bf2cb07feea0 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:26.150154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de57d22-65ee-4938-8436-bf2cb07feea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:26.150946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de57d22-65ee-4938-8436-bf2cb07feea0 None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=0e5ddcf00a184aa0ac0e7194f1c72425) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:26.151329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de57d22-65ee-4938-8436-bf2cb07feea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:26.152799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de57d22-65ee-4938-8436-bf2cb07feea0 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:26.168899 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 417/836] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:18:25 2022] GET /identity/v3/role_assignments?user.id=0e5ddcf00a184aa0ac0e7194f1c72425&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:26.178270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a639b-3c2f-4f76-a42b-682fd9b9380c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:26.218072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb173539-0d07-4a60-a6c6-603c340bc813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:26.219279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb173539-0d07-4a60-a6c6-603c340bc813 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:26.219768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb173539-0d07-4a60-a6c6-603c340bc813 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:26.220300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb173539-0d07-4a60-a6c6-603c340bc813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:26.235232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb173539-0d07-4a60-a6c6-603c340bc813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:26.237146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb173539-0d07-4a60-a6c6-603c340bc813 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:26.254005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-cb173539-0d07-4a60-a6c6-603c340bc813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:26.254005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:26.254005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:26.254005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:26.254005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:26.254005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:26.254005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:26.254005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:26.254005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:26.254005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:26.254005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:26.254005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:26.254005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:26.254005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:26.254005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:26.254005 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:26.255008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:26.255008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:26.255008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:26.255008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:26.255008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:26.255008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:26.255008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:26.255008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:26.255008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:26.255008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:26.255008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:26.255008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:26.255008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:26.255008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:26.255008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:26.255008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:26.255008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:26.255906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:26.255906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:26.255906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:26.258055 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 420/837] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:26.265370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de57d22-65ee-4938-8436-bf2cb07feea0 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:26.386022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:26.395627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de57d22-65ee-4938-8436-bf2cb07feea0 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:26.435352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1894ec5-7706-4e4e-99fd-1df42d42743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:26.436226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1894ec5-7706-4e4e-99fd-1df42d42743f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:26.436676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1894ec5-7706-4e4e-99fd-1df42d42743f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:26.437087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1894ec5-7706-4e4e-99fd-1df42d42743f None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:26.437867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1894ec5-7706-4e4e-99fd-1df42d42743f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:26.438309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1894ec5-7706-4e4e-99fd-1df42d42743f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:26.439817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1894ec5-7706-4e4e-99fd-1df42d42743f None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:26.453896 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 418/838] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:26.459324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb173539-0d07-4a60-a6c6-603c340bc813 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:26.596675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:26.681404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb173539-0d07-4a60-a6c6-603c340bc813 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:26.716653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bab8a-2d84-4a68-9402-f921239e85f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:26.717600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bab8a-2d84-4a68-9402-f921239e85f6 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:26.718064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bab8a-2d84-4a68-9402-f921239e85f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:26.718505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bab8a-2d84-4a68-9402-f921239e85f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:26.725942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bab8a-2d84-4a68-9402-f921239e85f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:26.727577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bab8a-2d84-4a68-9402-f921239e85f6 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:26.739710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-b90bab8a-2d84-4a68-9402-f921239e85f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:18:26.739710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:26.739710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:26.739710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:26.739710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:26.739710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:26.739710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:26.739710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:26.739710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:26.739710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:26.739710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:26.739710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:26.739710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:26.739710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:26.739710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:26.739710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:26.740710 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:26.741663 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:26.741663 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:26.741663 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:26.741663 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:26.741663 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:26.741663 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:26.741663 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:26.741663 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:26.741663 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 27 04:18:26.741663 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:26.743967 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 421/839] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:18:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:26.749456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1894ec5-7706-4e4e-99fd-1df42d42743f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:26.855021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1894ec5-7706-4e4e-99fd-1df42d42743f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:26.890861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537338b6-837a-464a-a77b-b7e262e9e7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:26.891742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537338b6-837a-464a-a77b-b7e262e9e7c6 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:26.892178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537338b6-837a-464a-a77b-b7e262e9e7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:26.892590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537338b6-837a-464a-a77b-b7e262e9e7c6 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:26.893446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537338b6-837a-464a-a77b-b7e262e9e7c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:26.893886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537338b6-837a-464a-a77b-b7e262e9e7c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:26.895518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537338b6-837a-464a-a77b-b7e262e9e7c6 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:26.916039 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 419/840] 10.222.0.76 () {56 vars in 1135 bytes} [Sat Aug 27 04:18:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:26.921461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bab8a-2d84-4a68-9402-f921239e85f6 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:26.923736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e3227-8380-4a08-aff2-7f6c65abeab8 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:26.924248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e3227-8380-4a08-aff2-7f6c65abeab8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:26.924692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e3227-8380-4a08-aff2-7f6c65abeab8 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:26.926257 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 420/841] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:26.931464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8b3ac-d593-4ff1-be95-11fb8038fa44 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:26.931900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8b3ac-d593-4ff1-be95-11fb8038fa44 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:26.932380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8b3ac-d593-4ff1-be95-11fb8038fa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:26.955805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7ae8b3ac-d593-4ff1-be95-11fb8038fa44 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:26.957054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7ae8b3ac-d593-4ff1-be95-11fb8038fa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:26.962355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:27.009021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:27.035898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bab8a-2d84-4a68-9402-f921239e85f6 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:27.040414 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 421/842] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:18:27.043687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9f4c-e8d2-430c-895a-cd5228e42ed8 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:27.043687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9f4c-e8d2-430c-895a-cd5228e42ed8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:27.043687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9f4c-e8d2-430c-895a-cd5228e42ed8 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:27.043687 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 422/843] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:27.049374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ee6b6-87e5-472f-a49e-1295808ce572 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:27.049652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ee6b6-87e5-472f-a49e-1295808ce572 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:27.049933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ee6b6-87e5-472f-a49e-1295808ce572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:27.068326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-fe1ee6b6-87e5-472f-a49e-1295808ce572 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:27.069472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fe1ee6b6-87e5-472f-a49e-1295808ce572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:27.081592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d50ea-2ff0-496e-a660-7df0e57060e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:27.082903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d50ea-2ff0-496e-a660-7df0e57060e0 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:27.083363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d50ea-2ff0-496e-a660-7df0e57060e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:27.084069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d50ea-2ff0-496e-a660-7df0e57060e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:27.152323 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 423/844] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:27.173265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d50ea-2ff0-496e-a660-7df0e57060e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:27.174963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d50ea-2ff0-496e-a660-7df0e57060e0 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:27.251723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:27.276086 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 422/845] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:18:26 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 04:18:27.281540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ee6b6-87e5-472f-a49e-1295808ce572 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:27.312792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d50ea-2ff0-496e-a660-7df0e57060e0 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:27.364660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:27.405679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ee6b6-87e5-472f-a49e-1295808ce572 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:27.428686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d50ea-2ff0-496e-a660-7df0e57060e0 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:27.449051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63f9a1-6d19-43df-a7b1-bc6b61d212eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:27.450177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63f9a1-6d19-43df-a7b1-bc6b61d212eb None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:27.450702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63f9a1-6d19-43df-a7b1-bc6b61d212eb None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:27.451037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63f9a1-6d19-43df-a7b1-bc6b61d212eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:27.462600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63f9a1-6d19-43df-a7b1-bc6b61d212eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:27.464734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63f9a1-6d19-43df-a7b1-bc6b61d212eb None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:27.470772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4d616-361d-4154-916d-99c97cb37b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:27.471414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4d616-361d-4154-916d-99c97cb37b1c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:27.471692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4d616-361d-4154-916d-99c97cb37b1c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:27.471963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4d616-361d-4154-916d-99c97cb37b1c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:27.473104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4d616-361d-4154-916d-99c97cb37b1c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:27.474869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4d616-361d-4154-916d-99c97cb37b1c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:27.480414 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-ab63f9a1-6d19-43df-a7b1-bc6b61d212eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:27.480414 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:27.480414 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:27.480414 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:27.480414 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:27.480414 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:27.480414 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:27.480414 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:27.480414 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:27.480414 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:27.480414 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:27.480414 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:27.480414 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:27.480414 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:27.480414 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:27.480414 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:27.481370 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:27.481370 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:27.481370 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:27.481370 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:27.481370 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:27.481370 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:27.481370 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:27.481370 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:27.481370 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:27.481370 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:27.481370 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:27.481370 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:27.481370 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:27.481370 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:27.481370 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:27.481370 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:27.481370 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:27.487175 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:27.487175 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:27.487175 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:27.487175 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 424/846] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:27.487175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63f9a1-6d19-43df-a7b1-bc6b61d212eb None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:27.487466 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-73f4d616-361d-4154-916d-99c97cb37b1c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 04:18:27.487466 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:27.487466 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:27.487466 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:27.487466 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:27.487466 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:27.487466 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:27.487466 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:27.487466 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 04:18:27.487466 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:27.487466 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:27.487466 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:27.487466 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:27.487466 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:27.487466 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:27.487466 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:27.487466 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:27.488395 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:27.488395 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:27.488395 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:27.488395 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:27.488395 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:27.488395 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:27.488395 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:27.488395 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:27.488395 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:27.488395 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:27.488395 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:27.488395 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:27.488395 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:27.488395 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:27.488395 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:27.488395 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:27.490040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:27.490040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:27.490040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:27.490040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:27.490040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:27.490040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:27.490040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:27.490040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:27.490040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:27.490040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:27.490040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:27.490040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:27.490040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 04:18:27.490040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:27.490040 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 423/847] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:18:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:27.491459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4d616-361d-4154-916d-99c97cb37b1c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:27.535345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:27.594435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4d616-361d-4154-916d-99c97cb37b1c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:27.595908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63f9a1-6d19-43df-a7b1-bc6b61d212eb None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:27.615183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:27.627808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1c4ca-2256-4361-903e-9688976d82d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:27.628465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1c4ca-2256-4361-903e-9688976d82d7 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:27.628704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1c4ca-2256-4361-903e-9688976d82d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:27.628976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1c4ca-2256-4361-903e-9688976d82d7 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:27.629593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1c4ca-2256-4361-903e-9688976d82d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:27.629773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a128738-2a91-4027-bab1-048403059529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:27.629898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1c4ca-2256-4361-903e-9688976d82d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:27.630337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a128738-2a91-4027-bab1-048403059529 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:27.630616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a128738-2a91-4027-bab1-048403059529 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:27.630884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a128738-2a91-4027-bab1-048403059529 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:27.631207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1c4ca-2256-4361-903e-9688976d82d7 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:27.641960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a128738-2a91-4027-bab1-048403059529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:27.648140 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 424/848] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:27.648140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1c4ca-2256-4361-903e-9688976d82d7 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:27.648531 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-0a128738-2a91-4027-bab1-048403059529 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:27.648531 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:27.648531 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:27.648531 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:27.648531 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:27.648531 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:27.648531 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:27.648531 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:27.648531 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:27.648531 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:27.648531 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:27.648531 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:27.648531 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:27.648531 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:27.648531 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:27.648531 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:27.649397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:27.649397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:27.649397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:27.649397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:27.649397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:27.649397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:27.649397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:27.649397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:27.649397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:27.649397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:27.649397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:27.649397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:27.649397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:27.649397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:27.649397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:27.649397 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:27.650222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:27.650222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:27.650222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:27.650222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:27.650222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:27.650222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:27.650222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:27.650222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:27.650222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:27.650222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:27.650222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:18:27.650222 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:27.650222 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 425/849] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:18:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:27.650222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a128738-2a91-4027-bab1-048403059529 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:27.752766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a128738-2a91-4027-bab1-048403059529 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:27.755801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:27.759202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1c4ca-2256-4361-903e-9688976d82d7 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:27.795952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07055e7-6d9c-4eee-8426-04f2e82dfa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:27.796583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07055e7-6d9c-4eee-8426-04f2e82dfa14 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:27.796863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07055e7-6d9c-4eee-8426-04f2e82dfa14 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:27.797193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07055e7-6d9c-4eee-8426-04f2e82dfa14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:27.799887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bed1ed-fb08-4249-8468-5888ced7c1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:27.800536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bed1ed-fb08-4249-8468-5888ced7c1c2 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:27.800792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bed1ed-fb08-4249-8468-5888ced7c1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:27.801070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bed1ed-fb08-4249-8468-5888ced7c1c2 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:27.801756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bed1ed-fb08-4249-8468-5888ced7c1c2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:27.802058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bed1ed-fb08-4249-8468-5888ced7c1c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:27.803412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bed1ed-fb08-4249-8468-5888ced7c1c2 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:27.804766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07055e7-6d9c-4eee-8426-04f2e82dfa14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:27.806195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07055e7-6d9c-4eee-8426-04f2e82dfa14 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:27.809314 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 425/850] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:18:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:27.809903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bed1ed-fb08-4249-8468-5888ced7c1c2 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:27.824436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-d07055e7-6d9c-4eee-8426-04f2e82dfa14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:27.824436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:27.824436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:27.824436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:27.824436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:27.824436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:27.824436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:27.824436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:27.824436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:27.824436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:27.824436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:27.824436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:27.824436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:27.824436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:27.824436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:27.825363 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:27.825363 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:27.825363 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:27.825363 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:27.825363 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:27.825363 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:27.825363 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:27.825363 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:27.825363 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:27.825363 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:27.825363 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:27.825363 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:27.825363 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:27.825363 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:27.825363 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:27.825363 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:27.825363 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:27.826269 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:27.826269 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:27.826269 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:27.826269 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:27.826269 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:27.826269 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:27.826269 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:27.826269 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:27.826269 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 426/851] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:27.827359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07055e7-6d9c-4eee-8426-04f2e82dfa14 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:27.871915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:27.923342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bed1ed-fb08-4249-8468-5888ced7c1c2 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:27.940625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07055e7-6d9c-4eee-8426-04f2e82dfa14 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:27.970177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f001f1-9012-421b-952f-2fea1ddfd138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:27.970854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f001f1-9012-421b-952f-2fea1ddfd138 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:27.971046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f001f1-9012-421b-952f-2fea1ddfd138 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:27.971313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f001f1-9012-421b-952f-2fea1ddfd138 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:27.971969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f001f1-9012-421b-952f-2fea1ddfd138 None admin] RBAC: Adding query filter params (name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:27.972404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f001f1-9012-421b-952f-2fea1ddfd138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:27.973647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f001f1-9012-421b-952f-2fea1ddfd138 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:27.978414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8293d-b368-400c-880d-32d40a3a8083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:27.979018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8293d-b368-400c-880d-32d40a3a8083 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:27.979485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8293d-b368-400c-880d-32d40a3a8083 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:27.979759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8293d-b368-400c-880d-32d40a3a8083 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:27.980478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8293d-b368-400c-880d-32d40a3a8083 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:27.980781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8293d-b368-400c-880d-32d40a3a8083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:27.982139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8293d-b368-400c-880d-32d40a3a8083 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:27.983401 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 426/852] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:18:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:27.984461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f001f1-9012-421b-952f-2fea1ddfd138 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:27.990872 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 427/853] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:18:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:27.991920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8293d-b368-400c-880d-32d40a3a8083 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:28.018838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:28.122475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f001f1-9012-421b-952f-2fea1ddfd138 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:28.145491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8293d-b368-400c-880d-32d40a3a8083 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:28.149788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:28.168542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afaeedc-e11e-4fad-b92f-f8d184333eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:28.169153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaeedc-e11e-4fad-b92f-f8d184333eaa None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:28.169474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaeedc-e11e-4fad-b92f-f8d184333eaa None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:28.169693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaeedc-e11e-4fad-b92f-f8d184333eaa None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:28.170479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afaeedc-e11e-4fad-b92f-f8d184333eaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:28.170692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afaeedc-e11e-4fad-b92f-f8d184333eaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:28.172136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afaeedc-e11e-4fad-b92f-f8d184333eaa None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:28.189213 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 427/854] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:28.195300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afaeedc-e11e-4fad-b92f-f8d184333eaa None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:28.198001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61730b8f-03a3-44f8-a38d-dde2c29df3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:28.198933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61730b8f-03a3-44f8-a38d-dde2c29df3e9 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:28.199165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61730b8f-03a3-44f8-a38d-dde2c29df3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:28.199442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61730b8f-03a3-44f8-a38d-dde2c29df3e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:28.221973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61730b8f-03a3-44f8-a38d-dde2c29df3e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:28.224022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61730b8f-03a3-44f8-a38d-dde2c29df3e9 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:28.246584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-61730b8f-03a3-44f8-a38d-dde2c29df3e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:28.246584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:28.246584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:28.246584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:28.246584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:28.246584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:28.246584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:28.246584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:28.246584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:28.246584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:28.246584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:28.246584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:28.246584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:28.246584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:28.246584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:28.246584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:28.247750 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:28.247750 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:28.247750 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:28.247750 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:28.247750 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:28.247750 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:28.247750 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:28.247750 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:28.247750 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:28.247750 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:28.247750 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:28.247750 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:28.247750 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:28.247750 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:28.247750 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:28.247750 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:28.247750 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:28.248785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:28.248785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:28.248785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:28.251314 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 428/855] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:28.259349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61730b8f-03a3-44f8-a38d-dde2c29df3e9 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:28.295856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:28.313168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afaeedc-e11e-4fad-b92f-f8d184333eaa None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:28.350954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8ad2d-3303-4da8-a1b0-4dc4e5503121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:28.351715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8ad2d-3303-4da8-a1b0-4dc4e5503121 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:28.352380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8ad2d-3303-4da8-a1b0-4dc4e5503121 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:28.352658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8ad2d-3303-4da8-a1b0-4dc4e5503121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:28.353658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8ad2d-3303-4da8-a1b0-4dc4e5503121 None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=cc067131b0d84c7c9da1a33ecb7a9d02) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:28.353961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8ad2d-3303-4da8-a1b0-4dc4e5503121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:28.356461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8ad2d-3303-4da8-a1b0-4dc4e5503121 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:28.364325 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 428/856] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:18:28 2022] GET /identity/v3/role_assignments?user.id=cc067131b0d84c7c9da1a33ecb7a9d02&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:28.365733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449d44f-09a2-46bf-8feb-4e38aa91e342 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:28.366104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449d44f-09a2-46bf-8feb-4e38aa91e342 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:28.366447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449d44f-09a2-46bf-8feb-4e38aa91e342 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:28.367963 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 429/857] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:28.374927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b48365-bfae-4d5e-834e-0cde865b31e3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:28.375501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b48365-bfae-4d5e-834e-0cde865b31e3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:28.375793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b48365-bfae-4d5e-834e-0cde865b31e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:28.391813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61730b8f-03a3-44f8-a38d-dde2c29df3e9 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:28.395834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f6b48365-bfae-4d5e-834e-0cde865b31e3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:28.397090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f6b48365-bfae-4d5e-834e-0cde865b31e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:28.441559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cbc50-9541-463e-b1bd-1900b28a8818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:28.442623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cbc50-9541-463e-b1bd-1900b28a8818 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:28.443161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cbc50-9541-463e-b1bd-1900b28a8818 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:28.443638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cbc50-9541-463e-b1bd-1900b28a8818 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:28.444549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cbc50-9541-463e-b1bd-1900b28a8818 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:28.445060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cbc50-9541-463e-b1bd-1900b28a8818 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:28.447952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cbc50-9541-463e-b1bd-1900b28a8818 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:28.467958 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 429/858] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:28.473738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cbc50-9541-463e-b1bd-1900b28a8818 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:28.483285 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 430/859] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:18:28.497536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:28.588188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cbc50-9541-463e-b1bd-1900b28a8818 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:28.624589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e693edb-3e39-4c21-8cfe-8a031b1ee11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:28.625558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e693edb-3e39-4c21-8cfe-8a031b1ee11c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:28.625982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e693edb-3e39-4c21-8cfe-8a031b1ee11c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:28.626414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e693edb-3e39-4c21-8cfe-8a031b1ee11c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:28.633762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e693edb-3e39-4c21-8cfe-8a031b1ee11c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:28.635552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e693edb-3e39-4c21-8cfe-8a031b1ee11c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:28.647863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-5e693edb-3e39-4c21-8cfe-8a031b1ee11c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:18:28.647863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:28.647863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:28.647863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:28.647863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:28.647863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:28.647863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:28.647863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:28.647863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:28.647863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:28.647863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:28.647863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:28.647863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:28.647863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:28.647863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:28.647863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:28.649033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:28.650205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:28.650205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:28.650205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:28.650205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:28.650205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:28.650205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:28.650205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:28.650205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:28.650205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:18:28.650205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:28.652983 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 430/860] 10.222.0.76 () {56 vars in 1117 bytes} [Sat Aug 27 04:18:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:28.660193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b48365-bfae-4d5e-834e-0cde865b31e3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:28.742118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:28.761521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b48365-bfae-4d5e-834e-0cde865b31e3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:28.784747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e693edb-3e39-4c21-8cfe-8a031b1ee11c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:28.805760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ceb32-aa63-4ba3-a19c-6ce774a81977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:28.806909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ceb32-aa63-4ba3-a19c-6ce774a81977 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:28.807753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ceb32-aa63-4ba3-a19c-6ce774a81977 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:28.808069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ceb32-aa63-4ba3-a19c-6ce774a81977 None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:28.808833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ceb32-aa63-4ba3-a19c-6ce774a81977 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:28.809132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ceb32-aa63-4ba3-a19c-6ce774a81977 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:28.810826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ceb32-aa63-4ba3-a19c-6ce774a81977 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:28.834477 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 431/861] 10.222.0.76 () {56 vars in 1149 bytes} [Sat Aug 27 04:18:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:28.839968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ceb32-aa63-4ba3-a19c-6ce774a81977 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:28.877115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:28.902868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e693edb-3e39-4c21-8cfe-8a031b1ee11c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:28.950548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199f7f2-6525-4783-9ad5-df1d575ab5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:28.952207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199f7f2-6525-4783-9ad5-df1d575ab5a4 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:28.952674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199f7f2-6525-4783-9ad5-df1d575ab5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:28.953125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199f7f2-6525-4783-9ad5-df1d575ab5a4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:28.953886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199f7f2-6525-4783-9ad5-df1d575ab5a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:28.954081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ceb32-aa63-4ba3-a19c-6ce774a81977 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:28.955875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199f7f2-6525-4783-9ad5-df1d575ab5a4 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:28.971164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-2199f7f2-6525-4783-9ad5-df1d575ab5a4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 04:18:28.971164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:28.971164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:28.971164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:28.971164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:28.971164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:28.971164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:28.971164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:28.971164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 04:18:28.971164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:28.971164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:28.971164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:28.971164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:28.971164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:28.971164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:28.971164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:28.972108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:28.972108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:28.972108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:28.972108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:28.972108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:28.972108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:28.972108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:28.972108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:28.972108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:28.972108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:28.972108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:28.972108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:28.972108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:28.972108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:28.972108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:28.972108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:28.972108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:28.973075 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:28.973075 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:28.973075 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:28.973075 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:28.973075 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:28.973075 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:28.973075 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:28.973075 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:28.973075 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:28.973075 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:28.973075 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:28.973075 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:28.973075 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 04:18:28.973075 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:28.978737 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 431/862] 10.222.0.76 () {56 vars in 1132 bytes} [Sat Aug 27 04:18:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:28.981575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199f7f2-6525-4783-9ad5-df1d575ab5a4 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:29.002340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f9c60-6ec2-4009-bb18-8968efc93c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:29.003265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f9c60-6ec2-4009-bb18-8968efc93c26 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:29.003672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f9c60-6ec2-4009-bb18-8968efc93c26 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:29.004124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f9c60-6ec2-4009-bb18-8968efc93c26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:29.013472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:29.074888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f9c60-6ec2-4009-bb18-8968efc93c26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:29.076357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f9c60-6ec2-4009-bb18-8968efc93c26 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:29.098736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199f7f2-6525-4783-9ad5-df1d575ab5a4 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:29.147604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadba7e-e803-43af-95bf-9f588cb55f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:29.148373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadba7e-e803-43af-95bf-9f588cb55f55 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:29.148757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadba7e-e803-43af-95bf-9f588cb55f55 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:29.149132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadba7e-e803-43af-95bf-9f588cb55f55 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:29.149890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadba7e-e803-43af-95bf-9f588cb55f55 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:29.150299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadba7e-e803-43af-95bf-9f588cb55f55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:29.152475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadba7e-e803-43af-95bf-9f588cb55f55 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:29.162520 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 432/863] 10.222.0.76 () {56 vars in 1126 bytes} [Sat Aug 27 04:18:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:29.163797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadba7e-e803-43af-95bf-9f588cb55f55 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:29.167498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:29.180262 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 432/864] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:18:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 04:18:29.189506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f9c60-6ec2-4009-bb18-8968efc93c26 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:29.248566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:29.281862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadba7e-e803-43af-95bf-9f588cb55f55 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:29.310745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f9c60-6ec2-4009-bb18-8968efc93c26 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:29.319070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b13b3b-fa72-4506-b055-98a9f0bcdf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:29.319956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b13b3b-fa72-4506-b055-98a9f0bcdf45 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:29.320481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b13b3b-fa72-4506-b055-98a9f0bcdf45 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:29.320956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b13b3b-fa72-4506-b055-98a9f0bcdf45 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:29.321810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b13b3b-fa72-4506-b055-98a9f0bcdf45 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:29.322333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b13b3b-fa72-4506-b055-98a9f0bcdf45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:29.324651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b13b3b-fa72-4506-b055-98a9f0bcdf45 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:29.329940 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 433/865] 10.222.0.76 () {56 vars in 1126 bytes} [Sat Aug 27 04:18:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:29.358510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd2768-8099-416c-ac35-4643e52d3e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:29.359577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd2768-8099-416c-ac35-4643e52d3e2c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:29.360062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd2768-8099-416c-ac35-4643e52d3e2c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:29.360570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd2768-8099-416c-ac35-4643e52d3e2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:29.373230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd2768-8099-416c-ac35-4643e52d3e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:29.375063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd2768-8099-416c-ac35-4643e52d3e2c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:29.393559 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-b9cd2768-8099-416c-ac35-4643e52d3e2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:29.393559 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:29.393559 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:29.393559 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:29.393559 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:29.393559 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:29.393559 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:29.393559 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:29.393559 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:29.393559 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:29.393559 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:29.393559 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:29.393559 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:29.393559 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:29.393559 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:29.393559 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:29.394874 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:29.394874 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:29.394874 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:29.394874 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:29.394874 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:29.394874 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:29.394874 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:29.394874 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:29.394874 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:29.394874 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:29.394874 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:29.394874 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:29.394874 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:29.394874 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:29.394874 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:29.394874 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:29.394874 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:29.395796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:29.395796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:29.395796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:29.398619 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 433/866] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:29.407409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b13b3b-fa72-4506-b055-98a9f0bcdf45 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:29.491235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:29.525832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b13b3b-fa72-4506-b055-98a9f0bcdf45 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:29.562845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5087dd-6c07-4fd5-987d-b4a45da2bf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:29.563453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5087dd-6c07-4fd5-987d-b4a45da2bf39 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:29.563734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5087dd-6c07-4fd5-987d-b4a45da2bf39 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:29.564007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5087dd-6c07-4fd5-987d-b4a45da2bf39 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:29.564735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5087dd-6c07-4fd5-987d-b4a45da2bf39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:29.565038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5087dd-6c07-4fd5-987d-b4a45da2bf39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:29.566412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5087dd-6c07-4fd5-987d-b4a45da2bf39 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:29.581321 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 434/867] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:29.586532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd2768-8099-416c-ac35-4643e52d3e2c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:29.684911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:29.694763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd2768-8099-416c-ac35-4643e52d3e2c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:29.731285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d175e-543a-46cb-97d3-8da28ef9a3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:29.731926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d175e-543a-46cb-97d3-8da28ef9a3f6 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:29.732230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d175e-543a-46cb-97d3-8da28ef9a3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:29.732507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d175e-543a-46cb-97d3-8da28ef9a3f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:29.739717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d175e-543a-46cb-97d3-8da28ef9a3f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:29.741200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d175e-543a-46cb-97d3-8da28ef9a3f6 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:29.753478 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-061d175e-543a-46cb-97d3-8da28ef9a3f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:29.753478 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:29.753478 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:29.753478 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:29.753478 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:29.753478 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:29.753478 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:29.753478 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:29.753478 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:29.753478 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:29.753478 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:29.753478 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:29.753478 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:29.753478 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:29.753478 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:29.754627 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:29.754627 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:29.754627 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:29.754627 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:29.754627 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:29.754627 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:29.754627 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:29.754627 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:29.754627 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:29.754627 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:29.754627 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:29.754627 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:29.754627 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:29.754627 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:29.754627 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:29.754627 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:29.754627 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:29.755507 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:29.755507 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:29.755507 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:29.755507 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:29.755507 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:29.755507 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:29.755507 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:29.755507 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:29.756587 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 434/868] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:29.764217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5087dd-6c07-4fd5-987d-b4a45da2bf39 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:29.873744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5087dd-6c07-4fd5-987d-b4a45da2bf39 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:29.905067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:29.910525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82351067-cd39-454c-aeba-42ac232ac773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:29.911133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82351067-cd39-454c-aeba-42ac232ac773 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:29.911414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82351067-cd39-454c-aeba-42ac232ac773 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:29.911679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82351067-cd39-454c-aeba-42ac232ac773 None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:29.912395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82351067-cd39-454c-aeba-42ac232ac773 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:29.912696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82351067-cd39-454c-aeba-42ac232ac773 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:29.914120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82351067-cd39-454c-aeba-42ac232ac773 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:29.926472 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 435/869] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:29.932032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d175e-543a-46cb-97d3-8da28ef9a3f6 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:30.004610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be6f20-d5b9-417d-8c35-101fb34c8ff6 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:30.005133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be6f20-d5b9-417d-8c35-101fb34c8ff6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:30.005479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be6f20-d5b9-417d-8c35-101fb34c8ff6 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:30.007148 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 436/870] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:30.013280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb402b-c289-472f-9abf-c076f7c743ed None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:30.013654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb402b-c289-472f-9abf-c076f7c743ed None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:30.014000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb402b-c289-472f-9abf-c076f7c743ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:30.032836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-93bb402b-c289-472f-9abf-c076f7c743ed None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:30.034121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-93bb402b-c289-472f-9abf-c076f7c743ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:30.054553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d175e-543a-46cb-97d3-8da28ef9a3f6 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:30.110401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844c08f-d0bb-4a5b-b22c-3088209b3628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:30.110401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844c08f-d0bb-4a5b-b22c-3088209b3628 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:30.110401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844c08f-d0bb-4a5b-b22c-3088209b3628 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:30.110401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844c08f-d0bb-4a5b-b22c-3088209b3628 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:30.110867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844c08f-d0bb-4a5b-b22c-3088209b3628 None admin] RBAC: Adding query filter params (role.id=127770d936b94a5da885e721233e7f7b, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=7aa8f9ba9e854c7abc4237eb72c55590) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:30.110867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844c08f-d0bb-4a5b-b22c-3088209b3628 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:30.110867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844c08f-d0bb-4a5b-b22c-3088209b3628 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:30.116420 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 437/871] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:30.117296 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 435/872] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:18:29 2022] GET /identity/v3/role_assignments?user.id=7aa8f9ba9e854c7abc4237eb72c55590&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=127770d936b94a5da885e721233e7f7b => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:30.409617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb402b-c289-472f-9abf-c076f7c743ed None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:30.491720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4824e-32fa-48c5-bf17-50bf47624415 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:30.492271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4824e-32fa-48c5-bf17-50bf47624415 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:30.492453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4824e-32fa-48c5-bf17-50bf47624415 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:30.494275 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 436/873] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:18:30.504489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f0b90-0a42-4e76-99b1-dd69925eedad None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:30.504489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f0b90-0a42-4e76-99b1-dd69925eedad None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:30.504489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f0b90-0a42-4e76-99b1-dd69925eedad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:30.555427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-635f0b90-0a42-4e76-99b1-dd69925eedad None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:30.555427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-635f0b90-0a42-4e76-99b1-dd69925eedad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:30.555765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb402b-c289-472f-9abf-c076f7c743ed None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:30.555933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:30.556081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:30.568119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4101c-1500-4d68-9cd9-6af5d4e8d3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:30.568754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4101c-1500-4d68-9cd9-6af5d4e8d3cb None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:30.569031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4101c-1500-4d68-9cd9-6af5d4e8d3cb None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:30.569304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4101c-1500-4d68-9cd9-6af5d4e8d3cb None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:30.569954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4101c-1500-4d68-9cd9-6af5d4e8d3cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:30.571329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4101c-1500-4d68-9cd9-6af5d4e8d3cb None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:30.596608 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 437/874] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:18:30.656670 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 438/875] 10.222.0.76 () {60 vars in 1141 bytes} [Sat Aug 27 04:18:30 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:18:30.868854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f0b90-0a42-4e76-99b1-dd69925eedad None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:30.977075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f0b90-0a42-4e76-99b1-dd69925eedad None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:31.020436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b4ed1-2022-4b60-954a-0f72cc7c6679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:31.021465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b4ed1-2022-4b60-954a-0f72cc7c6679 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:31.021954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b4ed1-2022-4b60-954a-0f72cc7c6679 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:31.022417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b4ed1-2022-4b60-954a-0f72cc7c6679 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:31.023180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b4ed1-2022-4b60-954a-0f72cc7c6679 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:31.024752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b4ed1-2022-4b60-954a-0f72cc7c6679 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:31.034824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-2c2b4ed1-2022-4b60-954a-0f72cc7c6679 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:18:31.034824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:31.034824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:31.034824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:31.034824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:31.034824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:31.034824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:31.034824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:31.034824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:18:31.034824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:31.034824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:31.034824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:31.034824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:31.034824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:31.034824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:31.034824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:31.034824 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:31.035831 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:31.035831 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:31.035831 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:31.035831 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:31.035831 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:31.035831 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:31.035831 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:31.035831 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:31.035831 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:31.035831 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:31.035831 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:31.035831 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:31.035831 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:31.035831 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:31.035831 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:31.035831 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:31.036692 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:31.036692 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:31.036692 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:31.036692 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:31.036692 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:31.036692 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:31.036692 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:31.036692 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:31.036692 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:31.036692 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:31.036692 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:31.036692 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:31.036692 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:18:31.036692 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:31.039414 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 438/876] 10.222.0.76 () {56 vars in 1126 bytes} [Sat Aug 27 04:18:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:31.045503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4101c-1500-4d68-9cd9-6af5d4e8d3cb None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:31.152758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4101c-1500-4d68-9cd9-6af5d4e8d3cb None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:31.192731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55497736-c0d2-4665-8e1c-959a8456cc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:31.193774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55497736-c0d2-4665-8e1c-959a8456cc6d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:31.194251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55497736-c0d2-4665-8e1c-959a8456cc6d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:31.194716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55497736-c0d2-4665-8e1c-959a8456cc6d None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:31.195559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55497736-c0d2-4665-8e1c-959a8456cc6d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:31.196054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55497736-c0d2-4665-8e1c-959a8456cc6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:31.197889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55497736-c0d2-4665-8e1c-959a8456cc6d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:31.203629 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 439/877] 10.222.0.76 () {56 vars in 1122 bytes} [Sat Aug 27 04:18:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:31.209277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b4ed1-2022-4b60-954a-0f72cc7c6679 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:31.214341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:31.316021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b4ed1-2022-4b60-954a-0f72cc7c6679 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:31.352432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7998c7-1d69-4731-928d-eded5d0d185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:31.353389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7998c7-1d69-4731-928d-eded5d0d185f None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:31.353863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7998c7-1d69-4731-928d-eded5d0d185f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:31.354356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7998c7-1d69-4731-928d-eded5d0d185f None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:31.355202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7998c7-1d69-4731-928d-eded5d0d185f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:31.355696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7998c7-1d69-4731-928d-eded5d0d185f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:31.357263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7998c7-1d69-4731-928d-eded5d0d185f None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:31.362570 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 439/878] 10.222.0.76 () {56 vars in 1122 bytes} [Sat Aug 27 04:18:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:31.368838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e58b2-1381-41c6-97e1-1257c5bae77c None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:31.368838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e58b2-1381-41c6-97e1-1257c5bae77c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:31.368838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e58b2-1381-41c6-97e1-1257c5bae77c None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:31.368838 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 440/879] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:31.374647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518077f-0482-4ca6-8b5d-0d8b74bd19c0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:31.374972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518077f-0482-4ca6-8b5d-0d8b74bd19c0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:31.375205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518077f-0482-4ca6-8b5d-0d8b74bd19c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:31.395406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8518077f-0482-4ca6-8b5d-0d8b74bd19c0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:31.396652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8518077f-0482-4ca6-8b5d-0d8b74bd19c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:31.469790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:31.481117 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 440/880] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:31 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:31.747928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e58b2-1381-41c6-97e1-1257c5bae77c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:31.797040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:31.873231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e58b2-1381-41c6-97e1-1257c5bae77c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:31.908956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53bb7b-c8fd-4e1d-8e0d-ef1449b15fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:31.909564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53bb7b-c8fd-4e1d-8e0d-ef1449b15fe3 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:31.909844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53bb7b-c8fd-4e1d-8e0d-ef1449b15fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:31.910116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53bb7b-c8fd-4e1d-8e0d-ef1449b15fe3 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:31.910776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53bb7b-c8fd-4e1d-8e0d-ef1449b15fe3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:31.912152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53bb7b-c8fd-4e1d-8e0d-ef1449b15fe3 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:32.006688 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 441/881] 10.222.0.76 () {60 vars in 1141 bytes} [Sat Aug 27 04:18:31 2022] POST /identity/v3/services => generated 269 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:18:32.177935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9001bb-c877-41db-892e-fc43bf1bc60a None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:32.178817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9001bb-c877-41db-892e-fc43bf1bc60a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:32.179097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9001bb-c877-41db-892e-fc43bf1bc60a None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:32.180619 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 441/882] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:18:32.186414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f0214-5eb6-43ad-8db3-15cc7a78a636 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:32.186857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f0214-5eb6-43ad-8db3-15cc7a78a636 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:32.186960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f0214-5eb6-43ad-8db3-15cc7a78a636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:32.206478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-833f0214-5eb6-43ad-8db3-15cc7a78a636 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:32.207668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-833f0214-5eb6-43ad-8db3-15cc7a78a636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:32.286195 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 442/883] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:32.562630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9001bb-c877-41db-892e-fc43bf1bc60a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:32.669100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9001bb-c877-41db-892e-fc43bf1bc60a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:32.705385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6faaa-6c12-41ff-9529-3bfa9243d25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:32.706016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6faaa-6c12-41ff-9529-3bfa9243d25d None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:32.706294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6faaa-6c12-41ff-9529-3bfa9243d25d None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:32.706564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6faaa-6c12-41ff-9529-3bfa9243d25d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:32.717657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6faaa-6c12-41ff-9529-3bfa9243d25d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:32.722441 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-9bf6faaa-6c12-41ff-9529-3bfa9243d25d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:18:32.722441 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:32.722441 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:32.722441 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:32.722441 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:32.722441 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:32.722441 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:32.722441 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:32.722441 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:32.722441 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:32.722441 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:32.722441 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:32.722441 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:32.722441 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:32.722441 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:32.722441 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:32.723359 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:32.723359 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:32.723359 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:32.723359 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:32.723359 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:32.723359 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:32.723359 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:32.723359 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:32.723359 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:32.723359 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:32.723359 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:32.723359 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:32.723359 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:32.723359 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:32.723359 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:32.723359 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:32.724217 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:32.724217 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:32.724217 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:32.724217 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:32.724217 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:32.724217 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:32.724217 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:32.724217 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:32.724217 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:32.724217 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:32.724217 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:18:32.724217 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:32.724217 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 442/884] 10.222.0.76 () {56 vars in 1120 bytes} [Sat Aug 27 04:18:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:32.733568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f0214-5eb6-43ad-8db3-15cc7a78a636 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:32.765307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:32.771837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f8d2f-06b6-42bc-9f0f-2d0b062e6ba0 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:32.772127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f8d2f-06b6-42bc-9f0f-2d0b062e6ba0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:32.772429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f8d2f-06b6-42bc-9f0f-2d0b062e6ba0 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:32.774577 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 443/885] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:32.783088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb496b4-f8a4-4635-a1be-767d6db85721 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:32.783088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb496b4-f8a4-4635-a1be-767d6db85721 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:32.783088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb496b4-f8a4-4635-a1be-767d6db85721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:32.799416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0fb496b4-f8a4-4635-a1be-767d6db85721 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:32.801081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0fb496b4-f8a4-4635-a1be-767d6db85721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:32.838700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f0214-5eb6-43ad-8db3-15cc7a78a636 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:32.856534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:32.877519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007d1e5-6929-428d-b3f3-bbecb25843ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:32.877813 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 444/886] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:18:32.878510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007d1e5-6929-428d-b3f3-bbecb25843ba None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:32.878966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007d1e5-6929-428d-b3f3-bbecb25843ba None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:32.879384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007d1e5-6929-428d-b3f3-bbecb25843ba None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:32.880222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007d1e5-6929-428d-b3f3-bbecb25843ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:32.880668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007d1e5-6929-428d-b3f3-bbecb25843ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:32.882175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007d1e5-6929-428d-b3f3-bbecb25843ba None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:32.893059 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 443/887] 10.222.0.76 () {56 vars in 1115 bytes} [Sat Aug 27 04:18:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:32.902070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb496b4-f8a4-4635-a1be-767d6db85721 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:33.029625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb496b4-f8a4-4635-a1be-767d6db85721 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:33.066222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0207f81-441e-4d0a-bd8d-e298d29bd292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:33.066857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207f81-441e-4d0a-bd8d-e298d29bd292 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:33.067131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207f81-441e-4d0a-bd8d-e298d29bd292 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:33.067403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207f81-441e-4d0a-bd8d-e298d29bd292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:33.078359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0207f81-441e-4d0a-bd8d-e298d29bd292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:33.079803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0207f81-441e-4d0a-bd8d-e298d29bd292 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:33.095386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-f0207f81-441e-4d0a-bd8d-e298d29bd292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:33.095386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:33.095386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:33.095386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:33.095386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:33.095386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:33.095386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:33.095386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:33.095386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:33.095386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:33.095386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:33.095386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:33.095386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:33.095386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:33.095386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:33.095386 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:33.096364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:33.096364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:33.096364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:33.096364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:33.096364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:33.096364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:33.096364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:33.096364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:33.096364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:33.096364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:33.096364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:33.096364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:33.096364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:33.096364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:33.096364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:33.096364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:33.096364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:33.097287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:33.097287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:33.097287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:33.097287 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 445/888] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:33.102504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007d1e5-6929-428d-b3f3-bbecb25843ba None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:33.152790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0207f81-441e-4d0a-bd8d-e298d29bd292 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:33.212655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:33.221747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:33.235144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007d1e5-6929-428d-b3f3-bbecb25843ba None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:33.270548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f889ba-dc8a-4fba-9335-5cb865f90d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:33.271779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f889ba-dc8a-4fba-9335-5cb865f90d2d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:33.272531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f889ba-dc8a-4fba-9335-5cb865f90d2d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:33.273104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f889ba-dc8a-4fba-9335-5cb865f90d2d None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:33.274339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f889ba-dc8a-4fba-9335-5cb865f90d2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:33.274939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f889ba-dc8a-4fba-9335-5cb865f90d2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:33.278312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f889ba-dc8a-4fba-9335-5cb865f90d2d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:33.279818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0207f81-441e-4d0a-bd8d-e298d29bd292 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:33.292374 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 444/889] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:33.298456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f889ba-dc8a-4fba-9335-5cb865f90d2d None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:33.325427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a769306-eb79-4c63-b487-58721e6049b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:33.326631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a769306-eb79-4c63-b487-58721e6049b5 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:33.327017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a769306-eb79-4c63-b487-58721e6049b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:33.327385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a769306-eb79-4c63-b487-58721e6049b5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:33.328360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a769306-eb79-4c63-b487-58721e6049b5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:33.330279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a769306-eb79-4c63-b487-58721e6049b5 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:33.342801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-8a769306-eb79-4c63-b487-58721e6049b5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 04:18:33.342801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:33.342801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:33.342801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:33.342801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:33.342801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:33.342801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:33.342801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:33.342801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 04:18:33.342801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:33.342801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:33.342801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:33.342801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:33.342801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:33.342801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:33.342801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:33.342801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:33.344569 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:33.344569 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:33.344569 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:33.344569 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:33.344569 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:33.344569 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:33.344569 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:33.344569 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:33.344569 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:33.344569 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:33.344569 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:33.344569 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:33.344569 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:33.344569 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:33.344569 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:33.344569 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:33.346547 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:33.346547 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:33.346547 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:33.346547 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:33.346547 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:33.346547 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:33.346547 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:33.346547 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:33.346547 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:33.346547 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:33.346547 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:33.346547 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:33.346547 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 04:18:33.346547 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:33.352185 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 446/890] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:18:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:33.353275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a769306-eb79-4c63-b487-58721e6049b5 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:33.427258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f889ba-dc8a-4fba-9335-5cb865f90d2d None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:33.464447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07796564-d4a2-4b63-80e9-6925504cedc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:33.464771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07796564-d4a2-4b63-80e9-6925504cedc4 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:33.464771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07796564-d4a2-4b63-80e9-6925504cedc4 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:33.465069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07796564-d4a2-4b63-80e9-6925504cedc4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:33.472253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a769306-eb79-4c63-b487-58721e6049b5 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:33.472625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07796564-d4a2-4b63-80e9-6925504cedc4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:33.474055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07796564-d4a2-4b63-80e9-6925504cedc4 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:33.475385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:33.485952 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-07796564-d4a2-4b63-80e9-6925504cedc4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:18:33.485952 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:33.485952 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:33.485952 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:33.485952 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:33.485952 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:33.485952 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:33.485952 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:33.485952 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:33.485952 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:33.485952 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:33.485952 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:33.485952 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:33.485952 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:33.485952 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:33.485952 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:33.489587 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:33.490544 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:33.490544 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:33.490544 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:33.490544 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:33.490544 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:33.490544 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:33.490544 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:33.490544 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:33.490544 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:18:33.490544 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:33.490544 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 445/891] 10.222.0.76 () {56 vars in 1117 bytes} [Sat Aug 27 04:18:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:33.490544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e46aa-5c92-4939-9481-da6b26e0074d None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:33.490544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e46aa-5c92-4939-9481-da6b26e0074d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:33.491276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e46aa-5c92-4939-9481-da6b26e0074d None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:33.491276 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 446/892] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:33.495013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e46aa-5c92-4939-9481-da6b26e0074d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:33.507806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:33.515462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc49cd1-6454-4701-a5c3-48a14efee29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:33.516059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49cd1-6454-4701-a5c3-48a14efee29f None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:33.516378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49cd1-6454-4701-a5c3-48a14efee29f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:33.516645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49cd1-6454-4701-a5c3-48a14efee29f None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:33.517266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc49cd1-6454-4701-a5c3-48a14efee29f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:33.517562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc49cd1-6454-4701-a5c3-48a14efee29f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:33.518986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc49cd1-6454-4701-a5c3-48a14efee29f None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:33.528320 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 447/893] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:18:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:33.529971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be6348-7af5-45b1-98a9-1e902c68ae46 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:33.530420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be6348-7af5-45b1-98a9-1e902c68ae46 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:33.530720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be6348-7af5-45b1-98a9-1e902c68ae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:33.549777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-33be6348-7af5-45b1-98a9-1e902c68ae46 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:33.550984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-33be6348-7af5-45b1-98a9-1e902c68ae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:33.611674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e46aa-5c92-4939-9481-da6b26e0074d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:33.627428 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 448/894] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:33.628951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be6348-7af5-45b1-98a9-1e902c68ae46 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:33.654865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d2295-2bd1-4e82-91a2-abfab094f1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:33.656270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d2295-2bd1-4e82-91a2-abfab094f1e1 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:33.656981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d2295-2bd1-4e82-91a2-abfab094f1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:33.657468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d2295-2bd1-4e82-91a2-abfab094f1e1 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:33.658642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d2295-2bd1-4e82-91a2-abfab094f1e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:33.659531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d2295-2bd1-4e82-91a2-abfab094f1e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:33.661268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d2295-2bd1-4e82-91a2-abfab094f1e1 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:33.687491 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 447/895] 10.222.0.76 () {56 vars in 1149 bytes} [Sat Aug 27 04:18:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:33.693164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d2295-2bd1-4e82-91a2-abfab094f1e1 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:33.758369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:33.762628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be6348-7af5-45b1-98a9-1e902c68ae46 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:33.789874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:33.798072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c771c-1f6d-47f6-a69b-423335a6a4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:33.798877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c771c-1f6d-47f6-a69b-423335a6a4e4 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:33.799322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c771c-1f6d-47f6-a69b-423335a6a4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:33.799736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c771c-1f6d-47f6-a69b-423335a6a4e4 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:33.800654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c771c-1f6d-47f6-a69b-423335a6a4e4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:33.801094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c771c-1f6d-47f6-a69b-423335a6a4e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:33.802669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c771c-1f6d-47f6-a69b-423335a6a4e4 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:33.813180 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 449/896] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:18:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:33.814632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c771c-1f6d-47f6-a69b-423335a6a4e4 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:33.831162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d2295-2bd1-4e82-91a2-abfab094f1e1 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:33.870634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a53b9-b4a3-4c2c-b61d-4b5b14f2de43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:33.871569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a53b9-b4a3-4c2c-b61d-4b5b14f2de43 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:33.872314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a53b9-b4a3-4c2c-b61d-4b5b14f2de43 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:33.872803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a53b9-b4a3-4c2c-b61d-4b5b14f2de43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:33.917699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c771c-1f6d-47f6-a69b-423335a6a4e4 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:33.948322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a53b9-b4a3-4c2c-b61d-4b5b14f2de43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:33.949810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a53b9-b4a3-4c2c-b61d-4b5b14f2de43 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:33.960546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306754a2-c685-451e-92f7-1ce9669b1ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:33.960546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306754a2-c685-451e-92f7-1ce9669b1ddb None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:33.960546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306754a2-c685-451e-92f7-1ce9669b1ddb None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:33.960546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306754a2-c685-451e-92f7-1ce9669b1ddb None admin] PATH_INFO: `/v3/endpoints` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:33.960949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306754a2-c685-451e-92f7-1ce9669b1ddb None admin] RBAC: Adding query filter params (interface=public, service_id=5261af4a8a15428092c21f7ac4ded9de, region_id=RegionOne) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:33.960949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306754a2-c685-451e-92f7-1ce9669b1ddb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:33.962581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306754a2-c685-451e-92f7-1ce9669b1ddb None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:33.973048 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 450/897] 10.222.0.76 () {56 vars in 1251 bytes} [Sat Aug 27 04:18:33 2022] GET /identity/v3/endpoints?service_id=5261af4a8a15428092c21f7ac4ded9de&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:33.974127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306754a2-c685-451e-92f7-1ce9669b1ddb None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:34.006228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:34.019188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:34.053399 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 448/898] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:18:33 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 27 04:18:34.054234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a53b9-b4a3-4c2c-b61d-4b5b14f2de43 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:34.081753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306754a2-c685-451e-92f7-1ce9669b1ddb None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:34.117941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab545d-1d9f-41bf-9017-51c1c339b249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:34.118539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab545d-1d9f-41bf-9017-51c1c339b249 None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:34.118822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab545d-1d9f-41bf-9017-51c1c339b249 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:34.119090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab545d-1d9f-41bf-9017-51c1c339b249 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:34.119804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab545d-1d9f-41bf-9017-51c1c339b249 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:34.121379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab545d-1d9f-41bf-9017-51c1c339b249 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:34.152619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a53b9-b4a3-4c2c-b61d-4b5b14f2de43 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:34.186008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713ac57-4fde-4b98-8cf4-1483c895afb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:34.186603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713ac57-4fde-4b98-8cf4-1483c895afb2 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:34.186919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713ac57-4fde-4b98-8cf4-1483c895afb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:34.187193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713ac57-4fde-4b98-8cf4-1483c895afb2 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:34.187790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713ac57-4fde-4b98-8cf4-1483c895afb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:34.189239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713ac57-4fde-4b98-8cf4-1483c895afb2 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:34.194698 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 449/899] 10.222.0.76 () {56 vars in 1087 bytes} [Sat Aug 27 04:18:34 2022] GET /identity/v3/services => generated 1268 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:18:34.195802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0833ce-0c93-49f8-ab94-00341d9bfcaa None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:34.196082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0833ce-0c93-49f8-ab94-00341d9bfcaa None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:34.196380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0833ce-0c93-49f8-ab94-00341d9bfcaa None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:34.198100 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 450/900] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:34.198889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0833ce-0c93-49f8-ab94-00341d9bfcaa None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:34.222628 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 451/901] 10.222.0.76 () {60 vars in 1141 bytes} [Sat Aug 27 04:18:33 2022] POST /identity/v3/services => generated 241 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:18:34.224060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661d5a9-ee48-471e-9998-23c5acb1a131 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:34.225044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661d5a9-ee48-471e-9998-23c5acb1a131 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:34.225326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661d5a9-ee48-471e-9998-23c5acb1a131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:34.245565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:34.255788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6661d5a9-ee48-471e-9998-23c5acb1a131 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:34.257410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6661d5a9-ee48-471e-9998-23c5acb1a131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:34.352564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0833ce-0c93-49f8-ab94-00341d9bfcaa None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:34.361967 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 452/902] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:34.395672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f887963-b4bd-4b3e-9144-e2fd8f480308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:34.396272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f887963-b4bd-4b3e-9144-e2fd8f480308 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:34.396556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f887963-b4bd-4b3e-9144-e2fd8f480308 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:34.396830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f887963-b4bd-4b3e-9144-e2fd8f480308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:34.407786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f887963-b4bd-4b3e-9144-e2fd8f480308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:34.409340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f887963-b4bd-4b3e-9144-e2fd8f480308 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:34.425418 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-1f887963-b4bd-4b3e-9144-e2fd8f480308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:34.425418 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:34.425418 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:34.425418 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:34.425418 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:34.425418 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:34.425418 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:34.425418 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:34.425418 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:34.425418 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:34.425418 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:34.425418 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:34.425418 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:34.425418 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:34.425418 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:34.425418 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:34.426394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:34.426394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:34.426394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:34.426394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:34.426394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:34.426394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:34.426394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:34.426394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:34.426394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:34.426394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:34.426394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:34.426394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:34.426394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:34.426394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:34.426394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:34.426394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:34.426394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:34.427289 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:34.427289 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:34.427289 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:34.427883 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 451/903] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:34.432585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661d5a9-ee48-471e-9998-23c5acb1a131 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:34.452428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:34.540514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661d5a9-ee48-471e-9998-23c5acb1a131 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:34.578759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d82bfe-6900-4571-8e72-d6c28b9a44d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:34.579646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d82bfe-6900-4571-8e72-d6c28b9a44d7 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:34.580114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d82bfe-6900-4571-8e72-d6c28b9a44d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:34.580673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d82bfe-6900-4571-8e72-d6c28b9a44d7 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:34.581468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d82bfe-6900-4571-8e72-d6c28b9a44d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:34.581969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d82bfe-6900-4571-8e72-d6c28b9a44d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:34.583542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d82bfe-6900-4571-8e72-d6c28b9a44d7 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:34.596030 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 453/904] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:34.604653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f887963-b4bd-4b3e-9144-e2fd8f480308 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:34.634243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d82bfe-6900-4571-8e72-d6c28b9a44d7 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:34.715361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f887963-b4bd-4b3e-9144-e2fd8f480308 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:34.717691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:34.734061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:34.761386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d82bfe-6900-4571-8e72-d6c28b9a44d7 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:34.761581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f0a24-ca27-47b6-bdf5-d9d1ee1e157c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:34.762107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f0a24-ca27-47b6-bdf5-d9d1ee1e157c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:34.762388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f0a24-ca27-47b6-bdf5-d9d1ee1e157c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:34.762662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f0a24-ca27-47b6-bdf5-d9d1ee1e157c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:34.770917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f0a24-ca27-47b6-bdf5-d9d1ee1e157c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:34.772407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f0a24-ca27-47b6-bdf5-d9d1ee1e157c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:34.785216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-5a3f0a24-ca27-47b6-bdf5-d9d1ee1e157c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:34.785216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:34.785216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:34.785216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:34.785216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:34.785216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:34.785216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:34.785216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:34.785216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:34.785216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:34.785216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:34.785216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:34.785216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:34.785216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:34.785216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:34.786188 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:34.786188 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:34.786188 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:34.786188 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:34.786188 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:34.786188 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:34.786188 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:34.786188 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:34.786188 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:34.786188 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:34.786188 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:34.786188 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:34.786188 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:34.786188 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:34.786188 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:34.786188 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:34.786188 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:34.787073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:34.787073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:34.787073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:34.787073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:34.787073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:34.787073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:34.787073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:34.787073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:34.787073 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 452/905] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:34.797514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f0a24-ca27-47b6-bdf5-d9d1ee1e157c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:34.802115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1509093-a49b-4d93-be1f-9a5d257fe1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:34.802954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1509093-a49b-4d93-be1f-9a5d257fe1b2 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:34.803425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1509093-a49b-4d93-be1f-9a5d257fe1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:34.803871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1509093-a49b-4d93-be1f-9a5d257fe1b2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:34.804729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1509093-a49b-4d93-be1f-9a5d257fe1b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:34.806269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1509093-a49b-4d93-be1f-9a5d257fe1b2 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:34.817423 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-f1509093-a49b-4d93-be1f-9a5d257fe1b2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 04:18:34.817423 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:34.817423 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:34.817423 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:34.817423 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:34.817423 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:34.817423 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:34.817423 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:34.817423 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 04:18:34.817423 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:34.817423 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:34.817423 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:34.817423 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:34.817423 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:34.817423 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:34.817423 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:34.818363 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:34.818363 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:34.818363 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:34.818363 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:34.818363 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:34.818363 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:34.818363 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:34.818363 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:34.818363 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:34.818363 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:34.818363 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:34.818363 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:34.818363 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:34.818363 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:34.818363 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:34.818363 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:34.818363 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:34.819305 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:34.819305 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:34.819305 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:34.819305 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:34.819305 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:34.819305 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:34.819305 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:34.819305 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:34.819305 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:34.819305 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:34.819305 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:34.819305 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:34.819305 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 04:18:34.819305 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:34.822131 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 454/906] 10.222.0.76 () {56 vars in 1132 bytes} [Sat Aug 27 04:18:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:34.836203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1509093-a49b-4d93-be1f-9a5d257fe1b2 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:34.925376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f0a24-ca27-47b6-bdf5-d9d1ee1e157c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:34.964246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1509093-a49b-4d93-be1f-9a5d257fe1b2 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:34.971937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fc9f4-1f64-47e2-af5d-d33dcc80696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:34.972825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fc9f4-1f64-47e2-af5d-d33dcc80696f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:34.973282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fc9f4-1f64-47e2-af5d-d33dcc80696f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:34.973715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fc9f4-1f64-47e2-af5d-d33dcc80696f None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:34.974809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fc9f4-1f64-47e2-af5d-d33dcc80696f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:34.975292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fc9f4-1f64-47e2-af5d-d33dcc80696f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:34.976964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fc9f4-1f64-47e2-af5d-d33dcc80696f None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:34.987931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:34.991732 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 453/907] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:34.998150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fc9f4-1f64-47e2-af5d-d33dcc80696f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:35.013667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2ae2e-b1a2-4a50-bfe5-3225be1e34b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:35.014625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2ae2e-b1a2-4a50-bfe5-3225be1e34b7 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:35.015117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2ae2e-b1a2-4a50-bfe5-3225be1e34b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:35.015641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2ae2e-b1a2-4a50-bfe5-3225be1e34b7 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:35.016507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2ae2e-b1a2-4a50-bfe5-3225be1e34b7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:35.017054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2ae2e-b1a2-4a50-bfe5-3225be1e34b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:35.018736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2ae2e-b1a2-4a50-bfe5-3225be1e34b7 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:35.024281 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 455/908] 10.222.0.76 () {56 vars in 1126 bytes} [Sat Aug 27 04:18:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:35.031187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2ae2e-b1a2-4a50-bfe5-3225be1e34b7 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:35.037553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:35.129417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fc9f4-1f64-47e2-af5d-d33dcc80696f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:35.154783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2ae2e-b1a2-4a50-bfe5-3225be1e34b7 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:35.176867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a57c48-7dc9-4907-9888-a71859df0b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:35.177678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a57c48-7dc9-4907-9888-a71859df0b09 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:35.178444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a57c48-7dc9-4907-9888-a71859df0b09 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:35.178864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a57c48-7dc9-4907-9888-a71859df0b09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:35.179942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a57c48-7dc9-4907-9888-a71859df0b09 None admin] RBAC: Adding query filter params (role.id=36d21a4033f94db3950f5e390f6e2a38, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=7aa8f9ba9e854c7abc4237eb72c55590) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:35.180370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a57c48-7dc9-4907-9888-a71859df0b09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:35.183907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a57c48-7dc9-4907-9888-a71859df0b09 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:35.192767 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 454/909] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:18:34 2022] GET /identity/v3/role_assignments?user.id=7aa8f9ba9e854c7abc4237eb72c55590&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=36d21a4033f94db3950f5e390f6e2a38 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:35.205312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8db428-6a96-4c35-9df4-81a1f80b3ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:35.206541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8db428-6a96-4c35-9df4-81a1f80b3ae4 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:35.207034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8db428-6a96-4c35-9df4-81a1f80b3ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:35.207512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8db428-6a96-4c35-9df4-81a1f80b3ae4 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:35.208436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8db428-6a96-4c35-9df4-81a1f80b3ae4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:35.208959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8db428-6a96-4c35-9df4-81a1f80b3ae4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:35.210618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8db428-6a96-4c35-9df4-81a1f80b3ae4 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:35.217182 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 456/910] 10.222.0.76 () {56 vars in 1126 bytes} [Sat Aug 27 04:18:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:35.223106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a57c48-7dc9-4907-9888-a71859df0b09 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:35.293600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:35.343940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a57c48-7dc9-4907-9888-a71859df0b09 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:35.380124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204d572-0dff-4a79-83bd-89e17e2ac844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:35.380817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204d572-0dff-4a79-83bd-89e17e2ac844 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:35.381096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204d572-0dff-4a79-83bd-89e17e2ac844 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:35.381363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204d572-0dff-4a79-83bd-89e17e2ac844 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:35.382165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204d572-0dff-4a79-83bd-89e17e2ac844 None admin] RBAC: Adding query filter params (interface=public, service_id=c996ea7a2f6d418bbf1c6ea29ac11ba2, region_id=RegionOne) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:35.382519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204d572-0dff-4a79-83bd-89e17e2ac844 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:35.383878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204d572-0dff-4a79-83bd-89e17e2ac844 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:35.392248 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 455/911] 10.222.0.76 () {56 vars in 1251 bytes} [Sat Aug 27 04:18:35 2022] GET /identity/v3/endpoints?service_id=c996ea7a2f6d418bbf1c6ea29ac11ba2&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:35.396303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8db428-6a96-4c35-9df4-81a1f80b3ae4 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:35.469992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:35.505797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8db428-6a96-4c35-9df4-81a1f80b3ae4 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:35.543474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dd2ed-8336-4aa8-b38b-fa912abe7bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:35.544444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dd2ed-8336-4aa8-b38b-fa912abe7bdd None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:35.544986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dd2ed-8336-4aa8-b38b-fa912abe7bdd None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:35.545466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dd2ed-8336-4aa8-b38b-fa912abe7bdd None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:35.546263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824dd2ed-8336-4aa8-b38b-fa912abe7bdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:35.547858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824dd2ed-8336-4aa8-b38b-fa912abe7bdd None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:35.568900 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 457/912] 10.222.0.76 () {56 vars in 1087 bytes} [Sat Aug 27 04:18:35 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:18:36.178943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30829f-55df-4cc5-b34a-f0e3e0198f91 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:36.179319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30829f-55df-4cc5-b34a-f0e3e0198f91 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:36.179523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30829f-55df-4cc5-b34a-f0e3e0198f91 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:36.181081 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 456/913] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:36.187067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dae273-5d34-4aa6-a17a-1fc361f794d4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:36.187352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dae273-5d34-4aa6-a17a-1fc361f794d4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:36.187625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dae273-5d34-4aa6-a17a-1fc361f794d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:36.206686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-66dae273-5d34-4aa6-a17a-1fc361f794d4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:36.207858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-66dae273-5d34-4aa6-a17a-1fc361f794d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:36.289952 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 458/914] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:36.304372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da625c26-d03c-42f9-a70c-febc35fc0cfb None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:36.304880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da625c26-d03c-42f9-a70c-febc35fc0cfb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:36.304961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da625c26-d03c-42f9-a70c-febc35fc0cfb None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:36.306553 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 457/915] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:36.312599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdaf23-9bf3-455c-a939-e15116eab086 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:36.312879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdaf23-9bf3-455c-a939-e15116eab086 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:36.313147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdaf23-9bf3-455c-a939-e15116eab086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:36.331781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8ebdaf23-9bf3-455c-a939-e15116eab086 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:36.332990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8ebdaf23-9bf3-455c-a939-e15116eab086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:36.399359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:36.410604 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 459/916] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:36.562436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da625c26-d03c-42f9-a70c-febc35fc0cfb None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:36.669756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da625c26-d03c-42f9-a70c-febc35fc0cfb None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:36.675322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdaf23-9bf3-455c-a939-e15116eab086 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:36.704677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:36.717090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9c0fd-8739-4e37-afab-7214e3f3ad0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:36.717736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9c0fd-8739-4e37-afab-7214e3f3ad0b None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:36.718015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9c0fd-8739-4e37-afab-7214e3f3ad0b None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:36.718287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9c0fd-8739-4e37-afab-7214e3f3ad0b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:36.720324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9c0fd-8739-4e37-afab-7214e3f3ad0b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:36.721576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9c0fd-8739-4e37-afab-7214e3f3ad0b None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:36.734179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-36f9c0fd-8739-4e37-afab-7214e3f3ad0b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 04:18:36.734179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:36.734179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:36.734179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:36.734179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:36.734179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:36.734179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:36.734179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:36.734179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 04:18:36.734179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:36.734179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:36.734179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:36.734179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:36.734179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:36.734179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:36.734179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:36.734179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:36.735216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:36.735216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:36.735216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:36.735216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:36.735216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:36.735216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:36.735216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:36.735216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:36.735216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:36.735216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:36.735216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:36.735216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:36.735216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:36.735216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:36.735216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:36.735216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:36.736051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:36.736051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:36.736051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:36.736051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:36.736051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:36.736051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:36.736051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:36.736051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:36.736051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:36.736051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:36.736051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:36.736051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:36.736051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 04:18:36.736051 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:36.736051 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 458/917] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:18:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:36.741591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9c0fd-8739-4e37-afab-7214e3f3ad0b None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:36.816385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdaf23-9bf3-455c-a939-e15116eab086 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:36.852894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0056e3d-2e83-45a1-b2ad-d8d976891172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:36.854570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0056e3d-2e83-45a1-b2ad-d8d976891172 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:36.855187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0056e3d-2e83-45a1-b2ad-d8d976891172 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:36.855663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0056e3d-2e83-45a1-b2ad-d8d976891172 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:36.856492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0056e3d-2e83-45a1-b2ad-d8d976891172 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:36.858056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0056e3d-2e83-45a1-b2ad-d8d976891172 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:36.864485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9c0fd-8739-4e37-afab-7214e3f3ad0b None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:36.867519 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-e0056e3d-2e83-45a1-b2ad-d8d976891172 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:18:36.867519 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:36.867519 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:36.867519 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:36.867519 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:36.867519 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:36.867519 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:36.867519 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:36.867519 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:18:36.867519 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:36.867519 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:36.867519 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:36.867519 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:36.867519 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:36.867519 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:36.867519 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:36.867519 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:36.868545 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:36.868545 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:36.868545 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:36.868545 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:36.868545 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:36.868545 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:36.868545 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:36.868545 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:36.868545 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:36.868545 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:36.868545 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:36.868545 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:36.868545 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:36.868545 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:36.868545 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:36.868545 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:36.869652 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:36.869652 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:36.869652 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:36.869652 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:36.869652 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:36.869652 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:36.869652 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:36.869652 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:36.869652 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:36.869652 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:36.869652 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:36.869652 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:36.869652 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:18:36.869652 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:36.872563 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 460/918] 10.222.0.76 () {56 vars in 1126 bytes} [Sat Aug 27 04:18:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:36.877858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0056e3d-2e83-45a1-b2ad-d8d976891172 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:36.906028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019c19b-3b9e-4fbf-9f1c-92c67d0abf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:36.906984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019c19b-3b9e-4fbf-9f1c-92c67d0abf68 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:36.907466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019c19b-3b9e-4fbf-9f1c-92c67d0abf68 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:36.907963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019c19b-3b9e-4fbf-9f1c-92c67d0abf68 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:36.908878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019c19b-3b9e-4fbf-9f1c-92c67d0abf68 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:36.909382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019c19b-3b9e-4fbf-9f1c-92c67d0abf68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:36.911052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019c19b-3b9e-4fbf-9f1c-92c67d0abf68 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:36.917468 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 459/919] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:18:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:36.922717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019c19b-3b9e-4fbf-9f1c-92c67d0abf68 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:36.952634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:36.996332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:37.010428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0056e3d-2e83-45a1-b2ad-d8d976891172 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:37.050475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75c12b-0999-4917-bbfc-257b408e7415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:37.051277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75c12b-0999-4917-bbfc-257b408e7415 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:37.051510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75c12b-0999-4917-bbfc-257b408e7415 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:37.051841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75c12b-0999-4917-bbfc-257b408e7415 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:37.052804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75c12b-0999-4917-bbfc-257b408e7415 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:37.053020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75c12b-0999-4917-bbfc-257b408e7415 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:37.054391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75c12b-0999-4917-bbfc-257b408e7415 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:37.056767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019c19b-3b9e-4fbf-9f1c-92c67d0abf68 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:37.060580 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 461/920] 10.222.0.76 () {56 vars in 1122 bytes} [Sat Aug 27 04:18:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:37.065805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75c12b-0999-4917-bbfc-257b408e7415 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:37.106336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aed5b-a19e-4d03-b86b-ab4038387f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:37.107564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aed5b-a19e-4d03-b86b-ab4038387f2d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:37.109148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aed5b-a19e-4d03-b86b-ab4038387f2d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:37.109629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aed5b-a19e-4d03-b86b-ab4038387f2d None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:37.110483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8aed5b-a19e-4d03-b86b-ab4038387f2d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:37.110984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8aed5b-a19e-4d03-b86b-ab4038387f2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:37.112615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8aed5b-a19e-4d03-b86b-ab4038387f2d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:37.125176 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 460/921] 10.222.0.76 () {56 vars in 1114 bytes} [Sat Aug 27 04:18:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:37.126551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aed5b-a19e-4d03-b86b-ab4038387f2d None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:37.185594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75c12b-0999-4917-bbfc-257b408e7415 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:37.217021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:37.236746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dda73-802a-403b-9078-4af1fdd1d753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:37.238132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dda73-802a-403b-9078-4af1fdd1d753 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:37.238598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dda73-802a-403b-9078-4af1fdd1d753 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:37.239036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dda73-802a-403b-9078-4af1fdd1d753 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:37.240422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3dda73-802a-403b-9078-4af1fdd1d753 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:37.240974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3dda73-802a-403b-9078-4af1fdd1d753 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:37.242820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3dda73-802a-403b-9078-4af1fdd1d753 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:37.255103 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 462/922] 10.222.0.76 () {56 vars in 1122 bytes} [Sat Aug 27 04:18:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:37.255691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dda73-802a-403b-9078-4af1fdd1d753 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:37.272917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aed5b-a19e-4d03-b86b-ab4038387f2d None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:37.304112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:37.318390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3f5c7-7205-43dd-8f18-1ff736523300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:37.319029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3f5c7-7205-43dd-8f18-1ff736523300 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:37.319480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3f5c7-7205-43dd-8f18-1ff736523300 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:37.319589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3f5c7-7205-43dd-8f18-1ff736523300 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:37.320203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3f5c7-7205-43dd-8f18-1ff736523300 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:37.321579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3f5c7-7205-43dd-8f18-1ff736523300 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:37.367207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dda73-802a-403b-9078-4af1fdd1d753 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:37.396322 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 461/923] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:18:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:18:37.396322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68a189-d38b-4f11-ac50-dccec9cddae4 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:37.396322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68a189-d38b-4f11-ac50-dccec9cddae4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:37.396322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68a189-d38b-4f11-ac50-dccec9cddae4 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:37.396322 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 462/924] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:37.398707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389604b1-fe5e-4368-a127-998f07e1aa2a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:37.398996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389604b1-fe5e-4368-a127-998f07e1aa2a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:37.399273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389604b1-fe5e-4368-a127-998f07e1aa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:37.419552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ee90f-bb03-4f07-8fe4-a68572b63f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:37.420263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ee90f-bb03-4f07-8fe4-a68572b63f5b None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:37.420475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ee90f-bb03-4f07-8fe4-a68572b63f5b None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:37.420788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ee90f-bb03-4f07-8fe4-a68572b63f5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:37.421497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ee90f-bb03-4f07-8fe4-a68572b63f5b None admin] RBAC: Adding query filter params (interface=public, service_id=6272756f21d74296ac992b794c68c296, region_id=RegionOne) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:37.421608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-389604b1-fe5e-4368-a127-998f07e1aa2a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:37.421801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ee90f-bb03-4f07-8fe4-a68572b63f5b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:37.422998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-389604b1-fe5e-4368-a127-998f07e1aa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:37.423351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ee90f-bb03-4f07-8fe4-a68572b63f5b None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:37.430060 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 463/925] 10.222.0.76 () {56 vars in 1251 bytes} [Sat Aug 27 04:18:37 2022] GET /identity/v3/endpoints?service_id=6272756f21d74296ac992b794c68c296&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:37.436311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ee90f-bb03-4f07-8fe4-a68572b63f5b None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:37.491026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:37.520422 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 463/926] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:18:37.569106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ee90f-bb03-4f07-8fe4-a68572b63f5b None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:37.595834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156f520-c087-47c1-a903-ba9f33ad29a7 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:37.596150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156f520-c087-47c1-a903-ba9f33ad29a7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:37.596414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156f520-c087-47c1-a903-ba9f33ad29a7 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:37.597874 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 464/927] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:18:37.603004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b24aac-b184-4208-a17e-832445c19056 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:37.603523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b24aac-b184-4208-a17e-832445c19056 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:37.605014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b24aac-b184-4208-a17e-832445c19056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:37.620683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bccad4-1954-4678-b53c-05326d4d149c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:37.621276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bccad4-1954-4678-b53c-05326d4d149c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:37.621562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bccad4-1954-4678-b53c-05326d4d149c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:37.621823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bccad4-1954-4678-b53c-05326d4d149c None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:37.622471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bccad4-1954-4678-b53c-05326d4d149c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:37.623820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bccad4-1954-4678-b53c-05326d4d149c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:37.624686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e4b24aac-b184-4208-a17e-832445c19056 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:37.625877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e4b24aac-b184-4208-a17e-832445c19056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:37.630754 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 464/928] 10.222.0.76 () {56 vars in 1087 bytes} [Sat Aug 27 04:18:37 2022] GET /identity/v3/services => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:18:37.706573 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 465/929] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:18:37.801292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bccad4-1954-4678-b53c-05326d4d149c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:37.911073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bccad4-1954-4678-b53c-05326d4d149c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:37.936701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:37.953128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddb40e-105b-41a4-a181-91e0b65a912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:37.953773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddb40e-105b-41a4-a181-91e0b65a912e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:37.954051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddb40e-105b-41a4-a181-91e0b65a912e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:37.954321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddb40e-105b-41a4-a181-91e0b65a912e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:37.975242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddb40e-105b-41a4-a181-91e0b65a912e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:37.981004 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-d9ddb40e-105b-41a4-a181-91e0b65a912e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:18:37.981004 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:37.981004 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:37.981004 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:37.981004 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:37.981004 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:37.981004 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:37.981004 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:37.981004 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:37.981004 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:37.981004 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:37.981004 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:37.981004 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:37.981004 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:37.981004 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:37.981004 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:37.981990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:37.981990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:37.981990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:37.981990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:37.981990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:37.981990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:37.981990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:37.981990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:37.981990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:37.981990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:37.981990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:37.981990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:37.981990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:37.981990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:37.981990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:37.981990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:37.982842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:37.982842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:37.982842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:37.982842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:37.982842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:37.982842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:37.982842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:37.982842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:37.982842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:37.982842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:37.982842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:18:37.982842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:37.982842 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 465/930] 10.222.0.76 () {56 vars in 1120 bytes} [Sat Aug 27 04:18:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:37.989741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b24aac-b184-4208-a17e-832445c19056 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:37.990828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddb40e-105b-41a4-a181-91e0b65a912e None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:38.043730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:38.111444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddb40e-105b-41a4-a181-91e0b65a912e None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:38.130468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b24aac-b184-4208-a17e-832445c19056 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:38.154521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bfdaa-8cb8-43d3-82ff-9925f7418e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:38.155507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bfdaa-8cb8-43d3-82ff-9925f7418e4a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:38.155988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bfdaa-8cb8-43d3-82ff-9925f7418e4a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:38.156493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bfdaa-8cb8-43d3-82ff-9925f7418e4a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:38.157317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bfdaa-8cb8-43d3-82ff-9925f7418e4a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:38.158932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bfdaa-8cb8-43d3-82ff-9925f7418e4a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:38.168678 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-df2bfdaa-8cb8-43d3-82ff-9925f7418e4a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 04:18:38.168678 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:38.168678 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:38.168678 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:38.168678 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:38.168678 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:38.168678 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:38.168678 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:38.168678 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 04:18:38.168678 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:38.168678 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:38.168678 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:38.168678 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:38.168678 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:38.168678 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:38.168678 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:38.169638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:38.169638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:38.169638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:38.169638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:38.169638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:38.169638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:38.169638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:38.169638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:38.169638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:38.169638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:38.169638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:38.169638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:38.169638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:38.169638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:38.169638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:38.169638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:38.169638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:38.170555 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:38.170555 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:38.170555 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:38.170555 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:38.170555 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:38.170555 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:38.170555 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:38.170555 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:38.170555 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:38.170555 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:38.170555 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:38.170555 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:38.170555 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 04:18:38.170555 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:38.171774 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 466/931] 10.222.0.76 () {56 vars in 1132 bytes} [Sat Aug 27 04:18:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:38.178243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bfdaa-8cb8-43d3-82ff-9925f7418e4a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:38.179244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfd92e-c1b9-40df-a97b-93d626317ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:38.179873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfd92e-c1b9-40df-a97b-93d626317ab2 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:38.180151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfd92e-c1b9-40df-a97b-93d626317ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:38.180448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfd92e-c1b9-40df-a97b-93d626317ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:38.181127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfd92e-c1b9-40df-a97b-93d626317ab2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:38.181434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfd92e-c1b9-40df-a97b-93d626317ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:38.183571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfd92e-c1b9-40df-a97b-93d626317ab2 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:38.194826 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 466/932] 10.222.0.76 () {56 vars in 1115 bytes} [Sat Aug 27 04:18:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:38.201204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfd92e-c1b9-40df-a97b-93d626317ab2 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:38.220440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:38.298426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bfdaa-8cb8-43d3-82ff-9925f7418e4a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:38.337297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205b05f-6e55-4a63-a90c-eeb6a91b2844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:38.337517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:38.337962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205b05f-6e55-4a63-a90c-eeb6a91b2844 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:38.338212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205b05f-6e55-4a63-a90c-eeb6a91b2844 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:38.338497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205b05f-6e55-4a63-a90c-eeb6a91b2844 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:38.339288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205b05f-6e55-4a63-a90c-eeb6a91b2844 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:38.339932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205b05f-6e55-4a63-a90c-eeb6a91b2844 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:38.341683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205b05f-6e55-4a63-a90c-eeb6a91b2844 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:38.342521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfd92e-c1b9-40df-a97b-93d626317ab2 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:38.348194 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 467/933] 10.222.0.76 () {56 vars in 1126 bytes} [Sat Aug 27 04:18:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:38.362678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205b05f-6e55-4a63-a90c-eeb6a91b2844 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:38.379721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfb0e4-9f8b-440c-865f-a1ecd6223a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:38.380556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfb0e4-9f8b-440c-865f-a1ecd6223a56 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:38.380932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfb0e4-9f8b-440c-865f-a1ecd6223a56 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:38.381310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfb0e4-9f8b-440c-865f-a1ecd6223a56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:38.393166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfb0e4-9f8b-440c-865f-a1ecd6223a56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:38.394765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfb0e4-9f8b-440c-865f-a1ecd6223a56 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:38.410224 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-b6cfb0e4-9f8b-440c-865f-a1ecd6223a56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:38.410224 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:38.410224 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:38.410224 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:38.410224 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:38.410224 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:38.410224 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:38.410224 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:38.410224 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:38.410224 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:38.410224 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:38.410224 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:38.410224 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:38.410224 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:38.410224 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:38.410224 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:38.411217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:38.411217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:38.411217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:38.411217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:38.411217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:38.411217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:38.411217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:38.411217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:38.411217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:38.411217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:38.411217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:38.411217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:38.411217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:38.411217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:38.411217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:38.411217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:38.411217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:38.412216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:38.412216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:38.412216 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:38.412216 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 467/934] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:38.421838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfb0e4-9f8b-440c-865f-a1ecd6223a56 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:38.476219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:38.482944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205b05f-6e55-4a63-a90c-eeb6a91b2844 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:38.542577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9fe94-b1cf-4091-a75d-00d45d30f505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:38.605404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9fe94-b1cf-4091-a75d-00d45d30f505 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:38.605404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9fe94-b1cf-4091-a75d-00d45d30f505 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:38.605404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9fe94-b1cf-4091-a75d-00d45d30f505 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:38.605404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9fe94-b1cf-4091-a75d-00d45d30f505 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:38.605404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9fe94-b1cf-4091-a75d-00d45d30f505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:38.605404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9fe94-b1cf-4091-a75d-00d45d30f505 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:38.605871 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 468/935] 10.222.0.76 () {56 vars in 1126 bytes} [Sat Aug 27 04:18:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:38.605871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9fe94-b1cf-4091-a75d-00d45d30f505 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:38.606004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfb0e4-9f8b-440c-865f-a1ecd6223a56 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:38.620282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391f21e-357b-4e36-a865-434d11fbd9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:38.620282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391f21e-357b-4e36-a865-434d11fbd9e2 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:38.620282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391f21e-357b-4e36-a865-434d11fbd9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:38.620282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391f21e-357b-4e36-a865-434d11fbd9e2 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:38.621174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391f21e-357b-4e36-a865-434d11fbd9e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:38.621689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391f21e-357b-4e36-a865-434d11fbd9e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:38.623175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391f21e-357b-4e36-a865-434d11fbd9e2 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:38.639226 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 468/936] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:38.644654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391f21e-357b-4e36-a865-434d11fbd9e2 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:38.658170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:38.693181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9fe94-b1cf-4091-a75d-00d45d30f505 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:38.733045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4649d-5e80-4ac1-8253-d0041e331b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:38.734207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4649d-5e80-4ac1-8253-d0041e331b37 None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:38.734697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4649d-5e80-4ac1-8253-d0041e331b37 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:38.735259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4649d-5e80-4ac1-8253-d0041e331b37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:38.736238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4649d-5e80-4ac1-8253-d0041e331b37 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:38.738017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4649d-5e80-4ac1-8253-d0041e331b37 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:38.758112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391f21e-357b-4e36-a865-434d11fbd9e2 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:38.796727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465c7ca-02c5-4803-9799-a392904e86e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:38.799229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465c7ca-02c5-4803-9799-a392904e86e3 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:38.799229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465c7ca-02c5-4803-9799-a392904e86e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:38.799229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465c7ca-02c5-4803-9799-a392904e86e3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:38.806872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465c7ca-02c5-4803-9799-a392904e86e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:38.809213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465c7ca-02c5-4803-9799-a392904e86e3 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:38.823711 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 469/937] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:18:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:18:38.825719 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-1465c7ca-02c5-4803-9799-a392904e86e3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:18:38.825719 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:38.825719 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:38.825719 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:38.825719 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:38.825719 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:38.825719 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:38.825719 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:38.825719 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:38.825719 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:38.825719 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:38.825719 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:38.825719 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:38.825719 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:38.825719 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:38.825719 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:38.826729 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:38.828181 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:38.828181 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:38.828181 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:38.828181 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:38.828181 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:38.828181 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:38.828181 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:38.828181 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:38.828181 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:18:38.828181 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:38.828181 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 469/938] 10.222.0.76 () {56 vars in 1117 bytes} [Sat Aug 27 04:18:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:38.832235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4649d-5e80-4ac1-8253-d0041e331b37 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:38.856807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:38.964902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4649d-5e80-4ac1-8253-d0041e331b37 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:39.005343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4fbee-521b-4fd2-8fa0-ed5df5a994e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:39.005956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4fbee-521b-4fd2-8fa0-ed5df5a994e7 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:39.006236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4fbee-521b-4fd2-8fa0-ed5df5a994e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:39.006533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4fbee-521b-4fd2-8fa0-ed5df5a994e7 None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:39.007271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4fbee-521b-4fd2-8fa0-ed5df5a994e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:39.007574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4fbee-521b-4fd2-8fa0-ed5df5a994e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:39.009022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4fbee-521b-4fd2-8fa0-ed5df5a994e7 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:39.029426 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 470/939] 10.222.0.76 () {56 vars in 1149 bytes} [Sat Aug 27 04:18:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:39.034753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465c7ca-02c5-4803-9799-a392904e86e3 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:39.115691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:39.152110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465c7ca-02c5-4803-9799-a392904e86e3 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:39.190834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d9e54-dbc6-4304-ad0e-bd243e320566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:39.191843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d9e54-dbc6-4304-ad0e-bd243e320566 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:39.192372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d9e54-dbc6-4304-ad0e-bd243e320566 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:39.192852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d9e54-dbc6-4304-ad0e-bd243e320566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:39.206325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d9e54-dbc6-4304-ad0e-bd243e320566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:39.208191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d9e54-dbc6-4304-ad0e-bd243e320566 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:39.224490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-a88d9e54-dbc6-4304-ad0e-bd243e320566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:39.224490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:39.224490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:39.224490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:39.224490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:39.224490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:39.224490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:39.224490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:39.224490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:39.224490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:39.224490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:39.224490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:39.224490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:39.224490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:39.224490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:39.224490 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:39.225492 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:39.225492 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:39.225492 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:39.225492 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:39.225492 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:39.225492 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:39.225492 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:39.225492 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:39.225492 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:39.225492 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:39.225492 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:39.225492 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:39.225492 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:39.225492 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:39.225492 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:39.225492 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:39.225492 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:39.226400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:39.226400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:39.226400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:39.228553 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 470/940] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:39.239727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4fbee-521b-4fd2-8fa0-ed5df5a994e7 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:39.331720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:39.364078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4fbee-521b-4fd2-8fa0-ed5df5a994e7 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:39.401995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db25ef1-1a72-4f26-879f-bab9b05b9d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:39.402657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db25ef1-1a72-4f26-879f-bab9b05b9d5c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:39.402931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db25ef1-1a72-4f26-879f-bab9b05b9d5c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:39.403197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db25ef1-1a72-4f26-879f-bab9b05b9d5c None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:39.405139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db25ef1-1a72-4f26-879f-bab9b05b9d5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:39.405464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db25ef1-1a72-4f26-879f-bab9b05b9d5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:39.406843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db25ef1-1a72-4f26-879f-bab9b05b9d5c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:39.419876 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 471/941] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:39.425415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d9e54-dbc6-4304-ad0e-bd243e320566 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:39.543214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d9e54-dbc6-4304-ad0e-bd243e320566 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:39.568747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:39.582185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87761064-43a9-4032-b5c5-6b3c16c9b806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:39.583164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87761064-43a9-4032-b5c5-6b3c16c9b806 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:39.583661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87761064-43a9-4032-b5c5-6b3c16c9b806 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:39.584152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87761064-43a9-4032-b5c5-6b3c16c9b806 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:39.592405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87761064-43a9-4032-b5c5-6b3c16c9b806 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:39.594164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87761064-43a9-4032-b5c5-6b3c16c9b806 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:39.607672 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-87761064-43a9-4032-b5c5-6b3c16c9b806 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:39.607672 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:39.607672 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:39.607672 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:39.607672 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:39.607672 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:39.607672 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:39.607672 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:39.607672 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:39.607672 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:39.607672 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:39.607672 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:39.607672 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:39.607672 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:39.607672 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:39.608664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:39.608664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:39.608664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:39.608664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:39.608664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:39.608664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:39.608664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:39.608664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:39.608664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:39.608664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:39.608664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:39.608664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:39.608664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:39.608664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:39.608664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:39.608664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:39.608664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:39.609567 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:39.609567 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:39.609567 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:39.609567 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:39.609567 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:39.609567 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:39.609567 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:39.609567 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:39.616688 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 471/942] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:39.621364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db25ef1-1a72-4f26-879f-bab9b05b9d5c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:39.636277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451405f8-79c9-440a-a563-b9c9072a9660 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:39.636693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451405f8-79c9-440a-a563-b9c9072a9660 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:39.636885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451405f8-79c9-440a-a563-b9c9072a9660 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:39.639676 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 472/943] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:18:39.646586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b804e-e322-4edb-abed-e546b7622f86 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:39.647098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b804e-e322-4edb-abed-e546b7622f86 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:39.647386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b804e-e322-4edb-abed-e546b7622f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:39.669046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-073b804e-e322-4edb-abed-e546b7622f86 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:39.670791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-073b804e-e322-4edb-abed-e546b7622f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:39.749777 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 473/944] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:18:39.751029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b1c3e-f42b-4996-abea-f7b2c334f6b9 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:39.751309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b1c3e-f42b-4996-abea-f7b2c334f6b9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:39.751577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b1c3e-f42b-4996-abea-f7b2c334f6b9 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:39.752963 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 474/945] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:39.758011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa505f7-f36f-4955-b354-263a576cba1b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:39.758291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa505f7-f36f-4955-b354-263a576cba1b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:39.758568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa505f7-f36f-4955-b354-263a576cba1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:39.773173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db25ef1-1a72-4f26-879f-bab9b05b9d5c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:39.776789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0aa505f7-f36f-4955-b354-263a576cba1b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:39.777920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0aa505f7-f36f-4955-b354-263a576cba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:39.813557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:39.821841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665fe66-c65e-4131-aa54-9bf6af8faebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:39.823447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665fe66-c65e-4131-aa54-9bf6af8faebe None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:39.824408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665fe66-c65e-4131-aa54-9bf6af8faebe None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:39.832317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665fe66-c65e-4131-aa54-9bf6af8faebe None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:39.832317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665fe66-c65e-4131-aa54-9bf6af8faebe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:39.832317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665fe66-c65e-4131-aa54-9bf6af8faebe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:39.832317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665fe66-c65e-4131-aa54-9bf6af8faebe None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:39.847018 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 472/946] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:39.847911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665fe66-c65e-4131-aa54-9bf6af8faebe None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:39.864503 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 475/947] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:18:39.973102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665fe66-c65e-4131-aa54-9bf6af8faebe None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:40.011790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c60f5e-0036-4fde-b2e4-7e46716e9f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:40.012873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c60f5e-0036-4fde-b2e4-7e46716e9f37 None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:40.013364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c60f5e-0036-4fde-b2e4-7e46716e9f37 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:40.013845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c60f5e-0036-4fde-b2e4-7e46716e9f37 None admin] PATH_INFO: `/v3/projects/5632b718c3aa48458247661045e99e5f/users/7aa8f9ba9e854c7abc4237eb72c55590/roles/36d21a4033f94db3950f5e390f6e2a38` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:40.016430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c60f5e-0036-4fde-b2e4-7e46716e9f37 None admin] RBAC: Authorizing `identity:create_grant(project_id=5632b718c3aa48458247661045e99e5f, user_id=7aa8f9ba9e854c7abc4237eb72c55590, role_id=36d21a4033f94db3950f5e390f6e2a38)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:40.018127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c60f5e-0036-4fde-b2e4-7e46716e9f37 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:40.030069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa505f7-f36f-4955-b354-263a576cba1b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:40.077000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:40.097870 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 473/948] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:18:39 2022] PUT /identity/v3/projects/5632b718c3aa48458247661045e99e5f/users/7aa8f9ba9e854c7abc4237eb72c55590/roles/36d21a4033f94db3950f5e390f6e2a38 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:18:40.158376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa505f7-f36f-4955-b354-263a576cba1b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:40.201653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1557666-8682-4ef8-a2a0-f2d1f21ed63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:40.202624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1557666-8682-4ef8-a2a0-f2d1f21ed63e None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:40.203062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1557666-8682-4ef8-a2a0-f2d1f21ed63e None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:40.203557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1557666-8682-4ef8-a2a0-f2d1f21ed63e None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:40.204407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1557666-8682-4ef8-a2a0-f2d1f21ed63e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:40.206069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1557666-8682-4ef8-a2a0-f2d1f21ed63e None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:40.208250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c60f5e-0036-4fde-b2e4-7e46716e9f37 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:40.209316 n-d-852088-5 devstack@keystone.service[82082]: WARNING keystone.server.flask.common [None req-d1557666-8682-4ef8-a2a0-f2d1f21ed63e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 27 04:18:40.263032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.sql.core [None req-d1557666-8682-4ef8-a2a0-f2d1f21ed63e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 27 04:18:40.263032 n-d-852088-5 devstack@keystone.service[82082]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 27 04:18:40.263032 n-d-852088-5 devstack@keystone.service[82082]: [parameters: {'id': '646122822ca140df8dfacf78790aa349', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 27 04:18:40.263032 n-d-852088-5 devstack@keystone.service[82082]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82082) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 04:18:40.272338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:40.285569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-d1557666-8682-4ef8-a2a0-f2d1f21ed63e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 646122822ca140df8dfacf78790aa349.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 646122822ca140df8dfacf78790aa349. Aug 27 04:18:40.285569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:40.285569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:18:40.285569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 04:18:40.285569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:18:40.285569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 04:18:40.285569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:18:40.285569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 04:18:40.285569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:18:40.285569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application conn.query(q) Aug 27 04:18:40.285569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:18:40.285569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:18:40.285569 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application result.read() Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 27 04:18:40.286489 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 27 04:18:40.287472 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 04:18:40.287472 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application next(self.gen) Aug 27 04:18:40.287472 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 27 04:18:40.287472 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application yield resource Aug 27 04:18:40.287472 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 04:18:40.287472 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application next(self.gen) Aug 27 04:18:40.287472 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 27 04:18:40.287472 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.session.rollback() Aug 27 04:18:40.287472 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:18:40.287472 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.force_reraise() Aug 27 04:18:40.287472 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:18:40.287472 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise self.value Aug 27 04:18:40.287472 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 27 04:18:40.287472 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 27 04:18:40.287472 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 27 04:18:40.287472 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application session.commit() Aug 27 04:18:40.287472 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 27 04:18:40.288461 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 27 04:18:40.288461 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 27 04:18:40.288461 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._prepare_impl() Aug 27 04:18:40.288461 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 27 04:18:40.288461 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.session.flush() Aug 27 04:18:40.288461 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 04:18:40.288461 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._flush(objects) Aug 27 04:18:40.288461 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 04:18:40.288461 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 27 04:18:40.288461 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 04:18:40.288461 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application compat.raise_( Aug 27 04:18:40.288461 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:18:40.288461 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception Aug 27 04:18:40.288461 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 04:18:40.288461 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application flush_context.execute() Aug 27 04:18:40.288461 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 04:18:40.288461 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rec.execute(self) Aug 27 04:18:40.289401 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 04:18:40.289401 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 27 04:18:40.289401 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 04:18:40.289401 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 27 04:18:40.289401 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 27 04:18:40.289401 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 27 04:18:40.289401 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 04:18:40.289401 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 04:18:40.289401 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 04:18:40.289401 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 27 04:18:40.289401 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 04:18:40.289401 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 27 04:18:40.289401 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 04:18:40.289401 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 27 04:18:40.289401 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 04:18:40.292865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 04:18:40.292865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:18:40.292865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception Aug 27 04:18:40.292865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:18:40.292865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 04:18:40.292865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:18:40.292865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 04:18:40.292865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:18:40.292865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 04:18:40.292865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:18:40.292865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application conn.query(q) Aug 27 04:18:40.292865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:18:40.292865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:18:40.292865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:18:40.292865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application result.read() Aug 27 04:18:40.292865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:18:40.292865 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 04:18:40.294619 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:18:40.294619 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 04:18:40.294619 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:18:40.294619 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 04:18:40.294619 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:18:40.294619 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 04:18:40.294619 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 27 04:18:40.294619 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 27 04:18:40.294619 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [parameters: {'id': '646122822ca140df8dfacf78790aa349', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 27 04:18:40.294619 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 04:18:40.294619 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:40.294619 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:40.294619 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:40.294619 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:40.294619 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 27 04:18:40.295714 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 27 04:18:40.295714 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 27 04:18:40.295714 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 27 04:18:40.295714 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 27 04:18:40.295714 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:40.295714 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:40.295714 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:40.295714 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:40.295714 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:40.295714 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:40.295714 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:40.295714 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:40.295714 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:40.295714 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:40.295714 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:40.295714 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:40.295714 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:40.297323 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:40.297323 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 27 04:18:40.297323 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 27 04:18:40.297323 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:40.297323 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:40.297323 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 27 04:18:40.297323 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 27 04:18:40.297323 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 646122822ca140df8dfacf78790aa349. Aug 27 04:18:40.297323 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:40.297323 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 476/949] 10.222.0.76 () {60 vars in 1140 bytes} [Sat Aug 27 04:18:40 2022] POST /identity/v3/projects => generated 262 bytes in 257 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:40.297323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1557666-8682-4ef8-a2a0-f2d1f21ed63e None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:40.359597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c60f5e-0036-4fde-b2e4-7e46716e9f37 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:40.403442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b899f-5c7f-4cea-9c43-0b4763e5fb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:40.404498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b899f-5c7f-4cea-9c43-0b4763e5fb53 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:40.405310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b899f-5c7f-4cea-9c43-0b4763e5fb53 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:40.405773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b899f-5c7f-4cea-9c43-0b4763e5fb53 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:40.406525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b899f-5c7f-4cea-9c43-0b4763e5fb53 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:40.408486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b899f-5c7f-4cea-9c43-0b4763e5fb53 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:40.419906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-2e3b899f-5c7f-4cea-9c43-0b4763e5fb53 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:18:40.419906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:40.419906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:40.419906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:40.419906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:40.419906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:40.419906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:40.419906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:40.419906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:18:40.419906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:40.419906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:40.419906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:40.419906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:40.419906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:40.419906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:40.419906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:40.419906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:40.420997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:40.420997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:40.420997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:40.420997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:40.420997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:40.420997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:40.420997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:40.420997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:40.420997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:40.420997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:40.420997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:40.420997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:40.420997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:40.420997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:40.420997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:40.420997 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:40.421835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:40.421835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:40.421835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:40.421835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:40.421835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:40.421835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:40.421835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:40.421835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:40.421835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:40.421835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:40.421835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:40.421835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:40.421835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:18:40.421835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:40.424527 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 474/950] 10.222.0.76 () {56 vars in 1126 bytes} [Sat Aug 27 04:18:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:40.430350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b899f-5c7f-4cea-9c43-0b4763e5fb53 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:40.437706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:40.442180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1557666-8682-4ef8-a2a0-f2d1f21ed63e None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:40.492528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483e958-4c0b-444c-8261-cd304f870509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:40.493544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483e958-4c0b-444c-8261-cd304f870509 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:40.494044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483e958-4c0b-444c-8261-cd304f870509 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:40.494697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483e958-4c0b-444c-8261-cd304f870509 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:40.503171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483e958-4c0b-444c-8261-cd304f870509 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:40.505086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483e958-4c0b-444c-8261-cd304f870509 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:40.519179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-9483e958-4c0b-444c-8261-cd304f870509 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:40.519179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:40.519179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:40.519179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:40.519179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:40.519179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:40.519179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:40.519179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:40.519179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:40.519179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:40.519179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:40.519179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:40.519179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:40.519179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:40.519179 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:40.520529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:40.520529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:40.520529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:40.520529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:40.520529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:40.520529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:40.520529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:40.520529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:40.520529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:40.520529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:40.520529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:40.520529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:40.520529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:40.520529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:40.520529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:40.520529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:40.520529 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:40.521673 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:40.521673 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:40.521673 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:40.521673 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:40.521673 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:40.521673 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:40.521673 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:40.521673 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:40.523229 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 477/951] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:40.530484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483e958-4c0b-444c-8261-cd304f870509 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:40.568424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b899f-5c7f-4cea-9c43-0b4763e5fb53 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:40.585108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:40.607191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f3156-7540-4b50-9c4c-367a29fa58d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:40.608076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f3156-7540-4b50-9c4c-367a29fa58d0 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:40.608674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f3156-7540-4b50-9c4c-367a29fa58d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:40.609124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f3156-7540-4b50-9c4c-367a29fa58d0 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:40.609957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f3156-7540-4b50-9c4c-367a29fa58d0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:40.610411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f3156-7540-4b50-9c4c-367a29fa58d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:40.611999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f3156-7540-4b50-9c4c-367a29fa58d0 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:40.618338 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 475/952] 10.222.0.76 () {56 vars in 1122 bytes} [Sat Aug 27 04:18:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:40.628227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f3156-7540-4b50-9c4c-367a29fa58d0 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:40.671631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483e958-4c0b-444c-8261-cd304f870509 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:40.720057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc747-a7c3-46a5-868b-00f34b4f8d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:40.720983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc747-a7c3-46a5-868b-00f34b4f8d5c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:40.721429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc747-a7c3-46a5-868b-00f34b4f8d5c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:40.721849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc747-a7c3-46a5-868b-00f34b4f8d5c None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:40.723284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadc747-a7c3-46a5-868b-00f34b4f8d5c None admin] RBAC: Adding query filter params (name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:40.723739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadc747-a7c3-46a5-868b-00f34b4f8d5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:40.725521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadc747-a7c3-46a5-868b-00f34b4f8d5c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:40.754626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f3156-7540-4b50-9c4c-367a29fa58d0 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:40.755360 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 478/953] 10.222.0.76 () {56 vars in 1112 bytes} [Sat Aug 27 04:18:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:40.790050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f1ee4-1099-4327-a488-c2bb23839af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:40.790944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f1ee4-1099-4327-a488-c2bb23839af7 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:40.792090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f1ee4-1099-4327-a488-c2bb23839af7 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:40.792497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f1ee4-1099-4327-a488-c2bb23839af7 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:40.793343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f1ee4-1099-4327-a488-c2bb23839af7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:40.793776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f1ee4-1099-4327-a488-c2bb23839af7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:40.795264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f1ee4-1099-4327-a488-c2bb23839af7 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:40.801739 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 476/954] 10.222.0.76 () {56 vars in 1122 bytes} [Sat Aug 27 04:18:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:40.808274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc747-a7c3-46a5-868b-00f34b4f8d5c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:40.839654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:40.960226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc747-a7c3-46a5-868b-00f34b4f8d5c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:40.971340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a047a-2578-4447-bd53-66bf2e75a0ee None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:40.971622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a047a-2578-4447-bd53-66bf2e75a0ee None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:40.975934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a047a-2578-4447-bd53-66bf2e75a0ee None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:40.977919 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 477/955] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:40.985350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712c78a-5838-4777-8d08-e4e826fdfe10 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:40.985720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712c78a-5838-4777-8d08-e4e826fdfe10 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:40.986098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712c78a-5838-4777-8d08-e4e826fdfe10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:41.006419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0712c78a-5838-4777-8d08-e4e826fdfe10 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:41.007839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60779c7-c1af-4be0-93cf-6d2cc2eecca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:41.008085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0712c78a-5838-4777-8d08-e4e826fdfe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:41.008668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60779c7-c1af-4be0-93cf-6d2cc2eecca6 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:41.009046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60779c7-c1af-4be0-93cf-6d2cc2eecca6 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:41.009419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60779c7-c1af-4be0-93cf-6d2cc2eecca6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:41.011377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60779c7-c1af-4be0-93cf-6d2cc2eecca6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:41.013782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60779c7-c1af-4be0-93cf-6d2cc2eecca6 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:41.055431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:41.090668 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 478/956] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:41.173232 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 479/957] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:18:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:18:41.406628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712c78a-5838-4777-8d08-e4e826fdfe10 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:41.518588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712c78a-5838-4777-8d08-e4e826fdfe10 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:41.560731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229e0e9-6ed2-4290-8fe3-fb5e4a41f34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:41.561715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229e0e9-6ed2-4290-8fe3-fb5e4a41f34c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:41.562192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229e0e9-6ed2-4290-8fe3-fb5e4a41f34c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:41.562680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229e0e9-6ed2-4290-8fe3-fb5e4a41f34c None admin] PATH_INFO: `/v3/services/compute` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:41.563457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229e0e9-6ed2-4290-8fe3-fb5e4a41f34c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:41.565061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229e0e9-6ed2-4290-8fe3-fb5e4a41f34c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:41.574336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-7229e0e9-6ed2-4290-8fe3-fb5e4a41f34c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 04:18:41.574336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:41.574336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:41.574336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:41.574336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:41.574336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:41.574336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:41.574336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:41.574336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 04:18:41.574336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:41.574336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:41.574336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:41.574336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:41.574336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:41.574336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:41.574336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:41.574336 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:41.575579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:41.575579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:41.575579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:41.575579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:41.575579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:41.575579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:41.575579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:41.575579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:41.575579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:41.575579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:41.575579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:41.575579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:41.575579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:41.575579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:41.575579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:41.575579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:41.576460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:41.576460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:41.576460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:41.576460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:41.576460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:41.576460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:41.576460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:41.576460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:41.576460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:41.576460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:41.576460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:41.576460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:41.576460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 04:18:41.576460 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:41.583855 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 479/958] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:41.585501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60779c7-c1af-4be0-93cf-6d2cc2eecca6 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:41.672933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:41.703768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60779c7-c1af-4be0-93cf-6d2cc2eecca6 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:41.740427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50770a9-2d61-4ce8-b54f-1556fa350abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:41.741393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50770a9-2d61-4ce8-b54f-1556fa350abf None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:41.741899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50770a9-2d61-4ce8-b54f-1556fa350abf None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:41.742390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50770a9-2d61-4ce8-b54f-1556fa350abf None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:41.743227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50770a9-2d61-4ce8-b54f-1556fa350abf None admin] RBAC: Adding query filter params (name=compute) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:41.743745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50770a9-2d61-4ce8-b54f-1556fa350abf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:41.745764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50770a9-2d61-4ce8-b54f-1556fa350abf None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:41.755802 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 480/959] 10.222.0.76 () {56 vars in 1112 bytes} [Sat Aug 27 04:18:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:41.757443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229e0e9-6ed2-4290-8fe3-fb5e4a41f34c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:41.793784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:41.867090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229e0e9-6ed2-4290-8fe3-fb5e4a41f34c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:41.904330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8f293-2436-4673-9f17-627fc833a0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:41.905328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8f293-2436-4673-9f17-627fc833a0cb None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:41.905809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8f293-2436-4673-9f17-627fc833a0cb None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:41.906284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8f293-2436-4673-9f17-627fc833a0cb None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:41.907127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8f293-2436-4673-9f17-627fc833a0cb None admin] RBAC: Adding query filter params (type=compute) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:41.907627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8f293-2436-4673-9f17-627fc833a0cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:41.909241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8f293-2436-4673-9f17-627fc833a0cb None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:41.918031 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 480/960] 10.222.0.76 () {56 vars in 1112 bytes} [Sat Aug 27 04:18:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:42.345757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ae0c8-5222-4ad3-8f83-aadc7c85aadb None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:42.346187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ae0c8-5222-4ad3-8f83-aadc7c85aadb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:42.346582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ae0c8-5222-4ad3-8f83-aadc7c85aadb None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:42.348350 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 481/961] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:42.353641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c95d8-d126-494b-826a-21166180faa3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:42.354033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c95d8-d126-494b-826a-21166180faa3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:42.354536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c95d8-d126-494b-826a-21166180faa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:42.373659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-cd3c95d8-d126-494b-826a-21166180faa3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:42.374853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cd3c95d8-d126-494b-826a-21166180faa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:42.456343 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 481/962] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:42.721861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ae0c8-5222-4ad3-8f83-aadc7c85aadb None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:42.832078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ae0c8-5222-4ad3-8f83-aadc7c85aadb None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:42.868616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895af2e1-0744-4c48-abfb-5c81392353c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:42.869362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895af2e1-0744-4c48-abfb-5c81392353c3 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:42.869644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895af2e1-0744-4c48-abfb-5c81392353c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:42.869910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895af2e1-0744-4c48-abfb-5c81392353c3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:42.877267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:42.882035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895af2e1-0744-4c48-abfb-5c81392353c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:42.887338 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-895af2e1-0744-4c48-abfb-5c81392353c3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:18:42.887338 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:42.887338 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:42.887338 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:42.887338 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:42.887338 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:42.887338 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:42.887338 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:42.887338 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:42.887338 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:42.887338 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:42.887338 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:42.887338 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:42.887338 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:42.887338 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:42.887338 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:42.894680 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:42.894680 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:42.894680 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:42.894680 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:42.894680 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:42.894680 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:42.894680 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:42.894680 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:42.894680 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:42.894680 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:42.894680 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:42.894680 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:42.894680 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:42.894680 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:42.894680 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:42.894680 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:42.896527 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:42.896527 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:42.896527 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:42.896527 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:42.896527 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:42.896527 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:42.896527 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:42.896527 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:42.896527 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:42.896527 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:42.896527 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:18:42.896527 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:42.896527 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 482/963] 10.222.0.76 () {56 vars in 1120 bytes} [Sat Aug 27 04:18:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:42.898008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c95d8-d126-494b-826a-21166180faa3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:42.928559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:43.000839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c95d8-d126-494b-826a-21166180faa3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:43.037923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1792b-8b45-42cf-b0f5-bd2cc567d9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:43.038532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1792b-8b45-42cf-b0f5-bd2cc567d9c2 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:43.038806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1792b-8b45-42cf-b0f5-bd2cc567d9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:43.039074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1792b-8b45-42cf-b0f5-bd2cc567d9c2 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:43.039733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1792b-8b45-42cf-b0f5-bd2cc567d9c2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:43.040032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1792b-8b45-42cf-b0f5-bd2cc567d9c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:43.041972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1792b-8b45-42cf-b0f5-bd2cc567d9c2 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:43.055094 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 482/964] 10.222.0.76 () {56 vars in 1115 bytes} [Sat Aug 27 04:18:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:43.057607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895af2e1-0744-4c48-abfb-5c81392353c3 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:43.080009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ffbe1-0862-47f6-9008-a987187d2814 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:43.080540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ffbe1-0862-47f6-9008-a987187d2814 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:43.080960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ffbe1-0862-47f6-9008-a987187d2814 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:43.084060 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 483/965] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:43.096009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9955f8-b691-4dcf-8075-03e124ce746b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:43.096522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9955f8-b691-4dcf-8075-03e124ce746b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:43.096894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9955f8-b691-4dcf-8075-03e124ce746b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:43.120500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4e9955f8-b691-4dcf-8075-03e124ce746b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:43.122009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4e9955f8-b691-4dcf-8075-03e124ce746b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:43.177402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895af2e1-0744-4c48-abfb-5c81392353c3 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:43.219609 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 484/966] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:43.225471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a50d7-5f4b-4da1-8f11-4cbccee7561d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:43.226111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a50d7-5f4b-4da1-8f11-4cbccee7561d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:43.226394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a50d7-5f4b-4da1-8f11-4cbccee7561d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:43.226665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a50d7-5f4b-4da1-8f11-4cbccee7561d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:43.239431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a50d7-5f4b-4da1-8f11-4cbccee7561d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:43.240910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a50d7-5f4b-4da1-8f11-4cbccee7561d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:43.256040 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-6a9a50d7-5f4b-4da1-8f11-4cbccee7561d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:43.256040 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:43.256040 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:43.256040 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:43.256040 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:43.256040 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:43.256040 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:43.256040 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:43.256040 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:43.256040 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:43.256040 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:43.256040 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:43.256040 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:43.256040 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:43.256040 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:43.256040 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:43.258259 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:43.258259 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:43.258259 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:43.258259 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:43.258259 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:43.258259 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:43.258259 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:43.258259 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:43.258259 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:43.258259 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:43.258259 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:43.258259 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:43.258259 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:43.258259 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:43.258259 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:43.258259 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:43.258259 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:43.261379 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:43.261379 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:43.261379 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:43.268195 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 483/967] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:43.269839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9955f8-b691-4dcf-8075-03e124ce746b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:43.289986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:43.376321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9955f8-b691-4dcf-8075-03e124ce746b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:43.413114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d82b7e-6277-4741-bc0e-316cc37a82cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:43.413723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d82b7e-6277-4741-bc0e-316cc37a82cb None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:43.413998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d82b7e-6277-4741-bc0e-316cc37a82cb None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:43.414267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d82b7e-6277-4741-bc0e-316cc37a82cb None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:43.414968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d82b7e-6277-4741-bc0e-316cc37a82cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:43.415269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d82b7e-6277-4741-bc0e-316cc37a82cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:43.417214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d82b7e-6277-4741-bc0e-316cc37a82cb None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:43.429974 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 485/968] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:43.433800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcfab9-4278-4e04-b9e7-676c4b4b2ba7 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:43.434089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcfab9-4278-4e04-b9e7-676c4b4b2ba7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:43.434366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcfab9-4278-4e04-b9e7-676c4b4b2ba7 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:43.435783 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 484/969] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:43.436796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d82b7e-6277-4741-bc0e-316cc37a82cb None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:43.441634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0716f8-30ed-4bd6-a7d5-0610ef16f891 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:43.441924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0716f8-30ed-4bd6-a7d5-0610ef16f891 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:43.442202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0716f8-30ed-4bd6-a7d5-0610ef16f891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:43.467446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4f0716f8-30ed-4bd6-a7d5-0610ef16f891 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:43.470206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4f0716f8-30ed-4bd6-a7d5-0610ef16f891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:43.528204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:43.536481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:43.550555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d82b7e-6277-4741-bc0e-316cc37a82cb None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:43.560884 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 485/970] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:43.561961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0716f8-30ed-4bd6-a7d5-0610ef16f891 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:43.604316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78968b58-cc9a-40e3-b535-5fe216411b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:43.604962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78968b58-cc9a-40e3-b535-5fe216411b32 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:43.605614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78968b58-cc9a-40e3-b535-5fe216411b32 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:43.605882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78968b58-cc9a-40e3-b535-5fe216411b32 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:43.615816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78968b58-cc9a-40e3-b535-5fe216411b32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:43.617726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78968b58-cc9a-40e3-b535-5fe216411b32 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:43.633349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-78968b58-cc9a-40e3-b535-5fe216411b32 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:18:43.633349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:43.633349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:43.633349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:43.633349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:43.633349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:43.633349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:43.633349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:43.633349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:43.633349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:43.633349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:43.633349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:43.633349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:43.633349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:43.633349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:43.633349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:43.634424 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:43.636532 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:43.636532 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:43.636532 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:43.636532 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:43.636532 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:43.636532 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:43.636532 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:43.636532 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:43.636532 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 04:18:43.636532 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:43.640488 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 486/971] 10.222.0.76 () {56 vars in 1117 bytes} [Sat Aug 27 04:18:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:43.642312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78968b58-cc9a-40e3-b535-5fe216411b32 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:43.675591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0716f8-30ed-4bd6-a7d5-0610ef16f891 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:43.721180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87937a-5e7b-407b-b1a2-2ab87c255e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:43.721803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87937a-5e7b-407b-b1a2-2ab87c255e86 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:43.722083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87937a-5e7b-407b-b1a2-2ab87c255e86 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:43.722624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87937a-5e7b-407b-b1a2-2ab87c255e86 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:43.723083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87937a-5e7b-407b-b1a2-2ab87c255e86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:43.724603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87937a-5e7b-407b-b1a2-2ab87c255e86 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:43.771423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.sql.core [None req-7e87937a-5e7b-407b-b1a2-2ab87c255e86 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 27 04:18:43.771423 n-d-852088-5 devstack@keystone.service[82082]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 27 04:18:43.771423 n-d-852088-5 devstack@keystone.service[82082]: [parameters: {'user_id': '8b01818873f144efb2f9cc8e4d1ab78f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 27 04:18:43.771423 n-d-852088-5 devstack@keystone.service[82082]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82082) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 04:18:43.777582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78968b58-cc9a-40e3-b535-5fe216411b32 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:43.781568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-7e87937a-5e7b-407b-b1a2-2ab87c255e86 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 27 04:18:43.781568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:43.781568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:18:43.781568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 04:18:43.781568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:18:43.781568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 04:18:43.781568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:18:43.781568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 04:18:43.781568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:18:43.781568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application conn.query(q) Aug 27 04:18:43.781568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:18:43.781568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:18:43.781568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:18:43.781568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application result.read() Aug 27 04:18:43.781568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 04:18:43.782509 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application next(self.gen) Aug 27 04:18:43.789234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 27 04:18:43.789234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application yield resource Aug 27 04:18:43.789234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 04:18:43.789234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application next(self.gen) Aug 27 04:18:43.789234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 27 04:18:43.789234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.session.rollback() Aug 27 04:18:43.789234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:18:43.789234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.force_reraise() Aug 27 04:18:43.789234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:18:43.789234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise self.value Aug 27 04:18:43.789234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 27 04:18:43.789234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 27 04:18:43.789234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 27 04:18:43.789234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application session.commit() Aug 27 04:18:43.789234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 27 04:18:43.789234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 27 04:18:43.789234 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 27 04:18:43.790145 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._prepare_impl() Aug 27 04:18:43.790145 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 27 04:18:43.790145 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.session.flush() Aug 27 04:18:43.790145 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 04:18:43.790145 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._flush(objects) Aug 27 04:18:43.790145 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 04:18:43.790145 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 27 04:18:43.790145 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 04:18:43.790145 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application compat.raise_( Aug 27 04:18:43.790145 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:18:43.790145 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception Aug 27 04:18:43.790145 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 04:18:43.790145 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application flush_context.execute() Aug 27 04:18:43.790145 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 04:18:43.790145 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rec.execute(self) Aug 27 04:18:43.790145 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 04:18:43.790145 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 27 04:18:43.793220 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 04:18:43.793220 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 27 04:18:43.793220 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 04:18:43.793220 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 27 04:18:43.793220 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 04:18:43.793220 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 04:18:43.793220 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 04:18:43.793220 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 27 04:18:43.793220 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 04:18:43.793220 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 27 04:18:43.793220 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 04:18:43.793220 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 27 04:18:43.793220 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 04:18:43.793220 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 04:18:43.793220 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:18:43.793220 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception Aug 27 04:18:43.796047 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:18:43.796047 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 04:18:43.796047 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:18:43.796047 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 04:18:43.796047 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:18:43.796047 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 04:18:43.796047 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:18:43.796047 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application conn.query(q) Aug 27 04:18:43.796047 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:18:43.796047 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:18:43.796047 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:18:43.796047 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application result.read() Aug 27 04:18:43.796047 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:18:43.796047 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 04:18:43.796047 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:18:43.796047 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 04:18:43.798411 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:18:43.798411 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 04:18:43.798411 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:18:43.798411 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 04:18:43.798411 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 27 04:18:43.798411 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 27 04:18:43.798411 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [parameters: {'user_id': '8b01818873f144efb2f9cc8e4d1ab78f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 27 04:18:43.798411 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 04:18:43.798411 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:43.798411 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:43.798411 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:43.798411 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:43.798411 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:43.798411 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:43.798411 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:43.801959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:43.801959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:43.801959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:43.801959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:43.801959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:43.801959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:43.801959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:43.801959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 27 04:18:43.801959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 27 04:18:43.801959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:43.801959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:43.801959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:43.801959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:43.801959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:43.801959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:43.801959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 27 04:18:43.801959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 27 04:18:43.804784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 27 04:18:43.804784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 27 04:18:43.804784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 27 04:18:43.804784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 27 04:18:43.804784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 27 04:18:43.804784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:43.804784 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 486/972] 10.222.0.76 () {60 vars in 1131 bytes} [Sat Aug 27 04:18:43 2022] POST /identity/v3/users => generated 160 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:43.804784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87937a-5e7b-407b-b1a2-2ab87c255e86 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:43.827646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed16bf-d075-4a7e-8216-d90c40c2149f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:43.828278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed16bf-d075-4a7e-8216-d90c40c2149f None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:43.828558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed16bf-d075-4a7e-8216-d90c40c2149f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:43.828829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed16bf-d075-4a7e-8216-d90c40c2149f None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:43.829573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed16bf-d075-4a7e-8216-d90c40c2149f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:43.829846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed16bf-d075-4a7e-8216-d90c40c2149f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:43.831265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed16bf-d075-4a7e-8216-d90c40c2149f None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:43.841020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:43.855947 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 487/973] 10.222.0.76 () {56 vars in 1149 bytes} [Sat Aug 27 04:18:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:43.861660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed16bf-d075-4a7e-8216-d90c40c2149f None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:43.861787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:43.918491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87937a-5e7b-407b-b1a2-2ab87c255e86 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:43.957907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dbd9f-9d1f-4e19-8978-87ebe8ff159c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:43.961630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dbd9f-9d1f-4e19-8978-87ebe8ff159c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:43.961630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dbd9f-9d1f-4e19-8978-87ebe8ff159c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:43.961630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dbd9f-9d1f-4e19-8978-87ebe8ff159c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:43.970401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed16bf-d075-4a7e-8216-d90c40c2149f None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:43.973408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dbd9f-9d1f-4e19-8978-87ebe8ff159c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:43.975076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dbd9f-9d1f-4e19-8978-87ebe8ff159c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:43.987072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-652dbd9f-9d1f-4e19-8978-87ebe8ff159c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 04:18:43.987072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:43.987072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:43.987072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:43.987072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:43.987072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:43.987072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:43.987072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:43.987072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:43.987072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:43.987072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:43.987072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:43.987072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:43.987072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:43.987072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:43.987072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:43.988254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:43.989588 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:43.989588 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:43.989588 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:43.989588 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:43.989588 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:43.989588 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:43.989588 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:43.989588 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:43.989588 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 04:18:43.989588 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:43.989588 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 487/974] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:18:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:43.989588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dbd9f-9d1f-4e19-8978-87ebe8ff159c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:44.007851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38462f6b-98f8-4033-a806-f8d3cb9784f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:44.008481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38462f6b-98f8-4033-a806-f8d3cb9784f6 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:44.008757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38462f6b-98f8-4033-a806-f8d3cb9784f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:44.009024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38462f6b-98f8-4033-a806-f8d3cb9784f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:44.069411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:44.076592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38462f6b-98f8-4033-a806-f8d3cb9784f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:44.080833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38462f6b-98f8-4033-a806-f8d3cb9784f6 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:44.089186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dbd9f-9d1f-4e19-8978-87ebe8ff159c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:44.090707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:44.122331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960cc88-80f8-44f1-beee-5c511b5f6d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:44.122943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960cc88-80f8-44f1-beee-5c511b5f6d9a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:44.123218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960cc88-80f8-44f1-beee-5c511b5f6d9a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:44.123488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960cc88-80f8-44f1-beee-5c511b5f6d9a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:44.124060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960cc88-80f8-44f1-beee-5c511b5f6d9a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:44.125450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960cc88-80f8-44f1-beee-5c511b5f6d9a None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:44.133945 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-3960cc88-80f8-44f1-beee-5c511b5f6d9a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:18:44.133945 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:44.133945 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:44.133945 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:44.133945 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:44.133945 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:44.133945 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:44.133945 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:44.133945 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:18:44.133945 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:44.133945 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:44.133945 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:44.133945 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:44.133945 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:44.133945 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:44.133945 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:44.133945 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:44.135560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:44.135560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:44.135560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:44.135560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:44.135560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:44.135560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:44.135560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:44.135560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:44.135560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:44.135560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:44.135560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:44.135560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:44.135560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:44.135560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:44.135560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:44.135560 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:44.136813 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:44.136813 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:44.136813 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:44.136813 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:44.136813 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:44.136813 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:44.136813 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:44.136813 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:44.136813 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:44.136813 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:44.136813 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:44.136813 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:44.136813 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:18:44.136813 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:44.136813 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 488/975] 10.222.0.76 () {56 vars in 1126 bytes} [Sat Aug 27 04:18:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:44.138011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba624783-b895-43bd-905f-79583ddbc211 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:44.138011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba624783-b895-43bd-905f-79583ddbc211 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:44.138277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba624783-b895-43bd-905f-79583ddbc211 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:44.142394 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 489/976] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:44.142948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba624783-b895-43bd-905f-79583ddbc211 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:44.184503 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 488/977] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:18:43 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 27 04:18:44.184503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38462f6b-98f8-4033-a806-f8d3cb9784f6 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:44.246764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba624783-b895-43bd-905f-79583ddbc211 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:44.281073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:44.282345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13c4cf-da01-4604-87f3-32b2eeea3294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:44.282947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13c4cf-da01-4604-87f3-32b2eeea3294 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:44.283232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13c4cf-da01-4604-87f3-32b2eeea3294 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:44.283506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13c4cf-da01-4604-87f3-32b2eeea3294 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:44.284225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13c4cf-da01-4604-87f3-32b2eeea3294 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:44.284531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13c4cf-da01-4604-87f3-32b2eeea3294 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:44.285963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13c4cf-da01-4604-87f3-32b2eeea3294 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:44.287306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38462f6b-98f8-4033-a806-f8d3cb9784f6 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:44.321141 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 490/978] 10.222.0.76 () {56 vars in 1101 bytes} [Sat Aug 27 04:18:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:44.321518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de848fb-6517-455e-9ad4-4c98b59ab20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:44.322835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de848fb-6517-455e-9ad4-4c98b59ab20a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:44.322958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6d318-8e7b-4060-b57a-d3ff38fab008 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:44.323115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de848fb-6517-455e-9ad4-4c98b59ab20a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:44.323205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6d318-8e7b-4060-b57a-d3ff38fab008 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:44.323387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de848fb-6517-455e-9ad4-4c98b59ab20a None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:44.323480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6d318-8e7b-4060-b57a-d3ff38fab008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:44.324013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de848fb-6517-455e-9ad4-4c98b59ab20a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:44.324347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de848fb-6517-455e-9ad4-4c98b59ab20a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:44.325727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de848fb-6517-455e-9ad4-4c98b59ab20a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:44.340572 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 489/979] 10.222.0.76 () {56 vars in 1122 bytes} [Sat Aug 27 04:18:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:44.341720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de848fb-6517-455e-9ad4-4c98b59ab20a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:44.342985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-31a6d318-8e7b-4060-b57a-d3ff38fab008 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:44.344624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-31a6d318-8e7b-4060-b57a-d3ff38fab008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:44.365730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:44.428463 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 491/980] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:44.428463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6d318-8e7b-4060-b57a-d3ff38fab008 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:44.457116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de848fb-6517-455e-9ad4-4c98b59ab20a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:44.502709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4761a-331c-4eff-83b8-4c023139373f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:44.503526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4761a-331c-4eff-83b8-4c023139373f None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:44.503816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4761a-331c-4eff-83b8-4c023139373f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:44.504277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4761a-331c-4eff-83b8-4c023139373f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:44.519156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4761a-331c-4eff-83b8-4c023139373f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:44.520637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4761a-331c-4eff-83b8-4c023139373f None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:44.537694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-49f4761a-331c-4eff-83b8-4c023139373f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:44.537694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:44.537694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:44.537694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:44.537694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:44.537694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:44.537694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:44.537694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:44.537694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:44.537694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:44.537694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:44.537694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:44.537694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:44.537694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:44.537694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:44.537694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:44.538753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:44.538753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:44.538753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:44.538753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:44.538753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:44.538753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:44.538753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:44.538753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:44.538753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:44.538753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:44.538753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:44.538753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:44.538753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:44.538753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:44.538753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:44.538753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:44.538753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:44.541587 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:44.541587 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:44.541587 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:44.541587 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 490/981] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:44.546215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4761a-331c-4eff-83b8-4c023139373f None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:44.559247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6d318-8e7b-4060-b57a-d3ff38fab008 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:44.568520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:44.608481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b52c8c-5dc5-41c8-9609-64598da92ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:44.609042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b52c8c-5dc5-41c8-9609-64598da92ce3 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:44.609322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b52c8c-5dc5-41c8-9609-64598da92ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:44.609628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b52c8c-5dc5-41c8-9609-64598da92ce3 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:44.610279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b52c8c-5dc5-41c8-9609-64598da92ce3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:44.610580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b52c8c-5dc5-41c8-9609-64598da92ce3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:44.612007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b52c8c-5dc5-41c8-9609-64598da92ce3 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:44.618270 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 492/982] 10.222.0.76 () {56 vars in 1122 bytes} [Sat Aug 27 04:18:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:44.624473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b52c8c-5dc5-41c8-9609-64598da92ce3 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:44.643894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:44.670685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4761a-331c-4eff-83b8-4c023139373f None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:44.706653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d87a0-6530-45e4-bc74-14a32715dae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:44.707243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d87a0-6530-45e4-bc74-14a32715dae0 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:44.707522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d87a0-6530-45e4-bc74-14a32715dae0 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:44.707787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d87a0-6530-45e4-bc74-14a32715dae0 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:44.708456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d87a0-6530-45e4-bc74-14a32715dae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:44.708753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d87a0-6530-45e4-bc74-14a32715dae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:44.710087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d87a0-6530-45e4-bc74-14a32715dae0 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:44.721701 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 491/983] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:44.722574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d87a0-6530-45e4-bc74-14a32715dae0 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:44.730851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b52c8c-5dc5-41c8-9609-64598da92ce3 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:44.765451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a3d97-cdd5-470a-931f-0dc7716e7ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:44.766047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a3d97-cdd5-470a-931f-0dc7716e7ec4 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:44.766322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a3d97-cdd5-470a-931f-0dc7716e7ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:44.766590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a3d97-cdd5-470a-931f-0dc7716e7ec4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:44.767292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a3d97-cdd5-470a-931f-0dc7716e7ec4 None admin] RBAC: Adding query filter params (interface=admin, service_id=6272756f21d74296ac992b794c68c296, region_id=RegionOne) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:44.767595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a3d97-cdd5-470a-931f-0dc7716e7ec4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:44.768983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a3d97-cdd5-470a-931f-0dc7716e7ec4 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:44.773800 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 493/984] 10.222.0.76 () {56 vars in 1249 bytes} [Sat Aug 27 04:18:44 2022] GET /identity/v3/endpoints?service_id=6272756f21d74296ac992b794c68c296&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:44.774554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a3d97-cdd5-470a-931f-0dc7716e7ec4 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:44.795697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:44.825243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d87a0-6530-45e4-bc74-14a32715dae0 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:44.853942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:44.859067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68940045-53e5-4059-8a22-26dfda052848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:44.859655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68940045-53e5-4059-8a22-26dfda052848 None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:44.859929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68940045-53e5-4059-8a22-26dfda052848 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:44.860227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68940045-53e5-4059-8a22-26dfda052848 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:44.863168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68940045-53e5-4059-8a22-26dfda052848 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:44.863168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68940045-53e5-4059-8a22-26dfda052848 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:44.871662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a3d97-cdd5-470a-931f-0dc7716e7ec4 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:44.905314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdcff0-d4c8-406e-a7ed-496895e4785d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:44.905935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdcff0-d4c8-406e-a7ed-496895e4785d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:44.906216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdcff0-d4c8-406e-a7ed-496895e4785d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:44.906568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdcff0-d4c8-406e-a7ed-496895e4785d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:44.913078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdcff0-d4c8-406e-a7ed-496895e4785d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:44.914542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdcff0-d4c8-406e-a7ed-496895e4785d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:44.920429 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 492/985] 10.222.0.76 () {60 vars in 1141 bytes} [Sat Aug 27 04:18:44 2022] POST /identity/v3/services => generated 242 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:18:44.921182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68940045-53e5-4059-8a22-26dfda052848 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:44.932754 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-6afdcff0-d4c8-406e-a7ed-496895e4785d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:44.932754 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:44.932754 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:44.932754 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:44.932754 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:44.932754 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:44.932754 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:44.932754 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:44.932754 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:44.932754 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:44.932754 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:44.932754 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:44.932754 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:44.932754 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:44.932754 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:44.933738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:44.933738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:44.933738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:44.933738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:44.933738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:44.933738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:44.933738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:44.933738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:44.933738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:44.933738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:44.933738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:44.933738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:44.933738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:44.933738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:44.933738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:44.933738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:44.933738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:44.934698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:44.934698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:44.934698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:44.934698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:44.934698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:44.934698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:44.934698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:44.934698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:44.939302 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 494/986] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:44.940353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdcff0-d4c8-406e-a7ed-496895e4785d None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:45.064857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68940045-53e5-4059-8a22-26dfda052848 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:45.074440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdcff0-d4c8-406e-a7ed-496895e4785d None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:45.100638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:45.111772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99fec4-9fc9-42bd-a45a-7a15057bf3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:45.112351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99fec4-9fc9-42bd-a45a-7a15057bf3e0 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:45.112630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99fec4-9fc9-42bd-a45a-7a15057bf3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:45.112902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99fec4-9fc9-42bd-a45a-7a15057bf3e0 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:45.113502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99fec4-9fc9-42bd-a45a-7a15057bf3e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:45.114992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99fec4-9fc9-42bd-a45a-7a15057bf3e0 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:45.118624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6558d7-3447-4d93-9195-71a9736dc083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:45.122475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6558d7-3447-4d93-9195-71a9736dc083 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:45.122475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6558d7-3447-4d93-9195-71a9736dc083 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:45.122475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6558d7-3447-4d93-9195-71a9736dc083 None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:45.122475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6558d7-3447-4d93-9195-71a9736dc083 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:45.122475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6558d7-3447-4d93-9195-71a9736dc083 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:45.122832 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 493/987] 10.222.0.76 () {56 vars in 1087 bytes} [Sat Aug 27 04:18:44 2022] GET /identity/v3/services => generated 1727 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:18:45.122916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6558d7-3447-4d93-9195-71a9736dc083 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:45.140078 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 495/988] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:45.146808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99fec4-9fc9-42bd-a45a-7a15057bf3e0 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:45.258529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99fec4-9fc9-42bd-a45a-7a15057bf3e0 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:45.303357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50043d1e-b475-46ab-ae77-b1276016d282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:45.304374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50043d1e-b475-46ab-ae77-b1276016d282 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:45.304859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50043d1e-b475-46ab-ae77-b1276016d282 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:45.305400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50043d1e-b475-46ab-ae77-b1276016d282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:45.306338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50043d1e-b475-46ab-ae77-b1276016d282 None admin] RBAC: Adding query filter params (role.id=36d21a4033f94db3950f5e390f6e2a38, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=7aa8f9ba9e854c7abc4237eb72c55590) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:45.307149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50043d1e-b475-46ab-ae77-b1276016d282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:45.309130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50043d1e-b475-46ab-ae77-b1276016d282 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:45.316292 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 494/989] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:18:45 2022] GET /identity/v3/role_assignments?user.id=7aa8f9ba9e854c7abc4237eb72c55590&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=36d21a4033f94db3950f5e390f6e2a38 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:46.984581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb993b-04e5-4eeb-adaf-4ae02a21c902 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:46.985087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb993b-04e5-4eeb-adaf-4ae02a21c902 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:46.985178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb993b-04e5-4eeb-adaf-4ae02a21c902 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:46.986647 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 496/990] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:46.991658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cf2b6-42d0-45c1-9182-b444293210b6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:46.992062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cf2b6-42d0-45c1-9182-b444293210b6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:46.992273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cf2b6-42d0-45c1-9182-b444293210b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:47.012208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ec7cf2b6-42d0-45c1-9182-b444293210b6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:47.013412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ec7cf2b6-42d0-45c1-9182-b444293210b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:47.079149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:47.100201 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 495/991] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:47.141351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c5b3c-0551-4de6-b81d-180c788c64d5 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:47.141692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c5b3c-0551-4de6-b81d-180c788c64d5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:47.141890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c5b3c-0551-4de6-b81d-180c788c64d5 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:47.143253 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 497/992] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:47.148547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4520e-45db-4cc2-b568-c4f03eb98973 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:47.148835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4520e-45db-4cc2-b568-c4f03eb98973 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:47.149111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4520e-45db-4cc2-b568-c4f03eb98973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:47.167961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bbe4520e-45db-4cc2-b568-c4f03eb98973 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:47.169193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bbe4520e-45db-4cc2-b568-c4f03eb98973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:47.244569 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 496/993] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:47.427814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c5b3c-0551-4de6-b81d-180c788c64d5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:47.430786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:47.516120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4520e-45db-4cc2-b568-c4f03eb98973 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:47.538677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c5b3c-0551-4de6-b81d-180c788c64d5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:47.634779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4520e-45db-4cc2-b568-c4f03eb98973 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:47.641723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94aca1-5104-4ad3-8498-ab12f02a5afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:47.642348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94aca1-5104-4ad3-8498-ab12f02a5afb None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:47.642627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94aca1-5104-4ad3-8498-ab12f02a5afb None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:47.642897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94aca1-5104-4ad3-8498-ab12f02a5afb None admin] PATH_INFO: `/v3/services/compute` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:47.643480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94aca1-5104-4ad3-8498-ab12f02a5afb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:47.644881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94aca1-5104-4ad3-8498-ab12f02a5afb None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:47.654949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:47.655335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-5c94aca1-5104-4ad3-8498-ab12f02a5afb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 04:18:47.655335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:47.655335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:47.655335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:47.655335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:47.655335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:47.655335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:47.655335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:47.655335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 04:18:47.655335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:47.655335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:47.655335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:47.655335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:47.655335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:47.655335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:47.655335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:47.655335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:47.656396 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:47.656396 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:47.656396 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:47.656396 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:47.656396 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:47.656396 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:47.656396 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:47.656396 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:47.656396 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:47.656396 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:47.656396 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:47.656396 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:47.656396 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:47.656396 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:47.656396 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:47.656396 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:47.657284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:47.657284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:47.657284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:47.657284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:47.657284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:47.657284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:47.657284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:47.657284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:47.657284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:47.657284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:47.657284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:47.657284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:47.657284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 04:18:47.657284 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:47.657284 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 498/994] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:47.662284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94aca1-5104-4ad3-8498-ab12f02a5afb None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:47.677367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b659f5d-0316-4f3e-b8c2-2989005eb480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:47.678055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b659f5d-0316-4f3e-b8c2-2989005eb480 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:47.678330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b659f5d-0316-4f3e-b8c2-2989005eb480 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:47.678624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b659f5d-0316-4f3e-b8c2-2989005eb480 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:47.679204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b659f5d-0316-4f3e-b8c2-2989005eb480 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:47.680635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b659f5d-0316-4f3e-b8c2-2989005eb480 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:47.690761 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-4b659f5d-0316-4f3e-b8c2-2989005eb480 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:18:47.690761 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:47.690761 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:47.690761 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:47.690761 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:47.690761 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:47.690761 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:47.690761 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:47.690761 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:18:47.690761 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:47.690761 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:47.690761 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:47.690761 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:47.690761 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:47.690761 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:47.690761 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:47.690761 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:47.691759 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:47.691759 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:47.691759 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:47.691759 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:47.691759 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:47.691759 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:47.691759 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:47.691759 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:47.691759 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:47.691759 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:47.691759 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:47.691759 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:47.691759 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:47.691759 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:47.691759 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:47.691759 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:47.693212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:47.693212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:47.693212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:47.693212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:47.693212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:47.693212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:47.693212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:47.693212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:47.693212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:47.693212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:47.693212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:47.693212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:47.693212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 04:18:47.693212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:47.693212 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 497/995] 10.222.0.76 () {56 vars in 1126 bytes} [Sat Aug 27 04:18:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:47.698989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b659f5d-0316-4f3e-b8c2-2989005eb480 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:47.741524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:47.781424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94aca1-5104-4ad3-8498-ab12f02a5afb None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:47.808194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b659f5d-0316-4f3e-b8c2-2989005eb480 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:47.817539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2c059-e5ab-46fb-9563-41caaffd660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:47.818154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2c059-e5ab-46fb-9563-41caaffd660e None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:47.818439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2c059-e5ab-46fb-9563-41caaffd660e None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:47.818711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2c059-e5ab-46fb-9563-41caaffd660e None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:47.819340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2c059-e5ab-46fb-9563-41caaffd660e None admin] RBAC: Adding query filter params (name=compute) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:47.819647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2c059-e5ab-46fb-9563-41caaffd660e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:47.821058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2c059-e5ab-46fb-9563-41caaffd660e None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:47.827284 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 499/996] 10.222.0.76 () {56 vars in 1112 bytes} [Sat Aug 27 04:18:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:47.832711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2c059-e5ab-46fb-9563-41caaffd660e None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:47.852528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2718f9-ea46-4af0-b5c4-e20f6310fb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:47.853274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2718f9-ea46-4af0-b5c4-e20f6310fb5a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:47.853618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2718f9-ea46-4af0-b5c4-e20f6310fb5a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:47.853885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2718f9-ea46-4af0-b5c4-e20f6310fb5a None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:47.854511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2718f9-ea46-4af0-b5c4-e20f6310fb5a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:47.854807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2718f9-ea46-4af0-b5c4-e20f6310fb5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:47.856188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2718f9-ea46-4af0-b5c4-e20f6310fb5a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:47.861323 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 498/997] 10.222.0.76 () {56 vars in 1122 bytes} [Sat Aug 27 04:18:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:47.867137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2718f9-ea46-4af0-b5c4-e20f6310fb5a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:47.917082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:47.946537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2c059-e5ab-46fb-9563-41caaffd660e None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:47.981797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:47.982184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2718f9-ea46-4af0-b5c4-e20f6310fb5a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:47.987242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfdfce-b65f-4516-aa25-f14e6b94e4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:47.987850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfdfce-b65f-4516-aa25-f14e6b94e4f7 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:47.988130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfdfce-b65f-4516-aa25-f14e6b94e4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:47.988440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfdfce-b65f-4516-aa25-f14e6b94e4f7 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:47.989073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfdfce-b65f-4516-aa25-f14e6b94e4f7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:47.989375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfdfce-b65f-4516-aa25-f14e6b94e4f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:47.990737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfdfce-b65f-4516-aa25-f14e6b94e4f7 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:47.995928 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 500/998] 10.222.0.76 () {56 vars in 1112 bytes} [Sat Aug 27 04:18:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:47.997136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7085a7-4e1a-46be-bc2e-3d4002011702 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:48.000877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7085a7-4e1a-46be-bc2e-3d4002011702 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:48.000877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7085a7-4e1a-46be-bc2e-3d4002011702 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:48.000877 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 501/999] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:48.002601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7085a7-4e1a-46be-bc2e-3d4002011702 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:48.018759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82184560-6bec-4901-b029-f56772793305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:48.019442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82184560-6bec-4901-b029-f56772793305 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:48.019782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82184560-6bec-4901-b029-f56772793305 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:48.020118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82184560-6bec-4901-b029-f56772793305 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:48.020894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82184560-6bec-4901-b029-f56772793305 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:48.021195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82184560-6bec-4901-b029-f56772793305 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:48.022535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82184560-6bec-4901-b029-f56772793305 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:48.028056 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 499/1000] 10.222.0.76 () {56 vars in 1122 bytes} [Sat Aug 27 04:18:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:48.029285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa9ce5-6ad9-4b08-ad50-601b4ecbd5a1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:48.029570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa9ce5-6ad9-4b08-ad50-601b4ecbd5a1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:48.029846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa9ce5-6ad9-4b08-ad50-601b4ecbd5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:48.047598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-70fa9ce5-6ad9-4b08-ad50-601b4ecbd5a1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:48.049134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-70fa9ce5-6ad9-4b08-ad50-601b4ecbd5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:48.107588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7085a7-4e1a-46be-bc2e-3d4002011702 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:48.117420 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 500/1001] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:48.118277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa9ce5-6ad9-4b08-ad50-601b4ecbd5a1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:48.144460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf178072-bda9-492f-bfa8-670c8198ffc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:48.145052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf178072-bda9-492f-bfa8-670c8198ffc5 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:48.145329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf178072-bda9-492f-bfa8-670c8198ffc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:48.145794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf178072-bda9-492f-bfa8-670c8198ffc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:48.146281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf178072-bda9-492f-bfa8-670c8198ffc5 None admin] RBAC: Adding query filter params (interface=public, service_id=dea3672756c04711ab4870869017e24e, region_id=RegionOne) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:48.146584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf178072-bda9-492f-bfa8-670c8198ffc5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:48.147942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf178072-bda9-492f-bfa8-670c8198ffc5 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:48.158251 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 502/1002] 10.222.0.76 () {56 vars in 1251 bytes} [Sat Aug 27 04:18:48 2022] GET /identity/v3/endpoints?service_id=dea3672756c04711ab4870869017e24e&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:48.159232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf178072-bda9-492f-bfa8-670c8198ffc5 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:48.165329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:48.227448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:48.227804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa9ce5-6ad9-4b08-ad50-601b4ecbd5a1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:48.264776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ef52b-bf73-4d5d-947c-840cc10dd9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:48.265384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ef52b-bf73-4d5d-947c-840cc10dd9b0 None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:48.265663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ef52b-bf73-4d5d-947c-840cc10dd9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:48.265935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ef52b-bf73-4d5d-947c-840cc10dd9b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:48.266601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ef52b-bf73-4d5d-947c-840cc10dd9b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:48.268046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ef52b-bf73-4d5d-947c-840cc10dd9b0 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:48.276674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf178072-bda9-492f-bfa8-670c8198ffc5 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:48.313135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df1027-ef3d-4580-a92b-dba3e6b7f049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:48.313663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df1027-ef3d-4580-a92b-dba3e6b7f049 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:48.314065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df1027-ef3d-4580-a92b-dba3e6b7f049 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:48.314345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df1027-ef3d-4580-a92b-dba3e6b7f049 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:48.314963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df1027-ef3d-4580-a92b-dba3e6b7f049 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:48.316387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df1027-ef3d-4580-a92b-dba3e6b7f049 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:48.325190 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 501/1003] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:18:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:18:48.325392 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 503/1004] 10.222.0.76 () {56 vars in 1087 bytes} [Sat Aug 27 04:18:48 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:18:48.390379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ef52b-bf73-4d5d-947c-840cc10dd9b0 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:48.504751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:48.515268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ef52b-bf73-4d5d-947c-840cc10dd9b0 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:48.551282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042914b-403e-446c-b0b6-42d422d43c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:48.551915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042914b-403e-446c-b0b6-42d422d43c3f None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:48.552251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042914b-403e-446c-b0b6-42d422d43c3f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:48.552535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042914b-403e-446c-b0b6-42d422d43c3f None admin] PATH_INFO: `/v3/services/image` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:48.553126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042914b-403e-446c-b0b6-42d422d43c3f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:48.557724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042914b-403e-446c-b0b6-42d422d43c3f None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:48.567906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-1042914b-403e-446c-b0b6-42d422d43c3f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 04:18:48.567906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:48.567906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:48.567906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:48.567906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:48.567906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:48.567906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:48.567906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:48.567906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 04:18:48.567906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:48.567906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:48.567906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:48.567906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:48.567906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:48.567906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:48.567906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:48.567906 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:48.569150 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:48.569150 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:48.569150 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:48.569150 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:48.569150 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:48.569150 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:48.569150 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:48.569150 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:48.569150 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:48.569150 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:48.569150 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:48.569150 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:48.569150 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:48.569150 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:48.569150 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:48.569150 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:48.570024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:48.570024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:48.570024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:48.570024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:48.570024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:48.570024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:48.570024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:48.570024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:48.570024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:48.570024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:48.570024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:48.570024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:48.570024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 04:18:48.570024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:48.570024 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 502/1005] 10.222.0.76 () {56 vars in 1105 bytes} [Sat Aug 27 04:18:48 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:48.575510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df1027-ef3d-4580-a92b-dba3e6b7f049 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:48.679103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df1027-ef3d-4580-a92b-dba3e6b7f049 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:48.702901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:48.715227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9a86f-ee92-4bae-812d-b9c950449600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:48.716058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9a86f-ee92-4bae-812d-b9c950449600 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:48.716532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9a86f-ee92-4bae-812d-b9c950449600 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:48.716966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9a86f-ee92-4bae-812d-b9c950449600 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:48.717776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9a86f-ee92-4bae-812d-b9c950449600 None admin] RBAC: Adding query filter params (name=image) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:48.718218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9a86f-ee92-4bae-812d-b9c950449600 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:48.719716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9a86f-ee92-4bae-812d-b9c950449600 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:48.730065 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 504/1006] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:48.731581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042914b-403e-446c-b0b6-42d422d43c3f None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:48.838184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042914b-403e-446c-b0b6-42d422d43c3f None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:48.880650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337e784-de63-4e7a-94b0-7db01af87d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:48.881523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337e784-de63-4e7a-94b0-7db01af87d3f None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:48.881935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337e784-de63-4e7a-94b0-7db01af87d3f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:48.882334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337e784-de63-4e7a-94b0-7db01af87d3f None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:48.883355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337e784-de63-4e7a-94b0-7db01af87d3f None admin] RBAC: Adding query filter params (type=image) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:48.883862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337e784-de63-4e7a-94b0-7db01af87d3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:48.886518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337e784-de63-4e7a-94b0-7db01af87d3f None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:48.900655 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 503/1007] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:50.315495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ed42d-c483-4ec5-8fd9-8f8360f74b09 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:50.315988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ed42d-c483-4ec5-8fd9-8f8360f74b09 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:50.315988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ed42d-c483-4ec5-8fd9-8f8360f74b09 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:50.317505 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 505/1008] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:50.323198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ee461-2779-4fb0-b4c2-80700baf9f74 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:50.323644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ee461-2779-4fb0-b4c2-80700baf9f74 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:50.323722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ee461-2779-4fb0-b4c2-80700baf9f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:50.341776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-881ee461-2779-4fb0-b4c2-80700baf9f74 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:50.342779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f82b5-8241-4432-b4f9-79a0634036fe None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:50.342952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-881ee461-2779-4fb0-b4c2-80700baf9f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:50.343058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f82b5-8241-4432-b4f9-79a0634036fe None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:50.343333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f82b5-8241-4432-b4f9-79a0634036fe None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:50.345024 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 506/1009] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:18:50.349666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354433e-8bf1-4425-80dd-6e4188669a3c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:50.349951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354433e-8bf1-4425-80dd-6e4188669a3c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:50.350227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354433e-8bf1-4425-80dd-6e4188669a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:50.364626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:50.369623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2354433e-8bf1-4425-80dd-6e4188669a3c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:50.370816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2354433e-8bf1-4425-80dd-6e4188669a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:50.423192 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 504/1010] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:50 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:50.445684 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 507/1011] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:50 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:18:50.698778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ee461-2779-4fb0-b4c2-80700baf9f74 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:50.712560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354433e-8bf1-4425-80dd-6e4188669a3c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:50.807586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ee461-2779-4fb0-b4c2-80700baf9f74 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:50.824750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354433e-8bf1-4425-80dd-6e4188669a3c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:50.841114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b49efb-070b-4c94-add1-e5db34df6fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:50.841741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b49efb-070b-4c94-add1-e5db34df6fa2 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:50.842019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b49efb-070b-4c94-add1-e5db34df6fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:50.842291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b49efb-070b-4c94-add1-e5db34df6fa2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:50.842536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:50.842866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b49efb-070b-4c94-add1-e5db34df6fa2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:50.844252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b49efb-070b-4c94-add1-e5db34df6fa2 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:50.853384 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-59b49efb-070b-4c94-add1-e5db34df6fa2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 04:18:50.853384 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:50.853384 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:50.853384 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:50.853384 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:50.853384 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:50.853384 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:50.853384 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:50.853384 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 04:18:50.853384 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:50.853384 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:50.853384 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:50.853384 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:50.853384 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:50.853384 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:50.853384 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:50.853384 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:50.860622 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:50.860622 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:50.860622 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:50.860622 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:50.860622 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:50.860622 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:50.860622 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:50.860622 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:50.860622 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:50.860622 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:50.860622 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:50.860622 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:50.860622 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:50.860622 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:50.860622 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:50.860622 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:50.861773 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:50.861773 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:50.861773 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:50.861773 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:50.861773 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:50.861773 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:50.861773 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:50.861773 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:50.861773 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:50.861773 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:50.861773 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:50.861773 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:50.861773 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 04:18:50.861773 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:50.861773 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 505/1012] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:50.862610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46498f4-e9c0-40bf-8680-5929af80bc8c None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:50.862610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46498f4-e9c0-40bf-8680-5929af80bc8c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:50.862610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46498f4-e9c0-40bf-8680-5929af80bc8c None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:50.862610 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 506/1013] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:50.862868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a25b6-732d-4c0e-844f-134534980f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:50.862868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a25b6-732d-4c0e-844f-134534980f65 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:50.863016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46498f4-e9c0-40bf-8680-5929af80bc8c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:50.863084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a25b6-732d-4c0e-844f-134534980f65 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:50.863084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a25b6-732d-4c0e-844f-134534980f65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:50.863084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a25b6-732d-4c0e-844f-134534980f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:50.863700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a25b6-732d-4c0e-844f-134534980f65 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:50.865584 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 508/1014] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:50.866310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94543386-8da0-48ee-aa92-fe966202d70e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:50.866696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94543386-8da0-48ee-aa92-fe966202d70e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:50.866882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94543386-8da0-48ee-aa92-fe966202d70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:50.881461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:50.886915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-94543386-8da0-48ee-aa92-fe966202d70e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:50.888121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-94543386-8da0-48ee-aa92-fe966202d70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:50.958801 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 509/1015] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:50 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:50.959527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94543386-8da0-48ee-aa92-fe966202d70e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:50.977038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46498f4-e9c0-40bf-8680-5929af80bc8c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:51.013201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e872d-f803-4f56-bebf-7498cc8557d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:51.013811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e872d-f803-4f56-bebf-7498cc8557d4 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:51.014090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e872d-f803-4f56-bebf-7498cc8557d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:51.014362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e872d-f803-4f56-bebf-7498cc8557d4 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:51.014987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e872d-f803-4f56-bebf-7498cc8557d4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:51.015290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e872d-f803-4f56-bebf-7498cc8557d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:51.016832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e872d-f803-4f56-bebf-7498cc8557d4 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:51.021605 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 507/1016] 10.222.0.76 () {56 vars in 1112 bytes} [Sat Aug 27 04:18:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:51.027446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e872d-f803-4f56-bebf-7498cc8557d4 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:51.076265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94543386-8da0-48ee-aa92-fe966202d70e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:51.090844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:51.113085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b1f55-89d0-49bb-9807-8bd5090e0950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:51.114154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b1f55-89d0-49bb-9807-8bd5090e0950 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:51.114776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b1f55-89d0-49bb-9807-8bd5090e0950 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:51.115064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b1f55-89d0-49bb-9807-8bd5090e0950 None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:51.116324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b1f55-89d0-49bb-9807-8bd5090e0950 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:51.118005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:51.119021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b1f55-89d0-49bb-9807-8bd5090e0950 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:51.138005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e872d-f803-4f56-bebf-7498cc8557d4 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:51.173547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c10c1f-67b8-4308-9beb-b640fcb04894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:51.174149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c10c1f-67b8-4308-9beb-b640fcb04894 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:51.174433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c10c1f-67b8-4308-9beb-b640fcb04894 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:51.174825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c10c1f-67b8-4308-9beb-b640fcb04894 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:51.175454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c10c1f-67b8-4308-9beb-b640fcb04894 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:51.175753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c10c1f-67b8-4308-9beb-b640fcb04894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:51.177189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c10c1f-67b8-4308-9beb-b640fcb04894 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:51.185081 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 508/1017] 10.222.0.76 () {56 vars in 1112 bytes} [Sat Aug 27 04:18:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:51.187855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c10c1f-67b8-4308-9beb-b640fcb04894 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:51.212072 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 510/1018] 10.222.0.76 () {60 vars in 1141 bytes} [Sat Aug 27 04:18:50 2022] POST /identity/v3/projects => generated 311 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:18:51.230355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b1f55-89d0-49bb-9807-8bd5090e0950 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:51.312583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c10c1f-67b8-4308-9beb-b640fcb04894 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:51.354306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbad01-3d23-4f3d-bb07-9d4c70fcaced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:51.355007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbad01-3d23-4f3d-bb07-9d4c70fcaced None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:51.355195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbad01-3d23-4f3d-bb07-9d4c70fcaced None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:51.355477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbad01-3d23-4f3d-bb07-9d4c70fcaced None admin] PATH_INFO: `/v3/endpoints` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:51.356193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbad01-3d23-4f3d-bb07-9d4c70fcaced None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:51.358493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbad01-3d23-4f3d-bb07-9d4c70fcaced None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:51.365038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b1f55-89d0-49bb-9807-8bd5090e0950 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:51.405082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb7770-2d2c-44a0-9690-093fc3a8133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:51.405687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb7770-2d2c-44a0-9690-093fc3a8133b None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:51.405966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb7770-2d2c-44a0-9690-093fc3a8133b None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:51.406237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb7770-2d2c-44a0-9690-093fc3a8133b None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:51.406899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb7770-2d2c-44a0-9690-093fc3a8133b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:51.408297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb7770-2d2c-44a0-9690-093fc3a8133b None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:51.434745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:51.440053 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 509/1019] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:18:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:18:51.509933 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 511/1020] 10.222.0.76 () {60 vars in 1141 bytes} [Sat Aug 27 04:18:51 2022] POST /identity/v3/services => generated 242 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:18:53.238668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff118710-0800-49d2-818e-5b115c2be3a8 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:53.239160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff118710-0800-49d2-818e-5b115c2be3a8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:53.239160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff118710-0800-49d2-818e-5b115c2be3a8 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:53.240550 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 510/1021] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:53.246927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fa258-3294-429f-a379-5f0faf9d7835 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:53.247414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fa258-3294-429f-a379-5f0faf9d7835 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:53.247501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fa258-3294-429f-a379-5f0faf9d7835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:53.266553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f77fa258-3294-429f-a379-5f0faf9d7835 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:53.267758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f77fa258-3294-429f-a379-5f0faf9d7835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:53.291530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:53.345329 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 512/1022] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:53.480113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd0308-747b-47fe-9083-99c880edfcd1 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:53.480475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd0308-747b-47fe-9083-99c880edfcd1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:53.480702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd0308-747b-47fe-9083-99c880edfcd1 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:53.482313 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 511/1023] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:53.487426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac8d34-798f-4b0f-a2df-9095db4ea6b6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:53.487717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac8d34-798f-4b0f-a2df-9095db4ea6b6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:53.487989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac8d34-798f-4b0f-a2df-9095db4ea6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:53.509501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b1ac8d34-798f-4b0f-a2df-9095db4ea6b6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:53.509501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b1ac8d34-798f-4b0f-a2df-9095db4ea6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:53.577108 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 513/1024] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:53.625248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd0308-747b-47fe-9083-99c880edfcd1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:53.731468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd0308-747b-47fe-9083-99c880edfcd1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:53.766582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e7c66-90af-42fa-9f21-4d9cfc6e59c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:53.767137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e7c66-90af-42fa-9f21-4d9cfc6e59c6 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:53.767416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e7c66-90af-42fa-9f21-4d9cfc6e59c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:53.767684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e7c66-90af-42fa-9f21-4d9cfc6e59c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:53.768824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e7c66-90af-42fa-9f21-4d9cfc6e59c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:53.770247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e7c66-90af-42fa-9f21-4d9cfc6e59c6 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:53.772020 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 512/1025] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:53.777851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac8d34-798f-4b0f-a2df-9095db4ea6b6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:53.844031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e7c66-90af-42fa-9f21-4d9cfc6e59c6 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:53.861476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:53.881948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac8d34-798f-4b0f-a2df-9095db4ea6b6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:53.912367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:53.916905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6da4a-8ea4-4d1e-9e60-99da9b7c4be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:53.917528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6da4a-8ea4-4d1e-9e60-99da9b7c4be7 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:53.917803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6da4a-8ea4-4d1e-9e60-99da9b7c4be7 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:53.918076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6da4a-8ea4-4d1e-9e60-99da9b7c4be7 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:53.918733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6da4a-8ea4-4d1e-9e60-99da9b7c4be7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:53.920258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6da4a-8ea4-4d1e-9e60-99da9b7c4be7 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:53.948892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e7c66-90af-42fa-9f21-4d9cfc6e59c6 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:53.984058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc72390-115a-4681-8774-3ae0f569a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:53.984753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc72390-115a-4681-8774-3ae0f569a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:53.985026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc72390-115a-4681-8774-3ae0f569a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:53.985288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc72390-115a-4681-8774-3ae0f569a2e8 None admin] PATH_INFO: `/v3/services/image` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:53.985881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc72390-115a-4681-8774-3ae0f569a2e8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:53.987221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc72390-115a-4681-8774-3ae0f569a2e8 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:53.996499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-2cc72390-115a-4681-8774-3ae0f569a2e8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 04:18:53.996499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:53.996499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:53.996499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:53.996499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:53.996499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:53.996499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:53.996499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:53.996499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 04:18:53.996499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:53.996499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:53.996499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:53.996499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:53.996499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:53.996499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:53.996499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:53.996499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:53.997873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:53.997873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:53.997873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:53.997873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:53.997873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:53.997873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:53.997873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:53.997873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:53.997873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:53.997873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:53.997873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:53.997873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:53.997873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:53.997873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:53.997873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:53.997873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:53.998958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:53.998958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:53.998958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:53.998958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:53.998958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:53.998958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:53.998958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:53.998958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:53.998958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:53.998958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:53.998958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:53.998958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:53.998958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 04:18:53.998958 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:54.000314 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 513/1026] 10.222.0.76 () {56 vars in 1105 bytes} [Sat Aug 27 04:18:53 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:54.001571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e9789-b52d-4d1f-8080-9f478321a085 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:54.001855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e9789-b52d-4d1f-8080-9f478321a085 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:54.002129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e9789-b52d-4d1f-8080-9f478321a085 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:54.003388 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 514/1027] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:54.004213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e9789-b52d-4d1f-8080-9f478321a085 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:54.016210 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 514/1028] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:18:53 2022] POST /identity/v3/users => generated 285 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:18:54.016210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fc118-95ef-43fe-b329-9bafe4fc43c5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:54.016210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fc118-95ef-43fe-b329-9bafe4fc43c5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:54.016210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fc118-95ef-43fe-b329-9bafe4fc43c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:54.036810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2f9fc118-95ef-43fe-b329-9bafe4fc43c5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:54.038356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2f9fc118-95ef-43fe-b329-9bafe4fc43c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:54.120523 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 515/1029] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:54.123127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e9789-b52d-4d1f-8080-9f478321a085 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:54.161671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:54.168204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e689b4-e87d-44f3-bc30-613744af0c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:54.169077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e689b4-e87d-44f3-bc30-613744af0c09 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:54.169509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e689b4-e87d-44f3-bc30-613744af0c09 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:54.169920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e689b4-e87d-44f3-bc30-613744af0c09 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:54.170703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e689b4-e87d-44f3-bc30-613744af0c09 None admin] RBAC: Adding query filter params (name=image) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:54.171188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e689b4-e87d-44f3-bc30-613744af0c09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:54.172651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e689b4-e87d-44f3-bc30-613744af0c09 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:54.177891 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 515/1030] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:54.185100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fc118-95ef-43fe-b329-9bafe4fc43c5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:54.258209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:54.295709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fc118-95ef-43fe-b329-9bafe4fc43c5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:54.338579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4398815-4831-4f71-adb0-1e1797245cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:54.339190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4398815-4831-4f71-adb0-1e1797245cb6 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:54.339472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4398815-4831-4f71-adb0-1e1797245cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:54.339749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4398815-4831-4f71-adb0-1e1797245cb6 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:54.340414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4398815-4831-4f71-adb0-1e1797245cb6 None admin] RBAC: Adding query filter params (type=image) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:54.340718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4398815-4831-4f71-adb0-1e1797245cb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:54.342516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4398815-4831-4f71-adb0-1e1797245cb6 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:54.348106 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 516/1031] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:54.354190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e689b4-e87d-44f3-bc30-613744af0c09 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:54.396097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4398815-4831-4f71-adb0-1e1797245cb6 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:54.464538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e689b4-e87d-44f3-bc30-613744af0c09 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:54.502464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a536f-a14f-4619-898d-bf3e6a214523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:54.503086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a536f-a14f-4619-898d-bf3e6a214523 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:54.503359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a536f-a14f-4619-898d-bf3e6a214523 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:54.503634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a536f-a14f-4619-898d-bf3e6a214523 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:54.504358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a536f-a14f-4619-898d-bf3e6a214523 None admin] RBAC: Adding query filter params (interface=public, service_id=a7c4bd8b7c1a49a6aa0016fb60126fff, region_id=RegionOne) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:54.504666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a536f-a14f-4619-898d-bf3e6a214523 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:54.504978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4398815-4831-4f71-adb0-1e1797245cb6 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:54.506019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a536f-a14f-4619-898d-bf3e6a214523 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:54.512649 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 516/1032] 10.222.0.76 () {56 vars in 1251 bytes} [Sat Aug 27 04:18:54 2022] GET /identity/v3/endpoints?service_id=a7c4bd8b7c1a49a6aa0016fb60126fff&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:54.517951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a536f-a14f-4619-898d-bf3e6a214523 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:54.537870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:54.543392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc4abe-b4aa-4177-9f11-4f5cda54e922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:54.544024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc4abe-b4aa-4177-9f11-4f5cda54e922 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:54.546661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc4abe-b4aa-4177-9f11-4f5cda54e922 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:54.546661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc4abe-b4aa-4177-9f11-4f5cda54e922 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:54.554533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc4abe-b4aa-4177-9f11-4f5cda54e922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:54.559833 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-73fc4abe-b4aa-4177-9f11-4f5cda54e922 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:18:54.559833 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:54.559833 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:54.559833 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:54.559833 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:54.559833 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:54.559833 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:54.559833 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:54.559833 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:54.559833 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:54.559833 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:54.559833 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:54.559833 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:54.559833 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:54.559833 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:54.559833 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:54.560910 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:54.560910 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:54.560910 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:54.560910 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:54.560910 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:54.560910 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:54.560910 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:54.560910 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:54.560910 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:54.560910 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:54.560910 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:54.560910 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:54.560910 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:54.560910 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:54.560910 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:54.560910 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:54.561778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:54.561778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:54.561778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:54.561778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:54.561778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:54.561778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:54.561778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:54.561778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:54.561778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:54.561778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:54.561778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:18:54.561778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:54.565966 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 517/1033] 10.222.0.76 () {56 vars in 1120 bytes} [Sat Aug 27 04:18:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:54.566814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc4abe-b4aa-4177-9f11-4f5cda54e922 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:54.585520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:54.630374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a536f-a14f-4619-898d-bf3e6a214523 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:54.668262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aa456-ae75-4d12-8297-48e2d0a7d101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:54.668872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aa456-ae75-4d12-8297-48e2d0a7d101 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:54.669153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aa456-ae75-4d12-8297-48e2d0a7d101 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:54.669429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aa456-ae75-4d12-8297-48e2d0a7d101 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:54.670037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6aa456-ae75-4d12-8297-48e2d0a7d101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:54.671400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6aa456-ae75-4d12-8297-48e2d0a7d101 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:54.676148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc4abe-b4aa-4177-9f11-4f5cda54e922 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:54.688197 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 517/1034] 10.222.0.76 () {56 vars in 1087 bytes} [Sat Aug 27 04:18:54 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:18:54.727141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea834-4cba-4e64-8419-38b5c2b95ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:54.728034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea834-4cba-4e64-8419-38b5c2b95ed5 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:54.728430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea834-4cba-4e64-8419-38b5c2b95ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:54.728774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea834-4cba-4e64-8419-38b5c2b95ed5 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:54.729637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ea834-4cba-4e64-8419-38b5c2b95ed5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:54.730008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ea834-4cba-4e64-8419-38b5c2b95ed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:54.731516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ea834-4cba-4e64-8419-38b5c2b95ed5 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:54.746339 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 518/1035] 10.222.0.76 () {56 vars in 1115 bytes} [Sat Aug 27 04:18:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:54.747700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aa456-ae75-4d12-8297-48e2d0a7d101 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:54.857307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aa456-ae75-4d12-8297-48e2d0a7d101 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:54.880787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:54.896358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb830d4e-a3db-4c35-b61a-e979355b17ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:54.896999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb830d4e-a3db-4c35-b61a-e979355b17ac None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:54.897281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb830d4e-a3db-4c35-b61a-e979355b17ac None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:54.897556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb830d4e-a3db-4c35-b61a-e979355b17ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:54.908510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb830d4e-a3db-4c35-b61a-e979355b17ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:54.909953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb830d4e-a3db-4c35-b61a-e979355b17ac None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:54.924694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-eb830d4e-a3db-4c35-b61a-e979355b17ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:54.924694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:54.924694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:54.924694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:54.924694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:54.924694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:54.924694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:54.924694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:54.924694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:54.924694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:54.924694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:54.924694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:54.924694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:54.924694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:54.924694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:54.924694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:54.925694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:54.925694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:54.925694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:54.925694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:54.925694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:54.925694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:54.925694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:54.925694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:54.925694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:54.925694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:54.925694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:54.925694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:54.925694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:54.925694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:54.925694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:54.925694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:54.925694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:54.926579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:54.926579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:54.926579 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:54.926579 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 518/1036] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:54.933355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea834-4cba-4e64-8419-38b5c2b95ed5 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:54.994959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:55.040954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea834-4cba-4e64-8419-38b5c2b95ed5 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:55.075852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb3013-deed-4b53-9aa8-55031bb9d0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:55.076486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb3013-deed-4b53-9aa8-55031bb9d0ac None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:55.076769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb3013-deed-4b53-9aa8-55031bb9d0ac None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:55.077041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb3013-deed-4b53-9aa8-55031bb9d0ac None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:55.077682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb3013-deed-4b53-9aa8-55031bb9d0ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:55.077987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb3013-deed-4b53-9aa8-55031bb9d0ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:55.079354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb3013-deed-4b53-9aa8-55031bb9d0ac None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:55.096124 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 519/1037] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:55.097378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb830d4e-a3db-4c35-b61a-e979355b17ac None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:55.204701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb830d4e-a3db-4c35-b61a-e979355b17ac None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:55.238659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b161600-1ca9-41e9-9c51-51afbfc11186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:55.239283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b161600-1ca9-41e9-9c51-51afbfc11186 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:55.239557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b161600-1ca9-41e9-9c51-51afbfc11186 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:55.239823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b161600-1ca9-41e9-9c51-51afbfc11186 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:55.248746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b161600-1ca9-41e9-9c51-51afbfc11186 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:55.250212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b161600-1ca9-41e9-9c51-51afbfc11186 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:55.262815 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-6b161600-1ca9-41e9-9c51-51afbfc11186 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:18:55.262815 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:55.262815 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:55.262815 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:55.262815 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:55.262815 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:55.262815 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:55.262815 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:55.262815 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:55.262815 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:55.262815 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:55.262815 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:55.262815 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:55.262815 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:55.262815 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:55.262815 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:55.263829 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:55.269681 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:55.269681 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:55.269681 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:55.269681 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:55.269681 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:55.269681 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:55.269681 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:55.269681 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:55.269681 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:18:55.269681 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:55.269681 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 519/1038] 10.222.0.76 () {56 vars in 1093 bytes} [Sat Aug 27 04:18:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:55.270297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb3013-deed-4b53-9aa8-55031bb9d0ac None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:55.389309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb3013-deed-4b53-9aa8-55031bb9d0ac None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:55.404094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:55.429967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa22579-f24e-40d9-9319-e43ae2a6e684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:55.430576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa22579-f24e-40d9-9319-e43ae2a6e684 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:55.431608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa22579-f24e-40d9-9319-e43ae2a6e684 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:55.432094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa22579-f24e-40d9-9319-e43ae2a6e684 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:55.433419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa22579-f24e-40d9-9319-e43ae2a6e684 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:55.434082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa22579-f24e-40d9-9319-e43ae2a6e684 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:55.435973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa22579-f24e-40d9-9319-e43ae2a6e684 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:55.458516 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 520/1039] 10.222.0.76 () {56 vars in 1133 bytes} [Sat Aug 27 04:18:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:55.460219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b161600-1ca9-41e9-9c51-51afbfc11186 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:55.499613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:55.568123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b161600-1ca9-41e9-9c51-51afbfc11186 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:55.602442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7520327-300d-487f-b4af-c90c0c118c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:55.604000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7520327-300d-487f-b4af-c90c0c118c01 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:55.604116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7520327-300d-487f-b4af-c90c0c118c01 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:55.604327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7520327-300d-487f-b4af-c90c0c118c01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:55.674747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7520327-300d-487f-b4af-c90c0c118c01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:55.676206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7520327-300d-487f-b4af-c90c0c118c01 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:55.710452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:55.778949 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 520/1040] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:18:55 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 27 04:18:55.784720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa22579-f24e-40d9-9319-e43ae2a6e684 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:55.889499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa22579-f24e-40d9-9319-e43ae2a6e684 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:55.925569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c41398-fce6-4652-8936-0c7c4445d1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:55.926190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c41398-fce6-4652-8936-0c7c4445d1b4 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:55.926462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c41398-fce6-4652-8936-0c7c4445d1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:55.926727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c41398-fce6-4652-8936-0c7c4445d1b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:55.940016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c41398-fce6-4652-8936-0c7c4445d1b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:55.941513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c41398-fce6-4652-8936-0c7c4445d1b4 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:55.956893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-b2c41398-fce6-4652-8936-0c7c4445d1b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:55.956893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:55.956893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:55.956893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:55.956893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:55.956893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:55.956893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:55.956893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:55.956893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:55.956893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:55.956893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:55.956893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:55.956893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:55.956893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:55.956893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:55.956893 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:55.957890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:55.957890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:55.957890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:55.957890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:55.957890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:55.957890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:55.957890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:55.957890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:55.957890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:55.957890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:55.957890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:55.957890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:55.957890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:55.957890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:55.957890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:55.957890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:55.957890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:55.958776 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:55.958776 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:55.958776 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:55.959669 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 521/1041] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:55.964758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7520327-300d-487f-b4af-c90c0c118c01 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:56.067073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7520327-300d-487f-b4af-c90c0c118c01 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:56.107621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bed38-e4cf-48e0-be4f-81352fae5840 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:56.107952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bed38-e4cf-48e0-be4f-81352fae5840 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:56.108237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bed38-e4cf-48e0-be4f-81352fae5840 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:56.109809 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 522/1042] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:18:56.113332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cae8a7-060c-49a9-9174-827ccdf49f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:56.113942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cae8a7-060c-49a9-9174-827ccdf49f25 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:56.114304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cae8a7-060c-49a9-9174-827ccdf49f25 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:56.114503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cae8a7-060c-49a9-9174-827ccdf49f25 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:56.115151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cae8a7-060c-49a9-9174-827ccdf49f25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:56.115254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341b821-8019-4f8a-8cfe-324e7ef5419b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:56.115447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cae8a7-060c-49a9-9174-827ccdf49f25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:56.115558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341b821-8019-4f8a-8cfe-324e7ef5419b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:56.115925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341b821-8019-4f8a-8cfe-324e7ef5419b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:56.116835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cae8a7-060c-49a9-9174-827ccdf49f25 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:56.119458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:56.134408 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 521/1043] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:56.143617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c341b821-8019-4f8a-8cfe-324e7ef5419b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:56.143753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cae8a7-060c-49a9-9174-827ccdf49f25 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:56.143833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c341b821-8019-4f8a-8cfe-324e7ef5419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:56.157108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:56.216755 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 523/1044] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:18:56.243426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cae8a7-060c-49a9-9174-827ccdf49f25 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:56.279004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db633280-9808-494a-b748-9c2afad146ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:56.279624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db633280-9808-494a-b748-9c2afad146ad None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:56.279897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db633280-9808-494a-b748-9c2afad146ad None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:56.280183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db633280-9808-494a-b748-9c2afad146ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:56.286927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db633280-9808-494a-b748-9c2afad146ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:56.288417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db633280-9808-494a-b748-9c2afad146ad None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:56.300409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-db633280-9808-494a-b748-9c2afad146ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:56.300409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:56.300409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:56.300409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:56.300409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:56.300409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:56.300409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:56.300409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:56.300409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:56.300409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:56.300409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:56.300409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:56.300409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:18:56.300409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:18:56.300409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:18:56.301310 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:18:56.301310 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:56.301310 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:56.301310 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:56.301310 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:56.301310 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:56.301310 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:56.301310 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:56.301310 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:56.301310 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:56.301310 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:56.301310 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:56.301310 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:56.301310 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:56.301310 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:56.301310 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:56.301310 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:56.302230 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:18:56.302230 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:18:56.302230 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:18:56.302230 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:18:56.302230 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:18:56.302230 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:18:56.302230 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:18:56.302230 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:56.304469 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 522/1045] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:18:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:56.307903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341b821-8019-4f8a-8cfe-324e7ef5419b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:56.411199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341b821-8019-4f8a-8cfe-324e7ef5419b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:56.446015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8bca5-3bfe-45f9-8a71-fd3a89a29cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:56.447169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8bca5-3bfe-45f9-8a71-fd3a89a29cd0 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:56.447450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8bca5-3bfe-45f9-8a71-fd3a89a29cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:56.447724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8bca5-3bfe-45f9-8a71-fd3a89a29cd0 None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:56.448579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8bca5-3bfe-45f9-8a71-fd3a89a29cd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:56.448889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8bca5-3bfe-45f9-8a71-fd3a89a29cd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:56.450323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8bca5-3bfe-45f9-8a71-fd3a89a29cd0 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:56.466896 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 524/1046] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:18:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:56.468019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db633280-9808-494a-b748-9c2afad146ad None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:56.488082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8bca5-3bfe-45f9-8a71-fd3a89a29cd0 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:56.506760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:56.543353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:56.590046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db633280-9808-494a-b748-9c2afad146ad None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:56.596652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8bca5-3bfe-45f9-8a71-fd3a89a29cd0 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:56.625812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f4341-50e8-4542-8985-e1c426f34db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:56.626424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f4341-50e8-4542-8985-e1c426f34db5 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:56.626726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f4341-50e8-4542-8985-e1c426f34db5 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:56.627099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f4341-50e8-4542-8985-e1c426f34db5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:56.627813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f4341-50e8-4542-8985-e1c426f34db5 None admin] RBAC: Adding query filter params (role.id=36d21a4033f94db3950f5e390f6e2a38, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=0e5ddcf00a184aa0ac0e7194f1c72425) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:56.628123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f4341-50e8-4542-8985-e1c426f34db5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:56.629572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f4341-50e8-4542-8985-e1c426f34db5 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:56.636621 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 523/1047] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:18:56 2022] GET /identity/v3/role_assignments?user.id=0e5ddcf00a184aa0ac0e7194f1c72425&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=36d21a4033f94db3950f5e390f6e2a38 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:56.642605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfae74-71d1-4252-9789-1d88b0f21ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:56.643246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfae74-71d1-4252-9789-1d88b0f21ffc None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:56.643529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfae74-71d1-4252-9789-1d88b0f21ffc None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:56.643803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfae74-71d1-4252-9789-1d88b0f21ffc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:56.656561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfae74-71d1-4252-9789-1d88b0f21ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:56.661466 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-cbcfae74-71d1-4252-9789-1d88b0f21ffc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:18:56.661466 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:56.661466 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:56.661466 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:56.661466 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:56.661466 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:56.661466 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:56.661466 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:56.661466 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:56.661466 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:56.661466 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:56.661466 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:56.661466 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:56.661466 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:56.661466 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:56.661466 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:56.662434 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:56.662434 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:56.662434 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:56.662434 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:56.662434 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:56.662434 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:56.662434 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:56.662434 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:56.662434 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:56.662434 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:56.662434 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:56.662434 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:56.662434 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:56.662434 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:56.662434 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:56.662434 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:56.665706 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:56.665706 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:56.665706 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:56.665706 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:56.665706 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:56.665706 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:56.665706 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:56.665706 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:56.665706 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:56.665706 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:56.665706 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:18:56.665706 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:56.665706 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 525/1048] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:18:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:56.669863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f4341-50e8-4542-8985-e1c426f34db5 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:56.678744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500b4c5-9ef7-47b8-8ef0-18e071016dcc None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:56.679063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500b4c5-9ef7-47b8-8ef0-18e071016dcc None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:56.679306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500b4c5-9ef7-47b8-8ef0-18e071016dcc None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:56.682694 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 526/1049] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:18:56.687087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacde06-9b64-47cb-baee-f95f85a57ff6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:56.687370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacde06-9b64-47cb-baee-f95f85a57ff6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:56.687644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacde06-9b64-47cb-baee-f95f85a57ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:56.706295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bcacde06-9b64-47cb-baee-f95f85a57ff6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:56.707517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bcacde06-9b64-47cb-baee-f95f85a57ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:56.778940 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 527/1050] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:18:56.786880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f4341-50e8-4542-8985-e1c426f34db5 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:56.810071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:56.824762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09604bcd-f8c1-4f93-a499-536862df44a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:56.825471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604bcd-f8c1-4f93-a499-536862df44a5 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:56.825752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604bcd-f8c1-4f93-a499-536862df44a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:56.826027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604bcd-f8c1-4f93-a499-536862df44a5 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:56.826694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09604bcd-f8c1-4f93-a499-536862df44a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:56.826999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09604bcd-f8c1-4f93-a499-536862df44a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:56.828377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09604bcd-f8c1-4f93-a499-536862df44a5 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:56.837246 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 524/1051] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:18:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:56.843400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacde06-9b64-47cb-baee-f95f85a57ff6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:56.846955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:56.955490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacde06-9b64-47cb-baee-f95f85a57ff6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:56.994822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438edcd5-21f1-4683-b58a-6f8a7684cc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:56.995461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438edcd5-21f1-4683-b58a-6f8a7684cc37 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:56.995743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438edcd5-21f1-4683-b58a-6f8a7684cc37 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:56.996016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438edcd5-21f1-4683-b58a-6f8a7684cc37 None admin] PATH_INFO: `/v3/users/5718e1d5bbb84b228854658df524301e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:57.010053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438edcd5-21f1-4683-b58a-6f8a7684cc37 None admin] RBAC: Authorizing `identity:get_user(user_id=5718e1d5bbb84b228854658df524301e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:57.011757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438edcd5-21f1-4683-b58a-6f8a7684cc37 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:57.013560 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 528/1052] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:18:56 2022] GET /identity/v3/users/5718e1d5bbb84b228854658df524301e => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:57.019395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09604bcd-f8c1-4f93-a499-536862df44a5 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:57.051364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438edcd5-21f1-4683-b58a-6f8a7684cc37 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:57.121376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:57.136772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09604bcd-f8c1-4f93-a499-536862df44a5 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:57.167835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438edcd5-21f1-4683-b58a-6f8a7684cc37 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:57.175187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c56acb-d456-4002-aa12-1b6f81b6907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:57.175797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c56acb-d456-4002-aa12-1b6f81b6907a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:57.176076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c56acb-d456-4002-aa12-1b6f81b6907a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:57.176376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c56acb-d456-4002-aa12-1b6f81b6907a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:57.207019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b4766-cd31-4af8-9159-f959662cf77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:57.207734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b4766-cd31-4af8-9159-f959662cf77b None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:57.208206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b4766-cd31-4af8-9159-f959662cf77b None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:57.208315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b4766-cd31-4af8-9159-f959662cf77b None admin] PATH_INFO: `/v3/services/image` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:57.208964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b4766-cd31-4af8-9159-f959662cf77b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:57.210336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b4766-cd31-4af8-9159-f959662cf77b None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:57.220291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-008b4766-cd31-4af8-9159-f959662cf77b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 04:18:57.220291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:57.220291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:18:57.220291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:18:57.220291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:18:57.220291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:18:57.220291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:18:57.220291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:57.220291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 04:18:57.220291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:57.220291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:18:57.220291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:57.220291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:57.220291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:57.220291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:57.220291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:57.220291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:57.221291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:57.221291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:57.221291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:57.221291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:57.221291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:57.221291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:57.221291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:18:57.221291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:18:57.221291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:18:57.221291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:18:57.221291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:57.221291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:57.221291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:57.221291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:57.221291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:57.221291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:57.222143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:57.222143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:57.222143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:57.222143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:57.222143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:57.222143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:57.222143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:57.222143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:57.222143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:57.222143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:57.222143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:18:57.222143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:18:57.222143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 04:18:57.222143 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:18:57.222143 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 529/1053] 10.222.0.76 () {56 vars in 1105 bytes} [Sat Aug 27 04:18:57 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:18:57.229068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b4766-cd31-4af8-9159-f959662cf77b None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:57.231660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:57.251524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c56acb-d456-4002-aa12-1b6f81b6907a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:57.253298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c56acb-d456-4002-aa12-1b6f81b6907a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:57.335860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b4766-cd31-4af8-9159-f959662cf77b None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:57.364385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:57.374736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207484b-91ab-4a70-8eda-7de0888104f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:57.375458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207484b-91ab-4a70-8eda-7de0888104f8 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:57.375742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207484b-91ab-4a70-8eda-7de0888104f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:57.376019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207484b-91ab-4a70-8eda-7de0888104f8 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:57.376702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207484b-91ab-4a70-8eda-7de0888104f8 None admin] RBAC: Adding query filter params (name=image) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:57.377008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207484b-91ab-4a70-8eda-7de0888104f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:57.378396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207484b-91ab-4a70-8eda-7de0888104f8 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:57.383604 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 525/1054] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:18:57 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 04:18:57.384565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c56acb-d456-4002-aa12-1b6f81b6907a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:57.393862 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 530/1055] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:57.394731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207484b-91ab-4a70-8eda-7de0888104f8 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:57.479673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:57.499475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c56acb-d456-4002-aa12-1b6f81b6907a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:57.508492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207484b-91ab-4a70-8eda-7de0888104f8 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:57.544234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a81f3f-db82-4a03-8a60-a9efdefb8556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:57.544884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a81f3f-db82-4a03-8a60-a9efdefb8556 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:57.545135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a81f3f-db82-4a03-8a60-a9efdefb8556 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:57.545462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a81f3f-db82-4a03-8a60-a9efdefb8556 None admin] PATH_INFO: `/v3/projects/913f340e8d0b4836a747fdb323c05769` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:57.546139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb715d1-b6c7-411e-8ae4-7c50e6bd3e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:57.546630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a81f3f-db82-4a03-8a60-a9efdefb8556 None admin] RBAC: Authorizing `identity:get_project(project_id=913f340e8d0b4836a747fdb323c05769)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:57.546996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb715d1-b6c7-411e-8ae4-7c50e6bd3e3a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:57.547284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb715d1-b6c7-411e-8ae4-7c50e6bd3e3a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:57.547559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb715d1-b6c7-411e-8ae4-7c50e6bd3e3a None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:57.548133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a81f3f-db82-4a03-8a60-a9efdefb8556 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:57.548266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb715d1-b6c7-411e-8ae4-7c50e6bd3e3a None admin] RBAC: Adding query filter params (type=image) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:57.548649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb715d1-b6c7-411e-8ae4-7c50e6bd3e3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:57.550017 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 526/1056] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:18:57 2022] GET /identity/v3/projects/913f340e8d0b4836a747fdb323c05769 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:57.552347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb715d1-b6c7-411e-8ae4-7c50e6bd3e3a None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:57.556577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a81f3f-db82-4a03-8a60-a9efdefb8556 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:57.564017 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 531/1057] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:57.565016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb715d1-b6c7-411e-8ae4-7c50e6bd3e3a None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:57.622599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:57.672588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb715d1-b6c7-411e-8ae4-7c50e6bd3e3a None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:57.679124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a81f3f-db82-4a03-8a60-a9efdefb8556 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:57.709040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefba4e-b881-4517-bbe9-a26c13f9acf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:57.709643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefba4e-b881-4517-bbe9-a26c13f9acf5 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:57.709919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefba4e-b881-4517-bbe9-a26c13f9acf5 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:57.710190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefba4e-b881-4517-bbe9-a26c13f9acf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:57.710847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefba4e-b881-4517-bbe9-a26c13f9acf5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:57.712806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefba4e-b881-4517-bbe9-a26c13f9acf5 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:57.716015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d516d4a-47d2-4feb-97b7-f4c524fc993c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:57.716664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d516d4a-47d2-4feb-97b7-f4c524fc993c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:57.716941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d516d4a-47d2-4feb-97b7-f4c524fc993c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:57.717210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d516d4a-47d2-4feb-97b7-f4c524fc993c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:57.718187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d516d4a-47d2-4feb-97b7-f4c524fc993c None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=913f340e8d0b4836a747fdb323c05769, user.id=5718e1d5bbb84b228854658df524301e) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:57.718868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d516d4a-47d2-4feb-97b7-f4c524fc993c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:57.720375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d516d4a-47d2-4feb-97b7-f4c524fc993c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:57.728222 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 527/1058] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:18:57 2022] GET /identity/v3/role_assignments?user.id=5718e1d5bbb84b228854658df524301e&scope.project.id=913f340e8d0b4836a747fdb323c05769&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:18:57.812203 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 532/1059] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:18:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:18:58.582547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e799479-8a6c-4af5-9460-c80bed147aaa None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:58.583074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e799479-8a6c-4af5-9460-c80bed147aaa None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:58.583074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e799479-8a6c-4af5-9460-c80bed147aaa None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:58.584662 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 528/1060] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:18:58.590540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb54c2-6ccd-4800-8e45-02c234569228 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:58.591035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb54c2-6ccd-4800-8e45-02c234569228 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:58.591123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb54c2-6ccd-4800-8e45-02c234569228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:58.609696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ccdb54c2-6ccd-4800-8e45-02c234569228 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:58.610884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ccdb54c2-6ccd-4800-8e45-02c234569228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:58.700258 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 533/1061] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:18:58.974850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e799479-8a6c-4af5-9460-c80bed147aaa None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:58.991676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:59.088477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e799479-8a6c-4af5-9460-c80bed147aaa None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:59.122973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95480ba-a4d1-4a43-95c6-6a2a6960c22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:59.123602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95480ba-a4d1-4a43-95c6-6a2a6960c22c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:59.123882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95480ba-a4d1-4a43-95c6-6a2a6960c22c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:59.124155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95480ba-a4d1-4a43-95c6-6a2a6960c22c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:59.135328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95480ba-a4d1-4a43-95c6-6a2a6960c22c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:18:59.140551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-c95480ba-a4d1-4a43-95c6-6a2a6960c22c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:18:59.140551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:59.140551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:59.140551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:59.140551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:59.140551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:59.140551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:59.140551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:59.140551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:59.140551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:59.140551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:59.140551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:59.140551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:18:59.140551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:18:59.140551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:18:59.140551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:18:59.141896 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:18:59.141896 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:18:59.141896 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:18:59.141896 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:18:59.141896 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:59.141896 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:59.141896 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:59.141896 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:59.141896 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:59.141896 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:59.141896 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:59.141896 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:59.141896 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:59.141896 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:59.141896 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:59.141896 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:59.143465 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:59.143465 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:59.143465 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:59.143465 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:59.143465 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:18:59.143465 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:18:59.143465 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:18:59.143465 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:18:59.143465 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:18:59.143465 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:18:59.143465 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:18:59.143465 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:59.150614 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 529/1062] 10.222.0.76 () {56 vars in 1120 bytes} [Sat Aug 27 04:18:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:59.150749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb54c2-6ccd-4800-8e45-02c234569228 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:59.200736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:59.313893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb54c2-6ccd-4800-8e45-02c234569228 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:59.374039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e2399-80a0-4a13-a2b9-30cf30eb2471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:59.374651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e2399-80a0-4a13-a2b9-30cf30eb2471 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:59.374932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e2399-80a0-4a13-a2b9-30cf30eb2471 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:59.375203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e2399-80a0-4a13-a2b9-30cf30eb2471 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:59.375874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e2399-80a0-4a13-a2b9-30cf30eb2471 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:59.376192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e2399-80a0-4a13-a2b9-30cf30eb2471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:59.377602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e2399-80a0-4a13-a2b9-30cf30eb2471 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:59.391675 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 534/1063] 10.222.0.76 () {56 vars in 1115 bytes} [Sat Aug 27 04:18:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:59.393031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95480ba-a4d1-4a43-95c6-6a2a6960c22c None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:59.479749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:59.506225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95480ba-a4d1-4a43-95c6-6a2a6960c22c None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:59.543433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8c38b-b3ea-4eca-aa57-7d2efc91825c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:59.544064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8c38b-b3ea-4eca-aa57-7d2efc91825c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:59.544377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8c38b-b3ea-4eca-aa57-7d2efc91825c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:59.544650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8c38b-b3ea-4eca-aa57-7d2efc91825c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:59.555249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8c38b-b3ea-4eca-aa57-7d2efc91825c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:59.556990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8c38b-b3ea-4eca-aa57-7d2efc91825c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:59.572860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-5ed8c38b-b3ea-4eca-aa57-7d2efc91825c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:59.572860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:59.572860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:59.572860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:59.572860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:59.572860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:59.572860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:59.572860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:59.572860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:59.572860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:59.572860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:59.572860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:59.572860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:18:59.572860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:18:59.572860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:18:59.572860 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:18:59.573844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:59.573844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:59.573844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:59.573844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:59.573844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:59.573844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:59.573844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:59.573844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:59.573844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:59.573844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:59.573844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:59.573844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:59.573844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:59.573844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:59.573844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:59.573844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:59.573844 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:18:59.574753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:18:59.574753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:18:59.574753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:59.576540 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 530/1064] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:59.579697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e2399-80a0-4a13-a2b9-30cf30eb2471 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:59.661384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2d20b-3879-4ca7-a8d1-7fc9f0edeba2 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:59.661384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2d20b-3879-4ca7-a8d1-7fc9f0edeba2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:59.661384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2d20b-3879-4ca7-a8d1-7fc9f0edeba2 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:59.662059 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 531/1065] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:18:59.667277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcb482-6a47-4d6c-ae9f-4a5877953454 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:59.667553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcb482-6a47-4d6c-ae9f-4a5877953454 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:59.667828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcb482-6a47-4d6c-ae9f-4a5877953454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:59.685501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5ffcb482-6a47-4d6c-ae9f-4a5877953454 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:59.686687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5ffcb482-6a47-4d6c-ae9f-4a5877953454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:59.695587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:59.701259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e2399-80a0-4a13-a2b9-30cf30eb2471 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:59.738709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c505e06-7adf-497b-8fac-692f5495d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:59.739691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c505e06-7adf-497b-8fac-692f5495d842 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:59.740151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c505e06-7adf-497b-8fac-692f5495d842 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:59.740627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c505e06-7adf-497b-8fac-692f5495d842 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:59.741448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c505e06-7adf-497b-8fac-692f5495d842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:18:59.741953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c505e06-7adf-497b-8fac-692f5495d842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:59.743577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c505e06-7adf-497b-8fac-692f5495d842 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:59.761580 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 532/1066] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:18:59.761756 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 535/1067] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:18:59.765234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcb482-6a47-4d6c-ae9f-4a5877953454 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:59.823551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:18:59.867865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcb482-6a47-4d6c-ae9f-4a5877953454 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:18:59.873185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd27c7-0777-42af-b2e8-d104e2230354 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:59.873462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd27c7-0777-42af-b2e8-d104e2230354 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:59.873736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd27c7-0777-42af-b2e8-d104e2230354 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:59.875200 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 536/1068] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:18:59.880128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991425f2-3f05-44bd-a8db-a51308c0645b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:59.880438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991425f2-3f05-44bd-a8db-a51308c0645b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:59.880744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991425f2-3f05-44bd-a8db-a51308c0645b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:59.900188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-991425f2-3f05-44bd-a8db-a51308c0645b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:18:59.901568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-991425f2-3f05-44bd-a8db-a51308c0645b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:18:59.912137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b11243-60b2-4c15-a0bd-69baace6a73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:18:59.913115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b11243-60b2-4c15-a0bd-69baace6a73b None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:18:59.913396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b11243-60b2-4c15-a0bd-69baace6a73b None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:18:59.913957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b11243-60b2-4c15-a0bd-69baace6a73b None admin] PATH_INFO: `/v3/users/nova` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:18:59.921650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b11243-60b2-4c15-a0bd-69baace6a73b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:18:59.923436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b11243-60b2-4c15-a0bd-69baace6a73b None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:18:59.937596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-26b11243-60b2-4c15-a0bd-69baace6a73b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:18:59.937596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:18:59.937596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:18:59.937596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:18:59.937596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:18:59.937596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:18:59.937596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:18:59.937596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:18:59.937596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:18:59.937596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:18:59.937596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:18:59.937596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:18:59.937596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:18:59.937596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:18:59.937596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:18:59.937596 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:18:59.938585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:18:59.939543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:18:59.939543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:18:59.939543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:18:59.939543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:18:59.939543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:18:59.939543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:18:59.939543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:18:59.939543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:18:59.939543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:18:59.939543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:18:59.939543 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 533/1069] 10.222.0.76 () {56 vars in 1093 bytes} [Sat Aug 27 04:18:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:18:59.941678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b11243-60b2-4c15-a0bd-69baace6a73b None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:18:59.986952 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 537/1070] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:18:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:19:00.029259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991425f2-3f05-44bd-a8db-a51308c0645b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:00.050668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b11243-60b2-4c15-a0bd-69baace6a73b None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:00.068982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:00.088845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25878ab4-08dd-452e-86d6-ae1f3be31add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:00.089375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25878ab4-08dd-452e-86d6-ae1f3be31add None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:00.089685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25878ab4-08dd-452e-86d6-ae1f3be31add None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:00.089917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25878ab4-08dd-452e-86d6-ae1f3be31add None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:00.090641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25878ab4-08dd-452e-86d6-ae1f3be31add None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:00.090949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25878ab4-08dd-452e-86d6-ae1f3be31add None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:00.092561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25878ab4-08dd-452e-86d6-ae1f3be31add None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:00.112583 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 534/1071] 10.222.0.76 () {56 vars in 1133 bytes} [Sat Aug 27 04:18:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:19:00.118660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25878ab4-08dd-452e-86d6-ae1f3be31add None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:00.126253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:00.141986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991425f2-3f05-44bd-a8db-a51308c0645b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:00.181919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cf9a1-414d-4d5e-8e35-7a0794f5fe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:00.182552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cf9a1-414d-4d5e-8e35-7a0794f5fe5f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:00.182829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cf9a1-414d-4d5e-8e35-7a0794f5fe5f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:00.183099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cf9a1-414d-4d5e-8e35-7a0794f5fe5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:00.194495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cf9a1-414d-4d5e-8e35-7a0794f5fe5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:19:00.200326 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-b44cf9a1-414d-4d5e-8e35-7a0794f5fe5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:19:00.200326 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:00.200326 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:19:00.200326 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:19:00.200326 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:19:00.200326 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:19:00.200326 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:19:00.200326 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:19:00.200326 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:19:00.200326 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:19:00.200326 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:19:00.200326 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:19:00.200326 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:19:00.200326 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:19:00.200326 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:19:00.200326 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:19:00.201273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:19:00.201273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:19:00.201273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:19:00.201273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:19:00.201273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:19:00.201273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:19:00.201273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:19:00.201273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:19:00.201273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:19:00.201273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:19:00.201273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:19:00.201273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:19:00.201273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:19:00.201273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:19:00.201273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:19:00.201273 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:19:00.204905 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:19:00.204905 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:19:00.204905 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:19:00.204905 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:19:00.204905 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:19:00.204905 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:19:00.204905 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:19:00.204905 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:19:00.204905 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:19:00.204905 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:19:00.204905 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:19:00.204905 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:19:00.204905 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 538/1072] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:19:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:19:00.207876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cf9a1-414d-4d5e-8e35-7a0794f5fe5f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:00.225688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25878ab4-08dd-452e-86d6-ae1f3be31add None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:00.264854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b50570-bc21-4859-8f9b-4b52c1e605b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:00.265486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b50570-bc21-4859-8f9b-4b52c1e605b4 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:00.265766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b50570-bc21-4859-8f9b-4b52c1e605b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:00.266040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b50570-bc21-4859-8f9b-4b52c1e605b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:00.276712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b50570-bc21-4859-8f9b-4b52c1e605b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:00.278144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b50570-bc21-4859-8f9b-4b52c1e605b4 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:00.293077 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-e7b50570-bc21-4859-8f9b-4b52c1e605b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:19:00.293077 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:00.293077 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:19:00.293077 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:19:00.293077 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:19:00.293077 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:19:00.293077 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:19:00.293077 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:19:00.293077 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:19:00.293077 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:19:00.293077 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:19:00.293077 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:19:00.293077 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:19:00.293077 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:19:00.293077 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:19:00.293077 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:19:00.294092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:19:00.294092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:19:00.294092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:19:00.294092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:19:00.294092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:19:00.294092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:19:00.294092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:19:00.294092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:19:00.294092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:19:00.294092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:19:00.294092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:19:00.294092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:19:00.294092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:19:00.294092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:19:00.294092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:19:00.294092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:19:00.294092 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:19:00.295543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:19:00.295543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:19:00.295543 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:19:00.295543 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 535/1073] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:19:00.296722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b50570-bc21-4859-8f9b-4b52c1e605b4 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:00.313169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cf9a1-414d-4d5e-8e35-7a0794f5fe5f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:00.324738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:00.348088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71394554-0ee0-47c2-9d2f-7f45ebcf7b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:00.348646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71394554-0ee0-47c2-9d2f-7f45ebcf7b18 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:00.348929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71394554-0ee0-47c2-9d2f-7f45ebcf7b18 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:00.349203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71394554-0ee0-47c2-9d2f-7f45ebcf7b18 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:00.349869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71394554-0ee0-47c2-9d2f-7f45ebcf7b18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:00.350173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71394554-0ee0-47c2-9d2f-7f45ebcf7b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:00.351548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71394554-0ee0-47c2-9d2f-7f45ebcf7b18 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:00.359861 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 539/1074] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:19:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:00.360685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71394554-0ee0-47c2-9d2f-7f45ebcf7b18 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:00.374306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:00.407916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b50570-bc21-4859-8f9b-4b52c1e605b4 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:00.443955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aacf94-d2f6-4b98-9074-236f14804f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:00.444679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aacf94-d2f6-4b98-9074-236f14804f42 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:00.444959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aacf94-d2f6-4b98-9074-236f14804f42 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:00.445241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aacf94-d2f6-4b98-9074-236f14804f42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:00.463233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71394554-0ee0-47c2-9d2f-7f45ebcf7b18 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:00.498976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292d1d2-2092-438d-9e06-3c43db862a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:00.499571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d1d2-2092-438d-9e06-3c43db862a7b None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:00.499849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d1d2-2092-438d-9e06-3c43db862a7b None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:00.500117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d1d2-2092-438d-9e06-3c43db862a7b None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:00.500783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292d1d2-2092-438d-9e06-3c43db862a7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:00.501080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292d1d2-2092-438d-9e06-3c43db862a7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:00.502438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292d1d2-2092-438d-9e06-3c43db862a7b None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:00.514082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aacf94-d2f6-4b98-9074-236f14804f42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:00.514664 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 540/1075] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:00.515443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292d1d2-2092-438d-9e06-3c43db862a7b None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:00.515687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aacf94-d2f6-4b98-9074-236f14804f42 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:00.544893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:00.594631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:00.623951 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 536/1076] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:19:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 04:19:00.624773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aacf94-d2f6-4b98-9074-236f14804f42 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:00.628917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292d1d2-2092-438d-9e06-3c43db862a7b None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:00.663173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34965e-2382-4fe0-9c41-e778bde18985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:00.663793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34965e-2382-4fe0-9c41-e778bde18985 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:00.664069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34965e-2382-4fe0-9c41-e778bde18985 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:00.664368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34965e-2382-4fe0-9c41-e778bde18985 None admin] PATH_INFO: `/v3/users/5718e1d5bbb84b228854658df524301e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:00.666557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34965e-2382-4fe0-9c41-e778bde18985 None admin] RBAC: Authorizing `identity:get_user(user_id=5718e1d5bbb84b228854658df524301e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:00.667993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34965e-2382-4fe0-9c41-e778bde18985 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:00.669741 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 541/1077] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:19:00 2022] GET /identity/v3/users/5718e1d5bbb84b228854658df524301e => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:00.674671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34965e-2382-4fe0-9c41-e778bde18985 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:00.731615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aacf94-d2f6-4b98-9074-236f14804f42 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:00.757669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:00.766340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f87cee-26c9-4377-ba74-10af6b11a932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:00.766968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f87cee-26c9-4377-ba74-10af6b11a932 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:00.767242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f87cee-26c9-4377-ba74-10af6b11a932 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:00.767507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f87cee-26c9-4377-ba74-10af6b11a932 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:00.773825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f87cee-26c9-4377-ba74-10af6b11a932 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:00.775273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f87cee-26c9-4377-ba74-10af6b11a932 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:00.775629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34965e-2382-4fe0-9c41-e778bde18985 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:00.786131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-d6f87cee-26c9-4377-ba74-10af6b11a932 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:19:00.786131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:00.786131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:19:00.786131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:19:00.786131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:19:00.786131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:19:00.786131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:19:00.786131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:19:00.786131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:19:00.786131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:19:00.786131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:19:00.786131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:19:00.786131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:19:00.786131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:19:00.786131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:19:00.787273 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:19:00.787273 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:19:00.787273 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:19:00.787273 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:19:00.787273 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:19:00.787273 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:19:00.787273 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:19:00.787273 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:19:00.787273 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:19:00.787273 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:19:00.787273 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:19:00.787273 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:19:00.787273 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:19:00.787273 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:19:00.787273 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:19:00.787273 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:19:00.787273 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:19:00.788319 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:19:00.788319 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:19:00.788319 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:19:00.788319 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:19:00.788319 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:19:00.788319 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:19:00.788319 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:19:00.788319 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:19:00.788319 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 537/1078] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:19:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:19:00.788319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f87cee-26c9-4377-ba74-10af6b11a932 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:00.816042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71edf5-fe08-471d-89a6-7dabb9c0a5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:00.816699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71edf5-fe08-471d-89a6-7dabb9c0a5db None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:00.816981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71edf5-fe08-471d-89a6-7dabb9c0a5db None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:00.817254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71edf5-fe08-471d-89a6-7dabb9c0a5db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:00.824249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:00.827933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71edf5-fe08-471d-89a6-7dabb9c0a5db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:00.829400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71edf5-fe08-471d-89a6-7dabb9c0a5db None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:00.845062 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-9d71edf5-fe08-471d-89a6-7dabb9c0a5db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:19:00.845062 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:00.845062 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:19:00.845062 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:19:00.845062 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:19:00.845062 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:19:00.845062 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:19:00.845062 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:19:00.845062 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:19:00.845062 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:19:00.845062 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:19:00.845062 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:19:00.845062 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:19:00.845062 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:19:00.845062 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:19:00.845062 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:19:00.846249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:19:00.846249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:19:00.846249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:19:00.846249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:19:00.846249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:19:00.846249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:19:00.846249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:19:00.846249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:19:00.846249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:19:00.846249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:19:00.846249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:19:00.846249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:19:00.846249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:19:00.846249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:19:00.846249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:19:00.846249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:19:00.846249 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:19:00.847448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:19:00.847448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:19:00.847448 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:19:00.847448 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 542/1079] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:19:00.847448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71edf5-fe08-471d-89a6-7dabb9c0a5db None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:00.896597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f87cee-26c9-4377-ba74-10af6b11a932 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:00.930845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11499b2d-60af-4481-95ad-fe69a8fe866d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:00.931397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11499b2d-60af-4481-95ad-fe69a8fe866d None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:00.931672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11499b2d-60af-4481-95ad-fe69a8fe866d None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:00.931942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11499b2d-60af-4481-95ad-fe69a8fe866d None admin] PATH_INFO: `/v3/projects/913f340e8d0b4836a747fdb323c05769` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:00.933104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11499b2d-60af-4481-95ad-fe69a8fe866d None admin] RBAC: Authorizing `identity:get_project(project_id=913f340e8d0b4836a747fdb323c05769)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:00.934632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11499b2d-60af-4481-95ad-fe69a8fe866d None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:00.936351 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 538/1080] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:19:00 2022] GET /identity/v3/projects/913f340e8d0b4836a747fdb323c05769 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:00.936971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11499b2d-60af-4481-95ad-fe69a8fe866d None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:00.956462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71edf5-fe08-471d-89a6-7dabb9c0a5db None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:00.992578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:01.011330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343ab96-94d6-46e9-9a52-a3f9d369756d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:01.011946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343ab96-94d6-46e9-9a52-a3f9d369756d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:01.012478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343ab96-94d6-46e9-9a52-a3f9d369756d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:01.012758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343ab96-94d6-46e9-9a52-a3f9d369756d None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:01.013466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343ab96-94d6-46e9-9a52-a3f9d369756d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:01.013772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343ab96-94d6-46e9-9a52-a3f9d369756d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:01.016895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343ab96-94d6-46e9-9a52-a3f9d369756d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:01.036764 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 543/1081] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:19:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:01.037598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343ab96-94d6-46e9-9a52-a3f9d369756d None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:01.046015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11499b2d-60af-4481-95ad-fe69a8fe866d None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:01.079510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304f9d7-36fe-4eb9-af6b-987c128db04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:01.080134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304f9d7-36fe-4eb9-af6b-987c128db04d None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:01.080437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304f9d7-36fe-4eb9-af6b-987c128db04d None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:01.080703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304f9d7-36fe-4eb9-af6b-987c128db04d None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:01.081330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304f9d7-36fe-4eb9-af6b-987c128db04d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:01.081629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304f9d7-36fe-4eb9-af6b-987c128db04d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:01.082965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304f9d7-36fe-4eb9-af6b-987c128db04d None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:01.095588 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 539/1082] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:01.096414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304f9d7-36fe-4eb9-af6b-987c128db04d None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:01.152267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:01.209862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343ab96-94d6-46e9-9a52-a3f9d369756d None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:01.221164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304f9d7-36fe-4eb9-af6b-987c128db04d None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:01.242826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:01.251829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f30f4-9d9d-46cb-a0b9-0e2dab68ef86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:01.252533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f30f4-9d9d-46cb-a0b9-0e2dab68ef86 None admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:01.252819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f30f4-9d9d-46cb-a0b9-0e2dab68ef86 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:01.253093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f30f4-9d9d-46cb-a0b9-0e2dab68ef86 None admin] PATH_INFO: `/v3/projects/913f340e8d0b4836a747fdb323c05769/users/5718e1d5bbb84b228854658df524301e/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:01.255378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f30f4-9d9d-46cb-a0b9-0e2dab68ef86 None admin] RBAC: Authorizing `identity:create_grant(project_id=913f340e8d0b4836a747fdb323c05769, user_id=5718e1d5bbb84b228854658df524301e, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:01.257033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f30f4-9d9d-46cb-a0b9-0e2dab68ef86 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:01.266258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef55c6-5a72-4ad0-a81d-9be2f472ab9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:01.267006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef55c6-5a72-4ad0-a81d-9be2f472ab9a None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:01.267345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef55c6-5a72-4ad0-a81d-9be2f472ab9a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:01.267621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef55c6-5a72-4ad0-a81d-9be2f472ab9a None admin] PATH_INFO: `/v3/projects/5632b718c3aa48458247661045e99e5f/users/0e5ddcf00a184aa0ac0e7194f1c72425/roles/36d21a4033f94db3950f5e390f6e2a38` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:01.269866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef55c6-5a72-4ad0-a81d-9be2f472ab9a None admin] RBAC: Authorizing `identity:create_grant(project_id=5632b718c3aa48458247661045e99e5f, user_id=0e5ddcf00a184aa0ac0e7194f1c72425, role_id=36d21a4033f94db3950f5e390f6e2a38)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:01.271587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef55c6-5a72-4ad0-a81d-9be2f472ab9a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:01.330674 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 544/1083] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:19:01 2022] PUT /identity/v3/projects/913f340e8d0b4836a747fdb323c05769/users/5718e1d5bbb84b228854658df524301e/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:19:01.360145 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 540/1084] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:19:01 2022] PUT /identity/v3/projects/5632b718c3aa48458247661045e99e5f/users/0e5ddcf00a184aa0ac0e7194f1c72425/roles/36d21a4033f94db3950f5e390f6e2a38 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:19:03.353387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557b2ec-0369-4568-afda-a61a8e540089 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:03.353387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557b2ec-0369-4568-afda-a61a8e540089 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:03.353969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557b2ec-0369-4568-afda-a61a8e540089 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:03.355022 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 545/1085] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:03.360395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced46d1-4274-4135-a0c0-8e678d5e6957 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:03.360839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced46d1-4274-4135-a0c0-8e678d5e6957 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:03.361073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced46d1-4274-4135-a0c0-8e678d5e6957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:03.379863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0ced46d1-4274-4135-a0c0-8e678d5e6957 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:03.381088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0ced46d1-4274-4135-a0c0-8e678d5e6957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:03.449125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a14d4-099c-4c93-91e8-028368a41ae4 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:03.449405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a14d4-099c-4c93-91e8-028368a41ae4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:03.449675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a14d4-099c-4c93-91e8-028368a41ae4 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:03.452426 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 546/1086] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:03.452771 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 541/1087] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:19:03.457518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb8016-da2c-4a8e-9215-78497d4b2a10 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:03.457794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb8016-da2c-4a8e-9215-78497d4b2a10 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:03.458067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb8016-da2c-4a8e-9215-78497d4b2a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:03.476890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ebeb8016-da2c-4a8e-9215-78497d4b2a10 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:03.478923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ebeb8016-da2c-4a8e-9215-78497d4b2a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:03.556350 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 547/1088] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:19:03.728944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced46d1-4274-4135-a0c0-8e678d5e6957 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:03.826899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced46d1-4274-4135-a0c0-8e678d5e6957 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:03.829195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:03.858434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb8016-da2c-4a8e-9215-78497d4b2a10 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:03.861195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4269f87-61b5-48f1-b267-2aef2b6ce8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:03.861828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4269f87-61b5-48f1-b267-2aef2b6ce8e1 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:03.862101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4269f87-61b5-48f1-b267-2aef2b6ce8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:03.862375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4269f87-61b5-48f1-b267-2aef2b6ce8e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:03.874305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4269f87-61b5-48f1-b267-2aef2b6ce8e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:19:03.879148 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-a4269f87-61b5-48f1-b267-2aef2b6ce8e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:19:03.879148 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:03.879148 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:19:03.879148 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:19:03.879148 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:19:03.879148 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:19:03.879148 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:19:03.879148 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:19:03.879148 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:19:03.879148 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:19:03.879148 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:19:03.879148 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:19:03.879148 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:19:03.879148 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:19:03.879148 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:19:03.879148 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:19:03.880365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:19:03.880365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:19:03.880365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:19:03.880365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:19:03.880365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:19:03.880365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:19:03.880365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:19:03.880365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:19:03.880365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:19:03.880365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:19:03.880365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:19:03.880365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:19:03.880365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:19:03.880365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:19:03.880365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:19:03.880365 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:19:03.881962 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:19:03.881962 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:19:03.881962 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:19:03.881962 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:19:03.881962 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:19:03.881962 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:19:03.881962 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:19:03.881962 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:19:03.881962 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:19:03.881962 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:19:03.881962 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:19:03.881962 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:19:03.881962 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 542/1089] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:19:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:19:03.887532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4269f87-61b5-48f1-b267-2aef2b6ce8e1 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:03.902367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:03.961116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb8016-da2c-4a8e-9215-78497d4b2a10 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:03.989337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4269f87-61b5-48f1-b267-2aef2b6ce8e1 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:03.995934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225b691-9048-4c4f-b133-faf3f2c47c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:03.996598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225b691-9048-4c4f-b133-faf3f2c47c99 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:03.996880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225b691-9048-4c4f-b133-faf3f2c47c99 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:03.997151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225b691-9048-4c4f-b133-faf3f2c47c99 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:04.007221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225b691-9048-4c4f-b133-faf3f2c47c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:19:04.013161 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-9225b691-9048-4c4f-b133-faf3f2c47c99 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:19:04.013161 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:04.013161 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:19:04.013161 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:19:04.013161 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:19:04.013161 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:19:04.013161 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:19:04.013161 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:19:04.013161 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:19:04.013161 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:19:04.013161 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:19:04.013161 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:19:04.013161 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:19:04.013161 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:19:04.013161 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:19:04.013161 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:19:04.016985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:19:04.016985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:19:04.016985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:19:04.016985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:19:04.016985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:19:04.016985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:19:04.016985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:19:04.016985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:19:04.016985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:19:04.016985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:19:04.016985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:19:04.016985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:19:04.016985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:19:04.016985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:19:04.016985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:19:04.016985 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:19:04.018301 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:19:04.018301 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:19:04.018301 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:19:04.018301 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:19:04.018301 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:19:04.018301 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:19:04.018301 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:19:04.018301 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:19:04.018301 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:19:04.018301 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:19:04.018301 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 04:19:04.018301 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:19:04.018301 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 548/1090] 10.222.0.76 () {56 vars in 1120 bytes} [Sat Aug 27 04:19:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:19:04.020335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225b691-9048-4c4f-b133-faf3f2c47c99 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:04.033274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ac675-5a22-40d7-ab9f-ed5761962433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:04.033606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ac675-5a22-40d7-ab9f-ed5761962433 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:04.033862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ac675-5a22-40d7-ab9f-ed5761962433 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:04.034136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ac675-5a22-40d7-ab9f-ed5761962433 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:04.034807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ac675-5a22-40d7-ab9f-ed5761962433 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:04.035111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ac675-5a22-40d7-ab9f-ed5761962433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:04.036520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ac675-5a22-40d7-ab9f-ed5761962433 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:04.045491 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 543/1091] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:19:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:19:04.051195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ac675-5a22-40d7-ab9f-ed5761962433 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:04.080354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:04.129109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:04.132567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225b691-9048-4c4f-b133-faf3f2c47c99 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:04.155200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ac675-5a22-40d7-ab9f-ed5761962433 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:04.167055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f46e9f-3e10-413d-ad81-3ee50b42cf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:04.167653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f46e9f-3e10-413d-ad81-3ee50b42cf59 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:04.167928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f46e9f-3e10-413d-ad81-3ee50b42cf59 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:04.168224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f46e9f-3e10-413d-ad81-3ee50b42cf59 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:04.168947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f46e9f-3e10-413d-ad81-3ee50b42cf59 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:04.169480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f46e9f-3e10-413d-ad81-3ee50b42cf59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:04.171130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f46e9f-3e10-413d-ad81-3ee50b42cf59 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:04.179366 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 549/1092] 10.222.0.76 () {56 vars in 1115 bytes} [Sat Aug 27 04:19:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:19:04.185693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f46e9f-3e10-413d-ad81-3ee50b42cf59 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:04.190030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983d5f7-d779-44e4-8df5-baa54662e403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:04.190667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983d5f7-d779-44e4-8df5-baa54662e403 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:04.190944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983d5f7-d779-44e4-8df5-baa54662e403 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:04.191214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983d5f7-d779-44e4-8df5-baa54662e403 None admin] PATH_INFO: `/v3/users/5718e1d5bbb84b228854658df524301e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:04.192378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983d5f7-d779-44e4-8df5-baa54662e403 None admin] RBAC: Authorizing `identity:get_user(user_id=5718e1d5bbb84b228854658df524301e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:04.193793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983d5f7-d779-44e4-8df5-baa54662e403 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:04.195359 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 544/1093] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:19:04 2022] GET /identity/v3/users/5718e1d5bbb84b228854658df524301e => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:19:04.201147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983d5f7-d779-44e4-8df5-baa54662e403 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:04.297168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f46e9f-3e10-413d-ad81-3ee50b42cf59 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:04.313665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:04.329594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983d5f7-d779-44e4-8df5-baa54662e403 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:04.336944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afa3da-8a9e-4cea-a3b6-7c77fec255aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:04.337700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afa3da-8a9e-4cea-a3b6-7c77fec255aa None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:04.338018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afa3da-8a9e-4cea-a3b6-7c77fec255aa None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:04.338288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afa3da-8a9e-4cea-a3b6-7c77fec255aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:04.349652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afa3da-8a9e-4cea-a3b6-7c77fec255aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:04.350903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afa3da-8a9e-4cea-a3b6-7c77fec255aa None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:04.366037 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-35afa3da-8a9e-4cea-a3b6-7c77fec255aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:19:04.366037 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:04.366037 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:19:04.366037 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:19:04.366037 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:19:04.366037 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:19:04.366037 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:19:04.366037 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:19:04.366037 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:19:04.366037 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:19:04.366037 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:19:04.366037 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:19:04.366037 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:19:04.366037 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:19:04.366037 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:19:04.366037 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:19:04.367470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:19:04.367470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:19:04.367470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:19:04.367470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:19:04.367470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:19:04.367470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:19:04.367470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:19:04.367470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:19:04.367470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:19:04.367470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:19:04.367470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:19:04.367470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:19:04.367470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:19:04.367470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:19:04.367470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:19:04.367470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:19:04.367470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:19:04.369938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:19:04.369938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:19:04.369938 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:19:04.370147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db74c34-25d4-478f-9f7b-9b5a8c3a21cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:04.370532 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 550/1094] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:19:04.370630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db74c34-25d4-478f-9f7b-9b5a8c3a21cd None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:04.370630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db74c34-25d4-478f-9f7b-9b5a8c3a21cd None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:04.370630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db74c34-25d4-478f-9f7b-9b5a8c3a21cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:04.373559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afa3da-8a9e-4cea-a3b6-7c77fec255aa None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:04.389137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:04.437837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db74c34-25d4-478f-9f7b-9b5a8c3a21cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:04.439279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db74c34-25d4-478f-9f7b-9b5a8c3a21cd None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:04.471045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afa3da-8a9e-4cea-a3b6-7c77fec255aa None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:04.514640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40befcc3-f088-49b4-850b-41dad2d6e4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:04.515251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40befcc3-f088-49b4-850b-41dad2d6e4b6 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:04.519864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40befcc3-f088-49b4-850b-41dad2d6e4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:04.519864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40befcc3-f088-49b4-850b-41dad2d6e4b6 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:04.519864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40befcc3-f088-49b4-850b-41dad2d6e4b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:04.519864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40befcc3-f088-49b4-850b-41dad2d6e4b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:04.519864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40befcc3-f088-49b4-850b-41dad2d6e4b6 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:04.532866 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 551/1095] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:19:04.538311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:04.538493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40befcc3-f088-49b4-850b-41dad2d6e4b6 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:04.546604 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 545/1096] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:19:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 27 04:19:04.552570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db74c34-25d4-478f-9f7b-9b5a8c3a21cd None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:04.615748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:04.640933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40befcc3-f088-49b4-850b-41dad2d6e4b6 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:04.653240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db74c34-25d4-478f-9f7b-9b5a8c3a21cd None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:04.676618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5d812-41db-4231-a389-bd13a216ce4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:04.677239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5d812-41db-4231-a389-bd13a216ce4f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:04.677521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5d812-41db-4231-a389-bd13a216ce4f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:04.677792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5d812-41db-4231-a389-bd13a216ce4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:04.684762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5d812-41db-4231-a389-bd13a216ce4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:04.686206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5d812-41db-4231-a389-bd13a216ce4f None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:04.686647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de8c97-0338-45a7-8ccf-1bf1871e4582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:04.687267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de8c97-0338-45a7-8ccf-1bf1871e4582 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:04.687540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de8c97-0338-45a7-8ccf-1bf1871e4582 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:04.687803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de8c97-0338-45a7-8ccf-1bf1871e4582 None admin] PATH_INFO: `/v3/projects/913f340e8d0b4836a747fdb323c05769` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:04.688917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de8c97-0338-45a7-8ccf-1bf1871e4582 None admin] RBAC: Authorizing `identity:get_project(project_id=913f340e8d0b4836a747fdb323c05769)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:04.690307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de8c97-0338-45a7-8ccf-1bf1871e4582 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:04.691907 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 546/1097] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:19:04 2022] GET /identity/v3/projects/913f340e8d0b4836a747fdb323c05769 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:04.697789 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-c9b5d812-41db-4231-a389-bd13a216ce4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:19:04.697789 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:04.697789 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:19:04.697789 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:19:04.697789 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:19:04.697789 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:19:04.697789 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:19:04.697789 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:19:04.697789 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:19:04.697789 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:19:04.697789 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:19:04.697789 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:19:04.697789 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:19:04.697789 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:19:04.697789 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:19:04.697789 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:19:04.698924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:19:04.700291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:19:04.700291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:19:04.700291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:19:04.700291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:19:04.700291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:19:04.700291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:19:04.700291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:19:04.700291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:19:04.700291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 04:19:04.700291 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:19:04.700865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de8c97-0338-45a7-8ccf-1bf1871e4582 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:04.700939 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 552/1098] 10.222.0.76 () {56 vars in 1093 bytes} [Sat Aug 27 04:19:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:19:04.704356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5d812-41db-4231-a389-bd13a216ce4f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:04.765421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:04.804393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de8c97-0338-45a7-8ccf-1bf1871e4582 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:04.807126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5d812-41db-4231-a389-bd13a216ce4f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:04.838786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec0bc6-7d8b-42d2-a785-15f0a52f84b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:04.839394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec0bc6-7d8b-42d2-a785-15f0a52f84b0 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:04.839665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec0bc6-7d8b-42d2-a785-15f0a52f84b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:04.839929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec0bc6-7d8b-42d2-a785-15f0a52f84b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:04.840187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdaa57-80bc-427f-9dae-8cee74528d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:04.840665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec0bc6-7d8b-42d2-a785-15f0a52f84b0 None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=913f340e8d0b4836a747fdb323c05769, user.id=5718e1d5bbb84b228854658df524301e) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:04.840778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdaa57-80bc-427f-9dae-8cee74528d57 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:04.840966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec0bc6-7d8b-42d2-a785-15f0a52f84b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:04.841060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdaa57-80bc-427f-9dae-8cee74528d57 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:04.841309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdaa57-80bc-427f-9dae-8cee74528d57 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:04.842022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdaa57-80bc-427f-9dae-8cee74528d57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:04.842321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdaa57-80bc-427f-9dae-8cee74528d57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:04.842419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec0bc6-7d8b-42d2-a785-15f0a52f84b0 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:04.843721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdaa57-80bc-427f-9dae-8cee74528d57 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:04.845378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:04.848000 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 547/1099] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:19:04 2022] GET /identity/v3/role_assignments?user.id=5718e1d5bbb84b228854658df524301e&scope.project.id=913f340e8d0b4836a747fdb323c05769&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:19:04.863625 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 553/1100] 10.222.0.76 () {56 vars in 1133 bytes} [Sat Aug 27 04:19:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:19:04.869856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec0bc6-7d8b-42d2-a785-15f0a52f84b0 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:04.988787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec0bc6-7d8b-42d2-a785-15f0a52f84b0 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:05.015836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:05.025335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6d192-0c83-435c-a286-057d53eeff13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:05.025935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6d192-0c83-435c-a286-057d53eeff13 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:05.026214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6d192-0c83-435c-a286-057d53eeff13 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:05.026555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6d192-0c83-435c-a286-057d53eeff13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:05.093955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6d192-0c83-435c-a286-057d53eeff13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:05.095312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6d192-0c83-435c-a286-057d53eeff13 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:05.192077 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 548/1101] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:19:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 04:19:05.198492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdaa57-80bc-427f-9dae-8cee74528d57 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:05.303508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdaa57-80bc-427f-9dae-8cee74528d57 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:05.340613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f238534-d9b7-4e32-958a-dfb8ae8b6b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:05.341240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f238534-d9b7-4e32-958a-dfb8ae8b6b05 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:05.341518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f238534-d9b7-4e32-958a-dfb8ae8b6b05 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:05.341785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f238534-d9b7-4e32-958a-dfb8ae8b6b05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:05.351873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f238534-d9b7-4e32-958a-dfb8ae8b6b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:05.353362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f238534-d9b7-4e32-958a-dfb8ae8b6b05 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:05.367451 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-7f238534-d9b7-4e32-958a-dfb8ae8b6b05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:19:05.367451 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:05.367451 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:19:05.367451 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:19:05.367451 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:19:05.367451 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:19:05.367451 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:19:05.367451 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:19:05.367451 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:19:05.367451 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:19:05.367451 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:19:05.367451 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:19:05.367451 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:19:05.367451 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:19:05.367451 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:19:05.367451 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:19:05.369380 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:19:05.369380 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:19:05.369380 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:19:05.369380 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:19:05.369380 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:19:05.369380 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:19:05.369380 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:19:05.369380 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:19:05.369380 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:19:05.369380 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:19:05.369380 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:19:05.369380 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:19:05.369380 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:19:05.369380 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:19:05.369380 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:19:05.369380 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:19:05.369380 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:19:05.370616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:19:05.370616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:19:05.370616 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:19:05.370616 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 554/1102] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:19:05.375065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6d192-0c83-435c-a286-057d53eeff13 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:05.402075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:05.472920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6d192-0c83-435c-a286-057d53eeff13 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:05.519556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00b09e-609b-4dfd-bd62-6067b6cb4999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:05.520328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00b09e-609b-4dfd-bd62-6067b6cb4999 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:05.520611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00b09e-609b-4dfd-bd62-6067b6cb4999 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:05.520882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00b09e-609b-4dfd-bd62-6067b6cb4999 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:05.521521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00b09e-609b-4dfd-bd62-6067b6cb4999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:05.521822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00b09e-609b-4dfd-bd62-6067b6cb4999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:05.523180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00b09e-609b-4dfd-bd62-6067b6cb4999 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:05.534881 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 549/1103] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:05.544633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f238534-d9b7-4e32-958a-dfb8ae8b6b05 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:05.595952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:05.654203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f238534-d9b7-4e32-958a-dfb8ae8b6b05 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:05.687816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f830c9-4d00-4a78-8cb9-89a1b24a710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:05.688469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f830c9-4d00-4a78-8cb9-89a1b24a710a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:05.688751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f830c9-4d00-4a78-8cb9-89a1b24a710a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:05.689024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f830c9-4d00-4a78-8cb9-89a1b24a710a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:05.695407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f830c9-4d00-4a78-8cb9-89a1b24a710a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:05.697177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f830c9-4d00-4a78-8cb9-89a1b24a710a None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:05.708149 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-86f830c9-4d00-4a78-8cb9-89a1b24a710a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:19:05.708149 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:05.708149 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:19:05.708149 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:19:05.708149 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:19:05.708149 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:19:05.708149 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:19:05.708149 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:19:05.708149 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:19:05.708149 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:19:05.708149 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:19:05.708149 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:19:05.708149 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:19:05.708149 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:19:05.708149 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:19:05.709236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:19:05.709236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:19:05.709236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:19:05.709236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:19:05.709236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:19:05.709236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:19:05.709236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:19:05.709236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:19:05.709236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:19:05.709236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:19:05.709236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:19:05.709236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:19:05.709236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:19:05.709236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:19:05.709236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:19:05.709236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:19:05.709236 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:19:05.710356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:19:05.710356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:19:05.710356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:19:05.710356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:19:05.710356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:19:05.710356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:19:05.710356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:19:05.710356 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:19:05.710356 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 555/1104] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:19:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:19:05.715241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00b09e-609b-4dfd-bd62-6067b6cb4999 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:05.800362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:05.815691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00b09e-609b-4dfd-bd62-6067b6cb4999 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:05.848973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24327577-3037-498f-9cbf-f1cb2285f23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:05.849569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24327577-3037-498f-9cbf-f1cb2285f23c None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:05.849842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24327577-3037-498f-9cbf-f1cb2285f23c None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:05.850109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24327577-3037-498f-9cbf-f1cb2285f23c None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:05.850784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24327577-3037-498f-9cbf-f1cb2285f23c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:05.851082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24327577-3037-498f-9cbf-f1cb2285f23c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:05.853059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24327577-3037-498f-9cbf-f1cb2285f23c None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:05.864502 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 550/1105] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:19:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:05.871389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f830c9-4d00-4a78-8cb9-89a1b24a710a None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:05.973844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f830c9-4d00-4a78-8cb9-89a1b24a710a None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:05.976274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:06.008998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147749e-e2cf-4a91-8a5b-316cf4766ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:06.009615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147749e-e2cf-4a91-8a5b-316cf4766ae1 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:06.009897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147749e-e2cf-4a91-8a5b-316cf4766ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:06.010173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147749e-e2cf-4a91-8a5b-316cf4766ae1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:06.011171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147749e-e2cf-4a91-8a5b-316cf4766ae1 None admin] RBAC: Adding query filter params (role.id=36d21a4033f94db3950f5e390f6e2a38, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=0e5ddcf00a184aa0ac0e7194f1c72425) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:06.011480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147749e-e2cf-4a91-8a5b-316cf4766ae1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:06.012942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147749e-e2cf-4a91-8a5b-316cf4766ae1 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:06.019081 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 556/1106] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:19:05 2022] GET /identity/v3/role_assignments?user.id=0e5ddcf00a184aa0ac0e7194f1c72425&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=36d21a4033f94db3950f5e390f6e2a38 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:07.109280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca920b-98e7-4095-9d76-e09e8893c506 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:07.113496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca920b-98e7-4095-9d76-e09e8893c506 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:07.113496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca920b-98e7-4095-9d76-e09e8893c506 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:07.113496 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 551/1107] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:07.118447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced9c12-14f5-46a2-b58f-67e4a12befe6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:07.118915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced9c12-14f5-46a2-b58f-67e4a12befe6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:07.119083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced9c12-14f5-46a2-b58f-67e4a12befe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:07.142573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-eced9c12-14f5-46a2-b58f-67e4a12befe6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:07.144397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-eced9c12-14f5-46a2-b58f-67e4a12befe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:07.220492 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 557/1108] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:19:07.500193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca920b-98e7-4095-9d76-e09e8893c506 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:07.606166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca920b-98e7-4095-9d76-e09e8893c506 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:07.639176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c46b48-9f6e-456d-a594-065469179169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:07.639789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c46b48-9f6e-456d-a594-065469179169 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:07.640062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c46b48-9f6e-456d-a594-065469179169 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:07.640361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c46b48-9f6e-456d-a594-065469179169 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:07.641459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c46b48-9f6e-456d-a594-065469179169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:07.642862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c46b48-9f6e-456d-a594-065469179169 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:07.644424 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 552/1109] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:19:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:07.650853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced9c12-14f5-46a2-b58f-67e4a12befe6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:07.743996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:07.747802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced9c12-14f5-46a2-b58f-67e4a12befe6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:07.782588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a3bb2-de2c-4cdb-a7bc-e75a281d255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:07.783108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a3bb2-de2c-4cdb-a7bc-e75a281d255d None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:07.783389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a3bb2-de2c-4cdb-a7bc-e75a281d255d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:07.783665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a3bb2-de2c-4cdb-a7bc-e75a281d255d None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:07.784356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a3bb2-de2c-4cdb-a7bc-e75a281d255d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:07.785796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a3bb2-de2c-4cdb-a7bc-e75a281d255d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:07.866722 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 558/1110] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:19:07 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:19:09.910062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc00929-6bd5-42a5-bf61-5d9ec3e26189 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:09.910715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc00929-6bd5-42a5-bf61-5d9ec3e26189 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:09.911036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc00929-6bd5-42a5-bf61-5d9ec3e26189 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:09.913547 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 553/1111] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:09.919501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbda79-26b7-4757-897c-5b759089acd2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:09.919943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbda79-26b7-4757-897c-5b759089acd2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:09.920050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbda79-26b7-4757-897c-5b759089acd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:09.937721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3bdbda79-26b7-4757-897c-5b759089acd2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:09.938906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3bdbda79-26b7-4757-897c-5b759089acd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:10.006094 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 559/1112] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:19:10.278839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc00929-6bd5-42a5-bf61-5d9ec3e26189 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:10.294846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:10.379514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc00929-6bd5-42a5-bf61-5d9ec3e26189 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:10.413178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899e14e-326d-4067-b269-daaac1642221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:10.413812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e14e-326d-4067-b269-daaac1642221 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:10.414092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e14e-326d-4067-b269-daaac1642221 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:10.414898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e14e-326d-4067-b269-daaac1642221 None admin] PATH_INFO: `/v3/roles/d78f86d36ded425d9148c0b5781ab7b2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:10.416883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899e14e-326d-4067-b269-daaac1642221 None admin] RBAC: Authorizing `identity:get_role(role_id=d78f86d36ded425d9148c0b5781ab7b2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:10.418247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899e14e-326d-4067-b269-daaac1642221 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:10.419577 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 554/1113] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:19:10 2022] GET /identity/v3/roles/d78f86d36ded425d9148c0b5781ab7b2 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:10.425458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbda79-26b7-4757-897c-5b759089acd2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:10.507657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:10.523366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbda79-26b7-4757-897c-5b759089acd2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:10.558941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabb756-153a-4785-9c01-0bbb3a62c653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:10.559493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabb756-153a-4785-9c01-0bbb3a62c653 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:10.559773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabb756-153a-4785-9c01-0bbb3a62c653 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:10.560045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabb756-153a-4785-9c01-0bbb3a62c653 None admin] PATH_INFO: `/v3/users/9e25afb26b8d447bad7b7fbd8ffd4a59` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:10.573543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabb756-153a-4785-9c01-0bbb3a62c653 None admin] RBAC: Authorizing `identity:get_user(user_id=9e25afb26b8d447bad7b7fbd8ffd4a59)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:10.574982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabb756-153a-4785-9c01-0bbb3a62c653 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:10.576621 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 560/1114] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:19:10 2022] GET /identity/v3/users/9e25afb26b8d447bad7b7fbd8ffd4a59 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:10.582614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899e14e-326d-4067-b269-daaac1642221 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:10.673758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:10.691214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899e14e-326d-4067-b269-daaac1642221 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:10.724531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a30bd-f48f-460a-943e-b59b4a0c7ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:10.725127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a30bd-f48f-460a-943e-b59b4a0c7ed9 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:10.725399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a30bd-f48f-460a-943e-b59b4a0c7ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:10.725665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a30bd-f48f-460a-943e-b59b4a0c7ed9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:10.791133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a30bd-f48f-460a-943e-b59b4a0c7ed9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:10.792584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a30bd-f48f-460a-943e-b59b4a0c7ed9 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:10.869491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:10.887552 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 555/1115] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:19:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 04:19:10.893522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabb756-153a-4785-9c01-0bbb3a62c653 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:10.990774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabb756-153a-4785-9c01-0bbb3a62c653 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:11.029568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe235513-70ed-4ef8-96e7-28ca58d064f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:11.030214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235513-70ed-4ef8-96e7-28ca58d064f9 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:11.030499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235513-70ed-4ef8-96e7-28ca58d064f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:11.030780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235513-70ed-4ef8-96e7-28ca58d064f9 None admin] PATH_INFO: `/v3/projects/913f340e8d0b4836a747fdb323c05769` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:11.031932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe235513-70ed-4ef8-96e7-28ca58d064f9 None admin] RBAC: Authorizing `identity:get_project(project_id=913f340e8d0b4836a747fdb323c05769)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:11.033493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe235513-70ed-4ef8-96e7-28ca58d064f9 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:11.035186 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 561/1116] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:19:10 2022] GET /identity/v3/projects/913f340e8d0b4836a747fdb323c05769 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:11.041445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a30bd-f48f-460a-943e-b59b4a0c7ed9 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:11.138989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a30bd-f48f-460a-943e-b59b4a0c7ed9 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:11.172338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dfa03-6246-4167-a83c-bebb328c8742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:11.172984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dfa03-6246-4167-a83c-bebb328c8742 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:11.173256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dfa03-6246-4167-a83c-bebb328c8742 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:11.173600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dfa03-6246-4167-a83c-bebb328c8742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:11.174424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3dfa03-6246-4167-a83c-bebb328c8742 None admin] RBAC: Adding query filter params (role.id=d78f86d36ded425d9148c0b5781ab7b2, scope.project.id=913f340e8d0b4836a747fdb323c05769, user.id=9e25afb26b8d447bad7b7fbd8ffd4a59) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:11.174729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3dfa03-6246-4167-a83c-bebb328c8742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:11.176127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3dfa03-6246-4167-a83c-bebb328c8742 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:11.181463 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 556/1117] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:19:11 2022] GET /identity/v3/role_assignments?user.id=9e25afb26b8d447bad7b7fbd8ffd4a59&scope.project.id=913f340e8d0b4836a747fdb323c05769&role.id=d78f86d36ded425d9148c0b5781ab7b2 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:19:13.068090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e450e27-899e-4589-83ee-717ef19e9609 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:13.068664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e450e27-899e-4589-83ee-717ef19e9609 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:13.068664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e450e27-899e-4589-83ee-717ef19e9609 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:13.070035 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 562/1118] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:13.076294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03082e3-2523-4897-aa43-5d2c5ba208ee None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:13.076787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03082e3-2523-4897-aa43-5d2c5ba208ee None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:13.076889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03082e3-2523-4897-aa43-5d2c5ba208ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:13.094823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e03082e3-2523-4897-aa43-5d2c5ba208ee None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:13.096028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e03082e3-2523-4897-aa43-5d2c5ba208ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:13.139648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:13.164829 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 557/1119] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:19:13.438092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e450e27-899e-4589-83ee-717ef19e9609 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:13.450913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:13.543605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e450e27-899e-4589-83ee-717ef19e9609 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:13.576379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80894a5a-f454-4c58-aeb9-11e82c0fea25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:13.576995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80894a5a-f454-4c58-aeb9-11e82c0fea25 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:13.577275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80894a5a-f454-4c58-aeb9-11e82c0fea25 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:13.577549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80894a5a-f454-4c58-aeb9-11e82c0fea25 None admin] PATH_INFO: `/v3/roles/d78f86d36ded425d9148c0b5781ab7b2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:13.578914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80894a5a-f454-4c58-aeb9-11e82c0fea25 None admin] RBAC: Authorizing `identity:get_role(role_id=d78f86d36ded425d9148c0b5781ab7b2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:13.580447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80894a5a-f454-4c58-aeb9-11e82c0fea25 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:13.581761 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 563/1120] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:19:13 2022] GET /identity/v3/roles/d78f86d36ded425d9148c0b5781ab7b2 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:13.588341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03082e3-2523-4897-aa43-5d2c5ba208ee None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:13.692277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03082e3-2523-4897-aa43-5d2c5ba208ee None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:13.725383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b9102-9d2f-4829-b0f1-2181ab7b4b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:13.725996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b9102-9d2f-4829-b0f1-2181ab7b4b58 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:13.726269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b9102-9d2f-4829-b0f1-2181ab7b4b58 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:13.726537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b9102-9d2f-4829-b0f1-2181ab7b4b58 None admin] PATH_INFO: `/v3/users/9e25afb26b8d447bad7b7fbd8ffd4a59` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:13.728419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b9102-9d2f-4829-b0f1-2181ab7b4b58 None admin] RBAC: Authorizing `identity:get_user(user_id=9e25afb26b8d447bad7b7fbd8ffd4a59)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:13.729826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b9102-9d2f-4829-b0f1-2181ab7b4b58 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:13.731413 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 558/1121] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:19:13 2022] GET /identity/v3/users/9e25afb26b8d447bad7b7fbd8ffd4a59 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:13.737286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80894a5a-f454-4c58-aeb9-11e82c0fea25 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:13.814967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:13.835620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80894a5a-f454-4c58-aeb9-11e82c0fea25 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:13.870490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ee72a-84e7-4a52-a11d-3f81e87728c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:13.871103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ee72a-84e7-4a52-a11d-3f81e87728c6 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:13.871384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ee72a-84e7-4a52-a11d-3f81e87728c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:13.871657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ee72a-84e7-4a52-a11d-3f81e87728c6 None admin] PATH_INFO: `/v3/projects/913f340e8d0b4836a747fdb323c05769` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:13.872768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ee72a-84e7-4a52-a11d-3f81e87728c6 None admin] RBAC: Authorizing `identity:get_project(project_id=913f340e8d0b4836a747fdb323c05769)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:13.874196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ee72a-84e7-4a52-a11d-3f81e87728c6 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:13.875803 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 564/1122] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:19:13 2022] GET /identity/v3/projects/913f340e8d0b4836a747fdb323c05769 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:13.881806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b9102-9d2f-4829-b0f1-2181ab7b4b58 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:13.927224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:13.981204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b9102-9d2f-4829-b0f1-2181ab7b4b58 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:14.020990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab2603-98c8-4a44-a3e4-256b823183ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:14.021641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab2603-98c8-4a44-a3e4-256b823183ae None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:14.021925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab2603-98c8-4a44-a3e4-256b823183ae None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:14.022199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab2603-98c8-4a44-a3e4-256b823183ae None admin] PATH_INFO: `/v3/projects/913f340e8d0b4836a747fdb323c05769/users/9e25afb26b8d447bad7b7fbd8ffd4a59/roles/d78f86d36ded425d9148c0b5781ab7b2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:14.024397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab2603-98c8-4a44-a3e4-256b823183ae None admin] RBAC: Authorizing `identity:create_grant(project_id=913f340e8d0b4836a747fdb323c05769, user_id=9e25afb26b8d447bad7b7fbd8ffd4a59, role_id=d78f86d36ded425d9148c0b5781ab7b2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:14.025834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab2603-98c8-4a44-a3e4-256b823183ae None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:14.106905 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 559/1123] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:19:13 2022] PUT /identity/v3/projects/913f340e8d0b4836a747fdb323c05769/users/9e25afb26b8d447bad7b7fbd8ffd4a59/roles/d78f86d36ded425d9148c0b5781ab7b2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:19:16.026788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769964a-a979-4239-a545-984fc833c629 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:16.027312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769964a-a979-4239-a545-984fc833c629 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:16.027312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769964a-a979-4239-a545-984fc833c629 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:16.028702 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 565/1124] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:16.034030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d8c04-1952-47e9-9557-1270048a5c4b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:16.034397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d8c04-1952-47e9-9557-1270048a5c4b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:16.034585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d8c04-1952-47e9-9557-1270048a5c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:16.053047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-909d8c04-1952-47e9-9557-1270048a5c4b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:16.054236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-909d8c04-1952-47e9-9557-1270048a5c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:16.119298 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 560/1125] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:19:16.400546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769964a-a979-4239-a545-984fc833c629 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:16.497291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769964a-a979-4239-a545-984fc833c629 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:16.538615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b041e8-8f49-45b3-af35-22d684837f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:16.539282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b041e8-8f49-45b3-af35-22d684837f6a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:16.539564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b041e8-8f49-45b3-af35-22d684837f6a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:16.539842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b041e8-8f49-45b3-af35-22d684837f6a None admin] PATH_INFO: `/v3/roles/d78f86d36ded425d9148c0b5781ab7b2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:16.542888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b041e8-8f49-45b3-af35-22d684837f6a None admin] RBAC: Authorizing `identity:get_role(role_id=d78f86d36ded425d9148c0b5781ab7b2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:16.544293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b041e8-8f49-45b3-af35-22d684837f6a None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:16.545638 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 566/1126] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:19:16 2022] GET /identity/v3/roles/d78f86d36ded425d9148c0b5781ab7b2 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:16.552062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d8c04-1952-47e9-9557-1270048a5c4b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:16.586466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:16.649346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d8c04-1952-47e9-9557-1270048a5c4b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:16.681666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de75c3-875e-48df-bdf1-fff48ccbd282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:16.682220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de75c3-875e-48df-bdf1-fff48ccbd282 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:16.682492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de75c3-875e-48df-bdf1-fff48ccbd282 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:16.682756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de75c3-875e-48df-bdf1-fff48ccbd282 None admin] PATH_INFO: `/v3/users/9e25afb26b8d447bad7b7fbd8ffd4a59` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:16.683844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de75c3-875e-48df-bdf1-fff48ccbd282 None admin] RBAC: Authorizing `identity:get_user(user_id=9e25afb26b8d447bad7b7fbd8ffd4a59)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:16.685284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de75c3-875e-48df-bdf1-fff48ccbd282 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:16.686821 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 561/1127] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:19:16 2022] GET /identity/v3/users/9e25afb26b8d447bad7b7fbd8ffd4a59 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:16.692696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b041e8-8f49-45b3-af35-22d684837f6a None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:16.708687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:16.791181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b041e8-8f49-45b3-af35-22d684837f6a None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:16.824423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b93373-2d08-4aee-b786-c429cb4944e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:16.825014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b93373-2d08-4aee-b786-c429cb4944e7 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:16.825304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b93373-2d08-4aee-b786-c429cb4944e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:16.825561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b93373-2d08-4aee-b786-c429cb4944e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:16.909633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b93373-2d08-4aee-b786-c429cb4944e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:16.911091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b93373-2d08-4aee-b786-c429cb4944e7 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:16.932436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:17.019200 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 567/1128] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:19:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 04:19:17.025375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de75c3-875e-48df-bdf1-fff48ccbd282 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:17.124706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de75c3-875e-48df-bdf1-fff48ccbd282 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:17.126173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:17.158981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ed99c-b3db-49ee-85ed-e542d97a7051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:17.159600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ed99c-b3db-49ee-85ed-e542d97a7051 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:17.159879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ed99c-b3db-49ee-85ed-e542d97a7051 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:17.160153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ed99c-b3db-49ee-85ed-e542d97a7051 None admin] PATH_INFO: `/v3/projects/913f340e8d0b4836a747fdb323c05769` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:17.161291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ed99c-b3db-49ee-85ed-e542d97a7051 None admin] RBAC: Authorizing `identity:get_project(project_id=913f340e8d0b4836a747fdb323c05769)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:17.162715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ed99c-b3db-49ee-85ed-e542d97a7051 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:17.165421 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 562/1129] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:19:17 2022] GET /identity/v3/projects/913f340e8d0b4836a747fdb323c05769 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:17.171488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b93373-2d08-4aee-b786-c429cb4944e7 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:17.274285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b93373-2d08-4aee-b786-c429cb4944e7 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:17.292952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:17.313899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac3dfc-584c-4d6c-99a2-e28d8a1cf633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:17.314565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac3dfc-584c-4d6c-99a2-e28d8a1cf633 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:17.314847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac3dfc-584c-4d6c-99a2-e28d8a1cf633 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:17.315121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac3dfc-584c-4d6c-99a2-e28d8a1cf633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:17.315849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac3dfc-584c-4d6c-99a2-e28d8a1cf633 None admin] RBAC: Adding query filter params (role.id=d78f86d36ded425d9148c0b5781ab7b2, scope.project.id=913f340e8d0b4836a747fdb323c05769, user.id=9e25afb26b8d447bad7b7fbd8ffd4a59) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:17.316155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac3dfc-584c-4d6c-99a2-e28d8a1cf633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:17.317650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac3dfc-584c-4d6c-99a2-e28d8a1cf633 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:17.324504 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 568/1130] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:19:17 2022] GET /identity/v3/role_assignments?user.id=9e25afb26b8d447bad7b7fbd8ffd4a59&scope.project.id=913f340e8d0b4836a747fdb323c05769&role.id=d78f86d36ded425d9148c0b5781ab7b2 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:19.237187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86733522-1563-4807-be8c-f1502175621a None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:19.237703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86733522-1563-4807-be8c-f1502175621a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:19.237703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86733522-1563-4807-be8c-f1502175621a None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:19.238950 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 563/1131] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:19.244705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1cd23-1b77-4b4b-932f-1f0eee3dd35e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:19.245123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1cd23-1b77-4b4b-932f-1f0eee3dd35e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:19.245240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1cd23-1b77-4b4b-932f-1f0eee3dd35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:19.264004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-60f1cd23-1b77-4b4b-932f-1f0eee3dd35e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:19.265228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-60f1cd23-1b77-4b4b-932f-1f0eee3dd35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:19.330830 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 569/1132] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:19:19.598067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86733522-1563-4807-be8c-f1502175621a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:19.701148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86733522-1563-4807-be8c-f1502175621a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:19.734403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb43c8-5305-4134-8913-1c33efabe3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:19.735020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb43c8-5305-4134-8913-1c33efabe3b7 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:19.735298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb43c8-5305-4134-8913-1c33efabe3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:19.735570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb43c8-5305-4134-8913-1c33efabe3b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:19.736694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb43c8-5305-4134-8913-1c33efabe3b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:19.738107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb43c8-5305-4134-8913-1c33efabe3b7 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:19.739672 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 564/1133] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:19:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:19.746144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1cd23-1b77-4b4b-932f-1f0eee3dd35e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:19.842498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1cd23-1b77-4b4b-932f-1f0eee3dd35e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:19.851450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:19.875555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded166e-7561-4e9f-96c8-27837c262cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:19.876143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded166e-7561-4e9f-96c8-27837c262cce None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:19.876452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded166e-7561-4e9f-96c8-27837c262cce None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:19.876721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded166e-7561-4e9f-96c8-27837c262cce None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:19.877367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded166e-7561-4e9f-96c8-27837c262cce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:19.878783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded166e-7561-4e9f-96c8-27837c262cce None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:19.958811 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 570/1134] 10.222.0.76 () {60 vars in 1141 bytes} [Sat Aug 27 04:19:19 2022] POST /identity/v3/projects => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:19:22.022478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845d8a1-aac5-49c6-b139-3be033f690cb None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:22.023003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845d8a1-aac5-49c6-b139-3be033f690cb None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:22.023599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845d8a1-aac5-49c6-b139-3be033f690cb None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:22.025118 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 565/1135] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:22.030280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec84ad-5008-4afa-bd58-014ed9536f36 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:22.030717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec84ad-5008-4afa-bd58-014ed9536f36 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:22.030826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec84ad-5008-4afa-bd58-014ed9536f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:22.048984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-94ec84ad-5008-4afa-bd58-014ed9536f36 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:22.050172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-94ec84ad-5008-4afa-bd58-014ed9536f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:22.115245 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 571/1136] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:19:22.386046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845d8a1-aac5-49c6-b139-3be033f690cb None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:22.425561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:22.483405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845d8a1-aac5-49c6-b139-3be033f690cb None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:22.516479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21461568-bd1d-4091-bc1e-85ede82af954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:22.517101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461568-bd1d-4091-bc1e-85ede82af954 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:22.517377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461568-bd1d-4091-bc1e-85ede82af954 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:22.517648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461568-bd1d-4091-bc1e-85ede82af954 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:22.518754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21461568-bd1d-4091-bc1e-85ede82af954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:22.520263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21461568-bd1d-4091-bc1e-85ede82af954 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:22.521751 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 566/1137] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:19:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:22.528060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec84ad-5008-4afa-bd58-014ed9536f36 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:22.623225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:22.633574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec84ad-5008-4afa-bd58-014ed9536f36 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:22.670149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced682b-c515-4c8e-a027-8359403f5464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:22.670675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced682b-c515-4c8e-a027-8359403f5464 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:22.670949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced682b-c515-4c8e-a027-8359403f5464 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:22.671219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced682b-c515-4c8e-a027-8359403f5464 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:22.671871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced682b-c515-4c8e-a027-8359403f5464 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:22.673341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced682b-c515-4c8e-a027-8359403f5464 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:22.803512 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 572/1138] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:19:22 2022] POST /identity/v3/users => generated 286 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:19:24.774810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f8d2b-9756-4816-8911-b2e6a0a770c6 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:24.775345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f8d2b-9756-4816-8911-b2e6a0a770c6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:24.775345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f8d2b-9756-4816-8911-b2e6a0a770c6 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:24.776740 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 567/1139] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:24.782332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c6f90-14ad-4a38-82fa-dac2a625d672 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:24.782848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c6f90-14ad-4a38-82fa-dac2a625d672 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:24.782969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c6f90-14ad-4a38-82fa-dac2a625d672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:24.801965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-081c6f90-14ad-4a38-82fa-dac2a625d672 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:24.803167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-081c6f90-14ad-4a38-82fa-dac2a625d672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:24.870037 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 573/1140] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:19:25.142268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f8d2b-9756-4816-8911-b2e6a0a770c6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:25.240991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f8d2b-9756-4816-8911-b2e6a0a770c6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:25.248575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:25.273928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437160eb-999c-4617-9823-66de9a2abbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:25.274528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437160eb-999c-4617-9823-66de9a2abbe4 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:25.274800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437160eb-999c-4617-9823-66de9a2abbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:25.275067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437160eb-999c-4617-9823-66de9a2abbe4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:25.284796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437160eb-999c-4617-9823-66de9a2abbe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:19:25.290523 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-437160eb-999c-4617-9823-66de9a2abbe4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:19:25.290523 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:25.290523 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:19:25.290523 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:19:25.290523 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:19:25.290523 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:19:25.290523 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:19:25.290523 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:19:25.290523 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:19:25.290523 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:19:25.290523 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:19:25.290523 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:19:25.290523 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:19:25.290523 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:19:25.290523 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:19:25.290523 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:19:25.291693 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:19:25.291693 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:19:25.291693 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:19:25.291693 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:19:25.291693 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:19:25.291693 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:19:25.291693 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:19:25.291693 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:19:25.291693 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:19:25.291693 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:19:25.291693 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:19:25.291693 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:19:25.291693 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:19:25.291693 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:19:25.291693 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:19:25.291693 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:19:25.292833 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:19:25.292833 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:19:25.292833 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:19:25.292833 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:19:25.292833 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:19:25.292833 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:19:25.292833 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:19:25.292833 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:19:25.292833 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:19:25.292833 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:19:25.292833 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:19:25.292833 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:19:25.292833 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 568/1141] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:19:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:19:25.297794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c6f90-14ad-4a38-82fa-dac2a625d672 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:25.385730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:25.417796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c6f90-14ad-4a38-82fa-dac2a625d672 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:25.451436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d600629-3cae-43dc-966a-351fb55fc4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:25.452031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d600629-3cae-43dc-966a-351fb55fc4e6 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:25.452339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d600629-3cae-43dc-966a-351fb55fc4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:25.452609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d600629-3cae-43dc-966a-351fb55fc4e6 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:25.453265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d600629-3cae-43dc-966a-351fb55fc4e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:25.453569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d600629-3cae-43dc-966a-351fb55fc4e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:25.454968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d600629-3cae-43dc-966a-351fb55fc4e6 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:25.463491 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 574/1142] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:19:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:25.469337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437160eb-999c-4617-9823-66de9a2abbe4 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:25.568088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437160eb-999c-4617-9823-66de9a2abbe4 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:25.600906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c81c2-4fcc-4f37-a209-8c7a7bf1bc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:25.602084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c81c2-4fcc-4f37-a209-8c7a7bf1bc89 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:25.602362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c81c2-4fcc-4f37-a209-8c7a7bf1bc89 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:25.602631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c81c2-4fcc-4f37-a209-8c7a7bf1bc89 None admin] PATH_INFO: `/v3/users/7c7878ad7dbe4fd195ecdfd31e41a1ae` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:25.615360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c81c2-4fcc-4f37-a209-8c7a7bf1bc89 None admin] RBAC: Authorizing `identity:get_user(user_id=7c7878ad7dbe4fd195ecdfd31e41a1ae)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:25.616856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c81c2-4fcc-4f37-a209-8c7a7bf1bc89 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:25.625123 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 569/1143] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:19:25 2022] GET /identity/v3/users/7c7878ad7dbe4fd195ecdfd31e41a1ae => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:25.625262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d600629-3cae-43dc-966a-351fb55fc4e6 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:25.727516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d600629-3cae-43dc-966a-351fb55fc4e6 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:25.768098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72dcd3-c2a6-42ef-82ea-53758c6bc056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:25.768906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72dcd3-c2a6-42ef-82ea-53758c6bc056 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:25.769186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72dcd3-c2a6-42ef-82ea-53758c6bc056 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:25.769457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72dcd3-c2a6-42ef-82ea-53758c6bc056 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:25.778503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:25.835782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72dcd3-c2a6-42ef-82ea-53758c6bc056 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:25.837980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72dcd3-c2a6-42ef-82ea-53758c6bc056 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:25.933187 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 575/1144] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:19:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 04:19:25.939148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c81c2-4fcc-4f37-a209-8c7a7bf1bc89 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:25.964849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:26.040886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c81c2-4fcc-4f37-a209-8c7a7bf1bc89 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:26.079462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3522ba7-4d71-4515-9b07-697efe2c1771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:26.080088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3522ba7-4d71-4515-9b07-697efe2c1771 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:26.080397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3522ba7-4d71-4515-9b07-697efe2c1771 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:26.080671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3522ba7-4d71-4515-9b07-697efe2c1771 None admin] PATH_INFO: `/v3/projects/717b1e5a663a418ca23b3238308a2d2d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:26.081778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3522ba7-4d71-4515-9b07-697efe2c1771 None admin] RBAC: Authorizing `identity:get_project(project_id=717b1e5a663a418ca23b3238308a2d2d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:26.083190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3522ba7-4d71-4515-9b07-697efe2c1771 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:26.084837 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 570/1145] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:19:25 2022] GET /identity/v3/projects/717b1e5a663a418ca23b3238308a2d2d => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:26.091647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72dcd3-c2a6-42ef-82ea-53758c6bc056 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:26.129975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:26.189212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72dcd3-c2a6-42ef-82ea-53758c6bc056 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:26.222763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55eb54d-5667-423a-940b-4314a2f8f405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:26.223355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eb54d-5667-423a-940b-4314a2f8f405 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:26.223634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eb54d-5667-423a-940b-4314a2f8f405 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:26.223904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eb54d-5667-423a-940b-4314a2f8f405 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:26.224655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55eb54d-5667-423a-940b-4314a2f8f405 None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=717b1e5a663a418ca23b3238308a2d2d, user.id=7c7878ad7dbe4fd195ecdfd31e41a1ae) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:26.224963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55eb54d-5667-423a-940b-4314a2f8f405 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:26.226386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55eb54d-5667-423a-940b-4314a2f8f405 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:26.231812 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 576/1146] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:19:26 2022] GET /identity/v3/role_assignments?user.id=7c7878ad7dbe4fd195ecdfd31e41a1ae&scope.project.id=717b1e5a663a418ca23b3238308a2d2d&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:28.094523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f28fe6-1e3c-48a5-92ec-23fbc6bc798e None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:28.095054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f28fe6-1e3c-48a5-92ec-23fbc6bc798e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:28.095054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f28fe6-1e3c-48a5-92ec-23fbc6bc798e None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:28.096412 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 571/1147] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:28.101515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088729e8-1d1b-4be2-ac52-652b791ef5c2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:28.102447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088729e8-1d1b-4be2-ac52-652b791ef5c2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:28.102682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088729e8-1d1b-4be2-ac52-652b791ef5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:28.120361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-088729e8-1d1b-4be2-ac52-652b791ef5c2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:28.121538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-088729e8-1d1b-4be2-ac52-652b791ef5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:28.187270 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 577/1148] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:19:28.457404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f28fe6-1e3c-48a5-92ec-23fbc6bc798e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:28.546884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:28.556049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f28fe6-1e3c-48a5-92ec-23fbc6bc798e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:28.589146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8409d-97cb-4cff-bc9c-fa2174d29471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:28.589750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8409d-97cb-4cff-bc9c-fa2174d29471 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:28.590023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8409d-97cb-4cff-bc9c-fa2174d29471 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:28.590291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8409d-97cb-4cff-bc9c-fa2174d29471 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:28.599893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8409d-97cb-4cff-bc9c-fa2174d29471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:19:28.605303 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-74b8409d-97cb-4cff-bc9c-fa2174d29471 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:19:28.605303 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:28.605303 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:19:28.605303 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:19:28.605303 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:19:28.605303 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:19:28.605303 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:19:28.605303 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:19:28.605303 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:19:28.605303 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:19:28.605303 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:19:28.605303 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:19:28.605303 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:19:28.605303 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:19:28.605303 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:19:28.605303 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:19:28.606472 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:19:28.606472 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:19:28.606472 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:19:28.606472 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:19:28.606472 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:19:28.606472 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:19:28.606472 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:19:28.606472 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:19:28.606472 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:19:28.606472 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:19:28.606472 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:19:28.606472 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:19:28.606472 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:19:28.606472 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:19:28.606472 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:19:28.606472 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:19:28.607723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:19:28.607723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:19:28.607723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:19:28.607723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:19:28.607723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:19:28.607723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:19:28.607723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:19:28.607723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:19:28.607723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:19:28.607723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:19:28.607723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:19:28.607723 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:19:28.607723 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 572/1149] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:19:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:19:28.612364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088729e8-1d1b-4be2-ac52-652b791ef5c2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:28.641917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:28.708228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088729e8-1d1b-4be2-ac52-652b791ef5c2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:28.741407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1195e2-1da1-4134-b4f6-9948d39ec0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:28.742021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1195e2-1da1-4134-b4f6-9948d39ec0f6 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:28.742315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1195e2-1da1-4134-b4f6-9948d39ec0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:28.742592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1195e2-1da1-4134-b4f6-9948d39ec0f6 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:28.743250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1195e2-1da1-4134-b4f6-9948d39ec0f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:28.743553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1195e2-1da1-4134-b4f6-9948d39ec0f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:28.744942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1195e2-1da1-4134-b4f6-9948d39ec0f6 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:28.752736 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 578/1150] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:19:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:28.758562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8409d-97cb-4cff-bc9c-fa2174d29471 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:28.855921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8409d-97cb-4cff-bc9c-fa2174d29471 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:28.887717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228f5fc-5cdb-48fb-a7ae-df80f846a1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:28.888351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228f5fc-5cdb-48fb-a7ae-df80f846a1b9 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:28.888629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228f5fc-5cdb-48fb-a7ae-df80f846a1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:28.888899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228f5fc-5cdb-48fb-a7ae-df80f846a1b9 None admin] PATH_INFO: `/v3/users/7c7878ad7dbe4fd195ecdfd31e41a1ae` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:28.890008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228f5fc-5cdb-48fb-a7ae-df80f846a1b9 None admin] RBAC: Authorizing `identity:get_user(user_id=7c7878ad7dbe4fd195ecdfd31e41a1ae)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:28.891422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228f5fc-5cdb-48fb-a7ae-df80f846a1b9 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:28.892980 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 573/1151] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:19:28 2022] GET /identity/v3/users/7c7878ad7dbe4fd195ecdfd31e41a1ae => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:28.899191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1195e2-1da1-4134-b4f6-9948d39ec0f6 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:28.989895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:28.996330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1195e2-1da1-4134-b4f6-9948d39ec0f6 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:29.029408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47802bb0-7611-433a-90a9-94b4bee20c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:29.030026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47802bb0-7611-433a-90a9-94b4bee20c16 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:29.030303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47802bb0-7611-433a-90a9-94b4bee20c16 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:29.030599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47802bb0-7611-433a-90a9-94b4bee20c16 None admin] PATH_INFO: `/v3/projects/717b1e5a663a418ca23b3238308a2d2d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:29.031810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47802bb0-7611-433a-90a9-94b4bee20c16 None admin] RBAC: Authorizing `identity:get_project(project_id=717b1e5a663a418ca23b3238308a2d2d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:29.033631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47802bb0-7611-433a-90a9-94b4bee20c16 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:29.035620 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 579/1152] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:19:28 2022] GET /identity/v3/projects/717b1e5a663a418ca23b3238308a2d2d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:29.041855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228f5fc-5cdb-48fb-a7ae-df80f846a1b9 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:29.063677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:29.140336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228f5fc-5cdb-48fb-a7ae-df80f846a1b9 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:29.173714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58654e-3707-4a0b-815d-eec9ab1dac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:29.174358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58654e-3707-4a0b-815d-eec9ab1dac23 None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:29.174638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58654e-3707-4a0b-815d-eec9ab1dac23 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:29.174911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58654e-3707-4a0b-815d-eec9ab1dac23 None admin] PATH_INFO: `/v3/projects/717b1e5a663a418ca23b3238308a2d2d/users/7c7878ad7dbe4fd195ecdfd31e41a1ae/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:29.176811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58654e-3707-4a0b-815d-eec9ab1dac23 None admin] RBAC: Authorizing `identity:create_grant(project_id=717b1e5a663a418ca23b3238308a2d2d, user_id=7c7878ad7dbe4fd195ecdfd31e41a1ae, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:29.178229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58654e-3707-4a0b-815d-eec9ab1dac23 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:29.261686 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 574/1153] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:19:29 2022] PUT /identity/v3/projects/717b1e5a663a418ca23b3238308a2d2d/users/7c7878ad7dbe4fd195ecdfd31e41a1ae/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:19:31.153404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d3d97-44b6-4945-a640-d9df30362aca None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:31.153925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d3d97-44b6-4945-a640-d9df30362aca None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:31.153925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d3d97-44b6-4945-a640-d9df30362aca None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:31.155280 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 580/1154] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:31.160522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd2b9f-54ca-4652-a418-e4bf02f37add None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:31.160929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd2b9f-54ca-4652-a418-e4bf02f37add None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:31.161074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd2b9f-54ca-4652-a418-e4bf02f37add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:31.179904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e0cd2b9f-54ca-4652-a418-e4bf02f37add None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:31.181635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e0cd2b9f-54ca-4652-a418-e4bf02f37add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:31.247985 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 575/1155] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:19:31.524598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d3d97-44b6-4945-a640-d9df30362aca None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:31.625500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d3d97-44b6-4945-a640-d9df30362aca None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:31.662946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df6879-19bf-4184-a2ae-ca7212fa0506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:31.663562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df6879-19bf-4184-a2ae-ca7212fa0506 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:31.663848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df6879-19bf-4184-a2ae-ca7212fa0506 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:31.664204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df6879-19bf-4184-a2ae-ca7212fa0506 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:31.676026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df6879-19bf-4184-a2ae-ca7212fa0506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:19:31.681381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-c1df6879-19bf-4184-a2ae-ca7212fa0506 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:19:31.681381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:31.681381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:19:31.681381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:19:31.681381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:19:31.681381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:19:31.681381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:19:31.681381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:19:31.681381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:19:31.681381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:19:31.681381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:19:31.681381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:19:31.681381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:19:31.681381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:19:31.681381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:19:31.681381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:19:31.682507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:19:31.682507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:19:31.682507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:19:31.682507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:19:31.682507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:19:31.682507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:19:31.682507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:19:31.682507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:19:31.682507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:19:31.682507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:19:31.682507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:19:31.682507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:19:31.682507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:19:31.682507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:19:31.682507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:19:31.682507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:19:31.683389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:19:31.683389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:19:31.683389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:19:31.683389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:19:31.683389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:19:31.683389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:19:31.683389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:19:31.683389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:19:31.683389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:19:31.683389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:19:31.683389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:19:31.683389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:19:31.683389 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 581/1156] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:19:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:19:31.688788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd2b9f-54ca-4652-a418-e4bf02f37add None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:31.700537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:31.785891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd2b9f-54ca-4652-a418-e4bf02f37add None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:31.829656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a2747-a06c-4bfa-9fe4-1973df3e3a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:31.830260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a2747-a06c-4bfa-9fe4-1973df3e3a93 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:31.830539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a2747-a06c-4bfa-9fe4-1973df3e3a93 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:31.830811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a2747-a06c-4bfa-9fe4-1973df3e3a93 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:31.831475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a2747-a06c-4bfa-9fe4-1973df3e3a93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:31.831777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a2747-a06c-4bfa-9fe4-1973df3e3a93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:31.833173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a2747-a06c-4bfa-9fe4-1973df3e3a93 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:31.841705 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 576/1157] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:19:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:31.847482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df6879-19bf-4184-a2ae-ca7212fa0506 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:31.872578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:31.947394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df6879-19bf-4184-a2ae-ca7212fa0506 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:31.980830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e07c9-2528-4bbd-84ea-10cf8ccfaffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:31.981451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e07c9-2528-4bbd-84ea-10cf8ccfaffc None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:31.981725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e07c9-2528-4bbd-84ea-10cf8ccfaffc None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:31.981992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e07c9-2528-4bbd-84ea-10cf8ccfaffc None admin] PATH_INFO: `/v3/users/7c7878ad7dbe4fd195ecdfd31e41a1ae` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:31.983071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e07c9-2528-4bbd-84ea-10cf8ccfaffc None admin] RBAC: Authorizing `identity:get_user(user_id=7c7878ad7dbe4fd195ecdfd31e41a1ae)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:31.984528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e07c9-2528-4bbd-84ea-10cf8ccfaffc None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:31.986080 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 582/1158] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:19:31 2022] GET /identity/v3/users/7c7878ad7dbe4fd195ecdfd31e41a1ae => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:31.991999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a2747-a06c-4bfa-9fe4-1973df3e3a93 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:32.067359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:32.098694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a2747-a06c-4bfa-9fe4-1973df3e3a93 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:32.131866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaf843-194c-4df0-b62a-b8f0d9183aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:32.132490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaf843-194c-4df0-b62a-b8f0d9183aa7 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:32.132770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaf843-194c-4df0-b62a-b8f0d9183aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:32.134020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaf843-194c-4df0-b62a-b8f0d9183aa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:32.201632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaf843-194c-4df0-b62a-b8f0d9183aa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:32.203061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaf843-194c-4df0-b62a-b8f0d9183aa7 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:32.270048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:32.300531 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 577/1159] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:19:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 04:19:32.307072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e07c9-2528-4bbd-84ea-10cf8ccfaffc None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:32.402312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:32.411765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e07c9-2528-4bbd-84ea-10cf8ccfaffc None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:32.445155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2c690-1b33-45e5-af60-2bdcebdeaa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:32.446039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2c690-1b33-45e5-af60-2bdcebdeaa2a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:32.446039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2c690-1b33-45e5-af60-2bdcebdeaa2a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:32.446373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2c690-1b33-45e5-af60-2bdcebdeaa2a None admin] PATH_INFO: `/v3/projects/717b1e5a663a418ca23b3238308a2d2d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:32.447495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2c690-1b33-45e5-af60-2bdcebdeaa2a None admin] RBAC: Authorizing `identity:get_project(project_id=717b1e5a663a418ca23b3238308a2d2d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:32.448955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2c690-1b33-45e5-af60-2bdcebdeaa2a None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:32.450569 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 583/1160] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:19:32 2022] GET /identity/v3/projects/717b1e5a663a418ca23b3238308a2d2d => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:32.456798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaf843-194c-4df0-b62a-b8f0d9183aa7 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:32.552852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaf843-194c-4df0-b62a-b8f0d9183aa7 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:32.585181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a2a89-0b84-40b5-b5ee-2164605f8d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:32.585764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a2a89-0b84-40b5-b5ee-2164605f8d15 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:32.586581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a2a89-0b84-40b5-b5ee-2164605f8d15 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:32.586847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a2a89-0b84-40b5-b5ee-2164605f8d15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:32.587550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a2a89-0b84-40b5-b5ee-2164605f8d15 None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=717b1e5a663a418ca23b3238308a2d2d, user.id=7c7878ad7dbe4fd195ecdfd31e41a1ae) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:32.587848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a2a89-0b84-40b5-b5ee-2164605f8d15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:32.589272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a2a89-0b84-40b5-b5ee-2164605f8d15 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:32.594822 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 578/1161] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:19:32 2022] GET /identity/v3/role_assignments?user.id=7c7878ad7dbe4fd195ecdfd31e41a1ae&scope.project.id=717b1e5a663a418ca23b3238308a2d2d&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:34.503957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129e69c-30be-4869-87cf-715be7c08abb None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:34.504531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129e69c-30be-4869-87cf-715be7c08abb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:34.504531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129e69c-30be-4869-87cf-715be7c08abb None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:34.505864 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 584/1162] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:34.511884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176585-2302-419d-b9a1-83c970e3b727 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:34.512332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176585-2302-419d-b9a1-83c970e3b727 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:34.512456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176585-2302-419d-b9a1-83c970e3b727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:34.530690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3a176585-2302-419d-b9a1-83c970e3b727 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:34.531857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3a176585-2302-419d-b9a1-83c970e3b727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:34.559795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:34.595523 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 579/1163] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:19:34.864862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129e69c-30be-4869-87cf-715be7c08abb None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:34.966603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129e69c-30be-4869-87cf-715be7c08abb None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:35.000326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548d2e6-81b3-4c68-9b94-7518eb6e0cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:35.000914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d2e6-81b3-4c68-9b94-7518eb6e0cd4 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:35.001190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d2e6-81b3-4c68-9b94-7518eb6e0cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:35.001457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d2e6-81b3-4c68-9b94-7518eb6e0cd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:35.027138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:35.067365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548d2e6-81b3-4c68-9b94-7518eb6e0cd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:35.068854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548d2e6-81b3-4c68-9b94-7518eb6e0cd4 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:35.164792 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 585/1164] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:19:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 04:19:35.170547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a176585-2302-419d-b9a1-83c970e3b727 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:35.267799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a176585-2302-419d-b9a1-83c970e3b727 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:35.301103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de1411-f662-4b1a-a863-c6a3657aecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:35.301716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de1411-f662-4b1a-a863-c6a3657aecc9 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:35.301995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de1411-f662-4b1a-a863-c6a3657aecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:35.302262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de1411-f662-4b1a-a863-c6a3657aecc9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:35.308770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de1411-f662-4b1a-a863-c6a3657aecc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:35.310229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de1411-f662-4b1a-a863-c6a3657aecc9 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:35.321479 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-f5de1411-f662-4b1a-a863-c6a3657aecc9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 27 04:19:35.321479 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:35.321479 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:19:35.321479 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:19:35.321479 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:19:35.321479 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:19:35.321479 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:19:35.321479 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:19:35.321479 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 27 04:19:35.321479 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:19:35.321479 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:19:35.321479 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:19:35.321479 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:35.321479 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:19:35.321479 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:19:35.321479 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:19:35.321479 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:19:35.322730 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:19:35.322730 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:19:35.322730 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:19:35.322730 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:19:35.322730 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:19:35.322730 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:19:35.322730 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:19:35.322730 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:19:35.322730 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:19:35.322730 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:19:35.322730 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:19:35.322730 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:19:35.322730 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:19:35.322730 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:19:35.322730 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:19:35.322730 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:19:35.323872 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:19:35.323872 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:19:35.323872 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:19:35.323872 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:19:35.323872 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:19:35.323872 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:19:35.323872 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:19:35.323872 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:19:35.323872 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:19:35.323872 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:19:35.323872 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:19:35.323872 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:19:35.323872 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 27 04:19:35.323872 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:19:35.323872 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 580/1165] 10.222.0.76 () {56 vars in 1117 bytes} [Sat Aug 27 04:19:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:19:35.328479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548d2e6-81b3-4c68-9b94-7518eb6e0cd4 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:35.384863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:35.425009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548d2e6-81b3-4c68-9b94-7518eb6e0cd4 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:35.458813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae3bd0-b671-4393-93a4-b66be5ac2b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:35.459410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae3bd0-b671-4393-93a4-b66be5ac2b25 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:35.459690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae3bd0-b671-4393-93a4-b66be5ac2b25 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:35.459962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae3bd0-b671-4393-93a4-b66be5ac2b25 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:35.460632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae3bd0-b671-4393-93a4-b66be5ac2b25 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:35.461477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae3bd0-b671-4393-93a4-b66be5ac2b25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:35.462934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae3bd0-b671-4393-93a4-b66be5ac2b25 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:35.469855 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 586/1166] 10.222.0.76 () {56 vars in 1115 bytes} [Sat Aug 27 04:19:35 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:37.365681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3647e-fffc-4467-b57b-b20658993a06 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:37.366201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3647e-fffc-4467-b57b-b20658993a06 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:37.366201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3647e-fffc-4467-b57b-b20658993a06 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:37.368042 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 581/1167] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:37.373423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780e82a-1e6a-40ac-abfc-7ec3c8756290 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:37.373834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780e82a-1e6a-40ac-abfc-7ec3c8756290 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:37.373980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780e82a-1e6a-40ac-abfc-7ec3c8756290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:37.392013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f780e82a-1e6a-40ac-abfc-7ec3c8756290 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:37.393228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f780e82a-1e6a-40ac-abfc-7ec3c8756290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:37.457742 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 587/1168] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:19:37.726990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3647e-fffc-4467-b57b-b20658993a06 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:37.754424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:37.845998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3647e-fffc-4467-b57b-b20658993a06 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:37.879106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71465f25-b505-4430-bcf5-b22ccb62ebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:37.879705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71465f25-b505-4430-bcf5-b22ccb62ebcf None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:37.879979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71465f25-b505-4430-bcf5-b22ccb62ebcf None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:37.880274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71465f25-b505-4430-bcf5-b22ccb62ebcf None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:37.880928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71465f25-b505-4430-bcf5-b22ccb62ebcf None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:37.882283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71465f25-b505-4430-bcf5-b22ccb62ebcf None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:37.947058 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 582/1169] 10.222.0.76 () {60 vars in 1138 bytes} [Sat Aug 27 04:19:37 2022] POST /identity/v3/domains => generated 267 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:19:39.904717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1537c3-fa59-48bc-b577-5ef4b352afee None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:39.905278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1537c3-fa59-48bc-b577-5ef4b352afee None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:39.905278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1537c3-fa59-48bc-b577-5ef4b352afee None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:39.906613 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 588/1170] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:39.911751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9422c4-2167-42f8-9d2f-de1ce32a6230 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:39.912138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9422c4-2167-42f8-9d2f-de1ce32a6230 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:39.912312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9422c4-2167-42f8-9d2f-de1ce32a6230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:39.930764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ad9422c4-2167-42f8-9d2f-de1ce32a6230 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:39.931935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ad9422c4-2167-42f8-9d2f-de1ce32a6230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:39.998213 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 583/1171] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:19:40.267250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1537c3-fa59-48bc-b577-5ef4b352afee None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:40.320432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:40.365952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1537c3-fa59-48bc-b577-5ef4b352afee None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:40.399047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cff04-5558-476d-8416-850a7f3a5122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:40.399657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cff04-5558-476d-8416-850a7f3a5122 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:40.399936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cff04-5558-476d-8416-850a7f3a5122 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:40.400233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cff04-5558-476d-8416-850a7f3a5122 None admin] PATH_INFO: `/v3/domains/5176fc8cb9e54a078c1cc929e72fc8a1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:40.410218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cff04-5558-476d-8416-850a7f3a5122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5176fc8cb9e54a078c1cc929e72fc8a1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:40.411650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cff04-5558-476d-8416-850a7f3a5122 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:40.413239 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 589/1172] 10.222.0.76 () {56 vars in 1183 bytes} [Sat Aug 27 04:19:40 2022] GET /identity/v3/domains/5176fc8cb9e54a078c1cc929e72fc8a1 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:40.419595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9422c4-2167-42f8-9d2f-de1ce32a6230 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:40.437417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:40.517975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9422c4-2167-42f8-9d2f-de1ce32a6230 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:40.552039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f416b-2f83-4553-bec0-93ec0010c46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:40.552667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f416b-2f83-4553-bec0-93ec0010c46f None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:40.552946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f416b-2f83-4553-bec0-93ec0010c46f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:40.553219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f416b-2f83-4553-bec0-93ec0010c46f None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:40.553944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f416b-2f83-4553-bec0-93ec0010c46f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:40.555463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f416b-2f83-4553-bec0-93ec0010c46f None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:40.643876 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 584/1173] 10.222.0.76 () {60 vars in 1141 bytes} [Sat Aug 27 04:19:40 2022] POST /identity/v3/projects => generated 361 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:19:42.583576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784360d-f3b7-4d10-a69e-05103b64ead3 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:42.584126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784360d-f3b7-4d10-a69e-05103b64ead3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:42.584126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784360d-f3b7-4d10-a69e-05103b64ead3 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:42.585612 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 590/1174] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:42.590712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e4e11-5d8b-49c4-aa1a-69b5a4bd9696 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:42.591095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e4e11-5d8b-49c4-aa1a-69b5a4bd9696 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:42.591256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e4e11-5d8b-49c4-aa1a-69b5a4bd9696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:42.609426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-320e4e11-5d8b-49c4-aa1a-69b5a4bd9696 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:42.610597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-320e4e11-5d8b-49c4-aa1a-69b5a4bd9696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:42.670505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:42.675700 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 585/1175] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:19:42.948447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784360d-f3b7-4d10-a69e-05103b64ead3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:43.049280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784360d-f3b7-4d10-a69e-05103b64ead3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:43.061474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:43.081438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa312b5-e01c-4b75-ad51-ca7b2000750b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:43.082052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa312b5-e01c-4b75-ad51-ca7b2000750b None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:43.082330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa312b5-e01c-4b75-ad51-ca7b2000750b None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:43.082600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa312b5-e01c-4b75-ad51-ca7b2000750b None admin] PATH_INFO: `/v3/domains/5176fc8cb9e54a078c1cc929e72fc8a1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:43.083696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa312b5-e01c-4b75-ad51-ca7b2000750b None admin] RBAC: Authorizing `identity:get_domain(domain_id=5176fc8cb9e54a078c1cc929e72fc8a1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:43.085161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa312b5-e01c-4b75-ad51-ca7b2000750b None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:43.087340 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 591/1176] 10.222.0.76 () {56 vars in 1183 bytes} [Sat Aug 27 04:19:42 2022] GET /identity/v3/domains/5176fc8cb9e54a078c1cc929e72fc8a1 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:43.093403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e4e11-5d8b-49c4-aa1a-69b5a4bd9696 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:43.189346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e4e11-5d8b-49c4-aa1a-69b5a4bd9696 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:43.222807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb665f2-d1ba-4c5b-af24-3b6a35471491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:43.223394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb665f2-d1ba-4c5b-af24-3b6a35471491 None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:43.223667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb665f2-d1ba-4c5b-af24-3b6a35471491 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:43.223932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb665f2-d1ba-4c5b-af24-3b6a35471491 None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:43.224606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb665f2-d1ba-4c5b-af24-3b6a35471491 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:43.226057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb665f2-d1ba-4c5b-af24-3b6a35471491 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:43.324120 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 586/1177] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:19:43 2022] POST /identity/v3/users => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:19:45.274105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64e4f2-fec2-49e6-b759-c95b565bb6e6 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:45.274610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64e4f2-fec2-49e6-b759-c95b565bb6e6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:45.274610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64e4f2-fec2-49e6-b759-c95b565bb6e6 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:45.275913 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 592/1178] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:45.281403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573502d-ae04-40b5-9798-580071f77062 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:45.281849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573502d-ae04-40b5-9798-580071f77062 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:45.281954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573502d-ae04-40b5-9798-580071f77062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:45.300131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b573502d-ae04-40b5-9798-580071f77062 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:45.301339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b573502d-ae04-40b5-9798-580071f77062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:45.348828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:45.365923 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 587/1179] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:19:45.645824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64e4f2-fec2-49e6-b759-c95b565bb6e6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:45.745094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64e4f2-fec2-49e6-b759-c95b565bb6e6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:45.778898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f10d4-ce76-4207-aa3f-f808899dc403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:45.779512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f10d4-ce76-4207-aa3f-f808899dc403 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:45.779795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f10d4-ce76-4207-aa3f-f808899dc403 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:45.780070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f10d4-ce76-4207-aa3f-f808899dc403 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:45.790420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f10d4-ce76-4207-aa3f-f808899dc403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:19:45.795156 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-5a7f10d4-ce76-4207-aa3f-f808899dc403 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:19:45.795156 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:45.795156 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:19:45.795156 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:19:45.795156 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:19:45.795156 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:19:45.795156 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:19:45.795156 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:19:45.795156 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:19:45.795156 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:19:45.795156 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:19:45.795156 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:19:45.795156 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:19:45.795156 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:19:45.795156 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:19:45.795156 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:19:45.796336 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:19:45.796336 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:19:45.796336 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:19:45.796336 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:19:45.796336 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:19:45.796336 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:19:45.796336 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:19:45.796336 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:19:45.796336 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:19:45.796336 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:19:45.796336 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:19:45.796336 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:19:45.796336 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:19:45.796336 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:19:45.796336 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:19:45.796336 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:19:45.797505 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:19:45.797505 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:19:45.797505 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:19:45.797505 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:19:45.797505 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:19:45.797505 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:19:45.797505 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:19:45.797505 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:19:45.797505 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:19:45.797505 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:19:45.797505 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:19:45.797505 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:19:45.797505 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 593/1180] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:19:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:19:45.802374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573502d-ae04-40b5-9798-580071f77062 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:45.906273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573502d-ae04-40b5-9798-580071f77062 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:45.945539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab319b6-2a4f-452d-966b-af45e1d43d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:45.946146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab319b6-2a4f-452d-966b-af45e1d43d1e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:45.946424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab319b6-2a4f-452d-966b-af45e1d43d1e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:45.946722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab319b6-2a4f-452d-966b-af45e1d43d1e None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:45.947381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab319b6-2a4f-452d-966b-af45e1d43d1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:45.947680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab319b6-2a4f-452d-966b-af45e1d43d1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:45.949068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab319b6-2a4f-452d-966b-af45e1d43d1e None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:45.957013 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 588/1181] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:19:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:45.964045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f10d4-ce76-4207-aa3f-f808899dc403 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:46.004300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:46.060215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f10d4-ce76-4207-aa3f-f808899dc403 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:46.092005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd5652-020f-4e5d-a8de-9f8e3319553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:46.092637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd5652-020f-4e5d-a8de-9f8e3319553d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:46.092912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd5652-020f-4e5d-a8de-9f8e3319553d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:46.093178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd5652-020f-4e5d-a8de-9f8e3319553d None admin] PATH_INFO: `/v3/users/2b04b98df4d14bf0a94b5d3fb162eb2b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:46.106521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd5652-020f-4e5d-a8de-9f8e3319553d None admin] RBAC: Authorizing `identity:get_user(user_id=2b04b98df4d14bf0a94b5d3fb162eb2b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:46.107977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd5652-020f-4e5d-a8de-9f8e3319553d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:46.109582 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 594/1182] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:19:45 2022] GET /identity/v3/users/2b04b98df4d14bf0a94b5d3fb162eb2b => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:46.115499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab319b6-2a4f-452d-966b-af45e1d43d1e None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:46.162683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:46.215043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab319b6-2a4f-452d-966b-af45e1d43d1e None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:46.246347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c7913-d160-4691-8ac9-ae4f8aa1008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:46.246924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c7913-d160-4691-8ac9-ae4f8aa1008a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:46.247223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c7913-d160-4691-8ac9-ae4f8aa1008a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:46.247490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c7913-d160-4691-8ac9-ae4f8aa1008a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:46.311573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c7913-d160-4691-8ac9-ae4f8aa1008a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:46.313027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c7913-d160-4691-8ac9-ae4f8aa1008a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:46.356349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:46.408863 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 589/1183] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:19:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 04:19:46.414961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd5652-020f-4e5d-a8de-9f8e3319553d None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:46.506779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:46.511388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd5652-020f-4e5d-a8de-9f8e3319553d None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:46.544579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d6dab-d4ac-4b7e-9568-55d13ac7fab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:46.545195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6dab-d4ac-4b7e-9568-55d13ac7fab1 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:46.545476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6dab-d4ac-4b7e-9568-55d13ac7fab1 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:46.545748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6dab-d4ac-4b7e-9568-55d13ac7fab1 None admin] PATH_INFO: `/v3/projects/c1ab81d666874f3ca25a057b350406cc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:46.546859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d6dab-d4ac-4b7e-9568-55d13ac7fab1 None admin] RBAC: Authorizing `identity:get_project(project_id=c1ab81d666874f3ca25a057b350406cc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:46.548321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d6dab-d4ac-4b7e-9568-55d13ac7fab1 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:46.549931 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 595/1184] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:19:46 2022] GET /identity/v3/projects/c1ab81d666874f3ca25a057b350406cc => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:46.556676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c7913-d160-4691-8ac9-ae4f8aa1008a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:46.653884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c7913-d160-4691-8ac9-ae4f8aa1008a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:46.686769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe116e-c2d9-45a7-8036-bc68c3b7dbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:46.687301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe116e-c2d9-45a7-8036-bc68c3b7dbc6 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:46.687581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe116e-c2d9-45a7-8036-bc68c3b7dbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:46.687852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe116e-c2d9-45a7-8036-bc68c3b7dbc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:46.688603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe116e-c2d9-45a7-8036-bc68c3b7dbc6 None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=c1ab81d666874f3ca25a057b350406cc, user.id=2b04b98df4d14bf0a94b5d3fb162eb2b) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:46.688910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe116e-c2d9-45a7-8036-bc68c3b7dbc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:46.690319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe116e-c2d9-45a7-8036-bc68c3b7dbc6 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:46.695655 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 590/1185] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:19:46 2022] GET /identity/v3/role_assignments?user.id=2b04b98df4d14bf0a94b5d3fb162eb2b&scope.project.id=c1ab81d666874f3ca25a057b350406cc&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:48.615807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052cdb3-7dae-42ce-ba45-405574a98824 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:48.616437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052cdb3-7dae-42ce-ba45-405574a98824 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:48.616437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052cdb3-7dae-42ce-ba45-405574a98824 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:48.617715 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 596/1186] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:48.622779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf80b7-4c22-4ce1-b82f-99a1b8d93343 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:48.623179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf80b7-4c22-4ce1-b82f-99a1b8d93343 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:48.623316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf80b7-4c22-4ce1-b82f-99a1b8d93343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:48.641644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-59cf80b7-4c22-4ce1-b82f-99a1b8d93343 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:48.642822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-59cf80b7-4c22-4ce1-b82f-99a1b8d93343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:48.645526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:48.708058 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 591/1187] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:19:48.978848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052cdb3-7dae-42ce-ba45-405574a98824 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:49.077852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052cdb3-7dae-42ce-ba45-405574a98824 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:49.111292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717963b6-6701-4d98-a98f-bc922bc9ba49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:49.111901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717963b6-6701-4d98-a98f-bc922bc9ba49 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:49.112264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717963b6-6701-4d98-a98f-bc922bc9ba49 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:49.112545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717963b6-6701-4d98-a98f-bc922bc9ba49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:49.122381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717963b6-6701-4d98-a98f-bc922bc9ba49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:19:49.127113 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-717963b6-6701-4d98-a98f-bc922bc9ba49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:19:49.127113 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:49.127113 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:19:49.127113 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:19:49.127113 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:19:49.127113 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:19:49.127113 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:19:49.127113 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:19:49.127113 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:19:49.127113 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:19:49.127113 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:19:49.127113 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:19:49.127113 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:19:49.127113 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:19:49.127113 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:19:49.127113 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:19:49.128295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:19:49.128295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:19:49.128295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:19:49.128295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:19:49.128295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:19:49.128295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:19:49.128295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:19:49.128295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:19:49.128295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:19:49.128295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:19:49.128295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:19:49.128295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:19:49.128295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:19:49.128295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:19:49.128295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:19:49.128295 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:19:49.129166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:19:49.129166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:19:49.129166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:19:49.129166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:19:49.129166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:19:49.129166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:19:49.129166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:19:49.129166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:19:49.129166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:19:49.129166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:19:49.129166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:19:49.129166 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:19:49.129166 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 597/1188] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:19:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:19:49.134676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf80b7-4c22-4ce1-b82f-99a1b8d93343 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:49.234365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf80b7-4c22-4ce1-b82f-99a1b8d93343 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:49.269273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5262c0-7036-46f3-b302-a127b375b5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:49.269863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5262c0-7036-46f3-b302-a127b375b5b7 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:49.270142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5262c0-7036-46f3-b302-a127b375b5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:49.270411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5262c0-7036-46f3-b302-a127b375b5b7 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:49.271064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5262c0-7036-46f3-b302-a127b375b5b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:49.271365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5262c0-7036-46f3-b302-a127b375b5b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:49.273834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5262c0-7036-46f3-b302-a127b375b5b7 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:49.281614 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 592/1189] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:19:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:49.287283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717963b6-6701-4d98-a98f-bc922bc9ba49 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:49.315089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:49.385791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717963b6-6701-4d98-a98f-bc922bc9ba49 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:49.418092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc4711-586f-4534-b768-72228db64048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:49.418695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc4711-586f-4534-b768-72228db64048 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:49.418970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc4711-586f-4534-b768-72228db64048 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:49.419236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc4711-586f-4534-b768-72228db64048 None admin] PATH_INFO: `/v3/users/2b04b98df4d14bf0a94b5d3fb162eb2b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:49.420342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc4711-586f-4534-b768-72228db64048 None admin] RBAC: Authorizing `identity:get_user(user_id=2b04b98df4d14bf0a94b5d3fb162eb2b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:49.421751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc4711-586f-4534-b768-72228db64048 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:49.423277 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 598/1190] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:19:49 2022] GET /identity/v3/users/2b04b98df4d14bf0a94b5d3fb162eb2b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:49.429237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5262c0-7036-46f3-b302-a127b375b5b7 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:49.432052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:49.527972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5262c0-7036-46f3-b302-a127b375b5b7 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:49.561355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef8909-f715-4182-bf37-7b229a563359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:49.562596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef8909-f715-4182-bf37-7b229a563359 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:49.562876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef8909-f715-4182-bf37-7b229a563359 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:49.563149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef8909-f715-4182-bf37-7b229a563359 None admin] PATH_INFO: `/v3/projects/c1ab81d666874f3ca25a057b350406cc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:49.564299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef8909-f715-4182-bf37-7b229a563359 None admin] RBAC: Authorizing `identity:get_project(project_id=c1ab81d666874f3ca25a057b350406cc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:49.565716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef8909-f715-4182-bf37-7b229a563359 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:49.567327 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 593/1191] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:19:49 2022] GET /identity/v3/projects/c1ab81d666874f3ca25a057b350406cc => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:49.574053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc4711-586f-4534-b768-72228db64048 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:49.665523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:49.671930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc4711-586f-4534-b768-72228db64048 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:49.706459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338363e-9b67-4c0c-a9de-8fcf9bdfe2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:49.707104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338363e-9b67-4c0c-a9de-8fcf9bdfe2a1 None admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:49.707382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338363e-9b67-4c0c-a9de-8fcf9bdfe2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:49.707656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338363e-9b67-4c0c-a9de-8fcf9bdfe2a1 None admin] PATH_INFO: `/v3/projects/c1ab81d666874f3ca25a057b350406cc/users/2b04b98df4d14bf0a94b5d3fb162eb2b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:49.709577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338363e-9b67-4c0c-a9de-8fcf9bdfe2a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1ab81d666874f3ca25a057b350406cc, user_id=2b04b98df4d14bf0a94b5d3fb162eb2b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:49.711844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338363e-9b67-4c0c-a9de-8fcf9bdfe2a1 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:49.774696 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 599/1192] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:19:49 2022] PUT /identity/v3/projects/c1ab81d666874f3ca25a057b350406cc/users/2b04b98df4d14bf0a94b5d3fb162eb2b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:19:51.639172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1533c8-6cce-45d4-8215-9f23a016acce None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:51.639724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1533c8-6cce-45d4-8215-9f23a016acce None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:51.639724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1533c8-6cce-45d4-8215-9f23a016acce None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:51.641056 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 594/1193] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:19:51.646257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0912c74-71c2-49bd-8ae8-a42b8a9987b6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:51.646661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0912c74-71c2-49bd-8ae8-a42b8a9987b6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:51.646800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0912c74-71c2-49bd-8ae8-a42b8a9987b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:51.664675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e0912c74-71c2-49bd-8ae8-a42b8a9987b6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:19:51.665837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e0912c74-71c2-49bd-8ae8-a42b8a9987b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:19:51.730796 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 600/1194] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:19:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:19:52.003429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1533c8-6cce-45d4-8215-9f23a016acce None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:52.073134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:52.105247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1533c8-6cce-45d4-8215-9f23a016acce None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:52.137724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618558a-0c9b-4690-816c-52ae249af54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:52.138341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618558a-0c9b-4690-816c-52ae249af54a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:52.138621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618558a-0c9b-4690-816c-52ae249af54a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:52.138892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618558a-0c9b-4690-816c-52ae249af54a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:52.149675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618558a-0c9b-4690-816c-52ae249af54a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:19:52.154438 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-0618558a-0c9b-4690-816c-52ae249af54a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:19:52.154438 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:19:52.154438 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:19:52.154438 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:19:52.154438 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:19:52.154438 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:19:52.154438 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:19:52.154438 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:19:52.154438 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:19:52.154438 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:19:52.154438 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:19:52.154438 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:19:52.154438 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:19:52.154438 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:19:52.154438 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:19:52.154438 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:19:52.155551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:19:52.155551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:19:52.155551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:19:52.155551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:19:52.155551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:19:52.155551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:19:52.155551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:19:52.155551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:19:52.155551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:19:52.155551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:19:52.155551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:19:52.155551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:19:52.155551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:19:52.155551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:19:52.155551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:19:52.155551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:19:52.156853 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:19:52.156853 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:19:52.156853 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:19:52.156853 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:19:52.156853 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:19:52.156853 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:19:52.156853 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:19:52.156853 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:19:52.156853 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:19:52.156853 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:19:52.156853 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:19:52.156853 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:19:52.156853 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 595/1195] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:19:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:19:52.161535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0912c74-71c2-49bd-8ae8-a42b8a9987b6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:52.245327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:52.261719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0912c74-71c2-49bd-8ae8-a42b8a9987b6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:52.296353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217faded-7f45-462d-9f9a-c35e9ccfc7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:52.297040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217faded-7f45-462d-9f9a-c35e9ccfc7fa None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:52.297319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217faded-7f45-462d-9f9a-c35e9ccfc7fa None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:52.297592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217faded-7f45-462d-9f9a-c35e9ccfc7fa None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:52.298250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217faded-7f45-462d-9f9a-c35e9ccfc7fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:52.298556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217faded-7f45-462d-9f9a-c35e9ccfc7fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:52.300365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217faded-7f45-462d-9f9a-c35e9ccfc7fa None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:52.309154 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 601/1196] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:19:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:52.314936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618558a-0c9b-4690-816c-52ae249af54a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:52.413822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618558a-0c9b-4690-816c-52ae249af54a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:52.440593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:52.446881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079bc1f-46ac-47a4-861c-731a1dceb070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:52.447497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079bc1f-46ac-47a4-861c-731a1dceb070 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:52.447778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079bc1f-46ac-47a4-861c-731a1dceb070 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:52.450946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079bc1f-46ac-47a4-861c-731a1dceb070 None admin] PATH_INFO: `/v3/users/2b04b98df4d14bf0a94b5d3fb162eb2b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:52.450946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079bc1f-46ac-47a4-861c-731a1dceb070 None admin] RBAC: Authorizing `identity:get_user(user_id=2b04b98df4d14bf0a94b5d3fb162eb2b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:52.450946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079bc1f-46ac-47a4-861c-731a1dceb070 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:52.452120 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 596/1197] 10.222.0.76 () {56 vars in 1177 bytes} [Sat Aug 27 04:19:52 2022] GET /identity/v3/users/2b04b98df4d14bf0a94b5d3fb162eb2b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:52.458104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217faded-7f45-462d-9f9a-c35e9ccfc7fa None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:52.559567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217faded-7f45-462d-9f9a-c35e9ccfc7fa None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:52.593102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797b41f-1f4e-44e4-bdc0-e98e027f1a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:52.593696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797b41f-1f4e-44e4-bdc0-e98e027f1a1a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:52.593980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797b41f-1f4e-44e4-bdc0-e98e027f1a1a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:52.594255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797b41f-1f4e-44e4-bdc0-e98e027f1a1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:52.609456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:52.664302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797b41f-1f4e-44e4-bdc0-e98e027f1a1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:52.665763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797b41f-1f4e-44e4-bdc0-e98e027f1a1a None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:52.763949 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 602/1198] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:19:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 04:19:52.769922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079bc1f-46ac-47a4-861c-731a1dceb070 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:52.868030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079bc1f-46ac-47a4-861c-731a1dceb070 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:52.900809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88c3f2-bbd6-4327-aacf-e970baf3dccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:52.901427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88c3f2-bbd6-4327-aacf-e970baf3dccb None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:52.901708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88c3f2-bbd6-4327-aacf-e970baf3dccb None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:52.901980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88c3f2-bbd6-4327-aacf-e970baf3dccb None admin] PATH_INFO: `/v3/projects/c1ab81d666874f3ca25a057b350406cc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:52.903078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88c3f2-bbd6-4327-aacf-e970baf3dccb None admin] RBAC: Authorizing `identity:get_project(project_id=c1ab81d666874f3ca25a057b350406cc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:52.904522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88c3f2-bbd6-4327-aacf-e970baf3dccb None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:52.906117 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 597/1199] 10.222.0.76 () {56 vars in 1186 bytes} [Sat Aug 27 04:19:52 2022] GET /identity/v3/projects/c1ab81d666874f3ca25a057b350406cc => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:19:52.912176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797b41f-1f4e-44e4-bdc0-e98e027f1a1a None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:19:52.958368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:19:53.012381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797b41f-1f4e-44e4-bdc0-e98e027f1a1a None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:19:53.045461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4143f-7a41-46f0-8975-0193e9c64c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:19:53.046055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4143f-7a41-46f0-8975-0193e9c64c5a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:19:53.046331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4143f-7a41-46f0-8975-0193e9c64c5a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:19:53.046602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4143f-7a41-46f0-8975-0193e9c64c5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:19:53.047318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4143f-7a41-46f0-8975-0193e9c64c5a None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=c1ab81d666874f3ca25a057b350406cc, user.id=2b04b98df4d14bf0a94b5d3fb162eb2b) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:19:53.047623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4143f-7a41-46f0-8975-0193e9c64c5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:19:53.049064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4143f-7a41-46f0-8975-0193e9c64c5a None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:19:53.054626 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 603/1200] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:19:52 2022] GET /identity/v3/role_assignments?user.id=2b04b98df4d14bf0a94b5d3fb162eb2b&scope.project.id=c1ab81d666874f3ca25a057b350406cc&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:20:02.896004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=67 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:20:03.052042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=45 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:05.261359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edc5bf-ac2e-4aba-b49e-c5ecc6c33eed None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:05.261902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edc5bf-ac2e-4aba-b49e-c5ecc6c33eed None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:05.261902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edc5bf-ac2e-4aba-b49e-c5ecc6c33eed None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:05.263147 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 598/1201] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:21:05.268746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d402b2-1781-479c-8bfb-2d8c77e3e7c3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:05.272707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d402b2-1781-479c-8bfb-2d8c77e3e7c3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:05.272707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d402b2-1781-479c-8bfb-2d8c77e3e7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:05.288195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-50d402b2-1781-479c-8bfb-2d8c77e3e7c3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:21:05.290203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-50d402b2-1781-479c-8bfb-2d8c77e3e7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:21:05.357592 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 604/1202] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:21:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:21:05.637970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edc5bf-ac2e-4aba-b49e-c5ecc6c33eed None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:05.740424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edc5bf-ac2e-4aba-b49e-c5ecc6c33eed None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:05.773507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d93d9-a2d2-4e46-987f-85c7ab40e500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:05.774512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d93d9-a2d2-4e46-987f-85c7ab40e500 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:05.774854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d93d9-a2d2-4e46-987f-85c7ab40e500 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:05.775372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d93d9-a2d2-4e46-987f-85c7ab40e500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:05.787368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d93d9-a2d2-4e46-987f-85c7ab40e500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:05.789659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d93d9-a2d2-4e46-987f-85c7ab40e500 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:05.803454 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-c87d93d9-a2d2-4e46-987f-85c7ab40e500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:05.803454 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:05.803454 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:05.803454 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:05.803454 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:05.803454 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:05.803454 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:05.803454 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:05.803454 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:05.803454 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:05.803454 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:05.803454 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:05.803454 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:21:05.803454 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:21:05.803454 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:21:05.803454 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:21:05.804586 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:05.804586 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:05.804586 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:05.804586 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:05.804586 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:05.804586 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:05.804586 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:05.804586 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:05.804586 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:05.804586 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:05.804586 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:05.804586 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:05.804586 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:05.804586 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:05.804586 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:05.804586 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:05.804586 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:21:05.806045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:21:05.806045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:05.806045 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:21:05.806045 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 599/1203] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:05.810706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d402b2-1781-479c-8bfb-2d8c77e3e7c3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:05.909784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d402b2-1781-479c-8bfb-2d8c77e3e7c3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:05.939470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:05.945802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05b606-1825-4b74-9ca1-9841e9c4ea94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:05.946412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05b606-1825-4b74-9ca1-9841e9c4ea94 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:05.946688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05b606-1825-4b74-9ca1-9841e9c4ea94 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:05.946957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05b606-1825-4b74-9ca1-9841e9c4ea94 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:05.947632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05b606-1825-4b74-9ca1-9841e9c4ea94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:05.947931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05b606-1825-4b74-9ca1-9841e9c4ea94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:05.949338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05b606-1825-4b74-9ca1-9841e9c4ea94 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:05.966232 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 605/1204] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:05.974182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d93d9-a2d2-4e46-987f-85c7ab40e500 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:06.030556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:06.078376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d93d9-a2d2-4e46-987f-85c7ab40e500 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:06.111951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15ecc0-f0f5-4a8f-a3f1-cd07c9145283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:06.112572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15ecc0-f0f5-4a8f-a3f1-cd07c9145283 None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:06.112845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15ecc0-f0f5-4a8f-a3f1-cd07c9145283 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:06.113144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15ecc0-f0f5-4a8f-a3f1-cd07c9145283 None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:06.113794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15ecc0-f0f5-4a8f-a3f1-cd07c9145283 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:06.115197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15ecc0-f0f5-4a8f-a3f1-cd07c9145283 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:06.201619 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 600/1205] 10.222.0.76 () {60 vars in 1132 bytes} [Sat Aug 27 04:21:05 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:21:08.196393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99c3ab-b979-40c1-8b8c-25a0582816e5 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:08.196945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99c3ab-b979-40c1-8b8c-25a0582816e5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:08.196945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99c3ab-b979-40c1-8b8c-25a0582816e5 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:08.198322 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 606/1206] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:21:08.203608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc49be-5cfe-4331-b113-438d39e0797c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:08.204037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc49be-5cfe-4331-b113-438d39e0797c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:08.204139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc49be-5cfe-4331-b113-438d39e0797c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:08.222764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a3cc49be-5cfe-4331-b113-438d39e0797c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:21:08.223852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a3cc49be-5cfe-4331-b113-438d39e0797c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:21:08.290602 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 601/1207] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:21:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:21:08.557877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99c3ab-b979-40c1-8b8c-25a0582816e5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:08.661674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99c3ab-b979-40c1-8b8c-25a0582816e5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:08.696452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca572e2-c3a8-4e53-a928-d3c732907d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:08.697105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca572e2-c3a8-4e53-a928-d3c732907d0f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:08.697381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca572e2-c3a8-4e53-a928-d3c732907d0f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:08.697653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca572e2-c3a8-4e53-a928-d3c732907d0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:08.707965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca572e2-c3a8-4e53-a928-d3c732907d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:21:08.712727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-0ca572e2-c3a8-4e53-a928-d3c732907d0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:21:08.712727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:08.712727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:08.712727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:08.712727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:08.712727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:08.712727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:08.712727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:08.712727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:08.712727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:08.712727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:08.712727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:08.712727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:21:08.712727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:21:08.712727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:21:08.712727 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:21:08.713806 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:21:08.713806 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:21:08.713806 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:21:08.713806 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:21:08.713806 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:08.713806 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:08.713806 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:08.713806 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:08.713806 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:08.713806 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:08.713806 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:08.713806 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:08.713806 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:08.713806 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:08.713806 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:08.713806 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:08.715017 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:08.715017 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:08.715017 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:08.715017 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:08.715017 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:21:08.715017 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:21:08.715017 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:21:08.715017 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:21:08.715017 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:21:08.715017 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:21:08.715017 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:21:08.715017 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:08.715017 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 607/1208] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:21:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:08.719849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc49be-5cfe-4331-b113-438d39e0797c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:08.759099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:08.821529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc49be-5cfe-4331-b113-438d39e0797c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:08.862809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f51709-b5e0-46de-b41a-7b48494e7668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:08.863418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51709-b5e0-46de-b41a-7b48494e7668 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:08.863694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51709-b5e0-46de-b41a-7b48494e7668 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:08.863961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51709-b5e0-46de-b41a-7b48494e7668 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:08.864647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f51709-b5e0-46de-b41a-7b48494e7668 None admin] RBAC: Adding query filter params (name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:08.864945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f51709-b5e0-46de-b41a-7b48494e7668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:08.866304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f51709-b5e0-46de-b41a-7b48494e7668 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:08.874846 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 602/1209] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:21:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:08.880750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca572e2-c3a8-4e53-a928-d3c732907d0f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:08.932072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:08.982063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca572e2-c3a8-4e53-a928-d3c732907d0f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:09.021045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02847f15-878c-4522-ac57-a365c0a797d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:09.021775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02847f15-878c-4522-ac57-a365c0a797d4 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:09.022058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02847f15-878c-4522-ac57-a365c0a797d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:09.022552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02847f15-878c-4522-ac57-a365c0a797d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:09.036633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02847f15-878c-4522-ac57-a365c0a797d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:09.039108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02847f15-878c-4522-ac57-a365c0a797d4 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:09.053586 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-02847f15-878c-4522-ac57-a365c0a797d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:09.053586 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:09.053586 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:09.053586 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:09.053586 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:09.053586 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:09.053586 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:09.053586 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:09.053586 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:09.053586 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:09.053586 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:09.053586 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:09.053586 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:21:09.053586 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:21:09.053586 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:21:09.053586 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:21:09.056486 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:09.056486 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:09.056486 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:09.056486 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:09.056486 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:09.056486 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:09.056486 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:09.056486 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:09.056486 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:09.056486 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:09.056486 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:09.056486 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:09.056486 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:09.056486 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:09.056486 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:09.056486 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:09.056486 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:21:09.057628 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:21:09.057628 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:09.057628 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:09.057628 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 608/1210] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:09.061514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f51709-b5e0-46de-b41a-7b48494e7668 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:09.156763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:09.159505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f51709-b5e0-46de-b41a-7b48494e7668 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:09.191987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be42156-9f09-4f5e-bc7b-2297a24c6bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:09.192609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be42156-9f09-4f5e-bc7b-2297a24c6bfc None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:09.192889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be42156-9f09-4f5e-bc7b-2297a24c6bfc None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:09.193161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be42156-9f09-4f5e-bc7b-2297a24c6bfc None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:09.193789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be42156-9f09-4f5e-bc7b-2297a24c6bfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:09.194089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be42156-9f09-4f5e-bc7b-2297a24c6bfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:09.195578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be42156-9f09-4f5e-bc7b-2297a24c6bfc None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:09.206749 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 603/1211] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:09.212629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02847f15-878c-4522-ac57-a365c0a797d4 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:09.312689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02847f15-878c-4522-ac57-a365c0a797d4 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:09.314263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:09.348370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097321cf-85f0-4883-8ad3-9dd12daaf98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:09.348991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097321cf-85f0-4883-8ad3-9dd12daaf98e None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:09.349273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097321cf-85f0-4883-8ad3-9dd12daaf98e None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:09.349545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097321cf-85f0-4883-8ad3-9dd12daaf98e None admin] PATH_INFO: `/v3/users/placement` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:09.357300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097321cf-85f0-4883-8ad3-9dd12daaf98e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:09.358732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097321cf-85f0-4883-8ad3-9dd12daaf98e None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:09.370520 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-097321cf-85f0-4883-8ad3-9dd12daaf98e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:21:09.370520 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:09.370520 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:09.370520 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:09.370520 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:09.370520 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:09.370520 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:09.370520 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:09.370520 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:09.370520 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:09.370520 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:09.370520 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:09.370520 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:21:09.370520 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:21:09.370520 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:21:09.370520 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:09.375335 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:09.376346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:09.376346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:09.376346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:21:09.376346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:21:09.376346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:21:09.376346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:21:09.376346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:21:09.376346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:21:09.376346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:21:09.376346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:09.376346 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 609/1212] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:09.377582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be42156-9f09-4f5e-bc7b-2297a24c6bfc None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:09.478577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be42156-9f09-4f5e-bc7b-2297a24c6bfc None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:09.513703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2da2d6-9216-47d3-ac5b-290472bcfea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:09.514307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2da2d6-9216-47d3-ac5b-290472bcfea3 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:09.514585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2da2d6-9216-47d3-ac5b-290472bcfea3 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:09.514855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2da2d6-9216-47d3-ac5b-290472bcfea3 None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:09.515572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2da2d6-9216-47d3-ac5b-290472bcfea3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:09.515877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2da2d6-9216-47d3-ac5b-290472bcfea3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:09.517328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2da2d6-9216-47d3-ac5b-290472bcfea3 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:09.535387 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 604/1213] 10.222.0.76 () {56 vars in 1143 bytes} [Sat Aug 27 04:21:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:09.541301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097321cf-85f0-4883-8ad3-9dd12daaf98e None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:09.643100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097321cf-85f0-4883-8ad3-9dd12daaf98e None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:09.675916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bc07a-0576-44c8-a19b-a3a32216bf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:09.676539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bc07a-0576-44c8-a19b-a3a32216bf4c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:09.676817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bc07a-0576-44c8-a19b-a3a32216bf4c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:09.677087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bc07a-0576-44c8-a19b-a3a32216bf4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:09.707264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:09.743769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bc07a-0576-44c8-a19b-a3a32216bf4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:09.745182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bc07a-0576-44c8-a19b-a3a32216bf4c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:09.843040 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 610/1214] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:21:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:09.849041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2da2d6-9216-47d3-ac5b-290472bcfea3 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:09.868589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:09.946308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2da2d6-9216-47d3-ac5b-290472bcfea3 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:09.980598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9427d-ba04-4e25-ab9a-46d3953d596a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:09.981223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9427d-ba04-4e25-ab9a-46d3953d596a None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:09.981497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9427d-ba04-4e25-ab9a-46d3953d596a None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:09.981766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9427d-ba04-4e25-ab9a-46d3953d596a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:09.992461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9427d-ba04-4e25-ab9a-46d3953d596a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:09.993931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9427d-ba04-4e25-ab9a-46d3953d596a None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:10.008883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-e9d9427d-ba04-4e25-ab9a-46d3953d596a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:10.008883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:10.008883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:10.008883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:10.008883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:10.008883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:10.008883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:10.008883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:10.008883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:10.008883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:10.008883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:10.008883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:10.008883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:21:10.008883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:21:10.008883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:21:10.008883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:21:10.010040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:10.010040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:10.010040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:10.010040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:10.010040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:10.010040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:10.010040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:10.010040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:10.010040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:10.010040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:10.010040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:10.010040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:10.010040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:10.010040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:10.010040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:10.010040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:10.010040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:21:10.011145 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:21:10.011145 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:10.011145 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:21:10.011145 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 605/1215] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:10.016137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bc07a-0576-44c8-a19b-a3a32216bf4c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:10.076474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:10.115310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bc07a-0576-44c8-a19b-a3a32216bf4c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:10.150089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097530e-56f2-4f7f-a320-e7a0cc0ff568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:10.150685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097530e-56f2-4f7f-a320-e7a0cc0ff568 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:10.150961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097530e-56f2-4f7f-a320-e7a0cc0ff568 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:10.151232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097530e-56f2-4f7f-a320-e7a0cc0ff568 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:10.151946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097530e-56f2-4f7f-a320-e7a0cc0ff568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:10.152270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097530e-56f2-4f7f-a320-e7a0cc0ff568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:10.153618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097530e-56f2-4f7f-a320-e7a0cc0ff568 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:10.165298 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 611/1216] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:10.170971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9427d-ba04-4e25-ab9a-46d3953d596a None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:10.242670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:10.273750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9427d-ba04-4e25-ab9a-46d3953d596a None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:10.306814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1762a-c108-4ac0-b107-d13de6ba9719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:10.307475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1762a-c108-4ac0-b107-d13de6ba9719 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:10.307741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1762a-c108-4ac0-b107-d13de6ba9719 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:10.308034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1762a-c108-4ac0-b107-d13de6ba9719 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:10.315085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1762a-c108-4ac0-b107-d13de6ba9719 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:10.316600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1762a-c108-4ac0-b107-d13de6ba9719 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:10.328409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-1cf1762a-c108-4ac0-b107-d13de6ba9719 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:21:10.328409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:10.328409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:10.328409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:10.328409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:10.328409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:10.328409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:10.328409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:10.328409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:10.328409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:10.328409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:10.328409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:10.328409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:21:10.328409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:21:10.328409 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:21:10.329490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:21:10.329490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:10.329490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:10.329490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:10.329490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:10.329490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:10.329490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:10.329490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:10.329490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:10.329490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:10.329490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:10.329490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:10.329490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:10.329490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:10.329490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:10.329490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:10.329490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:10.330784 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:21:10.330784 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:21:10.330784 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:21:10.330784 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:21:10.330784 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:21:10.330784 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:21:10.330784 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:21:10.330784 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:21:10.330784 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 606/1217] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:21:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:10.335416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097530e-56f2-4f7f-a320-e7a0cc0ff568 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:10.435663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097530e-56f2-4f7f-a320-e7a0cc0ff568 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:10.457851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:10.469175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7cc72-e542-4ce2-84a5-a2945805b7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:10.469775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7cc72-e542-4ce2-84a5-a2945805b7b9 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:10.470055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7cc72-e542-4ce2-84a5-a2945805b7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:10.470326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7cc72-e542-4ce2-84a5-a2945805b7b9 None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:10.471014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7cc72-e542-4ce2-84a5-a2945805b7b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:10.471319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7cc72-e542-4ce2-84a5-a2945805b7b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:10.472782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7cc72-e542-4ce2-84a5-a2945805b7b9 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:10.484284 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 612/1218] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:21:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:10.490505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1762a-c108-4ac0-b107-d13de6ba9719 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:10.590138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1762a-c108-4ac0-b107-d13de6ba9719 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:10.618058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:10.623426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d30d2-1b04-4dbe-ad66-1b5e43725ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:10.624102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d30d2-1b04-4dbe-ad66-1b5e43725ab3 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:10.624403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d30d2-1b04-4dbe-ad66-1b5e43725ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:10.624670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d30d2-1b04-4dbe-ad66-1b5e43725ab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:10.625380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d30d2-1b04-4dbe-ad66-1b5e43725ab3 None admin] RBAC: Adding query filter params (role.id=127770d936b94a5da885e721233e7f7b, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=702086569a63418685711c4c134b1482) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:10.625682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d30d2-1b04-4dbe-ad66-1b5e43725ab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:10.627079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d30d2-1b04-4dbe-ad66-1b5e43725ab3 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:10.632365 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 607/1219] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:21:10 2022] GET /identity/v3/role_assignments?user.id=702086569a63418685711c4c134b1482&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=127770d936b94a5da885e721233e7f7b => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:12.572087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e5901-4b0e-4084-b20d-8c92517827d3 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:12.572745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e5901-4b0e-4084-b20d-8c92517827d3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:12.572745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e5901-4b0e-4084-b20d-8c92517827d3 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:12.573992 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 613/1220] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:21:12.579176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e82e7-4e8a-4470-bc2a-f5937782618c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:12.579574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e82e7-4e8a-4470-bc2a-f5937782618c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:12.579727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e82e7-4e8a-4470-bc2a-f5937782618c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:12.598119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e42e82e7-4e8a-4470-bc2a-f5937782618c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:21:12.599310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e42e82e7-4e8a-4470-bc2a-f5937782618c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:21:12.668651 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 608/1221] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:21:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:21:12.946746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e5901-4b0e-4084-b20d-8c92517827d3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:13.048381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e5901-4b0e-4084-b20d-8c92517827d3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:13.082354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d7615-fe2c-421d-bce2-b0992f2bb87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:13.082976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d7615-fe2c-421d-bce2-b0992f2bb87d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:13.083255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d7615-fe2c-421d-bce2-b0992f2bb87d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:13.083528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d7615-fe2c-421d-bce2-b0992f2bb87d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:13.094276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d7615-fe2c-421d-bce2-b0992f2bb87d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:21:13.099052 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-f32d7615-fe2c-421d-bce2-b0992f2bb87d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:21:13.099052 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:13.099052 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:13.099052 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:13.099052 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:13.099052 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:13.099052 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:13.099052 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:13.099052 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:13.099052 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:13.099052 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:13.099052 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:13.099052 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:21:13.099052 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:21:13.099052 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:21:13.099052 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:21:13.100427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:21:13.100427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:21:13.100427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:21:13.100427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:21:13.100427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:13.100427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:13.100427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:13.100427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:13.100427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:13.100427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:13.100427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:13.100427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:13.100427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:13.100427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:13.100427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:13.100427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:13.101679 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:13.101679 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:13.101679 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:13.101679 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:13.101679 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:21:13.101679 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:21:13.101679 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:21:13.101679 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:21:13.101679 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:21:13.101679 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:21:13.101679 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:21:13.101679 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:13.101679 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 614/1222] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:21:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:13.106369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e82e7-4e8a-4470-bc2a-f5937782618c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:13.207562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e82e7-4e8a-4470-bc2a-f5937782618c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:13.231248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:13.242306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4a610-d9aa-447a-8997-292e8e7b83aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:13.246227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4a610-d9aa-447a-8997-292e8e7b83aa None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:13.246227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4a610-d9aa-447a-8997-292e8e7b83aa None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:13.246227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4a610-d9aa-447a-8997-292e8e7b83aa None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:13.246227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4a610-d9aa-447a-8997-292e8e7b83aa None admin] RBAC: Adding query filter params (name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:13.246227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4a610-d9aa-447a-8997-292e8e7b83aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:13.246227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4a610-d9aa-447a-8997-292e8e7b83aa None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:13.253646 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 609/1223] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:21:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:13.260457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d7615-fe2c-421d-bce2-b0992f2bb87d None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:13.304730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:13.359359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d7615-fe2c-421d-bce2-b0992f2bb87d None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:13.393432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ef8a5-b9a9-4e79-b478-7a4a23b7a13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:13.394137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ef8a5-b9a9-4e79-b478-7a4a23b7a13a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:13.394339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ef8a5-b9a9-4e79-b478-7a4a23b7a13a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:13.394707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ef8a5-b9a9-4e79-b478-7a4a23b7a13a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:13.404719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ef8a5-b9a9-4e79-b478-7a4a23b7a13a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:13.406147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ef8a5-b9a9-4e79-b478-7a4a23b7a13a None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:13.421731 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-cc3ef8a5-b9a9-4e79-b478-7a4a23b7a13a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:13.421731 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:13.421731 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:13.421731 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:13.421731 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:13.421731 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:13.421731 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:13.421731 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:13.421731 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:13.421731 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:13.421731 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:13.421731 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:13.421731 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:21:13.421731 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:21:13.421731 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:21:13.421731 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:21:13.422924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:13.422924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:13.422924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:13.422924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:13.422924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:13.422924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:13.422924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:13.422924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:13.422924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:13.422924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:13.422924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:13.422924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:13.422924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:13.422924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:13.422924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:13.422924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:13.422924 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:21:13.424027 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:21:13.424027 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:13.424027 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:13.424027 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 615/1224] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:13.429472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4a610-d9aa-447a-8997-292e8e7b83aa None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:13.530189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4a610-d9aa-447a-8997-292e8e7b83aa None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:13.563947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f45d35-40be-441d-a41f-442dd4738fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:13.564577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f45d35-40be-441d-a41f-442dd4738fa5 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:13.564856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f45d35-40be-441d-a41f-442dd4738fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:13.565128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f45d35-40be-441d-a41f-442dd4738fa5 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:13.565757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f45d35-40be-441d-a41f-442dd4738fa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:13.566055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f45d35-40be-441d-a41f-442dd4738fa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:13.567402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f45d35-40be-441d-a41f-442dd4738fa5 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:13.579037 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 610/1225] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:13.584755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ef8a5-b9a9-4e79-b478-7a4a23b7a13a None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:13.681819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:13.688533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ef8a5-b9a9-4e79-b478-7a4a23b7a13a None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:13.721638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c376409-8a21-4df0-8d06-0702fbd85679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:13.722393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c376409-8a21-4df0-8d06-0702fbd85679 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:13.722672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c376409-8a21-4df0-8d06-0702fbd85679 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:13.722943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c376409-8a21-4df0-8d06-0702fbd85679 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:13.731222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c376409-8a21-4df0-8d06-0702fbd85679 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:13.732804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c376409-8a21-4df0-8d06-0702fbd85679 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:13.744667 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-0c376409-8a21-4df0-8d06-0702fbd85679 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:21:13.744667 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:13.744667 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:13.744667 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:13.744667 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:13.744667 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:13.744667 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:13.744667 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:13.744667 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:13.744667 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:13.744667 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:13.744667 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:13.744667 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:21:13.744667 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:21:13.744667 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:21:13.744667 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:13.748684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:13.749697 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:13.749697 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:13.749697 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:21:13.749697 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:21:13.749697 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:21:13.749697 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:21:13.749697 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:21:13.749697 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:21:13.749697 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:21:13.749697 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:13.749697 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 616/1226] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:13.751678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f45d35-40be-441d-a41f-442dd4738fa5 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:13.798780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:13.851654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f45d35-40be-441d-a41f-442dd4738fa5 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:13.885614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ce02d-549d-47bf-8561-db9b61876b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:13.886213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ce02d-549d-47bf-8561-db9b61876b0e None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:13.886767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ce02d-549d-47bf-8561-db9b61876b0e None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:13.887249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ce02d-549d-47bf-8561-db9b61876b0e None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:13.887975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ce02d-549d-47bf-8561-db9b61876b0e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:13.888376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ce02d-549d-47bf-8561-db9b61876b0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:13.890619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ce02d-549d-47bf-8561-db9b61876b0e None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:13.907693 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 611/1227] 10.222.0.76 () {56 vars in 1143 bytes} [Sat Aug 27 04:21:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:13.914122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c376409-8a21-4df0-8d06-0702fbd85679 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:14.014617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c376409-8a21-4df0-8d06-0702fbd85679 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:14.048608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1b528-a9a0-407d-b155-af5dab3069b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:14.049279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1b528-a9a0-407d-b155-af5dab3069b5 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:14.049514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1b528-a9a0-407d-b155-af5dab3069b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:14.049788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1b528-a9a0-407d-b155-af5dab3069b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:14.060248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1b528-a9a0-407d-b155-af5dab3069b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:14.061691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1b528-a9a0-407d-b155-af5dab3069b5 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:14.075315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-77a1b528-a9a0-407d-b155-af5dab3069b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:14.075315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:14.075315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:14.075315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:14.075315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:14.075315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:14.075315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:14.075315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:14.075315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:14.075315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:14.075315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:14.075315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:14.075315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:21:14.075315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:21:14.075315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:21:14.075315 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:21:14.076809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:14.076809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:14.076809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:14.076809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:14.076809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:14.076809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:14.076809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:14.076809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:14.076809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:14.076809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:14.076809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:14.076809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:14.076809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:14.076809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:14.076809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:14.076809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:14.076809 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:21:14.077704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:21:14.077704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:14.077704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:14.077704 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 617/1228] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:14.082329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ce02d-549d-47bf-8561-db9b61876b0e None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:14.184049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ce02d-549d-47bf-8561-db9b61876b0e None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:14.186318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:14.217618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41ad60-8751-4883-bf86-b0c883998f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:14.218303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41ad60-8751-4883-bf86-b0c883998f60 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:14.218777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41ad60-8751-4883-bf86-b0c883998f60 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:14.219304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41ad60-8751-4883-bf86-b0c883998f60 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:14.220329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41ad60-8751-4883-bf86-b0c883998f60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:14.220646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41ad60-8751-4883-bf86-b0c883998f60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:14.222011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41ad60-8751-4883-bf86-b0c883998f60 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:14.235011 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 612/1229] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:14.240867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1b528-a9a0-407d-b155-af5dab3069b5 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:14.250327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:14.342939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1b528-a9a0-407d-b155-af5dab3069b5 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:14.376837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f320a-d02d-40fd-9f8c-974f84f8f98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:14.381562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f320a-d02d-40fd-9f8c-974f84f8f98e None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:14.381562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f320a-d02d-40fd-9f8c-974f84f8f98e None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:14.381562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f320a-d02d-40fd-9f8c-974f84f8f98e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:14.385222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f320a-d02d-40fd-9f8c-974f84f8f98e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:14.386948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f320a-d02d-40fd-9f8c-974f84f8f98e None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:14.398799 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-bc1f320a-d02d-40fd-9f8c-974f84f8f98e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:21:14.398799 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:14.398799 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:14.398799 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:14.398799 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:14.398799 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:14.398799 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:14.398799 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:14.398799 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:14.398799 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:14.398799 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:14.398799 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:14.398799 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:21:14.398799 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:21:14.398799 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:21:14.399853 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:21:14.399853 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:14.399853 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:14.399853 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:14.399853 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:14.399853 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:14.399853 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:14.399853 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:14.399853 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:14.399853 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:14.399853 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:14.399853 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:14.399853 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:14.399853 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:14.399853 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:14.399853 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:14.399853 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:14.408530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:21:14.408530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:21:14.408530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:21:14.408530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:21:14.408530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:21:14.408530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:21:14.408530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:21:14.408530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:14.408530 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 618/1230] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:21:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:14.409153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41ad60-8751-4883-bf86-b0c883998f60 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:14.504994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41ad60-8751-4883-bf86-b0c883998f60 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:14.539637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d303804-35b6-4a2e-b511-8710719e269f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:14.540269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d303804-35b6-4a2e-b511-8710719e269f None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:14.540552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d303804-35b6-4a2e-b511-8710719e269f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:14.540825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d303804-35b6-4a2e-b511-8710719e269f None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:14.541506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d303804-35b6-4a2e-b511-8710719e269f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:14.541812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d303804-35b6-4a2e-b511-8710719e269f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:14.543228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d303804-35b6-4a2e-b511-8710719e269f None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:14.555343 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 613/1231] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:21:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:14.561479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f320a-d02d-40fd-9f8c-974f84f8f98e None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:14.628298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:14.664434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f320a-d02d-40fd-9f8c-974f84f8f98e None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:14.697500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485516e-d288-4b55-8be2-cda6ffe35e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:14.698199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485516e-d288-4b55-8be2-cda6ffe35e27 None admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:14.698475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485516e-d288-4b55-8be2-cda6ffe35e27 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:14.698752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485516e-d288-4b55-8be2-cda6ffe35e27 None admin] PATH_INFO: `/v3/projects/5632b718c3aa48458247661045e99e5f/users/702086569a63418685711c4c134b1482/roles/127770d936b94a5da885e721233e7f7b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:14.713347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485516e-d288-4b55-8be2-cda6ffe35e27 None admin] RBAC: Authorizing `identity:create_grant(project_id=5632b718c3aa48458247661045e99e5f, user_id=702086569a63418685711c4c134b1482, role_id=127770d936b94a5da885e721233e7f7b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:14.714790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485516e-d288-4b55-8be2-cda6ffe35e27 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:14.813990 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 619/1232] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:21:14 2022] PUT /identity/v3/projects/5632b718c3aa48458247661045e99e5f/users/702086569a63418685711c4c134b1482/roles/127770d936b94a5da885e721233e7f7b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:21:16.744890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bec97c-c28d-4d76-bc14-1b34ec543fe3 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:16.745727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bec97c-c28d-4d76-bc14-1b34ec543fe3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:16.745898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bec97c-c28d-4d76-bc14-1b34ec543fe3 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:16.747236 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 614/1233] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:21:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:21:16.752763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc5d58-fd06-42ee-851c-35b297f850f1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:16.765293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc5d58-fd06-42ee-851c-35b297f850f1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:16.765293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc5d58-fd06-42ee-851c-35b297f850f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:16.771361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6fdc5d58-fd06-42ee-851c-35b297f850f1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:21:16.772591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6fdc5d58-fd06-42ee-851c-35b297f850f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:21:16.839836 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 620/1234] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:21:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:21:17.126017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bec97c-c28d-4d76-bc14-1b34ec543fe3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:17.152534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:17.228079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bec97c-c28d-4d76-bc14-1b34ec543fe3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:17.262030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00a62b-9ecc-421a-b912-9e72a243c680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:17.262647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00a62b-9ecc-421a-b912-9e72a243c680 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:17.262920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00a62b-9ecc-421a-b912-9e72a243c680 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:17.263179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00a62b-9ecc-421a-b912-9e72a243c680 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:17.274951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00a62b-9ecc-421a-b912-9e72a243c680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:21:17.279792 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-7a00a62b-9ecc-421a-b912-9e72a243c680 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:21:17.279792 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:17.279792 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:17.279792 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:17.279792 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:17.279792 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:17.279792 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:17.279792 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:17.279792 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:17.279792 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:17.279792 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:17.279792 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:17.279792 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:21:17.279792 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:21:17.279792 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:21:17.279792 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:21:17.282567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:21:17.282567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:21:17.282567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:21:17.282567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:21:17.282567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:17.282567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:17.282567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:17.282567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:17.282567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:17.282567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:17.282567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:17.282567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:17.282567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:17.282567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:17.282567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:17.282567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:17.283594 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:17.283594 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:17.283594 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:17.283594 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:17.283594 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:21:17.283594 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:21:17.283594 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:21:17.283594 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:21:17.283594 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:21:17.283594 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:21:17.283594 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 04:21:17.283594 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:21:17.283594 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 615/1235] 10.222.0.76 () {56 vars in 1102 bytes} [Sat Aug 27 04:21:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:17.286982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc5d58-fd06-42ee-851c-35b297f850f1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:17.333548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:17.387872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc5d58-fd06-42ee-851c-35b297f850f1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:17.422725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9c7ae-6c21-4550-bf78-4278f399d187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:17.423320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9c7ae-6c21-4550-bf78-4278f399d187 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:17.423602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9c7ae-6c21-4550-bf78-4278f399d187 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:17.423874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9c7ae-6c21-4550-bf78-4278f399d187 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:17.424567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9c7ae-6c21-4550-bf78-4278f399d187 None admin] RBAC: Adding query filter params (name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:17.424871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9c7ae-6c21-4550-bf78-4278f399d187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:17.426242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9c7ae-6c21-4550-bf78-4278f399d187 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:17.434517 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 621/1236] 10.222.0.76 () {56 vars in 1103 bytes} [Sat Aug 27 04:21:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:17.440380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00a62b-9ecc-421a-b912-9e72a243c680 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:17.525991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:17.542754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00a62b-9ecc-421a-b912-9e72a243c680 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:17.576341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed1057-99bc-4e64-a042-bbff260bdc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:17.576956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1057-99bc-4e64-a042-bbff260bdc37 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:17.577235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1057-99bc-4e64-a042-bbff260bdc37 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:17.577507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1057-99bc-4e64-a042-bbff260bdc37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:17.588362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed1057-99bc-4e64-a042-bbff260bdc37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:17.589808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed1057-99bc-4e64-a042-bbff260bdc37 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:17.605716 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-65ed1057-99bc-4e64-a042-bbff260bdc37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:17.605716 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:17.605716 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:17.605716 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:17.605716 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:17.605716 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:17.605716 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:17.605716 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:17.605716 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:17.605716 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:17.605716 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:17.605716 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:17.605716 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:21:17.605716 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:21:17.605716 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:21:17.605716 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:21:17.606878 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:17.606878 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:17.606878 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:17.606878 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:17.606878 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:17.606878 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:17.606878 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:17.606878 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:17.606878 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:17.606878 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:17.606878 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:17.606878 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:17.606878 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:17.606878 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:17.606878 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:17.606878 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:17.606878 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:21:17.607811 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:21:17.607811 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:17.607811 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:21:17.607811 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 616/1237] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:17.612974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9c7ae-6c21-4550-bf78-4278f399d187 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:17.715181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9c7ae-6c21-4550-bf78-4278f399d187 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:17.724230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:17.749765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b198-5b55-4e7b-8f21-5130f9fa9460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:17.750363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b198-5b55-4e7b-8f21-5130f9fa9460 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:17.750665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b198-5b55-4e7b-8f21-5130f9fa9460 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:17.750916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b198-5b55-4e7b-8f21-5130f9fa9460 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:17.751550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800b198-5b55-4e7b-8f21-5130f9fa9460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:17.751850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800b198-5b55-4e7b-8f21-5130f9fa9460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:17.753258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800b198-5b55-4e7b-8f21-5130f9fa9460 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:17.765295 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 622/1238] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:17.771154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed1057-99bc-4e64-a042-bbff260bdc37 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:17.872255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed1057-99bc-4e64-a042-bbff260bdc37 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:17.906096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4873e22-eba5-4b14-8ab1-3aac90b0d1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:17.906712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4873e22-eba5-4b14-8ab1-3aac90b0d1a1 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:17.906992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4873e22-eba5-4b14-8ab1-3aac90b0d1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:17.907261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4873e22-eba5-4b14-8ab1-3aac90b0d1a1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:17.909941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:17.917523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4873e22-eba5-4b14-8ab1-3aac90b0d1a1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:17.918945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4873e22-eba5-4b14-8ab1-3aac90b0d1a1 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:17.930406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-d4873e22-eba5-4b14-8ab1-3aac90b0d1a1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:21:17.930406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:17.930406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:17.930406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:17.930406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:17.930406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:17.930406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:17.930406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:17.930406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:17.930406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:17.930406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:17.930406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:17.930406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:21:17.930406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:21:17.930406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:21:17.930406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:17.931332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:17.932580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:17.932580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:17.932580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:21:17.932580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:21:17.932580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:21:17.932580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:21:17.932580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:21:17.932580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:21:17.932580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:21:17.932580 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:21:17.932580 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 617/1239] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:17.937722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b198-5b55-4e7b-8f21-5130f9fa9460 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:18.038750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b198-5b55-4e7b-8f21-5130f9fa9460 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:18.072969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d689f4-574a-46d3-ae7f-7b901f2b6dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:18.073666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d689f4-574a-46d3-ae7f-7b901f2b6dac None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:18.073951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d689f4-574a-46d3-ae7f-7b901f2b6dac None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:18.074221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d689f4-574a-46d3-ae7f-7b901f2b6dac None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:18.074943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d689f4-574a-46d3-ae7f-7b901f2b6dac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:18.075326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d689f4-574a-46d3-ae7f-7b901f2b6dac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:18.076788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d689f4-574a-46d3-ae7f-7b901f2b6dac None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:18.093997 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 623/1240] 10.222.0.76 () {56 vars in 1143 bytes} [Sat Aug 27 04:21:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:18.099939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4873e22-eba5-4b14-8ab1-3aac90b0d1a1 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:18.203055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4873e22-eba5-4b14-8ab1-3aac90b0d1a1 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:18.236844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272811ee-5926-425b-a06f-d6e186edce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:18.237441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272811ee-5926-425b-a06f-d6e186edce46 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:18.237723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272811ee-5926-425b-a06f-d6e186edce46 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:18.237997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272811ee-5926-425b-a06f-d6e186edce46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:18.300397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:18.306895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272811ee-5926-425b-a06f-d6e186edce46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:18.308374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272811ee-5926-425b-a06f-d6e186edce46 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:18.407004 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 618/1241] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:21:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:18.413105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d689f4-574a-46d3-ae7f-7b901f2b6dac None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:18.451623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:18.522455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d689f4-574a-46d3-ae7f-7b901f2b6dac None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:18.557602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ae5d7-cb0b-49fa-9eb6-1006cfee0f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:18.558141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ae5d7-cb0b-49fa-9eb6-1006cfee0f49 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:18.558420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ae5d7-cb0b-49fa-9eb6-1006cfee0f49 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:18.558694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ae5d7-cb0b-49fa-9eb6-1006cfee0f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:18.568579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ae5d7-cb0b-49fa-9eb6-1006cfee0f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:18.571021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ae5d7-cb0b-49fa-9eb6-1006cfee0f49 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:18.585704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-dd7ae5d7-cb0b-49fa-9eb6-1006cfee0f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:18.585704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:18.585704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:18.585704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:18.585704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:18.585704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:18.585704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:18.585704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:18.585704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:18.585704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:18.585704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:18.585704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:18.585704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:21:18.585704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:21:18.585704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:21:18.585704 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:21:18.586860 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:18.586860 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:18.586860 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:18.586860 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:18.586860 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:18.586860 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:18.586860 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:18.586860 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:18.586860 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:18.586860 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:18.586860 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:18.586860 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:18.586860 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:18.586860 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:18.586860 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:18.586860 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:18.586860 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:21:18.588004 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:21:18.588004 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:18.588004 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:18.591484 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 624/1242] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:18.592728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272811ee-5926-425b-a06f-d6e186edce46 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:18.688102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:18.693756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272811ee-5926-425b-a06f-d6e186edce46 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:18.728010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eb1d3-09e1-4aed-aaff-737244bc7564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:18.728634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eb1d3-09e1-4aed-aaff-737244bc7564 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:18.728912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eb1d3-09e1-4aed-aaff-737244bc7564 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:18.729180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eb1d3-09e1-4aed-aaff-737244bc7564 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:18.729814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7eb1d3-09e1-4aed-aaff-737244bc7564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:18.730117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7eb1d3-09e1-4aed-aaff-737244bc7564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:18.731517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7eb1d3-09e1-4aed-aaff-737244bc7564 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:18.742705 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 619/1243] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:18.748600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ae5d7-cb0b-49fa-9eb6-1006cfee0f49 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:18.831322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:18.852254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ae5d7-cb0b-49fa-9eb6-1006cfee0f49 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:18.885243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03f2c1-d2d6-4216-8e93-123f3ceb25f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:18.885873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03f2c1-d2d6-4216-8e93-123f3ceb25f5 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:18.886155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03f2c1-d2d6-4216-8e93-123f3ceb25f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:18.886428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03f2c1-d2d6-4216-8e93-123f3ceb25f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:18.893208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03f2c1-d2d6-4216-8e93-123f3ceb25f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:18.894647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03f2c1-d2d6-4216-8e93-123f3ceb25f5 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:18.907213 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-ba03f2c1-d2d6-4216-8e93-123f3ceb25f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:21:18.907213 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:18.907213 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:18.907213 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:18.907213 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:18.907213 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:18.907213 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:18.907213 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:18.907213 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:18.907213 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:18.907213 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:18.907213 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:18.907213 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:21:18.907213 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:21:18.907213 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:21:18.913242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:21:18.913242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:18.913242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:18.913242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:18.913242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:18.913242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:18.913242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:18.913242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:18.913242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:18.913242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:18.913242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:18.913242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:18.913242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:18.913242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:18.913242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:18.913242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:18.913242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:18.914426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:21:18.914426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:21:18.914426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:21:18.914426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:21:18.914426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:21:18.914426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:21:18.914426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:21:18.914426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:18.914426 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 625/1244] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:21:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:18.915105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eb1d3-09e1-4aed-aaff-737244bc7564 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:19.028117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eb1d3-09e1-4aed-aaff-737244bc7564 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:19.060652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91d99e-dc67-406a-be41-782cbf5b2070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:19.061253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91d99e-dc67-406a-be41-782cbf5b2070 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:19.061530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91d99e-dc67-406a-be41-782cbf5b2070 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:19.061800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91d99e-dc67-406a-be41-782cbf5b2070 None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:19.062483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91d99e-dc67-406a-be41-782cbf5b2070 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:19.062866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91d99e-dc67-406a-be41-782cbf5b2070 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:19.064466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91d99e-dc67-406a-be41-782cbf5b2070 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:19.077612 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 620/1245] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:21:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:21:19.084230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03f2c1-d2d6-4216-8e93-123f3ceb25f5 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:19.184873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03f2c1-d2d6-4216-8e93-123f3ceb25f5 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:19.217634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545c87c-51de-434f-8bf6-1a5df4db1af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:19.218219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545c87c-51de-434f-8bf6-1a5df4db1af4 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:19.218496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545c87c-51de-434f-8bf6-1a5df4db1af4 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:19.218767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545c87c-51de-434f-8bf6-1a5df4db1af4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:19.219488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545c87c-51de-434f-8bf6-1a5df4db1af4 None admin] RBAC: Adding query filter params (role.id=127770d936b94a5da885e721233e7f7b, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=702086569a63418685711c4c134b1482) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:19.219792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545c87c-51de-434f-8bf6-1a5df4db1af4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:19.221242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545c87c-51de-434f-8bf6-1a5df4db1af4 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:19.226988 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 626/1246] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:21:19 2022] GET /identity/v3/role_assignments?user.id=702086569a63418685711c4c134b1482&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=127770d936b94a5da885e721233e7f7b => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:21.215743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c1905-e74b-4fb2-b553-c3018eeaba4f None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:21.216287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c1905-e74b-4fb2-b553-c3018eeaba4f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:21.216287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c1905-e74b-4fb2-b553-c3018eeaba4f None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:21.217754 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 621/1247] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:21:21.222716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e174b-9891-47a6-8538-0dbf576ff10f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:21.223095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e174b-9891-47a6-8538-0dbf576ff10f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:21.223278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e174b-9891-47a6-8538-0dbf576ff10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:21.229665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:21.242068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c68e174b-9891-47a6-8538-0dbf576ff10f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:21:21.243250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c68e174b-9891-47a6-8538-0dbf576ff10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:21:21.307234 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 627/1248] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:21:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:21:21.605759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c1905-e74b-4fb2-b553-c3018eeaba4f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:21.624541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:21.709074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c1905-e74b-4fb2-b553-c3018eeaba4f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:21.743306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7349c-c420-4ac7-8432-905ea26f02b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:21.743917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7349c-c420-4ac7-8432-905ea26f02b2 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:21.744213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7349c-c420-4ac7-8432-905ea26f02b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:21.744486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7349c-c420-4ac7-8432-905ea26f02b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:21.754403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7349c-c420-4ac7-8432-905ea26f02b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:21:21.759990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-c6c7349c-c420-4ac7-8432-905ea26f02b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:21:21.759990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:21.759990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:21.759990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:21.759990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:21.759990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:21.759990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:21.759990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:21.759990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:21.759990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:21.759990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:21.759990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:21.759990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:21:21.759990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:21:21.759990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:21:21.759990 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:21:21.761255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:21:21.761255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:21:21.761255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:21:21.761255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:21:21.761255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:21.761255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:21.761255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:21.761255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:21.761255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:21.761255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:21.761255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:21.761255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:21.761255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:21.761255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:21.761255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:21.761255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:21.762724 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:21.762724 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:21.762724 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:21.762724 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:21.762724 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:21:21.762724 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:21:21.762724 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:21:21.762724 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:21:21.762724 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:21:21.762724 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:21:21.762724 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:21:21.762724 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:21:21.762724 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 622/1249] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:21:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:21.769111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e174b-9891-47a6-8538-0dbf576ff10f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:21.878521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e174b-9891-47a6-8538-0dbf576ff10f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:21.908843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:21.913972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c8329-835c-41b5-b0f8-7f869bfc544c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:21.914575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c8329-835c-41b5-b0f8-7f869bfc544c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:21.914861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c8329-835c-41b5-b0f8-7f869bfc544c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:21.915146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c8329-835c-41b5-b0f8-7f869bfc544c None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:21.915808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c8329-835c-41b5-b0f8-7f869bfc544c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:21.916130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c8329-835c-41b5-b0f8-7f869bfc544c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:21.917505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c8329-835c-41b5-b0f8-7f869bfc544c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:21.925686 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 628/1250] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:21:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:21.931323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7349c-c420-4ac7-8432-905ea26f02b2 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:22.011797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:22.034400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7349c-c420-4ac7-8432-905ea26f02b2 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:22.067968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78d90f-de15-4753-b8ed-709f03fcbeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:22.068630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78d90f-de15-4753-b8ed-709f03fcbeb3 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:22.068910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78d90f-de15-4753-b8ed-709f03fcbeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:22.069180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78d90f-de15-4753-b8ed-709f03fcbeb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:22.080258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78d90f-de15-4753-b8ed-709f03fcbeb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:22.081683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78d90f-de15-4753-b8ed-709f03fcbeb3 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:22.096840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-ff78d90f-de15-4753-b8ed-709f03fcbeb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:22.096840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:22.096840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:22.096840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:22.096840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:22.096840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:22.096840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:22.096840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:22.096840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:22.096840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:22.096840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:22.096840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:22.096840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:21:22.096840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:21:22.096840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:21:22.096840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:21:22.102753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:22.102753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:22.102753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:22.102753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:22.102753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:22.102753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:22.102753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:22.102753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:22.102753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:22.102753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:22.102753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:22.102753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:22.102753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:22.102753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:22.102753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:22.102753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:22.102753 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:21:22.103735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:21:22.103735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:22.103735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:21:22.103735 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 623/1251] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:22.103975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c8329-835c-41b5-b0f8-7f869bfc544c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:22.216270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c8329-835c-41b5-b0f8-7f869bfc544c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:22.249833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def31ea-9d97-404f-ad11-45a402525f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:22.250480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def31ea-9d97-404f-ad11-45a402525f86 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:22.250783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def31ea-9d97-404f-ad11-45a402525f86 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:22.251052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def31ea-9d97-404f-ad11-45a402525f86 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:22.251684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def31ea-9d97-404f-ad11-45a402525f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:22.251983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def31ea-9d97-404f-ad11-45a402525f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:22.253366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def31ea-9d97-404f-ad11-45a402525f86 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:22.265752 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 629/1252] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:22.271534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78d90f-de15-4753-b8ed-709f03fcbeb3 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:22.381393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78d90f-de15-4753-b8ed-709f03fcbeb3 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:22.407594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:22.415162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcd400-32d4-42b1-9965-611baba34949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:22.415776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcd400-32d4-42b1-9965-611baba34949 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:22.416049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcd400-32d4-42b1-9965-611baba34949 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:22.416348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcd400-32d4-42b1-9965-611baba34949 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:22.423582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcd400-32d4-42b1-9965-611baba34949 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:22.425036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcd400-32d4-42b1-9965-611baba34949 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:22.436969 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-ccbcd400-32d4-42b1-9965-611baba34949 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:21:22.436969 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:22.436969 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:22.436969 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:22.436969 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:22.436969 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:22.436969 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:22.436969 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:22.436969 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:22.436969 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:22.436969 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:22.436969 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:22.436969 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:21:22.436969 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:21:22.436969 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:21:22.436969 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:22.438194 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:22.439394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:22.439394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:22.439394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:21:22.439394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:21:22.439394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:21:22.439394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:21:22.439394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:21:22.439394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:21:22.439394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:21:22.439394 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:21:22.439394 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 624/1253] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:22.443823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def31ea-9d97-404f-ad11-45a402525f86 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:22.502250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:22.547067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def31ea-9d97-404f-ad11-45a402525f86 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:22.581573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2bc7b-9e23-4b8e-9166-277cc5631d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:22.582168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2bc7b-9e23-4b8e-9166-277cc5631d71 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:22.582446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2bc7b-9e23-4b8e-9166-277cc5631d71 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:22.582713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2bc7b-9e23-4b8e-9166-277cc5631d71 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:22.583432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2bc7b-9e23-4b8e-9166-277cc5631d71 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:22.583727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2bc7b-9e23-4b8e-9166-277cc5631d71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:22.585237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2bc7b-9e23-4b8e-9166-277cc5631d71 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:22.603154 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 630/1254] 10.222.0.76 () {56 vars in 1143 bytes} [Sat Aug 27 04:21:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:22.609062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcd400-32d4-42b1-9965-611baba34949 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:22.711805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcd400-32d4-42b1-9965-611baba34949 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:22.745497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311371bf-ca38-4767-ad3d-c8fbc6b32740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:22.746104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311371bf-ca38-4767-ad3d-c8fbc6b32740 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:22.746383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311371bf-ca38-4767-ad3d-c8fbc6b32740 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:22.746653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311371bf-ca38-4767-ad3d-c8fbc6b32740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:22.802208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:22.814008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311371bf-ca38-4767-ad3d-c8fbc6b32740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:22.815448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311371bf-ca38-4767-ad3d-c8fbc6b32740 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:22.912413 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 625/1255] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:21:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:22.918374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2bc7b-9e23-4b8e-9166-277cc5631d71 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:23.026066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2bc7b-9e23-4b8e-9166-277cc5631d71 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:23.041777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:23.063023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9da7c-ff86-43d0-903b-45ab4c2c7a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:23.063575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9da7c-ff86-43d0-903b-45ab4c2c7a3d None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:23.063851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9da7c-ff86-43d0-903b-45ab4c2c7a3d None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:23.064122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9da7c-ff86-43d0-903b-45ab4c2c7a3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:23.074548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9da7c-ff86-43d0-903b-45ab4c2c7a3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:23.075974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9da7c-ff86-43d0-903b-45ab4c2c7a3d None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:23.090019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-0ce9da7c-ff86-43d0-903b-45ab4c2c7a3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:23.090019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:23.090019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:23.090019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:23.090019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:23.090019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:23.090019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:23.090019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:23.090019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:23.090019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:23.090019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:23.090019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:23.090019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:21:23.090019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:21:23.090019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:21:23.090019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:21:23.091120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:23.091120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:23.091120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:23.091120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:23.091120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:23.091120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:23.091120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:23.091120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:23.091120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:23.091120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:23.091120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:23.091120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:23.091120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:23.091120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:23.091120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:23.091120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:23.091120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:21:23.092426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:21:23.092426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:23.092426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:23.092426 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 631/1256] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:23.097416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311371bf-ca38-4767-ad3d-c8fbc6b32740 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:23.183253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:23.195090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311371bf-ca38-4767-ad3d-c8fbc6b32740 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:23.227641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f82dc-c296-4caa-b5d6-75792dff2a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:23.228265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f82dc-c296-4caa-b5d6-75792dff2a25 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:23.228543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f82dc-c296-4caa-b5d6-75792dff2a25 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:23.228811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f82dc-c296-4caa-b5d6-75792dff2a25 None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:23.229436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f82dc-c296-4caa-b5d6-75792dff2a25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:23.229734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f82dc-c296-4caa-b5d6-75792dff2a25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:23.231078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f82dc-c296-4caa-b5d6-75792dff2a25 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:23.242754 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 626/1257] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:23.248597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9da7c-ff86-43d0-903b-45ab4c2c7a3d None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:23.348586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9da7c-ff86-43d0-903b-45ab4c2c7a3d None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:23.387747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58072dac-6493-4b63-9c2f-d977fbdfc4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:23.388408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58072dac-6493-4b63-9c2f-d977fbdfc4c7 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:23.388687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58072dac-6493-4b63-9c2f-d977fbdfc4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:23.388960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58072dac-6493-4b63-9c2f-d977fbdfc4c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:23.395505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58072dac-6493-4b63-9c2f-d977fbdfc4c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:23.396981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58072dac-6493-4b63-9c2f-d977fbdfc4c7 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:23.408551 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-58072dac-6493-4b63-9c2f-d977fbdfc4c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:21:23.408551 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:23.408551 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:23.408551 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:23.408551 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:23.408551 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:23.408551 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:23.408551 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:23.408551 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:23.408551 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:23.408551 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:23.408551 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:23.408551 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:21:23.408551 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:21:23.408551 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:21:23.409611 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:21:23.409611 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:23.409611 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:23.409611 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:23.409611 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:23.409611 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:23.409611 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:23.409611 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:23.409611 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:23.409611 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:23.409611 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:23.409611 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:23.409611 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:23.409611 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:23.409611 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:23.409611 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:23.409611 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:23.410891 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:21:23.410891 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:21:23.410891 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:21:23.410891 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:21:23.410891 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:21:23.410891 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:21:23.410891 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:21:23.410891 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:23.410891 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 632/1258] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:21:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:23.416359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f82dc-c296-4caa-b5d6-75792dff2a25 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:23.526964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f82dc-c296-4caa-b5d6-75792dff2a25 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:23.568317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bacf9c-9b66-41d5-8485-ff40028816ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:23.568918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bacf9c-9b66-41d5-8485-ff40028816ab None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:23.569192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bacf9c-9b66-41d5-8485-ff40028816ab None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:23.569499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bacf9c-9b66-41d5-8485-ff40028816ab None admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:23.570180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bacf9c-9b66-41d5-8485-ff40028816ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:23.570487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bacf9c-9b66-41d5-8485-ff40028816ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:23.571965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bacf9c-9b66-41d5-8485-ff40028816ab None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:23.587339 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 627/1259] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:21:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:23.593256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58072dac-6493-4b63-9c2f-d977fbdfc4c7 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:23.622717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:23.706971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58072dac-6493-4b63-9c2f-d977fbdfc4c7 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:23.751123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059fae1-696f-4aa2-83c7-9333982f7176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:23.751821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059fae1-696f-4aa2-83c7-9333982f7176 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:23.752360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059fae1-696f-4aa2-83c7-9333982f7176 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:23.752873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059fae1-696f-4aa2-83c7-9333982f7176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:23.754011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059fae1-696f-4aa2-83c7-9333982f7176 None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=702086569a63418685711c4c134b1482) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:23.754610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059fae1-696f-4aa2-83c7-9333982f7176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:23.756274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059fae1-696f-4aa2-83c7-9333982f7176 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:23.763325 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 633/1260] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:21:23 2022] GET /identity/v3/role_assignments?user.id=702086569a63418685711c4c134b1482&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:25.699105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06ff48-dada-4fc6-a60e-d6e2c7c4acf3 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:25.699692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06ff48-dada-4fc6-a60e-d6e2c7c4acf3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:25.699692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06ff48-dada-4fc6-a60e-d6e2c7c4acf3 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:25.701005 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 628/1261] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:21:25.706173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894ae38-6540-416f-bb67-fb8b96869978 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:25.706564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894ae38-6540-416f-bb67-fb8b96869978 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:25.706725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894ae38-6540-416f-bb67-fb8b96869978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:25.725710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6894ae38-6540-416f-bb67-fb8b96869978 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:21:25.726924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6894ae38-6540-416f-bb67-fb8b96869978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:21:25.793363 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 634/1262] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:21:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:21:26.063416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06ff48-dada-4fc6-a60e-d6e2c7c4acf3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:26.075271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:26.163569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06ff48-dada-4fc6-a60e-d6e2c7c4acf3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:26.199009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f786c0a-9b1c-4911-a650-38d0a0939994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:26.199632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f786c0a-9b1c-4911-a650-38d0a0939994 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:26.199910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f786c0a-9b1c-4911-a650-38d0a0939994 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:26.200203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f786c0a-9b1c-4911-a650-38d0a0939994 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:26.209995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f786c0a-9b1c-4911-a650-38d0a0939994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:21:26.214810 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-2f786c0a-9b1c-4911-a650-38d0a0939994 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:21:26.214810 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:26.214810 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:26.214810 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:26.214810 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:26.214810 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:26.214810 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:26.214810 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:26.214810 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:26.214810 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:26.214810 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:26.214810 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:26.214810 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:21:26.214810 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:21:26.214810 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:21:26.214810 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:21:26.215886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:21:26.215886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:21:26.215886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:21:26.215886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:21:26.215886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:26.215886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:26.215886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:26.215886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:26.215886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:26.215886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:26.215886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:26.215886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:26.215886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:26.215886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:26.215886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:26.215886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:26.216805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:26.216805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:26.216805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:26.216805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:26.216805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:21:26.216805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:21:26.216805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:21:26.216805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:21:26.216805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:21:26.216805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:21:26.216805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:21:26.216805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:21:26.216805 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 629/1263] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:21:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:26.221968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894ae38-6540-416f-bb67-fb8b96869978 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:26.240033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:26.321733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894ae38-6540-416f-bb67-fb8b96869978 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:26.357996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c785be-84bf-4524-a342-010224c01961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:26.358600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c785be-84bf-4524-a342-010224c01961 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:26.358882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c785be-84bf-4524-a342-010224c01961 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:26.359183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c785be-84bf-4524-a342-010224c01961 None admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:26.359842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c785be-84bf-4524-a342-010224c01961 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:26.360147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c785be-84bf-4524-a342-010224c01961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:26.361548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c785be-84bf-4524-a342-010224c01961 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:26.370249 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 635/1264] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:21:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:26.376193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f786c0a-9b1c-4911-a650-38d0a0939994 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:26.443182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:26.476225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f786c0a-9b1c-4911-a650-38d0a0939994 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:26.510124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a3657-e861-49a6-862b-baaad5c4e7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:26.510746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a3657-e861-49a6-862b-baaad5c4e7e6 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:26.511024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a3657-e861-49a6-862b-baaad5c4e7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:26.511295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a3657-e861-49a6-862b-baaad5c4e7e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:26.521752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a3657-e861-49a6-862b-baaad5c4e7e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:26.523707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a3657-e861-49a6-862b-baaad5c4e7e6 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:26.538610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-5d7a3657-e861-49a6-862b-baaad5c4e7e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:26.538610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:26.538610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:26.538610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:26.538610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:26.538610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:26.538610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:26.538610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:26.538610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:26.538610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:26.538610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:26.538610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:26.538610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:21:26.538610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:21:26.538610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:21:26.538610 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:21:26.546859 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:26.546859 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:26.546859 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:26.546859 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:26.546859 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:26.546859 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:26.546859 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:26.546859 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:26.546859 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:26.546859 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:26.546859 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:26.546859 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:26.546859 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:26.546859 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:26.546859 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:26.546859 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:26.546859 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:21:26.547782 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:21:26.547782 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:26.547782 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:21:26.547782 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 630/1265] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:26.548026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c785be-84bf-4524-a342-010224c01961 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:26.627251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:26.645645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c785be-84bf-4524-a342-010224c01961 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:26.678660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e4ad2-2e3c-45cd-8c04-87595278858a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:26.679254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e4ad2-2e3c-45cd-8c04-87595278858a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:26.679532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e4ad2-2e3c-45cd-8c04-87595278858a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:26.679800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e4ad2-2e3c-45cd-8c04-87595278858a None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:26.680460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e4ad2-2e3c-45cd-8c04-87595278858a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:26.680758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e4ad2-2e3c-45cd-8c04-87595278858a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:26.682114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e4ad2-2e3c-45cd-8c04-87595278858a None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:26.693589 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 636/1266] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:26.699373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a3657-e861-49a6-862b-baaad5c4e7e6 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:26.800785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a3657-e861-49a6-862b-baaad5c4e7e6 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:26.820855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:26.834357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1526e6-3b0a-49db-829b-d15d3d83b2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:26.835670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1526e6-3b0a-49db-829b-d15d3d83b2bd None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:26.836012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1526e6-3b0a-49db-829b-d15d3d83b2bd None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:26.836314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1526e6-3b0a-49db-829b-d15d3d83b2bd None admin] PATH_INFO: `/v3/users/placement` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:26.845976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1526e6-3b0a-49db-829b-d15d3d83b2bd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:26.849760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1526e6-3b0a-49db-829b-d15d3d83b2bd None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:26.870873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-ca1526e6-3b0a-49db-829b-d15d3d83b2bd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:21:26.870873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:26.870873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:26.870873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:26.870873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:26.870873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:26.870873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:26.870873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:26.870873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:26.870873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:26.870873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:26.870873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:26.870873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:21:26.870873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:21:26.870873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:21:26.870873 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:26.872075 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:26.873090 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:26.873090 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:26.873090 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:21:26.873090 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:21:26.873090 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:21:26.873090 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:21:26.873090 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:21:26.873090 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:21:26.873090 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:21:26.873090 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:21:26.873090 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 631/1267] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:26.878081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e4ad2-2e3c-45cd-8c04-87595278858a None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:26.982568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e4ad2-2e3c-45cd-8c04-87595278858a None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:27.019034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3da80-1aa6-47d3-a973-f5f796c03a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:27.019679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3da80-1aa6-47d3-a973-f5f796c03a89 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:27.019998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3da80-1aa6-47d3-a973-f5f796c03a89 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:27.020289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3da80-1aa6-47d3-a973-f5f796c03a89 None admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:27.021015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3da80-1aa6-47d3-a973-f5f796c03a89 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:27.021319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3da80-1aa6-47d3-a973-f5f796c03a89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:27.023808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3da80-1aa6-47d3-a973-f5f796c03a89 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:27.032431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:27.040976 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 637/1268] 10.222.0.76 () {56 vars in 1143 bytes} [Sat Aug 27 04:21:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:27.046906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1526e6-3b0a-49db-829b-d15d3d83b2bd None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:27.158422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1526e6-3b0a-49db-829b-d15d3d83b2bd None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:27.193387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb50c9-71ed-474a-bba6-c2502ca12373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:27.194061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb50c9-71ed-474a-bba6-c2502ca12373 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:27.194888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb50c9-71ed-474a-bba6-c2502ca12373 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:27.195770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb50c9-71ed-474a-bba6-c2502ca12373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:27.209543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb50c9-71ed-474a-bba6-c2502ca12373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:27.212326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb50c9-71ed-474a-bba6-c2502ca12373 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:27.227042 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-73fb50c9-71ed-474a-bba6-c2502ca12373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:27.227042 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:27.227042 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:27.227042 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:27.227042 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:27.227042 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:27.227042 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:27.227042 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:27.227042 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:27.227042 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:27.227042 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:27.227042 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:27.227042 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:21:27.227042 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:21:27.227042 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:21:27.227042 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:21:27.228262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:27.228262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:27.228262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:27.228262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:27.228262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:27.228262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:27.228262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:27.228262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:27.228262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:27.228262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:27.228262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:27.228262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:27.228262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:27.228262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:27.228262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:27.228262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:27.228262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:21:27.229367 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:21:27.229367 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:27.229367 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:21:27.229367 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 632/1269] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:27.234146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3da80-1aa6-47d3-a973-f5f796c03a89 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:27.336593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3da80-1aa6-47d3-a973-f5f796c03a89 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:27.370834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce717b-5d12-4e7a-8aee-d8e6182208cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:27.371434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce717b-5d12-4e7a-8aee-d8e6182208cf None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:27.371716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce717b-5d12-4e7a-8aee-d8e6182208cf None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:27.371991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce717b-5d12-4e7a-8aee-d8e6182208cf None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:27.372804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce717b-5d12-4e7a-8aee-d8e6182208cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:27.373108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce717b-5d12-4e7a-8aee-d8e6182208cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:27.374485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce717b-5d12-4e7a-8aee-d8e6182208cf None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:27.386149 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 638/1270] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:27.392328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb50c9-71ed-474a-bba6-c2502ca12373 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:27.423391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:27.494392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb50c9-71ed-474a-bba6-c2502ca12373 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:27.531145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0feb706-e374-4058-bd71-dc4a5c006a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:27.531770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0feb706-e374-4058-bd71-dc4a5c006a80 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:27.532046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0feb706-e374-4058-bd71-dc4a5c006a80 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:27.532354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0feb706-e374-4058-bd71-dc4a5c006a80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:27.544511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0feb706-e374-4058-bd71-dc4a5c006a80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:27.545933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0feb706-e374-4058-bd71-dc4a5c006a80 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:27.557751 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-b0feb706-e374-4058-bd71-dc4a5c006a80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:21:27.557751 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:27.557751 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:27.557751 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:27.557751 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:27.557751 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:27.557751 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:27.557751 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:27.557751 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:27.557751 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:27.557751 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:27.557751 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:27.557751 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:21:27.557751 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:21:27.557751 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:21:27.558803 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:21:27.558803 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:27.558803 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:27.558803 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:27.558803 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:27.558803 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:27.558803 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:27.558803 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:27.558803 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:27.558803 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:27.558803 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:27.558803 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:27.558803 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:27.558803 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:27.558803 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:27.558803 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:27.558803 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:27.559930 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:21:27.559930 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:21:27.559930 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:21:27.559930 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:21:27.559930 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:21:27.559930 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:21:27.559930 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:21:27.559930 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:21:27.559930 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 633/1271] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:21:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:27.564749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce717b-5d12-4e7a-8aee-d8e6182208cf None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:27.623439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:27.667396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce717b-5d12-4e7a-8aee-d8e6182208cf None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:27.701884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f3f28-7709-41a0-aabd-a132fa1062aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:27.702413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f3f28-7709-41a0-aabd-a132fa1062aa None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:27.702693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f3f28-7709-41a0-aabd-a132fa1062aa None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:27.702965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f3f28-7709-41a0-aabd-a132fa1062aa None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:27.703651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f3f28-7709-41a0-aabd-a132fa1062aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:27.703956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f3f28-7709-41a0-aabd-a132fa1062aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:27.705417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f3f28-7709-41a0-aabd-a132fa1062aa None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:27.718004 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 639/1272] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:21:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:27.724075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0feb706-e374-4058-bd71-dc4a5c006a80 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:27.815314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:27.825040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0feb706-e374-4058-bd71-dc4a5c006a80 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:27.861546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c63aae-2d08-4981-a4e7-75f84ede5bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:27.862195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c63aae-2d08-4981-a4e7-75f84ede5bf2 None admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:27.862469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c63aae-2d08-4981-a4e7-75f84ede5bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:27.862735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c63aae-2d08-4981-a4e7-75f84ede5bf2 None admin] PATH_INFO: `/v3/projects/5632b718c3aa48458247661045e99e5f/users/702086569a63418685711c4c134b1482/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:27.864934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c63aae-2d08-4981-a4e7-75f84ede5bf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5632b718c3aa48458247661045e99e5f, user_id=702086569a63418685711c4c134b1482, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:27.867050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c63aae-2d08-4981-a4e7-75f84ede5bf2 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:27.951324 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 634/1273] 10.222.0.76 () {58 vars in 1439 bytes} [Sat Aug 27 04:21:27 2022] PUT /identity/v3/projects/5632b718c3aa48458247661045e99e5f/users/702086569a63418685711c4c134b1482/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:21:29.847343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e7f7c-fe2b-459e-b895-0527567c3f4a None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:29.847912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e7f7c-fe2b-459e-b895-0527567c3f4a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:29.847912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e7f7c-fe2b-459e-b895-0527567c3f4a None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:29.849252 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 640/1274] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:21:29.855829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4df02d-3e6a-40e9-a614-fc56add77b8c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:29.856284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4df02d-3e6a-40e9-a614-fc56add77b8c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:29.856417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4df02d-3e6a-40e9-a614-fc56add77b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:29.875325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8e4df02d-3e6a-40e9-a614-fc56add77b8c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:21:29.876517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8e4df02d-3e6a-40e9-a614-fc56add77b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:21:29.941727 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 635/1275] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:21:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:21:30.213152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e7f7c-fe2b-459e-b895-0527567c3f4a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:30.313277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e7f7c-fe2b-459e-b895-0527567c3f4a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:30.331604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:30.348558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe03ad4-9760-48db-b5a6-1e6d5cf0fb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:30.349212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe03ad4-9760-48db-b5a6-1e6d5cf0fb6f None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:30.349491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe03ad4-9760-48db-b5a6-1e6d5cf0fb6f None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:30.349762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe03ad4-9760-48db-b5a6-1e6d5cf0fb6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:30.359674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe03ad4-9760-48db-b5a6-1e6d5cf0fb6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:21:30.365474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-7fe03ad4-9760-48db-b5a6-1e6d5cf0fb6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:21:30.365474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:30.365474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:30.365474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:30.365474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:30.365474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:30.365474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:30.365474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:30.365474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:30.365474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:30.365474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:30.365474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:30.365474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 04:21:30.365474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 04:21:30.365474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 04:21:30.365474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 04:21:30.367104 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:21:30.367104 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:21:30.367104 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:21:30.367104 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:21:30.367104 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:30.367104 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:30.367104 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:30.367104 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:30.367104 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:30.367104 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:30.367104 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:30.367104 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:30.367104 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:30.367104 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:30.367104 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:30.367104 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:30.368066 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:30.368066 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:30.368066 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:30.368066 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:30.368066 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:21:30.368066 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:21:30.368066 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:21:30.368066 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:21:30.368066 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:21:30.368066 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:21:30.368066 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 04:21:30.368066 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:30.368066 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 641/1276] 10.222.0.76 () {56 vars in 1096 bytes} [Sat Aug 27 04:21:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:30.373497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4df02d-3e6a-40e9-a614-fc56add77b8c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:30.454604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:30.478309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4df02d-3e6a-40e9-a614-fc56add77b8c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:30.504928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836550f2-9ee7-4c10-922d-3b4987cac994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:30.505529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836550f2-9ee7-4c10-922d-3b4987cac994 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:30.505803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836550f2-9ee7-4c10-922d-3b4987cac994 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:30.507502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836550f2-9ee7-4c10-922d-3b4987cac994 None admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:30.507502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836550f2-9ee7-4c10-922d-3b4987cac994 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:30.507686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836550f2-9ee7-4c10-922d-3b4987cac994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:30.508917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836550f2-9ee7-4c10-922d-3b4987cac994 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:30.516859 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 636/1277] 10.222.0.76 () {56 vars in 1099 bytes} [Sat Aug 27 04:21:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:30.522600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe03ad4-9760-48db-b5a6-1e6d5cf0fb6f None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:30.621038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe03ad4-9760-48db-b5a6-1e6d5cf0fb6f None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:30.655054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f68ba-1b24-4bc8-a622-7b4374e65e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:30.655665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f68ba-1b24-4bc8-a622-7b4374e65e7a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:30.655946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f68ba-1b24-4bc8-a622-7b4374e65e7a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:30.656244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f68ba-1b24-4bc8-a622-7b4374e65e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:30.666543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f68ba-1b24-4bc8-a622-7b4374e65e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:30.667980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f68ba-1b24-4bc8-a622-7b4374e65e7a None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:30.682306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-641f68ba-1b24-4bc8-a622-7b4374e65e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:30.682306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:30.682306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:30.682306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:30.682306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:30.682306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:30.682306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:30.682306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:30.682306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:30.682306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:30.682306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:30.682306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:30.682306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:21:30.682306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:21:30.682306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:21:30.682306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:21:30.683417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:30.683417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:30.683417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:30.683417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:30.683417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:30.683417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:30.683417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:30.683417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:30.683417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:30.683417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:30.683417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:30.683417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:30.683417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:30.683417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:30.683417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:30.683417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:30.683417 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:21:30.684378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:21:30.684378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:30.684378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:30.684378 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 642/1278] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:21:30.690818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836550f2-9ee7-4c10-922d-3b4987cac994 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:30.790286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836550f2-9ee7-4c10-922d-3b4987cac994 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:30.823313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f9e7b-89aa-4068-90fd-2b4a9a4effbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:30.823898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f9e7b-89aa-4068-90fd-2b4a9a4effbf None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:30.824237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f9e7b-89aa-4068-90fd-2b4a9a4effbf None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:30.824512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f9e7b-89aa-4068-90fd-2b4a9a4effbf None admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:30.825164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f9e7b-89aa-4068-90fd-2b4a9a4effbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:30.825464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f9e7b-89aa-4068-90fd-2b4a9a4effbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:30.826805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f9e7b-89aa-4068-90fd-2b4a9a4effbf None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:30.839078 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 637/1279] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:30.844995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f68ba-1b24-4bc8-a622-7b4374e65e7a None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:30.876584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:30.943833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f68ba-1b24-4bc8-a622-7b4374e65e7a None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:30.977677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0187900-fe03-42b4-a665-fac2eadfd006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:30.978467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0187900-fe03-42b4-a665-fac2eadfd006 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:30.978753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0187900-fe03-42b4-a665-fac2eadfd006 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:30.979025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0187900-fe03-42b4-a665-fac2eadfd006 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:30.986470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0187900-fe03-42b4-a665-fac2eadfd006 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:30.987945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0187900-fe03-42b4-a665-fac2eadfd006 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:30.999523 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-e0187900-fe03-42b4-a665-fac2eadfd006 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:21:30.999523 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:30.999523 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:30.999523 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:30.999523 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:30.999523 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:30.999523 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:30.999523 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:30.999523 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:30.999523 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:30.999523 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:30.999523 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:30.999523 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:21:30.999523 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:21:30.999523 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:21:30.999523 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:31.000665 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:31.002090 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:31.002090 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:31.002090 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:21:31.002090 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:21:31.002090 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:21:31.002090 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:21:31.002090 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:21:31.002090 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:21:31.002090 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 04:21:31.002090 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:31.002090 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 643/1280] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:31.006538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f9e7b-89aa-4068-90fd-2b4a9a4effbf None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:31.010600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:31.105738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f9e7b-89aa-4068-90fd-2b4a9a4effbf None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:31.138906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fb8f3-0be9-4bdb-abbf-dd69275f5f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:31.139501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fb8f3-0be9-4bdb-abbf-dd69275f5f36 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:31.139777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fb8f3-0be9-4bdb-abbf-dd69275f5f36 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:31.140046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fb8f3-0be9-4bdb-abbf-dd69275f5f36 None admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:31.140795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40fb8f3-0be9-4bdb-abbf-dd69275f5f36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:31.141096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40fb8f3-0be9-4bdb-abbf-dd69275f5f36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:31.142499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40fb8f3-0be9-4bdb-abbf-dd69275f5f36 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:31.168702 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 638/1281] 10.222.0.76 () {56 vars in 1143 bytes} [Sat Aug 27 04:21:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:31.174685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0187900-fe03-42b4-a665-fac2eadfd006 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:31.264416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:31.274176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0187900-fe03-42b4-a665-fac2eadfd006 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:31.306838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c44f0-6e17-4917-86bd-bed9b222346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:31.307424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c44f0-6e17-4917-86bd-bed9b222346c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:31.307701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c44f0-6e17-4917-86bd-bed9b222346c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:31.307969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c44f0-6e17-4917-86bd-bed9b222346c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:31.378634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c44f0-6e17-4917-86bd-bed9b222346c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:31.380005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c44f0-6e17-4917-86bd-bed9b222346c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:31.468797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:31.479849 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 644/1282] 10.222.0.76 () {58 vars in 1282 bytes} [Sat Aug 27 04:21:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:31.485831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fb8f3-0be9-4bdb-abbf-dd69275f5f36 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:31.550220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:31.588379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fb8f3-0be9-4bdb-abbf-dd69275f5f36 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:31.623222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a3ba3-dc23-451c-9443-b2d5a987e9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:31.624971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a3ba3-dc23-451c-9443-b2d5a987e9ab None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:31.624971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a3ba3-dc23-451c-9443-b2d5a987e9ab None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:31.624971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a3ba3-dc23-451c-9443-b2d5a987e9ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:31.634867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a3ba3-dc23-451c-9443-b2d5a987e9ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:31.636323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a3ba3-dc23-451c-9443-b2d5a987e9ab None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:31.654290 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-3a7a3ba3-dc23-451c-9443-b2d5a987e9ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:31.654290 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:31.654290 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:31.654290 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:31.654290 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:31.654290 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:31.654290 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:31.654290 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:31.654290 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:31.654290 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:31.654290 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:31.654290 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:31.654290 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:21:31.654290 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:21:31.654290 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:21:31.654290 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:21:31.655327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:31.655327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:31.655327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:31.655327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:31.655327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:31.655327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:31.655327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:31.655327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:31.655327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:31.655327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:31.655327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:31.655327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:31.655327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:31.655327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:31.655327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:31.655327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:31.655327 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 04:21:31.656279 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:21:31.656279 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 04:21:31.656279 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:21:31.656279 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 639/1283] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:31.661078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c44f0-6e17-4917-86bd-bed9b222346c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:31.761601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c44f0-6e17-4917-86bd-bed9b222346c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:31.794558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227747f-8acf-4645-ad64-5c2d0408b662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:31.795153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227747f-8acf-4645-ad64-5c2d0408b662 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:31.795428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227747f-8acf-4645-ad64-5c2d0408b662 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:31.795694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227747f-8acf-4645-ad64-5c2d0408b662 None admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:31.796353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227747f-8acf-4645-ad64-5c2d0408b662 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:31.799740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227747f-8acf-4645-ad64-5c2d0408b662 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:31.799740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227747f-8acf-4645-ad64-5c2d0408b662 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:31.815000 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 645/1284] 10.222.0.76 () {56 vars in 1109 bytes} [Sat Aug 27 04:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:31.816209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a3ba3-dc23-451c-9443-b2d5a987e9ab None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:31.915949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a3ba3-dc23-451c-9443-b2d5a987e9ab None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:31.928900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:31.948144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29264060-5e13-4d26-8cf4-ef52937ce2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:31.948792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29264060-5e13-4d26-8cf4-ef52937ce2dc None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:31.949070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29264060-5e13-4d26-8cf4-ef52937ce2dc None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:31.949339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29264060-5e13-4d26-8cf4-ef52937ce2dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:31.955801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29264060-5e13-4d26-8cf4-ef52937ce2dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:31.957255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29264060-5e13-4d26-8cf4-ef52937ce2dc None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:31.969589 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-29264060-5e13-4d26-8cf4-ef52937ce2dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:21:31.969589 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:31.969589 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:31.969589 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:31.969589 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:31.969589 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:31.969589 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:31.969589 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:31.969589 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:31.969589 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:31.969589 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:31.969589 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:31.969589 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 04:21:31.969589 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 04:21:31.969589 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 04:21:31.975471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 04:21:31.975471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:31.975471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:31.975471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:31.975471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:31.975471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:31.975471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:31.975471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:31.975471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:31.975471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:31.975471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:31.975471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:31.975471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:31.975471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:31.975471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:31.975471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:31.975471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:31.977165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 04:21:31.977165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 04:21:31.977165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:21:31.977165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:21:31.977165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:21:31.977165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:21:31.977165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 04:21:31.977165 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:21:31.977165 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 640/1285] 10.222.0.76 () {56 vars in 1111 bytes} [Sat Aug 27 04:21:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:31.977935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227747f-8acf-4645-ad64-5c2d0408b662 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:32.027019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:32.074194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227747f-8acf-4645-ad64-5c2d0408b662 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:32.106805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9fc45-20f3-47bc-aea4-d090620364d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:32.107393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9fc45-20f3-47bc-aea4-d090620364d1 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:32.107668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9fc45-20f3-47bc-aea4-d090620364d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:32.107935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9fc45-20f3-47bc-aea4-d090620364d1 None admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:32.108642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9fc45-20f3-47bc-aea4-d090620364d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:32.109051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9fc45-20f3-47bc-aea4-d090620364d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:32.110471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9fc45-20f3-47bc-aea4-d090620364d1 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:32.122194 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 646/1286] 10.222.0.76 () {56 vars in 1148 bytes} [Sat Aug 27 04:21:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:32.128985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29264060-5e13-4d26-8cf4-ef52937ce2dc None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:32.239291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29264060-5e13-4d26-8cf4-ef52937ce2dc None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:32.277605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d3167-ab24-499b-b2cf-fb7acef187c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:32.278329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d3167-ab24-499b-b2cf-fb7acef187c0 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:32.278613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d3167-ab24-499b-b2cf-fb7acef187c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:32.278885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d3167-ab24-499b-b2cf-fb7acef187c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:32.279613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d3167-ab24-499b-b2cf-fb7acef187c0 None admin] RBAC: Adding query filter params (role.id=0957af53dfcc4cfc8cf7947a65ecfabc, scope.project.id=5632b718c3aa48458247661045e99e5f, user.id=702086569a63418685711c4c134b1482) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:32.279918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d3167-ab24-499b-b2cf-fb7acef187c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:32.281430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d3167-ab24-499b-b2cf-fb7acef187c0 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:32.300218 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 641/1287] 10.222.0.76 () {56 vars in 1374 bytes} [Sat Aug 27 04:21:32 2022] GET /identity/v3/role_assignments?user.id=702086569a63418685711c4c134b1482&scope.project.id=5632b718c3aa48458247661045e99e5f&role.id=0957af53dfcc4cfc8cf7947a65ecfabc => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:34.293663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55f85-35ee-467e-b51c-dde833a4d5a0 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:34.294191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55f85-35ee-467e-b51c-dde833a4d5a0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:34.294191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55f85-35ee-467e-b51c-dde833a4d5a0 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:34.295697 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 647/1288] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:21:34.301162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e53d40-473a-41e1-bb27-62c2b030c1c6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:34.301937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e53d40-473a-41e1-bb27-62c2b030c1c6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:34.301937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e53d40-473a-41e1-bb27-62c2b030c1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:34.327774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b0e53d40-473a-41e1-bb27-62c2b030c1c6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:21:34.335973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b0e53d40-473a-41e1-bb27-62c2b030c1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:21:34.360993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:34.408050 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 642/1289] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:21:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:21:34.685493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55f85-35ee-467e-b51c-dde833a4d5a0 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:34.793567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55f85-35ee-467e-b51c-dde833a4d5a0 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:34.804771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:34.828597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcceccc-6c0e-4a19-b69f-ef930640ba4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:34.829222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcceccc-6c0e-4a19-b69f-ef930640ba4c None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:34.829504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcceccc-6c0e-4a19-b69f-ef930640ba4c None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:34.829774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcceccc-6c0e-4a19-b69f-ef930640ba4c None admin] PATH_INFO: `/v3/services/placement` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:34.830355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcceccc-6c0e-4a19-b69f-ef930640ba4c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:34.831719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcceccc-6c0e-4a19-b69f-ef930640ba4c None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:34.845081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-4dcceccc-6c0e-4a19-b69f-ef930640ba4c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 04:21:34.845081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:34.845081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:21:34.845081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:21:34.845081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:21:34.845081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:21:34.845081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:21:34.845081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:21:34.845081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 04:21:34.845081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:34.845081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:21:34.845081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:34.845081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:34.845081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:34.845081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:34.845081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:34.845081 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:34.846368 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:34.846368 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:34.846368 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:34.846368 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:34.846368 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:34.846368 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:34.846368 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:21:34.846368 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:21:34.846368 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:21:34.846368 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:21:34.846368 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:34.846368 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:34.846368 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:34.846368 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:34.846368 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:34.846368 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:34.847242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:34.847242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:34.847242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:34.847242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:34.847242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:34.847242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:34.847242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:34.847242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:34.847242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:34.847242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:34.847242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:21:34.847242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:21:34.847242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 04:21:34.847242 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:34.847242 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 648/1290] 10.222.0.76 () {56 vars in 1117 bytes} [Sat Aug 27 04:21:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:34.848673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e53d40-473a-41e1-bb27-62c2b030c1c6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:34.950845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e53d40-473a-41e1-bb27-62c2b030c1c6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:34.984022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99b089-7798-47ea-8386-f6a3f6523099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:34.984647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99b089-7798-47ea-8386-f6a3f6523099 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:34.984922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99b089-7798-47ea-8386-f6a3f6523099 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:34.985191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99b089-7798-47ea-8386-f6a3f6523099 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:34.985809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99b089-7798-47ea-8386-f6a3f6523099 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:34.986107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99b089-7798-47ea-8386-f6a3f6523099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:34.987457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99b089-7798-47ea-8386-f6a3f6523099 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:34.992928 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 643/1291] 10.222.0.76 () {56 vars in 1116 bytes} [Sat Aug 27 04:21:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:34.998673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcceccc-6c0e-4a19-b69f-ef930640ba4c None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:35.098167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcceccc-6c0e-4a19-b69f-ef930640ba4c None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:35.131176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fe320-dbc9-4e7c-900f-19b6ebe002b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:35.132490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fe320-dbc9-4e7c-900f-19b6ebe002b0 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:35.132997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fe320-dbc9-4e7c-900f-19b6ebe002b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:35.133278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fe320-dbc9-4e7c-900f-19b6ebe002b0 None admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:35.133918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fe320-dbc9-4e7c-900f-19b6ebe002b0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:35.134224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fe320-dbc9-4e7c-900f-19b6ebe002b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:35.135690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fe320-dbc9-4e7c-900f-19b6ebe002b0 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:35.140582 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 649/1292] 10.222.0.76 () {56 vars in 1116 bytes} [Sat Aug 27 04:21:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:37.073494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a7833-992f-4f5d-b0dd-4dd30be92f2d None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:37.074040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a7833-992f-4f5d-b0dd-4dd30be92f2d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:37.074040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a7833-992f-4f5d-b0dd-4dd30be92f2d None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:37.075391 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 644/1293] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:21:37.080568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf96da-06a1-4096-8c16-79c59a268ac9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:37.080990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf96da-06a1-4096-8c16-79c59a268ac9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:37.081181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf96da-06a1-4096-8c16-79c59a268ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:37.099688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-efbf96da-06a1-4096-8c16-79c59a268ac9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:21:37.101543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-efbf96da-06a1-4096-8c16-79c59a268ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:21:37.130655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:37.168872 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 650/1294] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:21:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:21:37.455096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a7833-992f-4f5d-b0dd-4dd30be92f2d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:37.487384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:37.557918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a7833-992f-4f5d-b0dd-4dd30be92f2d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:37.592570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f2fd4-2e67-44de-8c54-c71f46b28bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:37.593175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2fd4-2e67-44de-8c54-c71f46b28bd1 None admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:37.593448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2fd4-2e67-44de-8c54-c71f46b28bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:37.593714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2fd4-2e67-44de-8c54-c71f46b28bd1 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:37.594365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f2fd4-2e67-44de-8c54-c71f46b28bd1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:37.595747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f2fd4-2e67-44de-8c54-c71f46b28bd1 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:37.679761 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 645/1295] 10.222.0.76 () {60 vars in 1141 bytes} [Sat Aug 27 04:21:37 2022] POST /identity/v3/services => generated 246 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:21:39.607534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5857bcd-d332-481b-8d6b-2ab677eb2a03 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:39.608093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5857bcd-d332-481b-8d6b-2ab677eb2a03 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:39.608093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5857bcd-d332-481b-8d6b-2ab677eb2a03 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:39.609440 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 651/1296] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:21:39.614625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eedee7-7966-40eb-b84b-fda655600d11 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:39.615006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eedee7-7966-40eb-b84b-fda655600d11 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:39.615173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eedee7-7966-40eb-b84b-fda655600d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:39.634953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-88eedee7-7966-40eb-b84b-fda655600d11 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:21:39.636142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-88eedee7-7966-40eb-b84b-fda655600d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:21:39.708765 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 646/1297] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:21:39 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 04:21:39.986828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5857bcd-d332-481b-8d6b-2ab677eb2a03 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:40.087425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5857bcd-d332-481b-8d6b-2ab677eb2a03 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:40.122723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad54a3-c764-4d3e-bd2d-2ae7755c3a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:40.123338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad54a3-c764-4d3e-bd2d-2ae7755c3a8a None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:40.123614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad54a3-c764-4d3e-bd2d-2ae7755c3a8a None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:40.123883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad54a3-c764-4d3e-bd2d-2ae7755c3a8a None admin] PATH_INFO: `/v3/services/placement` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:40.124486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad54a3-c764-4d3e-bd2d-2ae7755c3a8a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:40.125836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad54a3-c764-4d3e-bd2d-2ae7755c3a8a None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:40.134306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-53ad54a3-c764-4d3e-bd2d-2ae7755c3a8a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 04:21:40.134306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:40.134306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:21:40.134306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:21:40.134306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:21:40.134306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:21:40.134306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:21:40.134306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:21:40.134306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 04:21:40.134306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:40.134306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:21:40.134306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:40.134306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:40.134306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:40.134306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:40.134306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:40.134306 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:40.136102 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:40.136102 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:40.136102 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:40.136102 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:40.136102 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:40.136102 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:40.136102 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:21:40.136102 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:21:40.136102 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:21:40.136102 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:21:40.136102 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:40.136102 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:40.136102 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:40.136102 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:40.136102 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:40.136102 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:40.137254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:40.137254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:40.137254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:40.137254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:40.137254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:40.137254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:40.137254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:40.137254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:40.137254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:40.137254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:40.137254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:21:40.137254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:21:40.137254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 04:21:40.137254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:40.137254 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 652/1298] 10.222.0.76 () {56 vars in 1117 bytes} [Sat Aug 27 04:21:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:21:40.141677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eedee7-7966-40eb-b84b-fda655600d11 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:40.160604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:40.238406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eedee7-7966-40eb-b84b-fda655600d11 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:40.270555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ebbf8-129c-4512-8255-fddb2cb8ee90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:40.271149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ebbf8-129c-4512-8255-fddb2cb8ee90 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:40.271429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ebbf8-129c-4512-8255-fddb2cb8ee90 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:40.271694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ebbf8-129c-4512-8255-fddb2cb8ee90 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:40.273167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ebbf8-129c-4512-8255-fddb2cb8ee90 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:40.273477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ebbf8-129c-4512-8255-fddb2cb8ee90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:40.274919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ebbf8-129c-4512-8255-fddb2cb8ee90 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:40.279783 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 647/1299] 10.222.0.76 () {56 vars in 1116 bytes} [Sat Aug 27 04:21:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:40.285753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad54a3-c764-4d3e-bd2d-2ae7755c3a8a None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:40.317048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:40.384977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad54a3-c764-4d3e-bd2d-2ae7755c3a8a None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:40.417290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d32856-8794-492c-9841-0811571b65f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:40.417958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d32856-8794-492c-9841-0811571b65f8 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:40.418235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d32856-8794-492c-9841-0811571b65f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:40.418506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d32856-8794-492c-9841-0811571b65f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:40.419190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d32856-8794-492c-9841-0811571b65f8 None admin] RBAC: Adding query filter params (interface=public, service_id=659862f702be46b292887f209f985b84, region_id=RegionOne) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:40.419494 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d32856-8794-492c-9841-0811571b65f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:40.420880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d32856-8794-492c-9841-0811571b65f8 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:40.425773 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 653/1300] 10.222.0.76 () {56 vars in 1251 bytes} [Sat Aug 27 04:21:40 2022] GET /identity/v3/endpoints?service_id=659862f702be46b292887f209f985b84&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:40.432349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ebbf8-129c-4512-8255-fddb2cb8ee90 None admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:40.513342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:40.530125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ebbf8-129c-4512-8255-fddb2cb8ee90 None admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:40.563101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983c74e-1af2-404a-92ae-fa6ecd4266f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:40.563692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983c74e-1af2-404a-92ae-fa6ecd4266f4 None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:40.563966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983c74e-1af2-404a-92ae-fa6ecd4266f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:40.564259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983c74e-1af2-404a-92ae-fa6ecd4266f4 None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:40.564850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983c74e-1af2-404a-92ae-fa6ecd4266f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:40.566192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983c74e-1af2-404a-92ae-fa6ecd4266f4 None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:40.572883 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 648/1301] 10.222.0.76 () {56 vars in 1087 bytes} [Sat Aug 27 04:21:40 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:21:42.479158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba52f0a-63dd-4865-9d1e-ccff5bc163a8 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:42.479678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba52f0a-63dd-4865-9d1e-ccff5bc163a8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:42.479678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba52f0a-63dd-4865-9d1e-ccff5bc163a8 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:42.481163 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 654/1302] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:21:42.486408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba8311-b62d-467f-8a2b-3f6bb83c043a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:42.486932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba8311-b62d-467f-8a2b-3f6bb83c043a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:42.487025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba8311-b62d-467f-8a2b-3f6bb83c043a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:42.505891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4bba8311-b62d-467f-8a2b-3f6bb83c043a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:21:42.507687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4bba8311-b62d-467f-8a2b-3f6bb83c043a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:21:42.573578 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 649/1303] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:21:42 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 04:21:42.864674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba52f0a-63dd-4865-9d1e-ccff5bc163a8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:42.951351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:42.957975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba52f0a-63dd-4865-9d1e-ccff5bc163a8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:42.992066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9e7c1-fda2-402c-879a-fc44ab9611e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:42.992717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9e7c1-fda2-402c-879a-fc44ab9611e5 None admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:42.993021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9e7c1-fda2-402c-879a-fc44ab9611e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:42.993268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9e7c1-fda2-402c-879a-fc44ab9611e5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:42.993844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9e7c1-fda2-402c-879a-fc44ab9611e5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:42.995211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9e7c1-fda2-402c-879a-fc44ab9611e5 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:43.003738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-d6b9e7c1-fda2-402c-879a-fc44ab9611e5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 04:21:43.003738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:43.003738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:21:43.003738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:21:43.003738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:21:43.003738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:21:43.003738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:21:43.003738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:21:43.003738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 04:21:43.003738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:43.003738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:21:43.003738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:43.003738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:21:43.003738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:21:43.003738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:21:43.003738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:21:43.003738 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:21:43.005043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:21:43.005043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:21:43.005043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:21:43.005043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:21:43.005043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:21:43.005043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:21:43.005043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:21:43.005043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:21:43.005043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:21:43.005043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:21:43.005043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:21:43.005043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:21:43.005043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:21:43.005043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:21:43.005043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:21:43.005043 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:21:43.006248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:21:43.006248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:21:43.006248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:21:43.006248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:21:43.006248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:21:43.006248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:21:43.006248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:21:43.006248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:21:43.006248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:21:43.006248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:21:43.006248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:21:43.006248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:21:43.006248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 04:21:43.006248 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:21:43.006248 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 655/1304] 10.222.0.76 () {56 vars in 1117 bytes} [Sat Aug 27 04:21:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 04:21:43.011164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba8311-b62d-467f-8a2b-3f6bb83c043a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:43.094962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:43.119069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba8311-b62d-467f-8a2b-3f6bb83c043a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:43.151953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57993536-f53c-4c67-b6ec-36d2c375296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:43.152588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57993536-f53c-4c67-b6ec-36d2c375296f None admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:43.152858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57993536-f53c-4c67-b6ec-36d2c375296f None admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:43.153123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57993536-f53c-4c67-b6ec-36d2c375296f None admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:43.153736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57993536-f53c-4c67-b6ec-36d2c375296f None admin] RBAC: Adding query filter params (name=placement) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:21:43.154032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57993536-f53c-4c67-b6ec-36d2c375296f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:43.155386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57993536-f53c-4c67-b6ec-36d2c375296f None admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:43.160392 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 650/1305] 10.222.0.76 () {56 vars in 1116 bytes} [Sat Aug 27 04:21:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:21:43.167391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9e7c1-fda2-402c-879a-fc44ab9611e5 None admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:21:43.267360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9e7c1-fda2-402c-879a-fc44ab9611e5 None admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:21:43.310827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd1155-e366-40d2-909b-77337cfdcaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:21:43.311432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd1155-e366-40d2-909b-77337cfdcaa9 None admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:21:43.311712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd1155-e366-40d2-909b-77337cfdcaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:21:43.311985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd1155-e366-40d2-909b-77337cfdcaa9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:21:43.312696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd1155-e366-40d2-909b-77337cfdcaa9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:21:43.314069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd1155-e366-40d2-909b-77337cfdcaa9 None admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:21:43.420747 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 656/1306] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:21:43 2022] POST /identity/v3/endpoints => generated 331 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:21:53.178796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=30 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:21:53.416016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:27:59.871751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125250cb-5503-4620-bfe2-baa07848091e None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:59.872978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125250cb-5503-4620-bfe2-baa07848091e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:59.873569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125250cb-5503-4620-bfe2-baa07848091e None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:59.886009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5e17e-6bc0-42c4-93c8-353f13210edf None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:27:59.886009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5e17e-6bc0-42c4-93c8-353f13210edf None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:27:59.886009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5e17e-6bc0-42c4-93c8-353f13210edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:27:59.888899 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 651/1307] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:27:59 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:27:59.990846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-54c5e17e-6bc0-42c4-93c8-353f13210edf None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:27:59.992412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-54c5e17e-6bc0-42c4-93c8-353f13210edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:00.113369 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 657/1308] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:28:00.426372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812cb84-64c5-4321-885e-4ff3cfc867aa None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:00.426745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812cb84-64c5-4321-885e-4ff3cfc867aa None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:00.426917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812cb84-64c5-4321-885e-4ff3cfc867aa None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:00.428581 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 652/1309] 10.222.0.76 () {54 vars in 965 bytes} [Sat Aug 27 04:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:00.435849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4194695-ff1b-4a4d-84da-80ae0d9beee7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:00.436134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4194695-ff1b-4a4d-84da-80ae0d9beee7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:00.436444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4194695-ff1b-4a4d-84da-80ae0d9beee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:00.526970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c4194695-ff1b-4a4d-84da-80ae0d9beee7 None None] MFA Rules not processed for user `0547461f91aa423381430eda35fe6b74`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:00.528759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c4194695-ff1b-4a4d-84da-80ae0d9beee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:00.553264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:00.620753 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 658/1310] 10.222.0.76 () {58 vars in 1062 bytes} [Sat Aug 27 04:28:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:00.630284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812cb84-64c5-4321-885e-4ff3cfc867aa None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:00.632265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1812cb84-64c5-4321-885e-4ff3cfc867aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:00.753176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812cb84-64c5-4321-885e-4ff3cfc867aa None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:00.833670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec9ee0-23d4-400f-a0cd-590154acd674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:00.834278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec9ee0-23d4-400f-a0cd-590154acd674 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:00.834554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec9ee0-23d4-400f-a0cd-590154acd674 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:00.834823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec9ee0-23d4-400f-a0cd-590154acd674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:00.836429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-87ec9ee0-23d4-400f-a0cd-590154acd674 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:00.893431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:00.955435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec9ee0-23d4-400f-a0cd-590154acd674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:00.956923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec9ee0-23d4-400f-a0cd-590154acd674 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:00.978877 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 653/1311] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:28:03.217998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0670895-57d4-4066-9583-7f73e2c5780a None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:03.218501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0670895-57d4-4066-9583-7f73e2c5780a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:03.218501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0670895-57d4-4066-9583-7f73e2c5780a None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:03.219820 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 659/1312] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:03.225423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8029e15-8107-47c1-ae72-d33fbfae3b04 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:03.225854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8029e15-8107-47c1-ae72-d33fbfae3b04 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:03.225955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8029e15-8107-47c1-ae72-d33fbfae3b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:03.310479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e8029e15-8107-47c1-ae72-d33fbfae3b04 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:03.311706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e8029e15-8107-47c1-ae72-d33fbfae3b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:03.414779 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 654/1313] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:03.710227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0670895-57d4-4066-9583-7f73e2c5780a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:03.711757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c0670895-57d4-4066-9583-7f73e2c5780a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:03.814913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0670895-57d4-4066-9583-7f73e2c5780a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:03.884082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:03.886358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11a29f-301e-450b-9024-df4c66977853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:03.887472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11a29f-301e-450b-9024-df4c66977853 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:03.887746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11a29f-301e-450b-9024-df4c66977853 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:03.888017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11a29f-301e-450b-9024-df4c66977853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:03.889640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3a11a29f-301e-450b-9024-df4c66977853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:04.004619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11a29f-301e-450b-9024-df4c66977853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:04.006058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11a29f-301e-450b-9024-df4c66977853 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:04.024918 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 660/1314] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:28:06.612863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4bdbe-f50d-4ba4-a950-23e122a71661 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:06.613432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4bdbe-f50d-4ba4-a950-23e122a71661 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:06.613528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4bdbe-f50d-4ba4-a950-23e122a71661 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:06.614898 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 655/1315] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:28:06.620206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3127cc-f707-4f81-93ac-bb3af5495761 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:06.620634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3127cc-f707-4f81-93ac-bb3af5495761 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:06.621273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3127cc-f707-4f81-93ac-bb3af5495761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:06.686731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ef3127cc-f707-4f81-93ac-bb3af5495761 None None] MFA Rules not processed for user `3762df846f914b0aa04761bfc47afef2`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:06.687919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ef3127cc-f707-4f81-93ac-bb3af5495761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:06.738614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:06.783406 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 661/1316] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:28:06 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:07.068355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4bdbe-f50d-4ba4-a950-23e122a71661 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:07.069938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-19b4bdbe-f50d-4ba4-a950-23e122a71661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:07.080831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:07.173786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4bdbe-f50d-4ba4-a950-23e122a71661 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:07.244542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bec551-31d8-4c8b-a4a6-30cc8925ff12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:07.245293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bec551-31d8-4c8b-a4a6-30cc8925ff12 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:07.245404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bec551-31d8-4c8b-a4a6-30cc8925ff12 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:07.245580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bec551-31d8-4c8b-a4a6-30cc8925ff12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:07.247740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f0bec551-31d8-4c8b-a4a6-30cc8925ff12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:07.317131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:07.374527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bec551-31d8-4c8b-a4a6-30cc8925ff12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:07.375997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bec551-31d8-4c8b-a4a6-30cc8925ff12 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:07.394889 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 656/1317] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:28:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:28:10.161187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4f19b-645c-4c25-a2b9-b195a7a829c2 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:10.161736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4f19b-645c-4c25-a2b9-b195a7a829c2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:10.161736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4f19b-645c-4c25-a2b9-b195a7a829c2 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:10.163085 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 662/1318] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:10.168436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168f2a9-cae1-46e8-952c-bd6362122313 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:10.168811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168f2a9-cae1-46e8-952c-bd6362122313 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:10.168981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168f2a9-cae1-46e8-952c-bd6362122313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:10.235634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a168f2a9-cae1-46e8-952c-bd6362122313 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:10.236781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a168f2a9-cae1-46e8-952c-bd6362122313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:10.333367 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 657/1319] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:28:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:10.624085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4f19b-645c-4c25-a2b9-b195a7a829c2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:10.625656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-42f4f19b-645c-4c25-a2b9-b195a7a829c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:10.729327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4f19b-645c-4c25-a2b9-b195a7a829c2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:10.806228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcd3b9-7f48-4f1e-ac95-3c42bd8eca62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:10.806823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcd3b9-7f48-4f1e-ac95-3c42bd8eca62 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:10.807096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcd3b9-7f48-4f1e-ac95-3c42bd8eca62 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:10.807361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcd3b9-7f48-4f1e-ac95-3c42bd8eca62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:10.809160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9ebcd3b9-7f48-4f1e-ac95-3c42bd8eca62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:10.816504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:10.917443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcd3b9-7f48-4f1e-ac95-3c42bd8eca62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:10.919549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcd3b9-7f48-4f1e-ac95-3c42bd8eca62 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:10.937601 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 663/1320] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:28:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:28:13.929871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf844e-4216-4242-a2f9-0b59d2e78139 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:13.930407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf844e-4216-4242-a2f9-0b59d2e78139 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:13.930407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf844e-4216-4242-a2f9-0b59d2e78139 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:13.931832 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 658/1321] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:13.938042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff3f76-6eca-493a-862c-920989a25d79 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:13.938846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff3f76-6eca-493a-862c-920989a25d79 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:13.939122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff3f76-6eca-493a-862c-920989a25d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:14.005464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-29ff3f76-6eca-493a-862c-920989a25d79 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:14.006649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-29ff3f76-6eca-493a-862c-920989a25d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:14.065065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:14.106390 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 664/1322] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:14.406184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf844e-4216-4242-a2f9-0b59d2e78139 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:14.407752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-60bf844e-4216-4242-a2f9-0b59d2e78139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:14.429371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:14.519927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf844e-4216-4242-a2f9-0b59d2e78139 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:14.596570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f88fbe-5429-4b02-96b9-f60bcd424f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:14.597273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f88fbe-5429-4b02-96b9-f60bcd424f42 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:14.597562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f88fbe-5429-4b02-96b9-f60bcd424f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:14.597823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f88fbe-5429-4b02-96b9-f60bcd424f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:14.599415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-98f88fbe-5429-4b02-96b9-f60bcd424f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:14.676716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:14.714938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f88fbe-5429-4b02-96b9-f60bcd424f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:14.716423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f88fbe-5429-4b02-96b9-f60bcd424f42 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:14.735243 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 659/1323] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:28:16.755501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42010661-f1ea-4c65-828e-70802459d627 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:16.756030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42010661-f1ea-4c65-828e-70802459d627 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:16.756030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42010661-f1ea-4c65-828e-70802459d627 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:16.757470 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 665/1324] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:16.763455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c04cf1-1790-4eb8-9c26-6b437429cc47 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:16.763887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c04cf1-1790-4eb8-9c26-6b437429cc47 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:16.764154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c04cf1-1790-4eb8-9c26-6b437429cc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:16.831498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d8c04cf1-1790-4eb8-9c26-6b437429cc47 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:16.832736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d8c04cf1-1790-4eb8-9c26-6b437429cc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:16.937470 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 660/1325] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:17.218091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42010661-f1ea-4c65-828e-70802459d627 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:17.219687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-42010661-f1ea-4c65-828e-70802459d627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:17.330571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42010661-f1ea-4c65-828e-70802459d627 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:17.415135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdc9c6-16cc-4b8a-b0ca-9568bea4d563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:17.415739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdc9c6-16cc-4b8a-b0ca-9568bea4d563 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:17.416019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdc9c6-16cc-4b8a-b0ca-9568bea4d563 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:17.416318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdc9c6-16cc-4b8a-b0ca-9568bea4d563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:17.418186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d4cdc9c6-16cc-4b8a-b0ca-9568bea4d563 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:17.435036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:17.537165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdc9c6-16cc-4b8a-b0ca-9568bea4d563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:17.538614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdc9c6-16cc-4b8a-b0ca-9568bea4d563 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:17.557798 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 666/1326] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:28:19.550740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5d3b2-4342-49f6-ab13-4f3bf67ff56d None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:19.551267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5d3b2-4342-49f6-ab13-4f3bf67ff56d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:19.551267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5d3b2-4342-49f6-ab13-4f3bf67ff56d None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:19.552563 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 661/1327] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:19.558109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3315a6d-0397-4c1f-a063-2826f05f036a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:19.558109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3315a6d-0397-4c1f-a063-2826f05f036a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:19.559023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3315a6d-0397-4c1f-a063-2826f05f036a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:19.624628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a3315a6d-0397-4c1f-a063-2826f05f036a None None] MFA Rules not processed for user `3762df846f914b0aa04761bfc47afef2`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:19.625851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a3315a6d-0397-4c1f-a063-2826f05f036a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:19.695266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:19.730054 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 667/1328] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:28:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:20.019891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5d3b2-4342-49f6-ab13-4f3bf67ff56d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:20.021454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-17c5d3b2-4342-49f6-ab13-4f3bf67ff56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:20.051737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:20.124871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5d3b2-4342-49f6-ab13-4f3bf67ff56d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:20.219305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0e79e-d22c-4ba2-8cae-141f4cdc1664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:20.220583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0e79e-d22c-4ba2-8cae-141f4cdc1664 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:20.220583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0e79e-d22c-4ba2-8cae-141f4cdc1664 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:20.220583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0e79e-d22c-4ba2-8cae-141f4cdc1664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:20.222194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-aaa0e79e-d22c-4ba2-8cae-141f4cdc1664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:20.317793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:20.349654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0e79e-d22c-4ba2-8cae-141f4cdc1664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:20.351103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0e79e-d22c-4ba2-8cae-141f4cdc1664 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:20.369717 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 662/1329] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:28:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:28:22.810480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452c8c2-8d81-464c-8f6a-2173efbb87f3 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:22.811082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452c8c2-8d81-464c-8f6a-2173efbb87f3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:22.811082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452c8c2-8d81-464c-8f6a-2173efbb87f3 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:22.812413 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 668/1330] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:22.817514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7631e50-6ff1-4662-9e1f-fe9cd4d79f0d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:22.817922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7631e50-6ff1-4662-9e1f-fe9cd4d79f0d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:22.818050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7631e50-6ff1-4662-9e1f-fe9cd4d79f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:22.884016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a7631e50-6ff1-4662-9e1f-fe9cd4d79f0d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:22.885245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a7631e50-6ff1-4662-9e1f-fe9cd4d79f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:22.981992 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 663/1331] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:23.258058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452c8c2-8d81-464c-8f6a-2173efbb87f3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:23.259580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b452c8c2-8d81-464c-8f6a-2173efbb87f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:23.369256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452c8c2-8d81-464c-8f6a-2173efbb87f3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:23.445900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18baf272-c783-464a-9702-a97689a521aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:23.446493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18baf272-c783-464a-9702-a97689a521aa service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:23.446768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18baf272-c783-464a-9702-a97689a521aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:23.447036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18baf272-c783-464a-9702-a97689a521aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:23.449317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-18baf272-c783-464a-9702-a97689a521aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:23.475969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:23.556900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18baf272-c783-464a-9702-a97689a521aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:23.558314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18baf272-c783-464a-9702-a97689a521aa service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:23.578833 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 669/1332] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:28:25.550287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03ceaf-7e26-42a9-8f33-95d40282b55e None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:25.550817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03ceaf-7e26-42a9-8f33-95d40282b55e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:25.550817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03ceaf-7e26-42a9-8f33-95d40282b55e None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:25.552058 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 664/1333] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:25.557481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89d77-4409-4dc0-ac7e-041782ccbf6c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:25.557979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89d77-4409-4dc0-ac7e-041782ccbf6c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:25.558084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89d77-4409-4dc0-ac7e-041782ccbf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:25.623265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4ab89d77-4409-4dc0-ac7e-041782ccbf6c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:25.624488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4ab89d77-4409-4dc0-ac7e-041782ccbf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:25.699187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:25.721759 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 670/1334] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:26.004903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03ceaf-7e26-42a9-8f33-95d40282b55e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:26.006494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4f03ceaf-7e26-42a9-8f33-95d40282b55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:26.047078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:26.109763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03ceaf-7e26-42a9-8f33-95d40282b55e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:26.182107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8a132-e6d1-4444-af2a-9cd11d9c4cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:26.183222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8a132-e6d1-4444-af2a-9cd11d9c4cfc service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:26.183498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8a132-e6d1-4444-af2a-9cd11d9c4cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:26.183764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8a132-e6d1-4444-af2a-9cd11d9c4cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:26.185389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7ab8a132-e6d1-4444-af2a-9cd11d9c4cfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:26.268616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:26.294145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8a132-e6d1-4444-af2a-9cd11d9c4cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:26.295557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8a132-e6d1-4444-af2a-9cd11d9c4cfc service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:26.313975 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 665/1335] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:28:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:28:29.005727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b12b2a-f5aa-41e9-bfdf-2a6320a6f9b9 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:29.006284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b12b2a-f5aa-41e9-bfdf-2a6320a6f9b9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:29.006284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b12b2a-f5aa-41e9-bfdf-2a6320a6f9b9 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:29.007615 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 671/1336] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:29.013709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f206a2-ddb5-4180-ba6d-a2323c713c55 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:29.014268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f206a2-ddb5-4180-ba6d-a2323c713c55 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:29.014268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f206a2-ddb5-4180-ba6d-a2323c713c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:29.096420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-62f206a2-ddb5-4180-ba6d-a2323c713c55 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:29.099020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-62f206a2-ddb5-4180-ba6d-a2323c713c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:29.232089 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 666/1337] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:28:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:29.536451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08339a-2fad-40ea-a3aa-043a2b102bec None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:29.536738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08339a-2fad-40ea-a3aa-043a2b102bec None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:29.537014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08339a-2fad-40ea-a3aa-043a2b102bec None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:29.538408 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 672/1338] 10.222.0.76 () {54 vars in 965 bytes} [Sat Aug 27 04:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:29.545445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a339dbf-9249-42e0-9972-b7d71c82a503 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:29.545733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a339dbf-9249-42e0-9972-b7d71c82a503 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:29.546009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a339dbf-9249-42e0-9972-b7d71c82a503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:29.605085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:29.627961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6a339dbf-9249-42e0-9972-b7d71c82a503 None None] MFA Rules not processed for user `0547461f91aa423381430eda35fe6b74`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:29.629197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6a339dbf-9249-42e0-9972-b7d71c82a503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:29.706362 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 667/1339] 10.222.0.76 () {58 vars in 1062 bytes} [Sat Aug 27 04:28:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:29.715868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08339a-2fad-40ea-a3aa-043a2b102bec None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:29.717442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1a08339a-2fad-40ea-a3aa-043a2b102bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:29.822614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08339a-2fad-40ea-a3aa-043a2b102bec None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:29.896475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00addaf6-112f-42ef-8115-ff0ee96d627d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:29.897076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00addaf6-112f-42ef-8115-ff0ee96d627d service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:29.897353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00addaf6-112f-42ef-8115-ff0ee96d627d service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:29.897624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00addaf6-112f-42ef-8115-ff0ee96d627d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:29.899222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-00addaf6-112f-42ef-8115-ff0ee96d627d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:29.935367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:30.009481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00addaf6-112f-42ef-8115-ff0ee96d627d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:30.011472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00addaf6-112f-42ef-8115-ff0ee96d627d service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:30.031673 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 673/1340] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:28:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:28:34.862217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408723e-0936-4119-9333-d9bf27634d8b None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:34.862749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408723e-0936-4119-9333-d9bf27634d8b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:34.862749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408723e-0936-4119-9333-d9bf27634d8b None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:34.864261 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 668/1341] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:34.869304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127b01e-a884-424b-8328-baa366c54fb4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:34.870364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127b01e-a884-424b-8328-baa366c54fb4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:34.870569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127b01e-a884-424b-8328-baa366c54fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:34.942312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7127b01e-a884-424b-8328-baa366c54fb4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:34.943513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7127b01e-a884-424b-8328-baa366c54fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:35.040125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:35.051388 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 674/1342] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:35.337201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408723e-0936-4119-9333-d9bf27634d8b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:35.338829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d408723e-0936-4119-9333-d9bf27634d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:35.454925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408723e-0936-4119-9333-d9bf27634d8b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:35.493802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:35.532139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9fe88-16bd-4d0d-b3ed-e95728114d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:35.532817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9fe88-16bd-4d0d-b3ed-e95728114d7c service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:35.533049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9fe88-16bd-4d0d-b3ed-e95728114d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:35.533318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9fe88-16bd-4d0d-b3ed-e95728114d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:35.534944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-20e9fe88-16bd-4d0d-b3ed-e95728114d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:35.648876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9fe88-16bd-4d0d-b3ed-e95728114d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:35.650221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9fe88-16bd-4d0d-b3ed-e95728114d7c service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:35.671047 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 669/1343] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:28:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:28:38.703117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9fdea-797c-4c1a-b16a-2982582d69dd None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:38.703640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9fdea-797c-4c1a-b16a-2982582d69dd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:38.703640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9fdea-797c-4c1a-b16a-2982582d69dd None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:38.704999 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 675/1344] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:38.710210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09bf93-c245-4613-b437-fc9991f8f7a3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:38.710657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09bf93-c245-4613-b437-fc9991f8f7a3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:38.710873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09bf93-c245-4613-b437-fc9991f8f7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:38.777566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-fd09bf93-c245-4613-b437-fc9991f8f7a3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:38.778784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fd09bf93-c245-4613-b437-fc9991f8f7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:38.796532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:38.877881 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 670/1345] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:28:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:39.160861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9fdea-797c-4c1a-b16a-2982582d69dd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:39.162394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-78f9fdea-797c-4c1a-b16a-2982582d69dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:39.271620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9fdea-797c-4c1a-b16a-2982582d69dd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:39.349791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d410fe5-f252-4df4-913d-35e8bb4e0b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:39.350391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d410fe5-f252-4df4-913d-35e8bb4e0b3e service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:39.350664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d410fe5-f252-4df4-913d-35e8bb4e0b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:39.350932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d410fe5-f252-4df4-913d-35e8bb4e0b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:39.352579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2d410fe5-f252-4df4-913d-35e8bb4e0b3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:39.398575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:39.467525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d410fe5-f252-4df4-913d-35e8bb4e0b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:39.468988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d410fe5-f252-4df4-913d-35e8bb4e0b3e service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:39.488155 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 676/1346] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:28:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:28:43.741937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d969191-4db9-4879-a695-309e7e5184a6 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:43.742386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d969191-4db9-4879-a695-309e7e5184a6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:43.742477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d969191-4db9-4879-a695-309e7e5184a6 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:43.743816 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 671/1347] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:43.749944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772694d3-2009-4580-ae9d-de04410182d7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:43.750476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772694d3-2009-4580-ae9d-de04410182d7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:43.750585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772694d3-2009-4580-ae9d-de04410182d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:43.823567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-772694d3-2009-4580-ae9d-de04410182d7 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:43.824927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-772694d3-2009-4580-ae9d-de04410182d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:43.928066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:43.930644 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 677/1348] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:44.216986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d969191-4db9-4879-a695-309e7e5184a6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:28:44.218515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7d969191-4db9-4879-a695-309e7e5184a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:44.331260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d969191-4db9-4879-a695-309e7e5184a6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:28:44.389951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:44.416376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d342c-de29-45c6-b67b-7f757a5cd129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:28:44.416987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d342c-de29-45c6-b67b-7f757a5cd129 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:44.417255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d342c-de29-45c6-b67b-7f757a5cd129 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:44.417516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d342c-de29-45c6-b67b-7f757a5cd129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:44.419132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-468d342c-de29-45c6-b67b-7f757a5cd129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:44.529523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d342c-de29-45c6-b67b-7f757a5cd129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:28:44.530933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d342c-de29-45c6-b67b-7f757a5cd129 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:28:44.549558 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 672/1349] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:28:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:28:49.569400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1347437-abdb-4a9f-a061-636506048032 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:49.569844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1347437-abdb-4a9f-a061-636506048032 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:49.570338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1347437-abdb-4a9f-a061-636506048032 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:49.572478 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 678/1350] 10.222.0.76 () {54 vars in 921 bytes} [Sat Aug 27 04:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:49.581513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db0512-28bf-4d7f-896b-a00c31808bf6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:49.581513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db0512-28bf-4d7f-896b-a00c31808bf6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:49.581513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db0512-28bf-4d7f-896b-a00c31808bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:49.730337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-65db0512-28bf-4d7f-896b-a00c31808bf6 None None] MFA Rules not processed for user `702086569a63418685711c4c134b1482`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:49.730337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-65db0512-28bf-4d7f-896b-a00c31808bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:49.750353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:49.848381 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 673/1351] 10.222.0.76 () {58 vars in 1018 bytes} [Sat Aug 27 04:28:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:54.287387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a2e67-3a4e-44ff-9e46-709ade5b5574 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:54.288315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a2e67-3a4e-44ff-9e46-709ade5b5574 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:54.288596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a2e67-3a4e-44ff-9e46-709ade5b5574 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:54.289937 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 679/1352] 10.222.0.76 () {54 vars in 921 bytes} [Sat Aug 27 04:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:54.295517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8353a4-556f-46cd-aeaf-31c57d839f01 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:54.295982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8353a4-556f-46cd-aeaf-31c57d839f01 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:54.296084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8353a4-556f-46cd-aeaf-31c57d839f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:54.375103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1d8353a4-556f-46cd-aeaf-31c57d839f01 None None] MFA Rules not processed for user `702086569a63418685711c4c134b1482`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:54.376427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1d8353a4-556f-46cd-aeaf-31c57d839f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:54.453460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:54.496111 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 674/1353] 10.222.0.76 () {58 vars in 1018 bytes} [Sat Aug 27 04:28:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:55.791355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbc0df-b0e8-4bfd-aa46-42b37ec59bbe None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:55.791901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbc0df-b0e8-4bfd-aa46-42b37ec59bbe None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:55.791901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbc0df-b0e8-4bfd-aa46-42b37ec59bbe None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:55.793313 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 680/1354] 10.222.0.76 () {54 vars in 921 bytes} [Sat Aug 27 04:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:55.798631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e0511-60cf-462d-8c0a-04d2e0b638b9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:55.799049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e0511-60cf-462d-8c0a-04d2e0b638b9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:55.799189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e0511-60cf-462d-8c0a-04d2e0b638b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:55.876681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-168e0511-60cf-462d-8c0a-04d2e0b638b9 None None] MFA Rules not processed for user `702086569a63418685711c4c134b1482`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:55.877976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-168e0511-60cf-462d-8c0a-04d2e0b638b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:55.990488 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 675/1355] 10.222.0.76 () {58 vars in 1018 bytes} [Sat Aug 27 04:28:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:59.315742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328890ac-865f-49f8-8bb8-beda1697f241 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:59.316716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328890ac-865f-49f8-8bb8-beda1697f241 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:59.316990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328890ac-865f-49f8-8bb8-beda1697f241 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:59.318492 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 681/1356] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:59.324474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee4808-be06-46b1-8c06-2d3d828f0395 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:59.324907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee4808-be06-46b1-8c06-2d3d828f0395 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:59.325017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee4808-be06-46b1-8c06-2d3d828f0395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:59.360776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:28:59.393761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d3ee4808-be06-46b1-8c06-2d3d828f0395 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:59.396260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d3ee4808-be06-46b1-8c06-2d3d828f0395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:59.519449 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 676/1357] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:28:59.832910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf5e32-f3ea-444e-a232-722582fce242 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:59.833466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf5e32-f3ea-444e-a232-722582fce242 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:59.833743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf5e32-f3ea-444e-a232-722582fce242 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:59.835072 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 682/1358] 10.222.0.76 () {54 vars in 962 bytes} [Sat Aug 27 04:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:28:59.845149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ed3d3-50dc-422b-b88f-e8f3cc28e22c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:28:59.845600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ed3d3-50dc-422b-b88f-e8f3cc28e22c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:28:59.845887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ed3d3-50dc-422b-b88f-e8f3cc28e22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:28:59.931921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-341ed3d3-50dc-422b-b88f-e8f3cc28e22c None None] MFA Rules not processed for user `0e5ddcf00a184aa0ac0e7194f1c72425`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:28:59.933194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-341ed3d3-50dc-422b-b88f-e8f3cc28e22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:28:59.998066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:00.068292 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 677/1359] 10.222.0.76 () {58 vars in 1059 bytes} [Sat Aug 27 04:28:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:29:00.076875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf5e32-f3ea-444e-a232-722582fce242 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:29:00.082369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6acf5e32-f3ea-444e-a232-722582fce242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:00.256447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf5e32-f3ea-444e-a232-722582fce242 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:29:00.335160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:00.377831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd37ab3-d7a6-416c-a100-c0d1bbd10719 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:29:00.378492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd37ab3-d7a6-416c-a100-c0d1bbd10719 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:00.378779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd37ab3-d7a6-416c-a100-c0d1bbd10719 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:00.379049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd37ab3-d7a6-416c-a100-c0d1bbd10719 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:00.380678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7cd37ab3-d7a6-416c-a100-c0d1bbd10719 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:00.476859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd37ab3-d7a6-416c-a100-c0d1bbd10719 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:29:00.478731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd37ab3-d7a6-416c-a100-c0d1bbd10719 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:29:00.497738 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 683/1360] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:29:02.661568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012061c8-4d46-401f-91bf-a0576b8debb2 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:02.662075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012061c8-4d46-401f-91bf-a0576b8debb2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:02.662075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012061c8-4d46-401f-91bf-a0576b8debb2 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:02.663525 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 678/1361] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:02.669065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33458e-1962-4d89-b101-23da235de82b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:02.669486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33458e-1962-4d89-b101-23da235de82b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:02.669615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33458e-1962-4d89-b101-23da235de82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:02.739401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5c33458e-1962-4d89-b101-23da235de82b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:02.740659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5c33458e-1962-4d89-b101-23da235de82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:02.783388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:02.844871 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 684/1362] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:29:03.149359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012061c8-4d46-401f-91bf-a0576b8debb2 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:29:03.151754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-012061c8-4d46-401f-91bf-a0576b8debb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:03.346564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012061c8-4d46-401f-91bf-a0576b8debb2 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:29:03.356366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:03.467259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f279075-d84c-4f5b-858c-38296676794f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:29:03.467895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f279075-d84c-4f5b-858c-38296676794f service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:03.468198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f279075-d84c-4f5b-858c-38296676794f service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:03.468482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f279075-d84c-4f5b-858c-38296676794f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:03.470191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4f279075-d84c-4f5b-858c-38296676794f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:03.570792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f279075-d84c-4f5b-858c-38296676794f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:29:03.573186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f279075-d84c-4f5b-858c-38296676794f service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:29:03.594616 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 679/1363] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:29:06.068278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5be71-371b-40ce-b1ac-b329e015f51b None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:06.068779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5be71-371b-40ce-b1ac-b329e015f51b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:06.068894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5be71-371b-40ce-b1ac-b329e015f51b None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:06.070446 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 685/1364] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:06.076473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8377fca-8626-415a-8f18-33023365ff96 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:06.076896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8377fca-8626-415a-8f18-33023365ff96 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:06.077103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8377fca-8626-415a-8f18-33023365ff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:06.095492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:06.156438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c8377fca-8626-415a-8f18-33023365ff96 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:06.157663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c8377fca-8626-415a-8f18-33023365ff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:06.291231 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 680/1365] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:29:06.583208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050499e-a247-4a38-966a-077b9537e535 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:06.591367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050499e-a247-4a38-966a-077b9537e535 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:06.591367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050499e-a247-4a38-966a-077b9537e535 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:06.591367 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 686/1366] 10.222.0.76 () {54 vars in 962 bytes} [Sat Aug 27 04:29:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:06.597705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586aa55-8c24-44a9-896c-da188e8852aa None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:06.598082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586aa55-8c24-44a9-896c-da188e8852aa None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:06.598278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586aa55-8c24-44a9-896c-da188e8852aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:06.687904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a586aa55-8c24-44a9-896c-da188e8852aa None None] MFA Rules not processed for user `0e5ddcf00a184aa0ac0e7194f1c72425`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:06.689050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a586aa55-8c24-44a9-896c-da188e8852aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:06.726586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:06.824388 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 681/1367] 10.222.0.76 () {58 vars in 1059 bytes} [Sat Aug 27 04:29:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:29:06.832608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050499e-a247-4a38-966a-077b9537e535 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:29:06.834188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4050499e-a247-4a38-966a-077b9537e535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:07.076028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050499e-a247-4a38-966a-077b9537e535 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:29:07.096530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:07.205354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c160c0-ac33-46fe-ab65-3eddf2424fd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:29:07.205959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c160c0-ac33-46fe-ab65-3eddf2424fd1 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:07.206234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c160c0-ac33-46fe-ab65-3eddf2424fd1 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:07.206500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c160c0-ac33-46fe-ab65-3eddf2424fd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:07.208102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f3c160c0-ac33-46fe-ab65-3eddf2424fd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:07.316322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c160c0-ac33-46fe-ab65-3eddf2424fd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:29:07.317931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c160c0-ac33-46fe-ab65-3eddf2424fd1 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:29:07.348261 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 687/1368] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:29:09.679063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690c798-e028-42bb-8829-506d5ee77b2a None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:09.679486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690c798-e028-42bb-8829-506d5ee77b2a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:09.679571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690c798-e028-42bb-8829-506d5ee77b2a None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:09.681606 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 682/1369] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:09.689067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717258d6-b3cd-4d63-8552-60c7055072b9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:09.689499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717258d6-b3cd-4d63-8552-60c7055072b9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:09.689608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717258d6-b3cd-4d63-8552-60c7055072b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:09.740790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:09.780724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-717258d6-b3cd-4d63-8552-60c7055072b9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:09.781956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-717258d6-b3cd-4d63-8552-60c7055072b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:09.904636 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 688/1370] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:29:10.203926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690c798-e028-42bb-8829-506d5ee77b2a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:29:10.205847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a690c798-e028-42bb-8829-506d5ee77b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:10.355046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:10.361940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690c798-e028-42bb-8829-506d5ee77b2a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:29:10.513489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be6ae8-b0c3-41dd-a1e9-bb9f8cb1513f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:29:10.514976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be6ae8-b0c3-41dd-a1e9-bb9f8cb1513f service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:10.515409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be6ae8-b0c3-41dd-a1e9-bb9f8cb1513f service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:10.515960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be6ae8-b0c3-41dd-a1e9-bb9f8cb1513f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:10.519826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-13be6ae8-b0c3-41dd-a1e9-bb9f8cb1513f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:10.638030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be6ae8-b0c3-41dd-a1e9-bb9f8cb1513f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:29:10.639787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be6ae8-b0c3-41dd-a1e9-bb9f8cb1513f service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:29:10.656587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:10.671726 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 683/1371] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:29:11.547574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c4c05-09b6-4d63-97a5-9c8d155d4993 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:11.548059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c4c05-09b6-4d63-97a5-9c8d155d4993 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:11.548195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c4c05-09b6-4d63-97a5-9c8d155d4993 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:11.549677 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 689/1372] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:11.555079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56cb9e-62aa-456a-9762-f5ab0acf5aa5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:11.555714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56cb9e-62aa-456a-9762-f5ab0acf5aa5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:11.555714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56cb9e-62aa-456a-9762-f5ab0acf5aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:11.630239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ec56cb9e-62aa-456a-9762-f5ab0acf5aa5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:11.631555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ec56cb9e-62aa-456a-9762-f5ab0acf5aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:11.737038 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 684/1373] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:29:12.319654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9122de-abcd-44a9-8ffb-9a584ce8151f None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:12.319654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9122de-abcd-44a9-8ffb-9a584ce8151f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:12.319654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9122de-abcd-44a9-8ffb-9a584ce8151f None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:12.322479 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 690/1374] 10.222.0.76 () {54 vars in 964 bytes} [Sat Aug 27 04:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:12.326196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a502c-28b0-4656-aea9-074f90bd4ac5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:12.326570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a502c-28b0-4656-aea9-074f90bd4ac5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:12.326930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a502c-28b0-4656-aea9-074f90bd4ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:12.419437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e73a502c-28b0-4656-aea9-074f90bd4ac5 None None] MFA Rules not processed for user `dfcccc451b4b443f9b2428cc207211ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:12.420683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e73a502c-28b0-4656-aea9-074f90bd4ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:12.442193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:12.505124 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 685/1375] 10.222.0.76 () {58 vars in 1061 bytes} [Sat Aug 27 04:29:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:29:12.513435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9122de-abcd-44a9-8ffb-9a584ce8151f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:29:12.515148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-de9122de-abcd-44a9-8ffb-9a584ce8151f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:12.629482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9122de-abcd-44a9-8ffb-9a584ce8151f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:29:12.635069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:12.709909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450062da-d4e7-4eb4-b89b-0427f7d89417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:29:12.710521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450062da-d4e7-4eb4-b89b-0427f7d89417 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:12.710801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450062da-d4e7-4eb4-b89b-0427f7d89417 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:12.711072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450062da-d4e7-4eb4-b89b-0427f7d89417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:12.713317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-450062da-d4e7-4eb4-b89b-0427f7d89417 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:12.834392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450062da-d4e7-4eb4-b89b-0427f7d89417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:29:12.835959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450062da-d4e7-4eb4-b89b-0427f7d89417 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:29:12.856333 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 691/1376] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:29:12.968681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33170f15-e6fa-406a-b7af-b94ae1d787ff None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:12.969133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33170f15-e6fa-406a-b7af-b94ae1d787ff None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:12.969240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33170f15-e6fa-406a-b7af-b94ae1d787ff None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:12.970690 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 686/1377] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:12.975684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be4bd9-79f7-4840-a4ac-9c1727e52419 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:12.975957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be4bd9-79f7-4840-a4ac-9c1727e52419 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:12.976261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be4bd9-79f7-4840-a4ac-9c1727e52419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:13.022094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:13.053438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f4be4bd9-79f7-4840-a4ac-9c1727e52419 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:13.054760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f4be4bd9-79f7-4840-a4ac-9c1727e52419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:13.160198 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 692/1378] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:29:13.447012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33170f15-e6fa-406a-b7af-b94ae1d787ff None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:29:13.448638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-33170f15-e6fa-406a-b7af-b94ae1d787ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:13.647273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33170f15-e6fa-406a-b7af-b94ae1d787ff None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:29:13.686882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:13.776439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f6b10-eccc-4c2c-8fa7-59484f30e0c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:29:13.777051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f6b10-eccc-4c2c-8fa7-59484f30e0c7 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:13.777326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f6b10-eccc-4c2c-8fa7-59484f30e0c7 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:13.777597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f6b10-eccc-4c2c-8fa7-59484f30e0c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:13.779331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f02f6b10-eccc-4c2c-8fa7-59484f30e0c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:13.875037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f6b10-eccc-4c2c-8fa7-59484f30e0c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:29:13.876549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f6b10-eccc-4c2c-8fa7-59484f30e0c7 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:29:13.896114 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 687/1379] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:29:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:29:16.036264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5f2a9-7372-4e59-bcea-b9c2f7948e56 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:16.037078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5f2a9-7372-4e59-bcea-b9c2f7948e56 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:16.037483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5f2a9-7372-4e59-bcea-b9c2f7948e56 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:16.042883 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 693/1380] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:29:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:16.044235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5392985-400d-426b-bd2c-c526d13356be None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:16.044660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5392985-400d-426b-bd2c-c526d13356be None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:16.044798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5392985-400d-426b-bd2c-c526d13356be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:16.089066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:16.115390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c5392985-400d-426b-bd2c-c526d13356be None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:16.116641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c5392985-400d-426b-bd2c-c526d13356be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:16.269508 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 688/1381] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:29:16.560018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5f2a9-7372-4e59-bcea-b9c2f7948e56 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:29:16.561932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f3c5f2a9-7372-4e59-bcea-b9c2f7948e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:16.737885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:16.795459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5f2a9-7372-4e59-bcea-b9c2f7948e56 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:29:16.946762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6f42f-c13e-4df5-a414-f3ba9d56e064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:29:16.947515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6f42f-c13e-4df5-a414-f3ba9d56e064 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:16.947893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6f42f-c13e-4df5-a414-f3ba9d56e064 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:16.948316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6f42f-c13e-4df5-a414-f3ba9d56e064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:16.952051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9ba6f42f-c13e-4df5-a414-f3ba9d56e064 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:17.047263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:17.072239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6f42f-c13e-4df5-a414-f3ba9d56e064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:29:17.072239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6f42f-c13e-4df5-a414-f3ba9d56e064 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:29:17.109577 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 694/1382] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:29:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:29:19.321659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f6668-c2cb-48e0-bce0-4ffda6053e23 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:19.322146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f6668-c2cb-48e0-bce0-4ffda6053e23 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:19.322259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f6668-c2cb-48e0-bce0-4ffda6053e23 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:19.327505 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 689/1383] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:29:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:19.329049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c32c08-00a8-4b7b-97d1-436a6c5155e8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:19.329779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c32c08-00a8-4b7b-97d1-436a6c5155e8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:19.330200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c32c08-00a8-4b7b-97d1-436a6c5155e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:19.400601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-45c32c08-00a8-4b7b-97d1-436a6c5155e8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:19.402094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-45c32c08-00a8-4b7b-97d1-436a6c5155e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:19.508755 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 695/1384] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:29:19.798304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f6668-c2cb-48e0-bce0-4ffda6053e23 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:29:19.799805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ae4f6668-c2cb-48e0-bce0-4ffda6053e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:19.913916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:19.965534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f6668-c2cb-48e0-bce0-4ffda6053e23 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:29:20.090171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3a65b-999d-4e3f-b276-7ba2256eec6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:29:20.090832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3a65b-999d-4e3f-b276-7ba2256eec6d service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:20.091130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3a65b-999d-4e3f-b276-7ba2256eec6d service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:20.091385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3a65b-999d-4e3f-b276-7ba2256eec6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:20.093271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-27b3a65b-999d-4e3f-b276-7ba2256eec6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:20.184271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:20.201123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3a65b-999d-4e3f-b276-7ba2256eec6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:29:20.202860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3a65b-999d-4e3f-b276-7ba2256eec6d service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:29:20.228105 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 690/1385] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:29:22.173798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c80e3-bf22-4d14-acdd-c01f0cae2980 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:22.174684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c80e3-bf22-4d14-acdd-c01f0cae2980 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:22.174985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c80e3-bf22-4d14-acdd-c01f0cae2980 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:22.176543 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 696/1386] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:22.183341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8d1af-4ee1-4967-88ff-6857c22e3905 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:22.183840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8d1af-4ee1-4967-88ff-6857c22e3905 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:22.184045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8d1af-4ee1-4967-88ff-6857c22e3905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:22.252584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5bc8d1af-4ee1-4967-88ff-6857c22e3905 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:22.253654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5bc8d1af-4ee1-4967-88ff-6857c22e3905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:22.364819 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 691/1387] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:29:22.666271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c80e3-bf22-4d14-acdd-c01f0cae2980 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:29:22.668290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-717c80e3-bf22-4d14-acdd-c01f0cae2980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:22.740557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:22.847466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c80e3-bf22-4d14-acdd-c01f0cae2980 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:29:22.968981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dead09-aa68-465c-97b3-0fe5d6f706c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:29:22.969725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dead09-aa68-465c-97b3-0fe5d6f706c7 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:22.970029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dead09-aa68-465c-97b3-0fe5d6f706c7 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:22.970304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dead09-aa68-465c-97b3-0fe5d6f706c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:22.972035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-16dead09-aa68-465c-97b3-0fe5d6f706c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:22.985555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:23.074509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dead09-aa68-465c-97b3-0fe5d6f706c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:29:23.076129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dead09-aa68-465c-97b3-0fe5d6f706c7 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:29:23.095301 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 697/1388] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:29:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:29:25.261576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc836fa7-a320-4f54-9753-a3d3bb0ac629 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:25.262269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc836fa7-a320-4f54-9753-a3d3bb0ac629 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:25.262269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc836fa7-a320-4f54-9753-a3d3bb0ac629 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:25.263386 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 692/1389] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:25.269198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b55ab-0c51-4561-9289-2f4d9018be92 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:25.269987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b55ab-0c51-4561-9289-2f4d9018be92 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:25.269987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b55ab-0c51-4561-9289-2f4d9018be92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:25.344640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-cd3b55ab-0c51-4561-9289-2f4d9018be92 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:25.346200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cd3b55ab-0c51-4561-9289-2f4d9018be92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:25.449967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:25.464748 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 698/1390] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:29:25.822301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc836fa7-a320-4f54-9753-a3d3bb0ac629 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:29:25.823964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bc836fa7-a320-4f54-9753-a3d3bb0ac629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:25.876833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:25.987733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc836fa7-a320-4f54-9753-a3d3bb0ac629 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:29:26.110377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bddae-cf1f-4472-abe1-4e9a7be654f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:29:26.110899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bddae-cf1f-4472-abe1-4e9a7be654f7 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:26.111177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bddae-cf1f-4472-abe1-4e9a7be654f7 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:26.111446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bddae-cf1f-4472-abe1-4e9a7be654f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:26.113091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-404bddae-cf1f-4472-abe1-4e9a7be654f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:26.125945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:26.224664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bddae-cf1f-4472-abe1-4e9a7be654f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:29:26.227432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bddae-cf1f-4472-abe1-4e9a7be654f7 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:29:26.252629 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 693/1391] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:29:28.451768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28659d1d-4123-4d9e-b8a6-10277b4398c1 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:28.452387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28659d1d-4123-4d9e-b8a6-10277b4398c1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:28.452387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28659d1d-4123-4d9e-b8a6-10277b4398c1 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:28.453999 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 699/1392] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:28.459460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f55514-b722-4c49-8c8f-101d9ef49ec9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:28.459907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f55514-b722-4c49-8c8f-101d9ef49ec9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:28.460067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f55514-b722-4c49-8c8f-101d9ef49ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:28.527651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-58f55514-b722-4c49-8c8f-101d9ef49ec9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:28.528893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-58f55514-b722-4c49-8c8f-101d9ef49ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:28.606466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad1e48-6d6e-4e2f-9cec-27a32e4d105c None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:28.606679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad1e48-6d6e-4e2f-9cec-27a32e4d105c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:28.606929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad1e48-6d6e-4e2f-9cec-27a32e4d105c None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:28.608269 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 700/1393] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:28.613127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a6560-8576-4094-b0bb-6072b46e3cba None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:28.613411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a6560-8576-4094-b0bb-6072b46e3cba None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:28.613683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a6560-8576-4094-b0bb-6072b46e3cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:28.619212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:28.631353 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 694/1394] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:29:28.683859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-986a6560-8576-4094-b0bb-6072b46e3cba None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:28.685121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-986a6560-8576-4094-b0bb-6072b46e3cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:28.783567 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 701/1395] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:29:28.924680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f55514-b722-4c49-8c8f-101d9ef49ec9 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:29:28.926091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-58f55514-b722-4c49-8c8f-101d9ef49ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:29.045709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f55514-b722-4c49-8c8f-101d9ef49ec9 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:29:29.100617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab454905-0cbe-4d08-8710-03644eb8b925 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:29.100911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab454905-0cbe-4d08-8710-03644eb8b925 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:29.101244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab454905-0cbe-4d08-8710-03644eb8b925 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:29.103645 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 702/1396] 10.222.0.76 () {54 vars in 967 bytes} [Sat Aug 27 04:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:29:29.108814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e099b9-76c0-4609-83b9-bd5b2d5b24b9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:29.109618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e099b9-76c0-4609-83b9-bd5b2d5b24b9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:29.109618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e099b9-76c0-4609-83b9-bd5b2d5b24b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:29.147366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:29.167582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383b6c1-9be3-4a61-8b84-a4423236a668 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:29:29.168110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383b6c1-9be3-4a61-8b84-a4423236a668 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:29.168532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383b6c1-9be3-4a61-8b84-a4423236a668 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:29.168807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383b6c1-9be3-4a61-8b84-a4423236a668 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:29.170403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0383b6c1-9be3-4a61-8b84-a4423236a668 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:29.192206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c4e099b9-76c0-4609-83b9-bd5b2d5b24b9 None None] MFA Rules not processed for user `f9cd48a297bf498e88ce722f74154354`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:29.193413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c4e099b9-76c0-4609-83b9-bd5b2d5b24b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:29.207105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:29.277642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383b6c1-9be3-4a61-8b84-a4423236a668 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:29:29.279329 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 703/1397] 10.222.0.76 () {58 vars in 1064 bytes} [Sat Aug 27 04:29:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:29:29.279501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383b6c1-9be3-4a61-8b84-a4423236a668 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:29:29.286943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e099b9-76c0-4609-83b9-bd5b2d5b24b9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:29:29.294269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e099b9-76c0-4609-83b9-bd5b2d5b24b9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:29:29.298063 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 695/1398] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:29:29.369919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7381e9-ec45-463b-87e9-4cb12e286958 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:29:29.370526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7381e9-ec45-463b-87e9-4cb12e286958 service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:29.370833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7381e9-ec45-463b-87e9-4cb12e286958 service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:29.371101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7381e9-ec45-463b-87e9-4cb12e286958 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:29.372766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ef7381e9-ec45-463b-87e9-4cb12e286958 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:29.455219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:29.484453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7381e9-ec45-463b-87e9-4cb12e286958 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:29:29.485807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7381e9-ec45-463b-87e9-4cb12e286958 service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:29:29.508723 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 704/1399] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:29:30.434990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d50b8-d8e9-4189-b582-25a76d15ad85 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:30.435484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d50b8-d8e9-4189-b582-25a76d15ad85 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:30.435662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d50b8-d8e9-4189-b582-25a76d15ad85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:30.507341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c57d50b8-d8e9-4189-b582-25a76d15ad85 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:30.509181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c57d50b8-d8e9-4189-b582-25a76d15ad85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:30.575885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:30.614066 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 696/1400] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:29:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:29:30.665541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf168a-9db2-4764-b1c0-3e0cf1ca6689 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:30.666075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf168a-9db2-4764-b1c0-3e0cf1ca6689 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:30.666346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf168a-9db2-4764-b1c0-3e0cf1ca6689 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:30.667893 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 705/1401] 10.222.0.76 () {54 vars in 943 bytes} [Sat Aug 27 04:29:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:30.675544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f6bd4-1e39-4c49-ad29-a2462f6c6260 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:30.675776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f6bd4-1e39-4c49-ad29-a2462f6c6260 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:30.676051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f6bd4-1e39-4c49-ad29-a2462f6c6260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:30.768840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d80f6bd4-1e39-4c49-ad29-a2462f6c6260 None None] MFA Rules not processed for user `cc067131b0d84c7c9da1a33ecb7a9d02`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:30.770040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d80f6bd4-1e39-4c49-ad29-a2462f6c6260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:30.896977 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 697/1402] 10.222.0.76 () {58 vars in 1040 bytes} [Sat Aug 27 04:29:30 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:29:30.907628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf168a-9db2-4764-b1c0-3e0cf1ca6689 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:29:30.909485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-89cf168a-9db2-4764-b1c0-3e0cf1ca6689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:31.069004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf168a-9db2-4764-b1c0-3e0cf1ca6689 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:29:31.131448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:31.196823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed7580-d4bc-4f4f-b319-c1470aa8bfd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:29:31.197439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed7580-d4bc-4f4f-b319-c1470aa8bfd5 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:31.197881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed7580-d4bc-4f4f-b319-c1470aa8bfd5 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:31.198374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed7580-d4bc-4f4f-b319-c1470aa8bfd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:31.200284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-01ed7580-d4bc-4f4f-b319-c1470aa8bfd5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:31.310730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed7580-d4bc-4f4f-b319-c1470aa8bfd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:29:31.312283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed7580-d4bc-4f4f-b319-c1470aa8bfd5 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:29:31.322571 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 706/1403] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:29:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:29:31.502032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a39b4-8693-4b3a-b522-d3caabef5796 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:31.502560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a39b4-8693-4b3a-b522-d3caabef5796 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:31.502687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a39b4-8693-4b3a-b522-d3caabef5796 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:31.504004 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 698/1404] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:31.510047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfbf61-5849-4e64-b496-e69fc1b27b09 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:31.513925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfbf61-5849-4e64-b496-e69fc1b27b09 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:31.513925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfbf61-5849-4e64-b496-e69fc1b27b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:31.577646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-aecfbf61-5849-4e64-b496-e69fc1b27b09 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:31.578819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aecfbf61-5849-4e64-b496-e69fc1b27b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:31.632694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:31.691830 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 707/1405] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:29:31.993355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a39b4-8693-4b3a-b522-d3caabef5796 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:29:31.994888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-164a39b4-8693-4b3a-b522-d3caabef5796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:32.039195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:32.173513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a39b4-8693-4b3a-b522-d3caabef5796 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:29:32.323795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176f56d-0100-4950-9a43-fc9548587b07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:29:32.324365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176f56d-0100-4950-9a43-fc9548587b07 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:32.324642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176f56d-0100-4950-9a43-fc9548587b07 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:32.324911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176f56d-0100-4950-9a43-fc9548587b07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:32.326663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2176f56d-0100-4950-9a43-fc9548587b07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:32.415290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:32.453970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176f56d-0100-4950-9a43-fc9548587b07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:29:32.455827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176f56d-0100-4950-9a43-fc9548587b07 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:29:32.476046 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 699/1406] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:29:34.985973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99c8f8-7006-4216-9f26-4576b6d74733 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:34.986555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99c8f8-7006-4216-9f26-4576b6d74733 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:34.986555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99c8f8-7006-4216-9f26-4576b6d74733 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:34.988250 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 708/1407] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:34.995954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f6877-26a5-4437-a95e-96fe073f0772 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:34.996556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f6877-26a5-4437-a95e-96fe073f0772 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:34.996556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f6877-26a5-4437-a95e-96fe073f0772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:35.075017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a93f6877-26a5-4437-a95e-96fe073f0772 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:35.076281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a93f6877-26a5-4437-a95e-96fe073f0772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:35.149326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:35.186582 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 700/1408] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:29:35.490268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99c8f8-7006-4216-9f26-4576b6d74733 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:29:35.491862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0b99c8f8-7006-4216-9f26-4576b6d74733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:35.655865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99c8f8-7006-4216-9f26-4576b6d74733 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:29:35.678165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:35.788204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c42f64-1730-4421-8d3e-922b04bf4107 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:29:35.789406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c42f64-1730-4421-8d3e-922b04bf4107 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:35.789677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c42f64-1730-4421-8d3e-922b04bf4107 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:35.789946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c42f64-1730-4421-8d3e-922b04bf4107 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:35.791843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a3c42f64-1730-4421-8d3e-922b04bf4107 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:35.899611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c42f64-1730-4421-8d3e-922b04bf4107 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:29:35.901226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c42f64-1730-4421-8d3e-922b04bf4107 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:29:35.932417 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 709/1409] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:29:45.198419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=13 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:45.922701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:55.127192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6c00d-52cf-4fd9-87f1-0f2ce306aa9f None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:55.127778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6c00d-52cf-4fd9-87f1-0f2ce306aa9f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:55.127778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6c00d-52cf-4fd9-87f1-0f2ce306aa9f None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:55.129176 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 701/1410] 10.222.0.76 () {54 vars in 918 bytes} [Sat Aug 27 04:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:55.134729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5d3a5-6e56-46f9-bfe4-6e431d56bab7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:55.135148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5d3a5-6e56-46f9-bfe4-6e431d56bab7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:55.135257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5d3a5-6e56-46f9-bfe4-6e431d56bab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:55.212252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2cb5d3a5-6e56-46f9-bfe4-6e431d56bab7 None None] MFA Rules not processed for user `702086569a63418685711c4c134b1482`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:55.213435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2cb5d3a5-6e56-46f9-bfe4-6e431d56bab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:55.315989 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 710/1411] 10.222.0.76 () {58 vars in 1015 bytes} [Sat Aug 27 04:29:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:29:55.330698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f9fe2-5421-496a-aa02-4d36b9d115d8 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:55.330986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f9fe2-5421-496a-aa02-4d36b9d115d8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:55.331262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f9fe2-5421-496a-aa02-4d36b9d115d8 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:55.334040 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 702/1412] 10.222.0.76 () {54 vars in 918 bytes} [Sat Aug 27 04:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:55.337936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a47f1f-e766-4968-ac00-b1c69590f74e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:55.338226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a47f1f-e766-4968-ac00-b1c69590f74e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:55.338503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a47f1f-e766-4968-ac00-b1c69590f74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:55.409704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:55.412708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-73a47f1f-e766-4968-ac00-b1c69590f74e None None] MFA Rules not processed for user `0e5ddcf00a184aa0ac0e7194f1c72425`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:55.413945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-73a47f1f-e766-4968-ac00-b1c69590f74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:55.541979 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 711/1413] 10.222.0.76 () {58 vars in 1015 bytes} [Sat Aug 27 04:29:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:29:57.953237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e651667-5b6d-41b5-9cfd-39419a9e5564 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:57.953803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e651667-5b6d-41b5-9cfd-39419a9e5564 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:57.953803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e651667-5b6d-41b5-9cfd-39419a9e5564 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:57.955141 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 04:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:57.961592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032eb12-e107-4176-b990-64401edf85fc None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:57.962045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032eb12-e107-4176-b990-64401edf85fc None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:57.962183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032eb12-e107-4176-b990-64401edf85fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:58.029496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d032eb12-e107-4176-b990-64401edf85fc None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:58.030690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d032eb12-e107-4176-b990-64401edf85fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:58.084077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:58.127580 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 04:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:29:58.412512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e651667-5b6d-41b5-9cfd-39419a9e5564 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:29:58.414043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8e651667-5b6d-41b5-9cfd-39419a9e5564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:58.560905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e651667-5b6d-41b5-9cfd-39419a9e5564 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:29:58.637418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:58.676707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377e0f5-b419-4773-ac9a-fac04362b807 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:29:58.677249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377e0f5-b419-4773-ac9a-fac04362b807 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:58.677528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377e0f5-b419-4773-ac9a-fac04362b807 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:58.677805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377e0f5-b419-4773-ac9a-fac04362b807 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:58.680299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9377e0f5-b419-4773-ac9a-fac04362b807 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:58.768964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377e0f5-b419-4773-ac9a-fac04362b807 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:29:58.770541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377e0f5-b419-4773-ac9a-fac04362b807 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:29:58.788296 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 704/1416] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:29:59.696880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae950900-5d6f-4a35-8f03-cc7699c9edbb None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:59.697401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae950900-5d6f-4a35-8f03-cc7699c9edbb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:59.697401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae950900-5d6f-4a35-8f03-cc7699c9edbb None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:59.698668 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 04:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:29:59.703529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacde91-150f-4891-8ea6-eedaf527c052 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:29:59.703960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacde91-150f-4891-8ea6-eedaf527c052 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:29:59.704130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacde91-150f-4891-8ea6-eedaf527c052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:29:59.782025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3bacde91-150f-4891-8ea6-eedaf527c052 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:29:59.783230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3bacde91-150f-4891-8ea6-eedaf527c052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:29:59.809659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:29:59.880914 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 04:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:00.045751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae950900-5d6f-4a35-8f03-cc7699c9edbb None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:00.047414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ae950900-5d6f-4a35-8f03-cc7699c9edbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:00.196434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae950900-5d6f-4a35-8f03-cc7699c9edbb None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:00.247133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:00.309136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ddcd7-b949-40c4-9433-7227b2b74c34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:00.309726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ddcd7-b949-40c4-9433-7227b2b74c34 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:00.310000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ddcd7-b949-40c4-9433-7227b2b74c34 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:00.310269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ddcd7-b949-40c4-9433-7227b2b74c34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:00.311873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ff7ddcd7-b949-40c4-9433-7227b2b74c34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:00.400013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ddcd7-b949-40c4-9433-7227b2b74c34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:00.401643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ddcd7-b949-40c4-9433-7227b2b74c34 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:00.420253 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 714/1419] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:01.322562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864ed05-d969-4f74-8b5d-ba84136783a1 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:01.323126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864ed05-d969-4f74-8b5d-ba84136783a1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:01.323126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864ed05-d969-4f74-8b5d-ba84136783a1 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:01.324489 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 04:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:30:01.329354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843711d0-0125-4e0f-92cc-3a47e42c5394 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:01.329751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843711d0-0125-4e0f-92cc-3a47e42c5394 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:01.329906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843711d0-0125-4e0f-92cc-3a47e42c5394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:01.386114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:01.407328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-843711d0-0125-4e0f-92cc-3a47e42c5394 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:30:01.414296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-843711d0-0125-4e0f-92cc-3a47e42c5394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:01.508936 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 04:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:01.678188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864ed05-d969-4f74-8b5d-ba84136783a1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:01.680294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d864ed05-d969-4f74-8b5d-ba84136783a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:01.826131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864ed05-d969-4f74-8b5d-ba84136783a1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:01.839074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:01.941081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ba6a5-667a-4745-bf30-c7e7eeb89025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:01.941688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ba6a5-667a-4745-bf30-c7e7eeb89025 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:01.941966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ba6a5-667a-4745-bf30-c7e7eeb89025 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:01.942238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ba6a5-667a-4745-bf30-c7e7eeb89025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:01.944438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5c4ba6a5-667a-4745-bf30-c7e7eeb89025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:02.034713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ba6a5-667a-4745-bf30-c7e7eeb89025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:02.036337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ba6a5-667a-4745-bf30-c7e7eeb89025 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:02.054169 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 707/1422] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:02.920028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2daf80-1f28-4262-8bd0-cad1012207fc None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:02.920648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2daf80-1f28-4262-8bd0-cad1012207fc None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:02.920648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2daf80-1f28-4262-8bd0-cad1012207fc None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:02.921971 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 04:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:30:02.926823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e87aa-f8be-42b3-a87c-223b5fbf4dc4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:02.927248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e87aa-f8be-42b3-a87c-223b5fbf4dc4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:02.927371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e87aa-f8be-42b3-a87c-223b5fbf4dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:02.948030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:03.008504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-175e87aa-f8be-42b3-a87c-223b5fbf4dc4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:30:03.009716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-175e87aa-f8be-42b3-a87c-223b5fbf4dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:03.106024 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 04:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:03.257258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2daf80-1f28-4262-8bd0-cad1012207fc None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:03.258813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9b2daf80-1f28-4262-8bd0-cad1012207fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:03.375984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:03.410959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2daf80-1f28-4262-8bd0-cad1012207fc None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:03.522802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ff132-3747-4327-9f6e-d005c320332e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:03.523327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ff132-3747-4327-9f6e-d005c320332e service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:03.523608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ff132-3747-4327-9f6e-d005c320332e service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:03.523876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ff132-3747-4327-9f6e-d005c320332e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:03.526289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-100ff132-3747-4327-9f6e-d005c320332e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:03.610595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:03.630156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ff132-3747-4327-9f6e-d005c320332e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:03.633362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ff132-3747-4327-9f6e-d005c320332e service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:03.657959 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 717/1425] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:04.523963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457f1d4-1876-4f13-a777-5eb6ce91e4fd None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:04.524560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457f1d4-1876-4f13-a777-5eb6ce91e4fd None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:04.524670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457f1d4-1876-4f13-a777-5eb6ce91e4fd None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:04.525951 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 04:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:30:04.530891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118c050-e678-4608-95c5-5efdf7b91334 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:04.531328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118c050-e678-4608-95c5-5efdf7b91334 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:04.531435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118c050-e678-4608-95c5-5efdf7b91334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:04.608922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a118c050-e678-4608-95c5-5efdf7b91334 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:30:04.610124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a118c050-e678-4608-95c5-5efdf7b91334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:04.706623 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 04:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:04.855792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457f1d4-1876-4f13-a777-5eb6ce91e4fd None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:04.857353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a457f1d4-1876-4f13-a777-5eb6ce91e4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:04.943761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:05.008123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457f1d4-1876-4f13-a777-5eb6ce91e4fd None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:05.119117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc5281-0e66-418c-b609-c906a7121922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:05.119650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc5281-0e66-418c-b609-c906a7121922 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:05.119932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc5281-0e66-418c-b609-c906a7121922 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:05.120234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc5281-0e66-418c-b609-c906a7121922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:05.121845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-66fc5281-0e66-418c-b609-c906a7121922 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:05.170763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:05.212943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc5281-0e66-418c-b609-c906a7121922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:05.214538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc5281-0e66-418c-b609-c906a7121922 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:05.233355 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 710/1428] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:06.150145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bcc59-2244-43cb-9bbc-1199ff337e7a None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:06.150740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bcc59-2244-43cb-9bbc-1199ff337e7a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:06.150740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bcc59-2244-43cb-9bbc-1199ff337e7a None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:06.152046 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 04:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:30:06.157032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480fa9b-8eaf-43f6-bf89-6a26c7fdf58a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:06.157432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480fa9b-8eaf-43f6-bf89-6a26c7fdf58a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:06.157573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480fa9b-8eaf-43f6-bf89-6a26c7fdf58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:06.235691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7480fa9b-8eaf-43f6-bf89-6a26c7fdf58a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:30:06.236854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7480fa9b-8eaf-43f6-bf89-6a26c7fdf58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:06.334737 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 04:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:06.485866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bcc59-2244-43cb-9bbc-1199ff337e7a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:06.487355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bd3bcc59-2244-43cb-9bbc-1199ff337e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:06.540031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:06.642400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bcc59-2244-43cb-9bbc-1199ff337e7a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:06.760265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12d4e5-ddcc-46bb-85f8-833503c3572b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:06.760796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12d4e5-ddcc-46bb-85f8-833503c3572b service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:06.761086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12d4e5-ddcc-46bb-85f8-833503c3572b service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:06.761348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12d4e5-ddcc-46bb-85f8-833503c3572b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:06.762949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6d12d4e5-ddcc-46bb-85f8-833503c3572b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:06.770163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:06.857839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12d4e5-ddcc-46bb-85f8-833503c3572b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:06.859450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12d4e5-ddcc-46bb-85f8-833503c3572b service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:06.878239 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 720/1431] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:07.791937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9597b7-2a34-467a-805f-9100ba0aa0d0 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:07.792513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9597b7-2a34-467a-805f-9100ba0aa0d0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:07.792513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9597b7-2a34-467a-805f-9100ba0aa0d0 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:07.793832 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 04:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:30:07.798813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0c816-87f8-4dd8-b2ae-f2b00e209c2e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:07.799197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0c816-87f8-4dd8-b2ae-f2b00e209c2e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:07.799361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0c816-87f8-4dd8-b2ae-f2b00e209c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:07.876040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b6b0c816-87f8-4dd8-b2ae-f2b00e209c2e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:30:07.877290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b6b0c816-87f8-4dd8-b2ae-f2b00e209c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:07.949540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:07.981662 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 04:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:08.130272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9597b7-2a34-467a-805f-9100ba0aa0d0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:08.132361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9f9597b7-2a34-467a-805f-9100ba0aa0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:08.150629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:08.279092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9597b7-2a34-467a-805f-9100ba0aa0d0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:08.364950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:08.389926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e2904-24ca-4717-834e-2653700db952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:08.390459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e2904-24ca-4717-834e-2653700db952 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:08.390736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e2904-24ca-4717-834e-2653700db952 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:08.391004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e2904-24ca-4717-834e-2653700db952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:08.392885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2b3e2904-24ca-4717-834e-2653700db952 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:08.481558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e2904-24ca-4717-834e-2653700db952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:08.483148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e2904-24ca-4717-834e-2653700db952 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:08.500685 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 713/1434] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:09.511532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78921ed0-0661-4242-8139-bb803a5b6e2e None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:09.512066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78921ed0-0661-4242-8139-bb803a5b6e2e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:09.512066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78921ed0-0661-4242-8139-bb803a5b6e2e None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:09.513460 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 04:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:30:09.518598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97759067-cdc9-4442-8bef-1022707c7282 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:09.530562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97759067-cdc9-4442-8bef-1022707c7282 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:09.530562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97759067-cdc9-4442-8bef-1022707c7282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:09.595639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-97759067-cdc9-4442-8bef-1022707c7282 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:30:09.596800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-97759067-cdc9-4442-8bef-1022707c7282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:09.638857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:09.705172 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 04:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:09.862403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78921ed0-0661-4242-8139-bb803a5b6e2e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:09.863846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-78921ed0-0661-4242-8139-bb803a5b6e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:10.020716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78921ed0-0661-4242-8139-bb803a5b6e2e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:10.079716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:10.138784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe698a0-e4a1-4a61-ba99-0f4d2c1f0a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:10.139313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe698a0-e4a1-4a61-ba99-0f4d2c1f0a70 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:10.139592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe698a0-e4a1-4a61-ba99-0f4d2c1f0a70 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:10.139862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe698a0-e4a1-4a61-ba99-0f4d2c1f0a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:10.141759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6fe698a0-e4a1-4a61-ba99-0f4d2c1f0a70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:10.231502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe698a0-e4a1-4a61-ba99-0f4d2c1f0a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:10.233183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe698a0-e4a1-4a61-ba99-0f4d2c1f0a70 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:10.251311 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 723/1437] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:11.139506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f57c0d-dbfe-4b0c-a58c-85d5d4502dd2 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:11.140068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f57c0d-dbfe-4b0c-a58c-85d5d4502dd2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:11.140068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f57c0d-dbfe-4b0c-a58c-85d5d4502dd2 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:11.141711 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 04:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:30:11.146676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631eedf-03b9-4064-85b4-16354d2fe994 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:11.147051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631eedf-03b9-4064-85b4-16354d2fe994 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:11.147758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631eedf-03b9-4064-85b4-16354d2fe994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:11.223917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d631eedf-03b9-4064-85b4-16354d2fe994 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:30:11.225052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d631eedf-03b9-4064-85b4-16354d2fe994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:11.227641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:11.328008 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 04:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:11.477898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f57c0d-dbfe-4b0c-a58c-85d5d4502dd2 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:11.479346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-23f57c0d-dbfe-4b0c-a58c-85d5d4502dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:11.628622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f57c0d-dbfe-4b0c-a58c-85d5d4502dd2 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:11.656650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:11.749670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff984906-ddb0-4571-8ec1-1df1bb68af79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:11.750196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff984906-ddb0-4571-8ec1-1df1bb68af79 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:11.750472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff984906-ddb0-4571-8ec1-1df1bb68af79 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:11.750746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff984906-ddb0-4571-8ec1-1df1bb68af79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:11.752446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ff984906-ddb0-4571-8ec1-1df1bb68af79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:11.843079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff984906-ddb0-4571-8ec1-1df1bb68af79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:11.844704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff984906-ddb0-4571-8ec1-1df1bb68af79 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:11.863899 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 716/1440] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:13.684643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d6cd8-6d92-40a3-87aa-9cc1c22e1327 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:13.685158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d6cd8-6d92-40a3-87aa-9cc1c22e1327 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:13.685158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d6cd8-6d92-40a3-87aa-9cc1c22e1327 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:13.686469 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 04:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:30:13.691982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6068d-6fcd-40c6-bcb8-9dd216f9160c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:13.692417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6068d-6fcd-40c6-bcb8-9dd216f9160c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:13.692556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6068d-6fcd-40c6-bcb8-9dd216f9160c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:13.733752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:13.765837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-21b6068d-6fcd-40c6-bcb8-9dd216f9160c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:30:13.767354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-21b6068d-6fcd-40c6-bcb8-9dd216f9160c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:13.862535 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 04:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:14.144370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d6cd8-6d92-40a3-87aa-9cc1c22e1327 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:14.145902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2c4d6cd8-6d92-40a3-87aa-9cc1c22e1327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:14.248496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d6cd8-6d92-40a3-87aa-9cc1c22e1327 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:14.280290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:14.321615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de699cca-9842-44b2-8ba0-a8600c16dea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:14.322392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de699cca-9842-44b2-8ba0-a8600c16dea2 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:14.322677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de699cca-9842-44b2-8ba0-a8600c16dea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:14.323120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de699cca-9842-44b2-8ba0-a8600c16dea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:14.325101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-de699cca-9842-44b2-8ba0-a8600c16dea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:14.431108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de699cca-9842-44b2-8ba0-a8600c16dea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:14.432611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de699cca-9842-44b2-8ba0-a8600c16dea2 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:14.451186 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 726/1443] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:16.538823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75613fa3-95d0-490a-b17c-edc8db3834e8 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:16.539443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75613fa3-95d0-490a-b17c-edc8db3834e8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:16.539443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75613fa3-95d0-490a-b17c-edc8db3834e8 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:16.540719 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 04:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:30:16.545899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5876c9-f3f0-4b98-bd4f-8c37d726b0c8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:16.546337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5876c9-f3f0-4b98-bd4f-8c37d726b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:16.546445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5876c9-f3f0-4b98-bd4f-8c37d726b0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:16.612914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ec5876c9-f3f0-4b98-bd4f-8c37d726b0c8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:30:16.614115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ec5876c9-f3f0-4b98-bd4f-8c37d726b0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:16.627738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:16.712558 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 04:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:17.004723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75613fa3-95d0-490a-b17c-edc8db3834e8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:17.006345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-75613fa3-95d0-490a-b17c-edc8db3834e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:17.110884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75613fa3-95d0-490a-b17c-edc8db3834e8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:17.123696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:17.188352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55253468-065a-47a6-a6fc-3dff4426621b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:17.188987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55253468-065a-47a6-a6fc-3dff4426621b service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:17.189268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55253468-065a-47a6-a6fc-3dff4426621b service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:17.189540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55253468-065a-47a6-a6fc-3dff4426621b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:17.191148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-55253468-065a-47a6-a6fc-3dff4426621b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:17.299436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55253468-065a-47a6-a6fc-3dff4426621b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:17.300823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55253468-065a-47a6-a6fc-3dff4426621b service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:17.318615 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 719/1446] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:19.589876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d1580-4231-4654-a72f-d3d704284b7b None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:19.590442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d1580-4231-4654-a72f-d3d704284b7b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:19.590442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d1580-4231-4654-a72f-d3d704284b7b None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:19.591813 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 04:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:30:19.597287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa27e3-e785-45e6-8046-68f04395bf1b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:19.597669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa27e3-e785-45e6-8046-68f04395bf1b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:19.597778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa27e3-e785-45e6-8046-68f04395bf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:19.646830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:19.664068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e7aa27e3-e785-45e6-8046-68f04395bf1b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:30:19.665334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e7aa27e3-e785-45e6-8046-68f04395bf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:19.762067 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 04:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:20.072323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d1580-4231-4654-a72f-d3d704284b7b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:20.073942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c69d1580-4231-4654-a72f-d3d704284b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:20.179911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d1580-4231-4654-a72f-d3d704284b7b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:20.221905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:20.258322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093b513-f7a7-4880-835a-9e183d249d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:20.258923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093b513-f7a7-4880-835a-9e183d249d5c service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:20.259202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093b513-f7a7-4880-835a-9e183d249d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:20.259471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093b513-f7a7-4880-835a-9e183d249d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:20.261114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3093b513-f7a7-4880-835a-9e183d249d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:20.368740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093b513-f7a7-4880-835a-9e183d249d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:20.370182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093b513-f7a7-4880-835a-9e183d249d5c service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:20.389167 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 729/1449] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:22.438125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ecfd4-1011-4a0c-b117-f114f1bb1379 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:22.438652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ecfd4-1011-4a0c-b117-f114f1bb1379 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:22.438652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ecfd4-1011-4a0c-b117-f114f1bb1379 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:22.439941 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 04:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:30:22.445617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e863a-e438-4188-a38c-043a06a44ec5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:22.446031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e863a-e438-4188-a38c-043a06a44ec5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:22.446160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e863a-e438-4188-a38c-043a06a44ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:22.511706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6b9e863a-e438-4188-a38c-043a06a44ec5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:30:22.512941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6b9e863a-e438-4188-a38c-043a06a44ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:22.534078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:22.609986 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 04:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:22.895932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ecfd4-1011-4a0c-b117-f114f1bb1379 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:22.898165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-745ecfd4-1011-4a0c-b117-f114f1bb1379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:23.000762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ecfd4-1011-4a0c-b117-f114f1bb1379 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:23.020949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:23.076152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968cdbf-6c24-4d93-8532-b5af1005efec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:23.076783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968cdbf-6c24-4d93-8532-b5af1005efec service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:23.077059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968cdbf-6c24-4d93-8532-b5af1005efec service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:23.077326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968cdbf-6c24-4d93-8532-b5af1005efec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:23.078946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c968cdbf-6c24-4d93-8532-b5af1005efec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:23.186903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968cdbf-6c24-4d93-8532-b5af1005efec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:23.188259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968cdbf-6c24-4d93-8532-b5af1005efec service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:23.206664 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 722/1452] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:25.245570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae26920-5a9d-48db-8fe6-cf7e3f2af3e3 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:25.246088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae26920-5a9d-48db-8fe6-cf7e3f2af3e3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:25.246088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae26920-5a9d-48db-8fe6-cf7e3f2af3e3 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:25.247430 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 04:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:30:25.252539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160af222-e2d2-4629-882b-28d522acca83 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:25.252970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160af222-e2d2-4629-882b-28d522acca83 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:25.253077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160af222-e2d2-4629-882b-28d522acca83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:25.315404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:25.318016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-160af222-e2d2-4629-882b-28d522acca83 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:30:25.319874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-160af222-e2d2-4629-882b-28d522acca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:25.415797 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 04:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:25.701866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae26920-5a9d-48db-8fe6-cf7e3f2af3e3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:25.703444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0ae26920-5a9d-48db-8fe6-cf7e3f2af3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:25.810341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae26920-5a9d-48db-8fe6-cf7e3f2af3e3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:25.858832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:25.885161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909d514-c556-40de-8a92-367a0827aeb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:25.885790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909d514-c556-40de-8a92-367a0827aeb2 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:25.886066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909d514-c556-40de-8a92-367a0827aeb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:25.886330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909d514-c556-40de-8a92-367a0827aeb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:25.888005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5909d514-c556-40de-8a92-367a0827aeb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:25.999569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909d514-c556-40de-8a92-367a0827aeb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:26.001037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909d514-c556-40de-8a92-367a0827aeb2 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:26.019521 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 732/1455] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:27.996413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72f9d-1a86-4971-8569-dd85fc1fd0c5 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:27.996929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72f9d-1a86-4971-8569-dd85fc1fd0c5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:27.996929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72f9d-1a86-4971-8569-dd85fc1fd0c5 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:27.998380 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 04:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:30:28.003688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022f9b1-f0bb-4c42-9711-b3c6ae1f36d2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:28.004089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022f9b1-f0bb-4c42-9711-b3c6ae1f36d2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:28.004266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022f9b1-f0bb-4c42-9711-b3c6ae1f36d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:28.071926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f022f9b1-f0bb-4c42-9711-b3c6ae1f36d2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:30:28.073182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f022f9b1-f0bb-4c42-9711-b3c6ae1f36d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:28.103739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:28.173567 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 04:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:28.455408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72f9d-1a86-4971-8569-dd85fc1fd0c5 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:28.456980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-16a72f9d-1a86-4971-8569-dd85fc1fd0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:28.564121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72f9d-1a86-4971-8569-dd85fc1fd0c5 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:28.594099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:28.646145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29a3d1-f115-4859-9aea-e7a1bcf1dbed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:28.646882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29a3d1-f115-4859-9aea-e7a1bcf1dbed service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:28.647146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29a3d1-f115-4859-9aea-e7a1bcf1dbed service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:28.647411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29a3d1-f115-4859-9aea-e7a1bcf1dbed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:28.649024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-be29a3d1-f115-4859-9aea-e7a1bcf1dbed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:28.777801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29a3d1-f115-4859-9aea-e7a1bcf1dbed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:28.779268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29a3d1-f115-4859-9aea-e7a1bcf1dbed service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:28.797761 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 725/1458] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:30.832496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad88b1f-0b78-41a6-a64e-294bd49d30f9 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:30.833030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad88b1f-0b78-41a6-a64e-294bd49d30f9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:30.833164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad88b1f-0b78-41a6-a64e-294bd49d30f9 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:30.835480 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 04:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:30:30.841010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31501a-2018-4ea5-9b4a-6f8710f40da4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:30.841411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31501a-2018-4ea5-9b4a-6f8710f40da4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:30.841565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31501a-2018-4ea5-9b4a-6f8710f40da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:30.909792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6d31501a-2018-4ea5-9b4a-6f8710f40da4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:30:30.911003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6d31501a-2018-4ea5-9b4a-6f8710f40da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:30.921473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:31.058479 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 04:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:31.299297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad88b1f-0b78-41a6-a64e-294bd49d30f9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:31.301146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1ad88b1f-0b78-41a6-a64e-294bd49d30f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:31.409512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad88b1f-0b78-41a6-a64e-294bd49d30f9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:31.468039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:31.486914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb95505-531f-4b33-a796-f18c462edf32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:31.487512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb95505-531f-4b33-a796-f18c462edf32 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:31.487787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb95505-531f-4b33-a796-f18c462edf32 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:31.488370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb95505-531f-4b33-a796-f18c462edf32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:31.489694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8bb95505-531f-4b33-a796-f18c462edf32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:31.602837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb95505-531f-4b33-a796-f18c462edf32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:31.604237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb95505-531f-4b33-a796-f18c462edf32 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:31.629316 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 735/1461] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:33.707644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb8b21-d01c-41c9-8137-e0a244c7aec1 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:33.708218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb8b21-d01c-41c9-8137-e0a244c7aec1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:33.708218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb8b21-d01c-41c9-8137-e0a244c7aec1 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:33.710063 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 04:30:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:30:33.715585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215d7b1-d085-4263-937e-c397ffd02099 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:33.716047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215d7b1-d085-4263-937e-c397ffd02099 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:33.716191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215d7b1-d085-4263-937e-c397ffd02099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:33.783382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a215d7b1-d085-4263-937e-c397ffd02099 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:30:33.784607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a215d7b1-d085-4263-937e-c397ffd02099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:33.822144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:33.884725 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 04:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:34.175085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb8b21-d01c-41c9-8137-e0a244c7aec1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:34.176673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5bbb8b21-d01c-41c9-8137-e0a244c7aec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:34.283883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb8b21-d01c-41c9-8137-e0a244c7aec1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:34.321458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:34.357316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe29bc-97e9-4eca-b35c-d7a3abd37002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:34.357918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe29bc-97e9-4eca-b35c-d7a3abd37002 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:34.358193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe29bc-97e9-4eca-b35c-d7a3abd37002 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:34.358561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe29bc-97e9-4eca-b35c-d7a3abd37002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:34.360303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3bfe29bc-97e9-4eca-b35c-d7a3abd37002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:34.468112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe29bc-97e9-4eca-b35c-d7a3abd37002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:34.469566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe29bc-97e9-4eca-b35c-d7a3abd37002 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:34.488322 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 728/1464] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:36.428512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a001e-f5bc-43e8-a77f-96105282fa8f None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:36.429065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a001e-f5bc-43e8-a77f-96105282fa8f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:36.429065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a001e-f5bc-43e8-a77f-96105282fa8f None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:36.430369 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 04:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:30:36.435501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75707e07-4c0f-4a8b-ba62-c213cd535bc0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:36.435944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75707e07-4c0f-4a8b-ba62-c213cd535bc0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:36.436055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75707e07-4c0f-4a8b-ba62-c213cd535bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:36.509735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-75707e07-4c0f-4a8b-ba62-c213cd535bc0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:30:36.510935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-75707e07-4c0f-4a8b-ba62-c213cd535bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:36.530165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:36.611179 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 04:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:36.907661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a001e-f5bc-43e8-a77f-96105282fa8f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:36.909226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b60a001e-f5bc-43e8-a77f-96105282fa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:37.014216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a001e-f5bc-43e8-a77f-96105282fa8f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:37.082008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:37.089212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dce45-c588-4251-a323-ed41ecd031c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:37.089809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dce45-c588-4251-a323-ed41ecd031c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:37.090091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dce45-c588-4251-a323-ed41ecd031c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:37.090359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dce45-c588-4251-a323-ed41ecd031c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:37.091945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a96dce45-c588-4251-a323-ed41ecd031c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:37.203213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dce45-c588-4251-a323-ed41ecd031c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:37.204691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dce45-c588-4251-a323-ed41ecd031c2 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:37.222919 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 738/1467] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:39.156730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7cd27-0a49-41cd-a901-1e0b7069d69f None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:39.157304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7cd27-0a49-41cd-a901-1e0b7069d69f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:39.157304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7cd27-0a49-41cd-a901-1e0b7069d69f None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:39.158521 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 04:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:30:39.164366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7878a-4042-473b-ab93-566808e3d452 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:39.164836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7878a-4042-473b-ab93-566808e3d452 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:39.164945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7878a-4042-473b-ab93-566808e3d452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:39.232837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-42b7878a-4042-473b-ab93-566808e3d452 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:30:39.234034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-42b7878a-4042-473b-ab93-566808e3d452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:39.282463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:39.330013 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 04:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:30:39.620140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7cd27-0a49-41cd-a901-1e0b7069d69f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:30:39.621703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-82a7cd27-0a49-41cd-a901-1e0b7069d69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:39.726325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7cd27-0a49-41cd-a901-1e0b7069d69f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:30:39.774832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:39.800682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a46a4-dbd1-42de-a012-d33fd6288346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:30:39.801314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a46a4-dbd1-42de-a012-d33fd6288346 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:30:39.801594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a46a4-dbd1-42de-a012-d33fd6288346 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:30:39.801864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a46a4-dbd1-42de-a012-d33fd6288346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:30:39.804430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ac0a46a4-dbd1-42de-a012-d33fd6288346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:30:39.945743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a46a4-dbd1-42de-a012-d33fd6288346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:30:39.947110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a46a4-dbd1-42de-a012-d33fd6288346 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:30:39.966679 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 731/1470] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:30:49.328323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=22 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:30:49.965428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=66 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:00.166367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b9e3c-f6a0-4da2-9169-83795814147d None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:00.166906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b9e3c-f6a0-4da2-9169-83795814147d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:00.166906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b9e3c-f6a0-4da2-9169-83795814147d None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:00.168280 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 740/1471] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:31:00.173723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02b70c-ca79-4075-ba5c-26948de34334 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:00.174095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02b70c-ca79-4075-ba5c-26948de34334 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:00.174095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02b70c-ca79-4075-ba5c-26948de34334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:00.240552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bf02b70c-ca79-4075-ba5c-26948de34334 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:31:00.241747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bf02b70c-ca79-4075-ba5c-26948de34334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:00.341160 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 732/1472] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:31:00.641269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df9ef0-918e-48c0-bc3c-68742235d5e6 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:00.641960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df9ef0-918e-48c0-bc3c-68742235d5e6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:00.642234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df9ef0-918e-48c0-bc3c-68742235d5e6 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:00.643566 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 741/1473] 10.222.0.76 () {54 vars in 967 bytes} [Sat Aug 27 04:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:31:00.648749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c6800-8740-4aa3-adb4-1b795e664d25 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:00.649037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c6800-8740-4aa3-adb4-1b795e664d25 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:00.649314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c6800-8740-4aa3-adb4-1b795e664d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:00.725666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5d6c6800-8740-4aa3-adb4-1b795e664d25 None None] MFA Rules not processed for user `f9cd48a297bf498e88ce722f74154354`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:31:00.726869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5d6c6800-8740-4aa3-adb4-1b795e664d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:00.748259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:00.805340 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 733/1474] 10.222.0.76 () {58 vars in 1064 bytes} [Sat Aug 27 04:31:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:31:00.812919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df9ef0-918e-48c0-bc3c-68742235d5e6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:31:00.814414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-43df9ef0-918e-48c0-bc3c-68742235d5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:00.917631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df9ef0-918e-48c0-bc3c-68742235d5e6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:31:00.993675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264860c0-fcc4-485f-a7cb-d0028187959a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:31:00.994279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264860c0-fcc4-485f-a7cb-d0028187959a service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:00.994562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264860c0-fcc4-485f-a7cb-d0028187959a service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:00.994836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264860c0-fcc4-485f-a7cb-d0028187959a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:00.996473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-264860c0-fcc4-485f-a7cb-d0028187959a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:01.051664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:01.106757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264860c0-fcc4-485f-a7cb-d0028187959a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:31:01.108227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264860c0-fcc4-485f-a7cb-d0028187959a service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:31:01.126976 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 742/1475] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:31:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:31:03.138438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c240eb4-2783-4132-8e61-7967f6031b12 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:03.138985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c240eb4-2783-4132-8e61-7967f6031b12 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:03.138985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c240eb4-2783-4132-8e61-7967f6031b12 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:03.140348 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 734/1476] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:31:03.145958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceffd1-dec0-4894-a36b-bb35bcbb9e80 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:03.146425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceffd1-dec0-4894-a36b-bb35bcbb9e80 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:03.146532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceffd1-dec0-4894-a36b-bb35bcbb9e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:03.211212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-50ceffd1-dec0-4894-a36b-bb35bcbb9e80 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:31:03.212440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-50ceffd1-dec0-4894-a36b-bb35bcbb9e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:03.311017 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 743/1477] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:31:03.596798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c240eb4-2783-4132-8e61-7967f6031b12 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:31:03.598872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7c240eb4-2783-4132-8e61-7967f6031b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:03.721990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c240eb4-2783-4132-8e61-7967f6031b12 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:31:03.770817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:03.814048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7a23f-82b9-4caa-b474-40d783d9d305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:31:03.814647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7a23f-82b9-4caa-b474-40d783d9d305 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:03.814917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7a23f-82b9-4caa-b474-40d783d9d305 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:03.815178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7a23f-82b9-4caa-b474-40d783d9d305 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:03.815792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7a23f-82b9-4caa-b474-40d783d9d305 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:31:03.818111 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-00e7a23f-82b9-4caa-b474-40d783d9d305 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:31:03.818111 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:31:03.818111 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:31:03.819240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7a23f-82b9-4caa-b474-40d783d9d305 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:31:03.838321 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 735/1478] 10.222.0.76 () {56 vars in 1108 bytes} [Sat Aug 27 04:31:03 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:31:05.779062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446bcdd-0bc6-4aae-b4a0-1fa680b3779b None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:05.779626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446bcdd-0bc6-4aae-b4a0-1fa680b3779b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:05.779626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446bcdd-0bc6-4aae-b4a0-1fa680b3779b None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:05.780995 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 744/1479] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:31:05.787080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7ed4d-83c6-4557-ae9a-1368f0b32e68 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:05.787498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7ed4d-83c6-4557-ae9a-1368f0b32e68 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:05.787637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7ed4d-83c6-4557-ae9a-1368f0b32e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:05.854336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-22e7ed4d-83c6-4557-ae9a-1368f0b32e68 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:31:05.855565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-22e7ed4d-83c6-4557-ae9a-1368f0b32e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:05.955722 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 736/1480] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:31:06.248579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446bcdd-0bc6-4aae-b4a0-1fa680b3779b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:31:06.250114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9446bcdd-0bc6-4aae-b4a0-1fa680b3779b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:06.260836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:06.407972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446bcdd-0bc6-4aae-b4a0-1fa680b3779b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:31:06.487207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:06.520957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aef72c-27ef-48c0-abfc-54d7bc9f0b92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:31:06.521741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aef72c-27ef-48c0-abfc-54d7bc9f0b92 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:06.522247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aef72c-27ef-48c0-abfc-54d7bc9f0b92 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:06.522541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aef72c-27ef-48c0-abfc-54d7bc9f0b92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:06.524608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b8aef72c-27ef-48c0-abfc-54d7bc9f0b92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:06.733143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aef72c-27ef-48c0-abfc-54d7bc9f0b92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:31:06.734851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aef72c-27ef-48c0-abfc-54d7bc9f0b92 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:31:06.753560 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 745/1481] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:31:08.851780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de6311-0e99-4a02-a0b0-591dfe086997 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:08.852397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de6311-0e99-4a02-a0b0-591dfe086997 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:08.852397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de6311-0e99-4a02-a0b0-591dfe086997 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:08.853671 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 737/1482] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:31:08.858815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021110a-1919-463b-9cda-094e071dfc57 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:08.859282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021110a-1919-463b-9cda-094e071dfc57 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:08.859395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021110a-1919-463b-9cda-094e071dfc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:08.939042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e021110a-1919-463b-9cda-094e071dfc57 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:31:08.944551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e021110a-1919-463b-9cda-094e071dfc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:08.987492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:09.038351 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 746/1483] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:31:09.327718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de6311-0e99-4a02-a0b0-591dfe086997 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:31:09.329315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-78de6311-0e99-4a02-a0b0-591dfe086997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:09.354559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:09.435948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de6311-0e99-4a02-a0b0-591dfe086997 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:31:09.512813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60fbb2-5749-41b2-878b-59b73abfc252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:31:09.513418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60fbb2-5749-41b2-878b-59b73abfc252 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:09.513699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60fbb2-5749-41b2-878b-59b73abfc252 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:09.513975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60fbb2-5749-41b2-878b-59b73abfc252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:09.515575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1e60fbb2-5749-41b2-878b-59b73abfc252 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:09.596759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:09.632675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60fbb2-5749-41b2-878b-59b73abfc252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:31:09.634096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60fbb2-5749-41b2-878b-59b73abfc252 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:31:09.652139 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 738/1484] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:31:11.699506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a913e1-d594-414d-aaa9-2f3186c28d4e None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:11.700058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a913e1-d594-414d-aaa9-2f3186c28d4e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:11.700201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a913e1-d594-414d-aaa9-2f3186c28d4e None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:11.701491 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 747/1485] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:31:11.708211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94684b12-5eec-44db-a502-ad7eca001860 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:11.708683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94684b12-5eec-44db-a502-ad7eca001860 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:11.709079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94684b12-5eec-44db-a502-ad7eca001860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:11.776707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-94684b12-5eec-44db-a502-ad7eca001860 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:31:11.777951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-94684b12-5eec-44db-a502-ad7eca001860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:11.874626 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 739/1486] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:31:12.172146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a913e1-d594-414d-aaa9-2f3186c28d4e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:31:12.173752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-33a913e1-d594-414d-aaa9-2f3186c28d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:12.276445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a913e1-d594-414d-aaa9-2f3186c28d4e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:31:12.349302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:12.351129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fa2b5-c315-40f7-a584-59defcdb281e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:31:12.351749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fa2b5-c315-40f7-a584-59defcdb281e service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:12.352007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fa2b5-c315-40f7-a584-59defcdb281e service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:12.352312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fa2b5-c315-40f7-a584-59defcdb281e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:12.353905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-227fa2b5-c315-40f7-a584-59defcdb281e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:12.460790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fa2b5-c315-40f7-a584-59defcdb281e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:31:12.462227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fa2b5-c315-40f7-a584-59defcdb281e service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:31:12.489768 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 748/1487] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:31:14.495427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f5edd-5e08-4b58-bc51-b0e67fcf6d5b None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:14.495974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f5edd-5e08-4b58-bc51-b0e67fcf6d5b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:14.495974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f5edd-5e08-4b58-bc51-b0e67fcf6d5b None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:14.497335 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 740/1488] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:31:14.504380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4bdcc-ac35-44f3-b3df-1b0491da97a7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:14.504856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4bdcc-ac35-44f3-b3df-1b0491da97a7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:14.504968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4bdcc-ac35-44f3-b3df-1b0491da97a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:14.571313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5fd4bdcc-ac35-44f3-b3df-1b0491da97a7 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:31:14.572554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5fd4bdcc-ac35-44f3-b3df-1b0491da97a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:14.624767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:14.670385 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 749/1489] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:31:14.964655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f5edd-5e08-4b58-bc51-b0e67fcf6d5b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:31:14.966244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-495f5edd-5e08-4b58-bc51-b0e67fcf6d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:15.001873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:15.071278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f5edd-5e08-4b58-bc51-b0e67fcf6d5b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:31:15.146760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94855bc-a53d-4e46-b815-14bac71eaaa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:31:15.147366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94855bc-a53d-4e46-b815-14bac71eaaa7 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:15.147652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94855bc-a53d-4e46-b815-14bac71eaaa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:15.147920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94855bc-a53d-4e46-b815-14bac71eaaa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:15.149545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a94855bc-a53d-4e46-b815-14bac71eaaa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:15.356212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:15.386478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94855bc-a53d-4e46-b815-14bac71eaaa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:31:15.388440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94855bc-a53d-4e46-b815-14bac71eaaa7 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:31:15.407748 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 741/1490] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:31:17.730229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6112e-f8f7-42f9-9456-7e631743a42a None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:17.730810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6112e-f8f7-42f9-9456-7e631743a42a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:17.730810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6112e-f8f7-42f9-9456-7e631743a42a None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:17.732137 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 750/1491] 10.222.0.76 () {54 vars in 927 bytes} [Sat Aug 27 04:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:31:17.737391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53d737-45b3-4f29-b575-3f592fd72ff3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:17.738434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53d737-45b3-4f29-b575-3f592fd72ff3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:17.738523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53d737-45b3-4f29-b575-3f592fd72ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:17.804486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-da53d737-45b3-4f29-b575-3f592fd72ff3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:31:17.805692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-da53d737-45b3-4f29-b575-3f592fd72ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:17.903317 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 742/1492] 10.222.0.76 () {58 vars in 1024 bytes} [Sat Aug 27 04:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:31:18.201145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6112e-f8f7-42f9-9456-7e631743a42a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:31:18.202744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7fc6112e-f8f7-42f9-9456-7e631743a42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:18.305685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6112e-f8f7-42f9-9456-7e631743a42a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:31:18.379017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff27af2-5c12-4126-b0bd-bd6456407c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:31:18.379967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff27af2-5c12-4126-b0bd-bd6456407c85 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:31:18.380277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff27af2-5c12-4126-b0bd-bd6456407c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:31:18.380548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff27af2-5c12-4126-b0bd-bd6456407c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:31:18.382143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0ff27af2-5c12-4126-b0bd-bd6456407c85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:31:18.391021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:18.496426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff27af2-5c12-4126-b0bd-bd6456407c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:31:18.497878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff27af2-5c12-4126-b0bd-bd6456407c85 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:31:18.515684 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 751/1493] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:31:27.901554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=82 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:31:28.513467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=50 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:42.907622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d706d-4fb0-4742-8aea-c99f59883b34 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:42.908286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d706d-4fb0-4742-8aea-c99f59883b34 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:42.908286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d706d-4fb0-4742-8aea-c99f59883b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:42.985065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-776d706d-4fb0-4742-8aea-c99f59883b34 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:32:42.986254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-776d706d-4fb0-4742-8aea-c99f59883b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:32:43.104610 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 743/1494] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:32:43.112924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b2313-9b27-440b-807f-430c21199e53 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:43.113429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b2313-9b27-440b-807f-430c21199e53 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:43.113559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b2313-9b27-440b-807f-430c21199e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:43.191486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ed5b2313-9b27-440b-807f-430c21199e53 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:32:43.193751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ed5b2313-9b27-440b-807f-430c21199e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:32:43.292812 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 752/1495] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:32:43.297454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d706d-4fb0-4742-8aea-c99f59883b34 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:32:43.298686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-776d706d-4fb0-4742-8aea-c99f59883b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:32:43.310233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d706d-4fb0-4742-8aea-c99f59883b34 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:32:43.383785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:43.416346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92a230-bdcf-4a7c-980b-f1368d6cfd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:32:43.416948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92a230-bdcf-4a7c-980b-f1368d6cfd2a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:43.417223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92a230-bdcf-4a7c-980b-f1368d6cfd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:43.417490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92a230-bdcf-4a7c-980b-f1368d6cfd2a admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:43.418119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92a230-bdcf-4a7c-980b-f1368d6cfd2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:32:43.418415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92a230-bdcf-4a7c-980b-f1368d6cfd2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:32:43.419405 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-3c92a230-bdcf-4a7c-980b-f1368d6cfd2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:32:43.419405 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:32:43.419405 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:32:43.420304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92a230-bdcf-4a7c-980b-f1368d6cfd2a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:32:43.432712 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 744/1496] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:32:43.440772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b2313-9b27-440b-807f-430c21199e53 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:32:43.450763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b2313-9b27-440b-807f-430c21199e53 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:32:43.511385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:43.544998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d2f0d-6694-41d9-ad29-a78c71c185ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:32:43.545658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d2f0d-6694-41d9-ad29-a78c71c185ed admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:43.545932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d2f0d-6694-41d9-ad29-a78c71c185ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:43.546401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d2f0d-6694-41d9-ad29-a78c71c185ed admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:43.547561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d2f0d-6694-41d9-ad29-a78c71c185ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:32:43.549401 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-2d5d2f0d-6694-41d9-ad29-a78c71c185ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:32:43.549401 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:32:43.549401 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:32:43.550578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d2f0d-6694-41d9-ad29-a78c71c185ed admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:32:43.706955 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 753/1497] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:32:43 2022] POST /identity/v3/projects => generated 377 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:32:43.711166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92a230-bdcf-4a7c-980b-f1368d6cfd2a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:32:43.712723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3c92a230-bdcf-4a7c-980b-f1368d6cfd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:32:43.746374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92a230-bdcf-4a7c-980b-f1368d6cfd2a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:32:43.839663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58427de0-d825-4178-b0d6-4cb45f16e5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:32:43.840283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58427de0-d825-4178-b0d6-4cb45f16e5bd admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:43.840558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58427de0-d825-4178-b0d6-4cb45f16e5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:43.840822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58427de0-d825-4178-b0d6-4cb45f16e5bd admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:43.841432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58427de0-d825-4178-b0d6-4cb45f16e5bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:32:43.842425 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-58427de0-d825-4178-b0d6-4cb45f16e5bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:32:43.842425 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:32:43.842425 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:32:43.843617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58427de0-d825-4178-b0d6-4cb45f16e5bd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:32:43.951558 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 745/1498] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:32:43 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:32:43.957409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d2f0d-6694-41d9-ad29-a78c71c185ed admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:32:43.959117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2d5d2f0d-6694-41d9-ad29-a78c71c185ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:32:44.024121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d2f0d-6694-41d9-ad29-a78c71c185ed admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:32:44.108904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:44.121764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2456244-1249-4124-a8bc-447ffd69b6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:32:44.122821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2456244-1249-4124-a8bc-447ffd69b6ef admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:44.123254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2456244-1249-4124-a8bc-447ffd69b6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:44.123535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2456244-1249-4124-a8bc-447ffd69b6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:44.124206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2456244-1249-4124-a8bc-447ffd69b6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:32:44.125235 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-d2456244-1249-4124-a8bc-447ffd69b6ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:32:44.125235 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:32:44.125235 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:32:44.126127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2456244-1249-4124-a8bc-447ffd69b6ef admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:32:44.140868 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 754/1499] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:32:44.145602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58427de0-d825-4178-b0d6-4cb45f16e5bd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:32:44.147118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-58427de0-d825-4178-b0d6-4cb45f16e5bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:32:44.159524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58427de0-d825-4178-b0d6-4cb45f16e5bd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:32:44.185701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:44.254834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed4a06-9f63-4d6b-a934-34b4ac8e8371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:32:44.255437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed4a06-9f63-4d6b-a934-34b4ac8e8371 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:44.255712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed4a06-9f63-4d6b-a934-34b4ac8e8371 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:44.255979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed4a06-9f63-4d6b-a934-34b4ac8e8371 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:44.256636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed4a06-9f63-4d6b-a934-34b4ac8e8371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:32:44.257641 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-95ed4a06-9f63-4d6b-a934-34b4ac8e8371 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:32:44.257641 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:32:44.257641 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:32:44.258524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed4a06-9f63-4d6b-a934-34b4ac8e8371 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:32:44.271437 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 746/1500] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:32:44.275728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2456244-1249-4124-a8bc-447ffd69b6ef admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:32:44.277300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d2456244-1249-4124-a8bc-447ffd69b6ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:32:44.310410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2456244-1249-4124-a8bc-447ffd69b6ef admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:32:44.403692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aa04d-cdf8-4cfb-a0b3-a77300dd381a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:32:44.404370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aa04d-cdf8-4cfb-a0b3-a77300dd381a admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:44.404654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aa04d-cdf8-4cfb-a0b3-a77300dd381a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:44.404930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aa04d-cdf8-4cfb-a0b3-a77300dd381a admin admin] PATH_INFO: `/v3/projects/c3469edf7ccd4cdc97e189a1e37b5d7c/users/cd1a4eb5a18045fbbc3c6e59876e92fe/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:44.426548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9aa04d-cdf8-4cfb-a0b3-a77300dd381a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3469edf7ccd4cdc97e189a1e37b5d7c, user_id=cd1a4eb5a18045fbbc3c6e59876e92fe, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:32:44.427582 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-cd9aa04d-cdf8-4cfb-a0b3-a77300dd381a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:32:44.427582 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:32:44.427582 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:32:44.429628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9aa04d-cdf8-4cfb-a0b3-a77300dd381a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:32:44.522783 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 755/1501] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:32:44 2022] PUT /identity/v3/projects/c3469edf7ccd4cdc97e189a1e37b5d7c/users/cd1a4eb5a18045fbbc3c6e59876e92fe/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:32:44.534995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9f57c-8b14-4383-9a23-b3c396c844d7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:44.535288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9f57c-8b14-4383-9a23-b3c396c844d7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:44.535797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9f57c-8b14-4383-9a23-b3c396c844d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:44.592366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-aff9f57c-8b14-4383-9a23-b3c396c844d7 None None] MFA Rules not processed for user `cd1a4eb5a18045fbbc3c6e59876e92fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:32:44.593596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-aff9f57c-8b14-4383-9a23-b3c396c844d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:32:44.671847 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 747/1502] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:32:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:32:44.685266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c2814-87f6-4de5-842f-1094a36fc078 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:44.685577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c2814-87f6-4de5-842f-1094a36fc078 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:44.685875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c2814-87f6-4de5-842f-1094a36fc078 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:44.687210 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 756/1503] 10.222.0.76 () {54 vars in 964 bytes} [Sat Aug 27 04:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:32:44.692002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4dad7-e439-48c8-b786-91e8bf3ff5b9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:44.692475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4dad7-e439-48c8-b786-91e8bf3ff5b9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:44.692751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4dad7-e439-48c8-b786-91e8bf3ff5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:44.724878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:44.769866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-fcb4dad7-e439-48c8-b786-91e8bf3ff5b9 None None] MFA Rules not processed for user `dfcccc451b4b443f9b2428cc207211ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:32:44.771067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fcb4dad7-e439-48c8-b786-91e8bf3ff5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:32:44.856529 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 748/1504] 10.222.0.76 () {58 vars in 1061 bytes} [Sat Aug 27 04:32:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:32:44.865472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c2814-87f6-4de5-842f-1094a36fc078 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:32:44.867062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9c8c2814-87f6-4de5-842f-1094a36fc078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:32:44.919259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:44.976662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c2814-87f6-4de5-842f-1094a36fc078 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:32:45.052272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdf848-5e32-472d-92d0-a535eac9f0e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:32:45.052879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdf848-5e32-472d-92d0-a535eac9f0e9 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:45.053159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdf848-5e32-472d-92d0-a535eac9f0e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:45.053428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdf848-5e32-472d-92d0-a535eac9f0e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:45.055035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4bbdf848-5e32-472d-92d0-a535eac9f0e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:32:45.158172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdf848-5e32-472d-92d0-a535eac9f0e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:32:45.159545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdf848-5e32-472d-92d0-a535eac9f0e9 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:32:45.164090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:45.179266 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 757/1505] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:32:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:32:45.225290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10542264-e1d2-49f5-861b-03c792dcfa81 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:45.225708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10542264-e1d2-49f5-861b-03c792dcfa81 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:45.225814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10542264-e1d2-49f5-861b-03c792dcfa81 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:45.227064 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 749/1506] 10.222.0.76 () {52 vars in 830 bytes} [Sat Aug 27 04:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:32:45.230584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdf848-5e32-472d-92d0-a535eac9f0e9 service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:32:45.231853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4bbdf848-5e32-472d-92d0-a535eac9f0e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:32:45.334042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdf848-5e32-472d-92d0-a535eac9f0e9 service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:32:45.432978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5be5ae-faf0-46b9-b772-15ae0cfa1af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:32:45.433541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5be5ae-faf0-46b9-b772-15ae0cfa1af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:45.433818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5be5ae-faf0-46b9-b772-15ae0cfa1af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:45.434087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5be5ae-faf0-46b9-b772-15ae0cfa1af5 admin admin] PATH_INFO: `/v3/users/cd1a4eb5a18045fbbc3c6e59876e92fe` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:45.446571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5be5ae-faf0-46b9-b772-15ae0cfa1af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd1a4eb5a18045fbbc3c6e59876e92fe)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:32:45.447611 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-cc5be5ae-faf0-46b9-b772-15ae0cfa1af5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:32:45.447611 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:32:45.447611 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:32:45.448852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5be5ae-faf0-46b9-b772-15ae0cfa1af5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:32:45.458385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:45.748760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc5be5ae-faf0-46b9-b772-15ae0cfa1af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd1a4eb5a18045fbbc3c6e59876e92fe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:32:45.827080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc5be5ae-faf0-46b9-b772-15ae0cfa1af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd1a4eb5a18045fbbc3c6e59876e92fe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:32:45.827631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc5be5ae-faf0-46b9-b772-15ae0cfa1af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd1a4eb5a18045fbbc3c6e59876e92fe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:32:45.842821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc5be5ae-faf0-46b9-b772-15ae0cfa1af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd1a4eb5a18045fbbc3c6e59876e92fe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:32:45.866596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc5be5ae-faf0-46b9-b772-15ae0cfa1af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd1a4eb5a18045fbbc3c6e59876e92fe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:32:45.872504 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 758/1507] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:32:45 2022] DELETE /identity/v3/users/cd1a4eb5a18045fbbc3c6e59876e92fe => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:32:45.876904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebf74a-2342-4cc7-b014-fa2babba14ec None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:45.877193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebf74a-2342-4cc7-b014-fa2babba14ec None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:45.877498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebf74a-2342-4cc7-b014-fa2babba14ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:45.943424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-84ebf74a-2342-4cc7-b014-fa2babba14ec None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:32:45.945099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-84ebf74a-2342-4cc7-b014-fa2babba14ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:32:46.024262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:46.036747 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 750/1508] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:32:46.046455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5be5ae-faf0-46b9-b772-15ae0cfa1af5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:32:46.047681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cc5be5ae-faf0-46b9-b772-15ae0cfa1af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:32:46.151030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5be5ae-faf0-46b9-b772-15ae0cfa1af5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:32:46.208173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:46.228927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b402fa-aec6-4ce1-a6c8-73a960a3c3da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:32:46.229531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b402fa-aec6-4ce1-a6c8-73a960a3c3da service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:46.229810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b402fa-aec6-4ce1-a6c8-73a960a3c3da service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:46.230079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b402fa-aec6-4ce1-a6c8-73a960a3c3da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:46.231673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-45b402fa-aec6-4ce1-a6c8-73a960a3c3da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:32:46.350759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b402fa-aec6-4ce1-a6c8-73a960a3c3da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:32:46.352081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b402fa-aec6-4ce1-a6c8-73a960a3c3da service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:32:46.370677 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 759/1509] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:32:46.869496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebf74a-2342-4cc7-b014-fa2babba14ec None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:32:46.870932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-84ebf74a-2342-4cc7-b014-fa2babba14ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:32:46.885835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebf74a-2342-4cc7-b014-fa2babba14ec None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:32:46.980364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189b73a-3cdc-442b-9fda-a81f0034e1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:32:46.981001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189b73a-3cdc-442b-9fda-a81f0034e1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:32:46.981277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189b73a-3cdc-442b-9fda-a81f0034e1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:32:46.981547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189b73a-3cdc-442b-9fda-a81f0034e1f5 admin admin] PATH_INFO: `/v3/projects/c3469edf7ccd4cdc97e189a1e37b5d7c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:32:46.991581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189b73a-3cdc-442b-9fda-a81f0034e1f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3469edf7ccd4cdc97e189a1e37b5d7c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:32:46.992645 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-0189b73a-3cdc-442b-9fda-a81f0034e1f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:32:46.992645 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:32:46.992645 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:32:46.993832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189b73a-3cdc-442b-9fda-a81f0034e1f5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:32:47.100505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0189b73a-3cdc-442b-9fda-a81f0034e1f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3469edf7ccd4cdc97e189a1e37b5d7c', 'request_id': 'req-0189b73a-3cdc-442b-9fda-a81f0034e1f5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:32:47.106860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0189b73a-3cdc-442b-9fda-a81f0034e1f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3469edf7ccd4cdc97e189a1e37b5d7c', 'request_id': 'req-0189b73a-3cdc-442b-9fda-a81f0034e1f5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:32:47.187023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0189b73a-3cdc-442b-9fda-a81f0034e1f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3469edf7ccd4cdc97e189a1e37b5d7c', 'request_id': 'req-0189b73a-3cdc-442b-9fda-a81f0034e1f5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:32:47.217103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0189b73a-3cdc-442b-9fda-a81f0034e1f5 admin admin] The token cache is being invalidate because project c3469edf7ccd4cdc97e189a1e37b5d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:32:47.217392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0189b73a-3cdc-442b-9fda-a81f0034e1f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:32:47.217817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0189b73a-3cdc-442b-9fda-a81f0034e1f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:32:47.219193 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 751/1510] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:32:46 2022] DELETE /identity/v3/projects/c3469edf7ccd4cdc97e189a1e37b5d7c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:32:56.368517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=62 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:32:57.215162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:08.889263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682ea2b-882f-48a7-8a48-32fb3fe7975c None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:08.889877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682ea2b-882f-48a7-8a48-32fb3fe7975c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:08.889877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682ea2b-882f-48a7-8a48-32fb3fe7975c None None] PATH_INFO: `/v3` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:08.891356 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 760/1511] 10.222.0.78 () {54 vars in 925 bytes} [Sat Aug 27 04:36:08 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:36:08.897812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6070b-3f9d-4048-bdd7-b68a981536ee None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:08.898230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6070b-3f9d-4048-bdd7-b68a981536ee None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:08.898418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6070b-3f9d-4048-bdd7-b68a981536ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:08.981091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-61c6070b-3f9d-4048-bdd7-b68a981536ee None None] MFA Rules not processed for user `702086569a63418685711c4c134b1482`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:08.982301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-61c6070b-3f9d-4048-bdd7-b68a981536ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:09.097482 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 752/1512] 10.222.0.78 () {58 vars in 1015 bytes} [Sat Aug 27 04:36:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:36:13.106665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f07d3-7706-4ada-8366-f2aaeec28c8a None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:13.107187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f07d3-7706-4ada-8366-f2aaeec28c8a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:13.107187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f07d3-7706-4ada-8366-f2aaeec28c8a None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:13.108503 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 761/1513] 10.222.0.76 () {54 vars in 961 bytes} [Sat Aug 27 04:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:13.113375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecd2f4-512b-440b-8a6b-277f1520f9bb None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:13.113805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecd2f4-512b-440b-8a6b-277f1520f9bb None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:13.113914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecd2f4-512b-440b-8a6b-277f1520f9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:13.133163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-44ecd2f4-512b-440b-8a6b-277f1520f9bb None None] MFA Rules not processed for user `702086569a63418685711c4c134b1482`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:13.134342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-44ecd2f4-512b-440b-8a6b-277f1520f9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:13.142994 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 753/1514] 10.222.0.76 () {58 vars in 1058 bytes} [Sat Aug 27 04:36:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:13.150676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f07d3-7706-4ada-8366-f2aaeec28c8a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:13.166928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f07d3-7706-4ada-8366-f2aaeec28c8a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:13.172486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e5391-854b-45e3-9846-6f4f61dfeade service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:13.173121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e5391-854b-45e3-9846-6f4f61dfeade service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:13.173441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e5391-854b-45e3-9846-6f4f61dfeade service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:13.173768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e5391-854b-45e3-9846-6f4f61dfeade service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:13.184656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e5391-854b-45e3-9846-6f4f61dfeade service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:13.186229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e5391-854b-45e3-9846-6f4f61dfeade service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:13.195772 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 762/1515] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:36:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:23.128078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=77 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:23.191677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:23.283031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23725a42-92df-42a2-9245-f5d13dd6ab5f None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:23.283241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23725a42-92df-42a2-9245-f5d13dd6ab5f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:23.283493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23725a42-92df-42a2-9245-f5d13dd6ab5f None None] PATH_INFO: `/v3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:23.284851 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 754/1516] 10.222.0.75 () {54 vars in 925 bytes} [Sat Aug 27 04:36:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:36:23.291357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24303516-a734-4dc7-95f4-18f65b43ae19 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:23.291641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24303516-a734-4dc7-95f4-18f65b43ae19 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:23.291915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24303516-a734-4dc7-95f4-18f65b43ae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:23.311545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-24303516-a734-4dc7-95f4-18f65b43ae19 None None] MFA Rules not processed for user `702086569a63418685711c4c134b1482`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:23.312787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-24303516-a734-4dc7-95f4-18f65b43ae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:23.322011 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 763/1517] 10.222.0.75 () {58 vars in 1015 bytes} [Sat Aug 27 04:36:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:32.065249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada73d-eb4c-47bb-97d4-96ce49ea9007 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:32.065671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada73d-eb4c-47bb-97d4-96ce49ea9007 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:32.065808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada73d-eb4c-47bb-97d4-96ce49ea9007 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:32.067244 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 755/1518] 10.222.0.76 () {54 vars in 961 bytes} [Sat Aug 27 04:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:32.073657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bfffb-3eb4-4013-a197-ea8fbe739c7a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:32.073657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bfffb-3eb4-4013-a197-ea8fbe739c7a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:32.073657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bfffb-3eb4-4013-a197-ea8fbe739c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:32.092425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-259bfffb-3eb4-4013-a197-ea8fbe739c7a None None] MFA Rules not processed for user `702086569a63418685711c4c134b1482`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:32.093615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-259bfffb-3eb4-4013-a197-ea8fbe739c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:32.103402 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 764/1519] 10.222.0.76 () {58 vars in 1058 bytes} [Sat Aug 27 04:36:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:32.110895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dada73d-eb4c-47bb-97d4-96ce49ea9007 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:32.124728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dada73d-eb4c-47bb-97d4-96ce49ea9007 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:32.129531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378db27d-571e-4f28-b0b8-521f8ca0738a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:32.130134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378db27d-571e-4f28-b0b8-521f8ca0738a service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:32.130426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378db27d-571e-4f28-b0b8-521f8ca0738a service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:32.130759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378db27d-571e-4f28-b0b8-521f8ca0738a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:32.139313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378db27d-571e-4f28-b0b8-521f8ca0738a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:32.141509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378db27d-571e-4f28-b0b8-521f8ca0738a service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:32.150964 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 756/1520] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:36:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:42.087251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:42.146959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:36:48.857737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67e035-afc9-4d59-82a0-5ed5e7ee41f7 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:48.858300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67e035-afc9-4d59-82a0-5ed5e7ee41f7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:48.858300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67e035-afc9-4d59-82a0-5ed5e7ee41f7 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:48.859629 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 765/1521] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 04:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:48.864581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb52b6-66b3-4059-b657-a6daef1edfff None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:48.865026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb52b6-66b3-4059-b657-a6daef1edfff None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:48.865131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb52b6-66b3-4059-b657-a6daef1edfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:48.924818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e8bb52b6-66b3-4059-b657-a6daef1edfff None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:48.926029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e8bb52b6-66b3-4059-b657-a6daef1edfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:49.017459 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 757/1522] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 04:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:49.169595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67e035-afc9-4d59-82a0-5ed5e7ee41f7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:49.171289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ed67e035-afc9-4d59-82a0-5ed5e7ee41f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:49.280902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67e035-afc9-4d59-82a0-5ed5e7ee41f7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:49.286630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579008d-0ca4-4f6c-81ba-988c4fd296bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:49.287262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579008d-0ca4-4f6c-81ba-988c4fd296bf service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:49.287545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579008d-0ca4-4f6c-81ba-988c4fd296bf service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:49.287836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579008d-0ca4-4f6c-81ba-988c4fd296bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:49.296539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579008d-0ca4-4f6c-81ba-988c4fd296bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:49.298139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579008d-0ca4-4f6c-81ba-988c4fd296bf service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:49.308145 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 766/1523] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:50.171024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2d04f-0f07-49c1-a5b3-041310944c71 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:50.171654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2d04f-0f07-49c1-a5b3-041310944c71 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:50.171654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2d04f-0f07-49c1-a5b3-041310944c71 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:50.172905 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 758/1524] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 04:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:50.177816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a02728-ef6c-430f-8539-89202cd748d8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:50.178253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a02728-ef6c-430f-8539-89202cd748d8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:50.178376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a02728-ef6c-430f-8539-89202cd748d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:50.198954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-86a02728-ef6c-430f-8539-89202cd748d8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:50.200143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-86a02728-ef6c-430f-8539-89202cd748d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:50.208228 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 767/1525] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 04:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:50.363609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2d04f-0f07-49c1-a5b3-041310944c71 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:50.378350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2d04f-0f07-49c1-a5b3-041310944c71 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:50.384324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8bba7-dc27-421a-bce9-031aa35ed588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:50.384912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8bba7-dc27-421a-bce9-031aa35ed588 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:50.385187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8bba7-dc27-421a-bce9-031aa35ed588 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:50.385454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8bba7-dc27-421a-bce9-031aa35ed588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:50.393725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8bba7-dc27-421a-bce9-031aa35ed588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:50.395312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8bba7-dc27-421a-bce9-031aa35ed588 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:50.405305 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 759/1526] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:54.106530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3deac5-0804-4ded-aa8c-5676ac579df7 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:54.107120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3deac5-0804-4ded-aa8c-5676ac579df7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:54.107120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3deac5-0804-4ded-aa8c-5676ac579df7 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:54.108482 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 768/1527] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 04:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:54.113557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a372c7-49e3-483e-87ec-0ac940314da2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:54.113971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a372c7-49e3-483e-87ec-0ac940314da2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:54.114101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a372c7-49e3-483e-87ec-0ac940314da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:54.134087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a8a372c7-49e3-483e-87ec-0ac940314da2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:54.135273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a8a372c7-49e3-483e-87ec-0ac940314da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:54.143269 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 760/1528] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 04:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:54.430755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3deac5-0804-4ded-aa8c-5676ac579df7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:54.432476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8e3deac5-0804-4ded-aa8c-5676ac579df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:54.512485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3deac5-0804-4ded-aa8c-5676ac579df7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:54.516418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3158dc-10ef-4cff-b41b-c1ef640181c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:54.517017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3158dc-10ef-4cff-b41b-c1ef640181c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:54.517298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3158dc-10ef-4cff-b41b-c1ef640181c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:54.517571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3158dc-10ef-4cff-b41b-c1ef640181c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:54.526932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3158dc-10ef-4cff-b41b-c1ef640181c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:54.528548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3158dc-10ef-4cff-b41b-c1ef640181c3 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:54.537903 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 769/1529] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:36:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:36:56.464243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284c44c-29fa-4472-823b-7f52f808bdb3 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:56.464786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284c44c-29fa-4472-823b-7f52f808bdb3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:56.464786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284c44c-29fa-4472-823b-7f52f808bdb3 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:56.466109 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 761/1530] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 04:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:36:56.471401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83db7e-235f-4dea-a692-2356db0ceab9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:56.471860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83db7e-235f-4dea-a692-2356db0ceab9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:56.471971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83db7e-235f-4dea-a692-2356db0ceab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:56.492544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8f83db7e-235f-4dea-a692-2356db0ceab9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:36:56.493743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8f83db7e-235f-4dea-a692-2356db0ceab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:36:56.501581 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 770/1531] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 04:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:36:56.792342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284c44c-29fa-4472-823b-7f52f808bdb3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:36:56.802981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284c44c-29fa-4472-823b-7f52f808bdb3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:36:56.806988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044bf8b-d917-44da-9437-7248957c605a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:36:56.807575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044bf8b-d917-44da-9437-7248957c605a service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:36:56.807851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044bf8b-d917-44da-9437-7248957c605a service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:36:56.808120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044bf8b-d917-44da-9437-7248957c605a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:36:56.817157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044bf8b-d917-44da-9437-7248957c605a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:36:56.818578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044bf8b-d917-44da-9437-7248957c605a service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:36:56.828463 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 762/1532] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:37:06.487311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:06.824420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=65 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:37:48.560603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163ef02-b1d0-496c-a9cd-a5be7964e190 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:48.561103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163ef02-b1d0-496c-a9cd-a5be7964e190 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:48.561103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163ef02-b1d0-496c-a9cd-a5be7964e190 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:48.562506 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 771/1533] 10.222.0.76 () {54 vars in 921 bytes} [Sat Aug 27 04:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:37:48.567706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae3685-eb3e-4dc8-8a8a-33339c1161b5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:37:48.568707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae3685-eb3e-4dc8-8a8a-33339c1161b5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:37:48.569516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae3685-eb3e-4dc8-8a8a-33339c1161b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:37:48.589241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b7ae3685-eb3e-4dc8-8a8a-33339c1161b5 None None] MFA Rules not processed for user `702086569a63418685711c4c134b1482`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:37:48.590504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b7ae3685-eb3e-4dc8-8a8a-33339c1161b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:37:48.599114 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 763/1534] 10.222.0.76 () {58 vars in 1018 bytes} [Sat Aug 27 04:37:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:37:58.584433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:20.731506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96787294-d301-401b-8ca4-4ba2178d1884 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:20.732075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96787294-d301-401b-8ca4-4ba2178d1884 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:20.732343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96787294-d301-401b-8ca4-4ba2178d1884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:20.762500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-96787294-d301-401b-8ca4-4ba2178d1884 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:20.764310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-96787294-d301-401b-8ca4-4ba2178d1884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:20.777647 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 772/1535] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:20.786873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806b770-bf2d-4b3d-a0c2-f74d4bfa8e07 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:20.787459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806b770-bf2d-4b3d-a0c2-f74d4bfa8e07 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:20.787459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806b770-bf2d-4b3d-a0c2-f74d4bfa8e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:20.816954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c806b770-bf2d-4b3d-a0c2-f74d4bfa8e07 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:20.818549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c806b770-bf2d-4b3d-a0c2-f74d4bfa8e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:20.832253 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 764/1536] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:20.838397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96787294-d301-401b-8ca4-4ba2178d1884 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:20.854207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96787294-d301-401b-8ca4-4ba2178d1884 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:20.861693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0bab0-a676-4966-93eb-ac75ae830983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:20.862319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0bab0-a676-4966-93eb-ac75ae830983 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:20.862747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0bab0-a676-4966-93eb-ac75ae830983 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:20.863029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0bab0-a676-4966-93eb-ac75ae830983 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:20.863689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0bab0-a676-4966-93eb-ac75ae830983 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:20.864360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0bab0-a676-4966-93eb-ac75ae830983 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:20.866042 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-bbd0bab0-a676-4966-93eb-ac75ae830983 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:38:20.866042 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:38:20.866042 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:38:20.866959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0bab0-a676-4966-93eb-ac75ae830983 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:20.886254 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 773/1537] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:20.892630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a350726-5b6a-4517-8fe8-455348e73609 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:20.893547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a350726-5b6a-4517-8fe8-455348e73609 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:20.894032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a350726-5b6a-4517-8fe8-455348e73609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:20.894138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0bab0-a676-4966-93eb-ac75ae830983 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:20.910125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0bab0-a676-4966-93eb-ac75ae830983 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:20.920197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d5a9f-c5b8-4abf-9e4e-81d5535be2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:20.920197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d5a9f-c5b8-4abf-9e4e-81d5535be2af admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:20.920197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d5a9f-c5b8-4abf-9e4e-81d5535be2af admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:20.920197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d5a9f-c5b8-4abf-9e4e-81d5535be2af admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:20.920654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d5a9f-c5b8-4abf-9e4e-81d5535be2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:20.921660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d5a9f-c5b8-4abf-9e4e-81d5535be2af admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:20.929238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6a350726-5b6a-4517-8fe8-455348e73609 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:20.931506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6a350726-5b6a-4517-8fe8-455348e73609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:20.961435 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 765/1538] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:20.978763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec49791-25bd-4f34-9eea-3be9701eed65 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:20.979073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec49791-25bd-4f34-9eea-3be9701eed65 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:20.979314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec49791-25bd-4f34-9eea-3be9701eed65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.017181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0ec49791-25bd-4f34-9eea-3be9701eed65 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:21.018876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0ec49791-25bd-4f34-9eea-3be9701eed65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:21.031237 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 766/1539] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:38:21.033271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd828d5-3883-412d-a0c5-8782141661f7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.033560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd828d5-3883-412d-a0c5-8782141661f7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.033833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd828d5-3883-412d-a0c5-8782141661f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.060283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bbd828d5-3883-412d-a0c5-8782141661f7 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:21.061493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bbd828d5-3883-412d-a0c5-8782141661f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:21.073901 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 767/1540] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:21.074826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd828d5-3883-412d-a0c5-8782141661f7 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:21.086240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd828d5-3883-412d-a0c5-8782141661f7 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:21.093933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c4a8f-069c-448b-b6ff-5443483b6a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:21.101343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c4a8f-069c-448b-b6ff-5443483b6a9e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.101343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c4a8f-069c-448b-b6ff-5443483b6a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.101343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c4a8f-069c-448b-b6ff-5443483b6a9e admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.101343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c4a8f-069c-448b-b6ff-5443483b6a9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:21.101343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c4a8f-069c-448b-b6ff-5443483b6a9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:21.101343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c4a8f-069c-448b-b6ff-5443483b6a9e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:21.114784 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 768/1541] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:21.116217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9e62d-71c1-4a58-a734-a4f01a2b1e74 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.116697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9e62d-71c1-4a58-a734-a4f01a2b1e74 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.116980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9e62d-71c1-4a58-a734-a4f01a2b1e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.141579 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 774/1542] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:20 2022] POST /identity/v3/projects => generated 399 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:21.143397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d5a9f-c5b8-4abf-9e4e-81d5535be2af admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:21.152373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0ae9e62d-71c1-4a58-a734-a4f01a2b1e74 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:21.153602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0ae9e62d-71c1-4a58-a734-a4f01a2b1e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:21.228797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d5a9f-c5b8-4abf-9e4e-81d5535be2af admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:21.234171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c2b6e-0deb-446f-8834-f5dd0b558722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:21.234778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c2b6e-0deb-446f-8834-f5dd0b558722 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.235076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c2b6e-0deb-446f-8834-f5dd0b558722 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.235421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c2b6e-0deb-446f-8834-f5dd0b558722 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.236176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c2b6e-0deb-446f-8834-f5dd0b558722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:21.238224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c2b6e-0deb-446f-8834-f5dd0b558722 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:21.244531 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 769/1543] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:21.245628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f207f-c5f4-4422-9297-52bd8ec10e52 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.245914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f207f-c5f4-4422-9297-52bd8ec10e52 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.246186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f207f-c5f4-4422-9297-52bd8ec10e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.267797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-264f207f-c5f4-4422-9297-52bd8ec10e52 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:21.269046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-264f207f-c5f4-4422-9297-52bd8ec10e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:21.278492 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 770/1544] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:21.279374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f207f-c5f4-4422-9297-52bd8ec10e52 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:21.292985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f207f-c5f4-4422-9297-52bd8ec10e52 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:21.298918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd8417-7c76-4a29-b70f-9bfd32dc6a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:21.299974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd8417-7c76-4a29-b70f-9bfd32dc6a5b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.300529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd8417-7c76-4a29-b70f-9bfd32dc6a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.301020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd8417-7c76-4a29-b70f-9bfd32dc6a5b admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.303224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd8417-7c76-4a29-b70f-9bfd32dc6a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:21.306038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd8417-7c76-4a29-b70f-9bfd32dc6a5b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:21.398040 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 775/1545] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/projects => generated 395 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:21.399975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a04c-a56f-4882-a40d-d40d7bf0245e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.400280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a04c-a56f-4882-a40d-d40d7bf0245e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.400600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a04c-a56f-4882-a40d-d40d7bf0245e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.419643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e6c1a04c-a56f-4882-a40d-d40d7bf0245e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:21.420903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e6c1a04c-a56f-4882-a40d-d40d7bf0245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:21.425292 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 771/1546] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/users => generated 300 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:21.427200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc019b-ddfa-497b-a054-4408573c03b8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.427514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc019b-ddfa-497b-a054-4408573c03b8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.427974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc019b-ddfa-497b-a054-4408573c03b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.452121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-65bc019b-ddfa-497b-a054-4408573c03b8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:21.453376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-65bc019b-ddfa-497b-a054-4408573c03b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:21.491156 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 776/1547] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:21.491884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1a04c-a56f-4882-a40d-d40d7bf0245e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:21.501224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1a04c-a56f-4882-a40d-d40d7bf0245e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:21.506705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bcdd3-1ef0-48e2-9d7a-6ee5d4434d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:21.507307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bcdd3-1ef0-48e2-9d7a-6ee5d4434d70 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.507587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bcdd3-1ef0-48e2-9d7a-6ee5d4434d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.507853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bcdd3-1ef0-48e2-9d7a-6ee5d4434d70 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.508526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bcdd3-1ef0-48e2-9d7a-6ee5d4434d70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:21.508825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bcdd3-1ef0-48e2-9d7a-6ee5d4434d70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:21.510445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bcdd3-1ef0-48e2-9d7a-6ee5d4434d70 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:21.516683 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 772/1548] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:21.518194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea26ae-d76b-45c0-a14a-a9381ff8edf2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.518474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea26ae-d76b-45c0-a14a-a9381ff8edf2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.518742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea26ae-d76b-45c0-a14a-a9381ff8edf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.537611 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 777/1549] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:21.537611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6d91f-494e-494d-b456-6d7f794cb19e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.537611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6d91f-494e-494d-b456-6d7f794cb19e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.537611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6d91f-494e-494d-b456-6d7f794cb19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.538883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-09ea26ae-d76b-45c0-a14a-a9381ff8edf2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:21.540084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-09ea26ae-d76b-45c0-a14a-a9381ff8edf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:21.547957 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 773/1550] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:21.549156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd8747-da18-4531-95d0-a66693d1c273 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.549433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd8747-da18-4531-95d0-a66693d1c273 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.549713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd8747-da18-4531-95d0-a66693d1c273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.552833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8af6d91f-494e-494d-b456-6d7f794cb19e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:21.554044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8af6d91f-494e-494d-b456-6d7f794cb19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:21.562382 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 778/1551] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:21.563272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6d91f-494e-494d-b456-6d7f794cb19e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:21.570093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-affd8747-da18-4531-95d0-a66693d1c273 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:21.571247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-affd8747-da18-4531-95d0-a66693d1c273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:21.573238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6d91f-494e-494d-b456-6d7f794cb19e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:21.578081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fec076-0e56-492d-90c7-9a72e15b1308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:21.578680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fec076-0e56-492d-90c7-9a72e15b1308 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.578988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fec076-0e56-492d-90c7-9a72e15b1308 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.579263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fec076-0e56-492d-90c7-9a72e15b1308 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.579665 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 774/1552] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:21.580472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd8747-da18-4531-95d0-a66693d1c273 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:21.587716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fec076-0e56-492d-90c7-9a72e15b1308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:21.588823 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-22fec076-0e56-492d-90c7-9a72e15b1308 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:38:21.588823 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:38:21.588823 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:38:21.589967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd8747-da18-4531-95d0-a66693d1c273 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:21.590066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fec076-0e56-492d-90c7-9a72e15b1308 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:21.594631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed714f90-5693-4c39-8c79-a4bcdb215808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:21.595217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed714f90-5693-4c39-8c79-a4bcdb215808 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.595490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed714f90-5693-4c39-8c79-a4bcdb215808 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.595755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed714f90-5693-4c39-8c79-a4bcdb215808 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.596420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed714f90-5693-4c39-8c79-a4bcdb215808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:21.597973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed714f90-5693-4c39-8c79-a4bcdb215808 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:21.608378 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 775/1553] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:21.609575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937cf1a-80a9-4783-b571-0a7273b1e0c2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.609856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937cf1a-80a9-4783-b571-0a7273b1e0c2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.610133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937cf1a-80a9-4783-b571-0a7273b1e0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.630721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9937cf1a-80a9-4783-b571-0a7273b1e0c2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:21.631926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9937cf1a-80a9-4783-b571-0a7273b1e0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:21.639944 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 776/1554] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:21.641155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78235b10-2be1-4ff5-8938-a893108466e3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.641434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78235b10-2be1-4ff5-8938-a893108466e3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.641725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78235b10-2be1-4ff5-8938-a893108466e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.655496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:21.662520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-78235b10-2be1-4ff5-8938-a893108466e3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:21.665325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-78235b10-2be1-4ff5-8938-a893108466e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:21.672583 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 777/1555] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:21.673345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78235b10-2be1-4ff5-8938-a893108466e3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:21.684788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78235b10-2be1-4ff5-8938-a893108466e3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:21.689480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c895385-946e-4a93-9641-e12e165c96a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:21.699502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c895385-946e-4a93-9641-e12e165c96a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.699502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c895385-946e-4a93-9641-e12e165c96a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.699502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c895385-946e-4a93-9641-e12e165c96a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.699502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c895385-946e-4a93-9641-e12e165c96a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:21.699502 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-3c895385-946e-4a93-9641-e12e165c96a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:38:21.699502 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:38:21.699502 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:38:21.700076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c895385-946e-4a93-9641-e12e165c96a3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:21.716483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:21.722576 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 779/1556] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:21.734243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92cf9f-ace6-48d2-9189-0d169de40fde None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.734243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92cf9f-ace6-48d2-9189-0d169de40fde None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.734243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92cf9f-ace6-48d2-9189-0d169de40fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.744443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4a92cf9f-ace6-48d2-9189-0d169de40fde None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:21.745573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4a92cf9f-ace6-48d2-9189-0d169de40fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:21.753353 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 780/1557] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:21.755194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92cf9f-ace6-48d2-9189-0d169de40fde None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:21.764649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92cf9f-ace6-48d2-9189-0d169de40fde None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:21.769581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86fc0a-51e9-42b5-9430-2344febf2379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:21.770160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86fc0a-51e9-42b5-9430-2344febf2379 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.770555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86fc0a-51e9-42b5-9430-2344febf2379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.770940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86fc0a-51e9-42b5-9430-2344febf2379 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.771649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86fc0a-51e9-42b5-9430-2344febf2379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:21.771955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86fc0a-51e9-42b5-9430-2344febf2379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:21.773648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86fc0a-51e9-42b5-9430-2344febf2379 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:21.785039 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 781/1558] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:21.786711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712e327-cc66-4a6c-9c09-e2989c47a01d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.787082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712e327-cc66-4a6c-9c09-e2989c47a01d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.787319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712e327-cc66-4a6c-9c09-e2989c47a01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.798782 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 778/1559] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/projects => generated 389 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:21.803195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c895385-946e-4a93-9641-e12e165c96a3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:21.809061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8712e327-cc66-4a6c-9c09-e2989c47a01d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:21.810308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8712e327-cc66-4a6c-9c09-e2989c47a01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:21.862648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c895385-946e-4a93-9641-e12e165c96a3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:21.868085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a8a04-3263-40e0-bc22-f4ce6df8ac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:21.868729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a8a04-3263-40e0-bc22-f4ce6df8ac7e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.869005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a8a04-3263-40e0-bc22-f4ce6df8ac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.869273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a8a04-3263-40e0-bc22-f4ce6df8ac7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.869933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a8a04-3263-40e0-bc22-f4ce6df8ac7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:21.870028 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 782/1560] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:21.870916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712e327-cc66-4a6c-9c09-e2989c47a01d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:21.871611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a8a04-3263-40e0-bc22-f4ce6df8ac7e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:21.880527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712e327-cc66-4a6c-9c09-e2989c47a01d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:21.881900 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 779/1561] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:21.882720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a8a04-3263-40e0-bc22-f4ce6df8ac7e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:21.886361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17059236-f228-4a81-83e6-c9e053f53601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:21.900145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17059236-f228-4a81-83e6-c9e053f53601 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.900145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17059236-f228-4a81-83e6-c9e053f53601 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.900145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17059236-f228-4a81-83e6-c9e053f53601 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.900145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17059236-f228-4a81-83e6-c9e053f53601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:21.900145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17059236-f228-4a81-83e6-c9e053f53601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:21.900145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17059236-f228-4a81-83e6-c9e053f53601 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:21.900678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a8a04-3263-40e0-bc22-f4ce6df8ac7e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:21.900678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541c8c1-3bf2-4474-bf53-88f15637ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:21.900678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541c8c1-3bf2-4474-bf53-88f15637ba7a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.900678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541c8c1-3bf2-4474-bf53-88f15637ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.900977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541c8c1-3bf2-4474-bf53-88f15637ba7a admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.900977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541c8c1-3bf2-4474-bf53-88f15637ba7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:21.900977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541c8c1-3bf2-4474-bf53-88f15637ba7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:21.900977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541c8c1-3bf2-4474-bf53-88f15637ba7a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:21.908926 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 783/1562] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:21.908926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17059236-f228-4a81-83e6-c9e053f53601 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:21.913934 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 780/1563] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:21.915079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541c8c1-3bf2-4474-bf53-88f15637ba7a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:21.919991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17059236-f228-4a81-83e6-c9e053f53601 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:21.924703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9781f-8be3-4be8-81fb-fcdc3e83fd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:21.925298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9781f-8be3-4be8-81fb-fcdc3e83fd24 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.925606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9781f-8be3-4be8-81fb-fcdc3e83fd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.925715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541c8c1-3bf2-4474-bf53-88f15637ba7a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:21.925895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9781f-8be3-4be8-81fb-fcdc3e83fd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.926590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9781f-8be3-4be8-81fb-fcdc3e83fd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:21.928844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9781f-8be3-4be8-81fb-fcdc3e83fd24 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:21.931100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9e404-738e-47a2-98bc-7b9cc5ee5786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:21.931685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9e404-738e-47a2-98bc-7b9cc5ee5786 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.931965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9e404-738e-47a2-98bc-7b9cc5ee5786 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.932279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9e404-738e-47a2-98bc-7b9cc5ee5786 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.932918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9e404-738e-47a2-98bc-7b9cc5ee5786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:21.933219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9e404-738e-47a2-98bc-7b9cc5ee5786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:21.934790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9e404-738e-47a2-98bc-7b9cc5ee5786 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:21.941924 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 784/1564] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:21.943048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9781f-8be3-4be8-81fb-fcdc3e83fd24 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:21.947200 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 781/1565] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:21.948005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9e404-738e-47a2-98bc-7b9cc5ee5786 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:21.957415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9e404-738e-47a2-98bc-7b9cc5ee5786 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:21.959108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9781f-8be3-4be8-81fb-fcdc3e83fd24 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:21.963071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d860d82-e202-4ddc-a4a5-196f36de5e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:21.963693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d860d82-e202-4ddc-a4a5-196f36de5e40 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.963969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d860d82-e202-4ddc-a4a5-196f36de5e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.964269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d860d82-e202-4ddc-a4a5-196f36de5e40 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.964936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d860d82-e202-4ddc-a4a5-196f36de5e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:21.965265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a410354-b426-47d7-bc9b-6a5463f91d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:21.965885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a410354-b426-47d7-bc9b-6a5463f91d48 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:21.966168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a410354-b426-47d7-bc9b-6a5463f91d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:21.966444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a410354-b426-47d7-bc9b-6a5463f91d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:21.967079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a410354-b426-47d7-bc9b-6a5463f91d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:21.967863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d860d82-e202-4ddc-a4a5-196f36de5e40 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:21.969031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a410354-b426-47d7-bc9b-6a5463f91d48 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:22.110090 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 782/1566] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:22.110960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d860d82-e202-4ddc-a4a5-196f36de5e40 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:22.120372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d860d82-e202-4ddc-a4a5-196f36de5e40 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:22.125326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb34114-35d5-4b19-9628-e584a582ebcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:22.125958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb34114-35d5-4b19-9628-e584a582ebcb admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:22.126236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb34114-35d5-4b19-9628-e584a582ebcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:22.126507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb34114-35d5-4b19-9628-e584a582ebcb admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:22.127167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb34114-35d5-4b19-9628-e584a582ebcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:22.127576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb34114-35d5-4b19-9628-e584a582ebcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:22.132381 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 785/1567] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:21 2022] POST /identity/v3/projects => generated 369 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:22.132536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb34114-35d5-4b19-9628-e584a582ebcb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:22.132641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a410354-b426-47d7-bc9b-6a5463f91d48 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:22.142243 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 783/1568] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:22.143031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb34114-35d5-4b19-9628-e584a582ebcb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:22.159737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb34114-35d5-4b19-9628-e584a582ebcb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:22.194083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a410354-b426-47d7-bc9b-6a5463f91d48 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:22.198764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c68c8-7a7c-4414-8603-c8167c847788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:22.199416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c68c8-7a7c-4414-8603-c8167c847788 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:22.199697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c68c8-7a7c-4414-8603-c8167c847788 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:22.199970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c68c8-7a7c-4414-8603-c8167c847788 admin admin] PATH_INFO: `/v3/projects/1275d58fd90145148f202c5286adc7cd/users/dfcdd13526e74e089bcac8b0ac057f96/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:22.215380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c68c8-7a7c-4414-8603-c8167c847788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1275d58fd90145148f202c5286adc7cd, user_id=dfcdd13526e74e089bcac8b0ac057f96, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:22.218130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c68c8-7a7c-4414-8603-c8167c847788 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:22.218435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba930dd-2bc6-45c2-92fc-2b72d1f44035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:22.219039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba930dd-2bc6-45c2-92fc-2b72d1f44035 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:22.219316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba930dd-2bc6-45c2-92fc-2b72d1f44035 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:22.219587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba930dd-2bc6-45c2-92fc-2b72d1f44035 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:22.220229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba930dd-2bc6-45c2-92fc-2b72d1f44035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:22.222116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba930dd-2bc6-45c2-92fc-2b72d1f44035 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:22.305238 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 786/1569] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:22 2022] PUT /identity/v3/projects/1275d58fd90145148f202c5286adc7cd/users/dfcdd13526e74e089bcac8b0ac057f96/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:22.306056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c68c8-7a7c-4414-8603-c8167c847788 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:22.323269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:22.349641 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 784/1570] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:22 2022] POST /identity/v3/projects => generated 391 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:22.349641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba930dd-2bc6-45c2-92fc-2b72d1f44035 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:22.351485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:22.370656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c68c8-7a7c-4414-8603-c8167c847788 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:22.410698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba930dd-2bc6-45c2-92fc-2b72d1f44035 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:22.415671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6ba02-aff4-4a7b-ac03-24bccc129419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:22.417193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6ba02-aff4-4a7b-ac03-24bccc129419 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:22.417193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6ba02-aff4-4a7b-ac03-24bccc129419 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:22.417193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6ba02-aff4-4a7b-ac03-24bccc129419 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:22.417803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6ba02-aff4-4a7b-ac03-24bccc129419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:22.419515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6ba02-aff4-4a7b-ac03-24bccc129419 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:22.428350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862bbb4-eca8-49aa-96e9-4cea79ef13e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:22.428958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862bbb4-eca8-49aa-96e9-4cea79ef13e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:22.429238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862bbb4-eca8-49aa-96e9-4cea79ef13e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:22.429511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862bbb4-eca8-49aa-96e9-4cea79ef13e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:22.430140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862bbb4-eca8-49aa-96e9-4cea79ef13e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:22.432080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862bbb4-eca8-49aa-96e9-4cea79ef13e1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:22.432736 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 785/1571] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:22.438021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6ba02-aff4-4a7b-ac03-24bccc129419 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:22.445502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6ba02-aff4-4a7b-ac03-24bccc129419 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:22.457319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4d2a8-7e8e-41af-a820-c0ef8c8af2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:22.457319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4d2a8-7e8e-41af-a820-c0ef8c8af2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:22.457319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4d2a8-7e8e-41af-a820-c0ef8c8af2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:22.457319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4d2a8-7e8e-41af-a820-c0ef8c8af2c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:22.457672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4d2a8-7e8e-41af-a820-c0ef8c8af2c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:22.457672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4d2a8-7e8e-41af-a820-c0ef8c8af2c3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:22.603096 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 787/1572] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:22 2022] POST /identity/v3/projects => generated 371 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:22.603936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862bbb4-eca8-49aa-96e9-4cea79ef13e1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:22.643860 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 786/1573] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:22 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:22.643860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4d2a8-7e8e-41af-a820-c0ef8c8af2c3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:22.677037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862bbb4-eca8-49aa-96e9-4cea79ef13e1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:22.714464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4d2a8-7e8e-41af-a820-c0ef8c8af2c3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:22.719050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e63a3-c5f4-4287-8c85-4a0a86898954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:22.719660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e63a3-c5f4-4287-8c85-4a0a86898954 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:22.719941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e63a3-c5f4-4287-8c85-4a0a86898954 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:22.720233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e63a3-c5f4-4287-8c85-4a0a86898954 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:22.720861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e63a3-c5f4-4287-8c85-4a0a86898954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:22.722777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e63a3-c5f4-4287-8c85-4a0a86898954 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:22.731052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:22.737825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a289b9f-8746-4efd-8b4a-a5f823298dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:22.738498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a289b9f-8746-4efd-8b4a-a5f823298dcc admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:22.738745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a289b9f-8746-4efd-8b4a-a5f823298dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:22.739032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a289b9f-8746-4efd-8b4a-a5f823298dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:22.739699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a289b9f-8746-4efd-8b4a-a5f823298dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:22.741306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a289b9f-8746-4efd-8b4a-a5f823298dcc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:22.751215 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 788/1574] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:22.752228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a289b9f-8746-4efd-8b4a-a5f823298dcc admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:22.762347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a289b9f-8746-4efd-8b4a-a5f823298dcc admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:22.767135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978006ce-1cd4-413c-8f4e-fe8306c6f22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:22.767719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978006ce-1cd4-413c-8f4e-fe8306c6f22e admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:22.768000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978006ce-1cd4-413c-8f4e-fe8306c6f22e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:22.768305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978006ce-1cd4-413c-8f4e-fe8306c6f22e admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:22.768924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978006ce-1cd4-413c-8f4e-fe8306c6f22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:22.771444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978006ce-1cd4-413c-8f4e-fe8306c6f22e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:22.830490 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 787/1575] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:22 2022] POST /identity/v3/users => generated 285 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:22.831744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023966f-7ed6-4f37-9fe2-0dde283c3e81 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:22.832029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023966f-7ed6-4f37-9fe2-0dde283c3e81 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:22.832343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023966f-7ed6-4f37-9fe2-0dde283c3e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:22.861713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5023966f-7ed6-4f37-9fe2-0dde283c3e81 None None] MFA Rules not processed for user `dfcdd13526e74e089bcac8b0ac057f96`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:22.862921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5023966f-7ed6-4f37-9fe2-0dde283c3e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:22.917535 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 789/1576] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:22 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:22.918336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978006ce-1cd4-413c-8f4e-fe8306c6f22e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:22.922034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:22.932323 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 788/1577] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:22 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:22.933112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023966f-7ed6-4f37-9fe2-0dde283c3e81 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:22.946717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023966f-7ed6-4f37-9fe2-0dde283c3e81 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:23.005580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978006ce-1cd4-413c-8f4e-fe8306c6f22e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:23.009478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac9bd7-50e1-4ed6-82cc-c221220317b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:23.010862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac9bd7-50e1-4ed6-82cc-c221220317b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.010996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b1da0-75db-4521-ba78-09837c0bc62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:23.011246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac9bd7-50e1-4ed6-82cc-c221220317b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.011534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac9bd7-50e1-4ed6-82cc-c221220317b3 admin admin] PATH_INFO: `/v3/projects/a9d7f623110e42e0a1dad7890cc646ed/users/8a2fea0eec6848e9bf93d43d1ad47f22/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.011721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b1da0-75db-4521-ba78-09837c0bc62a admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.011857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b1da0-75db-4521-ba78-09837c0bc62a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.012348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b1da0-75db-4521-ba78-09837c0bc62a admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.013522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b1da0-75db-4521-ba78-09837c0bc62a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:23.016119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b1da0-75db-4521-ba78-09837c0bc62a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:23.030812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac9bd7-50e1-4ed6-82cc-c221220317b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d7f623110e42e0a1dad7890cc646ed, user_id=8a2fea0eec6848e9bf93d43d1ad47f22, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:23.031887 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-d0ac9bd7-50e1-4ed6-82cc-c221220317b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:38:23.031887 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:38:23.031887 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:38:23.033895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac9bd7-50e1-4ed6-82cc-c221220317b3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:23.144996 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 790/1578] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:22 2022] POST /identity/v3/users => generated 296 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:23.146028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b1da0-75db-4521-ba78-09837c0bc62a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:23.155972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b1da0-75db-4521-ba78-09837c0bc62a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:23.156403 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 789/1579] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:22 2022] PUT /identity/v3/projects/a9d7f623110e42e0a1dad7890cc646ed/users/8a2fea0eec6848e9bf93d43d1ad47f22/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:23.157371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac9bd7-50e1-4ed6-82cc-c221220317b3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:23.221183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac9bd7-50e1-4ed6-82cc-c221220317b3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:23.225143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24234a1a-452a-46d2-a9d3-581eb701d5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:23.225753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24234a1a-452a-46d2-a9d3-581eb701d5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.226032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24234a1a-452a-46d2-a9d3-581eb701d5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.226305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24234a1a-452a-46d2-a9d3-581eb701d5d9 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.226926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cebfd-1a8b-4386-9dfe-3a70a3ede622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:23.227042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24234a1a-452a-46d2-a9d3-581eb701d5d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:23.227524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cebfd-1a8b-4386-9dfe-3a70a3ede622 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.227801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cebfd-1a8b-4386-9dfe-3a70a3ede622 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.228073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cebfd-1a8b-4386-9dfe-3a70a3ede622 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.228725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5cebfd-1a8b-4386-9dfe-3a70a3ede622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:23.228896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24234a1a-452a-46d2-a9d3-581eb701d5d9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:23.230615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5cebfd-1a8b-4386-9dfe-3a70a3ede622 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:23.317065 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 791/1580] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:23 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:23.318233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24234a1a-452a-46d2-a9d3-581eb701d5d9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:23.327994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24234a1a-452a-46d2-a9d3-581eb701d5d9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:23.332663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf392a-9e04-4773-be4e-c11983d88a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:23.333408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf392a-9e04-4773-be4e-c11983d88a93 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.333612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf392a-9e04-4773-be4e-c11983d88a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.333855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf392a-9e04-4773-be4e-c11983d88a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.334489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf392a-9e04-4773-be4e-c11983d88a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:23.336080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf392a-9e04-4773-be4e-c11983d88a93 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:23.345043 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 790/1581] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:23 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:23.345924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cebfd-1a8b-4386-9dfe-3a70a3ede622 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:23.346998 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 792/1582] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:23.347581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf392a-9e04-4773-be4e-c11983d88a93 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:23.358689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf392a-9e04-4773-be4e-c11983d88a93 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:23.360644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cebfd-1a8b-4386-9dfe-3a70a3ede622 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:23.363510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c94d3e-fb2b-427d-a70c-7b1be77672c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:23.364694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c94d3e-fb2b-427d-a70c-7b1be77672c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.365023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c94d3e-fb2b-427d-a70c-7b1be77672c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.365303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c94d3e-fb2b-427d-a70c-7b1be77672c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.365928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c94d3e-fb2b-427d-a70c-7b1be77672c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:23.366113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a7c65-7c83-4e0f-8f87-46061c28f4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:23.366721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a7c65-7c83-4e0f-8f87-46061c28f4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.367006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a7c65-7c83-4e0f-8f87-46061c28f4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.367280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a7c65-7c83-4e0f-8f87-46061c28f4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.367898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c94d3e-fb2b-427d-a70c-7b1be77672c0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:23.368018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a7c65-7c83-4e0f-8f87-46061c28f4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:23.369523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a7c65-7c83-4e0f-8f87-46061c28f4b2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:23.380571 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 791/1583] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:23.384583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a7c65-7c83-4e0f-8f87-46061c28f4b2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:23.390766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a7c65-7c83-4e0f-8f87-46061c28f4b2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:23.397469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657324fc-1f41-4b76-a50a-8b6c6563c0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:23.398106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657324fc-1f41-4b76-a50a-8b6c6563c0cc admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.398424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657324fc-1f41-4b76-a50a-8b6c6563c0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.398738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657324fc-1f41-4b76-a50a-8b6c6563c0cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.399430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657324fc-1f41-4b76-a50a-8b6c6563c0cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:23.401496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657324fc-1f41-4b76-a50a-8b6c6563c0cc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:23.475834 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 793/1584] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:23 2022] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:23.476913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c94d3e-fb2b-427d-a70c-7b1be77672c0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:23.486390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c94d3e-fb2b-427d-a70c-7b1be77672c0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:23.491225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cecab-e2e9-4264-a7ae-2a61bdf278ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:23.491797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cecab-e2e9-4264-a7ae-2a61bdf278ba admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.492078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cecab-e2e9-4264-a7ae-2a61bdf278ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.492407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cecab-e2e9-4264-a7ae-2a61bdf278ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.493018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cecab-e2e9-4264-a7ae-2a61bdf278ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:23.494605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cecab-e2e9-4264-a7ae-2a61bdf278ba admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:23.504273 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 794/1585] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:23.506076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33cf06-19a6-4683-95b0-9b6ba54113da None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.506360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33cf06-19a6-4683-95b0-9b6ba54113da None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.506635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33cf06-19a6-4683-95b0-9b6ba54113da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.526333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:23.534237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7c33cf06-19a6-4683-95b0-9b6ba54113da None None] MFA Rules not processed for user `8a2fea0eec6848e9bf93d43d1ad47f22`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:23.535440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7c33cf06-19a6-4683-95b0-9b6ba54113da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:23.597540 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 795/1586] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:23 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:23.598379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33cf06-19a6-4683-95b0-9b6ba54113da None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:23.608337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33cf06-19a6-4683-95b0-9b6ba54113da None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:23.612922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0710f97-b77d-419e-93cd-87779852e926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:23.619638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0710f97-b77d-419e-93cd-87779852e926 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.619638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0710f97-b77d-419e-93cd-87779852e926 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.619638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0710f97-b77d-419e-93cd-87779852e926 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.620866 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 792/1587] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:23 2022] POST /identity/v3/projects => generated 399 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:23.620866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657324fc-1f41-4b76-a50a-8b6c6563c0cc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:23.621035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0710f97-b77d-419e-93cd-87779852e926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:23.621035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0710f97-b77d-419e-93cd-87779852e926 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:23.632451 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 796/1588] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:23.633527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0710f97-b77d-419e-93cd-87779852e926 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:23.643557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0710f97-b77d-419e-93cd-87779852e926 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:23.660357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:23.688131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657324fc-1f41-4b76-a50a-8b6c6563c0cc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:23.695374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d401b-fb73-4a3b-bd5a-0b42b3df4d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:23.696304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d401b-fb73-4a3b-bd5a-0b42b3df4d14 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.696724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d401b-fb73-4a3b-bd5a-0b42b3df4d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.697139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d401b-fb73-4a3b-bd5a-0b42b3df4d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.698115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d401b-fb73-4a3b-bd5a-0b42b3df4d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:23.700553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d401b-fb73-4a3b-bd5a-0b42b3df4d14 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:23.709193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b50da-403b-45b4-bb97-13f802fc108d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:23.710118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b50da-403b-45b4-bb97-13f802fc108d admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.710790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b50da-403b-45b4-bb97-13f802fc108d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.712082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b50da-403b-45b4-bb97-13f802fc108d admin admin] PATH_INFO: `/v3/projects/dae5eca5a049462aa50c42ecaf08241e/users/897dedad921f400aa3206db5fd051231/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.716032 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 793/1589] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:23.716975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d401b-fb73-4a3b-bd5a-0b42b3df4d14 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:23.733955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b50da-403b-45b4-bb97-13f802fc108d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae5eca5a049462aa50c42ecaf08241e, user_id=897dedad921f400aa3206db5fd051231, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:23.734221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d401b-fb73-4a3b-bd5a-0b42b3df4d14 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:23.734317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b50da-403b-45b4-bb97-13f802fc108d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:23.736407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b2b9c-21fb-4795-a22b-ca6fc51a9252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:23.737281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b2b9c-21fb-4795-a22b-ca6fc51a9252 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.737692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b2b9c-21fb-4795-a22b-ca6fc51a9252 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.738092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b2b9c-21fb-4795-a22b-ca6fc51a9252 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.739584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b2b9c-21fb-4795-a22b-ca6fc51a9252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:23.742144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b2b9c-21fb-4795-a22b-ca6fc51a9252 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:23.753035 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 794/1590] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:23.753876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b2b9c-21fb-4795-a22b-ca6fc51a9252 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:23.764420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b2b9c-21fb-4795-a22b-ca6fc51a9252 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:23.769365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e3a9f-5895-45fb-aa1a-0ba5a49de977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:23.769945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e3a9f-5895-45fb-aa1a-0ba5a49de977 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.770249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e3a9f-5895-45fb-aa1a-0ba5a49de977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.770615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e3a9f-5895-45fb-aa1a-0ba5a49de977 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.771241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e3a9f-5895-45fb-aa1a-0ba5a49de977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:23.772900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e3a9f-5895-45fb-aa1a-0ba5a49de977 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:23.783194 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 795/1591] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:23.783984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e3a9f-5895-45fb-aa1a-0ba5a49de977 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:23.793913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e3a9f-5895-45fb-aa1a-0ba5a49de977 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:23.798565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65756739-1468-43e3-bc65-58c22e202092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:23.799191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756739-1468-43e3-bc65-58c22e202092 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.799474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756739-1468-43e3-bc65-58c22e202092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.799744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756739-1468-43e3-bc65-58c22e202092 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.800497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65756739-1468-43e3-bc65-58c22e202092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:23.802789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65756739-1468-43e3-bc65-58c22e202092 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:23.812685 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 796/1592] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:23.813537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65756739-1468-43e3-bc65-58c22e202092 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:23.823912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65756739-1468-43e3-bc65-58c22e202092 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:23.828424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc4499-88b5-4c21-9593-4e201ccc312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:23.829002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc4499-88b5-4c21-9593-4e201ccc312c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.829284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc4499-88b5-4c21-9593-4e201ccc312c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.829547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc4499-88b5-4c21-9593-4e201ccc312c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.830163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc4499-88b5-4c21-9593-4e201ccc312c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:23.832211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc4499-88b5-4c21-9593-4e201ccc312c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:23.836084 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 797/1593] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:23 2022] PUT /identity/v3/projects/dae5eca5a049462aa50c42ecaf08241e/users/897dedad921f400aa3206db5fd051231/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:23.837088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b50da-403b-45b4-bb97-13f802fc108d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:23.905085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b50da-403b-45b4-bb97-13f802fc108d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:23.909814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6efb04-3669-43d2-af23-ebcb674781d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:23.910409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6efb04-3669-43d2-af23-ebcb674781d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:23.910692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6efb04-3669-43d2-af23-ebcb674781d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:23.911541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6efb04-3669-43d2-af23-ebcb674781d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:23.912210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6efb04-3669-43d2-af23-ebcb674781d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:23.914190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6efb04-3669-43d2-af23-ebcb674781d2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:23.962942 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 797/1594] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:23 2022] POST /identity/v3/projects => generated 393 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:23.964147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc4499-88b5-4c21-9593-4e201ccc312c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:24.026045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc4499-88b5-4c21-9593-4e201ccc312c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:24.030840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af062075-ad2b-4826-acae-1b97c5c114b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:24.031470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af062075-ad2b-4826-acae-1b97c5c114b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.031755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af062075-ad2b-4826-acae-1b97c5c114b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.032031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af062075-ad2b-4826-acae-1b97c5c114b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.032739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af062075-ad2b-4826-acae-1b97c5c114b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:24.034419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af062075-ad2b-4826-acae-1b97c5c114b8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:24.049669 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 798/1595] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:24.050544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af062075-ad2b-4826-acae-1b97c5c114b8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:24.061428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af062075-ad2b-4826-acae-1b97c5c114b8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:24.066750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd09c7-f784-4982-8dbe-41f49549ce2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:24.067415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd09c7-f784-4982-8dbe-41f49549ce2e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.067415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd09c7-f784-4982-8dbe-41f49549ce2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.068004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd09c7-f784-4982-8dbe-41f49549ce2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.068572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd09c7-f784-4982-8dbe-41f49549ce2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:24.070392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd09c7-f784-4982-8dbe-41f49549ce2e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:24.077781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:24.088365 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 798/1596] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:23 2022] POST /identity/v3/users => generated 306 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:24.088365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6efb04-3669-43d2-af23-ebcb674781d2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:24.091237 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 799/1597] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:24.092570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd09c7-f784-4982-8dbe-41f49549ce2e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:24.098103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6efb04-3669-43d2-af23-ebcb674781d2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:24.103777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35fa40-16b0-4cd4-b7e3-50dcd32bd419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:24.105779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35fa40-16b0-4cd4-b7e3-50dcd32bd419 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.106064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35fa40-16b0-4cd4-b7e3-50dcd32bd419 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.106336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35fa40-16b0-4cd4-b7e3-50dcd32bd419 admin admin] PATH_INFO: `/v3/projects/b8eb583f85824886a7e066a7b884ce42/users/fbae0f44ca87484b8925f0bb9df28ac7/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.108001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd09c7-f784-4982-8dbe-41f49549ce2e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:24.115116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ed6ba-69f9-4f31-94db-25f0b8fa759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:24.115895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ed6ba-69f9-4f31-94db-25f0b8fa759e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.116231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ed6ba-69f9-4f31-94db-25f0b8fa759e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.116431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ed6ba-69f9-4f31-94db-25f0b8fa759e admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.117075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ed6ba-69f9-4f31-94db-25f0b8fa759e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:24.118663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ed6ba-69f9-4f31-94db-25f0b8fa759e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:24.124579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35fa40-16b0-4cd4-b7e3-50dcd32bd419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8eb583f85824886a7e066a7b884ce42, user_id=fbae0f44ca87484b8925f0bb9df28ac7, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:24.127242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35fa40-16b0-4cd4-b7e3-50dcd32bd419 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:24.133377 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 800/1598] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:24.134331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ed6ba-69f9-4f31-94db-25f0b8fa759e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:24.144301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ed6ba-69f9-4f31-94db-25f0b8fa759e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:24.148989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecb68e-5068-48d7-a5fd-bec5a0c72b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:24.149608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecb68e-5068-48d7-a5fd-bec5a0c72b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.149888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecb68e-5068-48d7-a5fd-bec5a0c72b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.150159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecb68e-5068-48d7-a5fd-bec5a0c72b11 admin admin] PATH_INFO: `/v3/projects/3f0dcb8cd77c43d1b20a41ab22537369/users/ea9350f95df244ebbc3fc26b313f82d2/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.165323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecb68e-5068-48d7-a5fd-bec5a0c72b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0dcb8cd77c43d1b20a41ab22537369, user_id=ea9350f95df244ebbc3fc26b313f82d2, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:24.168179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecb68e-5068-48d7-a5fd-bec5a0c72b11 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:24.236724 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 799/1599] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:24 2022] PUT /identity/v3/projects/b8eb583f85824886a7e066a7b884ce42/users/fbae0f44ca87484b8925f0bb9df28ac7/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:24.238457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd70de-6a3a-4784-bfa6-eff397a12d07 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.238457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd70de-6a3a-4784-bfa6-eff397a12d07 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.238617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd70de-6a3a-4784-bfa6-eff397a12d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.266835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-36dd70de-6a3a-4784-bfa6-eff397a12d07 None None] MFA Rules not processed for user `897dedad921f400aa3206db5fd051231`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:24.268343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-36dd70de-6a3a-4784-bfa6-eff397a12d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:24.277879 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 801/1600] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:24 2022] PUT /identity/v3/projects/3f0dcb8cd77c43d1b20a41ab22537369/users/ea9350f95df244ebbc3fc26b313f82d2/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:24.278699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecb68e-5068-48d7-a5fd-bec5a0c72b11 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:24.321315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:24.335710 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 800/1601] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:24.336967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd70de-6a3a-4784-bfa6-eff397a12d07 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:24.354516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecb68e-5068-48d7-a5fd-bec5a0c72b11 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:24.360297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92744283-ae24-4eff-ad02-3086d53ca957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:24.360893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92744283-ae24-4eff-ad02-3086d53ca957 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.361205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92744283-ae24-4eff-ad02-3086d53ca957 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.361472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92744283-ae24-4eff-ad02-3086d53ca957 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.362099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92744283-ae24-4eff-ad02-3086d53ca957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:24.364680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92744283-ae24-4eff-ad02-3086d53ca957 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:24.405756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd70de-6a3a-4784-bfa6-eff397a12d07 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:24.410451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd215cd-48c2-4f96-bcdc-09b905c1db7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:24.411186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd215cd-48c2-4f96-bcdc-09b905c1db7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.411596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd215cd-48c2-4f96-bcdc-09b905c1db7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.411875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd215cd-48c2-4f96-bcdc-09b905c1db7c admin admin] PATH_INFO: `/v3/projects/d11ef3b1badc4bb7b109648fc21f3fc7/users/41e90ddefaa54150a673d201162a44e6/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.427645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd215cd-48c2-4f96-bcdc-09b905c1db7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11ef3b1badc4bb7b109648fc21f3fc7, user_id=41e90ddefaa54150a673d201162a44e6, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:24.430271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd215cd-48c2-4f96-bcdc-09b905c1db7c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:24.484881 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 802/1602] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:24 2022] POST /identity/v3/users => generated 303 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:24.484881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92744283-ae24-4eff-ad02-3086d53ca957 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:24.492814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92744283-ae24-4eff-ad02-3086d53ca957 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:24.497360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec882e-c034-4200-8f1e-84d2e09451a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:24.497931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec882e-c034-4200-8f1e-84d2e09451a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.498207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec882e-c034-4200-8f1e-84d2e09451a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.498476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec882e-c034-4200-8f1e-84d2e09451a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.499096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec882e-c034-4200-8f1e-84d2e09451a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:24.500688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec882e-c034-4200-8f1e-84d2e09451a9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:24.512219 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 803/1603] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:24.513361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec882e-c034-4200-8f1e-84d2e09451a9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:24.519863 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 801/1604] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:24 2022] PUT /identity/v3/projects/d11ef3b1badc4bb7b109648fc21f3fc7/users/41e90ddefaa54150a673d201162a44e6/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:24.521012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd215cd-48c2-4f96-bcdc-09b905c1db7c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:24.524157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec882e-c034-4200-8f1e-84d2e09451a9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:24.581873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d8114-05ef-40b5-97db-4c1830e6bfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:24.582456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d8114-05ef-40b5-97db-4c1830e6bfa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.582780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d8114-05ef-40b5-97db-4c1830e6bfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.583028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:24.583283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d8114-05ef-40b5-97db-4c1830e6bfa9 admin admin] PATH_INFO: `/v3/projects/f8cdc14535344095acbb85a078073ccf/users/9da73530cb834803b849b0e97f467e0e/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.596045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd215cd-48c2-4f96-bcdc-09b905c1db7c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:24.597985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d8114-05ef-40b5-97db-4c1830e6bfa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8cdc14535344095acbb85a078073ccf, user_id=9da73530cb834803b849b0e97f467e0e, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:24.600955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d8114-05ef-40b5-97db-4c1830e6bfa9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:24.602419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e49f7-9a5c-4670-8e72-99bd68db4032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:24.603076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e49f7-9a5c-4670-8e72-99bd68db4032 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.603357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e49f7-9a5c-4670-8e72-99bd68db4032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.603632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e49f7-9a5c-4670-8e72-99bd68db4032 admin admin] PATH_INFO: `/v3/projects/47ac6bcb3b07481fac6b292b9c6a12b7/users/c6e3a429567442c8b4722611b9c3873f/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.618736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e49f7-9a5c-4670-8e72-99bd68db4032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ac6bcb3b07481fac6b292b9c6a12b7, user_id=c6e3a429567442c8b4722611b9c3873f, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:24.621457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e49f7-9a5c-4670-8e72-99bd68db4032 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:24.704262 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 804/1605] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:24 2022] PUT /identity/v3/projects/f8cdc14535344095acbb85a078073ccf/users/9da73530cb834803b849b0e97f467e0e/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:24.705506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deff6e2-d4e4-4d30-acb2-2426bdfe797a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.705904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deff6e2-d4e4-4d30-acb2-2426bdfe797a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.706181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deff6e2-d4e4-4d30-acb2-2426bdfe797a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.734476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0deff6e2-d4e4-4d30-acb2-2426bdfe797a None None] MFA Rules not processed for user `fbae0f44ca87484b8925f0bb9df28ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:24.735683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0deff6e2-d4e4-4d30-acb2-2426bdfe797a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:24.756512 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 802/1606] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:24 2022] PUT /identity/v3/projects/47ac6bcb3b07481fac6b292b9c6a12b7/users/c6e3a429567442c8b4722611b9c3873f/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:24.769897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f314eaa-4bbf-4488-a38d-c56b8ed0caca None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.770188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f314eaa-4bbf-4488-a38d-c56b8ed0caca None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.770470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f314eaa-4bbf-4488-a38d-c56b8ed0caca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.798186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3f314eaa-4bbf-4488-a38d-c56b8ed0caca None None] MFA Rules not processed for user `ea9350f95df244ebbc3fc26b313f82d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:24.799848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3f314eaa-4bbf-4488-a38d-c56b8ed0caca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:24.803416 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 805/1607] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:24.804336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deff6e2-d4e4-4d30-acb2-2426bdfe797a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:24.825011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:24.868869 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 803/1608] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:24.869453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deff6e2-d4e4-4d30-acb2-2426bdfe797a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:24.869801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f314eaa-4bbf-4488-a38d-c56b8ed0caca None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:24.929912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd14fba-540b-4602-a81c-b100485af3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:24.930526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd14fba-540b-4602-a81c-b100485af3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.930805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd14fba-540b-4602-a81c-b100485af3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.931076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd14fba-540b-4602-a81c-b100485af3b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.931734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd14fba-540b-4602-a81c-b100485af3b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:24.933679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd14fba-540b-4602-a81c-b100485af3b6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:24.937396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f314eaa-4bbf-4488-a38d-c56b8ed0caca None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:24.942180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f55794-408b-4198-845d-f7c138971ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:24.943458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f55794-408b-4198-845d-f7c138971ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.943745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f55794-408b-4198-845d-f7c138971ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.944023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f55794-408b-4198-845d-f7c138971ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.944703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f55794-408b-4198-845d-f7c138971ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:24.946325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f55794-408b-4198-845d-f7c138971ca5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:24.956646 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 804/1609] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:24.957422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f55794-408b-4198-845d-f7c138971ca5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:24.968024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f55794-408b-4198-845d-f7c138971ca5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:24.972736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014e500-75e6-486c-9f95-fcac343a3e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:24.973870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014e500-75e6-486c-9f95-fcac343a3e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:24.974484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014e500-75e6-486c-9f95-fcac343a3e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:24.974596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014e500-75e6-486c-9f95-fcac343a3e01 admin admin] PATH_INFO: `/v3/projects/ba664abd2b724fa1b4f5c4e549f707b9/users/f939d2a5ea444277afe426530ef158b2/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:24.990176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014e500-75e6-486c-9f95-fcac343a3e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba664abd2b724fa1b4f5c4e549f707b9, user_id=f939d2a5ea444277afe426530ef158b2, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:24.992674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014e500-75e6-486c-9f95-fcac343a3e01 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:25.038900 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 806/1610] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:24 2022] POST /identity/v3/projects => generated 389 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:25.040395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2a236-bc33-477e-a89c-5b45edc51717 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:25.040681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2a236-bc33-477e-a89c-5b45edc51717 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:25.040954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2a236-bc33-477e-a89c-5b45edc51717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:25.068185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-10c2a236-bc33-477e-a89c-5b45edc51717 None None] MFA Rules not processed for user `41e90ddefaa54150a673d201162a44e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:25.069374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-10c2a236-bc33-477e-a89c-5b45edc51717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:25.121971 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 805/1611] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:24 2022] PUT /identity/v3/projects/ba664abd2b724fa1b4f5c4e549f707b9/users/f939d2a5ea444277afe426530ef158b2/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:25.123501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b4e06-0eba-4ccc-95d6-38d8d5df8107 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:25.123974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b4e06-0eba-4ccc-95d6-38d8d5df8107 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:25.124445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b4e06-0eba-4ccc-95d6-38d8d5df8107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:25.134224 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 807/1612] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:25.136698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8f878-6069-419a-b136-bb3ba291d7b0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:25.136698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8f878-6069-419a-b136-bb3ba291d7b0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:25.136698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8f878-6069-419a-b136-bb3ba291d7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:25.156653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1f5b4e06-0eba-4ccc-95d6-38d8d5df8107 None None] MFA Rules not processed for user `9da73530cb834803b849b0e97f467e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:25.158087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1f5b4e06-0eba-4ccc-95d6-38d8d5df8107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:25.167859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8bc8f878-6069-419a-b136-bb3ba291d7b0 None None] MFA Rules not processed for user `c6e3a429567442c8b4722611b9c3873f`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:25.169115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8bc8f878-6069-419a-b136-bb3ba291d7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:25.178920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:25.203816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:25.229436 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 806/1613] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:25.230224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b4e06-0eba-4ccc-95d6-38d8d5df8107 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:25.244858 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 808/1614] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:25.244858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8f878-6069-419a-b136-bb3ba291d7b0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:25.294065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b4e06-0eba-4ccc-95d6-38d8d5df8107 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:25.298680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12e9ad-ac8d-486e-a757-8bc05d76f8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:25.299331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12e9ad-ac8d-486e-a757-8bc05d76f8be admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:25.299592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12e9ad-ac8d-486e-a757-8bc05d76f8be admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:25.299858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12e9ad-ac8d-486e-a757-8bc05d76f8be admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:25.300521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12e9ad-ac8d-486e-a757-8bc05d76f8be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:25.302551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12e9ad-ac8d-486e-a757-8bc05d76f8be admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:25.309060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8f878-6069-419a-b136-bb3ba291d7b0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:25.313720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de180e-7814-4c55-8ada-4745b85a1cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:25.314363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de180e-7814-4c55-8ada-4745b85a1cae admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:25.314642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de180e-7814-4c55-8ada-4745b85a1cae admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:25.314916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de180e-7814-4c55-8ada-4745b85a1cae admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:25.315535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de180e-7814-4c55-8ada-4745b85a1cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:25.318102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de180e-7814-4c55-8ada-4745b85a1cae admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:25.471861 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 807/1615] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:25 2022] POST /identity/v3/projects => generated 371 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:25.472714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12e9ad-ac8d-486e-a757-8bc05d76f8be admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:25.512481 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 809/1616] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:25 2022] POST /identity/v3/projects => generated 393 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:25.513794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de180e-7814-4c55-8ada-4745b85a1cae admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:25.540897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12e9ad-ac8d-486e-a757-8bc05d76f8be admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:25.596836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:25.596959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de180e-7814-4c55-8ada-4745b85a1cae admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:25.602225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ebb4e-399a-4c40-bcc4-8445a7b79d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:25.602837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ebb4e-399a-4c40-bcc4-8445a7b79d00 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:25.603108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ebb4e-399a-4c40-bcc4-8445a7b79d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:25.603374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ebb4e-399a-4c40-bcc4-8445a7b79d00 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:25.604063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ebb4e-399a-4c40-bcc4-8445a7b79d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:25.604356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723c119-99ea-4233-9b04-1df48524f492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:25.605085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723c119-99ea-4233-9b04-1df48524f492 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:25.605437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723c119-99ea-4233-9b04-1df48524f492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:25.605780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723c119-99ea-4233-9b04-1df48524f492 admin admin] PATH_INFO: `/v3/projects/a748fb909db84586a68a8e013258931f/users/bb6a9fc1e55e48ba970953739d1a9918/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:25.606040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ebb4e-399a-4c40-bcc4-8445a7b79d00 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:25.624801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723c119-99ea-4233-9b04-1df48524f492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a748fb909db84586a68a8e013258931f, user_id=bb6a9fc1e55e48ba970953739d1a9918, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:25.627542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723c119-99ea-4233-9b04-1df48524f492 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:25.699748 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 810/1617] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:25 2022] POST /identity/v3/users => generated 301 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:25.700945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ebb4e-399a-4c40-bcc4-8445a7b79d00 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:25.711061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ebb4e-399a-4c40-bcc4-8445a7b79d00 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:25.715767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621eccad-34c7-49e3-9827-cb30676139e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:25.716422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eccad-34c7-49e3-9827-cb30676139e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:25.716706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eccad-34c7-49e3-9827-cb30676139e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:25.716976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eccad-34c7-49e3-9827-cb30676139e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:25.717882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621eccad-34c7-49e3-9827-cb30676139e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:25.719647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621eccad-34c7-49e3-9827-cb30676139e1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:25.730086 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 811/1618] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:25.730830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621eccad-34c7-49e3-9827-cb30676139e1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:25.740559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621eccad-34c7-49e3-9827-cb30676139e1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:25.745414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd33b05-f9d6-4e48-9710-d3eb61b1fdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:25.746030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd33b05-f9d6-4e48-9710-d3eb61b1fdc1 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:25.746316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd33b05-f9d6-4e48-9710-d3eb61b1fdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:25.746591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd33b05-f9d6-4e48-9710-d3eb61b1fdc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:25.747236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd33b05-f9d6-4e48-9710-d3eb61b1fdc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:25.749228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd33b05-f9d6-4e48-9710-d3eb61b1fdc1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:25.763525 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 808/1619] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:25 2022] PUT /identity/v3/projects/a748fb909db84586a68a8e013258931f/users/bb6a9fc1e55e48ba970953739d1a9918/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:25.767988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723c119-99ea-4233-9b04-1df48524f492 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:25.835974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723c119-99ea-4233-9b04-1df48524f492 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:25.840577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096b4c4-1bce-4f64-9f2c-4d9c4092aff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:25.841179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096b4c4-1bce-4f64-9f2c-4d9c4092aff1 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:25.841456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096b4c4-1bce-4f64-9f2c-4d9c4092aff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:25.841728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096b4c4-1bce-4f64-9f2c-4d9c4092aff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:25.842350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096b4c4-1bce-4f64-9f2c-4d9c4092aff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:25.844288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096b4c4-1bce-4f64-9f2c-4d9c4092aff1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:25.916835 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 812/1620] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:25 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:25.917787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd33b05-f9d6-4e48-9710-d3eb61b1fdc1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:25.930119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:25.940593 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 809/1621] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:25 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:25.941419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096b4c4-1bce-4f64-9f2c-4d9c4092aff1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:25.981932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd33b05-f9d6-4e48-9710-d3eb61b1fdc1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:26.010936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096b4c4-1bce-4f64-9f2c-4d9c4092aff1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:26.015894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee5219-7cc7-4f19-a44d-864d8c06424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:26.016532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee5219-7cc7-4f19-a44d-864d8c06424b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.017314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee5219-7cc7-4f19-a44d-864d8c06424b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.017437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee5219-7cc7-4f19-a44d-864d8c06424b admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.018564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee5219-7cc7-4f19-a44d-864d8c06424b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:26.021154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee5219-7cc7-4f19-a44d-864d8c06424b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:26.040396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830acec-5a0d-4631-b79d-650efb54daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:26.040999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830acec-5a0d-4631-b79d-650efb54daaa admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.041275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830acec-5a0d-4631-b79d-650efb54daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.041542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830acec-5a0d-4631-b79d-650efb54daaa admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.042162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830acec-5a0d-4631-b79d-650efb54daaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:26.044038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830acec-5a0d-4631-b79d-650efb54daaa admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:26.134161 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 810/1622] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:25 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:26.135108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee5219-7cc7-4f19-a44d-864d8c06424b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:26.145251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee5219-7cc7-4f19-a44d-864d8c06424b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:26.150111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0da14-3f38-43e7-a172-e9c15d883f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:26.150692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0da14-3f38-43e7-a172-e9c15d883f36 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.150969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0da14-3f38-43e7-a172-e9c15d883f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.151239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0da14-3f38-43e7-a172-e9c15d883f36 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.151857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0da14-3f38-43e7-a172-e9c15d883f36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:26.153835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0da14-3f38-43e7-a172-e9c15d883f36 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:26.175555 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 813/1623] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:25 2022] POST /identity/v3/projects => generated 383 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:26.176473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830acec-5a0d-4631-b79d-650efb54daaa admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:26.239999 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 811/1624] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:26 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:26.239999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0da14-3f38-43e7-a172-e9c15d883f36 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:26.240266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830acec-5a0d-4631-b79d-650efb54daaa admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:26.244156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3f1a7-2ee7-46db-b8b8-4c6579a5f879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:26.244803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3f1a7-2ee7-46db-b8b8-4c6579a5f879 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.245089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3f1a7-2ee7-46db-b8b8-4c6579a5f879 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.245361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3f1a7-2ee7-46db-b8b8-4c6579a5f879 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.245999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3f1a7-2ee7-46db-b8b8-4c6579a5f879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:26.247639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3f1a7-2ee7-46db-b8b8-4c6579a5f879 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:26.250390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0da14-3f38-43e7-a172-e9c15d883f36 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:26.255950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e3a7d-f442-4f02-ad28-6cf772129e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:26.256768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e3a7d-f442-4f02-ad28-6cf772129e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.257049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e3a7d-f442-4f02-ad28-6cf772129e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.257330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e3a7d-f442-4f02-ad28-6cf772129e9b admin admin] PATH_INFO: `/v3/projects/ba664abd2b724fa1b4f5c4e549f707b9/users/f939d2a5ea444277afe426530ef158b2/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.259223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e3a7d-f442-4f02-ad28-6cf772129e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba664abd2b724fa1b4f5c4e549f707b9, user_id=f939d2a5ea444277afe426530ef158b2, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:26.259336 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 814/1625] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:26.260106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3f1a7-2ee7-46db-b8b8-4c6579a5f879 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:26.262023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e3a7d-f442-4f02-ad28-6cf772129e9b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:26.271177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3f1a7-2ee7-46db-b8b8-4c6579a5f879 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:26.274334 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 812/1626] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:26 2022] PUT /identity/v3/projects/ba664abd2b724fa1b4f5c4e549f707b9/users/f939d2a5ea444277afe426530ef158b2/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:26.275387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e3a7d-f442-4f02-ad28-6cf772129e9b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:26.303166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:26.310720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:26.328737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0edcde-f552-49b4-ad4e-fe59b7b422ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:26.329347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0edcde-f552-49b4-ad4e-fe59b7b422ea admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.329659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0edcde-f552-49b4-ad4e-fe59b7b422ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.329932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0edcde-f552-49b4-ad4e-fe59b7b422ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.330573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0edcde-f552-49b4-ad4e-fe59b7b422ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:26.332220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0edcde-f552-49b4-ad4e-fe59b7b422ea admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:26.341255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e3a7d-f442-4f02-ad28-6cf772129e9b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:26.342470 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 815/1627] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:26.343474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0edcde-f552-49b4-ad4e-fe59b7b422ea admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:26.347141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e106631-33cf-4b1f-a91b-a03c60271f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:26.347803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e106631-33cf-4b1f-a91b-a03c60271f2d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.349538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e106631-33cf-4b1f-a91b-a03c60271f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.349538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e106631-33cf-4b1f-a91b-a03c60271f2d admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.349771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e106631-33cf-4b1f-a91b-a03c60271f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:26.351555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e106631-33cf-4b1f-a91b-a03c60271f2d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:26.354880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0edcde-f552-49b4-ad4e-fe59b7b422ea admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:26.359450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d4f14-54de-48a7-9d91-c3d8e808ff26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:26.360066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d4f14-54de-48a7-9d91-c3d8e808ff26 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.360657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d4f14-54de-48a7-9d91-c3d8e808ff26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.360657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d4f14-54de-48a7-9d91-c3d8e808ff26 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.361251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d4f14-54de-48a7-9d91-c3d8e808ff26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:26.363139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d4f14-54de-48a7-9d91-c3d8e808ff26 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:26.462629 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 813/1628] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:26 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:26.463198 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 816/1629] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:26 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:26.463319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e106631-33cf-4b1f-a91b-a03c60271f2d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:26.463394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d4f14-54de-48a7-9d91-c3d8e808ff26 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:26.470775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e106631-33cf-4b1f-a91b-a03c60271f2d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:26.474855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d4f14-54de-48a7-9d91-c3d8e808ff26 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:26.476297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51269ce9-05ae-4f91-8887-52a8aa6f8eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:26.476899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51269ce9-05ae-4f91-8887-52a8aa6f8eed admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.477177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51269ce9-05ae-4f91-8887-52a8aa6f8eed admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.477451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51269ce9-05ae-4f91-8887-52a8aa6f8eed admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.478103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51269ce9-05ae-4f91-8887-52a8aa6f8eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:26.479596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bde1f-e0b7-4e46-8b1d-bda06755e2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:26.479725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51269ce9-05ae-4f91-8887-52a8aa6f8eed admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:26.480384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bde1f-e0b7-4e46-8b1d-bda06755e2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.480732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bde1f-e0b7-4e46-8b1d-bda06755e2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.481071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bde1f-e0b7-4e46-8b1d-bda06755e2a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.482111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bde1f-e0b7-4e46-8b1d-bda06755e2a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:26.483705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bde1f-e0b7-4e46-8b1d-bda06755e2a1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:26.495292 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 814/1630] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:26.495292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51269ce9-05ae-4f91-8887-52a8aa6f8eed admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:26.500774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51269ce9-05ae-4f91-8887-52a8aa6f8eed admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:26.505366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c3120-b8b0-4d74-b092-c1e136eb9f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:26.505950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c3120-b8b0-4d74-b092-c1e136eb9f6a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.506231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c3120-b8b0-4d74-b092-c1e136eb9f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.506506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c3120-b8b0-4d74-b092-c1e136eb9f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.507132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c3120-b8b0-4d74-b092-c1e136eb9f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:26.508755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c3120-b8b0-4d74-b092-c1e136eb9f6a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:26.519137 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 815/1631] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:26.519910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c3120-b8b0-4d74-b092-c1e136eb9f6a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:26.530804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c3120-b8b0-4d74-b092-c1e136eb9f6a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:26.535270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b728d70-a41a-41e0-b316-6f4f3f94458f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:26.536666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b728d70-a41a-41e0-b316-6f4f3f94458f admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.536932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b728d70-a41a-41e0-b316-6f4f3f94458f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.537202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b728d70-a41a-41e0-b316-6f4f3f94458f admin admin] PATH_INFO: `/v3/projects/05ffa52411954891bff423a45852eed0/users/f5eba8a8f8a14ffa9131e612cb76a98e/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.551663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b728d70-a41a-41e0-b316-6f4f3f94458f admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ffa52411954891bff423a45852eed0, user_id=f5eba8a8f8a14ffa9131e612cb76a98e, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:26.554356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b728d70-a41a-41e0-b316-6f4f3f94458f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:26.607504 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 817/1632] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:26 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:26.609040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c66fa-899c-4eba-a476-d4e44239a8eb None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.609355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c66fa-899c-4eba-a476-d4e44239a8eb None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.609675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c66fa-899c-4eba-a476-d4e44239a8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.638904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-735c66fa-899c-4eba-a476-d4e44239a8eb None None] MFA Rules not processed for user `f939d2a5ea444277afe426530ef158b2`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:26.640181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-735c66fa-899c-4eba-a476-d4e44239a8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:26.642803 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 816/1633] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:26 2022] PUT /identity/v3/projects/05ffa52411954891bff423a45852eed0/users/f5eba8a8f8a14ffa9131e612cb76a98e/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:26.643664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b728d70-a41a-41e0-b316-6f4f3f94458f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:26.709041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b728d70-a41a-41e0-b316-6f4f3f94458f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:26.711973 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 818/1634] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:26 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:26.712853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c66fa-899c-4eba-a476-d4e44239a8eb None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:26.713819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23f8d1-74d7-4da6-b589-aa05d141eca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:26.714504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23f8d1-74d7-4da6-b589-aa05d141eca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.714784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23f8d1-74d7-4da6-b589-aa05d141eca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.715054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23f8d1-74d7-4da6-b589-aa05d141eca2 admin admin] PATH_INFO: `/v3/projects/a748fb909db84586a68a8e013258931f/users/bb6a9fc1e55e48ba970953739d1a9918/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.717111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23f8d1-74d7-4da6-b589-aa05d141eca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a748fb909db84586a68a8e013258931f, user_id=bb6a9fc1e55e48ba970953739d1a9918, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:26.720187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23f8d1-74d7-4da6-b589-aa05d141eca2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:26.727874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c66fa-899c-4eba-a476-d4e44239a8eb None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:26.737291 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 817/1635] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:26 2022] PUT /identity/v3/projects/a748fb909db84586a68a8e013258931f/users/bb6a9fc1e55e48ba970953739d1a9918/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:26.741580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23f8d1-74d7-4da6-b589-aa05d141eca2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:26.798235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd909cd-e6f8-4cf4-8999-c16034cc0271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:26.798763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd909cd-e6f8-4cf4-8999-c16034cc0271 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.799044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd909cd-e6f8-4cf4-8999-c16034cc0271 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.799316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd909cd-e6f8-4cf4-8999-c16034cc0271 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.799957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd909cd-e6f8-4cf4-8999-c16034cc0271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:26.801601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd909cd-e6f8-4cf4-8999-c16034cc0271 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:26.810568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23f8d1-74d7-4da6-b589-aa05d141eca2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:26.812477 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 819/1636] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:26.813352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd909cd-e6f8-4cf4-8999-c16034cc0271 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:26.818910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51727987-d4ac-4cb0-905d-0d10ee766bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:26.819517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51727987-d4ac-4cb0-905d-0d10ee766bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.819816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51727987-d4ac-4cb0-905d-0d10ee766bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.820092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51727987-d4ac-4cb0-905d-0d10ee766bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.820885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51727987-d4ac-4cb0-905d-0d10ee766bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:26.822523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51727987-d4ac-4cb0-905d-0d10ee766bd4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:26.823506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd909cd-e6f8-4cf4-8999-c16034cc0271 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:26.823890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:26.828096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da654a75-fe99-4db5-8424-0275ab76877d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:26.828864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da654a75-fe99-4db5-8424-0275ab76877d admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.829148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da654a75-fe99-4db5-8424-0275ab76877d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.829419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da654a75-fe99-4db5-8424-0275ab76877d admin admin] PATH_INFO: `/v3/projects/d280b9d5e8114413bc7097042208b136/users/7259768b6da04017807081c6d51a6f92/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.833866 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 818/1637] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:26.834703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51727987-d4ac-4cb0-905d-0d10ee766bd4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:26.845038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da654a75-fe99-4db5-8424-0275ab76877d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d280b9d5e8114413bc7097042208b136, user_id=7259768b6da04017807081c6d51a6f92, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:26.845224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51727987-d4ac-4cb0-905d-0d10ee766bd4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:26.849226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da654a75-fe99-4db5-8424-0275ab76877d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:26.850500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1ab17-c4ae-4702-86ff-900b62fba29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:26.851300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1ab17-c4ae-4702-86ff-900b62fba29e admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:26.851578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1ab17-c4ae-4702-86ff-900b62fba29e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:26.851848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1ab17-c4ae-4702-86ff-900b62fba29e admin admin] PATH_INFO: `/v3/projects/0908b27b2b9246959efad49212610c3e/users/6aeaaab0b2894b24a2e1b3506e081bca/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:26.867952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1ab17-c4ae-4702-86ff-900b62fba29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0908b27b2b9246959efad49212610c3e, user_id=6aeaaab0b2894b24a2e1b3506e081bca, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:26.870681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1ab17-c4ae-4702-86ff-900b62fba29e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:26.939380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:26.945702 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 820/1638] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:26 2022] PUT /identity/v3/projects/d280b9d5e8114413bc7097042208b136/users/7259768b6da04017807081c6d51a6f92/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:26.946502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da654a75-fe99-4db5-8424-0275ab76877d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:27.008011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da654a75-fe99-4db5-8424-0275ab76877d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:27.012621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bb35e-1170-4579-a0b0-941c1ebae028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:27.013224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bb35e-1170-4579-a0b0-941c1ebae028 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.013520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bb35e-1170-4579-a0b0-941c1ebae028 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.013799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bb35e-1170-4579-a0b0-941c1ebae028 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.014433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bb35e-1170-4579-a0b0-941c1ebae028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:27.016010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bb35e-1170-4579-a0b0-941c1ebae028 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:27.019227 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 819/1639] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:26 2022] PUT /identity/v3/projects/0908b27b2b9246959efad49212610c3e/users/6aeaaab0b2894b24a2e1b3506e081bca/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:27.020233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1ab17-c4ae-4702-86ff-900b62fba29e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:27.027213 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 821/1640] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:27.030389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef344e1-882a-4cf3-8d85-7f4ad6f75c51 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.030389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef344e1-882a-4cf3-8d85-7f4ad6f75c51 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.030389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef344e1-882a-4cf3-8d85-7f4ad6f75c51 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.032412 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 822/1641] 10.222.0.76 () {54 vars in 962 bytes} [Sat Aug 27 04:38:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:27.033652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef155f9-98a0-4bd8-a938-2ad681965962 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.033951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef155f9-98a0-4bd8-a938-2ad681965962 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.034563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef155f9-98a0-4bd8-a938-2ad681965962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.062032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8ef155f9-98a0-4bd8-a938-2ad681965962 None None] MFA Rules not processed for user `bb6a9fc1e55e48ba970953739d1a9918`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:27.063153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8ef155f9-98a0-4bd8-a938-2ad681965962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:27.086030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1ab17-c4ae-4702-86ff-900b62fba29e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:27.091005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23f8e2-1e8b-49cd-9cc8-fcdffe7fd740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:27.091799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23f8e2-1e8b-49cd-9cc8-fcdffe7fd740 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.092233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23f8e2-1e8b-49cd-9cc8-fcdffe7fd740 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.092509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23f8e2-1e8b-49cd-9cc8-fcdffe7fd740 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.093148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23f8e2-1e8b-49cd-9cc8-fcdffe7fd740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:27.094752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23f8e2-1e8b-49cd-9cc8-fcdffe7fd740 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:27.108338 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 820/1642] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:27.109404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23f8e2-1e8b-49cd-9cc8-fcdffe7fd740 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:27.119158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23f8e2-1e8b-49cd-9cc8-fcdffe7fd740 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:27.123721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598355d-a0c0-4f79-b79a-2b68b07324e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:27.124481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598355d-a0c0-4f79-b79a-2b68b07324e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.124758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598355d-a0c0-4f79-b79a-2b68b07324e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.125027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598355d-a0c0-4f79-b79a-2b68b07324e8 admin admin] PATH_INFO: `/v3/projects/e3257ae112444765a396e3ebab7380a1/users/c14523f4fc704828bb6b3626c72fb30a/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.135019 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 823/1643] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:27.136564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef155f9-98a0-4bd8-a938-2ad681965962 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:27.142269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598355d-a0c0-4f79-b79a-2b68b07324e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3257ae112444765a396e3ebab7380a1, user_id=c14523f4fc704828bb6b3626c72fb30a, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:27.145192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598355d-a0c0-4f79-b79a-2b68b07324e8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:27.148905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef155f9-98a0-4bd8-a938-2ad681965962 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:27.153511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c0fa5-d1b0-40bb-aa6a-1e1a985121ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:27.154166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c0fa5-d1b0-40bb-aa6a-1e1a985121ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.154441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c0fa5-d1b0-40bb-aa6a-1e1a985121ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.154709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c0fa5-d1b0-40bb-aa6a-1e1a985121ea admin admin] PATH_INFO: `/v3/projects/4dce039e9b1d49d6bee258b212c635cc/users/a2e39713402a42b4bd0f88c499ef9d0d/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.170499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c0fa5-d1b0-40bb-aa6a-1e1a985121ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dce039e9b1d49d6bee258b212c635cc, user_id=a2e39713402a42b4bd0f88c499ef9d0d, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:27.173744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c0fa5-d1b0-40bb-aa6a-1e1a985121ea admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:27.264507 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 821/1644] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:27 2022] PUT /identity/v3/projects/e3257ae112444765a396e3ebab7380a1/users/c14523f4fc704828bb6b3626c72fb30a/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:27.265342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598355d-a0c0-4f79-b79a-2b68b07324e8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:27.299239 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 824/1645] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:27 2022] PUT /identity/v3/projects/4dce039e9b1d49d6bee258b212c635cc/users/a2e39713402a42b4bd0f88c499ef9d0d/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:27.300080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c0fa5-d1b0-40bb-aa6a-1e1a985121ea admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:27.332394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598355d-a0c0-4f79-b79a-2b68b07324e8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:27.367810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c0fa5-d1b0-40bb-aa6a-1e1a985121ea admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:27.372513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2b6a9-dc1b-43c0-a9ba-018157f50e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:27.373123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2b6a9-dc1b-43c0-a9ba-018157f50e47 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.373401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2b6a9-dc1b-43c0-a9ba-018157f50e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.373918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2b6a9-dc1b-43c0-a9ba-018157f50e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.374379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2b6a9-dc1b-43c0-a9ba-018157f50e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:27.375965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2b6a9-dc1b-43c0-a9ba-018157f50e47 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:27.382161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:27.387177 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 825/1646] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:27.390333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2b6a9-dc1b-43c0-a9ba-018157f50e47 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:27.395008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b7c5e-0991-4fcb-a426-cc5d714e53ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:27.395700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b7c5e-0991-4fcb-a426-cc5d714e53ba admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.396002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b7c5e-0991-4fcb-a426-cc5d714e53ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.396267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b7c5e-0991-4fcb-a426-cc5d714e53ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.396894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b7c5e-0991-4fcb-a426-cc5d714e53ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:27.398512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b7c5e-0991-4fcb-a426-cc5d714e53ba admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:27.401804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2b6a9-dc1b-43c0-a9ba-018157f50e47 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:27.406733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ab732-dc90-4ef2-a44d-40c23247664a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:27.407377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ab732-dc90-4ef2-a44d-40c23247664a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.407658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ab732-dc90-4ef2-a44d-40c23247664a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.407932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ab732-dc90-4ef2-a44d-40c23247664a admin admin] PATH_INFO: `/v3/projects/7a8084423ead4b7f8269af329acaf6b8/users/226124b94984432c9664cac49f827b10/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.412126 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 822/1647] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:27.412126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b7f8-5187-44ea-af7b-ad3cff4072e8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.412126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b7f8-5187-44ea-af7b-ad3cff4072e8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.412126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b7f8-5187-44ea-af7b-ad3cff4072e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.422308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:27.430216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ab732-dc90-4ef2-a44d-40c23247664a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8084423ead4b7f8269af329acaf6b8, user_id=226124b94984432c9664cac49f827b10, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:27.432923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ab732-dc90-4ef2-a44d-40c23247664a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:27.450534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-41e4b7f8-5187-44ea-af7b-ad3cff4072e8 None None] MFA Rules not processed for user `0e5ddcf00a184aa0ac0e7194f1c72425`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:27.452017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-41e4b7f8-5187-44ea-af7b-ad3cff4072e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:27.518497 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 823/1648] 10.222.0.76 () {58 vars in 1059 bytes} [Sat Aug 27 04:38:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:27.519397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4b7f8-5187-44ea-af7b-ad3cff4072e8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:27.524927 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 826/1649] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:27 2022] PUT /identity/v3/projects/7a8084423ead4b7f8269af329acaf6b8/users/226124b94984432c9664cac49f827b10/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:27.524927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ab732-dc90-4ef2-a44d-40c23247664a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:27.530275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4b7f8-5187-44ea-af7b-ad3cff4072e8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:27.586353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0768d81-bc14-4c1a-b027-cd7e107535a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:27.586935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0768d81-bc14-4c1a-b027-cd7e107535a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.587214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0768d81-bc14-4c1a-b027-cd7e107535a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.587490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0768d81-bc14-4c1a-b027-cd7e107535a0 admin admin] PATH_INFO: `/v3/projects/05ffa52411954891bff423a45852eed0/users/f5eba8a8f8a14ffa9131e612cb76a98e/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.589518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0768d81-bc14-4c1a-b027-cd7e107535a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ffa52411954891bff423a45852eed0, user_id=f5eba8a8f8a14ffa9131e612cb76a98e, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:27.590239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ab732-dc90-4ef2-a44d-40c23247664a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:27.592243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0768d81-bc14-4c1a-b027-cd7e107535a0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:27.595221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697ce6d-28ca-4a43-b7b8-4649d0e31a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:27.595902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697ce6d-28ca-4a43-b7b8-4649d0e31a5e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.596310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697ce6d-28ca-4a43-b7b8-4649d0e31a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.596586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697ce6d-28ca-4a43-b7b8-4649d0e31a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.597214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697ce6d-28ca-4a43-b7b8-4649d0e31a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:27.599208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697ce6d-28ca-4a43-b7b8-4649d0e31a5e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:27.603593 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 824/1650] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:27 2022] PUT /identity/v3/projects/05ffa52411954891bff423a45852eed0/users/f5eba8a8f8a14ffa9131e612cb76a98e/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:27.604305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0768d81-bc14-4c1a-b027-cd7e107535a0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:27.670507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0768d81-bc14-4c1a-b027-cd7e107535a0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:27.675078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc56a3-8333-4387-92cc-f8c368acf45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:27.675678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc56a3-8333-4387-92cc-f8c368acf45f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.675958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc56a3-8333-4387-92cc-f8c368acf45f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.676262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc56a3-8333-4387-92cc-f8c368acf45f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.677650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc56a3-8333-4387-92cc-f8c368acf45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:27.679372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc56a3-8333-4387-92cc-f8c368acf45f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:27.680658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:27.689572 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 825/1651] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:27.690354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc56a3-8333-4387-92cc-f8c368acf45f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:27.699938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc56a3-8333-4387-92cc-f8c368acf45f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:27.704535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c3643-6934-438e-8960-39b743922790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:27.705112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c3643-6934-438e-8960-39b743922790 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.705386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c3643-6934-438e-8960-39b743922790 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.705657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c3643-6934-438e-8960-39b743922790 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.706277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c3643-6934-438e-8960-39b743922790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:27.707979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c3643-6934-438e-8960-39b743922790 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:27.718293 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 826/1652] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:27.719038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c3643-6934-438e-8960-39b743922790 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:27.729460 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 827/1653] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:27 2022] POST /identity/v3/projects => generated 395 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:27.730574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697ce6d-28ca-4a43-b7b8-4649d0e31a5e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:27.730710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c3643-6934-438e-8960-39b743922790 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:27.792088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054387ee-689d-4688-9656-d74943f52d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:27.793089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054387ee-689d-4688-9656-d74943f52d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.793089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054387ee-689d-4688-9656-d74943f52d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.793614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054387ee-689d-4688-9656-d74943f52d05 admin admin] PATH_INFO: `/v3/projects/0908b27b2b9246959efad49212610c3e/users/6aeaaab0b2894b24a2e1b3506e081bca/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.795539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054387ee-689d-4688-9656-d74943f52d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0908b27b2b9246959efad49212610c3e, user_id=6aeaaab0b2894b24a2e1b3506e081bca, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:27.796393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697ce6d-28ca-4a43-b7b8-4649d0e31a5e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:27.798383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054387ee-689d-4688-9656-d74943f52d05 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:27.801183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5ff17-0ef6-4a0d-9f33-356687f3ec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:27.803017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5ff17-0ef6-4a0d-9f33-356687f3ec80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.803294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5ff17-0ef6-4a0d-9f33-356687f3ec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.803567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5ff17-0ef6-4a0d-9f33-356687f3ec80 admin admin] PATH_INFO: `/v3/projects/d280b9d5e8114413bc7097042208b136/users/7259768b6da04017807081c6d51a6f92/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.805514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5ff17-0ef6-4a0d-9f33-356687f3ec80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d280b9d5e8114413bc7097042208b136, user_id=7259768b6da04017807081c6d51a6f92, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:27.808140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5ff17-0ef6-4a0d-9f33-356687f3ec80 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:27.809796 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 827/1654] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:27 2022] PUT /identity/v3/projects/0908b27b2b9246959efad49212610c3e/users/6aeaaab0b2894b24a2e1b3506e081bca/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:27.810731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054387ee-689d-4688-9656-d74943f52d05 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:27.819234 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 828/1655] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:27 2022] PUT /identity/v3/projects/d280b9d5e8114413bc7097042208b136/users/7259768b6da04017807081c6d51a6f92/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:27.820030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5ff17-0ef6-4a0d-9f33-356687f3ec80 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:27.869912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:27.876077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054387ee-689d-4688-9656-d74943f52d05 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:27.891428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5ff17-0ef6-4a0d-9f33-356687f3ec80 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:27.897170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b22fb-e761-4ca6-84af-5a7d799052fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:27.897800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b22fb-e761-4ca6-84af-5a7d799052fe service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.898076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b22fb-e761-4ca6-84af-5a7d799052fe service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.898355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b22fb-e761-4ca6-84af-5a7d799052fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.935084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fbf55-5dbd-4f00-8dca-ba85a735606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:27.935701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fbf55-5dbd-4f00-8dca-ba85a735606a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.935978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fbf55-5dbd-4f00-8dca-ba85a735606a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.936270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fbf55-5dbd-4f00-8dca-ba85a735606a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.936907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fbf55-5dbd-4f00-8dca-ba85a735606a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:27.938565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fbf55-5dbd-4f00-8dca-ba85a735606a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:27.953041 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 828/1656] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:27.953041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142138ff-85cc-4de8-af60-13b4f52e7fca None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.953041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142138ff-85cc-4de8-af60-13b4f52e7fca None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.953041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142138ff-85cc-4de8-af60-13b4f52e7fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.960991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b22fb-e761-4ca6-84af-5a7d799052fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:27.962634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b22fb-e761-4ca6-84af-5a7d799052fe service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:27.973053 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 829/1657] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:27 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:27.973866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b22fb-e761-4ca6-84af-5a7d799052fe service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:27.981377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-142138ff-85cc-4de8-af60-13b4f52e7fca None None] MFA Rules not processed for user `f5eba8a8f8a14ffa9131e612cb76a98e`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:27.983027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-142138ff-85cc-4de8-af60-13b4f52e7fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:27.984413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b22fb-e761-4ca6-84af-5a7d799052fe service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:27.989705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea0b0f-e3c4-4a76-b521-53fc347ebf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:27.990452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea0b0f-e3c4-4a76-b521-53fc347ebf1a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:27.990740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea0b0f-e3c4-4a76-b521-53fc347ebf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:27.991011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea0b0f-e3c4-4a76-b521-53fc347ebf1a admin admin] PATH_INFO: `/v3/projects/e3257ae112444765a396e3ebab7380a1/users/c14523f4fc704828bb6b3626c72fb30a/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:27.992889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:27.993101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea0b0f-e3c4-4a76-b521-53fc347ebf1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3257ae112444765a396e3ebab7380a1, user_id=c14523f4fc704828bb6b3626c72fb30a, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:27.995989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea0b0f-e3c4-4a76-b521-53fc347ebf1a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:28.009136 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 830/1658] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:27 2022] PUT /identity/v3/projects/e3257ae112444765a396e3ebab7380a1/users/c14523f4fc704828bb6b3626c72fb30a/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:28.009694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea0b0f-e3c4-4a76-b521-53fc347ebf1a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:28.075066 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 829/1659] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:27 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:28.075066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142138ff-85cc-4de8-af60-13b4f52e7fca None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:28.081358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142138ff-85cc-4de8-af60-13b4f52e7fca None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:28.087199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2051803-9d26-4fd4-9fb0-d2b9637dbc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:28.093581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea0b0f-e3c4-4a76-b521-53fc347ebf1a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:28.093711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2051803-9d26-4fd4-9fb0-d2b9637dbc5a admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:28.093711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2051803-9d26-4fd4-9fb0-d2b9637dbc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:28.093711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2051803-9d26-4fd4-9fb0-d2b9637dbc5a admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:28.093711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2051803-9d26-4fd4-9fb0-d2b9637dbc5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:28.093711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2051803-9d26-4fd4-9fb0-d2b9637dbc5a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:28.094064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3666c-9b5f-44cc-99fe-f768349f894c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:28.094064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3666c-9b5f-44cc-99fe-f768349f894c admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:28.094064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3666c-9b5f-44cc-99fe-f768349f894c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:28.094064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3666c-9b5f-44cc-99fe-f768349f894c admin admin] PATH_INFO: `/v3/projects/4dce039e9b1d49d6bee258b212c635cc/users/a2e39713402a42b4bd0f88c499ef9d0d/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:28.095668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3666c-9b5f-44cc-99fe-f768349f894c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dce039e9b1d49d6bee258b212c635cc, user_id=a2e39713402a42b4bd0f88c499ef9d0d, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:28.098526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3666c-9b5f-44cc-99fe-f768349f894c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:28.111166 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 831/1660] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:28 2022] PUT /identity/v3/projects/4dce039e9b1d49d6bee258b212c635cc/users/a2e39713402a42b4bd0f88c499ef9d0d/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:28.113040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46943654-821d-400b-957a-8ce10b9c3298 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:28.113359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46943654-821d-400b-957a-8ce10b9c3298 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:28.113630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46943654-821d-400b-957a-8ce10b9c3298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:28.143326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-46943654-821d-400b-957a-8ce10b9c3298 None None] MFA Rules not processed for user `6aeaaab0b2894b24a2e1b3506e081bca`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:28.144557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-46943654-821d-400b-957a-8ce10b9c3298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:28.192947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:28.214424 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 832/1661] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:28.215666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d24e2-105f-4513-8593-b8802342472c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:28.215949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d24e2-105f-4513-8593-b8802342472c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:28.216483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d24e2-105f-4513-8593-b8802342472c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:28.237240 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 830/1662] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:28 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:28.238085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2051803-9d26-4fd4-9fb0-d2b9637dbc5a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:28.249024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2051803-9d26-4fd4-9fb0-d2b9637dbc5a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:28.249502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3d7d24e2-105f-4513-8593-b8802342472c None None] MFA Rules not processed for user `7259768b6da04017807081c6d51a6f92`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:28.250988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3d7d24e2-105f-4513-8593-b8802342472c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:28.309007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77262f-6922-4eef-bc66-4b43573692a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:28.309878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77262f-6922-4eef-bc66-4b43573692a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:28.310232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77262f-6922-4eef-bc66-4b43573692a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:28.310576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77262f-6922-4eef-bc66-4b43573692a4 admin admin] PATH_INFO: `/v3/projects/7a8084423ead4b7f8269af329acaf6b8/users/226124b94984432c9664cac49f827b10/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:28.312930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77262f-6922-4eef-bc66-4b43573692a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8084423ead4b7f8269af329acaf6b8, user_id=226124b94984432c9664cac49f827b10, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:28.316424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77262f-6922-4eef-bc66-4b43573692a4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:28.329122 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 831/1663] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:28 2022] PUT /identity/v3/projects/7a8084423ead4b7f8269af329acaf6b8/users/226124b94984432c9664cac49f827b10/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:28.330718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737eab6-8f1f-469b-bd74-4dc97caf9f5e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:28.337610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737eab6-8f1f-469b-bd74-4dc97caf9f5e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:28.337610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737eab6-8f1f-469b-bd74-4dc97caf9f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:28.349752 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 833/1664] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:28.351334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb4eba-1fd0-4f99-8e4f-05c9d8381ecd None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:28.351817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb4eba-1fd0-4f99-8e4f-05c9d8381ecd None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:28.352323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb4eba-1fd0-4f99-8e4f-05c9d8381ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:28.373997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-18cb4eba-1fd0-4f99-8e4f-05c9d8381ecd None None] MFA Rules not processed for user `897dedad921f400aa3206db5fd051231`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:28.374366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9737eab6-8f1f-469b-bd74-4dc97caf9f5e None None] MFA Rules not processed for user `c14523f4fc704828bb6b3626c72fb30a`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:28.375210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-18cb4eba-1fd0-4f99-8e4f-05c9d8381ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:28.375438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9737eab6-8f1f-469b-bd74-4dc97caf9f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:28.443165 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 834/1665] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:28.443165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c26830-f96b-4b34-9d41-824c6602ab60 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:28.443165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c26830-f96b-4b34-9d41-824c6602ab60 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:28.443165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c26830-f96b-4b34-9d41-824c6602ab60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:28.461269 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 832/1666] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:28.461269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737eab6-8f1f-469b-bd74-4dc97caf9f5e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:28.467728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:28.481488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c4c26830-f96b-4b34-9d41-824c6602ab60 None None] MFA Rules not processed for user `a2e39713402a42b4bd0f88c499ef9d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:28.483159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c4c26830-f96b-4b34-9d41-824c6602ab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:28.532894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737eab6-8f1f-469b-bd74-4dc97caf9f5e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:28.540960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354d139-4e0b-4678-86fd-8dbee988d20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:28.542073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354d139-4e0b-4678-86fd-8dbee988d20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:28.542470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354d139-4e0b-4678-86fd-8dbee988d20f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:28.542809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354d139-4e0b-4678-86fd-8dbee988d20f admin admin] PATH_INFO: `/v3/users/ea9350f95df244ebbc3fc26b313f82d2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:28.544300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354d139-4e0b-4678-86fd-8dbee988d20f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9350f95df244ebbc3fc26b313f82d2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:28.555703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354d139-4e0b-4678-86fd-8dbee988d20f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:28.570282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:28.574474 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 835/1667] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:28.575315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c26830-f96b-4b34-9d41-824c6602ab60 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:28.585454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c26830-f96b-4b34-9d41-824c6602ab60 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:28.589998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5702ee-00f3-4ede-acc6-543ec8a399d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:28.590614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5702ee-00f3-4ede-acc6-543ec8a399d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:28.590879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5702ee-00f3-4ede-acc6-543ec8a399d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:28.591152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5702ee-00f3-4ede-acc6-543ec8a399d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:28.591789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5702ee-00f3-4ede-acc6-543ec8a399d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:28.593487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5702ee-00f3-4ede-acc6-543ec8a399d9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:28.603848 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 836/1668] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:28.605033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d919ea-f0b9-47b2-b381-818239ee4b80 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:28.605318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d919ea-f0b9-47b2-b381-818239ee4b80 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:28.605593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d919ea-f0b9-47b2-b381-818239ee4b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:28.635496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-32d919ea-f0b9-47b2-b381-818239ee4b80 None None] MFA Rules not processed for user `226124b94984432c9664cac49f827b10`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:28.636761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-32d919ea-f0b9-47b2-b381-818239ee4b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:28.712573 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 837/1669] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:28.713465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d919ea-f0b9-47b2-b381-818239ee4b80 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:28.763980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4354d139-4e0b-4678-86fd-8dbee988d20f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9350f95df244ebbc3fc26b313f82d2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:28.785274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d919ea-f0b9-47b2-b381-818239ee4b80 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:28.791354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa605093-2ea4-4171-86a5-b88b926a2973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:28.791962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa605093-2ea4-4171-86a5-b88b926a2973 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:28.792270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa605093-2ea4-4171-86a5-b88b926a2973 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:28.792550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa605093-2ea4-4171-86a5-b88b926a2973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:28.835580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4354d139-4e0b-4678-86fd-8dbee988d20f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9350f95df244ebbc3fc26b313f82d2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:28.836279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4354d139-4e0b-4678-86fd-8dbee988d20f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9350f95df244ebbc3fc26b313f82d2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:28.844351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4354d139-4e0b-4678-86fd-8dbee988d20f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9350f95df244ebbc3fc26b313f82d2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:28.852116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa605093-2ea4-4171-86a5-b88b926a2973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:28.853745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa605093-2ea4-4171-86a5-b88b926a2973 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:28.857793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4354d139-4e0b-4678-86fd-8dbee988d20f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9350f95df244ebbc3fc26b313f82d2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:28.864377 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 833/1670] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:28 2022] DELETE /identity/v3/users/ea9350f95df244ebbc3fc26b313f82d2 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:28.865173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354d139-4e0b-4678-86fd-8dbee988d20f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:28.865660 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 838/1671] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:28.866572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4354d139-4e0b-4678-86fd-8dbee988d20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:28.866911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ac60b-25d9-4bfe-804b-75dd81c72f04 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:28.867199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ac60b-25d9-4bfe-804b-75dd81c72f04 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:28.867471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ac60b-25d9-4bfe-804b-75dd81c72f04 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:28.869075 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 839/1672] 10.222.0.76 () {54 vars in 962 bytes} [Sat Aug 27 04:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:28.874593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5fb1-aa57-4c9c-ba9b-b507992caa76 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:28.875069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5fb1-aa57-4c9c-ba9b-b507992caa76 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:28.875351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5fb1-aa57-4c9c-ba9b-b507992caa76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:28.891053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:28.899008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5acd5fb1-aa57-4c9c-ba9b-b507992caa76 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:28.900986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5acd5fb1-aa57-4c9c-ba9b-b507992caa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:28.947151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354d139-4e0b-4678-86fd-8dbee988d20f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:28.951978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684e804-5553-4a66-88a8-a54a15d1ce31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:28.952709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684e804-5553-4a66-88a8-a54a15d1ce31 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:28.952990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684e804-5553-4a66-88a8-a54a15d1ce31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:28.953261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684e804-5553-4a66-88a8-a54a15d1ce31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:28.953905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684e804-5553-4a66-88a8-a54a15d1ce31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:28.955510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684e804-5553-4a66-88a8-a54a15d1ce31 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:28.966240 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 834/1673] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:28.966240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4792d-a786-4d3a-968c-9669f164fb4c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:28.966240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4792d-a786-4d3a-968c-9669f164fb4c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:28.966240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4792d-a786-4d3a-968c-9669f164fb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:28.973328 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 840/1674] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:28.974273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5fb1-aa57-4c9c-ba9b-b507992caa76 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:28.975869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5acd5fb1-aa57-4c9c-ba9b-b507992caa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:28.994728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-fff4792d-a786-4d3a-968c-9669f164fb4c None None] MFA Rules not processed for user `0e5ddcf00a184aa0ac0e7194f1c72425`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:28.995957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fff4792d-a786-4d3a-968c-9669f164fb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:29.016342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:29.056282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5fb1-aa57-4c9c-ba9b-b507992caa76 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:29.061638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bf7f6-e257-4b69-9e48-6a57a0f2f185 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:29.062256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bf7f6-e257-4b69-9e48-6a57a0f2f185 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:29.062547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bf7f6-e257-4b69-9e48-6a57a0f2f185 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:29.062801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bf7f6-e257-4b69-9e48-6a57a0f2f185 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:29.064588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e80bf7f6-e257-4b69-9e48-6a57a0f2f185 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:29.065489 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 835/1675] 10.222.0.76 () {58 vars in 1059 bytes} [Sat Aug 27 04:38:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:29.066314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4792d-a786-4d3a-968c-9669f164fb4c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:29.077667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4792d-a786-4d3a-968c-9669f164fb4c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:29.082668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b54242-4914-4a84-9c14-d27ed558507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:29.083318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b54242-4914-4a84-9c14-d27ed558507b admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:29.083599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b54242-4914-4a84-9c14-d27ed558507b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:29.083874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b54242-4914-4a84-9c14-d27ed558507b admin admin] PATH_INFO: `/v3/projects/a077b614074d407c8b5b1053febfc109/users/61d5fcdacfb142e696bc86b0499d4e3e/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:29.100802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b54242-4914-4a84-9c14-d27ed558507b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a077b614074d407c8b5b1053febfc109, user_id=61d5fcdacfb142e696bc86b0499d4e3e, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:29.103694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b54242-4914-4a84-9c14-d27ed558507b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:29.133079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bf7f6-e257-4b69-9e48-6a57a0f2f185 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:29.139759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bf7f6-e257-4b69-9e48-6a57a0f2f185 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:29.145197 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 841/1676] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:29.146214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bf7f6-e257-4b69-9e48-6a57a0f2f185 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:29.147496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e80bf7f6-e257-4b69-9e48-6a57a0f2f185 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:29.193203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:29.206243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bf7f6-e257-4b69-9e48-6a57a0f2f185 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:29.219826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35950669-4b1c-441c-8846-c0d395c77fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:29.219826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35950669-4b1c-441c-8846-c0d395c77fbb service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:29.219826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35950669-4b1c-441c-8846-c0d395c77fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:29.219826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35950669-4b1c-441c-8846-c0d395c77fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:29.220265 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 836/1677] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:29 2022] PUT /identity/v3/projects/a077b614074d407c8b5b1053febfc109/users/61d5fcdacfb142e696bc86b0499d4e3e/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:29.220648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b54242-4914-4a84-9c14-d27ed558507b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:29.232085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35950669-4b1c-441c-8846-c0d395c77fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:29.233804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35950669-4b1c-441c-8846-c0d395c77fbb service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:29.244310 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 842/1678] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:29.245130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35950669-4b1c-441c-8846-c0d395c77fbb service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:29.258335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35950669-4b1c-441c-8846-c0d395c77fbb service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:29.298345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b54242-4914-4a84-9c14-d27ed558507b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:29.306107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1aa40-20ea-4103-b886-9ba1f45ca4a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:29.306728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1aa40-20ea-4103-b886-9ba1f45ca4a0 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:29.307006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1aa40-20ea-4103-b886-9ba1f45ca4a0 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:29.307283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1aa40-20ea-4103-b886-9ba1f45ca4a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:29.309142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7fe1aa40-20ea-4103-b886-9ba1f45ca4a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:29.333976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc1b7a-c38d-4ee9-b885-477de093897e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:29.335054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc1b7a-c38d-4ee9-b885-477de093897e service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:29.335054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc1b7a-c38d-4ee9-b885-477de093897e service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:29.335254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc1b7a-c38d-4ee9-b885-477de093897e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:29.337669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bdcc1b7a-c38d-4ee9-b885-477de093897e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:29.371049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1aa40-20ea-4103-b886-9ba1f45ca4a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:29.372685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1aa40-20ea-4103-b886-9ba1f45ca4a0 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:29.383339 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 837/1679] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:29.384631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599e9e1-e5d3-45f7-9cdb-14b03c612906 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:29.384949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599e9e1-e5d3-45f7-9cdb-14b03c612906 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:29.385291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599e9e1-e5d3-45f7-9cdb-14b03c612906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:29.404008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc1b7a-c38d-4ee9-b885-477de093897e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:29.405659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc1b7a-c38d-4ee9-b885-477de093897e service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:29.415211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c599e9e1-e5d3-45f7-9cdb-14b03c612906 None None] MFA Rules not processed for user `61d5fcdacfb142e696bc86b0499d4e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:29.416462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c599e9e1-e5d3-45f7-9cdb-14b03c612906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:29.424359 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 843/1680] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:29.438800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:29.445066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b611b1-ea5c-4dbb-a683-b9d28b02b487 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:29.445348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b611b1-ea5c-4dbb-a683-b9d28b02b487 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:29.445617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b611b1-ea5c-4dbb-a683-b9d28b02b487 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:29.447657 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 844/1681] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:38:29.453934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059b727-db31-4471-9a2d-44cef1f62f86 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:29.454217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059b727-db31-4471-9a2d-44cef1f62f86 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:29.454592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059b727-db31-4471-9a2d-44cef1f62f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:29.481824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b059b727-db31-4471-9a2d-44cef1f62f86 None None] MFA Rules not processed for user `0e5ddcf00a184aa0ac0e7194f1c72425`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:29.483181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b059b727-db31-4471-9a2d-44cef1f62f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:29.526159 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 845/1682] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:38:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:38:29.534829 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 838/1683] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:29 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:29.536818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059b727-db31-4471-9a2d-44cef1f62f86 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:29.538497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b059b727-db31-4471-9a2d-44cef1f62f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:29.626106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:29.628756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059b727-db31-4471-9a2d-44cef1f62f86 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:29.633220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a1bef-5b21-4fc5-8c08-a1f11eeb3133 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:29.633831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a1bef-5b21-4fc5-8c08-a1f11eeb3133 service glance] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:29.634105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a1bef-5b21-4fc5-8c08-a1f11eeb3133 service glance] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:29.634375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a1bef-5b21-4fc5-8c08-a1f11eeb3133 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:29.644831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a1bef-5b21-4fc5-8c08-a1f11eeb3133 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:29.646339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a1bef-5b21-4fc5-8c08-a1f11eeb3133 service glance] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:29.656770 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 846/1684] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:29.749282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599e9e1-e5d3-45f7-9cdb-14b03c612906 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:29.750722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c599e9e1-e5d3-45f7-9cdb-14b03c612906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:29.777302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203be5da-5662-48ed-a752-794d2935268e None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:29.777735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203be5da-5662-48ed-a752-794d2935268e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:29.778109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203be5da-5662-48ed-a752-794d2935268e None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:29.780450 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 847/1685] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:29.786849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deae4a4-3e88-4326-bc59-0da620d1eb4e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:29.787343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deae4a4-3e88-4326-bc59-0da620d1eb4e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:29.787621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deae4a4-3e88-4326-bc59-0da620d1eb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:29.811956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5deae4a4-3e88-4326-bc59-0da620d1eb4e None None] MFA Rules not processed for user `702086569a63418685711c4c134b1482`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:29.813448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5deae4a4-3e88-4326-bc59-0da620d1eb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:29.836550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599e9e1-e5d3-45f7-9cdb-14b03c612906 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:29.846778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a707b-bb99-400e-b025-69fada625012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:29.846778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a707b-bb99-400e-b025-69fada625012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:29.846778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a707b-bb99-400e-b025-69fada625012 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:29.846778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a707b-bb99-400e-b025-69fada625012 admin admin] PATH_INFO: `/v3/projects/3f0dcb8cd77c43d1b20a41ab22537369` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:29.849699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a707b-bb99-400e-b025-69fada625012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f0dcb8cd77c43d1b20a41ab22537369)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:29.850953 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-3b8a707b-bb99-400e-b025-69fada625012 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:38:29.850953 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:38:29.850953 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:38:29.852277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a707b-bb99-400e-b025-69fada625012 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:29.900987 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 848/1686] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:38:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:29.925065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deae4a4-3e88-4326-bc59-0da620d1eb4e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:29.927221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5deae4a4-3e88-4326-bc59-0da620d1eb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:29.941659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deae4a4-3e88-4326-bc59-0da620d1eb4e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:29.947903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0165ff2-481a-4161-be41-bffd4afc353a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:29.948577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0165ff2-481a-4161-be41-bffd4afc353a service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:29.948863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0165ff2-481a-4161-be41-bffd4afc353a service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:29.949138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0165ff2-481a-4161-be41-bffd4afc353a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:29.959412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0165ff2-481a-4161-be41-bffd4afc353a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:29.961161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0165ff2-481a-4161-be41-bffd4afc353a service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:29.972249 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 849/1687] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:38:29.987911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b8a707b-bb99-400e-b025-69fada625012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f0dcb8cd77c43d1b20a41ab22537369', 'request_id': 'req-3b8a707b-bb99-400e-b025-69fada625012'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:29.995504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b8a707b-bb99-400e-b025-69fada625012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f0dcb8cd77c43d1b20a41ab22537369', 'request_id': 'req-3b8a707b-bb99-400e-b025-69fada625012'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:30.011125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b8a707b-bb99-400e-b025-69fada625012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f0dcb8cd77c43d1b20a41ab22537369', 'request_id': 'req-3b8a707b-bb99-400e-b025-69fada625012'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:30.092504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b8a707b-bb99-400e-b025-69fada625012 admin admin] The token cache is being invalidate because project 3f0dcb8cd77c43d1b20a41ab22537369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:30.093136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b8a707b-bb99-400e-b025-69fada625012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:30.093641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b8a707b-bb99-400e-b025-69fada625012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:30.095371 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 839/1688] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:29 2022] DELETE /identity/v3/projects/3f0dcb8cd77c43d1b20a41ab22537369 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:30.103190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0165ff2-481a-4161-be41-bffd4afc353a service placement] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:30.111849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0165ff2-481a-4161-be41-bffd4afc353a service placement] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:30.171765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f6753-9996-420d-be65-8e5bdab17cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:30.172430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f6753-9996-420d-be65-8e5bdab17cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:30.172707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f6753-9996-420d-be65-8e5bdab17cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:30.172980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f6753-9996-420d-be65-8e5bdab17cc3 admin admin] PATH_INFO: `/v3/users/6aeaaab0b2894b24a2e1b3506e081bca` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:30.174087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f6753-9996-420d-be65-8e5bdab17cc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aeaaab0b2894b24a2e1b3506e081bca)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:30.175101 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-807f6753-9996-420d-be65-8e5bdab17cc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:38:30.175101 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:38:30.175101 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:38:30.176916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f6753-9996-420d-be65-8e5bdab17cc3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:30.198437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a707b-bb99-400e-b025-69fada625012 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:30.199907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3b8a707b-bb99-400e-b025-69fada625012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:30.251257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:30.276321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a707b-bb99-400e-b025-69fada625012 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:30.281837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e376e6f-ea44-4481-853c-06b8c7cae850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:30.282451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e376e6f-ea44-4481-853c-06b8c7cae850 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:30.282737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e376e6f-ea44-4481-853c-06b8c7cae850 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:30.283012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e376e6f-ea44-4481-853c-06b8c7cae850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:30.284826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2e376e6f-ea44-4481-853c-06b8c7cae850 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:30.390418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e376e6f-ea44-4481-853c-06b8c7cae850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:30.392025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e376e6f-ea44-4481-853c-06b8c7cae850 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:30.399211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-807f6753-9996-420d-be65-8e5bdab17cc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aeaaab0b2894b24a2e1b3506e081bca'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:30.400063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-807f6753-9996-420d-be65-8e5bdab17cc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aeaaab0b2894b24a2e1b3506e081bca'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:30.402557 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 840/1689] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:38:30.413711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e376e6f-ea44-4481-853c-06b8c7cae850 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:30.417214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2e376e6f-ea44-4481-853c-06b8c7cae850 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:30.431247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e376e6f-ea44-4481-853c-06b8c7cae850 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:30.436900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab30a8-a31e-408d-b1a4-e5a39f61778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:30.437800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab30a8-a31e-408d-b1a4-e5a39f61778b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:30.438086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab30a8-a31e-408d-b1a4-e5a39f61778b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:30.438364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab30a8-a31e-408d-b1a4-e5a39f61778b admin admin] PATH_INFO: `/v3/users/fbae0f44ca87484b8925f0bb9df28ac7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:30.442740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab30a8-a31e-408d-b1a4-e5a39f61778b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbae0f44ca87484b8925f0bb9df28ac7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:30.442740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab30a8-a31e-408d-b1a4-e5a39f61778b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:30.510701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-807f6753-9996-420d-be65-8e5bdab17cc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aeaaab0b2894b24a2e1b3506e081bca'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:30.511632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-807f6753-9996-420d-be65-8e5bdab17cc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aeaaab0b2894b24a2e1b3506e081bca'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:30.541116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-807f6753-9996-420d-be65-8e5bdab17cc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aeaaab0b2894b24a2e1b3506e081bca'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:30.547030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:30.561356 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 850/1690] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:30 2022] DELETE /identity/v3/users/6aeaaab0b2894b24a2e1b3506e081bca => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:30.565165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f6753-9996-420d-be65-8e5bdab17cc3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:30.566750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-807f6753-9996-420d-be65-8e5bdab17cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:30.648996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f6753-9996-420d-be65-8e5bdab17cc3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:30.654522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df276db6-f40b-43cf-8638-bc465d8d1e2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:30.655137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df276db6-f40b-43cf-8638-bc465d8d1e2d service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:30.655414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df276db6-f40b-43cf-8638-bc465d8d1e2d service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:30.655686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df276db6-f40b-43cf-8638-bc465d8d1e2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:30.657437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-df276db6-f40b-43cf-8638-bc465d8d1e2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:30.668764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df276db6-f40b-43cf-8638-bc465d8d1e2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:30.670346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df276db6-f40b-43cf-8638-bc465d8d1e2d service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:30.680688 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 851/1691] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:30.681920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df276db6-f40b-43cf-8638-bc465d8d1e2d service placement] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:30.683584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-df276db6-f40b-43cf-8638-bc465d8d1e2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:30.756348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df276db6-f40b-43cf-8638-bc465d8d1e2d service placement] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:30.769027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8214f9-1af3-40b9-8d13-640ca0ecc387 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:30.769027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8214f9-1af3-40b9-8d13-640ca0ecc387 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:30.769027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8214f9-1af3-40b9-8d13-640ca0ecc387 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:30.769027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8214f9-1af3-40b9-8d13-640ca0ecc387 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:30.769731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6f8214f9-1af3-40b9-8d13-640ca0ecc387 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:30.779779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8eab30a8-a31e-408d-b1a4-e5a39f61778b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbae0f44ca87484b8925f0bb9df28ac7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:30.849681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8214f9-1af3-40b9-8d13-640ca0ecc387 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:30.851514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8214f9-1af3-40b9-8d13-640ca0ecc387 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:30.862983 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 852/1692] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:30 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:30.864734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e1f20-8ca2-4e0f-b38a-61cd1f95c710 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:30.865124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e1f20-8ca2-4e0f-b38a-61cd1f95c710 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:30.865438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e1f20-8ca2-4e0f-b38a-61cd1f95c710 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:30.866983 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 853/1693] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:30.873611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063550f6-b67e-447c-a695-78d293cad40a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:30.873611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063550f6-b67e-447c-a695-78d293cad40a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:30.873611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063550f6-b67e-447c-a695-78d293cad40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:30.896559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-063550f6-b67e-447c-a695-78d293cad40a None None] MFA Rules not processed for user `0e5ddcf00a184aa0ac0e7194f1c72425`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:30.898065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-063550f6-b67e-447c-a695-78d293cad40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:30.898616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8eab30a8-a31e-408d-b1a4-e5a39f61778b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbae0f44ca87484b8925f0bb9df28ac7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:30.899379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8eab30a8-a31e-408d-b1a4-e5a39f61778b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbae0f44ca87484b8925f0bb9df28ac7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:30.907683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8eab30a8-a31e-408d-b1a4-e5a39f61778b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbae0f44ca87484b8925f0bb9df28ac7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:30.911349 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 854/1694] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:38:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:38:30.922272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063550f6-b67e-447c-a695-78d293cad40a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:30.923379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8eab30a8-a31e-408d-b1a4-e5a39f61778b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbae0f44ca87484b8925f0bb9df28ac7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:30.923710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-063550f6-b67e-447c-a695-78d293cad40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:30.932428 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 841/1695] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:30 2022] DELETE /identity/v3/users/fbae0f44ca87484b8925f0bb9df28ac7 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:30.937245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fccc8-21fc-4d56-a3d3-77d585ac4f24 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:30.937639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fccc8-21fc-4d56-a3d3-77d585ac4f24 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:30.940519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fccc8-21fc-4d56-a3d3-77d585ac4f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:30.948114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:30.982448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-432fccc8-21fc-4d56-a3d3-77d585ac4f24 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:30.983744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-432fccc8-21fc-4d56-a3d3-77d585ac4f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:31.012135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063550f6-b67e-447c-a695-78d293cad40a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:31.048659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:31.065669 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 842/1696] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:31.073090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be7ce0-f0a6-4e63-8106-b39cb8c5b8cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:31.073762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be7ce0-f0a6-4e63-8106-b39cb8c5b8cb service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:31.074043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be7ce0-f0a6-4e63-8106-b39cb8c5b8cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:31.074312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be7ce0-f0a6-4e63-8106-b39cb8c5b8cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:31.076480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-62be7ce0-f0a6-4e63-8106-b39cb8c5b8cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:31.077675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fccc8-21fc-4d56-a3d3-77d585ac4f24 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:31.079219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-432fccc8-21fc-4d56-a3d3-77d585ac4f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:31.092116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fccc8-21fc-4d56-a3d3-77d585ac4f24 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:31.095895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa71102-fc08-48a7-9fb5-25cdb45a0595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:31.096663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa71102-fc08-48a7-9fb5-25cdb45a0595 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:31.097045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa71102-fc08-48a7-9fb5-25cdb45a0595 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:31.097401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa71102-fc08-48a7-9fb5-25cdb45a0595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:31.109502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa71102-fc08-48a7-9fb5-25cdb45a0595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:31.111276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa71102-fc08-48a7-9fb5-25cdb45a0595 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:31.123567 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 843/1697] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:31.124534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa71102-fc08-48a7-9fb5-25cdb45a0595 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:31.133936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ffa71102-fc08-48a7-9fb5-25cdb45a0595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:31.160524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa71102-fc08-48a7-9fb5-25cdb45a0595 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:31.166169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6dba3-5914-4141-955d-fce9e1961d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:31.166802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6dba3-5914-4141-955d-fce9e1961d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:31.167082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6dba3-5914-4141-955d-fce9e1961d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:31.167360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6dba3-5914-4141-955d-fce9e1961d63 admin admin] PATH_INFO: `/v3/projects/0908b27b2b9246959efad49212610c3e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:31.168529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6dba3-5914-4141-955d-fce9e1961d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0908b27b2b9246959efad49212610c3e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:31.170448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6dba3-5914-4141-955d-fce9e1961d63 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:31.181519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be7ce0-f0a6-4e63-8106-b39cb8c5b8cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:31.182961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be7ce0-f0a6-4e63-8106-b39cb8c5b8cb service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:31.197112 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 855/1698] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:31.198216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889453f4-f03e-45e6-8f52-e7a2376e4df7 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:31.198487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889453f4-f03e-45e6-8f52-e7a2376e4df7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:31.198762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889453f4-f03e-45e6-8f52-e7a2376e4df7 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:31.200237 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 856/1699] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:31.205573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba543a7-9158-4ab2-8c41-0aab46acfd2d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:31.206472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba543a7-9158-4ab2-8c41-0aab46acfd2d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:31.206769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba543a7-9158-4ab2-8c41-0aab46acfd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:31.229468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6ba543a7-9158-4ab2-8c41-0aab46acfd2d None None] MFA Rules not processed for user `702086569a63418685711c4c134b1482`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:31.230554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6ba543a7-9158-4ab2-8c41-0aab46acfd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:31.299645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d6d6dba3-5914-4141-955d-fce9e1961d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0908b27b2b9246959efad49212610c3e', 'request_id': 'req-d6d6dba3-5914-4141-955d-fce9e1961d63'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:31.305733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d6d6dba3-5914-4141-955d-fce9e1961d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0908b27b2b9246959efad49212610c3e', 'request_id': 'req-d6d6dba3-5914-4141-955d-fce9e1961d63'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:31.309426 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 857/1700] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:38:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:38:31.310807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22b2fb-9a0d-481d-83d9-ab48ddaa5b36 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:31.311098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22b2fb-9a0d-481d-83d9-ab48ddaa5b36 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:31.311366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22b2fb-9a0d-481d-83d9-ab48ddaa5b36 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:31.312624 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 858/1701] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:31.318704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22b2fb-9a0d-481d-83d9-ab48ddaa5b36 None None] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:38:31.320516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4a22b2fb-9a0d-481d-83d9-ab48ddaa5b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:31.326505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:31.327688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d6d6dba3-5914-4141-955d-fce9e1961d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0908b27b2b9246959efad49212610c3e', 'request_id': 'req-d6d6dba3-5914-4141-955d-fce9e1961d63'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:31.401388 n-d-852088-5 devstack@keystone.service[82083]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-4a22b2fb-9a0d-481d-83d9-ab48ddaa5b36 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 27 04:38:31.401555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22b2fb-9a0d-481d-83d9-ab48ddaa5b36 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:31.402833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4a22b2fb-9a0d-481d-83d9-ab48ddaa5b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:31.434650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d6d6dba3-5914-4141-955d-fce9e1961d63 admin admin] The token cache is being invalidate because project 0908b27b2b9246959efad49212610c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:31.434650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d6d6dba3-5914-4141-955d-fce9e1961d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:31.434650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d6d6dba3-5914-4141-955d-fce9e1961d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:31.434650 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 844/1702] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:31 2022] DELETE /identity/v3/projects/0908b27b2b9246959efad49212610c3e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:31.434650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6dba3-5914-4141-955d-fce9e1961d63 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:31.435587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d6d6dba3-5914-4141-955d-fce9e1961d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:31.503789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22b2fb-9a0d-481d-83d9-ab48ddaa5b36 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:31.509516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dea997-57f9-4596-a2d8-a98c7937f5b4 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6a9fc1e55e48ba970953739d1a9918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a748fb909db84586a68a8e013258931f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:31.510247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dea997-57f9-4596-a2d8-a98c7937f5b4 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:31.510763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dea997-57f9-4596-a2d8-a98c7937f5b4 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:31.511034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dea997-57f9-4596-a2d8-a98c7937f5b4 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] PATH_INFO: `/v3/projects/a9d7f623110e42e0a1dad7890cc646ed` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:31.512669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dea997-57f9-4596-a2d8-a98c7937f5b4 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: Authorizing `identity:get_project(project_id=a9d7f623110e42e0a1dad7890cc646ed)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:31.514535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dea997-57f9-4596-a2d8-a98c7937f5b4 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:31.525979 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 859/1703] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:38:31 2022] GET /identity/v3/projects/a9d7f623110e42e0a1dad7890cc646ed => generated 395 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:38:31.529551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b1703-5100-43a2-b919-0f94104b468f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:31.530071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b1703-5100-43a2-b919-0f94104b468f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:31.530195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b1703-5100-43a2-b919-0f94104b468f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:31.539795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6dba3-5914-4141-955d-fce9e1961d63 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:31.546728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70f834-2136-4417-bf9e-5d10298c5167 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:31.547928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70f834-2136-4417-bf9e-5d10298c5167 service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:31.549349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70f834-2136-4417-bf9e-5d10298c5167 service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:31.549867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70f834-2136-4417-bf9e-5d10298c5167 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:31.553526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ee70f834-2136-4417-bf9e-5d10298c5167 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:31.565446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-603b1703-5100-43a2-b919-0f94104b468f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:31.566789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-603b1703-5100-43a2-b919-0f94104b468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:31.569112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70f834-2136-4417-bf9e-5d10298c5167 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:31.570994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70f834-2136-4417-bf9e-5d10298c5167 service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:31.583530 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 845/1704] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:31.637629 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 860/1705] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:31.643423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70f834-2136-4417-bf9e-5d10298c5167 service placement] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:31.649821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ee70f834-2136-4417-bf9e-5d10298c5167 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:31.649948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b9abc-6597-4194-93ab-0eecdfa32340 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:31.649948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b9abc-6597-4194-93ab-0eecdfa32340 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:31.649948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b9abc-6597-4194-93ab-0eecdfa32340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:31.669989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70f834-2136-4417-bf9e-5d10298c5167 service placement] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:31.676029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:31.677318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-921b9abc-6597-4194-93ab-0eecdfa32340 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:31.677876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:31.678264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:31.678605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0 admin admin] PATH_INFO: `/v3/projects/b8eb583f85824886a7e066a7b884ce42` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:31.679390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-921b9abc-6597-4194-93ab-0eecdfa32340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:31.680388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8eb583f85824886a7e066a7b884ce42)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:31.684072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:31.689561 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 861/1706] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:31.695685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b9abc-6597-4194-93ab-0eecdfa32340 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:31.721147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b9abc-6597-4194-93ab-0eecdfa32340 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:31.728473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc16b2-7e75-4f9c-9c7d-25939fe270ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:31.729154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc16b2-7e75-4f9c-9c7d-25939fe270ad admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:31.729602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc16b2-7e75-4f9c-9c7d-25939fe270ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:31.729944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc16b2-7e75-4f9c-9c7d-25939fe270ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:31.730721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc16b2-7e75-4f9c-9c7d-25939fe270ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:31.731104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc16b2-7e75-4f9c-9c7d-25939fe270ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:31.732927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc16b2-7e75-4f9c-9c7d-25939fe270ad admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:31.747660 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 862/1707] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:31.749107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac92dc-0fc4-485b-a521-bcae7155ae88 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:31.753463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac92dc-0fc4-485b-a521-bcae7155ae88 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:31.753463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac92dc-0fc4-485b-a521-bcae7155ae88 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:31.753463 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 863/1708] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:31.753463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac92dc-0fc4-485b-a521-bcae7155ae88 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:31.764737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac92dc-0fc4-485b-a521-bcae7155ae88 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:31.770488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94c539-c934-4d81-be88-aca90b318c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:31.771624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94c539-c934-4d81-be88-aca90b318c06 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:31.771904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94c539-c934-4d81-be88-aca90b318c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:31.772206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94c539-c934-4d81-be88-aca90b318c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:31.772830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94c539-c934-4d81-be88-aca90b318c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:31.774710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94c539-c934-4d81-be88-aca90b318c06 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:31.916770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:31.916993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:31.918261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8eb583f85824886a7e066a7b884ce42', 'request_id': 'req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:31.925810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8eb583f85824886a7e066a7b884ce42', 'request_id': 'req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:31.926676 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 864/1709] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:31 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:38:31.927781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94c539-c934-4d81-be88-aca90b318c06 admin admin] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:38:31.929575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6a94c539-c934-4d81-be88-aca90b318c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:31.937220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8eb583f85824886a7e066a7b884ce42', 'request_id': 'req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:32.009596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0 admin admin] The token cache is being invalidate because project b8eb583f85824886a7e066a7b884ce42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:32.010363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:32.010550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:32.012387 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 846/1710] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:31 2022] DELETE /identity/v3/projects/b8eb583f85824886a7e066a7b884ce42 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:32.013887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:32.015655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:32.018412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94c539-c934-4d81-be88-aca90b318c06 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:32.019684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6a94c539-c934-4d81-be88-aca90b318c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:32.084627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0bc2b-138e-4d79-8d28-956c7e2ddec0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:32.090402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94c539-c934-4d81-be88-aca90b318c06 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:32.095101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b7656-c5a7-4f70-89c8-d8786e9b28c4 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6a9fc1e55e48ba970953739d1a9918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a748fb909db84586a68a8e013258931f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:32.095864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7656-c5a7-4f70-89c8-d8786e9b28c4 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:32.096156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7656-c5a7-4f70-89c8-d8786e9b28c4 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:32.096463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7656-c5a7-4f70-89c8-d8786e9b28c4 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] PATH_INFO: `/v3/projects/a9d7f623110e42e0a1dad7890cc646ed` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:32.097656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b7656-c5a7-4f70-89c8-d8786e9b28c4 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: Authorizing `identity:get_project(project_id=a9d7f623110e42e0a1dad7890cc646ed)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:32.100440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b7656-c5a7-4f70-89c8-d8786e9b28c4 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:32.102410 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 865/1711] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:38:31 2022] GET /identity/v3/projects/a9d7f623110e42e0a1dad7890cc646ed => generated 395 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:32.102896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b7656-c5a7-4f70-89c8-d8786e9b28c4 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:32.104884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-df3b7656-c5a7-4f70-89c8-d8786e9b28c4 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:32.149086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf99dac-6835-4d56-b3c2-cf255828e969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:32.149704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf99dac-6835-4d56-b3c2-cf255828e969 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:32.149978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf99dac-6835-4d56-b3c2-cf255828e969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:32.150253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf99dac-6835-4d56-b3c2-cf255828e969 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:32.150908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf99dac-6835-4d56-b3c2-cf255828e969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:32.152951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf99dac-6835-4d56-b3c2-cf255828e969 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:32.174447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b7656-c5a7-4f70-89c8-d8786e9b28c4 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:32.179421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96e478-0592-4400-a640-3c2e337a7bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:32.180046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96e478-0592-4400-a640-3c2e337a7bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:32.180364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96e478-0592-4400-a640-3c2e337a7bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:32.180636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96e478-0592-4400-a640-3c2e337a7bc3 admin admin] PATH_INFO: `/v3/users/7259768b6da04017807081c6d51a6f92` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:32.181749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96e478-0592-4400-a640-3c2e337a7bc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7259768b6da04017807081c6d51a6f92)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:32.183763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96e478-0592-4400-a640-3c2e337a7bc3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:32.277437 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 847/1712] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:32 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:32.278687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d6a1e-8890-4f9d-a5ab-79b399074957 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:32.278966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d6a1e-8890-4f9d-a5ab-79b399074957 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:32.283533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d6a1e-8890-4f9d-a5ab-79b399074957 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:32.283533 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 848/1713] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:38:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:32.285261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d6a1e-8890-4f9d-a5ab-79b399074957 None None] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:38:32.286996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d98d6a1e-8890-4f9d-a5ab-79b399074957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:32.304816 n-d-852088-5 devstack@keystone.service[82082]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-d98d6a1e-8890-4f9d-a5ab-79b399074957 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 27 04:38:32.305117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d6a1e-8890-4f9d-a5ab-79b399074957 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:32.306333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d98d6a1e-8890-4f9d-a5ab-79b399074957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:32.318982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d6a1e-8890-4f9d-a5ab-79b399074957 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:32.323515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab815887-4234-457f-9a66-d5228f5b2d23 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6a9fc1e55e48ba970953739d1a9918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a748fb909db84586a68a8e013258931f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:32.324114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815887-4234-457f-9a66-d5228f5b2d23 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:32.324440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815887-4234-457f-9a66-d5228f5b2d23 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:32.324719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815887-4234-457f-9a66-d5228f5b2d23 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] PATH_INFO: `/v3/projects/a9d7f623110e42e0a1dad7890cc646ed` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:32.325813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab815887-4234-457f-9a66-d5228f5b2d23 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: Authorizing `identity:get_project(project_id=a9d7f623110e42e0a1dad7890cc646ed)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:32.327879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab815887-4234-457f-9a66-d5228f5b2d23 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:32.329524 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 849/1714] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:38:32 2022] GET /identity/v3/projects/a9d7f623110e42e0a1dad7890cc646ed => generated 395 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:38:32.330262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab815887-4234-457f-9a66-d5228f5b2d23 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:32.342467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab815887-4234-457f-9a66-d5228f5b2d23 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:32.352737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ee6ef-bb41-45e3-aebe-856eb4ddce92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:32.352737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee6ef-bb41-45e3-aebe-856eb4ddce92 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:32.352737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee6ef-bb41-45e3-aebe-856eb4ddce92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:32.352737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee6ef-bb41-45e3-aebe-856eb4ddce92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:32.356414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ee6ef-bb41-45e3-aebe-856eb4ddce92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:32.357489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ee6ef-bb41-45e3-aebe-856eb4ddce92 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:32.370852 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 850/1715] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:32.374587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ee6ef-bb41-45e3-aebe-856eb4ddce92 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:32.385090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ee6ef-bb41-45e3-aebe-856eb4ddce92 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:32.389867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307aa79-41ac-4b92-b523-b52ea32f4ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:32.390461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307aa79-41ac-4b92-b523-b52ea32f4ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:32.390741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307aa79-41ac-4b92-b523-b52ea32f4ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:32.391011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307aa79-41ac-4b92-b523-b52ea32f4ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:32.391650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307aa79-41ac-4b92-b523-b52ea32f4ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:32.393623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307aa79-41ac-4b92-b523-b52ea32f4ce6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:32.407886 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 851/1716] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:38:32.408910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307aa79-41ac-4b92-b523-b52ea32f4ce6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:32.419277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307aa79-41ac-4b92-b523-b52ea32f4ce6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:32.424065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdc12f-b834-4d63-9009-2e6c18c4391f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:32.424751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdc12f-b834-4d63-9009-2e6c18c4391f admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:32.432018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdc12f-b834-4d63-9009-2e6c18c4391f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:32.432018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdc12f-b834-4d63-9009-2e6c18c4391f admin admin] PATH_INFO: `/v3/projects/78237faaefb0418e914718aacec86264/users/6aca3a2b351c41ffb00d9641d1a535fa/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:32.444387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdc12f-b834-4d63-9009-2e6c18c4391f admin admin] RBAC: Authorizing `identity:create_grant(project_id=78237faaefb0418e914718aacec86264, user_id=6aca3a2b351c41ffb00d9641d1a535fa, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:32.447069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdc12f-b834-4d63-9009-2e6c18c4391f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:32.512251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:32.525876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cd96e478-0592-4400-a640-3c2e337a7bc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7259768b6da04017807081c6d51a6f92'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:32.526527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cd96e478-0592-4400-a640-3c2e337a7bc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7259768b6da04017807081c6d51a6f92'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:32.631144 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 852/1717] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:32 2022] PUT /identity/v3/projects/78237faaefb0418e914718aacec86264/users/6aca3a2b351c41ffb00d9641d1a535fa/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:32.631836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdc12f-b834-4d63-9009-2e6c18c4391f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:32.641430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-21fdc12f-b834-4d63-9009-2e6c18c4391f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:32.686955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cd96e478-0592-4400-a640-3c2e337a7bc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7259768b6da04017807081c6d51a6f92'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:32.687602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cd96e478-0592-4400-a640-3c2e337a7bc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7259768b6da04017807081c6d51a6f92'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:32.702417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cd96e478-0592-4400-a640-3c2e337a7bc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7259768b6da04017807081c6d51a6f92'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:32.715742 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 866/1718] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:32 2022] DELETE /identity/v3/users/7259768b6da04017807081c6d51a6f92 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:32.720036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e5981-4fb0-42ea-8b86-6c51f3df28ef None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:32.720036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e5981-4fb0-42ea-8b86-6c51f3df28ef None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:32.720036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e5981-4fb0-42ea-8b86-6c51f3df28ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:32.722536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdc12f-b834-4d63-9009-2e6c18c4391f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:32.765443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2f4e5981-4fb0-42ea-8b86-6c51f3df28ef None None] MFA Rules not processed for user `6aca3a2b351c41ffb00d9641d1a535fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:32.768375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2f4e5981-4fb0-42ea-8b86-6c51f3df28ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:32.805657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c07fbf-ea34-495b-89f0-fd2e179bbe8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:32.806425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c07fbf-ea34-495b-89f0-fd2e179bbe8d service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:32.806805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c07fbf-ea34-495b-89f0-fd2e179bbe8d service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:32.807180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c07fbf-ea34-495b-89f0-fd2e179bbe8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:32.809182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-03c07fbf-ea34-495b-89f0-fd2e179bbe8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:32.852315 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 867/1719] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:32.853490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e5981-4fb0-42ea-8b86-6c51f3df28ef None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:32.854846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2f4e5981-4fb0-42ea-8b86-6c51f3df28ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:32.884279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c07fbf-ea34-495b-89f0-fd2e179bbe8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:32.885992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c07fbf-ea34-495b-89f0-fd2e179bbe8d service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:32.893813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:32.897901 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 853/1720] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:32 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:32.976196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e5981-4fb0-42ea-8b86-6c51f3df28ef None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:32.976196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7b41f-da74-46a7-a9bd-6f107072049d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:32.976196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7b41f-da74-46a7-a9bd-6f107072049d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:32.976196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7b41f-da74-46a7-a9bd-6f107072049d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:32.977286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7b41f-da74-46a7-a9bd-6f107072049d admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:32.977286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7b41f-da74-46a7-a9bd-6f107072049d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:32.979974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7b41f-da74-46a7-a9bd-6f107072049d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:33.078395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c07fbf-ea34-495b-89f0-fd2e179bbe8d service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:33.080563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-03c07fbf-ea34-495b-89f0-fd2e179bbe8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:33.095326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c07fbf-ea34-495b-89f0-fd2e179bbe8d service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:33.100788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709a9c9-8ac7-4878-89ac-db4e3af23cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:33.101407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709a9c9-8ac7-4878-89ac-db4e3af23cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:33.101839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709a9c9-8ac7-4878-89ac-db4e3af23cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:33.102109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709a9c9-8ac7-4878-89ac-db4e3af23cf1 admin admin] PATH_INFO: `/v3/users/41e90ddefaa54150a673d201162a44e6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:33.103258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709a9c9-8ac7-4878-89ac-db4e3af23cf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e90ddefaa54150a673d201162a44e6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:33.105225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709a9c9-8ac7-4878-89ac-db4e3af23cf1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:33.144127 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 868/1721] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:32 2022] POST /identity/v3/projects => generated 383 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:33.145652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7b41f-da74-46a7-a9bd-6f107072049d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:33.178940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:33.215479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7b41f-da74-46a7-a9bd-6f107072049d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:33.220735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fa628-1200-49ed-bc28-93e31e542636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:33.221329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fa628-1200-49ed-bc28-93e31e542636 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:33.221607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fa628-1200-49ed-bc28-93e31e542636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:33.221902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fa628-1200-49ed-bc28-93e31e542636 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:33.222519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fa628-1200-49ed-bc28-93e31e542636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:33.225132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fa628-1200-49ed-bc28-93e31e542636 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:33.381455 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 869/1722] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:33 2022] POST /identity/v3/users => generated 298 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:33.382475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fa628-1200-49ed-bc28-93e31e542636 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:33.384291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-111fa628-1200-49ed-bc28-93e31e542636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:33.404426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fa628-1200-49ed-bc28-93e31e542636 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:33.408068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4a461-54c6-4ab1-8ee2-052a4f086c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:33.408068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4a461-54c6-4ab1-8ee2-052a4f086c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:33.408068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4a461-54c6-4ab1-8ee2-052a4f086c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:33.408068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4a461-54c6-4ab1-8ee2-052a4f086c67 admin admin] PATH_INFO: `/v3/projects/d280b9d5e8114413bc7097042208b136` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:33.409091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4a461-54c6-4ab1-8ee2-052a4f086c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d280b9d5e8114413bc7097042208b136)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:33.411677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4a461-54c6-4ab1-8ee2-052a4f086c67 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:33.440375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f709a9c9-8ac7-4878-89ac-db4e3af23cf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e90ddefaa54150a673d201162a44e6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:33.537693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f709a9c9-8ac7-4878-89ac-db4e3af23cf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e90ddefaa54150a673d201162a44e6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:33.539864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f709a9c9-8ac7-4878-89ac-db4e3af23cf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e90ddefaa54150a673d201162a44e6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:33.553056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f709a9c9-8ac7-4878-89ac-db4e3af23cf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e90ddefaa54150a673d201162a44e6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:33.562563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-83a4a461-54c6-4ab1-8ee2-052a4f086c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd280b9d5e8114413bc7097042208b136', 'request_id': 'req-83a4a461-54c6-4ab1-8ee2-052a4f086c67'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:33.567296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f709a9c9-8ac7-4878-89ac-db4e3af23cf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e90ddefaa54150a673d201162a44e6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:33.569615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-83a4a461-54c6-4ab1-8ee2-052a4f086c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd280b9d5e8114413bc7097042208b136', 'request_id': 'req-83a4a461-54c6-4ab1-8ee2-052a4f086c67'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:33.587428 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 854/1723] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:33 2022] DELETE /identity/v3/users/41e90ddefaa54150a673d201162a44e6 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:38:33.597776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709a9c9-8ac7-4878-89ac-db4e3af23cf1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:33.600117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f709a9c9-8ac7-4878-89ac-db4e3af23cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:33.673312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709a9c9-8ac7-4878-89ac-db4e3af23cf1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:33.678560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76375be5-7eca-41b9-a19e-6adbe7a4a7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:33.679256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76375be5-7eca-41b9-a19e-6adbe7a4a7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:33.679605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76375be5-7eca-41b9-a19e-6adbe7a4a7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:33.679947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76375be5-7eca-41b9-a19e-6adbe7a4a7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:33.680702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76375be5-7eca-41b9-a19e-6adbe7a4a7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:33.682367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76375be5-7eca-41b9-a19e-6adbe7a4a7a5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:33.687139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-83a4a461-54c6-4ab1-8ee2-052a4f086c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd280b9d5e8114413bc7097042208b136', 'request_id': 'req-83a4a461-54c6-4ab1-8ee2-052a4f086c67'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:33.693602 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 855/1724] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:33.694955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904af20-b801-418e-b8bb-76b101c0aea5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:33.695233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904af20-b801-418e-b8bb-76b101c0aea5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:33.695506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904af20-b801-418e-b8bb-76b101c0aea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:33.705670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-83a4a461-54c6-4ab1-8ee2-052a4f086c67 admin admin] The token cache is being invalidate because project d280b9d5e8114413bc7097042208b136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:33.705967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-83a4a461-54c6-4ab1-8ee2-052a4f086c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:33.706640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-83a4a461-54c6-4ab1-8ee2-052a4f086c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:33.713140 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 870/1725] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:33 2022] DELETE /identity/v3/projects/d280b9d5e8114413bc7097042208b136 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:33.714069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4a461-54c6-4ab1-8ee2-052a4f086c67 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:33.715277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2904af20-b801-418e-b8bb-76b101c0aea5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:33.715560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-83a4a461-54c6-4ab1-8ee2-052a4f086c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:33.716499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2904af20-b801-418e-b8bb-76b101c0aea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:33.724648 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 856/1726] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:33.725955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d9af4-2791-46ee-b3ca-d9d25dee5bdd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:33.733291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d9af4-2791-46ee-b3ca-d9d25dee5bdd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:33.733291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d9af4-2791-46ee-b3ca-d9d25dee5bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:33.761498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:33.767948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b19d9af4-2791-46ee-b3ca-d9d25dee5bdd None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:33.777069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b19d9af4-2791-46ee-b3ca-d9d25dee5bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:33.787028 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 857/1727] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:33.787944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d9af4-2791-46ee-b3ca-d9d25dee5bdd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:33.789478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b19d9af4-2791-46ee-b3ca-d9d25dee5bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:33.798780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4a461-54c6-4ab1-8ee2-052a4f086c67 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:33.804382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4553e-9ac9-44fd-9bb2-0861bf7fc0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:33.806026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4553e-9ac9-44fd-9bb2-0861bf7fc0f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:33.806026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4553e-9ac9-44fd-9bb2-0861bf7fc0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:33.806026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4553e-9ac9-44fd-9bb2-0861bf7fc0f1 admin admin] PATH_INFO: `/v3/projects/aa1ed44f243049f1bbabb82f89f3f017/users/2f7f6987bfe44c079a31217e39a98e21/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:33.834376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4553e-9ac9-44fd-9bb2-0861bf7fc0f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1ed44f243049f1bbabb82f89f3f017, user_id=2f7f6987bfe44c079a31217e39a98e21, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:33.838724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4553e-9ac9-44fd-9bb2-0861bf7fc0f1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:33.861784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d9af4-2791-46ee-b3ca-d9d25dee5bdd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:33.867433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ad573-83d7-4dc4-a3cb-bf98e79538b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:33.868265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ad573-83d7-4dc4-a3cb-bf98e79538b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:33.868819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ad573-83d7-4dc4-a3cb-bf98e79538b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:33.869188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ad573-83d7-4dc4-a3cb-bf98e79538b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:33.890991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ad573-83d7-4dc4-a3cb-bf98e79538b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:33.893043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ad573-83d7-4dc4-a3cb-bf98e79538b3 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:33.904533 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 858/1728] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:33.905824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4347ff-f184-4fee-917e-b5bd598fc6b5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:33.906102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4347ff-f184-4fee-917e-b5bd598fc6b5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:33.906462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4347ff-f184-4fee-917e-b5bd598fc6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:33.929607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6a4347ff-f184-4fee-917e-b5bd598fc6b5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:33.931105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6a4347ff-f184-4fee-917e-b5bd598fc6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:33.934058 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 871/1729] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:33 2022] PUT /identity/v3/projects/aa1ed44f243049f1bbabb82f89f3f017/users/2f7f6987bfe44c079a31217e39a98e21/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:33.938010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4553e-9ac9-44fd-9bb2-0861bf7fc0f1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:34.006072 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 859/1730] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:34.010076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4347ff-f184-4fee-917e-b5bd598fc6b5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:34.022107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4347ff-f184-4fee-917e-b5bd598fc6b5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:34.027052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc565e3-8069-4807-be2c-dd4cfee19460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:34.027689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc565e3-8069-4807-be2c-dd4cfee19460 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:34.028425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc565e3-8069-4807-be2c-dd4cfee19460 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:34.028425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc565e3-8069-4807-be2c-dd4cfee19460 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:34.033599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc565e3-8069-4807-be2c-dd4cfee19460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:34.033599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc565e3-8069-4807-be2c-dd4cfee19460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:34.033599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc565e3-8069-4807-be2c-dd4cfee19460 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:34.041636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4553e-9ac9-44fd-9bb2-0861bf7fc0f1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:34.047587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c520bd8-b94a-407b-85f6-c30acfaf6d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:34.050184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c520bd8-b94a-407b-85f6-c30acfaf6d5c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:34.053527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c520bd8-b94a-407b-85f6-c30acfaf6d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:34.053527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c520bd8-b94a-407b-85f6-c30acfaf6d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:34.053527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c520bd8-b94a-407b-85f6-c30acfaf6d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:34.056831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c520bd8-b94a-407b-85f6-c30acfaf6d5c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:34.058328 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 860/1731] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:38:34.059357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc565e3-8069-4807-be2c-dd4cfee19460 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:34.062023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fdc565e3-8069-4807-be2c-dd4cfee19460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:34.069569 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 872/1732] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:38:34.070839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c520bd8-b94a-407b-85f6-c30acfaf6d5c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:34.081230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c520bd8-b94a-407b-85f6-c30acfaf6d5c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:34.089578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871567f-41db-4f57-88c8-9b5117092e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:34.090194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871567f-41db-4f57-88c8-9b5117092e44 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:34.090519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871567f-41db-4f57-88c8-9b5117092e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:34.090928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871567f-41db-4f57-88c8-9b5117092e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:34.091553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871567f-41db-4f57-88c8-9b5117092e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:34.093510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871567f-41db-4f57-88c8-9b5117092e44 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:34.136948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc565e3-8069-4807-be2c-dd4cfee19460 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:34.142637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca80ace-0938-406e-9004-b961fbb969dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:34.143233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca80ace-0938-406e-9004-b961fbb969dd service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:34.143513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca80ace-0938-406e-9004-b961fbb969dd service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:34.143785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca80ace-0938-406e-9004-b961fbb969dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:34.146108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1ca80ace-0938-406e-9004-b961fbb969dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:34.202911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca80ace-0938-406e-9004-b961fbb969dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:34.204630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca80ace-0938-406e-9004-b961fbb969dd service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:34.214036 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 861/1733] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:34 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:34.214909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca80ace-0938-406e-9004-b961fbb969dd service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:34.225097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca80ace-0938-406e-9004-b961fbb969dd service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:34.232760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ca94f-06f7-4cd5-b94b-51d6e07680ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:34.233409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ca94f-06f7-4cd5-b94b-51d6e07680ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:34.233693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ca94f-06f7-4cd5-b94b-51d6e07680ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:34.233976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ca94f-06f7-4cd5-b94b-51d6e07680ad admin admin] PATH_INFO: `/v3/projects/aa1ed44f243049f1bbabb82f89f3f017/users/2f7f6987bfe44c079a31217e39a98e21/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:34.238401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ca94f-06f7-4cd5-b94b-51d6e07680ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1ed44f243049f1bbabb82f89f3f017, user_id=2f7f6987bfe44c079a31217e39a98e21, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:34.240834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ca94f-06f7-4cd5-b94b-51d6e07680ad admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:34.253453 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 862/1734] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:34 2022] PUT /identity/v3/projects/aa1ed44f243049f1bbabb82f89f3f017/users/2f7f6987bfe44c079a31217e39a98e21/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:34.265811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e745f-e553-4b6b-8270-dd00783b6f81 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:34.266100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e745f-e553-4b6b-8270-dd00783b6f81 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:34.266380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e745f-e553-4b6b-8270-dd00783b6f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:34.299506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-695e745f-e553-4b6b-8270-dd00783b6f81 None None] MFA Rules not processed for user `2f7f6987bfe44c079a31217e39a98e21`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:34.300759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-695e745f-e553-4b6b-8270-dd00783b6f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:34.304815 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 873/1735] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:34 2022] POST /identity/v3/projects => generated 389 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:34.306438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871567f-41db-4f57-88c8-9b5117092e44 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:34.403526 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 863/1736] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:34.428435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871567f-41db-4f57-88c8-9b5117092e44 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:34.434329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7d990-0eb2-4f66-ba22-9e6ddc4531c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:34.435318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7d990-0eb2-4f66-ba22-9e6ddc4531c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:34.435774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7d990-0eb2-4f66-ba22-9e6ddc4531c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:34.436244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7d990-0eb2-4f66-ba22-9e6ddc4531c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:34.437045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7d990-0eb2-4f66-ba22-9e6ddc4531c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:34.439752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7d990-0eb2-4f66-ba22-9e6ddc4531c2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:34.489177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e745f-e553-4b6b-8270-dd00783b6f81 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:34.490822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-695e745f-e553-4b6b-8270-dd00783b6f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:34.509367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e745f-e553-4b6b-8270-dd00783b6f81 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:34.514524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70d78e-72ce-4c89-92ed-0f6789d571fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:34.515365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d78e-72ce-4c89-92ed-0f6789d571fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:34.515654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d78e-72ce-4c89-92ed-0f6789d571fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:34.515930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d78e-72ce-4c89-92ed-0f6789d571fb admin admin] PATH_INFO: `/v3/users/c6e3a429567442c8b4722611b9c3873f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:34.517550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70d78e-72ce-4c89-92ed-0f6789d571fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e3a429567442c8b4722611b9c3873f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:34.519705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70d78e-72ce-4c89-92ed-0f6789d571fb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:34.597108 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 874/1737] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:34 2022] POST /identity/v3/users => generated 295 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:34.597108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7d990-0eb2-4f66-ba22-9e6ddc4531c2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:34.597108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dbe7d990-0eb2-4f66-ba22-9e6ddc4531c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:34.695002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7d990-0eb2-4f66-ba22-9e6ddc4531c2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:34.701294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda95b0d-a890-4161-b542-66f84f1f4d9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:34.701918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda95b0d-a890-4161-b542-66f84f1f4d9d service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:34.702197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda95b0d-a890-4161-b542-66f84f1f4d9d service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:34.702498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda95b0d-a890-4161-b542-66f84f1f4d9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:34.713597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda95b0d-a890-4161-b542-66f84f1f4d9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:34.715368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda95b0d-a890-4161-b542-66f84f1f4d9d service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:34.725678 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 875/1738] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:34.726463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda95b0d-a890-4161-b542-66f84f1f4d9d service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:34.737520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda95b0d-a890-4161-b542-66f84f1f4d9d service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:34.743892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c73dc6-e09e-4101-8672-014431175ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:34.749300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73dc6-e09e-4101-8672-014431175ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:34.749300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73dc6-e09e-4101-8672-014431175ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:34.749300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73dc6-e09e-4101-8672-014431175ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:34.749300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c73dc6-e09e-4101-8672-014431175ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:34.749300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c73dc6-e09e-4101-8672-014431175ed2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:34.760478 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 876/1739] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:34.765570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c73dc6-e09e-4101-8672-014431175ed2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:34.767549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c5c73dc6-e09e-4101-8672-014431175ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:34.782721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c73dc6-e09e-4101-8672-014431175ed2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:34.789155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbbb16-46b8-4372-b1ee-21fbf24d5164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:34.790803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbbb16-46b8-4372-b1ee-21fbf24d5164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:34.791156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbbb16-46b8-4372-b1ee-21fbf24d5164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:34.796971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbbb16-46b8-4372-b1ee-21fbf24d5164 admin admin] PATH_INFO: `/v3/projects/d11ef3b1badc4bb7b109648fc21f3fc7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:34.796971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:34.796971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbbb16-46b8-4372-b1ee-21fbf24d5164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11ef3b1badc4bb7b109648fc21f3fc7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:34.799074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbbb16-46b8-4372-b1ee-21fbf24d5164 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:34.826927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5e70d78e-72ce-4c89-92ed-0f6789d571fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e3a429567442c8b4722611b9c3873f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:34.900961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5e70d78e-72ce-4c89-92ed-0f6789d571fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e3a429567442c8b4722611b9c3873f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:34.902274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5e70d78e-72ce-4c89-92ed-0f6789d571fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e3a429567442c8b4722611b9c3873f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:34.915031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5e70d78e-72ce-4c89-92ed-0f6789d571fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e3a429567442c8b4722611b9c3873f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:34.932199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-77cbbb16-46b8-4372-b1ee-21fbf24d5164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11ef3b1badc4bb7b109648fc21f3fc7', 'request_id': 'req-77cbbb16-46b8-4372-b1ee-21fbf24d5164'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:34.955339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5e70d78e-72ce-4c89-92ed-0f6789d571fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e3a429567442c8b4722611b9c3873f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:34.963152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:34.968120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-77cbbb16-46b8-4372-b1ee-21fbf24d5164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11ef3b1badc4bb7b109648fc21f3fc7', 'request_id': 'req-77cbbb16-46b8-4372-b1ee-21fbf24d5164'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:34.971730 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 864/1740] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:34 2022] DELETE /identity/v3/users/c6e3a429567442c8b4722611b9c3873f => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:38:34.972780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70d78e-72ce-4c89-92ed-0f6789d571fb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:34.976193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5e70d78e-72ce-4c89-92ed-0f6789d571fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:35.050710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70d78e-72ce-4c89-92ed-0f6789d571fb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:35.056590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69a1b1-50e3-4909-9d23-a0ed2dfc1ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:35.057251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69a1b1-50e3-4909-9d23-a0ed2dfc1ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:35.057531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69a1b1-50e3-4909-9d23-a0ed2dfc1ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:35.057801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69a1b1-50e3-4909-9d23-a0ed2dfc1ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:35.058437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69a1b1-50e3-4909-9d23-a0ed2dfc1ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:35.060032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69a1b1-50e3-4909-9d23-a0ed2dfc1ae5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:35.070655 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 865/1741] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:35.071438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69a1b1-50e3-4909-9d23-a0ed2dfc1ae5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:35.073151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5b69a1b1-50e3-4909-9d23-a0ed2dfc1ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:35.076009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-77cbbb16-46b8-4372-b1ee-21fbf24d5164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11ef3b1badc4bb7b109648fc21f3fc7', 'request_id': 'req-77cbbb16-46b8-4372-b1ee-21fbf24d5164'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:35.095807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-77cbbb16-46b8-4372-b1ee-21fbf24d5164 admin admin] The token cache is being invalidate because project d11ef3b1badc4bb7b109648fc21f3fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:35.096450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-77cbbb16-46b8-4372-b1ee-21fbf24d5164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:35.097290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-77cbbb16-46b8-4372-b1ee-21fbf24d5164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:35.099933 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 877/1742] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:34 2022] DELETE /identity/v3/projects/d11ef3b1badc4bb7b109648fc21f3fc7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:35.101640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0976884-d0a2-4b92-8737-393bfb1dbd5a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:35.102085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0976884-d0a2-4b92-8737-393bfb1dbd5a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:35.102541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0976884-d0a2-4b92-8737-393bfb1dbd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:35.104340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69a1b1-50e3-4909-9d23-a0ed2dfc1ae5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:35.110612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f745013-64bf-4e85-a152-c7e21dce83eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:35.111680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f745013-64bf-4e85-a152-c7e21dce83eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:35.111966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f745013-64bf-4e85-a152-c7e21dce83eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:35.112530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f745013-64bf-4e85-a152-c7e21dce83eb admin admin] PATH_INFO: `/v3/users/6aca3a2b351c41ffb00d9641d1a535fa` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:35.115575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f745013-64bf-4e85-a152-c7e21dce83eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aca3a2b351c41ffb00d9641d1a535fa)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:35.117628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f745013-64bf-4e85-a152-c7e21dce83eb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:35.130560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c0976884-d0a2-4b92-8737-393bfb1dbd5a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:35.132101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c0976884-d0a2-4b92-8737-393bfb1dbd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:35.146436 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 878/1743] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:35.146436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d29d48-c4a6-4017-878d-9a77c15e07d5 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:35.146436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d29d48-c4a6-4017-878d-9a77c15e07d5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:35.146436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d29d48-c4a6-4017-878d-9a77c15e07d5 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:35.147424 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 879/1744] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:35.148205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3987a2-06e5-422a-b069-f1fc04774049 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:35.148566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3987a2-06e5-422a-b069-f1fc04774049 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:35.149020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3987a2-06e5-422a-b069-f1fc04774049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:35.202170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-fa3987a2-06e5-422a-b069-f1fc04774049 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:35.203473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fa3987a2-06e5-422a-b069-f1fc04774049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:35.278001 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 880/1745] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:38:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:35.278816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3987a2-06e5-422a-b069-f1fc04774049 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:35.280121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fa3987a2-06e5-422a-b069-f1fc04774049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:35.297397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3987a2-06e5-422a-b069-f1fc04774049 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:35.302610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7b79f-5a3d-4d11-bac7-fbdc3d04c4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:35.304535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7b79f-5a3d-4d11-bac7-fbdc3d04c4a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:35.304535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7b79f-5a3d-4d11-bac7-fbdc3d04c4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:35.304535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7b79f-5a3d-4d11-bac7-fbdc3d04c4a6 admin admin] PATH_INFO: `/v3/projects/5fa92687e4ed4c3895a95a733decc212/users/8e85936a073c48b7a8dc4d1ab9d26559/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:35.320294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7b79f-5a3d-4d11-bac7-fbdc3d04c4a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa92687e4ed4c3895a95a733decc212, user_id=8e85936a073c48b7a8dc4d1ab9d26559, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:35.323032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7b79f-5a3d-4d11-bac7-fbdc3d04c4a6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:35.347151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6f745013-64bf-4e85-a152-c7e21dce83eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aca3a2b351c41ffb00d9641d1a535fa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:35.422670 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 881/1746] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:35 2022] PUT /identity/v3/projects/5fa92687e4ed4c3895a95a733decc212/users/8e85936a073c48b7a8dc4d1ab9d26559/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:35.423981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7b79f-5a3d-4d11-bac7-fbdc3d04c4a6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:35.426904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6f745013-64bf-4e85-a152-c7e21dce83eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aca3a2b351c41ffb00d9641d1a535fa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:35.434649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6f745013-64bf-4e85-a152-c7e21dce83eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aca3a2b351c41ffb00d9641d1a535fa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:35.435653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0eb7b79f-5a3d-4d11-bac7-fbdc3d04c4a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:35.438463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6f745013-64bf-4e85-a152-c7e21dce83eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aca3a2b351c41ffb00d9641d1a535fa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:35.467306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6f745013-64bf-4e85-a152-c7e21dce83eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aca3a2b351c41ffb00d9641d1a535fa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:35.476220 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 866/1747] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:35 2022] DELETE /identity/v3/users/6aca3a2b351c41ffb00d9641d1a535fa => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:35.476787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f745013-64bf-4e85-a152-c7e21dce83eb admin admin] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:38:35.478126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6f745013-64bf-4e85-a152-c7e21dce83eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:35.542325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7b79f-5a3d-4d11-bac7-fbdc3d04c4a6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:35.562119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f745013-64bf-4e85-a152-c7e21dce83eb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:35.563674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6f745013-64bf-4e85-a152-c7e21dce83eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:35.611931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3177e-f7dc-45df-ba23-eff8b45fb274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:35.612634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3177e-f7dc-45df-ba23-eff8b45fb274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:35.612913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3177e-f7dc-45df-ba23-eff8b45fb274 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:35.613233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3177e-f7dc-45df-ba23-eff8b45fb274 admin admin] PATH_INFO: `/v3/users/a2e39713402a42b4bd0f88c499ef9d0d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:35.614646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3177e-f7dc-45df-ba23-eff8b45fb274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e39713402a42b4bd0f88c499ef9d0d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:35.616771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3177e-f7dc-45df-ba23-eff8b45fb274 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:35.663779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f745013-64bf-4e85-a152-c7e21dce83eb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:35.675516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bf766-e785-4b99-b3bc-990c38ddad8d tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6a9fc1e55e48ba970953739d1a9918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a748fb909db84586a68a8e013258931f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:35.676081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bf766-e785-4b99-b3bc-990c38ddad8d tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:35.676488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bf766-e785-4b99-b3bc-990c38ddad8d tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:35.676773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bf766-e785-4b99-b3bc-990c38ddad8d tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] PATH_INFO: `/v3/projects/a9d7f623110e42e0a1dad7890cc646ed` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:35.678989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633bf766-e785-4b99-b3bc-990c38ddad8d tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: Authorizing `identity:get_project(project_id=a9d7f623110e42e0a1dad7890cc646ed)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:35.681917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633bf766-e785-4b99-b3bc-990c38ddad8d tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:35.683421 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 867/1748] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:38:35 2022] GET /identity/v3/projects/a9d7f623110e42e0a1dad7890cc646ed => generated 395 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:35.684037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bf766-e785-4b99-b3bc-990c38ddad8d tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:35.685707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-633bf766-e785-4b99-b3bc-990c38ddad8d tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:35.750885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bf766-e785-4b99-b3bc-990c38ddad8d tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:35.754802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac8fe8-e1b9-4084-b465-9c43fa1ab326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:35.755610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8fe8-e1b9-4084-b465-9c43fa1ab326 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:35.755885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8fe8-e1b9-4084-b465-9c43fa1ab326 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:35.759759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8fe8-e1b9-4084-b465-9c43fa1ab326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:35.759759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5dac8fe8-e1b9-4084-b465-9c43fa1ab326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:35.770430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac8fe8-e1b9-4084-b465-9c43fa1ab326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:35.771912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac8fe8-e1b9-4084-b465-9c43fa1ab326 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:35.781300 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 868/1749] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:35.782408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862a5c0-55b0-49c8-8767-72df76ee9c3d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:35.783472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862a5c0-55b0-49c8-8767-72df76ee9c3d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:35.783779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862a5c0-55b0-49c8-8767-72df76ee9c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:35.830956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8862a5c0-55b0-49c8-8767-72df76ee9c3d None None] MFA Rules not processed for user `8e85936a073c48b7a8dc4d1ab9d26559`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:35.832323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8862a5c0-55b0-49c8-8767-72df76ee9c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:35.898994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ab3177e-f7dc-45df-ba23-eff8b45fb274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e39713402a42b4bd0f88c499ef9d0d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:35.899674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ab3177e-f7dc-45df-ba23-eff8b45fb274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e39713402a42b4bd0f88c499ef9d0d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:35.923207 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 869/1750] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:35.926611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddfdb5-e6dc-43c7-9d88-7d4f287d4632 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:35.926611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddfdb5-e6dc-43c7-9d88-7d4f287d4632 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:35.926611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddfdb5-e6dc-43c7-9d88-7d4f287d4632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:35.946862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-95ddfdb5-e6dc-43c7-9d88-7d4f287d4632 None None] MFA Rules not processed for user `9da73530cb834803b849b0e97f467e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:35.948122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-95ddfdb5-e6dc-43c7-9d88-7d4f287d4632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:36.007165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ab3177e-f7dc-45df-ba23-eff8b45fb274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e39713402a42b4bd0f88c499ef9d0d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:36.007893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ab3177e-f7dc-45df-ba23-eff8b45fb274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e39713402a42b4bd0f88c499ef9d0d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:36.024477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ab3177e-f7dc-45df-ba23-eff8b45fb274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e39713402a42b4bd0f88c499ef9d0d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:36.039546 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 882/1751] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:35 2022] DELETE /identity/v3/users/a2e39713402a42b4bd0f88c499ef9d0d => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:36.043741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf991904-7bd6-47a4-bcaf-53bef712a15e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:36.044281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf991904-7bd6-47a4-bcaf-53bef712a15e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:36.044696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf991904-7bd6-47a4-bcaf-53bef712a15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:36.068425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-cf991904-7bd6-47a4-bcaf-53bef712a15e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:36.070921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cf991904-7bd6-47a4-bcaf-53bef712a15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:36.095336 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 870/1752] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:36.097341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddfdb5-e6dc-43c7-9d88-7d4f287d4632 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:36.101229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-95ddfdb5-e6dc-43c7-9d88-7d4f287d4632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:36.154964 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 883/1753] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:36.156667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07ced8-eed1-42d7-8600-e8767da407be None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:36.157143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07ced8-eed1-42d7-8600-e8767da407be None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:36.157710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07ced8-eed1-42d7-8600-e8767da407be None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:36.160717 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 884/1754] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:38:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:36.162033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07ced8-eed1-42d7-8600-e8767da407be None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:36.166643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1f07ced8-eed1-42d7-8600-e8767da407be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:36.190815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07ced8-eed1-42d7-8600-e8767da407be None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:36.198681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb4a4f-9364-497d-a591-60dd3be5881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:36.199525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb4a4f-9364-497d-a591-60dd3be5881d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:36.200276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb4a4f-9364-497d-a591-60dd3be5881d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:36.200556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb4a4f-9364-497d-a591-60dd3be5881d admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:36.201286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb4a4f-9364-497d-a591-60dd3be5881d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:36.203242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb4a4f-9364-497d-a591-60dd3be5881d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:36.225203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddfdb5-e6dc-43c7-9d88-7d4f287d4632 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:36.309052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b014c4-6887-458e-afba-847bdbcc0697 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:36.309932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b014c4-6887-458e-afba-847bdbcc0697 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:36.310209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b014c4-6887-458e-afba-847bdbcc0697 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:36.310482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b014c4-6887-458e-afba-847bdbcc0697 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:36.315303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-06b014c4-6887-458e-afba-847bdbcc0697 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:36.340919 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 885/1755] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:36 2022] POST /identity/v3/projects => generated 389 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:36.344837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a1c9-c275-4c35-a977-1c7647d0efc4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:36.344837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a1c9-c275-4c35-a977-1c7647d0efc4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:36.344837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a1c9-c275-4c35-a977-1c7647d0efc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:36.348870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:36.385059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b014c4-6887-458e-afba-847bdbcc0697 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:36.386676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b014c4-6887-458e-afba-847bdbcc0697 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:36.390936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5c01a1c9-c275-4c35-a977-1c7647d0efc4 None None] MFA Rules not processed for user `0547461f91aa423381430eda35fe6b74`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:36.392151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5c01a1c9-c275-4c35-a977-1c7647d0efc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:36.398643 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 871/1756] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:38:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:36.399664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b014c4-6887-458e-afba-847bdbcc0697 service swift] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:38:36.401490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-06b014c4-6887-458e-afba-847bdbcc0697 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:36.500097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:36.506341 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 886/1757] 10.222.0.78 () {58 vars in 1015 bytes} [Sat Aug 27 04:38:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:36.508381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01a1c9-c275-4c35-a977-1c7647d0efc4 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:36.510809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5c01a1c9-c275-4c35-a977-1c7647d0efc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:36.534968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01a1c9-c275-4c35-a977-1c7647d0efc4 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:36.546801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e8bb0-6986-4b24-9754-169d1e4b2695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:36.547567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e8bb0-6986-4b24-9754-169d1e4b2695 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:36.547567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e8bb0-6986-4b24-9754-169d1e4b2695 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:36.548594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e8bb0-6986-4b24-9754-169d1e4b2695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:36.555976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b014c4-6887-458e-afba-847bdbcc0697 service swift] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:36.561992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-06b014c4-6887-458e-afba-847bdbcc0697 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:36.674682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e8bb0-6986-4b24-9754-169d1e4b2695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:36.678393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e8bb0-6986-4b24-9754-169d1e4b2695 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:36.692322 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 887/1758] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:36.693649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e8bb0-6986-4b24-9754-169d1e4b2695 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:36.695901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-560e8bb0-6986-4b24-9754-169d1e4b2695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:36.761553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b014c4-6887-458e-afba-847bdbcc0697 service swift] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:36.905894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e8bb0-6986-4b24-9754-169d1e4b2695 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:36.906188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60de7a2-5572-49d7-87a6-2b01c98ab004 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6a9fc1e55e48ba970953739d1a9918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a748fb909db84586a68a8e013258931f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:36.907092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60de7a2-5572-49d7-87a6-2b01c98ab004 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:36.907519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60de7a2-5572-49d7-87a6-2b01c98ab004 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:36.907949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60de7a2-5572-49d7-87a6-2b01c98ab004 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] PATH_INFO: `/v3/projects/a9d7f623110e42e0a1dad7890cc646ed` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:36.909783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60de7a2-5572-49d7-87a6-2b01c98ab004 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: Authorizing `identity:get_project(project_id=a9d7f623110e42e0a1dad7890cc646ed)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:36.913919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60de7a2-5572-49d7-87a6-2b01c98ab004 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:36.916906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c084271-1fa6-4074-9530-2293f1f8087d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:36.917846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c084271-1fa6-4074-9530-2293f1f8087d service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:36.918432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c084271-1fa6-4074-9530-2293f1f8087d service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:36.918979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c084271-1fa6-4074-9530-2293f1f8087d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:36.922025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:36.924616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1c084271-1fa6-4074-9530-2293f1f8087d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:36.931636 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 872/1759] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:38:36 2022] GET /identity/v3/projects/a9d7f623110e42e0a1dad7890cc646ed => generated 395 bytes in 532 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:36.932959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60de7a2-5572-49d7-87a6-2b01c98ab004 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:36.956727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60de7a2-5572-49d7-87a6-2b01c98ab004 tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:36.968622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948294d-3c0d-45bf-992f-f473674b1c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:36.971056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948294d-3c0d-45bf-992f-f473674b1c56 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:36.971698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948294d-3c0d-45bf-992f-f473674b1c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:36.972190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948294d-3c0d-45bf-992f-f473674b1c56 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:36.976602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948294d-3c0d-45bf-992f-f473674b1c56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:36.978718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948294d-3c0d-45bf-992f-f473674b1c56 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:37.010143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c084271-1fa6-4074-9530-2293f1f8087d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:37.011944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c084271-1fa6-4074-9530-2293f1f8087d service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:37.024932 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 888/1760] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:37.025584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c084271-1fa6-4074-9530-2293f1f8087d service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:37.037854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c084271-1fa6-4074-9530-2293f1f8087d service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:37.045353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3dda71-c51c-4ccd-802b-82a91aa7be3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:37.045353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dda71-c51c-4ccd-802b-82a91aa7be3e service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:37.045353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dda71-c51c-4ccd-802b-82a91aa7be3e service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:37.045353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3dda71-c51c-4ccd-802b-82a91aa7be3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:37.053224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3dda71-c51c-4ccd-802b-82a91aa7be3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:37.054767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3dda71-c51c-4ccd-802b-82a91aa7be3e service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:37.065357 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 889/1761] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:37.066154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3dda71-c51c-4ccd-802b-82a91aa7be3e service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:37.068313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ec3dda71-c51c-4ccd-802b-82a91aa7be3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:37.097764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3dda71-c51c-4ccd-802b-82a91aa7be3e service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:37.105351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca41f3-e076-4a66-ac61-443119b0d2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:37.105954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca41f3-e076-4a66-ac61-443119b0d2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:37.106224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca41f3-e076-4a66-ac61-443119b0d2da admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:37.106499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca41f3-e076-4a66-ac61-443119b0d2da admin admin] PATH_INFO: `/v3/projects/47ac6bcb3b07481fac6b292b9c6a12b7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:37.108934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca41f3-e076-4a66-ac61-443119b0d2da admin admin] RBAC: Authorizing `identity:delete_project(project_id=47ac6bcb3b07481fac6b292b9c6a12b7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:37.112812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca41f3-e076-4a66-ac61-443119b0d2da admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:37.184851 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 873/1762] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:36 2022] POST /identity/v3/users => generated 301 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:37.184851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948294d-3c0d-45bf-992f-f473674b1c56 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:37.184851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1948294d-3c0d-45bf-992f-f473674b1c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:37.215640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:37.237869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948294d-3c0d-45bf-992f-f473674b1c56 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:37.257339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff454b41-498c-4f8d-b1fa-8899069e676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:37.264249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff454b41-498c-4f8d-b1fa-8899069e676d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:37.264249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff454b41-498c-4f8d-b1fa-8899069e676d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:37.264249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff454b41-498c-4f8d-b1fa-8899069e676d admin admin] PATH_INFO: `/v3/projects/4dce039e9b1d49d6bee258b212c635cc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:37.264249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff454b41-498c-4f8d-b1fa-8899069e676d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dce039e9b1d49d6bee258b212c635cc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:37.266303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff454b41-498c-4f8d-b1fa-8899069e676d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:37.345850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-36ca41f3-e076-4a66-ac61-443119b0d2da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47ac6bcb3b07481fac6b292b9c6a12b7', 'request_id': 'req-36ca41f3-e076-4a66-ac61-443119b0d2da'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:37.362776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-36ca41f3-e076-4a66-ac61-443119b0d2da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47ac6bcb3b07481fac6b292b9c6a12b7', 'request_id': 'req-36ca41f3-e076-4a66-ac61-443119b0d2da'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:37.563762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-36ca41f3-e076-4a66-ac61-443119b0d2da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47ac6bcb3b07481fac6b292b9c6a12b7', 'request_id': 'req-36ca41f3-e076-4a66-ac61-443119b0d2da'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:37.596398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-36ca41f3-e076-4a66-ac61-443119b0d2da admin admin] The token cache is being invalidate because project 47ac6bcb3b07481fac6b292b9c6a12b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:37.596398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-36ca41f3-e076-4a66-ac61-443119b0d2da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:37.596398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-36ca41f3-e076-4a66-ac61-443119b0d2da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:37.596398 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 890/1763] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:37 2022] DELETE /identity/v3/projects/47ac6bcb3b07481fac6b292b9c6a12b7 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:37.596398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca41f3-e076-4a66-ac61-443119b0d2da admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:37.596876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-36ca41f3-e076-4a66-ac61-443119b0d2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:37.600654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ff454b41-498c-4f8d-b1fa-8899069e676d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dce039e9b1d49d6bee258b212c635cc', 'request_id': 'req-ff454b41-498c-4f8d-b1fa-8899069e676d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:37.609847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ff454b41-498c-4f8d-b1fa-8899069e676d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dce039e9b1d49d6bee258b212c635cc', 'request_id': 'req-ff454b41-498c-4f8d-b1fa-8899069e676d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:37.621381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ff454b41-498c-4f8d-b1fa-8899069e676d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dce039e9b1d49d6bee258b212c635cc', 'request_id': 'req-ff454b41-498c-4f8d-b1fa-8899069e676d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:37.825512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ff454b41-498c-4f8d-b1fa-8899069e676d admin admin] The token cache is being invalidate because project 4dce039e9b1d49d6bee258b212c635cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:37.826284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ff454b41-498c-4f8d-b1fa-8899069e676d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:37.827407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ff454b41-498c-4f8d-b1fa-8899069e676d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:37.829546 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 874/1764] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:37 2022] DELETE /identity/v3/projects/4dce039e9b1d49d6bee258b212c635cc => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:37.834964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff454b41-498c-4f8d-b1fa-8899069e676d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:37.838451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ff454b41-498c-4f8d-b1fa-8899069e676d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:37.898058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca41f3-e076-4a66-ac61-443119b0d2da admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:37.997162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b29d30-91a5-4e6c-a662-17bfcc6707cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:37.998878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b29d30-91a5-4e6c-a662-17bfcc6707cb admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:37.998878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b29d30-91a5-4e6c-a662-17bfcc6707cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:37.998878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b29d30-91a5-4e6c-a662-17bfcc6707cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:37.999918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b29d30-91a5-4e6c-a662-17bfcc6707cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:38.006662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b29d30-91a5-4e6c-a662-17bfcc6707cb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:38.006856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff454b41-498c-4f8d-b1fa-8899069e676d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:38.026899 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 891/1765] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:38.027635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b29d30-91a5-4e6c-a662-17bfcc6707cb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:38.029340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c8b29d30-91a5-4e6c-a662-17bfcc6707cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:38.032118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905a9ae-12a8-445f-8319-301a8bec19b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:38.032814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905a9ae-12a8-445f-8319-301a8bec19b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:38.033098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905a9ae-12a8-445f-8319-301a8bec19b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:38.033375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905a9ae-12a8-445f-8319-301a8bec19b0 admin admin] PATH_INFO: `/v3/users/226124b94984432c9664cac49f827b10` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:38.035883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905a9ae-12a8-445f-8319-301a8bec19b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=226124b94984432c9664cac49f827b10)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:38.037884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905a9ae-12a8-445f-8319-301a8bec19b0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:38.048308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b29d30-91a5-4e6c-a662-17bfcc6707cb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:38.056223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d219a6b-2795-406f-b8bb-2806a0bf9a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:38.056223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d219a6b-2795-406f-b8bb-2806a0bf9a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:38.056223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d219a6b-2795-406f-b8bb-2806a0bf9a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:38.056223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d219a6b-2795-406f-b8bb-2806a0bf9a4c admin admin] PATH_INFO: `/v3/projects/78237faaefb0418e914718aacec86264` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:38.057182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d219a6b-2795-406f-b8bb-2806a0bf9a4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78237faaefb0418e914718aacec86264)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:38.060450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d219a6b-2795-406f-b8bb-2806a0bf9a4c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:38.408115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2d219a6b-2795-406f-b8bb-2806a0bf9a4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78237faaefb0418e914718aacec86264', 'request_id': 'req-2d219a6b-2795-406f-b8bb-2806a0bf9a4c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:38.421945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2d219a6b-2795-406f-b8bb-2806a0bf9a4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78237faaefb0418e914718aacec86264', 'request_id': 'req-2d219a6b-2795-406f-b8bb-2806a0bf9a4c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:38.422090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2905a9ae-12a8-445f-8319-301a8bec19b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '226124b94984432c9664cac49f827b10'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:38.510445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2d219a6b-2795-406f-b8bb-2806a0bf9a4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78237faaefb0418e914718aacec86264', 'request_id': 'req-2d219a6b-2795-406f-b8bb-2806a0bf9a4c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:38.526555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2d219a6b-2795-406f-b8bb-2806a0bf9a4c admin admin] The token cache is being invalidate because project 78237faaefb0418e914718aacec86264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:38.527229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2d219a6b-2795-406f-b8bb-2806a0bf9a4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:38.528289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2d219a6b-2795-406f-b8bb-2806a0bf9a4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:38.530166 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 892/1766] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:38 2022] DELETE /identity/v3/projects/78237faaefb0418e914718aacec86264 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:38.531961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203cf0d-449e-4275-9131-49dac3afdd8e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:38.532476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203cf0d-449e-4275-9131-49dac3afdd8e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:38.533018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203cf0d-449e-4275-9131-49dac3afdd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:38.540685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:38.573144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2905a9ae-12a8-445f-8319-301a8bec19b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '226124b94984432c9664cac49f827b10'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:38.573821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2905a9ae-12a8-445f-8319-301a8bec19b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '226124b94984432c9664cac49f827b10'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:38.581843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2905a9ae-12a8-445f-8319-301a8bec19b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '226124b94984432c9664cac49f827b10'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:38.586592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:38.589581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a203cf0d-449e-4275-9131-49dac3afdd8e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:38.594277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a203cf0d-449e-4275-9131-49dac3afdd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:38.602423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2905a9ae-12a8-445f-8319-301a8bec19b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '226124b94984432c9664cac49f827b10'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:38.627715 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 875/1767] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:37 2022] DELETE /identity/v3/users/226124b94984432c9664cac49f827b10 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:38.629176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905a9ae-12a8-445f-8319-301a8bec19b0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:38.631459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2905a9ae-12a8-445f-8319-301a8bec19b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:38.788887 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 893/1768] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:38.789598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905a9ae-12a8-445f-8319-301a8bec19b0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:38.792039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2b9fc-a694-4531-b33e-4ef0c00ab4fa None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:38.795103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2b9fc-a694-4531-b33e-4ef0c00ab4fa None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:38.795563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2b9fc-a694-4531-b33e-4ef0c00ab4fa None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:38.796792 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 894/1769] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:38:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:38.804090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c464004-b738-4114-9226-cccb139a92f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:38.805124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c464004-b738-4114-9226-cccb139a92f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:38.805124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c464004-b738-4114-9226-cccb139a92f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:38.805433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c464004-b738-4114-9226-cccb139a92f9 admin admin] PATH_INFO: `/v3/projects/7014de47600c4336a3e192f1f822a3a6/users/91380adca9974e108ab3c74ec0f17237/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:38.805974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2b9fc-a694-4531-b33e-4ef0c00ab4fa None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:38.808672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e6d2b9fc-a694-4531-b33e-4ef0c00ab4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:38.826786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c464004-b738-4114-9226-cccb139a92f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7014de47600c4336a3e192f1f822a3a6, user_id=91380adca9974e108ab3c74ec0f17237, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:38.833960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c464004-b738-4114-9226-cccb139a92f9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:38.844285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2b9fc-a694-4531-b33e-4ef0c00ab4fa None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:38.860755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68421bc7-a7a2-41e9-9e41-2b21d4a3a86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:38.861417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68421bc7-a7a2-41e9-9e41-2b21d4a3a86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:38.861888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68421bc7-a7a2-41e9-9e41-2b21d4a3a86b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:38.862166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68421bc7-a7a2-41e9-9e41-2b21d4a3a86b admin admin] PATH_INFO: `/v3/users/2f7f6987bfe44c079a31217e39a98e21` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:38.863509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68421bc7-a7a2-41e9-9e41-2b21d4a3a86b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7f6987bfe44c079a31217e39a98e21)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:38.866248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68421bc7-a7a2-41e9-9e41-2b21d4a3a86b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:38.929491 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 876/1770] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:38 2022] PUT /identity/v3/projects/7014de47600c4336a3e192f1f822a3a6/users/91380adca9974e108ab3c74ec0f17237/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:38.932620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd5f2-b61b-48c4-9450-459467e8fe3f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:38.933192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd5f2-b61b-48c4-9450-459467e8fe3f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:38.934063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd5f2-b61b-48c4-9450-459467e8fe3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:38.994379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b31bd5f2-b61b-48c4-9450-459467e8fe3f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:38.996397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b31bd5f2-b61b-48c4-9450-459467e8fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:39.145563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-68421bc7-a7a2-41e9-9e41-2b21d4a3a86b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7f6987bfe44c079a31217e39a98e21'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:39.149239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-68421bc7-a7a2-41e9-9e41-2b21d4a3a86b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7f6987bfe44c079a31217e39a98e21'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:39.202906 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 877/1771] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:39.225517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bd5f2-b61b-48c4-9450-459467e8fe3f None None] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:38:39.237385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b31bd5f2-b61b-48c4-9450-459467e8fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:39.322341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-68421bc7-a7a2-41e9-9e41-2b21d4a3a86b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7f6987bfe44c079a31217e39a98e21'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:39.323562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-68421bc7-a7a2-41e9-9e41-2b21d4a3a86b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7f6987bfe44c079a31217e39a98e21'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:39.359936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-68421bc7-a7a2-41e9-9e41-2b21d4a3a86b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7f6987bfe44c079a31217e39a98e21'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:39.434218 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 895/1772] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:38 2022] DELETE /identity/v3/users/2f7f6987bfe44c079a31217e39a98e21 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:39.435688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68421bc7-a7a2-41e9-9e41-2b21d4a3a86b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:39.451112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:39.457653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bd5f2-b61b-48c4-9450-459467e8fe3f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:39.457847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-68421bc7-a7a2-41e9-9e41-2b21d4a3a86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:39.457960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b31bd5f2-b61b-48c4-9450-459467e8fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:39.550996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bd5f2-b61b-48c4-9450-459467e8fe3f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:39.651657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734f96d-b7e5-439f-a4f8-4df1932feb7e tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6a9fc1e55e48ba970953739d1a9918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a748fb909db84586a68a8e013258931f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:39.652497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734f96d-b7e5-439f-a4f8-4df1932feb7e tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:39.652781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734f96d-b7e5-439f-a4f8-4df1932feb7e tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:39.653060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734f96d-b7e5-439f-a4f8-4df1932feb7e tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] PATH_INFO: `/v3/projects/a077b614074d407c8b5b1053febfc109` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:39.654404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734f96d-b7e5-439f-a4f8-4df1932feb7e tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: Authorizing `identity:get_project(project_id=a077b614074d407c8b5b1053febfc109)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:39.656608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734f96d-b7e5-439f-a4f8-4df1932feb7e tempest-FlavorsAccessNegativeTestJSON-290804195 tempest-FlavorsAccessNegativeTestJSON-290804195-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:39.658457 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 878/1773] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:38:39 2022] GET /identity/v3/projects/a077b614074d407c8b5b1053febfc109 => generated 395 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:39.662163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a0cd6-b132-458c-b13c-e8eeba67cc66 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:39.662163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a0cd6-b132-458c-b13c-e8eeba67cc66 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:39.662163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a0cd6-b132-458c-b13c-e8eeba67cc66 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:39.662830 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 879/1774] 10.222.0.76 () {54 vars in 921 bytes} [Sat Aug 27 04:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:39.663628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a0cd6-b132-458c-b13c-e8eeba67cc66 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:39.665503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a41a0cd6-b132-458c-b13c-e8eeba67cc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:39.716847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:39.779064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a0cd6-b132-458c-b13c-e8eeba67cc66 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:39.779292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68421bc7-a7a2-41e9-9e41-2b21d4a3a86b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:39.800961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b40d6c-fd0b-405a-9f9d-32d01a272804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:39.801751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40d6c-fd0b-405a-9f9d-32d01a272804 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:39.802140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40d6c-fd0b-405a-9f9d-32d01a272804 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:39.802433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40d6c-fd0b-405a-9f9d-32d01a272804 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:39.803255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b40d6c-fd0b-405a-9f9d-32d01a272804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:39.805167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f82114-35a0-4ddb-a577-9262ff46d142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:39.806303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f82114-35a0-4ddb-a577-9262ff46d142 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:39.806661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f82114-35a0-4ddb-a577-9262ff46d142 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:39.807811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f82114-35a0-4ddb-a577-9262ff46d142 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:39.808558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f82114-35a0-4ddb-a577-9262ff46d142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:39.808918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f82114-35a0-4ddb-a577-9262ff46d142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:39.812397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b40d6c-fd0b-405a-9f9d-32d01a272804 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:39.826261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f82114-35a0-4ddb-a577-9262ff46d142 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:39.831412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:39.856251 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 880/1775] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:39.860102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721aab9-d168-4a52-80a2-0524dbd01740 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:39.861905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721aab9-d168-4a52-80a2-0524dbd01740 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:39.863346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721aab9-d168-4a52-80a2-0524dbd01740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:39.866015 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 896/1776] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:39.867083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b40d6c-fd0b-405a-9f9d-32d01a272804 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:39.879738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b40d6c-fd0b-405a-9f9d-32d01a272804 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:39.901657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e0668-3dc2-41f5-9017-6a6bcc226b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:39.904269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e0668-3dc2-41f5-9017-6a6bcc226b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:39.904269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e0668-3dc2-41f5-9017-6a6bcc226b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:39.904269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e0668-3dc2-41f5-9017-6a6bcc226b69 admin admin] PATH_INFO: `/v3/projects/7014de47600c4336a3e192f1f822a3a6/users/91380adca9974e108ab3c74ec0f17237/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:39.908658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e0668-3dc2-41f5-9017-6a6bcc226b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7014de47600c4336a3e192f1f822a3a6, user_id=91380adca9974e108ab3c74ec0f17237, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:39.914447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e0668-3dc2-41f5-9017-6a6bcc226b69 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:39.938618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5721aab9-d168-4a52-80a2-0524dbd01740 None None] MFA Rules not processed for user `0e5ddcf00a184aa0ac0e7194f1c72425`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:39.938757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5721aab9-d168-4a52-80a2-0524dbd01740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:39.986679 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 897/1777] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:39 2022] PUT /identity/v3/projects/7014de47600c4336a3e192f1f822a3a6/users/91380adca9974e108ab3c74ec0f17237/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:39.991598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e0668-3dc2-41f5-9017-6a6bcc226b69 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:40.091831 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 881/1778] 10.222.0.76 () {58 vars in 1018 bytes} [Sat Aug 27 04:38:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:40.092920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721aab9-d168-4a52-80a2-0524dbd01740 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:40.100961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5721aab9-d168-4a52-80a2-0524dbd01740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:40.148024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e0668-3dc2-41f5-9017-6a6bcc226b69 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:40.167121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98549e2-f76c-475e-ae05-c8210d5aa755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:40.172699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98549e2-f76c-475e-ae05-c8210d5aa755 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:40.173241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98549e2-f76c-475e-ae05-c8210d5aa755 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:40.180697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98549e2-f76c-475e-ae05-c8210d5aa755 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:40.180697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98549e2-f76c-475e-ae05-c8210d5aa755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:40.180697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98549e2-f76c-475e-ae05-c8210d5aa755 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:40.289842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721aab9-d168-4a52-80a2-0524dbd01740 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:40.308435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713c602-5320-4fc5-8cf8-8adf5edf3021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:40.310592 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 898/1779] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:39 2022] POST /identity/v3/projects => generated 381 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:40.312981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6938b6-d85d-46b6-8217-836b8f30d897 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:40.313885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713c602-5320-4fc5-8cf8-8adf5edf3021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:40.314515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713c602-5320-4fc5-8cf8-8adf5edf3021 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:40.314964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6938b6-d85d-46b6-8217-836b8f30d897 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:40.315593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6938b6-d85d-46b6-8217-836b8f30d897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:40.316276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713c602-5320-4fc5-8cf8-8adf5edf3021 admin admin] PATH_INFO: `/v3/users/8a2fea0eec6848e9bf93d43d1ad47f22` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:40.322073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713c602-5320-4fc5-8cf8-8adf5edf3021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a2fea0eec6848e9bf93d43d1ad47f22)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:40.324416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713c602-5320-4fc5-8cf8-8adf5edf3021 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:40.378668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8d6938b6-d85d-46b6-8217-836b8f30d897 None None] MFA Rules not processed for user `91380adca9974e108ab3c74ec0f17237`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:40.385404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8d6938b6-d85d-46b6-8217-836b8f30d897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:40.500610 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 899/1780] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:40 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:40.500610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6938b6-d85d-46b6-8217-836b8f30d897 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:40.500610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8d6938b6-d85d-46b6-8217-836b8f30d897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:40.599547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3713c602-5320-4fc5-8cf8-8adf5edf3021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a2fea0eec6848e9bf93d43d1ad47f22'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:40.601060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6938b6-d85d-46b6-8217-836b8f30d897 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:40.607204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad467797-b00f-4c54-bcff-22b12d651e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:40.607915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad467797-b00f-4c54-bcff-22b12d651e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:40.608386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad467797-b00f-4c54-bcff-22b12d651e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:40.608565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad467797-b00f-4c54-bcff-22b12d651e71 admin admin] PATH_INFO: `/v3/projects/7a8084423ead4b7f8269af329acaf6b8` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:40.609941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad467797-b00f-4c54-bcff-22b12d651e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8084423ead4b7f8269af329acaf6b8)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:40.612827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad467797-b00f-4c54-bcff-22b12d651e71 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:40.642212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:40.715782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3713c602-5320-4fc5-8cf8-8adf5edf3021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a2fea0eec6848e9bf93d43d1ad47f22'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:40.716525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3713c602-5320-4fc5-8cf8-8adf5edf3021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a2fea0eec6848e9bf93d43d1ad47f22'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:40.725338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3713c602-5320-4fc5-8cf8-8adf5edf3021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a2fea0eec6848e9bf93d43d1ad47f22'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:40.746573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3713c602-5320-4fc5-8cf8-8adf5edf3021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a2fea0eec6848e9bf93d43d1ad47f22'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:40.753997 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 882/1781] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:40 2022] DELETE /identity/v3/users/8a2fea0eec6848e9bf93d43d1ad47f22 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:40.755155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713c602-5320-4fc5-8cf8-8adf5edf3021 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:40.756746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3713c602-5320-4fc5-8cf8-8adf5edf3021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:40.820235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad467797-b00f-4c54-bcff-22b12d651e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8084423ead4b7f8269af329acaf6b8', 'request_id': 'req-ad467797-b00f-4c54-bcff-22b12d651e71'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:40.829878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad467797-b00f-4c54-bcff-22b12d651e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8084423ead4b7f8269af329acaf6b8', 'request_id': 'req-ad467797-b00f-4c54-bcff-22b12d651e71'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:40.874110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713c602-5320-4fc5-8cf8-8adf5edf3021 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:40.894600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad467797-b00f-4c54-bcff-22b12d651e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8084423ead4b7f8269af329acaf6b8', 'request_id': 'req-ad467797-b00f-4c54-bcff-22b12d651e71'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:40.919155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad467797-b00f-4c54-bcff-22b12d651e71 admin admin] The token cache is being invalidate because project 7a8084423ead4b7f8269af329acaf6b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:40.919553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad467797-b00f-4c54-bcff-22b12d651e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:40.920634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad467797-b00f-4c54-bcff-22b12d651e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:40.922947 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 900/1782] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:40 2022] DELETE /identity/v3/projects/7a8084423ead4b7f8269af329acaf6b8 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:40.925807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad467797-b00f-4c54-bcff-22b12d651e71 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:40.928622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ad467797-b00f-4c54-bcff-22b12d651e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:40.983773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:41.026582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ba149-378f-4889-90e4-0d9012c07a72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:41.027218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba149-378f-4889-90e4-0d9012c07a72 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:41.027415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba149-378f-4889-90e4-0d9012c07a72 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:41.027691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ba149-378f-4889-90e4-0d9012c07a72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:41.029452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-de4ba149-378f-4889-90e4-0d9012c07a72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:41.043526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad467797-b00f-4c54-bcff-22b12d651e71 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:41.046354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ba149-378f-4889-90e4-0d9012c07a72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:41.048371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ba149-378f-4889-90e4-0d9012c07a72 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:41.049925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e00d8c-5629-4a0d-b16d-f0c19517abda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:41.050690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e00d8c-5629-4a0d-b16d-f0c19517abda admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:41.051008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e00d8c-5629-4a0d-b16d-f0c19517abda admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:41.051866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e00d8c-5629-4a0d-b16d-f0c19517abda admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:41.052092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e00d8c-5629-4a0d-b16d-f0c19517abda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:41.054678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e00d8c-5629-4a0d-b16d-f0c19517abda admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:41.061048 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 883/1783] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:41.061827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ba149-378f-4889-90e4-0d9012c07a72 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:41.065520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-de4ba149-378f-4889-90e4-0d9012c07a72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:41.083689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ba149-378f-4889-90e4-0d9012c07a72 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:41.089550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c96aa-313b-404a-ba2b-f8e6d1640127 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:41.090212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c96aa-313b-404a-ba2b-f8e6d1640127 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:41.090494 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c96aa-313b-404a-ba2b-f8e6d1640127 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:41.090770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c96aa-313b-404a-ba2b-f8e6d1640127 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:41.093708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b42c96aa-313b-404a-ba2b-f8e6d1640127 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:41.184113 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 901/1784] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:40 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:41.184113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e00d8c-5629-4a0d-b16d-f0c19517abda admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:41.187357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-76e00d8c-5629-4a0d-b16d-f0c19517abda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:41.189215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c96aa-313b-404a-ba2b-f8e6d1640127 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:41.191145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c96aa-313b-404a-ba2b-f8e6d1640127 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:41.200597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e00d8c-5629-4a0d-b16d-f0c19517abda admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:41.203648 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 884/1785] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:41 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:41.205269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd51bf5-5d82-4ed8-b8ee-9cb7bf4392d1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:41.205653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd51bf5-5d82-4ed8-b8ee-9cb7bf4392d1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:41.206203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd51bf5-5d82-4ed8-b8ee-9cb7bf4392d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:41.222621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c79e5f-5244-40f5-ab5a-ce932532a3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:41.223397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c79e5f-5244-40f5-ab5a-ce932532a3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:41.223702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c79e5f-5244-40f5-ab5a-ce932532a3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:41.223942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c79e5f-5244-40f5-ab5a-ce932532a3c1 admin admin] PATH_INFO: `/v3/projects/aa1ed44f243049f1bbabb82f89f3f017` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:41.226442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c79e5f-5244-40f5-ab5a-ce932532a3c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa1ed44f243049f1bbabb82f89f3f017)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:41.228608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c79e5f-5244-40f5-ab5a-ce932532a3c1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:41.233248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3bd51bf5-5d82-4ed8-b8ee-9cb7bf4392d1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:41.235191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3bd51bf5-5d82-4ed8-b8ee-9cb7bf4392d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:41.244426 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 885/1786] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:41.252560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0751e0-0554-4906-949d-dba9fc59faac None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:41.252968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0751e0-0554-4906-949d-dba9fc59faac None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:41.256720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0751e0-0554-4906-949d-dba9fc59faac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:41.315841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-fd0751e0-0554-4906-949d-dba9fc59faac None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:41.318101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fd0751e0-0554-4906-949d-dba9fc59faac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:41.326625 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 886/1787] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:41.331273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0751e0-0554-4906-949d-dba9fc59faac None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:41.351403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0751e0-0554-4906-949d-dba9fc59faac None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:41.367750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32089b87-7e5d-411a-a247-4e50882e3647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:41.368762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32089b87-7e5d-411a-a247-4e50882e3647 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:41.369280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32089b87-7e5d-411a-a247-4e50882e3647 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:41.370673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32089b87-7e5d-411a-a247-4e50882e3647 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:41.370673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32089b87-7e5d-411a-a247-4e50882e3647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:41.372755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32089b87-7e5d-411a-a247-4e50882e3647 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:41.389758 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 887/1788] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:41.389758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32089b87-7e5d-411a-a247-4e50882e3647 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:41.396887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-75c79e5f-5244-40f5-ab5a-ce932532a3c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1ed44f243049f1bbabb82f89f3f017', 'request_id': 'req-75c79e5f-5244-40f5-ab5a-ce932532a3c1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:41.404099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-32089b87-7e5d-411a-a247-4e50882e3647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:41.408731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-75c79e5f-5244-40f5-ab5a-ce932532a3c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1ed44f243049f1bbabb82f89f3f017', 'request_id': 'req-75c79e5f-5244-40f5-ab5a-ce932532a3c1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:41.499214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-75c79e5f-5244-40f5-ab5a-ce932532a3c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1ed44f243049f1bbabb82f89f3f017', 'request_id': 'req-75c79e5f-5244-40f5-ab5a-ce932532a3c1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:41.505477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32089b87-7e5d-411a-a247-4e50882e3647 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:41.522430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-75c79e5f-5244-40f5-ab5a-ce932532a3c1 admin admin] The token cache is being invalidate because project aa1ed44f243049f1bbabb82f89f3f017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:41.523371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-75c79e5f-5244-40f5-ab5a-ce932532a3c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:41.524509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-75c79e5f-5244-40f5-ab5a-ce932532a3c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:41.540462 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 902/1789] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:41 2022] DELETE /identity/v3/projects/aa1ed44f243049f1bbabb82f89f3f017 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:41.543057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1d454-4dde-480f-9906-6d97e0d18651 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:41.545290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1d454-4dde-480f-9906-6d97e0d18651 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:41.545859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1d454-4dde-480f-9906-6d97e0d18651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:41.594082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-31e1d454-4dde-480f-9906-6d97e0d18651 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:41.595376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-31e1d454-4dde-480f-9906-6d97e0d18651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:41.621461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0e356-b6dd-4c6a-90b6-545d5127e779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:41.622360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0e356-b6dd-4c6a-90b6-545d5127e779 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:41.622743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0e356-b6dd-4c6a-90b6-545d5127e779 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:41.623088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0e356-b6dd-4c6a-90b6-545d5127e779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:41.625107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9eb0e356-b6dd-4c6a-90b6-545d5127e779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:41.707922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:41.713825 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 903/1790] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:41.715188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1d454-4dde-480f-9906-6d97e0d18651 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:41.716523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-31e1d454-4dde-480f-9906-6d97e0d18651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:41.734849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1d454-4dde-480f-9906-6d97e0d18651 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:41.741696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8cc25-f9c0-44d8-b643-cc7074957158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:41.742481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8cc25-f9c0-44d8-b643-cc7074957158 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:41.742754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8cc25-f9c0-44d8-b643-cc7074957158 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:41.743023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8cc25-f9c0-44d8-b643-cc7074957158 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:41.743656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8cc25-f9c0-44d8-b643-cc7074957158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:41.745274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8cc25-f9c0-44d8-b643-cc7074957158 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:41.746644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0e356-b6dd-4c6a-90b6-545d5127e779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:41.748115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0e356-b6dd-4c6a-90b6-545d5127e779 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:41.762490 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 904/1791] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:41.762490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8cc25-f9c0-44d8-b643-cc7074957158 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:41.762490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7fb8cc25-f9c0-44d8-b643-cc7074957158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:41.767625 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 888/1792] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:41.768785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf2db1-d993-40a3-850e-18a6b60f00aa None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:41.769097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf2db1-d993-40a3-850e-18a6b60f00aa None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:41.769350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf2db1-d993-40a3-850e-18a6b60f00aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:41.795086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-42cf2db1-d993-40a3-850e-18a6b60f00aa None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:41.795702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:41.796371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-42cf2db1-d993-40a3-850e-18a6b60f00aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:41.831935 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 889/1793] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:41.831935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf2db1-d993-40a3-850e-18a6b60f00aa None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:41.866450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf2db1-d993-40a3-850e-18a6b60f00aa None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:41.872840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5038b7-0b96-466f-865d-feb41f8c7c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:41.873625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5038b7-0b96-466f-865d-feb41f8c7c53 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:41.873824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5038b7-0b96-466f-865d-feb41f8c7c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:41.874139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5038b7-0b96-466f-865d-feb41f8c7c53 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:41.875289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5038b7-0b96-466f-865d-feb41f8c7c53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:41.875289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5038b7-0b96-466f-865d-feb41f8c7c53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:41.876799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5038b7-0b96-466f-865d-feb41f8c7c53 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:41.893970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8cc25-f9c0-44d8-b643-cc7074957158 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:41.896394 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 890/1794] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:41.896832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5038b7-0b96-466f-865d-feb41f8c7c53 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:41.901526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4dc586-8f71-4faf-aa45-481b0cbe6eb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:41.902156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dc586-8f71-4faf-aa45-481b0cbe6eb6 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:41.902433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dc586-8f71-4faf-aa45-481b0cbe6eb6 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:41.902703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dc586-8f71-4faf-aa45-481b0cbe6eb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:41.905920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dd4dc586-8f71-4faf-aa45-481b0cbe6eb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:41.916798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5038b7-0b96-466f-865d-feb41f8c7c53 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:41.922159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd27ed-cde1-4d39-af20-01c74109d398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:41.923153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd27ed-cde1-4d39-af20-01c74109d398 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:41.923439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd27ed-cde1-4d39-af20-01c74109d398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:41.923819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd27ed-cde1-4d39-af20-01c74109d398 admin admin] PATH_INFO: `/v3/projects/3542b4b8761349c1826612240b01ba6b/users/f5f6cef4a1d4400589c48ec606ae4dae/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:41.950679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd27ed-cde1-4d39-af20-01c74109d398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3542b4b8761349c1826612240b01ba6b, user_id=f5f6cef4a1d4400589c48ec606ae4dae, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:41.955774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd27ed-cde1-4d39-af20-01c74109d398 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:42.012664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4dc586-8f71-4faf-aa45-481b0cbe6eb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:42.015927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4dc586-8f71-4faf-aa45-481b0cbe6eb6 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:42.036805 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 905/1795] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:42.049024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ffe9f-69c1-48d0-a651-b9a949cfe39d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:42.049024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ffe9f-69c1-48d0-a651-b9a949cfe39d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:42.049024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ffe9f-69c1-48d0-a651-b9a949cfe39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:42.077866 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 891/1796] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:41 2022] PUT /identity/v3/projects/3542b4b8761349c1826612240b01ba6b/users/f5f6cef4a1d4400589c48ec606ae4dae/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:42.077866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd27ed-cde1-4d39-af20-01c74109d398 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:42.088461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d83ffe9f-69c1-48d0-a651-b9a949cfe39d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:42.088461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d83ffe9f-69c1-48d0-a651-b9a949cfe39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:42.130995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:42.158067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:42.196614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:42.223832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd27ed-cde1-4d39-af20-01c74109d398 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:42.233701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf5517-290c-4099-96ad-72808fadc532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:42.233701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf5517-290c-4099-96ad-72808fadc532 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:42.233701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf5517-290c-4099-96ad-72808fadc532 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:42.233701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf5517-290c-4099-96ad-72808fadc532 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:42.235159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf5517-290c-4099-96ad-72808fadc532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:42.240220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf5517-290c-4099-96ad-72808fadc532 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:42.290307 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 906/1797] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:42.292156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ab6a4-c6e1-4035-9f29-2de0c35074d9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:42.292507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ab6a4-c6e1-4035-9f29-2de0c35074d9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:42.292861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ab6a4-c6e1-4035-9f29-2de0c35074d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:42.334245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bc4ab6a4-c6e1-4035-9f29-2de0c35074d9 None None] MFA Rules not processed for user `f5f6cef4a1d4400589c48ec606ae4dae`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:42.336351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bc4ab6a4-c6e1-4035-9f29-2de0c35074d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:42.397872 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 892/1798] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:42 2022] POST /identity/v3/projects => generated 381 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:42.397872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf5517-290c-4099-96ad-72808fadc532 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:42.508579 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 907/1799] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:42.510614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ab6a4-c6e1-4035-9f29-2de0c35074d9 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:42.548810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ab6a4-c6e1-4035-9f29-2de0c35074d9 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:42.556218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c2ee4-d87b-49df-8a47-3d17ea8f87df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:42.557287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c2ee4-d87b-49df-8a47-3d17ea8f87df admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:42.557738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c2ee4-d87b-49df-8a47-3d17ea8f87df admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:42.558310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c2ee4-d87b-49df-8a47-3d17ea8f87df admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:42.559132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c2ee4-d87b-49df-8a47-3d17ea8f87df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:42.561354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf5517-290c-4099-96ad-72808fadc532 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:42.568739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c2ee4-d87b-49df-8a47-3d17ea8f87df admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:42.568875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0baf55-96dd-4778-a56c-17e171e663b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:42.568875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0baf55-96dd-4778-a56c-17e171e663b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:42.575484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0baf55-96dd-4778-a56c-17e171e663b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:42.576373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0baf55-96dd-4778-a56c-17e171e663b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:42.577761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0baf55-96dd-4778-a56c-17e171e663b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:42.580449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0baf55-96dd-4778-a56c-17e171e663b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:42.583431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0baf55-96dd-4778-a56c-17e171e663b6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:42.600823 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 893/1800] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:42.602010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0baf55-96dd-4778-a56c-17e171e663b6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:42.606254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ad0baf55-96dd-4778-a56c-17e171e663b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:42.624067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0baf55-96dd-4778-a56c-17e171e663b6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:42.631515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd0d78-4dce-4443-9db4-aed3921365d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:42.639472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd0d78-4dce-4443-9db4-aed3921365d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:42.639472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd0d78-4dce-4443-9db4-aed3921365d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:42.639472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd0d78-4dce-4443-9db4-aed3921365d6 admin admin] PATH_INFO: `/v3/projects/a9d7f623110e42e0a1dad7890cc646ed` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:42.643999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd0d78-4dce-4443-9db4-aed3921365d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9d7f623110e42e0a1dad7890cc646ed)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:42.666814 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 908/1801] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:42 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:42.670992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd0d78-4dce-4443-9db4-aed3921365d6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:42.671389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c2ee4-d87b-49df-8a47-3d17ea8f87df admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:42.706625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c2ee4-d87b-49df-8a47-3d17ea8f87df admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:42.736352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dda05b-7db8-47f3-a2cd-e1f7787713ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:42.737111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda05b-7db8-47f3-a2cd-e1f7787713ff admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:42.737465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda05b-7db8-47f3-a2cd-e1f7787713ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:42.737754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dda05b-7db8-47f3-a2cd-e1f7787713ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:42.739630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dda05b-7db8-47f3-a2cd-e1f7787713ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:42.744962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dda05b-7db8-47f3-a2cd-e1f7787713ff admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:42.861129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-13cd0d78-4dce-4443-9db4-aed3921365d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9d7f623110e42e0a1dad7890cc646ed', 'request_id': 'req-13cd0d78-4dce-4443-9db4-aed3921365d6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:42.872286 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 909/1802] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:42 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:42.875199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dda05b-7db8-47f3-a2cd-e1f7787713ff admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:42.876817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-13cd0d78-4dce-4443-9db4-aed3921365d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9d7f623110e42e0a1dad7890cc646ed', 'request_id': 'req-13cd0d78-4dce-4443-9db4-aed3921365d6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:42.896767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-13cd0d78-4dce-4443-9db4-aed3921365d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9d7f623110e42e0a1dad7890cc646ed', 'request_id': 'req-13cd0d78-4dce-4443-9db4-aed3921365d6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:42.980500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-13cd0d78-4dce-4443-9db4-aed3921365d6 admin admin] The token cache is being invalidate because project a9d7f623110e42e0a1dad7890cc646ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:42.981046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-13cd0d78-4dce-4443-9db4-aed3921365d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:42.983188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-13cd0d78-4dce-4443-9db4-aed3921365d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:42.985744 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 894/1803] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:42 2022] DELETE /identity/v3/projects/a9d7f623110e42e0a1dad7890cc646ed => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:42.989129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd0d78-4dce-4443-9db4-aed3921365d6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:42.994452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-13cd0d78-4dce-4443-9db4-aed3921365d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:43.030843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:43.041808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dda05b-7db8-47f3-a2cd-e1f7787713ff admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:43.054909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea5baa-6519-4f2b-993d-5d4c62174303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:43.055656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea5baa-6519-4f2b-993d-5d4c62174303 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:43.056001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea5baa-6519-4f2b-993d-5d4c62174303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:43.056323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea5baa-6519-4f2b-993d-5d4c62174303 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:43.057998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea5baa-6519-4f2b-993d-5d4c62174303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:43.060818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea5baa-6519-4f2b-993d-5d4c62174303 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:43.150345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd0d78-4dce-4443-9db4-aed3921365d6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:43.160781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c798f-a897-4bbf-9ed9-866de8a995d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:43.161737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c798f-a897-4bbf-9ed9-866de8a995d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:43.162387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c798f-a897-4bbf-9ed9-866de8a995d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:43.162863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c798f-a897-4bbf-9ed9-866de8a995d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:43.163856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c798f-a897-4bbf-9ed9-866de8a995d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:43.166268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c798f-a897-4bbf-9ed9-866de8a995d5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:43.185592 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 895/1804] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:43.192500 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 910/1805] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:42 2022] POST /identity/v3/projects => generated 409 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:43.192789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea5baa-6519-4f2b-993d-5d4c62174303 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:43.193331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c798f-a897-4bbf-9ed9-866de8a995d5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:43.195362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6d1c798f-a897-4bbf-9ed9-866de8a995d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:43.202976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e6ea5baa-6519-4f2b-993d-5d4c62174303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:43.219436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c798f-a897-4bbf-9ed9-866de8a995d5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:43.277688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:43.295994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea5baa-6519-4f2b-993d-5d4c62174303 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:43.306800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150aaf0f-9901-4680-8c1d-519c0ed6ade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:43.307858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150aaf0f-9901-4680-8c1d-519c0ed6ade0 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:43.308137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150aaf0f-9901-4680-8c1d-519c0ed6ade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:43.310527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150aaf0f-9901-4680-8c1d-519c0ed6ade0 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:43.310527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150aaf0f-9901-4680-8c1d-519c0ed6ade0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:43.312945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150aaf0f-9901-4680-8c1d-519c0ed6ade0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:43.327048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc57b2-6fd5-4ba2-85e7-06696b4f8c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:43.327768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc57b2-6fd5-4ba2-85e7-06696b4f8c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:43.328111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc57b2-6fd5-4ba2-85e7-06696b4f8c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:43.328505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc57b2-6fd5-4ba2-85e7-06696b4f8c3b admin admin] PATH_INFO: `/v3/users/8e85936a073c48b7a8dc4d1ab9d26559` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:43.330145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc57b2-6fd5-4ba2-85e7-06696b4f8c3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e85936a073c48b7a8dc4d1ab9d26559)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:43.333405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc57b2-6fd5-4ba2-85e7-06696b4f8c3b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:43.444662 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 911/1806] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:43 2022] POST /identity/v3/users => generated 298 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:43.445442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150aaf0f-9901-4680-8c1d-519c0ed6ade0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:43.448445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-150aaf0f-9901-4680-8c1d-519c0ed6ade0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:43.461635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150aaf0f-9901-4680-8c1d-519c0ed6ade0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:43.467002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e725024-ca89-4895-9b1e-ff29c1321a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:43.467804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e725024-ca89-4895-9b1e-ff29c1321a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:43.468090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e725024-ca89-4895-9b1e-ff29c1321a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:43.468413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e725024-ca89-4895-9b1e-ff29c1321a1f admin admin] PATH_INFO: `/v3/users/bb6a9fc1e55e48ba970953739d1a9918` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:43.470544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e725024-ca89-4895-9b1e-ff29c1321a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb6a9fc1e55e48ba970953739d1a9918)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:43.474254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e725024-ca89-4895-9b1e-ff29c1321a1f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:43.610505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-27bc57b2-6fd5-4ba2-85e7-06696b4f8c3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e85936a073c48b7a8dc4d1ab9d26559'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:43.740392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-27bc57b2-6fd5-4ba2-85e7-06696b4f8c3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e85936a073c48b7a8dc4d1ab9d26559'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:43.740940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-27bc57b2-6fd5-4ba2-85e7-06696b4f8c3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e85936a073c48b7a8dc4d1ab9d26559'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:43.744361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:43.750040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5e725024-ca89-4895-9b1e-ff29c1321a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb6a9fc1e55e48ba970953739d1a9918'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:43.750803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5e725024-ca89-4895-9b1e-ff29c1321a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb6a9fc1e55e48ba970953739d1a9918'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:43.757813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-27bc57b2-6fd5-4ba2-85e7-06696b4f8c3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e85936a073c48b7a8dc4d1ab9d26559'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:43.788595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-27bc57b2-6fd5-4ba2-85e7-06696b4f8c3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e85936a073c48b7a8dc4d1ab9d26559'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:43.796919 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 896/1807] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:43 2022] DELETE /identity/v3/users/8e85936a073c48b7a8dc4d1ab9d26559 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:43.798172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc57b2-6fd5-4ba2-85e7-06696b4f8c3b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:43.800112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-27bc57b2-6fd5-4ba2-85e7-06696b4f8c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:43.858365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5e725024-ca89-4895-9b1e-ff29c1321a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb6a9fc1e55e48ba970953739d1a9918'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:43.859078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5e725024-ca89-4895-9b1e-ff29c1321a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb6a9fc1e55e48ba970953739d1a9918'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:43.873836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5e725024-ca89-4895-9b1e-ff29c1321a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb6a9fc1e55e48ba970953739d1a9918'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:43.891753 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 912/1808] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:43 2022] DELETE /identity/v3/users/bb6a9fc1e55e48ba970953739d1a9918 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:43.891952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc57b2-6fd5-4ba2-85e7-06696b4f8c3b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:43.893113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e725024-ca89-4895-9b1e-ff29c1321a1f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:43.895150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5e725024-ca89-4895-9b1e-ff29c1321a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:43.992304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:44.005080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55226c53-c684-4c28-8a5e-2370da0c26ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:44.005832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55226c53-c684-4c28-8a5e-2370da0c26ff admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:44.006403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55226c53-c684-4c28-8a5e-2370da0c26ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:44.006403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55226c53-c684-4c28-8a5e-2370da0c26ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:44.007021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55226c53-c684-4c28-8a5e-2370da0c26ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:44.010601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55226c53-c684-4c28-8a5e-2370da0c26ff admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:44.031824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e725024-ca89-4895-9b1e-ff29c1321a1f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:44.040775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b279cb0-8468-4819-a46a-f9afa21edf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:44.041483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b279cb0-8468-4819-a46a-f9afa21edf35 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:44.043159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b279cb0-8468-4819-a46a-f9afa21edf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:44.043447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b279cb0-8468-4819-a46a-f9afa21edf35 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:44.044004 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 897/1809] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:44.044135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b279cb0-8468-4819-a46a-f9afa21edf35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:44.044930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55226c53-c684-4c28-8a5e-2370da0c26ff admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:44.049371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b279cb0-8468-4819-a46a-f9afa21edf35 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:44.053693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-55226c53-c684-4c28-8a5e-2370da0c26ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:44.074454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55226c53-c684-4c28-8a5e-2370da0c26ff admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:44.079653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fa470-47fa-46c9-a700-43ce1ff17d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:44.082955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fa470-47fa-46c9-a700-43ce1ff17d5a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:44.082955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fa470-47fa-46c9-a700-43ce1ff17d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:44.082955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fa470-47fa-46c9-a700-43ce1ff17d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:44.082955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fa470-47fa-46c9-a700-43ce1ff17d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:44.085948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fa470-47fa-46c9-a700-43ce1ff17d5a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:44.105309 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 898/1810] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:44.105309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacfa0a-62fb-48f4-b4bb-9901523ea56f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:44.105309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacfa0a-62fb-48f4-b4bb-9901523ea56f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:44.105309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacfa0a-62fb-48f4-b4bb-9901523ea56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:44.111641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:44.134238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ffacfa0a-62fb-48f4-b4bb-9901523ea56f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:44.136193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ffacfa0a-62fb-48f4-b4bb-9901523ea56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:44.144606 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 913/1811] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:43 2022] POST /identity/v3/users => generated 305 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:44.144606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b279cb0-8468-4819-a46a-f9afa21edf35 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:44.147541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7b279cb0-8468-4819-a46a-f9afa21edf35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:44.153855 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 899/1812] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:44.154875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacfa0a-62fb-48f4-b4bb-9901523ea56f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:44.165644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacfa0a-62fb-48f4-b4bb-9901523ea56f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:44.167330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b279cb0-8468-4819-a46a-f9afa21edf35 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:44.172657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c0cfd-358a-4446-aef4-8f33366b9981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:44.173589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c0cfd-358a-4446-aef4-8f33366b9981 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:44.174133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c0cfd-358a-4446-aef4-8f33366b9981 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:44.174683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c0cfd-358a-4446-aef4-8f33366b9981 admin admin] PATH_INFO: `/v3/projects/f078c5c4c11d43b5af5486e99df69078/users/23b8e2226dec438ea3e84280de6a48a7/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:44.175536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3da2e-b04e-42b2-94f6-346aa244806d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:44.180715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3da2e-b04e-42b2-94f6-346aa244806d admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:44.185721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3da2e-b04e-42b2-94f6-346aa244806d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:44.186367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3da2e-b04e-42b2-94f6-346aa244806d admin admin] PATH_INFO: `/v3/projects/47348d84e2d94af4966603cd6ea2ce84/users/ffc14988e7f04e45adbdf9c02c4010dc/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:44.204154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c0cfd-358a-4446-aef4-8f33366b9981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f078c5c4c11d43b5af5486e99df69078, user_id=23b8e2226dec438ea3e84280de6a48a7, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:44.216772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3da2e-b04e-42b2-94f6-346aa244806d admin admin] RBAC: Authorizing `identity:create_grant(project_id=47348d84e2d94af4966603cd6ea2ce84, user_id=ffc14988e7f04e45adbdf9c02c4010dc, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:44.220465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3da2e-b04e-42b2-94f6-346aa244806d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:44.229674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c0cfd-358a-4446-aef4-8f33366b9981 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:44.365781 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 914/1813] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:44 2022] PUT /identity/v3/projects/47348d84e2d94af4966603cd6ea2ce84/users/ffc14988e7f04e45adbdf9c02c4010dc/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:44.367093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3da2e-b04e-42b2-94f6-346aa244806d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:44.396949 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 900/1814] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:44 2022] PUT /identity/v3/projects/f078c5c4c11d43b5af5486e99df69078/users/23b8e2226dec438ea3e84280de6a48a7/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:44.398187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c0cfd-358a-4446-aef4-8f33366b9981 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:44.400961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3f2c0cfd-358a-4446-aef4-8f33366b9981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:44.483214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:44.523491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:44.532914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3da2e-b04e-42b2-94f6-346aa244806d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:44.543720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c0cfd-358a-4446-aef4-8f33366b9981 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:44.549609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adb881-5107-479d-b96e-76a08be149c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:44.550089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adb881-5107-479d-b96e-76a08be149c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:44.550368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adb881-5107-479d-b96e-76a08be149c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:44.554838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adb881-5107-479d-b96e-76a08be149c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:44.588653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=87,keystone:INSERT=8,keystone:DELETE=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:44.625357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64521bf2-71fe-4c2c-8888-5ef0b73b36a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:44.626343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64521bf2-71fe-4c2c-8888-5ef0b73b36a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:44.626909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64521bf2-71fe-4c2c-8888-5ef0b73b36a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:44.631480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64521bf2-71fe-4c2c-8888-5ef0b73b36a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:44.631480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64521bf2-71fe-4c2c-8888-5ef0b73b36a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:44.632364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64521bf2-71fe-4c2c-8888-5ef0b73b36a9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:44.660533 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 915/1815] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:44.663320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff9df8-c325-457f-9907-85cb30bb378a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:44.663320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff9df8-c325-457f-9907-85cb30bb378a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:44.663698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff9df8-c325-457f-9907-85cb30bb378a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:44.670012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adb881-5107-479d-b96e-76a08be149c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:44.671706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adb881-5107-479d-b96e-76a08be149c2 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:44.703635 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 901/1816] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:44.703635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adb881-5107-479d-b96e-76a08be149c2 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:44.716303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-85ff9df8-c325-457f-9907-85cb30bb378a None None] MFA Rules not processed for user `ffc14988e7f04e45adbdf9c02c4010dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:44.717590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-85ff9df8-c325-457f-9907-85cb30bb378a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:44.729359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adb881-5107-479d-b96e-76a08be149c2 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:44.748033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5b3a8-86d5-4862-9268-598f964bb5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:44.748707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5b3a8-86d5-4862-9268-598f964bb5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:44.749060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5b3a8-86d5-4862-9268-598f964bb5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:44.749447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5b3a8-86d5-4862-9268-598f964bb5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:44.751189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5b3a8-86d5-4862-9268-598f964bb5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:44.753076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5b3a8-86d5-4862-9268-598f964bb5c4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:44.784093 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 902/1817] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:44.785114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5b3a8-86d5-4862-9268-598f964bb5c4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:44.798821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5b3a8-86d5-4862-9268-598f964bb5c4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:44.813903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd4a7d-c4a7-4605-89da-27aa935d3082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:44.815255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd4a7d-c4a7-4605-89da-27aa935d3082 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:44.815588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd4a7d-c4a7-4605-89da-27aa935d3082 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:44.815863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd4a7d-c4a7-4605-89da-27aa935d3082 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:44.817586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd4a7d-c4a7-4605-89da-27aa935d3082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:44.821435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd4a7d-c4a7-4605-89da-27aa935d3082 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:44.855423 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 903/1818] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:44.856934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd4a7d-c4a7-4605-89da-27aa935d3082 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:44.860950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e6cd4a7d-c4a7-4605-89da-27aa935d3082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:44.870757 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 916/1819] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:44.871759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff9df8-c325-457f-9907-85cb30bb378a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:44.888095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff9df8-c325-457f-9907-85cb30bb378a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:44.892713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd4a7d-c4a7-4605-89da-27aa935d3082 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:44.893716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a9212-644f-44b6-a19d-a90f45f902ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:44.894464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a9212-644f-44b6-a19d-a90f45f902ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:44.894782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a9212-644f-44b6-a19d-a90f45f902ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:44.895053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a9212-644f-44b6-a19d-a90f45f902ed admin admin] PATH_INFO: `/v3/projects/f078c5c4c11d43b5af5486e99df69078/users/23b8e2226dec438ea3e84280de6a48a7/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:44.897246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a9212-644f-44b6-a19d-a90f45f902ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f078c5c4c11d43b5af5486e99df69078, user_id=23b8e2226dec438ea3e84280de6a48a7, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:44.900338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a9212-644f-44b6-a19d-a90f45f902ed admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:44.901606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f650f5a-d07a-4545-9184-373c9a53f965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:44.902451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f650f5a-d07a-4545-9184-373c9a53f965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:44.903180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f650f5a-d07a-4545-9184-373c9a53f965 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:44.903572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f650f5a-d07a-4545-9184-373c9a53f965 admin admin] PATH_INFO: `/v3/projects/a748fb909db84586a68a8e013258931f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:44.909392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f650f5a-d07a-4545-9184-373c9a53f965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a748fb909db84586a68a8e013258931f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:44.914734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f650f5a-d07a-4545-9184-373c9a53f965 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:44.930087 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 917/1820] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:44 2022] PUT /identity/v3/projects/f078c5c4c11d43b5af5486e99df69078/users/23b8e2226dec438ea3e84280de6a48a7/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:44.931116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a9212-644f-44b6-a19d-a90f45f902ed admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:45.054647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a9212-644f-44b6-a19d-a90f45f902ed admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:45.059719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af671e-46b3-4c52-bab5-e134d4816955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:45.060577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af671e-46b3-4c52-bab5-e134d4816955 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:45.060862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af671e-46b3-4c52-bab5-e134d4816955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:45.061119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af671e-46b3-4c52-bab5-e134d4816955 admin admin] PATH_INFO: `/v3/projects/3abc374e90e84a308dc532e53f122985/users/166ca64f550e494fb63a945322b85c34/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:45.076455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af671e-46b3-4c52-bab5-e134d4816955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abc374e90e84a308dc532e53f122985, user_id=166ca64f550e494fb63a945322b85c34, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:45.079675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af671e-46b3-4c52-bab5-e134d4816955 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:45.128065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:45.219602 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 918/1821] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:44 2022] PUT /identity/v3/projects/3abc374e90e84a308dc532e53f122985/users/166ca64f550e494fb63a945322b85c34/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:45.220514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af671e-46b3-4c52-bab5-e134d4816955 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:45.237506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7f650f5a-d07a-4545-9184-373c9a53f965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a748fb909db84586a68a8e013258931f', 'request_id': 'req-7f650f5a-d07a-4545-9184-373c9a53f965'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:45.244339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7f650f5a-d07a-4545-9184-373c9a53f965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a748fb909db84586a68a8e013258931f', 'request_id': 'req-7f650f5a-d07a-4545-9184-373c9a53f965'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:45.265254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7f650f5a-d07a-4545-9184-373c9a53f965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a748fb909db84586a68a8e013258931f', 'request_id': 'req-7f650f5a-d07a-4545-9184-373c9a53f965'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:45.304912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af671e-46b3-4c52-bab5-e134d4816955 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:45.358069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:45.363435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a829f8-9013-406d-94b5-5acc9da7d9ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:45.364248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a829f8-9013-406d-94b5-5acc9da7d9ad service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:45.364390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a829f8-9013-406d-94b5-5acc9da7d9ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:45.364629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a829f8-9013-406d-94b5-5acc9da7d9ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:45.402251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7f650f5a-d07a-4545-9184-373c9a53f965 admin admin] The token cache is being invalidate because project a748fb909db84586a68a8e013258931f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:45.402539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7f650f5a-d07a-4545-9184-373c9a53f965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:45.403264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7f650f5a-d07a-4545-9184-373c9a53f965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:45.404812 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 904/1822] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:44 2022] DELETE /identity/v3/projects/a748fb909db84586a68a8e013258931f => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:45.406097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523cdc2-d2c5-4751-989b-71ec983a451a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:45.406355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523cdc2-d2c5-4751-989b-71ec983a451a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:45.406635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523cdc2-d2c5-4751-989b-71ec983a451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:45.438228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a829f8-9013-406d-94b5-5acc9da7d9ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:45.439379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b523cdc2-d2c5-4751-989b-71ec983a451a None None] MFA Rules not processed for user `23b8e2226dec438ea3e84280de6a48a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:45.440408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a829f8-9013-406d-94b5-5acc9da7d9ad service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:45.440769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b523cdc2-d2c5-4751-989b-71ec983a451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:45.451810 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 919/1823] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:45.453368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a8a5e-5795-44ad-a9bf-56d2d06da698 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:45.453617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a8a5e-5795-44ad-a9bf-56d2d06da698 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:45.453881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a8a5e-5795-44ad-a9bf-56d2d06da698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:45.500121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-869a8a5e-5795-44ad-a9bf-56d2d06da698 None None] MFA Rules not processed for user `166ca64f550e494fb63a945322b85c34`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:45.501918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-869a8a5e-5795-44ad-a9bf-56d2d06da698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:45.576319 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 905/1824] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:45.587813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523cdc2-d2c5-4751-989b-71ec983a451a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:45.595003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b523cdc2-d2c5-4751-989b-71ec983a451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:45.634030 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 920/1825] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:45 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:45.635531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a8a5e-5795-44ad-a9bf-56d2d06da698 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:45.640926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-869a8a5e-5795-44ad-a9bf-56d2d06da698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:45.750553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523cdc2-d2c5-4751-989b-71ec983a451a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:45.756747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844c5e9-339f-400f-8ba4-85b732e4371e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:45.757521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844c5e9-339f-400f-8ba4-85b732e4371e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:45.757822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844c5e9-339f-400f-8ba4-85b732e4371e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:45.758099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844c5e9-339f-400f-8ba4-85b732e4371e admin admin] PATH_INFO: `/v3/projects/5fa92687e4ed4c3895a95a733decc212` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:45.759257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844c5e9-339f-400f-8ba4-85b732e4371e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa92687e4ed4c3895a95a733decc212)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:45.762749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844c5e9-339f-400f-8ba4-85b732e4371e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:45.767281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a8a5e-5795-44ad-a9bf-56d2d06da698 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:45.774407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d3fc5-568b-4ec8-b0b0-265e67601ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:45.775477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d3fc5-568b-4ec8-b0b0-265e67601ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:45.775966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d3fc5-568b-4ec8-b0b0-265e67601ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:45.776477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d3fc5-568b-4ec8-b0b0-265e67601ab4 admin admin] PATH_INFO: `/v3/users/61d5fcdacfb142e696bc86b0499d4e3e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:45.787134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d3fc5-568b-4ec8-b0b0-265e67601ab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61d5fcdacfb142e696bc86b0499d4e3e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:45.789184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d3fc5-568b-4ec8-b0b0-265e67601ab4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:46.107878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0844c5e9-339f-400f-8ba4-85b732e4371e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa92687e4ed4c3895a95a733decc212', 'request_id': 'req-0844c5e9-339f-400f-8ba4-85b732e4371e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:46.108590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c89d3fc5-568b-4ec8-b0b0-265e67601ab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61d5fcdacfb142e696bc86b0499d4e3e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:46.109398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c89d3fc5-568b-4ec8-b0b0-265e67601ab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61d5fcdacfb142e696bc86b0499d4e3e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:46.117461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:46.120609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0844c5e9-339f-400f-8ba4-85b732e4371e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa92687e4ed4c3895a95a733decc212', 'request_id': 'req-0844c5e9-339f-400f-8ba4-85b732e4371e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:46.126277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0844c5e9-339f-400f-8ba4-85b732e4371e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa92687e4ed4c3895a95a733decc212', 'request_id': 'req-0844c5e9-339f-400f-8ba4-85b732e4371e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:46.212808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c89d3fc5-568b-4ec8-b0b0-265e67601ab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61d5fcdacfb142e696bc86b0499d4e3e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:46.213429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c89d3fc5-568b-4ec8-b0b0-265e67601ab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61d5fcdacfb142e696bc86b0499d4e3e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:46.226433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c89d3fc5-568b-4ec8-b0b0-265e67601ab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61d5fcdacfb142e696bc86b0499d4e3e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:46.240593 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 921/1826] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:45 2022] DELETE /identity/v3/users/61d5fcdacfb142e696bc86b0499d4e3e => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:46.241377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d3fc5-568b-4ec8-b0b0-265e67601ab4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:46.242969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c89d3fc5-568b-4ec8-b0b0-265e67601ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:46.307694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0844c5e9-339f-400f-8ba4-85b732e4371e admin admin] The token cache is being invalidate because project 5fa92687e4ed4c3895a95a733decc212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:46.308073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0844c5e9-339f-400f-8ba4-85b732e4371e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:46.308829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0844c5e9-339f-400f-8ba4-85b732e4371e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:46.313681 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 906/1827] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:45 2022] DELETE /identity/v3/projects/5fa92687e4ed4c3895a95a733decc212 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:46.313681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844c5e9-339f-400f-8ba4-85b732e4371e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:46.314288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0844c5e9-339f-400f-8ba4-85b732e4371e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:46.319251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d3fc5-568b-4ec8-b0b0-265e67601ab4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:46.331809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb93ce6-156a-4a7e-bcdc-736883513c73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:46.333108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb93ce6-156a-4a7e-bcdc-736883513c73 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:46.333400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb93ce6-156a-4a7e-bcdc-736883513c73 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:46.333677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb93ce6-156a-4a7e-bcdc-736883513c73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:46.335497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1eb93ce6-156a-4a7e-bcdc-736883513c73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:46.381331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844c5e9-339f-400f-8ba4-85b732e4371e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:46.399647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb93ce6-156a-4a7e-bcdc-736883513c73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:46.401349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb93ce6-156a-4a7e-bcdc-736883513c73 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:46.411589 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 922/1828] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:46.412428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb93ce6-156a-4a7e-bcdc-736883513c73 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:46.413850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1eb93ce6-156a-4a7e-bcdc-736883513c73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:46.430764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:46.444934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249731f-053c-4d26-8a64-35c041d54ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:46.446661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249731f-053c-4d26-8a64-35c041d54ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:46.447265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249731f-053c-4d26-8a64-35c041d54ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:46.457241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249731f-053c-4d26-8a64-35c041d54ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:46.458932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249731f-053c-4d26-8a64-35c041d54ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:46.461375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249731f-053c-4d26-8a64-35c041d54ba4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:46.518273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb93ce6-156a-4a7e-bcdc-736883513c73 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:46.524557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3694e-4ec9-465d-8bc4-85ec88fd893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:46.525337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3694e-4ec9-465d-8bc4-85ec88fd893b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:46.525823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3694e-4ec9-465d-8bc4-85ec88fd893b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:46.526197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3694e-4ec9-465d-8bc4-85ec88fd893b admin admin] PATH_INFO: `/v3/users/ffc14988e7f04e45adbdf9c02c4010dc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:46.527474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3694e-4ec9-465d-8bc4-85ec88fd893b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc14988e7f04e45adbdf9c02c4010dc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:46.529765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3694e-4ec9-465d-8bc4-85ec88fd893b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:46.593989 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 907/1829] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:46 2022] POST /identity/v3/projects => generated 411 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:46.595124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249731f-053c-4d26-8a64-35c041d54ba4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:46.599908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a249731f-053c-4d26-8a64-35c041d54ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:46.671169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249731f-053c-4d26-8a64-35c041d54ba4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:46.676832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594b2df-6c6d-4d62-94f1-e3bdb0d023f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:46.677872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594b2df-6c6d-4d62-94f1-e3bdb0d023f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:46.678156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594b2df-6c6d-4d62-94f1-e3bdb0d023f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:46.678554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594b2df-6c6d-4d62-94f1-e3bdb0d023f2 admin admin] PATH_INFO: `/v3/users/91380adca9974e108ab3c74ec0f17237` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:46.679722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594b2df-6c6d-4d62-94f1-e3bdb0d023f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91380adca9974e108ab3c74ec0f17237)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:46.681761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594b2df-6c6d-4d62-94f1-e3bdb0d023f2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:46.740647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-80b3694e-4ec9-465d-8bc4-85ec88fd893b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc14988e7f04e45adbdf9c02c4010dc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:46.745814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-80b3694e-4ec9-465d-8bc4-85ec88fd893b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc14988e7f04e45adbdf9c02c4010dc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:46.813100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-80b3694e-4ec9-465d-8bc4-85ec88fd893b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc14988e7f04e45adbdf9c02c4010dc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:46.813310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:46.813837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-80b3694e-4ec9-465d-8bc4-85ec88fd893b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc14988e7f04e45adbdf9c02c4010dc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:46.827532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-80b3694e-4ec9-465d-8bc4-85ec88fd893b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc14988e7f04e45adbdf9c02c4010dc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:46.840259 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 923/1830] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:46 2022] DELETE /identity/v3/users/ffc14988e7f04e45adbdf9c02c4010dc => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:46.841044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3694e-4ec9-465d-8bc4-85ec88fd893b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:46.842473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-80b3694e-4ec9-465d-8bc4-85ec88fd893b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:46.895653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6594b2df-6c6d-4d62-94f1-e3bdb0d023f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91380adca9974e108ab3c74ec0f17237'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:46.921929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3694e-4ec9-465d-8bc4-85ec88fd893b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:46.921929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08a814-d31b-4409-8dbf-03d321d204e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:46.921929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08a814-d31b-4409-8dbf-03d321d204e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:46.921929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08a814-d31b-4409-8dbf-03d321d204e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:46.922355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08a814-d31b-4409-8dbf-03d321d204e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:46.922355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08a814-d31b-4409-8dbf-03d321d204e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:46.922355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08a814-d31b-4409-8dbf-03d321d204e7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:46.938844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:46.990086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6594b2df-6c6d-4d62-94f1-e3bdb0d023f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91380adca9974e108ab3c74ec0f17237'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:46.990712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6594b2df-6c6d-4d62-94f1-e3bdb0d023f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91380adca9974e108ab3c74ec0f17237'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:47.002086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6594b2df-6c6d-4d62-94f1-e3bdb0d023f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91380adca9974e108ab3c74ec0f17237'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:47.008461 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 924/1831] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:46 2022] POST /identity/v3/users => generated 312 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:47.009763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08a814-d31b-4409-8dbf-03d321d204e7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:47.012580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2b08a814-d31b-4409-8dbf-03d321d204e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:47.015881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6594b2df-6c6d-4d62-94f1-e3bdb0d023f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91380adca9974e108ab3c74ec0f17237'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:47.024331 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 908/1832] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:46 2022] DELETE /identity/v3/users/91380adca9974e108ab3c74ec0f17237 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:47.025676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099510a-196d-4632-9168-97f289bd1ce4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:47.026112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099510a-196d-4632-9168-97f289bd1ce4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:47.026395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099510a-196d-4632-9168-97f289bd1ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:47.030879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08a814-d31b-4409-8dbf-03d321d204e7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:47.048590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1099510a-196d-4632-9168-97f289bd1ce4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:47.049985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1099510a-196d-4632-9168-97f289bd1ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:47.122737 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 909/1833] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:47.124433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099510a-196d-4632-9168-97f289bd1ce4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:47.128025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f4a70-856e-4aa0-9bc4-62ce97946af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:47.128025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f4a70-856e-4aa0-9bc4-62ce97946af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:47.128741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1099510a-196d-4632-9168-97f289bd1ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:47.128841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f4a70-856e-4aa0-9bc4-62ce97946af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:47.128841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f4a70-856e-4aa0-9bc4-62ce97946af9 admin admin] PATH_INFO: `/v3/projects/a077b614074d407c8b5b1053febfc109` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:47.128841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f4a70-856e-4aa0-9bc4-62ce97946af9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a077b614074d407c8b5b1053febfc109)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:47.130560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f4a70-856e-4aa0-9bc4-62ce97946af9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:47.140428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099510a-196d-4632-9168-97f289bd1ce4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:47.150993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd214c-f1f2-40b4-9859-2f6d7c373306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:47.150993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd214c-f1f2-40b4-9859-2f6d7c373306 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:47.150993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd214c-f1f2-40b4-9859-2f6d7c373306 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:47.150993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd214c-f1f2-40b4-9859-2f6d7c373306 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:47.151429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd214c-f1f2-40b4-9859-2f6d7c373306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:47.151429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd214c-f1f2-40b4-9859-2f6d7c373306 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:47.160434 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 910/1834] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:47.161467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd214c-f1f2-40b4-9859-2f6d7c373306 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:47.163189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a2dd214c-f1f2-40b4-9859-2f6d7c373306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:47.197197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:47.221553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd214c-f1f2-40b4-9859-2f6d7c373306 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:47.226736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637e106-43f8-4644-99d8-599eae77e9cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:47.227365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637e106-43f8-4644-99d8-599eae77e9cd service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:47.227696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637e106-43f8-4644-99d8-599eae77e9cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:47.227997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637e106-43f8-4644-99d8-599eae77e9cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:47.240780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637e106-43f8-4644-99d8-599eae77e9cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:47.242724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637e106-43f8-4644-99d8-599eae77e9cd service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:47.251199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ea9f4a70-856e-4aa0-9bc4-62ce97946af9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a077b614074d407c8b5b1053febfc109', 'request_id': 'req-ea9f4a70-856e-4aa0-9bc4-62ce97946af9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:47.256112 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 911/1835] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:47.263716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637e106-43f8-4644-99d8-599eae77e9cd service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:47.263846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ea9f4a70-856e-4aa0-9bc4-62ce97946af9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a077b614074d407c8b5b1053febfc109', 'request_id': 'req-ea9f4a70-856e-4aa0-9bc4-62ce97946af9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:47.269445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637e106-43f8-4644-99d8-599eae77e9cd service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:47.334898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ea9f4a70-856e-4aa0-9bc4-62ce97946af9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a077b614074d407c8b5b1053febfc109', 'request_id': 'req-ea9f4a70-856e-4aa0-9bc4-62ce97946af9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:47.335809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be30b70-8d27-4c49-9779-73d2858cf81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:47.336522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be30b70-8d27-4c49-9779-73d2858cf81e admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:47.336819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be30b70-8d27-4c49-9779-73d2858cf81e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:47.337056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be30b70-8d27-4c49-9779-73d2858cf81e admin admin] PATH_INFO: `/v3/projects/94f01a9940a74089816f8478000f0013/users/5c5bafb4545743f99bddd79bb2157240/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:47.354984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ea9f4a70-856e-4aa0-9bc4-62ce97946af9 admin admin] The token cache is being invalidate because project a077b614074d407c8b5b1053febfc109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:47.355423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ea9f4a70-856e-4aa0-9bc4-62ce97946af9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:47.356136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ea9f4a70-856e-4aa0-9bc4-62ce97946af9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:47.358159 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 925/1836] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:47 2022] DELETE /identity/v3/projects/a077b614074d407c8b5b1053febfc109 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:47.361213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be30b70-8d27-4c49-9779-73d2858cf81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f01a9940a74089816f8478000f0013, user_id=5c5bafb4545743f99bddd79bb2157240, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:47.361909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be30b70-8d27-4c49-9779-73d2858cf81e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:47.364073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921a652-9e38-4674-b9a5-6b08b66dfcd4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:47.364674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921a652-9e38-4674-b9a5-6b08b66dfcd4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:47.365064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921a652-9e38-4674-b9a5-6b08b66dfcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:47.389344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d921a652-9e38-4674-b9a5-6b08b66dfcd4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:47.392794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d921a652-9e38-4674-b9a5-6b08b66dfcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:47.399544 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 926/1837] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:47.408126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789efc9-a0f1-4d24-b262-2089927a2ec3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:47.408448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789efc9-a0f1-4d24-b262-2089927a2ec3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:47.408788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789efc9-a0f1-4d24-b262-2089927a2ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:47.429057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2789efc9-a0f1-4d24-b262-2089927a2ec3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:47.430251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2789efc9-a0f1-4d24-b262-2089927a2ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:47.438102 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 927/1838] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:38:47.442668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789efc9-a0f1-4d24-b262-2089927a2ec3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:47.449115 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 912/1839] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:47 2022] PUT /identity/v3/projects/94f01a9940a74089816f8478000f0013/users/5c5bafb4545743f99bddd79bb2157240/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:47.451722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789efc9-a0f1-4d24-b262-2089927a2ec3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:47.453264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be30b70-8d27-4c49-9779-73d2858cf81e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:47.454972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9be30b70-8d27-4c49-9779-73d2858cf81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:47.509763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67598bca-c485-444e-8372-6d39d35ab5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:47.512996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67598bca-c485-444e-8372-6d39d35ab5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:47.512996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67598bca-c485-444e-8372-6d39d35ab5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:47.512996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67598bca-c485-444e-8372-6d39d35ab5a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:47.512996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67598bca-c485-444e-8372-6d39d35ab5a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:47.512996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67598bca-c485-444e-8372-6d39d35ab5a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:47.514372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67598bca-c485-444e-8372-6d39d35ab5a7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:47.532215 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 928/1840] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:38:47.536892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67598bca-c485-444e-8372-6d39d35ab5a7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:47.537928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be30b70-8d27-4c49-9779-73d2858cf81e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:47.546955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd0759-68a2-4897-ae5e-e8b5d66064b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:47.547367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67598bca-c485-444e-8372-6d39d35ab5a7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:47.547957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd0759-68a2-4897-ae5e-e8b5d66064b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:47.548496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd0759-68a2-4897-ae5e-e8b5d66064b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:47.548783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd0759-68a2-4897-ae5e-e8b5d66064b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:47.549447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd0759-68a2-4897-ae5e-e8b5d66064b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:47.551683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd0759-68a2-4897-ae5e-e8b5d66064b9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:47.554445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a33d9-b058-4ee3-8516-48e85b8d69ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:47.555261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a33d9-b058-4ee3-8516-48e85b8d69ec admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:47.555738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a33d9-b058-4ee3-8516-48e85b8d69ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:47.556465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a33d9-b058-4ee3-8516-48e85b8d69ec admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:47.557661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a33d9-b058-4ee3-8516-48e85b8d69ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:47.560693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a33d9-b058-4ee3-8516-48e85b8d69ec admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:47.563390 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 913/1841] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:38:47.568626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd0759-68a2-4897-ae5e-e8b5d66064b9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:47.568626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-77dd0759-68a2-4897-ae5e-e8b5d66064b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:47.586273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd0759-68a2-4897-ae5e-e8b5d66064b9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:47.591712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7c8b9-5a36-40f1-aee6-75ef8e3779e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:47.592402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7c8b9-5a36-40f1-aee6-75ef8e3779e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:47.592686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7c8b9-5a36-40f1-aee6-75ef8e3779e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:47.592958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7c8b9-5a36-40f1-aee6-75ef8e3779e0 admin admin] PATH_INFO: `/v3/projects/7014de47600c4336a3e192f1f822a3a6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:47.594166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7c8b9-5a36-40f1-aee6-75ef8e3779e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7014de47600c4336a3e192f1f822a3a6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:47.596106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7c8b9-5a36-40f1-aee6-75ef8e3779e0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:47.660807 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 929/1842] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:47 2022] POST /identity/v3/projects => generated 401 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:47.662071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a33d9-b058-4ee3-8516-48e85b8d69ec admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:47.725103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a33d9-b058-4ee3-8516-48e85b8d69ec admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:47.729773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238422f-89e3-4a68-99cc-86dfa7653ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:47.730424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238422f-89e3-4a68-99cc-86dfa7653ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:47.730700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238422f-89e3-4a68-99cc-86dfa7653ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:47.730968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238422f-89e3-4a68-99cc-86dfa7653ff0 admin admin] PATH_INFO: `/v3/projects/94f01a9940a74089816f8478000f0013/users/5c5bafb4545743f99bddd79bb2157240/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:47.732913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238422f-89e3-4a68-99cc-86dfa7653ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f01a9940a74089816f8478000f0013, user_id=5c5bafb4545743f99bddd79bb2157240, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:47.735523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238422f-89e3-4a68-99cc-86dfa7653ff0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:47.746151 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 930/1843] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:47 2022] PUT /identity/v3/projects/94f01a9940a74089816f8478000f0013/users/5c5bafb4545743f99bddd79bb2157240/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:47.746948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238422f-89e3-4a68-99cc-86dfa7653ff0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:47.766411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-87c7c8b9-5a36-40f1-aee6-75ef8e3779e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7014de47600c4336a3e192f1f822a3a6', 'request_id': 'req-87c7c8b9-5a36-40f1-aee6-75ef8e3779e0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:47.772930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-87c7c8b9-5a36-40f1-aee6-75ef8e3779e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7014de47600c4336a3e192f1f822a3a6', 'request_id': 'req-87c7c8b9-5a36-40f1-aee6-75ef8e3779e0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:47.780797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-87c7c8b9-5a36-40f1-aee6-75ef8e3779e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7014de47600c4336a3e192f1f822a3a6', 'request_id': 'req-87c7c8b9-5a36-40f1-aee6-75ef8e3779e0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:47.809397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238422f-89e3-4a68-99cc-86dfa7653ff0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:47.865893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282be71d-bded-4ecc-84b0-8cba23a5bb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:47.866522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282be71d-bded-4ecc-84b0-8cba23a5bb2e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:47.866790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282be71d-bded-4ecc-84b0-8cba23a5bb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:47.867061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282be71d-bded-4ecc-84b0-8cba23a5bb2e admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:47.867682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282be71d-bded-4ecc-84b0-8cba23a5bb2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:47.869704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282be71d-bded-4ecc-84b0-8cba23a5bb2e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:47.876255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-87c7c8b9-5a36-40f1-aee6-75ef8e3779e0 admin admin] The token cache is being invalidate because project 7014de47600c4336a3e192f1f822a3a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:47.876255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-87c7c8b9-5a36-40f1-aee6-75ef8e3779e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:47.876255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-87c7c8b9-5a36-40f1-aee6-75ef8e3779e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:47.876255 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 914/1844] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:47 2022] DELETE /identity/v3/projects/7014de47600c4336a3e192f1f822a3a6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:47.876255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f1882-bc03-4907-92a7-992f5f59dfec None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:47.876697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f1882-bc03-4907-92a7-992f5f59dfec None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:47.876697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f1882-bc03-4907-92a7-992f5f59dfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:47.901221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-833f1882-bc03-4907-92a7-992f5f59dfec None None] MFA Rules not processed for user `5c5bafb4545743f99bddd79bb2157240`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:47.902431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-833f1882-bc03-4907-92a7-992f5f59dfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:47.955963 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 931/1845] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:47 2022] POST /identity/v3/users => generated 301 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:47.957092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282be71d-bded-4ecc-84b0-8cba23a5bb2e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:47.958732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-282be71d-bded-4ecc-84b0-8cba23a5bb2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:47.970566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282be71d-bded-4ecc-84b0-8cba23a5bb2e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:47.971770 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 915/1846] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:47 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:47.974066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a455d1-3a92-4726-9d90-5ff6de1f55af None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:47.974356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a455d1-3a92-4726-9d90-5ff6de1f55af None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:47.974635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a455d1-3a92-4726-9d90-5ff6de1f55af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:47.980814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca4ffb-4057-452e-8e95-656f57dbd9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:47.981460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca4ffb-4057-452e-8e95-656f57dbd9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:47.981741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca4ffb-4057-452e-8e95-656f57dbd9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:47.982215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca4ffb-4057-452e-8e95-656f57dbd9b2 admin admin] PATH_INFO: `/v3/projects/47348d84e2d94af4966603cd6ea2ce84` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:47.983842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca4ffb-4057-452e-8e95-656f57dbd9b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47348d84e2d94af4966603cd6ea2ce84)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:47.985403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca4ffb-4057-452e-8e95-656f57dbd9b2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:47.986259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:47.997284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f4a455d1-3a92-4726-9d90-5ff6de1f55af None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:47.998520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f4a455d1-3a92-4726-9d90-5ff6de1f55af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:48.006812 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 916/1847] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:48.007593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a455d1-3a92-4726-9d90-5ff6de1f55af None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:48.008817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f4a455d1-3a92-4726-9d90-5ff6de1f55af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:48.021905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a455d1-3a92-4726-9d90-5ff6de1f55af None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:48.026803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ec575-4927-4d12-abc8-09562a17e489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:48.027411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ec575-4927-4d12-abc8-09562a17e489 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:48.027684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ec575-4927-4d12-abc8-09562a17e489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:48.027947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ec575-4927-4d12-abc8-09562a17e489 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:48.028611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ec575-4927-4d12-abc8-09562a17e489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:48.030186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ec575-4927-4d12-abc8-09562a17e489 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:48.041390 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 917/1848] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:48.042181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ec575-4927-4d12-abc8-09562a17e489 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:48.043744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e00ec575-4927-4d12-abc8-09562a17e489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:48.092967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f1ca4ffb-4057-452e-8e95-656f57dbd9b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47348d84e2d94af4966603cd6ea2ce84', 'request_id': 'req-f1ca4ffb-4057-452e-8e95-656f57dbd9b2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:48.099817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f1ca4ffb-4057-452e-8e95-656f57dbd9b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47348d84e2d94af4966603cd6ea2ce84', 'request_id': 'req-f1ca4ffb-4057-452e-8e95-656f57dbd9b2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:48.120441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ec575-4927-4d12-abc8-09562a17e489 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:48.178498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f1ca4ffb-4057-452e-8e95-656f57dbd9b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47348d84e2d94af4966603cd6ea2ce84', 'request_id': 'req-f1ca4ffb-4057-452e-8e95-656f57dbd9b2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:48.184149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2406c5-6df0-42ad-98e7-811ee9e034a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:48.193554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2406c5-6df0-42ad-98e7-811ee9e034a2 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:48.193554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2406c5-6df0-42ad-98e7-811ee9e034a2 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:48.193554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2406c5-6df0-42ad-98e7-811ee9e034a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:48.194528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f1ca4ffb-4057-452e-8e95-656f57dbd9b2 admin admin] The token cache is being invalidate because project 47348d84e2d94af4966603cd6ea2ce84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:48.194528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f1ca4ffb-4057-452e-8e95-656f57dbd9b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:48.194528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f1ca4ffb-4057-452e-8e95-656f57dbd9b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:48.194528 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 932/1849] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:47 2022] DELETE /identity/v3/projects/47348d84e2d94af4966603cd6ea2ce84 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:48.195250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd077bf-22ac-4a1d-84aa-37d9390a2096 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:48.195250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd077bf-22ac-4a1d-84aa-37d9390a2096 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:48.195374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd077bf-22ac-4a1d-84aa-37d9390a2096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:48.216152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1dd077bf-22ac-4a1d-84aa-37d9390a2096 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:48.217460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1dd077bf-22ac-4a1d-84aa-37d9390a2096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:48.250285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2406c5-6df0-42ad-98e7-811ee9e034a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:48.251874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2406c5-6df0-42ad-98e7-811ee9e034a2 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:48.261772 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 918/1850] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:48 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:48.263078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2406c5-6df0-42ad-98e7-811ee9e034a2 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:48.279346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:48.283385 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 933/1851] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:48.286085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a260724-1d50-459a-903a-f521bf190568 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:48.286264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a260724-1d50-459a-903a-f521bf190568 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:48.286644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a260724-1d50-459a-903a-f521bf190568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:48.309954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6a260724-1d50-459a-903a-f521bf190568 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:48.310924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6a260724-1d50-459a-903a-f521bf190568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:48.321721 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 934/1852] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:48.322778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a260724-1d50-459a-903a-f521bf190568 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:48.333667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a260724-1d50-459a-903a-f521bf190568 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:48.339094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f3af6-2f28-43d4-9c6e-bd9a40db2132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:48.340426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f3af6-2f28-43d4-9c6e-bd9a40db2132 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:48.340426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f3af6-2f28-43d4-9c6e-bd9a40db2132 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:48.340426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f3af6-2f28-43d4-9c6e-bd9a40db2132 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:48.341216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f3af6-2f28-43d4-9c6e-bd9a40db2132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:48.341638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f3af6-2f28-43d4-9c6e-bd9a40db2132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:48.343437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f3af6-2f28-43d4-9c6e-bd9a40db2132 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:48.362444 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 935/1853] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:48.362444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f3af6-2f28-43d4-9c6e-bd9a40db2132 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:48.362444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e11f3af6-2f28-43d4-9c6e-bd9a40db2132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:48.376497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f3af6-2f28-43d4-9c6e-bd9a40db2132 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:48.379921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2406c5-6df0-42ad-98e7-811ee9e034a2 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:48.382045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04267de2-5d10-46d6-b257-8afc2a45cff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:48.383393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04267de2-5d10-46d6-b257-8afc2a45cff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:48.383752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04267de2-5d10-46d6-b257-8afc2a45cff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:48.384298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04267de2-5d10-46d6-b257-8afc2a45cff0 admin admin] PATH_INFO: `/v3/users/f5f6cef4a1d4400589c48ec606ae4dae` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:48.385777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04267de2-5d10-46d6-b257-8afc2a45cff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f6cef4a1d4400589c48ec606ae4dae)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:48.387980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04267de2-5d10-46d6-b257-8afc2a45cff0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:48.396478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88458a35-7964-4d50-be89-a276356ce6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:48.397102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88458a35-7964-4d50-be89-a276356ce6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:48.397382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88458a35-7964-4d50-be89-a276356ce6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:48.397700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88458a35-7964-4d50-be89-a276356ce6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:48.398714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88458a35-7964-4d50-be89-a276356ce6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:48.400577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88458a35-7964-4d50-be89-a276356ce6b3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:48.413012 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 919/1854] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:48.418724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d7df-c535-4c39-9266-9835858ba74d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:48.418724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d7df-c535-4c39-9266-9835858ba74d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:48.418724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d7df-c535-4c39-9266-9835858ba74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:48.436815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-eaf0d7df-c535-4c39-9266-9835858ba74d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:48.438171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-eaf0d7df-c535-4c39-9266-9835858ba74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:48.446904 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 920/1855] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:48.450874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0d7df-c535-4c39-9266-9835858ba74d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:48.461583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0d7df-c535-4c39-9266-9835858ba74d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:48.466949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63802257-afea-4703-8caf-950e5fe5b210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:48.467698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63802257-afea-4703-8caf-950e5fe5b210 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:48.468055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63802257-afea-4703-8caf-950e5fe5b210 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:48.468542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63802257-afea-4703-8caf-950e5fe5b210 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:48.469245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63802257-afea-4703-8caf-950e5fe5b210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:48.471216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63802257-afea-4703-8caf-950e5fe5b210 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:48.604044 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 921/1856] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:48 2022] POST /identity/v3/projects => generated 391 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:48.607120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63802257-afea-4703-8caf-950e5fe5b210 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:48.607786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-63802257-afea-4703-8caf-950e5fe5b210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:48.621095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-04267de2-5d10-46d6-b257-8afc2a45cff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f6cef4a1d4400589c48ec606ae4dae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:48.621740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-04267de2-5d10-46d6-b257-8afc2a45cff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f6cef4a1d4400589c48ec606ae4dae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:48.673521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63802257-afea-4703-8caf-950e5fe5b210 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:48.676754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:48.680958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04e07d-1272-4e04-becd-189fd3321fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:48.687423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04e07d-1272-4e04-becd-189fd3321fef admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:48.687423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04e07d-1272-4e04-becd-189fd3321fef admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:48.687423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04e07d-1272-4e04-becd-189fd3321fef admin admin] PATH_INFO: `/v3/projects/2900af09c3054d8ab1483c824ed091a2/users/9f3d556f9d8948f796a0e1bd01c3b550/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:48.700353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04e07d-1272-4e04-becd-189fd3321fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2900af09c3054d8ab1483c824ed091a2, user_id=9f3d556f9d8948f796a0e1bd01c3b550, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:48.703039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04e07d-1272-4e04-becd-189fd3321fef admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:48.727497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-04267de2-5d10-46d6-b257-8afc2a45cff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f6cef4a1d4400589c48ec606ae4dae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:48.727497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-04267de2-5d10-46d6-b257-8afc2a45cff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f6cef4a1d4400589c48ec606ae4dae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:48.735848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-04267de2-5d10-46d6-b257-8afc2a45cff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f6cef4a1d4400589c48ec606ae4dae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:48.750352 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 936/1857] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:48 2022] DELETE /identity/v3/users/f5f6cef4a1d4400589c48ec606ae4dae => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:48.751989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04267de2-5d10-46d6-b257-8afc2a45cff0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:48.753848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-04267de2-5d10-46d6-b257-8afc2a45cff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:48.821207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04267de2-5d10-46d6-b257-8afc2a45cff0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:48.827023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e563e-18f5-4c85-89fc-f076a933c4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:48.827656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e563e-18f5-4c85-89fc-f076a933c4fa admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:48.827942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e563e-18f5-4c85-89fc-f076a933c4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:48.828248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e563e-18f5-4c85-89fc-f076a933c4fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:48.828898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e563e-18f5-4c85-89fc-f076a933c4fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:48.829254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e563e-18f5-4c85-89fc-f076a933c4fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:48.841016 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 922/1858] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:48 2022] PUT /identity/v3/projects/2900af09c3054d8ab1483c824ed091a2/users/9f3d556f9d8948f796a0e1bd01c3b550/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:48.841016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04e07d-1272-4e04-becd-189fd3321fef admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:48.841265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e563e-18f5-4c85-89fc-f076a933c4fa admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:48.841340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4b04e07d-1272-4e04-becd-189fd3321fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:48.849985 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 937/1859] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:48.849985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e563e-18f5-4c85-89fc-f076a933c4fa admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:48.851136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-476e563e-18f5-4c85-89fc-f076a933c4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:48.870855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e563e-18f5-4c85-89fc-f076a933c4fa admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:48.924298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04e07d-1272-4e04-becd-189fd3321fef admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:48.930166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb6ff1-c5ee-47e9-abf9-b511d577414a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:48.930779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb6ff1-c5ee-47e9-abf9-b511d577414a service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:48.931125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb6ff1-c5ee-47e9-abf9-b511d577414a service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:48.931341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb6ff1-c5ee-47e9-abf9-b511d577414a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:48.933118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cfeb6ff1-c5ee-47e9-abf9-b511d577414a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:48.939288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000753c0-b5fc-4ed0-89d3-bffd34be6361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:48.939288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000753c0-b5fc-4ed0-89d3-bffd34be6361 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:48.939288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000753c0-b5fc-4ed0-89d3-bffd34be6361 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:48.939288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000753c0-b5fc-4ed0-89d3-bffd34be6361 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:48.939640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000753c0-b5fc-4ed0-89d3-bffd34be6361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:48.939640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000753c0-b5fc-4ed0-89d3-bffd34be6361 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:48.955599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:48.996962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb6ff1-c5ee-47e9-abf9-b511d577414a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:48.998482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb6ff1-c5ee-47e9-abf9-b511d577414a service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:49.008485 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 923/1860] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:48 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:49.009726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b411be-7489-442f-b26e-20a5287fa881 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:49.009992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b411be-7489-442f-b26e-20a5287fa881 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:49.010267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b411be-7489-442f-b26e-20a5287fa881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:49.031532 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 938/1861] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:48 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:49.031532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c832d8b-ae60-4299-a327-29fc045f267a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:49.031532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c832d8b-ae60-4299-a327-29fc045f267a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:49.031532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c832d8b-ae60-4299-a327-29fc045f267a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:49.037898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a0b411be-7489-442f-b26e-20a5287fa881 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:49.037898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a0b411be-7489-442f-b26e-20a5287fa881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:49.047144 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 924/1862] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:49.047949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b411be-7489-442f-b26e-20a5287fa881 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:49.058312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b411be-7489-442f-b26e-20a5287fa881 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:49.058711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5c832d8b-ae60-4299-a327-29fc045f267a None None] MFA Rules not processed for user `9f3d556f9d8948f796a0e1bd01c3b550`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:49.059942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5c832d8b-ae60-4299-a327-29fc045f267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:49.063468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e2cb1-8ba1-45fa-abd9-5d1b6f9c0d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:49.064195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e2cb1-8ba1-45fa-abd9-5d1b6f9c0d6d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:49.064574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e2cb1-8ba1-45fa-abd9-5d1b6f9c0d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:49.064918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e2cb1-8ba1-45fa-abd9-5d1b6f9c0d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:49.065558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e2cb1-8ba1-45fa-abd9-5d1b6f9c0d6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:49.068808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e2cb1-8ba1-45fa-abd9-5d1b6f9c0d6d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:49.123951 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 939/1863] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:49 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:49.124829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c832d8b-ae60-4299-a327-29fc045f267a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:49.135571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c832d8b-ae60-4299-a327-29fc045f267a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:49.140032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81475b56-085f-4ef5-8431-9b4069de71dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:49.140640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81475b56-085f-4ef5-8431-9b4069de71dc admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:49.140918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81475b56-085f-4ef5-8431-9b4069de71dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:49.141188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81475b56-085f-4ef5-8431-9b4069de71dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:49.141811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81475b56-085f-4ef5-8431-9b4069de71dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:49.143646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81475b56-085f-4ef5-8431-9b4069de71dc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:49.153514 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 940/1864] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:49.154370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81475b56-085f-4ef5-8431-9b4069de71dc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:49.155926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-81475b56-085f-4ef5-8431-9b4069de71dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:49.168192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81475b56-085f-4ef5-8431-9b4069de71dc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:49.173091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707edd29-7abe-4fae-af01-b2c52627fbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:49.177045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707edd29-7abe-4fae-af01-b2c52627fbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:49.177045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707edd29-7abe-4fae-af01-b2c52627fbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:49.177045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707edd29-7abe-4fae-af01-b2c52627fbb3 admin admin] PATH_INFO: `/v3/users/166ca64f550e494fb63a945322b85c34` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:49.177045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707edd29-7abe-4fae-af01-b2c52627fbb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=166ca64f550e494fb63a945322b85c34)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:49.178221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707edd29-7abe-4fae-af01-b2c52627fbb3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:49.202526 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 925/1865] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:49 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:49.203447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e2cb1-8ba1-45fa-abd9-5d1b6f9c0d6d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:49.205192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-259e2cb1-8ba1-45fa-abd9-5d1b6f9c0d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:49.262256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e2cb1-8ba1-45fa-abd9-5d1b6f9c0d6d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:49.265856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d56a1-c766-4bff-9149-17f2562e36ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:49.268651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d56a1-c766-4bff-9149-17f2562e36ed service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:49.268651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d56a1-c766-4bff-9149-17f2562e36ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:49.268651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d56a1-c766-4bff-9149-17f2562e36ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:49.327700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d56a1-c766-4bff-9149-17f2562e36ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:49.329162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d56a1-c766-4bff-9149-17f2562e36ed service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:49.338479 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 926/1866] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:49.339246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d56a1-c766-4bff-9149-17f2562e36ed service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:49.341595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-836d56a1-c766-4bff-9149-17f2562e36ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:49.356658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d56a1-c766-4bff-9149-17f2562e36ed service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:49.362078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffa331-a20f-42e2-97ba-38091cc2433c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:49.362674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffa331-a20f-42e2-97ba-38091cc2433c admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:49.362954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffa331-a20f-42e2-97ba-38091cc2433c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:49.363223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffa331-a20f-42e2-97ba-38091cc2433c admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:49.364453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffa331-a20f-42e2-97ba-38091cc2433c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:49.366464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffa331-a20f-42e2-97ba-38091cc2433c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:49.402003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:49.416215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-707edd29-7abe-4fae-af01-b2c52627fbb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166ca64f550e494fb63a945322b85c34'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:49.416898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-707edd29-7abe-4fae-af01-b2c52627fbb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166ca64f550e494fb63a945322b85c34'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:49.542723 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 927/1867] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:49 2022] POST /identity/v3/projects => generated 403 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:49.542723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffa331-a20f-42e2-97ba-38091cc2433c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:49.585598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-707edd29-7abe-4fae-af01-b2c52627fbb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166ca64f550e494fb63a945322b85c34'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:49.586811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-707edd29-7abe-4fae-af01-b2c52627fbb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166ca64f550e494fb63a945322b85c34'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:49.602770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-707edd29-7abe-4fae-af01-b2c52627fbb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166ca64f550e494fb63a945322b85c34'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:49.609673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffa331-a20f-42e2-97ba-38091cc2433c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:49.621372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873abf9-2fa2-4c1b-b242-8ba3a03f8142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:49.621372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873abf9-2fa2-4c1b-b242-8ba3a03f8142 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:49.621372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873abf9-2fa2-4c1b-b242-8ba3a03f8142 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:49.621372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873abf9-2fa2-4c1b-b242-8ba3a03f8142 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:49.621667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873abf9-2fa2-4c1b-b242-8ba3a03f8142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:49.621667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873abf9-2fa2-4c1b-b242-8ba3a03f8142 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:49.621888 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 941/1868] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:49 2022] DELETE /identity/v3/users/166ca64f550e494fb63a945322b85c34 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:49.624615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707edd29-7abe-4fae-af01-b2c52627fbb3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:49.629296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-707edd29-7abe-4fae-af01-b2c52627fbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:49.641248 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 928/1869] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:49.642164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873abf9-2fa2-4c1b-b242-8ba3a03f8142 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:49.644694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6873abf9-2fa2-4c1b-b242-8ba3a03f8142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:49.667715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873abf9-2fa2-4c1b-b242-8ba3a03f8142 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:49.722204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707edd29-7abe-4fae-af01-b2c52627fbb3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:49.728559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:49.730448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a4cb0-5fb5-4ff0-af67-99f89fead5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:49.731857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4cb0-5fb5-4ff0-af67-99f89fead5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:49.731857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4cb0-5fb5-4ff0-af67-99f89fead5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:49.731857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4cb0-5fb5-4ff0-af67-99f89fead5e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:49.732282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a4cb0-5fb5-4ff0-af67-99f89fead5e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:49.734401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a4cb0-5fb5-4ff0-af67-99f89fead5e2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:49.737601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d5e72-4a0d-4499-aea1-60b3c7ad0977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:49.739254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d5e72-4a0d-4499-aea1-60b3c7ad0977 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:49.739254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d5e72-4a0d-4499-aea1-60b3c7ad0977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:49.739468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d5e72-4a0d-4499-aea1-60b3c7ad0977 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:49.740142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d5e72-4a0d-4499-aea1-60b3c7ad0977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:49.742253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d5e72-4a0d-4499-aea1-60b3c7ad0977 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:49.813386 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 942/1870] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:49 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:49.814931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec7576-283b-4ce6-b59f-f0e532414560 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:49.815389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec7576-283b-4ce6-b59f-f0e532414560 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:49.815865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec7576-283b-4ce6-b59f-f0e532414560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:49.836143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2fec7576-283b-4ce6-b59f-f0e532414560 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:49.837531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2fec7576-283b-4ce6-b59f-f0e532414560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:49.841665 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 929/1871] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:49 2022] POST /identity/v3/users => generated 308 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:49.842554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d5e72-4a0d-4499-aea1-60b3c7ad0977 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:49.844436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-014d5e72-4a0d-4499-aea1-60b3c7ad0977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:49.849046 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 943/1872] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:49.850143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec7576-283b-4ce6-b59f-f0e532414560 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:49.860368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d5e72-4a0d-4499-aea1-60b3c7ad0977 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:49.861278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec7576-283b-4ce6-b59f-f0e532414560 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:49.865883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57536dc3-d5c8-4067-806d-211de0200164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:49.866549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57536dc3-d5c8-4067-806d-211de0200164 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:49.866833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57536dc3-d5c8-4067-806d-211de0200164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:49.867113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57536dc3-d5c8-4067-806d-211de0200164 admin admin] PATH_INFO: `/v3/projects/f8753714da584eb8a8ff4f7cd6b158d4/users/ce38d28fd179474dba9e0f9c3bd042e7/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:49.867676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0822994-6c36-4356-982a-f0e48bbb3d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:49.868657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0822994-6c36-4356-982a-f0e48bbb3d1e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:49.869110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0822994-6c36-4356-982a-f0e48bbb3d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:49.869571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0822994-6c36-4356-982a-f0e48bbb3d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:49.871001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0822994-6c36-4356-982a-f0e48bbb3d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:49.872685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0822994-6c36-4356-982a-f0e48bbb3d1e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:49.883505 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 944/1873] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:49.884491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0822994-6c36-4356-982a-f0e48bbb3d1e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:49.885360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57536dc3-d5c8-4067-806d-211de0200164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8753714da584eb8a8ff4f7cd6b158d4, user_id=ce38d28fd179474dba9e0f9c3bd042e7, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:49.888462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57536dc3-d5c8-4067-806d-211de0200164 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:49.895185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0822994-6c36-4356-982a-f0e48bbb3d1e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:49.899907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228d20d-e4ec-4277-bd65-18c3eb7bbf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:49.900553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228d20d-e4ec-4277-bd65-18c3eb7bbf0d admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:49.905649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228d20d-e4ec-4277-bd65-18c3eb7bbf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:49.905649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228d20d-e4ec-4277-bd65-18c3eb7bbf0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:49.905649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228d20d-e4ec-4277-bd65-18c3eb7bbf0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:49.905649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228d20d-e4ec-4277-bd65-18c3eb7bbf0d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:49.914442 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 945/1874] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:49.915022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228d20d-e4ec-4277-bd65-18c3eb7bbf0d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:49.918786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b228d20d-e4ec-4277-bd65-18c3eb7bbf0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:49.960426 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 930/1875] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:49 2022] PUT /identity/v3/projects/f8753714da584eb8a8ff4f7cd6b158d4/users/ce38d28fd179474dba9e0f9c3bd042e7/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:49.961492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57536dc3-d5c8-4067-806d-211de0200164 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:49.984263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228d20d-e4ec-4277-bd65-18c3eb7bbf0d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:50.026589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57536dc3-d5c8-4067-806d-211de0200164 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:50.031630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542d3a7-c259-4ab5-9c52-5c10d6d8a4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:50.032303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542d3a7-c259-4ab5-9c52-5c10d6d8a4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:50.032588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542d3a7-c259-4ab5-9c52-5c10d6d8a4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:50.032863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542d3a7-c259-4ab5-9c52-5c10d6d8a4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:50.033512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542d3a7-c259-4ab5-9c52-5c10d6d8a4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:50.034117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ba21c-2577-451b-a792-cf6e6192edaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:50.034724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ba21c-2577-451b-a792-cf6e6192edaf service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:50.035034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ba21c-2577-451b-a792-cf6e6192edaf service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:50.035175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542d3a7-c259-4ab5-9c52-5c10d6d8a4b6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:50.036104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ba21c-2577-451b-a792-cf6e6192edaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:50.045621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ba21c-2577-451b-a792-cf6e6192edaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:50.045784 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 931/1876] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:50.046544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542d3a7-c259-4ab5-9c52-5c10d6d8a4b6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:50.047041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ba21c-2577-451b-a792-cf6e6192edaf service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:50.056156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542d3a7-c259-4ab5-9c52-5c10d6d8a4b6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:50.057133 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 946/1877] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:50.057962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ba21c-2577-451b-a792-cf6e6192edaf service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:50.059257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e80ba21c-2577-451b-a792-cf6e6192edaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:50.061971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88016e83-890e-41f4-bdc3-52914ff1ff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:50.063882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88016e83-890e-41f4-bdc3-52914ff1ff0a admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:50.063882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88016e83-890e-41f4-bdc3-52914ff1ff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:50.063882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88016e83-890e-41f4-bdc3-52914ff1ff0a admin admin] PATH_INFO: `/v3/projects/122e99ea16214018ad34a2ef7373ebb7/users/a841b7d3eb674efdba9a66ccd9b53897/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:50.072056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ba21c-2577-451b-a792-cf6e6192edaf service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:50.077269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660592b9-52bb-41a5-a634-dc9148d3188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:50.077905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660592b9-52bb-41a5-a634-dc9148d3188d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:50.078199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660592b9-52bb-41a5-a634-dc9148d3188d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:50.078456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660592b9-52bb-41a5-a634-dc9148d3188d admin admin] PATH_INFO: `/v3/projects/3542b4b8761349c1826612240b01ba6b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:50.079571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660592b9-52bb-41a5-a634-dc9148d3188d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3542b4b8761349c1826612240b01ba6b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:50.081795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660592b9-52bb-41a5-a634-dc9148d3188d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:50.081920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88016e83-890e-41f4-bdc3-52914ff1ff0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=122e99ea16214018ad34a2ef7373ebb7, user_id=a841b7d3eb674efdba9a66ccd9b53897, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:50.085791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88016e83-890e-41f4-bdc3-52914ff1ff0a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:50.202220 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 932/1878] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:50 2022] PUT /identity/v3/projects/122e99ea16214018ad34a2ef7373ebb7/users/a841b7d3eb674efdba9a66ccd9b53897/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:50.203821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b105d6-9bb0-4ce3-a113-3b3501b62243 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:50.204428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b105d6-9bb0-4ce3-a113-3b3501b62243 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:50.204428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b105d6-9bb0-4ce3-a113-3b3501b62243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:50.233313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-03b105d6-9bb0-4ce3-a113-3b3501b62243 None None] MFA Rules not processed for user `ce38d28fd179474dba9e0f9c3bd042e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:50.234633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-03b105d6-9bb0-4ce3-a113-3b3501b62243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:50.242734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-660592b9-52bb-41a5-a634-dc9148d3188d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3542b4b8761349c1826612240b01ba6b', 'request_id': 'req-660592b9-52bb-41a5-a634-dc9148d3188d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:50.248121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-660592b9-52bb-41a5-a634-dc9148d3188d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3542b4b8761349c1826612240b01ba6b', 'request_id': 'req-660592b9-52bb-41a5-a634-dc9148d3188d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:50.271425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:50.302202 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 933/1879] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:50.303270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b105d6-9bb0-4ce3-a113-3b3501b62243 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:50.310616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-660592b9-52bb-41a5-a634-dc9148d3188d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3542b4b8761349c1826612240b01ba6b', 'request_id': 'req-660592b9-52bb-41a5-a634-dc9148d3188d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:50.325496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-660592b9-52bb-41a5-a634-dc9148d3188d admin admin] The token cache is being invalidate because project 3542b4b8761349c1826612240b01ba6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:50.325818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-660592b9-52bb-41a5-a634-dc9148d3188d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:50.326484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-660592b9-52bb-41a5-a634-dc9148d3188d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:50.328137 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 947/1880] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:50 2022] DELETE /identity/v3/projects/3542b4b8761349c1826612240b01ba6b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:50.328965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660592b9-52bb-41a5-a634-dc9148d3188d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:50.335102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:50.336039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-660592b9-52bb-41a5-a634-dc9148d3188d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:50.373472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b105d6-9bb0-4ce3-a113-3b3501b62243 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:50.377996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeab6d8-b397-486e-a5c0-8c5cd0fc43e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:50.378348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeab6d8-b397-486e-a5c0-8c5cd0fc43e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:50.378628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeab6d8-b397-486e-a5c0-8c5cd0fc43e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:50.379422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeab6d8-b397-486e-a5c0-8c5cd0fc43e0 admin admin] PATH_INFO: `/v3/projects/76a738c95fb340e99ec9da1cf243a549/users/e1a5f52f15024f4e89bb41dc0cc698ae/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:50.395800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeab6d8-b397-486e-a5c0-8c5cd0fc43e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a738c95fb340e99ec9da1cf243a549, user_id=e1a5f52f15024f4e89bb41dc0cc698ae, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:50.398496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeab6d8-b397-486e-a5c0-8c5cd0fc43e0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:50.412585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660592b9-52bb-41a5-a634-dc9148d3188d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:50.417310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c78dad-84d6-4a68-8d97-305e62a01304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:50.418389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c78dad-84d6-4a68-8d97-305e62a01304 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:50.418389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c78dad-84d6-4a68-8d97-305e62a01304 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:50.418574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c78dad-84d6-4a68-8d97-305e62a01304 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:50.419072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c78dad-84d6-4a68-8d97-305e62a01304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:50.420783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c78dad-84d6-4a68-8d97-305e62a01304 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:50.431245 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 948/1881] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:50.432134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c78dad-84d6-4a68-8d97-305e62a01304 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:50.433835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d1c78dad-84d6-4a68-8d97-305e62a01304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:50.446946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c78dad-84d6-4a68-8d97-305e62a01304 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:50.451550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06aaf8-9d86-42cd-acb2-5b047c616533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:50.452152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06aaf8-9d86-42cd-acb2-5b047c616533 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:50.452465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06aaf8-9d86-42cd-acb2-5b047c616533 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:50.452736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06aaf8-9d86-42cd-acb2-5b047c616533 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:50.453360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06aaf8-9d86-42cd-acb2-5b047c616533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:50.455388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06aaf8-9d86-42cd-acb2-5b047c616533 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:50.522901 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 934/1882] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:50 2022] PUT /identity/v3/projects/76a738c95fb340e99ec9da1cf243a549/users/e1a5f52f15024f4e89bb41dc0cc698ae/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:50.523739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeab6d8-b397-486e-a5c0-8c5cd0fc43e0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:50.525332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-afeab6d8-b397-486e-a5c0-8c5cd0fc43e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:50.559920 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 949/1883] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:50 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:50.560607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06aaf8-9d86-42cd-acb2-5b047c616533 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:50.607178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeab6d8-b397-486e-a5c0-8c5cd0fc43e0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:50.645365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06aaf8-9d86-42cd-acb2-5b047c616533 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:50.650231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafb8e6-4a83-4530-8898-82c614b83aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:50.650917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb8e6-4a83-4530-8898-82c614b83aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:50.651194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb8e6-4a83-4530-8898-82c614b83aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:50.651482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb8e6-4a83-4530-8898-82c614b83aa1 admin admin] PATH_INFO: `/v3/projects/122e99ea16214018ad34a2ef7373ebb7/users/a841b7d3eb674efdba9a66ccd9b53897/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:50.653384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafb8e6-4a83-4530-8898-82c614b83aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=122e99ea16214018ad34a2ef7373ebb7, user_id=a841b7d3eb674efdba9a66ccd9b53897, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:50.656003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafb8e6-4a83-4530-8898-82c614b83aa1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:50.670826 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 950/1884] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:50 2022] PUT /identity/v3/projects/122e99ea16214018ad34a2ef7373ebb7/users/a841b7d3eb674efdba9a66ccd9b53897/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:50.670826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d16c9d-c99d-4897-9204-f64f2dff4fb8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:50.670826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d16c9d-c99d-4897-9204-f64f2dff4fb8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:50.670826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d16c9d-c99d-4897-9204-f64f2dff4fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:50.686493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c072c8e-3855-43b7-b753-4284a62cb56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:50.687384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c072c8e-3855-43b7-b753-4284a62cb56a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:50.687473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c072c8e-3855-43b7-b753-4284a62cb56a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:50.687700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c072c8e-3855-43b7-b753-4284a62cb56a admin admin] PATH_INFO: `/v3/users/23b8e2226dec438ea3e84280de6a48a7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:50.693180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c072c8e-3855-43b7-b753-4284a62cb56a admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b8e2226dec438ea3e84280de6a48a7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:50.695422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c072c8e-3855-43b7-b753-4284a62cb56a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:50.720647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-55d16c9d-c99d-4897-9204-f64f2dff4fb8 None None] MFA Rules not processed for user `e1a5f52f15024f4e89bb41dc0cc698ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:50.788691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-55d16c9d-c99d-4897-9204-f64f2dff4fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:50.796759 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 951/1885] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:50.797829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d16c9d-c99d-4897-9204-f64f2dff4fb8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:50.799340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-55d16c9d-c99d-4897-9204-f64f2dff4fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:50.875560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d16c9d-c99d-4897-9204-f64f2dff4fb8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:50.881172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c3180-5fd6-49ed-b83b-2f71e772c1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:50.881812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c3180-5fd6-49ed-b83b-2f71e772c1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:50.882091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c3180-5fd6-49ed-b83b-2f71e772c1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:50.882359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c3180-5fd6-49ed-b83b-2f71e772c1fd admin admin] PATH_INFO: `/v3/projects/3abc374e90e84a308dc532e53f122985` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:50.883492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c3180-5fd6-49ed-b83b-2f71e772c1fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abc374e90e84a308dc532e53f122985)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:50.885427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c3180-5fd6-49ed-b83b-2f71e772c1fd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:51.567670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:51.615512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-672c3180-5fd6-49ed-b83b-2f71e772c1fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abc374e90e84a308dc532e53f122985', 'request_id': 'req-672c3180-5fd6-49ed-b83b-2f71e772c1fd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:51.621311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-672c3180-5fd6-49ed-b83b-2f71e772c1fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abc374e90e84a308dc532e53f122985', 'request_id': 'req-672c3180-5fd6-49ed-b83b-2f71e772c1fd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:51.678273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c072c8e-3855-43b7-b753-4284a62cb56a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b8e2226dec438ea3e84280de6a48a7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:51.740544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-672c3180-5fd6-49ed-b83b-2f71e772c1fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abc374e90e84a308dc532e53f122985', 'request_id': 'req-672c3180-5fd6-49ed-b83b-2f71e772c1fd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:51.753217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-672c3180-5fd6-49ed-b83b-2f71e772c1fd admin admin] The token cache is being invalidate because project 3abc374e90e84a308dc532e53f122985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:51.753594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-672c3180-5fd6-49ed-b83b-2f71e772c1fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:51.754946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-672c3180-5fd6-49ed-b83b-2f71e772c1fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:51.756792 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 952/1886] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:50 2022] DELETE /identity/v3/projects/3abc374e90e84a308dc532e53f122985 => generated 0 bytes in 959 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:51.757583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c3180-5fd6-49ed-b83b-2f71e772c1fd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:51.758879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-672c3180-5fd6-49ed-b83b-2f71e772c1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:51.830060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c3180-5fd6-49ed-b83b-2f71e772c1fd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:51.836096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a4216-47c2-45b3-8623-9d4d188767cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:51.836957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4216-47c2-45b3-8623-9d4d188767cd admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:51.837393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4216-47c2-45b3-8623-9d4d188767cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:51.837675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4216-47c2-45b3-8623-9d4d188767cd admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:51.838316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a4216-47c2-45b3-8623-9d4d188767cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:51.840489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a4216-47c2-45b3-8623-9d4d188767cd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:51.847492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c072c8e-3855-43b7-b753-4284a62cb56a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b8e2226dec438ea3e84280de6a48a7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:51.848709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c072c8e-3855-43b7-b753-4284a62cb56a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b8e2226dec438ea3e84280de6a48a7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:51.860022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c072c8e-3855-43b7-b753-4284a62cb56a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b8e2226dec438ea3e84280de6a48a7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:51.873147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c072c8e-3855-43b7-b753-4284a62cb56a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b8e2226dec438ea3e84280de6a48a7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:51.880433 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 935/1887] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:50 2022] DELETE /identity/v3/users/23b8e2226dec438ea3e84280de6a48a7 => generated 0 bytes in 1357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:51.881642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc44e4c-f59e-4b65-b2fd-1d3d9ffc26a0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:51.881930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc44e4c-f59e-4b65-b2fd-1d3d9ffc26a0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:51.882201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc44e4c-f59e-4b65-b2fd-1d3d9ffc26a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:51.913838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-dbc44e4c-f59e-4b65-b2fd-1d3d9ffc26a0 None None] MFA Rules not processed for user `a841b7d3eb674efdba9a66ccd9b53897`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:51.915144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dbc44e4c-f59e-4b65-b2fd-1d3d9ffc26a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:51.976416 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 953/1888] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:51 2022] POST /identity/v3/users => generated 303 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:51.983745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a4216-47c2-45b3-8623-9d4d188767cd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:51.983745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9b3a4216-47c2-45b3-8623-9d4d188767cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:51.992326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a4216-47c2-45b3-8623-9d4d188767cd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:52.009946 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 936/1889] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:51 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:52.016307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc44e4c-f59e-4b65-b2fd-1d3d9ffc26a0 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:52.016307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dbc44e4c-f59e-4b65-b2fd-1d3d9ffc26a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:52.067073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f9552-8985-4962-86bd-2847b5eb56d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:52.067888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f9552-8985-4962-86bd-2847b5eb56d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:52.068200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f9552-8985-4962-86bd-2847b5eb56d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:52.068453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f9552-8985-4962-86bd-2847b5eb56d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:52.069095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f9552-8985-4962-86bd-2847b5eb56d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:52.071479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f9552-8985-4962-86bd-2847b5eb56d8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:52.109336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc44e4c-f59e-4b65-b2fd-1d3d9ffc26a0 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:52.133592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c756ac2-eb32-410d-b271-4059114092b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:52.135435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c756ac2-eb32-410d-b271-4059114092b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:52.135739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c756ac2-eb32-410d-b271-4059114092b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:52.136022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c756ac2-eb32-410d-b271-4059114092b9 admin admin] PATH_INFO: `/v3/users/5c5bafb4545743f99bddd79bb2157240` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:52.139348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c756ac2-eb32-410d-b271-4059114092b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5bafb4545743f99bddd79bb2157240)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:52.141443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c756ac2-eb32-410d-b271-4059114092b9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:52.173885 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 954/1890] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:51 2022] POST /identity/v3/projects => generated 375 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:52.174868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f9552-8985-4962-86bd-2847b5eb56d8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:52.180426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4f8f9552-8985-4962-86bd-2847b5eb56d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:52.281396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f9552-8985-4962-86bd-2847b5eb56d8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:52.286985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3db01b-d193-43d4-88d4-cd19e7646d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:52.287598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3db01b-d193-43d4-88d4-cd19e7646d58 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:52.288007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3db01b-d193-43d4-88d4-cd19e7646d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:52.288310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3db01b-d193-43d4-88d4-cd19e7646d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:52.288973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3db01b-d193-43d4-88d4-cd19e7646d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:52.290558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3db01b-d193-43d4-88d4-cd19e7646d58 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:52.300594 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 955/1891] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:52.306720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3db01b-d193-43d4-88d4-cd19e7646d58 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:52.306938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3d3db01b-d193-43d4-88d4-cd19e7646d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:52.348131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1c756ac2-eb32-410d-b271-4059114092b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5bafb4545743f99bddd79bb2157240'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:52.436347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1c756ac2-eb32-410d-b271-4059114092b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5bafb4545743f99bddd79bb2157240'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:52.436508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1c756ac2-eb32-410d-b271-4059114092b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5bafb4545743f99bddd79bb2157240'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:52.444494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3db01b-d193-43d4-88d4-cd19e7646d58 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:52.445174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1c756ac2-eb32-410d-b271-4059114092b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5bafb4545743f99bddd79bb2157240'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:52.450400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f05ae1-c1d7-4213-b42d-da4ee5d3161d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:52.451174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f05ae1-c1d7-4213-b42d-da4ee5d3161d service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:52.451496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f05ae1-c1d7-4213-b42d-da4ee5d3161d service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:52.451972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f05ae1-c1d7-4213-b42d-da4ee5d3161d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:52.459169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1c756ac2-eb32-410d-b271-4059114092b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5bafb4545743f99bddd79bb2157240'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:52.464624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:52.467568 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 937/1892] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:52 2022] DELETE /identity/v3/users/5c5bafb4545743f99bddd79bb2157240 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:52.468143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c756ac2-eb32-410d-b271-4059114092b9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:52.469635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1c756ac2-eb32-410d-b271-4059114092b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:52.551766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f05ae1-c1d7-4213-b42d-da4ee5d3161d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:52.554505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f05ae1-c1d7-4213-b42d-da4ee5d3161d service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:52.567221 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 956/1893] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:52 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:52.568259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f05ae1-c1d7-4213-b42d-da4ee5d3161d service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:52.581532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c756ac2-eb32-410d-b271-4059114092b9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:52.594943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f05ae1-c1d7-4213-b42d-da4ee5d3161d service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:52.596187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299e14b-fd08-4a85-bd57-151e8158d48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:52.599082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299e14b-fd08-4a85-bd57-151e8158d48a admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:52.599564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299e14b-fd08-4a85-bd57-151e8158d48a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:52.599985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299e14b-fd08-4a85-bd57-151e8158d48a admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:52.600923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299e14b-fd08-4a85-bd57-151e8158d48a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:52.604690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299e14b-fd08-4a85-bd57-151e8158d48a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:52.619087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c6689-e7b4-45d8-bd1d-77c264a53b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:52.619767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c6689-e7b4-45d8-bd1d-77c264a53b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:52.620042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c6689-e7b4-45d8-bd1d-77c264a53b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:52.620665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c6689-e7b4-45d8-bd1d-77c264a53b54 admin admin] PATH_INFO: `/v3/projects/07874299a526478f86485a30dac994b3/users/a6d6b147beea482588d7c9abf2be662b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:52.637583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c6689-e7b4-45d8-bd1d-77c264a53b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07874299a526478f86485a30dac994b3, user_id=a6d6b147beea482588d7c9abf2be662b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:52.640947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c6689-e7b4-45d8-bd1d-77c264a53b54 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:52.708499 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 938/1894] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:52 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:52.709780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299e14b-fd08-4a85-bd57-151e8158d48a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:52.715159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7299e14b-fd08-4a85-bd57-151e8158d48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:52.743022 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 957/1895] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:52 2022] PUT /identity/v3/projects/07874299a526478f86485a30dac994b3/users/a6d6b147beea482588d7c9abf2be662b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:52.744820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c6689-e7b4-45d8-bd1d-77c264a53b54 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:52.750896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-264c6689-e7b4-45d8-bd1d-77c264a53b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:52.751423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299e14b-fd08-4a85-bd57-151e8158d48a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:52.864765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c32993-0ffc-4d06-9577-f57e8c4548b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:52.869723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c32993-0ffc-4d06-9577-f57e8c4548b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:52.869723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c32993-0ffc-4d06-9577-f57e8c4548b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:52.869723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c32993-0ffc-4d06-9577-f57e8c4548b5 admin admin] PATH_INFO: `/v3/projects/f078c5c4c11d43b5af5486e99df69078` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:52.869723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c32993-0ffc-4d06-9577-f57e8c4548b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f078c5c4c11d43b5af5486e99df69078)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:52.870322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c32993-0ffc-4d06-9577-f57e8c4548b5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:53.027881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c6689-e7b4-45d8-bd1d-77c264a53b54 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:53.034526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bf91f-b86f-42a8-916a-59022c204d63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:53.036097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bf91f-b86f-42a8-916a-59022c204d63 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:53.036720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bf91f-b86f-42a8-916a-59022c204d63 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:53.037530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bf91f-b86f-42a8-916a-59022c204d63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:53.040806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-805bf91f-b86f-42a8-916a-59022c204d63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:53.067177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:53.070371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b9c32993-0ffc-4d06-9577-f57e8c4548b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f078c5c4c11d43b5af5486e99df69078', 'request_id': 'req-b9c32993-0ffc-4d06-9577-f57e8c4548b5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:53.083761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b9c32993-0ffc-4d06-9577-f57e8c4548b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f078c5c4c11d43b5af5486e99df69078', 'request_id': 'req-b9c32993-0ffc-4d06-9577-f57e8c4548b5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:53.101276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b9c32993-0ffc-4d06-9577-f57e8c4548b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f078c5c4c11d43b5af5486e99df69078', 'request_id': 'req-b9c32993-0ffc-4d06-9577-f57e8c4548b5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:53.131516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805bf91f-b86f-42a8-916a-59022c204d63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:53.137249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805bf91f-b86f-42a8-916a-59022c204d63 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:53.155064 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 958/1896] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:52 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:53.155934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bf91f-b86f-42a8-916a-59022c204d63 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:53.197674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bf91f-b86f-42a8-916a-59022c204d63 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:53.276468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc7bca-f6d5-4321-947b-0084ec5df4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:53.277383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc7bca-f6d5-4321-947b-0084ec5df4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:53.277753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc7bca-f6d5-4321-947b-0084ec5df4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:53.278118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc7bca-f6d5-4321-947b-0084ec5df4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:53.278866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc7bca-f6d5-4321-947b-0084ec5df4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:53.280573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc7bca-f6d5-4321-947b-0084ec5df4f4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:53.293677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b9c32993-0ffc-4d06-9577-f57e8c4548b5 admin admin] The token cache is being invalidate because project f078c5c4c11d43b5af5486e99df69078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:53.294454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b9c32993-0ffc-4d06-9577-f57e8c4548b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:53.295121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b9c32993-0ffc-4d06-9577-f57e8c4548b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:53.295703 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 959/1897] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:53.296834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc7bca-f6d5-4321-947b-0084ec5df4f4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:53.300498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f2bc7bca-f6d5-4321-947b-0084ec5df4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:53.300844 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 939/1898] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:52 2022] DELETE /identity/v3/projects/f078c5c4c11d43b5af5486e99df69078 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:53.301775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c32993-0ffc-4d06-9577-f57e8c4548b5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:53.303284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b9c32993-0ffc-4d06-9577-f57e8c4548b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:53.317868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c32993-0ffc-4d06-9577-f57e8c4548b5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:53.335883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc7bca-f6d5-4321-947b-0084ec5df4f4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:53.342936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f30b81-a3d3-4fbf-b83c-e60a3954b86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:53.343637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f30b81-a3d3-4fbf-b83c-e60a3954b86f admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:53.343915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f30b81-a3d3-4fbf-b83c-e60a3954b86f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:53.344217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f30b81-a3d3-4fbf-b83c-e60a3954b86f admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:53.344870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f30b81-a3d3-4fbf-b83c-e60a3954b86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:53.347187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f30b81-a3d3-4fbf-b83c-e60a3954b86f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:53.359082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbcc61-6688-46e7-91b3-2058dbd97cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:53.360309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbcc61-6688-46e7-91b3-2058dbd97cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:53.360595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbcc61-6688-46e7-91b3-2058dbd97cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:53.362900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbcc61-6688-46e7-91b3-2058dbd97cbd admin admin] PATH_INFO: `/v3/projects/9c291fc39e884d9eaa7ba9a757a64c25/users/abb8657e6b70471e869f1cf9198fb07f/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:53.363778 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 960/1899] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:53.398664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bcca6-ffff-47d7-b0c3-0ece43368a36 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:53.399113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bcca6-ffff-47d7-b0c3-0ece43368a36 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:53.403039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bcca6-ffff-47d7-b0c3-0ece43368a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:53.403271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbcc61-6688-46e7-91b3-2058dbd97cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c291fc39e884d9eaa7ba9a757a64c25, user_id=abb8657e6b70471e869f1cf9198fb07f, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:53.405048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbcc61-6688-46e7-91b3-2058dbd97cbd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:53.435084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-373bcca6-ffff-47d7-b0c3-0ece43368a36 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:53.436388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-373bcca6-ffff-47d7-b0c3-0ece43368a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:53.456662 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 961/1900] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:53.471371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bcca6-ffff-47d7-b0c3-0ece43368a36 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:53.471371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-373bcca6-ffff-47d7-b0c3-0ece43368a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:53.478646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bcca6-ffff-47d7-b0c3-0ece43368a36 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:53.483793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aada56-b367-49d8-b467-1d2a0e72c2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:53.485062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aada56-b367-49d8-b467-1d2a0e72c2d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:53.485341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aada56-b367-49d8-b467-1d2a0e72c2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:53.485662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aada56-b367-49d8-b467-1d2a0e72c2d0 admin admin] PATH_INFO: `/v3/projects/94f01a9940a74089816f8478000f0013` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:53.487501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aada56-b367-49d8-b467-1d2a0e72c2d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94f01a9940a74089816f8478000f0013)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:53.489445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aada56-b367-49d8-b467-1d2a0e72c2d0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:53.515291 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 940/1901] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:53 2022] PUT /identity/v3/projects/9c291fc39e884d9eaa7ba9a757a64c25/users/abb8657e6b70471e869f1cf9198fb07f/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:53.516278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbcc61-6688-46e7-91b3-2058dbd97cbd admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:53.599927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbcc61-6688-46e7-91b3-2058dbd97cbd admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:53.606050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c1f74-6266-445a-ad49-04f401986baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:53.606799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c1f74-6266-445a-ad49-04f401986baf admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:53.607279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c1f74-6266-445a-ad49-04f401986baf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:53.608261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c1f74-6266-445a-ad49-04f401986baf admin admin] PATH_INFO: `/v3/projects/07874299a526478f86485a30dac994b3/users/a6d6b147beea482588d7c9abf2be662b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:53.610819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c1f74-6266-445a-ad49-04f401986baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=07874299a526478f86485a30dac994b3, user_id=a6d6b147beea482588d7c9abf2be662b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:53.615596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c1f74-6266-445a-ad49-04f401986baf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:53.630044 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 941/1902] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:53 2022] PUT /identity/v3/projects/07874299a526478f86485a30dac994b3/users/a6d6b147beea482588d7c9abf2be662b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:53.632095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe2f83-f504-48e9-96ab-de3a25cf7c4c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:53.632605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe2f83-f504-48e9-96ab-de3a25cf7c4c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:53.633166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe2f83-f504-48e9-96ab-de3a25cf7c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:53.642888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-27aada56-b367-49d8-b467-1d2a0e72c2d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94f01a9940a74089816f8478000f0013', 'request_id': 'req-27aada56-b367-49d8-b467-1d2a0e72c2d0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:53.652699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-27aada56-b367-49d8-b467-1d2a0e72c2d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94f01a9940a74089816f8478000f0013', 'request_id': 'req-27aada56-b367-49d8-b467-1d2a0e72c2d0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:53.681851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c9fe2f83-f504-48e9-96ab-de3a25cf7c4c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:53.683164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c9fe2f83-f504-48e9-96ab-de3a25cf7c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:53.739534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-27aada56-b367-49d8-b467-1d2a0e72c2d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94f01a9940a74089816f8478000f0013', 'request_id': 'req-27aada56-b367-49d8-b467-1d2a0e72c2d0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:53.750377 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 942/1903] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:53.750377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe2f83-f504-48e9-96ab-de3a25cf7c4c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:53.760078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe2f83-f504-48e9-96ab-de3a25cf7c4c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:53.765325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55001c-beae-4e10-98e7-2163e09f8190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:53.765922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55001c-beae-4e10-98e7-2163e09f8190 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:53.766411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55001c-beae-4e10-98e7-2163e09f8190 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:53.766757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55001c-beae-4e10-98e7-2163e09f8190 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:53.767896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55001c-beae-4e10-98e7-2163e09f8190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:53.770005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55001c-beae-4e10-98e7-2163e09f8190 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:53.778677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-27aada56-b367-49d8-b467-1d2a0e72c2d0 admin admin] The token cache is being invalidate because project 94f01a9940a74089816f8478000f0013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:53.782709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-27aada56-b367-49d8-b467-1d2a0e72c2d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:53.784985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-27aada56-b367-49d8-b467-1d2a0e72c2d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:53.785177 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 943/1904] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:53.787581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0c634-5c8a-46a7-926e-25ead625bcbb None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:53.787581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0c634-5c8a-46a7-926e-25ead625bcbb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:53.787915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0c634-5c8a-46a7-926e-25ead625bcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:53.788229 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 962/1905] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:53 2022] DELETE /identity/v3/projects/94f01a9940a74089816f8478000f0013 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:53.789208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aada56-b367-49d8-b467-1d2a0e72c2d0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:53.794845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-27aada56-b367-49d8-b467-1d2a0e72c2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:53.825553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-add0c634-5c8a-46a7-926e-25ead625bcbb None None] MFA Rules not processed for user `a6d6b147beea482588d7c9abf2be662b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:53.826784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-add0c634-5c8a-46a7-926e-25ead625bcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:53.900327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aada56-b367-49d8-b467-1d2a0e72c2d0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:53.906298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e98e1c-7a50-4326-a776-02c9d7a5a96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:53.907265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e98e1c-7a50-4326-a776-02c9d7a5a96a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:53.907650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e98e1c-7a50-4326-a776-02c9d7a5a96a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:53.908244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e98e1c-7a50-4326-a776-02c9d7a5a96a admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:53.909108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e98e1c-7a50-4326-a776-02c9d7a5a96a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:53.909357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e98e1c-7a50-4326-a776-02c9d7a5a96a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:53.916875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e98e1c-7a50-4326-a776-02c9d7a5a96a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:53.916961 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 944/1906] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:53 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:53.916961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0c634-5c8a-46a7-926e-25ead625bcbb None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:53.916961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-add0c634-5c8a-46a7-926e-25ead625bcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:53.933514 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 963/1907] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:53.934360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0c634-5c8a-46a7-926e-25ead625bcbb None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:53.934831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8784055-d0a0-479f-b0f3-86e1027bcd16 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:53.935113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8784055-d0a0-479f-b0f3-86e1027bcd16 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:53.935381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8784055-d0a0-479f-b0f3-86e1027bcd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:53.940589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab9a68-909e-4202-bb28-f17a0cc15712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:53.945586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab9a68-909e-4202-bb28-f17a0cc15712 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:53.945586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab9a68-909e-4202-bb28-f17a0cc15712 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:53.945586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab9a68-909e-4202-bb28-f17a0cc15712 admin admin] PATH_INFO: `/v3/projects/9c291fc39e884d9eaa7ba9a757a64c25/users/abb8657e6b70471e869f1cf9198fb07f/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:53.945586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab9a68-909e-4202-bb28-f17a0cc15712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c291fc39e884d9eaa7ba9a757a64c25, user_id=abb8657e6b70471e869f1cf9198fb07f, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:53.947672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab9a68-909e-4202-bb28-f17a0cc15712 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:53.955181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a8784055-d0a0-479f-b0f3-86e1027bcd16 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:53.956431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a8784055-d0a0-479f-b0f3-86e1027bcd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:53.959084 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 945/1908] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:53 2022] PUT /identity/v3/projects/9c291fc39e884d9eaa7ba9a757a64c25/users/abb8657e6b70471e869f1cf9198fb07f/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:53.960004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab9a68-909e-4202-bb28-f17a0cc15712 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:53.961707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-81ab9a68-909e-4202-bb28-f17a0cc15712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:54.028241 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 964/1909] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:54.028241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8784055-d0a0-479f-b0f3-86e1027bcd16 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:54.028241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a8784055-d0a0-479f-b0f3-86e1027bcd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:54.037380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab9a68-909e-4202-bb28-f17a0cc15712 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:54.042744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1319908-bb93-45fd-a740-c8c3487f46ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:54.043535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1319908-bb93-45fd-a740-c8c3487f46ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:54.043819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1319908-bb93-45fd-a740-c8c3487f46ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:54.044092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1319908-bb93-45fd-a740-c8c3487f46ec admin admin] PATH_INFO: `/v3/users/9f3d556f9d8948f796a0e1bd01c3b550` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:54.045559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1319908-bb93-45fd-a740-c8c3487f46ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3d556f9d8948f796a0e1bd01c3b550)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:54.047529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1319908-bb93-45fd-a740-c8c3487f46ec admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:54.115999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8784055-d0a0-479f-b0f3-86e1027bcd16 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:54.121953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10a10d-d655-484a-b71f-3145d860b41c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:54.122580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10a10d-d655-484a-b71f-3145d860b41c service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:54.122858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10a10d-d655-484a-b71f-3145d860b41c service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:54.123304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10a10d-d655-484a-b71f-3145d860b41c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:54.194520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10a10d-d655-484a-b71f-3145d860b41c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:54.196292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10a10d-d655-484a-b71f-3145d860b41c service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:54.208263 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 965/1910] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:54 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:54.212892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10a10d-d655-484a-b71f-3145d860b41c service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:54.227135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10a10d-d655-484a-b71f-3145d860b41c service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:54.233692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ac6e4-240c-4ffa-9c1a-0448d441b344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:54.235421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac6e4-240c-4ffa-9c1a-0448d441b344 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:54.235768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac6e4-240c-4ffa-9c1a-0448d441b344 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:54.236052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac6e4-240c-4ffa-9c1a-0448d441b344 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:54.236855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ac6e4-240c-4ffa-9c1a-0448d441b344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:54.241580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ac6e4-240c-4ffa-9c1a-0448d441b344 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:54.296745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b1319908-bb93-45fd-a740-c8c3487f46ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3d556f9d8948f796a0e1bd01c3b550'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:54.356048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b1319908-bb93-45fd-a740-c8c3487f46ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3d556f9d8948f796a0e1bd01c3b550'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:54.356748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b1319908-bb93-45fd-a740-c8c3487f46ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3d556f9d8948f796a0e1bd01c3b550'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:54.369628 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 966/1911] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:54 2022] POST /identity/v3/projects => generated 393 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:54.369628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a67af-5e72-46dd-afdb-d6487033d816 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:54.369628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a67af-5e72-46dd-afdb-d6487033d816 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:54.370255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b1319908-bb93-45fd-a740-c8c3487f46ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3d556f9d8948f796a0e1bd01c3b550'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:54.371260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a67af-5e72-46dd-afdb-d6487033d816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:54.398860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b1319908-bb93-45fd-a740-c8c3487f46ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3d556f9d8948f796a0e1bd01c3b550'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:54.409873 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 946/1912] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:53 2022] DELETE /identity/v3/users/9f3d556f9d8948f796a0e1bd01c3b550 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:54.411859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ed642-185b-45a4-8d90-e9c8ad637c7c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:54.412151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ed642-185b-45a4-8d90-e9c8ad637c7c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:54.412449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ed642-185b-45a4-8d90-e9c8ad637c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:54.433043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ce1a67af-5e72-46dd-afdb-d6487033d816 None None] MFA Rules not processed for user `abb8657e6b70471e869f1cf9198fb07f`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:54.435331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ce1a67af-5e72-46dd-afdb-d6487033d816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:54.459114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9b2ed642-185b-45a4-8d90-e9c8ad637c7c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:54.468286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9b2ed642-185b-45a4-8d90-e9c8ad637c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:54.523574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:54.530508 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 967/1913] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:54.531525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a67af-5e72-46dd-afdb-d6487033d816 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:54.533974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ce1a67af-5e72-46dd-afdb-d6487033d816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:54.543848 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 947/1914] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:54.545372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5b15f-6714-407c-9f4a-e07ed5562f72 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:54.545802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5b15f-6714-407c-9f4a-e07ed5562f72 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:54.546232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5b15f-6714-407c-9f4a-e07ed5562f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:54.550844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a67af-5e72-46dd-afdb-d6487033d816 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:54.556219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f58760-abac-45cf-b36b-7be20eab2498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:54.556985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f58760-abac-45cf-b36b-7be20eab2498 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:54.557510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f58760-abac-45cf-b36b-7be20eab2498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:54.557895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f58760-abac-45cf-b36b-7be20eab2498 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:54.558637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f58760-abac-45cf-b36b-7be20eab2498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:54.560811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f58760-abac-45cf-b36b-7be20eab2498 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:54.566742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b8d5b15f-6714-407c-9f4a-e07ed5562f72 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:54.567967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b8d5b15f-6714-407c-9f4a-e07ed5562f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:54.575595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:54.579677 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 948/1915] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:54.579677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5b15f-6714-407c-9f4a-e07ed5562f72 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:54.579677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b8d5b15f-6714-407c-9f4a-e07ed5562f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:54.591974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5b15f-6714-407c-9f4a-e07ed5562f72 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:54.596693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bb8a0-f312-494a-932f-ad03ac8313cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:54.597401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bb8a0-f312-494a-932f-ad03ac8313cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:54.598412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bb8a0-f312-494a-932f-ad03ac8313cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:54.598700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bb8a0-f312-494a-932f-ad03ac8313cb admin admin] PATH_INFO: `/v3/users/ce38d28fd179474dba9e0f9c3bd042e7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:54.605980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bb8a0-f312-494a-932f-ad03ac8313cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce38d28fd179474dba9e0f9c3bd042e7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:54.605980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bb8a0-f312-494a-932f-ad03ac8313cb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:54.656789 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 968/1916] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:54 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:54.656789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f58760-abac-45cf-b36b-7be20eab2498 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:54.657993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-27f58760-abac-45cf-b36b-7be20eab2498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:54.737311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f58760-abac-45cf-b36b-7be20eab2498 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:54.744543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e1b82-a3e0-4216-8bcf-d3a5a29c8e05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:54.745159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e1b82-a3e0-4216-8bcf-d3a5a29c8e05 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:54.745438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e1b82-a3e0-4216-8bcf-d3a5a29c8e05 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:54.745711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e1b82-a3e0-4216-8bcf-d3a5a29c8e05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:54.754869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e1b82-a3e0-4216-8bcf-d3a5a29c8e05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:54.756573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e1b82-a3e0-4216-8bcf-d3a5a29c8e05 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:54.769544 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 969/1917] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:54.770855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e1b82-a3e0-4216-8bcf-d3a5a29c8e05 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:54.782198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e1b82-a3e0-4216-8bcf-d3a5a29c8e05 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:54.787808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c196cb8-29e1-4e2e-8f0e-4d663717546b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:54.788459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196cb8-29e1-4e2e-8f0e-4d663717546b admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:54.788738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196cb8-29e1-4e2e-8f0e-4d663717546b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:54.789473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196cb8-29e1-4e2e-8f0e-4d663717546b admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:54.789647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c196cb8-29e1-4e2e-8f0e-4d663717546b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:54.789931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c196cb8-29e1-4e2e-8f0e-4d663717546b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:54.791513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c196cb8-29e1-4e2e-8f0e-4d663717546b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:54.804000 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 970/1918] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:54.805029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c196cb8-29e1-4e2e-8f0e-4d663717546b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:54.806886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7c196cb8-29e1-4e2e-8f0e-4d663717546b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:54.835372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-619bb8a0-f312-494a-932f-ad03ac8313cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce38d28fd179474dba9e0f9c3bd042e7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:54.869781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c196cb8-29e1-4e2e-8f0e-4d663717546b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:54.874523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8310a3e-a1d7-482c-8f43-9c0945a02ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:54.875142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8310a3e-a1d7-482c-8f43-9c0945a02ceb service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:54.875417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8310a3e-a1d7-482c-8f43-9c0945a02ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:54.875689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8310a3e-a1d7-482c-8f43-9c0945a02ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:54.885754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8310a3e-a1d7-482c-8f43-9c0945a02ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:54.887429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8310a3e-a1d7-482c-8f43-9c0945a02ceb service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:54.899769 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 971/1919] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:54.904939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8310a3e-a1d7-482c-8f43-9c0945a02ceb service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:54.922530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8310a3e-a1d7-482c-8f43-9c0945a02ceb service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:54.932113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aca61f-15b7-498f-9283-4fa50a20dafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:54.933149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aca61f-15b7-498f-9283-4fa50a20dafa admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:54.933644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aca61f-15b7-498f-9283-4fa50a20dafa admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:54.934146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aca61f-15b7-498f-9283-4fa50a20dafa admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:54.939841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aca61f-15b7-498f-9283-4fa50a20dafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:54.939841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aca61f-15b7-498f-9283-4fa50a20dafa admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:54.946251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-619bb8a0-f312-494a-932f-ad03ac8313cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce38d28fd179474dba9e0f9c3bd042e7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:54.946925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-619bb8a0-f312-494a-932f-ad03ac8313cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce38d28fd179474dba9e0f9c3bd042e7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:54.964149 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 972/1920] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:54.965814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aca61f-15b7-498f-9283-4fa50a20dafa admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:54.969934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-619bb8a0-f312-494a-932f-ad03ac8313cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce38d28fd179474dba9e0f9c3bd042e7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:54.988145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aca61f-15b7-498f-9283-4fa50a20dafa admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:54.990692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-619bb8a0-f312-494a-932f-ad03ac8313cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce38d28fd179474dba9e0f9c3bd042e7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:54.995841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0272b1-bc1a-49ff-9eff-06cfbadd23bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:54.996877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0272b1-bc1a-49ff-9eff-06cfbadd23bc admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:54.997369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0272b1-bc1a-49ff-9eff-06cfbadd23bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:54.997872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0272b1-bc1a-49ff-9eff-06cfbadd23bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:54.999033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0272b1-bc1a-49ff-9eff-06cfbadd23bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:55.003337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0272b1-bc1a-49ff-9eff-06cfbadd23bc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:55.007608 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 949/1921] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:54 2022] DELETE /identity/v3/users/ce38d28fd179474dba9e0f9c3bd042e7 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:55.009068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bb8a0-f312-494a-932f-ad03ac8313cb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:55.013470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-619bb8a0-f312-494a-932f-ad03ac8313cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:55.113672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bb8a0-f312-494a-932f-ad03ac8313cb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:55.120685 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 973/1922] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:54 2022] POST /identity/v3/projects => generated 405 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:55.121412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ae475-8b51-4808-9dcd-8da98078b8c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:55.122064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ae475-8b51-4808-9dcd-8da98078b8c9 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:55.122346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ae475-8b51-4808-9dcd-8da98078b8c9 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:55.122570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0272b1-bc1a-49ff-9eff-06cfbadd23bc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:55.122682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ae475-8b51-4808-9dcd-8da98078b8c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:55.125195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bd0272b1-bc1a-49ff-9eff-06cfbadd23bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:55.125369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c36ae475-8b51-4808-9dcd-8da98078b8c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:55.217511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:55.217692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0272b1-bc1a-49ff-9eff-06cfbadd23bc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:55.224888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a797394-0979-43f8-827e-23da5842d31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:55.225735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a797394-0979-43f8-827e-23da5842d31b admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:55.226290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a797394-0979-43f8-827e-23da5842d31b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:55.227638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a797394-0979-43f8-827e-23da5842d31b admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:55.228775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a797394-0979-43f8-827e-23da5842d31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:55.231259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a797394-0979-43f8-827e-23da5842d31b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:55.242170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ae475-8b51-4808-9dcd-8da98078b8c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:55.243978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ae475-8b51-4808-9dcd-8da98078b8c9 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:55.248209 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 974/1923] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:55.248725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c905f42-1cd4-41df-8884-fa096eb1011b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:55.249033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c905f42-1cd4-41df-8884-fa096eb1011b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:55.249717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c905f42-1cd4-41df-8884-fa096eb1011b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:55.257249 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 950/1924] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:55.258345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ae475-8b51-4808-9dcd-8da98078b8c9 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:55.259644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c36ae475-8b51-4808-9dcd-8da98078b8c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:55.281645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8c905f42-1cd4-41df-8884-fa096eb1011b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:55.283598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8c905f42-1cd4-41df-8884-fa096eb1011b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:55.294823 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 975/1925] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:55.295859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c905f42-1cd4-41df-8884-fa096eb1011b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:55.325048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c905f42-1cd4-41df-8884-fa096eb1011b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:55.331242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc698b-13fa-4690-a9dc-bed2a14e5a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:55.331242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc698b-13fa-4690-a9dc-bed2a14e5a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:55.331501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc698b-13fa-4690-a9dc-bed2a14e5a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:55.331757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc698b-13fa-4690-a9dc-bed2a14e5a14 admin admin] PATH_INFO: `/v3/projects/53e16ad050b14326978c7b1a5fae8dcc/users/de3900ebfb934a1293119f2cf29f319d/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:55.353738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ae475-8b51-4808-9dcd-8da98078b8c9 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:55.358862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc698b-13fa-4690-a9dc-bed2a14e5a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e16ad050b14326978c7b1a5fae8dcc, user_id=de3900ebfb934a1293119f2cf29f319d, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:55.361781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc698b-13fa-4690-a9dc-bed2a14e5a14 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:55.363045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bc33f-50b3-457b-bee0-9893a783be81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:55.364427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bc33f-50b3-457b-bee0-9893a783be81 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:55.364803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bc33f-50b3-457b-bee0-9893a783be81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:55.365079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bc33f-50b3-457b-bee0-9893a783be81 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:55.365727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bc33f-50b3-457b-bee0-9893a783be81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:55.367673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bc33f-50b3-457b-bee0-9893a783be81 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:55.436497 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 976/1926] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:55 2022] PUT /identity/v3/projects/53e16ad050b14326978c7b1a5fae8dcc/users/de3900ebfb934a1293119f2cf29f319d/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:55.437385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc698b-13fa-4690-a9dc-bed2a14e5a14 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:55.439026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6efc698b-13fa-4690-a9dc-bed2a14e5a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:55.493764 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 951/1927] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:55 2022] POST /identity/v3/users => generated 303 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:55.496439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b99179-b1bc-4d6b-ac5a-c00014b49547 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:55.496738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b99179-b1bc-4d6b-ac5a-c00014b49547 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:55.497290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b99179-b1bc-4d6b-ac5a-c00014b49547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:55.515970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc698b-13fa-4690-a9dc-bed2a14e5a14 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:55.522552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76338e8-4a1b-4ac9-929a-bf81227ea7b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:55.523184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76338e8-4a1b-4ac9-929a-bf81227ea7b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:55.523498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76338e8-4a1b-4ac9-929a-bf81227ea7b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:55.523735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76338e8-4a1b-4ac9-929a-bf81227ea7b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:55.548179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f6b99179-b1bc-4d6b-ac5a-c00014b49547 None None] MFA Rules not processed for user `de3900ebfb934a1293119f2cf29f319d`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:55.549032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f6b99179-b1bc-4d6b-ac5a-c00014b49547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:55.592424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:55.638236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76338e8-4a1b-4ac9-929a-bf81227ea7b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:55.639803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76338e8-4a1b-4ac9-929a-bf81227ea7b8 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:55.652359 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 952/1928] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:55.653308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b99179-b1bc-4d6b-ac5a-c00014b49547 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:55.656341 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 977/1929] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:55.657468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76338e8-4a1b-4ac9-929a-bf81227ea7b8 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:55.659658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d76338e8-4a1b-4ac9-929a-bf81227ea7b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:55.665319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b99179-b1bc-4d6b-ac5a-c00014b49547 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:55.670166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c910d-263b-41fb-ba7c-52d52f72107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:55.671232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c910d-263b-41fb-ba7c-52d52f72107f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:55.671232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c910d-263b-41fb-ba7c-52d52f72107f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:55.671421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c910d-263b-41fb-ba7c-52d52f72107f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:55.672001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c910d-263b-41fb-ba7c-52d52f72107f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:55.673825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c910d-263b-41fb-ba7c-52d52f72107f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:55.681512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76338e8-4a1b-4ac9-929a-bf81227ea7b8 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:55.686421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:55.687220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:55.687508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:55.687787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d admin admin] PATH_INFO: `/v3/projects/2900af09c3054d8ab1483c824ed091a2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:55.689193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2900af09c3054d8ab1483c824ed091a2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:55.691782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:55.711030 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 953/1930] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:55.711875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c910d-263b-41fb-ba7c-52d52f72107f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:55.725984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c910d-263b-41fb-ba7c-52d52f72107f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:55.741551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77726f-290d-4dad-b6dd-189b6a99dd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:55.742181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77726f-290d-4dad-b6dd-189b6a99dd6b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:55.742520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77726f-290d-4dad-b6dd-189b6a99dd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:55.742735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77726f-290d-4dad-b6dd-189b6a99dd6b admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:55.743375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77726f-290d-4dad-b6dd-189b6a99dd6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:55.745367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77726f-290d-4dad-b6dd-189b6a99dd6b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:55.875163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2900af09c3054d8ab1483c824ed091a2', 'request_id': 'req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:55.876318 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 954/1931] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:55 2022] POST /identity/v3/projects => generated 393 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:55.879954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351503f0-1b32-4f77-8466-fe2ffeba74ce None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:55.880612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351503f0-1b32-4f77-8466-fe2ffeba74ce None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:55.881462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351503f0-1b32-4f77-8466-fe2ffeba74ce None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:55.884135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2900af09c3054d8ab1483c824ed091a2', 'request_id': 'req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:55.887438 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 955/1932] 10.222.0.76 () {54 vars in 921 bytes} [Sat Aug 27 04:38:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:38:55.890438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351503f0-1b32-4f77-8466-fe2ffeba74ce None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:55.933607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2900af09c3054d8ab1483c824ed091a2', 'request_id': 'req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:55.952976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d admin admin] The token cache is being invalidate because project 2900af09c3054d8ab1483c824ed091a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:55.953407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:55.954181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:55.956021 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 978/1933] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:55 2022] DELETE /identity/v3/projects/2900af09c3054d8ab1483c824ed091a2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:55.956709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:55.959290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:55.995442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351503f0-1b32-4f77-8466-fe2ffeba74ce None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:56.001782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bcadd-6c28-4e9c-93c4-8c50bc804999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:56.002565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bcadd-6c28-4e9c-93c4-8c50bc804999 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:56.003388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bcadd-6c28-4e9c-93c4-8c50bc804999 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:56.003925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bcadd-6c28-4e9c-93c4-8c50bc804999 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:56.004737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0bcadd-6c28-4e9c-93c4-8c50bc804999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:56.006930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0bcadd-6c28-4e9c-93c4-8c50bc804999 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:56.018218 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 956/1934] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:56.019007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bcadd-6c28-4e9c-93c4-8c50bc804999 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:56.021390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0c0bcadd-6c28-4e9c-93c4-8c50bc804999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:56.033219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc03493-2e3b-4f09-9452-d8d6cbfbb44d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:56.034222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bcadd-6c28-4e9c-93c4-8c50bc804999 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:56.039514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599e467-5b65-4727-aaa2-6f87fbb3992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:56.039955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd4590-153a-454b-9c5f-5fcf48768913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:56.040336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e467-5b65-4727-aaa2-6f87fbb3992b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:56.040593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd4590-153a-454b-9c5f-5fcf48768913 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:56.040687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e467-5b65-4727-aaa2-6f87fbb3992b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:56.040870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd4590-153a-454b-9c5f-5fcf48768913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:56.041022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e467-5b65-4727-aaa2-6f87fbb3992b admin admin] PATH_INFO: `/v3/users/e1a5f52f15024f4e89bb41dc0cc698ae` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:56.041157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd4590-153a-454b-9c5f-5fcf48768913 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:56.041764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd4590-153a-454b-9c5f-5fcf48768913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:56.042471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599e467-5b65-4727-aaa2-6f87fbb3992b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1a5f52f15024f4e89bb41dc0cc698ae)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:56.043685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd4590-153a-454b-9c5f-5fcf48768913 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:56.044585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599e467-5b65-4727-aaa2-6f87fbb3992b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:56.138545 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 957/1935] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:56 2022] POST /identity/v3/users => generated 303 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:56.139819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a9e0d-f9dc-4e34-a28e-3675c585f0c0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:56.140757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a9e0d-f9dc-4e34-a28e-3675c585f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:56.141032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a9e0d-f9dc-4e34-a28e-3675c585f0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:56.160815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-229a9e0d-f9dc-4e34-a28e-3675c585f0c0 None None] MFA Rules not processed for user `0e5ddcf00a184aa0ac0e7194f1c72425`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:56.162003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-229a9e0d-f9dc-4e34-a28e-3675c585f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:56.167992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:56.236582 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 958/1936] 10.222.0.76 () {58 vars in 1018 bytes} [Sat Aug 27 04:38:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:56.237870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a9e0d-f9dc-4e34-a28e-3675c585f0c0 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:56.239161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-229a9e0d-f9dc-4e34-a28e-3675c585f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:56.252899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a9e0d-f9dc-4e34-a28e-3675c585f0c0 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:56.266024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5dbf5-edc5-47c9-b4d9-eb1d04ea55ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:56.266024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5dbf5-edc5-47c9-b4d9-eb1d04ea55ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:56.266024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5dbf5-edc5-47c9-b4d9-eb1d04ea55ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:56.266024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5dbf5-edc5-47c9-b4d9-eb1d04ea55ba admin admin] PATH_INFO: `/v3/users/a841b7d3eb674efdba9a66ccd9b53897` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:56.266473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5dbf5-edc5-47c9-b4d9-eb1d04ea55ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=a841b7d3eb674efdba9a66ccd9b53897)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:56.266473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5dbf5-edc5-47c9-b4d9-eb1d04ea55ba admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:56.272890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7599e467-5b65-4727-aaa2-6f87fbb3992b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1a5f52f15024f4e89bb41dc0cc698ae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:56.273681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7599e467-5b65-4727-aaa2-6f87fbb3992b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1a5f52f15024f4e89bb41dc0cc698ae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:56.378346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7599e467-5b65-4727-aaa2-6f87fbb3992b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1a5f52f15024f4e89bb41dc0cc698ae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:56.379643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7599e467-5b65-4727-aaa2-6f87fbb3992b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1a5f52f15024f4e89bb41dc0cc698ae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:56.392280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7599e467-5b65-4727-aaa2-6f87fbb3992b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1a5f52f15024f4e89bb41dc0cc698ae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:56.406638 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 979/1937] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:55 2022] DELETE /identity/v3/users/e1a5f52f15024f4e89bb41dc0cc698ae => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:56.407660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599e467-5b65-4727-aaa2-6f87fbb3992b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:56.409937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7599e467-5b65-4727-aaa2-6f87fbb3992b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:56.474713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599e467-5b65-4727-aaa2-6f87fbb3992b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:56.479266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379596b-5fed-462d-8039-47cce5720f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:56.479929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379596b-5fed-462d-8039-47cce5720f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:56.480238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379596b-5fed-462d-8039-47cce5720f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:56.480514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379596b-5fed-462d-8039-47cce5720f53 admin admin] PATH_INFO: `/v3/projects/0e2774ce585b4cfba6bcec93ae80096f/users/efe6d41548884cd1b34043afe1bafc51/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:56.494695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379596b-5fed-462d-8039-47cce5720f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2774ce585b4cfba6bcec93ae80096f, user_id=efe6d41548884cd1b34043afe1bafc51, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:56.497418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379596b-5fed-462d-8039-47cce5720f53 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:56.501194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fcb5dbf5-edc5-47c9-b4d9-eb1d04ea55ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a841b7d3eb674efdba9a66ccd9b53897'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:56.590486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:56.630873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fcb5dbf5-edc5-47c9-b4d9-eb1d04ea55ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a841b7d3eb674efdba9a66ccd9b53897'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:56.631844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fcb5dbf5-edc5-47c9-b4d9-eb1d04ea55ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a841b7d3eb674efdba9a66ccd9b53897'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:56.640402 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 980/1938] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:56 2022] PUT /identity/v3/projects/0e2774ce585b4cfba6bcec93ae80096f/users/efe6d41548884cd1b34043afe1bafc51/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:56.641729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379596b-5fed-462d-8039-47cce5720f53 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:56.644230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fcb5dbf5-edc5-47c9-b4d9-eb1d04ea55ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a841b7d3eb674efdba9a66ccd9b53897'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:56.645673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c379596b-5fed-462d-8039-47cce5720f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:56.662638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fcb5dbf5-edc5-47c9-b4d9-eb1d04ea55ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a841b7d3eb674efdba9a66ccd9b53897'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:56.671969 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 959/1939] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:56 2022] DELETE /identity/v3/users/a841b7d3eb674efdba9a66ccd9b53897 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:56.673311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5dbf5-edc5-47c9-b4d9-eb1d04ea55ba admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:56.677768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fcb5dbf5-edc5-47c9-b4d9-eb1d04ea55ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:56.747938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379596b-5fed-462d-8039-47cce5720f53 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:56.749586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5dbf5-edc5-47c9-b4d9-eb1d04ea55ba admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:56.755721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d123c8b-0640-42ab-8a05-1ad1de540145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:56.756751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d123c8b-0640-42ab-8a05-1ad1de540145 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:56.757220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d123c8b-0640-42ab-8a05-1ad1de540145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:56.757694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d123c8b-0640-42ab-8a05-1ad1de540145 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:56.758807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d123c8b-0640-42ab-8a05-1ad1de540145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:56.761179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b1938-8980-4673-bedf-f441ba053ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:56.761375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d123c8b-0640-42ab-8a05-1ad1de540145 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:56.761845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b1938-8980-4673-bedf-f441ba053ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:56.762129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b1938-8980-4673-bedf-f441ba053ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:56.762405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b1938-8980-4673-bedf-f441ba053ffa admin admin] PATH_INFO: `/v3/projects/f8753714da584eb8a8ff4f7cd6b158d4` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:56.763561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b1938-8980-4673-bedf-f441ba053ffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8753714da584eb8a8ff4f7cd6b158d4)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:56.765991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b1938-8980-4673-bedf-f441ba053ffa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:56.774119 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 981/1940] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:56.775057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d123c8b-0640-42ab-8a05-1ad1de540145 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:56.778604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0d123c8b-0640-42ab-8a05-1ad1de540145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:56.858311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d123c8b-0640-42ab-8a05-1ad1de540145 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:56.866007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72386a-aa4a-44ad-82ac-bed21655f53a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:56.866650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72386a-aa4a-44ad-82ac-bed21655f53a service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:56.866921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72386a-aa4a-44ad-82ac-bed21655f53a service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:56.867184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72386a-aa4a-44ad-82ac-bed21655f53a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:56.869304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1d72386a-aa4a-44ad-82ac-bed21655f53a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:56.882362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72386a-aa4a-44ad-82ac-bed21655f53a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:56.883925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72386a-aa4a-44ad-82ac-bed21655f53a service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:56.894272 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 982/1941] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:56.895553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35d144-2884-4bae-8388-cf38699e1fc6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:56.895834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35d144-2884-4bae-8388-cf38699e1fc6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:56.896102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35d144-2884-4bae-8388-cf38699e1fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:56.917703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7c35d144-2884-4bae-8388-cf38699e1fc6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:56.919145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7c35d144-2884-4bae-8388-cf38699e1fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:56.920292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1e0b1938-8980-4673-bedf-f441ba053ffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8753714da584eb8a8ff4f7cd6b158d4', 'request_id': 'req-1e0b1938-8980-4673-bedf-f441ba053ffa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:56.928567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1e0b1938-8980-4673-bedf-f441ba053ffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8753714da584eb8a8ff4f7cd6b158d4', 'request_id': 'req-1e0b1938-8980-4673-bedf-f441ba053ffa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:56.941400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1e0b1938-8980-4673-bedf-f441ba053ffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8753714da584eb8a8ff4f7cd6b158d4', 'request_id': 'req-1e0b1938-8980-4673-bedf-f441ba053ffa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:57.002389 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 983/1942] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:57.005575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1e61e-4d5d-4c8e-b309-ebebb829e3bc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:57.006327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1e61e-4d5d-4c8e-b309-ebebb829e3bc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:57.006327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1e61e-4d5d-4c8e-b309-ebebb829e3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:57.028765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-35a1e61e-4d5d-4c8e-b309-ebebb829e3bc None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:57.030012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-35a1e61e-4d5d-4c8e-b309-ebebb829e3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:57.038645 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 984/1943] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:57.039451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1e61e-4d5d-4c8e-b309-ebebb829e3bc None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:57.040934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-35a1e61e-4d5d-4c8e-b309-ebebb829e3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:57.054968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1e61e-4d5d-4c8e-b309-ebebb829e3bc None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:57.059734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b6012-8b1a-4b31-b917-2e36bfa885d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:57.060437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b6012-8b1a-4b31-b917-2e36bfa885d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:57.060712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b6012-8b1a-4b31-b917-2e36bfa885d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:57.060980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b6012-8b1a-4b31-b917-2e36bfa885d7 admin admin] PATH_INFO: `/v3/projects/a7f150be00514a02a7d339aa7a111332/users/aa9f5c2feca843d392983dbae4b9e2c2/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:57.076144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b6012-8b1a-4b31-b917-2e36bfa885d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f150be00514a02a7d339aa7a111332, user_id=aa9f5c2feca843d392983dbae4b9e2c2, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:57.078792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b6012-8b1a-4b31-b917-2e36bfa885d7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:57.082730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:57.089530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1e0b1938-8980-4673-bedf-f441ba053ffa admin admin] The token cache is being invalidate because project f8753714da584eb8a8ff4f7cd6b158d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:57.090462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1e0b1938-8980-4673-bedf-f441ba053ffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:57.090560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1e0b1938-8980-4673-bedf-f441ba053ffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:57.095166 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 960/1944] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:56 2022] DELETE /identity/v3/projects/f8753714da584eb8a8ff4f7cd6b158d4 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:57.095166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b1938-8980-4673-bedf-f441ba053ffa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:57.095166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1e0b1938-8980-4673-bedf-f441ba053ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:57.152961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b1938-8980-4673-bedf-f441ba053ffa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:57.156507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce472fb-2299-48e7-b1b9-a853e4d6e337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:57.157105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce472fb-2299-48e7-b1b9-a853e4d6e337 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:57.157383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce472fb-2299-48e7-b1b9-a853e4d6e337 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:57.157654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce472fb-2299-48e7-b1b9-a853e4d6e337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:57.159370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6ce472fb-2299-48e7-b1b9-a853e4d6e337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:57.171756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce472fb-2299-48e7-b1b9-a853e4d6e337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:57.173224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce472fb-2299-48e7-b1b9-a853e4d6e337 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:57.183680 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 961/1945] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:57.184496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce472fb-2299-48e7-b1b9-a853e4d6e337 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:57.185786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6ce472fb-2299-48e7-b1b9-a853e4d6e337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:57.196104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce472fb-2299-48e7-b1b9-a853e4d6e337 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:57.199916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89325-4c77-4be0-898b-fef2f5876676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:57.200809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89325-4c77-4be0-898b-fef2f5876676 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:57.201094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89325-4c77-4be0-898b-fef2f5876676 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:57.201365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89325-4c77-4be0-898b-fef2f5876676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:57.203200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a8b89325-4c77-4be0-898b-fef2f5876676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:57.215525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b89325-4c77-4be0-898b-fef2f5876676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:57.217017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b89325-4c77-4be0-898b-fef2f5876676 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:57.227102 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 962/1946] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:57.227885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89325-4c77-4be0-898b-fef2f5876676 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:57.229218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a8b89325-4c77-4be0-898b-fef2f5876676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:57.245407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89325-4c77-4be0-898b-fef2f5876676 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:57.246718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5878115-c7ab-4b1f-b260-125ede7ab8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:57.247337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5878115-c7ab-4b1f-b260-125ede7ab8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:57.247624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5878115-c7ab-4b1f-b260-125ede7ab8db admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:57.247900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5878115-c7ab-4b1f-b260-125ede7ab8db admin admin] PATH_INFO: `/v3/users/a6d6b147beea482588d7c9abf2be662b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:57.249044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5878115-c7ab-4b1f-b260-125ede7ab8db admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d6b147beea482588d7c9abf2be662b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:57.250950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5878115-c7ab-4b1f-b260-125ede7ab8db admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:57.291343 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 985/1947] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:57 2022] PUT /identity/v3/projects/a7f150be00514a02a7d339aa7a111332/users/aa9f5c2feca843d392983dbae4b9e2c2/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:57.291343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b6012-8b1a-4b31-b917-2e36bfa885d7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:57.292808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e76b6012-8b1a-4b31-b917-2e36bfa885d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:57.323281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:57.364123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b6012-8b1a-4b31-b917-2e36bfa885d7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:57.371455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc126a0c-3509-429b-b8ed-2719ad99b5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:57.371455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc126a0c-3509-429b-b8ed-2719ad99b5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:57.371455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc126a0c-3509-429b-b8ed-2719ad99b5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:57.371455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc126a0c-3509-429b-b8ed-2719ad99b5b8 admin admin] PATH_INFO: `/v3/projects/122e99ea16214018ad34a2ef7373ebb7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:57.371836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc126a0c-3509-429b-b8ed-2719ad99b5b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=122e99ea16214018ad34a2ef7373ebb7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:57.372824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc126a0c-3509-429b-b8ed-2719ad99b5b8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:57.542552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a5878115-c7ab-4b1f-b260-125ede7ab8db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d6b147beea482588d7c9abf2be662b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:57.549207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cc126a0c-3509-429b-b8ed-2719ad99b5b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122e99ea16214018ad34a2ef7373ebb7', 'request_id': 'req-cc126a0c-3509-429b-b8ed-2719ad99b5b8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:57.557936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cc126a0c-3509-429b-b8ed-2719ad99b5b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122e99ea16214018ad34a2ef7373ebb7', 'request_id': 'req-cc126a0c-3509-429b-b8ed-2719ad99b5b8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:57.670029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a5878115-c7ab-4b1f-b260-125ede7ab8db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d6b147beea482588d7c9abf2be662b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:57.670733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a5878115-c7ab-4b1f-b260-125ede7ab8db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d6b147beea482588d7c9abf2be662b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:57.679218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a5878115-c7ab-4b1f-b260-125ede7ab8db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d6b147beea482588d7c9abf2be662b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:57.692704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a5878115-c7ab-4b1f-b260-125ede7ab8db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d6b147beea482588d7c9abf2be662b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:57.698907 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 963/1948] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:57 2022] DELETE /identity/v3/users/a6d6b147beea482588d7c9abf2be662b => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:57.700522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5878115-c7ab-4b1f-b260-125ede7ab8db admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:57.703628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a5878115-c7ab-4b1f-b260-125ede7ab8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:57.757034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cc126a0c-3509-429b-b8ed-2719ad99b5b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122e99ea16214018ad34a2ef7373ebb7', 'request_id': 'req-cc126a0c-3509-429b-b8ed-2719ad99b5b8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:57.773951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cc126a0c-3509-429b-b8ed-2719ad99b5b8 admin admin] The token cache is being invalidate because project 122e99ea16214018ad34a2ef7373ebb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:57.774602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cc126a0c-3509-429b-b8ed-2719ad99b5b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:57.776870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cc126a0c-3509-429b-b8ed-2719ad99b5b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:57.784085 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 986/1949] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:57 2022] DELETE /identity/v3/projects/122e99ea16214018ad34a2ef7373ebb7 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:38:57.784863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc126a0c-3509-429b-b8ed-2719ad99b5b8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:57.786860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cc126a0c-3509-429b-b8ed-2719ad99b5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:57.807145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5878115-c7ab-4b1f-b260-125ede7ab8db admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:57.813292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d9cf8-8947-40a1-98c8-8c85dcac7bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:57.813967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d9cf8-8947-40a1-98c8-8c85dcac7bbf admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:57.814371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d9cf8-8947-40a1-98c8-8c85dcac7bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:57.814760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d9cf8-8947-40a1-98c8-8c85dcac7bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:57.823662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d9cf8-8947-40a1-98c8-8c85dcac7bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:57.823662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d9cf8-8947-40a1-98c8-8c85dcac7bbf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:57.828573 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 964/1950] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:57.829874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed0161-a1ca-4096-8a10-03c33a2ae9e1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:57.830160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed0161-a1ca-4096-8a10-03c33a2ae9e1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:57.830434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed0161-a1ca-4096-8a10-03c33a2ae9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:57.852276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a2ed0161-a1ca-4096-8a10-03c33a2ae9e1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:57.853500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a2ed0161-a1ca-4096-8a10-03c33a2ae9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:57.861840 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 965/1951] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:57.862656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed0161-a1ca-4096-8a10-03c33a2ae9e1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:57.864474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a2ed0161-a1ca-4096-8a10-03c33a2ae9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:57.871884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc126a0c-3509-429b-b8ed-2719ad99b5b8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:57.877646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7813d-ddc5-407c-baa8-11ccb487e5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:57.878530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed0161-a1ca-4096-8a10-03c33a2ae9e1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:57.879539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7813d-ddc5-407c-baa8-11ccb487e5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:57.880002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7813d-ddc5-407c-baa8-11ccb487e5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:57.882143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7813d-ddc5-407c-baa8-11ccb487e5c8 admin admin] PATH_INFO: `/v3/projects/76a738c95fb340e99ec9da1cf243a549` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:57.883627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7813d-ddc5-407c-baa8-11ccb487e5c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76a738c95fb340e99ec9da1cf243a549)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:57.884496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe395c3-fb10-4395-b046-554d470ce372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:57.886728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe395c3-fb10-4395-b046-554d470ce372 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:57.886728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe395c3-fb10-4395-b046-554d470ce372 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:57.886728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe395c3-fb10-4395-b046-554d470ce372 admin admin] PATH_INFO: `/v3/projects/a7f150be00514a02a7d339aa7a111332/users/aa9f5c2feca843d392983dbae4b9e2c2/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:57.886974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7813d-ddc5-407c-baa8-11ccb487e5c8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:57.887983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe395c3-fb10-4395-b046-554d470ce372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f150be00514a02a7d339aa7a111332, user_id=aa9f5c2feca843d392983dbae4b9e2c2, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:57.890659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe395c3-fb10-4395-b046-554d470ce372 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:57.915452 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 966/1952] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:57 2022] PUT /identity/v3/projects/a7f150be00514a02a7d339aa7a111332/users/aa9f5c2feca843d392983dbae4b9e2c2/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:57.915452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051385d3-0850-4607-9865-f2061ddf2606 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:57.915452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051385d3-0850-4607-9865-f2061ddf2606 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:57.915452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051385d3-0850-4607-9865-f2061ddf2606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:57.932722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-051385d3-0850-4607-9865-f2061ddf2606 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:57.934051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-051385d3-0850-4607-9865-f2061ddf2606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:57.999295 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 967/1953] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:58.000669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb811db-c6c0-4fa7-b9fe-c655149031c2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:58.000966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb811db-c6c0-4fa7-b9fe-c655149031c2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:58.001213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb811db-c6c0-4fa7-b9fe-c655149031c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:58.031121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ebb811db-c6c0-4fa7-b9fe-c655149031c2 None None] MFA Rules not processed for user `aa9f5c2feca843d392983dbae4b9e2c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:58.032481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ebb811db-c6c0-4fa7-b9fe-c655149031c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:58.069277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-93c7813d-ddc5-407c-baa8-11ccb487e5c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76a738c95fb340e99ec9da1cf243a549', 'request_id': 'req-93c7813d-ddc5-407c-baa8-11ccb487e5c8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:58.075356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-93c7813d-ddc5-407c-baa8-11ccb487e5c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76a738c95fb340e99ec9da1cf243a549', 'request_id': 'req-93c7813d-ddc5-407c-baa8-11ccb487e5c8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:58.112721 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 968/1954] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:57 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:58.114784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb811db-c6c0-4fa7-b9fe-c655149031c2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:58.125614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb811db-c6c0-4fa7-b9fe-c655149031c2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:58.221948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914d303-9603-4da9-b459-6c776e66145c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:58.223162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914d303-9603-4da9-b459-6c776e66145c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:58.223357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914d303-9603-4da9-b459-6c776e66145c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:58.223762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914d303-9603-4da9-b459-6c776e66145c admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:58.225407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-93c7813d-ddc5-407c-baa8-11ccb487e5c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76a738c95fb340e99ec9da1cf243a549', 'request_id': 'req-93c7813d-ddc5-407c-baa8-11ccb487e5c8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:58.228071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914d303-9603-4da9-b459-6c776e66145c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:58.233573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914d303-9603-4da9-b459-6c776e66145c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:58.237722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914d303-9603-4da9-b459-6c776e66145c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:58.242368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-93c7813d-ddc5-407c-baa8-11ccb487e5c8 admin admin] The token cache is being invalidate because project 76a738c95fb340e99ec9da1cf243a549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:58.242888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-93c7813d-ddc5-407c-baa8-11ccb487e5c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:58.243736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-93c7813d-ddc5-407c-baa8-11ccb487e5c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:58.249519 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 987/1955] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:57 2022] DELETE /identity/v3/projects/76a738c95fb340e99ec9da1cf243a549 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:58.250856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7813d-ddc5-407c-baa8-11ccb487e5c8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:58.254541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-93c7813d-ddc5-407c-baa8-11ccb487e5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:58.274120 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 969/1956] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:58.274330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914d303-9603-4da9-b459-6c776e66145c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:58.280859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1914d303-9603-4da9-b459-6c776e66145c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:58.297363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914d303-9603-4da9-b459-6c776e66145c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:58.303199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503eeb0-6d89-40b3-b8f0-1d08ad756090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:58.304111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503eeb0-6d89-40b3-b8f0-1d08ad756090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:58.304527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503eeb0-6d89-40b3-b8f0-1d08ad756090 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:58.304905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503eeb0-6d89-40b3-b8f0-1d08ad756090 admin admin] PATH_INFO: `/v3/users/abb8657e6b70471e869f1cf9198fb07f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:58.306202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503eeb0-6d89-40b3-b8f0-1d08ad756090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb8657e6b70471e869f1cf9198fb07f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:58.308295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503eeb0-6d89-40b3-b8f0-1d08ad756090 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:58.351405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7813d-ddc5-407c-baa8-11ccb487e5c8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:58.357475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beff328-2443-4fa6-8140-8ba8c0f67f53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:58.358422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beff328-2443-4fa6-8140-8ba8c0f67f53 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:58.358700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beff328-2443-4fa6-8140-8ba8c0f67f53 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:58.358967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beff328-2443-4fa6-8140-8ba8c0f67f53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:58.361323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6beff328-2443-4fa6-8140-8ba8c0f67f53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:58.442706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beff328-2443-4fa6-8140-8ba8c0f67f53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:58.444380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beff328-2443-4fa6-8140-8ba8c0f67f53 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:58.453925 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 988/1957] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:58 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:58.454694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beff328-2443-4fa6-8140-8ba8c0f67f53 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:58.455955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6beff328-2443-4fa6-8140-8ba8c0f67f53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:58.460026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:58.473123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beff328-2443-4fa6-8140-8ba8c0f67f53 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:58.478592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709a761-d755-4197-b4af-467dd152477c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:58.479329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709a761-d755-4197-b4af-467dd152477c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:58.479706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709a761-d755-4197-b4af-467dd152477c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:58.480187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709a761-d755-4197-b4af-467dd152477c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:58.480940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709a761-d755-4197-b4af-467dd152477c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:58.482976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709a761-d755-4197-b4af-467dd152477c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:58.567580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3503eeb0-6d89-40b3-b8f0-1d08ad756090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb8657e6b70471e869f1cf9198fb07f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:58.606417 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 989/1958] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:58 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:58.607262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709a761-d755-4197-b4af-467dd152477c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:58.611330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d709a761-d755-4197-b4af-467dd152477c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:58.689107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:38:58.706556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709a761-d755-4197-b4af-467dd152477c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:58.712371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:58.713109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:58.713395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:58.713663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a admin admin] PATH_INFO: `/v3/projects/07874299a526478f86485a30dac994b3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:58.714959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a admin admin] RBAC: Authorizing `identity:delete_project(project_id=07874299a526478f86485a30dac994b3)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:58.716841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:58.721425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3503eeb0-6d89-40b3-b8f0-1d08ad756090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb8657e6b70471e869f1cf9198fb07f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:58.723108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3503eeb0-6d89-40b3-b8f0-1d08ad756090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb8657e6b70471e869f1cf9198fb07f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:58.732731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3503eeb0-6d89-40b3-b8f0-1d08ad756090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb8657e6b70471e869f1cf9198fb07f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:58.747960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3503eeb0-6d89-40b3-b8f0-1d08ad756090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb8657e6b70471e869f1cf9198fb07f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:58.754539 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 970/1959] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:58 2022] DELETE /identity/v3/users/abb8657e6b70471e869f1cf9198fb07f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:58.755595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503eeb0-6d89-40b3-b8f0-1d08ad756090 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:58.757244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3503eeb0-6d89-40b3-b8f0-1d08ad756090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:58.840514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503eeb0-6d89-40b3-b8f0-1d08ad756090 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:58.857976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07874299a526478f86485a30dac994b3', 'request_id': 'req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:58.869997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07874299a526478f86485a30dac994b3', 'request_id': 'req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:58.922775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a73c7d-0ead-4c34-a4e9-2f1300b3a521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:58.923455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a73c7d-0ead-4c34-a4e9-2f1300b3a521 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:58.923739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a73c7d-0ead-4c34-a4e9-2f1300b3a521 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:58.924212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a73c7d-0ead-4c34-a4e9-2f1300b3a521 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:58.924856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a73c7d-0ead-4c34-a4e9-2f1300b3a521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:58.927142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a73c7d-0ead-4c34-a4e9-2f1300b3a521 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:58.978768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07874299a526478f86485a30dac994b3', 'request_id': 'req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:58.991022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a admin admin] The token cache is being invalidate because project 07874299a526478f86485a30dac994b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:38:58.991305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:58.991975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:58.993839 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 990/1960] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:58 2022] DELETE /identity/v3/projects/07874299a526478f86485a30dac994b3 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:59.000433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:59.000433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:59.068509 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 971/1961] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:58 2022] POST /identity/v3/users => generated 288 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:59.069414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d0e0c-30a3-4ecc-a5f2-5e2da626687a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:59.069979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d8b18-ff99-4db2-9a73-de9a4d49676b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:59.070262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d8b18-ff99-4db2-9a73-de9a4d49676b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:59.070569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d8b18-ff99-4db2-9a73-de9a4d49676b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:59.075245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12244a-c14b-422b-b3a8-0b46e15ebc1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:59.075864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12244a-c14b-422b-b3a8-0b46e15ebc1b service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:59.076133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12244a-c14b-422b-b3a8-0b46e15ebc1b service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:59.076437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12244a-c14b-422b-b3a8-0b46e15ebc1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:59.078595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4d12244a-c14b-422b-b3a8-0b46e15ebc1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:59.093890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d65d8b18-ff99-4db2-9a73-de9a4d49676b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:59.095014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d65d8b18-ff99-4db2-9a73-de9a4d49676b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:59.104711 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 972/1962] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:59.105597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d8b18-ff99-4db2-9a73-de9a4d49676b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:59.115325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d65d8b18-ff99-4db2-9a73-de9a4d49676b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:59.119129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d8b18-ff99-4db2-9a73-de9a4d49676b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:59.124524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b29d6a-7bbd-4044-9e22-5dad00aea77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:59.125996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b29d6a-7bbd-4044-9e22-5dad00aea77b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:59.125996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b29d6a-7bbd-4044-9e22-5dad00aea77b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:59.126215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b29d6a-7bbd-4044-9e22-5dad00aea77b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:59.126798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b29d6a-7bbd-4044-9e22-5dad00aea77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:59.128467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b29d6a-7bbd-4044-9e22-5dad00aea77b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:59.140360 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 973/1963] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:59.141645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5243469-9b4a-44ae-a59e-c0b9f55bfd45 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:59.141885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5243469-9b4a-44ae-a59e-c0b9f55bfd45 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:59.142158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5243469-9b4a-44ae-a59e-c0b9f55bfd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:59.168263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12244a-c14b-422b-b3a8-0b46e15ebc1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:59.169636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d5243469-9b4a-44ae-a59e-c0b9f55bfd45 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:59.170737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12244a-c14b-422b-b3a8-0b46e15ebc1b service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:59.171140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d5243469-9b4a-44ae-a59e-c0b9f55bfd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:59.185266 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 974/1964] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:59.186289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5243469-9b4a-44ae-a59e-c0b9f55bfd45 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:59.186538 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 991/1965] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:38:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:38:59.187456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12244a-c14b-422b-b3a8-0b46e15ebc1b service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:59.207592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5243469-9b4a-44ae-a59e-c0b9f55bfd45 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:59.208576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12244a-c14b-422b-b3a8-0b46e15ebc1b service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:59.221634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3251047-3c8e-4c1e-8f90-9f69e655889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:59.223406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3251047-3c8e-4c1e-8f90-9f69e655889a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:59.223406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3251047-3c8e-4c1e-8f90-9f69e655889a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:59.223604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3251047-3c8e-4c1e-8f90-9f69e655889a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:59.223986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e5f52-8dff-470f-b574-7e65e4262e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:59.224226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3251047-3c8e-4c1e-8f90-9f69e655889a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:59.225062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e5f52-8dff-470f-b574-7e65e4262e20 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:59.225897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3251047-3c8e-4c1e-8f90-9f69e655889a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:59.226070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e5f52-8dff-470f-b574-7e65e4262e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:59.226487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e5f52-8dff-470f-b574-7e65e4262e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:59.227891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e5f52-8dff-470f-b574-7e65e4262e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:38:59.228676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e5f52-8dff-470f-b574-7e65e4262e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:59.230872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e5f52-8dff-470f-b574-7e65e4262e20 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:59.247999 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 975/1966] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:38:59.247999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3251047-3c8e-4c1e-8f90-9f69e655889a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:59.252270 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 992/1967] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:38:59.254678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d3251047-3c8e-4c1e-8f90-9f69e655889a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:59.256119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e5f52-8dff-470f-b574-7e65e4262e20 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:59.270553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e5f52-8dff-470f-b574-7e65e4262e20 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:59.276375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318eaaa-25b2-446c-b4db-7a833e524f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:59.277366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318eaaa-25b2-446c-b4db-7a833e524f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:59.277798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318eaaa-25b2-446c-b4db-7a833e524f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:59.278223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318eaaa-25b2-446c-b4db-7a833e524f39 admin admin] PATH_INFO: `/v3/projects/97bfd3043f0a465892d401dbb012409d/users/f382e53f164242a3afbc6657c572c318/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:59.285386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3251047-3c8e-4c1e-8f90-9f69e655889a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:59.290481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e8a44-8794-4f3e-a796-20e8556cc4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:59.291385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e8a44-8794-4f3e-a796-20e8556cc4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:59.291729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e8a44-8794-4f3e-a796-20e8556cc4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:59.292009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e8a44-8794-4f3e-a796-20e8556cc4c2 admin admin] PATH_INFO: `/v3/users/de3900ebfb934a1293119f2cf29f319d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:59.293423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e8a44-8794-4f3e-a796-20e8556cc4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de3900ebfb934a1293119f2cf29f319d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:59.295491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e8a44-8794-4f3e-a796-20e8556cc4c2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:59.297499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318eaaa-25b2-446c-b4db-7a833e524f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97bfd3043f0a465892d401dbb012409d, user_id=f382e53f164242a3afbc6657c572c318, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:59.300338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318eaaa-25b2-446c-b4db-7a833e524f39 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:59.402997 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 993/1968] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:38:59 2022] PUT /identity/v3/projects/97bfd3043f0a465892d401dbb012409d/users/f382e53f164242a3afbc6657c572c318/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:59.403655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318eaaa-25b2-446c-b4db-7a833e524f39 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:59.479083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318eaaa-25b2-446c-b4db-7a833e524f39 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:59.488455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf502870-3e91-4e4b-a631-f6c4cc93a049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:59.488455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf502870-3e91-4e4b-a631-f6c4cc93a049 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:59.488455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf502870-3e91-4e4b-a631-f6c4cc93a049 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:59.488455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf502870-3e91-4e4b-a631-f6c4cc93a049 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:59.488795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf502870-3e91-4e4b-a631-f6c4cc93a049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:59.489655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf502870-3e91-4e4b-a631-f6c4cc93a049 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:59.595598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-611e8a44-8794-4f3e-a796-20e8556cc4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de3900ebfb934a1293119f2cf29f319d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:59.645757 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 994/1969] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:38:59 2022] POST /identity/v3/projects => generated 375 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:38:59.645757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf502870-3e91-4e4b-a631-f6c4cc93a049 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:59.649498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bf502870-3e91-4e4b-a631-f6c4cc93a049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:59.716140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf502870-3e91-4e4b-a631-f6c4cc93a049 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:38:59.721799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-611e8a44-8794-4f3e-a796-20e8556cc4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de3900ebfb934a1293119f2cf29f319d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:59.722717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-611e8a44-8794-4f3e-a796-20e8556cc4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de3900ebfb934a1293119f2cf29f319d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:59.726756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf4af2-cad3-4ac0-b00d-8569df546bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:38:59.728794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf4af2-cad3-4ac0-b00d-8569df546bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:59.729083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf4af2-cad3-4ac0-b00d-8569df546bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:59.729353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf4af2-cad3-4ac0-b00d-8569df546bf6 admin admin] PATH_INFO: `/v3/projects/9c291fc39e884d9eaa7ba9a757a64c25` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:59.731619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-611e8a44-8794-4f3e-a796-20e8556cc4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de3900ebfb934a1293119f2cf29f319d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:59.732874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf4af2-cad3-4ac0-b00d-8569df546bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c291fc39e884d9eaa7ba9a757a64c25)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:38:59.735330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf4af2-cad3-4ac0-b00d-8569df546bf6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:38:59.747055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-611e8a44-8794-4f3e-a796-20e8556cc4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de3900ebfb934a1293119f2cf29f319d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:59.759471 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 976/1970] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:38:59 2022] DELETE /identity/v3/users/de3900ebfb934a1293119f2cf29f319d => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:38:59.762040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62763c-c501-48c0-b5bc-def5c512000e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:38:59.762501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62763c-c501-48c0-b5bc-def5c512000e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:38:59.763567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62763c-c501-48c0-b5bc-def5c512000e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:38:59.800461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0f62763c-c501-48c0-b5bc-def5c512000e None None] MFA Rules not processed for user `f382e53f164242a3afbc6657c572c318`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:38:59.802796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0f62763c-c501-48c0-b5bc-def5c512000e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:59.887311 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 977/1971] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:38:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:38:59.887311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62763c-c501-48c0-b5bc-def5c512000e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:38:59.887311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0f62763c-c501-48c0-b5bc-def5c512000e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:38:59.929717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2fdf4af2-cad3-4ac0-b00d-8569df546bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c291fc39e884d9eaa7ba9a757a64c25', 'request_id': 'req-2fdf4af2-cad3-4ac0-b00d-8569df546bf6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:59.938880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2fdf4af2-cad3-4ac0-b00d-8569df546bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c291fc39e884d9eaa7ba9a757a64c25', 'request_id': 'req-2fdf4af2-cad3-4ac0-b00d-8569df546bf6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:38:59.974386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62763c-c501-48c0-b5bc-def5c512000e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:00.036312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2fdf4af2-cad3-4ac0-b00d-8569df546bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c291fc39e884d9eaa7ba9a757a64c25', 'request_id': 'req-2fdf4af2-cad3-4ac0-b00d-8569df546bf6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:00.057166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2fdf4af2-cad3-4ac0-b00d-8569df546bf6 admin admin] The token cache is being invalidate because project 9c291fc39e884d9eaa7ba9a757a64c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:00.057166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2fdf4af2-cad3-4ac0-b00d-8569df546bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:00.060023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b06bd6-4dd7-4b2d-8717-364e6f4a683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:00.060342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b06bd6-4dd7-4b2d-8717-364e6f4a683c admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.060523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b06bd6-4dd7-4b2d-8717-364e6f4a683c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.060958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b06bd6-4dd7-4b2d-8717-364e6f4a683c admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.061687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b06bd6-4dd7-4b2d-8717-364e6f4a683c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:00.062769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2fdf4af2-cad3-4ac0-b00d-8569df546bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:00.064039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b06bd6-4dd7-4b2d-8717-364e6f4a683c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:00.075184 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 995/1972] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:38:59 2022] DELETE /identity/v3/projects/9c291fc39e884d9eaa7ba9a757a64c25 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:00.077102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3eae7-8b8b-41d9-a0c2-65bd314571c3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.077631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3eae7-8b8b-41d9-a0c2-65bd314571c3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.078122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3eae7-8b8b-41d9-a0c2-65bd314571c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.101167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b1d3eae7-8b8b-41d9-a0c2-65bd314571c3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:00.102387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b1d3eae7-8b8b-41d9-a0c2-65bd314571c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:00.110789 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 996/1973] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:00.111475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3eae7-8b8b-41d9-a0c2-65bd314571c3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:00.112873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b1d3eae7-8b8b-41d9-a0c2-65bd314571c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:00.126110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3eae7-8b8b-41d9-a0c2-65bd314571c3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:00.135262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69daf73-30ab-4f7b-9005-2dd87b55df30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:00.136196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69daf73-30ab-4f7b-9005-2dd87b55df30 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.143285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69daf73-30ab-4f7b-9005-2dd87b55df30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.143285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69daf73-30ab-4f7b-9005-2dd87b55df30 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.143285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69daf73-30ab-4f7b-9005-2dd87b55df30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:00.143285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69daf73-30ab-4f7b-9005-2dd87b55df30 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:00.212206 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 978/1974] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:38:59 2022] POST /identity/v3/users => generated 288 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:00.214230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f954ee-9e31-4d2b-b769-b1712342c2a1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.214522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f954ee-9e31-4d2b-b769-b1712342c2a1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.214802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f954ee-9e31-4d2b-b769-b1712342c2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.235374 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 997/1975] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:00 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:00.236861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69daf73-30ab-4f7b-9005-2dd87b55df30 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:00.240765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d69daf73-30ab-4f7b-9005-2dd87b55df30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:00.241199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-61f954ee-9e31-4d2b-b769-b1712342c2a1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:00.242411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-61f954ee-9e31-4d2b-b769-b1712342c2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:00.308302 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 979/1976] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:00.309364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f954ee-9e31-4d2b-b769-b1712342c2a1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:00.313789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-61f954ee-9e31-4d2b-b769-b1712342c2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:00.319457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69daf73-30ab-4f7b-9005-2dd87b55df30 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:00.323785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b43fe4-94e9-4e3d-89bb-3fb069d9cf2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:00.324946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b43fe4-94e9-4e3d-89bb-3fb069d9cf2d service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.325231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b43fe4-94e9-4e3d-89bb-3fb069d9cf2d service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.325505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b43fe4-94e9-4e3d-89bb-3fb069d9cf2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.331038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f954ee-9e31-4d2b-b769-b1712342c2a1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:00.338987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2f0ef-77e4-4712-8280-de89ee2c6803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:00.339276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b43fe4-94e9-4e3d-89bb-3fb069d9cf2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:00.340803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2f0ef-77e4-4712-8280-de89ee2c6803 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.341215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b43fe4-94e9-4e3d-89bb-3fb069d9cf2d service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:00.341390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2f0ef-77e4-4712-8280-de89ee2c6803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.341873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2f0ef-77e4-4712-8280-de89ee2c6803 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.342695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2f0ef-77e4-4712-8280-de89ee2c6803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:00.355119 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 998/1977] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:00.356202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b43fe4-94e9-4e3d-89bb-3fb069d9cf2d service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:00.356664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2f0ef-77e4-4712-8280-de89ee2c6803 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:00.370098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b43fe4-94e9-4e3d-89bb-3fb069d9cf2d service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:00.377075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43e3d1-8145-4c93-9528-937831e1a37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:00.377826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e3d1-8145-4c93-9528-937831e1a37c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.378205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e3d1-8145-4c93-9528-937831e1a37c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.378604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e3d1-8145-4c93-9528-937831e1a37c admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.379360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43e3d1-8145-4c93-9528-937831e1a37c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:00.381643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43e3d1-8145-4c93-9528-937831e1a37c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:00.383307 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 980/1978] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:00.384822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b75c4-b4f5-426e-947f-04efa7f2bb40 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.385267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b75c4-b4f5-426e-947f-04efa7f2bb40 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.385642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b75c4-b4f5-426e-947f-04efa7f2bb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.423776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8c6b75c4-b4f5-426e-947f-04efa7f2bb40 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:00.425193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8c6b75c4-b4f5-426e-947f-04efa7f2bb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:00.434913 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 981/1979] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:00.451224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b75c4-b4f5-426e-947f-04efa7f2bb40 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:00.454132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:00.475051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b75c4-b4f5-426e-947f-04efa7f2bb40 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:00.482281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ea016-4d0c-4d33-b186-fba75abe1429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:00.483523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea016-4d0c-4d33-b186-fba75abe1429 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.483737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea016-4d0c-4d33-b186-fba75abe1429 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.484016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea016-4d0c-4d33-b186-fba75abe1429 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.485089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ea016-4d0c-4d33-b186-fba75abe1429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:00.487431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ea016-4d0c-4d33-b186-fba75abe1429 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:00.501639 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 982/1980] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:00.502704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ea016-4d0c-4d33-b186-fba75abe1429 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:00.523673 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 999/1981] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:00 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:00.523871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ea016-4d0c-4d33-b186-fba75abe1429 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:00.523960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43e3d1-8145-4c93-9528-937831e1a37c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:00.537085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885facf-9bb4-4445-ab68-89063e761cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:00.537703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885facf-9bb4-4445-ab68-89063e761cca admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.538039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885facf-9bb4-4445-ab68-89063e761cca admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.538314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885facf-9bb4-4445-ab68-89063e761cca admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.538971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885facf-9bb4-4445-ab68-89063e761cca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:00.539475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885facf-9bb4-4445-ab68-89063e761cca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:00.541251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885facf-9bb4-4445-ab68-89063e761cca admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:00.555404 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 983/1982] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:00.558078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43e3d1-8145-4c93-9528-937831e1a37c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:00.558786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885facf-9bb4-4445-ab68-89063e761cca admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:00.568117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86869b6e-0301-4d5b-a6b6-cf5b4d94a950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:00.570224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86869b6e-0301-4d5b-a6b6-cf5b4d94a950 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.570224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86869b6e-0301-4d5b-a6b6-cf5b4d94a950 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.570224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86869b6e-0301-4d5b-a6b6-cf5b4d94a950 admin admin] PATH_INFO: `/v3/projects/e29f97d7f4b048348e405dff4e6afc52/users/cb920e2b6722479690c65af7d8730f90/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.574007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885facf-9bb4-4445-ab68-89063e761cca admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:00.578986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98febf-ae3e-47e7-8ebe-799ff8dae24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:00.579603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98febf-ae3e-47e7-8ebe-799ff8dae24c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.579881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98febf-ae3e-47e7-8ebe-799ff8dae24c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.583165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98febf-ae3e-47e7-8ebe-799ff8dae24c admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.583165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98febf-ae3e-47e7-8ebe-799ff8dae24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:00.583165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98febf-ae3e-47e7-8ebe-799ff8dae24c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:00.594906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86869b6e-0301-4d5b-a6b6-cf5b4d94a950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29f97d7f4b048348e405dff4e6afc52, user_id=cb920e2b6722479690c65af7d8730f90, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:00.600007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86869b6e-0301-4d5b-a6b6-cf5b4d94a950 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:00.600288 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 984/1983] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:00.601225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98febf-ae3e-47e7-8ebe-799ff8dae24c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:00.614949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98febf-ae3e-47e7-8ebe-799ff8dae24c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:00.624331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e79a0-2b08-4d23-b472-12524857c8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:00.624995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e79a0-2b08-4d23-b472-12524857c8fa admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.625286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e79a0-2b08-4d23-b472-12524857c8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.625580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e79a0-2b08-4d23-b472-12524857c8fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.626229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e79a0-2b08-4d23-b472-12524857c8fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:00.628199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e79a0-2b08-4d23-b472-12524857c8fa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:00.860950 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1000/1984] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:00 2022] PUT /identity/v3/projects/e29f97d7f4b048348e405dff4e6afc52/users/cb920e2b6722479690c65af7d8730f90/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:00.861783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86869b6e-0301-4d5b-a6b6-cf5b4d94a950 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:00.866994 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 985/1985] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:00 2022] POST /identity/v3/projects => generated 371 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:00.871670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61304f-7712-4e5c-b595-a1f243032735 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:00.871968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61304f-7712-4e5c-b595-a1f243032735 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:00.872277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61304f-7712-4e5c-b595-a1f243032735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:00.935920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ee61304f-7712-4e5c-b595-a1f243032735 None None] MFA Rules not processed for user `cb920e2b6722479690c65af7d8730f90`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:00.938601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ee61304f-7712-4e5c-b595-a1f243032735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:01.012212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86869b6e-0301-4d5b-a6b6-cf5b4d94a950 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:01.058410 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 986/1986] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:39:01.059808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61304f-7712-4e5c-b595-a1f243032735 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:01.101817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d67c4-55fe-49a4-b8f7-5b6c9c5d390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:01.102486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d67c4-55fe-49a4-b8f7-5b6c9c5d390d admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:01.102764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d67c4-55fe-49a4-b8f7-5b6c9c5d390d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:01.103039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d67c4-55fe-49a4-b8f7-5b6c9c5d390d admin admin] PATH_INFO: `/v3/projects/ab925fef5c8b4b63bceb4f546cde291b/users/0f789885bfef4045b0b33e1fba083d2f/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:01.119835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d67c4-55fe-49a4-b8f7-5b6c9c5d390d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab925fef5c8b4b63bceb4f546cde291b, user_id=0f789885bfef4045b0b33e1fba083d2f, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:01.122764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d67c4-55fe-49a4-b8f7-5b6c9c5d390d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:01.164597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61304f-7712-4e5c-b595-a1f243032735 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:01.169237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73360eca-a045-4860-88cb-e3ada6583049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:01.169842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73360eca-a045-4860-88cb-e3ada6583049 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:01.170150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73360eca-a045-4860-88cb-e3ada6583049 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:01.170426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73360eca-a045-4860-88cb-e3ada6583049 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:01.171120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73360eca-a045-4860-88cb-e3ada6583049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:01.173043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73360eca-a045-4860-88cb-e3ada6583049 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:01.240407 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1001/1987] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:00 2022] PUT /identity/v3/projects/ab925fef5c8b4b63bceb4f546cde291b/users/0f789885bfef4045b0b33e1fba083d2f/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:01.241426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d67c4-55fe-49a4-b8f7-5b6c9c5d390d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:01.266018 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 987/1988] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:01 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:01.267245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73360eca-a045-4860-88cb-e3ada6583049 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:01.270356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-73360eca-a045-4860-88cb-e3ada6583049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:01.284405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73360eca-a045-4860-88cb-e3ada6583049 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:01.317496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d67c4-55fe-49a4-b8f7-5b6c9c5d390d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:01.322705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a23d7-7e53-4448-a83d-93df8ec76602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:01.323656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a23d7-7e53-4448-a83d-93df8ec76602 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:01.324087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a23d7-7e53-4448-a83d-93df8ec76602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:01.324554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a23d7-7e53-4448-a83d-93df8ec76602 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:01.325342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a23d7-7e53-4448-a83d-93df8ec76602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:01.327747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a23d7-7e53-4448-a83d-93df8ec76602 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:01.354416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9ae5d-f75d-4035-b254-c9a353576581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:01.355361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9ae5d-f75d-4035-b254-c9a353576581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:01.356043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9ae5d-f75d-4035-b254-c9a353576581 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:01.356529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9ae5d-f75d-4035-b254-c9a353576581 admin admin] PATH_INFO: `/v3/projects/53e16ad050b14326978c7b1a5fae8dcc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:01.357905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9ae5d-f75d-4035-b254-c9a353576581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e16ad050b14326978c7b1a5fae8dcc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:01.360311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9ae5d-f75d-4035-b254-c9a353576581 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:01.437781 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1002/1989] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:01 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:01.437781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a23d7-7e53-4448-a83d-93df8ec76602 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:01.519469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aff9ae5d-f75d-4035-b254-c9a353576581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e16ad050b14326978c7b1a5fae8dcc', 'request_id': 'req-aff9ae5d-f75d-4035-b254-c9a353576581'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:01.526270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aff9ae5d-f75d-4035-b254-c9a353576581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e16ad050b14326978c7b1a5fae8dcc', 'request_id': 'req-aff9ae5d-f75d-4035-b254-c9a353576581'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:01.528991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a23d7-7e53-4448-a83d-93df8ec76602 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:01.533630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aff9ae5d-f75d-4035-b254-c9a353576581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e16ad050b14326978c7b1a5fae8dcc', 'request_id': 'req-aff9ae5d-f75d-4035-b254-c9a353576581'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:01.603582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22ab01-ce15-4619-b8e5-9369b8ac9a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:01.604568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22ab01-ce15-4619-b8e5-9369b8ac9a39 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:01.618586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22ab01-ce15-4619-b8e5-9369b8ac9a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:01.619251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22ab01-ce15-4619-b8e5-9369b8ac9a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:01.622562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22ab01-ce15-4619-b8e5-9369b8ac9a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:01.624949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22ab01-ce15-4619-b8e5-9369b8ac9a39 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:01.632952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aff9ae5d-f75d-4035-b254-c9a353576581 admin admin] The token cache is being invalidate because project 53e16ad050b14326978c7b1a5fae8dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:01.633248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aff9ae5d-f75d-4035-b254-c9a353576581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:01.637771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aff9ae5d-f75d-4035-b254-c9a353576581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:01.637771 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 988/1990] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:01 2022] DELETE /identity/v3/projects/53e16ad050b14326978c7b1a5fae8dcc => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:01.641030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9ae5d-f75d-4035-b254-c9a353576581 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:01.642431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aff9ae5d-f75d-4035-b254-c9a353576581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:01.655112 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1003/1991] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:01.656686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22ab01-ce15-4619-b8e5-9369b8ac9a39 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:01.658366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9ae5d-f75d-4035-b254-c9a353576581 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:01.659104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3d22ab01-ce15-4619-b8e5-9369b8ac9a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:01.665833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e880a66-e218-4719-94d0-9a10aa24f31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:01.666680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e880a66-e218-4719-94d0-9a10aa24f31d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:01.667290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e880a66-e218-4719-94d0-9a10aa24f31d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:01.667707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e880a66-e218-4719-94d0-9a10aa24f31d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:01.668726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e880a66-e218-4719-94d0-9a10aa24f31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:01.671844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e880a66-e218-4719-94d0-9a10aa24f31d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:01.674682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:01.688690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22ab01-ce15-4619-b8e5-9369b8ac9a39 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:01.696605 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 989/1992] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:01.697805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e880a66-e218-4719-94d0-9a10aa24f31d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:01.699769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0e880a66-e218-4719-94d0-9a10aa24f31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:01.704846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf83bb3-9c21-4a75-9462-c08853d236f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:01.705478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83bb3-9c21-4a75-9462-c08853d236f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:01.705758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83bb3-9c21-4a75-9462-c08853d236f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:01.706031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83bb3-9c21-4a75-9462-c08853d236f1 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:01.706663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf83bb3-9c21-4a75-9462-c08853d236f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:01.713465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf83bb3-9c21-4a75-9462-c08853d236f1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:01.718226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e880a66-e218-4719-94d0-9a10aa24f31d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:01.725190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718d3b6-6544-421c-8f12-97de19cae5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:01.726050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718d3b6-6544-421c-8f12-97de19cae5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:01.726353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718d3b6-6544-421c-8f12-97de19cae5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:01.726710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718d3b6-6544-421c-8f12-97de19cae5dc admin admin] PATH_INFO: `/v3/users/aa9f5c2feca843d392983dbae4b9e2c2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:01.727876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718d3b6-6544-421c-8f12-97de19cae5dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa9f5c2feca843d392983dbae4b9e2c2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:01.729064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:01.730118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718d3b6-6544-421c-8f12-97de19cae5dc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:01.825297 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1004/1993] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:01 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:01.826498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf83bb3-9c21-4a75-9462-c08853d236f1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:01.828797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6cf83bb3-9c21-4a75-9462-c08853d236f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:01.918434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf83bb3-9c21-4a75-9462-c08853d236f1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:01.926683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50601b-b6ff-431a-b37f-32787d093188 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:01.929512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50601b-b6ff-431a-b37f-32787d093188 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:01.929512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50601b-b6ff-431a-b37f-32787d093188 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:01.930270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50601b-b6ff-431a-b37f-32787d093188 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:01.932453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ee50601b-b6ff-431a-b37f-32787d093188 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:01.980611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6718d3b6-6544-421c-8f12-97de19cae5dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa9f5c2feca843d392983dbae4b9e2c2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:02.082368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50601b-b6ff-431a-b37f-32787d093188 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:02.084880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50601b-b6ff-431a-b37f-32787d093188 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:02.098464 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1005/1994] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:01 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:02.099940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50601b-b6ff-431a-b37f-32787d093188 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:02.102207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ee50601b-b6ff-431a-b37f-32787d093188 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:02.110538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6718d3b6-6544-421c-8f12-97de19cae5dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa9f5c2feca843d392983dbae4b9e2c2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:02.111154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6718d3b6-6544-421c-8f12-97de19cae5dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa9f5c2feca843d392983dbae4b9e2c2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:02.120232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50601b-b6ff-431a-b37f-32787d093188 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:02.122777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6718d3b6-6544-421c-8f12-97de19cae5dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa9f5c2feca843d392983dbae4b9e2c2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:02.126602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0c2bc-8a0f-4dab-b4ac-fd7ecb05010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:02.127640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0c2bc-8a0f-4dab-b4ac-fd7ecb05010e admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:02.127640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0c2bc-8a0f-4dab-b4ac-fd7ecb05010e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:02.127814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0c2bc-8a0f-4dab-b4ac-fd7ecb05010e admin admin] PATH_INFO: `/v3/projects/ab925fef5c8b4b63bceb4f546cde291b/users/0f789885bfef4045b0b33e1fba083d2f/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:02.130728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0c2bc-8a0f-4dab-b4ac-fd7ecb05010e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab925fef5c8b4b63bceb4f546cde291b, user_id=0f789885bfef4045b0b33e1fba083d2f, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:02.134211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0c2bc-8a0f-4dab-b4ac-fd7ecb05010e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:02.155275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6718d3b6-6544-421c-8f12-97de19cae5dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa9f5c2feca843d392983dbae4b9e2c2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:02.156284 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1006/1995] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:02 2022] PUT /identity/v3/projects/ab925fef5c8b4b63bceb4f546cde291b/users/0f789885bfef4045b0b33e1fba083d2f/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:02.166753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0c2bc-8a0f-4dab-b4ac-fd7ecb05010e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:02.171469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-72d0c2bc-8a0f-4dab-b4ac-fd7ecb05010e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:02.203391 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 990/1996] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:01 2022] DELETE /identity/v3/users/aa9f5c2feca843d392983dbae4b9e2c2 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:02.206574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718d3b6-6544-421c-8f12-97de19cae5dc admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:02.213405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6718d3b6-6544-421c-8f12-97de19cae5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:02.271404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0c2bc-8a0f-4dab-b4ac-fd7ecb05010e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:02.355019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957cb84-e52e-4bcd-a0c8-29a1443348e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:02.355863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957cb84-e52e-4bcd-a0c8-29a1443348e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:02.356279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957cb84-e52e-4bcd-a0c8-29a1443348e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:02.356673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957cb84-e52e-4bcd-a0c8-29a1443348e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:02.357662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957cb84-e52e-4bcd-a0c8-29a1443348e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:02.360219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957cb84-e52e-4bcd-a0c8-29a1443348e4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:02.378128 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1007/1997] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:02.378128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dff982-d44b-4364-ac4f-f12a2dd7b511 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:02.378128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dff982-d44b-4364-ac4f-f12a2dd7b511 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:02.378128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dff982-d44b-4364-ac4f-f12a2dd7b511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:02.394634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718d3b6-6544-421c-8f12-97de19cae5dc admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:02.400391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba95e7-1f1d-4732-b6bc-acca886b4710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:02.401561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba95e7-1f1d-4732-b6bc-acca886b4710 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:02.401938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba95e7-1f1d-4732-b6bc-acca886b4710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:02.402304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba95e7-1f1d-4732-b6bc-acca886b4710 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:02.403348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba95e7-1f1d-4732-b6bc-acca886b4710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:02.405117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba95e7-1f1d-4732-b6bc-acca886b4710 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:02.427982 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 991/1998] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:02.429793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f0dff982-d44b-4364-ac4f-f12a2dd7b511 None None] MFA Rules not processed for user `0f789885bfef4045b0b33e1fba083d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:02.433122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba95e7-1f1d-4732-b6bc-acca886b4710 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:02.433415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f0dff982-d44b-4364-ac4f-f12a2dd7b511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:02.458778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba95e7-1f1d-4732-b6bc-acca886b4710 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:02.473331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850d31b-bddf-4bb9-a333-34b7e5c98270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:02.474181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850d31b-bddf-4bb9-a333-34b7e5c98270 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:02.474560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850d31b-bddf-4bb9-a333-34b7e5c98270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:02.474932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850d31b-bddf-4bb9-a333-34b7e5c98270 admin admin] PATH_INFO: `/v3/projects/876447d8eb814920856d46902fd76713/users/301b13659b4e40c4bbf4f6a822083580/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:02.521070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850d31b-bddf-4bb9-a333-34b7e5c98270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=876447d8eb814920856d46902fd76713, user_id=301b13659b4e40c4bbf4f6a822083580, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:02.521954 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1008/1999] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:02.522942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dff982-d44b-4364-ac4f-f12a2dd7b511 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:02.529564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850d31b-bddf-4bb9-a333-34b7e5c98270 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:02.534863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dff982-d44b-4364-ac4f-f12a2dd7b511 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:02.540391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47370f-0f36-420b-8009-194068bd6634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:02.541294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47370f-0f36-420b-8009-194068bd6634 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:02.543176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47370f-0f36-420b-8009-194068bd6634 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:02.543176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47370f-0f36-420b-8009-194068bd6634 admin admin] PATH_INFO: `/v3/projects/6100886b0ef243edba1b735b7dfd2be5/users/f073125258e242dcb21d09c372b31dae/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:02.560735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47370f-0f36-420b-8009-194068bd6634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6100886b0ef243edba1b735b7dfd2be5, user_id=f073125258e242dcb21d09c372b31dae, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:02.563659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47370f-0f36-420b-8009-194068bd6634 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:02.676750 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1009/2000] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:02 2022] PUT /identity/v3/projects/6100886b0ef243edba1b735b7dfd2be5/users/f073125258e242dcb21d09c372b31dae/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:02.692582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47370f-0f36-420b-8009-194068bd6634 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:02.692744 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 992/2001] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:02 2022] PUT /identity/v3/projects/876447d8eb814920856d46902fd76713/users/301b13659b4e40c4bbf4f6a822083580/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:02.692831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-be47370f-0f36-420b-8009-194068bd6634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:02.697834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850d31b-bddf-4bb9-a333-34b7e5c98270 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:02.840821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47370f-0f36-420b-8009-194068bd6634 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:02.856432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850d31b-bddf-4bb9-a333-34b7e5c98270 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:02.869886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47950165-3997-4de6-a9e0-8ce71e40bd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:02.870523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47950165-3997-4de6-a9e0-8ce71e40bd66 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:02.870928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47950165-3997-4de6-a9e0-8ce71e40bd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:02.871213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47950165-3997-4de6-a9e0-8ce71e40bd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:02.871873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47950165-3997-4de6-a9e0-8ce71e40bd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:02.873555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47950165-3997-4de6-a9e0-8ce71e40bd66 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:02.901090 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 993/2002] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:02.908667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf6273-216d-4aa9-80c4-08b025d71ac5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:02.911326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf6273-216d-4aa9-80c4-08b025d71ac5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:02.911326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf6273-216d-4aa9-80c4-08b025d71ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:02.933689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773555d-93d1-4b8e-922d-994e78722540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:02.934368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773555d-93d1-4b8e-922d-994e78722540 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:02.934650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773555d-93d1-4b8e-922d-994e78722540 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:02.934925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773555d-93d1-4b8e-922d-994e78722540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:02.938281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5eaf6273-216d-4aa9-80c4-08b025d71ac5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:02.939715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5eaf6273-216d-4aa9-80c4-08b025d71ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:02.960919 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 994/2003] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:02.961893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf6273-216d-4aa9-80c4-08b025d71ac5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:02.972221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf6273-216d-4aa9-80c4-08b025d71ac5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:02.979322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdad3c9-58b9-4582-a6ee-18b0c680b53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:02.979322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdad3c9-58b9-4582-a6ee-18b0c680b53e admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:02.979322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdad3c9-58b9-4582-a6ee-18b0c680b53e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:02.979894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdad3c9-58b9-4582-a6ee-18b0c680b53e admin admin] PATH_INFO: `/v3/projects/6100886b0ef243edba1b735b7dfd2be5/users/f073125258e242dcb21d09c372b31dae/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:02.981567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdad3c9-58b9-4582-a6ee-18b0c680b53e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6100886b0ef243edba1b735b7dfd2be5, user_id=f073125258e242dcb21d09c372b31dae, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:02.998306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdad3c9-58b9-4582-a6ee-18b0c680b53e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:03.023894 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 995/2004] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:02 2022] PUT /identity/v3/projects/6100886b0ef243edba1b735b7dfd2be5/users/f073125258e242dcb21d09c372b31dae/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:03.025192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdad3c9-58b9-4582-a6ee-18b0c680b53e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:03.027859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bbdad3c9-58b9-4582-a6ee-18b0c680b53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:03.040034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773555d-93d1-4b8e-922d-994e78722540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:03.041718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773555d-93d1-4b8e-922d-994e78722540 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:03.054363 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1010/2005] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:03.055295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773555d-93d1-4b8e-922d-994e78722540 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:03.056613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7773555d-93d1-4b8e-922d-994e78722540 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:03.073153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773555d-93d1-4b8e-922d-994e78722540 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:03.120442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdad3c9-58b9-4582-a6ee-18b0c680b53e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:03.125612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a775daf-c50e-40c1-8b05-c49c9681e33a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:03.126229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a775daf-c50e-40c1-8b05-c49c9681e33a service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:03.126575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a775daf-c50e-40c1-8b05-c49c9681e33a service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:03.126856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a775daf-c50e-40c1-8b05-c49c9681e33a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:03.194514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00590ed-e232-47b0-a1fa-c8f708efec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:03.196028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00590ed-e232-47b0-a1fa-c8f708efec9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:03.196340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00590ed-e232-47b0-a1fa-c8f708efec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:03.196614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00590ed-e232-47b0-a1fa-c8f708efec9f admin admin] PATH_INFO: `/v3/projects/a7f150be00514a02a7d339aa7a111332` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:03.198398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00590ed-e232-47b0-a1fa-c8f708efec9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7f150be00514a02a7d339aa7a111332)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:03.200409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00590ed-e232-47b0-a1fa-c8f708efec9f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:03.207650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a775daf-c50e-40c1-8b05-c49c9681e33a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:03.209251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a775daf-c50e-40c1-8b05-c49c9681e33a service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:03.223358 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 996/2006] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:03.224830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43953f9c-ae4f-4473-95f5-7baf08ea90c7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:03.225120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43953f9c-ae4f-4473-95f5-7baf08ea90c7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:03.225395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43953f9c-ae4f-4473-95f5-7baf08ea90c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:03.277079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-43953f9c-ae4f-4473-95f5-7baf08ea90c7 None None] MFA Rules not processed for user `f073125258e242dcb21d09c372b31dae`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:03.278287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-43953f9c-ae4f-4473-95f5-7baf08ea90c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:03.333232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b00590ed-e232-47b0-a1fa-c8f708efec9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7f150be00514a02a7d339aa7a111332', 'request_id': 'req-b00590ed-e232-47b0-a1fa-c8f708efec9f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:03.339895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b00590ed-e232-47b0-a1fa-c8f708efec9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7f150be00514a02a7d339aa7a111332', 'request_id': 'req-b00590ed-e232-47b0-a1fa-c8f708efec9f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:03.383259 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 997/2007] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:03.383259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43953f9c-ae4f-4473-95f5-7baf08ea90c7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:03.447208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b00590ed-e232-47b0-a1fa-c8f708efec9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7f150be00514a02a7d339aa7a111332', 'request_id': 'req-b00590ed-e232-47b0-a1fa-c8f708efec9f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:03.470363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43953f9c-ae4f-4473-95f5-7baf08ea90c7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:03.472244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b00590ed-e232-47b0-a1fa-c8f708efec9f admin admin] The token cache is being invalidate because project a7f150be00514a02a7d339aa7a111332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:03.473103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b00590ed-e232-47b0-a1fa-c8f708efec9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:03.474009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b00590ed-e232-47b0-a1fa-c8f708efec9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:03.478406 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1011/2008] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:03 2022] DELETE /identity/v3/projects/a7f150be00514a02a7d339aa7a111332 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:03.479318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00590ed-e232-47b0-a1fa-c8f708efec9f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:03.483561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b00590ed-e232-47b0-a1fa-c8f708efec9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:03.577713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00590ed-e232-47b0-a1fa-c8f708efec9f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:03.584205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24fb46c-e96e-4f9b-bf2b-ea05de2cad0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:03.584911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fb46c-e96e-4f9b-bf2b-ea05de2cad0b service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:03.585193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fb46c-e96e-4f9b-bf2b-ea05de2cad0b service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:03.585487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fb46c-e96e-4f9b-bf2b-ea05de2cad0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:03.587251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a24fb46c-e96e-4f9b-bf2b-ea05de2cad0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:03.588797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c9160-aecc-4950-a181-b2ade0f87d55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:03.589515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c9160-aecc-4950-a181-b2ade0f87d55 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:03.589908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c9160-aecc-4950-a181-b2ade0f87d55 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:03.590285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c9160-aecc-4950-a181-b2ade0f87d55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:03.592193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1d5c9160-aecc-4950-a181-b2ade0f87d55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:03.716629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c9160-aecc-4950-a181-b2ade0f87d55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:03.718432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c9160-aecc-4950-a181-b2ade0f87d55 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:03.719434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24fb46c-e96e-4f9b-bf2b-ea05de2cad0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:03.721537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24fb46c-e96e-4f9b-bf2b-ea05de2cad0b service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:03.747707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:03.749030 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 998/2009] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:03.750647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dec584-cce5-4d10-9214-6a5bc587e5e8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:03.750932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dec584-cce5-4d10-9214-6a5bc587e5e8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:03.752260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dec584-cce5-4d10-9214-6a5bc587e5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:03.755833 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1012/2010] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:03.761636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:03.798617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-56dec584-cce5-4d10-9214-6a5bc587e5e8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:03.801178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-56dec584-cce5-4d10-9214-6a5bc587e5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:03.897054 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 999/2011] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:03.898606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87d365-b9f5-44f6-b285-758a7cea4f0e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:03.898893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87d365-b9f5-44f6-b285-758a7cea4f0e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:03.899168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87d365-b9f5-44f6-b285-758a7cea4f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:03.929553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bc87d365-b9f5-44f6-b285-758a7cea4f0e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:03.931466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bc87d365-b9f5-44f6-b285-758a7cea4f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:03.965069 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1013/2012] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:03.968694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dec584-cce5-4d10-9214-6a5bc587e5e8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:03.984905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dec584-cce5-4d10-9214-6a5bc587e5e8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:03.998850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc13fd-a9b4-4975-9b19-837bd979bd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:03.999670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc13fd-a9b4-4975-9b19-837bd979bd17 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:04.001680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc13fd-a9b4-4975-9b19-837bd979bd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:04.003065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc13fd-a9b4-4975-9b19-837bd979bd17 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:04.004096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc13fd-a9b4-4975-9b19-837bd979bd17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:04.005505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc13fd-a9b4-4975-9b19-837bd979bd17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:04.009112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc13fd-a9b4-4975-9b19-837bd979bd17 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:04.031896 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1000/2013] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:04.038327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87d365-b9f5-44f6-b285-758a7cea4f0e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:04.050332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87d365-b9f5-44f6-b285-758a7cea4f0e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:04.057899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e21c24-da88-4510-ae55-3716895553d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:04.059380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e21c24-da88-4510-ae55-3716895553d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:04.059766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e21c24-da88-4510-ae55-3716895553d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:04.060140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e21c24-da88-4510-ae55-3716895553d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:04.060919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e21c24-da88-4510-ae55-3716895553d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:04.063909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e21c24-da88-4510-ae55-3716895553d4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:04.214126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc13fd-a9b4-4975-9b19-837bd979bd17 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:04.215055 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1014/2014] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:04 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:39:04.228120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc13fd-a9b4-4975-9b19-837bd979bd17 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:04.302209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d0e81-876e-4f36-b2d2-60eca615d0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:04.302825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d0e81-876e-4f36-b2d2-60eca615d0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:04.303028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d0e81-876e-4f36-b2d2-60eca615d0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:04.303304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d0e81-876e-4f36-b2d2-60eca615d0b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:04.303945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d0e81-876e-4f36-b2d2-60eca615d0b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:04.306948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d0e81-876e-4f36-b2d2-60eca615d0b2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:04.397779 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1001/2015] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:04 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:04.400980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e21c24-da88-4510-ae55-3716895553d4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:04.413382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e21c24-da88-4510-ae55-3716895553d4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:04.419494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654112b-3040-45b3-9fb1-edead0286d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:04.420364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654112b-3040-45b3-9fb1-edead0286d35 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:04.420957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654112b-3040-45b3-9fb1-edead0286d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:04.421377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654112b-3040-45b3-9fb1-edead0286d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:04.422494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654112b-3040-45b3-9fb1-edead0286d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:04.424356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654112b-3040-45b3-9fb1-edead0286d35 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:04.436553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d0e81-876e-4f36-b2d2-60eca615d0b2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:04.438702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ab5d0e81-876e-4f36-b2d2-60eca615d0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:04.452418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d0e81-876e-4f36-b2d2-60eca615d0b2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:04.455987 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1015/2016] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:04.460575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654112b-3040-45b3-9fb1-edead0286d35 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:04.462337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462c3bd-b50d-4f63-9bfb-81ba68616059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:04.463006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462c3bd-b50d-4f63-9bfb-81ba68616059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:04.463427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462c3bd-b50d-4f63-9bfb-81ba68616059 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:04.463758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462c3bd-b50d-4f63-9bfb-81ba68616059 admin admin] PATH_INFO: `/v3/users/f382e53f164242a3afbc6657c572c318` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:04.465061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462c3bd-b50d-4f63-9bfb-81ba68616059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f382e53f164242a3afbc6657c572c318)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:04.467154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462c3bd-b50d-4f63-9bfb-81ba68616059 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:04.487280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654112b-3040-45b3-9fb1-edead0286d35 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:04.493774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf33389-c223-4243-b33f-648a4a0f25c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:04.494394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf33389-c223-4243-b33f-648a4a0f25c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:04.494673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf33389-c223-4243-b33f-648a4a0f25c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:04.494971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf33389-c223-4243-b33f-648a4a0f25c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:04.495609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf33389-c223-4243-b33f-648a4a0f25c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:04.497250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf33389-c223-4243-b33f-648a4a0f25c9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:04.516011 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1016/2017] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:39:04.521323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf33389-c223-4243-b33f-648a4a0f25c9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:04.531959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf33389-c223-4243-b33f-648a4a0f25c9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:04.537946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c739e5-3b41-4780-9998-ab50acd2e03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:04.538920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c739e5-3b41-4780-9998-ab50acd2e03e admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:04.539200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c739e5-3b41-4780-9998-ab50acd2e03e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:04.539553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c739e5-3b41-4780-9998-ab50acd2e03e admin admin] PATH_INFO: `/v3/projects/b20136c6b84e441eab875d7a007dd4dd/users/7db40a0539d14b2e83dde91ca9d22789/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:04.557347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c739e5-3b41-4780-9998-ab50acd2e03e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20136c6b84e441eab875d7a007dd4dd, user_id=7db40a0539d14b2e83dde91ca9d22789, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:04.560450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c739e5-3b41-4780-9998-ab50acd2e03e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:04.658899 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1017/2018] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:04 2022] PUT /identity/v3/projects/b20136c6b84e441eab875d7a007dd4dd/users/7db40a0539d14b2e83dde91ca9d22789/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:04.672531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ca94c-7fd8-4a88-89c1-dce19bb94b63 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:04.672811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ca94c-7fd8-4a88-89c1-dce19bb94b63 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:04.673084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ca94c-7fd8-4a88-89c1-dce19bb94b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:04.712834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ca3ca94c-7fd8-4a88-89c1-dce19bb94b63 None None] MFA Rules not processed for user `7db40a0539d14b2e83dde91ca9d22789`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:04.714466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ca3ca94c-7fd8-4a88-89c1-dce19bb94b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:04.764491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9462c3bd-b50d-4f63-9bfb-81ba68616059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f382e53f164242a3afbc6657c572c318'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:04.796268 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1018/2019] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:04.813856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ca94c-7fd8-4a88-89c1-dce19bb94b63 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:04.867343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9462c3bd-b50d-4f63-9bfb-81ba68616059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f382e53f164242a3afbc6657c572c318'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:04.867509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9462c3bd-b50d-4f63-9bfb-81ba68616059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f382e53f164242a3afbc6657c572c318'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:04.904390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9462c3bd-b50d-4f63-9bfb-81ba68616059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f382e53f164242a3afbc6657c572c318'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:04.943977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9462c3bd-b50d-4f63-9bfb-81ba68616059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f382e53f164242a3afbc6657c572c318'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:04.959579 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1002/2020] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:04 2022] DELETE /identity/v3/users/f382e53f164242a3afbc6657c572c318 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:39:04.967068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863fcd2-d629-4865-9ca0-a7e78b710002 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:04.971702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863fcd2-d629-4865-9ca0-a7e78b710002 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:04.973600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863fcd2-d629-4865-9ca0-a7e78b710002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:04.988309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ca94c-7fd8-4a88-89c1-dce19bb94b63 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:05.001962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a863fcd2-d629-4865-9ca0-a7e78b710002 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:05.003402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a863fcd2-d629-4865-9ca0-a7e78b710002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:05.079237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf42436-0986-4ec0-af7a-d23ee49be204 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:05.082992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf42436-0986-4ec0-af7a-d23ee49be204 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:05.082992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf42436-0986-4ec0-af7a-d23ee49be204 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:05.082992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf42436-0986-4ec0-af7a-d23ee49be204 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:05.084119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fcf42436-0986-4ec0-af7a-d23ee49be204 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:05.093821 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1003/2021] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:05.103438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863fcd2-d629-4865-9ca0-a7e78b710002 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:05.104909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a863fcd2-d629-4865-9ca0-a7e78b710002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:05.173068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf42436-0986-4ec0-af7a-d23ee49be204 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:05.176554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf42436-0986-4ec0-af7a-d23ee49be204 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:05.187065 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1019/2022] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:39:05.188099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf42436-0986-4ec0-af7a-d23ee49be204 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:05.189628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fcf42436-0986-4ec0-af7a-d23ee49be204 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:05.206252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf42436-0986-4ec0-af7a-d23ee49be204 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:05.214443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19935a-0242-4e6c-b4a2-c7070c67729e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:05.215320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19935a-0242-4e6c-b4a2-c7070c67729e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:05.215875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19935a-0242-4e6c-b4a2-c7070c67729e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:05.216078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19935a-0242-4e6c-b4a2-c7070c67729e admin admin] PATH_INFO: `/v3/users/cb920e2b6722479690c65af7d8730f90` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:05.225080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19935a-0242-4e6c-b4a2-c7070c67729e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb920e2b6722479690c65af7d8730f90)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:05.225080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19935a-0242-4e6c-b4a2-c7070c67729e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:05.247172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863fcd2-d629-4865-9ca0-a7e78b710002 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:05.255525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de79051-6b44-4f44-8b21-dfd12a0ea484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:05.256537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de79051-6b44-4f44-8b21-dfd12a0ea484 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:05.256991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de79051-6b44-4f44-8b21-dfd12a0ea484 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:05.257376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de79051-6b44-4f44-8b21-dfd12a0ea484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:05.271847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de79051-6b44-4f44-8b21-dfd12a0ea484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:05.273823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de79051-6b44-4f44-8b21-dfd12a0ea484 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:05.290409 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1004/2023] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:05.323310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:05.598424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cf19935a-0242-4e6c-b4a2-c7070c67729e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb920e2b6722479690c65af7d8730f90'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:05.601486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cf19935a-0242-4e6c-b4a2-c7070c67729e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb920e2b6722479690c65af7d8730f90'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:05.646946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cf19935a-0242-4e6c-b4a2-c7070c67729e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb920e2b6722479690c65af7d8730f90'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:05.650528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cf19935a-0242-4e6c-b4a2-c7070c67729e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb920e2b6722479690c65af7d8730f90'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:05.682436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cf19935a-0242-4e6c-b4a2-c7070c67729e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb920e2b6722479690c65af7d8730f90'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:05.723361 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1020/2024] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:05 2022] DELETE /identity/v3/users/cb920e2b6722479690c65af7d8730f90 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:05.729469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb03d9d-5587-44d6-a52b-ef7f92f87848 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:05.730409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb03d9d-5587-44d6-a52b-ef7f92f87848 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:05.732085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb03d9d-5587-44d6-a52b-ef7f92f87848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:05.779625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ebb03d9d-5587-44d6-a52b-ef7f92f87848 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:05.780477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ebb03d9d-5587-44d6-a52b-ef7f92f87848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:05.944389 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1005/2025] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:05.948705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19935a-0242-4e6c-b4a2-c7070c67729e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:05.950705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cf19935a-0242-4e6c-b4a2-c7070c67729e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:05.993378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb03d9d-5587-44d6-a52b-ef7f92f87848 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:05.997113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ebb03d9d-5587-44d6-a52b-ef7f92f87848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:06.023526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb03d9d-5587-44d6-a52b-ef7f92f87848 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:06.030683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59fd34-4516-444f-b962-145e84d4da5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:06.031568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59fd34-4516-444f-b962-145e84d4da5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:06.034550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59fd34-4516-444f-b962-145e84d4da5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:06.034550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59fd34-4516-444f-b962-145e84d4da5a admin admin] PATH_INFO: `/v3/projects/97bfd3043f0a465892d401dbb012409d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:06.034550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59fd34-4516-444f-b962-145e84d4da5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=97bfd3043f0a465892d401dbb012409d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:06.039954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59fd34-4516-444f-b962-145e84d4da5a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:06.045113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19935a-0242-4e6c-b4a2-c7070c67729e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:06.049293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50048237-ae09-4083-ad75-cb095b97a9bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:06.050165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50048237-ae09-4083-ad75-cb095b97a9bd service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:06.062895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:06.070571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50048237-ae09-4083-ad75-cb095b97a9bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:06.070571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50048237-ae09-4083-ad75-cb095b97a9bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:06.079011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50048237-ae09-4083-ad75-cb095b97a9bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:06.080517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50048237-ae09-4083-ad75-cb095b97a9bd service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:06.112229 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1021/2026] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:06.250704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5c59fd34-4516-444f-b962-145e84d4da5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97bfd3043f0a465892d401dbb012409d', 'request_id': 'req-5c59fd34-4516-444f-b962-145e84d4da5a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:06.270999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5c59fd34-4516-444f-b962-145e84d4da5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97bfd3043f0a465892d401dbb012409d', 'request_id': 'req-5c59fd34-4516-444f-b962-145e84d4da5a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:06.290194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5c59fd34-4516-444f-b962-145e84d4da5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97bfd3043f0a465892d401dbb012409d', 'request_id': 'req-5c59fd34-4516-444f-b962-145e84d4da5a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:06.434034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5c59fd34-4516-444f-b962-145e84d4da5a admin admin] The token cache is being invalidate because project 97bfd3043f0a465892d401dbb012409d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:06.434034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5c59fd34-4516-444f-b962-145e84d4da5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:06.434819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5c59fd34-4516-444f-b962-145e84d4da5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:06.437808 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1006/2027] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:05 2022] DELETE /identity/v3/projects/97bfd3043f0a465892d401dbb012409d => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:06.442707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50048237-ae09-4083-ad75-cb095b97a9bd service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:06.456235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59fd34-4516-444f-b962-145e84d4da5a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:06.463966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5c59fd34-4516-444f-b962-145e84d4da5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:06.468626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50048237-ae09-4083-ad75-cb095b97a9bd service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:06.597507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8f662-4a84-42a4-bd92-d44d551977dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:06.598308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8f662-4a84-42a4-bd92-d44d551977dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:06.600310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8f662-4a84-42a4-bd92-d44d551977dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:06.600669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8f662-4a84-42a4-bd92-d44d551977dd admin admin] PATH_INFO: `/v3/users/0f789885bfef4045b0b33e1fba083d2f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:06.604303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8f662-4a84-42a4-bd92-d44d551977dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f789885bfef4045b0b33e1fba083d2f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:06.610341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8f662-4a84-42a4-bd92-d44d551977dd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:06.626719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59fd34-4516-444f-b962-145e84d4da5a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:06.641402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321583f-9d9e-4c15-9390-3e9358e7aeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:06.642049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321583f-9d9e-4c15-9390-3e9358e7aeaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:06.642330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321583f-9d9e-4c15-9390-3e9358e7aeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:06.642798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321583f-9d9e-4c15-9390-3e9358e7aeaf admin admin] PATH_INFO: `/v3/users/7db40a0539d14b2e83dde91ca9d22789` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:06.644972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321583f-9d9e-4c15-9390-3e9358e7aeaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7db40a0539d14b2e83dde91ca9d22789)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:06.648670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321583f-9d9e-4c15-9390-3e9358e7aeaf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:06.887457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-39a8f662-4a84-42a4-bd92-d44d551977dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f789885bfef4045b0b33e1fba083d2f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:06.888140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-39a8f662-4a84-42a4-bd92-d44d551977dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f789885bfef4045b0b33e1fba083d2f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:06.917481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1321583f-9d9e-4c15-9390-3e9358e7aeaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7db40a0539d14b2e83dde91ca9d22789'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:06.922454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:07.002515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-39a8f662-4a84-42a4-bd92-d44d551977dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f789885bfef4045b0b33e1fba083d2f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:07.003231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-39a8f662-4a84-42a4-bd92-d44d551977dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f789885bfef4045b0b33e1fba083d2f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:07.029995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-39a8f662-4a84-42a4-bd92-d44d551977dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f789885bfef4045b0b33e1fba083d2f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:07.071690 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1022/2028] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:06 2022] DELETE /identity/v3/users/0f789885bfef4045b0b33e1fba083d2f => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:07.075476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8f662-4a84-42a4-bd92-d44d551977dd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:07.076997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-39a8f662-4a84-42a4-bd92-d44d551977dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:07.100586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1321583f-9d9e-4c15-9390-3e9358e7aeaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7db40a0539d14b2e83dde91ca9d22789'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:07.101991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1321583f-9d9e-4c15-9390-3e9358e7aeaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7db40a0539d14b2e83dde91ca9d22789'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:07.112029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1321583f-9d9e-4c15-9390-3e9358e7aeaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7db40a0539d14b2e83dde91ca9d22789'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:07.164781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1321583f-9d9e-4c15-9390-3e9358e7aeaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7db40a0539d14b2e83dde91ca9d22789'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:07.182072 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1007/2029] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:06 2022] DELETE /identity/v3/users/7db40a0539d14b2e83dde91ca9d22789 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:07.185984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfdfc8-ef2b-4a45-b959-e4fd653595f8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:07.186278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfdfc8-ef2b-4a45-b959-e4fd653595f8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:07.186554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfdfc8-ef2b-4a45-b959-e4fd653595f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:07.246193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8f662-4a84-42a4-bd92-d44d551977dd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:07.265235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bdbfdfc8-ef2b-4a45-b959-e4fd653595f8 None None] MFA Rules not processed for user `efe6d41548884cd1b34043afe1bafc51`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:07.272848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bdbfdfc8-ef2b-4a45-b959-e4fd653595f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:07.399947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3e0b1-633f-4b7c-ad16-67564276f231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:07.400656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3e0b1-633f-4b7c-ad16-67564276f231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:07.401010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3e0b1-633f-4b7c-ad16-67564276f231 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:07.401200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3e0b1-633f-4b7c-ad16-67564276f231 admin admin] PATH_INFO: `/v3/projects/e29f97d7f4b048348e405dff4e6afc52` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:07.402559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3e0b1-633f-4b7c-ad16-67564276f231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29f97d7f4b048348e405dff4e6afc52)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:07.407642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3e0b1-633f-4b7c-ad16-67564276f231 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:07.446964 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1008/2030] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:07 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:07.448850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb6ab2-4b53-4736-9f3d-312a9aa8183e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:07.449147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb6ab2-4b53-4736-9f3d-312a9aa8183e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:07.449420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb6ab2-4b53-4736-9f3d-312a9aa8183e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:07.485298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9abb6ab2-4b53-4736-9f3d-312a9aa8183e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:07.486686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9abb6ab2-4b53-4736-9f3d-312a9aa8183e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:07.498888 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1009/2031] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:07.498888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb6ab2-4b53-4736-9f3d-312a9aa8183e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:07.498888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9abb6ab2-4b53-4736-9f3d-312a9aa8183e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:07.541920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb6ab2-4b53-4736-9f3d-312a9aa8183e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:07.549251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3388251-2f6b-47f9-9289-fafa845bbf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:07.550921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3388251-2f6b-47f9-9289-fafa845bbf53 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:07.551205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3388251-2f6b-47f9-9289-fafa845bbf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:07.551478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3388251-2f6b-47f9-9289-fafa845bbf53 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:07.552333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3388251-2f6b-47f9-9289-fafa845bbf53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:07.566832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:07.570956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3388251-2f6b-47f9-9289-fafa845bbf53 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:07.592374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-78d3e0b1-633f-4b7c-ad16-67564276f231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29f97d7f4b048348e405dff4e6afc52', 'request_id': 'req-78d3e0b1-633f-4b7c-ad16-67564276f231'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:07.592374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-78d3e0b1-633f-4b7c-ad16-67564276f231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29f97d7f4b048348e405dff4e6afc52', 'request_id': 'req-78d3e0b1-633f-4b7c-ad16-67564276f231'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:07.641717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-78d3e0b1-633f-4b7c-ad16-67564276f231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29f97d7f4b048348e405dff4e6afc52', 'request_id': 'req-78d3e0b1-633f-4b7c-ad16-67564276f231'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:07.663064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-78d3e0b1-633f-4b7c-ad16-67564276f231 admin admin] The token cache is being invalidate because project e29f97d7f4b048348e405dff4e6afc52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:07.663369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-78d3e0b1-633f-4b7c-ad16-67564276f231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:07.664513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-78d3e0b1-633f-4b7c-ad16-67564276f231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:07.666529 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1023/2032] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:07 2022] DELETE /identity/v3/projects/e29f97d7f4b048348e405dff4e6afc52 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:07.667347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3e0b1-633f-4b7c-ad16-67564276f231 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:07.668856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-78d3e0b1-633f-4b7c-ad16-67564276f231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:07.702222 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1010/2033] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:07 2022] POST /identity/v3/projects => generated 403 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:07.703317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3388251-2f6b-47f9-9289-fafa845bbf53 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:07.706474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f3388251-2f6b-47f9-9289-fafa845bbf53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:07.784268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3e0b1-633f-4b7c-ad16-67564276f231 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:07.902452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdd245-8ae8-4c4b-8cce-5ed36ac19045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:07.903466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd245-8ae8-4c4b-8cce-5ed36ac19045 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:07.903962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd245-8ae8-4c4b-8cce-5ed36ac19045 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:07.904825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd245-8ae8-4c4b-8cce-5ed36ac19045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:07.908779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0fcdd245-8ae8-4c4b-8cce-5ed36ac19045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:07.934668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3388251-2f6b-47f9-9289-fafa845bbf53 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:07.947992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcdd245-8ae8-4c4b-8cce-5ed36ac19045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:07.951089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcdd245-8ae8-4c4b-8cce-5ed36ac19045 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:07.951345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeba0d-fe6a-497f-825e-a70f450852f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:07.964353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeba0d-fe6a-497f-825e-a70f450852f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:07.964353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeba0d-fe6a-497f-825e-a70f450852f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:07.964353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeba0d-fe6a-497f-825e-a70f450852f0 admin admin] PATH_INFO: `/v3/users/f073125258e242dcb21d09c372b31dae` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:07.964353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeba0d-fe6a-497f-825e-a70f450852f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f073125258e242dcb21d09c372b31dae)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:07.964353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeba0d-fe6a-497f-825e-a70f450852f0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:07.977432 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1024/2034] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:07.978354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdd245-8ae8-4c4b-8cce-5ed36ac19045 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:07.982465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0fcdd245-8ae8-4c4b-8cce-5ed36ac19045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:08.008641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdd245-8ae8-4c4b-8cce-5ed36ac19045 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:08.046983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb41cb-08e5-40b6-bd11-c36d45e6d76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:08.047963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb41cb-08e5-40b6-bd11-c36d45e6d76d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:08.047963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb41cb-08e5-40b6-bd11-c36d45e6d76d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:08.048135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb41cb-08e5-40b6-bd11-c36d45e6d76d admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:08.048830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb41cb-08e5-40b6-bd11-c36d45e6d76d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:08.051669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb41cb-08e5-40b6-bd11-c36d45e6d76d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:08.217084 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1025/2035] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:07 2022] POST /identity/v3/users => generated 308 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:08.218107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb41cb-08e5-40b6-bd11-c36d45e6d76d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:08.221293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ddeb41cb-08e5-40b6-bd11-c36d45e6d76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:08.260579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb41cb-08e5-40b6-bd11-c36d45e6d76d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:08.261754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e3eeba0d-fe6a-497f-825e-a70f450852f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f073125258e242dcb21d09c372b31dae'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:08.268568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa97f7-77fc-4f58-b60d-e16baef7bbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:08.270867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa97f7-77fc-4f58-b60d-e16baef7bbf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:08.271192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa97f7-77fc-4f58-b60d-e16baef7bbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:08.271623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa97f7-77fc-4f58-b60d-e16baef7bbf4 admin admin] PATH_INFO: `/v3/projects/ab925fef5c8b4b63bceb4f546cde291b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:08.273374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa97f7-77fc-4f58-b60d-e16baef7bbf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab925fef5c8b4b63bceb4f546cde291b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:08.276339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa97f7-77fc-4f58-b60d-e16baef7bbf4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:08.321297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e3eeba0d-fe6a-497f-825e-a70f450852f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f073125258e242dcb21d09c372b31dae'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:08.322446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e3eeba0d-fe6a-497f-825e-a70f450852f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f073125258e242dcb21d09c372b31dae'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:08.333521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e3eeba0d-fe6a-497f-825e-a70f450852f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f073125258e242dcb21d09c372b31dae'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:08.365757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e3eeba0d-fe6a-497f-825e-a70f450852f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f073125258e242dcb21d09c372b31dae'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:08.378830 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1011/2036] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:07 2022] DELETE /identity/v3/users/f073125258e242dcb21d09c372b31dae => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:08.381118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeba0d-fe6a-497f-825e-a70f450852f0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:08.383569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e3eeba0d-fe6a-497f-825e-a70f450852f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:08.467691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3efa97f7-77fc-4f58-b60d-e16baef7bbf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab925fef5c8b4b63bceb4f546cde291b', 'request_id': 'req-3efa97f7-77fc-4f58-b60d-e16baef7bbf4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:08.475729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeba0d-fe6a-497f-825e-a70f450852f0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:08.479512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3efa97f7-77fc-4f58-b60d-e16baef7bbf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab925fef5c8b4b63bceb4f546cde291b', 'request_id': 'req-3efa97f7-77fc-4f58-b60d-e16baef7bbf4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:08.568229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3efa97f7-77fc-4f58-b60d-e16baef7bbf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab925fef5c8b4b63bceb4f546cde291b', 'request_id': 'req-3efa97f7-77fc-4f58-b60d-e16baef7bbf4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:08.587425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3efa97f7-77fc-4f58-b60d-e16baef7bbf4 admin admin] The token cache is being invalidate because project ab925fef5c8b4b63bceb4f546cde291b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:08.587727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3efa97f7-77fc-4f58-b60d-e16baef7bbf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:08.588500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3efa97f7-77fc-4f58-b60d-e16baef7bbf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:08.590210 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1026/2037] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:08 2022] DELETE /identity/v3/projects/ab925fef5c8b4b63bceb4f546cde291b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:08.612060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8a002-dfc4-4607-a0d7-49760d93df32 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:08.612723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8a002-dfc4-4607-a0d7-49760d93df32 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:08.613429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8a002-dfc4-4607-a0d7-49760d93df32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:08.629299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a66b3-26ef-4124-910d-8de5cc61b924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:08.631935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a66b3-26ef-4124-910d-8de5cc61b924 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:08.634560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a66b3-26ef-4124-910d-8de5cc61b924 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:08.634970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a66b3-26ef-4124-910d-8de5cc61b924 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:08.635927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a66b3-26ef-4124-910d-8de5cc61b924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:08.639269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a66b3-26ef-4124-910d-8de5cc61b924 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:08.666537 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1012/2038] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:08.670483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a66b3-26ef-4124-910d-8de5cc61b924 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:08.671757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:08.673295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f31a66b3-26ef-4124-910d-8de5cc61b924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:08.694380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3be8a002-dfc4-4607-a0d7-49760d93df32 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:08.695679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3be8a002-dfc4-4607-a0d7-49760d93df32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:08.698627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a66b3-26ef-4124-910d-8de5cc61b924 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:08.715187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512e7ff-8e65-4bc3-a8f1-3fa71dbc3be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:08.716079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512e7ff-8e65-4bc3-a8f1-3fa71dbc3be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:08.716847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512e7ff-8e65-4bc3-a8f1-3fa71dbc3be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:08.717647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512e7ff-8e65-4bc3-a8f1-3fa71dbc3be1 admin admin] PATH_INFO: `/v3/projects/b6348e2d199d41b790823569854a5517/users/1b5c9acbaf244d1aa1576e35a80c3693/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:08.732377 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1027/2039] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:08.742566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48108c-1799-4aa4-b546-b5f94c0f40dc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:08.742850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48108c-1799-4aa4-b546-b5f94c0f40dc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:08.743156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48108c-1799-4aa4-b546-b5f94c0f40dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:08.757062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512e7ff-8e65-4bc3-a8f1-3fa71dbc3be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6348e2d199d41b790823569854a5517, user_id=1b5c9acbaf244d1aa1576e35a80c3693, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:08.760724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512e7ff-8e65-4bc3-a8f1-3fa71dbc3be1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:08.806916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-fb48108c-1799-4aa4-b546-b5f94c0f40dc None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:08.808150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fb48108c-1799-4aa4-b546-b5f94c0f40dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:08.827007 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1028/2040] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:08.832481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48108c-1799-4aa4-b546-b5f94c0f40dc None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:08.843275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48108c-1799-4aa4-b546-b5f94c0f40dc None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:08.848533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9729d78-8e8c-4c1d-a933-c4a7ec1c02e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:08.870385 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1013/2041] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:08 2022] PUT /identity/v3/projects/b6348e2d199d41b790823569854a5517/users/1b5c9acbaf244d1aa1576e35a80c3693/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:39:08.870897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9729d78-8e8c-4c1d-a933-c4a7ec1c02e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:08.871465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9729d78-8e8c-4c1d-a933-c4a7ec1c02e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:08.871764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9729d78-8e8c-4c1d-a933-c4a7ec1c02e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:08.872489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9729d78-8e8c-4c1d-a933-c4a7ec1c02e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:08.874100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512e7ff-8e65-4bc3-a8f1-3fa71dbc3be1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:08.877271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9729d78-8e8c-4c1d-a933-c4a7ec1c02e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:08.897198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9729d78-8e8c-4c1d-a933-c4a7ec1c02e8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:08.926849 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1029/2042] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:08.931470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9729d78-8e8c-4c1d-a933-c4a7ec1c02e8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:08.957704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9729d78-8e8c-4c1d-a933-c4a7ec1c02e8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:09.037873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512e7ff-8e65-4bc3-a8f1-3fa71dbc3be1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:09.044064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a397d40-d7bb-4adf-828f-9d4a1700959f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:09.045045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a397d40-d7bb-4adf-828f-9d4a1700959f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:09.045534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a397d40-d7bb-4adf-828f-9d4a1700959f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:09.046050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a397d40-d7bb-4adf-828f-9d4a1700959f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:09.047014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a397d40-d7bb-4adf-828f-9d4a1700959f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:09.049041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a397d40-d7bb-4adf-828f-9d4a1700959f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:09.064087 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1014/2043] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:09.067630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a397d40-d7bb-4adf-828f-9d4a1700959f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:09.084498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a397d40-d7bb-4adf-828f-9d4a1700959f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:09.089492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdede0c-4d3e-4168-947e-727f07282df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:09.090432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088c51c-2936-4fd6-b4ec-d157b2b6a9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:09.091749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088c51c-2936-4fd6-b4ec-d157b2b6a9a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:09.092126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088c51c-2936-4fd6-b4ec-d157b2b6a9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:09.093021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdede0c-4d3e-4168-947e-727f07282df5 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:09.093133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088c51c-2936-4fd6-b4ec-d157b2b6a9a2 admin admin] PATH_INFO: `/v3/projects/b6348e2d199d41b790823569854a5517/users/1b5c9acbaf244d1aa1576e35a80c3693/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:09.093227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdede0c-4d3e-4168-947e-727f07282df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:09.093227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdede0c-4d3e-4168-947e-727f07282df5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:09.093781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdede0c-4d3e-4168-947e-727f07282df5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:09.100053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdede0c-4d3e-4168-947e-727f07282df5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:09.111928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088c51c-2936-4fd6-b4ec-d157b2b6a9a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6348e2d199d41b790823569854a5517, user_id=1b5c9acbaf244d1aa1576e35a80c3693, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:09.117067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088c51c-2936-4fd6-b4ec-d157b2b6a9a2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:09.125546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:09.147885 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1015/2044] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:09 2022] PUT /identity/v3/projects/b6348e2d199d41b790823569854a5517/users/1b5c9acbaf244d1aa1576e35a80c3693/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:09.181628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088c51c-2936-4fd6-b4ec-d157b2b6a9a2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:09.184196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7088c51c-2936-4fd6-b4ec-d157b2b6a9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:09.214214 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1030/2045] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:08 2022] POST /identity/v3/projects => generated 393 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:09.221055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdede0c-4d3e-4168-947e-727f07282df5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:09.365454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088c51c-2936-4fd6-b4ec-d157b2b6a9a2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:09.389706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdede0c-4d3e-4168-947e-727f07282df5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:09.412209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28d636-dace-4fab-bec0-76fea4404ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:09.412209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28d636-dace-4fab-bec0-76fea4404ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:09.412209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28d636-dace-4fab-bec0-76fea4404ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:09.412209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28d636-dace-4fab-bec0-76fea4404ec8 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:09.414181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28d636-dace-4fab-bec0-76fea4404ec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:09.420738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28d636-dace-4fab-bec0-76fea4404ec8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:09.474504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:09.475780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:09.485668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:09.485668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681 admin admin] PATH_INFO: `/v3/projects/b20136c6b84e441eab875d7a007dd4dd` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:09.485668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b20136c6b84e441eab875d7a007dd4dd)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:09.485668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:09.567581 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1031/2046] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:09 2022] POST /identity/v3/users => generated 297 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:09.569244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28d636-dace-4fab-bec0-76fea4404ec8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:09.572003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-be28d636-dace-4fab-bec0-76fea4404ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:09.591581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28d636-dace-4fab-bec0-76fea4404ec8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:09.599205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ca472-32cf-41fd-815e-222494fa320c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:09.600291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ca472-32cf-41fd-815e-222494fa320c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:09.601062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ca472-32cf-41fd-815e-222494fa320c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:09.601620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ca472-32cf-41fd-815e-222494fa320c admin admin] PATH_INFO: `/v3/projects/6100886b0ef243edba1b735b7dfd2be5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:09.603223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ca472-32cf-41fd-815e-222494fa320c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6100886b0ef243edba1b735b7dfd2be5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:09.606107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ca472-32cf-41fd-815e-222494fa320c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:09.687888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b20136c6b84e441eab875d7a007dd4dd', 'request_id': 'req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:09.718146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b20136c6b84e441eab875d7a007dd4dd', 'request_id': 'req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:09.729508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b20136c6b84e441eab875d7a007dd4dd', 'request_id': 'req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:09.830205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681 admin admin] The token cache is being invalidate because project b20136c6b84e441eab875d7a007dd4dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:09.830205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:09.830868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:09.831308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f69ca472-32cf-41fd-815e-222494fa320c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6100886b0ef243edba1b735b7dfd2be5', 'request_id': 'req-f69ca472-32cf-41fd-815e-222494fa320c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:09.839089 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1016/2047] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:09 2022] DELETE /identity/v3/projects/b20136c6b84e441eab875d7a007dd4dd => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:09.840915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:09.843513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f69ca472-32cf-41fd-815e-222494fa320c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6100886b0ef243edba1b735b7dfd2be5', 'request_id': 'req-f69ca472-32cf-41fd-815e-222494fa320c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:09.844253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:09.945879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f69ca472-32cf-41fd-815e-222494fa320c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6100886b0ef243edba1b735b7dfd2be5', 'request_id': 'req-f69ca472-32cf-41fd-815e-222494fa320c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:09.985117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f69ca472-32cf-41fd-815e-222494fa320c admin admin] The token cache is being invalidate because project 6100886b0ef243edba1b735b7dfd2be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:09.988406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f69ca472-32cf-41fd-815e-222494fa320c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:09.988406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f69ca472-32cf-41fd-815e-222494fa320c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:09.996687 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1032/2048] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:09 2022] DELETE /identity/v3/projects/6100886b0ef243edba1b735b7dfd2be5 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:10.011350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c127753-0873-4d01-9a46-2ffc98f06492 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:10.011752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c127753-0873-4d01-9a46-2ffc98f06492 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:10.012033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c127753-0873-4d01-9a46-2ffc98f06492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:10.043393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb8293-48a1-4caa-a7f4-2b8e0cd44681 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:10.050960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2c127753-0873-4d01-9a46-2ffc98f06492 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:10.052515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2c127753-0873-4d01-9a46-2ffc98f06492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:10.157692 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1033/2049] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:10.160115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc8023-c23a-4a5c-bb1a-355cc1713e40 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:10.160502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc8023-c23a-4a5c-bb1a-355cc1713e40 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:10.160775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc8023-c23a-4a5c-bb1a-355cc1713e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:10.181761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37515e-06c8-485b-8ef6-50ca9656212e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:10.182406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37515e-06c8-485b-8ef6-50ca9656212e admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:10.182696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37515e-06c8-485b-8ef6-50ca9656212e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:10.182997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37515e-06c8-485b-8ef6-50ca9656212e admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:10.183632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37515e-06c8-485b-8ef6-50ca9656212e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:10.185492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37515e-06c8-485b-8ef6-50ca9656212e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:10.192122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3bcc8023-c23a-4a5c-bb1a-355cc1713e40 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:10.192252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3bcc8023-c23a-4a5c-bb1a-355cc1713e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:10.200812 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1017/2050] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:10.202820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f10ebf-2ea8-438c-b581-a3b0081873ea None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:10.203485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f10ebf-2ea8-438c-b581-a3b0081873ea None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:10.203779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f10ebf-2ea8-438c-b581-a3b0081873ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:10.214240 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1034/2051] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:10.215034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08077fb1-5f5f-4bff-a29e-93b258550bcd None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:10.215422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08077fb1-5f5f-4bff-a29e-93b258550bcd None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:10.215632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08077fb1-5f5f-4bff-a29e-93b258550bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:10.236579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d6f10ebf-2ea8-438c-b581-a3b0081873ea None None] MFA Rules not processed for user `897dedad921f400aa3206db5fd051231`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:10.239586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d6f10ebf-2ea8-438c-b581-a3b0081873ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:10.240947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-08077fb1-5f5f-4bff-a29e-93b258550bcd None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:10.242198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-08077fb1-5f5f-4bff-a29e-93b258550bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:10.257425 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1035/2052] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:10.258444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08077fb1-5f5f-4bff-a29e-93b258550bcd None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:10.261478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-08077fb1-5f5f-4bff-a29e-93b258550bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:10.275176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08077fb1-5f5f-4bff-a29e-93b258550bcd None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:10.293090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc52196-a188-4a4d-a3c6-47824bcb0ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:10.294417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc52196-a188-4a4d-a3c6-47824bcb0ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:10.294832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc52196-a188-4a4d-a3c6-47824bcb0ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:10.295285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc52196-a188-4a4d-a3c6-47824bcb0ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:10.296134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc52196-a188-4a4d-a3c6-47824bcb0ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:10.299022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc52196-a188-4a4d-a3c6-47824bcb0ea4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:10.319489 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1036/2053] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:10.321034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef9c85-a969-4bf1-8748-a35db9c33b9b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:10.321335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef9c85-a969-4bf1-8748-a35db9c33b9b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:10.321612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef9c85-a969-4bf1-8748-a35db9c33b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:10.343026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-beef9c85-a969-4bf1-8748-a35db9c33b9b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:10.344390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-beef9c85-a969-4bf1-8748-a35db9c33b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:10.346449 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1018/2054] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:10.348471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f10ebf-2ea8-438c-b581-a3b0081873ea None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:10.361099 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1037/2055] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:10.361099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef9c85-a969-4bf1-8748-a35db9c33b9b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:10.363742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f10ebf-2ea8-438c-b581-a3b0081873ea None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:10.372224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef9c85-a969-4bf1-8748-a35db9c33b9b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:10.380189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca0595-1cad-4c82-944d-0246dc532121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:10.380737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca0595-1cad-4c82-944d-0246dc532121 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:10.381019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2792c9-feba-40fb-b56f-6445ff56ff2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:10.381298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca0595-1cad-4c82-944d-0246dc532121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:10.381821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca0595-1cad-4c82-944d-0246dc532121 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:10.382511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2792c9-feba-40fb-b56f-6445ff56ff2a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:10.382967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2792c9-feba-40fb-b56f-6445ff56ff2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:10.383323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca0595-1cad-4c82-944d-0246dc532121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:10.383526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2792c9-feba-40fb-b56f-6445ff56ff2a admin admin] PATH_INFO: `/v3/projects/2b4b25bc171f426b8cea0a1b22e2c7d5/users/ba056f7971cb45da8c7e3c6c0eeb78da/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:10.383892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca0595-1cad-4c82-944d-0246dc532121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:10.389555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca0595-1cad-4c82-944d-0246dc532121 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:10.410676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2792c9-feba-40fb-b56f-6445ff56ff2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4b25bc171f426b8cea0a1b22e2c7d5, user_id=ba056f7971cb45da8c7e3c6c0eeb78da, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:10.414720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2792c9-feba-40fb-b56f-6445ff56ff2a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:10.437456 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1019/2056] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:10.440062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca0595-1cad-4c82-944d-0246dc532121 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:10.457887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca0595-1cad-4c82-944d-0246dc532121 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:10.465062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:10.467847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660a6c6-f6f9-470d-aa7a-01c9ad647201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:10.468535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660a6c6-f6f9-470d-aa7a-01c9ad647201 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:10.476735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660a6c6-f6f9-470d-aa7a-01c9ad647201 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:10.476735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660a6c6-f6f9-470d-aa7a-01c9ad647201 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:10.476735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660a6c6-f6f9-470d-aa7a-01c9ad647201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:10.476735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660a6c6-f6f9-470d-aa7a-01c9ad647201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:10.476735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660a6c6-f6f9-470d-aa7a-01c9ad647201 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:10.497569 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1020/2057] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:10.499129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660a6c6-f6f9-470d-aa7a-01c9ad647201 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:10.511862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660a6c6-f6f9-470d-aa7a-01c9ad647201 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:10.517170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50425d2-fe9f-4b94-a1a1-78d35039e1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:10.517958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50425d2-fe9f-4b94-a1a1-78d35039e1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:10.518605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50425d2-fe9f-4b94-a1a1-78d35039e1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:10.519987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50425d2-fe9f-4b94-a1a1-78d35039e1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:10.520837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50425d2-fe9f-4b94-a1a1-78d35039e1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:10.523183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50425d2-fe9f-4b94-a1a1-78d35039e1e5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:10.551051 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1038/2058] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:10 2022] PUT /identity/v3/projects/2b4b25bc171f426b8cea0a1b22e2c7d5/users/ba056f7971cb45da8c7e3c6c0eeb78da/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:10.552725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2792c9-feba-40fb-b56f-6445ff56ff2a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:10.649974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2792c9-feba-40fb-b56f-6445ff56ff2a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:10.656316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4aaa6e-a052-4aa2-af0f-5abad5e73e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:10.656944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aaa6e-a052-4aa2-af0f-5abad5e73e4e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:10.657274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aaa6e-a052-4aa2-af0f-5abad5e73e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:10.657974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aaa6e-a052-4aa2-af0f-5abad5e73e4e admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:10.658630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4aaa6e-a052-4aa2-af0f-5abad5e73e4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:10.660920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4aaa6e-a052-4aa2-af0f-5abad5e73e4e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:10.669533 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1021/2059] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:10 2022] POST /identity/v3/projects => generated 397 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:10.671220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3457d3-4402-4df4-b0ba-a081d631b352 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:10.674752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3457d3-4402-4df4-b0ba-a081d631b352 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:10.675118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3457d3-4402-4df4-b0ba-a081d631b352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:10.740728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6a3457d3-4402-4df4-b0ba-a081d631b352 None None] MFA Rules not processed for user `ba056f7971cb45da8c7e3c6c0eeb78da`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:10.742138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6a3457d3-4402-4df4-b0ba-a081d631b352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:10.818672 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1039/2060] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:10 2022] POST /identity/v3/projects => generated 389 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:10.819482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4aaa6e-a052-4aa2-af0f-5abad5e73e4e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:10.911491 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1022/2061] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:10.912567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3457d3-4402-4df4-b0ba-a081d631b352 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:11.088136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3457d3-4402-4df4-b0ba-a081d631b352 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:11.132623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:11.147827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4aaa6e-a052-4aa2-af0f-5abad5e73e4e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:11.164088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ed4fd-27a9-4aa2-b4ec-3d5fc79ebd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:11.166923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ed4fd-27a9-4aa2-b4ec-3d5fc79ebd05 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:11.171817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ed4fd-27a9-4aa2-b4ec-3d5fc79ebd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:11.171817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ed4fd-27a9-4aa2-b4ec-3d5fc79ebd05 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:11.171817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ed4fd-27a9-4aa2-b4ec-3d5fc79ebd05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:11.173007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ed4fd-27a9-4aa2-b4ec-3d5fc79ebd05 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:11.279116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcd068-f0ea-45ca-a9d6-fc5dd2254396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:11.279788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcd068-f0ea-45ca-a9d6-fc5dd2254396 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:11.280054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcd068-f0ea-45ca-a9d6-fc5dd2254396 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:11.280390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcd068-f0ea-45ca-a9d6-fc5dd2254396 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:11.281040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcd068-f0ea-45ca-a9d6-fc5dd2254396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:11.289635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcd068-f0ea-45ca-a9d6-fc5dd2254396 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:11.328805 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1040/2062] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:10 2022] POST /identity/v3/users => generated 299 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:11.328805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ed4fd-27a9-4aa2-b4ec-3d5fc79ebd05 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:11.343939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ed4fd-27a9-4aa2-b4ec-3d5fc79ebd05 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:11.350329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b5cb0-2152-44c0-a83d-c298ed378b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:11.351019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b5cb0-2152-44c0-a83d-c298ed378b67 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:11.351295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b5cb0-2152-44c0-a83d-c298ed378b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:11.351563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b5cb0-2152-44c0-a83d-c298ed378b67 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:11.352306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b5cb0-2152-44c0-a83d-c298ed378b67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:11.360006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b5cb0-2152-44c0-a83d-c298ed378b67 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:11.423214 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1023/2063] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:10 2022] POST /identity/v3/users => generated 295 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:11.424381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcd068-f0ea-45ca-a9d6-fc5dd2254396 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:11.436868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcd068-f0ea-45ca-a9d6-fc5dd2254396 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:11.444736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625b6f1-8759-4fca-a370-298bc1e7b5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:11.448057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625b6f1-8759-4fca-a370-298bc1e7b5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:11.448606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625b6f1-8759-4fca-a370-298bc1e7b5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:11.448987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625b6f1-8759-4fca-a370-298bc1e7b5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:11.449858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625b6f1-8759-4fca-a370-298bc1e7b5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:11.455424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625b6f1-8759-4fca-a370-298bc1e7b5b9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:11.508716 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1024/2064] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:11.510279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb77ba9-803e-46d3-b633-1696c54082fa None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:11.510629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb77ba9-803e-46d3-b633-1696c54082fa None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:11.510996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb77ba9-803e-46d3-b633-1696c54082fa None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:11.512804 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1025/2065] 10.222.0.76 () {54 vars in 921 bytes} [Sat Aug 27 04:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:11.513619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb77ba9-803e-46d3-b633-1696c54082fa None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:11.538661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb77ba9-803e-46d3-b633-1696c54082fa None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:11.544011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3c58f-e55f-4504-a6b7-b5e1b5f155ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:11.544758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3c58f-e55f-4504-a6b7-b5e1b5f155ae admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:11.545227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3c58f-e55f-4504-a6b7-b5e1b5f155ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:11.545868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3c58f-e55f-4504-a6b7-b5e1b5f155ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:11.546592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3c58f-e55f-4504-a6b7-b5e1b5f155ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:11.549233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3c58f-e55f-4504-a6b7-b5e1b5f155ae admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:11.568414 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1026/2066] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:11.569678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3c58f-e55f-4504-a6b7-b5e1b5f155ae admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:11.572958 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1041/2067] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:11 2022] POST /identity/v3/projects => generated 395 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:11.582411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00a127-1e55-4a15-9f4c-65c228a36886 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:11.583049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00a127-1e55-4a15-9f4c-65c228a36886 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:11.584391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00a127-1e55-4a15-9f4c-65c228a36886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:11.589029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3c58f-e55f-4504-a6b7-b5e1b5f155ae admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:11.623759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2a00a127-1e55-4a15-9f4c-65c228a36886 None None] MFA Rules not processed for user `0e5ddcf00a184aa0ac0e7194f1c72425`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:11.630480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2a00a127-1e55-4a15-9f4c-65c228a36886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:11.765401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77462f-42d0-4b22-b1e4-7ad9c0d19836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:11.765401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77462f-42d0-4b22-b1e4-7ad9c0d19836 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:11.765401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77462f-42d0-4b22-b1e4-7ad9c0d19836 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:11.765401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77462f-42d0-4b22-b1e4-7ad9c0d19836 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:11.765742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77462f-42d0-4b22-b1e4-7ad9c0d19836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:11.768673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77462f-42d0-4b22-b1e4-7ad9c0d19836 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:11.795904 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1027/2068] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:11.803138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77462f-42d0-4b22-b1e4-7ad9c0d19836 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:11.825835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77462f-42d0-4b22-b1e4-7ad9c0d19836 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:11.839108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c804acb-de40-48a7-be26-1a13b2b67216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:11.840574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c804acb-de40-48a7-be26-1a13b2b67216 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:11.841686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c804acb-de40-48a7-be26-1a13b2b67216 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:11.842484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c804acb-de40-48a7-be26-1a13b2b67216 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:11.843655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c804acb-de40-48a7-be26-1a13b2b67216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:11.847947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c804acb-de40-48a7-be26-1a13b2b67216 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:11.881499 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1028/2069] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:11.882640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c804acb-de40-48a7-be26-1a13b2b67216 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:11.908772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c804acb-de40-48a7-be26-1a13b2b67216 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:11.916784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e878b-57a3-4942-bf97-75077e04ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:11.917635 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1042/2070] 10.222.0.76 () {58 vars in 1018 bytes} [Sat Aug 27 04:39:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:11.917756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e878b-57a3-4942-bf97-75077e04ff90 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:11.917849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e878b-57a3-4942-bf97-75077e04ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:11.918305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00a127-1e55-4a15-9f4c-65c228a36886 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:11.918409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e878b-57a3-4942-bf97-75077e04ff90 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:11.918996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e878b-57a3-4942-bf97-75077e04ff90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:11.921715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e878b-57a3-4942-bf97-75077e04ff90 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:11.922448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:11.965502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00a127-1e55-4a15-9f4c-65c228a36886 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:11.997231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c97a3-3d9b-4e56-83ba-f400a38648e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:11.997934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c97a3-3d9b-4e56-83ba-f400a38648e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:11.998218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c97a3-3d9b-4e56-83ba-f400a38648e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:11.998516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c97a3-3d9b-4e56-83ba-f400a38648e0 admin admin] PATH_INFO: `/v3/projects/86f7acaa2f2347218b8f4e34b08d53e5/users/68021a8e064748fe8ea6965bcc00cf1e/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:12.031953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c97a3-3d9b-4e56-83ba-f400a38648e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f7acaa2f2347218b8f4e34b08d53e5, user_id=68021a8e064748fe8ea6965bcc00cf1e, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:12.036740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c97a3-3d9b-4e56-83ba-f400a38648e0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:12.069221 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1029/2071] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:11 2022] POST /identity/v3/users => generated 304 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:12.072023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e878b-57a3-4942-bf97-75077e04ff90 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:12.100685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e878b-57a3-4942-bf97-75077e04ff90 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:12.120550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c051f-b810-424d-a2d0-d157722b6ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:12.121261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c051f-b810-424d-a2d0-d157722b6ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:12.121552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c051f-b810-424d-a2d0-d157722b6ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:12.121825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c051f-b810-424d-a2d0-d157722b6ce7 admin admin] PATH_INFO: `/v3/projects/924b11c4c75648429a304e08e7e8042d/users/fda979b06e7b4ef3b929a7e0d38159eb/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:12.160759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c051f-b810-424d-a2d0-d157722b6ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=924b11c4c75648429a304e08e7e8042d, user_id=fda979b06e7b4ef3b929a7e0d38159eb, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:12.163615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c051f-b810-424d-a2d0-d157722b6ce7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:12.177399 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1043/2072] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:11 2022] PUT /identity/v3/projects/86f7acaa2f2347218b8f4e34b08d53e5/users/68021a8e064748fe8ea6965bcc00cf1e/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:12.178978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c97a3-3d9b-4e56-83ba-f400a38648e0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:12.183405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7b8c97a3-3d9b-4e56-83ba-f400a38648e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:12.256035 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1030/2073] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:12 2022] PUT /identity/v3/projects/924b11c4c75648429a304e08e7e8042d/users/fda979b06e7b4ef3b929a7e0d38159eb/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:12.257660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c051f-b810-424d-a2d0-d157722b6ce7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:12.313891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c97a3-3d9b-4e56-83ba-f400a38648e0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:12.439878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c051f-b810-424d-a2d0-d157722b6ce7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:12.469697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22a9d4-2ba9-4c27-a4bc-e926e9ed21ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:12.470655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22a9d4-2ba9-4c27-a4bc-e926e9ed21ff admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:12.470655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22a9d4-2ba9-4c27-a4bc-e926e9ed21ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:12.472979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22a9d4-2ba9-4c27-a4bc-e926e9ed21ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:12.472979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22a9d4-2ba9-4c27-a4bc-e926e9ed21ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:12.483446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22a9d4-2ba9-4c27-a4bc-e926e9ed21ff admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:12.507811 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1031/2074] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:12.518538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1ad49-1ab9-454f-8f10-7c8e91748117 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:12.518538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1ad49-1ab9-454f-8f10-7c8e91748117 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:12.518752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b44495-00a8-40c1-a6b2-14a94dfaf8a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:12.518847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1ad49-1ab9-454f-8f10-7c8e91748117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:12.519545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b44495-00a8-40c1-a6b2-14a94dfaf8a9 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:12.519545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b44495-00a8-40c1-a6b2-14a94dfaf8a9 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:12.520066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b44495-00a8-40c1-a6b2-14a94dfaf8a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:12.580362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b44495-00a8-40c1-a6b2-14a94dfaf8a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:12.582525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b44495-00a8-40c1-a6b2-14a94dfaf8a9 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:12.597407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9ca1ad49-1ab9-454f-8f10-7c8e91748117 None None] MFA Rules not processed for user `68021a8e064748fe8ea6965bcc00cf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:12.598736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9ca1ad49-1ab9-454f-8f10-7c8e91748117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:12.624074 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1044/2075] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:12.629168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3546-f848-4066-b7b7-587829221bae None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:12.629558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3546-f848-4066-b7b7-587829221bae None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:12.629665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3546-f848-4066-b7b7-587829221bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:12.719406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a19c3546-f848-4066-b7b7-587829221bae None None] MFA Rules not processed for user `fda979b06e7b4ef3b929a7e0d38159eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:12.720631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a19c3546-f848-4066-b7b7-587829221bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:12.824187 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1032/2076] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:12.825287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1ad49-1ab9-454f-8f10-7c8e91748117 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:12.846875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1ad49-1ab9-454f-8f10-7c8e91748117 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:12.867258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2af60-8e09-4c94-a06f-d51788e2aa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:12.868715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2af60-8e09-4c94-a06f-d51788e2aa5a admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:12.868715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2af60-8e09-4c94-a06f-d51788e2aa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:12.868900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2af60-8e09-4c94-a06f-d51788e2aa5a admin admin] PATH_INFO: `/v3/projects/0c6b6bde537b4b62bf37d8bba7a5eb7f/users/48e02b3f696c4479b57f8d3a6be62f2b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:12.912779 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1045/2077] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:12.912779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c3546-f848-4066-b7b7-587829221bae None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:12.915817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2af60-8e09-4c94-a06f-d51788e2aa5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6b6bde537b4b62bf37d8bba7a5eb7f, user_id=48e02b3f696c4479b57f8d3a6be62f2b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:12.918834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2af60-8e09-4c94-a06f-d51788e2aa5a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:12.928845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c3546-f848-4066-b7b7-587829221bae None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:12.938189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2c1db-67b0-447c-82bc-57f16f97467c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:12.938189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2c1db-67b0-447c-82bc-57f16f97467c service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:12.938189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2c1db-67b0-447c-82bc-57f16f97467c service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:12.938189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2c1db-67b0-447c-82bc-57f16f97467c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:12.945824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2c1db-67b0-447c-82bc-57f16f97467c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:12.947536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2c1db-67b0-447c-82bc-57f16f97467c service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:12.961052 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1046/2078] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:12 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:12.961052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2c1db-67b0-447c-82bc-57f16f97467c service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:12.977405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2c1db-67b0-447c-82bc-57f16f97467c service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:12.998521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c0a6e-2f9b-4f1f-8dd4-cf4a70bb0658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:12.999144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c0a6e-2f9b-4f1f-8dd4-cf4a70bb0658 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:12.999559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c0a6e-2f9b-4f1f-8dd4-cf4a70bb0658 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:13.000088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c0a6e-2f9b-4f1f-8dd4-cf4a70bb0658 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:13.001498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c0a6e-2f9b-4f1f-8dd4-cf4a70bb0658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:13.004369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c0a6e-2f9b-4f1f-8dd4-cf4a70bb0658 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:13.029524 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1033/2079] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:12 2022] PUT /identity/v3/projects/0c6b6bde537b4b62bf37d8bba7a5eb7f/users/48e02b3f696c4479b57f8d3a6be62f2b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:13.030997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2af60-8e09-4c94-a06f-d51788e2aa5a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:13.099090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:13.107671 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1047/2080] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:12 2022] POST /identity/v3/projects => generated 391 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:13.108741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c0a6e-2f9b-4f1f-8dd4-cf4a70bb0658 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:13.289033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2af60-8e09-4c94-a06f-d51788e2aa5a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:13.341814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c0a6e-2f9b-4f1f-8dd4-cf4a70bb0658 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:13.359232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413f310-2bbf-427c-ac0f-7cb461610b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:13.360039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f310-2bbf-427c-ac0f-7cb461610b6a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:13.371385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f310-2bbf-427c-ac0f-7cb461610b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:13.371385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f310-2bbf-427c-ac0f-7cb461610b6a admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:13.371385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413f310-2bbf-427c-ac0f-7cb461610b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:13.376713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413f310-2bbf-427c-ac0f-7cb461610b6a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:13.413453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01955fc-f085-4d61-ade0-f5208f11afb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:13.414483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01955fc-f085-4d61-ade0-f5208f11afb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:13.414908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01955fc-f085-4d61-ade0-f5208f11afb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:13.415479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01955fc-f085-4d61-ade0-f5208f11afb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:13.416930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01955fc-f085-4d61-ade0-f5208f11afb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:13.419486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01955fc-f085-4d61-ade0-f5208f11afb3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:13.433898 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1034/2081] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:13.435921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01955fc-f085-4d61-ade0-f5208f11afb3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:13.462511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01955fc-f085-4d61-ade0-f5208f11afb3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:13.467385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c004ab-c883-48d6-a7b9-d039b693b6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:13.468021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c004ab-c883-48d6-a7b9-d039b693b6d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:13.468724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c004ab-c883-48d6-a7b9-d039b693b6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:13.469003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c004ab-c883-48d6-a7b9-d039b693b6d9 admin admin] PATH_INFO: `/v3/users/68021a8e064748fe8ea6965bcc00cf1e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:13.470749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c004ab-c883-48d6-a7b9-d039b693b6d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68021a8e064748fe8ea6965bcc00cf1e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:13.473399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c004ab-c883-48d6-a7b9-d039b693b6d9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:13.515722 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1048/2082] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:13 2022] POST /identity/v3/users => generated 302 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:13.520949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413f310-2bbf-427c-ac0f-7cb461610b6a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:13.530975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413f310-2bbf-427c-ac0f-7cb461610b6a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:13.541949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0fbc9-f4e3-4b02-abb8-6aeec984240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:13.542891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0fbc9-f4e3-4b02-abb8-6aeec984240a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:13.543324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0fbc9-f4e3-4b02-abb8-6aeec984240a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:13.543761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0fbc9-f4e3-4b02-abb8-6aeec984240a admin admin] PATH_INFO: `/v3/projects/0c6b6bde537b4b62bf37d8bba7a5eb7f/users/48e02b3f696c4479b57f8d3a6be62f2b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:13.547149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0fbc9-f4e3-4b02-abb8-6aeec984240a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6b6bde537b4b62bf37d8bba7a5eb7f, user_id=48e02b3f696c4479b57f8d3a6be62f2b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:13.551441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0fbc9-f4e3-4b02-abb8-6aeec984240a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:13.568323 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1049/2083] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:13 2022] PUT /identity/v3/projects/0c6b6bde537b4b62bf37d8bba7a5eb7f/users/48e02b3f696c4479b57f8d3a6be62f2b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:13.569650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0fbc9-f4e3-4b02-abb8-6aeec984240a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:13.708772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-77c004ab-c883-48d6-a7b9-d039b693b6d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68021a8e064748fe8ea6965bcc00cf1e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:13.749870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0fbc9-f4e3-4b02-abb8-6aeec984240a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:13.755460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0650dc-1366-4407-ab06-e9ef26334a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:13.756344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0650dc-1366-4407-ab06-e9ef26334a0c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:13.756915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0650dc-1366-4407-ab06-e9ef26334a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:13.757447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0650dc-1366-4407-ab06-e9ef26334a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:13.758272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0650dc-1366-4407-ab06-e9ef26334a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:13.760234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0650dc-1366-4407-ab06-e9ef26334a0c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:13.772483 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1050/2084] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:13.774827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad627a-2855-4bf6-9838-ead211158e89 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:13.775737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad627a-2855-4bf6-9838-ead211158e89 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:13.776407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad627a-2855-4bf6-9838-ead211158e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:13.786126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-77c004ab-c883-48d6-a7b9-d039b693b6d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68021a8e064748fe8ea6965bcc00cf1e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:13.786980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-77c004ab-c883-48d6-a7b9-d039b693b6d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68021a8e064748fe8ea6965bcc00cf1e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:13.799753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-77c004ab-c883-48d6-a7b9-d039b693b6d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68021a8e064748fe8ea6965bcc00cf1e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:13.807498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:13.880321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-77c004ab-c883-48d6-a7b9-d039b693b6d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68021a8e064748fe8ea6965bcc00cf1e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:13.886084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f6ad627a-2855-4bf6-9838-ead211158e89 None None] MFA Rules not processed for user `48e02b3f696c4479b57f8d3a6be62f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:13.887394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f6ad627a-2855-4bf6-9838-ead211158e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:13.896553 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1035/2085] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:13 2022] DELETE /identity/v3/users/68021a8e064748fe8ea6965bcc00cf1e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:13.900659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c004ab-c883-48d6-a7b9-d039b693b6d9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:13.901189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-77c004ab-c883-48d6-a7b9-d039b693b6d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:14.032938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c004ab-c883-48d6-a7b9-d039b693b6d9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:14.043370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b8fcb-5a06-4ac1-91b0-4dea34e135b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:14.044154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b8fcb-5a06-4ac1-91b0-4dea34e135b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:14.044522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b8fcb-5a06-4ac1-91b0-4dea34e135b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:14.044865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b8fcb-5a06-4ac1-91b0-4dea34e135b0 admin admin] PATH_INFO: `/v3/projects/a5a462aca3ed42dbb5d220090986844b/users/acef8ffe4d8a42919e2d0d052c8c935f/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:14.065779 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1051/2086] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:13 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:14.069207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b02a7-b4c6-4d42-9d06-8ea8fcb08533 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:14.069207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b02a7-b4c6-4d42-9d06-8ea8fcb08533 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:14.075068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b02a7-b4c6-4d42-9d06-8ea8fcb08533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:14.083057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b8fcb-5a06-4ac1-91b0-4dea34e135b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a462aca3ed42dbb5d220090986844b, user_id=acef8ffe4d8a42919e2d0d052c8c935f, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:14.085813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b8fcb-5a06-4ac1-91b0-4dea34e135b0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:14.164430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-304b02a7-b4c6-4d42-9d06-8ea8fcb08533 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:14.167750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-304b02a7-b4c6-4d42-9d06-8ea8fcb08533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:14.181981 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1052/2087] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:14.181981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b02a7-b4c6-4d42-9d06-8ea8fcb08533 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:14.182782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-304b02a7-b4c6-4d42-9d06-8ea8fcb08533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:14.193019 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1036/2088] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:13 2022] PUT /identity/v3/projects/a5a462aca3ed42dbb5d220090986844b/users/acef8ffe4d8a42919e2d0d052c8c935f/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:14.197760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b8fcb-5a06-4ac1-91b0-4dea34e135b0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:14.200141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-da7b8fcb-5a06-4ac1-91b0-4dea34e135b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:14.319932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b02a7-b4c6-4d42-9d06-8ea8fcb08533 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:14.328409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b8fcb-5a06-4ac1-91b0-4dea34e135b0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:14.339784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf2751-5692-49f8-a5e4-c0599cf8e693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:14.340582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf2751-5692-49f8-a5e4-c0599cf8e693 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:14.340960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf2751-5692-49f8-a5e4-c0599cf8e693 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:14.341465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf2751-5692-49f8-a5e4-c0599cf8e693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:14.423612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84277b39-5660-4fbd-a221-a9492917e180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:14.424300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84277b39-5660-4fbd-a221-a9492917e180 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:14.424569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84277b39-5660-4fbd-a221-a9492917e180 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:14.424844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84277b39-5660-4fbd-a221-a9492917e180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:14.528553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf2751-5692-49f8-a5e4-c0599cf8e693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:14.530617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf2751-5692-49f8-a5e4-c0599cf8e693 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:14.542376 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1037/2089] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:39:14.543678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf2751-5692-49f8-a5e4-c0599cf8e693 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:14.554678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf2751-5692-49f8-a5e4-c0599cf8e693 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:14.557755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84277b39-5660-4fbd-a221-a9492917e180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:14.560140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84277b39-5660-4fbd-a221-a9492917e180 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:14.565682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a75025-1ef7-4f64-a516-9a248a4b0df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:14.571037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a75025-1ef7-4f64-a516-9a248a4b0df4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:14.571037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a75025-1ef7-4f64-a516-9a248a4b0df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:14.571037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a75025-1ef7-4f64-a516-9a248a4b0df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:14.574875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a75025-1ef7-4f64-a516-9a248a4b0df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:14.575510 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1053/2090] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:14 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:14.579430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a75025-1ef7-4f64-a516-9a248a4b0df4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:14.607240 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1038/2091] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:14.611968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84277b39-5660-4fbd-a221-a9492917e180 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:14.625362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84277b39-5660-4fbd-a221-a9492917e180 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:14.652660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736a752-216b-48df-8a87-136c5274031b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:14.654800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736a752-216b-48df-8a87-136c5274031b admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:14.656291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736a752-216b-48df-8a87-136c5274031b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:14.656584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736a752-216b-48df-8a87-136c5274031b admin admin] PATH_INFO: `/v3/projects/a5a462aca3ed42dbb5d220090986844b/users/acef8ffe4d8a42919e2d0d052c8c935f/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:14.660982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736a752-216b-48df-8a87-136c5274031b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a462aca3ed42dbb5d220090986844b, user_id=acef8ffe4d8a42919e2d0d052c8c935f, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:14.668778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736a752-216b-48df-8a87-136c5274031b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:14.686033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a75025-1ef7-4f64-a516-9a248a4b0df4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:14.687984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-56a75025-1ef7-4f64-a516-9a248a4b0df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:14.715005 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1054/2092] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:14 2022] PUT /identity/v3/projects/a5a462aca3ed42dbb5d220090986844b/users/acef8ffe4d8a42919e2d0d052c8c935f/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:14.716901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dde9b8-3a88-47ef-8b4d-4d76947f2a93 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:14.717187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dde9b8-3a88-47ef-8b4d-4d76947f2a93 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:14.717464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dde9b8-3a88-47ef-8b4d-4d76947f2a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:14.724513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a75025-1ef7-4f64-a516-9a248a4b0df4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:14.802093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-28dde9b8-3a88-47ef-8b4d-4d76947f2a93 None None] MFA Rules not processed for user `acef8ffe4d8a42919e2d0d052c8c935f`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:14.803380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-28dde9b8-3a88-47ef-8b4d-4d76947f2a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:14.893680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bc794-32d0-46b2-afd0-ebf396b1390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:14.894367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bc794-32d0-46b2-afd0-ebf396b1390e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:14.894686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bc794-32d0-46b2-afd0-ebf396b1390e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:14.894912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bc794-32d0-46b2-afd0-ebf396b1390e admin admin] PATH_INFO: `/v3/users/ba056f7971cb45da8c7e3c6c0eeb78da` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:14.897051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bc794-32d0-46b2-afd0-ebf396b1390e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba056f7971cb45da8c7e3c6c0eeb78da)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:14.905296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bc794-32d0-46b2-afd0-ebf396b1390e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:14.997391 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1055/2093] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:14 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:15.011035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dde9b8-3a88-47ef-8b4d-4d76947f2a93 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:15.149272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dde9b8-3a88-47ef-8b4d-4d76947f2a93 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:15.156460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ee1d9-3716-4ab8-ab99-e4c56b083486 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:15.157221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ee1d9-3716-4ab8-ab99-e4c56b083486 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:15.157503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ee1d9-3716-4ab8-ab99-e4c56b083486 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:15.157772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ee1d9-3716-4ab8-ab99-e4c56b083486 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:15.166745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f72ee1d9-3716-4ab8-ab99-e4c56b083486 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:15.280590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d15bc794-32d0-46b2-afd0-ebf396b1390e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba056f7971cb45da8c7e3c6c0eeb78da'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:15.359667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ee1d9-3716-4ab8-ab99-e4c56b083486 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:15.361474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ee1d9-3716-4ab8-ab99-e4c56b083486 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:15.392237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:15.411569 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1056/2094] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:39:15.428066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d15bc794-32d0-46b2-afd0-ebf396b1390e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba056f7971cb45da8c7e3c6c0eeb78da'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:15.434129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d15bc794-32d0-46b2-afd0-ebf396b1390e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba056f7971cb45da8c7e3c6c0eeb78da'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:15.451724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d15bc794-32d0-46b2-afd0-ebf396b1390e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba056f7971cb45da8c7e3c6c0eeb78da'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:15.523181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d15bc794-32d0-46b2-afd0-ebf396b1390e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba056f7971cb45da8c7e3c6c0eeb78da'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:15.554660 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1039/2095] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:14 2022] DELETE /identity/v3/users/ba056f7971cb45da8c7e3c6c0eeb78da => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:39:15.559192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2d545-ffe5-43ff-b120-8ad52e5c8794 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:15.559691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2d545-ffe5-43ff-b120-8ad52e5c8794 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:15.559782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2d545-ffe5-43ff-b120-8ad52e5c8794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:15.596694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ecd2d545-ffe5-43ff-b120-8ad52e5c8794 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:15.601328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ecd2d545-ffe5-43ff-b120-8ad52e5c8794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:15.717168 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1057/2096] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:15.786899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bc794-32d0-46b2-afd0-ebf396b1390e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:15.789432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d15bc794-32d0-46b2-afd0-ebf396b1390e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:15.993047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bc794-32d0-46b2-afd0-ebf396b1390e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:16.001393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149f3b9-8421-4712-8dfa-02ec0caa1688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:16.002564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149f3b9-8421-4712-8dfa-02ec0caa1688 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:16.002856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149f3b9-8421-4712-8dfa-02ec0caa1688 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:16.006908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149f3b9-8421-4712-8dfa-02ec0caa1688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:16.039069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149f3b9-8421-4712-8dfa-02ec0caa1688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:16.040707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149f3b9-8421-4712-8dfa-02ec0caa1688 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:16.065028 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1040/2097] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:16.631035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:16.743525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2d545-ffe5-43ff-b120-8ad52e5c8794 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:16.745027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ecd2d545-ffe5-43ff-b120-8ad52e5c8794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:16.763314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2d545-ffe5-43ff-b120-8ad52e5c8794 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:16.779931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99603151-1ad7-456b-9256-56af8005dcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:16.780608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99603151-1ad7-456b-9256-56af8005dcec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:16.781052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99603151-1ad7-456b-9256-56af8005dcec admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:16.781514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99603151-1ad7-456b-9256-56af8005dcec admin admin] PATH_INFO: `/v3/projects/86f7acaa2f2347218b8f4e34b08d53e5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:16.782690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99603151-1ad7-456b-9256-56af8005dcec admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f7acaa2f2347218b8f4e34b08d53e5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:16.784684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99603151-1ad7-456b-9256-56af8005dcec admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:17.340980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-99603151-1ad7-456b-9256-56af8005dcec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f7acaa2f2347218b8f4e34b08d53e5', 'request_id': 'req-99603151-1ad7-456b-9256-56af8005dcec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:17.340980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-99603151-1ad7-456b-9256-56af8005dcec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f7acaa2f2347218b8f4e34b08d53e5', 'request_id': 'req-99603151-1ad7-456b-9256-56af8005dcec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:17.600842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-99603151-1ad7-456b-9256-56af8005dcec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f7acaa2f2347218b8f4e34b08d53e5', 'request_id': 'req-99603151-1ad7-456b-9256-56af8005dcec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:17.619789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-99603151-1ad7-456b-9256-56af8005dcec admin admin] The token cache is being invalidate because project 86f7acaa2f2347218b8f4e34b08d53e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:17.620448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-99603151-1ad7-456b-9256-56af8005dcec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:17.621656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-99603151-1ad7-456b-9256-56af8005dcec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:17.623720 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1058/2098] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:16 2022] DELETE /identity/v3/projects/86f7acaa2f2347218b8f4e34b08d53e5 => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:17.633233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4dac8-4070-4ebb-9ef6-642035746617 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:17.640402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4dac8-4070-4ebb-9ef6-642035746617 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:17.640402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4dac8-4070-4ebb-9ef6-642035746617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:17.654844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132197a0-b53b-42b7-bff2-d9952c04d8c4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:17.655368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132197a0-b53b-42b7-bff2-d9952c04d8c4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:17.655684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132197a0-b53b-42b7-bff2-d9952c04d8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:17.730050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-132197a0-b53b-42b7-bff2-d9952c04d8c4 None None] MFA Rules not processed for user `301b13659b4e40c4bbf4f6a822083580`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:17.731183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-edc4dac8-4070-4ebb-9ef6-642035746617 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:17.731914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-132197a0-b53b-42b7-bff2-d9952c04d8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:17.733387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-edc4dac8-4070-4ebb-9ef6-642035746617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:17.843598 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1059/2099] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:17.844896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132197a0-b53b-42b7-bff2-d9952c04d8c4 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:17.846518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-132197a0-b53b-42b7-bff2-d9952c04d8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:17.945085 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1041/2100] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:17.950566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4dac8-4070-4ebb-9ef6-642035746617 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:17.956099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-edc4dac8-4070-4ebb-9ef6-642035746617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:17.993225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4dac8-4070-4ebb-9ef6-642035746617 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:18.002408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279694f4-6e30-4b2d-8c5e-99ca695efbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:18.003330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279694f4-6e30-4b2d-8c5e-99ca695efbea admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:18.003807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279694f4-6e30-4b2d-8c5e-99ca695efbea admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:18.004279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279694f4-6e30-4b2d-8c5e-99ca695efbea admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:18.005065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279694f4-6e30-4b2d-8c5e-99ca695efbea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:18.009170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279694f4-6e30-4b2d-8c5e-99ca695efbea admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:18.027589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132197a0-b53b-42b7-bff2-d9952c04d8c4 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:18.042057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:18.043682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:18.044136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:18.045044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c admin admin] PATH_INFO: `/v3/projects/2b4b25bc171f426b8cea0a1b22e2c7d5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:18.046865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4b25bc171f426b8cea0a1b22e2c7d5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:18.050923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:18.182595 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1042/2101] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:17 2022] POST /identity/v3/projects => generated 369 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:18.184586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e5a37-56c5-4003-8d4d-697c50989caf None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:18.184869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e5a37-56c5-4003-8d4d-697c50989caf None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:18.185292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e5a37-56c5-4003-8d4d-697c50989caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:18.212269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c74e5a37-56c5-4003-8d4d-697c50989caf None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:18.216359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c74e5a37-56c5-4003-8d4d-697c50989caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:18.281889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4b25bc171f426b8cea0a1b22e2c7d5', 'request_id': 'req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:18.293327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4b25bc171f426b8cea0a1b22e2c7d5', 'request_id': 'req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:18.322708 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1043/2102] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:18.324071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e5a37-56c5-4003-8d4d-697c50989caf None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:18.337264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e5a37-56c5-4003-8d4d-697c50989caf None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:18.378790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4b25bc171f426b8cea0a1b22e2c7d5', 'request_id': 'req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:18.402887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c admin admin] The token cache is being invalidate because project 2b4b25bc171f426b8cea0a1b22e2c7d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:18.403163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:18.403837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:18.405903 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1060/2103] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:17 2022] DELETE /identity/v3/projects/2b4b25bc171f426b8cea0a1b22e2c7d5 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:18.406868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:18.409281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:18.437463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6774f-7e0d-413a-9610-af1c5214903f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:18.438163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6774f-7e0d-413a-9610-af1c5214903f admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:18.438697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6774f-7e0d-413a-9610-af1c5214903f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:18.439173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6774f-7e0d-413a-9610-af1c5214903f admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:18.440106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6774f-7e0d-413a-9610-af1c5214903f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:18.443951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6774f-7e0d-413a-9610-af1c5214903f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:18.561970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa1d2a-f12f-41df-8a10-14b220c7b04c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:18.570875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6501d4-25f8-4698-bb42-7e22d8f17321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:18.571540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6501d4-25f8-4698-bb42-7e22d8f17321 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:18.571819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6501d4-25f8-4698-bb42-7e22d8f17321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:18.572091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6501d4-25f8-4698-bb42-7e22d8f17321 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:18.572779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6501d4-25f8-4698-bb42-7e22d8f17321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:18.573079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6501d4-25f8-4698-bb42-7e22d8f17321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:18.577371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6501d4-25f8-4698-bb42-7e22d8f17321 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:18.594209 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1061/2104] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:18.595225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6501d4-25f8-4698-bb42-7e22d8f17321 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:18.597100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bd6501d4-25f8-4698-bb42-7e22d8f17321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:18.609685 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1044/2105] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:18 2022] POST /identity/v3/users => generated 291 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:18.613616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6774f-7e0d-413a-9610-af1c5214903f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:18.625001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6774f-7e0d-413a-9610-af1c5214903f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:18.627550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6501d4-25f8-4698-bb42-7e22d8f17321 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:18.640526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7926698-634f-47d9-94e0-a41c7f4e92ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:18.646919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7926698-634f-47d9-94e0-a41c7f4e92ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:18.647339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6924f9f-10c5-4dd6-8eef-a99ca89ae085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:18.647841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7926698-634f-47d9-94e0-a41c7f4e92ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:18.647841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7926698-634f-47d9-94e0-a41c7f4e92ca admin admin] PATH_INFO: `/v3/users/48e02b3f696c4479b57f8d3a6be62f2b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:18.647996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6924f9f-10c5-4dd6-8eef-a99ca89ae085 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:18.647996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6924f9f-10c5-4dd6-8eef-a99ca89ae085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:18.647996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6924f9f-10c5-4dd6-8eef-a99ca89ae085 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:18.648248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7926698-634f-47d9-94e0-a41c7f4e92ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e02b3f696c4479b57f8d3a6be62f2b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:18.648329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6924f9f-10c5-4dd6-8eef-a99ca89ae085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:18.648407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7926698-634f-47d9-94e0-a41c7f4e92ca admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:18.649712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6924f9f-10c5-4dd6-8eef-a99ca89ae085 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:18.876426 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1045/2106] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:18 2022] POST /identity/v3/projects => generated 381 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:18.876426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6924f9f-10c5-4dd6-8eef-a99ca89ae085 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:18.878910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e6924f9f-10c5-4dd6-8eef-a99ca89ae085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:19.009008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e7926698-634f-47d9-94e0-a41c7f4e92ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e02b3f696c4479b57f8d3a6be62f2b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:19.010823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e7926698-634f-47d9-94e0-a41c7f4e92ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e02b3f696c4479b57f8d3a6be62f2b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:19.041264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6924f9f-10c5-4dd6-8eef-a99ca89ae085 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:19.049370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a0c84-b14c-40a5-a90c-92f601c0bbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:19.050784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a0c84-b14c-40a5-a90c-92f601c0bbfa admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:19.054541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a0c84-b14c-40a5-a90c-92f601c0bbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:19.055317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a0c84-b14c-40a5-a90c-92f601c0bbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:19.056361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a0c84-b14c-40a5-a90c-92f601c0bbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:19.058233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a0c84-b14c-40a5-a90c-92f601c0bbfa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:19.072390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:19.082852 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1046/2107] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:19.084057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a0c84-b14c-40a5-a90c-92f601c0bbfa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:19.102053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a0c84-b14c-40a5-a90c-92f601c0bbfa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:19.104868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e7926698-634f-47d9-94e0-a41c7f4e92ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e02b3f696c4479b57f8d3a6be62f2b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:19.105771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e7926698-634f-47d9-94e0-a41c7f4e92ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e02b3f696c4479b57f8d3a6be62f2b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:19.108759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d4a93-21cc-4323-8157-7428042ae8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:19.110515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4a93-21cc-4323-8157-7428042ae8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:19.110945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4a93-21cc-4323-8157-7428042ae8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:19.111530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4a93-21cc-4323-8157-7428042ae8f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:19.113968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d4a93-21cc-4323-8157-7428042ae8f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:19.116932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d4a93-21cc-4323-8157-7428042ae8f2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:19.133631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e7926698-634f-47d9-94e0-a41c7f4e92ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e02b3f696c4479b57f8d3a6be62f2b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:19.154658 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1062/2108] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:18 2022] DELETE /identity/v3/users/48e02b3f696c4479b57f8d3a6be62f2b => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:19.155910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7926698-634f-47d9-94e0-a41c7f4e92ca admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:19.164322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e7926698-634f-47d9-94e0-a41c7f4e92ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:19.229903 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1047/2109] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:19 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:19.230883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d4a93-21cc-4323-8157-7428042ae8f2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:19.234127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ac1d4a93-21cc-4323-8157-7428042ae8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:19.275171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d4a93-21cc-4323-8157-7428042ae8f2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:19.317324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7926698-634f-47d9-94e0-a41c7f4e92ca admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:19.333180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679098c8-c68b-4eef-b1ea-b688d6a2d521 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:19.339939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679098c8-c68b-4eef-b1ea-b688d6a2d521 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:19.339939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679098c8-c68b-4eef-b1ea-b688d6a2d521 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:19.339939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679098c8-c68b-4eef-b1ea-b688d6a2d521 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:19.339939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-679098c8-c68b-4eef-b1ea-b688d6a2d521 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:19.466649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6d320-77de-4458-a713-cbe5fa8be620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:19.467349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6d320-77de-4458-a713-cbe5fa8be620 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:19.467631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6d320-77de-4458-a713-cbe5fa8be620 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:19.467906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6d320-77de-4458-a713-cbe5fa8be620 admin admin] PATH_INFO: `/v3/projects/3836cf4a5fcb4de098cca1d964f3899e/users/28cf6624aed24f4da3e4abcc35a84dcf/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:19.486461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6d320-77de-4458-a713-cbe5fa8be620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3836cf4a5fcb4de098cca1d964f3899e, user_id=28cf6624aed24f4da3e4abcc35a84dcf, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:19.490814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6d320-77de-4458-a713-cbe5fa8be620 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:19.506342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679098c8-c68b-4eef-b1ea-b688d6a2d521 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:19.508016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679098c8-c68b-4eef-b1ea-b688d6a2d521 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:19.530626 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1063/2110] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:19 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:19.530626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679098c8-c68b-4eef-b1ea-b688d6a2d521 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:19.530626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-679098c8-c68b-4eef-b1ea-b688d6a2d521 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:19.538427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679098c8-c68b-4eef-b1ea-b688d6a2d521 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:19.543406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742213a-a60d-4404-92b1-a2c082f4c7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:19.544251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742213a-a60d-4404-92b1-a2c082f4c7eb admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:19.548244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742213a-a60d-4404-92b1-a2c082f4c7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:19.548244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742213a-a60d-4404-92b1-a2c082f4c7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:19.548244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742213a-a60d-4404-92b1-a2c082f4c7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:19.548244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742213a-a60d-4404-92b1-a2c082f4c7eb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:19.561946 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1064/2111] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:19.566227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742213a-a60d-4404-92b1-a2c082f4c7eb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:19.581023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742213a-a60d-4404-92b1-a2c082f4c7eb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:19.593378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6803049-2c63-45a9-8114-409800f2c8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:19.594086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6803049-2c63-45a9-8114-409800f2c8af admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:19.594833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6803049-2c63-45a9-8114-409800f2c8af admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:19.595200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6803049-2c63-45a9-8114-409800f2c8af admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:19.596307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6803049-2c63-45a9-8114-409800f2c8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:19.598708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6803049-2c63-45a9-8114-409800f2c8af admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:19.620373 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1065/2112] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:19.623819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6803049-2c63-45a9-8114-409800f2c8af admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:19.638100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6803049-2c63-45a9-8114-409800f2c8af admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:19.669534 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1048/2113] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:19 2022] PUT /identity/v3/projects/3836cf4a5fcb4de098cca1d964f3899e/users/28cf6624aed24f4da3e4abcc35a84dcf/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:19.674163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6d320-77de-4458-a713-cbe5fa8be620 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:19.675738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb82c68-ff43-4aa2-a382-c8a61b71130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:19.676457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb82c68-ff43-4aa2-a382-c8a61b71130b admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:19.676737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb82c68-ff43-4aa2-a382-c8a61b71130b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:19.677009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb82c68-ff43-4aa2-a382-c8a61b71130b admin admin] PATH_INFO: `/v3/projects/102c34e4c00d4db4bcdfdfbbffd8992c/users/a8e0435efb844bc59166293ec9ee40d0/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:19.726282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb82c68-ff43-4aa2-a382-c8a61b71130b admin admin] RBAC: Authorizing `identity:create_grant(project_id=102c34e4c00d4db4bcdfdfbbffd8992c, user_id=a8e0435efb844bc59166293ec9ee40d0, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:19.733647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb82c68-ff43-4aa2-a382-c8a61b71130b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:19.825133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6d320-77de-4458-a713-cbe5fa8be620 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:19.839131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f22954-a9b4-409b-81d2-fc04897cb179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:19.840125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f22954-a9b4-409b-81d2-fc04897cb179 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:19.840592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f22954-a9b4-409b-81d2-fc04897cb179 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:19.841022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f22954-a9b4-409b-81d2-fc04897cb179 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:19.841841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f22954-a9b4-409b-81d2-fc04897cb179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:19.844071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f22954-a9b4-409b-81d2-fc04897cb179 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:19.862341 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1066/2114] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:19 2022] PUT /identity/v3/projects/102c34e4c00d4db4bcdfdfbbffd8992c/users/a8e0435efb844bc59166293ec9ee40d0/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:19.862560 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1049/2115] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:19.863803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb82c68-ff43-4aa2-a382-c8a61b71130b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:19.867575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52398cd-8d25-4c27-a9f0-2658e446f6dd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:19.867861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52398cd-8d25-4c27-a9f0-2658e446f6dd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:19.868204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52398cd-8d25-4c27-a9f0-2658e446f6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:19.901617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e52398cd-8d25-4c27-a9f0-2658e446f6dd None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:19.903188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e52398cd-8d25-4c27-a9f0-2658e446f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:19.994472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb82c68-ff43-4aa2-a382-c8a61b71130b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:20.010635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c1dfd-c886-45c4-9cad-8a37deae0ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:20.013646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1dfd-c886-45c4-9cad-8a37deae0ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:20.015194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1dfd-c886-45c4-9cad-8a37deae0ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:20.015889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1dfd-c886-45c4-9cad-8a37deae0ceb admin admin] PATH_INFO: `/v3/projects/3836cf4a5fcb4de098cca1d964f3899e/users/28cf6624aed24f4da3e4abcc35a84dcf/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:20.020311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c1dfd-c886-45c4-9cad-8a37deae0ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3836cf4a5fcb4de098cca1d964f3899e, user_id=28cf6624aed24f4da3e4abcc35a84dcf, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:20.023650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c1dfd-c886-45c4-9cad-8a37deae0ceb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:20.028589 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1050/2116] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:20.029530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52398cd-8d25-4c27-a9f0-2658e446f6dd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:20.031669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e52398cd-8d25-4c27-a9f0-2658e446f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:20.040061 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1067/2117] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:19 2022] PUT /identity/v3/projects/3836cf4a5fcb4de098cca1d964f3899e/users/28cf6624aed24f4da3e4abcc35a84dcf/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:20.042571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c1dfd-c886-45c4-9cad-8a37deae0ceb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:20.044573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-324c1dfd-c886-45c4-9cad-8a37deae0ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:20.069690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52398cd-8d25-4c27-a9f0-2658e446f6dd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:20.138359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c1dfd-c886-45c4-9cad-8a37deae0ceb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:20.148530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0a76a-94e7-4817-82f5-4925339bad22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:20.153047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0a76a-94e7-4817-82f5-4925339bad22 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:20.153047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0a76a-94e7-4817-82f5-4925339bad22 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:20.153047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0a76a-94e7-4817-82f5-4925339bad22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:20.189703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd381ee-b757-4f8e-8535-5488e52e6706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:20.190351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd381ee-b757-4f8e-8535-5488e52e6706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:20.191270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd381ee-b757-4f8e-8535-5488e52e6706 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:20.191845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd381ee-b757-4f8e-8535-5488e52e6706 admin admin] PATH_INFO: `/v3/projects/0c6b6bde537b4b62bf37d8bba7a5eb7f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:20.193325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd381ee-b757-4f8e-8535-5488e52e6706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c6b6bde537b4b62bf37d8bba7a5eb7f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:20.197455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd381ee-b757-4f8e-8535-5488e52e6706 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:20.298374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0a76a-94e7-4817-82f5-4925339bad22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:20.298374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0a76a-94e7-4817-82f5-4925339bad22 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:20.332652 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1068/2118] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:20.437519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0bd381ee-b757-4f8e-8535-5488e52e6706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c6b6bde537b4b62bf37d8bba7a5eb7f', 'request_id': 'req-0bd381ee-b757-4f8e-8535-5488e52e6706'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:20.452833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0bd381ee-b757-4f8e-8535-5488e52e6706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c6b6bde537b4b62bf37d8bba7a5eb7f', 'request_id': 'req-0bd381ee-b757-4f8e-8535-5488e52e6706'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:20.464897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0bd381ee-b757-4f8e-8535-5488e52e6706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c6b6bde537b4b62bf37d8bba7a5eb7f', 'request_id': 'req-0bd381ee-b757-4f8e-8535-5488e52e6706'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:20.542396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0bd381ee-b757-4f8e-8535-5488e52e6706 admin admin] The token cache is being invalidate because project 0c6b6bde537b4b62bf37d8bba7a5eb7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:20.542927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0bd381ee-b757-4f8e-8535-5488e52e6706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:20.554373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0bd381ee-b757-4f8e-8535-5488e52e6706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:20.556914 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1051/2119] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:20 2022] DELETE /identity/v3/projects/0c6b6bde537b4b62bf37d8bba7a5eb7f => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:20.563696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b074070-3904-4992-bb75-0e300440d61d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:20.564407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b074070-3904-4992-bb75-0e300440d61d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:20.564988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b074070-3904-4992-bb75-0e300440d61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:20.598741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6b074070-3904-4992-bb75-0e300440d61d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:20.601449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6b074070-3904-4992-bb75-0e300440d61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:20.711861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:20.723703 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1069/2120] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:20.732182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a510fcb-d54b-44f7-8dbe-9baca99322a4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:20.732650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a510fcb-d54b-44f7-8dbe-9baca99322a4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:20.732916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a510fcb-d54b-44f7-8dbe-9baca99322a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:20.778341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6a510fcb-d54b-44f7-8dbe-9baca99322a4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:20.786424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6a510fcb-d54b-44f7-8dbe-9baca99322a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:20.802610 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1052/2121] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:20.806755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b074070-3904-4992-bb75-0e300440d61d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:20.826202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b074070-3904-4992-bb75-0e300440d61d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:20.832009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f3b80-d516-4cbc-8f0a-95df5cf62447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:20.834496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f3b80-d516-4cbc-8f0a-95df5cf62447 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:20.834890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f3b80-d516-4cbc-8f0a-95df5cf62447 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:20.835363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f3b80-d516-4cbc-8f0a-95df5cf62447 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:20.836048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f3b80-d516-4cbc-8f0a-95df5cf62447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:20.836474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f3b80-d516-4cbc-8f0a-95df5cf62447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:20.838670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f3b80-d516-4cbc-8f0a-95df5cf62447 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:20.874368 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1070/2122] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:39:20.879283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a510fcb-d54b-44f7-8dbe-9baca99322a4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:20.892209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a510fcb-d54b-44f7-8dbe-9baca99322a4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:20.942225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89794503-fc25-43da-95d0-80b3e0b9dc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:20.943301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89794503-fc25-43da-95d0-80b3e0b9dc55 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:20.943584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89794503-fc25-43da-95d0-80b3e0b9dc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:20.943863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89794503-fc25-43da-95d0-80b3e0b9dc55 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:20.944657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89794503-fc25-43da-95d0-80b3e0b9dc55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:20.947571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89794503-fc25-43da-95d0-80b3e0b9dc55 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:21.160669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f3b80-d516-4cbc-8f0a-95df5cf62447 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:21.169671 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1053/2123] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:20 2022] POST /identity/v3/projects => generated 361 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:21.175975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f3b80-d516-4cbc-8f0a-95df5cf62447 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:21.332488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7485e-7d34-4e96-ac79-164a556a165b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:21.333374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7485e-7d34-4e96-ac79-164a556a165b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:21.333556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7485e-7d34-4e96-ac79-164a556a165b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:21.333793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7485e-7d34-4e96-ac79-164a556a165b admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:21.334993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7485e-7d34-4e96-ac79-164a556a165b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:21.336440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7485e-7d34-4e96-ac79-164a556a165b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:21.507154 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1071/2124] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:21 2022] POST /identity/v3/users => generated 281 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:21.511662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89794503-fc25-43da-95d0-80b3e0b9dc55 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:21.538968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89794503-fc25-43da-95d0-80b3e0b9dc55 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:21.548082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d62f8-e163-4784-9d82-ad6572234d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:21.549497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d62f8-e163-4784-9d82-ad6572234d50 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:21.550498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d62f8-e163-4784-9d82-ad6572234d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:21.552022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d62f8-e163-4784-9d82-ad6572234d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:21.552969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d62f8-e163-4784-9d82-ad6572234d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:21.554845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d62f8-e163-4784-9d82-ad6572234d50 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:21.572747 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1054/2125] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:21.576793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7485e-7d34-4e96-ac79-164a556a165b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:21.597695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7485e-7d34-4e96-ac79-164a556a165b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:21.645137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16087307-0c73-4974-b071-f8963cb04679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:21.652735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16087307-0c73-4974-b071-f8963cb04679 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:21.652735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16087307-0c73-4974-b071-f8963cb04679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:21.652735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16087307-0c73-4974-b071-f8963cb04679 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:21.652735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16087307-0c73-4974-b071-f8963cb04679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:21.658306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16087307-0c73-4974-b071-f8963cb04679 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:21.719762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d62f8-e163-4784-9d82-ad6572234d50 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:21.727812 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1072/2126] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:21.734495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d62f8-e163-4784-9d82-ad6572234d50 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:21.745822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0607d0-558b-4f68-b575-4caf2a0bf703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:21.752987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0607d0-558b-4f68-b575-4caf2a0bf703 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:21.752987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0607d0-558b-4f68-b575-4caf2a0bf703 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:21.752987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0607d0-558b-4f68-b575-4caf2a0bf703 admin admin] PATH_INFO: `/v3/projects/03a16e9694944b158242b5187b405875/users/f14d151de0424f5ea579ee3be5b50f60/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:21.787689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0607d0-558b-4f68-b575-4caf2a0bf703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a16e9694944b158242b5187b405875, user_id=f14d151de0424f5ea579ee3be5b50f60, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:21.790731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0607d0-558b-4f68-b575-4caf2a0bf703 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:21.958391 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1055/2127] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:21 2022] PUT /identity/v3/projects/03a16e9694944b158242b5187b405875/users/f14d151de0424f5ea579ee3be5b50f60/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:39:21.963137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4ea68-d55c-4de1-bf4a-9eea73f31a7d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:21.963137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4ea68-d55c-4de1-bf4a-9eea73f31a7d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:21.963137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4ea68-d55c-4de1-bf4a-9eea73f31a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:22.031895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-36e4ea68-d55c-4de1-bf4a-9eea73f31a7d None None] MFA Rules not processed for user `f14d151de0424f5ea579ee3be5b50f60`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:22.031895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-36e4ea68-d55c-4de1-bf4a-9eea73f31a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:22.192581 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1073/2128] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:22.196822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0607d0-558b-4f68-b575-4caf2a0bf703 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:22.252018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325b600-b243-4934-b61b-dcef2715f581 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:22.252724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325b600-b243-4934-b61b-dcef2715f581 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:22.254267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325b600-b243-4934-b61b-dcef2715f581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:22.314375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7325b600-b243-4934-b61b-dcef2715f581 None None] MFA Rules not processed for user `1b5c9acbaf244d1aa1576e35a80c3693`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:22.316433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7325b600-b243-4934-b61b-dcef2715f581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:22.318684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0607d0-558b-4f68-b575-4caf2a0bf703 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:22.352067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d7290-0814-4862-95dc-d2b701abf57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:22.355106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d7290-0814-4862-95dc-d2b701abf57a admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:22.355401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d7290-0814-4862-95dc-d2b701abf57a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:22.355684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d7290-0814-4862-95dc-d2b701abf57a admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:22.359301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d7290-0814-4862-95dc-d2b701abf57a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:22.377230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d7290-0814-4862-95dc-d2b701abf57a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:22.463970 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1074/2129] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:22 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:22.502829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:22.513862 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1056/2130] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:22 2022] POST /identity/v3/projects => generated 361 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:39:22.517941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325b600-b243-4934-b61b-dcef2715f581 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:22.536405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325b600-b243-4934-b61b-dcef2715f581 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:22.638438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cf875-26c1-4079-a2e0-50f201df9a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:22.639084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cf875-26c1-4079-a2e0-50f201df9a56 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:22.639367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cf875-26c1-4079-a2e0-50f201df9a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:22.639740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cf875-26c1-4079-a2e0-50f201df9a56 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:22.640443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cf875-26c1-4079-a2e0-50f201df9a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:22.646396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cf875-26c1-4079-a2e0-50f201df9a56 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:22.746589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d7290-0814-4862-95dc-d2b701abf57a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:22.748386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b97d7290-0814-4862-95dc-d2b701abf57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:22.771175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d7290-0814-4862-95dc-d2b701abf57a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:22.788520 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1075/2131] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:22 2022] POST /identity/v3/users => generated 287 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:22.793546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff692438-3216-407f-85db-d8affffa3507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:22.794689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff692438-3216-407f-85db-d8affffa3507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:22.794977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff692438-3216-407f-85db-d8affffa3507 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:22.795253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff692438-3216-407f-85db-d8affffa3507 admin admin] PATH_INFO: `/v3/users/dfcdd13526e74e089bcac8b0ac057f96` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:22.796185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cf875-26c1-4079-a2e0-50f201df9a56 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:22.796464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff692438-3216-407f-85db-d8affffa3507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfcdd13526e74e089bcac8b0ac057f96)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:22.798435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff692438-3216-407f-85db-d8affffa3507 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:22.837838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cf875-26c1-4079-a2e0-50f201df9a56 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:22.844819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e9298-004c-42a1-af52-2c888a8e62fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:22.844977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e9298-004c-42a1-af52-2c888a8e62fb admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:22.845270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e9298-004c-42a1-af52-2c888a8e62fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:22.845553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e9298-004c-42a1-af52-2c888a8e62fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:22.846680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e9298-004c-42a1-af52-2c888a8e62fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:22.848468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e9298-004c-42a1-af52-2c888a8e62fb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:22.861635 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1076/2132] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:22.866820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e9298-004c-42a1-af52-2c888a8e62fb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:22.927607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e9298-004c-42a1-af52-2c888a8e62fb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:22.939417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9a4d8-64bf-4a41-94bc-f2e488284573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:22.941424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9a4d8-64bf-4a41-94bc-f2e488284573 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:22.943436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9a4d8-64bf-4a41-94bc-f2e488284573 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:22.945057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9a4d8-64bf-4a41-94bc-f2e488284573 admin admin] PATH_INFO: `/v3/projects/ccf7558ad87b40e28a9a2e458455bab6/users/4b306ceae470401b9be9f54793c6a16f/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:22.974254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9a4d8-64bf-4a41-94bc-f2e488284573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf7558ad87b40e28a9a2e458455bab6, user_id=4b306ceae470401b9be9f54793c6a16f, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:22.977708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9a4d8-64bf-4a41-94bc-f2e488284573 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:23.064585 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1077/2133] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:22 2022] PUT /identity/v3/projects/ccf7558ad87b40e28a9a2e458455bab6/users/4b306ceae470401b9be9f54793c6a16f/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:39:23.067294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ff692438-3216-407f-85db-d8affffa3507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfcdd13526e74e089bcac8b0ac057f96'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:23.071084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9a4d8-64bf-4a41-94bc-f2e488284573 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:23.148278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ff692438-3216-407f-85db-d8affffa3507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfcdd13526e74e089bcac8b0ac057f96'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:23.150255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ff692438-3216-407f-85db-d8affffa3507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfcdd13526e74e089bcac8b0ac057f96'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:23.178177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ff692438-3216-407f-85db-d8affffa3507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfcdd13526e74e089bcac8b0ac057f96'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:23.221817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9a4d8-64bf-4a41-94bc-f2e488284573 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:23.238079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ff692438-3216-407f-85db-d8affffa3507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfcdd13526e74e089bcac8b0ac057f96'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:23.239592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a0ae9-1e98-4b08-bb9d-7c6ec1bdc6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:23.240253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a0ae9-1e98-4b08-bb9d-7c6ec1bdc6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:23.244008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a0ae9-1e98-4b08-bb9d-7c6ec1bdc6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:23.244346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a0ae9-1e98-4b08-bb9d-7c6ec1bdc6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:23.245890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a0ae9-1e98-4b08-bb9d-7c6ec1bdc6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:23.247544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a0ae9-1e98-4b08-bb9d-7c6ec1bdc6c6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:23.281411 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1057/2134] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:22 2022] DELETE /identity/v3/users/dfcdd13526e74e089bcac8b0ac057f96 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:39:23.285111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7628f-8e25-4729-9dc1-b6372e6376fb None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:23.285728 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1078/2135] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:23.287259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7628f-8e25-4729-9dc1-b6372e6376fb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:23.288331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7628f-8e25-4729-9dc1-b6372e6376fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:23.291290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a0ae9-1e98-4b08-bb9d-7c6ec1bdc6c6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:23.295889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2c5a0ae9-1e98-4b08-bb9d-7c6ec1bdc6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:23.328867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a0ae9-1e98-4b08-bb9d-7c6ec1bdc6c6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:23.369477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-62d7628f-8e25-4729-9dc1-b6372e6376fb None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:23.372719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-62d7628f-8e25-4729-9dc1-b6372e6376fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:23.477842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da23f5-2821-42bc-b0a3-478808ea5f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:23.478702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da23f5-2821-42bc-b0a3-478808ea5f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:23.482594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da23f5-2821-42bc-b0a3-478808ea5f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:23.482755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da23f5-2821-42bc-b0a3-478808ea5f98 admin admin] PATH_INFO: `/v3/projects/ccf7558ad87b40e28a9a2e458455bab6/users/4b306ceae470401b9be9f54793c6a16f/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:23.485102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da23f5-2821-42bc-b0a3-478808ea5f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf7558ad87b40e28a9a2e458455bab6, user_id=4b306ceae470401b9be9f54793c6a16f, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:23.491126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da23f5-2821-42bc-b0a3-478808ea5f98 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:23.517987 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1079/2136] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:23 2022] PUT /identity/v3/projects/ccf7558ad87b40e28a9a2e458455bab6/users/4b306ceae470401b9be9f54793c6a16f/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:23.529497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4958274-ea38-44a8-ab69-f9d6c1c7f1dd None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:23.529849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4958274-ea38-44a8-ab69-f9d6c1c7f1dd None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:23.530083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4958274-ea38-44a8-ab69-f9d6c1c7f1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:23.575498 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1058/2137] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:23.598431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f4958274-ea38-44a8-ab69-f9d6c1c7f1dd None None] MFA Rules not processed for user `4b306ceae470401b9be9f54793c6a16f`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:23.599691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f4958274-ea38-44a8-ab69-f9d6c1c7f1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:23.683556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7628f-8e25-4729-9dc1-b6372e6376fb None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:23.686484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-62d7628f-8e25-4729-9dc1-b6372e6376fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:23.784156 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1080/2138] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:39:23.819953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7628f-8e25-4729-9dc1-b6372e6376fb None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:23.879550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:23.884900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a35ff-e284-4893-89e5-b20500ea2d43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:23.886372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a35ff-e284-4893-89e5-b20500ea2d43 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:23.886658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a35ff-e284-4893-89e5-b20500ea2d43 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:23.886937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a35ff-e284-4893-89e5-b20500ea2d43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:23.969070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a35ff-e284-4893-89e5-b20500ea2d43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:23.973433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a35ff-e284-4893-89e5-b20500ea2d43 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:23.988564 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1059/2139] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:24.174926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc5315-d7f5-43ef-8685-23b562b21a84 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:24.175700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc5315-d7f5-43ef-8685-23b562b21a84 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:24.175984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc5315-d7f5-43ef-8685-23b562b21a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:24.217356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-18bc5315-d7f5-43ef-8685-23b562b21a84 None None] MFA Rules not processed for user `0547461f91aa423381430eda35fe6b74`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:24.218631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-18bc5315-d7f5-43ef-8685-23b562b21a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:24.240817 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1081/2140] 10.222.0.75 () {58 vars in 1015 bytes} [Sat Aug 27 04:39:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:24.262444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a35ff-e284-4893-89e5-b20500ea2d43 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:24.263434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7f0a35ff-e284-4893-89e5-b20500ea2d43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:24.281344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a35ff-e284-4893-89e5-b20500ea2d43 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:24.288605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322cd66-dcd4-4199-9f7f-7f83a7bed3ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:24.289541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322cd66-dcd4-4199-9f7f-7f83a7bed3ff service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:24.289955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322cd66-dcd4-4199-9f7f-7f83a7bed3ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:24.290098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322cd66-dcd4-4199-9f7f-7f83a7bed3ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:24.309083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322cd66-dcd4-4199-9f7f-7f83a7bed3ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:24.310260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322cd66-dcd4-4199-9f7f-7f83a7bed3ff service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:24.332663 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1060/2141] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:24.392247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc5315-d7f5-43ef-8685-23b562b21a84 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:24.394252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-18bc5315-d7f5-43ef-8685-23b562b21a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:24.447962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:24.478886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc5315-d7f5-43ef-8685-23b562b21a84 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:24.486587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88d84a-061a-44b5-8b6a-896b6867b4ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:24.487243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88d84a-061a-44b5-8b6a-896b6867b4ca service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:24.488095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88d84a-061a-44b5-8b6a-896b6867b4ca service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:24.488400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88d84a-061a-44b5-8b6a-896b6867b4ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:24.499182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88d84a-061a-44b5-8b6a-896b6867b4ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:24.501042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88d84a-061a-44b5-8b6a-896b6867b4ca service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:24.522721 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1082/2142] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:25.481920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:26.087747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:26.386774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322cd66-dcd4-4199-9f7f-7f83a7bed3ff service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:26.388854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e322cd66-dcd4-4199-9f7f-7f83a7bed3ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:26.434742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322cd66-dcd4-4199-9f7f-7f83a7bed3ff service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:26.448531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c65161-9dd4-47bc-ae79-9423f0d153c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:26.449445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c65161-9dd4-47bc-ae79-9423f0d153c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:26.449730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c65161-9dd4-47bc-ae79-9423f0d153c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:26.450002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c65161-9dd4-47bc-ae79-9423f0d153c9 admin admin] PATH_INFO: `/v3/projects/1275d58fd90145148f202c5286adc7cd` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:26.451222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c65161-9dd4-47bc-ae79-9423f0d153c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1275d58fd90145148f202c5286adc7cd)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:26.460246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c65161-9dd4-47bc-ae79-9423f0d153c9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:26.624394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:26.648975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c4c65161-9dd4-47bc-ae79-9423f0d153c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1275d58fd90145148f202c5286adc7cd', 'request_id': 'req-c4c65161-9dd4-47bc-ae79-9423f0d153c9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:26.662628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c4c65161-9dd4-47bc-ae79-9423f0d153c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1275d58fd90145148f202c5286adc7cd', 'request_id': 'req-c4c65161-9dd4-47bc-ae79-9423f0d153c9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:26.677856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c4c65161-9dd4-47bc-ae79-9423f0d153c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1275d58fd90145148f202c5286adc7cd', 'request_id': 'req-c4c65161-9dd4-47bc-ae79-9423f0d153c9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:26.762259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c4c65161-9dd4-47bc-ae79-9423f0d153c9 admin admin] The token cache is being invalidate because project 1275d58fd90145148f202c5286adc7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:26.762793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c4c65161-9dd4-47bc-ae79-9423f0d153c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:26.764076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c4c65161-9dd4-47bc-ae79-9423f0d153c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:26.767199 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1061/2143] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:26 2022] DELETE /identity/v3/projects/1275d58fd90145148f202c5286adc7cd => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:26.774111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88d84a-061a-44b5-8b6a-896b6867b4ca service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:26.795085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88d84a-061a-44b5-8b6a-896b6867b4ca service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:26.988586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805cdf3-883d-49fc-a01a-a5586d28a807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:26.989372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805cdf3-883d-49fc-a01a-a5586d28a807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:26.989713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805cdf3-883d-49fc-a01a-a5586d28a807 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:26.990173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805cdf3-883d-49fc-a01a-a5586d28a807 admin admin] PATH_INFO: `/v3/users/f939d2a5ea444277afe426530ef158b2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:26.991447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805cdf3-883d-49fc-a01a-a5586d28a807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f939d2a5ea444277afe426530ef158b2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:26.993702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805cdf3-883d-49fc-a01a-a5586d28a807 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:27.227478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3805cdf3-883d-49fc-a01a-a5586d28a807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f939d2a5ea444277afe426530ef158b2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:27.228218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3805cdf3-883d-49fc-a01a-a5586d28a807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f939d2a5ea444277afe426530ef158b2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:27.248793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:27.296236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3805cdf3-883d-49fc-a01a-a5586d28a807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f939d2a5ea444277afe426530ef158b2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:27.298347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c65161-9dd4-47bc-ae79-9423f0d153c9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:27.306224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3805cdf3-883d-49fc-a01a-a5586d28a807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f939d2a5ea444277afe426530ef158b2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:27.306532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c4c65161-9dd4-47bc-ae79-9423f0d153c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:27.344836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:27.346115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3805cdf3-883d-49fc-a01a-a5586d28a807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f939d2a5ea444277afe426530ef158b2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:27.351392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c65161-9dd4-47bc-ae79-9423f0d153c9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:27.375268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ae478-af84-4bb3-9099-f37f57bca25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:27.375922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ae478-af84-4bb3-9099-f37f57bca25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:27.376242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ae478-af84-4bb3-9099-f37f57bca25f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:27.376531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ae478-af84-4bb3-9099-f37f57bca25f admin admin] PATH_INFO: `/v3/users/f14d151de0424f5ea579ee3be5b50f60` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:27.380254 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1083/2144] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:26 2022] DELETE /identity/v3/users/f939d2a5ea444277afe426530ef158b2 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:27.384134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ae478-af84-4bb3-9099-f37f57bca25f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14d151de0424f5ea579ee3be5b50f60)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:27.386355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ae478-af84-4bb3-9099-f37f57bca25f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:27.651203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-558ae478-af84-4bb3-9099-f37f57bca25f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14d151de0424f5ea579ee3be5b50f60'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:27.715578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-558ae478-af84-4bb3-9099-f37f57bca25f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14d151de0424f5ea579ee3be5b50f60'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:27.716624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-558ae478-af84-4bb3-9099-f37f57bca25f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14d151de0424f5ea579ee3be5b50f60'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:27.728556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-558ae478-af84-4bb3-9099-f37f57bca25f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14d151de0424f5ea579ee3be5b50f60'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:27.761382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-558ae478-af84-4bb3-9099-f37f57bca25f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14d151de0424f5ea579ee3be5b50f60'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:27.780563 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1062/2145] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:27 2022] DELETE /identity/v3/users/f14d151de0424f5ea579ee3be5b50f60 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:39:27.785221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a558bf-4b4a-43d1-a87e-715e8a43e406 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:27.785816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a558bf-4b4a-43d1-a87e-715e8a43e406 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:27.785930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a558bf-4b4a-43d1-a87e-715e8a43e406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:27.819876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-40a558bf-4b4a-43d1-a87e-715e8a43e406 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:27.821234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-40a558bf-4b4a-43d1-a87e-715e8a43e406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:27.938390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:28.030623 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1084/2146] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:28.064559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:28.125583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ae478-af84-4bb3-9099-f37f57bca25f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:28.130171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-558ae478-af84-4bb3-9099-f37f57bca25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:28.172261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:28.195947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:28.257818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a558bf-4b4a-43d1-a87e-715e8a43e406 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:28.263337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-40a558bf-4b4a-43d1-a87e-715e8a43e406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:28.288015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a558bf-4b4a-43d1-a87e-715e8a43e406 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:28.314058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a365fd-a14a-403a-a719-d837eab32b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:28.314921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a365fd-a14a-403a-a719-d837eab32b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:28.315208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a365fd-a14a-403a-a719-d837eab32b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:28.316062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a365fd-a14a-403a-a719-d837eab32b28 admin admin] PATH_INFO: `/v3/users/9da73530cb834803b849b0e97f467e0e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:28.318107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ae478-af84-4bb3-9099-f37f57bca25f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:28.318579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a365fd-a14a-403a-a719-d837eab32b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9da73530cb834803b849b0e97f467e0e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:28.324145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71dd14-0bd9-471e-9a98-10f9fc1f0da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:28.324992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a365fd-a14a-403a-a719-d837eab32b28 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:28.325418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71dd14-0bd9-471e-9a98-10f9fc1f0da5 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:28.325915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71dd14-0bd9-471e-9a98-10f9fc1f0da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:28.326389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71dd14-0bd9-471e-9a98-10f9fc1f0da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:28.339247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71dd14-0bd9-471e-9a98-10f9fc1f0da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:28.348049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71dd14-0bd9-471e-9a98-10f9fc1f0da5 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:28.378772 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1063/2147] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:28.589464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84a365fd-a14a-403a-a719-d837eab32b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9da73530cb834803b849b0e97f467e0e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:28.590913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84a365fd-a14a-403a-a719-d837eab32b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9da73530cb834803b849b0e97f467e0e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:28.654083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84a365fd-a14a-403a-a719-d837eab32b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9da73530cb834803b849b0e97f467e0e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:28.654741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84a365fd-a14a-403a-a719-d837eab32b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9da73530cb834803b849b0e97f467e0e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:28.678839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84a365fd-a14a-403a-a719-d837eab32b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9da73530cb834803b849b0e97f467e0e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:28.720881 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1085/2148] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:28 2022] DELETE /identity/v3/users/9da73530cb834803b849b0e97f467e0e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:28.725050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446d202-9595-42c2-a00c-21f5bc35b092 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:28.725704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446d202-9595-42c2-a00c-21f5bc35b092 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:28.731802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446d202-9595-42c2-a00c-21f5bc35b092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:28.768672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6446d202-9595-42c2-a00c-21f5bc35b092 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:28.781419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:28.784475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6446d202-9595-42c2-a00c-21f5bc35b092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:28.853430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:28.952908 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1064/2149] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:39:28.988912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a365fd-a14a-403a-a719-d837eab32b28 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:28.991855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-84a365fd-a14a-403a-a719-d837eab32b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:29.057076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446d202-9595-42c2-a00c-21f5bc35b092 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:29.058584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6446d202-9595-42c2-a00c-21f5bc35b092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:29.081609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446d202-9595-42c2-a00c-21f5bc35b092 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:29.098153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43bb53-d046-4dbf-992c-aaf4e274b80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:29.098680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43bb53-d046-4dbf-992c-aaf4e274b80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:29.098955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43bb53-d046-4dbf-992c-aaf4e274b80b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:29.099232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43bb53-d046-4dbf-992c-aaf4e274b80b admin admin] PATH_INFO: `/v3/projects/ba664abd2b724fa1b4f5c4e549f707b9` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:29.101381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43bb53-d046-4dbf-992c-aaf4e274b80b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba664abd2b724fa1b4f5c4e549f707b9)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:29.104196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43bb53-d046-4dbf-992c-aaf4e274b80b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:29.187082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a365fd-a14a-403a-a719-d837eab32b28 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:29.204393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d594b4-fc77-461c-b7ef-2cf52db34053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:29.209912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d594b4-fc77-461c-b7ef-2cf52db34053 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:29.210309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d594b4-fc77-461c-b7ef-2cf52db34053 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:29.210589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d594b4-fc77-461c-b7ef-2cf52db34053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:29.237824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d594b4-fc77-461c-b7ef-2cf52db34053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:29.239622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d594b4-fc77-461c-b7ef-2cf52db34053 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:29.253509 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1086/2150] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:29.283410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8b43bb53-d046-4dbf-992c-aaf4e274b80b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba664abd2b724fa1b4f5c4e549f707b9', 'request_id': 'req-8b43bb53-d046-4dbf-992c-aaf4e274b80b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:29.290188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8b43bb53-d046-4dbf-992c-aaf4e274b80b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba664abd2b724fa1b4f5c4e549f707b9', 'request_id': 'req-8b43bb53-d046-4dbf-992c-aaf4e274b80b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:29.308798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8b43bb53-d046-4dbf-992c-aaf4e274b80b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba664abd2b724fa1b4f5c4e549f707b9', 'request_id': 'req-8b43bb53-d046-4dbf-992c-aaf4e274b80b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:29.372598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8b43bb53-d046-4dbf-992c-aaf4e274b80b admin admin] The token cache is being invalidate because project ba664abd2b724fa1b4f5c4e549f707b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:29.373263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8b43bb53-d046-4dbf-992c-aaf4e274b80b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:29.380683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8b43bb53-d046-4dbf-992c-aaf4e274b80b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:29.382387 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1065/2151] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:29 2022] DELETE /identity/v3/projects/ba664abd2b724fa1b4f5c4e549f707b9 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:29.387386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fdc29-91bb-45a5-92d6-f3052d7a159d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:29.387844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fdc29-91bb-45a5-92d6-f3052d7a159d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:29.395124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fdc29-91bb-45a5-92d6-f3052d7a159d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:29.428768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d40fdc29-91bb-45a5-92d6-f3052d7a159d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:29.431101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d40fdc29-91bb-45a5-92d6-f3052d7a159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:29.477972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:29.575470 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1087/2152] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:29.585083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40cac8-7b94-4367-83b0-b29c4d79fd44 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:29.585710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40cac8-7b94-4367-83b0-b29c4d79fd44 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:29.586194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40cac8-7b94-4367-83b0-b29c4d79fd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:29.614663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:29.635271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9e40cac8-7b94-4367-83b0-b29c4d79fd44 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:29.636698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9e40cac8-7b94-4367-83b0-b29c4d79fd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:29.656225 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1066/2153] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:29.657886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fdc29-91bb-45a5-92d6-f3052d7a159d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:29.671102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fdc29-91bb-45a5-92d6-f3052d7a159d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:29.687500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc15f4-f275-4c99-bae5-d7b46265b552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:29.688348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc15f4-f275-4c99-bae5-d7b46265b552 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:29.688932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc15f4-f275-4c99-bae5-d7b46265b552 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:29.689433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc15f4-f275-4c99-bae5-d7b46265b552 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:29.691180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc15f4-f275-4c99-bae5-d7b46265b552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:29.692006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc15f4-f275-4c99-bae5-d7b46265b552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:29.695790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc15f4-f275-4c99-bae5-d7b46265b552 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:29.731034 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1088/2154] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:29.735022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40cac8-7b94-4367-83b0-b29c4d79fd44 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:29.749480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40cac8-7b94-4367-83b0-b29c4d79fd44 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:29.765902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b0509-e3b1-429a-b1ca-18bee3407768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:29.766703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b0509-e3b1-429a-b1ca-18bee3407768 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:29.767075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b0509-e3b1-429a-b1ca-18bee3407768 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:29.767657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b0509-e3b1-429a-b1ca-18bee3407768 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:29.769378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b0509-e3b1-429a-b1ca-18bee3407768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:29.777192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b0509-e3b1-429a-b1ca-18bee3407768 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:29.939715 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1067/2155] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:29 2022] POST /identity/v3/projects => generated 401 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:29.941517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc15f4-f275-4c99-bae5-d7b46265b552 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:29.955078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc15f4-f275-4c99-bae5-d7b46265b552 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:30.124649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63163ee0-cbd1-481f-9338-ed8d80a344e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:30.126240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63163ee0-cbd1-481f-9338-ed8d80a344e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:30.126813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63163ee0-cbd1-481f-9338-ed8d80a344e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:30.127268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63163ee0-cbd1-481f-9338-ed8d80a344e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:30.137957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63163ee0-cbd1-481f-9338-ed8d80a344e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:30.148866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63163ee0-cbd1-481f-9338-ed8d80a344e7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:30.203909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b0509-e3b1-429a-b1ca-18bee3407768 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:30.205921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2f1b0509-e3b1-429a-b1ca-18bee3407768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:30.230169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b0509-e3b1-429a-b1ca-18bee3407768 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:30.245605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:30.246283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:30.246566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:30.246848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f admin admin] PATH_INFO: `/v3/projects/f8cdc14535344095acbb85a078073ccf` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:30.250190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8cdc14535344095acbb85a078073ccf)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:30.252622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:30.291796 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1089/2156] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:29 2022] POST /identity/v3/users => generated 301 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:30.295736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63163ee0-cbd1-481f-9338-ed8d80a344e7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:30.310508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63163ee0-cbd1-481f-9338-ed8d80a344e7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:30.317551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3e684-c12d-4a20-a27e-06636703234c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:30.318849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3e684-c12d-4a20-a27e-06636703234c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:30.319281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3e684-c12d-4a20-a27e-06636703234c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:30.319984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3e684-c12d-4a20-a27e-06636703234c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:30.321850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3e684-c12d-4a20-a27e-06636703234c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:30.324303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3e684-c12d-4a20-a27e-06636703234c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:30.346355 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1090/2157] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:39:30.349257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3e684-c12d-4a20-a27e-06636703234c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:30.363845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3e684-c12d-4a20-a27e-06636703234c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:30.377153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07a542-acc2-49fc-9585-46515e548695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:30.378004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07a542-acc2-49fc-9585-46515e548695 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:30.378482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07a542-acc2-49fc-9585-46515e548695 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:30.378948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07a542-acc2-49fc-9585-46515e548695 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:30.381047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07a542-acc2-49fc-9585-46515e548695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:30.384865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07a542-acc2-49fc-9585-46515e548695 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:30.411055 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1091/2158] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:30.418147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07a542-acc2-49fc-9585-46515e548695 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:30.432976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8cdc14535344095acbb85a078073ccf', 'request_id': 'req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:30.441870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8cdc14535344095acbb85a078073ccf', 'request_id': 'req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:30.453052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8cdc14535344095acbb85a078073ccf', 'request_id': 'req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:30.453159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07a542-acc2-49fc-9585-46515e548695 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:30.544345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f admin admin] The token cache is being invalidate because project f8cdc14535344095acbb85a078073ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:30.544645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:30.544900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e80ee-b145-4ab4-bcae-3146d7de972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:30.545536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:30.545665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e80ee-b145-4ab4-bcae-3146d7de972c admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:30.545953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e80ee-b145-4ab4-bcae-3146d7de972c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:30.546280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e80ee-b145-4ab4-bcae-3146d7de972c admin admin] PATH_INFO: `/v3/projects/5830193fb5044d669e0ec200593ff23f/users/d5329b8aa2834338bd50b0efc6fbbb16/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:30.548760 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1068/2159] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:30 2022] DELETE /identity/v3/projects/f8cdc14535344095acbb85a078073ccf => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:30.552866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:30.554457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:30.566291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e80ee-b145-4ab4-bcae-3146d7de972c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5830193fb5044d669e0ec200593ff23f, user_id=d5329b8aa2834338bd50b0efc6fbbb16, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:30.570273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e80ee-b145-4ab4-bcae-3146d7de972c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:30.586589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16f5d8-f42a-4488-8bd5-7f0fcc8ef24f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:30.588062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6a21e-618d-4c58-b95d-9b98b97d0a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:30.589108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6a21e-618d-4c58-b95d-9b98b97d0a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:30.589463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6a21e-618d-4c58-b95d-9b98b97d0a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:30.589853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6a21e-618d-4c58-b95d-9b98b97d0a2c admin admin] PATH_INFO: `/v3/users/c14523f4fc704828bb6b3626c72fb30a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:30.591175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6a21e-618d-4c58-b95d-9b98b97d0a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c14523f4fc704828bb6b3626c72fb30a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:30.595286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6a21e-618d-4c58-b95d-9b98b97d0a2c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:30.685374 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1092/2160] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:30 2022] PUT /identity/v3/projects/5830193fb5044d669e0ec200593ff23f/users/d5329b8aa2834338bd50b0efc6fbbb16/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:30.688913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0ca85-1a62-48e6-b1ee-fcbf991a15cf None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:30.690057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0ca85-1a62-48e6-b1ee-fcbf991a15cf None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:30.690925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0ca85-1a62-48e6-b1ee-fcbf991a15cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:30.782315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-78c0ca85-1a62-48e6-b1ee-fcbf991a15cf None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:30.783693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-78c0ca85-1a62-48e6-b1ee-fcbf991a15cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:30.866022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-11d6a21e-618d-4c58-b95d-9b98b97d0a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c14523f4fc704828bb6b3626c72fb30a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:30.916342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-11d6a21e-618d-4c58-b95d-9b98b97d0a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c14523f4fc704828bb6b3626c72fb30a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:30.917697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-11d6a21e-618d-4c58-b95d-9b98b97d0a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c14523f4fc704828bb6b3626c72fb30a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:30.941233 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1093/2161] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:39:30.942632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0ca85-1a62-48e6-b1ee-fcbf991a15cf None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:30.948335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-11d6a21e-618d-4c58-b95d-9b98b97d0a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c14523f4fc704828bb6b3626c72fb30a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:30.951155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-78c0ca85-1a62-48e6-b1ee-fcbf991a15cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:30.976840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-11d6a21e-618d-4c58-b95d-9b98b97d0a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c14523f4fc704828bb6b3626c72fb30a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:30.994042 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1069/2162] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:30 2022] DELETE /identity/v3/users/c14523f4fc704828bb6b3626c72fb30a => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:39:30.995771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6a21e-618d-4c58-b95d-9b98b97d0a2c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:30.997199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0ca85-1a62-48e6-b1ee-fcbf991a15cf None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:30.997552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-11d6a21e-618d-4c58-b95d-9b98b97d0a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:31.026837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:31.129560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:31.190360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8a8f8-8980-4a18-90df-59e8b0269a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:31.192814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8a8f8-8980-4a18-90df-59e8b0269a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:31.194947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6a21e-618d-4c58-b95d-9b98b97d0a2c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:31.200050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8a8f8-8980-4a18-90df-59e8b0269a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:31.200416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8a8f8-8980-4a18-90df-59e8b0269a7b admin admin] PATH_INFO: `/v3/projects/03a16e9694944b158242b5187b405875` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:31.205500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8a8f8-8980-4a18-90df-59e8b0269a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a16e9694944b158242b5187b405875)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:31.209450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287902b8-188d-4e1f-b462-a0878330106b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:31.209996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8a8f8-8980-4a18-90df-59e8b0269a7b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:31.210673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287902b8-188d-4e1f-b462-a0878330106b service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:31.211122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287902b8-188d-4e1f-b462-a0878330106b service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:31.211540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287902b8-188d-4e1f-b462-a0878330106b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:31.215616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-287902b8-188d-4e1f-b462-a0878330106b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:31.256066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287902b8-188d-4e1f-b462-a0878330106b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:31.257971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287902b8-188d-4e1f-b462-a0878330106b service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:31.284455 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1070/2163] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:31.405953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-beb8a8f8-8980-4a18-90df-59e8b0269a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a16e9694944b158242b5187b405875', 'request_id': 'req-beb8a8f8-8980-4a18-90df-59e8b0269a7b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:31.445434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-beb8a8f8-8980-4a18-90df-59e8b0269a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a16e9694944b158242b5187b405875', 'request_id': 'req-beb8a8f8-8980-4a18-90df-59e8b0269a7b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:31.490918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-beb8a8f8-8980-4a18-90df-59e8b0269a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a16e9694944b158242b5187b405875', 'request_id': 'req-beb8a8f8-8980-4a18-90df-59e8b0269a7b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:31.514795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-beb8a8f8-8980-4a18-90df-59e8b0269a7b admin admin] The token cache is being invalidate because project 03a16e9694944b158242b5187b405875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:31.515339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-beb8a8f8-8980-4a18-90df-59e8b0269a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:31.516337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-beb8a8f8-8980-4a18-90df-59e8b0269a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:31.519246 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1094/2164] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:30 2022] DELETE /identity/v3/projects/03a16e9694944b158242b5187b405875 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:31.523447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287902b8-188d-4e1f-b462-a0878330106b service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:31.525322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-287902b8-188d-4e1f-b462-a0878330106b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:31.527178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:31.547357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:31.565812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287902b8-188d-4e1f-b462-a0878330106b service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:31.624953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:31.641868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:31.724223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c2623-3148-47fb-bd84-2679a7451d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:31.724885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c2623-3148-47fb-bd84-2679a7451d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:31.725166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c2623-3148-47fb-bd84-2679a7451d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:31.725883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c2623-3148-47fb-bd84-2679a7451d4a admin admin] PATH_INFO: `/v3/users/4b306ceae470401b9be9f54793c6a16f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:31.726781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c2623-3148-47fb-bd84-2679a7451d4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b306ceae470401b9be9f54793c6a16f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:31.729716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c2623-3148-47fb-bd84-2679a7451d4a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:31.865398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:31.945532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-517c2623-3148-47fb-bd84-2679a7451d4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b306ceae470401b9be9f54793c6a16f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:32.054999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-517c2623-3148-47fb-bd84-2679a7451d4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b306ceae470401b9be9f54793c6a16f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:32.057171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-517c2623-3148-47fb-bd84-2679a7451d4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b306ceae470401b9be9f54793c6a16f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:32.073839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-517c2623-3148-47fb-bd84-2679a7451d4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b306ceae470401b9be9f54793c6a16f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:32.131531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-517c2623-3148-47fb-bd84-2679a7451d4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b306ceae470401b9be9f54793c6a16f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:32.138638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:32.153737 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1071/2165] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:31 2022] DELETE /identity/v3/users/4b306ceae470401b9be9f54793c6a16f => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:39:32.280563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56617585-38a2-4242-8d01-c490a99ac9e4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:32.280846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56617585-38a2-4242-8d01-c490a99ac9e4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:32.281106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56617585-38a2-4242-8d01-c490a99ac9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:32.319134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-56617585-38a2-4242-8d01-c490a99ac9e4 None None] MFA Rules not processed for user `28cf6624aed24f4da3e4abcc35a84dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:32.320515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-56617585-38a2-4242-8d01-c490a99ac9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:32.477201 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1095/2166] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:32.482441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ca213-a3d1-4c9f-bcce-fd4554b0d4f9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:32.482609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ca213-a3d1-4c9f-bcce-fd4554b0d4f9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:32.482778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ca213-a3d1-4c9f-bcce-fd4554b0d4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:32.510420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bf2ca213-a3d1-4c9f-bcce-fd4554b0d4f9 None None] MFA Rules not processed for user `301b13659b4e40c4bbf4f6a822083580`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:32.512202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bf2ca213-a3d1-4c9f-bcce-fd4554b0d4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:32.606946 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1072/2167] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:32.607675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:32.630280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56617585-38a2-4242-8d01-c490a99ac9e4 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:32.631715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-56617585-38a2-4242-8d01-c490a99ac9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:32.769059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56617585-38a2-4242-8d01-c490a99ac9e4 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:32.775735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21355e-838a-43c5-9fac-e2786ca6ab66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:32.776510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21355e-838a-43c5-9fac-e2786ca6ab66 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:32.776825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21355e-838a-43c5-9fac-e2786ca6ab66 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:32.777094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21355e-838a-43c5-9fac-e2786ca6ab66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:32.778934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4a21355e-838a-43c5-9fac-e2786ca6ab66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:32.804269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21355e-838a-43c5-9fac-e2786ca6ab66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:32.804269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21355e-838a-43c5-9fac-e2786ca6ab66 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:32.822405 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1096/2168] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:32.889612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ca213-a3d1-4c9f-bcce-fd4554b0d4f9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:32.891069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bf2ca213-a3d1-4c9f-bcce-fd4554b0d4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:33.069993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ca213-a3d1-4c9f-bcce-fd4554b0d4f9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:33.087023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d42525-04a4-4fdd-a7d4-5b19c26f01f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:33.087732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d42525-04a4-4fdd-a7d4-5b19c26f01f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:33.088015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d42525-04a4-4fdd-a7d4-5b19c26f01f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:33.088364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d42525-04a4-4fdd-a7d4-5b19c26f01f0 admin admin] PATH_INFO: `/v3/projects/e3257ae112444765a396e3ebab7380a1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:33.092736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d42525-04a4-4fdd-a7d4-5b19c26f01f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3257ae112444765a396e3ebab7380a1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:33.099852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d42525-04a4-4fdd-a7d4-5b19c26f01f0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:33.298422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f4d42525-04a4-4fdd-a7d4-5b19c26f01f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3257ae112444765a396e3ebab7380a1', 'request_id': 'req-f4d42525-04a4-4fdd-a7d4-5b19c26f01f0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:33.313305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f4d42525-04a4-4fdd-a7d4-5b19c26f01f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3257ae112444765a396e3ebab7380a1', 'request_id': 'req-f4d42525-04a4-4fdd-a7d4-5b19c26f01f0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:33.324292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f4d42525-04a4-4fdd-a7d4-5b19c26f01f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3257ae112444765a396e3ebab7380a1', 'request_id': 'req-f4d42525-04a4-4fdd-a7d4-5b19c26f01f0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:33.359848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21355e-838a-43c5-9fac-e2786ca6ab66 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:33.362039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4a21355e-838a-43c5-9fac-e2786ca6ab66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:33.379988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:33.403553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21355e-838a-43c5-9fac-e2786ca6ab66 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:33.426657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f4d42525-04a4-4fdd-a7d4-5b19c26f01f0 admin admin] The token cache is being invalidate because project e3257ae112444765a396e3ebab7380a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:33.426920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f4d42525-04a4-4fdd-a7d4-5b19c26f01f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:33.429111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f4d42525-04a4-4fdd-a7d4-5b19c26f01f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:33.432976 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1073/2169] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:32 2022] DELETE /identity/v3/projects/e3257ae112444765a396e3ebab7380a1 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:33.439611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116332c-55de-4768-8f52-d2530d15094c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:33.439899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116332c-55de-4768-8f52-d2530d15094c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:33.440256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116332c-55de-4768-8f52-d2530d15094c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:33.494623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2116332c-55de-4768-8f52-d2530d15094c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:33.495914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2116332c-55de-4768-8f52-d2530d15094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:33.566705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:33.608734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d272d11-09b6-42b5-9ea9-da0f2a0ca898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:33.609382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d272d11-09b6-42b5-9ea9-da0f2a0ca898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:33.609662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d272d11-09b6-42b5-9ea9-da0f2a0ca898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:33.609934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d272d11-09b6-42b5-9ea9-da0f2a0ca898 admin admin] PATH_INFO: `/v3/projects/ccf7558ad87b40e28a9a2e458455bab6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:33.611236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d272d11-09b6-42b5-9ea9-da0f2a0ca898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf7558ad87b40e28a9a2e458455bab6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:33.614092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d272d11-09b6-42b5-9ea9-da0f2a0ca898 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:33.662060 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1074/2170] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:33.676146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7136e-6bb6-4ea3-b93a-751ca6292918 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:33.676682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7136e-6bb6-4ea3-b93a-751ca6292918 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:33.677181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7136e-6bb6-4ea3-b93a-751ca6292918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:33.709958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d4d7136e-6bb6-4ea3-b93a-751ca6292918 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:33.711667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d4d7136e-6bb6-4ea3-b93a-751ca6292918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:33.734732 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1075/2171] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:33.748018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7136e-6bb6-4ea3-b93a-751ca6292918 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:33.776427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7136e-6bb6-4ea3-b93a-751ca6292918 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:33.782904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7d272d11-09b6-42b5-9ea9-da0f2a0ca898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf7558ad87b40e28a9a2e458455bab6', 'request_id': 'req-7d272d11-09b6-42b5-9ea9-da0f2a0ca898'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:33.798975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7d272d11-09b6-42b5-9ea9-da0f2a0ca898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf7558ad87b40e28a9a2e458455bab6', 'request_id': 'req-7d272d11-09b6-42b5-9ea9-da0f2a0ca898'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:33.864660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39987da-aee5-4898-8138-e00a3ab705c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:33.865444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39987da-aee5-4898-8138-e00a3ab705c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:33.865725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39987da-aee5-4898-8138-e00a3ab705c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:33.866002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39987da-aee5-4898-8138-e00a3ab705c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:33.866671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39987da-aee5-4898-8138-e00a3ab705c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:33.866975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39987da-aee5-4898-8138-e00a3ab705c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:33.869624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39987da-aee5-4898-8138-e00a3ab705c4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:33.875488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7d272d11-09b6-42b5-9ea9-da0f2a0ca898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf7558ad87b40e28a9a2e458455bab6', 'request_id': 'req-7d272d11-09b6-42b5-9ea9-da0f2a0ca898'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:33.896243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7d272d11-09b6-42b5-9ea9-da0f2a0ca898 admin admin] The token cache is being invalidate because project ccf7558ad87b40e28a9a2e458455bab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:33.896813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7d272d11-09b6-42b5-9ea9-da0f2a0ca898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:33.899456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7d272d11-09b6-42b5-9ea9-da0f2a0ca898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:33.905780 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1097/2172] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:33 2022] DELETE /identity/v3/projects/ccf7558ad87b40e28a9a2e458455bab6 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:33.907445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661b4f4-d06c-471a-89d5-44bcefae7f4b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:33.909673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661b4f4-d06c-471a-89d5-44bcefae7f4b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:33.910013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661b4f4-d06c-471a-89d5-44bcefae7f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:33.914936 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1076/2173] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:33.918823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39987da-aee5-4898-8138-e00a3ab705c4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:33.921896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d39987da-aee5-4898-8138-e00a3ab705c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:33.947332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39987da-aee5-4898-8138-e00a3ab705c4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:33.952752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3661b4f4-d06c-471a-89d5-44bcefae7f4b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:33.959082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3661b4f4-d06c-471a-89d5-44bcefae7f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:33.959992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37aa4f-264b-4144-9bff-ad5520a3ced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:33.961336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37aa4f-264b-4144-9bff-ad5520a3ced6 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:33.962848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37aa4f-264b-4144-9bff-ad5520a3ced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:33.963265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37aa4f-264b-4144-9bff-ad5520a3ced6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:33.965283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37aa4f-264b-4144-9bff-ad5520a3ced6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:33.972220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37aa4f-264b-4144-9bff-ad5520a3ced6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:33.985076 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1098/2174] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:33.994557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaa4a3-4a6e-4979-b10f-ee8bd3b3c9be None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:33.999509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaa4a3-4a6e-4979-b10f-ee8bd3b3c9be None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:33.999509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaa4a3-4a6e-4979-b10f-ee8bd3b3c9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:34.028334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9deaa4a3-4a6e-4979-b10f-ee8bd3b3c9be None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:34.028873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9deaa4a3-4a6e-4979-b10f-ee8bd3b3c9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:34.039726 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1099/2175] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:34.043027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaa4a3-4a6e-4979-b10f-ee8bd3b3c9be None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:34.059786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaa4a3-4a6e-4979-b10f-ee8bd3b3c9be None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:34.067846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f60ef7-5ac0-47a9-9878-14c8ff0b089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:34.068788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f60ef7-5ac0-47a9-9878-14c8ff0b089d admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:34.069235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f60ef7-5ac0-47a9-9878-14c8ff0b089d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:34.069511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f60ef7-5ac0-47a9-9878-14c8ff0b089d admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:34.070841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f60ef7-5ac0-47a9-9878-14c8ff0b089d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:34.070841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f60ef7-5ac0-47a9-9878-14c8ff0b089d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:34.072376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f60ef7-5ac0-47a9-9878-14c8ff0b089d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:34.087039 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1100/2176] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:34.101802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f60ef7-5ac0-47a9-9878-14c8ff0b089d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:34.116545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f60ef7-5ac0-47a9-9878-14c8ff0b089d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:34.125560 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1077/2177] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:33 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:39:34.126987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37aa4f-264b-4144-9bff-ad5520a3ced6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:34.132548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39d256-33fe-4d22-9bf6-227e7338fc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:34.133428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39d256-33fe-4d22-9bf6-227e7338fc79 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:34.133886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39d256-33fe-4d22-9bf6-227e7338fc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:34.134486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39d256-33fe-4d22-9bf6-227e7338fc79 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:34.135284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39d256-33fe-4d22-9bf6-227e7338fc79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:34.139465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39d256-33fe-4d22-9bf6-227e7338fc79 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:34.260681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37aa4f-264b-4144-9bff-ad5520a3ced6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:34.261588 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1101/2178] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:34 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:34.263234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87be690-789e-4e43-bee7-b47444e740a2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:34.264712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87be690-789e-4e43-bee7-b47444e740a2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:34.265063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87be690-789e-4e43-bee7-b47444e740a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:34.301486 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-f87be690-789e-4e43-bee7-b47444e740a2 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:39:34.301486 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:39:34.301486 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:39:34.301486 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:39:34.301486 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:39:34.301486 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:39:34.301486 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:39:34.301486 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:39:34.301486 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:39:34.301486 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:39:34.301486 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:39:34.301486 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:39:34.301486 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:39:34.302315 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:39:34.302315 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:39:34.302315 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:39:34.302315 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:39:34.302315 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:39:34.302315 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:39:34.302315 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:39:34.302315 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:39:34.302315 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:39:34.302315 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:39:34.302315 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:39:34.302315 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:39:34.302315 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:39:34.302315 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:39:34.302315 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:39:34.305027 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1102/2179] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:39:34 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 42 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:39:34.306221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87be690-789e-4e43-bee7-b47444e740a2 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:34.383900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031cfbc-5f96-41e5-b59c-1e574d8db876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:34.383900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031cfbc-5f96-41e5-b59c-1e574d8db876 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:34.383900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031cfbc-5f96-41e5-b59c-1e574d8db876 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:34.383900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031cfbc-5f96-41e5-b59c-1e574d8db876 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:34.387279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031cfbc-5f96-41e5-b59c-1e574d8db876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:34.387279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031cfbc-5f96-41e5-b59c-1e574d8db876 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:34.442377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87be690-789e-4e43-bee7-b47444e740a2 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:34.449851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738d64f-bde0-4b43-bba0-9ce04b2cbf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:34.450538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738d64f-bde0-4b43-bba0-9ce04b2cbf1e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:34.450816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738d64f-bde0-4b43-bba0-9ce04b2cbf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:34.451092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738d64f-bde0-4b43-bba0-9ce04b2cbf1e admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:34.452026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738d64f-bde0-4b43-bba0-9ce04b2cbf1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:34.454799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738d64f-bde0-4b43-bba0-9ce04b2cbf1e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:34.541373 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1078/2180] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:34 2022] POST /identity/v3/users => generated 291 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:34.542965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0675f84-9fdc-42cf-b138-4798a4303d7c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:34.543262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0675f84-9fdc-42cf-b138-4798a4303d7c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:34.543537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0675f84-9fdc-42cf-b138-4798a4303d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:34.563596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:34.565078 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1103/2181] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:34 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:34.571351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738d64f-bde0-4b43-bba0-9ce04b2cbf1e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:34.611162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f0675f84-9fdc-42cf-b138-4798a4303d7c None None] MFA Rules not processed for user `301b13659b4e40c4bbf4f6a822083580`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:34.619826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f0675f84-9fdc-42cf-b138-4798a4303d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:34.663950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738d64f-bde0-4b43-bba0-9ce04b2cbf1e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:34.669942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c845b-7e1d-4df5-857f-bf58627342df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:34.670884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c845b-7e1d-4df5-857f-bf58627342df admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:34.671368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c845b-7e1d-4df5-857f-bf58627342df admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:34.672057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c845b-7e1d-4df5-857f-bf58627342df admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:34.672950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c845b-7e1d-4df5-857f-bf58627342df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:34.675414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c845b-7e1d-4df5-857f-bf58627342df admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:34.693785 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1104/2182] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:34.695010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c845b-7e1d-4df5-857f-bf58627342df admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:34.711029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c845b-7e1d-4df5-857f-bf58627342df admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:34.714390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:34.724074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aabd0e-61a0-479b-9f09-fe708e04e6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:34.725234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aabd0e-61a0-479b-9f09-fe708e04e6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:34.725806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aabd0e-61a0-479b-9f09-fe708e04e6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:34.726341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aabd0e-61a0-479b-9f09-fe708e04e6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:34.727147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aabd0e-61a0-479b-9f09-fe708e04e6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:34.736177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aabd0e-61a0-479b-9f09-fe708e04e6d4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:34.769195 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1079/2183] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:34.771061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0675f84-9fdc-42cf-b138-4798a4303d7c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:34.784662 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1105/2184] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:34.788513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0675f84-9fdc-42cf-b138-4798a4303d7c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:34.793705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aabd0e-61a0-479b-9f09-fe708e04e6d4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:34.809730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9b65c-463b-45c3-a4a0-0982e9b33c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:34.810350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9b65c-463b-45c3-a4a0-0982e9b33c92 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:34.810628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9b65c-463b-45c3-a4a0-0982e9b33c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:34.810947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9b65c-463b-45c3-a4a0-0982e9b33c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:34.811544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9b65c-463b-45c3-a4a0-0982e9b33c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:34.818504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9b65c-463b-45c3-a4a0-0982e9b33c92 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:34.819639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aabd0e-61a0-479b-9f09-fe708e04e6d4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:34.835125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc731e6b-cadd-4ca2-a72e-a4c8e4a5d1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:34.839269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc731e6b-cadd-4ca2-a72e-a4c8e4a5d1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:34.839587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc731e6b-cadd-4ca2-a72e-a4c8e4a5d1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:34.839754 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1080/2185] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:34.846054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc731e6b-cadd-4ca2-a72e-a4c8e4a5d1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:34.846054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc731e6b-cadd-4ca2-a72e-a4c8e4a5d1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:34.846444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9b65c-463b-45c3-a4a0-0982e9b33c92 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:34.848146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc731e6b-cadd-4ca2-a72e-a4c8e4a5d1b2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:34.867247 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1106/2186] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:34.873808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc731e6b-cadd-4ca2-a72e-a4c8e4a5d1b2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:34.883248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9b65c-463b-45c3-a4a0-0982e9b33c92 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:34.885613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc731e6b-cadd-4ca2-a72e-a4c8e4a5d1b2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:34.891381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44d5b4-9185-4a9b-b052-70c6b2336c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:34.892822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d5b4-9185-4a9b-b052-70c6b2336c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:34.893105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d5b4-9185-4a9b-b052-70c6b2336c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:34.893943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d5b4-9185-4a9b-b052-70c6b2336c55 admin admin] PATH_INFO: `/v3/projects/9698589ac2984c589f2a357cf753b3f1/users/5491012f862d41a787f1a84aeecb8b28/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:34.909707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a8118-92a7-4660-bec0-7a285a7fd682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:34.909707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8118-92a7-4660-bec0-7a285a7fd682 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:34.909707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8118-92a7-4660-bec0-7a285a7fd682 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:34.909707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8118-92a7-4660-bec0-7a285a7fd682 admin admin] PATH_INFO: `/v3/projects/1ad64f4c133b4363a643fd08ec2a32a8/users/169f20cc176045be974f39056fc1000a/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:34.952153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a8118-92a7-4660-bec0-7a285a7fd682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad64f4c133b4363a643fd08ec2a32a8, user_id=169f20cc176045be974f39056fc1000a, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:34.959018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a8118-92a7-4660-bec0-7a285a7fd682 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:34.963303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44d5b4-9185-4a9b-b052-70c6b2336c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9698589ac2984c589f2a357cf753b3f1, user_id=5491012f862d41a787f1a84aeecb8b28, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:34.991986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44d5b4-9185-4a9b-b052-70c6b2336c55 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:35.048314 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1081/2187] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:34 2022] PUT /identity/v3/projects/1ad64f4c133b4363a643fd08ec2a32a8/users/169f20cc176045be974f39056fc1000a/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:39:35.059384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05343b-acb4-4c75-8a70-078880676e85 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:35.059859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05343b-acb4-4c75-8a70-078880676e85 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:35.060313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05343b-acb4-4c75-8a70-078880676e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:35.084203 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1107/2188] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:34 2022] PUT /identity/v3/projects/9698589ac2984c589f2a357cf753b3f1/users/5491012f862d41a787f1a84aeecb8b28/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:35.097095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d7cf7-6aa0-4b88-808e-3a0d3ac6788e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:35.101358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d7cf7-6aa0-4b88-808e-3a0d3ac6788e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:35.101358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d7cf7-6aa0-4b88-808e-3a0d3ac6788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:35.124118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1a05343b-acb4-4c75-8a70-078880676e85 None None] MFA Rules not processed for user `169f20cc176045be974f39056fc1000a`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:35.126359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1a05343b-acb4-4c75-8a70-078880676e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:35.179802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-fa0d7cf7-6aa0-4b88-808e-3a0d3ac6788e None None] MFA Rules not processed for user `5491012f862d41a787f1a84aeecb8b28`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:35.185173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:35.187336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fa0d7cf7-6aa0-4b88-808e-3a0d3ac6788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:35.300544 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1082/2189] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:39:35.301580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05343b-acb4-4c75-8a70-078880676e85 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:35.357272 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1108/2190] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:39:35.363722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d7cf7-6aa0-4b88-808e-3a0d3ac6788e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:35.456089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05343b-acb4-4c75-8a70-078880676e85 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:35.463193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf77df9-5931-443c-ac10-153d9e96c1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:35.464146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf77df9-5931-443c-ac10-153d9e96c1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:35.464514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf77df9-5931-443c-ac10-153d9e96c1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:35.464797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf77df9-5931-443c-ac10-153d9e96c1e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:35.465453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf77df9-5931-443c-ac10-153d9e96c1e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:35.467798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf77df9-5931-443c-ac10-153d9e96c1e1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:35.495721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d7cf7-6aa0-4b88-808e-3a0d3ac6788e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:35.503248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dad57-1cf2-4952-abf0-dfa70ee81e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:35.503891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dad57-1cf2-4952-abf0-dfa70ee81e6c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:35.504287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dad57-1cf2-4952-abf0-dfa70ee81e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:35.504567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dad57-1cf2-4952-abf0-dfa70ee81e6c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:35.505217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939dad57-1cf2-4952-abf0-dfa70ee81e6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:35.507207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939dad57-1cf2-4952-abf0-dfa70ee81e6c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:35.592590 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1083/2191] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:35 2022] POST /identity/v3/projects => generated 383 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:35.594082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf77df9-5931-443c-ac10-153d9e96c1e1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:35.604353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:35.663842 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1109/2192] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:35 2022] POST /identity/v3/projects => generated 375 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:35.664860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dad57-1cf2-4952-abf0-dfa70ee81e6c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:35.696672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:35.711344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf77df9-5931-443c-ac10-153d9e96c1e1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:35.807623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dad57-1cf2-4952-abf0-dfa70ee81e6c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:35.818044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe67be9-8796-4461-8759-5e07f1216255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:35.818697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe67be9-8796-4461-8759-5e07f1216255 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:35.818977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe67be9-8796-4461-8759-5e07f1216255 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:35.819252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe67be9-8796-4461-8759-5e07f1216255 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:35.819904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe67be9-8796-4461-8759-5e07f1216255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:35.825693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe67be9-8796-4461-8759-5e07f1216255 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:35.863824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291965af-78a8-482a-aab8-5f886aa87cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:35.865139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291965af-78a8-482a-aab8-5f886aa87cff admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:35.865625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291965af-78a8-482a-aab8-5f886aa87cff admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:35.866042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291965af-78a8-482a-aab8-5f886aa87cff admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:35.867087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291965af-78a8-482a-aab8-5f886aa87cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:35.869657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291965af-78a8-482a-aab8-5f886aa87cff admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:35.957399 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1110/2193] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:35 2022] POST /identity/v3/users => generated 294 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:35.961660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe67be9-8796-4461-8759-5e07f1216255 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:35.988122 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1084/2194] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:35 2022] POST /identity/v3/users => generated 298 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:35.992045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291965af-78a8-482a-aab8-5f886aa87cff admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:35.998579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe67be9-8796-4461-8759-5e07f1216255 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:36.010361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02bdbd-4eac-4bd0-bcd7-912728af9584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:36.010900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02bdbd-4eac-4bd0-bcd7-912728af9584 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:36.011193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02bdbd-4eac-4bd0-bcd7-912728af9584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:36.011451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02bdbd-4eac-4bd0-bcd7-912728af9584 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:36.012105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02bdbd-4eac-4bd0-bcd7-912728af9584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:36.015276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02bdbd-4eac-4bd0-bcd7-912728af9584 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:36.017707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291965af-78a8-482a-aab8-5f886aa87cff admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:36.042350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8326b37-7912-4b77-9746-c9a7489a6239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:36.042978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8326b37-7912-4b77-9746-c9a7489a6239 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:36.043260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8326b37-7912-4b77-9746-c9a7489a6239 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:36.043586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8326b37-7912-4b77-9746-c9a7489a6239 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:36.044849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8326b37-7912-4b77-9746-c9a7489a6239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:36.047751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8326b37-7912-4b77-9746-c9a7489a6239 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:36.052318 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1111/2195] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:39:36.056812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02bdbd-4eac-4bd0-bcd7-912728af9584 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:36.074327 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1085/2196] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:36.075511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8326b37-7912-4b77-9746-c9a7489a6239 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:36.087034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02bdbd-4eac-4bd0-bcd7-912728af9584 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:36.095495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d99050-14cd-4055-87f5-83825d3e9930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:36.097202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d99050-14cd-4055-87f5-83825d3e9930 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:36.097829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d99050-14cd-4055-87f5-83825d3e9930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:36.098333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d99050-14cd-4055-87f5-83825d3e9930 admin admin] PATH_INFO: `/v3/projects/a009574aaba144b7912f5dbc5173dc42/users/7c00083f8691424e813cccbe2ba1bd71/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:36.099670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8326b37-7912-4b77-9746-c9a7489a6239 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:36.120697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5a482-637b-4636-b843-26dac19f6773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:36.123241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:36.138407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5a482-637b-4636-b843-26dac19f6773 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:36.138879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5a482-637b-4636-b843-26dac19f6773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:36.139167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5a482-637b-4636-b843-26dac19f6773 admin admin] PATH_INFO: `/v3/projects/65ab61c8de834429b2a40c1986e9ee1d/users/b1882c85ecab421383a830231fbae5eb/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:36.151351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:36.166514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d99050-14cd-4055-87f5-83825d3e9930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a009574aaba144b7912f5dbc5173dc42, user_id=7c00083f8691424e813cccbe2ba1bd71, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:36.170433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d99050-14cd-4055-87f5-83825d3e9930 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:36.181868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5a482-637b-4636-b843-26dac19f6773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ab61c8de834429b2a40c1986e9ee1d, user_id=b1882c85ecab421383a830231fbae5eb, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:36.185264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5a482-637b-4636-b843-26dac19f6773 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:36.279493 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1112/2197] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:36 2022] PUT /identity/v3/projects/a009574aaba144b7912f5dbc5173dc42/users/7c00083f8691424e813cccbe2ba1bd71/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:36.280882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39e377-4876-44f0-9c46-958cb78721fb None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:36.282168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39e377-4876-44f0-9c46-958cb78721fb None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:36.282463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39e377-4876-44f0-9c46-958cb78721fb None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:36.283946 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1113/2198] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:36.285520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090ac7-44b6-4f45-ab00-d2d0675b9df6 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:36.285799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090ac7-44b6-4f45-ab00-d2d0675b9df6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:36.286072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090ac7-44b6-4f45-ab00-d2d0675b9df6 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:36.298159 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1114/2199] 10.222.0.76 () {54 vars in 921 bytes} [Sat Aug 27 04:39:36 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:36.299087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4090ac7-44b6-4f45-ab00-d2d0675b9df6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:36.321335 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1086/2200] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:36 2022] PUT /identity/v3/projects/65ab61c8de834429b2a40c1986e9ee1d/users/b1882c85ecab421383a830231fbae5eb/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:39:36.323732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a486e-a8a6-4b54-b0e4-1abeddb99213 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:36.323996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a486e-a8a6-4b54-b0e4-1abeddb99213 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:36.325790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a486e-a8a6-4b54-b0e4-1abeddb99213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:36.343214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-b69a486e-a8a6-4b54-b0e4-1abeddb99213 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:39:36.343214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:39:36.343214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:39:36.343214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:39:36.343214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:39:36.343214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:39:36.343214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:39:36.343214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:39:36.343214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:39:36.343214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:39:36.343214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:39:36.343214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:39:36.343214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:39:36.344050 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:39:36.344050 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:39:36.344050 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:39:36.344050 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:39:36.344050 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:39:36.344050 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:39:36.344050 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:39:36.344050 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:39:36.344050 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:39:36.344050 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:39:36.344050 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:39:36.344050 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:39:36.344050 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:39:36.344050 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:39:36.344050 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:39:36.357328 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1087/2201] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:39:36 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 34 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:39:36.367968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ccfdf-a650-4151-adcf-d8174b6581e9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:36.367968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ccfdf-a650-4151-adcf-d8174b6581e9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:36.367968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ccfdf-a650-4151-adcf-d8174b6581e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:36.426159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ef6ccfdf-a650-4151-adcf-d8174b6581e9 None None] MFA Rules not processed for user `702086569a63418685711c4c134b1482`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:36.426159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ef6ccfdf-a650-4151-adcf-d8174b6581e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:36.470519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4090ac7-44b6-4f45-ab00-d2d0675b9df6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:36.484447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9aa7c-ace1-4c6c-9937-6b1824cd166a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:36.485072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9aa7c-ace1-4c6c-9937-6b1824cd166a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:36.485353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9aa7c-ace1-4c6c-9937-6b1824cd166a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:36.485622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9aa7c-ace1-4c6c-9937-6b1824cd166a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:36.486270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9aa7c-ace1-4c6c-9937-6b1824cd166a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:36.488526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9aa7c-ace1-4c6c-9937-6b1824cd166a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:36.519616 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1115/2202] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:36.519616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9aa7c-ace1-4c6c-9937-6b1824cd166a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:36.544228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9aa7c-ace1-4c6c-9937-6b1824cd166a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:36.552291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12648f-8bf9-4b9e-be81-dbfcdce5b99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:36.554071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12648f-8bf9-4b9e-be81-dbfcdce5b99d admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:36.554341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12648f-8bf9-4b9e-be81-dbfcdce5b99d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:36.554687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12648f-8bf9-4b9e-be81-dbfcdce5b99d admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:36.555888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12648f-8bf9-4b9e-be81-dbfcdce5b99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:36.563749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12648f-8bf9-4b9e-be81-dbfcdce5b99d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:36.593003 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1116/2203] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:36.593003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12648f-8bf9-4b9e-be81-dbfcdce5b99d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:36.598425 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1088/2204] 10.222.0.76 () {58 vars in 1018 bytes} [Sat Aug 27 04:39:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:36.600468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ccfdf-a650-4151-adcf-d8174b6581e9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:36.611048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12648f-8bf9-4b9e-be81-dbfcdce5b99d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:36.613497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ccfdf-a650-4151-adcf-d8174b6581e9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:36.618437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809c497-655b-4dd3-9f06-c85d4537f270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:36.621841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1724da-9ce4-4bb2-a709-409d369e5ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:36.622063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809c497-655b-4dd3-9f06-c85d4537f270 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:36.622351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1724da-9ce4-4bb2-a709-409d369e5ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:36.622440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809c497-655b-4dd3-9f06-c85d4537f270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:36.622514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1724da-9ce4-4bb2-a709-409d369e5ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:36.622584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809c497-655b-4dd3-9f06-c85d4537f270 admin admin] PATH_INFO: `/v3/projects/65ab61c8de834429b2a40c1986e9ee1d/users/b1882c85ecab421383a830231fbae5eb/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:36.622655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1724da-9ce4-4bb2-a709-409d369e5ae2 admin admin] PATH_INFO: `/v3/projects/a009574aaba144b7912f5dbc5173dc42/users/7c00083f8691424e813cccbe2ba1bd71/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:36.622725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809c497-655b-4dd3-9f06-c85d4537f270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ab61c8de834429b2a40c1986e9ee1d, user_id=b1882c85ecab421383a830231fbae5eb, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:36.622804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1724da-9ce4-4bb2-a709-409d369e5ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a009574aaba144b7912f5dbc5173dc42, user_id=7c00083f8691424e813cccbe2ba1bd71, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:36.625396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809c497-655b-4dd3-9f06-c85d4537f270 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:36.625769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1724da-9ce4-4bb2-a709-409d369e5ae2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:36.648277 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1089/2205] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:36 2022] PUT /identity/v3/projects/65ab61c8de834429b2a40c1986e9ee1d/users/b1882c85ecab421383a830231fbae5eb/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:36.649399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809c497-655b-4dd3-9f06-c85d4537f270 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:36.651723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4809c497-655b-4dd3-9f06-c85d4537f270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:36.664928 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1117/2206] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:36 2022] PUT /identity/v3/projects/a009574aaba144b7912f5dbc5173dc42/users/7c00083f8691424e813cccbe2ba1bd71/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:36.676475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d43f72-e874-4089-a0d8-0dcb741df4b8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:36.677085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d43f72-e874-4089-a0d8-0dcb741df4b8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:36.677613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d43f72-e874-4089-a0d8-0dcb741df4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:36.728583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-73d43f72-e874-4089-a0d8-0dcb741df4b8 None None] MFA Rules not processed for user `b1882c85ecab421383a830231fbae5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:36.730409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-73d43f72-e874-4089-a0d8-0dcb741df4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:36.780798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809c497-655b-4dd3-9f06-c85d4537f270 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:36.854575 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1118/2207] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:36.856416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e12d1-7ab7-4d7a-ac1e-3285bc0b5fae None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:36.856910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e12d1-7ab7-4d7a-ac1e-3285bc0b5fae None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:36.857425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e12d1-7ab7-4d7a-ac1e-3285bc0b5fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:36.936788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0b5e12d1-7ab7-4d7a-ac1e-3285bc0b5fae None None] MFA Rules not processed for user `7c00083f8691424e813cccbe2ba1bd71`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:36.938247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0b5e12d1-7ab7-4d7a-ac1e-3285bc0b5fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:36.941683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e1f50-bbcc-4863-911a-d7b7fac22310 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:36.943035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e1f50-bbcc-4863-911a-d7b7fac22310 service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:36.943493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e1f50-bbcc-4863-911a-d7b7fac22310 service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:36.943939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e1f50-bbcc-4863-911a-d7b7fac22310 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:36.950842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:36.962307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e1f50-bbcc-4863-911a-d7b7fac22310 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:36.964114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e1f50-bbcc-4863-911a-d7b7fac22310 service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:36.980877 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1090/2208] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:36.982012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e1f50-bbcc-4863-911a-d7b7fac22310 service placement] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:36.983653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-694e1f50-bbcc-4863-911a-d7b7fac22310 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:37.063102 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1119/2209] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:37.071382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e12d1-7ab7-4d7a-ac1e-3285bc0b5fae None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:37.089003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e12d1-7ab7-4d7a-ac1e-3285bc0b5fae None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:37.096062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e863b-5b4c-4d3f-9236-283840decb74 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:37.096943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e863b-5b4c-4d3f-9236-283840decb74 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:37.097263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e863b-5b4c-4d3f-9236-283840decb74 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:37.097537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e863b-5b4c-4d3f-9236-283840decb74 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:37.098195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e863b-5b4c-4d3f-9236-283840decb74 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:37.098499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e863b-5b4c-4d3f-9236-283840decb74 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:37.100448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e863b-5b4c-4d3f-9236-283840decb74 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:37.108682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e1f50-bbcc-4863-911a-d7b7fac22310 service placement] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:37.117865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3b961-07c0-4cb5-bb8e-b68396947047 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:37.119713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b961-07c0-4cb5-bb8e-b68396947047 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:37.120102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b961-07c0-4cb5-bb8e-b68396947047 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:37.120553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b961-07c0-4cb5-bb8e-b68396947047 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:37.121851 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1120/2210] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:39:37.123788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e863b-5b4c-4d3f-9236-283840decb74 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:37.136911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e863b-5b4c-4d3f-9236-283840decb74 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:37.142532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba982a-68d9-4119-bb42-5c62318f9b25 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:37.143155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba982a-68d9-4119-bb42-5c62318f9b25 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:37.143476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba982a-68d9-4119-bb42-5c62318f9b25 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:37.144011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba982a-68d9-4119-bb42-5c62318f9b25 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:37.145803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba982a-68d9-4119-bb42-5c62318f9b25 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:37.147763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba982a-68d9-4119-bb42-5c62318f9b25 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:37.216331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3b961-07c0-4cb5-bb8e-b68396947047 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:37.218065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3b961-07c0-4cb5-bb8e-b68396947047 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:37.229075 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1091/2211] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:37.239340 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1121/2212] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:37 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:37.243231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3b961-07c0-4cb5-bb8e-b68396947047 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:37.259793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba982a-68d9-4119-bb42-5c62318f9b25 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:37.273114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3b961-07c0-4cb5-bb8e-b68396947047 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:37.411905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d6d51-e80d-4cdd-88a7-60ac181a3d28 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:37.412861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d6d51-e80d-4cdd-88a7-60ac181a3d28 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:37.413554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d6d51-e80d-4cdd-88a7-60ac181a3d28 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:37.414409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d6d51-e80d-4cdd-88a7-60ac181a3d28 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:37.420387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d6d51-e80d-4cdd-88a7-60ac181a3d28 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:37.420957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d6d51-e80d-4cdd-88a7-60ac181a3d28 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:37.422859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d6d51-e80d-4cdd-88a7-60ac181a3d28 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:37.434707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba982a-68d9-4119-bb42-5c62318f9b25 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:37.445303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76034344-8e1a-4a37-bc7c-41f271886f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:37.446162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76034344-8e1a-4a37-bc7c-41f271886f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:37.446434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76034344-8e1a-4a37-bc7c-41f271886f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:37.446904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76034344-8e1a-4a37-bc7c-41f271886f02 admin admin] PATH_INFO: `/v3/users/169f20cc176045be974f39056fc1000a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:37.448446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76034344-8e1a-4a37-bc7c-41f271886f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=169f20cc176045be974f39056fc1000a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:37.451030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76034344-8e1a-4a37-bc7c-41f271886f02 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:37.453991 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1092/2213] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:37.458693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:37.647960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-76034344-8e1a-4a37-bc7c-41f271886f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169f20cc176045be974f39056fc1000a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:37.649337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-76034344-8e1a-4a37-bc7c-41f271886f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169f20cc176045be974f39056fc1000a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:37.693495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-76034344-8e1a-4a37-bc7c-41f271886f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169f20cc176045be974f39056fc1000a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:37.694266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-76034344-8e1a-4a37-bc7c-41f271886f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169f20cc176045be974f39056fc1000a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:37.713265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-76034344-8e1a-4a37-bc7c-41f271886f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169f20cc176045be974f39056fc1000a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:37.732860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f325a-9607-490b-b3dd-dfd2295dde2b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:37.733058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f325a-9607-490b-b3dd-dfd2295dde2b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:37.733272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f325a-9607-490b-b3dd-dfd2295dde2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:37.737745 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1122/2214] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:37 2022] DELETE /identity/v3/users/169f20cc176045be974f39056fc1000a => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:37.756434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3b4f325a-9607-490b-b3dd-dfd2295dde2b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:37.757868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3b4f325a-9607-490b-b3dd-dfd2295dde2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:37.850920 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1093/2215] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:37.861694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76034344-8e1a-4a37-bc7c-41f271886f02 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:37.864325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-76034344-8e1a-4a37-bc7c-41f271886f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:37.946144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76034344-8e1a-4a37-bc7c-41f271886f02 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:37.965196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c48b51-1729-412f-9c02-a9b62eadb544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:37.965847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c48b51-1729-412f-9c02-a9b62eadb544 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:37.966134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c48b51-1729-412f-9c02-a9b62eadb544 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:37.966409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c48b51-1729-412f-9c02-a9b62eadb544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:37.979932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c48b51-1729-412f-9c02-a9b62eadb544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:37.981265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c48b51-1729-412f-9c02-a9b62eadb544 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:37.992818 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1123/2216] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:38.225580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:38.264156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:38.327232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f325a-9607-490b-b3dd-dfd2295dde2b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:38.330131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3b4f325a-9607-490b-b3dd-dfd2295dde2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:38.483190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f325a-9607-490b-b3dd-dfd2295dde2b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:38.536217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd5fc5-ef40-432c-96ad-6697681d8255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:38.536217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd5fc5-ef40-432c-96ad-6697681d8255 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:38.536217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd5fc5-ef40-432c-96ad-6697681d8255 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:38.540677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd5fc5-ef40-432c-96ad-6697681d8255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:38.550590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-24bd5fc5-ef40-432c-96ad-6697681d8255 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:38.681578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd5fc5-ef40-432c-96ad-6697681d8255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:38.686106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd5fc5-ef40-432c-96ad-6697681d8255 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:38.717415 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1094/2217] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:38.751497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72023d-fbe9-4c9d-b6dc-e84e70491fd3 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:38.752641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72023d-fbe9-4c9d-b6dc-e84e70491fd3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:38.753702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72023d-fbe9-4c9d-b6dc-e84e70491fd3 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:38.755876 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1124/2218] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:39:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:38.762402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd5fc5-ef40-432c-96ad-6697681d8255 service nova] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:39:38.782286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd5fc5-ef40-432c-96ad-6697681d8255 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:38.804556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd5fc5-ef40-432c-96ad-6697681d8255 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:38.825472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5d7e2-5986-4a9b-9b2a-218f188ba2f2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:38.827150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5d7e2-5986-4a9b-9b2a-218f188ba2f2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:38.827437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5d7e2-5986-4a9b-9b2a-218f188ba2f2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:38.827712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5d7e2-5986-4a9b-9b2a-218f188ba2f2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/projects/242a8de126934decbbd797e4da7ce5fa` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:38.831535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5d7e2-5986-4a9b-9b2a-218f188ba2f2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:get_project(project_id=242a8de126934decbbd797e4da7ce5fa)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:38.833835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5d7e2-5986-4a9b-9b2a-218f188ba2f2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:38.843204 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1095/2219] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:39:38 2022] GET /identity/v3/projects/242a8de126934decbbd797e4da7ce5fa => generated 371 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:38.959012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbd5ba-d1fb-4f4e-9a59-66d6f8936c91 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:38.959297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbd5ba-d1fb-4f4e-9a59-66d6f8936c91 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:38.960355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbd5ba-d1fb-4f4e-9a59-66d6f8936c91 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:38.962017 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1125/2220] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:38.970502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5d7e2-5986-4a9b-9b2a-218f188ba2f2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:39:38.978924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:39.007880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5d7e2-5986-4a9b-9b2a-218f188ba2f2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:39.053825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5d7e2-5986-4a9b-9b2a-218f188ba2f2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:39.068270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d413cdc-e25b-42af-80a0-66466996b44b tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:39.068933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d413cdc-e25b-42af-80a0-66466996b44b tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:39.069213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d413cdc-e25b-42af-80a0-66466996b44b tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:39.069490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d413cdc-e25b-42af-80a0-66466996b44b tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/projects/242a8de126934decbbd797e4da7ce5fa` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:39.074335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d413cdc-e25b-42af-80a0-66466996b44b tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:get_project(project_id=242a8de126934decbbd797e4da7ce5fa)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:39.076600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d413cdc-e25b-42af-80a0-66466996b44b tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:39.080691 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1096/2221] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:39:38 2022] GET /identity/v3/projects/242a8de126934decbbd797e4da7ce5fa => generated 371 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:39.116420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:39.539605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbd5ba-d1fb-4f4e-9a59-66d6f8936c91 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:39.541704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-affbd5ba-d1fb-4f4e-9a59-66d6f8936c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:39.586513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbd5ba-d1fb-4f4e-9a59-66d6f8936c91 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:39.609868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:39.610368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:39.610903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:39.611180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f admin admin] PATH_INFO: `/v3/projects/1ad64f4c133b4363a643fd08ec2a32a8` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:39.613140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ad64f4c133b4363a643fd08ec2a32a8)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:39.615092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:39.746568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b30ae-323e-4b38-9ae3-9fdb5c7e2434 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:39.747060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b30ae-323e-4b38-9ae3-9fdb5c7e2434 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:39.747179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b30ae-323e-4b38-9ae3-9fdb5c7e2434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:39.809748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ad64f4c133b4363a643fd08ec2a32a8', 'request_id': 'req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:39.820780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b54b30ae-323e-4b38-9ae3-9fdb5c7e2434 None None] MFA Rules not processed for user `a8e0435efb844bc59166293ec9ee40d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:39.824761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b54b30ae-323e-4b38-9ae3-9fdb5c7e2434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:39.827183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ad64f4c133b4363a643fd08ec2a32a8', 'request_id': 'req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:39.904122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ad64f4c133b4363a643fd08ec2a32a8', 'request_id': 'req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:39.925208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f admin admin] The token cache is being invalidate because project 1ad64f4c133b4363a643fd08ec2a32a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:39.926308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:39.927349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:39.936735 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1126/2222] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:39 2022] DELETE /identity/v3/projects/1ad64f4c133b4363a643fd08ec2a32a8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:39.938879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:39.945720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:39.975788 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1097/2223] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:39:39.987902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd36017-0108-4a9c-af49-104a494cb0a0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:39.987902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd36017-0108-4a9c-af49-104a494cb0a0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:39.987902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd36017-0108-4a9c-af49-104a494cb0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:40.005285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:40.022485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-cfd36017-0108-4a9c-af49-104a494cb0a0 None None] MFA Rules not processed for user `a8e0435efb844bc59166293ec9ee40d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:40.024114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cfd36017-0108-4a9c-af49-104a494cb0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:40.032813 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1098/2224] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:40.122836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94515e13-3cea-4f3a-ada8-43eb67ff6e7f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:40.131683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502afa9c-4223-40ae-9b40-a222aaa682e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:40.134129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502afa9c-4223-40ae-9b40-a222aaa682e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:40.134599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502afa9c-4223-40ae-9b40-a222aaa682e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:40.135040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502afa9c-4223-40ae-9b40-a222aaa682e0 admin admin] PATH_INFO: `/v3/users/b1882c85ecab421383a830231fbae5eb` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:40.137119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502afa9c-4223-40ae-9b40-a222aaa682e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1882c85ecab421383a830231fbae5eb)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:40.141556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502afa9c-4223-40ae-9b40-a222aaa682e0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:40.149060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd36017-0108-4a9c-af49-104a494cb0a0 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:40.150733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cfd36017-0108-4a9c-af49-104a494cb0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:40.183850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd36017-0108-4a9c-af49-104a494cb0a0 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:40.202080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249de8b5-25a5-49b9-ab30-41aa842a90fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:40.204324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249de8b5-25a5-49b9-ab30-41aa842a90fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:40.204861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249de8b5-25a5-49b9-ab30-41aa842a90fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:40.207707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249de8b5-25a5-49b9-ab30-41aa842a90fc admin admin] PATH_INFO: `/v3/users/fda979b06e7b4ef3b929a7e0d38159eb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:40.211895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249de8b5-25a5-49b9-ab30-41aa842a90fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda979b06e7b4ef3b929a7e0d38159eb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:40.220248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249de8b5-25a5-49b9-ab30-41aa842a90fc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:40.239706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:40.414875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-502afa9c-4223-40ae-9b40-a222aaa682e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1882c85ecab421383a830231fbae5eb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:40.416152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-502afa9c-4223-40ae-9b40-a222aaa682e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1882c85ecab421383a830231fbae5eb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:40.421029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-249de8b5-25a5-49b9-ab30-41aa842a90fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda979b06e7b4ef3b929a7e0d38159eb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:40.501733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-502afa9c-4223-40ae-9b40-a222aaa682e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1882c85ecab421383a830231fbae5eb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:40.502404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-502afa9c-4223-40ae-9b40-a222aaa682e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1882c85ecab421383a830231fbae5eb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:40.537415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-502afa9c-4223-40ae-9b40-a222aaa682e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1882c85ecab421383a830231fbae5eb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:40.577883 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1127/2225] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:39 2022] DELETE /identity/v3/users/b1882c85ecab421383a830231fbae5eb => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:40.582489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf27331-8840-45b6-aa3b-89719758fcbe None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:40.582657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf27331-8840-45b6-aa3b-89719758fcbe None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:40.583075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf27331-8840-45b6-aa3b-89719758fcbe None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:40.586270 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1128/2226] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:39:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:40.588406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf27331-8840-45b6-aa3b-89719758fcbe None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:40.591330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-249de8b5-25a5-49b9-ab30-41aa842a90fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda979b06e7b4ef3b929a7e0d38159eb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:40.591852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9bf27331-8840-45b6-aa3b-89719758fcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:40.592299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-249de8b5-25a5-49b9-ab30-41aa842a90fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda979b06e7b4ef3b929a7e0d38159eb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:40.616935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-249de8b5-25a5-49b9-ab30-41aa842a90fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda979b06e7b4ef3b929a7e0d38159eb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:40.657834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-249de8b5-25a5-49b9-ab30-41aa842a90fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda979b06e7b4ef3b929a7e0d38159eb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:40.682269 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1099/2227] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:40 2022] DELETE /identity/v3/users/fda979b06e7b4ef3b929a7e0d38159eb => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:40.689834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249de8b5-25a5-49b9-ab30-41aa842a90fc admin admin] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:39:40.698797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-249de8b5-25a5-49b9-ab30-41aa842a90fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:40.785403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf27331-8840-45b6-aa3b-89719758fcbe None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:40.890406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249de8b5-25a5-49b9-ab30-41aa842a90fc admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:40.897720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-249de8b5-25a5-49b9-ab30-41aa842a90fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:40.906432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:40.940462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a29702-744d-4f38-a7a2-8a6ba33bd0ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:40.943391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a29702-744d-4f38-a7a2-8a6ba33bd0ca service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:40.944080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a29702-744d-4f38-a7a2-8a6ba33bd0ca service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:40.946605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a29702-744d-4f38-a7a2-8a6ba33bd0ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:40.950482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a9a29702-744d-4f38-a7a2-8a6ba33bd0ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:40.978637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:41.054363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249de8b5-25a5-49b9-ab30-41aa842a90fc admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:41.063863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ba99a-bc66-496b-8a09-69d4e49d8a27 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:41.064679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ba99a-bc66-496b-8a09-69d4e49d8a27 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:41.064847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ba99a-bc66-496b-8a09-69d4e49d8a27 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:41.065181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ba99a-bc66-496b-8a09-69d4e49d8a27 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/projects/242a8de126934decbbd797e4da7ce5fa` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:41.066845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ba99a-bc66-496b-8a09-69d4e49d8a27 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:get_project(project_id=242a8de126934decbbd797e4da7ce5fa)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:41.083824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ba99a-bc66-496b-8a09-69d4e49d8a27 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:41.110318 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1100/2228] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:39:40 2022] GET /identity/v3/projects/242a8de126934decbbd797e4da7ce5fa => generated 371 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:41.117251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804fc9-0235-4d8c-8d47-53be9f34f73c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:41.118107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804fc9-0235-4d8c-8d47-53be9f34f73c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:41.118540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804fc9-0235-4d8c-8d47-53be9f34f73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:41.178916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:41.179351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-84804fc9-0235-4d8c-8d47-53be9f34f73c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:41.181199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-84804fc9-0235-4d8c-8d47-53be9f34f73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:41.213004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a29702-744d-4f38-a7a2-8a6ba33bd0ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:41.215453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a29702-744d-4f38-a7a2-8a6ba33bd0ca service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:41.241147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:41.259121 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1129/2229] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:41.260404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a29702-744d-4f38-a7a2-8a6ba33bd0ca service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:41.301108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a29702-744d-4f38-a7a2-8a6ba33bd0ca service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:41.312881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b928e86-d8b1-4c66-9f38-4a27da1ea96d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:41.314688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b928e86-d8b1-4c66-9f38-4a27da1ea96d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:41.315909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b928e86-d8b1-4c66-9f38-4a27da1ea96d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:41.316394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b928e86-d8b1-4c66-9f38-4a27da1ea96d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/projects/242a8de126934decbbd797e4da7ce5fa` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:41.318843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b928e86-d8b1-4c66-9f38-4a27da1ea96d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:delete_project(project_id=242a8de126934decbbd797e4da7ce5fa)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:41.327032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b928e86-d8b1-4c66-9f38-4a27da1ea96d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:41.376455 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1101/2230] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:41.522212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:41.570197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84804fc9-0235-4d8c-8d47-53be9f34f73c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:41.572437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-84804fc9-0235-4d8c-8d47-53be9f34f73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:41.589622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0b928e86-d8b1-4c66-9f38-4a27da1ea96d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '242a8de126934decbbd797e4da7ce5fa', 'request_id': 'req-0b928e86-d8b1-4c66-9f38-4a27da1ea96d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:41.614703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0b928e86-d8b1-4c66-9f38-4a27da1ea96d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '242a8de126934decbbd797e4da7ce5fa', 'request_id': 'req-0b928e86-d8b1-4c66-9f38-4a27da1ea96d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:41.727040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84804fc9-0235-4d8c-8d47-53be9f34f73c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:41.733749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0b928e86-d8b1-4c66-9f38-4a27da1ea96d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '242a8de126934decbbd797e4da7ce5fa', 'request_id': 'req-0b928e86-d8b1-4c66-9f38-4a27da1ea96d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:41.756334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0b928e86-d8b1-4c66-9f38-4a27da1ea96d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] The token cache is being invalidate because project 242a8de126934decbbd797e4da7ce5fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:41.756630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0b928e86-d8b1-4c66-9f38-4a27da1ea96d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:41.760429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0b928e86-d8b1-4c66-9f38-4a27da1ea96d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:41.763967 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1130/2231] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:41 2022] DELETE /identity/v3/projects/242a8de126934decbbd797e4da7ce5fa => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:41.859138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dece08a-9ca9-4974-b3c5-6ebc2131f542 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:41.859413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dece08a-9ca9-4974-b3c5-6ebc2131f542 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:41.859853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dece08a-9ca9-4974-b3c5-6ebc2131f542 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:41.861738 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1131/2232] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:39:41.865241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b8f53-f515-42c6-9af7-397414552429 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:41.865704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b8f53-f515-42c6-9af7-397414552429 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:41.866165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b8f53-f515-42c6-9af7-397414552429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:41.896288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590148de-2487-4a35-8429-16112c2caa86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:41.897024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590148de-2487-4a35-8429-16112c2caa86 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:41.897171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590148de-2487-4a35-8429-16112c2caa86 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:41.897445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590148de-2487-4a35-8429-16112c2caa86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:41.904589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-590148de-2487-4a35-8429-16112c2caa86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:41.905155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-6d9b8f53-f515-42c6-9af7-397414552429 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:39:41.905155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:39:41.905155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:39:41.905155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:39:41.905155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:39:41.905155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:39:41.905155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:39:41.905155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:39:41.905155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:39:41.905155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:39:41.905155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:39:41.905155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:39:41.905155 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:39:41.906104 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:39:41.906104 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:39:41.906104 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:39:41.906104 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:39:41.906104 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:39:41.906104 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:39:41.906104 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:39:41.906104 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:39:41.906104 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:39:41.906104 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:39:41.906104 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:39:41.906104 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:39:41.906104 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:39:41.906104 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:39:41.906104 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:39:41.927986 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1132/2233] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:39:41 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 56 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:39:41.927986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b8f53-f515-42c6-9af7-397414552429 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:41.940183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6d9b8f53-f515-42c6-9af7-397414552429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:42.113418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590148de-2487-4a35-8429-16112c2caa86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:42.119910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590148de-2487-4a35-8429-16112c2caa86 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:42.150658 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1102/2234] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:39:42.151792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590148de-2487-4a35-8429-16112c2caa86 service neutron] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:39:42.155959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-590148de-2487-4a35-8429-16112c2caa86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:42.178049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b8f53-f515-42c6-9af7-397414552429 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:42.192719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82dabf-2547-4015-bfa7-8d8f3807172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:42.193771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82dabf-2547-4015-bfa7-8d8f3807172d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:42.194197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82dabf-2547-4015-bfa7-8d8f3807172d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:42.194603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82dabf-2547-4015-bfa7-8d8f3807172d admin admin] PATH_INFO: `/v3/projects/65ab61c8de834429b2a40c1986e9ee1d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:42.196727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82dabf-2547-4015-bfa7-8d8f3807172d admin admin] RBAC: Authorizing `identity:delete_project(project_id=65ab61c8de834429b2a40c1986e9ee1d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:42.204302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82dabf-2547-4015-bfa7-8d8f3807172d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:42.355874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:42.370386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590148de-2487-4a35-8429-16112c2caa86 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:42.374059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-590148de-2487-4a35-8429-16112c2caa86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:42.421084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8a82dabf-2547-4015-bfa7-8d8f3807172d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ab61c8de834429b2a40c1986e9ee1d', 'request_id': 'req-8a82dabf-2547-4015-bfa7-8d8f3807172d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:42.431076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8a82dabf-2547-4015-bfa7-8d8f3807172d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ab61c8de834429b2a40c1986e9ee1d', 'request_id': 'req-8a82dabf-2547-4015-bfa7-8d8f3807172d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:42.498307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8a82dabf-2547-4015-bfa7-8d8f3807172d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ab61c8de834429b2a40c1986e9ee1d', 'request_id': 'req-8a82dabf-2547-4015-bfa7-8d8f3807172d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:42.515780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8a82dabf-2547-4015-bfa7-8d8f3807172d admin admin] The token cache is being invalidate because project 65ab61c8de834429b2a40c1986e9ee1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:42.516366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8a82dabf-2547-4015-bfa7-8d8f3807172d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:42.519329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8a82dabf-2547-4015-bfa7-8d8f3807172d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:42.522061 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1133/2235] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:41 2022] DELETE /identity/v3/projects/65ab61c8de834429b2a40c1986e9ee1d => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:42.527995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a37b-6d00-4e14-aeae-f7a64a28219b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:42.528500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a37b-6d00-4e14-aeae-f7a64a28219b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:42.528938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a37b-6d00-4e14-aeae-f7a64a28219b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:42.536237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590148de-2487-4a35-8429-16112c2caa86 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:42.570957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c703a37b-6d00-4e14-aeae-f7a64a28219b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:42.573459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c703a37b-6d00-4e14-aeae-f7a64a28219b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:42.703386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c598de-533d-4d9c-acc9-0ead7cca1619 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:42.704511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c598de-533d-4d9c-acc9-0ead7cca1619 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:42.706500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c598de-533d-4d9c-acc9-0ead7cca1619 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:42.707104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c598de-533d-4d9c-acc9-0ead7cca1619 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/projects/9698589ac2984c589f2a357cf753b3f1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:42.708978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c598de-533d-4d9c-acc9-0ead7cca1619 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:get_project(project_id=9698589ac2984c589f2a357cf753b3f1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:42.715008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c598de-533d-4d9c-acc9-0ead7cca1619 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:42.735449 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1103/2236] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:39:42 2022] GET /identity/v3/projects/9698589ac2984c589f2a357cf753b3f1 => generated 373 bytes in 584 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:42.744732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c598de-533d-4d9c-acc9-0ead7cca1619 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:42.746994 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1134/2237] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:39:42.751793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d7c598de-533d-4d9c-acc9-0ead7cca1619 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:42.753246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528cb41-a74d-455b-8e0d-bd995ef88d34 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:42.753845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528cb41-a74d-455b-8e0d-bd995ef88d34 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:42.753984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528cb41-a74d-455b-8e0d-bd995ef88d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:42.782019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c598de-533d-4d9c-acc9-0ead7cca1619 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:42.787859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcf581-37c5-491f-ae78-0951805a9b6b tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:42.789237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcf581-37c5-491f-ae78-0951805a9b6b tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:42.790025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcf581-37c5-491f-ae78-0951805a9b6b tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:42.790499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcf581-37c5-491f-ae78-0951805a9b6b tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:42.792667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcf581-37c5-491f-ae78-0951805a9b6b tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:42.793194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcf581-37c5-491f-ae78-0951805a9b6b tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:42.797669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcf581-37c5-491f-ae78-0951805a9b6b tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:42.800109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=77,keystone:DELETE=19,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:42.803306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c528cb41-a74d-455b-8e0d-bd995ef88d34 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:42.806292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c528cb41-a74d-455b-8e0d-bd995ef88d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:42.820400 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1135/2238] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:42.823083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528cb41-a74d-455b-8e0d-bd995ef88d34 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:42.829269 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1104/2239] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:39:42.834547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcf581-37c5-491f-ae78-0951805a9b6b tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:42.836141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528cb41-a74d-455b-8e0d-bd995ef88d34 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:42.842468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a97e1e-967d-4b9e-855a-33d5e285d5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:42.846256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a97e1e-967d-4b9e-855a-33d5e285d5dd admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:42.846256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a97e1e-967d-4b9e-855a-33d5e285d5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:42.846256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a97e1e-967d-4b9e-855a-33d5e285d5dd admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:42.846256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a97e1e-967d-4b9e-855a-33d5e285d5dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:42.846256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a97e1e-967d-4b9e-855a-33d5e285d5dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:42.846797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a97e1e-967d-4b9e-855a-33d5e285d5dd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:42.855136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcf581-37c5-491f-ae78-0951805a9b6b tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:42.864421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a029968-4a5b-4cc0-bce9-7ae1b4b1f0e2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:42.865502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029968-4a5b-4cc0-bce9-7ae1b4b1f0e2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:42.876435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029968-4a5b-4cc0-bce9-7ae1b4b1f0e2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:42.879141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029968-4a5b-4cc0-bce9-7ae1b4b1f0e2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:42.879927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a029968-4a5b-4cc0-bce9-7ae1b4b1f0e2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:42.886255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a029968-4a5b-4cc0-bce9-7ae1b4b1f0e2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:42.898556 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1136/2240] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:42.902613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a97e1e-967d-4b9e-855a-33d5e285d5dd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:42.926749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a97e1e-967d-4b9e-855a-33d5e285d5dd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:42.935701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4076722-1849-45d5-abaf-febca46f5ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:42.936966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4076722-1849-45d5-abaf-febca46f5ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:42.937996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4076722-1849-45d5-abaf-febca46f5ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:42.938446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4076722-1849-45d5-abaf-febca46f5ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:42.939286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4076722-1849-45d5-abaf-febca46f5ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:42.946478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4076722-1849-45d5-abaf-febca46f5ac8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:43.088883 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1105/2241] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:42 2022] POST /identity/v3/projects => generated 371 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:43.094115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a029968-4a5b-4cc0-bce9-7ae1b4b1f0e2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:43.095454 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1137/2242] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:42 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:43.100628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4076722-1849-45d5-abaf-febca46f5ac8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:43.247885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4076722-1849-45d5-abaf-febca46f5ac8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:43.260866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240a602-f6e4-4fc1-bd9d-81159c5b0011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:43.261534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240a602-f6e4-4fc1-bd9d-81159c5b0011 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:43.261819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240a602-f6e4-4fc1-bd9d-81159c5b0011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:43.262092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240a602-f6e4-4fc1-bd9d-81159c5b0011 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:43.262780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240a602-f6e4-4fc1-bd9d-81159c5b0011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:43.264783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240a602-f6e4-4fc1-bd9d-81159c5b0011 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:43.318149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a029968-4a5b-4cc0-bce9-7ae1b4b1f0e2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:43.436673 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1138/2243] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:43 2022] POST /identity/v3/users => generated 289 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:43.438087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da4e16-dd39-4f95-a416-f15f76c5e91c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:43.438377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da4e16-dd39-4f95-a416-f15f76c5e91c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:43.442296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da4e16-dd39-4f95-a416-f15f76c5e91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:43.516857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b210e-ef1f-4c13-89d0-4f9f95c19666 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:43.517488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b210e-ef1f-4c13-89d0-4f9f95c19666 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:43.517772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b210e-ef1f-4c13-89d0-4f9f95c19666 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:43.518069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b210e-ef1f-4c13-89d0-4f9f95c19666 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:43.519153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b210e-ef1f-4c13-89d0-4f9f95c19666 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:43.519351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b210e-ef1f-4c13-89d0-4f9f95c19666 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:43.521056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b210e-ef1f-4c13-89d0-4f9f95c19666 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:43.530063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-63da4e16-dd39-4f95-a416-f15f76c5e91c None None] MFA Rules not processed for user `301b13659b4e40c4bbf4f6a822083580`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:43.532870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-63da4e16-dd39-4f95-a416-f15f76c5e91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:43.570368 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1106/2244] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:43.571084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b210e-ef1f-4c13-89d0-4f9f95c19666 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:43.617215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b210e-ef1f-4c13-89d0-4f9f95c19666 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:43.640977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d168b-086a-49d6-b0ac-c86ced6dc423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:43.641612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d168b-086a-49d6-b0ac-c86ced6dc423 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:43.642246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d168b-086a-49d6-b0ac-c86ced6dc423 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:43.642246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d168b-086a-49d6-b0ac-c86ced6dc423 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:43.642882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d168b-086a-49d6-b0ac-c86ced6dc423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:43.644994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d168b-086a-49d6-b0ac-c86ced6dc423 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:43.668907 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1107/2245] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:43.671516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a05fc-d37b-46ad-9cb5-5812a5ee088f None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:43.671832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a05fc-d37b-46ad-9cb5-5812a5ee088f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:43.673002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a05fc-d37b-46ad-9cb5-5812a5ee088f None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:43.675381 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1108/2246] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:39:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:43.676182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a05fc-d37b-46ad-9cb5-5812a5ee088f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:43.688912 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1139/2247] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:43.695273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da4e16-dd39-4f95-a416-f15f76c5e91c None None] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:39:43.697440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-63da4e16-dd39-4f95-a416-f15f76c5e91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:43.722595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a05fc-d37b-46ad-9cb5-5812a5ee088f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:43.739450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77594a-2245-4a02-8f54-c6c5530d0498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:43.740474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77594a-2245-4a02-8f54-c6c5530d0498 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:43.740761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77594a-2245-4a02-8f54-c6c5530d0498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:43.741041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77594a-2245-4a02-8f54-c6c5530d0498 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:43.741956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77594a-2245-4a02-8f54-c6c5530d0498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:43.743589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77594a-2245-4a02-8f54-c6c5530d0498 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:43.763215 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1109/2248] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:43.767578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77594a-2245-4a02-8f54-c6c5530d0498 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:43.790617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77594a-2245-4a02-8f54-c6c5530d0498 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:43.806735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62a960-d500-4140-87ce-0ef2be7fa99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:43.807672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a960-d500-4140-87ce-0ef2be7fa99f admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:43.808133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a960-d500-4140-87ce-0ef2be7fa99f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:43.808592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a960-d500-4140-87ce-0ef2be7fa99f admin admin] PATH_INFO: `/v3/projects/3260003f727e4758bd94829754848349/users/460d695601d74cdbbe5b3f6560907fa4/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:43.824686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:43.840826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62a960-d500-4140-87ce-0ef2be7fa99f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3260003f727e4758bd94829754848349, user_id=460d695601d74cdbbe5b3f6560907fa4, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:43.843819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62a960-d500-4140-87ce-0ef2be7fa99f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:43.913248 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1110/2249] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:43 2022] PUT /identity/v3/projects/3260003f727e4758bd94829754848349/users/460d695601d74cdbbe5b3f6560907fa4/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:39:43.913248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62a960-d500-4140-87ce-0ef2be7fa99f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:43.920602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da4e16-dd39-4f95-a416-f15f76c5e91c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:43.930509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-eb62a960-d500-4140-87ce-0ef2be7fa99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:43.949626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da4e16-dd39-4f95-a416-f15f76c5e91c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:44.025765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:44.122793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62a960-d500-4140-87ce-0ef2be7fa99f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:44.139301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:44.142458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:44.142749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:44.143060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c admin admin] PATH_INFO: `/v3/projects/924b11c4c75648429a304e08e7e8042d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:44.149835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c admin admin] RBAC: Authorizing `identity:delete_project(project_id=924b11c4c75648429a304e08e7e8042d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:44.152531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09f2d8-c435-486a-937e-949405bf427d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:44.154393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:44.156799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09f2d8-c435-486a-937e-949405bf427d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:44.158516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09f2d8-c435-486a-937e-949405bf427d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:44.158516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09f2d8-c435-486a-937e-949405bf427d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/projects/084538d38b524e1ab44025cea7b055f5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:44.162671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09f2d8-c435-486a-937e-949405bf427d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:get_project(project_id=084538d38b524e1ab44025cea7b055f5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:44.164824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09f2d8-c435-486a-937e-949405bf427d tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:44.166766 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1140/2250] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:39:43 2022] GET /identity/v3/projects/084538d38b524e1ab44025cea7b055f5 => generated 371 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:44.168082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9c66e-0410-4f71-bc78-5bf0108e07ac None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:44.179698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9c66e-0410-4f71-bc78-5bf0108e07ac None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:44.179984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9c66e-0410-4f71-bc78-5bf0108e07ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:44.253983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3eb9c66e-0410-4f71-bc78-5bf0108e07ac None None] MFA Rules not processed for user `460d695601d74cdbbe5b3f6560907fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:44.255343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3eb9c66e-0410-4f71-bc78-5bf0108e07ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:44.350887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924b11c4c75648429a304e08e7e8042d', 'request_id': 'req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:44.360917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924b11c4c75648429a304e08e7e8042d', 'request_id': 'req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:44.376379 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1141/2251] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:44.383880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924b11c4c75648429a304e08e7e8042d', 'request_id': 'req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:44.385528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9c66e-0410-4f71-bc78-5bf0108e07ac None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:44.403028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9c66e-0410-4f71-bc78-5bf0108e07ac None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:44.487839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fede85-01ab-4dd4-a7eb-224da10b3207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:44.489050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c admin admin] The token cache is being invalidate because project 924b11c4c75648429a304e08e7e8042d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:44.492109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fede85-01ab-4dd4-a7eb-224da10b3207 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:44.492404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:44.492499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fede85-01ab-4dd4-a7eb-224da10b3207 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:44.492499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fede85-01ab-4dd4-a7eb-224da10b3207 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:44.492633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:44.492704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fede85-01ab-4dd4-a7eb-224da10b3207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:44.496420 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1111/2252] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:43 2022] DELETE /identity/v3/projects/924b11c4c75648429a304e08e7e8042d => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:44.496714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fede85-01ab-4dd4-a7eb-224da10b3207 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:44.498347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:44.501202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:44.541562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4c3c3-dd57-49ab-b3bd-fa22de9d109c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:44.549584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77664353-e3bf-4e88-9370-f45db431ec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:44.550773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77664353-e3bf-4e88-9370-f45db431ec2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:44.551291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77664353-e3bf-4e88-9370-f45db431ec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:44.551801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77664353-e3bf-4e88-9370-f45db431ec2c admin admin] PATH_INFO: `/v3/users/acef8ffe4d8a42919e2d0d052c8c935f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:44.553527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77664353-e3bf-4e88-9370-f45db431ec2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=acef8ffe4d8a42919e2d0d052c8c935f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:44.556766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77664353-e3bf-4e88-9370-f45db431ec2c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:44.634688 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1142/2253] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:44 2022] POST /identity/v3/projects => generated 375 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:44.638988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fede85-01ab-4dd4-a7eb-224da10b3207 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:44.640960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-76fede85-01ab-4dd4-a7eb-224da10b3207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:44.722347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fede85-01ab-4dd4-a7eb-224da10b3207 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:44.728131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1590c-e965-4ffe-af5b-a0b5182bb00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:44.729498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1590c-e965-4ffe-af5b-a0b5182bb00f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:44.729782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1590c-e965-4ffe-af5b-a0b5182bb00f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:44.730061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1590c-e965-4ffe-af5b-a0b5182bb00f admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:44.731659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1590c-e965-4ffe-af5b-a0b5182bb00f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:44.733660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1590c-e965-4ffe-af5b-a0b5182bb00f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:44.751789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-77664353-e3bf-4e88-9370-f45db431ec2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acef8ffe4d8a42919e2d0d052c8c935f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:44.819965 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1143/2254] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:44 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:44.822027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63854fe8-5c4c-48d6-a47c-68862f044dac None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:44.822180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63854fe8-5c4c-48d6-a47c-68862f044dac None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:44.822769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63854fe8-5c4c-48d6-a47c-68862f044dac None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:44.824026 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1144/2255] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:44.824781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63854fe8-5c4c-48d6-a47c-68862f044dac None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:44.851095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63854fe8-5c4c-48d6-a47c-68862f044dac None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:44.859966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1caf77-c126-49b5-bddd-d58705d388cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:44.860764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1caf77-c126-49b5-bddd-d58705d388cf admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:44.861206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1caf77-c126-49b5-bddd-d58705d388cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:44.861483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1caf77-c126-49b5-bddd-d58705d388cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:44.863288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1caf77-c126-49b5-bddd-d58705d388cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:44.865331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1caf77-c126-49b5-bddd-d58705d388cf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:44.880974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-77664353-e3bf-4e88-9370-f45db431ec2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acef8ffe4d8a42919e2d0d052c8c935f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:44.881183 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1145/2256] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:44.881705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-77664353-e3bf-4e88-9370-f45db431ec2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acef8ffe4d8a42919e2d0d052c8c935f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:44.882428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1caf77-c126-49b5-bddd-d58705d388cf admin admin] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:39:44.885606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-be1caf77-c126-49b5-bddd-d58705d388cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:44.892949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-77664353-e3bf-4e88-9370-f45db431ec2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acef8ffe4d8a42919e2d0d052c8c935f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:44.921206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-77664353-e3bf-4e88-9370-f45db431ec2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acef8ffe4d8a42919e2d0d052c8c935f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:44.933626 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1112/2257] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:44 2022] DELETE /identity/v3/users/acef8ffe4d8a42919e2d0d052c8c935f => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:39:44.940558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77664353-e3bf-4e88-9370-f45db431ec2c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:44.942947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-77664353-e3bf-4e88-9370-f45db431ec2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:45.014105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:45.025026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1caf77-c126-49b5-bddd-d58705d388cf admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:45.027391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-be1caf77-c126-49b5-bddd-d58705d388cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:45.104966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77664353-e3bf-4e88-9370-f45db431ec2c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:45.115544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaad201-7a46-4487-8402-e30ec6fc5cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:45.121036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaad201-7a46-4487-8402-e30ec6fc5cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:45.121552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaad201-7a46-4487-8402-e30ec6fc5cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:45.122772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaad201-7a46-4487-8402-e30ec6fc5cd8 admin admin] PATH_INFO: `/v3/projects/a66264cd9ee44c5aa506cd280e01b6ba/users/2f856b20e1964ce38e4d60e6bb8f2859/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:45.145326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaad201-7a46-4487-8402-e30ec6fc5cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a66264cd9ee44c5aa506cd280e01b6ba, user_id=2f856b20e1964ce38e4d60e6bb8f2859, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:45.149226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaad201-7a46-4487-8402-e30ec6fc5cd8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:45.156811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1caf77-c126-49b5-bddd-d58705d388cf admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:45.203332 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1113/2258] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:44 2022] PUT /identity/v3/projects/a66264cd9ee44c5aa506cd280e01b6ba/users/2f856b20e1964ce38e4d60e6bb8f2859/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:45.204341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae59527-91ca-441f-a532-e28a142b04c3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:45.204794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae59527-91ca-441f-a532-e28a142b04c3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:45.205215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae59527-91ca-441f-a532-e28a142b04c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:45.214270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-cae59527-91ca-441f-a532-e28a142b04c3 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:39:45.214270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:39:45.214270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:39:45.214270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:39:45.214270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:39:45.214270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:39:45.214270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:39:45.214270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:39:45.214270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:39:45.214270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:39:45.214270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:39:45.214270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:39:45.214270 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:39:45.215292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:39:45.215292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:39:45.215292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:39:45.215292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:39:45.215292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:39:45.215292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:39:45.215292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:39:45.215292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:39:45.215292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:39:45.215292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:39:45.215292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:39:45.215292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:39:45.215292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:39:45.215292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:39:45.215292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:39:45.218107 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1114/2259] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:39:45 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:39:45.242925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae59527-91ca-441f-a532-e28a142b04c3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:45.252015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9ad21-1a75-469e-8864-3182d6632a8a tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:45.252015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9ad21-1a75-469e-8864-3182d6632a8a tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:45.252015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9ad21-1a75-469e-8864-3182d6632a8a tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:45.252503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9ad21-1a75-469e-8864-3182d6632a8a tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/projects/084538d38b524e1ab44025cea7b055f5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:45.253464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9ad21-1a75-469e-8864-3182d6632a8a tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:get_project(project_id=084538d38b524e1ab44025cea7b055f5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:45.256940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9ad21-1a75-469e-8864-3182d6632a8a tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:45.272728 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1146/2260] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:39:44 2022] GET /identity/v3/projects/084538d38b524e1ab44025cea7b055f5 => generated 371 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:45.272914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:45.274000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18551700-fe33-4f90-9773-d7454a61c4e9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:45.281856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18551700-fe33-4f90-9773-d7454a61c4e9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:45.281856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18551700-fe33-4f90-9773-d7454a61c4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:45.342566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-18551700-fe33-4f90-9773-d7454a61c4e9 None None] MFA Rules not processed for user `301b13659b4e40c4bbf4f6a822083580`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:45.344050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-18551700-fe33-4f90-9773-d7454a61c4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:45.490314 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1147/2261] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:45.490314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18551700-fe33-4f90-9773-d7454a61c4e9 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:45.490314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-18551700-fe33-4f90-9773-d7454a61c4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:45.598360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae59527-91ca-441f-a532-e28a142b04c3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:45.629106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4673582-c4d5-42b4-97d2-82456e7481ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:45.629106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4673582-c4d5-42b4-97d2-82456e7481ac admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:45.629106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4673582-c4d5-42b4-97d2-82456e7481ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:45.629106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4673582-c4d5-42b4-97d2-82456e7481ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:45.631062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4673582-c4d5-42b4-97d2-82456e7481ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:45.636468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4673582-c4d5-42b4-97d2-82456e7481ac admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:45.688786 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1115/2262] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:45.690469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4673582-c4d5-42b4-97d2-82456e7481ac admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:45.708469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4673582-c4d5-42b4-97d2-82456e7481ac admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:45.713172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18551700-fe33-4f90-9773-d7454a61c4e9 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:45.716197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61093ea2-8a48-4990-813d-324c43573cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:45.717210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61093ea2-8a48-4990-813d-324c43573cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:45.717664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61093ea2-8a48-4990-813d-324c43573cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:45.718330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61093ea2-8a48-4990-813d-324c43573cb2 admin admin] PATH_INFO: `/v3/projects/a66264cd9ee44c5aa506cd280e01b6ba/users/2f856b20e1964ce38e4d60e6bb8f2859/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:45.720838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca09535-2812-4b62-ad6d-80275c8d18d6 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:45.721079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61093ea2-8a48-4990-813d-324c43573cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a66264cd9ee44c5aa506cd280e01b6ba, user_id=2f856b20e1964ce38e4d60e6bb8f2859, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:45.722516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca09535-2812-4b62-ad6d-80275c8d18d6 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:45.723194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca09535-2812-4b62-ad6d-80275c8d18d6 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:45.723789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca09535-2812-4b62-ad6d-80275c8d18d6 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:45.725148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca09535-2812-4b62-ad6d-80275c8d18d6 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:45.726118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca09535-2812-4b62-ad6d-80275c8d18d6 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:45.731865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61093ea2-8a48-4990-813d-324c43573cb2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:45.732025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca09535-2812-4b62-ad6d-80275c8d18d6 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:45.759187 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1116/2263] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:45 2022] PUT /identity/v3/projects/a66264cd9ee44c5aa506cd280e01b6ba/users/2f856b20e1964ce38e4d60e6bb8f2859/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:45.781500 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1148/2264] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:45.789362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770795a0-b716-47dd-acab-d95beb16eca5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:45.789362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770795a0-b716-47dd-acab-d95beb16eca5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:45.789362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770795a0-b716-47dd-acab-d95beb16eca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:45.790496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca09535-2812-4b62-ad6d-80275c8d18d6 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:45.808198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:45.814345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca09535-2812-4b62-ad6d-80275c8d18d6 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:45.866945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-770795a0-b716-47dd-acab-d95beb16eca5 None None] MFA Rules not processed for user `2f856b20e1964ce38e4d60e6bb8f2859`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:45.866945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-770795a0-b716-47dd-acab-d95beb16eca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:45.951954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f87895-a567-44c2-98fd-32a16b0936ac tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:45.952632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87895-a567-44c2-98fd-32a16b0936ac tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:45.952905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87895-a567-44c2-98fd-32a16b0936ac tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:45.953250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87895-a567-44c2-98fd-32a16b0936ac tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:45.953898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f87895-a567-44c2-98fd-32a16b0936ac tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:45.955998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f87895-a567-44c2-98fd-32a16b0936ac tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:46.036349 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1117/2265] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:46.049308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770795a0-b716-47dd-acab-d95beb16eca5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:46.051870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-770795a0-b716-47dd-acab-d95beb16eca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:46.102633 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1149/2266] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:45 2022] POST /identity/v3/users => generated 381 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:46.103949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f87895-a567-44c2-98fd-32a16b0936ac tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:46.116085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f87895-a567-44c2-98fd-32a16b0936ac tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:46.124036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d2247-30c9-40c4-b3fa-5115c1b7331c tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:46.124768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d2247-30c9-40c4-b3fa-5115c1b7331c tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:46.125274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d2247-30c9-40c4-b3fa-5115c1b7331c tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:46.126213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d2247-30c9-40c4-b3fa-5115c1b7331c tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:46.128844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:46.129954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d2247-30c9-40c4-b3fa-5115c1b7331c tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:46.130486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d2247-30c9-40c4-b3fa-5115c1b7331c tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:46.133529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d2247-30c9-40c4-b3fa-5115c1b7331c tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:46.169904 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1150/2267] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:39:46.230646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770795a0-b716-47dd-acab-d95beb16eca5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:46.248361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9815f8c-46b3-4456-953c-a48a54476352 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:46.249420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9815f8c-46b3-4456-953c-a48a54476352 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:46.250771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9815f8c-46b3-4456-953c-a48a54476352 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:46.251294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9815f8c-46b3-4456-953c-a48a54476352 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:46.286230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9815f8c-46b3-4456-953c-a48a54476352 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:46.290825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9815f8c-46b3-4456-953c-a48a54476352 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:46.298470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d2247-30c9-40c4-b3fa-5115c1b7331c tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:46.302610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-577d2247-30c9-40c4-b3fa-5115c1b7331c tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:46.334010 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1118/2268] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:39:46.367833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:46.490094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d2247-30c9-40c4-b3fa-5115c1b7331c tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:46.509006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cfc6b-e661-4596-b0a8-b5ca943c5916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:46.509946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cfc6b-e661-4596-b0a8-b5ca943c5916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:46.510382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cfc6b-e661-4596-b0a8-b5ca943c5916 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:46.510807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cfc6b-e661-4596-b0a8-b5ca943c5916 admin admin] PATH_INFO: `/v3/projects/a5a462aca3ed42dbb5d220090986844b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:46.516264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8cfc6b-e661-4596-b0a8-b5ca943c5916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a462aca3ed42dbb5d220090986844b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:46.521603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8cfc6b-e661-4596-b0a8-b5ca943c5916 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:46.577215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5468ae0-9f03-430b-975f-7a36f390cb51 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:46.577882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5468ae0-9f03-430b-975f-7a36f390cb51 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:46.578411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5468ae0-9f03-430b-975f-7a36f390cb51 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:46.582297 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1119/2269] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:39:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:39:46.589607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5468ae0-9f03-430b-975f-7a36f390cb51 None None] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:39:46.650134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:46.655824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5468ae0-9f03-430b-975f-7a36f390cb51 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:46.687962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5468ae0-9f03-430b-975f-7a36f390cb51 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:46.690354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3e8cfc6b-e661-4596-b0a8-b5ca943c5916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a462aca3ed42dbb5d220090986844b', 'request_id': 'req-3e8cfc6b-e661-4596-b0a8-b5ca943c5916'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:46.700146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3e8cfc6b-e661-4596-b0a8-b5ca943c5916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a462aca3ed42dbb5d220090986844b', 'request_id': 'req-3e8cfc6b-e661-4596-b0a8-b5ca943c5916'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:46.852678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3e8cfc6b-e661-4596-b0a8-b5ca943c5916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a462aca3ed42dbb5d220090986844b', 'request_id': 'req-3e8cfc6b-e661-4596-b0a8-b5ca943c5916'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:46.885191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6401a63-e116-442d-99dc-eaa2002e0d95 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:46.888054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3e8cfc6b-e661-4596-b0a8-b5ca943c5916 admin admin] The token cache is being invalidate because project a5a462aca3ed42dbb5d220090986844b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:46.888766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3e8cfc6b-e661-4596-b0a8-b5ca943c5916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:46.890905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3e8cfc6b-e661-4596-b0a8-b5ca943c5916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:46.892501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6401a63-e116-442d-99dc-eaa2002e0d95 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:46.892864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6401a63-e116-442d-99dc-eaa2002e0d95 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:46.893663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6401a63-e116-442d-99dc-eaa2002e0d95 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/projects/084538d38b524e1ab44025cea7b055f5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:46.897522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6401a63-e116-442d-99dc-eaa2002e0d95 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:get_project(project_id=084538d38b524e1ab44025cea7b055f5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:46.902098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6401a63-e116-442d-99dc-eaa2002e0d95 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:46.903845 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1151/2270] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:46 2022] DELETE /identity/v3/projects/a5a462aca3ed42dbb5d220090986844b => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:39:46.910206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726800d2-7e65-4a17-b647-91a925d940a3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:46.910800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726800d2-7e65-4a17-b647-91a925d940a3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:46.910909 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1120/2271] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:39:46 2022] GET /identity/v3/projects/084538d38b524e1ab44025cea7b055f5 => generated 371 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:39:46.911366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726800d2-7e65-4a17-b647-91a925d940a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:46.988586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-726800d2-7e65-4a17-b647-91a925d940a3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:47.000758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-726800d2-7e65-4a17-b647-91a925d940a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:47.184872 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1152/2272] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:39:47.193035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedbbeb-edb5-42ef-9865-74c5d8f00ed2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:47.193319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedbbeb-edb5-42ef-9865-74c5d8f00ed2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:47.193824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedbbeb-edb5-42ef-9865-74c5d8f00ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:47.230628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6fedbbeb-edb5-42ef-9865-74c5d8f00ed2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:47.242815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6fedbbeb-edb5-42ef-9865-74c5d8f00ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:47.296144 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1121/2273] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:47.301178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726800d2-7e65-4a17-b647-91a925d940a3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:47.332864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726800d2-7e65-4a17-b647-91a925d940a3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:47.367800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28041f-99c7-4613-8dec-948eae8b4597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:47.368829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28041f-99c7-4613-8dec-948eae8b4597 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:47.370570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28041f-99c7-4613-8dec-948eae8b4597 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:47.371438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28041f-99c7-4613-8dec-948eae8b4597 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:47.374021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28041f-99c7-4613-8dec-948eae8b4597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:47.374801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28041f-99c7-4613-8dec-948eae8b4597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:47.380755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28041f-99c7-4613-8dec-948eae8b4597 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:47.386372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae911a8-a067-4916-a647-f3f1472ec2be None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:47.386658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae911a8-a067-4916-a647-f3f1472ec2be None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:47.386936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae911a8-a067-4916-a647-f3f1472ec2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:47.432314 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1153/2274] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:47.433244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28041f-99c7-4613-8dec-948eae8b4597 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:47.458407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28041f-99c7-4613-8dec-948eae8b4597 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:47.470244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa63c53-5c2c-4215-b096-9e5de3f3d748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:47.470701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-cae911a8-a067-4916-a647-f3f1472ec2be None None] MFA Rules not processed for user `d5329b8aa2834338bd50b0efc6fbbb16`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:47.470837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa63c53-5c2c-4215-b096-9e5de3f3d748 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:47.471154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa63c53-5c2c-4215-b096-9e5de3f3d748 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:47.471502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa63c53-5c2c-4215-b096-9e5de3f3d748 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:47.479784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa63c53-5c2c-4215-b096-9e5de3f3d748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:47.501412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa63c53-5c2c-4215-b096-9e5de3f3d748 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:47.501796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cae911a8-a067-4916-a647-f3f1472ec2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:47.635270 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1122/2275] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:47 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:47.636816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4ba7e-59a9-4794-834b-a0d0550e8b59 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:47.637449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4ba7e-59a9-4794-834b-a0d0550e8b59 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:47.637802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4ba7e-59a9-4794-834b-a0d0550e8b59 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:47.640305 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1123/2276] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:47.646803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4ba7e-59a9-4794-834b-a0d0550e8b59 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:47.652761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bbb4ba7e-59a9-4794-834b-a0d0550e8b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:47.694294 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1154/2277] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:47 2022] POST /identity/v3/projects => generated 385 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:47.695593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa63c53-5c2c-4215-b096-9e5de3f3d748 admin admin] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:39:47.698468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cfa63c53-5c2c-4215-b096-9e5de3f3d748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:47.716241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4ba7e-59a9-4794-834b-a0d0550e8b59 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:47.828580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa63c53-5c2c-4215-b096-9e5de3f3d748 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:47.829965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cfa63c53-5c2c-4215-b096-9e5de3f3d748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:47.876024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:47.901981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740ca2c-f97a-4fa6-9474-d1e992231b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:47.902750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740ca2c-f97a-4fa6-9474-d1e992231b16 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:47.903875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740ca2c-f97a-4fa6-9474-d1e992231b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:47.904366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740ca2c-f97a-4fa6-9474-d1e992231b16 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:47.907877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740ca2c-f97a-4fa6-9474-d1e992231b16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:47.914710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740ca2c-f97a-4fa6-9474-d1e992231b16 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:47.923878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa63c53-5c2c-4215-b096-9e5de3f3d748 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:47.930629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625863cf-6ed0-44e5-b058-cf5fa8f023a3 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:47.931664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625863cf-6ed0-44e5-b058-cf5fa8f023a3 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:47.931941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625863cf-6ed0-44e5-b058-cf5fa8f023a3 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:47.932242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625863cf-6ed0-44e5-b058-cf5fa8f023a3 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/projects/084538d38b524e1ab44025cea7b055f5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:47.933412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625863cf-6ed0-44e5-b058-cf5fa8f023a3 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:get_project(project_id=084538d38b524e1ab44025cea7b055f5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:47.942341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625863cf-6ed0-44e5-b058-cf5fa8f023a3 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:47.959255 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1155/2278] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:39:47 2022] GET /identity/v3/projects/084538d38b524e1ab44025cea7b055f5 => generated 371 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:47.967592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625863cf-6ed0-44e5-b058-cf5fa8f023a3 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:47.998683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625863cf-6ed0-44e5-b058-cf5fa8f023a3 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:48.014230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25135f9b-190b-450e-8a89-0f2e136b8a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:48.014967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25135f9b-190b-450e-8a89-0f2e136b8a62 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:48.015251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25135f9b-190b-450e-8a89-0f2e136b8a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:48.015523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25135f9b-190b-450e-8a89-0f2e136b8a62 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:48.016182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25135f9b-190b-450e-8a89-0f2e136b8a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:48.018718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25135f9b-190b-450e-8a89-0f2e136b8a62 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:48.160104 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1124/2279] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:47 2022] POST /identity/v3/projects => generated 403 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:48.160104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740ca2c-f97a-4fa6-9474-d1e992231b16 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:48.242238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:48.244121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740ca2c-f97a-4fa6-9474-d1e992231b16 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:48.249503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50497a36-ee0c-47b3-a2e9-6766b942267f tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:48.250148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50497a36-ee0c-47b3-a2e9-6766b942267f tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:48.250436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50497a36-ee0c-47b3-a2e9-6766b942267f tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:48.250714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50497a36-ee0c-47b3-a2e9-6766b942267f tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/users/e3ef3901d0f34421813922b7cc2c1751` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:48.296036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50497a36-ee0c-47b3-a2e9-6766b942267f tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e3ef3901d0f34421813922b7cc2c1751)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:48.296036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50497a36-ee0c-47b3-a2e9-6766b942267f tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:48.419700 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1156/2280] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:47 2022] POST /identity/v3/users => generated 293 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:48.421769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25135f9b-190b-450e-8a89-0f2e136b8a62 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:48.445341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25135f9b-190b-450e-8a89-0f2e136b8a62 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:48.507300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728880-23f1-43aa-9463-b4ff2b757d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:48.508035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728880-23f1-43aa-9463-b4ff2b757d46 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:48.508358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728880-23f1-43aa-9463-b4ff2b757d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:48.508629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728880-23f1-43aa-9463-b4ff2b757d46 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:48.509271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a728880-23f1-43aa-9463-b4ff2b757d46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:48.511165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a728880-23f1-43aa-9463-b4ff2b757d46 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:48.618489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-50497a36-ee0c-47b3-a2e9-6766b942267f tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ef3901d0f34421813922b7cc2c1751'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:48.647724 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1157/2281] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:48 2022] POST /identity/v3/users => generated 308 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:48.648407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728880-23f1-43aa-9463-b4ff2b757d46 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:48.670521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728880-23f1-43aa-9463-b4ff2b757d46 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:48.683717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b0ba2-bf5f-406a-91c8-b6722255c949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:48.683717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b0ba2-bf5f-406a-91c8-b6722255c949 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:48.683717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b0ba2-bf5f-406a-91c8-b6722255c949 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:48.683717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b0ba2-bf5f-406a-91c8-b6722255c949 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:48.684210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b0ba2-bf5f-406a-91c8-b6722255c949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:48.685668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b0ba2-bf5f-406a-91c8-b6722255c949 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:48.702245 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1158/2282] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:48.703179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b0ba2-bf5f-406a-91c8-b6722255c949 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:48.704395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-50497a36-ee0c-47b3-a2e9-6766b942267f tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ef3901d0f34421813922b7cc2c1751'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:48.705212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-50497a36-ee0c-47b3-a2e9-6766b942267f tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ef3901d0f34421813922b7cc2c1751'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:48.718007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-50497a36-ee0c-47b3-a2e9-6766b942267f tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ef3901d0f34421813922b7cc2c1751'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:48.719442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b0ba2-bf5f-406a-91c8-b6722255c949 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:48.732055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29211758-ed2e-4015-b78f-b3db4609687a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:48.733669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29211758-ed2e-4015-b78f-b3db4609687a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:48.734050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29211758-ed2e-4015-b78f-b3db4609687a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:48.734422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29211758-ed2e-4015-b78f-b3db4609687a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:48.735192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29211758-ed2e-4015-b78f-b3db4609687a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:48.738107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-50497a36-ee0c-47b3-a2e9-6766b942267f tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ef3901d0f34421813922b7cc2c1751'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:48.744137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29211758-ed2e-4015-b78f-b3db4609687a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:48.764724 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1159/2284] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:48.765007 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1125/2284] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:48 2022] DELETE /identity/v3/users/e3ef3901d0f34421813922b7cc2c1751 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:48.765929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29211758-ed2e-4015-b78f-b3db4609687a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:48.767217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50497a36-ee0c-47b3-a2e9-6766b942267f tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:48.767992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-29211758-ed2e-4015-b78f-b3db4609687a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:48.769337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-50497a36-ee0c-47b3-a2e9-6766b942267f tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:48.787080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29211758-ed2e-4015-b78f-b3db4609687a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:48.865309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890efc6e-8fce-4e11-bd75-ae3cc1557bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:48.866181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890efc6e-8fce-4e11-bd75-ae3cc1557bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:48.866652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890efc6e-8fce-4e11-bd75-ae3cc1557bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:48.867717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890efc6e-8fce-4e11-bd75-ae3cc1557bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:48.868607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890efc6e-8fce-4e11-bd75-ae3cc1557bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:48.872368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890efc6e-8fce-4e11-bd75-ae3cc1557bc7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:48.876328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50497a36-ee0c-47b3-a2e9-6766b942267f tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:48.885882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:48.887159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:48.887346 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1160/2285] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:48.887624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:48.887906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/projects/084538d38b524e1ab44025cea7b055f5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:48.888867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890efc6e-8fce-4e11-bd75-ae3cc1557bc7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:48.889118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:delete_project(project_id=084538d38b524e1ab44025cea7b055f5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:48.891068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-890efc6e-8fce-4e11-bd75-ae3cc1557bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:48.891824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:48.924032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890efc6e-8fce-4e11-bd75-ae3cc1557bc7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:48.940647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936a041-9dce-48c8-9b24-e9ce4e06319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:48.941336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936a041-9dce-48c8-9b24-e9ce4e06319a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:48.941612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936a041-9dce-48c8-9b24-e9ce4e06319a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:48.941879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936a041-9dce-48c8-9b24-e9ce4e06319a admin admin] PATH_INFO: `/v3/projects/4be70acd148e4739ba601614d787ad14/users/01471a5a05de4b149fb04f13cf0e66b5/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:48.977358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936a041-9dce-48c8-9b24-e9ce4e06319a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be70acd148e4739ba601614d787ad14, user_id=01471a5a05de4b149fb04f13cf0e66b5, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:48.980759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936a041-9dce-48c8-9b24-e9ce4e06319a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:49.065969 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1161/2286] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:48 2022] PUT /identity/v3/projects/4be70acd148e4739ba601614d787ad14/users/01471a5a05de4b149fb04f13cf0e66b5/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:49.067300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936a041-9dce-48c8-9b24-e9ce4e06319a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:49.109691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '084538d38b524e1ab44025cea7b055f5', 'request_id': 'req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:49.123879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '084538d38b524e1ab44025cea7b055f5', 'request_id': 'req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:49.132874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '084538d38b524e1ab44025cea7b055f5', 'request_id': 'req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:49.178880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:49.215886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] The token cache is being invalidate because project 084538d38b524e1ab44025cea7b055f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:49.217245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:49.218069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:49.224594 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1126/2287] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:48 2022] DELETE /identity/v3/projects/084538d38b524e1ab44025cea7b055f5 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:49.225783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:49.228608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:49.231638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936a041-9dce-48c8-9b24-e9ce4e06319a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:49.323642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b863c-c910-4443-911a-8ff13cf870cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:49.324436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b863c-c910-4443-911a-8ff13cf870cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:49.324905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b863c-c910-4443-911a-8ff13cf870cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:49.325202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b863c-c910-4443-911a-8ff13cf870cc admin admin] PATH_INFO: `/v3/projects/b6295028045c4e4a89a385e4e835c7a3/users/95a5ea624f3247f4ad47068013e03d40/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:49.328971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969c8d8-fc2e-4d95-ba7d-b90c98a470d2 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:49.336854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3fad1-5bc8-4f61-a678-582c351942b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:49.338344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3fad1-5bc8-4f61-a678-582c351942b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:49.338819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3fad1-5bc8-4f61-a678-582c351942b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:49.339288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3fad1-5bc8-4f61-a678-582c351942b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:49.340509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3fad1-5bc8-4f61-a678-582c351942b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:49.342982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3fad1-5bc8-4f61-a678-582c351942b7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:49.357793 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1127/2288] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:49.359262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac4abf-1603-40a9-bcef-08d76e70f4cf None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:49.361263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac4abf-1603-40a9-bcef-08d76e70f4cf None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:49.361545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac4abf-1603-40a9-bcef-08d76e70f4cf None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:49.361937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b863c-c910-4443-911a-8ff13cf870cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6295028045c4e4a89a385e4e835c7a3, user_id=95a5ea624f3247f4ad47068013e03d40, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:49.365037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b863c-c910-4443-911a-8ff13cf870cc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:49.366542 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1128/2289] 10.222.0.76 () {54 vars in 921 bytes} [Sat Aug 27 04:39:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:49.367743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715b0f-7374-414e-a383-89172e3a3770 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:49.367947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715b0f-7374-414e-a383-89172e3a3770 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:49.368933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715b0f-7374-414e-a383-89172e3a3770 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:49.370652 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1129/2290] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:49.371480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5715b0f-7374-414e-a383-89172e3a3770 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:49.399130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5715b0f-7374-414e-a383-89172e3a3770 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:49.413815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9cc20-a062-491d-9c0d-0d794c68e7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:49.414484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9cc20-a062-491d-9c0d-0d794c68e7c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:49.415207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9cc20-a062-491d-9c0d-0d794c68e7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:49.415207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9cc20-a062-491d-9c0d-0d794c68e7c7 admin admin] PATH_INFO: `/v3/projects/4be70acd148e4739ba601614d787ad14/users/01471a5a05de4b149fb04f13cf0e66b5/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:49.418286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9cc20-a062-491d-9c0d-0d794c68e7c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be70acd148e4739ba601614d787ad14, user_id=01471a5a05de4b149fb04f13cf0e66b5, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:49.420266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9cc20-a062-491d-9c0d-0d794c68e7c7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:49.444490 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1130/2291] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:49 2022] PUT /identity/v3/projects/4be70acd148e4739ba601614d787ad14/users/01471a5a05de4b149fb04f13cf0e66b5/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:49.445571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9cc20-a062-491d-9c0d-0d794c68e7c7 admin admin] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:39:49.447386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8ea9cc20-a062-491d-9c0d-0d794c68e7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:49.498659 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1162/2292] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:49 2022] PUT /identity/v3/projects/b6295028045c4e4a89a385e4e835c7a3/users/95a5ea624f3247f4ad47068013e03d40/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:49.500257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba99424-51d5-497c-81ff-8ae090643b94 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:49.500715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba99424-51d5-497c-81ff-8ae090643b94 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:49.500994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba99424-51d5-497c-81ff-8ae090643b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:49.539014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-aba99424-51d5-497c-81ff-8ae090643b94 None None] MFA Rules not processed for user `702086569a63418685711c4c134b1482`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:49.540325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-aba99424-51d5-497c-81ff-8ae090643b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:49.611835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:49.616707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9cc20-a062-491d-9c0d-0d794c68e7c7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:49.620112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8ea9cc20-a062-491d-9c0d-0d794c68e7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:49.714618 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1163/2293] 10.222.0.76 () {58 vars in 1018 bytes} [Sat Aug 27 04:39:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:49.718157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2a1d-dd05-4993-a448-a2ea4a24c5d8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:49.718445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2a1d-dd05-4993-a448-a2ea4a24c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:49.718711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2a1d-dd05-4993-a448-a2ea4a24c5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:49.782033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7d3f2a1d-dd05-4993-a448-a2ea4a24c5d8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:49.783258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7d3f2a1d-dd05-4993-a448-a2ea4a24c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:49.839959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9cc20-a062-491d-9c0d-0d794c68e7c7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:49.983887 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1164/2294] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:49.985560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f2a1d-dd05-4993-a448-a2ea4a24c5d8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:49.996231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7d3f2a1d-dd05-4993-a448-a2ea4a24c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:50.003039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa3c56-f4cc-48bb-afe5-834499030b20 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:50.003183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa3c56-f4cc-48bb-afe5-834499030b20 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:50.004798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa3c56-f4cc-48bb-afe5-834499030b20 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:50.005010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa3c56-f4cc-48bb-afe5-834499030b20 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/projects/9698589ac2984c589f2a357cf753b3f1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:50.016362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f2a1d-dd05-4993-a448-a2ea4a24c5d8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:50.019409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa3c56-f4cc-48bb-afe5-834499030b20 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:get_project(project_id=9698589ac2984c589f2a357cf753b3f1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:50.026800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa3c56-f4cc-48bb-afe5-834499030b20 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:50.035950 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1131/2295] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:39:49 2022] GET /identity/v3/projects/9698589ac2984c589f2a357cf753b3f1 => generated 373 bytes in 591 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:50.037713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30187ee1-3654-466c-b9e7-6209dc0e3df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:50.039651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa3c56-f4cc-48bb-afe5-834499030b20 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:50.040913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30187ee1-3654-466c-b9e7-6209dc0e3df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:50.043803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30187ee1-3654-466c-b9e7-6209dc0e3df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:50.044385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30187ee1-3654-466c-b9e7-6209dc0e3df8 admin admin] PATH_INFO: `/v3/users/efe6d41548884cd1b34043afe1bafc51` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:50.047392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30187ee1-3654-466c-b9e7-6209dc0e3df8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efe6d41548884cd1b34043afe1bafc51)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:50.056651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c4fa3c56-f4cc-48bb-afe5-834499030b20 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:50.060329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30187ee1-3654-466c-b9e7-6209dc0e3df8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:50.102539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa3c56-f4cc-48bb-afe5-834499030b20 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:50.136873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54e71f-5f00-494a-8202-e2ef454bbc0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:50.137658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54e71f-5f00-494a-8202-e2ef454bbc0f service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:50.138824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54e71f-5f00-494a-8202-e2ef454bbc0f service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:50.139199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54e71f-5f00-494a-8202-e2ef454bbc0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:50.165132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54e71f-5f00-494a-8202-e2ef454bbc0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:50.168776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54e71f-5f00-494a-8202-e2ef454bbc0f service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:50.188425 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1132/2296] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:50.193904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54e71f-5f00-494a-8202-e2ef454bbc0f service placement] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:50.193904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5f54e71f-5f00-494a-8202-e2ef454bbc0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:50.341594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-30187ee1-3654-466c-b9e7-6209dc0e3df8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efe6d41548884cd1b34043afe1bafc51'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:50.342274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-30187ee1-3654-466c-b9e7-6209dc0e3df8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efe6d41548884cd1b34043afe1bafc51'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:50.395756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54e71f-5f00-494a-8202-e2ef454bbc0f service placement] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:50.401876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a05ba3-5e09-4220-92ff-6c429ae22f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:50.403117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a05ba3-5e09-4220-92ff-6c429ae22f4d service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:50.403855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a05ba3-5e09-4220-92ff-6c429ae22f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:50.404523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a05ba3-5e09-4220-92ff-6c429ae22f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:50.430610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a05ba3-5e09-4220-92ff-6c429ae22f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:50.433970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a05ba3-5e09-4220-92ff-6c429ae22f4d service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:50.436133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-30187ee1-3654-466c-b9e7-6209dc0e3df8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efe6d41548884cd1b34043afe1bafc51'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:50.437068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-30187ee1-3654-466c-b9e7-6209dc0e3df8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efe6d41548884cd1b34043afe1bafc51'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:50.486677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-30187ee1-3654-466c-b9e7-6209dc0e3df8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efe6d41548884cd1b34043afe1bafc51'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:50.525881 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1133/2297] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:50.525881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c2b8-67fb-4705-a8c6-72f1fc5c331e None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:50.525881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c2b8-67fb-4705-a8c6-72f1fc5c331e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:50.525881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c2b8-67fb-4705-a8c6-72f1fc5c331e None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:50.526206 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1165/2298] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:49 2022] DELETE /identity/v3/users/efe6d41548884cd1b34043afe1bafc51 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:50.526206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30187ee1-3654-466c-b9e7-6209dc0e3df8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:50.526444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-30187ee1-3654-466c-b9e7-6209dc0e3df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:50.530476 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1134/2299] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:39:50 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:50.532788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2c2b8-67fb-4705-a8c6-72f1fc5c331e None None] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:39:50.538120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dad2c2b8-67fb-4705-a8c6-72f1fc5c331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:50.635980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:50.733818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2c2b8-67fb-4705-a8c6-72f1fc5c331e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:50.737456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dad2c2b8-67fb-4705-a8c6-72f1fc5c331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:50.786751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30187ee1-3654-466c-b9e7-6209dc0e3df8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:50.811854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dffdf-7ec8-4f01-b1b4-7a0f8f2e098d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:50.812529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dffdf-7ec8-4f01-b1b4-7a0f8f2e098d service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:50.812814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dffdf-7ec8-4f01-b1b4-7a0f8f2e098d service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:50.813089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dffdf-7ec8-4f01-b1b4-7a0f8f2e098d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:50.824074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-311dffdf-7ec8-4f01-b1b4-7a0f8f2e098d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:50.951609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:50.980346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2c2b8-67fb-4705-a8c6-72f1fc5c331e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:50.990047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ac7fa-e96f-4b83-b26f-2a8923717d0a tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:50.991001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ac7fa-e96f-4b83-b26f-2a8923717d0a tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:50.991977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ac7fa-e96f-4b83-b26f-2a8923717d0a tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:50.992342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ac7fa-e96f-4b83-b26f-2a8923717d0a tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/projects/9698589ac2984c589f2a357cf753b3f1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:50.993662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ac7fa-e96f-4b83-b26f-2a8923717d0a tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:get_project(project_id=9698589ac2984c589f2a357cf753b3f1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:50.996445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ac7fa-e96f-4b83-b26f-2a8923717d0a tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:51.011587 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1135/2300] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:39:50 2022] GET /identity/v3/projects/9698589ac2984c589f2a357cf753b3f1 => generated 373 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:51.038958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dffdf-7ec8-4f01-b1b4-7a0f8f2e098d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:51.049424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dffdf-7ec8-4f01-b1b4-7a0f8f2e098d service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:51.080257 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1166/2301] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:51.266869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ac7fa-e96f-4b83-b26f-2a8923717d0a tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:51.270713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a68ac7fa-e96f-4b83-b26f-2a8923717d0a tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:51.414476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:51.472409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ac7fa-e96f-4b83-b26f-2a8923717d0a tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:51.478937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c068699-de31-442d-bfd0-59cfa85a38b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:51.479847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068699-de31-442d-bfd0-59cfa85a38b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:51.480139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068699-de31-442d-bfd0-59cfa85a38b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:51.480576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068699-de31-442d-bfd0-59cfa85a38b8 admin admin] PATH_INFO: `/v3/projects/0e2774ce585b4cfba6bcec93ae80096f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:51.482117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c068699-de31-442d-bfd0-59cfa85a38b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2774ce585b4cfba6bcec93ae80096f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:51.484510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c068699-de31-442d-bfd0-59cfa85a38b8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:51.672596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c068699-de31-442d-bfd0-59cfa85a38b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2774ce585b4cfba6bcec93ae80096f', 'request_id': 'req-2c068699-de31-442d-bfd0-59cfa85a38b8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:51.682085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c068699-de31-442d-bfd0-59cfa85a38b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2774ce585b4cfba6bcec93ae80096f', 'request_id': 'req-2c068699-de31-442d-bfd0-59cfa85a38b8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:51.692280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c068699-de31-442d-bfd0-59cfa85a38b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2774ce585b4cfba6bcec93ae80096f', 'request_id': 'req-2c068699-de31-442d-bfd0-59cfa85a38b8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:51.844084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c068699-de31-442d-bfd0-59cfa85a38b8 admin admin] The token cache is being invalidate because project 0e2774ce585b4cfba6bcec93ae80096f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:51.844597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c068699-de31-442d-bfd0-59cfa85a38b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:51.854120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c068699-de31-442d-bfd0-59cfa85a38b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:51.864696 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1136/2302] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:51 2022] DELETE /identity/v3/projects/0e2774ce585b4cfba6bcec93ae80096f => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:51.868456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dffdf-7ec8-4f01-b1b4-7a0f8f2e098d service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:51.894932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dffdf-7ec8-4f01-b1b4-7a0f8f2e098d service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:52.075616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648556b-0cd1-415f-ba1d-be8477c04c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:52.076801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648556b-0cd1-415f-ba1d-be8477c04c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:52.077566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648556b-0cd1-415f-ba1d-be8477c04c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:52.081763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648556b-0cd1-415f-ba1d-be8477c04c4f admin admin] PATH_INFO: `/v3/users/1b5c9acbaf244d1aa1576e35a80c3693` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:52.083391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648556b-0cd1-415f-ba1d-be8477c04c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b5c9acbaf244d1aa1576e35a80c3693)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:52.093309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648556b-0cd1-415f-ba1d-be8477c04c4f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:52.793183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1648556b-0cd1-415f-ba1d-be8477c04c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b5c9acbaf244d1aa1576e35a80c3693'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:52.793183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1648556b-0cd1-415f-ba1d-be8477c04c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b5c9acbaf244d1aa1576e35a80c3693'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:52.968375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1648556b-0cd1-415f-ba1d-be8477c04c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b5c9acbaf244d1aa1576e35a80c3693'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:52.969801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1648556b-0cd1-415f-ba1d-be8477c04c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b5c9acbaf244d1aa1576e35a80c3693'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:52.995104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1648556b-0cd1-415f-ba1d-be8477c04c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b5c9acbaf244d1aa1576e35a80c3693'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:53.031353 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1167/2303] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:51 2022] DELETE /identity/v3/users/1b5c9acbaf244d1aa1576e35a80c3693 => generated 0 bytes in 1160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:53.074940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:53.260350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ab69f-c925-42aa-bd32-a0fb83546f31 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:53.261321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ab69f-c925-42aa-bd32-a0fb83546f31 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:53.261781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ab69f-c925-42aa-bd32-a0fb83546f31 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:53.264649 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1137/2304] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:39:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:39:53.280642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648556b-0cd1-415f-ba1d-be8477c04c4f admin admin] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:39:53.283527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1648556b-0cd1-415f-ba1d-be8477c04c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:53.505940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:53.600677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648556b-0cd1-415f-ba1d-be8477c04c4f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:53.602070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1648556b-0cd1-415f-ba1d-be8477c04c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:53.711786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ab69f-c925-42aa-bd32-a0fb83546f31 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:53.714369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-888ab69f-c925-42aa-bd32-a0fb83546f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:53.843581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648556b-0cd1-415f-ba1d-be8477c04c4f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:53.853661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7df29-ea67-4768-9bb7-046cc4bb4a04 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c00083f8691424e813cccbe2ba1bd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a009574aaba144b7912f5dbc5173dc42', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:53.853661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7df29-ea67-4768-9bb7-046cc4bb4a04 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:53.855890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7df29-ea67-4768-9bb7-046cc4bb4a04 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:53.871495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7df29-ea67-4768-9bb7-046cc4bb4a04 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] PATH_INFO: `/v3/projects/9698589ac2984c589f2a357cf753b3f1` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:53.874006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7df29-ea67-4768-9bb7-046cc4bb4a04 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorizing `identity:get_project(project_id=9698589ac2984c589f2a357cf753b3f1)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:53.886085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7df29-ea67-4768-9bb7-046cc4bb4a04 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:53.891371 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1168/2305] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:39:53 2022] GET /identity/v3/projects/9698589ac2984c589f2a357cf753b3f1 => generated 373 bytes in 611 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:53.894733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7df29-ea67-4768-9bb7-046cc4bb4a04 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:53.904778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-53b7df29-ea67-4768-9bb7-046cc4bb4a04 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:53.922353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ab69f-c925-42aa-bd32-a0fb83546f31 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:53.941114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4d127-46ae-4409-a8f6-c9ee73c98922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:53.941114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4d127-46ae-4409-a8f6-c9ee73c98922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:53.941114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4d127-46ae-4409-a8f6-c9ee73c98922 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:53.941114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4d127-46ae-4409-a8f6-c9ee73c98922 admin admin] PATH_INFO: `/v3/users/897dedad921f400aa3206db5fd051231` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:53.941565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4d127-46ae-4409-a8f6-c9ee73c98922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=897dedad921f400aa3206db5fd051231)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:53.941565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4d127-46ae-4409-a8f6-c9ee73c98922 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:53.966464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7df29-ea67-4768-9bb7-046cc4bb4a04 tempest-QuotasAdminTestJSON-1167469425 tempest-QuotasAdminTestJSON-1167469425-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:54.014645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92abea-0c04-40fb-8b4a-43d48ec95359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:54.015338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92abea-0c04-40fb-8b4a-43d48ec95359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:54.015595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92abea-0c04-40fb-8b4a-43d48ec95359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:54.015880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92abea-0c04-40fb-8b4a-43d48ec95359 admin admin] PATH_INFO: `/v3/projects/b6348e2d199d41b790823569854a5517` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:54.020807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92abea-0c04-40fb-8b4a-43d48ec95359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6348e2d199d41b790823569854a5517)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:54.027440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92abea-0c04-40fb-8b4a-43d48ec95359 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:54.357000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bdc4d127-46ae-4409-a8f6-c9ee73c98922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897dedad921f400aa3206db5fd051231'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:54.360587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fa92abea-0c04-40fb-8b4a-43d48ec95359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6348e2d199d41b790823569854a5517', 'request_id': 'req-fa92abea-0c04-40fb-8b4a-43d48ec95359'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:54.370148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fa92abea-0c04-40fb-8b4a-43d48ec95359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6348e2d199d41b790823569854a5517', 'request_id': 'req-fa92abea-0c04-40fb-8b4a-43d48ec95359'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:54.465915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bdc4d127-46ae-4409-a8f6-c9ee73c98922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897dedad921f400aa3206db5fd051231'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:54.468387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bdc4d127-46ae-4409-a8f6-c9ee73c98922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897dedad921f400aa3206db5fd051231'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:54.482362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bdc4d127-46ae-4409-a8f6-c9ee73c98922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897dedad921f400aa3206db5fd051231'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:54.547137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bdc4d127-46ae-4409-a8f6-c9ee73c98922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897dedad921f400aa3206db5fd051231'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:54.576811 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1138/2306] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:53 2022] DELETE /identity/v3/users/897dedad921f400aa3206db5fd051231 => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:54.581072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ac673-170e-4ce4-a7cd-93a9a950418b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:54.581421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ac673-170e-4ce4-a7cd-93a9a950418b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:54.584283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ac673-170e-4ce4-a7cd-93a9a950418b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:54.613777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fa92abea-0c04-40fb-8b4a-43d48ec95359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6348e2d199d41b790823569854a5517', 'request_id': 'req-fa92abea-0c04-40fb-8b4a-43d48ec95359'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:54.644524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-662ac673-170e-4ce4-a7cd-93a9a950418b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:54.647295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-662ac673-170e-4ce4-a7cd-93a9a950418b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:54.668588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fa92abea-0c04-40fb-8b4a-43d48ec95359 admin admin] The token cache is being invalidate because project b6348e2d199d41b790823569854a5517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:54.669031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fa92abea-0c04-40fb-8b4a-43d48ec95359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:54.670246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fa92abea-0c04-40fb-8b4a-43d48ec95359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:54.674365 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1169/2307] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:53 2022] DELETE /identity/v3/projects/b6348e2d199d41b790823569854a5517 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:54.679214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f475f-744f-4c23-afb6-015d0682b031 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:54.679873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f475f-744f-4c23-afb6-015d0682b031 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:54.680336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f475f-744f-4c23-afb6-015d0682b031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:54.719467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8d1f475f-744f-4c23-afb6-015d0682b031 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:54.720960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8d1f475f-744f-4c23-afb6-015d0682b031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:54.807208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:54.884599 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1170/2308] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:54.886377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe3f88-e8ce-4361-8f81-7a088c97d207 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:54.886669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe3f88-e8ce-4361-8f81-7a088c97d207 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:54.886944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe3f88-e8ce-4361-8f81-7a088c97d207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:54.903764 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1139/2309] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:54.961051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b8fe3f88-e8ce-4361-8f81-7a088c97d207 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:54.962404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b8fe3f88-e8ce-4361-8f81-7a088c97d207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:55.000762 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1171/2310] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:39:55.014961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ac673-170e-4ce4-a7cd-93a9a950418b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:55.039045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ac673-170e-4ce4-a7cd-93a9a950418b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:55.072915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a18b5-0645-40eb-b4c9-f7851185e2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:55.075465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a18b5-0645-40eb-b4c9-f7851185e2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:55.079995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a18b5-0645-40eb-b4c9-f7851185e2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:55.080918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a18b5-0645-40eb-b4c9-f7851185e2e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:55.082465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a18b5-0645-40eb-b4c9-f7851185e2e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:55.083071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a18b5-0645-40eb-b4c9-f7851185e2e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:55.091360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a18b5-0645-40eb-b4c9-f7851185e2e9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:55.139146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe3f88-e8ce-4361-8f81-7a088c97d207 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:55.139725 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1140/2311] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:55.155469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe3f88-e8ce-4361-8f81-7a088c97d207 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:55.176028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe4adf-96c3-41a4-ab97-f67e38177674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:55.176748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe4adf-96c3-41a4-ab97-f67e38177674 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:55.177068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe4adf-96c3-41a4-ab97-f67e38177674 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:55.177340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe4adf-96c3-41a4-ab97-f67e38177674 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:55.182951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe4adf-96c3-41a4-ab97-f67e38177674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:55.189127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe4adf-96c3-41a4-ab97-f67e38177674 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:55.191321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:55.342868 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1172/2312] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:55 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:39:55.348092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a18b5-0645-40eb-b4c9-f7851185e2e9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:55.387411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a18b5-0645-40eb-b4c9-f7851185e2e9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:55.574483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01337d84-cf18-47a2-8767-50d42be7e915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:55.575489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01337d84-cf18-47a2-8767-50d42be7e915 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:55.576008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01337d84-cf18-47a2-8767-50d42be7e915 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:55.576957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01337d84-cf18-47a2-8767-50d42be7e915 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:55.580990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01337d84-cf18-47a2-8767-50d42be7e915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:55.588834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01337d84-cf18-47a2-8767-50d42be7e915 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:55.603805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe4adf-96c3-41a4-ab97-f67e38177674 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:55.608080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9cbe4adf-96c3-41a4-ab97-f67e38177674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:55.692447 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1141/2313] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:55 2022] POST /identity/v3/users => generated 294 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:55.697035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01337d84-cf18-47a2-8767-50d42be7e915 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:55.710368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe4adf-96c3-41a4-ab97-f67e38177674 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:55.716346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38105104-265c-45bb-a22b-af24b3c89ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:55.717242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38105104-265c-45bb-a22b-af24b3c89ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:55.717637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38105104-265c-45bb-a22b-af24b3c89ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:55.717810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38105104-265c-45bb-a22b-af24b3c89ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:55.719608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01337d84-cf18-47a2-8767-50d42be7e915 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:55.733675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:55.739475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38105104-265c-45bb-a22b-af24b3c89ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:55.741307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38105104-265c-45bb-a22b-af24b3c89ca7 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:55.742157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e622958-2657-47b7-b6f5-5cf826fe79c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:55.743097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e622958-2657-47b7-b6f5-5cf826fe79c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:55.743557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e622958-2657-47b7-b6f5-5cf826fe79c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:55.744025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e622958-2657-47b7-b6f5-5cf826fe79c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:55.744874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e622958-2657-47b7-b6f5-5cf826fe79c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:55.746950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e622958-2657-47b7-b6f5-5cf826fe79c6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:55.754691 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1173/2314] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:39:55.756185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38105104-265c-45bb-a22b-af24b3c89ca7 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:55.758036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-38105104-265c-45bb-a22b-af24b3c89ca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:55.776500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38105104-265c-45bb-a22b-af24b3c89ca7 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:55.789372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53cf6e-f9d0-4810-ba6b-012b3ee485b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:55.793632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53cf6e-f9d0-4810-ba6b-012b3ee485b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:55.794997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53cf6e-f9d0-4810-ba6b-012b3ee485b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:55.795470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53cf6e-f9d0-4810-ba6b-012b3ee485b7 admin admin] PATH_INFO: `/v3/users/460d695601d74cdbbe5b3f6560907fa4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:55.800912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53cf6e-f9d0-4810-ba6b-012b3ee485b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=460d695601d74cdbbe5b3f6560907fa4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:55.805043 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1142/2315] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:55.810282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e622958-2657-47b7-b6f5-5cf826fe79c6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:55.811967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53cf6e-f9d0-4810-ba6b-012b3ee485b7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:55.852374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e622958-2657-47b7-b6f5-5cf826fe79c6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:55.871423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb399fd-ea80-4ba8-8b11-92bfc13ab797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:55.875071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb399fd-ea80-4ba8-8b11-92bfc13ab797 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:55.875071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb399fd-ea80-4ba8-8b11-92bfc13ab797 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:55.875071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb399fd-ea80-4ba8-8b11-92bfc13ab797 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:55.875071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb399fd-ea80-4ba8-8b11-92bfc13ab797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:55.876804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb399fd-ea80-4ba8-8b11-92bfc13ab797 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:55.897768 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1143/2316] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:55.906112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb399fd-ea80-4ba8-8b11-92bfc13ab797 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:55.933234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb399fd-ea80-4ba8-8b11-92bfc13ab797 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:55.950001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c9146-8944-4339-9bc5-05f93a39fe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:55.952848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9146-8944-4339-9bc5-05f93a39fe6b admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:55.961930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9146-8944-4339-9bc5-05f93a39fe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:55.967448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9146-8944-4339-9bc5-05f93a39fe6b admin admin] PATH_INFO: `/v3/projects/7690f1c669934b5f8cac0ccb02d846b3/users/bd847880c4e34c519a7f8f97277da277/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:56.005169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c9146-8944-4339-9bc5-05f93a39fe6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7690f1c669934b5f8cac0ccb02d846b3, user_id=bd847880c4e34c519a7f8f97277da277, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:56.008035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c9146-8944-4339-9bc5-05f93a39fe6b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:56.090860 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1144/2317] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:55 2022] PUT /identity/v3/projects/7690f1c669934b5f8cac0ccb02d846b3/users/bd847880c4e34c519a7f8f97277da277/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:56.105499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0064e4b-946e-433e-949f-3505a0bfd7b4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:56.105778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0064e4b-946e-433e-949f-3505a0bfd7b4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:56.106072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0064e4b-946e-433e-949f-3505a0bfd7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:56.110711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3d53cf6e-f9d0-4810-ba6b-012b3ee485b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460d695601d74cdbbe5b3f6560907fa4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:56.112012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3d53cf6e-f9d0-4810-ba6b-012b3ee485b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460d695601d74cdbbe5b3f6560907fa4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:56.159307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a0064e4b-946e-433e-949f-3505a0bfd7b4 None None] MFA Rules not processed for user `bd847880c4e34c519a7f8f97277da277`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:56.167893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a0064e4b-946e-433e-949f-3505a0bfd7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:56.208081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3d53cf6e-f9d0-4810-ba6b-012b3ee485b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460d695601d74cdbbe5b3f6560907fa4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:56.212765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3d53cf6e-f9d0-4810-ba6b-012b3ee485b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460d695601d74cdbbe5b3f6560907fa4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:56.242654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3d53cf6e-f9d0-4810-ba6b-012b3ee485b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460d695601d74cdbbe5b3f6560907fa4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:56.282316 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1174/2318] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:55 2022] DELETE /identity/v3/users/460d695601d74cdbbe5b3f6560907fa4 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:56.282316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53cf6e-f9d0-4810-ba6b-012b3ee485b7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:56.282316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3d53cf6e-f9d0-4810-ba6b-012b3ee485b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:56.390244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:56.392341 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1145/2319] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:56.395413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0064e4b-946e-433e-949f-3505a0bfd7b4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:56.397995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a0064e4b-946e-433e-949f-3505a0bfd7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:56.461575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53cf6e-f9d0-4810-ba6b-012b3ee485b7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:56.478992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44fb83-3a43-46e9-a5d5-a6f7b57cc03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:56.479693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44fb83-3a43-46e9-a5d5-a6f7b57cc03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:56.479977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44fb83-3a43-46e9-a5d5-a6f7b57cc03a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:56.480284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44fb83-3a43-46e9-a5d5-a6f7b57cc03a admin admin] PATH_INFO: `/v3/users/a8e0435efb844bc59166293ec9ee40d0` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:56.481575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44fb83-3a43-46e9-a5d5-a6f7b57cc03a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e0435efb844bc59166293ec9ee40d0)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:56.485483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44fb83-3a43-46e9-a5d5-a6f7b57cc03a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:56.569704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0064e4b-946e-433e-949f-3505a0bfd7b4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:56.594054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e73227-5071-4fe5-9976-11dc0ef95159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:56.595998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e73227-5071-4fe5-9976-11dc0ef95159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:56.595998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e73227-5071-4fe5-9976-11dc0ef95159 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:56.595998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e73227-5071-4fe5-9976-11dc0ef95159 admin admin] PATH_INFO: `/v3/users/5491012f862d41a787f1a84aeecb8b28` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:56.596773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e73227-5071-4fe5-9976-11dc0ef95159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5491012f862d41a787f1a84aeecb8b28)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:56.599200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e73227-5071-4fe5-9976-11dc0ef95159 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:56.741536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2a44fb83-3a43-46e9-a5d5-a6f7b57cc03a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e0435efb844bc59166293ec9ee40d0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:56.745978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2a44fb83-3a43-46e9-a5d5-a6f7b57cc03a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e0435efb844bc59166293ec9ee40d0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:56.791289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:56.875967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2a44fb83-3a43-46e9-a5d5-a6f7b57cc03a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e0435efb844bc59166293ec9ee40d0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:56.876863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2a44fb83-3a43-46e9-a5d5-a6f7b57cc03a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e0435efb844bc59166293ec9ee40d0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:56.907300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2a44fb83-3a43-46e9-a5d5-a6f7b57cc03a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e0435efb844bc59166293ec9ee40d0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:56.921229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-63e73227-5071-4fe5-9976-11dc0ef95159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5491012f862d41a787f1a84aeecb8b28'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:56.979896 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1175/2320] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:56 2022] DELETE /identity/v3/users/a8e0435efb844bc59166293ec9ee40d0 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:56.984497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738111e-1b4b-4bcb-92ba-5a902409071e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:56.984792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738111e-1b4b-4bcb-92ba-5a902409071e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:56.985075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738111e-1b4b-4bcb-92ba-5a902409071e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:56.995436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-63e73227-5071-4fe5-9976-11dc0ef95159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5491012f862d41a787f1a84aeecb8b28'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:56.996721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-63e73227-5071-4fe5-9976-11dc0ef95159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5491012f862d41a787f1a84aeecb8b28'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:57.018375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-63e73227-5071-4fe5-9976-11dc0ef95159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5491012f862d41a787f1a84aeecb8b28'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:57.047907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7738111e-1b4b-4bcb-92ba-5a902409071e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:57.052949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7738111e-1b4b-4bcb-92ba-5a902409071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:57.066917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-63e73227-5071-4fe5-9976-11dc0ef95159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5491012f862d41a787f1a84aeecb8b28'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:57.083076 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1146/2321] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:56 2022] DELETE /identity/v3/users/5491012f862d41a787f1a84aeecb8b28 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:57.087085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e73227-5071-4fe5-9976-11dc0ef95159 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:57.090129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-63e73227-5071-4fe5-9976-11dc0ef95159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:57.244273 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1176/2322] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:57.247017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738111e-1b4b-4bcb-92ba-5a902409071e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:57.251431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7738111e-1b4b-4bcb-92ba-5a902409071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:57.277023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738111e-1b4b-4bcb-92ba-5a902409071e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:57.285752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e73227-5071-4fe5-9976-11dc0ef95159 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:57.304717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:57.309542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9745e2-ec2e-4781-a148-9fde0d009eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:57.310446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9745e2-ec2e-4781-a148-9fde0d009eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:57.310800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9745e2-ec2e-4781-a148-9fde0d009eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:57.311529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9745e2-ec2e-4781-a148-9fde0d009eb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:57.313104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9745e2-ec2e-4781-a148-9fde0d009eb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:57.316500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44822d13-f069-4b91-b8f8-60e66d3eea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:57.320007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44822d13-f069-4b91-b8f8-60e66d3eea6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:57.320812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44822d13-f069-4b91-b8f8-60e66d3eea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:57.322564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44822d13-f069-4b91-b8f8-60e66d3eea6b admin admin] PATH_INFO: `/v3/projects/dae5eca5a049462aa50c42ecaf08241e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:57.322981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9745e2-ec2e-4781-a148-9fde0d009eb1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:57.324642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44822d13-f069-4b91-b8f8-60e66d3eea6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae5eca5a049462aa50c42ecaf08241e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:57.328551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44822d13-f069-4b91-b8f8-60e66d3eea6b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:57.442724 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1147/2323] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:57 2022] POST /identity/v3/projects => generated 387 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:57.450974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186e4b4-f5d4-4644-975f-0bbc93fe73b3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:57.454604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186e4b4-f5d4-4644-975f-0bbc93fe73b3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:57.456525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186e4b4-f5d4-4644-975f-0bbc93fe73b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:57.521116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3186e4b4-f5d4-4644-975f-0bbc93fe73b3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:57.522877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3186e4b4-f5d4-4644-975f-0bbc93fe73b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:57.592491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-44822d13-f069-4b91-b8f8-60e66d3eea6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae5eca5a049462aa50c42ecaf08241e', 'request_id': 'req-44822d13-f069-4b91-b8f8-60e66d3eea6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:57.629107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-44822d13-f069-4b91-b8f8-60e66d3eea6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae5eca5a049462aa50c42ecaf08241e', 'request_id': 'req-44822d13-f069-4b91-b8f8-60e66d3eea6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:57.729837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-44822d13-f069-4b91-b8f8-60e66d3eea6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae5eca5a049462aa50c42ecaf08241e', 'request_id': 'req-44822d13-f069-4b91-b8f8-60e66d3eea6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:57.769736 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1148/2324] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:57.771531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-44822d13-f069-4b91-b8f8-60e66d3eea6b admin admin] The token cache is being invalidate because project dae5eca5a049462aa50c42ecaf08241e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:57.771828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-44822d13-f069-4b91-b8f8-60e66d3eea6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:57.774245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-44822d13-f069-4b91-b8f8-60e66d3eea6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:57.775425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186e4b4-f5d4-4644-975f-0bbc93fe73b3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:57.778356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3186e4b4-f5d4-4644-975f-0bbc93fe73b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:57.783102 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1177/2325] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:57 2022] DELETE /identity/v3/projects/dae5eca5a049462aa50c42ecaf08241e => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:57.791765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44822d13-f069-4b91-b8f8-60e66d3eea6b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:57.794233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-44822d13-f069-4b91-b8f8-60e66d3eea6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:57.994174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186e4b4-f5d4-4644-975f-0bbc93fe73b3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:58.002591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44822d13-f069-4b91-b8f8-60e66d3eea6b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:58.015948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:58.016919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0a71a-eb69-43be-a8cf-19df39ffd004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:58.019467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0a71a-eb69-43be-a8cf-19df39ffd004 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:58.020891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0a71a-eb69-43be-a8cf-19df39ffd004 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:58.023015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0a71a-eb69-43be-a8cf-19df39ffd004 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:58.024516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0a71a-eb69-43be-a8cf-19df39ffd004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:58.027564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0a71a-eb69-43be-a8cf-19df39ffd004 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:58.102506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853a741-9cd5-4808-a0fc-fe8add69e7b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:58.103392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853a741-9cd5-4808-a0fc-fe8add69e7b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:58.103821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853a741-9cd5-4808-a0fc-fe8add69e7b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:58.104298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853a741-9cd5-4808-a0fc-fe8add69e7b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:58.106319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d853a741-9cd5-4808-a0fc-fe8add69e7b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:58.135937 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1178/2326] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:57 2022] POST /identity/v3/users => generated 300 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:58.136922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0a71a-eb69-43be-a8cf-19df39ffd004 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:58.139707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-51f0a71a-eb69-43be-a8cf-19df39ffd004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:58.143281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853a741-9cd5-4808-a0fc-fe8add69e7b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:58.145253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853a741-9cd5-4808-a0fc-fe8add69e7b0 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:58.168032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0a71a-eb69-43be-a8cf-19df39ffd004 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:58.178894 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1149/2327] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:58.180637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853a741-9cd5-4808-a0fc-fe8add69e7b0 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:58.185185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d853a741-9cd5-4808-a0fc-fe8add69e7b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:58.188547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68f19d-72d3-4c8e-8b15-4f967145e5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:58.191432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68f19d-72d3-4c8e-8b15-4f967145e5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:58.192094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68f19d-72d3-4c8e-8b15-4f967145e5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:58.193761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68f19d-72d3-4c8e-8b15-4f967145e5b4 admin admin] PATH_INFO: `/v3/users/f5eba8a8f8a14ffa9131e612cb76a98e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:58.197640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68f19d-72d3-4c8e-8b15-4f967145e5b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5eba8a8f8a14ffa9131e612cb76a98e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:58.208475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68f19d-72d3-4c8e-8b15-4f967145e5b4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:58.218012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853a741-9cd5-4808-a0fc-fe8add69e7b0 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:58.240081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e430e-5def-427b-b53c-9780b143bdf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:58.240743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e430e-5def-427b-b53c-9780b143bdf5 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:58.241019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e430e-5def-427b-b53c-9780b143bdf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:58.241481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e430e-5def-427b-b53c-9780b143bdf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:58.245821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b21e430e-5def-427b-b53c-9780b143bdf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:58.288096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e430e-5def-427b-b53c-9780b143bdf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:58.290641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e430e-5def-427b-b53c-9780b143bdf5 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:58.315377 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1150/2328] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:39:58.316305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e430e-5def-427b-b53c-9780b143bdf5 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:58.317681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b21e430e-5def-427b-b53c-9780b143bdf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:58.331175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e430e-5def-427b-b53c-9780b143bdf5 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:58.336054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2e76a-2836-4626-8e31-90bd0597d486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:58.336734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2e76a-2836-4626-8e31-90bd0597d486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:58.337012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2e76a-2836-4626-8e31-90bd0597d486 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:58.337280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2e76a-2836-4626-8e31-90bd0597d486 admin admin] PATH_INFO: `/v3/projects/102c34e4c00d4db4bcdfdfbbffd8992c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:58.338458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2e76a-2836-4626-8e31-90bd0597d486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=102c34e4c00d4db4bcdfdfbbffd8992c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:58.340443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2e76a-2836-4626-8e31-90bd0597d486 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:58.396492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:58.503456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9c68f19d-72d3-4c8e-8b15-4f967145e5b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5eba8a8f8a14ffa9131e612cb76a98e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:58.504642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9c68f19d-72d3-4c8e-8b15-4f967145e5b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5eba8a8f8a14ffa9131e612cb76a98e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:58.607505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9c68f19d-72d3-4c8e-8b15-4f967145e5b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5eba8a8f8a14ffa9131e612cb76a98e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:58.610288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9c68f19d-72d3-4c8e-8b15-4f967145e5b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5eba8a8f8a14ffa9131e612cb76a98e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:58.666181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9c68f19d-72d3-4c8e-8b15-4f967145e5b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5eba8a8f8a14ffa9131e612cb76a98e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:58.693101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8d2e76a-2836-4626-8e31-90bd0597d486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102c34e4c00d4db4bcdfdfbbffd8992c', 'request_id': 'req-e8d2e76a-2836-4626-8e31-90bd0597d486'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:58.707219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8d2e76a-2836-4626-8e31-90bd0597d486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102c34e4c00d4db4bcdfdfbbffd8992c', 'request_id': 'req-e8d2e76a-2836-4626-8e31-90bd0597d486'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:58.713053 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1179/2329] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:39:58 2022] DELETE /identity/v3/users/f5eba8a8f8a14ffa9131e612cb76a98e => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:58.716685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68f19d-72d3-4c8e-8b15-4f967145e5b4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:58.722067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8d2e76a-2836-4626-8e31-90bd0597d486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102c34e4c00d4db4bcdfdfbbffd8992c', 'request_id': 'req-e8d2e76a-2836-4626-8e31-90bd0597d486'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:58.723512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9c68f19d-72d3-4c8e-8b15-4f967145e5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:58.813044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8d2e76a-2836-4626-8e31-90bd0597d486 admin admin] The token cache is being invalidate because project 102c34e4c00d4db4bcdfdfbbffd8992c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:39:58.813333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8d2e76a-2836-4626-8e31-90bd0597d486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:58.818037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8d2e76a-2836-4626-8e31-90bd0597d486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:39:58.823169 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1151/2330] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:39:58 2022] DELETE /identity/v3/projects/102c34e4c00d4db4bcdfdfbbffd8992c => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:58.825522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c75dd-d022-4a66-b1f5-09f1a481ff76 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:58.831990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c75dd-d022-4a66-b1f5-09f1a481ff76 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:58.831990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c75dd-d022-4a66-b1f5-09f1a481ff76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:58.901875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5e1c75dd-d022-4a66-b1f5-09f1a481ff76 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:58.902305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5e1c75dd-d022-4a66-b1f5-09f1a481ff76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:58.928653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68f19d-72d3-4c8e-8b15-4f967145e5b4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:58.937033 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1152/2331] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:39:58.950791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627683d-d60b-4260-919c-9c196d5a5c81 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:58.958315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627683d-d60b-4260-919c-9c196d5a5c81 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:58.958315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627683d-d60b-4260-919c-9c196d5a5c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:58.966937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5c001-7d2e-4b87-812d-6149f78fc136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:58.967156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5c001-7d2e-4b87-812d-6149f78fc136 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:58.967406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5c001-7d2e-4b87-812d-6149f78fc136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:58.967675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5c001-7d2e-4b87-812d-6149f78fc136 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:58.969447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5c001-7d2e-4b87-812d-6149f78fc136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:58.973351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5c001-7d2e-4b87-812d-6149f78fc136 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:59.030613 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1180/2332] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:59.039524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5c001-7d2e-4b87-812d-6149f78fc136 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:59.041673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a627683d-d60b-4260-919c-9c196d5a5c81 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:59.043182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a627683d-d60b-4260-919c-9c196d5a5c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:59.045560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-34b5c001-7d2e-4b87-812d-6149f78fc136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:59.082248 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1153/2333] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:39:59.087918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627683d-d60b-4260-919c-9c196d5a5c81 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:59.099618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5c001-7d2e-4b87-812d-6149f78fc136 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:59.112291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627683d-d60b-4260-919c-9c196d5a5c81 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:59.122192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab9ce0-0c42-45f4-bbe8-13f439f159c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:59.122192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab9ce0-0c42-45f4-bbe8-13f439f159c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:59.122192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab9ce0-0c42-45f4-bbe8-13f439f159c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:59.122192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab9ce0-0c42-45f4-bbe8-13f439f159c1 admin admin] PATH_INFO: `/v3/projects/6454543c9d204a7eb912ae27787e9613/users/0296b052d5ae4df3bdb36e809b5cf825/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:59.140266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7951ed5-fe2b-49c1-9f85-13c1289ae2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:59.141238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7951ed5-fe2b-49c1-9f85-13c1289ae2de admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:59.141238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7951ed5-fe2b-49c1-9f85-13c1289ae2de admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:59.141448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7951ed5-fe2b-49c1-9f85-13c1289ae2de admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:59.142127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7951ed5-fe2b-49c1-9f85-13c1289ae2de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:39:59.142431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7951ed5-fe2b-49c1-9f85-13c1289ae2de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:59.144581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7951ed5-fe2b-49c1-9f85-13c1289ae2de admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:59.162166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab9ce0-0c42-45f4-bbe8-13f439f159c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6454543c9d204a7eb912ae27787e9613, user_id=0296b052d5ae4df3bdb36e809b5cf825, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:59.166514 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1154/2334] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:39:59.168960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab9ce0-0c42-45f4-bbe8-13f439f159c1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:59.178010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7951ed5-fe2b-49c1-9f85-13c1289ae2de admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:59.243948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7951ed5-fe2b-49c1-9f85-13c1289ae2de admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:59.265333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7bf2e-b773-4f47-87f6-daf0d6989590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:59.265926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7bf2e-b773-4f47-87f6-daf0d6989590 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:59.275809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7bf2e-b773-4f47-87f6-daf0d6989590 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:59.275809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7bf2e-b773-4f47-87f6-daf0d6989590 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:59.275809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7bf2e-b773-4f47-87f6-daf0d6989590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:59.276125 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1181/2335] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:59 2022] PUT /identity/v3/projects/6454543c9d204a7eb912ae27787e9613/users/0296b052d5ae4df3bdb36e809b5cf825/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:39:59.276240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7bf2e-b773-4f47-87f6-daf0d6989590 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:59.277870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab9ce0-0c42-45f4-bbe8-13f439f159c1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:59.316198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:59.379701 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1155/2336] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:39:59 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:59.381449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7bf2e-b773-4f47-87f6-daf0d6989590 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:59.395537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab9ce0-0c42-45f4-bbe8-13f439f159c1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:59.572150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d008e46-a4a7-42e0-8a84-bfce750ef2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:59.575672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d008e46-a4a7-42e0-8a84-bfce750ef2cd admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:59.575988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d008e46-a4a7-42e0-8a84-bfce750ef2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:59.576279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d008e46-a4a7-42e0-8a84-bfce750ef2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:59.580314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d008e46-a4a7-42e0-8a84-bfce750ef2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:59.591762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:39:59.600468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d008e46-a4a7-42e0-8a84-bfce750ef2cd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:59.617180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7bf2e-b773-4f47-87f6-daf0d6989590 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:59.633695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08772f3a-07bf-4153-a21b-233fc3bfec94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:59.634396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08772f3a-07bf-4153-a21b-233fc3bfec94 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:59.634622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08772f3a-07bf-4153-a21b-233fc3bfec94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:59.634895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08772f3a-07bf-4153-a21b-233fc3bfec94 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:59.637779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08772f3a-07bf-4153-a21b-233fc3bfec94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:59.644570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08772f3a-07bf-4153-a21b-233fc3bfec94 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:59.655553 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1182/2337] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:59.659554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d008e46-a4a7-42e0-8a84-bfce750ef2cd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:59.711164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d008e46-a4a7-42e0-8a84-bfce750ef2cd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:59.728901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac0b3f-950c-4e3f-8c42-9569fb7e0cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:59.730730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac0b3f-950c-4e3f-8c42-9569fb7e0cce admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:59.730730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac0b3f-950c-4e3f-8c42-9569fb7e0cce admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:59.731907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac0b3f-950c-4e3f-8c42-9569fb7e0cce admin admin] PATH_INFO: `/v3/projects/6454543c9d204a7eb912ae27787e9613/users/0296b052d5ae4df3bdb36e809b5cf825/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:59.739523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac0b3f-950c-4e3f-8c42-9569fb7e0cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6454543c9d204a7eb912ae27787e9613, user_id=0296b052d5ae4df3bdb36e809b5cf825, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:59.749248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac0b3f-950c-4e3f-8c42-9569fb7e0cce admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:59.769878 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1156/2338] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:39:59 2022] POST /identity/v3/users => generated 291 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:39:59.774192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08772f3a-07bf-4153-a21b-233fc3bfec94 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:39:59.782553 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1183/2339] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:39:59 2022] PUT /identity/v3/projects/6454543c9d204a7eb912ae27787e9613/users/0296b052d5ae4df3bdb36e809b5cf825/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:39:59.794644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb76a-ce98-434b-b229-308b89417aca None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:59.794922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb76a-ce98-434b-b229-308b89417aca None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:59.795194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb76a-ce98-434b-b229-308b89417aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:59.798492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08772f3a-07bf-4153-a21b-233fc3bfec94 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:39:59.880068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f67cb76a-ce98-434b-b229-308b89417aca None None] MFA Rules not processed for user `0296b052d5ae4df3bdb36e809b5cf825`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:39:59.883220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f67cb76a-ce98-434b-b229-308b89417aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:39:59.956121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce2c1e-f617-4601-8602-d648951c4bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:39:59.956831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce2c1e-f617-4601-8602-d648951c4bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:39:59.957192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce2c1e-f617-4601-8602-d648951c4bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:39:59.957373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce2c1e-f617-4601-8602-d648951c4bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:39:59.958133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce2c1e-f617-4601-8602-d648951c4bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:39:59.966481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce2c1e-f617-4601-8602-d648951c4bd6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:39:59.987706 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1157/2340] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:39:59.989566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce2c1e-f617-4601-8602-d648951c4bd6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:00.010538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce2c1e-f617-4601-8602-d648951c4bd6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:00.027540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e95f08-124e-4092-ae8d-febb83df71bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:00.032691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e95f08-124e-4092-ae8d-febb83df71bd admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:00.032691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e95f08-124e-4092-ae8d-febb83df71bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:00.032691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e95f08-124e-4092-ae8d-febb83df71bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:00.032691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e95f08-124e-4092-ae8d-febb83df71bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:00.036699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e95f08-124e-4092-ae8d-febb83df71bd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:00.051798 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1184/2341] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:39:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:00.053146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cb76a-ce98-434b-b229-308b89417aca None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:00.058173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f67cb76a-ce98-434b-b229-308b89417aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:00.083105 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1158/2342] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:00.083105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e95f08-124e-4092-ae8d-febb83df71bd admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:00.090728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-70e95f08-124e-4092-ae8d-febb83df71bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:00.108739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cb76a-ce98-434b-b229-308b89417aca None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:00.118727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29897b33-2df0-4d2a-bba4-51eb88f9aef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:00.119384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29897b33-2df0-4d2a-bba4-51eb88f9aef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:00.121272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29897b33-2df0-4d2a-bba4-51eb88f9aef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:00.124086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:00.125162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29897b33-2df0-4d2a-bba4-51eb88f9aef1 admin admin] PATH_INFO: `/v3/projects/3260003f727e4758bd94829754848349` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:00.127602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29897b33-2df0-4d2a-bba4-51eb88f9aef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3260003f727e4758bd94829754848349)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:00.139985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29897b33-2df0-4d2a-bba4-51eb88f9aef1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:00.229870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:00.329151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e95f08-124e-4092-ae8d-febb83df71bd admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:00.347817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-29897b33-2df0-4d2a-bba4-51eb88f9aef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3260003f727e4758bd94829754848349', 'request_id': 'req-29897b33-2df0-4d2a-bba4-51eb88f9aef1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:00.371307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-29897b33-2df0-4d2a-bba4-51eb88f9aef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3260003f727e4758bd94829754848349', 'request_id': 'req-29897b33-2df0-4d2a-bba4-51eb88f9aef1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:00.515890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043677e0-6995-41e6-a500-67c0a76846b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:00.516555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043677e0-6995-41e6-a500-67c0a76846b6 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:00.516837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043677e0-6995-41e6-a500-67c0a76846b6 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:00.517103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043677e0-6995-41e6-a500-67c0a76846b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:00.521030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-29897b33-2df0-4d2a-bba4-51eb88f9aef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3260003f727e4758bd94829754848349', 'request_id': 'req-29897b33-2df0-4d2a-bba4-51eb88f9aef1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:00.541694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-29897b33-2df0-4d2a-bba4-51eb88f9aef1 admin admin] The token cache is being invalidate because project 3260003f727e4758bd94829754848349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:00.544849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-29897b33-2df0-4d2a-bba4-51eb88f9aef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:00.547548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-29897b33-2df0-4d2a-bba4-51eb88f9aef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:00.552230 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1185/2343] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:00 2022] DELETE /identity/v3/projects/3260003f727e4758bd94829754848349 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:00.555144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29897b33-2df0-4d2a-bba4-51eb88f9aef1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:00.559434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-29897b33-2df0-4d2a-bba4-51eb88f9aef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:00.704865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043677e0-6995-41e6-a500-67c0a76846b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:00.709756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043677e0-6995-41e6-a500-67c0a76846b6 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:00.742370 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1159/2344] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:00.748157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29897b33-2df0-4d2a-bba4-51eb88f9aef1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:00.749722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043677e0-6995-41e6-a500-67c0a76846b6 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:00.759089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-043677e0-6995-41e6-a500-67c0a76846b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:00.761731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4938809-79e3-49af-86b0-a887ae635958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:00.762576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4938809-79e3-49af-86b0-a887ae635958 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:00.762860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4938809-79e3-49af-86b0-a887ae635958 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:00.763146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4938809-79e3-49af-86b0-a887ae635958 admin admin] PATH_INFO: `/v3/projects/2936c03bbeee48a585b66453179cba76/users/284ca0eca1c04f948354125f33d1c308/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:00.789470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043677e0-6995-41e6-a500-67c0a76846b6 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:00.811606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132e296-35e2-413e-8fbf-28a1b8c0b24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:00.814087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132e296-35e2-413e-8fbf-28a1b8c0b24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:00.814399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132e296-35e2-413e-8fbf-28a1b8c0b24d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:00.815315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132e296-35e2-413e-8fbf-28a1b8c0b24d admin admin] PATH_INFO: `/v3/projects/9698589ac2984c589f2a357cf753b3f1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:00.819320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4938809-79e3-49af-86b0-a887ae635958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2936c03bbeee48a585b66453179cba76, user_id=284ca0eca1c04f948354125f33d1c308, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:00.822744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132e296-35e2-413e-8fbf-28a1b8c0b24d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9698589ac2984c589f2a357cf753b3f1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:00.826604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4938809-79e3-49af-86b0-a887ae635958 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:00.832857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132e296-35e2-413e-8fbf-28a1b8c0b24d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:00.903119 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1186/2345] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:00 2022] PUT /identity/v3/projects/2936c03bbeee48a585b66453179cba76/users/284ca0eca1c04f948354125f33d1c308/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:00.903895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4938809-79e3-49af-86b0-a887ae635958 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:00.915984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c4938809-79e3-49af-86b0-a887ae635958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:01.092827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:01.120434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9132e296-35e2-413e-8fbf-28a1b8c0b24d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9698589ac2984c589f2a357cf753b3f1', 'request_id': 'req-9132e296-35e2-413e-8fbf-28a1b8c0b24d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:01.145637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9132e296-35e2-413e-8fbf-28a1b8c0b24d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9698589ac2984c589f2a357cf753b3f1', 'request_id': 'req-9132e296-35e2-413e-8fbf-28a1b8c0b24d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:01.163865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9132e296-35e2-413e-8fbf-28a1b8c0b24d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9698589ac2984c589f2a357cf753b3f1', 'request_id': 'req-9132e296-35e2-413e-8fbf-28a1b8c0b24d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:01.165127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4938809-79e3-49af-86b0-a887ae635958 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:01.210116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:01.288271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9132e296-35e2-413e-8fbf-28a1b8c0b24d admin admin] The token cache is being invalidate because project 9698589ac2984c589f2a357cf753b3f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:01.288569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9132e296-35e2-413e-8fbf-28a1b8c0b24d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:01.302280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9132e296-35e2-413e-8fbf-28a1b8c0b24d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:01.302280 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1160/2346] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:00 2022] DELETE /identity/v3/projects/9698589ac2984c589f2a357cf753b3f1 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:01.302280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132e296-35e2-413e-8fbf-28a1b8c0b24d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:01.302280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9132e296-35e2-413e-8fbf-28a1b8c0b24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:01.365832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7366fa-96ea-44ed-af99-dccf0f4bd62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:01.367793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7366fa-96ea-44ed-af99-dccf0f4bd62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:01.371163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7366fa-96ea-44ed-af99-dccf0f4bd62b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:01.371666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7366fa-96ea-44ed-af99-dccf0f4bd62b admin admin] PATH_INFO: `/v3/users/2f856b20e1964ce38e4d60e6bb8f2859` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:01.381364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7366fa-96ea-44ed-af99-dccf0f4bd62b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f856b20e1964ce38e4d60e6bb8f2859)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:01.400755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7366fa-96ea-44ed-af99-dccf0f4bd62b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:01.500904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132e296-35e2-413e-8fbf-28a1b8c0b24d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:01.522031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295ca1d-e8e4-4e4b-83bc-f788782a382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:01.523069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295ca1d-e8e4-4e4b-83bc-f788782a382f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:01.523903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295ca1d-e8e4-4e4b-83bc-f788782a382f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:01.524579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295ca1d-e8e4-4e4b-83bc-f788782a382f admin admin] PATH_INFO: `/v3/projects/05ffa52411954891bff423a45852eed0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:01.527500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295ca1d-e8e4-4e4b-83bc-f788782a382f admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ffa52411954891bff423a45852eed0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:01.531228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295ca1d-e8e4-4e4b-83bc-f788782a382f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:01.688975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:01.694674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d7366fa-96ea-44ed-af99-dccf0f4bd62b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f856b20e1964ce38e4d60e6bb8f2859'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:01.694674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d7366fa-96ea-44ed-af99-dccf0f4bd62b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f856b20e1964ce38e4d60e6bb8f2859'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:01.701494 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4295ca1d-e8e4-4e4b-83bc-f788782a382f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ffa52411954891bff423a45852eed0', 'request_id': 'req-4295ca1d-e8e4-4e4b-83bc-f788782a382f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:01.713615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4295ca1d-e8e4-4e4b-83bc-f788782a382f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ffa52411954891bff423a45852eed0', 'request_id': 'req-4295ca1d-e8e4-4e4b-83bc-f788782a382f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:01.721613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4295ca1d-e8e4-4e4b-83bc-f788782a382f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ffa52411954891bff423a45852eed0', 'request_id': 'req-4295ca1d-e8e4-4e4b-83bc-f788782a382f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:01.824543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d7366fa-96ea-44ed-af99-dccf0f4bd62b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f856b20e1964ce38e4d60e6bb8f2859'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:01.826095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d7366fa-96ea-44ed-af99-dccf0f4bd62b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f856b20e1964ce38e4d60e6bb8f2859'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:01.854340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d7366fa-96ea-44ed-af99-dccf0f4bd62b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f856b20e1964ce38e4d60e6bb8f2859'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:01.887643 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1187/2347] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:40:00 2022] DELETE /identity/v3/users/2f856b20e1964ce38e4d60e6bb8f2859 => generated 0 bytes in 984 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:01.888972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d32e8b-2810-412b-ab75-c33326747f92 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:01.889362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d32e8b-2810-412b-ab75-c33326747f92 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:01.889743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d32e8b-2810-412b-ab75-c33326747f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:01.957165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-19d32e8b-2810-412b-ab75-c33326747f92 None None] MFA Rules not processed for user `284ca0eca1c04f948354125f33d1c308`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:01.964254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-19d32e8b-2810-412b-ab75-c33326747f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:01.970347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4295ca1d-e8e4-4e4b-83bc-f788782a382f admin admin] The token cache is being invalidate because project 05ffa52411954891bff423a45852eed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:01.971480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4295ca1d-e8e4-4e4b-83bc-f788782a382f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:01.972868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4295ca1d-e8e4-4e4b-83bc-f788782a382f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:01.977201 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1161/2348] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:01 2022] DELETE /identity/v3/projects/05ffa52411954891bff423a45852eed0 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:01.978413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295ca1d-e8e4-4e4b-83bc-f788782a382f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:01.984649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4295ca1d-e8e4-4e4b-83bc-f788782a382f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:02.144668 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1188/2349] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:02.147034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387d2d-3e4a-483c-a7d2-630044e355cd None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:02.160757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387d2d-3e4a-483c-a7d2-630044e355cd None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:02.160757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387d2d-3e4a-483c-a7d2-630044e355cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:02.184056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295ca1d-e8e4-4e4b-83bc-f788782a382f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:02.198042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d2387d2d-3e4a-483c-a7d2-630044e355cd None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:02.201791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d2387d2d-3e4a-483c-a7d2-630044e355cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:02.332046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c724b0d-d3f6-41fa-af94-30abcef48052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:02.332799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c724b0d-d3f6-41fa-af94-30abcef48052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:02.333078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c724b0d-d3f6-41fa-af94-30abcef48052 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:02.333354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c724b0d-d3f6-41fa-af94-30abcef48052 admin admin] PATH_INFO: `/v3/users/7c00083f8691424e813cccbe2ba1bd71` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:02.334640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c724b0d-d3f6-41fa-af94-30abcef48052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c00083f8691424e813cccbe2ba1bd71)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:02.337796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c724b0d-d3f6-41fa-af94-30abcef48052 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:02.375255 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1189/2350] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:02.379634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4774-e473-434d-9e69-b28d65175697 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:02.381578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4774-e473-434d-9e69-b28d65175697 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:02.382202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4774-e473-434d-9e69-b28d65175697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:02.433231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-dc8e4774-e473-434d-9e69-b28d65175697 None None] MFA Rules not processed for user `284ca0eca1c04f948354125f33d1c308`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:02.437293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dc8e4774-e473-434d-9e69-b28d65175697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:02.464381 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1190/2351] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:02.476914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cc143-c8b2-409f-9701-8cb6b97d544a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:02.476914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cc143-c8b2-409f-9701-8cb6b97d544a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:02.476914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cc143-c8b2-409f-9701-8cb6b97d544a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:02.505087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a90cc143-c8b2-409f-9701-8cb6b97d544a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:02.508917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a90cc143-c8b2-409f-9701-8cb6b97d544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:02.521726 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1191/2352] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:02.523098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cc143-c8b2-409f-9701-8cb6b97d544a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:02.524734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a90cc143-c8b2-409f-9701-8cb6b97d544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:02.628513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3c724b0d-d3f6-41fa-af94-30abcef48052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c00083f8691424e813cccbe2ba1bd71'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:02.738701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3c724b0d-d3f6-41fa-af94-30abcef48052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c00083f8691424e813cccbe2ba1bd71'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:02.739589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3c724b0d-d3f6-41fa-af94-30abcef48052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c00083f8691424e813cccbe2ba1bd71'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:02.752635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3c724b0d-d3f6-41fa-af94-30abcef48052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c00083f8691424e813cccbe2ba1bd71'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:02.798947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3c724b0d-d3f6-41fa-af94-30abcef48052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c00083f8691424e813cccbe2ba1bd71'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:02.812414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cc143-c8b2-409f-9701-8cb6b97d544a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:02.816371 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1162/2353] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:40:01 2022] DELETE /identity/v3/users/7c00083f8691424e813cccbe2ba1bd71 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:02.817399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c724b0d-d3f6-41fa-af94-30abcef48052 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:02.822067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3c724b0d-d3f6-41fa-af94-30abcef48052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:02.979601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f591462-0769-419f-a69d-4ead0650d149 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:02.980269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f591462-0769-419f-a69d-4ead0650d149 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:02.980551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f591462-0769-419f-a69d-4ead0650d149 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:02.981411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f591462-0769-419f-a69d-4ead0650d149 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:02.983634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0f591462-0769-419f-a69d-4ead0650d149 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:03.076249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f591462-0769-419f-a69d-4ead0650d149 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:03.078916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c724b0d-d3f6-41fa-af94-30abcef48052 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:03.079768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f591462-0769-419f-a69d-4ead0650d149 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:03.098580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4d859-f83e-4631-b5fd-813434a4c669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:03.099219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4d859-f83e-4631-b5fd-813434a4c669 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:03.099502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4d859-f83e-4631-b5fd-813434a4c669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:03.099870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4d859-f83e-4631-b5fd-813434a4c669 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:03.101056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4d859-f83e-4631-b5fd-813434a4c669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:40:03.101056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4d859-f83e-4631-b5fd-813434a4c669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:03.108239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4d859-f83e-4631-b5fd-813434a4c669 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:03.129248 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1192/2354] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:03.156587 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1163/2355] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:40:03.157847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f591462-0769-419f-a69d-4ead0650d149 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:03.182406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f591462-0769-419f-a69d-4ead0650d149 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:03.195099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61b2a9-c37b-4b14-a96f-9e8359f43c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:03.195901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61b2a9-c37b-4b14-a96f-9e8359f43c64 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:03.196791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61b2a9-c37b-4b14-a96f-9e8359f43c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:03.197217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61b2a9-c37b-4b14-a96f-9e8359f43c64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:03.206663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61b2a9-c37b-4b14-a96f-9e8359f43c64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:03.211838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61b2a9-c37b-4b14-a96f-9e8359f43c64 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:03.344888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:03.347812 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1193/2356] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:03 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:03.348695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4d859-f83e-4631-b5fd-813434a4c669 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:03.379190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4d859-f83e-4631-b5fd-813434a4c669 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:03.578537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db90d13-99e9-4e99-a05f-01e4b4a5a097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:03.583537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db90d13-99e9-4e99-a05f-01e4b4a5a097 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:03.584716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db90d13-99e9-4e99-a05f-01e4b4a5a097 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:03.585660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f389b85-92b6-4b68-abca-c33f17c89085 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:03.586006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f389b85-92b6-4b68-abca-c33f17c89085 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:03.588959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f389b85-92b6-4b68-abca-c33f17c89085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:03.589125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db90d13-99e9-4e99-a05f-01e4b4a5a097 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:03.589125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db90d13-99e9-4e99-a05f-01e4b4a5a097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:03.603582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db90d13-99e9-4e99-a05f-01e4b4a5a097 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:03.684649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8f389b85-92b6-4b68-abca-c33f17c89085 None None] MFA Rules not processed for user `95a5ea624f3247f4ad47068013e03d40`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:03.687302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8f389b85-92b6-4b68-abca-c33f17c89085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:03.699971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:03.722941 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1164/2357] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:03 2022] POST /identity/v3/users => generated 294 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:03.726682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db90d13-99e9-4e99-a05f-01e4b4a5a097 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:03.737784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5db90d13-99e9-4e99-a05f-01e4b4a5a097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:03.761955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db90d13-99e9-4e99-a05f-01e4b4a5a097 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:03.782956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585be79-4491-4d54-8b2c-29990e290360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:03.784292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585be79-4491-4d54-8b2c-29990e290360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:03.792458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585be79-4491-4d54-8b2c-29990e290360 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:03.792458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585be79-4491-4d54-8b2c-29990e290360 admin admin] PATH_INFO: `/v3/users/bd847880c4e34c519a7f8f97277da277` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:03.793206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585be79-4491-4d54-8b2c-29990e290360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd847880c4e34c519a7f8f97277da277)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:03.802974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585be79-4491-4d54-8b2c-29990e290360 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:03.868999 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1194/2358] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:03.870049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f389b85-92b6-4b68-abca-c33f17c89085 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:03.901025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f389b85-92b6-4b68-abca-c33f17c89085 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:03.918702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9288e-71ec-445f-a3da-b07e20e3b180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:03.919543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9288e-71ec-445f-a3da-b07e20e3b180 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:03.929990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9288e-71ec-445f-a3da-b07e20e3b180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:03.930419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9288e-71ec-445f-a3da-b07e20e3b180 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:03.931204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9288e-71ec-445f-a3da-b07e20e3b180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:03.946442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9288e-71ec-445f-a3da-b07e20e3b180 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:03.971682 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1195/2359] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:03.972879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9288e-71ec-445f-a3da-b07e20e3b180 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:03.974626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d5a9288e-71ec-445f-a3da-b07e20e3b180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:04.019724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3585be79-4491-4d54-8b2c-29990e290360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd847880c4e34c519a7f8f97277da277'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:04.022172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9288e-71ec-445f-a3da-b07e20e3b180 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:04.053085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66816399-1c52-4612-b38c-8571866c8623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:04.054199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66816399-1c52-4612-b38c-8571866c8623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:04.054666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66816399-1c52-4612-b38c-8571866c8623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:04.055086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66816399-1c52-4612-b38c-8571866c8623 admin admin] PATH_INFO: `/v3/projects/a66264cd9ee44c5aa506cd280e01b6ba` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:04.058078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66816399-1c52-4612-b38c-8571866c8623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a66264cd9ee44c5aa506cd280e01b6ba)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:04.062123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66816399-1c52-4612-b38c-8571866c8623 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:04.150572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3585be79-4491-4d54-8b2c-29990e290360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd847880c4e34c519a7f8f97277da277'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:04.151288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3585be79-4491-4d54-8b2c-29990e290360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd847880c4e34c519a7f8f97277da277'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:04.163630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3585be79-4491-4d54-8b2c-29990e290360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd847880c4e34c519a7f8f97277da277'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:04.192052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3585be79-4491-4d54-8b2c-29990e290360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd847880c4e34c519a7f8f97277da277'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:04.202916 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1165/2360] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:40:03 2022] DELETE /identity/v3/users/bd847880c4e34c519a7f8f97277da277 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:04.205939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585be79-4491-4d54-8b2c-29990e290360 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:04.207492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3585be79-4491-4d54-8b2c-29990e290360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:04.311571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-66816399-1c52-4612-b38c-8571866c8623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a66264cd9ee44c5aa506cd280e01b6ba', 'request_id': 'req-66816399-1c52-4612-b38c-8571866c8623'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:04.324712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-66816399-1c52-4612-b38c-8571866c8623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a66264cd9ee44c5aa506cd280e01b6ba', 'request_id': 'req-66816399-1c52-4612-b38c-8571866c8623'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:04.345666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585be79-4491-4d54-8b2c-29990e290360 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:04.350434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:04.393078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-66816399-1c52-4612-b38c-8571866c8623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a66264cd9ee44c5aa506cd280e01b6ba', 'request_id': 'req-66816399-1c52-4612-b38c-8571866c8623'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:04.413756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-66816399-1c52-4612-b38c-8571866c8623 admin admin] The token cache is being invalidate because project a66264cd9ee44c5aa506cd280e01b6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:04.414559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-66816399-1c52-4612-b38c-8571866c8623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:04.415650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-66816399-1c52-4612-b38c-8571866c8623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:04.421864 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1196/2361] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:03 2022] DELETE /identity/v3/projects/a66264cd9ee44c5aa506cd280e01b6ba => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:04.423163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66816399-1c52-4612-b38c-8571866c8623 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:04.425681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-66816399-1c52-4612-b38c-8571866c8623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:04.441008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25f308-25a5-44b2-95fa-1c5cf69ecb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:04.445060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25f308-25a5-44b2-95fa-1c5cf69ecb5d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:04.445870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25f308-25a5-44b2-95fa-1c5cf69ecb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:04.446299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25f308-25a5-44b2-95fa-1c5cf69ecb5d admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:04.451790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25f308-25a5-44b2-95fa-1c5cf69ecb5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:04.454249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25f308-25a5-44b2-95fa-1c5cf69ecb5d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:04.527562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:04.538592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66816399-1c52-4612-b38c-8571866c8623 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:04.545101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb3ff9-16c0-4375-a315-d8efb263fecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:04.545996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb3ff9-16c0-4375-a315-d8efb263fecc admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:04.546288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb3ff9-16c0-4375-a315-d8efb263fecc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:04.546982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb3ff9-16c0-4375-a315-d8efb263fecc admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:04.547356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb3ff9-16c0-4375-a315-d8efb263fecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:04.552824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb3ff9-16c0-4375-a315-d8efb263fecc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:04.565961 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1197/2362] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:04.567281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7908e75-affc-4fd7-902f-fe76c2ea3912 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:04.567708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7908e75-affc-4fd7-902f-fe76c2ea3912 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:04.567987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7908e75-affc-4fd7-902f-fe76c2ea3912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:04.592786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d7908e75-affc-4fd7-902f-fe76c2ea3912 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:04.594078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d7908e75-affc-4fd7-902f-fe76c2ea3912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:04.604933 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1198/2363] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:04.608633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7908e75-affc-4fd7-902f-fe76c2ea3912 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:04.609836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d7908e75-affc-4fd7-902f-fe76c2ea3912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:04.613610 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1166/2364] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:04 2022] POST /identity/v3/projects => generated 385 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:04.618255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f89ff9-93c9-4fa0-970b-881745b24c9d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:04.618527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f89ff9-93c9-4fa0-970b-881745b24c9d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:04.622039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f89ff9-93c9-4fa0-970b-881745b24c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:04.632020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7908e75-affc-4fd7-902f-fe76c2ea3912 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:04.681322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-37f89ff9-93c9-4fa0-970b-881745b24c9d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:04.684850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-37f89ff9-93c9-4fa0-970b-881745b24c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:04.725083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9385c-d57b-4c0f-979a-cf632ed8bda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:04.725956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9385c-d57b-4c0f-979a-cf632ed8bda4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:04.726343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9385c-d57b-4c0f-979a-cf632ed8bda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:04.726953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9385c-d57b-4c0f-979a-cf632ed8bda4 admin admin] PATH_INFO: `/v3/projects/a009574aaba144b7912f5dbc5173dc42` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:04.729908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9385c-d57b-4c0f-979a-cf632ed8bda4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a009574aaba144b7912f5dbc5173dc42)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:04.755323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9385c-d57b-4c0f-979a-cf632ed8bda4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:04.776885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:04.835260 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1167/2365] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:04.836330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:04.836572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f89ff9-93c9-4fa0-970b-881745b24c9d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:04.874178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f89ff9-93c9-4fa0-970b-881745b24c9d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:04.880824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb02e7-405b-46f3-8899-59617615218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:04.881700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb02e7-405b-46f3-8899-59617615218e admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:04.882250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb02e7-405b-46f3-8899-59617615218e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:04.883761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb02e7-405b-46f3-8899-59617615218e admin admin] PATH_INFO: `/v3/projects/3bc95c4104b3460290278eec9645eef2/users/1286e699d1304edfa8710a141b78355b/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:04.902479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb02e7-405b-46f3-8899-59617615218e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc95c4104b3460290278eec9645eef2, user_id=1286e699d1304edfa8710a141b78355b, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:04.905618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb02e7-405b-46f3-8899-59617615218e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:04.980675 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1168/2366] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:04 2022] PUT /identity/v3/projects/3bc95c4104b3460290278eec9645eef2/users/1286e699d1304edfa8710a141b78355b/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:04.984319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb02e7-405b-46f3-8899-59617615218e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:04.988877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aabb02e7-405b-46f3-8899-59617615218e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:05.000590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-57e9385c-d57b-4c0f-979a-cf632ed8bda4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a009574aaba144b7912f5dbc5173dc42', 'request_id': 'req-57e9385c-d57b-4c0f-979a-cf632ed8bda4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:05.013622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-57e9385c-d57b-4c0f-979a-cf632ed8bda4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a009574aaba144b7912f5dbc5173dc42', 'request_id': 'req-57e9385c-d57b-4c0f-979a-cf632ed8bda4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:05.114321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-57e9385c-d57b-4c0f-979a-cf632ed8bda4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a009574aaba144b7912f5dbc5173dc42', 'request_id': 'req-57e9385c-d57b-4c0f-979a-cf632ed8bda4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:05.133546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-57e9385c-d57b-4c0f-979a-cf632ed8bda4 admin admin] The token cache is being invalidate because project a009574aaba144b7912f5dbc5173dc42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:05.133837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-57e9385c-d57b-4c0f-979a-cf632ed8bda4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:05.136733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-57e9385c-d57b-4c0f-979a-cf632ed8bda4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:05.139677 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1199/2367] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:04 2022] DELETE /identity/v3/projects/a009574aaba144b7912f5dbc5173dc42 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:05.141356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9385c-d57b-4c0f-979a-cf632ed8bda4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:05.144502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-57e9385c-d57b-4c0f-979a-cf632ed8bda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:05.161875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb02e7-405b-46f3-8899-59617615218e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:05.250175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9385c-d57b-4c0f-979a-cf632ed8bda4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:05.266265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16339c-24da-4c8d-95aa-1c40a0c99293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:05.267297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16339c-24da-4c8d-95aa-1c40a0c99293 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:05.268063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16339c-24da-4c8d-95aa-1c40a0c99293 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:05.268582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16339c-24da-4c8d-95aa-1c40a0c99293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:05.271883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ab16339c-24da-4c8d-95aa-1c40a0c99293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:05.284122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d426df3-ca13-425e-95ec-e1f0563ce154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:05.285347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426df3-ca13-425e-95ec-e1f0563ce154 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:05.285831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426df3-ca13-425e-95ec-e1f0563ce154 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:05.286180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426df3-ca13-425e-95ec-e1f0563ce154 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:05.287136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d426df3-ca13-425e-95ec-e1f0563ce154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:05.289459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d426df3-ca13-425e-95ec-e1f0563ce154 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:05.350859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16339c-24da-4c8d-95aa-1c40a0c99293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:05.352741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16339c-24da-4c8d-95aa-1c40a0c99293 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:05.364501 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1200/2368] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:05.374706 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1169/2369] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:04 2022] POST /identity/v3/users => generated 299 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:05.377860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2dd18-4ff8-4e87-9751-c9bed66c3986 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:05.378148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2dd18-4ff8-4e87-9751-c9bed66c3986 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:05.378418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2dd18-4ff8-4e87-9751-c9bed66c3986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:05.379336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719585-4d60-4648-96c1-1598075b1317 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:05.379630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719585-4d60-4648-96c1-1598075b1317 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:05.379897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719585-4d60-4648-96c1-1598075b1317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:05.416565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5e719585-4d60-4648-96c1-1598075b1317 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:05.417800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5e719585-4d60-4648-96c1-1598075b1317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:05.428888 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1201/2370] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:05.430245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4418d-de9e-4206-a2ad-9e62cdffff0d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:05.430596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4418d-de9e-4206-a2ad-9e62cdffff0d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:05.430812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4418d-de9e-4206-a2ad-9e62cdffff0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:05.431706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-44c2dd18-4ff8-4e87-9751-c9bed66c3986 None None] MFA Rules not processed for user `1286e699d1304edfa8710a141b78355b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:05.434101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-44c2dd18-4ff8-4e87-9751-c9bed66c3986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:05.462925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f8e4418d-de9e-4206-a2ad-9e62cdffff0d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:05.464805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f8e4418d-de9e-4206-a2ad-9e62cdffff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:05.474915 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1202/2371] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:05.477020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe15a1-d097-446a-8c0e-e628ae8ece50 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:05.477020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe15a1-d097-446a-8c0e-e628ae8ece50 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:05.477020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe15a1-d097-446a-8c0e-e628ae8ece50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:05.524857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-fdbe15a1-d097-446a-8c0e-e628ae8ece50 None None] MFA Rules not processed for user `01471a5a05de4b149fb04f13cf0e66b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:05.526951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fdbe15a1-d097-446a-8c0e-e628ae8ece50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:05.540668 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1170/2372] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:05.541872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2dd18-4ff8-4e87-9751-c9bed66c3986 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:05.543791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-44c2dd18-4ff8-4e87-9751-c9bed66c3986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:05.579265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2dd18-4ff8-4e87-9751-c9bed66c3986 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:05.589472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f3ec9-9678-4967-8ab6-ca9edb61649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:05.590493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f3ec9-9678-4967-8ab6-ca9edb61649b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:05.591570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f3ec9-9678-4967-8ab6-ca9edb61649b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:05.592070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f3ec9-9678-4967-8ab6-ca9edb61649b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:05.593718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f3ec9-9678-4967-8ab6-ca9edb61649b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:05.596186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f3ec9-9678-4967-8ab6-ca9edb61649b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:05.612003 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1171/2373] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:05.613454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f3ec9-9678-4967-8ab6-ca9edb61649b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:05.625133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f3ec9-9678-4967-8ab6-ca9edb61649b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:05.631279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa593d3-350c-41a8-bfb2-55924d4bb7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:05.631900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa593d3-350c-41a8-bfb2-55924d4bb7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:05.634266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa593d3-350c-41a8-bfb2-55924d4bb7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:05.634543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa593d3-350c-41a8-bfb2-55924d4bb7d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:05.635212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa593d3-350c-41a8-bfb2-55924d4bb7d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:40:05.635520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa593d3-350c-41a8-bfb2-55924d4bb7d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:05.637267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa593d3-350c-41a8-bfb2-55924d4bb7d3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:05.652938 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1172/2374] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:40:05.654497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8e42e-15f4-405b-83c1-07cd1a21f341 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:05.654788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8e42e-15f4-405b-83c1-07cd1a21f341 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:05.655062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8e42e-15f4-405b-83c1-07cd1a21f341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:05.656682 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1203/2375] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:05 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:05.660139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe15a1-d097-446a-8c0e-e628ae8ece50 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:05.661851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fdbe15a1-d097-446a-8c0e-e628ae8ece50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:05.672636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:05.684762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe15a1-d097-446a-8c0e-e628ae8ece50 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:05.691044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5db8e42e-15f4-405b-83c1-07cd1a21f341 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:05.692241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5db8e42e-15f4-405b-83c1-07cd1a21f341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:05.696014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c1b3c-fba1-4a8e-a955-96c31eee0f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:05.697897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c1b3c-fba1-4a8e-a955-96c31eee0f12 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:05.698536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c1b3c-fba1-4a8e-a955-96c31eee0f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:05.698874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c1b3c-fba1-4a8e-a955-96c31eee0f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:05.701978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c1b3c-fba1-4a8e-a955-96c31eee0f12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:05.701978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c1b3c-fba1-4a8e-a955-96c31eee0f12 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:05.711067 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1173/2376] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:05.711982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8e42e-15f4-405b-83c1-07cd1a21f341 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:05.730775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8e42e-15f4-405b-83c1-07cd1a21f341 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:05.737030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff7ca3-992b-48bc-9228-68c519e60c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:05.737948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff7ca3-992b-48bc-9228-68c519e60c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:05.738447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff7ca3-992b-48bc-9228-68c519e60c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:05.738811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff7ca3-992b-48bc-9228-68c519e60c7a admin admin] PATH_INFO: `/v3/projects/987059a7976d45cbbc3b3dfc6c09dafd/users/987b1209e9b24505a2b173834b2d4e15/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:05.766193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff7ca3-992b-48bc-9228-68c519e60c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=987059a7976d45cbbc3b3dfc6c09dafd, user_id=987b1209e9b24505a2b173834b2d4e15, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:05.770960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff7ca3-992b-48bc-9228-68c519e60c7a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:05.857331 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1174/2377] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:05 2022] PUT /identity/v3/projects/987059a7976d45cbbc3b3dfc6c09dafd/users/987b1209e9b24505a2b173834b2d4e15/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:05.858320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff7ca3-992b-48bc-9228-68c519e60c7a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:05.866982 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1204/2378] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:05 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:05.873067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c1b3c-fba1-4a8e-a955-96c31eee0f12 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:05.886431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f66c1b3c-fba1-4a8e-a955-96c31eee0f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:05.974588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff7ca3-992b-48bc-9228-68c519e60c7a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:05.991162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:06.069336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c1b3c-fba1-4a8e-a955-96c31eee0f12 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:06.073819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba172a0-1ee8-4ff9-bd4e-77cbd1bdd888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:06.074738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba172a0-1ee8-4ff9-bd4e-77cbd1bdd888 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:06.075024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba172a0-1ee8-4ff9-bd4e-77cbd1bdd888 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:06.075300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba172a0-1ee8-4ff9-bd4e-77cbd1bdd888 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:06.076947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba172a0-1ee8-4ff9-bd4e-77cbd1bdd888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:06.077992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451ef94-c670-47a8-b290-db64dcb124a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:06.078907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451ef94-c670-47a8-b290-db64dcb124a0 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:06.079043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba172a0-1ee8-4ff9-bd4e-77cbd1bdd888 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:06.079451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451ef94-c670-47a8-b290-db64dcb124a0 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:06.079970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451ef94-c670-47a8-b290-db64dcb124a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:06.083202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4451ef94-c670-47a8-b290-db64dcb124a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:06.158996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451ef94-c670-47a8-b290-db64dcb124a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:06.160613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451ef94-c670-47a8-b290-db64dcb124a0 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:06.171114 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1205/2379] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:05 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:06.172071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451ef94-c670-47a8-b290-db64dcb124a0 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:06.176154 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1175/2380] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:05 2022] POST /identity/v3/projects => generated 391 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:06.177277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba172a0-1ee8-4ff9-bd4e-77cbd1bdd888 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:06.194121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451ef94-c670-47a8-b290-db64dcb124a0 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:06.281121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431f078-5b62-4774-8bdc-d53889d9b099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:06.282135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431f078-5b62-4774-8bdc-d53889d9b099 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:06.282420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431f078-5b62-4774-8bdc-d53889d9b099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:06.282698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431f078-5b62-4774-8bdc-d53889d9b099 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:06.283405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431f078-5b62-4774-8bdc-d53889d9b099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:40:06.283665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431f078-5b62-4774-8bdc-d53889d9b099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:06.285721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431f078-5b62-4774-8bdc-d53889d9b099 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:06.289571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba172a0-1ee8-4ff9-bd4e-77cbd1bdd888 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:06.303044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b86802-b051-4e70-a753-f1d946cb1c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:06.307622 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1206/2381] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:40:06.307771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b86802-b051-4e70-a753-f1d946cb1c3b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:06.307874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431f078-5b62-4774-8bdc-d53889d9b099 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:06.307990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b86802-b051-4e70-a753-f1d946cb1c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:06.307990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b86802-b051-4e70-a753-f1d946cb1c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:06.307990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b86802-b051-4e70-a753-f1d946cb1c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:06.307990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b86802-b051-4e70-a753-f1d946cb1c3b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:06.322611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431f078-5b62-4774-8bdc-d53889d9b099 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:06.327347 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1176/2382] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:06.328390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b86802-b051-4e70-a753-f1d946cb1c3b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:06.329819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56b30f-bee2-46f6-88a4-c2b6962ead97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:06.330335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b0b86802-b051-4e70-a753-f1d946cb1c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:06.333702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56b30f-bee2-46f6-88a4-c2b6962ead97 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:06.333702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56b30f-bee2-46f6-88a4-c2b6962ead97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:06.333702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56b30f-bee2-46f6-88a4-c2b6962ead97 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:06.334925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56b30f-bee2-46f6-88a4-c2b6962ead97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:06.337411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56b30f-bee2-46f6-88a4-c2b6962ead97 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:06.348400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b86802-b051-4e70-a753-f1d946cb1c3b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:06.354119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed181f96-f8eb-452a-9218-2c8e63e70a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:06.355934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed181f96-f8eb-452a-9218-2c8e63e70a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:06.355934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed181f96-f8eb-452a-9218-2c8e63e70a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:06.355934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed181f96-f8eb-452a-9218-2c8e63e70a24 admin admin] PATH_INFO: `/v3/projects/7690f1c669934b5f8cac0ccb02d846b3` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:06.356825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed181f96-f8eb-452a-9218-2c8e63e70a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7690f1c669934b5f8cac0ccb02d846b3)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:06.359180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed181f96-f8eb-452a-9218-2c8e63e70a24 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:06.444237 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1207/2383] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:06 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:06.444237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56b30f-bee2-46f6-88a4-c2b6962ead97 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:06.454843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56b30f-bee2-46f6-88a4-c2b6962ead97 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:06.460092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b47cd5-c9fe-4439-ad2d-5e179d75bb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:06.460729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b47cd5-c9fe-4439-ad2d-5e179d75bb5b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:06.463559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b47cd5-c9fe-4439-ad2d-5e179d75bb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:06.463853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b47cd5-c9fe-4439-ad2d-5e179d75bb5b admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:06.464545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b47cd5-c9fe-4439-ad2d-5e179d75bb5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:06.466670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b47cd5-c9fe-4439-ad2d-5e179d75bb5b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:06.484895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ed181f96-f8eb-452a-9218-2c8e63e70a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7690f1c669934b5f8cac0ccb02d846b3', 'request_id': 'req-ed181f96-f8eb-452a-9218-2c8e63e70a24'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:06.491857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ed181f96-f8eb-452a-9218-2c8e63e70a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7690f1c669934b5f8cac0ccb02d846b3', 'request_id': 'req-ed181f96-f8eb-452a-9218-2c8e63e70a24'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:06.501699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ed181f96-f8eb-452a-9218-2c8e63e70a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7690f1c669934b5f8cac0ccb02d846b3', 'request_id': 'req-ed181f96-f8eb-452a-9218-2c8e63e70a24'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:06.561799 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1208/2384] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:06 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:06.563069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b47cd5-c9fe-4439-ad2d-5e179d75bb5b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:06.564921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-26b47cd5-c9fe-4439-ad2d-5e179d75bb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:06.580540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ed181f96-f8eb-452a-9218-2c8e63e70a24 admin admin] The token cache is being invalidate because project 7690f1c669934b5f8cac0ccb02d846b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:06.580945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ed181f96-f8eb-452a-9218-2c8e63e70a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:06.581903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ed181f96-f8eb-452a-9218-2c8e63e70a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:06.587579 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1177/2385] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:06 2022] DELETE /identity/v3/projects/7690f1c669934b5f8cac0ccb02d846b3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:06.588473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed181f96-f8eb-452a-9218-2c8e63e70a24 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:06.590079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ed181f96-f8eb-452a-9218-2c8e63e70a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:06.684332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed181f96-f8eb-452a-9218-2c8e63e70a24 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:06.694201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401694e-5215-4307-bb5c-f94013d86306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:06.695170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401694e-5215-4307-bb5c-f94013d86306 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:06.695458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401694e-5215-4307-bb5c-f94013d86306 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:06.697937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401694e-5215-4307-bb5c-f94013d86306 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:06.700821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b47cd5-c9fe-4439-ad2d-5e179d75bb5b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:06.700957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401694e-5215-4307-bb5c-f94013d86306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:06.703174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401694e-5215-4307-bb5c-f94013d86306 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:06.796314 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1178/2386] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:06 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:06.796314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401694e-5215-4307-bb5c-f94013d86306 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:06.801493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:06.803845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0401694e-5215-4307-bb5c-f94013d86306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:06.811991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee7276-658e-4108-bbcb-dcfd6902cb15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:06.814860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee7276-658e-4108-bbcb-dcfd6902cb15 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:06.814860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee7276-658e-4108-bbcb-dcfd6902cb15 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:06.814860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee7276-658e-4108-bbcb-dcfd6902cb15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:06.815938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-48ee7276-658e-4108-bbcb-dcfd6902cb15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:06.895829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401694e-5215-4307-bb5c-f94013d86306 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:06.901408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585755d-cf3b-4c2c-a521-dd6b6f4eaa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:06.902085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585755d-cf3b-4c2c-a521-dd6b6f4eaa3b admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:06.902466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585755d-cf3b-4c2c-a521-dd6b6f4eaa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:06.902637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585755d-cf3b-4c2c-a521-dd6b6f4eaa3b admin admin] PATH_INFO: `/v3/projects/987059a7976d45cbbc3b3dfc6c09dafd/users/987b1209e9b24505a2b173834b2d4e15/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:06.903415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee7276-658e-4108-bbcb-dcfd6902cb15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:06.904988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585755d-cf3b-4c2c-a521-dd6b6f4eaa3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=987059a7976d45cbbc3b3dfc6c09dafd, user_id=987b1209e9b24505a2b173834b2d4e15, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:06.905630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee7276-658e-4108-bbcb-dcfd6902cb15 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:06.908921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585755d-cf3b-4c2c-a521-dd6b6f4eaa3b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:06.924334 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1179/2387] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:06 2022] PUT /identity/v3/projects/987059a7976d45cbbc3b3dfc6c09dafd/users/987b1209e9b24505a2b173834b2d4e15/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:06.925724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585755d-cf3b-4c2c-a521-dd6b6f4eaa3b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:06.927963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9585755d-cf3b-4c2c-a521-dd6b6f4eaa3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:06.932536 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1209/2388] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:06 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:06.934778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee7276-658e-4108-bbcb-dcfd6902cb15 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:06.936647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-48ee7276-658e-4108-bbcb-dcfd6902cb15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:06.954806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:06.955554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee7276-658e-4108-bbcb-dcfd6902cb15 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:07.041964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079a317-3617-416d-89c2-95a47a5d677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:07.044142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079a317-3617-416d-89c2-95a47a5d677a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:07.045635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079a317-3617-416d-89c2-95a47a5d677a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:07.046012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079a317-3617-416d-89c2-95a47a5d677a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:07.046776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079a317-3617-416d-89c2-95a47a5d677a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:07.048530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079a317-3617-416d-89c2-95a47a5d677a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:07.094132 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1210/2389] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:07.098567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079a317-3617-416d-89c2-95a47a5d677a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:07.105060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3079a317-3617-416d-89c2-95a47a5d677a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:07.164771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079a317-3617-416d-89c2-95a47a5d677a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:07.184979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585755d-cf3b-4c2c-a521-dd6b6f4eaa3b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:07.186228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf4acd-5791-45c0-ae8d-1be04858eb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:07.188871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf4acd-5791-45c0-ae8d-1be04858eb8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:07.195670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf4acd-5791-45c0-ae8d-1be04858eb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:07.196071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf4acd-5791-45c0-ae8d-1be04858eb8a admin admin] PATH_INFO: `/v3/users/0296b052d5ae4df3bdb36e809b5cf825` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:07.198629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf4acd-5791-45c0-ae8d-1be04858eb8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0296b052d5ae4df3bdb36e809b5cf825)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:07.200611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf4acd-5791-45c0-ae8d-1be04858eb8a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:07.200923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10de9f2-4e4c-4ef9-813a-ccdea49f50cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:07.201661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10de9f2-4e4c-4ef9-813a-ccdea49f50cb admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:07.202210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10de9f2-4e4c-4ef9-813a-ccdea49f50cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:07.202586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10de9f2-4e4c-4ef9-813a-ccdea49f50cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:07.203349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10de9f2-4e4c-4ef9-813a-ccdea49f50cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:07.207793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10de9f2-4e4c-4ef9-813a-ccdea49f50cb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:07.226772 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1180/2390] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:07.226772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10de9f2-4e4c-4ef9-813a-ccdea49f50cb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:07.258011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10de9f2-4e4c-4ef9-813a-ccdea49f50cb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:07.274709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa507c9c-906f-4bca-af5b-dd4ece40bd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:07.275783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa507c9c-906f-4bca-af5b-dd4ece40bd73 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:07.276187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa507c9c-906f-4bca-af5b-dd4ece40bd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:07.276704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa507c9c-906f-4bca-af5b-dd4ece40bd73 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:07.277521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa507c9c-906f-4bca-af5b-dd4ece40bd73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:07.281841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa507c9c-906f-4bca-af5b-dd4ece40bd73 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:07.400432 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1181/2391] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:07 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:07.402757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa507c9c-906f-4bca-af5b-dd4ece40bd73 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:07.427584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa507c9c-906f-4bca-af5b-dd4ece40bd73 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:07.453272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cddf4acd-5791-45c0-ae8d-1be04858eb8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0296b052d5ae4df3bdb36e809b5cf825'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:07.454595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a0728-79de-48d2-8980-7ea53e0eab72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:07.456301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cddf4acd-5791-45c0-ae8d-1be04858eb8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0296b052d5ae4df3bdb36e809b5cf825'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:07.457273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a0728-79de-48d2-8980-7ea53e0eab72 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:07.457760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a0728-79de-48d2-8980-7ea53e0eab72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:07.459675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a0728-79de-48d2-8980-7ea53e0eab72 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:07.460592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a0728-79de-48d2-8980-7ea53e0eab72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:07.464450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a0728-79de-48d2-8980-7ea53e0eab72 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:07.498855 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1182/2392] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:07.500500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a0728-79de-48d2-8980-7ea53e0eab72 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:07.532054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a0728-79de-48d2-8980-7ea53e0eab72 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:07.539510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46434f-7f37-4a50-8e58-6c3bc3769ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:07.540319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46434f-7f37-4a50-8e58-6c3bc3769ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:07.540681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46434f-7f37-4a50-8e58-6c3bc3769ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:07.541041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46434f-7f37-4a50-8e58-6c3bc3769ceb admin admin] PATH_INFO: `/v3/projects/a8eae55425674a53b3a6c1ef8f339c50/users/2c75163e50924369986503cfc238ccc7/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:07.550320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cddf4acd-5791-45c0-ae8d-1be04858eb8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0296b052d5ae4df3bdb36e809b5cf825'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:07.551293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cddf4acd-5791-45c0-ae8d-1be04858eb8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0296b052d5ae4df3bdb36e809b5cf825'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:07.581725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46434f-7f37-4a50-8e58-6c3bc3769ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8eae55425674a53b3a6c1ef8f339c50, user_id=2c75163e50924369986503cfc238ccc7, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:07.588650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46434f-7f37-4a50-8e58-6c3bc3769ceb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:07.596606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cddf4acd-5791-45c0-ae8d-1be04858eb8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0296b052d5ae4df3bdb36e809b5cf825'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:07.623299 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1211/2393] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:40:07 2022] DELETE /identity/v3/users/0296b052d5ae4df3bdb36e809b5cf825 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:07.624094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf4acd-5791-45c0-ae8d-1be04858eb8a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:07.625869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cddf4acd-5791-45c0-ae8d-1be04858eb8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:07.667443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:07.678410 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1183/2394] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:07 2022] PUT /identity/v3/projects/a8eae55425674a53b3a6c1ef8f339c50/users/2c75163e50924369986503cfc238ccc7/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:07.679435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46434f-7f37-4a50-8e58-6c3bc3769ceb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:07.682767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4e46434f-7f37-4a50-8e58-6c3bc3769ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:07.806992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf4acd-5791-45c0-ae8d-1be04858eb8a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:07.866988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46434f-7f37-4a50-8e58-6c3bc3769ceb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:07.883540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f116ec1-1d92-4829-bd29-19ecee5c2d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:07.884573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f116ec1-1d92-4829-bd29-19ecee5c2d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:07.887371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f116ec1-1d92-4829-bd29-19ecee5c2d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:07.887371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f116ec1-1d92-4829-bd29-19ecee5c2d14 admin admin] PATH_INFO: `/v3/projects/89b1cc4e6d084e15a1011ac667271532/users/3ca4cefa885248bfbaf9cc0de9549402/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:07.929744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f116ec1-1d92-4829-bd29-19ecee5c2d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b1cc4e6d084e15a1011ac667271532, user_id=3ca4cefa885248bfbaf9cc0de9549402, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:07.939709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f116ec1-1d92-4829-bd29-19ecee5c2d14 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:07.947080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:07.959011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b43ed4-9db0-469b-9321-5932b385540e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:07.959677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b43ed4-9db0-469b-9321-5932b385540e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:07.959964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b43ed4-9db0-469b-9321-5932b385540e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:07.960284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b43ed4-9db0-469b-9321-5932b385540e admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:07.960943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b43ed4-9db0-469b-9321-5932b385540e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:07.964116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b43ed4-9db0-469b-9321-5932b385540e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:07.981623 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1212/2395] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:07.983142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b43ed4-9db0-469b-9321-5932b385540e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:07.989734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a3b43ed4-9db0-469b-9321-5932b385540e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:08.008758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b43ed4-9db0-469b-9321-5932b385540e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:08.015684 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1184/2396] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:07 2022] PUT /identity/v3/projects/89b1cc4e6d084e15a1011ac667271532/users/3ca4cefa885248bfbaf9cc0de9549402/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:08.017134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f116ec1-1d92-4829-bd29-19ecee5c2d14 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:08.189083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf1388-e507-4d59-bee3-3fd4068480d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:08.189083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf1388-e507-4d59-bee3-3fd4068480d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:08.189083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf1388-e507-4d59-bee3-3fd4068480d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:08.189083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf1388-e507-4d59-bee3-3fd4068480d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:08.190655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf1388-e507-4d59-bee3-3fd4068480d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:08.190655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf1388-e507-4d59-bee3-3fd4068480d0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:08.195976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f116ec1-1d92-4829-bd29-19ecee5c2d14 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:08.214414 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1213/2397] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:08.214414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef6a68-d01f-4434-995f-981dcfdbbf0c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:08.214414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef6a68-d01f-4434-995f-981dcfdbbf0c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:08.214414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef6a68-d01f-4434-995f-981dcfdbbf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:08.214768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41b1aa-f9fb-4571-b5cc-dab429dabd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:08.214768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41b1aa-f9fb-4571-b5cc-dab429dabd95 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:08.214768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41b1aa-f9fb-4571-b5cc-dab429dabd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:08.214768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41b1aa-f9fb-4571-b5cc-dab429dabd95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:08.216532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41b1aa-f9fb-4571-b5cc-dab429dabd95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:08.221532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41b1aa-f9fb-4571-b5cc-dab429dabd95 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:08.280053 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1185/2398] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:08.280053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41b1aa-f9fb-4571-b5cc-dab429dabd95 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:08.295777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41b1aa-f9fb-4571-b5cc-dab429dabd95 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:08.297811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b3ef6a68-d01f-4434-995f-981dcfdbbf0c None None] MFA Rules not processed for user `3ca4cefa885248bfbaf9cc0de9549402`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:08.300551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b3ef6a68-d01f-4434-995f-981dcfdbbf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:08.310554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c9538-8a7f-4cad-a5a0-bedae88bda8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:08.311154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c9538-8a7f-4cad-a5a0-bedae88bda8d admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:08.311429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c9538-8a7f-4cad-a5a0-bedae88bda8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:08.311701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c9538-8a7f-4cad-a5a0-bedae88bda8d admin admin] PATH_INFO: `/v3/projects/a8eae55425674a53b3a6c1ef8f339c50/users/2c75163e50924369986503cfc238ccc7/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:08.315054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c9538-8a7f-4cad-a5a0-bedae88bda8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8eae55425674a53b3a6c1ef8f339c50, user_id=2c75163e50924369986503cfc238ccc7, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:08.321457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c9538-8a7f-4cad-a5a0-bedae88bda8d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:08.355859 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1186/2399] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:08 2022] PUT /identity/v3/projects/a8eae55425674a53b3a6c1ef8f339c50/users/2c75163e50924369986503cfc238ccc7/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:08.357318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c9538-8a7f-4cad-a5a0-bedae88bda8d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:08.416537 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1214/2400] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:08.418678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d3bc2-ac52-47b3-a6b5-883d03e33ad4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:08.418678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d3bc2-ac52-47b3-a6b5-883d03e33ad4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:08.422704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d3bc2-ac52-47b3-a6b5-883d03e33ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:08.498664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-cd8d3bc2-ac52-47b3-a6b5-883d03e33ad4 None None] MFA Rules not processed for user `2c75163e50924369986503cfc238ccc7`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:08.503227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cd8d3bc2-ac52-47b3-a6b5-883d03e33ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:08.510714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c9538-8a7f-4cad-a5a0-bedae88bda8d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:08.520340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c4b56-6572-41b6-9623-94d64290c5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:08.522903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c4b56-6572-41b6-9623-94d64290c5ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:08.523469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c4b56-6572-41b6-9623-94d64290c5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:08.524141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c4b56-6572-41b6-9623-94d64290c5ca admin admin] PATH_INFO: `/v3/projects/d85e7650a4374066922085ef5115c973/users/4f4affe28e084a7eb873d9a1f0f79fe9/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:08.581709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c4b56-6572-41b6-9623-94d64290c5ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85e7650a4374066922085ef5115c973, user_id=4f4affe28e084a7eb873d9a1f0f79fe9, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:08.587189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c4b56-6572-41b6-9623-94d64290c5ca admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:08.678372 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1187/2401] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:08 2022] PUT /identity/v3/projects/d85e7650a4374066922085ef5115c973/users/4f4affe28e084a7eb873d9a1f0f79fe9/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:08.680381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c4b56-6572-41b6-9623-94d64290c5ca admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:08.699389 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1215/2402] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:08.700846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133590c7-bc0f-4859-9d08-8ee52bd04651 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:08.701147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133590c7-bc0f-4859-9d08-8ee52bd04651 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:08.701404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133590c7-bc0f-4859-9d08-8ee52bd04651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:08.781626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-133590c7-bc0f-4859-9d08-8ee52bd04651 None None] MFA Rules not processed for user `4f4affe28e084a7eb873d9a1f0f79fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:08.782215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c4b56-6572-41b6-9623-94d64290c5ca admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:08.786903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-133590c7-bc0f-4859-9d08-8ee52bd04651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:08.788489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df1b63-260f-4875-b76a-2e70da480d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:08.789672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df1b63-260f-4875-b76a-2e70da480d25 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:08.790011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df1b63-260f-4875-b76a-2e70da480d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:08.794149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df1b63-260f-4875-b76a-2e70da480d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:08.794149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df1b63-260f-4875-b76a-2e70da480d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:08.794149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df1b63-260f-4875-b76a-2e70da480d25 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:08.817026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:08.925056 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1216/2403] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:08.926211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133590c7-bc0f-4859-9d08-8ee52bd04651 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:08.929261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-133590c7-bc0f-4859-9d08-8ee52bd04651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:08.943769 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1188/2404] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:08 2022] POST /identity/v3/projects => generated 391 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:08.943769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df1b63-260f-4875-b76a-2e70da480d25 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:09.081742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:09.140341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133590c7-bc0f-4859-9d08-8ee52bd04651 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:09.158882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df1b63-260f-4875-b76a-2e70da480d25 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:09.169452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70605b-bfec-4f7e-85c6-dac4d6d0e8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:09.170534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70605b-bfec-4f7e-85c6-dac4d6d0e8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:09.170534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70605b-bfec-4f7e-85c6-dac4d6d0e8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:09.170738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70605b-bfec-4f7e-85c6-dac4d6d0e8b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:09.171789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70605b-bfec-4f7e-85c6-dac4d6d0e8b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:09.183715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70605b-bfec-4f7e-85c6-dac4d6d0e8b1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:09.251169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc61a5-8e29-4153-a1c7-e82b832bd17c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:09.251169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc61a5-8e29-4153-a1c7-e82b832bd17c service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:09.251169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc61a5-8e29-4153-a1c7-e82b832bd17c service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:09.251169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc61a5-8e29-4153-a1c7-e82b832bd17c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:09.370475 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1189/2405] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:08 2022] POST /identity/v3/projects => generated 383 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:09.374222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc61a5-8e29-4153-a1c7-e82b832bd17c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:09.374750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70605b-bfec-4f7e-85c6-dac4d6d0e8b1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:09.376204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc61a5-8e29-4153-a1c7-e82b832bd17c service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:09.401784 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1217/2406] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:09.402801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc61a5-8e29-4153-a1c7-e82b832bd17c service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:09.432393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc61a5-8e29-4153-a1c7-e82b832bd17c service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:09.504769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70605b-bfec-4f7e-85c6-dac4d6d0e8b1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:09.515417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a74ec7-44da-494f-b03d-682f49128592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:09.516438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a74ec7-44da-494f-b03d-682f49128592 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:09.516719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a74ec7-44da-494f-b03d-682f49128592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:09.518154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a74ec7-44da-494f-b03d-682f49128592 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:09.518814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a74ec7-44da-494f-b03d-682f49128592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:09.521623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a74ec7-44da-494f-b03d-682f49128592 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:09.574898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56582eb-6317-478a-81dc-524081686bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:09.575585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56582eb-6317-478a-81dc-524081686bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:09.576012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56582eb-6317-478a-81dc-524081686bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:09.576990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56582eb-6317-478a-81dc-524081686bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:09.577656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56582eb-6317-478a-81dc-524081686bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:09.580765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56582eb-6317-478a-81dc-524081686bd6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:09.626013 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1190/2407] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:09 2022] POST /identity/v3/users => generated 302 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:09.640944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a74ec7-44da-494f-b03d-682f49128592 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:09.674928 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1218/2408] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:09 2022] POST /identity/v3/users => generated 298 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:09.678461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56582eb-6317-478a-81dc-524081686bd6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:09.681244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d56582eb-6317-478a-81dc-524081686bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:09.685114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a74ec7-44da-494f-b03d-682f49128592 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:09.712668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080cf74-0236-480f-9298-61a62f6cc8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:09.713516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080cf74-0236-480f-9298-61a62f6cc8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:09.715534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080cf74-0236-480f-9298-61a62f6cc8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:09.715821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080cf74-0236-480f-9298-61a62f6cc8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:09.717235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080cf74-0236-480f-9298-61a62f6cc8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:09.718866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080cf74-0236-480f-9298-61a62f6cc8b6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:09.743108 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1191/2409] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:09.743523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080cf74-0236-480f-9298-61a62f6cc8b6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:09.773642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080cf74-0236-480f-9298-61a62f6cc8b6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:09.789756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ba678-3fcb-4979-90c3-85e51e842dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:09.790337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ba678-3fcb-4979-90c3-85e51e842dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:09.790616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ba678-3fcb-4979-90c3-85e51e842dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:09.790886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ba678-3fcb-4979-90c3-85e51e842dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:09.791541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ba678-3fcb-4979-90c3-85e51e842dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:09.793486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ba678-3fcb-4979-90c3-85e51e842dd6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:09.816710 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1192/2410] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:09.818030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ba678-3fcb-4979-90c3-85e51e842dd6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:09.836422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ba678-3fcb-4979-90c3-85e51e842dd6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:09.842772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75fd12-1c30-40fc-bf53-ea80ebfc1a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:09.843446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75fd12-1c30-40fc-bf53-ea80ebfc1a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:09.843712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75fd12-1c30-40fc-bf53-ea80ebfc1a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:09.843977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75fd12-1c30-40fc-bf53-ea80ebfc1a22 admin admin] PATH_INFO: `/v3/projects/dc5b4797d0314d93a07a94511edc1837/users/aa9ffe709b204ff0af3fb0bbcbdc38e4/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:09.868222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75fd12-1c30-40fc-bf53-ea80ebfc1a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5b4797d0314d93a07a94511edc1837, user_id=aa9ffe709b204ff0af3fb0bbcbdc38e4, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:09.871597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75fd12-1c30-40fc-bf53-ea80ebfc1a22 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:09.904347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56582eb-6317-478a-81dc-524081686bd6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:09.911140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:09.949777 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1193/2411] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:09 2022] PUT /identity/v3/projects/dc5b4797d0314d93a07a94511edc1837/users/aa9ffe709b204ff0af3fb0bbcbdc38e4/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:09.950583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75fd12-1c30-40fc-bf53-ea80ebfc1a22 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:09.959092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1fb44-4339-4583-8675-d74592b6f14a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:09.959319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1fb44-4339-4583-8675-d74592b6f14a service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:09.959690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1fb44-4339-4583-8675-d74592b6f14a service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:09.959798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1fb44-4339-4583-8675-d74592b6f14a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:09.965488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-63e1fb44-4339-4583-8675-d74592b6f14a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:10.072736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:10.163010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75fd12-1c30-40fc-bf53-ea80ebfc1a22 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:10.167435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1fb44-4339-4583-8675-d74592b6f14a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:10.169636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09c805-13a1-4505-abe5-fb02ab5d5833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:10.169968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1fb44-4339-4583-8675-d74592b6f14a service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:10.170308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09c805-13a1-4505-abe5-fb02ab5d5833 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:10.170838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09c805-13a1-4505-abe5-fb02ab5d5833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:10.171230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09c805-13a1-4505-abe5-fb02ab5d5833 admin admin] PATH_INFO: `/v3/projects/ad797a2bd4a84ea4adb86c37f9905a21/users/63fe5047410145f7bbe2d46493d6a000/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:10.183447 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1219/2412] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:10.184590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1fb44-4339-4583-8675-d74592b6f14a service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:10.196411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1fb44-4339-4583-8675-d74592b6f14a service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:10.208372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306e619-0bd1-460d-bf37-8625ed3e7e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:10.209267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306e619-0bd1-460d-bf37-8625ed3e7e0a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:10.209700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306e619-0bd1-460d-bf37-8625ed3e7e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:10.210153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306e619-0bd1-460d-bf37-8625ed3e7e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:10.211201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306e619-0bd1-460d-bf37-8625ed3e7e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:10.217077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306e619-0bd1-460d-bf37-8625ed3e7e0a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:10.246256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09c805-13a1-4505-abe5-fb02ab5d5833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad797a2bd4a84ea4adb86c37f9905a21, user_id=63fe5047410145f7bbe2d46493d6a000, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:10.250295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09c805-13a1-4505-abe5-fb02ab5d5833 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:10.257833 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1220/2413] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:10.262494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306e619-0bd1-460d-bf37-8625ed3e7e0a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:10.295128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306e619-0bd1-460d-bf37-8625ed3e7e0a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:10.311267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d755d-3df8-4dd4-a6a1-8d689f2003db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:10.312324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d755d-3df8-4dd4-a6a1-8d689f2003db admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:10.312677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d755d-3df8-4dd4-a6a1-8d689f2003db admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:10.313021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d755d-3df8-4dd4-a6a1-8d689f2003db admin admin] PATH_INFO: `/v3/projects/dc5b4797d0314d93a07a94511edc1837/users/aa9ffe709b204ff0af3fb0bbcbdc38e4/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:10.317201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d755d-3df8-4dd4-a6a1-8d689f2003db admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5b4797d0314d93a07a94511edc1837, user_id=aa9ffe709b204ff0af3fb0bbcbdc38e4, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:10.335689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d755d-3df8-4dd4-a6a1-8d689f2003db admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:10.335793 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1194/2414] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:09 2022] PUT /identity/v3/projects/ad797a2bd4a84ea4adb86c37f9905a21/users/63fe5047410145f7bbe2d46493d6a000/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:10.336073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09c805-13a1-4505-abe5-fb02ab5d5833 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:10.377652 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1221/2415] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:10 2022] PUT /identity/v3/projects/dc5b4797d0314d93a07a94511edc1837/users/aa9ffe709b204ff0af3fb0bbcbdc38e4/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:10.379543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48194a68-de30-4ffe-9e0c-3a3be93de577 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:10.390841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48194a68-de30-4ffe-9e0c-3a3be93de577 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:10.392742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48194a68-de30-4ffe-9e0c-3a3be93de577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:10.489300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-48194a68-de30-4ffe-9e0c-3a3be93de577 None None] MFA Rules not processed for user `aa9ffe709b204ff0af3fb0bbcbdc38e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:10.492027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-48194a68-de30-4ffe-9e0c-3a3be93de577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:10.586973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09c805-13a1-4505-abe5-fb02ab5d5833 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:10.625335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:10.729511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94066923-1bc6-4b8c-ad39-17838e986294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:10.730180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94066923-1bc6-4b8c-ad39-17838e986294 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:10.730468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94066923-1bc6-4b8c-ad39-17838e986294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:10.730837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94066923-1bc6-4b8c-ad39-17838e986294 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:10.731601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94066923-1bc6-4b8c-ad39-17838e986294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:10.733223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94066923-1bc6-4b8c-ad39-17838e986294 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:10.756602 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1195/2416] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:40:10.760034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94066923-1bc6-4b8c-ad39-17838e986294 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:10.760034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-94066923-1bc6-4b8c-ad39-17838e986294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:10.774400 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1222/2417] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:10 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:10.775958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94066923-1bc6-4b8c-ad39-17838e986294 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:10.780227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48194a68-de30-4ffe-9e0c-3a3be93de577 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:10.788259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344b15e-bea3-4be0-91e8-9c7b0cd44718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:10.789377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344b15e-bea3-4be0-91e8-9c7b0cd44718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:10.789667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344b15e-bea3-4be0-91e8-9c7b0cd44718 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:10.789947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344b15e-bea3-4be0-91e8-9c7b0cd44718 admin admin] PATH_INFO: `/v3/projects/6454543c9d204a7eb912ae27787e9613` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:10.791579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344b15e-bea3-4be0-91e8-9c7b0cd44718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6454543c9d204a7eb912ae27787e9613)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:10.793485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344b15e-bea3-4be0-91e8-9c7b0cd44718 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:10.839264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48194a68-de30-4ffe-9e0c-3a3be93de577 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:10.859021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb7825-3c69-42ad-8843-3acad8065578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:10.863832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7825-3c69-42ad-8843-3acad8065578 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:10.863832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7825-3c69-42ad-8843-3acad8065578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:10.863832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7825-3c69-42ad-8843-3acad8065578 admin admin] PATH_INFO: `/v3/projects/ad797a2bd4a84ea4adb86c37f9905a21/users/63fe5047410145f7bbe2d46493d6a000/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:10.879763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb7825-3c69-42ad-8843-3acad8065578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad797a2bd4a84ea4adb86c37f9905a21, user_id=63fe5047410145f7bbe2d46493d6a000, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:10.889676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb7825-3c69-42ad-8843-3acad8065578 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:10.928461 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1223/2418] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:10 2022] PUT /identity/v3/projects/ad797a2bd4a84ea4adb86c37f9905a21/users/63fe5047410145f7bbe2d46493d6a000/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:10.929846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb7825-3c69-42ad-8843-3acad8065578 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:11.011098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3344b15e-bea3-4be0-91e8-9c7b0cd44718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6454543c9d204a7eb912ae27787e9613', 'request_id': 'req-3344b15e-bea3-4be0-91e8-9c7b0cd44718'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:11.034515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3344b15e-bea3-4be0-91e8-9c7b0cd44718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6454543c9d204a7eb912ae27787e9613', 'request_id': 'req-3344b15e-bea3-4be0-91e8-9c7b0cd44718'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:11.063985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3344b15e-bea3-4be0-91e8-9c7b0cd44718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6454543c9d204a7eb912ae27787e9613', 'request_id': 'req-3344b15e-bea3-4be0-91e8-9c7b0cd44718'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:11.194137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3344b15e-bea3-4be0-91e8-9c7b0cd44718 admin admin] The token cache is being invalidate because project 6454543c9d204a7eb912ae27787e9613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:11.194137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3344b15e-bea3-4be0-91e8-9c7b0cd44718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:11.194137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3344b15e-bea3-4be0-91e8-9c7b0cd44718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:11.194137 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1196/2419] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:10 2022] DELETE /identity/v3/projects/6454543c9d204a7eb912ae27787e9613 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:11.194137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5643ea7-4271-4c9d-b261-8020f9e8849c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:11.194878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5643ea7-4271-4c9d-b261-8020f9e8849c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:11.194878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5643ea7-4271-4c9d-b261-8020f9e8849c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:11.197813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb7825-3c69-42ad-8843-3acad8065578 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:11.234720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c5643ea7-4271-4c9d-b261-8020f9e8849c None None] MFA Rules not processed for user `63fe5047410145f7bbe2d46493d6a000`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:11.238279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c5643ea7-4271-4c9d-b261-8020f9e8849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:11.275849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:11.554243 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1197/2420] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:11.556870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d5f16-47f9-4fe7-9207-d69748223100 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:11.557884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d5f16-47f9-4fe7-9207-d69748223100 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:11.558364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d5f16-47f9-4fe7-9207-d69748223100 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:11.558841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d5f16-47f9-4fe7-9207-d69748223100 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:11.559267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622365fe-ec83-44b0-86c4-e7854845e11d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:11.569768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-880d5f16-47f9-4fe7-9207-d69748223100 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:11.576255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622365fe-ec83-44b0-86c4-e7854845e11d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:11.577013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622365fe-ec83-44b0-86c4-e7854845e11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:11.611904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-622365fe-ec83-44b0-86c4-e7854845e11d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:11.614837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-622365fe-ec83-44b0-86c4-e7854845e11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:11.770790 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1198/2421] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:11.771765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622365fe-ec83-44b0-86c4-e7854845e11d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:11.780808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-622365fe-ec83-44b0-86c4-e7854845e11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:11.810443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:11.821328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622365fe-ec83-44b0-86c4-e7854845e11d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:11.842516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce73b64-1312-45fd-b8dd-878f7542f147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:11.847871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce73b64-1312-45fd-b8dd-878f7542f147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:11.847871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce73b64-1312-45fd-b8dd-878f7542f147 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:11.847871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce73b64-1312-45fd-b8dd-878f7542f147 admin admin] PATH_INFO: `/v3/users/1286e699d1304edfa8710a141b78355b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:11.847871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce73b64-1312-45fd-b8dd-878f7542f147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1286e699d1304edfa8710a141b78355b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:11.860668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce73b64-1312-45fd-b8dd-878f7542f147 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:11.910449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d5f16-47f9-4fe7-9207-d69748223100 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:11.918231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d5f16-47f9-4fe7-9207-d69748223100 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:11.963366 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1224/2422] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:10 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 1034 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:11.993127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec143113-0f11-47b4-966f-d38ed3b15595 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:11.993868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec143113-0f11-47b4-966f-d38ed3b15595 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:12.000436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec143113-0f11-47b4-966f-d38ed3b15595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:12.068549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ec143113-0f11-47b4-966f-d38ed3b15595 None None] MFA Rules not processed for user `4f4affe28e084a7eb873d9a1f0f79fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:12.070782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ec143113-0f11-47b4-966f-d38ed3b15595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:12.163823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:12.190672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cce73b64-1312-45fd-b8dd-878f7542f147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1286e699d1304edfa8710a141b78355b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:12.216384 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1225/2423] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:12.378046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fd50d-b9b6-4026-bb02-cd970a8dc885 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:12.378046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fd50d-b9b6-4026-bb02-cd970a8dc885 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:12.378046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fd50d-b9b6-4026-bb02-cd970a8dc885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:12.378046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-494fd50d-b9b6-4026-bb02-cd970a8dc885 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:12.378046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-494fd50d-b9b6-4026-bb02-cd970a8dc885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:12.378046 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1226/2424] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:12.379830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fd50d-b9b6-4026-bb02-cd970a8dc885 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:12.379830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-494fd50d-b9b6-4026-bb02-cd970a8dc885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:12.379830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fd50d-b9b6-4026-bb02-cd970a8dc885 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:12.400627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc6df5-04ca-45ff-8aee-cb68f4fa5c18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:12.403065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc6df5-04ca-45ff-8aee-cb68f4fa5c18 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:12.403204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc6df5-04ca-45ff-8aee-cb68f4fa5c18 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:12.403439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc6df5-04ca-45ff-8aee-cb68f4fa5c18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:12.551692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-61cc6df5-04ca-45ff-8aee-cb68f4fa5c18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:12.551692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc6df5-04ca-45ff-8aee-cb68f4fa5c18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:12.551692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc6df5-04ca-45ff-8aee-cb68f4fa5c18 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:12.551692 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1227/2425] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:12.551692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc6df5-04ca-45ff-8aee-cb68f4fa5c18 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:12.551692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc6df5-04ca-45ff-8aee-cb68f4fa5c18 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:12.555999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108b790-9f63-4d2d-9867-a02ab421e1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:12.555999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108b790-9f63-4d2d-9867-a02ab421e1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:12.555999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108b790-9f63-4d2d-9867-a02ab421e1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:12.555999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108b790-9f63-4d2d-9867-a02ab421e1b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:12.558250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108b790-9f63-4d2d-9867-a02ab421e1b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:40:12.559584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108b790-9f63-4d2d-9867-a02ab421e1b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:12.561505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108b790-9f63-4d2d-9867-a02ab421e1b8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:12.592948 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1228/2426] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:40:12.597042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108b790-9f63-4d2d-9867-a02ab421e1b8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:12.618434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108b790-9f63-4d2d-9867-a02ab421e1b8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:12.625041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18f026-e9ea-4a8e-87fd-e471568ad88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:12.625791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18f026-e9ea-4a8e-87fd-e471568ad88f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:12.626147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18f026-e9ea-4a8e-87fd-e471568ad88f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:12.626631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18f026-e9ea-4a8e-87fd-e471568ad88f admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:12.627573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18f026-e9ea-4a8e-87fd-e471568ad88f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:12.630085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18f026-e9ea-4a8e-87fd-e471568ad88f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:12.635864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cce73b64-1312-45fd-b8dd-878f7542f147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1286e699d1304edfa8710a141b78355b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:12.637222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cce73b64-1312-45fd-b8dd-878f7542f147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1286e699d1304edfa8710a141b78355b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:12.658587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cce73b64-1312-45fd-b8dd-878f7542f147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1286e699d1304edfa8710a141b78355b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:12.689458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cce73b64-1312-45fd-b8dd-878f7542f147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1286e699d1304edfa8710a141b78355b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:12.705906 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1199/2427] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:40:11 2022] DELETE /identity/v3/users/1286e699d1304edfa8710a141b78355b => generated 0 bytes in 935 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:12.709102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1e3ce-5c7f-40c2-850d-19fd5d9eb55c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:12.709102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1e3ce-5c7f-40c2-850d-19fd5d9eb55c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:12.709102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1e3ce-5c7f-40c2-850d-19fd5d9eb55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:12.741822 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1229/2428] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:12 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:12.744061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7684d10-00a3-4f1a-b326-356d00fceaee None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:12.746343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7684d10-00a3-4f1a-b326-356d00fceaee None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:12.746947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7684d10-00a3-4f1a-b326-356d00fceaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:12.755287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8ef1e3ce-5c7f-40c2-850d-19fd5d9eb55c None None] MFA Rules not processed for user `d5329b8aa2834338bd50b0efc6fbbb16`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:12.756990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8ef1e3ce-5c7f-40c2-850d-19fd5d9eb55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:12.780858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a7684d10-00a3-4f1a-b326-356d00fceaee None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:12.782402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a7684d10-00a3-4f1a-b326-356d00fceaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:12.896237 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1230/2429] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:12.900129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7684d10-00a3-4f1a-b326-356d00fceaee None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:12.905124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a7684d10-00a3-4f1a-b326-356d00fceaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:12.931354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7684d10-00a3-4f1a-b326-356d00fceaee None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:12.936337 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1200/2430] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:12 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:12.947645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76855e74-acc5-477d-a8a4-a0f21058c700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:12.949296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76855e74-acc5-477d-a8a4-a0f21058c700 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:12.949866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76855e74-acc5-477d-a8a4-a0f21058c700 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:12.950349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76855e74-acc5-477d-a8a4-a0f21058c700 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:12.951372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76855e74-acc5-477d-a8a4-a0f21058c700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:12.953636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76855e74-acc5-477d-a8a4-a0f21058c700 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:12.993717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1e3ce-5c7f-40c2-850d-19fd5d9eb55c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:12.995577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8ef1e3ce-5c7f-40c2-850d-19fd5d9eb55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:13.148283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1e3ce-5c7f-40c2-850d-19fd5d9eb55c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:13.154280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cd036-fc6d-469b-ba44-46567f850cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:13.155341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cd036-fc6d-469b-ba44-46567f850cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:13.156116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cd036-fc6d-469b-ba44-46567f850cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:13.156593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cd036-fc6d-469b-ba44-46567f850cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:13.171842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cd036-fc6d-469b-ba44-46567f850cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:13.174194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cd036-fc6d-469b-ba44-46567f850cb5 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:13.211792 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1201/2431] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:13.726658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7e50a-0374-498b-8571-53ae773e23ea None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:13.727317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7e50a-0374-498b-8571-53ae773e23ea None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:13.727549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7e50a-0374-498b-8571-53ae773e23ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:13.735563 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-d3e7e50a-0374-498b-8571-53ae773e23ea None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:40:13.735563 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:40:13.735563 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:40:13.735563 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:40:13.735563 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:40:13.735563 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:40:13.735563 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:40:13.735563 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:40:13.735563 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:40:13.735563 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:40:13.735563 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:40:13.735563 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:40:13.735563 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:40:13.737217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:40:13.737217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:40:13.737217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:40:13.737217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:40:13.737217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:40:13.737217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:40:13.737217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:40:13.737217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:40:13.737217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:40:13.737217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:40:13.737217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:40:13.737217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:40:13.737217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:40:13.737217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:40:13.737217 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:40:13.738285 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1202/2432] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:40:13 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 12 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 04:40:13.818972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7e50a-0374-498b-8571-53ae773e23ea None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:13.821010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d3e7e50a-0374-498b-8571-53ae773e23ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:13.844706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7e50a-0374-498b-8571-53ae773e23ea None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:13.850670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83fb61-2c0c-4935-8957-2d3653ed631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:13.851490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83fb61-2c0c-4935-8957-2d3653ed631e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:13.851835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83fb61-2c0c-4935-8957-2d3653ed631e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:13.852220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83fb61-2c0c-4935-8957-2d3653ed631e admin admin] PATH_INFO: `/v3/users/3ca4cefa885248bfbaf9cc0de9549402` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:13.853401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83fb61-2c0c-4935-8957-2d3653ed631e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca4cefa885248bfbaf9cc0de9549402)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:13.855962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83fb61-2c0c-4935-8957-2d3653ed631e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:13.990894 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1231/2433] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:12 2022] POST /identity/v3/users => generated 292 bytes in 1094 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:13.995024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76855e74-acc5-477d-a8a4-a0f21058c700 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:14.005970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76855e74-acc5-477d-a8a4-a0f21058c700 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:14.011106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c720767-4a11-46d5-933f-c3283a067802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:14.011762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c720767-4a11-46d5-933f-c3283a067802 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:14.012213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c720767-4a11-46d5-933f-c3283a067802 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:14.012499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c720767-4a11-46d5-933f-c3283a067802 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:14.013144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c720767-4a11-46d5-933f-c3283a067802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:14.015239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c720767-4a11-46d5-933f-c3283a067802 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:14.030766 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1232/2434] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:40:14.036488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c720767-4a11-46d5-933f-c3283a067802 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:14.050362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c720767-4a11-46d5-933f-c3283a067802 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:14.057107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4c221-2ac2-42f6-b342-d6332ef8b7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:14.061051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4c221-2ac2-42f6-b342-d6332ef8b7bd admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:14.061051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4c221-2ac2-42f6-b342-d6332ef8b7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:14.061051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4c221-2ac2-42f6-b342-d6332ef8b7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:14.061051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4c221-2ac2-42f6-b342-d6332ef8b7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:14.061721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4c221-2ac2-42f6-b342-d6332ef8b7bd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:14.074751 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1233/2435] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:14.078243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4c221-2ac2-42f6-b342-d6332ef8b7bd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:14.094214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4c221-2ac2-42f6-b342-d6332ef8b7bd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:14.102701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183adb5a-075d-4559-b463-0b2e8b2fdfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:14.103146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183adb5a-075d-4559-b463-0b2e8b2fdfd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:14.103425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183adb5a-075d-4559-b463-0b2e8b2fdfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:14.103748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183adb5a-075d-4559-b463-0b2e8b2fdfd7 admin admin] PATH_INFO: `/v3/projects/ee01a09299784387bceb8555cee06080/users/d26cae92a4da4d4eb8f3027477a6d07f/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:14.121444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183adb5a-075d-4559-b463-0b2e8b2fdfd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee01a09299784387bceb8555cee06080, user_id=d26cae92a4da4d4eb8f3027477a6d07f, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:14.124120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183adb5a-075d-4559-b463-0b2e8b2fdfd7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:14.315671 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1234/2436] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:14 2022] PUT /identity/v3/projects/ee01a09299784387bceb8555cee06080/users/d26cae92a4da4d4eb8f3027477a6d07f/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:40:14.316147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2d83fb61-2c0c-4935-8957-2d3653ed631e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca4cefa885248bfbaf9cc0de9549402'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:14.318011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840572e6-6593-4962-be56-c6b24cea3a3f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:14.321848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840572e6-6593-4962-be56-c6b24cea3a3f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:14.321848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840572e6-6593-4962-be56-c6b24cea3a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:14.335726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:14.370550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-840572e6-6593-4962-be56-c6b24cea3a3f None None] MFA Rules not processed for user `d26cae92a4da4d4eb8f3027477a6d07f`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:14.373483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-840572e6-6593-4962-be56-c6b24cea3a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:14.379094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2d83fb61-2c0c-4935-8957-2d3653ed631e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca4cefa885248bfbaf9cc0de9549402'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:14.379843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2d83fb61-2c0c-4935-8957-2d3653ed631e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca4cefa885248bfbaf9cc0de9549402'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:14.389422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2d83fb61-2c0c-4935-8957-2d3653ed631e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca4cefa885248bfbaf9cc0de9549402'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:14.425203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2d83fb61-2c0c-4935-8957-2d3653ed631e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca4cefa885248bfbaf9cc0de9549402'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:14.437667 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1203/2437] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:40:13 2022] DELETE /identity/v3/users/3ca4cefa885248bfbaf9cc0de9549402 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:40:14.443220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39387ea1-e618-417c-bd49-a9d99f765a4a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:14.443507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39387ea1-e618-417c-bd49-a9d99f765a4a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:14.443777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39387ea1-e618-417c-bd49-a9d99f765a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:14.505514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-39387ea1-e618-417c-bd49-a9d99f765a4a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:14.507156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-39387ea1-e618-417c-bd49-a9d99f765a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:14.554055 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1235/2438] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:14.561563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840572e6-6593-4962-be56-c6b24cea3a3f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:14.567754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-840572e6-6593-4962-be56-c6b24cea3a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:14.715359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:14.720903 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1204/2439] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:14.747479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39387ea1-e618-417c-bd49-a9d99f765a4a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:14.749789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-39387ea1-e618-417c-bd49-a9d99f765a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:14.789431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840572e6-6593-4962-be56-c6b24cea3a3f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:14.809140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60571ac-96f1-40b9-ba31-daea35832bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:14.810814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60571ac-96f1-40b9-ba31-daea35832bfa admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:14.811329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60571ac-96f1-40b9-ba31-daea35832bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:14.811607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60571ac-96f1-40b9-ba31-daea35832bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:14.815138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60571ac-96f1-40b9-ba31-daea35832bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:14.817149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60571ac-96f1-40b9-ba31-daea35832bfa admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:14.918454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39387ea1-e618-417c-bd49-a9d99f765a4a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:14.923416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6f919-c5ad-4319-bd07-2ec842869761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:14.927346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6f919-c5ad-4319-bd07-2ec842869761 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:14.927346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6f919-c5ad-4319-bd07-2ec842869761 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:14.927346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6f919-c5ad-4319-bd07-2ec842869761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:14.942884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6f919-c5ad-4319-bd07-2ec842869761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:14.945385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6f919-c5ad-4319-bd07-2ec842869761 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:14.989661 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1236/2440] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:14 2022] POST /identity/v3/projects => generated 383 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:40:14.998684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60571ac-96f1-40b9-ba31-daea35832bfa admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:15.018599 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1205/2441] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:15.200506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60571ac-96f1-40b9-ba31-daea35832bfa admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:15.214487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fac551-838c-4154-b778-43ef4909ec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:15.215589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fac551-838c-4154-b778-43ef4909ec31 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:15.216027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fac551-838c-4154-b778-43ef4909ec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:15.219032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fac551-838c-4154-b778-43ef4909ec31 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:15.224533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fac551-838c-4154-b778-43ef4909ec31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:15.229242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fac551-838c-4154-b778-43ef4909ec31 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:15.339041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6f919-c5ad-4319-bd07-2ec842869761 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:15.346086 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1237/2442] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:14 2022] POST /identity/v3/users => generated 298 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:15.354209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6f919-c5ad-4319-bd07-2ec842869761 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:15.367321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db864b1-e498-4178-a998-bc263c21c554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:15.368283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db864b1-e498-4178-a998-bc263c21c554 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:15.368834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db864b1-e498-4178-a998-bc263c21c554 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:15.369706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db864b1-e498-4178-a998-bc263c21c554 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:15.372051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db864b1-e498-4178-a998-bc263c21c554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:15.379052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db864b1-e498-4178-a998-bc263c21c554 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:15.411940 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1206/2443] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:15.413394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fac551-838c-4154-b778-43ef4909ec31 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:15.446264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fac551-838c-4154-b778-43ef4909ec31 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:15.457471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bf655-6fbf-405a-b280-c73804173853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:15.458162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bf655-6fbf-405a-b280-c73804173853 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:15.458512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bf655-6fbf-405a-b280-c73804173853 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:15.459934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bf655-6fbf-405a-b280-c73804173853 admin admin] PATH_INFO: `/v3/projects/65ba8f506eda464c937113c3a88bde45/users/d7d70b8593854605b4483c0a27fb7e22/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:15.488057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9bf655-6fbf-405a-b280-c73804173853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ba8f506eda464c937113c3a88bde45, user_id=d7d70b8593854605b4483c0a27fb7e22, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:15.492787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9bf655-6fbf-405a-b280-c73804173853 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:15.614194 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1238/2444] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:15 2022] PUT /identity/v3/projects/65ba8f506eda464c937113c3a88bde45/users/d7d70b8593854605b4483c0a27fb7e22/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:40:15.618031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db864b1-e498-4178-a998-bc263c21c554 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:15.633400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db864b1-e498-4178-a998-bc263c21c554 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:15.770063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294353c9-bb6c-409f-9ef9-ebd0a6c8e6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:15.772195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294353c9-bb6c-409f-9ef9-ebd0a6c8e6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:15.772879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294353c9-bb6c-409f-9ef9-ebd0a6c8e6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:15.773391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294353c9-bb6c-409f-9ef9-ebd0a6c8e6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:15.774290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294353c9-bb6c-409f-9ef9-ebd0a6c8e6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:15.778419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294353c9-bb6c-409f-9ef9-ebd0a6c8e6f5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:15.798797 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1207/2445] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:15.799751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bf655-6fbf-405a-b280-c73804173853 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:15.801596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:15.820314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bf655-6fbf-405a-b280-c73804173853 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:15.838901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee41c54-8409-4d77-b5c4-c2905a486c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:15.838901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee41c54-8409-4d77-b5c4-c2905a486c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:15.838901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee41c54-8409-4d77-b5c4-c2905a486c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:15.838901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee41c54-8409-4d77-b5c4-c2905a486c0f admin admin] PATH_INFO: `/v3/projects/65ba8f506eda464c937113c3a88bde45/users/d7d70b8593854605b4483c0a27fb7e22/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:15.843469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee41c54-8409-4d77-b5c4-c2905a486c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ba8f506eda464c937113c3a88bde45, user_id=d7d70b8593854605b4483c0a27fb7e22, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:15.868882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee41c54-8409-4d77-b5c4-c2905a486c0f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:15.897210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294353c9-bb6c-409f-9ef9-ebd0a6c8e6f5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:15.899041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-294353c9-bb6c-409f-9ef9-ebd0a6c8e6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:15.920522 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1239/2446] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:15 2022] PUT /identity/v3/projects/65ba8f506eda464c937113c3a88bde45/users/d7d70b8593854605b4483c0a27fb7e22/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:40:15.929821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294353c9-bb6c-409f-9ef9-ebd0a6c8e6f5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:15.944506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd3752-4309-4bdb-94dc-b4af5da985b7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:15.951955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd3752-4309-4bdb-94dc-b4af5da985b7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:15.951955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd3752-4309-4bdb-94dc-b4af5da985b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:16.044008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fd9f4-4df6-4f92-9557-c68425be6f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:16.045406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fd9f4-4df6-4f92-9557-c68425be6f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:16.045406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fd9f4-4df6-4f92-9557-c68425be6f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:16.045406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fd9f4-4df6-4f92-9557-c68425be6f44 admin admin] PATH_INFO: `/v3/projects/3bc95c4104b3460290278eec9645eef2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:16.046835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fd9f4-4df6-4f92-9557-c68425be6f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bc95c4104b3460290278eec9645eef2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:16.050653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fd9f4-4df6-4f92-9557-c68425be6f44 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:16.090619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-58fd3752-4309-4bdb-94dc-b4af5da985b7 None None] MFA Rules not processed for user `d7d70b8593854605b4483c0a27fb7e22`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:16.092451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-58fd3752-4309-4bdb-94dc-b4af5da985b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:16.213266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e17fd9f4-4df6-4f92-9557-c68425be6f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bc95c4104b3460290278eec9645eef2', 'request_id': 'req-e17fd9f4-4df6-4f92-9557-c68425be6f44'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:16.236664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e17fd9f4-4df6-4f92-9557-c68425be6f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bc95c4104b3460290278eec9645eef2', 'request_id': 'req-e17fd9f4-4df6-4f92-9557-c68425be6f44'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:16.260338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e17fd9f4-4df6-4f92-9557-c68425be6f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bc95c4104b3460290278eec9645eef2', 'request_id': 'req-e17fd9f4-4df6-4f92-9557-c68425be6f44'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:16.292219 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1240/2447] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:16.300321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd3752-4309-4bdb-94dc-b4af5da985b7 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:16.300321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-58fd3752-4309-4bdb-94dc-b4af5da985b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:16.362405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e17fd9f4-4df6-4f92-9557-c68425be6f44 admin admin] The token cache is being invalidate because project 3bc95c4104b3460290278eec9645eef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:16.363008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e17fd9f4-4df6-4f92-9557-c68425be6f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:16.365047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e17fd9f4-4df6-4f92-9557-c68425be6f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:16.368424 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1208/2448] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:15 2022] DELETE /identity/v3/projects/3bc95c4104b3460290278eec9645eef2 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:16.373840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fd9f4-4df6-4f92-9557-c68425be6f44 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:16.377402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e17fd9f4-4df6-4f92-9557-c68425be6f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:16.505058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:16.509655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fd9f4-4df6-4f92-9557-c68425be6f44 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:16.515511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ee924-d219-4725-9d53-487ace3f2449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:16.516189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ee924-d219-4725-9d53-487ace3f2449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:16.516473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ee924-d219-4725-9d53-487ace3f2449 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:16.516747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ee924-d219-4725-9d53-487ace3f2449 admin admin] PATH_INFO: `/v3/users/2c75163e50924369986503cfc238ccc7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:16.518299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd3752-4309-4bdb-94dc-b4af5da985b7 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:16.524304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ee924-d219-4725-9d53-487ace3f2449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c75163e50924369986503cfc238ccc7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:16.526906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ee924-d219-4725-9d53-487ace3f2449 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:16.703204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628915fa-0227-4d3d-af50-1564ff04cf26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:16.703839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628915fa-0227-4d3d-af50-1564ff04cf26 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:16.704120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628915fa-0227-4d3d-af50-1564ff04cf26 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:16.704418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628915fa-0227-4d3d-af50-1564ff04cf26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:16.707106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-628915fa-0227-4d3d-af50-1564ff04cf26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:16.806247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dc8ee924-d219-4725-9d53-487ace3f2449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c75163e50924369986503cfc238ccc7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:16.855750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628915fa-0227-4d3d-af50-1564ff04cf26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:16.864950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dc8ee924-d219-4725-9d53-487ace3f2449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c75163e50924369986503cfc238ccc7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:16.865694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dc8ee924-d219-4725-9d53-487ace3f2449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c75163e50924369986503cfc238ccc7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:16.875277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dc8ee924-d219-4725-9d53-487ace3f2449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c75163e50924369986503cfc238ccc7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:16.876864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628915fa-0227-4d3d-af50-1564ff04cf26 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:16.902588 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1241/2449] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:40:16.903878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628915fa-0227-4d3d-af50-1564ff04cf26 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:16.916135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-628915fa-0227-4d3d-af50-1564ff04cf26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:16.937098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dc8ee924-d219-4725-9d53-487ace3f2449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c75163e50924369986503cfc238ccc7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:16.981554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628915fa-0227-4d3d-af50-1564ff04cf26 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:16.984357 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1209/2450] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:40:16 2022] DELETE /identity/v3/users/2c75163e50924369986503cfc238ccc7 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:16.989512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ea880-e134-4cbf-a515-63ad29f2ab97 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:16.989828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ea880-e134-4cbf-a515-63ad29f2ab97 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:16.990112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ea880-e134-4cbf-a515-63ad29f2ab97 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:16.996498 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1210/2451] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:40:16 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:40:17.000029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ea880-e134-4cbf-a515-63ad29f2ab97 None None] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:40:17.008880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-075ea880-e134-4cbf-a515-63ad29f2ab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:17.092892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:17.093640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:17.094249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:17.094623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4 admin admin] PATH_INFO: `/v3/projects/89b1cc4e6d084e15a1011ac667271532` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:17.096141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b1cc4e6d084e15a1011ac667271532)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:17.098588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:17.215030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ea880-e134-4cbf-a515-63ad29f2ab97 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:17.222037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-075ea880-e134-4cbf-a515-63ad29f2ab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:17.231915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b1cc4e6d084e15a1011ac667271532', 'request_id': 'req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:17.240744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b1cc4e6d084e15a1011ac667271532', 'request_id': 'req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:17.317603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ea880-e134-4cbf-a515-63ad29f2ab97 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:17.339517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b1cc4e6d084e15a1011ac667271532', 'request_id': 'req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:17.359355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4 admin admin] The token cache is being invalidate because project 89b1cc4e6d084e15a1011ac667271532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:17.368070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:17.368070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:17.368070 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1242/2452] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:16 2022] DELETE /identity/v3/projects/89b1cc4e6d084e15a1011ac667271532 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:17.369234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:17.373056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:17.434890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21cae9-7644-4e2b-9475-8a28ad5cae2b tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7d70b8593854605b4483c0a27fb7e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ba8f506eda464c937113c3a88bde45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:17.435867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21cae9-7644-4e2b-9475-8a28ad5cae2b tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:17.436338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21cae9-7644-4e2b-9475-8a28ad5cae2b tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:17.437025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21cae9-7644-4e2b-9475-8a28ad5cae2b tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] PATH_INFO: `/v3/projects/ee01a09299784387bceb8555cee06080` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:17.439629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21cae9-7644-4e2b-9475-8a28ad5cae2b tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorizing `identity:get_project(project_id=ee01a09299784387bceb8555cee06080)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:17.443852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21cae9-7644-4e2b-9475-8a28ad5cae2b tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:17.458840 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1211/2453] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:40:16 2022] GET /identity/v3/projects/ee01a09299784387bceb8555cee06080 => generated 383 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:40:17.506728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c0f94-6709-44cf-9c64-c91a82e92068 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:17.507579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c0f94-6709-44cf-9c64-c91a82e92068 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:17.508315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c0f94-6709-44cf-9c64-c91a82e92068 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:17.511435 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1212/2454] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:40:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:40:17.515513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6cd6f-ed28-4d5f-8d52-cb414fb425f4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:17.521657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa9703-c338-497a-bc6a-a44892aea47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:17.522368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa9703-c338-497a-bc6a-a44892aea47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:17.524091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa9703-c338-497a-bc6a-a44892aea47c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:17.524091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa9703-c338-497a-bc6a-a44892aea47c admin admin] PATH_INFO: `/v3/users/aa9ffe709b204ff0af3fb0bbcbdc38e4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:17.525844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa9703-c338-497a-bc6a-a44892aea47c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa9ffe709b204ff0af3fb0bbcbdc38e4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:17.528450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c0f94-6709-44cf-9c64-c91a82e92068 None None] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:40:17.528758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa9703-c338-497a-bc6a-a44892aea47c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:17.533015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ce7c0f94-6709-44cf-9c64-c91a82e92068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:17.711477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:17.714923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c0f94-6709-44cf-9c64-c91a82e92068 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:17.716514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ce7c0f94-6709-44cf-9c64-c91a82e92068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:17.750801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c0f94-6709-44cf-9c64-c91a82e92068 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:17.760764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4f4a6-a025-4b33-bc57-a1e53fe53658 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7d70b8593854605b4483c0a27fb7e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ba8f506eda464c937113c3a88bde45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:17.761997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4f4a6-a025-4b33-bc57-a1e53fe53658 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:17.762289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4f4a6-a025-4b33-bc57-a1e53fe53658 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:17.762568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4f4a6-a025-4b33-bc57-a1e53fe53658 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] PATH_INFO: `/v3/projects/ee01a09299784387bceb8555cee06080` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:17.764317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4f4a6-a025-4b33-bc57-a1e53fe53658 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorizing `identity:get_project(project_id=ee01a09299784387bceb8555cee06080)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:17.766678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4f4a6-a025-4b33-bc57-a1e53fe53658 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:17.768950 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1213/2455] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:40:17 2022] GET /identity/v3/projects/ee01a09299784387bceb8555cee06080 => generated 383 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:40:17.805951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4f4a6-a025-4b33-bc57-a1e53fe53658 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:17.817229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dfaa9703-c338-497a-bc6a-a44892aea47c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa9ffe709b204ff0af3fb0bbcbdc38e4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:17.818181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ebf4f4a6-a025-4b33-bc57-a1e53fe53658 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:17.827140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dfaa9703-c338-497a-bc6a-a44892aea47c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa9ffe709b204ff0af3fb0bbcbdc38e4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:17.858467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4f4a6-a025-4b33-bc57-a1e53fe53658 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:17.865947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294ea98-27cd-41d9-854f-16c555d4b766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:17.868415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294ea98-27cd-41d9-854f-16c555d4b766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:17.868883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294ea98-27cd-41d9-854f-16c555d4b766 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:17.869427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294ea98-27cd-41d9-854f-16c555d4b766 admin admin] PATH_INFO: `/v3/projects/a8eae55425674a53b3a6c1ef8f339c50` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:17.871286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294ea98-27cd-41d9-854f-16c555d4b766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8eae55425674a53b3a6c1ef8f339c50)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:17.899107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294ea98-27cd-41d9-854f-16c555d4b766 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:17.914212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dfaa9703-c338-497a-bc6a-a44892aea47c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa9ffe709b204ff0af3fb0bbcbdc38e4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:17.915398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dfaa9703-c338-497a-bc6a-a44892aea47c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa9ffe709b204ff0af3fb0bbcbdc38e4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:17.967905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dfaa9703-c338-497a-bc6a-a44892aea47c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa9ffe709b204ff0af3fb0bbcbdc38e4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:18.003347 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1243/2456] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:40:17 2022] DELETE /identity/v3/users/aa9ffe709b204ff0af3fb0bbcbdc38e4 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:18.044041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f24dde-c70d-49f8-a757-0aff63ac711a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:18.044380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f24dde-c70d-49f8-a757-0aff63ac711a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:18.045458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f24dde-c70d-49f8-a757-0aff63ac711a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:18.077049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-78f24dde-c70d-49f8-a757-0aff63ac711a None None] MFA Rules not processed for user `d26cae92a4da4d4eb8f3027477a6d07f`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:18.078871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-78f24dde-c70d-49f8-a757-0aff63ac711a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:18.184227 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1244/2457] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:40:18.197081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f24dde-c70d-49f8-a757-0aff63ac711a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:18.199355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-78f24dde-c70d-49f8-a757-0aff63ac711a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:18.246433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c294ea98-27cd-41d9-854f-16c555d4b766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8eae55425674a53b3a6c1ef8f339c50', 'request_id': 'req-c294ea98-27cd-41d9-854f-16c555d4b766'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:18.266603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c294ea98-27cd-41d9-854f-16c555d4b766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8eae55425674a53b3a6c1ef8f339c50', 'request_id': 'req-c294ea98-27cd-41d9-854f-16c555d4b766'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:18.281310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c294ea98-27cd-41d9-854f-16c555d4b766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8eae55425674a53b3a6c1ef8f339c50', 'request_id': 'req-c294ea98-27cd-41d9-854f-16c555d4b766'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:18.379301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c294ea98-27cd-41d9-854f-16c555d4b766 admin admin] The token cache is being invalidate because project a8eae55425674a53b3a6c1ef8f339c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:18.379601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c294ea98-27cd-41d9-854f-16c555d4b766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:18.380553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c294ea98-27cd-41d9-854f-16c555d4b766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:18.387083 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1214/2458] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:17 2022] DELETE /identity/v3/projects/a8eae55425674a53b3a6c1ef8f339c50 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:18.388385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232579d7-75b9-4004-a82e-e0b38c6d8a85 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:18.388674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232579d7-75b9-4004-a82e-e0b38c6d8a85 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:18.388955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232579d7-75b9-4004-a82e-e0b38c6d8a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:18.431863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f24dde-c70d-49f8-a757-0aff63ac711a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:18.437933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-232579d7-75b9-4004-a82e-e0b38c6d8a85 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:18.438607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-232579d7-75b9-4004-a82e-e0b38c6d8a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:18.619744 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1215/2459] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:18.631185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68716241-3ebe-458a-9beb-d86904a4d7ba None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:18.631468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68716241-3ebe-458a-9beb-d86904a4d7ba None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:18.631746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68716241-3ebe-458a-9beb-d86904a4d7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:18.647797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cb6df-719c-43f4-a29f-bbaf5a511fe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:18.648868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cb6df-719c-43f4-a29f-bbaf5a511fe0 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:18.649381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cb6df-719c-43f4-a29f-bbaf5a511fe0 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:18.649524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cb6df-719c-43f4-a29f-bbaf5a511fe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:18.655507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-796cb6df-719c-43f4-a29f-bbaf5a511fe0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:18.657499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-68716241-3ebe-458a-9beb-d86904a4d7ba None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:18.659644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-68716241-3ebe-458a-9beb-d86904a4d7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:18.669041 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1216/2460] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:18.673671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68716241-3ebe-458a-9beb-d86904a4d7ba None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:18.686253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68716241-3ebe-458a-9beb-d86904a4d7ba None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:18.712971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3af1c-22b7-4763-992a-28449a2f2102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:18.714635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3af1c-22b7-4763-992a-28449a2f2102 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:18.716068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3af1c-22b7-4763-992a-28449a2f2102 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:18.716378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3af1c-22b7-4763-992a-28449a2f2102 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:18.730257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3af1c-22b7-4763-992a-28449a2f2102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:40:18.730257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3af1c-22b7-4763-992a-28449a2f2102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:18.730257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3af1c-22b7-4763-992a-28449a2f2102 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:18.733518 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1217/2461] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:40:18.742447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3af1c-22b7-4763-992a-28449a2f2102 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:18.761821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3af1c-22b7-4763-992a-28449a2f2102 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:18.769641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6914f19-d88b-4a8a-b666-b2a882d0c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:18.770510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6914f19-d88b-4a8a-b666-b2a882d0c56e admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:18.770799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6914f19-d88b-4a8a-b666-b2a882d0c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:18.772531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6914f19-d88b-4a8a-b666-b2a882d0c56e admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:18.773198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6914f19-d88b-4a8a-b666-b2a882d0c56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:18.777647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6914f19-d88b-4a8a-b666-b2a882d0c56e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:18.795245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cb6df-719c-43f4-a29f-bbaf5a511fe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:18.797208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cb6df-719c-43f4-a29f-bbaf5a511fe0 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:18.809466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:18.837511 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1245/2462] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:18.919816 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1218/2463] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:18 2022] POST /identity/v3/projects => generated 409 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:40:18.924634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cb6df-719c-43f4-a29f-bbaf5a511fe0 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:18.937699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cb6df-719c-43f4-a29f-bbaf5a511fe0 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:19.065624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df0b61-21f0-4fe9-97bb-1e74456b395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:19.066256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df0b61-21f0-4fe9-97bb-1e74456b395e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:19.066538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df0b61-21f0-4fe9-97bb-1e74456b395e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:19.066813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df0b61-21f0-4fe9-97bb-1e74456b395e admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:19.067826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df0b61-21f0-4fe9-97bb-1e74456b395e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:19.072503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df0b61-21f0-4fe9-97bb-1e74456b395e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:19.219406 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1246/2464] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:18 2022] POST /identity/v3/users => generated 305 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:19.223826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6914f19-d88b-4a8a-b666-b2a882d0c56e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:19.240144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6914f19-d88b-4a8a-b666-b2a882d0c56e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:19.248666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9310ac7-0f36-4d51-b519-c0eb46380af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:19.249093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9310ac7-0f36-4d51-b519-c0eb46380af2 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:19.249375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9310ac7-0f36-4d51-b519-c0eb46380af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:19.249748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9310ac7-0f36-4d51-b519-c0eb46380af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:19.250839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9310ac7-0f36-4d51-b519-c0eb46380af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:19.255952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9310ac7-0f36-4d51-b519-c0eb46380af2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:19.280087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df0b61-21f0-4fe9-97bb-1e74456b395e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:19.301820 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1219/2465] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:19.310988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df0b61-21f0-4fe9-97bb-1e74456b395e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:19.324152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2e4f8-eef5-4baf-a581-a586a82aa396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:19.324826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2e4f8-eef5-4baf-a581-a586a82aa396 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:19.325159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2e4f8-eef5-4baf-a581-a586a82aa396 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:19.325438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2e4f8-eef5-4baf-a581-a586a82aa396 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:19.326649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2e4f8-eef5-4baf-a581-a586a82aa396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:19.332521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2e4f8-eef5-4baf-a581-a586a82aa396 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:19.333076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:19.362871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9310ac7-0f36-4d51-b519-c0eb46380af2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:19.372067 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1247/2466] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:40:19.378639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9310ac7-0f36-4d51-b519-c0eb46380af2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:19.394002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bfc4d-c8d5-4b83-b203-f9cafb82c003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:19.394691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bfc4d-c8d5-4b83-b203-f9cafb82c003 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:19.396922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bfc4d-c8d5-4b83-b203-f9cafb82c003 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:19.396922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bfc4d-c8d5-4b83-b203-f9cafb82c003 admin admin] PATH_INFO: `/v3/projects/0dc0e301a3604d3684400e8567e9f76a/users/8f85d8bd8cad489b948f341295eb0947/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:19.433383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02bfc4d-c8d5-4b83-b203-f9cafb82c003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc0e301a3604d3684400e8567e9f76a, user_id=8f85d8bd8cad489b948f341295eb0947, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:19.439899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02bfc4d-c8d5-4b83-b203-f9cafb82c003 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:19.533762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2e4f8-eef5-4baf-a581-a586a82aa396 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:19.539970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ebf2e4f8-eef5-4baf-a581-a586a82aa396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:19.549546 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1220/2467] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:19 2022] PUT /identity/v3/projects/0dc0e301a3604d3684400e8567e9f76a/users/8f85d8bd8cad489b948f341295eb0947/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:19.556893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d529a72-4f7c-4c1e-a410-c3230e63cf48 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:19.557179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d529a72-4f7c-4c1e-a410-c3230e63cf48 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:19.557455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d529a72-4f7c-4c1e-a410-c3230e63cf48 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:19.563633 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1221/2468] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:40:19 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:40:19.565449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba189cf-3f26-4670-a3bb-2cca70746da5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:19.565724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba189cf-3f26-4670-a3bb-2cca70746da5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:19.570176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba189cf-3f26-4670-a3bb-2cca70746da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:19.577796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2e4f8-eef5-4baf-a581-a586a82aa396 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:19.681469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-fba189cf-3f26-4670-a3bb-2cca70746da5 None None] MFA Rules not processed for user `8f85d8bd8cad489b948f341295eb0947`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:19.682626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fba189cf-3f26-4670-a3bb-2cca70746da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:19.760279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f247105-53e5-40b3-8d18-753336ab927b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:19.761004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f247105-53e5-40b3-8d18-753336ab927b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:19.761287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f247105-53e5-40b3-8d18-753336ab927b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:19.761567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f247105-53e5-40b3-8d18-753336ab927b admin admin] PATH_INFO: `/v3/projects/dc5b4797d0314d93a07a94511edc1837` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:19.763832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f247105-53e5-40b3-8d18-753336ab927b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5b4797d0314d93a07a94511edc1837)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:19.766713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f247105-53e5-40b3-8d18-753336ab927b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:19.843344 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1222/2469] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:19 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:19.844955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba189cf-3f26-4670-a3bb-2cca70746da5 None None] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:40:19.848946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fba189cf-3f26-4670-a3bb-2cca70746da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:19.877690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:19.956507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9f247105-53e5-40b3-8d18-753336ab927b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5b4797d0314d93a07a94511edc1837', 'request_id': 'req-9f247105-53e5-40b3-8d18-753336ab927b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:19.969935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9f247105-53e5-40b3-8d18-753336ab927b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5b4797d0314d93a07a94511edc1837', 'request_id': 'req-9f247105-53e5-40b3-8d18-753336ab927b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:20.007609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba189cf-3f26-4670-a3bb-2cca70746da5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:20.010489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fba189cf-3f26-4670-a3bb-2cca70746da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:20.058040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9f247105-53e5-40b3-8d18-753336ab927b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5b4797d0314d93a07a94511edc1837', 'request_id': 'req-9f247105-53e5-40b3-8d18-753336ab927b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:20.077593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9f247105-53e5-40b3-8d18-753336ab927b admin admin] The token cache is being invalidate because project dc5b4797d0314d93a07a94511edc1837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:20.078448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9f247105-53e5-40b3-8d18-753336ab927b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:20.079124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9f247105-53e5-40b3-8d18-753336ab927b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:20.084330 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1248/2470] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:19 2022] DELETE /identity/v3/projects/dc5b4797d0314d93a07a94511edc1837 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:40:20.084330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f247105-53e5-40b3-8d18-753336ab927b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:20.085866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9f247105-53e5-40b3-8d18-753336ab927b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:20.149035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:20.175862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba189cf-3f26-4670-a3bb-2cca70746da5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:20.263534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f247105-53e5-40b3-8d18-753336ab927b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:20.279178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73381d70-307b-4849-b222-dc8053021cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:20.279826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73381d70-307b-4849-b222-dc8053021cca admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:20.280098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73381d70-307b-4849-b222-dc8053021cca admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:20.280400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73381d70-307b-4849-b222-dc8053021cca admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:20.281042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73381d70-307b-4849-b222-dc8053021cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:20.283561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73381d70-307b-4849-b222-dc8053021cca admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:20.325655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d8d72-02ea-4058-9d07-fb58acfbf5d2 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7d70b8593854605b4483c0a27fb7e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ba8f506eda464c937113c3a88bde45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:20.326620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d8d72-02ea-4058-9d07-fb58acfbf5d2 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:20.327009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d8d72-02ea-4058-9d07-fb58acfbf5d2 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:20.327293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d8d72-02ea-4058-9d07-fb58acfbf5d2 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] PATH_INFO: `/v3/projects/ee01a09299784387bceb8555cee06080` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:20.328680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d8d72-02ea-4058-9d07-fb58acfbf5d2 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorizing `identity:get_project(project_id=ee01a09299784387bceb8555cee06080)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:20.331158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d8d72-02ea-4058-9d07-fb58acfbf5d2 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:20.333806 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1223/2471] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:40:19 2022] GET /identity/v3/projects/ee01a09299784387bceb8555cee06080 => generated 383 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:40:20.334623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812fd66-9488-4721-a93a-c881123629ec None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:20.334904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812fd66-9488-4721-a93a-c881123629ec None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:20.335180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812fd66-9488-4721-a93a-c881123629ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:20.367143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b812fd66-9488-4721-a93a-c881123629ec None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:20.368473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b812fd66-9488-4721-a93a-c881123629ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:20.385228 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1224/2472] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:20.386799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a95a27-747b-4eaa-8a91-fea6589ba8d0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:20.387203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a95a27-747b-4eaa-8a91-fea6589ba8d0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:20.387681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a95a27-747b-4eaa-8a91-fea6589ba8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:20.412415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a3a95a27-747b-4eaa-8a91-fea6589ba8d0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:20.414217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a3a95a27-747b-4eaa-8a91-fea6589ba8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:20.429993 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1249/2473] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:20 2022] POST /identity/v3/projects => generated 409 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:20.434524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73381d70-307b-4849-b222-dc8053021cca admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:20.653917 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1225/2474] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:20.666251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db1851-0b51-42e5-8f57-6dcf8d1c4afe None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:20.666558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db1851-0b51-42e5-8f57-6dcf8d1c4afe None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:20.667029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db1851-0b51-42e5-8f57-6dcf8d1c4afe None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:20.676950 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1226/2475] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:40:20 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:40:20.677809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db1851-0b51-42e5-8f57-6dcf8d1c4afe None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:20.678715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73381d70-307b-4849-b222-dc8053021cca admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:20.699853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b941c07-13fc-47d8-b763-19c6b22c799d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:20.700950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b941c07-13fc-47d8-b763-19c6b22c799d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:20.700950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b941c07-13fc-47d8-b763-19c6b22c799d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:20.701146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b941c07-13fc-47d8-b763-19c6b22c799d admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:20.701719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b941c07-13fc-47d8-b763-19c6b22c799d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:20.707909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b941c07-13fc-47d8-b763-19c6b22c799d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:20.730517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db1851-0b51-42e5-8f57-6dcf8d1c4afe None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:20.747147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ffbd1-1fce-4df0-992f-82ef7bebaefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:20.747774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ffbd1-1fce-4df0-992f-82ef7bebaefb admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:20.748101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ffbd1-1fce-4df0-992f-82ef7bebaefb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:20.748438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ffbd1-1fce-4df0-992f-82ef7bebaefb admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:20.749107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ffbd1-1fce-4df0-992f-82ef7bebaefb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:40:20.749414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ffbd1-1fce-4df0-992f-82ef7bebaefb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:20.759216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ffbd1-1fce-4df0-992f-82ef7bebaefb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:20.790555 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1227/2476] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:40:20.795031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ffbd1-1fce-4df0-992f-82ef7bebaefb admin admin] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:40:20.808277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7b5ffbd1-1fce-4df0-992f-82ef7bebaefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:20.865966 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1250/2477] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:20 2022] POST /identity/v3/users => generated 311 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:20.866626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b941c07-13fc-47d8-b763-19c6b22c799d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:20.887012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b941c07-13fc-47d8-b763-19c6b22c799d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:20.912049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e0ff8-ee40-496d-a02f-a52e50d0e59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:20.912797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0ff8-ee40-496d-a02f-a52e50d0e59c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:20.913080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0ff8-ee40-496d-a02f-a52e50d0e59c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:20.913352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0ff8-ee40-496d-a02f-a52e50d0e59c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:20.914123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e0ff8-ee40-496d-a02f-a52e50d0e59c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:20.916050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e0ff8-ee40-496d-a02f-a52e50d0e59c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:20.983901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:21.014084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ffbd1-1fce-4df0-992f-82ef7bebaefb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:21.018369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7b5ffbd1-1fce-4df0-992f-82ef7bebaefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:21.075158 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1251/2478] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:20 2022] POST /identity/v3/projects => generated 397 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:21.076108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e0ff8-ee40-496d-a02f-a52e50d0e59c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:21.096393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:21.101138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ffbd1-1fce-4df0-992f-82ef7bebaefb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:21.181654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fea00-9df4-473d-8544-e70c1a35b3aa tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7d70b8593854605b4483c0a27fb7e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ba8f506eda464c937113c3a88bde45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:21.182864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fea00-9df4-473d-8544-e70c1a35b3aa tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:21.183153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fea00-9df4-473d-8544-e70c1a35b3aa tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:21.183425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fea00-9df4-473d-8544-e70c1a35b3aa tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] PATH_INFO: `/v3/projects/ee01a09299784387bceb8555cee06080` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:21.185018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fea00-9df4-473d-8544-e70c1a35b3aa tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorizing `identity:get_project(project_id=ee01a09299784387bceb8555cee06080)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:21.187181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fea00-9df4-473d-8544-e70c1a35b3aa tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:21.191117 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1228/2479] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:40:20 2022] GET /identity/v3/projects/ee01a09299784387bceb8555cee06080 => generated 383 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:40:21.192010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fea00-9df4-473d-8544-e70c1a35b3aa tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:21.197865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e0ff8-ee40-496d-a02f-a52e50d0e59c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:21.205171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd86990-64f9-47f9-9b91-f7f0dc525e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:21.205941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fea00-9df4-473d-8544-e70c1a35b3aa tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:21.206412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd86990-64f9-47f9-9b91-f7f0dc525e67 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:21.206934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd86990-64f9-47f9-9b91-f7f0dc525e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:21.207451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd86990-64f9-47f9-9b91-f7f0dc525e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:21.208286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd86990-64f9-47f9-9b91-f7f0dc525e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:21.212899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c1e32-f269-4d67-916f-4f906628c6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:21.213823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c1e32-f269-4d67-916f-4f906628c6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:21.214095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c1e32-f269-4d67-916f-4f906628c6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:21.214365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c1e32-f269-4d67-916f-4f906628c6b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:21.214997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c1e32-f269-4d67-916f-4f906628c6b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:21.215159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd86990-64f9-47f9-9b91-f7f0dc525e67 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:21.217204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c1e32-f269-4d67-916f-4f906628c6b5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:21.227361 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1252/2480] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:21.233295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd86990-64f9-47f9-9b91-f7f0dc525e67 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:21.246288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd86990-64f9-47f9-9b91-f7f0dc525e67 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:21.256137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce10cc-450f-42b3-90a8-2ef22ded5a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:21.257344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce10cc-450f-42b3-90a8-2ef22ded5a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:21.257845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce10cc-450f-42b3-90a8-2ef22ded5a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:21.258296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce10cc-450f-42b3-90a8-2ef22ded5a47 admin admin] PATH_INFO: `/v3/projects/221888b8a04f40cd8d678753fc882746/users/9f14605d27004dcf8f46a0687ce9c9cd/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:21.279037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce10cc-450f-42b3-90a8-2ef22ded5a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=221888b8a04f40cd8d678753fc882746, user_id=9f14605d27004dcf8f46a0687ce9c9cd, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:21.283564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce10cc-450f-42b3-90a8-2ef22ded5a47 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:21.296146 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1229/2481] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:21 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:21.296146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657a0bf-53a1-4173-b453-ebe16465649f None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:21.296146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657a0bf-53a1-4173-b453-ebe16465649f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:21.296146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657a0bf-53a1-4173-b453-ebe16465649f None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:21.297893 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1230/2482] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:40:21.301774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657a0bf-53a1-4173-b453-ebe16465649f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:21.345621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657a0bf-53a1-4173-b453-ebe16465649f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:21.356849 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1253/2483] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:21 2022] PUT /identity/v3/projects/221888b8a04f40cd8d678753fc882746/users/9f14605d27004dcf8f46a0687ce9c9cd/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:21.357887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce10cc-450f-42b3-90a8-2ef22ded5a47 admin admin] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:40:21.360461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f933fa-9168-4981-b3b6-0e06812ea91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:21.361907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f933fa-9168-4981-b3b6-0e06812ea91d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:21.362336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f933fa-9168-4981-b3b6-0e06812ea91d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:21.362752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f933fa-9168-4981-b3b6-0e06812ea91d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:21.363562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f933fa-9168-4981-b3b6-0e06812ea91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:21.369511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f933fa-9168-4981-b3b6-0e06812ea91d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:21.418648 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1231/2484] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:21.440957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f933fa-9168-4981-b3b6-0e06812ea91d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:21.484264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f933fa-9168-4981-b3b6-0e06812ea91d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:21.499556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:21.553982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce10cc-450f-42b3-90a8-2ef22ded5a47 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:21.671411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:21.715434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce10cc-450f-42b3-90a8-2ef22ded5a47 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:21.727331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aba93-cd04-491a-bbfc-32e6143de54c tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7d70b8593854605b4483c0a27fb7e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ba8f506eda464c937113c3a88bde45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:21.729443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aba93-cd04-491a-bbfc-32e6143de54c tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:21.729734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aba93-cd04-491a-bbfc-32e6143de54c tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:21.730008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aba93-cd04-491a-bbfc-32e6143de54c tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] PATH_INFO: `/v3/projects/ee01a09299784387bceb8555cee06080` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:21.736543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11aba93-cd04-491a-bbfc-32e6143de54c tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorizing `identity:get_project(project_id=ee01a09299784387bceb8555cee06080)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:21.750035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11aba93-cd04-491a-bbfc-32e6143de54c tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:21.764110 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1254/2485] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:40:21 2022] GET /identity/v3/projects/ee01a09299784387bceb8555cee06080 => generated 383 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:40:21.764110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aba93-cd04-491a-bbfc-32e6143de54c tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:21.837236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:21.840095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca270a-bf57-4393-85d0-fbabcda1611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:21.851243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca270a-bf57-4393-85d0-fbabcda1611b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:21.851705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca270a-bf57-4393-85d0-fbabcda1611b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:21.854857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca270a-bf57-4393-85d0-fbabcda1611b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:21.862190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:21.865747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca270a-bf57-4393-85d0-fbabcda1611b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:21.871839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca270a-bf57-4393-85d0-fbabcda1611b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:21.954789 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1232/2486] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 535 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:21.967513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca270a-bf57-4393-85d0-fbabcda1611b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:21.968263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:21.980199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:22.032014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca270a-bf57-4393-85d0-fbabcda1611b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:22.039022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aba93-cd04-491a-bbfc-32e6143de54c tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:22.055083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c28f4-081e-4759-83d4-8992a7c81321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:22.055983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a95379-5c00-46fa-98b7-0ca94d142130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:22.056225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c28f4-081e-4759-83d4-8992a7c81321 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:22.056713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c28f4-081e-4759-83d4-8992a7c81321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:22.056954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a95379-5c00-46fa-98b7-0ca94d142130 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:22.057344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a95379-5c00-46fa-98b7-0ca94d142130 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:22.057722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a95379-5c00-46fa-98b7-0ca94d142130 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:22.058583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c28f4-081e-4759-83d4-8992a7c81321 admin admin] PATH_INFO: `/v3/projects/221888b8a04f40cd8d678753fc882746/users/9f14605d27004dcf8f46a0687ce9c9cd/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:22.058693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a95379-5c00-46fa-98b7-0ca94d142130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:22.060929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a95379-5c00-46fa-98b7-0ca94d142130 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:22.073051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c28f4-081e-4759-83d4-8992a7c81321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=221888b8a04f40cd8d678753fc882746, user_id=9f14605d27004dcf8f46a0687ce9c9cd, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:22.083607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c28f4-081e-4759-83d4-8992a7c81321 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:22.093103 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1255/2487] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:22.094187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a95379-5c00-46fa-98b7-0ca94d142130 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:22.118705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a95379-5c00-46fa-98b7-0ca94d142130 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:22.140729 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1233/2488] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:21 2022] PUT /identity/v3/projects/221888b8a04f40cd8d678753fc882746/users/9f14605d27004dcf8f46a0687ce9c9cd/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:22.154703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6e0b8-f8db-42f1-8e25-a7bc92737c7d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:22.155208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6e0b8-f8db-42f1-8e25-a7bc92737c7d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:22.155697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6e0b8-f8db-42f1-8e25-a7bc92737c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:22.281947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c6b6e0b8-f8db-42f1-8e25-a7bc92737c7d None None] MFA Rules not processed for user `9f14605d27004dcf8f46a0687ce9c9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:22.283927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca21274-c724-49e0-9a87-71c58cd10e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:22.288109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21274-c724-49e0-9a87-71c58cd10e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:22.288109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21274-c724-49e0-9a87-71c58cd10e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:22.288109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21274-c724-49e0-9a87-71c58cd10e0f admin admin] PATH_INFO: `/v3/projects/58b3dd9918d0412a9441e5b405948450/users/eab4fe38f4aa4180b5b4ea27fb01b06b/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:22.288419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c6b6e0b8-f8db-42f1-8e25-a7bc92737c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:22.326902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca21274-c724-49e0-9a87-71c58cd10e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b3dd9918d0412a9441e5b405948450, user_id=eab4fe38f4aa4180b5b4ea27fb01b06b, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:22.332963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca21274-c724-49e0-9a87-71c58cd10e0f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:22.338432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:22.452790 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1256/2489] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:22 2022] PUT /identity/v3/projects/58b3dd9918d0412a9441e5b405948450/users/eab4fe38f4aa4180b5b4ea27fb01b06b/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:22.455444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3250f6-80b7-4a79-a2e4-d01a8e837763 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:22.455802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3250f6-80b7-4a79-a2e4-d01a8e837763 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:22.456076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3250f6-80b7-4a79-a2e4-d01a8e837763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:22.501146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1c3250f6-80b7-4a79-a2e4-d01a8e837763 None None] MFA Rules not processed for user `d26cae92a4da4d4eb8f3027477a6d07f`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:22.510989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1c3250f6-80b7-4a79-a2e4-d01a8e837763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:22.538478 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1234/2490] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:22 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:40:22.542615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f68585-83e9-45dd-8468-094f019fff65 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:22.546849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f68585-83e9-45dd-8468-094f019fff65 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:22.546849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f68585-83e9-45dd-8468-094f019fff65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:22.547050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:22.607992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-79f68585-83e9-45dd-8468-094f019fff65 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:22.609498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-79f68585-83e9-45dd-8468-094f019fff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:22.659455 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1257/2491] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:22.659455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3250f6-80b7-4a79-a2e4-d01a8e837763 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:22.789256 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1235/2492] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:22.846655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3250f6-80b7-4a79-a2e4-d01a8e837763 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:22.864412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f68585-83e9-45dd-8468-094f019fff65 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:22.872028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-79f68585-83e9-45dd-8468-094f019fff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:22.882887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce670586-61d6-4335-ba53-082abc5a7c9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:22.884005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce670586-61d6-4335-ba53-082abc5a7c9a service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:22.884637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce670586-61d6-4335-ba53-082abc5a7c9a service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:22.885242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce670586-61d6-4335-ba53-082abc5a7c9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:22.918076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:22.952808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:23.017350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:23.196474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce670586-61d6-4335-ba53-082abc5a7c9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:23.203441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f68585-83e9-45dd-8468-094f019fff65 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:23.207026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce670586-61d6-4335-ba53-082abc5a7c9a service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:23.215618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:23.226091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952099b-63a2-468c-b960-b826718c2f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:23.227339 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1258/2493] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:22 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:23.227784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952099b-63a2-468c-b960-b826718c2f39 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:23.236963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952099b-63a2-468c-b960-b826718c2f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:23.237626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952099b-63a2-468c-b960-b826718c2f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:23.305227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952099b-63a2-468c-b960-b826718c2f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:23.310466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952099b-63a2-468c-b960-b826718c2f39 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:23.340424 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1236/2494] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:40:23.351702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:23.373074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:23.812557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:23.853620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:24.191094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce670586-61d6-4335-ba53-082abc5a7c9a service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:24.216128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce670586-61d6-4335-ba53-082abc5a7c9a service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:24.243677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fa16a-0fc1-4244-aa51-6d4feb7dea18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:24.244408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fa16a-0fc1-4244-aa51-6d4feb7dea18 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:24.244697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fa16a-0fc1-4244-aa51-6d4feb7dea18 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:24.244967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fa16a-0fc1-4244-aa51-6d4feb7dea18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:24.250100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-619fa16a-0fc1-4244-aa51-6d4feb7dea18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:24.366387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fa16a-0fc1-4244-aa51-6d4feb7dea18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:24.368421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fa16a-0fc1-4244-aa51-6d4feb7dea18 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:24.389065 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1259/2495] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:24 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:24.435648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20afe7-32c3-426e-ab61-5196b22d316b None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:24.438675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20afe7-32c3-426e-ab61-5196b22d316b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:24.439721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20afe7-32c3-426e-ab61-5196b22d316b None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:24.443892 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1237/2496] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:40:24 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:40:24.453867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fa16a-0fc1-4244-aa51-6d4feb7dea18 service nova] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:40:24.477271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fa16a-0fc1-4244-aa51-6d4feb7dea18 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:24.625940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fa16a-0fc1-4244-aa51-6d4feb7dea18 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:24.662641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e936d5f-de4c-4f26-85c8-ab6aa3477f54 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7d70b8593854605b4483c0a27fb7e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ba8f506eda464c937113c3a88bde45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:24.663568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e936d5f-de4c-4f26-85c8-ab6aa3477f54 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:24.664070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e936d5f-de4c-4f26-85c8-ab6aa3477f54 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:24.665201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e936d5f-de4c-4f26-85c8-ab6aa3477f54 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] PATH_INFO: `/v3/projects/ee01a09299784387bceb8555cee06080` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:24.667386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e936d5f-de4c-4f26-85c8-ab6aa3477f54 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorizing `identity:get_project(project_id=ee01a09299784387bceb8555cee06080)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:24.669909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e936d5f-de4c-4f26-85c8-ab6aa3477f54 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:24.672267 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1260/2497] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:40:24 2022] GET /identity/v3/projects/ee01a09299784387bceb8555cee06080 => generated 383 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:40:24.681252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:24.854610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20afe7-32c3-426e-ab61-5196b22d316b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:24.870107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20afe7-32c3-426e-ab61-5196b22d316b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:24.891707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf1564-4dcf-435f-b259-adb47f1679f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:24.892350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf1564-4dcf-435f-b259-adb47f1679f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:24.892701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf1564-4dcf-435f-b259-adb47f1679f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:24.892910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf1564-4dcf-435f-b259-adb47f1679f6 admin admin] PATH_INFO: `/v3/users/8f85d8bd8cad489b948f341295eb0947` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:24.894130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf1564-4dcf-435f-b259-adb47f1679f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f85d8bd8cad489b948f341295eb0947)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:24.896382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf1564-4dcf-435f-b259-adb47f1679f6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:25.030278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c788f-4426-455a-b0e8-bc8001c5198d None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:25.030566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c788f-4426-455a-b0e8-bc8001c5198d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:25.033282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c788f-4426-455a-b0e8-bc8001c5198d None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:25.033282 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1261/2498] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 04:40:25.038266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c788f-4426-455a-b0e8-bc8001c5198d None None] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:40:25.080749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c788f-4426-455a-b0e8-bc8001c5198d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:25.092601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:25.113115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c788f-4426-455a-b0e8-bc8001c5198d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:25.121326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a64e0-0269-4419-9bbb-d85852abae10 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7d70b8593854605b4483c0a27fb7e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ba8f506eda464c937113c3a88bde45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:25.122284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a64e0-0269-4419-9bbb-d85852abae10 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:25.122692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a64e0-0269-4419-9bbb-d85852abae10 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:25.123201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a64e0-0269-4419-9bbb-d85852abae10 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] PATH_INFO: `/v3/projects/ee01a09299784387bceb8555cee06080` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:25.124607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a64e0-0269-4419-9bbb-d85852abae10 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorizing `identity:get_project(project_id=ee01a09299784387bceb8555cee06080)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:25.127886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a64e0-0269-4419-9bbb-d85852abae10 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:25.144398 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1262/2499] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:40:25 2022] GET /identity/v3/projects/ee01a09299784387bceb8555cee06080 => generated 383 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:40:25.201066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55944b5f-6f13-4fa7-8268-fceae2584124 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:25.201580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55944b5f-6f13-4fa7-8268-fceae2584124 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:25.201857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55944b5f-6f13-4fa7-8268-fceae2584124 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:25.203244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8fdf1564-4dcf-435f-b259-adb47f1679f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f85d8bd8cad489b948f341295eb0947'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:25.204001 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1263/2500] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:40:25.218216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55944b5f-6f13-4fa7-8268-fceae2584124 None None] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:40:25.221642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-55944b5f-6f13-4fa7-8268-fceae2584124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:25.249918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55944b5f-6f13-4fa7-8268-fceae2584124 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:25.262280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55944b5f-6f13-4fa7-8268-fceae2584124 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:25.268899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0627f-4401-40ef-bf02-e7eb8b0ebf45 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7d70b8593854605b4483c0a27fb7e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ba8f506eda464c937113c3a88bde45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:25.270122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0627f-4401-40ef-bf02-e7eb8b0ebf45 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:25.270573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0627f-4401-40ef-bf02-e7eb8b0ebf45 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:25.270996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0627f-4401-40ef-bf02-e7eb8b0ebf45 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] PATH_INFO: `/v3/projects/ee01a09299784387bceb8555cee06080` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:25.273088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0627f-4401-40ef-bf02-e7eb8b0ebf45 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorizing `identity:get_project(project_id=ee01a09299784387bceb8555cee06080)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:25.275321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0627f-4401-40ef-bf02-e7eb8b0ebf45 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:25.291220 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1264/2501] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:40:25 2022] GET /identity/v3/projects/ee01a09299784387bceb8555cee06080 => generated 383 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:40:25.377188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8fdf1564-4dcf-435f-b259-adb47f1679f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f85d8bd8cad489b948f341295eb0947'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:25.377188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8fdf1564-4dcf-435f-b259-adb47f1679f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f85d8bd8cad489b948f341295eb0947'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:25.384579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8fdf1564-4dcf-435f-b259-adb47f1679f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f85d8bd8cad489b948f341295eb0947'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:25.403650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8fdf1564-4dcf-435f-b259-adb47f1679f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f85d8bd8cad489b948f341295eb0947'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:25.420513 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1238/2502] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:40:24 2022] DELETE /identity/v3/users/8f85d8bd8cad489b948f341295eb0947 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:40:25.423117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251267c-837d-4348-90bc-f9d6bc707292 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:25.425306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251267c-837d-4348-90bc-f9d6bc707292 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:25.425805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251267c-837d-4348-90bc-f9d6bc707292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:25.465333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e251267c-837d-4348-90bc-f9d6bc707292 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:25.466937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e251267c-837d-4348-90bc-f9d6bc707292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:25.496747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ef1e1-2d5b-4caa-b80f-5ca0be86fc26 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:25.499896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ef1e1-2d5b-4caa-b80f-5ca0be86fc26 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:25.500279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ef1e1-2d5b-4caa-b80f-5ca0be86fc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:25.553830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8b8ef1e1-2d5b-4caa-b80f-5ca0be86fc26 None None] MFA Rules not processed for user `d26cae92a4da4d4eb8f3027477a6d07f`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:25.556676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8b8ef1e1-2d5b-4caa-b80f-5ca0be86fc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:25.575492 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1265/2503] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:25.642838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251267c-837d-4348-90bc-f9d6bc707292 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:25.642838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e251267c-837d-4348-90bc-f9d6bc707292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:25.665915 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1239/2504] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:40:25.746029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251267c-837d-4348-90bc-f9d6bc707292 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:25.753050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de03667-2475-44d1-8953-a9cb038ccc45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:25.754449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de03667-2475-44d1-8953-a9cb038ccc45 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:25.754727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de03667-2475-44d1-8953-a9cb038ccc45 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:25.755053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de03667-2475-44d1-8953-a9cb038ccc45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:25.773516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de03667-2475-44d1-8953-a9cb038ccc45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:25.775081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de03667-2475-44d1-8953-a9cb038ccc45 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:25.790250 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1266/2505] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:25.862366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c95653-9b8f-47ea-9071-9bc5bc46c140 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:25.862603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c95653-9b8f-47ea-9071-9bc5bc46c140 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:25.862793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c95653-9b8f-47ea-9071-9bc5bc46c140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:25.911236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-81c95653-9b8f-47ea-9071-9bc5bc46c140 None None] MFA Rules not processed for user `987b1209e9b24505a2b173834b2d4e15`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:25.914177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-81c95653-9b8f-47ea-9071-9bc5bc46c140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:26.022528 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1240/2506] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:26.034579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de03667-2475-44d1-8953-a9cb038ccc45 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:26.035851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9de03667-2475-44d1-8953-a9cb038ccc45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:26.148341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de03667-2475-44d1-8953-a9cb038ccc45 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:26.155713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fefa1-22c9-4d1d-bfcc-dfd025275bac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:26.157005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fefa1-22c9-4d1d-bfcc-dfd025275bac service glance] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:26.158220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fefa1-22c9-4d1d-bfcc-dfd025275bac service glance] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:26.158723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fefa1-22c9-4d1d-bfcc-dfd025275bac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:26.190642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fefa1-22c9-4d1d-bfcc-dfd025275bac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:26.190642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fefa1-22c9-4d1d-bfcc-dfd025275bac service glance] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:26.213739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:26.254161 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1267/2507] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:26.635670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75682152-e47a-4c7c-888d-170b19400406 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:26.636696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75682152-e47a-4c7c-888d-170b19400406 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:26.637150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75682152-e47a-4c7c-888d-170b19400406 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:26.639385 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1241/2508] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:40:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:40:26.646830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fefa1-22c9-4d1d-bfcc-dfd025275bac service glance] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:40:26.649288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-460fefa1-22c9-4d1d-bfcc-dfd025275bac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:26.816513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fefa1-22c9-4d1d-bfcc-dfd025275bac service glance] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:26.818690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-460fefa1-22c9-4d1d-bfcc-dfd025275bac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:27.042273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fefa1-22c9-4d1d-bfcc-dfd025275bac service glance] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:27.058951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ea21e-6940-40e0-9bd6-d5e156855af2 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7d70b8593854605b4483c0a27fb7e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ba8f506eda464c937113c3a88bde45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:27.059602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ea21e-6940-40e0-9bd6-d5e156855af2 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:27.059887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ea21e-6940-40e0-9bd6-d5e156855af2 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:27.060199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ea21e-6940-40e0-9bd6-d5e156855af2 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] PATH_INFO: `/v3/projects/ee01a09299784387bceb8555cee06080` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:27.066874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ea21e-6940-40e0-9bd6-d5e156855af2 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorizing `identity:get_project(project_id=ee01a09299784387bceb8555cee06080)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:27.066874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ea21e-6940-40e0-9bd6-d5e156855af2 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:27.066874 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1268/2509] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:40:26 2022] GET /identity/v3/projects/ee01a09299784387bceb8555cee06080 => generated 383 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:40:27.466653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75682152-e47a-4c7c-888d-170b19400406 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:27.469204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-75682152-e47a-4c7c-888d-170b19400406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:27.516149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75682152-e47a-4c7c-888d-170b19400406 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:27.528329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ea21e-6940-40e0-9bd6-d5e156855af2 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:27.530278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-325ea21e-6940-40e0-9bd6-d5e156855af2 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:27.537256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934943f-d2cd-4b8c-b58d-bb077fdf0166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:27.537911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934943f-d2cd-4b8c-b58d-bb077fdf0166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:27.538187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934943f-d2cd-4b8c-b58d-bb077fdf0166 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:27.538455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934943f-d2cd-4b8c-b58d-bb077fdf0166 admin admin] PATH_INFO: `/v3/users/d26cae92a4da4d4eb8f3027477a6d07f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:27.539803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934943f-d2cd-4b8c-b58d-bb077fdf0166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d26cae92a4da4d4eb8f3027477a6d07f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:27.552372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934943f-d2cd-4b8c-b58d-bb077fdf0166 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:27.560279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ea21e-6940-40e0-9bd6-d5e156855af2 tempest-QuotasAdminNegativeTest-2040001807 tempest-QuotasAdminNegativeTest-2040001807-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:27.570343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b19d6-68ed-41a8-b249-6540d79f5007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:27.571051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b19d6-68ed-41a8-b249-6540d79f5007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:27.571268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b19d6-68ed-41a8-b249-6540d79f5007 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:27.571545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b19d6-68ed-41a8-b249-6540d79f5007 admin admin] PATH_INFO: `/v3/projects/0dc0e301a3604d3684400e8567e9f76a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:27.572756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b19d6-68ed-41a8-b249-6540d79f5007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dc0e301a3604d3684400e8567e9f76a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:27.574692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b19d6-68ed-41a8-b249-6540d79f5007 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:27.970963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1934943f-d2cd-4b8c-b58d-bb077fdf0166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd26cae92a4da4d4eb8f3027477a6d07f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:27.972843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9e9b19d6-68ed-41a8-b249-6540d79f5007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dc0e301a3604d3684400e8567e9f76a', 'request_id': 'req-9e9b19d6-68ed-41a8-b249-6540d79f5007'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:27.987440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9e9b19d6-68ed-41a8-b249-6540d79f5007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dc0e301a3604d3684400e8567e9f76a', 'request_id': 'req-9e9b19d6-68ed-41a8-b249-6540d79f5007'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:28.121529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1934943f-d2cd-4b8c-b58d-bb077fdf0166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd26cae92a4da4d4eb8f3027477a6d07f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:28.122537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1934943f-d2cd-4b8c-b58d-bb077fdf0166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd26cae92a4da4d4eb8f3027477a6d07f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:28.135654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1934943f-d2cd-4b8c-b58d-bb077fdf0166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd26cae92a4da4d4eb8f3027477a6d07f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:28.184596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1934943f-d2cd-4b8c-b58d-bb077fdf0166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd26cae92a4da4d4eb8f3027477a6d07f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:28.201779 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1242/2510] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:40:27 2022] DELETE /identity/v3/users/d26cae92a4da4d4eb8f3027477a6d07f => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:28.209056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3b1b6-c129-4e9e-a6ef-97b85c39138e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:28.209704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3b1b6-c129-4e9e-a6ef-97b85c39138e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:28.210268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3b1b6-c129-4e9e-a6ef-97b85c39138e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:28.218404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:28.264056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-63b3b1b6-c129-4e9e-a6ef-97b85c39138e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:28.269109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-63b3b1b6-c129-4e9e-a6ef-97b85c39138e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:28.297608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9e9b19d6-68ed-41a8-b249-6540d79f5007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dc0e301a3604d3684400e8567e9f76a', 'request_id': 'req-9e9b19d6-68ed-41a8-b249-6540d79f5007'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:28.321011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9e9b19d6-68ed-41a8-b249-6540d79f5007 admin admin] The token cache is being invalidate because project 0dc0e301a3604d3684400e8567e9f76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:28.323246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9e9b19d6-68ed-41a8-b249-6540d79f5007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:28.324967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9e9b19d6-68ed-41a8-b249-6540d79f5007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:28.329025 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1269/2511] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:27 2022] DELETE /identity/v3/projects/0dc0e301a3604d3684400e8567e9f76a => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:28.336987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b19d6-68ed-41a8-b249-6540d79f5007 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:28.344348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9e9b19d6-68ed-41a8-b249-6540d79f5007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:28.457138 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1243/2512] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:28.469000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3b1b6-c129-4e9e-a6ef-97b85c39138e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:28.475127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-63b3b1b6-c129-4e9e-a6ef-97b85c39138e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:28.598490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b19d6-68ed-41a8-b249-6540d79f5007 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:28.633598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4112b3d-4342-436c-82c2-6de7a007908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:28.639659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:28.640242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4112b3d-4342-436c-82c2-6de7a007908e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:28.640708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4112b3d-4342-436c-82c2-6de7a007908e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:28.641130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4112b3d-4342-436c-82c2-6de7a007908e admin admin] PATH_INFO: `/v3/users/9f14605d27004dcf8f46a0687ce9c9cd` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:28.644084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4112b3d-4342-436c-82c2-6de7a007908e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f14605d27004dcf8f46a0687ce9c9cd)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:28.646797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4112b3d-4342-436c-82c2-6de7a007908e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:28.653910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3b1b6-c129-4e9e-a6ef-97b85c39138e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:28.667439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f31b99-6fe4-4b4e-8e4b-ae65c3e2e737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:28.669280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f31b99-6fe4-4b4e-8e4b-ae65c3e2e737 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:28.669686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f31b99-6fe4-4b4e-8e4b-ae65c3e2e737 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:28.670079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f31b99-6fe4-4b4e-8e4b-ae65c3e2e737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:28.704938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f31b99-6fe4-4b4e-8e4b-ae65c3e2e737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:28.709912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f31b99-6fe4-4b4e-8e4b-ae65c3e2e737 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:28.754376 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1244/2513] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:28.999869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a4112b3d-4342-436c-82c2-6de7a007908e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f14605d27004dcf8f46a0687ce9c9cd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:29.002903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a4112b3d-4342-436c-82c2-6de7a007908e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f14605d27004dcf8f46a0687ce9c9cd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:29.133348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a4112b3d-4342-436c-82c2-6de7a007908e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f14605d27004dcf8f46a0687ce9c9cd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:29.134155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a4112b3d-4342-436c-82c2-6de7a007908e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f14605d27004dcf8f46a0687ce9c9cd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:29.159536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a4112b3d-4342-436c-82c2-6de7a007908e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f14605d27004dcf8f46a0687ce9c9cd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:29.196896 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1270/2514] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:40:28 2022] DELETE /identity/v3/users/9f14605d27004dcf8f46a0687ce9c9cd => generated 0 bytes in 862 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:30.336764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f31b99-6fe4-4b4e-8e4b-ae65c3e2e737 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:30.339565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-82f31b99-6fe4-4b4e-8e4b-ae65c3e2e737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:30.366542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f31b99-6fe4-4b4e-8e4b-ae65c3e2e737 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:30.474224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f14cf-ea84-46bb-b905-30b0021c486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:30.474224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f14cf-ea84-46bb-b905-30b0021c486b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:30.474224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f14cf-ea84-46bb-b905-30b0021c486b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:30.474224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f14cf-ea84-46bb-b905-30b0021c486b admin admin] PATH_INFO: `/v3/projects/ee01a09299784387bceb8555cee06080` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:30.474746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f14cf-ea84-46bb-b905-30b0021c486b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee01a09299784387bceb8555cee06080)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:30.475431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f14cf-ea84-46bb-b905-30b0021c486b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:30.641485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4112b3d-4342-436c-82c2-6de7a007908e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:30.641485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a4112b3d-4342-436c-82c2-6de7a007908e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:30.677653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4112b3d-4342-436c-82c2-6de7a007908e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:30.725609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030139c-7aae-4e78-a7fd-69c9b872762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:30.726475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030139c-7aae-4e78-a7fd-69c9b872762c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:30.726915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030139c-7aae-4e78-a7fd-69c9b872762c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:30.727356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030139c-7aae-4e78-a7fd-69c9b872762c admin admin] PATH_INFO: `/v3/projects/221888b8a04f40cd8d678753fc882746` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:30.728788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030139c-7aae-4e78-a7fd-69c9b872762c admin admin] RBAC: Authorizing `identity:delete_project(project_id=221888b8a04f40cd8d678753fc882746)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:30.749449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030139c-7aae-4e78-a7fd-69c9b872762c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:30.972050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0f1f14cf-ea84-46bb-b905-30b0021c486b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee01a09299784387bceb8555cee06080', 'request_id': 'req-0f1f14cf-ea84-46bb-b905-30b0021c486b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:30.991125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0f1f14cf-ea84-46bb-b905-30b0021c486b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee01a09299784387bceb8555cee06080', 'request_id': 'req-0f1f14cf-ea84-46bb-b905-30b0021c486b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:31.003462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0f1f14cf-ea84-46bb-b905-30b0021c486b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee01a09299784387bceb8555cee06080', 'request_id': 'req-0f1f14cf-ea84-46bb-b905-30b0021c486b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:31.110310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0f1f14cf-ea84-46bb-b905-30b0021c486b admin admin] The token cache is being invalidate because project ee01a09299784387bceb8555cee06080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:31.111230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0f1f14cf-ea84-46bb-b905-30b0021c486b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:31.123292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0f1f14cf-ea84-46bb-b905-30b0021c486b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:31.136374 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1245/2515] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:30 2022] DELETE /identity/v3/projects/ee01a09299784387bceb8555cee06080 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:31.137529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f14cf-ea84-46bb-b905-30b0021c486b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:31.145811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b030139c-7aae-4e78-a7fd-69c9b872762c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '221888b8a04f40cd8d678753fc882746', 'request_id': 'req-b030139c-7aae-4e78-a7fd-69c9b872762c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:31.148439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0f1f14cf-ea84-46bb-b905-30b0021c486b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:31.168274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b030139c-7aae-4e78-a7fd-69c9b872762c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '221888b8a04f40cd8d678753fc882746', 'request_id': 'req-b030139c-7aae-4e78-a7fd-69c9b872762c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:31.233962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:31.298407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b030139c-7aae-4e78-a7fd-69c9b872762c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '221888b8a04f40cd8d678753fc882746', 'request_id': 'req-b030139c-7aae-4e78-a7fd-69c9b872762c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:31.317198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b030139c-7aae-4e78-a7fd-69c9b872762c admin admin] The token cache is being invalidate because project 221888b8a04f40cd8d678753fc882746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:31.317508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b030139c-7aae-4e78-a7fd-69c9b872762c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:31.325889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b030139c-7aae-4e78-a7fd-69c9b872762c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:31.339745 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1271/2516] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:30 2022] DELETE /identity/v3/projects/221888b8a04f40cd8d678753fc882746 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:31.344514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeb191-f14b-4b1b-8e4d-77b46f8b4931 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:31.344858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeb191-f14b-4b1b-8e4d-77b46f8b4931 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:31.345287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeb191-f14b-4b1b-8e4d-77b46f8b4931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:31.375487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f14cf-ea84-46bb-b905-30b0021c486b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:31.425995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b1eeb191-f14b-4b1b-8e4d-77b46f8b4931 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:31.429042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b1eeb191-f14b-4b1b-8e4d-77b46f8b4931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:31.639575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc89d7-5d4e-4170-b896-551e9713b1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:31.639575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc89d7-5d4e-4170-b896-551e9713b1ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:31.639575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc89d7-5d4e-4170-b896-551e9713b1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:31.639575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc89d7-5d4e-4170-b896-551e9713b1ee admin admin] PATH_INFO: `/v3/users/d7d70b8593854605b4483c0a27fb7e22` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:31.640531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc89d7-5d4e-4170-b896-551e9713b1ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d70b8593854605b4483c0a27fb7e22)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:31.640531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc89d7-5d4e-4170-b896-551e9713b1ee admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:31.641143 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1272/2517] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:31.641143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ad423-09ee-47eb-8e64-53f76ac844b1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:31.641143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ad423-09ee-47eb-8e64-53f76ac844b1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:31.641143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ad423-09ee-47eb-8e64-53f76ac844b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:31.721761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:31.728764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d71ad423-09ee-47eb-8e64-53f76ac844b1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:31.730288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d71ad423-09ee-47eb-8e64-53f76ac844b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:31.752452 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1273/2518] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:40:31.754607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ad423-09ee-47eb-8e64-53f76ac844b1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:31.768361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ad423-09ee-47eb-8e64-53f76ac844b1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:31.780599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceffaea-7527-4be6-afc0-aa0d61b7c1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:31.786364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceffaea-7527-4be6-afc0-aa0d61b7c1cf admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:31.786364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceffaea-7527-4be6-afc0-aa0d61b7c1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:31.786364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceffaea-7527-4be6-afc0-aa0d61b7c1cf admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:31.786364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceffaea-7527-4be6-afc0-aa0d61b7c1cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:40:31.786364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceffaea-7527-4be6-afc0-aa0d61b7c1cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:31.786364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceffaea-7527-4be6-afc0-aa0d61b7c1cf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:31.842552 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1274/2519] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:40:31.842552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceffaea-7527-4be6-afc0-aa0d61b7c1cf admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:31.854924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceffaea-7527-4be6-afc0-aa0d61b7c1cf admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:31.861041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20869dc-5811-4a27-a131-1cddfd71d8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:31.862307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20869dc-5811-4a27-a131-1cddfd71d8aa admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:31.862307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20869dc-5811-4a27-a131-1cddfd71d8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:31.862307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20869dc-5811-4a27-a131-1cddfd71d8aa admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:31.862683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20869dc-5811-4a27-a131-1cddfd71d8aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:31.864670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20869dc-5811-4a27-a131-1cddfd71d8aa admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:32.018711 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1275/2520] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:31 2022] POST /identity/v3/projects => generated 391 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:32.021487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20869dc-5811-4a27-a131-1cddfd71d8aa admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:32.051277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7ccc89d7-5d4e-4170-b896-551e9713b1ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d70b8593854605b4483c0a27fb7e22'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:32.166828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7ccc89d7-5d4e-4170-b896-551e9713b1ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d70b8593854605b4483c0a27fb7e22'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:32.167465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7ccc89d7-5d4e-4170-b896-551e9713b1ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d70b8593854605b4483c0a27fb7e22'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:32.182135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7ccc89d7-5d4e-4170-b896-551e9713b1ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d70b8593854605b4483c0a27fb7e22'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:32.223254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20869dc-5811-4a27-a131-1cddfd71d8aa admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:32.227966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7ccc89d7-5d4e-4170-b896-551e9713b1ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d70b8593854605b4483c0a27fb7e22'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:32.244955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4554e2-dee9-4290-876d-96e0e777e9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:32.246937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4554e2-dee9-4290-876d-96e0e777e9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:32.247552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4554e2-dee9-4290-876d-96e0e777e9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:32.247828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4554e2-dee9-4290-876d-96e0e777e9d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:32.248025 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1246/2521] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:40:31 2022] DELETE /identity/v3/users/d7d70b8593854605b4483c0a27fb7e22 => generated 0 bytes in 1111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:32.248947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4554e2-dee9-4290-876d-96e0e777e9d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:32.251074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4554e2-dee9-4290-876d-96e0e777e9d5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:32.355767 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1276/2522] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:32 2022] POST /identity/v3/users => generated 296 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:32.357105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc89d7-5d4e-4170-b896-551e9713b1ee admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:32.358694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7ccc89d7-5d4e-4170-b896-551e9713b1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:32.523305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc89d7-5d4e-4170-b896-551e9713b1ee admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:32.545085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91f196-cac7-4c75-8602-2385aebe2a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:32.546161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91f196-cac7-4c75-8602-2385aebe2a81 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:32.546657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91f196-cac7-4c75-8602-2385aebe2a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:32.547613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91f196-cac7-4c75-8602-2385aebe2a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:32.548842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91f196-cac7-4c75-8602-2385aebe2a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:32.553972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91f196-cac7-4c75-8602-2385aebe2a81 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:32.590109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4554e2-dee9-4290-876d-96e0e777e9d5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:32.623229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4554e2-dee9-4290-876d-96e0e777e9d5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:32.624144 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1247/2523] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:32.625538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dff7c-3586-4acd-907c-07ce4d25a286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:32.626633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dff7c-3586-4acd-907c-07ce4d25a286 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:32.632530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dff7c-3586-4acd-907c-07ce4d25a286 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:32.635666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dff7c-3586-4acd-907c-07ce4d25a286 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:32.636778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7dff7c-3586-4acd-907c-07ce4d25a286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:32.640627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7dff7c-3586-4acd-907c-07ce4d25a286 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:32.674968 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1277/2524] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:40:32.676472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91f196-cac7-4c75-8602-2385aebe2a81 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:32.689003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91f196-cac7-4c75-8602-2385aebe2a81 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:32.708866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca1306-7c9c-4f22-a7c4-e8ae2bf2cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:32.709850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca1306-7c9c-4f22-a7c4-e8ae2bf2cc6f admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:32.710290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca1306-7c9c-4f22-a7c4-e8ae2bf2cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:32.710755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca1306-7c9c-4f22-a7c4-e8ae2bf2cc6f admin admin] PATH_INFO: `/v3/projects/13b5bce4a2e84ed7a2eebbd849374b72/users/0d57c08b83534595857f5b9856b967e4/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:32.785685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca1306-7c9c-4f22-a7c4-e8ae2bf2cc6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b5bce4a2e84ed7a2eebbd849374b72, user_id=0d57c08b83534595857f5b9856b967e4, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:32.788751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca1306-7c9c-4f22-a7c4-e8ae2bf2cc6f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:32.813132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:32.893190 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1248/2525] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:32 2022] PUT /identity/v3/projects/13b5bce4a2e84ed7a2eebbd849374b72/users/0d57c08b83534595857f5b9856b967e4/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:32.912779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab00ec5-33c6-4337-804b-715a28dc9935 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:32.913616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab00ec5-33c6-4337-804b-715a28dc9935 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:32.914055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab00ec5-33c6-4337-804b-715a28dc9935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:33.016929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7ab00ec5-33c6-4337-804b-715a28dc9935 None None] MFA Rules not processed for user `0d57c08b83534595857f5b9856b967e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:33.023065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7ab00ec5-33c6-4337-804b-715a28dc9935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:33.214242 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1278/2526] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:33.218405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca1306-7c9c-4f22-a7c4-e8ae2bf2cc6f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:33.366472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca1306-7c9c-4f22-a7c4-e8ae2bf2cc6f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:33.372354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09474896-42a8-49c5-b26f-155566a565de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:33.373175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09474896-42a8-49c5-b26f-155566a565de admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:33.373657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09474896-42a8-49c5-b26f-155566a565de admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:33.374097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09474896-42a8-49c5-b26f-155566a565de admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:33.374982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09474896-42a8-49c5-b26f-155566a565de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:33.379442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09474896-42a8-49c5-b26f-155566a565de admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:33.454027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:33.463169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab00ec5-33c6-4337-804b-715a28dc9935 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:33.465429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7ab00ec5-33c6-4337-804b-715a28dc9935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:33.500325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab00ec5-33c6-4337-804b-715a28dc9935 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:33.514075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b80b74-1adb-42bc-aab2-4c1b74e5a5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:33.514897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b80b74-1adb-42bc-aab2-4c1b74e5a5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:33.515278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b80b74-1adb-42bc-aab2-4c1b74e5a5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:33.516329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b80b74-1adb-42bc-aab2-4c1b74e5a5fc admin admin] PATH_INFO: `/v3/projects/65ba8f506eda464c937113c3a88bde45` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:33.520125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b80b74-1adb-42bc-aab2-4c1b74e5a5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=65ba8f506eda464c937113c3a88bde45)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:33.522266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b80b74-1adb-42bc-aab2-4c1b74e5a5fc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:33.550078 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1249/2527] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:33 2022] POST /identity/v3/projects => generated 393 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:40:33.555375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09474896-42a8-49c5-b26f-155566a565de admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:33.702315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d0b80b74-1adb-42bc-aab2-4c1b74e5a5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ba8f506eda464c937113c3a88bde45', 'request_id': 'req-d0b80b74-1adb-42bc-aab2-4c1b74e5a5fc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:33.722416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d0b80b74-1adb-42bc-aab2-4c1b74e5a5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ba8f506eda464c937113c3a88bde45', 'request_id': 'req-d0b80b74-1adb-42bc-aab2-4c1b74e5a5fc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:33.830775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09474896-42a8-49c5-b26f-155566a565de admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:33.852398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d0b80b74-1adb-42bc-aab2-4c1b74e5a5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ba8f506eda464c937113c3a88bde45', 'request_id': 'req-d0b80b74-1adb-42bc-aab2-4c1b74e5a5fc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:33.931135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d0b80b74-1adb-42bc-aab2-4c1b74e5a5fc admin admin] The token cache is being invalidate because project 65ba8f506eda464c937113c3a88bde45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:33.932414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d0b80b74-1adb-42bc-aab2-4c1b74e5a5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:33.936980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d0b80b74-1adb-42bc-aab2-4c1b74e5a5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:33.943744 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1279/2528] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:33 2022] DELETE /identity/v3/projects/65ba8f506eda464c937113c3a88bde45 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:33.946449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:33.950767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9a4ee-fb39-4eb1-9c68-d8e7b47ccfdf None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:33.961965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9a4ee-fb39-4eb1-9c68-d8e7b47ccfdf None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:33.961965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9a4ee-fb39-4eb1-9c68-d8e7b47ccfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:34.049638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-05f9a4ee-fb39-4eb1-9c68-d8e7b47ccfdf None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:34.052708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-05f9a4ee-fb39-4eb1-9c68-d8e7b47ccfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:34.078437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e70bc6-bab4-4ff8-81f5-91e4a836df56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:34.079824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e70bc6-bab4-4ff8-81f5-91e4a836df56 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:34.080328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e70bc6-bab4-4ff8-81f5-91e4a836df56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:34.080786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e70bc6-bab4-4ff8-81f5-91e4a836df56 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:34.090670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e70bc6-bab4-4ff8-81f5-91e4a836df56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:34.096229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e70bc6-bab4-4ff8-81f5-91e4a836df56 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:34.263190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:34.272281 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1250/2529] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:33 2022] POST /identity/v3/users => generated 303 bytes in 718 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:34.273627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e70bc6-bab4-4ff8-81f5-91e4a836df56 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:34.276940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-82e70bc6-bab4-4ff8-81f5-91e4a836df56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:34.294962 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1280/2530] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:34.309419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597db38-9cd4-44b3-a7d6-7f9d7280fc80 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:34.309757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597db38-9cd4-44b3-a7d6-7f9d7280fc80 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:34.310052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597db38-9cd4-44b3-a7d6-7f9d7280fc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:34.333193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e70bc6-bab4-4ff8-81f5-91e4a836df56 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:34.353117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf642db-c3be-48c9-966e-9c311bdc23a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:34.354123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf642db-c3be-48c9-966e-9c311bdc23a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:34.354424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf642db-c3be-48c9-966e-9c311bdc23a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:34.354706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf642db-c3be-48c9-966e-9c311bdc23a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:34.355549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf642db-c3be-48c9-966e-9c311bdc23a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:34.360243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf642db-c3be-48c9-966e-9c311bdc23a4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:34.381768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c597db38-9cd4-44b3-a7d6-7f9d7280fc80 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:34.388361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c597db38-9cd4-44b3-a7d6-7f9d7280fc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:34.405242 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1251/2531] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:34.415334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf642db-c3be-48c9-966e-9c311bdc23a4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:34.426516 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1281/2532] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:34.427665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597db38-9cd4-44b3-a7d6-7f9d7280fc80 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:34.454180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597db38-9cd4-44b3-a7d6-7f9d7280fc80 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:34.472152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85d833-155c-40eb-a4ca-8cb3a171722f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:34.472941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85d833-155c-40eb-a4ca-8cb3a171722f admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:34.473218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85d833-155c-40eb-a4ca-8cb3a171722f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:34.473489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85d833-155c-40eb-a4ca-8cb3a171722f admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:34.474225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85d833-155c-40eb-a4ca-8cb3a171722f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:40:34.474538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85d833-155c-40eb-a4ca-8cb3a171722f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:34.476112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85d833-155c-40eb-a4ca-8cb3a171722f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:34.477304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf642db-c3be-48c9-966e-9c311bdc23a4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:34.523400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db2b9a-f61b-41d6-9469-f2640002d219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:34.533725 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1282/2533] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:40:34.533725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85d833-155c-40eb-a4ca-8cb3a171722f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:34.535103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db2b9a-f61b-41d6-9469-f2640002d219 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:34.535903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db2b9a-f61b-41d6-9469-f2640002d219 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:34.536447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db2b9a-f61b-41d6-9469-f2640002d219 admin admin] PATH_INFO: `/v3/projects/6fe86516ee7d4ff6827f5e27a6f0ee6c/users/d8bff7bfabe94d4d8956f37cad8f5847/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:34.575473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85d833-155c-40eb-a4ca-8cb3a171722f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:34.593802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db2b9a-f61b-41d6-9469-f2640002d219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe86516ee7d4ff6827f5e27a6f0ee6c, user_id=d8bff7bfabe94d4d8956f37cad8f5847, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:34.594431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c3072-d8db-4734-97f5-6b8a36ff88a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:34.596680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c3072-d8db-4734-97f5-6b8a36ff88a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:34.598887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db2b9a-f61b-41d6-9469-f2640002d219 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:34.599585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c3072-d8db-4734-97f5-6b8a36ff88a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:34.600011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c3072-d8db-4734-97f5-6b8a36ff88a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:34.602089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c3072-d8db-4734-97f5-6b8a36ff88a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:34.612670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c3072-d8db-4734-97f5-6b8a36ff88a4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:34.713939 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1252/2534] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:34 2022] PUT /identity/v3/projects/6fe86516ee7d4ff6827f5e27a6f0ee6c/users/d8bff7bfabe94d4d8956f37cad8f5847/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:34.718867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db2b9a-f61b-41d6-9469-f2640002d219 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:34.744402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:34.800190 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1283/2535] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:34 2022] POST /identity/v3/projects => generated 387 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:34.801827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c3072-d8db-4734-97f5-6b8a36ff88a4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:34.956670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db2b9a-f61b-41d6-9469-f2640002d219 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:35.098412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f494a-8687-4667-b064-906c26c43ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:35.099401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f494a-8687-4667-b064-906c26c43ffa admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:35.099877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f494a-8687-4667-b064-906c26c43ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:35.100347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f494a-8687-4667-b064-906c26c43ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:35.104833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f494a-8687-4667-b064-906c26c43ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:35.106519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f494a-8687-4667-b064-906c26c43ffa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:35.168952 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1253/2536] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:35.169835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f494a-8687-4667-b064-906c26c43ffa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:35.199277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c3072-d8db-4734-97f5-6b8a36ff88a4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:35.213327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b883428-1998-4c52-8c40-8dae02bd1f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:35.214017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b883428-1998-4c52-8c40-8dae02bd1f6a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:35.214294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b883428-1998-4c52-8c40-8dae02bd1f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:35.214586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b883428-1998-4c52-8c40-8dae02bd1f6a admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:35.215215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b883428-1998-4c52-8c40-8dae02bd1f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:35.224460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f494a-8687-4667-b064-906c26c43ffa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:35.226899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b883428-1998-4c52-8c40-8dae02bd1f6a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:35.242000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0742593-26b1-4186-9b0c-0fcac9d9c26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:35.244583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0742593-26b1-4186-9b0c-0fcac9d9c26b admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:35.244870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0742593-26b1-4186-9b0c-0fcac9d9c26b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:35.245148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0742593-26b1-4186-9b0c-0fcac9d9c26b admin admin] PATH_INFO: `/v3/projects/6fe86516ee7d4ff6827f5e27a6f0ee6c/users/d8bff7bfabe94d4d8956f37cad8f5847/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:35.259566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0742593-26b1-4186-9b0c-0fcac9d9c26b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe86516ee7d4ff6827f5e27a6f0ee6c, user_id=d8bff7bfabe94d4d8956f37cad8f5847, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:35.267461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0742593-26b1-4186-9b0c-0fcac9d9c26b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:35.319591 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1254/2537] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:35 2022] PUT /identity/v3/projects/6fe86516ee7d4ff6827f5e27a6f0ee6c/users/d8bff7bfabe94d4d8956f37cad8f5847/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:35.337555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84882bcd-d2be-4d9d-850c-44841dc4f716 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:35.338043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84882bcd-d2be-4d9d-850c-44841dc4f716 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:35.338495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84882bcd-d2be-4d9d-850c-44841dc4f716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:35.442318 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1284/2538] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:34 2022] POST /identity/v3/users => generated 294 bytes in 641 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:35.453333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b883428-1998-4c52-8c40-8dae02bd1f6a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:35.515293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b883428-1998-4c52-8c40-8dae02bd1f6a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:35.534594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-84882bcd-d2be-4d9d-850c-44841dc4f716 None None] MFA Rules not processed for user `d8bff7bfabe94d4d8956f37cad8f5847`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:35.548751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-84882bcd-d2be-4d9d-850c-44841dc4f716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:35.799038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5b88b-2665-463d-9400-55266229ab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:35.799986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5b88b-2665-463d-9400-55266229ab8c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:35.804009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5b88b-2665-463d-9400-55266229ab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:35.806613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5b88b-2665-463d-9400-55266229ab8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:35.807347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5b88b-2665-463d-9400-55266229ab8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:35.809053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5b88b-2665-463d-9400-55266229ab8c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:35.874348 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1285/2539] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:35.874348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5b88b-2665-463d-9400-55266229ab8c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:35.875309 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1255/2540] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 533 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:35.885631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e45622-2796-4cd5-8f99-39a0bc1745b1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:35.885984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e45622-2796-4cd5-8f99-39a0bc1745b1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:35.886264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e45622-2796-4cd5-8f99-39a0bc1745b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:35.903910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5b88b-2665-463d-9400-55266229ab8c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:35.940081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e08dd-8c70-463d-96bd-4407a2e564d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:35.946526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e08dd-8c70-463d-96bd-4407a2e564d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:35.946526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e08dd-8c70-463d-96bd-4407a2e564d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:35.946526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e08dd-8c70-463d-96bd-4407a2e564d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:35.946526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e08dd-8c70-463d-96bd-4407a2e564d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:35.959819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e08dd-8c70-463d-96bd-4407a2e564d3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:35.977427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-19e45622-2796-4cd5-8f99-39a0bc1745b1 None None] MFA Rules not processed for user `0d57c08b83534595857f5b9856b967e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:35.989154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-19e45622-2796-4cd5-8f99-39a0bc1745b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:36.008804 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1286/2541] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:36.009846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e08dd-8c70-463d-96bd-4407a2e564d3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:36.035732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e08dd-8c70-463d-96bd-4407a2e564d3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:36.046225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ef1ff-3318-4be0-9870-4eb9599fe02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:36.046907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ef1ff-3318-4be0-9870-4eb9599fe02d admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:36.047186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ef1ff-3318-4be0-9870-4eb9599fe02d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:36.047457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ef1ff-3318-4be0-9870-4eb9599fe02d admin admin] PATH_INFO: `/v3/projects/846cd1c98578429c921d9598106bcdcf/users/70a3037174c74cc6bd8c22538f3acbcb/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:36.132589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ef1ff-3318-4be0-9870-4eb9599fe02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=846cd1c98578429c921d9598106bcdcf, user_id=70a3037174c74cc6bd8c22538f3acbcb, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:36.135193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ef1ff-3318-4be0-9870-4eb9599fe02d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:36.242304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:36.268658 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1256/2542] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:36.280649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e45622-2796-4cd5-8f99-39a0bc1745b1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:36.283004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-19e45622-2796-4cd5-8f99-39a0bc1745b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:36.288247 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1287/2543] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:36 2022] PUT /identity/v3/projects/846cd1c98578429c921d9598106bcdcf/users/70a3037174c74cc6bd8c22538f3acbcb/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:36.306022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:36.308227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01247a3a-283b-4fdf-8cd6-7b7c9cc4968f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:36.308520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01247a3a-283b-4fdf-8cd6-7b7c9cc4968f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:36.308955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01247a3a-283b-4fdf-8cd6-7b7c9cc4968f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:36.372319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-01247a3a-283b-4fdf-8cd6-7b7c9cc4968f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:36.393980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-01247a3a-283b-4fdf-8cd6-7b7c9cc4968f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:36.524029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e45622-2796-4cd5-8f99-39a0bc1745b1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:36.672201 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1288/2544] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:36.683958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01247a3a-283b-4fdf-8cd6-7b7c9cc4968f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:36.708394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-01247a3a-283b-4fdf-8cd6-7b7c9cc4968f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:36.721138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377896b-7099-4214-b7e3-96f99434253e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:36.723994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377896b-7099-4214-b7e3-96f99434253e service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:36.723994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377896b-7099-4214-b7e3-96f99434253e service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:36.723994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377896b-7099-4214-b7e3-96f99434253e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:36.724982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3377896b-7099-4214-b7e3-96f99434253e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:36.905230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377896b-7099-4214-b7e3-96f99434253e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:36.907699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377896b-7099-4214-b7e3-96f99434253e service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:36.931083 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1257/2545] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:36.950190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01247a3a-283b-4fdf-8cd6-7b7c9cc4968f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:36.960781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0931d-4f9f-41f4-b74f-474d3a6dcf4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:36.963003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0931d-4f9f-41f4-b74f-474d3a6dcf4b service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:36.964939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0931d-4f9f-41f4-b74f-474d3a6dcf4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:36.966887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0931d-4f9f-41f4-b74f-474d3a6dcf4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:37.024804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0931d-4f9f-41f4-b74f-474d3a6dcf4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:37.026451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0931d-4f9f-41f4-b74f-474d3a6dcf4b service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:37.073616 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1289/2546] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:37.092924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:37.304567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:37.389792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:37.949790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:38.046509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:38.069468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:38.201544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:38.647376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:38.955962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0a291-655a-4f97-b7a9-a7562b326c04 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:38.955962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0a291-655a-4f97-b7a9-a7562b326c04 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:38.955962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0a291-655a-4f97-b7a9-a7562b326c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:39.095909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-08e0a291-655a-4f97-b7a9-a7562b326c04 None None] MFA Rules not processed for user `eab4fe38f4aa4180b5b4ea27fb01b06b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:39.101571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-08e0a291-655a-4f97-b7a9-a7562b326c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:39.232142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:39.359022 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1258/2547] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:39.365154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0931d-4f9f-41f4-b74f-474d3a6dcf4b service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:39.366961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a8f0931d-4f9f-41f4-b74f-474d3a6dcf4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:39.409576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0931d-4f9f-41f4-b74f-474d3a6dcf4b service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:39.432045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3761f-0516-4110-9461-333649f6557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:39.433012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3761f-0516-4110-9461-333649f6557e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:39.434452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3761f-0516-4110-9461-333649f6557e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:39.435487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3761f-0516-4110-9461-333649f6557e admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:39.438598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3761f-0516-4110-9461-333649f6557e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:39.443953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3761f-0516-4110-9461-333649f6557e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:39.481433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:39.655273 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1290/2548] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:39 2022] POST /identity/v3/projects => generated 397 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:39.660690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0a291-655a-4f97-b7a9-a7562b326c04 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:39.691396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0a291-655a-4f97-b7a9-a7562b326c04 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:39.811366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7acbe6-1146-4792-9c28-dcb6a960543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:39.812247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7acbe6-1146-4792-9c28-dcb6a960543f admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:39.812703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7acbe6-1146-4792-9c28-dcb6a960543f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:39.813190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7acbe6-1146-4792-9c28-dcb6a960543f admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:39.814282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7acbe6-1146-4792-9c28-dcb6a960543f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:39.816700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7acbe6-1146-4792-9c28-dcb6a960543f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:39.957390 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1259/2549] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:39 2022] POST /identity/v3/users => generated 305 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:39.958621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3761f-0516-4110-9461-333649f6557e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:39.986076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3761f-0516-4110-9461-333649f6557e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:40.005446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71962038-d2f9-425d-b7a1-e78845b6dd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:40.006766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71962038-d2f9-425d-b7a1-e78845b6dd94 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:40.007215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71962038-d2f9-425d-b7a1-e78845b6dd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:40.007645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71962038-d2f9-425d-b7a1-e78845b6dd94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:40.008685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71962038-d2f9-425d-b7a1-e78845b6dd94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:40.011286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71962038-d2f9-425d-b7a1-e78845b6dd94 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:40.014824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:40.031471 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1291/2550] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:40:40.037676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7acbe6-1146-4792-9c28-dcb6a960543f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:40.067127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7acbe6-1146-4792-9c28-dcb6a960543f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:40.081996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1654807-6098-4014-9231-f61341b4c59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:40.083354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1654807-6098-4014-9231-f61341b4c59a admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:40.086073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1654807-6098-4014-9231-f61341b4c59a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:40.086646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1654807-6098-4014-9231-f61341b4c59a admin admin] PATH_INFO: `/v3/projects/f8e12ca98ca249628fc4edb3bc6a1675/users/ff2da905c9c944f9ae470e2ad3bbd64a/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:40.113839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1654807-6098-4014-9231-f61341b4c59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e12ca98ca249628fc4edb3bc6a1675, user_id=ff2da905c9c944f9ae470e2ad3bbd64a, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:40.117336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1654807-6098-4014-9231-f61341b4c59a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:40.128079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3ec06-bafb-4f39-a6ee-c4bded076300 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:40.128443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3ec06-bafb-4f39-a6ee-c4bded076300 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:40.128723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3ec06-bafb-4f39-a6ee-c4bded076300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:40.171506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-68b3ec06-bafb-4f39-a6ee-c4bded076300 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:40.173679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-68b3ec06-bafb-4f39-a6ee-c4bded076300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:40.184342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:40.229711 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1260/2551] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:40 2022] PUT /identity/v3/projects/f8e12ca98ca249628fc4edb3bc6a1675/users/ff2da905c9c944f9ae470e2ad3bbd64a/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:40.234060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1654807-6098-4014-9231-f61341b4c59a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:40.354602 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1292/2552] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:40:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:40:40.368612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1654807-6098-4014-9231-f61341b4c59a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:40.375544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d7ff7-fc3c-4264-8f07-5c91b41f99fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:40.378572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d7ff7-fc3c-4264-8f07-5c91b41f99fb admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:40.378572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d7ff7-fc3c-4264-8f07-5c91b41f99fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:40.379769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d7ff7-fc3c-4264-8f07-5c91b41f99fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:40.380868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d7ff7-fc3c-4264-8f07-5c91b41f99fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:40.382787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d7ff7-fc3c-4264-8f07-5c91b41f99fb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:40.424331 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1261/2553] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:40.428792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3ec06-bafb-4f39-a6ee-c4bded076300 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:40.430791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-68b3ec06-bafb-4f39-a6ee-c4bded076300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:40.434935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d7ff7-fc3c-4264-8f07-5c91b41f99fb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:40.466991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d7ff7-fc3c-4264-8f07-5c91b41f99fb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:40.479740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bc88f-ea38-48d5-8b4e-4f38b20d05c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:40.480595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bc88f-ea38-48d5-8b4e-4f38b20d05c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:40.485307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bc88f-ea38-48d5-8b4e-4f38b20d05c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:40.485307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bc88f-ea38-48d5-8b4e-4f38b20d05c0 admin admin] PATH_INFO: `/v3/projects/f8e12ca98ca249628fc4edb3bc6a1675/users/ff2da905c9c944f9ae470e2ad3bbd64a/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:40.491469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bc88f-ea38-48d5-8b4e-4f38b20d05c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e12ca98ca249628fc4edb3bc6a1675, user_id=ff2da905c9c944f9ae470e2ad3bbd64a, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:40.494342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bc88f-ea38-48d5-8b4e-4f38b20d05c0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:40.518180 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1262/2554] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:40 2022] PUT /identity/v3/projects/f8e12ca98ca249628fc4edb3bc6a1675/users/ff2da905c9c944f9ae470e2ad3bbd64a/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:40.655948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3ec06-bafb-4f39-a6ee-c4bded076300 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:40.833183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00a563-d7d9-4669-9359-48403d84038c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:40.833900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00a563-d7d9-4669-9359-48403d84038c service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:40.834429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00a563-d7d9-4669-9359-48403d84038c service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:40.834957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00a563-d7d9-4669-9359-48403d84038c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:40.884422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471a746-4647-4007-9638-8464fd0d09a2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:40.884928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471a746-4647-4007-9638-8464fd0d09a2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:40.885374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471a746-4647-4007-9638-8464fd0d09a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:40.895072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-6471a746-4647-4007-9638-8464fd0d09a2 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:40:40.895072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:40:40.895072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:40:40.895072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:40:40.895072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:40:40.895072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:40:40.895072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:40:40.895072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:40:40.895072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:40:40.895072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:40:40.895072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:40:40.895072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:40:40.895072 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:40:40.896128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:40:40.896128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:40:40.896128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:40:40.896128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:40:40.896128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:40:40.896128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:40:40.896128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:40:40.896128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:40:40.896128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:40:40.896128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:40:40.896128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:40:40.896128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:40:40.896128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:40:40.896128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:40:40.896128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:40:40.901405 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1263/2555] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:40:40 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 18 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 04:40:40.942413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00a563-d7d9-4669-9359-48403d84038c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:40.944221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00a563-d7d9-4669-9359-48403d84038c service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:40.957922 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1293/2556] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:40:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 04:40:41.626935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:42.053139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:42.263671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471a746-4647-4007-9638-8464fd0d09a2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:42.267382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6471a746-4647-4007-9638-8464fd0d09a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:42.419621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:42.667585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471a746-4647-4007-9638-8464fd0d09a2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:42.680910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3efc00-4e5d-4172-8547-cddd5edecf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:42.682044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3efc00-4e5d-4172-8547-cddd5edecf37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:42.683324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3efc00-4e5d-4172-8547-cddd5edecf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:42.683838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3efc00-4e5d-4172-8547-cddd5edecf37 admin admin] PATH_INFO: `/v3/users/d5329b8aa2834338bd50b0efc6fbbb16` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:42.687872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3efc00-4e5d-4172-8547-cddd5edecf37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5329b8aa2834338bd50b0efc6fbbb16)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:42.692002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3efc00-4e5d-4172-8547-cddd5edecf37 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:43.002091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-de3efc00-4e5d-4172-8547-cddd5edecf37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5329b8aa2834338bd50b0efc6fbbb16'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:43.086648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-de3efc00-4e5d-4172-8547-cddd5edecf37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5329b8aa2834338bd50b0efc6fbbb16'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:43.088106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-de3efc00-4e5d-4172-8547-cddd5edecf37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5329b8aa2834338bd50b0efc6fbbb16'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:43.102435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-de3efc00-4e5d-4172-8547-cddd5edecf37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5329b8aa2834338bd50b0efc6fbbb16'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:43.179286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-de3efc00-4e5d-4172-8547-cddd5edecf37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5329b8aa2834338bd50b0efc6fbbb16'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:43.200154 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1264/2557] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:40:42 2022] DELETE /identity/v3/users/d5329b8aa2834338bd50b0efc6fbbb16 => generated 0 bytes in 938 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:43.615153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:43.990925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00a563-d7d9-4669-9359-48403d84038c service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:44.023280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00a563-d7d9-4669-9359-48403d84038c service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:44.029794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781cb98-9c5b-46e2-90a0-207adaa88c9d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:44.031222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781cb98-9c5b-46e2-90a0-207adaa88c9d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:44.031997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781cb98-9c5b-46e2-90a0-207adaa88c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:44.093305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f781cb98-9c5b-46e2-90a0-207adaa88c9d None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:44.109624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f781cb98-9c5b-46e2-90a0-207adaa88c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:44.307060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d60df6-f324-4028-af8d-dc22fa27df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:44.308713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d60df6-f324-4028-af8d-dc22fa27df27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:44.308713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d60df6-f324-4028-af8d-dc22fa27df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:44.308713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d60df6-f324-4028-af8d-dc22fa27df27 admin admin] PATH_INFO: `/v3/projects/5830193fb5044d669e0ec200593ff23f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:44.316662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d60df6-f324-4028-af8d-dc22fa27df27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5830193fb5044d669e0ec200593ff23f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:44.326241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d60df6-f324-4028-af8d-dc22fa27df27 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:44.327289 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1265/2558] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:40:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:44.334756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781cb98-9c5b-46e2-90a0-207adaa88c9d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:44.336312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f781cb98-9c5b-46e2-90a0-207adaa88c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:44.456305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:44.510802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-18d60df6-f324-4028-af8d-dc22fa27df27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5830193fb5044d669e0ec200593ff23f', 'request_id': 'req-18d60df6-f324-4028-af8d-dc22fa27df27'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:44.520564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-18d60df6-f324-4028-af8d-dc22fa27df27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5830193fb5044d669e0ec200593ff23f', 'request_id': 'req-18d60df6-f324-4028-af8d-dc22fa27df27'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:44.532601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781cb98-9c5b-46e2-90a0-207adaa88c9d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:44.631625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-18d60df6-f324-4028-af8d-dc22fa27df27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5830193fb5044d669e0ec200593ff23f', 'request_id': 'req-18d60df6-f324-4028-af8d-dc22fa27df27'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:44.654854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:44.688786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-18d60df6-f324-4028-af8d-dc22fa27df27 admin admin] The token cache is being invalidate because project 5830193fb5044d669e0ec200593ff23f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:44.697997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-18d60df6-f324-4028-af8d-dc22fa27df27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:44.699259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-18d60df6-f324-4028-af8d-dc22fa27df27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:44.701798 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1294/2559] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:43 2022] DELETE /identity/v3/projects/5830193fb5044d669e0ec200593ff23f => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:44.711818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d60df6-f324-4028-af8d-dc22fa27df27 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:44.718146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-18d60df6-f324-4028-af8d-dc22fa27df27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:44.756373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba967c-49e7-4e57-8da2-eeaa1fe1e1fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:44.757866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba967c-49e7-4e57-8da2-eeaa1fe1e1fd service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:44.761021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba967c-49e7-4e57-8da2-eeaa1fe1e1fd service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:44.761021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba967c-49e7-4e57-8da2-eeaa1fe1e1fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:44.766190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e6ba967c-49e7-4e57-8da2-eeaa1fe1e1fd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:44.967897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d60df6-f324-4028-af8d-dc22fa27df27 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:44.978334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec194a2-7d4d-41e5-a313-5e4b08bc388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:44.981054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec194a2-7d4d-41e5-a313-5e4b08bc388d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:44.982351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec194a2-7d4d-41e5-a313-5e4b08bc388d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:44.983022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec194a2-7d4d-41e5-a313-5e4b08bc388d admin admin] PATH_INFO: `/v3/users/01471a5a05de4b149fb04f13cf0e66b5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:44.987456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec194a2-7d4d-41e5-a313-5e4b08bc388d admin admin] RBAC: Authorizing `identity:delete_user(user_id=01471a5a05de4b149fb04f13cf0e66b5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:44.994943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec194a2-7d4d-41e5-a313-5e4b08bc388d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:45.015468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba967c-49e7-4e57-8da2-eeaa1fe1e1fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:45.015468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba967c-49e7-4e57-8da2-eeaa1fe1e1fd service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:45.074204 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1266/2560] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:40:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 04:40:45.074204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba967c-49e7-4e57-8da2-eeaa1fe1e1fd service swift] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:45.085471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e6ba967c-49e7-4e57-8da2-eeaa1fe1e1fd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:45.296049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dec194a2-7d4d-41e5-a313-5e4b08bc388d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01471a5a05de4b149fb04f13cf0e66b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:45.298933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba967c-49e7-4e57-8da2-eeaa1fe1e1fd service swift] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:45.309002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dec194a2-7d4d-41e5-a313-5e4b08bc388d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01471a5a05de4b149fb04f13cf0e66b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:45.322188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9022a81-dce0-472e-a47a-a8a6d413ce25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:45.323178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9022a81-dce0-472e-a47a-a8a6d413ce25 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:45.323616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9022a81-dce0-472e-a47a-a8a6d413ce25 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:45.324063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9022a81-dce0-472e-a47a-a8a6d413ce25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:45.330164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e9022a81-dce0-472e-a47a-a8a6d413ce25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:45.401574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:45.406776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dec194a2-7d4d-41e5-a313-5e4b08bc388d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01471a5a05de4b149fb04f13cf0e66b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:45.408359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dec194a2-7d4d-41e5-a313-5e4b08bc388d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01471a5a05de4b149fb04f13cf0e66b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:45.487119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dec194a2-7d4d-41e5-a313-5e4b08bc388d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01471a5a05de4b149fb04f13cf0e66b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:45.527357 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1295/2561] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:40:44 2022] DELETE /identity/v3/users/01471a5a05de4b149fb04f13cf0e66b5 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:45.551228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9022a81-dce0-472e-a47a-a8a6d413ce25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:45.553445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9022a81-dce0-472e-a47a-a8a6d413ce25 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:45.582091 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1267/2562] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:40:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:40:46.484591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec194a2-7d4d-41e5-a313-5e4b08bc388d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:46.488124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dec194a2-7d4d-41e5-a313-5e4b08bc388d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:46.564840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:46.736862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec194a2-7d4d-41e5-a313-5e4b08bc388d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:46.756527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0f987-6ab9-434b-96fe-11d8a05a8494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:46.757517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0f987-6ab9-434b-96fe-11d8a05a8494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:46.757949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0f987-6ab9-434b-96fe-11d8a05a8494 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:46.758374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0f987-6ab9-434b-96fe-11d8a05a8494 admin admin] PATH_INFO: `/v3/projects/4be70acd148e4739ba601614d787ad14` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:46.759770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0f987-6ab9-434b-96fe-11d8a05a8494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be70acd148e4739ba601614d787ad14)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:46.761895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0f987-6ab9-434b-96fe-11d8a05a8494 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:46.971389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7dc0f987-6ab9-434b-96fe-11d8a05a8494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be70acd148e4739ba601614d787ad14', 'request_id': 'req-7dc0f987-6ab9-434b-96fe-11d8a05a8494'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:46.985235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7dc0f987-6ab9-434b-96fe-11d8a05a8494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be70acd148e4739ba601614d787ad14', 'request_id': 'req-7dc0f987-6ab9-434b-96fe-11d8a05a8494'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:47.103561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7dc0f987-6ab9-434b-96fe-11d8a05a8494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be70acd148e4739ba601614d787ad14', 'request_id': 'req-7dc0f987-6ab9-434b-96fe-11d8a05a8494'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:47.122849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7dc0f987-6ab9-434b-96fe-11d8a05a8494 admin admin] The token cache is being invalidate because project 4be70acd148e4739ba601614d787ad14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:40:47.123055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7dc0f987-6ab9-434b-96fe-11d8a05a8494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:47.124528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7dc0f987-6ab9-434b-96fe-11d8a05a8494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:40:47.129729 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1296/2563] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:40:46 2022] DELETE /identity/v3/projects/4be70acd148e4739ba601614d787ad14 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:47.134773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a09f6-7a63-49a7-9e89-3873e524be1d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:47.135340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a09f6-7a63-49a7-9e89-3873e524be1d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:47.135443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a09f6-7a63-49a7-9e89-3873e524be1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:47.175554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8a9a09f6-7a63-49a7-9e89-3873e524be1d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:47.176841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8a9a09f6-7a63-49a7-9e89-3873e524be1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:47.324086 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1268/2564] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:47.325966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72170-840b-49b7-bdd6-dc4cecb6a110 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:47.326097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72170-840b-49b7-bdd6-dc4cecb6a110 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:47.326341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72170-840b-49b7-bdd6-dc4cecb6a110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:47.371594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-cbb72170-840b-49b7-bdd6-dc4cecb6a110 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:47.373024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cbb72170-840b-49b7-bdd6-dc4cecb6a110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:47.399993 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1297/2565] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:40:47.403883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a09f6-7a63-49a7-9e89-3873e524be1d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:47.421238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a09f6-7a63-49a7-9e89-3873e524be1d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:47.434351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98efd9-5f5a-4753-bee7-eec69675d43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:47.435067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98efd9-5f5a-4753-bee7-eec69675d43b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:47.435355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98efd9-5f5a-4753-bee7-eec69675d43b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:47.435634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98efd9-5f5a-4753-bee7-eec69675d43b admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:47.436510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98efd9-5f5a-4753-bee7-eec69675d43b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:40:47.436852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98efd9-5f5a-4753-bee7-eec69675d43b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:47.439713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98efd9-5f5a-4753-bee7-eec69675d43b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:47.481824 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1269/2566] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:40:47.483042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb72170-840b-49b7-bdd6-dc4cecb6a110 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:47.496363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb72170-840b-49b7-bdd6-dc4cecb6a110 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:47.508350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53aa3e4-a3e6-405a-90b4-e4be45ebcac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:47.511216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aa3e4-a3e6-405a-90b4-e4be45ebcac8 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:47.511835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aa3e4-a3e6-405a-90b4-e4be45ebcac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:47.512341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aa3e4-a3e6-405a-90b4-e4be45ebcac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:47.513233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53aa3e4-a3e6-405a-90b4-e4be45ebcac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:47.521510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53aa3e4-a3e6-405a-90b4-e4be45ebcac8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:47.645761 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1298/2567] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:47 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:47.649911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98efd9-5f5a-4753-bee7-eec69675d43b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:47.668357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98efd9-5f5a-4753-bee7-eec69675d43b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:47.903478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1ab79-62b8-4a68-8e64-f4a4f53b4488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:47.904179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1ab79-62b8-4a68-8e64-f4a4f53b4488 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:47.904482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1ab79-62b8-4a68-8e64-f4a4f53b4488 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:47.904759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1ab79-62b8-4a68-8e64-f4a4f53b4488 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:47.905466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1ab79-62b8-4a68-8e64-f4a4f53b4488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:47.915896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1ab79-62b8-4a68-8e64-f4a4f53b4488 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:48.032368 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1270/2568] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:47 2022] POST /identity/v3/users => generated 289 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:48.036406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53aa3e4-a3e6-405a-90b4-e4be45ebcac8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:48.056894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53aa3e4-a3e6-405a-90b4-e4be45ebcac8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:48.084058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52720498-d8f1-4e31-989a-c2b8ea6eec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:48.084727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52720498-d8f1-4e31-989a-c2b8ea6eec03 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:48.085007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52720498-d8f1-4e31-989a-c2b8ea6eec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:48.085285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52720498-d8f1-4e31-989a-c2b8ea6eec03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:48.087709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212d3be-c459-46a6-a7e6-dc6848a9e431 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:48.090647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212d3be-c459-46a6-a7e6-dc6848a9e431 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:48.091193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212d3be-c459-46a6-a7e6-dc6848a9e431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:48.102283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52720498-d8f1-4e31-989a-c2b8ea6eec03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:48.103964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52720498-d8f1-4e31-989a-c2b8ea6eec03 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:48.145678 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1299/2569] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:48.148118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52720498-d8f1-4e31-989a-c2b8ea6eec03 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:48.160855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1212d3be-c459-46a6-a7e6-dc6848a9e431 None None] MFA Rules not processed for user `4f4affe28e084a7eb873d9a1f0f79fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:48.170619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1212d3be-c459-46a6-a7e6-dc6848a9e431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:48.189362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52720498-d8f1-4e31-989a-c2b8ea6eec03 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:48.217088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a9fe2-180c-48fa-883a-35937c2fab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:48.217737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9fe2-180c-48fa-883a-35937c2fab63 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:48.218025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9fe2-180c-48fa-883a-35937c2fab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:48.218306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9fe2-180c-48fa-883a-35937c2fab63 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:48.219029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a9fe2-180c-48fa-883a-35937c2fab63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:48.225917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a9fe2-180c-48fa-883a-35937c2fab63 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:48.293549 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1300/2570] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:48.305329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a9fe2-180c-48fa-883a-35937c2fab63 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:48.351798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a9fe2-180c-48fa-883a-35937c2fab63 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:48.378271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1473b6-bd38-47d9-bda4-fd45a7de85bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:48.379100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:48.381085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1473b6-bd38-47d9-bda4-fd45a7de85bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:48.381393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1473b6-bd38-47d9-bda4-fd45a7de85bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:48.381664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1473b6-bd38-47d9-bda4-fd45a7de85bf admin admin] PATH_INFO: `/v3/projects/85e6a5d271a34981aa46e35c5d87235d/users/1c6f5869b505455c8a124f4971cdc03f/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:48.432404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1473b6-bd38-47d9-bda4-fd45a7de85bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e6a5d271a34981aa46e35c5d87235d, user_id=1c6f5869b505455c8a124f4971cdc03f, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:48.436607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1473b6-bd38-47d9-bda4-fd45a7de85bf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:48.460831 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1271/2571] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:40:48.542671 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1301/2572] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:48 2022] PUT /identity/v3/projects/85e6a5d271a34981aa46e35c5d87235d/users/1c6f5869b505455c8a124f4971cdc03f/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:48.556497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695c016-c4d0-4663-86bc-9fe0f12dce5e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:48.556840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695c016-c4d0-4663-86bc-9fe0f12dce5e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:48.557141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695c016-c4d0-4663-86bc-9fe0f12dce5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:48.644756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d695c016-c4d0-4663-86bc-9fe0f12dce5e None None] MFA Rules not processed for user `1c6f5869b505455c8a124f4971cdc03f`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:48.646290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d695c016-c4d0-4663-86bc-9fe0f12dce5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:48.828534 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1272/2573] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:48.833132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1473b6-bd38-47d9-bda4-fd45a7de85bf admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:48.901157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:48.946989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1473b6-bd38-47d9-bda4-fd45a7de85bf admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:48.960630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc81325-80f0-45d3-aff0-cea4ffedba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:48.962148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc81325-80f0-45d3-aff0-cea4ffedba58 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:48.962148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc81325-80f0-45d3-aff0-cea4ffedba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:48.962148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc81325-80f0-45d3-aff0-cea4ffedba58 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:48.963153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc81325-80f0-45d3-aff0-cea4ffedba58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:48.973305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc81325-80f0-45d3-aff0-cea4ffedba58 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:49.117900 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1302/2574] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:40:48 2022] POST /identity/v3/projects => generated 379 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:49.125056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695c016-c4d0-4663-86bc-9fe0f12dce5e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:49.142954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695c016-c4d0-4663-86bc-9fe0f12dce5e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:49.303129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf27a80-27d9-4673-aaf3-b9f0de554820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:49.304881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf27a80-27d9-4673-aaf3-b9f0de554820 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:49.305630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf27a80-27d9-4673-aaf3-b9f0de554820 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:49.306233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf27a80-27d9-4673-aaf3-b9f0de554820 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:49.308077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf27a80-27d9-4673-aaf3-b9f0de554820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:49.311644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf27a80-27d9-4673-aaf3-b9f0de554820 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:49.509500 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1273/2575] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:40:49 2022] POST /identity/v3/users => generated 296 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:40:49.511929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc81325-80f0-45d3-aff0-cea4ffedba58 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:49.538779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc81325-80f0-45d3-aff0-cea4ffedba58 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:49.557442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1d068-2912-4c21-8c59-42610dc5de99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:49.559343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1d068-2912-4c21-8c59-42610dc5de99 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:49.559834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1d068-2912-4c21-8c59-42610dc5de99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:49.560346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1d068-2912-4c21-8c59-42610dc5de99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:49.561259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1d068-2912-4c21-8c59-42610dc5de99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:49.568193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1d068-2912-4c21-8c59-42610dc5de99 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:49.607345 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1303/2576] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:40:49.610280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf27a80-27d9-4673-aaf3-b9f0de554820 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:49.633240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf27a80-27d9-4673-aaf3-b9f0de554820 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:49.655621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320dede-21ad-40e4-aed9-d29d3e0f708f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:49.658286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320dede-21ad-40e4-aed9-d29d3e0f708f admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:49.658847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320dede-21ad-40e4-aed9-d29d3e0f708f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:49.660102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320dede-21ad-40e4-aed9-d29d3e0f708f admin admin] PATH_INFO: `/v3/projects/6b1345166a4d43aa9540deb79f58d190/users/78f00229131843988a82d9ea90f796e4/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:49.705057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320dede-21ad-40e4-aed9-d29d3e0f708f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1345166a4d43aa9540deb79f58d190, user_id=78f00229131843988a82d9ea90f796e4, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:49.708383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320dede-21ad-40e4-aed9-d29d3e0f708f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:49.842856 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1274/2577] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:49 2022] PUT /identity/v3/projects/6b1345166a4d43aa9540deb79f58d190/users/78f00229131843988a82d9ea90f796e4/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:49.847054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1d068-2912-4c21-8c59-42610dc5de99 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:49.878704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1d068-2912-4c21-8c59-42610dc5de99 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:50.114339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81645a17-006d-4d86-821b-97fa05da1d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:50.115152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81645a17-006d-4d86-821b-97fa05da1d22 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:50.120928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81645a17-006d-4d86-821b-97fa05da1d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:50.121308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81645a17-006d-4d86-821b-97fa05da1d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:50.122080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81645a17-006d-4d86-821b-97fa05da1d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:50.123760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81645a17-006d-4d86-821b-97fa05da1d22 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:50.165766 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1304/2578] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:40:50.167891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320dede-21ad-40e4-aed9-d29d3e0f708f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:40:50.194003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320dede-21ad-40e4-aed9-d29d3e0f708f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:40:50.211455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dbd0ae-5540-490e-ba29-d5c8e1f04b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:40:50.212513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbd0ae-5540-490e-ba29-d5c8e1f04b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:50.213027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbd0ae-5540-490e-ba29-d5c8e1f04b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:50.213453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbd0ae-5540-490e-ba29-d5c8e1f04b9a admin admin] PATH_INFO: `/v3/projects/6b1345166a4d43aa9540deb79f58d190/users/78f00229131843988a82d9ea90f796e4/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:50.216773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dbd0ae-5540-490e-ba29-d5c8e1f04b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1345166a4d43aa9540deb79f58d190, user_id=78f00229131843988a82d9ea90f796e4, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:40:50.225674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dbd0ae-5540-490e-ba29-d5c8e1f04b9a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:40:50.250673 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1275/2579] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:40:50 2022] PUT /identity/v3/projects/6b1345166a4d43aa9540deb79f58d190/users/78f00229131843988a82d9ea90f796e4/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:40:50.262845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49bff2-ce30-4acc-b64c-e17da522e967 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:50.263132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49bff2-ce30-4acc-b64c-e17da522e967 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:50.263682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49bff2-ce30-4acc-b64c-e17da522e967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:50.335787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1c49bff2-ce30-4acc-b64c-e17da522e967 None None] MFA Rules not processed for user `78f00229131843988a82d9ea90f796e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:50.338139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1c49bff2-ce30-4acc-b64c-e17da522e967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:50.649949 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1305/2580] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:56.656467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4c3b0-6b73-422e-b98e-75f81509d0a3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:56.656467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4c3b0-6b73-422e-b98e-75f81509d0a3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:56.656467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4c3b0-6b73-422e-b98e-75f81509d0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:56.753456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-76b4c3b0-6b73-422e-b98e-75f81509d0a3 None None] MFA Rules not processed for user `ff2da905c9c944f9ae470e2ad3bbd64a`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:56.755601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-76b4c3b0-6b73-422e-b98e-75f81509d0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:56.807230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:57.166733 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1276/2581] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 512 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:40:57.178540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eca6e-c82f-4074-8793-3f3b85a0c1ac None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:40:57.179496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eca6e-c82f-4074-8793-3f3b85a0c1ac None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:40:57.179926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eca6e-c82f-4074-8793-3f3b85a0c1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:40:57.231060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e18eca6e-c82f-4074-8793-3f3b85a0c1ac None None] MFA Rules not processed for user `eab4fe38f4aa4180b5b4ea27fb01b06b`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:40:57.232894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e18eca6e-c82f-4074-8793-3f3b85a0c1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:40:57.278382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:40:57.413523 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1306/2582] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:40:57 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:00.490801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32e510-1b86-404e-a14d-76e283925820 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:00.491402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32e510-1b86-404e-a14d-76e283925820 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:00.491402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32e510-1b86-404e-a14d-76e283925820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:00.571204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8b32e510-1b86-404e-a14d-76e283925820 None None] MFA Rules not processed for user `70a3037174c74cc6bd8c22538f3acbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:00.572470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8b32e510-1b86-404e-a14d-76e283925820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:00.752674 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1277/2583] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:05.646671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18eca6e-c82f-4074-8793-3f3b85a0c1ac None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:05.648257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e18eca6e-c82f-4074-8793-3f3b85a0c1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:05.774429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18eca6e-c82f-4074-8793-3f3b85a0c1ac None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:05.791133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6f7e7-ded3-43d2-aca8-4ee5ae6ef36d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:05.791772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6f7e7-ded3-43d2-aca8-4ee5ae6ef36d service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:05.792051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6f7e7-ded3-43d2-aca8-4ee5ae6ef36d service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:05.792354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6f7e7-ded3-43d2-aca8-4ee5ae6ef36d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:05.808986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6f7e7-ded3-43d2-aca8-4ee5ae6ef36d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:05.810760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6f7e7-ded3-43d2-aca8-4ee5ae6ef36d service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:05.823886 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1307/2584] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:06.038647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32e510-1b86-404e-a14d-76e283925820 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:06.064587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32e510-1b86-404e-a14d-76e283925820 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:06.064587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53a170-431d-4456-960d-e13e99c12d53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:06.076351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53a170-431d-4456-960d-e13e99c12d53 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:06.076664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53a170-431d-4456-960d-e13e99c12d53 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:06.077332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53a170-431d-4456-960d-e13e99c12d53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:06.080265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ee53a170-431d-4456-960d-e13e99c12d53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:06.127904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53a170-431d-4456-960d-e13e99c12d53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:06.129516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53a170-431d-4456-960d-e13e99c12d53 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:06.145650 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1278/2585] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:06 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:06.491946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bbdf2-39bf-482c-962e-7e2a7c159e16 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:06.492437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bbdf2-39bf-482c-962e-7e2a7c159e16 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:06.493400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bbdf2-39bf-482c-962e-7e2a7c159e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:06.500635 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-285bbdf2-39bf-482c-962e-7e2a7c159e16 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:41:06.500635 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:41:06.500635 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:41:06.500635 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:41:06.500635 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:41:06.500635 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:41:06.500635 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:41:06.500635 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:41:06.500635 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:41:06.500635 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:41:06.500635 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:41:06.500635 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:41:06.500635 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:41:06.501598 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:41:06.501598 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:41:06.501598 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:41:06.501598 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:41:06.501598 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:41:06.501598 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:41:06.501598 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:41:06.501598 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:41:06.501598 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:41:06.501598 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:41:06.501598 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:41:06.501598 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:41:06.501598 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:41:06.501598 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:41:06.501598 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:41:06.502485 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1308/2586] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:41:06 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:41:06.546743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bbdf2-39bf-482c-962e-7e2a7c159e16 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:06.550930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df095f-c85b-4d1a-87c0-64ce696875f1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:06.554606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df095f-c85b-4d1a-87c0-64ce696875f1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:06.555818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df095f-c85b-4d1a-87c0-64ce696875f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:06.582869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bbdf2-39bf-482c-962e-7e2a7c159e16 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:06.585997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-74df095f-c85b-4d1a-87c0-64ce696875f1 None None] MFA Rules not processed for user `eab4fe38f4aa4180b5b4ea27fb01b06b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:06.587334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-74df095f-c85b-4d1a-87c0-64ce696875f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:06.603085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2d5c2-3531-45ed-8cd8-7533c08436e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:06.603731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2d5c2-3531-45ed-8cd8-7533c08436e7 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:06.604010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2d5c2-3531-45ed-8cd8-7533c08436e7 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:06.604307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2d5c2-3531-45ed-8cd8-7533c08436e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:06.608992 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1279/2587] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:06.623782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2d5c2-3531-45ed-8cd8-7533c08436e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:06.635417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2d5c2-3531-45ed-8cd8-7533c08436e7 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:06.644607 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1309/2588] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:07.366395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df095f-c85b-4d1a-87c0-64ce696875f1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:07.369273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-74df095f-c85b-4d1a-87c0-64ce696875f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:07.399496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df095f-c85b-4d1a-87c0-64ce696875f1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:07.413262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a39c4a-d5e6-4b70-a8bf-6ba54aca9dc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:07.413898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a39c4a-d5e6-4b70-a8bf-6ba54aca9dc4 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:07.414357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a39c4a-d5e6-4b70-a8bf-6ba54aca9dc4 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:07.417922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a39c4a-d5e6-4b70-a8bf-6ba54aca9dc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:07.420010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-31a39c4a-d5e6-4b70-a8bf-6ba54aca9dc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:07.508549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a39c4a-d5e6-4b70-a8bf-6ba54aca9dc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:07.510679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a39c4a-d5e6-4b70-a8bf-6ba54aca9dc4 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:07.536129 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1280/2589] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:07.693005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34039687-ab25-4759-aee3-47c5afcd895d None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:07.693537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34039687-ab25-4759-aee3-47c5afcd895d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:07.694010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34039687-ab25-4759-aee3-47c5afcd895d None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:07.695540 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1310/2590] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:41:07.702921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a39c4a-d5e6-4b70-a8bf-6ba54aca9dc4 service nova] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:41:07.717077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a39c4a-d5e6-4b70-a8bf-6ba54aca9dc4 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:07.729835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a39c4a-d5e6-4b70-a8bf-6ba54aca9dc4 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:07.737912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17e0f4-460d-45a7-bac8-efa951297fa4 tempest-FlavorsAccessTestJSON-1422149761 tempest-FlavorsAccessTestJSON-1422149761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f00229131843988a82d9ea90f796e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b1345166a4d43aa9540deb79f58d190', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:07.738625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17e0f4-460d-45a7-bac8-efa951297fa4 tempest-FlavorsAccessTestJSON-1422149761 tempest-FlavorsAccessTestJSON-1422149761-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:07.739002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17e0f4-460d-45a7-bac8-efa951297fa4 tempest-FlavorsAccessTestJSON-1422149761 tempest-FlavorsAccessTestJSON-1422149761-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:07.739210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17e0f4-460d-45a7-bac8-efa951297fa4 tempest-FlavorsAccessTestJSON-1422149761 tempest-FlavorsAccessTestJSON-1422149761-project-admin] PATH_INFO: `/v3/projects/85e6a5d271a34981aa46e35c5d87235d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:07.740427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17e0f4-460d-45a7-bac8-efa951297fa4 tempest-FlavorsAccessTestJSON-1422149761 tempest-FlavorsAccessTestJSON-1422149761-project-admin] RBAC: Authorizing `identity:get_project(project_id=85e6a5d271a34981aa46e35c5d87235d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:07.742808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17e0f4-460d-45a7-bac8-efa951297fa4 tempest-FlavorsAccessTestJSON-1422149761 tempest-FlavorsAccessTestJSON-1422149761-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:07.745112 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1281/2591] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:41:07 2022] GET /identity/v3/projects/85e6a5d271a34981aa46e35c5d87235d => generated 377 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:41:08.307479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34039687-ab25-4759-aee3-47c5afcd895d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:08.309546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-34039687-ab25-4759-aee3-47c5afcd895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:08.397961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34039687-ab25-4759-aee3-47c5afcd895d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:08.402810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c8d22-4e4a-44f5-8740-3a7c0b0ad1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:08.403292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c8d22-4e4a-44f5-8740-3a7c0b0ad1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:08.403574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c8d22-4e4a-44f5-8740-3a7c0b0ad1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:08.403846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c8d22-4e4a-44f5-8740-3a7c0b0ad1c0 admin admin] PATH_INFO: `/v3/users/301b13659b4e40c4bbf4f6a822083580` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:08.405200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c8d22-4e4a-44f5-8740-3a7c0b0ad1c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=301b13659b4e40c4bbf4f6a822083580)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:08.422070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4851400-e359-4162-acae-330fe052061b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:08.422070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4851400-e359-4162-acae-330fe052061b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:08.422070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4851400-e359-4162-acae-330fe052061b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:08.423120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c8d22-4e4a-44f5-8740-3a7c0b0ad1c0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:08.433868 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-e4851400-e359-4162-acae-330fe052061b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:41:08.433868 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:41:08.433868 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:41:08.433868 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:41:08.433868 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:41:08.433868 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:41:08.433868 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:41:08.433868 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:41:08.433868 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:41:08.433868 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:41:08.433868 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:41:08.433868 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:41:08.433868 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:41:08.434949 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:41:08.434949 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:41:08.434949 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:41:08.434949 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:41:08.434949 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:41:08.434949 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:41:08.434949 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:41:08.434949 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:41:08.434949 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:41:08.434949 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:41:08.434949 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:41:08.434949 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:41:08.434949 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:41:08.434949 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:41:08.434949 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:41:08.449239 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1282/2592] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:41:08 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 33 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 04:41:08.719711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:08.721536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-464c8d22-4e4a-44f5-8740-3a7c0b0ad1c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '301b13659b4e40c4bbf4f6a822083580'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:08.722259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-464c8d22-4e4a-44f5-8740-3a7c0b0ad1c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '301b13659b4e40c4bbf4f6a822083580'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:08.804063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-464c8d22-4e4a-44f5-8740-3a7c0b0ad1c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '301b13659b4e40c4bbf4f6a822083580'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:08.806900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-464c8d22-4e4a-44f5-8740-3a7c0b0ad1c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '301b13659b4e40c4bbf4f6a822083580'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:08.840628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-464c8d22-4e4a-44f5-8740-3a7c0b0ad1c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '301b13659b4e40c4bbf4f6a822083580'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:08.866226 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1311/2593] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:41:08 2022] DELETE /identity/v3/users/301b13659b4e40c4bbf4f6a822083580 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:09.028399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4851400-e359-4162-acae-330fe052061b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:09.032520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e4851400-e359-4162-acae-330fe052061b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:09.054627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:09.131280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4851400-e359-4162-acae-330fe052061b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:09.137955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31db30-690f-4837-a259-5656ed1174e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:09.138629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31db30-690f-4837-a259-5656ed1174e8 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:09.138916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31db30-690f-4837-a259-5656ed1174e8 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:09.139188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31db30-690f-4837-a259-5656ed1174e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:09.141612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3b31db30-690f-4837-a259-5656ed1174e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:09.237245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31db30-690f-4837-a259-5656ed1174e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:09.238879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31db30-690f-4837-a259-5656ed1174e8 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:09.249756 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1283/2594] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:09.551807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f9933-b515-4b12-a26a-6add59c57bee None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:09.552373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f9933-b515-4b12-a26a-6add59c57bee None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:09.552649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f9933-b515-4b12-a26a-6add59c57bee None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:09.554165 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1312/2595] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:41:09.559688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31db30-690f-4837-a259-5656ed1174e8 service nova] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:41:09.572478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31db30-690f-4837-a259-5656ed1174e8 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:09.574240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3b31db30-690f-4837-a259-5656ed1174e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:09.668022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31db30-690f-4837-a259-5656ed1174e8 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:09.675704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a4aba-f463-4a99-badc-2c58e388f227 tempest-FlavorsAccessTestJSON-1422149761 tempest-FlavorsAccessTestJSON-1422149761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f00229131843988a82d9ea90f796e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b1345166a4d43aa9540deb79f58d190', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:09.676390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a4aba-f463-4a99-badc-2c58e388f227 tempest-FlavorsAccessTestJSON-1422149761 tempest-FlavorsAccessTestJSON-1422149761-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:09.676676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a4aba-f463-4a99-badc-2c58e388f227 tempest-FlavorsAccessTestJSON-1422149761 tempest-FlavorsAccessTestJSON-1422149761-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:09.676958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a4aba-f463-4a99-badc-2c58e388f227 tempest-FlavorsAccessTestJSON-1422149761 tempest-FlavorsAccessTestJSON-1422149761-project-admin] PATH_INFO: `/v3/projects/85e6a5d271a34981aa46e35c5d87235d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:09.678241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a4aba-f463-4a99-badc-2c58e388f227 tempest-FlavorsAccessTestJSON-1422149761 tempest-FlavorsAccessTestJSON-1422149761-project-admin] RBAC: Authorizing `identity:get_project(project_id=85e6a5d271a34981aa46e35c5d87235d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:09.699364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f9933-b515-4b12-a26a-6add59c57bee None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:09.701409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ed4f9933-b515-4b12-a26a-6add59c57bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:09.702093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a4aba-f463-4a99-badc-2c58e388f227 tempest-FlavorsAccessTestJSON-1422149761 tempest-FlavorsAccessTestJSON-1422149761-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:09.707241 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1284/2596] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:41:09 2022] GET /identity/v3/projects/85e6a5d271a34981aa46e35c5d87235d => generated 377 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:41:09.842578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f9933-b515-4b12-a26a-6add59c57bee None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:09.848002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86fcff-ff28-4c25-bf54-447288ec8939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:09.848409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86fcff-ff28-4c25-bf54-447288ec8939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:09.848691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86fcff-ff28-4c25-bf54-447288ec8939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:09.848964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86fcff-ff28-4c25-bf54-447288ec8939 admin admin] PATH_INFO: `/v3/projects/876447d8eb814920856d46902fd76713` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:09.850182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86fcff-ff28-4c25-bf54-447288ec8939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=876447d8eb814920856d46902fd76713)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:09.852482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86fcff-ff28-4c25-bf54-447288ec8939 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:10.120632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8c86fcff-ff28-4c25-bf54-447288ec8939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '876447d8eb814920856d46902fd76713', 'request_id': 'req-8c86fcff-ff28-4c25-bf54-447288ec8939'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:10.127934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8c86fcff-ff28-4c25-bf54-447288ec8939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '876447d8eb814920856d46902fd76713', 'request_id': 'req-8c86fcff-ff28-4c25-bf54-447288ec8939'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:10.223742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8c86fcff-ff28-4c25-bf54-447288ec8939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '876447d8eb814920856d46902fd76713', 'request_id': 'req-8c86fcff-ff28-4c25-bf54-447288ec8939'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:10.240764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8c86fcff-ff28-4c25-bf54-447288ec8939 admin admin] The token cache is being invalidate because project 876447d8eb814920856d46902fd76713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:41:10.241055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8c86fcff-ff28-4c25-bf54-447288ec8939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:10.242279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8c86fcff-ff28-4c25-bf54-447288ec8939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:10.243990 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1313/2597] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:09 2022] DELETE /identity/v3/projects/876447d8eb814920856d46902fd76713 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:10.248844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a4aba-f463-4a99-badc-2c58e388f227 tempest-FlavorsAccessTestJSON-1422149761 tempest-FlavorsAccessTestJSON-1422149761-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:10.256998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7b2a4aba-f463-4a99-badc-2c58e388f227 tempest-FlavorsAccessTestJSON-1422149761 tempest-FlavorsAccessTestJSON-1422149761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:10.304078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a4aba-f463-4a99-badc-2c58e388f227 tempest-FlavorsAccessTestJSON-1422149761 tempest-FlavorsAccessTestJSON-1422149761-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:10.414470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:10.459661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa03e9f-37aa-49c9-9be2-af445e0da5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:10.461712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa03e9f-37aa-49c9-9be2-af445e0da5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:10.461712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa03e9f-37aa-49c9-9be2-af445e0da5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:10.461712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa03e9f-37aa-49c9-9be2-af445e0da5ea admin admin] PATH_INFO: `/v3/users/28cf6624aed24f4da3e4abcc35a84dcf` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:10.462836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa03e9f-37aa-49c9-9be2-af445e0da5ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=28cf6624aed24f4da3e4abcc35a84dcf)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:10.465049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa03e9f-37aa-49c9-9be2-af445e0da5ea admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:10.775488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9fa03e9f-37aa-49c9-9be2-af445e0da5ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28cf6624aed24f4da3e4abcc35a84dcf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:10.863729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9fa03e9f-37aa-49c9-9be2-af445e0da5ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28cf6624aed24f4da3e4abcc35a84dcf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:10.864882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9fa03e9f-37aa-49c9-9be2-af445e0da5ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28cf6624aed24f4da3e4abcc35a84dcf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:10.874725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9fa03e9f-37aa-49c9-9be2-af445e0da5ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28cf6624aed24f4da3e4abcc35a84dcf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:10.890129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9fa03e9f-37aa-49c9-9be2-af445e0da5ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28cf6624aed24f4da3e4abcc35a84dcf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:10.924194 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1285/2598] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:41:10 2022] DELETE /identity/v3/users/28cf6624aed24f4da3e4abcc35a84dcf => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:11.271148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9151512-eb36-4869-b47d-572bd7961656 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:11.271633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9151512-eb36-4869-b47d-572bd7961656 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:11.271723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9151512-eb36-4869-b47d-572bd7961656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:11.298217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e9151512-eb36-4869-b47d-572bd7961656 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:11.298217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e9151512-eb36-4869-b47d-572bd7961656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:11.361828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc0385-fbca-4b34-a74b-95c6174c3451 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:11.362442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc0385-fbca-4b34-a74b-95c6174c3451 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:11.363881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc0385-fbca-4b34-a74b-95c6174c3451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:11.387978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:11.405346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5dfc0385-fbca-4b34-a74b-95c6174c3451 None None] MFA Rules not processed for user `95a5ea624f3247f4ad47068013e03d40`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:11.413237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5dfc0385-fbca-4b34-a74b-95c6174c3451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:11.413562 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1314/2599] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:41:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:11.426834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9151512-eb36-4869-b47d-572bd7961656 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:11.428966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e9151512-eb36-4869-b47d-572bd7961656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:11.583220 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1286/2600] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:11.583220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc0385-fbca-4b34-a74b-95c6174c3451 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:11.586768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5dfc0385-fbca-4b34-a74b-95c6174c3451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:11.611104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9151512-eb36-4869-b47d-572bd7961656 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:11.617311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36d838-03cb-45cf-9bc7-3de6340aea7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:11.618214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36d838-03cb-45cf-9bc7-3de6340aea7a service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:11.618214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36d838-03cb-45cf-9bc7-3de6340aea7a service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:11.618466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36d838-03cb-45cf-9bc7-3de6340aea7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:11.635918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36d838-03cb-45cf-9bc7-3de6340aea7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:11.637635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36d838-03cb-45cf-9bc7-3de6340aea7a service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:11.652379 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1315/2601] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:41:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 04:41:11.716562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc0385-fbca-4b34-a74b-95c6174c3451 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:11.724437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e0866-b6d5-4263-a4e2-cd7174000bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:11.725284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e0866-b6d5-4263-a4e2-cd7174000bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:11.725567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e0866-b6d5-4263-a4e2-cd7174000bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:11.725841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e0866-b6d5-4263-a4e2-cd7174000bcf admin admin] PATH_INFO: `/v3/projects/3836cf4a5fcb4de098cca1d964f3899e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:11.727499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e0866-b6d5-4263-a4e2-cd7174000bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3836cf4a5fcb4de098cca1d964f3899e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:11.729668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e0866-b6d5-4263-a4e2-cd7174000bcf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:11.742769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:11.884548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-046e0866-b6d5-4263-a4e2-cd7174000bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3836cf4a5fcb4de098cca1d964f3899e', 'request_id': 'req-046e0866-b6d5-4263-a4e2-cd7174000bcf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:11.891840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-046e0866-b6d5-4263-a4e2-cd7174000bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3836cf4a5fcb4de098cca1d964f3899e', 'request_id': 'req-046e0866-b6d5-4263-a4e2-cd7174000bcf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:11.899594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-046e0866-b6d5-4263-a4e2-cd7174000bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3836cf4a5fcb4de098cca1d964f3899e', 'request_id': 'req-046e0866-b6d5-4263-a4e2-cd7174000bcf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:11.978859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-046e0866-b6d5-4263-a4e2-cd7174000bcf admin admin] The token cache is being invalidate because project 3836cf4a5fcb4de098cca1d964f3899e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:41:11.979160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-046e0866-b6d5-4263-a4e2-cd7174000bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:11.989114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-046e0866-b6d5-4263-a4e2-cd7174000bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:11.989114 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1287/2602] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:11 2022] DELETE /identity/v3/projects/3836cf4a5fcb4de098cca1d964f3899e => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:11.992934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66531fd3-2b07-4ecc-9cb3-b829ac18583e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:11.993831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66531fd3-2b07-4ecc-9cb3-b829ac18583e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:11.994341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66531fd3-2b07-4ecc-9cb3-b829ac18583e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:12.056421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-66531fd3-2b07-4ecc-9cb3-b829ac18583e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:12.058041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-66531fd3-2b07-4ecc-9cb3-b829ac18583e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:12.150547 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1316/2603] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:12.152686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5427a1-f70d-4d33-aac5-f98f915b9837 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:12.153218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5427a1-f70d-4d33-aac5-f98f915b9837 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:12.153677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5427a1-f70d-4d33-aac5-f98f915b9837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:12.188182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5d5427a1-f70d-4d33-aac5-f98f915b9837 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:12.191091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5d5427a1-f70d-4d33-aac5-f98f915b9837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:12.202052 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1288/2604] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:41:12.207357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66531fd3-2b07-4ecc-9cb3-b829ac18583e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:12.223247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66531fd3-2b07-4ecc-9cb3-b829ac18583e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:12.230636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01377d64-2fa2-46b9-905f-5d1a47a73042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:12.232458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01377d64-2fa2-46b9-905f-5d1a47a73042 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:12.232850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01377d64-2fa2-46b9-905f-5d1a47a73042 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:12.233023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01377d64-2fa2-46b9-905f-5d1a47a73042 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:12.234046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01377d64-2fa2-46b9-905f-5d1a47a73042 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:41:12.234386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01377d64-2fa2-46b9-905f-5d1a47a73042 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:12.238879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01377d64-2fa2-46b9-905f-5d1a47a73042 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:12.274254 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1317/2605] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:41:12.279935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5427a1-f70d-4d33-aac5-f98f915b9837 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:12.288897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5427a1-f70d-4d33-aac5-f98f915b9837 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:12.294485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ac7c7-e967-45c2-bf0a-4c16203f7e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:12.295109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ac7c7-e967-45c2-bf0a-4c16203f7e63 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:12.295386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ac7c7-e967-45c2-bf0a-4c16203f7e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:12.295661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ac7c7-e967-45c2-bf0a-4c16203f7e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:12.296426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ac7c7-e967-45c2-bf0a-4c16203f7e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:12.299545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ac7c7-e967-45c2-bf0a-4c16203f7e63 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:12.382560 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1289/2606] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:41:12 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:12.384441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01377d64-2fa2-46b9-905f-5d1a47a73042 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:12.394371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01377d64-2fa2-46b9-905f-5d1a47a73042 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:12.456705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c45661-d6ef-4a16-a046-7f1b950b8b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:12.457700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c45661-d6ef-4a16-a046-7f1b950b8b87 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:12.458183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c45661-d6ef-4a16-a046-7f1b950b8b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:12.458645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c45661-d6ef-4a16-a046-7f1b950b8b87 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:12.459473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c45661-d6ef-4a16-a046-7f1b950b8b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:12.462417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c45661-d6ef-4a16-a046-7f1b950b8b87 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:12.602435 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1318/2607] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:41:12 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:12.608075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ac7c7-e967-45c2-bf0a-4c16203f7e63 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:12.635246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ac7c7-e967-45c2-bf0a-4c16203f7e63 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:12.644356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea568c0a-de08-4f12-9161-67b6d17ad48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:12.646108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea568c0a-de08-4f12-9161-67b6d17ad48d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:12.646498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea568c0a-de08-4f12-9161-67b6d17ad48d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:12.646780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea568c0a-de08-4f12-9161-67b6d17ad48d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:12.647741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea568c0a-de08-4f12-9161-67b6d17ad48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:12.650155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea568c0a-de08-4f12-9161-67b6d17ad48d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:12.662264 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1290/2608] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:12.666462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c45661-d6ef-4a16-a046-7f1b950b8b87 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:12.679396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c45661-d6ef-4a16-a046-7f1b950b8b87 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:12.686067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86611850-7101-4d9e-bd96-c4ef7ddf4539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:12.688155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86611850-7101-4d9e-bd96-c4ef7ddf4539 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:12.688690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86611850-7101-4d9e-bd96-c4ef7ddf4539 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:12.689264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86611850-7101-4d9e-bd96-c4ef7ddf4539 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:12.690517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86611850-7101-4d9e-bd96-c4ef7ddf4539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:12.693005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86611850-7101-4d9e-bd96-c4ef7ddf4539 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:12.711012 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1319/2609] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:12.715859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea568c0a-de08-4f12-9161-67b6d17ad48d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:12.733757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea568c0a-de08-4f12-9161-67b6d17ad48d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:12.744333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345ffe4-e1fb-427f-99ce-a766a0adf367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:12.744950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345ffe4-e1fb-427f-99ce-a766a0adf367 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:12.745228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345ffe4-e1fb-427f-99ce-a766a0adf367 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:12.745501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345ffe4-e1fb-427f-99ce-a766a0adf367 admin admin] PATH_INFO: `/v3/projects/8511e600620148c2b51cb7fe446763eb/users/c0493ef2484140f69c1817efaaa51f98/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:12.771568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345ffe4-e1fb-427f-99ce-a766a0adf367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8511e600620148c2b51cb7fe446763eb, user_id=c0493ef2484140f69c1817efaaa51f98, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:12.776797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345ffe4-e1fb-427f-99ce-a766a0adf367 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:12.915907 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1291/2610] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:41:12 2022] PUT /identity/v3/projects/8511e600620148c2b51cb7fe446763eb/users/c0493ef2484140f69c1817efaaa51f98/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:12.931664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ccc7-5949-462a-823a-37dde43db4c8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:12.932536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ccc7-5949-462a-823a-37dde43db4c8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:12.940696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ccc7-5949-462a-823a-37dde43db4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:12.981425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ea84ccc7-5949-462a-823a-37dde43db4c8 None None] MFA Rules not processed for user `c0493ef2484140f69c1817efaaa51f98`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:12.984574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ea84ccc7-5949-462a-823a-37dde43db4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:13.031282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:13.076870 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1320/2611] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:13.081754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345ffe4-e1fb-427f-99ce-a766a0adf367 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:13.153706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345ffe4-e1fb-427f-99ce-a766a0adf367 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:13.159203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f65b5-e937-4b62-b7da-2d38bac5756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:13.164474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f65b5-e937-4b62-b7da-2d38bac5756a admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:13.164474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f65b5-e937-4b62-b7da-2d38bac5756a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:13.164474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f65b5-e937-4b62-b7da-2d38bac5756a admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:13.164474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f65b5-e937-4b62-b7da-2d38bac5756a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:13.164474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f65b5-e937-4b62-b7da-2d38bac5756a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:13.304790 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1292/2612] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:41:13 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:13.305417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84ccc7-5949-462a-823a-37dde43db4c8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:13.320267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84ccc7-5949-462a-823a-37dde43db4c8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:13.410937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4ceb1-c2a5-41da-9838-73ace5704c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:13.412000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4ceb1-c2a5-41da-9838-73ace5704c52 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:13.412547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4ceb1-c2a5-41da-9838-73ace5704c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:13.412974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4ceb1-c2a5-41da-9838-73ace5704c52 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:13.413910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4ceb1-c2a5-41da-9838-73ace5704c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:13.416100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4ceb1-c2a5-41da-9838-73ace5704c52 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:13.490926 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1321/2613] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:41:13 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:41:13.491823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f65b5-e937-4b62-b7da-2d38bac5756a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:13.510564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f65b5-e937-4b62-b7da-2d38bac5756a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:13.518619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97e506-66cc-47e5-a1cb-0287085f2169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:13.519313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97e506-66cc-47e5-a1cb-0287085f2169 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:13.519597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97e506-66cc-47e5-a1cb-0287085f2169 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:13.519864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97e506-66cc-47e5-a1cb-0287085f2169 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:13.521520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97e506-66cc-47e5-a1cb-0287085f2169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:13.523982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97e506-66cc-47e5-a1cb-0287085f2169 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:13.545959 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1293/2614] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:41:13.555314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4ceb1-c2a5-41da-9838-73ace5704c52 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:13.570807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4ceb1-c2a5-41da-9838-73ace5704c52 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:13.577105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65824c6a-2f2a-4bcd-a132-53ea990302d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:13.578787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824c6a-2f2a-4bcd-a132-53ea990302d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:13.578787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824c6a-2f2a-4bcd-a132-53ea990302d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:13.578787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824c6a-2f2a-4bcd-a132-53ea990302d3 admin admin] PATH_INFO: `/v3/projects/ec38230faef14dfebc11b3916089b542/users/801f94c1f2a348589c33b52c9cf02584/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:13.595795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65824c6a-2f2a-4bcd-a132-53ea990302d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec38230faef14dfebc11b3916089b542, user_id=801f94c1f2a348589c33b52c9cf02584, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:13.598419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65824c6a-2f2a-4bcd-a132-53ea990302d3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:13.652648 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1322/2615] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:41:13 2022] PUT /identity/v3/projects/ec38230faef14dfebc11b3916089b542/users/801f94c1f2a348589c33b52c9cf02584/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:13.658517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97e506-66cc-47e5-a1cb-0287085f2169 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:13.684944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97e506-66cc-47e5-a1cb-0287085f2169 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:13.693106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:13.741803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc60c7a-63e7-4133-bedf-0f024da70760 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:13.745473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc60c7a-63e7-4133-bedf-0f024da70760 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:13.745473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc60c7a-63e7-4133-bedf-0f024da70760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:13.755641 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-2fc60c7a-63e7-4133-bedf-0f024da70760 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:41:13.755641 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:41:13.755641 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:41:13.755641 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:41:13.755641 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:41:13.755641 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:41:13.755641 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:41:13.755641 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:41:13.755641 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:41:13.755641 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:41:13.755641 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:41:13.755641 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:41:13.755641 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:41:13.756682 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:41:13.756682 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:41:13.756682 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:41:13.756682 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:41:13.756682 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:41:13.756682 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:41:13.756682 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:41:13.756682 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:41:13.756682 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:41:13.756682 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:41:13.756682 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:41:13.756682 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:41:13.756682 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:41:13.756682 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:41:13.756682 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:41:13.757820 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1323/2616] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:41:13 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 16 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:41:13.800745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de32c4-cb9b-4b06-a381-7a3084a785cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:13.801488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de32c4-cb9b-4b06-a381-7a3084a785cc admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:13.801844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de32c4-cb9b-4b06-a381-7a3084a785cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:13.802639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de32c4-cb9b-4b06-a381-7a3084a785cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:13.803245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de32c4-cb9b-4b06-a381-7a3084a785cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:13.805045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de32c4-cb9b-4b06-a381-7a3084a785cc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:13.817175 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1294/2617] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:13.823318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc60c7a-63e7-4133-bedf-0f024da70760 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:13.849370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc60c7a-63e7-4133-bedf-0f024da70760 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:13.855006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3539c-ad7e-4213-b1f7-bf35f27aba67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:13.855480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3539c-ad7e-4213-b1f7-bf35f27aba67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:13.855761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3539c-ad7e-4213-b1f7-bf35f27aba67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:13.856080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3539c-ad7e-4213-b1f7-bf35f27aba67 admin admin] PATH_INFO: `/v3/projects/ec38230faef14dfebc11b3916089b542/users/801f94c1f2a348589c33b52c9cf02584/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:13.864915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3539c-ad7e-4213-b1f7-bf35f27aba67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec38230faef14dfebc11b3916089b542, user_id=801f94c1f2a348589c33b52c9cf02584, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:13.868131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3539c-ad7e-4213-b1f7-bf35f27aba67 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:13.895245 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1324/2618] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:41:13 2022] PUT /identity/v3/projects/ec38230faef14dfebc11b3916089b542/users/801f94c1f2a348589c33b52c9cf02584/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:41:13.898493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe7339-5b56-4a5c-884b-c4da86b7bf5d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:13.899998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe7339-5b56-4a5c-884b-c4da86b7bf5d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:13.900477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe7339-5b56-4a5c-884b-c4da86b7bf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:13.975424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-87fe7339-5b56-4a5c-884b-c4da86b7bf5d None None] MFA Rules not processed for user `801f94c1f2a348589c33b52c9cf02584`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:13.977418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-87fe7339-5b56-4a5c-884b-c4da86b7bf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:14.079737 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1295/2619] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:14.089794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17494c-9229-4d3b-81a1-0da81032abd6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:14.090433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17494c-9229-4d3b-81a1-0da81032abd6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:14.090922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17494c-9229-4d3b-81a1-0da81032abd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:14.118298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ee17494c-9229-4d3b-81a1-0da81032abd6 None None] MFA Rules not processed for user `c0493ef2484140f69c1817efaaa51f98`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:14.118298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ee17494c-9229-4d3b-81a1-0da81032abd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:14.151318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:14.189660 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1325/2620] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:14.389757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c8179-526d-44de-84a4-e4d79fd2f94a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:14.390045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c8179-526d-44de-84a4-e4d79fd2f94a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:14.390357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c8179-526d-44de-84a4-e4d79fd2f94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:14.418981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d14c8179-526d-44de-84a4-e4d79fd2f94a None None] MFA Rules not processed for user `eab4fe38f4aa4180b5b4ea27fb01b06b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:14.420219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d14c8179-526d-44de-84a4-e4d79fd2f94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:14.528204 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1296/2621] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:15.107045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17494c-9229-4d3b-81a1-0da81032abd6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:15.109682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ee17494c-9229-4d3b-81a1-0da81032abd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:15.140379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c8179-526d-44de-84a4-e4d79fd2f94a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:15.143124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d14c8179-526d-44de-84a4-e4d79fd2f94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:15.190746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:15.199819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17494c-9229-4d3b-81a1-0da81032abd6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:15.206080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0d1cd-35d2-4c9e-88e2-bb3d088f88bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:15.206919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0d1cd-35d2-4c9e-88e2-bb3d088f88bb service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:15.207259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0d1cd-35d2-4c9e-88e2-bb3d088f88bb service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:15.211616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0d1cd-35d2-4c9e-88e2-bb3d088f88bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:15.211616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0fa0d1cd-35d2-4c9e-88e2-bb3d088f88bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:15.224848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0d1cd-35d2-4c9e-88e2-bb3d088f88bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:15.227093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0d1cd-35d2-4c9e-88e2-bb3d088f88bb service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:15.239660 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1326/2622] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:15.262903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c8179-526d-44de-84a4-e4d79fd2f94a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:15.269747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c152883-c3fa-495c-aa27-b8c10250f006 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:15.271058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c152883-c3fa-495c-aa27-b8c10250f006 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:15.271437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c152883-c3fa-495c-aa27-b8c10250f006 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:15.271817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c152883-c3fa-495c-aa27-b8c10250f006 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:15.281617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c152883-c3fa-495c-aa27-b8c10250f006 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:15.283935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c152883-c3fa-495c-aa27-b8c10250f006 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:15.295012 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1297/2623] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:41:15.442581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111905f2-44b7-453a-80b8-d26296177b34 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:15.442937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111905f2-44b7-453a-80b8-d26296177b34 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:15.443296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111905f2-44b7-453a-80b8-d26296177b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:15.463393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-111905f2-44b7-453a-80b8-d26296177b34 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:15.464649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-111905f2-44b7-453a-80b8-d26296177b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:15.526282 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1327/2624] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:41:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:15.541637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c152883-c3fa-495c-aa27-b8c10250f006 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:15.543414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3c152883-c3fa-495c-aa27-b8c10250f006 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:15.617646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c152883-c3fa-495c-aa27-b8c10250f006 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:15.623022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07339c18-8f2b-4f37-8db5-62e2ce312303 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:15.623656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07339c18-8f2b-4f37-8db5-62e2ce312303 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:15.623943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07339c18-8f2b-4f37-8db5-62e2ce312303 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:15.624243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07339c18-8f2b-4f37-8db5-62e2ce312303 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:15.633414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07339c18-8f2b-4f37-8db5-62e2ce312303 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:15.635198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07339c18-8f2b-4f37-8db5-62e2ce312303 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:15.648671 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1298/2625] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:41:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:41:16.299297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fe1cb-5f90-41d9-a4c4-7d9b1172ed65 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:16.299816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fe1cb-5f90-41d9-a4c4-7d9b1172ed65 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:16.300066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fe1cb-5f90-41d9-a4c4-7d9b1172ed65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:16.307887 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-319fe1cb-5f90-41d9-a4c4-7d9b1172ed65 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:41:16.307887 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:41:16.307887 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:41:16.307887 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:41:16.307887 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:41:16.307887 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:41:16.307887 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:41:16.307887 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:41:16.307887 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:41:16.307887 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:41:16.307887 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:41:16.307887 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:41:16.307887 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:41:16.309256 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:41:16.309256 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:41:16.309256 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:41:16.309256 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:41:16.309256 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:41:16.309256 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:41:16.309256 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:41:16.309256 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:41:16.309256 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:41:16.309256 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:41:16.309256 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:41:16.309256 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:41:16.309256 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:41:16.309256 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:41:16.309256 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:41:16.310263 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1328/2626] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:41:16 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:41:16.342636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970190e3-5964-4afd-9364-5153d39ebd7b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:16.342636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970190e3-5964-4afd-9364-5153d39ebd7b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:16.342636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970190e3-5964-4afd-9364-5153d39ebd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:16.362112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-970190e3-5964-4afd-9364-5153d39ebd7b None None] MFA Rules not processed for user `eab4fe38f4aa4180b5b4ea27fb01b06b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:16.363334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-970190e3-5964-4afd-9364-5153d39ebd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:16.370614 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1299/2627] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:16 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:16.479592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fe1cb-5f90-41d9-a4c4-7d9b1172ed65 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:16.488138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-319fe1cb-5f90-41d9-a4c4-7d9b1172ed65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:16.590100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fe1cb-5f90-41d9-a4c4-7d9b1172ed65 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:16.597558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63453dff-2877-444e-9a7f-e02743401a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:16.598321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63453dff-2877-444e-9a7f-e02743401a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:16.598666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63453dff-2877-444e-9a7f-e02743401a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:16.599315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63453dff-2877-444e-9a7f-e02743401a30 admin admin] PATH_INFO: `/v3/users/1c6f5869b505455c8a124f4971cdc03f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:16.600722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63453dff-2877-444e-9a7f-e02743401a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c6f5869b505455c8a124f4971cdc03f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:16.604327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63453dff-2877-444e-9a7f-e02743401a30 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:16.640051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:16.862313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-63453dff-2877-444e-9a7f-e02743401a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c6f5869b505455c8a124f4971cdc03f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:16.863107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-63453dff-2877-444e-9a7f-e02743401a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c6f5869b505455c8a124f4971cdc03f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:16.989382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-63453dff-2877-444e-9a7f-e02743401a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c6f5869b505455c8a124f4971cdc03f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:16.992752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-63453dff-2877-444e-9a7f-e02743401a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c6f5869b505455c8a124f4971cdc03f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:17.007352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-63453dff-2877-444e-9a7f-e02743401a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c6f5869b505455c8a124f4971cdc03f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:17.021415 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1329/2628] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:41:16 2022] DELETE /identity/v3/users/1c6f5869b505455c8a124f4971cdc03f => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:17.028243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48463c-6f0b-4f0b-83ce-ea6865a74206 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:17.028597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48463c-6f0b-4f0b-83ce-ea6865a74206 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:17.028878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48463c-6f0b-4f0b-83ce-ea6865a74206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:17.049844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-cd48463c-6f0b-4f0b-83ce-ea6865a74206 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:17.051081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cd48463c-6f0b-4f0b-83ce-ea6865a74206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:17.121931 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1300/2629] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:41:17.138385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63453dff-2877-444e-9a7f-e02743401a30 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:17.139899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-63453dff-2877-444e-9a7f-e02743401a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:17.228814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63453dff-2877-444e-9a7f-e02743401a30 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:17.233489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764cd35-63e5-4dfc-9c55-70abd7dff4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:17.235235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764cd35-63e5-4dfc-9c55-70abd7dff4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:17.235955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764cd35-63e5-4dfc-9c55-70abd7dff4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:17.236714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764cd35-63e5-4dfc-9c55-70abd7dff4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:17.250541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764cd35-63e5-4dfc-9c55-70abd7dff4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:17.257514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764cd35-63e5-4dfc-9c55-70abd7dff4d7 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:17.284726 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1330/2630] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:18.766050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48463c-6f0b-4f0b-83ce-ea6865a74206 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:18.766050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cd48463c-6f0b-4f0b-83ce-ea6865a74206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:18.771905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48463c-6f0b-4f0b-83ce-ea6865a74206 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:18.782655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db12b94-0737-4f32-b8c9-397568f84078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:18.783638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db12b94-0737-4f32-b8c9-397568f84078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:18.784002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db12b94-0737-4f32-b8c9-397568f84078 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:18.784408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db12b94-0737-4f32-b8c9-397568f84078 admin admin] PATH_INFO: `/v3/projects/85e6a5d271a34981aa46e35c5d87235d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:18.786436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db12b94-0737-4f32-b8c9-397568f84078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85e6a5d271a34981aa46e35c5d87235d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:18.788541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db12b94-0737-4f32-b8c9-397568f84078 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:19.064923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:19.097003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8db12b94-0737-4f32-b8c9-397568f84078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85e6a5d271a34981aa46e35c5d87235d', 'request_id': 'req-8db12b94-0737-4f32-b8c9-397568f84078'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:19.110500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8db12b94-0737-4f32-b8c9-397568f84078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85e6a5d271a34981aa46e35c5d87235d', 'request_id': 'req-8db12b94-0737-4f32-b8c9-397568f84078'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:19.122801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8db12b94-0737-4f32-b8c9-397568f84078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85e6a5d271a34981aa46e35c5d87235d', 'request_id': 'req-8db12b94-0737-4f32-b8c9-397568f84078'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:19.237910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8db12b94-0737-4f32-b8c9-397568f84078 admin admin] The token cache is being invalidate because project 85e6a5d271a34981aa46e35c5d87235d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:41:19.238533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8db12b94-0737-4f32-b8c9-397568f84078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:19.241741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8db12b94-0737-4f32-b8c9-397568f84078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:19.249985 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1301/2631] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:18 2022] DELETE /identity/v3/projects/85e6a5d271a34981aa46e35c5d87235d => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:19.254199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764cd35-63e5-4dfc-9c55-70abd7dff4d7 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:19.266846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764cd35-63e5-4dfc-9c55-70abd7dff4d7 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:19.367947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05591f42-f405-44c4-ad22-c9703317919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:19.368692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05591f42-f405-44c4-ad22-c9703317919b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:19.368974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05591f42-f405-44c4-ad22-c9703317919b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:19.369335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05591f42-f405-44c4-ad22-c9703317919b admin admin] PATH_INFO: `/v3/users/78f00229131843988a82d9ea90f796e4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:19.370706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05591f42-f405-44c4-ad22-c9703317919b admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f00229131843988a82d9ea90f796e4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:19.372741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05591f42-f405-44c4-ad22-c9703317919b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:19.675473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:19.682480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-05591f42-f405-44c4-ad22-c9703317919b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f00229131843988a82d9ea90f796e4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:19.683850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-05591f42-f405-44c4-ad22-c9703317919b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f00229131843988a82d9ea90f796e4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:19.838476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-05591f42-f405-44c4-ad22-c9703317919b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f00229131843988a82d9ea90f796e4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:19.839503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-05591f42-f405-44c4-ad22-c9703317919b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f00229131843988a82d9ea90f796e4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:19.885709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-05591f42-f405-44c4-ad22-c9703317919b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f00229131843988a82d9ea90f796e4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:19.924152 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1331/2632] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:41:19 2022] DELETE /identity/v3/users/78f00229131843988a82d9ea90f796e4 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:20.938712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db12b94-0737-4f32-b8c9-397568f84078 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:20.944268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8db12b94-0737-4f32-b8c9-397568f84078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:20.968376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db12b94-0737-4f32-b8c9-397568f84078 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:21.095410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2938c-2693-4b41-bc29-cf9f987036d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:21.096062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2938c-2693-4b41-bc29-cf9f987036d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:21.096376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2938c-2693-4b41-bc29-cf9f987036d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:21.096649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2938c-2693-4b41-bc29-cf9f987036d5 admin admin] PATH_INFO: `/v3/users/0d57c08b83534595857f5b9856b967e4` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:21.098776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2938c-2693-4b41-bc29-cf9f987036d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d57c08b83534595857f5b9856b967e4)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:21.104573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2938c-2693-4b41-bc29-cf9f987036d5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:21.386603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f1f2938c-2693-4b41-bc29-cf9f987036d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d57c08b83534595857f5b9856b967e4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:21.495861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f1f2938c-2693-4b41-bc29-cf9f987036d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d57c08b83534595857f5b9856b967e4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:21.495861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f1f2938c-2693-4b41-bc29-cf9f987036d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d57c08b83534595857f5b9856b967e4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:21.504870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f1f2938c-2693-4b41-bc29-cf9f987036d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d57c08b83534595857f5b9856b967e4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:21.551211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f1f2938c-2693-4b41-bc29-cf9f987036d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d57c08b83534595857f5b9856b967e4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:21.571715 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1302/2633] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:41:20 2022] DELETE /identity/v3/users/0d57c08b83534595857f5b9856b967e4 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:21.586935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bee1c7-e3be-4f53-a704-7880e75426ac None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:21.586935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bee1c7-e3be-4f53-a704-7880e75426ac None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:21.586935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bee1c7-e3be-4f53-a704-7880e75426ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:21.605253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-33bee1c7-e3be-4f53-a704-7880e75426ac None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:21.606728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-33bee1c7-e3be-4f53-a704-7880e75426ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:21.799068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2938c-2693-4b41-bc29-cf9f987036d5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:21.800640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f1f2938c-2693-4b41-bc29-cf9f987036d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:21.881687 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1332/2634] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:21.899946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:21.918751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2938c-2693-4b41-bc29-cf9f987036d5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:21.926566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8237ed0-2334-4fb8-9dd3-bd1f8368a09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:21.927310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8237ed0-2334-4fb8-9dd3-bd1f8368a09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:21.927685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8237ed0-2334-4fb8-9dd3-bd1f8368a09f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:21.928028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8237ed0-2334-4fb8-9dd3-bd1f8368a09f admin admin] PATH_INFO: `/v3/projects/6b1345166a4d43aa9540deb79f58d190` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:21.929692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8237ed0-2334-4fb8-9dd3-bd1f8368a09f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1345166a4d43aa9540deb79f58d190)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:21.931640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8237ed0-2334-4fb8-9dd3-bd1f8368a09f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:21.954136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bee1c7-e3be-4f53-a704-7880e75426ac None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:21.954136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-33bee1c7-e3be-4f53-a704-7880e75426ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:22.077341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bee1c7-e3be-4f53-a704-7880e75426ac None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:22.096032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3027f48-b9df-4175-af1b-b7d880ee7d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:22.098251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3027f48-b9df-4175-af1b-b7d880ee7d9e service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:22.098251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3027f48-b9df-4175-af1b-b7d880ee7d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:22.099923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3027f48-b9df-4175-af1b-b7d880ee7d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:22.123029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8237ed0-2334-4fb8-9dd3-bd1f8368a09f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1345166a4d43aa9540deb79f58d190', 'request_id': 'req-e8237ed0-2334-4fb8-9dd3-bd1f8368a09f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:22.126407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3027f48-b9df-4175-af1b-b7d880ee7d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:22.131721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3027f48-b9df-4175-af1b-b7d880ee7d9e service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:22.142712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8237ed0-2334-4fb8-9dd3-bd1f8368a09f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1345166a4d43aa9540deb79f58d190', 'request_id': 'req-e8237ed0-2334-4fb8-9dd3-bd1f8368a09f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:22.154016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8237ed0-2334-4fb8-9dd3-bd1f8368a09f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1345166a4d43aa9540deb79f58d190', 'request_id': 'req-e8237ed0-2334-4fb8-9dd3-bd1f8368a09f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:22.162048 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1333/2635] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:22.290456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8237ed0-2334-4fb8-9dd3-bd1f8368a09f admin admin] The token cache is being invalidate because project 6b1345166a4d43aa9540deb79f58d190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:41:22.290756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8237ed0-2334-4fb8-9dd3-bd1f8368a09f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:22.293028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8237ed0-2334-4fb8-9dd3-bd1f8368a09f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:22.301152 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1303/2636] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:21 2022] DELETE /identity/v3/projects/6b1345166a4d43aa9540deb79f58d190 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:41:22.315931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff3270-0153-44ca-965f-ba54f3cc054c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:22.316485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff3270-0153-44ca-965f-ba54f3cc054c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:22.316933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff3270-0153-44ca-965f-ba54f3cc054c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:22.362833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-77ff3270-0153-44ca-965f-ba54f3cc054c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:22.364074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-77ff3270-0153-44ca-965f-ba54f3cc054c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:22.535636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:22.550308 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1334/2637] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:22.558372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b111-ef07-40f6-9087-9a111e3d6aa3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:22.558938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b111-ef07-40f6-9087-9a111e3d6aa3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:22.559572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b111-ef07-40f6-9087-9a111e3d6aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:22.610189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8ab3b111-ef07-40f6-9087-9a111e3d6aa3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:22.611698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8ab3b111-ef07-40f6-9087-9a111e3d6aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:22.632810 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1304/2638] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:22.636939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff3270-0153-44ca-965f-ba54f3cc054c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:22.654152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff3270-0153-44ca-965f-ba54f3cc054c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:22.660852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108df35-31b7-49d7-9a9c-29787e95483e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:22.661922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108df35-31b7-49d7-9a9c-29787e95483e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:22.662296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108df35-31b7-49d7-9a9c-29787e95483e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:22.662579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108df35-31b7-49d7-9a9c-29787e95483e admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:22.663240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108df35-31b7-49d7-9a9c-29787e95483e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:41:22.663548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108df35-31b7-49d7-9a9c-29787e95483e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:22.665227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108df35-31b7-49d7-9a9c-29787e95483e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:22.685822 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1335/2639] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:41:22.686021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3b111-ef07-40f6-9087-9a111e3d6aa3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:22.702030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3b111-ef07-40f6-9087-9a111e3d6aa3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:22.720657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64312e59-bef5-4141-bb29-02a4f306f597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:22.727603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64312e59-bef5-4141-bb29-02a4f306f597 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:22.727603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64312e59-bef5-4141-bb29-02a4f306f597 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:22.729058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64312e59-bef5-4141-bb29-02a4f306f597 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:22.729772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64312e59-bef5-4141-bb29-02a4f306f597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:22.731942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64312e59-bef5-4141-bb29-02a4f306f597 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:22.868311 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1305/2640] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:41:22 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:41:22.872853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108df35-31b7-49d7-9a9c-29787e95483e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:22.887685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108df35-31b7-49d7-9a9c-29787e95483e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:22.973586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c67d89-fbde-4520-a26d-a9f7aace3ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:22.974077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c67d89-fbde-4520-a26d-a9f7aace3ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:22.975077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c67d89-fbde-4520-a26d-a9f7aace3ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:22.975434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c67d89-fbde-4520-a26d-a9f7aace3ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:22.984009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c67d89-fbde-4520-a26d-a9f7aace3ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:22.984009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c67d89-fbde-4520-a26d-a9f7aace3ea2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:23.073478 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1336/2641] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:41:22 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:41:23.077493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64312e59-bef5-4141-bb29-02a4f306f597 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:23.106474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64312e59-bef5-4141-bb29-02a4f306f597 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:23.120202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049b57c-c183-4578-96a8-0d22847b7019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:23.122154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049b57c-c183-4578-96a8-0d22847b7019 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:23.122452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049b57c-c183-4578-96a8-0d22847b7019 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:23.122724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049b57c-c183-4578-96a8-0d22847b7019 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:23.125209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049b57c-c183-4578-96a8-0d22847b7019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:23.133202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049b57c-c183-4578-96a8-0d22847b7019 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:23.152379 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1306/2642] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:23.156542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c67d89-fbde-4520-a26d-a9f7aace3ea2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:23.171540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049b57c-c183-4578-96a8-0d22847b7019 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:23.173626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8049b57c-c183-4578-96a8-0d22847b7019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:23.175826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c67d89-fbde-4520-a26d-a9f7aace3ea2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:23.182306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48c4f4-4646-4fc5-afe8-b13aa3ea0423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:23.182306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48c4f4-4646-4fc5-afe8-b13aa3ea0423 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:23.182306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48c4f4-4646-4fc5-afe8-b13aa3ea0423 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:23.182639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48c4f4-4646-4fc5-afe8-b13aa3ea0423 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:23.185416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48c4f4-4646-4fc5-afe8-b13aa3ea0423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:23.192407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48c4f4-4646-4fc5-afe8-b13aa3ea0423 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:23.205479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049b57c-c183-4578-96a8-0d22847b7019 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:23.220715 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1337/2643] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:23.221525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d722c-cade-4edc-8b31-ea6e312917b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:23.222955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d722c-cade-4edc-8b31-ea6e312917b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:23.223342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d722c-cade-4edc-8b31-ea6e312917b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:23.223793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d722c-cade-4edc-8b31-ea6e312917b8 admin admin] PATH_INFO: `/v3/projects/13b5bce4a2e84ed7a2eebbd849374b72` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:23.226124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48c4f4-4646-4fc5-afe8-b13aa3ea0423 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:23.230033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d722c-cade-4edc-8b31-ea6e312917b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b5bce4a2e84ed7a2eebbd849374b72)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:23.237432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d722c-cade-4edc-8b31-ea6e312917b8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:23.247168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48c4f4-4646-4fc5-afe8-b13aa3ea0423 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:23.289067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fd6ff-0bcd-4455-a4be-d8f7ec1354ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:23.294489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fd6ff-0bcd-4455-a4be-d8f7ec1354ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:23.294489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fd6ff-0bcd-4455-a4be-d8f7ec1354ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:23.294489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fd6ff-0bcd-4455-a4be-d8f7ec1354ea admin admin] PATH_INFO: `/v3/projects/6fc87aaa92cb4c7ab02dc9f6dfde455a/users/8bc3312b05bd4715b04f736aa21b1a49/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:23.327512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fd6ff-0bcd-4455-a4be-d8f7ec1354ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc87aaa92cb4c7ab02dc9f6dfde455a, user_id=8bc3312b05bd4715b04f736aa21b1a49, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:23.331027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fd6ff-0bcd-4455-a4be-d8f7ec1354ea admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:23.477070 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1338/2644] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:41:23 2022] PUT /identity/v3/projects/6fc87aaa92cb4c7ab02dc9f6dfde455a/users/8bc3312b05bd4715b04f736aa21b1a49/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:23.491592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cadbaa-94da-4d43-aa5c-b53d6c2ec559 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:23.492268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cadbaa-94da-4d43-aa5c-b53d6c2ec559 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:23.492709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cadbaa-94da-4d43-aa5c-b53d6c2ec559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:23.567435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fa2d722c-cade-4edc-8b31-ea6e312917b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b5bce4a2e84ed7a2eebbd849374b72', 'request_id': 'req-fa2d722c-cade-4edc-8b31-ea6e312917b8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:23.586403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fa2d722c-cade-4edc-8b31-ea6e312917b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b5bce4a2e84ed7a2eebbd849374b72', 'request_id': 'req-fa2d722c-cade-4edc-8b31-ea6e312917b8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:23.586640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-52cadbaa-94da-4d43-aa5c-b53d6c2ec559 None None] MFA Rules not processed for user `8bc3312b05bd4715b04f736aa21b1a49`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:23.586640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-52cadbaa-94da-4d43-aa5c-b53d6c2ec559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:23.594229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fa2d722c-cade-4edc-8b31-ea6e312917b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b5bce4a2e84ed7a2eebbd849374b72', 'request_id': 'req-fa2d722c-cade-4edc-8b31-ea6e312917b8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:23.754820 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1339/2645] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:41:23.761293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cadbaa-94da-4d43-aa5c-b53d6c2ec559 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:23.818062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fa2d722c-cade-4edc-8b31-ea6e312917b8 admin admin] The token cache is being invalidate because project 13b5bce4a2e84ed7a2eebbd849374b72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:41:23.818360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fa2d722c-cade-4edc-8b31-ea6e312917b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:23.826374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fa2d722c-cade-4edc-8b31-ea6e312917b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:23.828377 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1307/2646] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:23 2022] DELETE /identity/v3/projects/13b5bce4a2e84ed7a2eebbd849374b72 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:41:23.832368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d722c-cade-4edc-8b31-ea6e312917b8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:23.834377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fa2d722c-cade-4edc-8b31-ea6e312917b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:23.843454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cadbaa-94da-4d43-aa5c-b53d6c2ec559 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:23.849047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce07a1-5c82-462f-8bbc-b5b62e5cb4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:23.849814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce07a1-5c82-462f-8bbc-b5b62e5cb4bb admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:23.850129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce07a1-5c82-462f-8bbc-b5b62e5cb4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:23.850582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce07a1-5c82-462f-8bbc-b5b62e5cb4bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:23.851234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce07a1-5c82-462f-8bbc-b5b62e5cb4bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:23.853371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce07a1-5c82-462f-8bbc-b5b62e5cb4bb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:23.868457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d722c-cade-4edc-8b31-ea6e312917b8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:23.877042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0234d6-eb84-4bd1-9494-0f405a303af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:23.878738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0234d6-eb84-4bd1-9494-0f405a303af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:23.879379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0234d6-eb84-4bd1-9494-0f405a303af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:23.880037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0234d6-eb84-4bd1-9494-0f405a303af3 admin admin] PATH_INFO: `/v3/users/d8bff7bfabe94d4d8956f37cad8f5847` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:23.882619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0234d6-eb84-4bd1-9494-0f405a303af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8bff7bfabe94d4d8956f37cad8f5847)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:23.886672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0234d6-eb84-4bd1-9494-0f405a303af3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:23.902258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:23.940323 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1340/2647] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:41:23 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:23.948926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce07a1-5c82-462f-8bbc-b5b62e5cb4bb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:23.953428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0dce07a1-5c82-462f-8bbc-b5b62e5cb4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:24.115945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8c0234d6-eb84-4bd1-9494-0f405a303af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8bff7bfabe94d4d8956f37cad8f5847'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:24.123503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce07a1-5c82-462f-8bbc-b5b62e5cb4bb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:24.134015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefaebe-de5a-4ad6-bfc4-3024d9b71384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:24.134743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefaebe-de5a-4ad6-bfc4-3024d9b71384 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:24.135092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefaebe-de5a-4ad6-bfc4-3024d9b71384 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:24.135436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefaebe-de5a-4ad6-bfc4-3024d9b71384 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:24.136157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefaebe-de5a-4ad6-bfc4-3024d9b71384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:24.138311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefaebe-de5a-4ad6-bfc4-3024d9b71384 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:24.240880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8c0234d6-eb84-4bd1-9494-0f405a303af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8bff7bfabe94d4d8956f37cad8f5847'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:24.241472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:24.241736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8c0234d6-eb84-4bd1-9494-0f405a303af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8bff7bfabe94d4d8956f37cad8f5847'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:24.250822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8c0234d6-eb84-4bd1-9494-0f405a303af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8bff7bfabe94d4d8956f37cad8f5847'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:24.266761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8c0234d6-eb84-4bd1-9494-0f405a303af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8bff7bfabe94d4d8956f37cad8f5847'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:24.274211 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1308/2648] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:41:23 2022] DELETE /identity/v3/users/d8bff7bfabe94d4d8956f37cad8f5847 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:41:24.313064 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1341/2649] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:41:23 2022] POST /identity/v3/users => generated 299 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:24.318008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0234d6-eb84-4bd1-9494-0f405a303af3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:24.320228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8c0234d6-eb84-4bd1-9494-0f405a303af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:24.435204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0234d6-eb84-4bd1-9494-0f405a303af3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:24.443291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499575c-8766-44e6-a04c-7482f31e6748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:24.444394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499575c-8766-44e6-a04c-7482f31e6748 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:24.445548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499575c-8766-44e6-a04c-7482f31e6748 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:24.446066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499575c-8766-44e6-a04c-7482f31e6748 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:24.447212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499575c-8766-44e6-a04c-7482f31e6748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:24.449716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499575c-8766-44e6-a04c-7482f31e6748 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:24.467132 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1309/2650] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:24.477434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefaebe-de5a-4ad6-bfc4-3024d9b71384 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:24.506183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefaebe-de5a-4ad6-bfc4-3024d9b71384 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:24.516962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb7663-0590-48ae-b21e-ff6631d8e44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:24.520096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb7663-0590-48ae-b21e-ff6631d8e44a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:24.521143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb7663-0590-48ae-b21e-ff6631d8e44a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:24.522296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb7663-0590-48ae-b21e-ff6631d8e44a admin admin] PATH_INFO: `/v3/projects/ff30ddb23da94216b6c3fe1cb2f4d5f4/users/4d4f4039d2e443939d35cff435f689bb/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:24.569987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb7663-0590-48ae-b21e-ff6631d8e44a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff30ddb23da94216b6c3fe1cb2f4d5f4, user_id=4d4f4039d2e443939d35cff435f689bb, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:24.574582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb7663-0590-48ae-b21e-ff6631d8e44a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:24.731737 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1342/2651] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:41:24 2022] PUT /identity/v3/projects/ff30ddb23da94216b6c3fe1cb2f4d5f4/users/4d4f4039d2e443939d35cff435f689bb/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:41:24.736610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499575c-8766-44e6-a04c-7482f31e6748 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:24.754642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499575c-8766-44e6-a04c-7482f31e6748 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:24.910552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e5262-a8de-4cbd-94ee-27830437c302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:24.912070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e5262-a8de-4cbd-94ee-27830437c302 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:24.912392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e5262-a8de-4cbd-94ee-27830437c302 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:24.912674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e5262-a8de-4cbd-94ee-27830437c302 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:24.913518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e5262-a8de-4cbd-94ee-27830437c302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:24.916384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e5262-a8de-4cbd-94ee-27830437c302 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:24.963386 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1310/2652] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:24.969430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb7663-0590-48ae-b21e-ff6631d8e44a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:24.987780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb7663-0590-48ae-b21e-ff6631d8e44a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:24.994224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386caab-d52f-47e1-a90f-952e4971f82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:24.995212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386caab-d52f-47e1-a90f-952e4971f82f admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:24.995684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386caab-d52f-47e1-a90f-952e4971f82f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:24.996131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386caab-d52f-47e1-a90f-952e4971f82f admin admin] PATH_INFO: `/v3/projects/ff30ddb23da94216b6c3fe1cb2f4d5f4/users/4d4f4039d2e443939d35cff435f689bb/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:24.999664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386caab-d52f-47e1-a90f-952e4971f82f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff30ddb23da94216b6c3fe1cb2f4d5f4, user_id=4d4f4039d2e443939d35cff435f689bb, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:25.011946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386caab-d52f-47e1-a90f-952e4971f82f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:25.044144 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1343/2653] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:41:24 2022] PUT /identity/v3/projects/ff30ddb23da94216b6c3fe1cb2f4d5f4/users/4d4f4039d2e443939d35cff435f689bb/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:41:25.060389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6974c1-4257-444c-867e-8cd009e9c2be None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:25.067980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6974c1-4257-444c-867e-8cd009e9c2be None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:25.068444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6974c1-4257-444c-867e-8cd009e9c2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:25.120646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6d6974c1-4257-444c-867e-8cd009e9c2be None None] MFA Rules not processed for user `4d4f4039d2e443939d35cff435f689bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:25.121912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6d6974c1-4257-444c-867e-8cd009e9c2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:25.137873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:25.237447 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1311/2654] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:25.479058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386caab-d52f-47e1-a90f-952e4971f82f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:25.482123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3386caab-d52f-47e1-a90f-952e4971f82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:25.490446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6974c1-4257-444c-867e-8cd009e9c2be None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:25.493539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6d6974c1-4257-444c-867e-8cd009e9c2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:25.635268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6974c1-4257-444c-867e-8cd009e9c2be None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:25.635268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ac6b7-f895-49e8-a9fe-219a96629d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:25.635592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ac6b7-f895-49e8-a9fe-219a96629d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:25.635827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ac6b7-f895-49e8-a9fe-219a96629d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:25.641054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ac6b7-f895-49e8-a9fe-219a96629d4d admin admin] PATH_INFO: `/v3/projects/6fe86516ee7d4ff6827f5e27a6f0ee6c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:25.644118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ac6b7-f895-49e8-a9fe-219a96629d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe86516ee7d4ff6827f5e27a6f0ee6c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:25.647229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ac6b7-f895-49e8-a9fe-219a96629d4d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:25.680532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386caab-d52f-47e1-a90f-952e4971f82f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:25.698782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcace5-4cc8-4157-b849-19a72a14e7ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:25.699408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcace5-4cc8-4157-b849-19a72a14e7ce service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:25.699690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcace5-4cc8-4157-b849-19a72a14e7ce service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:25.699966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcace5-4cc8-4157-b849-19a72a14e7ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:25.706585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:25.710986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcace5-4cc8-4157-b849-19a72a14e7ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:25.712809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcace5-4cc8-4157-b849-19a72a14e7ce service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:25.725291 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1344/2655] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:25.861343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bb2ac6b7-f895-49e8-a9fe-219a96629d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe86516ee7d4ff6827f5e27a6f0ee6c', 'request_id': 'req-bb2ac6b7-f895-49e8-a9fe-219a96629d4d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:25.888182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bb2ac6b7-f895-49e8-a9fe-219a96629d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe86516ee7d4ff6827f5e27a6f0ee6c', 'request_id': 'req-bb2ac6b7-f895-49e8-a9fe-219a96629d4d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:25.900686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bb2ac6b7-f895-49e8-a9fe-219a96629d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe86516ee7d4ff6827f5e27a6f0ee6c', 'request_id': 'req-bb2ac6b7-f895-49e8-a9fe-219a96629d4d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:26.010265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bb2ac6b7-f895-49e8-a9fe-219a96629d4d admin admin] The token cache is being invalidate because project 6fe86516ee7d4ff6827f5e27a6f0ee6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:41:26.010581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bb2ac6b7-f895-49e8-a9fe-219a96629d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:26.011335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bb2ac6b7-f895-49e8-a9fe-219a96629d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:26.013801 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1312/2656] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:25 2022] DELETE /identity/v3/projects/6fe86516ee7d4ff6827f5e27a6f0ee6c => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:41:26.019536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34385f-9a9d-4505-b0ca-b482329f7d8f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:26.020039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34385f-9a9d-4505-b0ca-b482329f7d8f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:26.020325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34385f-9a9d-4505-b0ca-b482329f7d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:26.052448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ea34385f-9a9d-4505-b0ca-b482329f7d8f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:26.054560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ea34385f-9a9d-4505-b0ca-b482329f7d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:26.195241 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1345/2657] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:41:26.197046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f182a-f66d-41f3-a257-f7870cfeb4d4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:26.197337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f182a-f66d-41f3-a257-f7870cfeb4d4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:26.197617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f182a-f66d-41f3-a257-f7870cfeb4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:26.225628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f59f182a-f66d-41f3-a257-f7870cfeb4d4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:26.227030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f59f182a-f66d-41f3-a257-f7870cfeb4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:26.243402 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1313/2658] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:26.244643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34385f-9a9d-4505-b0ca-b482329f7d8f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:26.262358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34385f-9a9d-4505-b0ca-b482329f7d8f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:26.274071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537612b-d2f5-4480-b818-bc6f9b13289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:26.274071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537612b-d2f5-4480-b818-bc6f9b13289a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:26.274071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537612b-d2f5-4480-b818-bc6f9b13289a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:26.274071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537612b-d2f5-4480-b818-bc6f9b13289a admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:26.274496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537612b-d2f5-4480-b818-bc6f9b13289a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:41:26.274496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537612b-d2f5-4480-b818-bc6f9b13289a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:26.279971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537612b-d2f5-4480-b818-bc6f9b13289a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:26.318195 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1346/2659] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:41:26.319591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f182a-f66d-41f3-a257-f7870cfeb4d4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:26.332635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f182a-f66d-41f3-a257-f7870cfeb4d4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:26.343947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcffed-90e6-44c2-9916-596ae921d77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:26.345154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcffed-90e6-44c2-9916-596ae921d77f admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:26.346103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcffed-90e6-44c2-9916-596ae921d77f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:26.346565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcffed-90e6-44c2-9916-596ae921d77f admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:26.347376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcffed-90e6-44c2-9916-596ae921d77f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:26.350689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcffed-90e6-44c2-9916-596ae921d77f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:26.495532 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1314/2660] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:41:26 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:26.499576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537612b-d2f5-4480-b818-bc6f9b13289a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:26.519620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537612b-d2f5-4480-b818-bc6f9b13289a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:26.650027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7bddf-44f1-4639-93f8-10b89ba7e184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:26.650909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7bddf-44f1-4639-93f8-10b89ba7e184 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:26.653062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7bddf-44f1-4639-93f8-10b89ba7e184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:26.653217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7bddf-44f1-4639-93f8-10b89ba7e184 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:26.656381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7bddf-44f1-4639-93f8-10b89ba7e184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:26.660715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7bddf-44f1-4639-93f8-10b89ba7e184 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:26.795213 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1347/2661] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:41:26 2022] POST /identity/v3/users => generated 287 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:26.797386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcffed-90e6-44c2-9916-596ae921d77f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:26.810704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcffed-90e6-44c2-9916-596ae921d77f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:26.817608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd5d56-17ed-465f-89df-a6a442d3da29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:26.818289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd5d56-17ed-465f-89df-a6a442d3da29 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:26.818574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd5d56-17ed-465f-89df-a6a442d3da29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:26.818857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd5d56-17ed-465f-89df-a6a442d3da29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:26.819549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd5d56-17ed-465f-89df-a6a442d3da29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:26.821288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd5d56-17ed-465f-89df-a6a442d3da29 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:26.828008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:26.833267 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1315/2662] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:26.837364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7bddf-44f1-4639-93f8-10b89ba7e184 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:26.848288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7bddf-44f1-4639-93f8-10b89ba7e184 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:26.857224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4f661-4873-45aa-964c-9d53bb84bc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:26.862178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4f661-4873-45aa-964c-9d53bb84bc0d admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:26.862178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4f661-4873-45aa-964c-9d53bb84bc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:26.862178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4f661-4873-45aa-964c-9d53bb84bc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:26.862178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4f661-4873-45aa-964c-9d53bb84bc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:26.862178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4f661-4873-45aa-964c-9d53bb84bc0d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:26.880424 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1348/2663] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:26.884529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd5d56-17ed-465f-89df-a6a442d3da29 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:26.908331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd5d56-17ed-465f-89df-a6a442d3da29 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:26.929954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d9139-2e29-452a-9693-d0a1f9c37c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:26.930632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d9139-2e29-452a-9693-d0a1f9c37c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:26.930916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d9139-2e29-452a-9693-d0a1f9c37c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:26.931187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d9139-2e29-452a-9693-d0a1f9c37c61 admin admin] PATH_INFO: `/v3/projects/4d1c84c5c0f4408188e3c2e8f9fc748a/users/afd74c321da04ddb95acd071cbd767cd/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:26.970238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d9139-2e29-452a-9693-d0a1f9c37c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1c84c5c0f4408188e3c2e8f9fc748a, user_id=afd74c321da04ddb95acd071cbd767cd, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:26.973336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d9139-2e29-452a-9693-d0a1f9c37c61 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:27.121090 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1316/2664] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:41:26 2022] PUT /identity/v3/projects/4d1c84c5c0f4408188e3c2e8f9fc748a/users/afd74c321da04ddb95acd071cbd767cd/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:27.127414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb7632-cdfc-4061-a487-41d2d5d16ff1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:27.127936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb7632-cdfc-4061-a487-41d2d5d16ff1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:27.128082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb7632-cdfc-4061-a487-41d2d5d16ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:27.152265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-cafb7632-cdfc-4061-a487-41d2d5d16ff1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:27.153641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cafb7632-cdfc-4061-a487-41d2d5d16ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:27.214240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:27.223873 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1349/2665] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:27.235717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d9139-2e29-452a-9693-d0a1f9c37c61 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:27.243471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b86d9139-2e29-452a-9693-d0a1f9c37c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:27.335818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d9139-2e29-452a-9693-d0a1f9c37c61 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:27.339661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc966a3d-9da2-4b0f-84d1-b4090891f26a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:27.340310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc966a3d-9da2-4b0f-84d1-b4090891f26a service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:27.340594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc966a3d-9da2-4b0f-84d1-b4090891f26a service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:27.340865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc966a3d-9da2-4b0f-84d1-b4090891f26a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:27.353348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc966a3d-9da2-4b0f-84d1-b4090891f26a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:27.355042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc966a3d-9da2-4b0f-84d1-b4090891f26a service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:27.367013 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1317/2666] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:27.431039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb7632-cdfc-4061-a487-41d2d5d16ff1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:27.432816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cafb7632-cdfc-4061-a487-41d2d5d16ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:27.449010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb7632-cdfc-4061-a487-41d2d5d16ff1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:27.457753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de6771-4f2e-4338-a952-b036ce2a41ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:27.458628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de6771-4f2e-4338-a952-b036ce2a41ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:27.459090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de6771-4f2e-4338-a952-b036ce2a41ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:27.459519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de6771-4f2e-4338-a952-b036ce2a41ac admin admin] PATH_INFO: `/v3/users/8bc3312b05bd4715b04f736aa21b1a49` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:27.460934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de6771-4f2e-4338-a952-b036ce2a41ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc3312b05bd4715b04f736aa21b1a49)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:27.463957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de6771-4f2e-4338-a952-b036ce2a41ac admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:27.907430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-47de6771-4f2e-4338-a952-b036ce2a41ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc3312b05bd4715b04f736aa21b1a49'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:27.908464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-47de6771-4f2e-4338-a952-b036ce2a41ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc3312b05bd4715b04f736aa21b1a49'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:27.995806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-47de6771-4f2e-4338-a952-b036ce2a41ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc3312b05bd4715b04f736aa21b1a49'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:27.997650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-47de6771-4f2e-4338-a952-b036ce2a41ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc3312b05bd4715b04f736aa21b1a49'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:28.025687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-47de6771-4f2e-4338-a952-b036ce2a41ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc3312b05bd4715b04f736aa21b1a49'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:28.044589 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1350/2667] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:41:27 2022] DELETE /identity/v3/users/8bc3312b05bd4715b04f736aa21b1a49 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:28.053957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70295f5b-02fd-43bf-90a9-7f155759af5e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:28.054869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70295f5b-02fd-43bf-90a9-7f155759af5e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:28.055296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70295f5b-02fd-43bf-90a9-7f155759af5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:28.091429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-70295f5b-02fd-43bf-90a9-7f155759af5e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:28.091652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-70295f5b-02fd-43bf-90a9-7f155759af5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:28.177966 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1318/2668] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:41:28.207342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de6771-4f2e-4338-a952-b036ce2a41ac admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:28.209406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-47de6771-4f2e-4338-a952-b036ce2a41ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:28.318072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de6771-4f2e-4338-a952-b036ce2a41ac admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:28.323507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91053ca-bcc0-4725-9702-9e20d5fab406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:28.324705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91053ca-bcc0-4725-9702-9e20d5fab406 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:28.325341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91053ca-bcc0-4725-9702-9e20d5fab406 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:28.328501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91053ca-bcc0-4725-9702-9e20d5fab406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:28.340849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91053ca-bcc0-4725-9702-9e20d5fab406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:28.343923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91053ca-bcc0-4725-9702-9e20d5fab406 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:28.370491 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1351/2669] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:29.461984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3170620-27c6-4962-902e-9c21ab0e5225 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:29.466270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3170620-27c6-4962-902e-9c21ab0e5225 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:29.466270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3170620-27c6-4962-902e-9c21ab0e5225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:29.517900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f3170620-27c6-4962-902e-9c21ab0e5225 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:29.519143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f3170620-27c6-4962-902e-9c21ab0e5225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:29.621558 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1319/2670] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:41:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:41:29.636276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91053ca-bcc0-4725-9702-9e20d5fab406 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:29.637910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a91053ca-bcc0-4725-9702-9e20d5fab406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:29.785045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91053ca-bcc0-4725-9702-9e20d5fab406 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:29.798343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7535e9e-9f3c-4526-9319-adfc01015fcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:29.799413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7535e9e-9f3c-4526-9319-adfc01015fcc service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:29.800008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7535e9e-9f3c-4526-9319-adfc01015fcc service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:29.800811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7535e9e-9f3c-4526-9319-adfc01015fcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:29.811557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7535e9e-9f3c-4526-9319-adfc01015fcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:29.814260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7535e9e-9f3c-4526-9319-adfc01015fcc service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:29.857178 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1352/2671] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:41:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:41:31.007288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3170620-27c6-4962-902e-9c21ab0e5225 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:31.009703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f3170620-27c6-4962-902e-9c21ab0e5225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:31.049920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3170620-27c6-4962-902e-9c21ab0e5225 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:31.071334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4df6b5-475b-455a-a108-6a7d43883c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:31.074689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4df6b5-475b-455a-a108-6a7d43883c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:31.075806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4df6b5-475b-455a-a108-6a7d43883c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:31.076455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4df6b5-475b-455a-a108-6a7d43883c49 admin admin] PATH_INFO: `/v3/projects/6fc87aaa92cb4c7ab02dc9f6dfde455a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:31.088674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4df6b5-475b-455a-a108-6a7d43883c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc87aaa92cb4c7ab02dc9f6dfde455a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:31.091045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4df6b5-475b-455a-a108-6a7d43883c49 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:31.161498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:31.349648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4a4df6b5-475b-455a-a108-6a7d43883c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc87aaa92cb4c7ab02dc9f6dfde455a', 'request_id': 'req-4a4df6b5-475b-455a-a108-6a7d43883c49'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:31.379216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4a4df6b5-475b-455a-a108-6a7d43883c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc87aaa92cb4c7ab02dc9f6dfde455a', 'request_id': 'req-4a4df6b5-475b-455a-a108-6a7d43883c49'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:31.409091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4a4df6b5-475b-455a-a108-6a7d43883c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc87aaa92cb4c7ab02dc9f6dfde455a', 'request_id': 'req-4a4df6b5-475b-455a-a108-6a7d43883c49'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:31.510743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4a4df6b5-475b-455a-a108-6a7d43883c49 admin admin] The token cache is being invalidate because project 6fc87aaa92cb4c7ab02dc9f6dfde455a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:41:31.510952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4a4df6b5-475b-455a-a108-6a7d43883c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:31.512346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4a4df6b5-475b-455a-a108-6a7d43883c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:31.517400 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1320/2672] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:31 2022] DELETE /identity/v3/projects/6fc87aaa92cb4c7ab02dc9f6dfde455a => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:31.522008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7535e9e-9f3c-4526-9319-adfc01015fcc service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:31.533497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:31.539367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7535e9e-9f3c-4526-9319-adfc01015fcc service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:31.845876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66aa87-d2b6-4ad9-a441-f168951fac40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:31.846823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66aa87-d2b6-4ad9-a441-f168951fac40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:31.847267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66aa87-d2b6-4ad9-a441-f168951fac40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:31.847706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66aa87-d2b6-4ad9-a441-f168951fac40 admin admin] PATH_INFO: `/v3/users/4d4f4039d2e443939d35cff435f689bb` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:31.849634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66aa87-d2b6-4ad9-a441-f168951fac40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d4f4039d2e443939d35cff435f689bb)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:31.851757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66aa87-d2b6-4ad9-a441-f168951fac40 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:32.163464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8d66aa87-d2b6-4ad9-a441-f168951fac40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d4f4039d2e443939d35cff435f689bb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:32.165962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8d66aa87-d2b6-4ad9-a441-f168951fac40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d4f4039d2e443939d35cff435f689bb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:32.298807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8d66aa87-d2b6-4ad9-a441-f168951fac40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d4f4039d2e443939d35cff435f689bb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:32.301829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8d66aa87-d2b6-4ad9-a441-f168951fac40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d4f4039d2e443939d35cff435f689bb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:32.354952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8d66aa87-d2b6-4ad9-a441-f168951fac40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d4f4039d2e443939d35cff435f689bb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:32.442698 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1353/2673] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:41:31 2022] DELETE /identity/v3/users/4d4f4039d2e443939d35cff435f689bb => generated 0 bytes in 921 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:34.630043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fbe28-44b2-4a65-8e61-1123f7d512e8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:34.633438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fbe28-44b2-4a65-8e61-1123f7d512e8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:34.633438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fbe28-44b2-4a65-8e61-1123f7d512e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:34.699360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e08fbe28-44b2-4a65-8e61-1123f7d512e8 None None] MFA Rules not processed for user `4f4affe28e084a7eb873d9a1f0f79fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:34.700996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e08fbe28-44b2-4a65-8e61-1123f7d512e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:34.842139 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1321/2674] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:35.485461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66aa87-d2b6-4ad9-a441-f168951fac40 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:35.486925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8d66aa87-d2b6-4ad9-a441-f168951fac40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:35.621329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66aa87-d2b6-4ad9-a441-f168951fac40 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:35.626926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06068096-f261-4c84-a7c8-15ac69f79167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:35.627974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06068096-f261-4c84-a7c8-15ac69f79167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:35.633724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06068096-f261-4c84-a7c8-15ac69f79167 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:35.634213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06068096-f261-4c84-a7c8-15ac69f79167 admin admin] PATH_INFO: `/v3/projects/ff30ddb23da94216b6c3fe1cb2f4d5f4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:35.636207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06068096-f261-4c84-a7c8-15ac69f79167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff30ddb23da94216b6c3fe1cb2f4d5f4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:35.638950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06068096-f261-4c84-a7c8-15ac69f79167 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:35.896405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:35.919097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-06068096-f261-4c84-a7c8-15ac69f79167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff30ddb23da94216b6c3fe1cb2f4d5f4', 'request_id': 'req-06068096-f261-4c84-a7c8-15ac69f79167'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:35.930449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-06068096-f261-4c84-a7c8-15ac69f79167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff30ddb23da94216b6c3fe1cb2f4d5f4', 'request_id': 'req-06068096-f261-4c84-a7c8-15ac69f79167'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:36.109697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-06068096-f261-4c84-a7c8-15ac69f79167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff30ddb23da94216b6c3fe1cb2f4d5f4', 'request_id': 'req-06068096-f261-4c84-a7c8-15ac69f79167'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:36.143940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-06068096-f261-4c84-a7c8-15ac69f79167 admin admin] The token cache is being invalidate because project ff30ddb23da94216b6c3fe1cb2f4d5f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:41:36.144418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-06068096-f261-4c84-a7c8-15ac69f79167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:36.150436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-06068096-f261-4c84-a7c8-15ac69f79167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:36.157815 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1354/2675] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:35 2022] DELETE /identity/v3/projects/ff30ddb23da94216b6c3fe1cb2f4d5f4 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:36.159936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e396ce-f128-43b7-ac6c-ee71ef62d757 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:36.160440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e396ce-f128-43b7-ac6c-ee71ef62d757 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:36.160566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e396ce-f128-43b7-ac6c-ee71ef62d757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:36.214880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-63e396ce-f128-43b7-ac6c-ee71ef62d757 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:36.219927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-63e396ce-f128-43b7-ac6c-ee71ef62d757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:36.473132 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1322/2676] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:36.480666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98a316-4c98-4718-9cb0-b6be659dc4db None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:36.485032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98a316-4c98-4718-9cb0-b6be659dc4db None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:36.485032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98a316-4c98-4718-9cb0-b6be659dc4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:36.527740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1f98a316-4c98-4718-9cb0-b6be659dc4db None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:36.529046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1f98a316-4c98-4718-9cb0-b6be659dc4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:36.542988 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1355/2677] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:41:36.548229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e396ce-f128-43b7-ac6c-ee71ef62d757 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:36.564261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e396ce-f128-43b7-ac6c-ee71ef62d757 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:36.570762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c422c1-b52b-4a7e-9870-52684554118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:36.571663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c422c1-b52b-4a7e-9870-52684554118d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:36.572204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c422c1-b52b-4a7e-9870-52684554118d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:36.572710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c422c1-b52b-4a7e-9870-52684554118d admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:36.573588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c422c1-b52b-4a7e-9870-52684554118d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:41:36.574119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c422c1-b52b-4a7e-9870-52684554118d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:36.576480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c422c1-b52b-4a7e-9870-52684554118d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:36.611092 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1323/2678] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:41:36.611305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98a316-4c98-4718-9cb0-b6be659dc4db None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:36.623209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98a316-4c98-4718-9cb0-b6be659dc4db None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:36.629397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1324c9-ff49-486d-8faf-9757ae2b66c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:36.630162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1324c9-ff49-486d-8faf-9757ae2b66c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:36.633256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1324c9-ff49-486d-8faf-9757ae2b66c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:36.633256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1324c9-ff49-486d-8faf-9757ae2b66c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:36.633256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1324c9-ff49-486d-8faf-9757ae2b66c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:36.636608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1324c9-ff49-486d-8faf-9757ae2b66c6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:36.783030 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1356/2679] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:41:36 2022] POST /identity/v3/projects => generated 397 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:36.784711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c422c1-b52b-4a7e-9870-52684554118d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:36.818749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c422c1-b52b-4a7e-9870-52684554118d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:36.981528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:37.024403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad355362-38c5-4f71-b93b-d49dfaf8f311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:37.026836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad355362-38c5-4f71-b93b-d49dfaf8f311 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:37.027195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad355362-38c5-4f71-b93b-d49dfaf8f311 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:37.027807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad355362-38c5-4f71-b93b-d49dfaf8f311 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:37.029280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad355362-38c5-4f71-b93b-d49dfaf8f311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:37.034016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad355362-38c5-4f71-b93b-d49dfaf8f311 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:37.340471 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1324/2680] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:41:36 2022] POST /identity/v3/users => generated 299 bytes in 556 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:41:37.346927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1324c9-ff49-486d-8faf-9757ae2b66c6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:37.357210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1324c9-ff49-486d-8faf-9757ae2b66c6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:37.363084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6664d3-5087-4322-a53a-e07470719c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:37.363948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6664d3-5087-4322-a53a-e07470719c36 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:37.365964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6664d3-5087-4322-a53a-e07470719c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:37.370002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6664d3-5087-4322-a53a-e07470719c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:37.370002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6664d3-5087-4322-a53a-e07470719c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:37.370002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6664d3-5087-4322-a53a-e07470719c36 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:37.386609 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1357/2681] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:41:37.388702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad355362-38c5-4f71-b93b-d49dfaf8f311 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:37.409321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad355362-38c5-4f71-b93b-d49dfaf8f311 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:37.454166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4acf3-f4a4-4d32-a67c-6d0ed18b4687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:37.455991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4acf3-f4a4-4d32-a67c-6d0ed18b4687 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:37.457084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4acf3-f4a4-4d32-a67c-6d0ed18b4687 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:37.458156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4acf3-f4a4-4d32-a67c-6d0ed18b4687 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:37.459116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4acf3-f4a4-4d32-a67c-6d0ed18b4687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:37.462252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4acf3-f4a4-4d32-a67c-6d0ed18b4687 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:37.474550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6664d3-5087-4322-a53a-e07470719c36 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:37.478025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-de6664d3-5087-4322-a53a-e07470719c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:37.500762 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1325/2682] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:37.506665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6664d3-5087-4322-a53a-e07470719c36 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:37.514116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4acf3-f4a4-4d32-a67c-6d0ed18b4687 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:37.523635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3bae5-322d-4409-bb52-2ac010ce5cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:37.524661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3bae5-322d-4409-bb52-2ac010ce5cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:37.525107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3bae5-322d-4409-bb52-2ac010ce5cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:37.525539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3bae5-322d-4409-bb52-2ac010ce5cbb admin admin] PATH_INFO: `/v3/users/95a5ea624f3247f4ad47068013e03d40` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:37.534715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3bae5-322d-4409-bb52-2ac010ce5cbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a5ea624f3247f4ad47068013e03d40)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:37.537341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3bae5-322d-4409-bb52-2ac010ce5cbb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:37.545937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4acf3-f4a4-4d32-a67c-6d0ed18b4687 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:37.561359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637d235-a174-4ab7-9fef-b07e3d42d67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:37.563673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637d235-a174-4ab7-9fef-b07e3d42d67b admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:37.564131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637d235-a174-4ab7-9fef-b07e3d42d67b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:37.565585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637d235-a174-4ab7-9fef-b07e3d42d67b admin admin] PATH_INFO: `/v3/projects/302715970b2c4823a59a1667a51a25e1/users/b63f3491e1f04df09284d8f3b073167a/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:37.798397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637d235-a174-4ab7-9fef-b07e3d42d67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=302715970b2c4823a59a1667a51a25e1, user_id=b63f3491e1f04df09284d8f3b073167a, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:37.805009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637d235-a174-4ab7-9fef-b07e3d42d67b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:37.855330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-efc3bae5-322d-4409-bb52-2ac010ce5cbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a5ea624f3247f4ad47068013e03d40'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:37.856656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-efc3bae5-322d-4409-bb52-2ac010ce5cbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a5ea624f3247f4ad47068013e03d40'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:37.900547 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1326/2683] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:41:37 2022] PUT /identity/v3/projects/302715970b2c4823a59a1667a51a25e1/users/b63f3491e1f04df09284d8f3b073167a/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:37.912839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744881dd-90fa-497f-9b6b-4822d91441d8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:37.927876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744881dd-90fa-497f-9b6b-4822d91441d8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:37.927876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744881dd-90fa-497f-9b6b-4822d91441d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:37.988670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-efc3bae5-322d-4409-bb52-2ac010ce5cbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a5ea624f3247f4ad47068013e03d40'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:37.989432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-efc3bae5-322d-4409-bb52-2ac010ce5cbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a5ea624f3247f4ad47068013e03d40'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:38.017550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-744881dd-90fa-497f-9b6b-4822d91441d8 None None] MFA Rules not processed for user `b63f3491e1f04df09284d8f3b073167a`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:38.021925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-744881dd-90fa-497f-9b6b-4822d91441d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:38.028992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-efc3bae5-322d-4409-bb52-2ac010ce5cbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a5ea624f3247f4ad47068013e03d40'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:38.082873 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1358/2684] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:41:37 2022] DELETE /identity/v3/users/95a5ea624f3247f4ad47068013e03d40 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:41:38.144363 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1327/2685] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:41:38.153046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3bae5-322d-4409-bb52-2ac010ce5cbb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:38.156662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-efc3bae5-322d-4409-bb52-2ac010ce5cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:38.254706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:38.306569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3bae5-322d-4409-bb52-2ac010ce5cbb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:38.326744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da49d9e-2040-40c5-b718-a144d33082fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:38.327988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da49d9e-2040-40c5-b718-a144d33082fa admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:38.329461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da49d9e-2040-40c5-b718-a144d33082fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:38.332864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da49d9e-2040-40c5-b718-a144d33082fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:38.332864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da49d9e-2040-40c5-b718-a144d33082fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:38.338555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da49d9e-2040-40c5-b718-a144d33082fa admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:38.505216 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1359/2686] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:41:38 2022] POST /identity/v3/projects => generated 397 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:38.505928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744881dd-90fa-497f-9b6b-4822d91441d8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:38.647087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744881dd-90fa-497f-9b6b-4822d91441d8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:38.693469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:38.736248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11bf80-0d14-4302-81d7-fa247835be22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:38.737398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11bf80-0d14-4302-81d7-fa247835be22 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:38.737846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11bf80-0d14-4302-81d7-fa247835be22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:38.738521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11bf80-0d14-4302-81d7-fa247835be22 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:38.739340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11bf80-0d14-4302-81d7-fa247835be22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:38.741595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11bf80-0d14-4302-81d7-fa247835be22 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:38.918832 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1328/2687] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:41:38 2022] POST /identity/v3/users => generated 305 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:38.922922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da49d9e-2040-40c5-b718-a144d33082fa admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:38.962757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da49d9e-2040-40c5-b718-a144d33082fa admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:38.977390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe962b-dcb6-4f79-88ba-7fbc754c738e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:38.978035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe962b-dcb6-4f79-88ba-7fbc754c738e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:38.978320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe962b-dcb6-4f79-88ba-7fbc754c738e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:38.978589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe962b-dcb6-4f79-88ba-7fbc754c738e admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:38.979250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe962b-dcb6-4f79-88ba-7fbc754c738e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:38.989565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe962b-dcb6-4f79-88ba-7fbc754c738e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:39.017112 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1360/2688] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:39.024108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11bf80-0d14-4302-81d7-fa247835be22 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:39.033853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11bf80-0d14-4302-81d7-fa247835be22 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:39.046069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835872f-056d-4296-9d3e-b0771248e854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:39.046069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835872f-056d-4296-9d3e-b0771248e854 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:39.046069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835872f-056d-4296-9d3e-b0771248e854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:39.046069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835872f-056d-4296-9d3e-b0771248e854 admin admin] PATH_INFO: `/v3/projects/6b2573ec9dc344a092108c47052a476c/users/bb684e8004db45899591800a014bbdda/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:39.086968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835872f-056d-4296-9d3e-b0771248e854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2573ec9dc344a092108c47052a476c, user_id=bb684e8004db45899591800a014bbdda, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:39.089691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835872f-056d-4296-9d3e-b0771248e854 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:39.101922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe962b-dcb6-4f79-88ba-7fbc754c738e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:39.104433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e1fe962b-dcb6-4f79-88ba-7fbc754c738e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:39.188554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe962b-dcb6-4f79-88ba-7fbc754c738e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:39.188554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed05e54-f234-497c-9cce-dcb872f51f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:39.188554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed05e54-f234-497c-9cce-dcb872f51f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:39.191215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed05e54-f234-497c-9cce-dcb872f51f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:39.191812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed05e54-f234-497c-9cce-dcb872f51f40 admin admin] PATH_INFO: `/v3/projects/b6295028045c4e4a89a385e4e835c7a3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:39.199112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed05e54-f234-497c-9cce-dcb872f51f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6295028045c4e4a89a385e4e835c7a3)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:39.201879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed05e54-f234-497c-9cce-dcb872f51f40 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:40.081297 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1329/2689] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:41:39 2022] PUT /identity/v3/projects/6b2573ec9dc344a092108c47052a476c/users/bb684e8004db45899591800a014bbdda/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 1063 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:40.103416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835872f-056d-4296-9d3e-b0771248e854 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:40.262564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835872f-056d-4296-9d3e-b0771248e854 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:40.263482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8ed05e54-f234-497c-9cce-dcb872f51f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6295028045c4e4a89a385e4e835c7a3', 'request_id': 'req-8ed05e54-f234-497c-9cce-dcb872f51f40'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:40.329431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8ed05e54-f234-497c-9cce-dcb872f51f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6295028045c4e4a89a385e4e835c7a3', 'request_id': 'req-8ed05e54-f234-497c-9cce-dcb872f51f40'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:40.419571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e03ca-a8f9-4193-94a2-243189cfe770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:40.420297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e03ca-a8f9-4193-94a2-243189cfe770 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:40.420579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e03ca-a8f9-4193-94a2-243189cfe770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:40.421430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e03ca-a8f9-4193-94a2-243189cfe770 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:40.422149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e03ca-a8f9-4193-94a2-243189cfe770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:40.423888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e03ca-a8f9-4193-94a2-243189cfe770 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:40.440592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8ed05e54-f234-497c-9cce-dcb872f51f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6295028045c4e4a89a385e4e835c7a3', 'request_id': 'req-8ed05e54-f234-497c-9cce-dcb872f51f40'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:40.450398 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1330/2690] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:40.451458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e03ca-a8f9-4193-94a2-243189cfe770 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:40.461768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8ed05e54-f234-497c-9cce-dcb872f51f40 admin admin] The token cache is being invalidate because project b6295028045c4e4a89a385e4e835c7a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:41:40.462060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8ed05e54-f234-497c-9cce-dcb872f51f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:40.464305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8ed05e54-f234-497c-9cce-dcb872f51f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:40.470439 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1361/2691] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:39 2022] DELETE /identity/v3/projects/b6295028045c4e4a89a385e4e835c7a3 => generated 0 bytes in 1369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:40.474740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed05e54-f234-497c-9cce-dcb872f51f40 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:40.483116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e03ca-a8f9-4193-94a2-243189cfe770 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:40.485485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8ed05e54-f234-497c-9cce-dcb872f51f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:40.501376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436320c-9fe9-4484-b778-0d4046c30e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:40.502349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436320c-9fe9-4484-b778-0d4046c30e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:40.502951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436320c-9fe9-4484-b778-0d4046c30e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:40.503393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436320c-9fe9-4484-b778-0d4046c30e5a admin admin] PATH_INFO: `/v3/projects/6b2573ec9dc344a092108c47052a476c/users/bb684e8004db45899591800a014bbdda/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:40.510827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436320c-9fe9-4484-b778-0d4046c30e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2573ec9dc344a092108c47052a476c, user_id=bb684e8004db45899591800a014bbdda, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:40.515914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436320c-9fe9-4484-b778-0d4046c30e5a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:40.545273 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1331/2692] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:41:40 2022] PUT /identity/v3/projects/6b2573ec9dc344a092108c47052a476c/users/bb684e8004db45899591800a014bbdda/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:40.547662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aa47a-055e-4d00-95b7-a99cf1d49b17 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:40.547961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aa47a-055e-4d00-95b7-a99cf1d49b17 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:40.548265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aa47a-055e-4d00-95b7-a99cf1d49b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:40.556196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed05e54-f234-497c-9cce-dcb872f51f40 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:40.627795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-980aa47a-055e-4d00-95b7-a99cf1d49b17 None None] MFA Rules not processed for user `bb684e8004db45899591800a014bbdda`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:40.634665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-980aa47a-055e-4d00-95b7-a99cf1d49b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:40.730373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:40.773985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3227607-50e3-4919-842e-e5555eabbb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:40.774815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3227607-50e3-4919-842e-e5555eabbb6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:40.776541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3227607-50e3-4919-842e-e5555eabbb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:40.781369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3227607-50e3-4919-842e-e5555eabbb6b admin admin] PATH_INFO: `/v3/users/987b1209e9b24505a2b173834b2d4e15` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:40.796366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3227607-50e3-4919-842e-e5555eabbb6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=987b1209e9b24505a2b173834b2d4e15)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:40.810630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3227607-50e3-4919-842e-e5555eabbb6b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:40.888835 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1332/2693] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:40 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:41.107995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:41.122553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c3227607-50e3-4919-842e-e5555eabbb6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987b1209e9b24505a2b173834b2d4e15'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:41.125896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c3227607-50e3-4919-842e-e5555eabbb6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987b1209e9b24505a2b173834b2d4e15'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:41.219538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c3227607-50e3-4919-842e-e5555eabbb6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987b1209e9b24505a2b173834b2d4e15'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:41.223807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c3227607-50e3-4919-842e-e5555eabbb6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987b1209e9b24505a2b173834b2d4e15'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:41.243983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c3227607-50e3-4919-842e-e5555eabbb6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987b1209e9b24505a2b173834b2d4e15'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:41.280201 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1362/2694] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:41:40 2022] DELETE /identity/v3/users/987b1209e9b24505a2b173834b2d4e15 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:41.675784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980aa47a-055e-4d00-95b7-a99cf1d49b17 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:41.677465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-980aa47a-055e-4d00-95b7-a99cf1d49b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:41.867090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980aa47a-055e-4d00-95b7-a99cf1d49b17 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:42.070723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd522d7-7ebe-4226-8c3f-38541c1040f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:42.074876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd522d7-7ebe-4226-8c3f-38541c1040f7 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:42.075642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd522d7-7ebe-4226-8c3f-38541c1040f7 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:42.076206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd522d7-7ebe-4226-8c3f-38541c1040f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:42.086825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ccd522d7-7ebe-4226-8c3f-38541c1040f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:42.237043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:42.265898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd522d7-7ebe-4226-8c3f-38541c1040f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:42.267949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd522d7-7ebe-4226-8c3f-38541c1040f7 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:42.306662 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1333/2695] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:41 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:42.466728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3227607-50e3-4919-842e-e5555eabbb6b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:42.469149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c3227607-50e3-4919-842e-e5555eabbb6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:42.481013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd522d7-7ebe-4226-8c3f-38541c1040f7 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:42.482549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ccd522d7-7ebe-4226-8c3f-38541c1040f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:42.531560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3227607-50e3-4919-842e-e5555eabbb6b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:42.551623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256efcba-d897-4fb5-99c1-8172de712428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:42.552275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256efcba-d897-4fb5-99c1-8172de712428 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:42.555131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256efcba-d897-4fb5-99c1-8172de712428 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:42.561912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256efcba-d897-4fb5-99c1-8172de712428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:42.564470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-256efcba-d897-4fb5-99c1-8172de712428 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:42.745489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd522d7-7ebe-4226-8c3f-38541c1040f7 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:42.776671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a280c-e683-4cfe-88c1-4c3522fb7a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:42.777586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a280c-e683-4cfe-88c1-4c3522fb7a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:42.778153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a280c-e683-4cfe-88c1-4c3522fb7a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:42.778593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a280c-e683-4cfe-88c1-4c3522fb7a47 admin admin] PATH_INFO: `/v3/projects/987059a7976d45cbbc3b3dfc6c09dafd` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:42.779988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a280c-e683-4cfe-88c1-4c3522fb7a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=987059a7976d45cbbc3b3dfc6c09dafd)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:42.783768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a280c-e683-4cfe-88c1-4c3522fb7a47 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:42.915983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256efcba-d897-4fb5-99c1-8172de712428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:42.928359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256efcba-d897-4fb5-99c1-8172de712428 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:42.967093 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1363/2696] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:42.975038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c00a280c-e683-4cfe-88c1-4c3522fb7a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987059a7976d45cbbc3b3dfc6c09dafd', 'request_id': 'req-c00a280c-e683-4cfe-88c1-4c3522fb7a47'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:43.026361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c00a280c-e683-4cfe-88c1-4c3522fb7a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987059a7976d45cbbc3b3dfc6c09dafd', 'request_id': 'req-c00a280c-e683-4cfe-88c1-4c3522fb7a47'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:43.040090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c00a280c-e683-4cfe-88c1-4c3522fb7a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987059a7976d45cbbc3b3dfc6c09dafd', 'request_id': 'req-c00a280c-e683-4cfe-88c1-4c3522fb7a47'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:43.149841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c00a280c-e683-4cfe-88c1-4c3522fb7a47 admin admin] The token cache is being invalidate because project 987059a7976d45cbbc3b3dfc6c09dafd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:41:43.159042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c00a280c-e683-4cfe-88c1-4c3522fb7a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:43.159042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c00a280c-e683-4cfe-88c1-4c3522fb7a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:43.159042 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1334/2697] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:42 2022] DELETE /identity/v3/projects/987059a7976d45cbbc3b3dfc6c09dafd => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:43.164065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad78ceb-544b-47a1-b5a9-13514f89b1c3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:43.164378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad78ceb-544b-47a1-b5a9-13514f89b1c3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:43.164719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad78ceb-544b-47a1-b5a9-13514f89b1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:43.221936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581659cd-6f21-4287-80a6-90195043a884 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:43.222226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581659cd-6f21-4287-80a6-90195043a884 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:43.222591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581659cd-6f21-4287-80a6-90195043a884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:43.225239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0ad78ceb-544b-47a1-b5a9-13514f89b1c3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:43.226703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0ad78ceb-544b-47a1-b5a9-13514f89b1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:43.303515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-581659cd-6f21-4287-80a6-90195043a884 None None] MFA Rules not processed for user `afd74c321da04ddb95acd071cbd767cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:43.304769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-581659cd-6f21-4287-80a6-90195043a884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:43.365626 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1364/2698] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:43.374510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e76d95-14f3-4286-b11d-1c917d3a5a37 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:43.375087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e76d95-14f3-4286-b11d-1c917d3a5a37 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:43.375498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e76d95-14f3-4286-b11d-1c917d3a5a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:43.428451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-64e76d95-14f3-4286-b11d-1c917d3a5a37 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:43.430053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-64e76d95-14f3-4286-b11d-1c917d3a5a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:43.449441 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1365/2699] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:41:43.453595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e76d95-14f3-4286-b11d-1c917d3a5a37 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:43.468687 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1335/2700] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:43.478680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e76d95-14f3-4286-b11d-1c917d3a5a37 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:43.488758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda77b80-3e5f-4cd7-a348-c6bd978d60d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:43.494339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda77b80-3e5f-4cd7-a348-c6bd978d60d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:43.494790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda77b80-3e5f-4cd7-a348-c6bd978d60d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:43.495144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda77b80-3e5f-4cd7-a348-c6bd978d60d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:43.495979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda77b80-3e5f-4cd7-a348-c6bd978d60d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:41:43.496382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda77b80-3e5f-4cd7-a348-c6bd978d60d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:43.498785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda77b80-3e5f-4cd7-a348-c6bd978d60d3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:43.521897 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1366/2701] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:41:43.527185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581659cd-6f21-4287-80a6-90195043a884 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:43.535477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda77b80-3e5f-4cd7-a348-c6bd978d60d3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:43.537037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581659cd-6f21-4287-80a6-90195043a884 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:43.542178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604666d-682b-402f-b3f8-b9a4bf80e2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:43.542568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fda77b80-3e5f-4cd7-a348-c6bd978d60d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:43.543331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604666d-682b-402f-b3f8-b9a4bf80e2cf admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:43.543838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604666d-682b-402f-b3f8-b9a4bf80e2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:43.544472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604666d-682b-402f-b3f8-b9a4bf80e2cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:43.545355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604666d-682b-402f-b3f8-b9a4bf80e2cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:43.548503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604666d-682b-402f-b3f8-b9a4bf80e2cf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:43.564399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:43.630324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:43.703913 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1336/2702] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:41:43 2022] POST /identity/v3/projects => generated 395 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:43.704937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604666d-682b-402f-b3f8-b9a4bf80e2cf admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:43.736762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda77b80-3e5f-4cd7-a348-c6bd978d60d3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:43.891553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd256a30-b5e5-412d-a973-b89e4621b6ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:43.892193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd256a30-b5e5-412d-a973-b89e4621b6ff service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:43.892922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd256a30-b5e5-412d-a973-b89e4621b6ff service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:43.892922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd256a30-b5e5-412d-a973-b89e4621b6ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:43.896435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cd256a30-b5e5-412d-a973-b89e4621b6ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:43.931159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604666d-682b-402f-b3f8-b9a4bf80e2cf admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:43.947074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0d597-3f90-4b06-8d83-e2528b7f27f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:43.947809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d597-3f90-4b06-8d83-e2528b7f27f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:43.948216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d597-3f90-4b06-8d83-e2528b7f27f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:43.948610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d597-3f90-4b06-8d83-e2528b7f27f8 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:43.949381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0d597-3f90-4b06-8d83-e2528b7f27f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:43.952638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0d597-3f90-4b06-8d83-e2528b7f27f8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:44.107212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd256a30-b5e5-412d-a973-b89e4621b6ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:44.109657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd256a30-b5e5-412d-a973-b89e4621b6ff service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:44.142780 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1367/2703] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:43 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:44.178686 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1337/2704] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:41:43 2022] POST /identity/v3/users => generated 298 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:44.183065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd256a30-b5e5-412d-a973-b89e4621b6ff service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:44.199542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd256a30-b5e5-412d-a973-b89e4621b6ff service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:44.218469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c613e-185c-44e6-8e9c-18b0b8a4f7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:44.219254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c613e-185c-44e6-8e9c-18b0b8a4f7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:44.219543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c613e-185c-44e6-8e9c-18b0b8a4f7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:44.219829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c613e-185c-44e6-8e9c-18b0b8a4f7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:44.220905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c613e-185c-44e6-8e9c-18b0b8a4f7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:44.222573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c613e-185c-44e6-8e9c-18b0b8a4f7f6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:44.270336 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1368/2705] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:44.274528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0d597-3f90-4b06-8d83-e2528b7f27f8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:44.307046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0d597-3f90-4b06-8d83-e2528b7f27f8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:44.331301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204b53a-af1d-453e-b2b4-7a7362c174d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:44.331826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204b53a-af1d-453e-b2b4-7a7362c174d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:44.332117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204b53a-af1d-453e-b2b4-7a7362c174d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:44.332424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204b53a-af1d-453e-b2b4-7a7362c174d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:44.333143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204b53a-af1d-453e-b2b4-7a7362c174d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:44.334709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204b53a-af1d-453e-b2b4-7a7362c174d9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:44.339664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c613e-185c-44e6-8e9c-18b0b8a4f7f6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:44.364787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c613e-185c-44e6-8e9c-18b0b8a4f7f6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:44.387491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac0477-540d-4cfd-91b5-c0d9ef497860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:44.388194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac0477-540d-4cfd-91b5-c0d9ef497860 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:44.388467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac0477-540d-4cfd-91b5-c0d9ef497860 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:44.388743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac0477-540d-4cfd-91b5-c0d9ef497860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:44.467779 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1338/2706] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:44.473651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204b53a-af1d-453e-b2b4-7a7362c174d9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:44.492629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204b53a-af1d-453e-b2b4-7a7362c174d9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:44.518673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a99787-1022-47f7-8182-4fc280fa7507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:44.520432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a99787-1022-47f7-8182-4fc280fa7507 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:44.522028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a99787-1022-47f7-8182-4fc280fa7507 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:44.522417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a99787-1022-47f7-8182-4fc280fa7507 admin admin] PATH_INFO: `/v3/projects/36e20864d1964d7b8110ad48ba654711/users/3f7c26be27ef4db883f1ffc9f9855ed7/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:44.525284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac0477-540d-4cfd-91b5-c0d9ef497860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:44.527770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac0477-540d-4cfd-91b5-c0d9ef497860 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:44.541125 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1369/2707] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:44.570808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a99787-1022-47f7-8182-4fc280fa7507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e20864d1964d7b8110ad48ba654711, user_id=3f7c26be27ef4db883f1ffc9f9855ed7, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:44.575461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a99787-1022-47f7-8182-4fc280fa7507 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:44.854223 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1339/2708] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:41:44 2022] PUT /identity/v3/projects/36e20864d1964d7b8110ad48ba654711/users/3f7c26be27ef4db883f1ffc9f9855ed7/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:41:44.860738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca242283-acef-4426-b003-47aa07ca11b6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:44.861281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca242283-acef-4426-b003-47aa07ca11b6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:44.862039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca242283-acef-4426-b003-47aa07ca11b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:44.870812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8da7-85d2-4a80-9553-22969c88dac4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:44.873039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8da7-85d2-4a80-9553-22969c88dac4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:44.873039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8da7-85d2-4a80-9553-22969c88dac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:44.879332 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-c0ce8da7-85d2-4a80-9553-22969c88dac4 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:41:44.879332 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:41:44.879332 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:41:44.879332 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:41:44.879332 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:41:44.879332 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:41:44.879332 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:41:44.879332 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:41:44.879332 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:41:44.879332 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:41:44.879332 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:41:44.879332 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:41:44.879332 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:41:44.880497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:41:44.880497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:41:44.880497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:41:44.880497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:41:44.880497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:41:44.880497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:41:44.880497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:41:44.880497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:41:44.880497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:41:44.880497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:41:44.880497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:41:44.880497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:41:44.880497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:41:44.880497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:41:44.880497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:41:44.881624 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1340/2709] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:41:44 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 04:41:44.919229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ca242283-acef-4426-b003-47aa07ca11b6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:44.920499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ca242283-acef-4426-b003-47aa07ca11b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:45.025191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd04b9-9cd7-44bd-8cdb-9cdbf43525a8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:45.025644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd04b9-9cd7-44bd-8cdb-9cdbf43525a8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:45.025805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd04b9-9cd7-44bd-8cdb-9cdbf43525a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:45.066356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b0bd04b9-9cd7-44bd-8cdb-9cdbf43525a8 None None] MFA Rules not processed for user `c0493ef2484140f69c1817efaaa51f98`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:45.067798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b0bd04b9-9cd7-44bd-8cdb-9cdbf43525a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:45.173640 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1370/2710] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:45.182278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca242283-acef-4426-b003-47aa07ca11b6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:45.184712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ca242283-acef-4426-b003-47aa07ca11b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:45.247845 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1341/2711] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:41:45.273202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd04b9-9cd7-44bd-8cdb-9cdbf43525a8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:45.275053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b0bd04b9-9cd7-44bd-8cdb-9cdbf43525a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:45.303143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd04b9-9cd7-44bd-8cdb-9cdbf43525a8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:45.314841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca242283-acef-4426-b003-47aa07ca11b6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:45.318999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf927f-5c55-463e-a597-a89ec9f6dfa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:45.319714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e5d2e-3a31-4762-bcc1-a3e856d9100f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:45.319884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf927f-5c55-463e-a597-a89ec9f6dfa6 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:45.320154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf927f-5c55-463e-a597-a89ec9f6dfa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:45.320575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf927f-5c55-463e-a597-a89ec9f6dfa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:45.321138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e5d2e-3a31-4762-bcc1-a3e856d9100f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:45.322741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e5d2e-3a31-4762-bcc1-a3e856d9100f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:45.323218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e5d2e-3a31-4762-bcc1-a3e856d9100f admin admin] PATH_INFO: `/v3/users/b63f3491e1f04df09284d8f3b073167a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:45.324863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e5d2e-3a31-4762-bcc1-a3e856d9100f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63f3491e1f04df09284d8f3b073167a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:45.327641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e5d2e-3a31-4762-bcc1-a3e856d9100f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:45.334336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf927f-5c55-463e-a597-a89ec9f6dfa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:45.335945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf927f-5c55-463e-a597-a89ec9f6dfa6 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:45.349823 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1371/2712] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:41:45.496018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf927f-5c55-463e-a597-a89ec9f6dfa6 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:45.497785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fdbf927f-5c55-463e-a597-a89ec9f6dfa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:45.554598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf927f-5c55-463e-a597-a89ec9f6dfa6 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:45.569197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:45.583048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91eeef-b5d1-4c0d-b2e9-b0a2b24e07ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:45.584071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91eeef-b5d1-4c0d-b2e9-b0a2b24e07ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:45.584783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91eeef-b5d1-4c0d-b2e9-b0a2b24e07ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:45.585203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91eeef-b5d1-4c0d-b2e9-b0a2b24e07ac admin admin] PATH_INFO: `/v3/users/70a3037174c74cc6bd8c22538f3acbcb` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:45.586848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91eeef-b5d1-4c0d-b2e9-b0a2b24e07ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=70a3037174c74cc6bd8c22538f3acbcb)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:45.588976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91eeef-b5d1-4c0d-b2e9-b0a2b24e07ac admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:45.677468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:45.697157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d19e5d2e-3a31-4762-bcc1-a3e856d9100f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63f3491e1f04df09284d8f3b073167a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:45.812282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d19e5d2e-3a31-4762-bcc1-a3e856d9100f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63f3491e1f04df09284d8f3b073167a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:45.812943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d19e5d2e-3a31-4762-bcc1-a3e856d9100f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63f3491e1f04df09284d8f3b073167a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:45.826731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d19e5d2e-3a31-4762-bcc1-a3e856d9100f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63f3491e1f04df09284d8f3b073167a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:45.851307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d19e5d2e-3a31-4762-bcc1-a3e856d9100f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63f3491e1f04df09284d8f3b073167a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:45.865462 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1342/2713] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:41:45 2022] DELETE /identity/v3/users/b63f3491e1f04df09284d8f3b073167a => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:45.866244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a80080-f8d5-4001-8e5f-7f27b0beaa60 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:45.866682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a80080-f8d5-4001-8e5f-7f27b0beaa60 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:45.867103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a80080-f8d5-4001-8e5f-7f27b0beaa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:45.893729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f7a80080-f8d5-4001-8e5f-7f27b0beaa60 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:45.895856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f7a80080-f8d5-4001-8e5f-7f27b0beaa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:45.918201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d91eeef-b5d1-4c0d-b2e9-b0a2b24e07ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70a3037174c74cc6bd8c22538f3acbcb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:45.922342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d91eeef-b5d1-4c0d-b2e9-b0a2b24e07ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70a3037174c74cc6bd8c22538f3acbcb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:46.009229 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1343/2714] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:46.053900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a80080-f8d5-4001-8e5f-7f27b0beaa60 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:46.055618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f7a80080-f8d5-4001-8e5f-7f27b0beaa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:46.067414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d91eeef-b5d1-4c0d-b2e9-b0a2b24e07ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70a3037174c74cc6bd8c22538f3acbcb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:46.072451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d91eeef-b5d1-4c0d-b2e9-b0a2b24e07ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70a3037174c74cc6bd8c22538f3acbcb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:46.136050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d91eeef-b5d1-4c0d-b2e9-b0a2b24e07ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70a3037174c74cc6bd8c22538f3acbcb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:46.185131 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1372/2715] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:41:45 2022] DELETE /identity/v3/users/70a3037174c74cc6bd8c22538f3acbcb => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:41:46.251699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a80080-f8d5-4001-8e5f-7f27b0beaa60 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:46.438116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dde58f-64a4-4617-aa49-b080b0a67f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:46.441941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dde58f-64a4-4617-aa49-b080b0a67f68 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:46.442408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dde58f-64a4-4617-aa49-b080b0a67f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:46.444104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dde58f-64a4-4617-aa49-b080b0a67f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:46.449247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f3dde58f-64a4-4617-aa49-b080b0a67f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:46.595352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dde58f-64a4-4617-aa49-b080b0a67f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:46.596904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dde58f-64a4-4617-aa49-b080b0a67f68 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:46.646202 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1344/2716] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:46.757305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91eeef-b5d1-4c0d-b2e9-b0a2b24e07ac admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:46.759506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5d91eeef-b5d1-4c0d-b2e9-b0a2b24e07ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:46.789689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:47.108922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91eeef-b5d1-4c0d-b2e9-b0a2b24e07ac admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:47.139786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdfd98-dba8-4cf9-8e65-c39acdceb8ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:47.147659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdfd98-dba8-4cf9-8e65-c39acdceb8ac service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:47.147659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdfd98-dba8-4cf9-8e65-c39acdceb8ac service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:47.147659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdfd98-dba8-4cf9-8e65-c39acdceb8ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:47.180571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a1fdfd98-dba8-4cf9-8e65-c39acdceb8ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:47.209646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdfd98-dba8-4cf9-8e65-c39acdceb8ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:47.227952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdfd98-dba8-4cf9-8e65-c39acdceb8ac service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:47.253748 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1373/2717] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:41:47.446373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dde58f-64a4-4617-aa49-b080b0a67f68 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:47.449136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f3dde58f-64a4-4617-aa49-b080b0a67f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:47.548595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dde58f-64a4-4617-aa49-b080b0a67f68 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:47.587157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d8d9b-7945-46b5-ae78-1740d2595b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:47.587157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d8d9b-7945-46b5-ae78-1740d2595b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:47.587157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d8d9b-7945-46b5-ae78-1740d2595b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:47.587157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d8d9b-7945-46b5-ae78-1740d2595b78 admin admin] PATH_INFO: `/v3/projects/846cd1c98578429c921d9598106bcdcf` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:47.587770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d8d9b-7945-46b5-ae78-1740d2595b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=846cd1c98578429c921d9598106bcdcf)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:47.587770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d8d9b-7945-46b5-ae78-1740d2595b78 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:47.820639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-027d8d9b-7945-46b5-ae78-1740d2595b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '846cd1c98578429c921d9598106bcdcf', 'request_id': 'req-027d8d9b-7945-46b5-ae78-1740d2595b78'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:47.841023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-027d8d9b-7945-46b5-ae78-1740d2595b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '846cd1c98578429c921d9598106bcdcf', 'request_id': 'req-027d8d9b-7945-46b5-ae78-1740d2595b78'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:47.863317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-027d8d9b-7945-46b5-ae78-1740d2595b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '846cd1c98578429c921d9598106bcdcf', 'request_id': 'req-027d8d9b-7945-46b5-ae78-1740d2595b78'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:48.080740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-027d8d9b-7945-46b5-ae78-1740d2595b78 admin admin] The token cache is being invalidate because project 846cd1c98578429c921d9598106bcdcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:41:48.080740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-027d8d9b-7945-46b5-ae78-1740d2595b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:48.080740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-027d8d9b-7945-46b5-ae78-1740d2595b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:48.082142 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1345/2718] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:47 2022] DELETE /identity/v3/projects/846cd1c98578429c921d9598106bcdcf => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:48.082606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1cb39-9c33-4cbc-a98d-3bd396f6a678 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:48.083398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1cb39-9c33-4cbc-a98d-3bd396f6a678 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:48.084154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1cb39-9c33-4cbc-a98d-3bd396f6a678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:48.144485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a2e1cb39-9c33-4cbc-a98d-3bd396f6a678 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:48.146387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a2e1cb39-9c33-4cbc-a98d-3bd396f6a678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:48.472595 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1374/2719] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:48.478961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d8d9b-7945-46b5-ae78-1740d2595b78 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:48.480422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-027d8d9b-7945-46b5-ae78-1740d2595b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:48.491598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845f37d-800f-4bde-98cf-0f6469605a3d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:48.491881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845f37d-800f-4bde-98cf-0f6469605a3d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:48.496612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845f37d-800f-4bde-98cf-0f6469605a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:48.532248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d8d9b-7945-46b5-ae78-1740d2595b78 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:48.573430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:48.573951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:48.574240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:48.574509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44 admin admin] PATH_INFO: `/v3/projects/302715970b2c4823a59a1667a51a25e1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:48.581651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=302715970b2c4823a59a1667a51a25e1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:48.583643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:48.615754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8845f37d-800f-4bde-98cf-0f6469605a3d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:48.629530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8845f37d-800f-4bde-98cf-0f6469605a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:48.697350 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1375/2720] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:48.700472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845f37d-800f-4bde-98cf-0f6469605a3d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:48.713891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845f37d-800f-4bde-98cf-0f6469605a3d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:48.743994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cd21b-df46-4249-9a27-75bcfe13d171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:48.745464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cd21b-df46-4249-9a27-75bcfe13d171 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:48.745953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cd21b-df46-4249-9a27-75bcfe13d171 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:48.746400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cd21b-df46-4249-9a27-75bcfe13d171 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:48.757007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cd21b-df46-4249-9a27-75bcfe13d171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:41:48.757007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cd21b-df46-4249-9a27-75bcfe13d171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:48.757007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cd21b-df46-4249-9a27-75bcfe13d171 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:48.794808 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1376/2721] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:41:48.798848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cd21b-df46-4249-9a27-75bcfe13d171 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:48.815379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cd21b-df46-4249-9a27-75bcfe13d171 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:48.853639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258e150-064a-4d62-8173-28a66a3eee3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:48.855690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258e150-064a-4d62-8173-28a66a3eee3b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:48.856902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258e150-064a-4d62-8173-28a66a3eee3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:48.858862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258e150-064a-4d62-8173-28a66a3eee3b admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:48.862287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258e150-064a-4d62-8173-28a66a3eee3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:48.865966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258e150-064a-4d62-8173-28a66a3eee3b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:48.892914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:49.093498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302715970b2c4823a59a1667a51a25e1', 'request_id': 'req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:49.114461 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1377/2722] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:41:48 2022] POST /identity/v3/projects => generated 393 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:49.118950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258e150-064a-4d62-8173-28a66a3eee3b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:49.125085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302715970b2c4823a59a1667a51a25e1', 'request_id': 'req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:49.135233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302715970b2c4823a59a1667a51a25e1', 'request_id': 'req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:49.258992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44 admin admin] The token cache is being invalidate because project 302715970b2c4823a59a1667a51a25e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:41:49.260301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:49.262307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:49.267236 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1346/2723] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:48 2022] DELETE /identity/v3/projects/302715970b2c4823a59a1667a51a25e1 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:49.270685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:49.275670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:49.392406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258e150-064a-4d62-8173-28a66a3eee3b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:49.405866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd965f7-e75b-46e3-b73b-a17a18ba8491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:49.407230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd965f7-e75b-46e3-b73b-a17a18ba8491 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:49.408636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd965f7-e75b-46e3-b73b-a17a18ba8491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:49.409668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd965f7-e75b-46e3-b73b-a17a18ba8491 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:49.410528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd965f7-e75b-46e3-b73b-a17a18ba8491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:49.418394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd965f7-e75b-46e3-b73b-a17a18ba8491 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:49.443395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163fe50-c0cd-4a77-bc2b-8301a22b3b44 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:49.449125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7da0b-8e5b-4f7b-92bb-2d38cee06e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:49.449926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7da0b-8e5b-4f7b-92bb-2d38cee06e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:49.450370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7da0b-8e5b-4f7b-92bb-2d38cee06e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:49.450747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7da0b-8e5b-4f7b-92bb-2d38cee06e30 admin admin] PATH_INFO: `/v3/users/bb684e8004db45899591800a014bbdda` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:49.452660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7da0b-8e5b-4f7b-92bb-2d38cee06e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb684e8004db45899591800a014bbdda)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:49.455775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7da0b-8e5b-4f7b-92bb-2d38cee06e30 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:49.645482 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1378/2724] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:41:49 2022] POST /identity/v3/users => generated 297 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:49.649831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd965f7-e75b-46e3-b73b-a17a18ba8491 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:49.672469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6cd965f7-e75b-46e3-b73b-a17a18ba8491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:49.705043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd965f7-e75b-46e3-b73b-a17a18ba8491 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:49.719123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd1120-3687-4cea-bf6d-b6077fca7785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:49.719123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd1120-3687-4cea-bf6d-b6077fca7785 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:49.719123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd1120-3687-4cea-bf6d-b6077fca7785 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:49.719123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd1120-3687-4cea-bf6d-b6077fca7785 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:49.719507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd1120-3687-4cea-bf6d-b6077fca7785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:49.726279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd1120-3687-4cea-bf6d-b6077fca7785 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:49.745517 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1379/2725] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:41:49.750362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd1120-3687-4cea-bf6d-b6077fca7785 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:49.778823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd1120-3687-4cea-bf6d-b6077fca7785 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:49.797979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef42548-35fe-42ff-a653-8e91698c43df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:49.798934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42548-35fe-42ff-a653-8e91698c43df admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:49.799403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42548-35fe-42ff-a653-8e91698c43df admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:49.800895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42548-35fe-42ff-a653-8e91698c43df admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:49.801739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef42548-35fe-42ff-a653-8e91698c43df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:49.803529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef42548-35fe-42ff-a653-8e91698c43df admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:49.829569 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1380/2726] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:41:49.837168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef42548-35fe-42ff-a653-8e91698c43df admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:49.867075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef42548-35fe-42ff-a653-8e91698c43df admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:49.881548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1ca7da0b-8e5b-4f7b-92bb-2d38cee06e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb684e8004db45899591800a014bbdda'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:49.882088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6380bc-8905-4a17-b6d0-d2fd8a59edba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:49.882242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6380bc-8905-4a17-b6d0-d2fd8a59edba admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:49.882512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6380bc-8905-4a17-b6d0-d2fd8a59edba admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:49.882788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6380bc-8905-4a17-b6d0-d2fd8a59edba admin admin] PATH_INFO: `/v3/projects/7a2842d87a554d9eab30e1fb0a955e08/users/524213eb8d154c6e8c4d08234003d4e8/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:49.931281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6380bc-8905-4a17-b6d0-d2fd8a59edba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a2842d87a554d9eab30e1fb0a955e08, user_id=524213eb8d154c6e8c4d08234003d4e8, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:49.948651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6380bc-8905-4a17-b6d0-d2fd8a59edba admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:50.151766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1ca7da0b-8e5b-4f7b-92bb-2d38cee06e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb684e8004db45899591800a014bbdda'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:50.152660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1ca7da0b-8e5b-4f7b-92bb-2d38cee06e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb684e8004db45899591800a014bbdda'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:50.162995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1ca7da0b-8e5b-4f7b-92bb-2d38cee06e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb684e8004db45899591800a014bbdda'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:50.178268 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1381/2727] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:41:49 2022] PUT /identity/v3/projects/7a2842d87a554d9eab30e1fb0a955e08/users/524213eb8d154c6e8c4d08234003d4e8/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:50.189041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cdc91-5d60-45b9-8d0c-b20ffbbab07c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:50.189707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cdc91-5d60-45b9-8d0c-b20ffbbab07c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:50.190138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cdc91-5d60-45b9-8d0c-b20ffbbab07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:50.240331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1ca7da0b-8e5b-4f7b-92bb-2d38cee06e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb684e8004db45899591800a014bbdda'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:50.263047 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1347/2728] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:41:49 2022] DELETE /identity/v3/users/bb684e8004db45899591800a014bbdda => generated 0 bytes in 993 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:50.274878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-293cdc91-5d60-45b9-8d0c-b20ffbbab07c None None] MFA Rules not processed for user `524213eb8d154c6e8c4d08234003d4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:50.276287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-293cdc91-5d60-45b9-8d0c-b20ffbbab07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:50.454322 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1382/2729] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:41:51.341279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7da0b-8e5b-4f7b-92bb-2d38cee06e30 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:51.343112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1ca7da0b-8e5b-4f7b-92bb-2d38cee06e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:51.595931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7da0b-8e5b-4f7b-92bb-2d38cee06e30 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:51.612397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49f675-1f96-47a4-95f7-bb01cdb7af07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:51.613012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49f675-1f96-47a4-95f7-bb01cdb7af07 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:51.613293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49f675-1f96-47a4-95f7-bb01cdb7af07 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:51.613567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49f675-1f96-47a4-95f7-bb01cdb7af07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:51.641401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49f675-1f96-47a4-95f7-bb01cdb7af07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:51.644813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49f675-1f96-47a4-95f7-bb01cdb7af07 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:51.666858 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1348/2730] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:41:51.770622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c420d9-d9bd-4849-aae5-bbb42fb2a6e6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:51.771373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c420d9-d9bd-4849-aae5-bbb42fb2a6e6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:51.771670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c420d9-d9bd-4849-aae5-bbb42fb2a6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:51.823737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-12c420d9-d9bd-4849-aae5-bbb42fb2a6e6 None None] MFA Rules not processed for user `524213eb8d154c6e8c4d08234003d4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:51.826181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-12c420d9-d9bd-4849-aae5-bbb42fb2a6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:51.849292 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1383/2731] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:52.007949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:53.020050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49f675-1f96-47a4-95f7-bb01cdb7af07 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:53.021920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ee49f675-1f96-47a4-95f7-bb01cdb7af07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:53.107490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c420d9-d9bd-4849-aae5-bbb42fb2a6e6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:53.109499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-12c420d9-d9bd-4849-aae5-bbb42fb2a6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:53.302162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49f675-1f96-47a4-95f7-bb01cdb7af07 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:53.318283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5193b3-4763-4411-90e8-d4b33a61a4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:53.319241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5193b3-4763-4411-90e8-d4b33a61a4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:53.319731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c420d9-d9bd-4849-aae5-bbb42fb2a6e6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:53.319891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5193b3-4763-4411-90e8-d4b33a61a4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:53.320334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5193b3-4763-4411-90e8-d4b33a61a4c8 admin admin] PATH_INFO: `/v3/projects/6b2573ec9dc344a092108c47052a476c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:53.321706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5193b3-4763-4411-90e8-d4b33a61a4c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b2573ec9dc344a092108c47052a476c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:53.323817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5193b3-4763-4411-90e8-d4b33a61a4c8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:53.336280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19281b4-21d8-4e2d-ae46-621c5699b3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:53.337666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19281b4-21d8-4e2d-ae46-621c5699b3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:53.339252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19281b4-21d8-4e2d-ae46-621c5699b3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:53.339732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19281b4-21d8-4e2d-ae46-621c5699b3ef admin admin] PATH_INFO: `/v3/users/524213eb8d154c6e8c4d08234003d4e8` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:53.344181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19281b4-21d8-4e2d-ae46-621c5699b3ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=524213eb8d154c6e8c4d08234003d4e8)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:53.352536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19281b4-21d8-4e2d-ae46-621c5699b3ef admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:53.835894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d19281b4-21d8-4e2d-ae46-621c5699b3ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '524213eb8d154c6e8c4d08234003d4e8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:53.838189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d19281b4-21d8-4e2d-ae46-621c5699b3ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '524213eb8d154c6e8c4d08234003d4e8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:53.844263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4c5193b3-4763-4411-90e8-d4b33a61a4c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b2573ec9dc344a092108c47052a476c', 'request_id': 'req-4c5193b3-4763-4411-90e8-d4b33a61a4c8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:53.864919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4c5193b3-4763-4411-90e8-d4b33a61a4c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b2573ec9dc344a092108c47052a476c', 'request_id': 'req-4c5193b3-4763-4411-90e8-d4b33a61a4c8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:53.879902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4c5193b3-4763-4411-90e8-d4b33a61a4c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b2573ec9dc344a092108c47052a476c', 'request_id': 'req-4c5193b3-4763-4411-90e8-d4b33a61a4c8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:53.967034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d19281b4-21d8-4e2d-ae46-621c5699b3ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '524213eb8d154c6e8c4d08234003d4e8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:53.968768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d19281b4-21d8-4e2d-ae46-621c5699b3ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '524213eb8d154c6e8c4d08234003d4e8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:53.991984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d19281b4-21d8-4e2d-ae46-621c5699b3ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '524213eb8d154c6e8c4d08234003d4e8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:54.058060 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1384/2732] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:41:53 2022] DELETE /identity/v3/users/524213eb8d154c6e8c4d08234003d4e8 => generated 0 bytes in 951 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:54.069341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4c5193b3-4763-4411-90e8-d4b33a61a4c8 admin admin] The token cache is being invalidate because project 6b2573ec9dc344a092108c47052a476c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:41:54.069817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4c5193b3-4763-4411-90e8-d4b33a61a4c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:54.070349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4c5193b3-4763-4411-90e8-d4b33a61a4c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:54.072470 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1349/2733] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:53 2022] DELETE /identity/v3/projects/6b2573ec9dc344a092108c47052a476c => generated 0 bytes in 1053 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:54.072649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31259ee7-aea0-4552-bed9-84e616c5b4ee None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:54.073260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31259ee7-aea0-4552-bed9-84e616c5b4ee None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:54.077453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31259ee7-aea0-4552-bed9-84e616c5b4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:54.079254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85d92b-dd7d-42f3-b100-f3c56c218219 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:54.082924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85d92b-dd7d-42f3-b100-f3c56c218219 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:54.085268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85d92b-dd7d-42f3-b100-f3c56c218219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:54.183673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-31259ee7-aea0-4552-bed9-84e616c5b4ee None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:54.183673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-31259ee7-aea0-4552-bed9-84e616c5b4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:54.194530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9d85d92b-dd7d-42f3-b100-f3c56c218219 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:54.202829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9d85d92b-dd7d-42f3-b100-f3c56c218219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:54.442542 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1350/2734] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:54.442939 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1385/2735] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:54.451285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278d9b7-810d-4b2e-87f6-d58eccbd94de None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:54.452421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278d9b7-810d-4b2e-87f6-d58eccbd94de None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:54.452965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278d9b7-810d-4b2e-87f6-d58eccbd94de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:54.490183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31259ee7-aea0-4552-bed9-84e616c5b4ee None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:54.491894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-31259ee7-aea0-4552-bed9-84e616c5b4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:54.546855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6278d9b7-810d-4b2e-87f6-d58eccbd94de None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:54.549420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6278d9b7-810d-4b2e-87f6-d58eccbd94de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:54.589656 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1351/2736] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:54.590739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278d9b7-810d-4b2e-87f6-d58eccbd94de None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:54.618659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278d9b7-810d-4b2e-87f6-d58eccbd94de None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:54.641426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8e5a4-18e2-4d91-bf1d-0a8c47a37c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:54.642422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8e5a4-18e2-4d91-bf1d-0a8c47a37c5b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:54.642919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8e5a4-18e2-4d91-bf1d-0a8c47a37c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:54.643403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8e5a4-18e2-4d91-bf1d-0a8c47a37c5b admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:54.645371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8e5a4-18e2-4d91-bf1d-0a8c47a37c5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:41:54.648645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8e5a4-18e2-4d91-bf1d-0a8c47a37c5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:54.650602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8e5a4-18e2-4d91-bf1d-0a8c47a37c5b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:54.687135 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1352/2737] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:41:54.692223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8e5a4-18e2-4d91-bf1d-0a8c47a37c5b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:54.732336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8e5a4-18e2-4d91-bf1d-0a8c47a37c5b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:54.732713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31259ee7-aea0-4552-bed9-84e616c5b4ee None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:54.745727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba709cc-d9fa-4015-b0f1-1a6e0ab7578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:54.746729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba709cc-d9fa-4015-b0f1-1a6e0ab7578b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:54.747622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba709cc-d9fa-4015-b0f1-1a6e0ab7578b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:54.748126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba709cc-d9fa-4015-b0f1-1a6e0ab7578b admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:54.750567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba709cc-d9fa-4015-b0f1-1a6e0ab7578b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:54.752828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba709cc-d9fa-4015-b0f1-1a6e0ab7578b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:54.777254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09d404-619b-4eaa-a8ea-5e45b286efc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:54.779476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09d404-619b-4eaa-a8ea-5e45b286efc9 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:54.780149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09d404-619b-4eaa-a8ea-5e45b286efc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:54.780490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09d404-619b-4eaa-a8ea-5e45b286efc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:54.790051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:54.821799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09d404-619b-4eaa-a8ea-5e45b286efc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:54.829243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09d404-619b-4eaa-a8ea-5e45b286efc9 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:54.861348 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1386/2738] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:54.907271 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1353/2739] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:41:54 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:54.908676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09d404-619b-4eaa-a8ea-5e45b286efc9 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:54.923410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09d404-619b-4eaa-a8ea-5e45b286efc9 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:55.062467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5567e1e-3b0d-4d20-8ab0-61c30f7555be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:55.063641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5567e1e-3b0d-4d20-8ab0-61c30f7555be admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:55.064286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5567e1e-3b0d-4d20-8ab0-61c30f7555be admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:55.064717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5567e1e-3b0d-4d20-8ab0-61c30f7555be admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:55.065507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5567e1e-3b0d-4d20-8ab0-61c30f7555be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:55.068443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5567e1e-3b0d-4d20-8ab0-61c30f7555be admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:55.228558 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1387/2740] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:41:54 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:55.232659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba709cc-d9fa-4015-b0f1-1a6e0ab7578b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:55.252667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba709cc-d9fa-4015-b0f1-1a6e0ab7578b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:55.277920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458ba5b-4860-47da-8a37-74245dfa3a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:55.281394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ba5b-4860-47da-8a37-74245dfa3a99 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:55.286212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ba5b-4860-47da-8a37-74245dfa3a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:55.288619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ba5b-4860-47da-8a37-74245dfa3a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:55.289398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458ba5b-4860-47da-8a37-74245dfa3a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:55.304026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458ba5b-4860-47da-8a37-74245dfa3a99 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:55.331023 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1354/2741] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:55.337741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5567e1e-3b0d-4d20-8ab0-61c30f7555be admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:55.348895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5567e1e-3b0d-4d20-8ab0-61c30f7555be admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:55.357499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c60d9-b9ac-41bb-ab37-7a3ac93f9f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:55.358499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c60d9-b9ac-41bb-ab37-7a3ac93f9f68 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:55.358979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c60d9-b9ac-41bb-ab37-7a3ac93f9f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:55.359395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c60d9-b9ac-41bb-ab37-7a3ac93f9f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:55.360241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c60d9-b9ac-41bb-ab37-7a3ac93f9f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:55.362087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c60d9-b9ac-41bb-ab37-7a3ac93f9f68 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:55.376738 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1388/2742] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:55.381271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458ba5b-4860-47da-8a37-74245dfa3a99 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:55.392545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458ba5b-4860-47da-8a37-74245dfa3a99 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:55.397658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d58906-8ebe-45ca-ae5a-c4a4942c0570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:55.398352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d58906-8ebe-45ca-ae5a-c4a4942c0570 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:55.398631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d58906-8ebe-45ca-ae5a-c4a4942c0570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:55.398954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d58906-8ebe-45ca-ae5a-c4a4942c0570 admin admin] PATH_INFO: `/v3/projects/e5865b7b9da947b2a324cb31d5c658bd/users/d1f1f8e372994677b491a2d2f9a74bf2/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:55.416412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d58906-8ebe-45ca-ae5a-c4a4942c0570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5865b7b9da947b2a324cb31d5c658bd, user_id=d1f1f8e372994677b491a2d2f9a74bf2, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:55.419433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d58906-8ebe-45ca-ae5a-c4a4942c0570 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:55.556586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:41:55.597034 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1355/2743] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:41:55 2022] PUT /identity/v3/projects/e5865b7b9da947b2a324cb31d5c658bd/users/d1f1f8e372994677b491a2d2f9a74bf2/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:55.607924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e44794-4e5a-4727-af1f-143cd9cb6ca0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:55.608476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e44794-4e5a-4727-af1f-143cd9cb6ca0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:55.608900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e44794-4e5a-4727-af1f-143cd9cb6ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:55.651857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-04e44794-4e5a-4727-af1f-143cd9cb6ca0 None None] MFA Rules not processed for user `d1f1f8e372994677b491a2d2f9a74bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:55.655121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-04e44794-4e5a-4727-af1f-143cd9cb6ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:55.745540 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1389/2744] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:55.750515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d58906-8ebe-45ca-ae5a-c4a4942c0570 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:55.838356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d58906-8ebe-45ca-ae5a-c4a4942c0570 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:55.844541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05800d1-b80e-47ad-af0b-3d655cfabbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:55.845474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05800d1-b80e-47ad-af0b-3d655cfabbe0 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:55.845918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05800d1-b80e-47ad-af0b-3d655cfabbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:55.846349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05800d1-b80e-47ad-af0b-3d655cfabbe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:55.848002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05800d1-b80e-47ad-af0b-3d655cfabbe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:55.850212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05800d1-b80e-47ad-af0b-3d655cfabbe0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:56.045341 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1356/2745] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:41:55 2022] POST /identity/v3/projects => generated 385 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:56.049497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e44794-4e5a-4727-af1f-143cd9cb6ca0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:56.097143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e44794-4e5a-4727-af1f-143cd9cb6ca0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:56.203777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e376a-a1cc-4583-97b6-6ee8e32fc336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:56.204672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e376a-a1cc-4583-97b6-6ee8e32fc336 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:56.205013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e376a-a1cc-4583-97b6-6ee8e32fc336 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:56.205315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e376a-a1cc-4583-97b6-6ee8e32fc336 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:56.210512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e376a-a1cc-4583-97b6-6ee8e32fc336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:56.210512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e376a-a1cc-4583-97b6-6ee8e32fc336 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:56.243513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05800d1-b80e-47ad-af0b-3d655cfabbe0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:56.246172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c05800d1-b80e-47ad-af0b-3d655cfabbe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:56.267800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05800d1-b80e-47ad-af0b-3d655cfabbe0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:56.276838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a45485-46d1-425e-b730-98b4d5fbfa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:56.277635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a45485-46d1-425e-b730-98b4d5fbfa25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:56.277889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a45485-46d1-425e-b730-98b4d5fbfa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:56.278932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a45485-46d1-425e-b730-98b4d5fbfa25 admin admin] PATH_INFO: `/v3/projects/7a2842d87a554d9eab30e1fb0a955e08` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:56.282432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a45485-46d1-425e-b730-98b4d5fbfa25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a2842d87a554d9eab30e1fb0a955e08)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:56.284495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a45485-46d1-425e-b730-98b4d5fbfa25 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:56.354618 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1390/2746] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:41:56 2022] POST /identity/v3/users => generated 299 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:56.355910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e376a-a1cc-4583-97b6-6ee8e32fc336 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:56.368205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e376a-a1cc-4583-97b6-6ee8e32fc336 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:56.382047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6405b-7722-4329-a0d5-855b56bbbf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:56.383108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6405b-7722-4329-a0d5-855b56bbbf54 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:56.383437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6405b-7722-4329-a0d5-855b56bbbf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:56.386937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6405b-7722-4329-a0d5-855b56bbbf54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:56.386937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6405b-7722-4329-a0d5-855b56bbbf54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:56.386937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6405b-7722-4329-a0d5-855b56bbbf54 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:56.402962 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1391/2747] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:56.407461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6405b-7722-4329-a0d5-855b56bbbf54 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:56.430049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6405b-7722-4329-a0d5-855b56bbbf54 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:56.437194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93a45485-46d1-425e-b730-98b4d5fbfa25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a2842d87a554d9eab30e1fb0a955e08', 'request_id': 'req-93a45485-46d1-425e-b730-98b4d5fbfa25'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:56.451270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93a45485-46d1-425e-b730-98b4d5fbfa25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a2842d87a554d9eab30e1fb0a955e08', 'request_id': 'req-93a45485-46d1-425e-b730-98b4d5fbfa25'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:56.461628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93a45485-46d1-425e-b730-98b4d5fbfa25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a2842d87a554d9eab30e1fb0a955e08', 'request_id': 'req-93a45485-46d1-425e-b730-98b4d5fbfa25'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:56.513756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf77612-da78-44fa-be2c-20eee466f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:56.515306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf77612-da78-44fa-be2c-20eee466f5da admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:56.515622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf77612-da78-44fa-be2c-20eee466f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:56.515902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf77612-da78-44fa-be2c-20eee466f5da admin admin] PATH_INFO: `/v3/projects/3f8eccffe64c41388566ed2dbee7d79f/users/471a8afd4a664ccfa3fa753a1cf34ae8/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:56.532477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf77612-da78-44fa-be2c-20eee466f5da admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8eccffe64c41388566ed2dbee7d79f, user_id=471a8afd4a664ccfa3fa753a1cf34ae8, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:56.535441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf77612-da78-44fa-be2c-20eee466f5da admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:56.682817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93a45485-46d1-425e-b730-98b4d5fbfa25 admin admin] The token cache is being invalidate because project 7a2842d87a554d9eab30e1fb0a955e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:41:56.683562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93a45485-46d1-425e-b730-98b4d5fbfa25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:56.684596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93a45485-46d1-425e-b730-98b4d5fbfa25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:41:56.687347 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1357/2748] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:41:56 2022] DELETE /identity/v3/projects/7a2842d87a554d9eab30e1fb0a955e08 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:56.695067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667a28-009a-4b5a-958d-57a653e90258 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:56.695852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667a28-009a-4b5a-958d-57a653e90258 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:56.696391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667a28-009a-4b5a-958d-57a653e90258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:56.720041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bc667a28-009a-4b5a-958d-57a653e90258 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:56.721423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bc667a28-009a-4b5a-958d-57a653e90258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:56.729629 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1358/2749] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:56.755934 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1392/2750] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:41:56 2022] PUT /identity/v3/projects/3f8eccffe64c41388566ed2dbee7d79f/users/471a8afd4a664ccfa3fa753a1cf34ae8/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:56.756751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc667a28-009a-4b5a-958d-57a653e90258 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:56.758470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bc667a28-009a-4b5a-958d-57a653e90258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:56.780131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc667a28-009a-4b5a-958d-57a653e90258 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:56.804276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da730a-9370-4dab-9260-341f314fd990 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:56.804883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da730a-9370-4dab-9260-341f314fd990 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:56.805182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da730a-9370-4dab-9260-341f314fd990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:56.869798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-87da730a-9370-4dab-9260-341f314fd990 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:56.874426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-87da730a-9370-4dab-9260-341f314fd990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:56.948542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5036a7-c86c-4bc2-b94a-816bcc8634a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:56.949165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5036a7-c86c-4bc2-b94a-816bcc8634a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:56.950146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5036a7-c86c-4bc2-b94a-816bcc8634a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:56.950415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5036a7-c86c-4bc2-b94a-816bcc8634a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:56.951243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5036a7-c86c-4bc2-b94a-816bcc8634a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:56.954576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5036a7-c86c-4bc2-b94a-816bcc8634a7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:57.002212 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1359/2751] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:41:57.007200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5036a7-c86c-4bc2-b94a-816bcc8634a7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:57.029530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5036a7-c86c-4bc2-b94a-816bcc8634a7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:57.043022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3dbc4-393b-4192-853f-1c26e4c478e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:57.043699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3dbc4-393b-4192-853f-1c26e4c478e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:57.043978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3dbc4-393b-4192-853f-1c26e4c478e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:57.052149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3dbc4-393b-4192-853f-1c26e4c478e7 admin admin] PATH_INFO: `/v3/projects/3f8eccffe64c41388566ed2dbee7d79f/users/471a8afd4a664ccfa3fa753a1cf34ae8/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:57.059868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3dbc4-393b-4192-853f-1c26e4c478e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8eccffe64c41388566ed2dbee7d79f, user_id=471a8afd4a664ccfa3fa753a1cf34ae8, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:57.064530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3dbc4-393b-4192-853f-1c26e4c478e7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:57.086013 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1393/2752] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:57.087459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da730a-9370-4dab-9260-341f314fd990 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:57.102161 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1360/2753] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:41:57 2022] PUT /identity/v3/projects/3f8eccffe64c41388566ed2dbee7d79f/users/471a8afd4a664ccfa3fa753a1cf34ae8/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:57.107530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da730a-9370-4dab-9260-341f314fd990 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:57.115177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3941-a1d2-4ebb-9660-ba0d0524463c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:57.115465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3941-a1d2-4ebb-9660-ba0d0524463c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:57.115793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3941-a1d2-4ebb-9660-ba0d0524463c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:57.184119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-34fa3941-a1d2-4ebb-9660-ba0d0524463c None None] MFA Rules not processed for user `471a8afd4a664ccfa3fa753a1cf34ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:57.185434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-34fa3941-a1d2-4ebb-9660-ba0d0524463c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:57.240323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6ba4e-366d-477a-a880-b085b7537ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:57.241144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ba4e-366d-477a-a880-b085b7537ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:57.241430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ba4e-366d-477a-a880-b085b7537ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:57.241698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ba4e-366d-477a-a880-b085b7537ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:57.244138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6ba4e-366d-477a-a880-b085b7537ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:41:57.244649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6ba4e-366d-477a-a880-b085b7537ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:57.267951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6ba4e-366d-477a-a880-b085b7537ea1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:57.299770 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1394/2754] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:41:57.301596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6ba4e-366d-477a-a880-b085b7537ea1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:57.317379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6ba4e-366d-477a-a880-b085b7537ea1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:57.337241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6c1bc-017b-4493-a6e6-d382d372dea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:57.338308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c1bc-017b-4493-a6e6-d382d372dea8 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:57.338944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c1bc-017b-4493-a6e6-d382d372dea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:57.340096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6c1bc-017b-4493-a6e6-d382d372dea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:57.341841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6c1bc-017b-4493-a6e6-d382d372dea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:57.345790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6c1bc-017b-4493-a6e6-d382d372dea8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:57.378745 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1361/2755] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:57.385806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d94bd4-747f-4a06-af7e-268783700486 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:57.386101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d94bd4-747f-4a06-af7e-268783700486 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:57.386376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d94bd4-747f-4a06-af7e-268783700486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:57.433847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d0d94bd4-747f-4a06-af7e-268783700486 None None] MFA Rules not processed for user `d1f1f8e372994677b491a2d2f9a74bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:57.440476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d0d94bd4-747f-4a06-af7e-268783700486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:57.546065 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1362/2756] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:41:57.559416 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1395/2757] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:41:57 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:41:57.562097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d94bd4-747f-4a06-af7e-268783700486 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:57.593370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d94bd4-747f-4a06-af7e-268783700486 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:57.748218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d4b83-efaf-463d-93f2-e0205eda9609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:57.749226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d4b83-efaf-463d-93f2-e0205eda9609 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:57.749507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d4b83-efaf-463d-93f2-e0205eda9609 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:57.749928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d4b83-efaf-463d-93f2-e0205eda9609 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:57.750470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d4b83-efaf-463d-93f2-e0205eda9609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:57.753145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d4b83-efaf-463d-93f2-e0205eda9609 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:57.839298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6c1bc-017b-4493-a6e6-d382d372dea8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:57.842848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-86a6c1bc-017b-4493-a6e6-d382d372dea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:57.937868 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1363/2758] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:41:57 2022] POST /identity/v3/users => generated 289 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:41:57.939073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d4b83-efaf-463d-93f2-e0205eda9609 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:57.966105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d4b83-efaf-463d-93f2-e0205eda9609 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:57.973557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6753a29-ae4f-457c-882e-cd4d67f7895c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:57.974296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6753a29-ae4f-457c-882e-cd4d67f7895c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:57.974670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6753a29-ae4f-457c-882e-cd4d67f7895c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:57.976655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6753a29-ae4f-457c-882e-cd4d67f7895c admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:57.978510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6753a29-ae4f-457c-882e-cd4d67f7895c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:57.980838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6753a29-ae4f-457c-882e-cd4d67f7895c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:57.992671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6c1bc-017b-4493-a6e6-d382d372dea8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:58.007683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b32cfb-937f-4552-b50d-23f290dac102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:58.009341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b32cfb-937f-4552-b50d-23f290dac102 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:58.009639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b32cfb-937f-4552-b50d-23f290dac102 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:58.013851 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1364/2759] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:41:58.014611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b32cfb-937f-4552-b50d-23f290dac102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:58.016016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6753a29-ae4f-457c-882e-cd4d67f7895c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:58.016844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-38b32cfb-937f-4552-b50d-23f290dac102 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:58.032609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6753a29-ae4f-457c-882e-cd4d67f7895c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:58.043431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547807c-0b3a-4bbe-905a-1803fe59ac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:58.044058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547807c-0b3a-4bbe-905a-1803fe59ac53 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:58.044465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547807c-0b3a-4bbe-905a-1803fe59ac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:58.044750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547807c-0b3a-4bbe-905a-1803fe59ac53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:58.045822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547807c-0b3a-4bbe-905a-1803fe59ac53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:58.047667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547807c-0b3a-4bbe-905a-1803fe59ac53 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:58.067143 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1365/2760] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:41:58.070800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547807c-0b3a-4bbe-905a-1803fe59ac53 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:58.088767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547807c-0b3a-4bbe-905a-1803fe59ac53 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:58.096841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9dd51-2230-4831-87f0-9d3361978087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:58.097538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9dd51-2230-4831-87f0-9d3361978087 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:58.098388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9dd51-2230-4831-87f0-9d3361978087 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:58.098671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9dd51-2230-4831-87f0-9d3361978087 admin admin] PATH_INFO: `/v3/projects/4a75c85087244b31b3ed8b1908c8ade5/users/f40a67254cfd47e2b7822d1359ce408f/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:58.119042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9dd51-2230-4831-87f0-9d3361978087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a75c85087244b31b3ed8b1908c8ade5, user_id=f40a67254cfd47e2b7822d1359ce408f, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:58.122254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9dd51-2230-4831-87f0-9d3361978087 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:58.145363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b32cfb-937f-4552-b50d-23f290dac102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:58.147256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b32cfb-937f-4552-b50d-23f290dac102 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:58.161068 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1396/2761] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:41:58.289735 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1366/2762] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:41:58 2022] PUT /identity/v3/projects/4a75c85087244b31b3ed8b1908c8ade5/users/f40a67254cfd47e2b7822d1359ce408f/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:41:58.291102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59398a8-eb1c-40fa-a5a6-bd1191048132 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:58.291396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59398a8-eb1c-40fa-a5a6-bd1191048132 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:58.291670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59398a8-eb1c-40fa-a5a6-bd1191048132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:58.318106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f59398a8-eb1c-40fa-a5a6-bd1191048132 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:41:58.319496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f59398a8-eb1c-40fa-a5a6-bd1191048132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:58.410634 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1397/2763] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:41:58.455136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9dd51-2230-4831-87f0-9d3361978087 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:41:58.458126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a9b9dd51-2230-4831-87f0-9d3361978087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:41:58.553673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9dd51-2230-4831-87f0-9d3361978087 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:41:58.558305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bca959-2ad3-40f6-84b9-f26494a1f42a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:41:58.559431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bca959-2ad3-40f6-84b9-f26494a1f42a service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:41:58.559913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bca959-2ad3-40f6-84b9-f26494a1f42a service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:41:58.560368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bca959-2ad3-40f6-84b9-f26494a1f42a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:41:58.588516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bca959-2ad3-40f6-84b9-f26494a1f42a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:41:58.591496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bca959-2ad3-40f6-84b9-f26494a1f42a service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:41:58.621433 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1367/2764] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:41:59.304593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:00.558144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f323d-c292-42fe-996e-ce966066a118 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:00.558616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f323d-c292-42fe-996e-ce966066a118 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:00.558727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f323d-c292-42fe-996e-ce966066a118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:00.600374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a74f323d-c292-42fe-996e-ce966066a118 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:00.604292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a74f323d-c292-42fe-996e-ce966066a118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:00.766272 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1398/2765] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:42:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:00.781189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bca959-2ad3-40f6-84b9-f26494a1f42a service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:00.782748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-65bca959-2ad3-40f6-84b9-f26494a1f42a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:00.890631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bca959-2ad3-40f6-84b9-f26494a1f42a service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:00.903662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dafff-359a-4ec7-b77a-9dc1cdfee580 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:00.904313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dafff-359a-4ec7-b77a-9dc1cdfee580 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:00.905145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dafff-359a-4ec7-b77a-9dc1cdfee580 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:00.905449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dafff-359a-4ec7-b77a-9dc1cdfee580 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:00.916196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609dafff-359a-4ec7-b77a-9dc1cdfee580 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:00.918875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609dafff-359a-4ec7-b77a-9dc1cdfee580 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:00.928473 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1368/2766] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:42:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:42:01.027317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:02.981705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9e51a-d868-42c2-917d-493e4ca5e3dc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:02.983019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9e51a-d868-42c2-917d-493e4ca5e3dc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:02.983987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9e51a-d868-42c2-917d-493e4ca5e3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:03.038315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5de9e51a-d868-42c2-917d-493e4ca5e3dc None None] MFA Rules not processed for user `3f7c26be27ef4db883f1ffc9f9855ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:03.039872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5de9e51a-d868-42c2-917d-493e4ca5e3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:03.166207 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1399/2767] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:03.175807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0a4cd-2a69-4b2f-bcbc-53a5f70b4bc2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:03.176386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0a4cd-2a69-4b2f-bcbc-53a5f70b4bc2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:03.176386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0a4cd-2a69-4b2f-bcbc-53a5f70b4bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:03.225411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3ae0a4cd-2a69-4b2f-bcbc-53a5f70b4bc2 None None] MFA Rules not processed for user `3f7c26be27ef4db883f1ffc9f9855ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:03.226656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3ae0a4cd-2a69-4b2f-bcbc-53a5f70b4bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:03.242897 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1369/2768] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:03.254114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9e51a-d868-42c2-917d-493e4ca5e3dc None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:03.256792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5de9e51a-d868-42c2-917d-493e4ca5e3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:03.428507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9e51a-d868-42c2-917d-493e4ca5e3dc None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:03.447671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8cfe9-a8cc-46c8-91ab-41b1b37501cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:03.448339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8cfe9-a8cc-46c8-91ab-41b1b37501cb service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:03.448672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8cfe9-a8cc-46c8-91ab-41b1b37501cb service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:03.449578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8cfe9-a8cc-46c8-91ab-41b1b37501cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:03.458515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8cfe9-a8cc-46c8-91ab-41b1b37501cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:03.460299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8cfe9-a8cc-46c8-91ab-41b1b37501cb service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:03.471973 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1400/2769] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:42:03 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:03.973839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f67d8-8f1c-410e-85e3-e956033feb4f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:03.974431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f67d8-8f1c-410e-85e3-e956033feb4f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:03.975179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f67d8-8f1c-410e-85e3-e956033feb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:03.983644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-c30f67d8-8f1c-410e-85e3-e956033feb4f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:42:03.983644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:42:03.983644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:42:03.983644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:42:03.983644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:42:03.983644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:42:03.983644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:42:03.983644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:42:03.983644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:42:03.983644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:42:03.983644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:42:03.983644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:42:03.983644 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:42:03.984749 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:42:03.984749 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:42:03.984749 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:42:03.984749 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:42:03.984749 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:42:03.984749 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:42:03.984749 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:42:03.984749 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:42:03.984749 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:42:03.984749 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:42:03.984749 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:42:03.984749 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:42:03.984749 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:42:03.984749 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:42:03.984749 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:42:03.992003 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1370/2770] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:42:03 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 21 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:42:07.114252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:07.469584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:09.841302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:09.967735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:10.658273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8511fb1-3329-46f5-a0a8-edac2ad7f11f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:10.658618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8511fb1-3329-46f5-a0a8-edac2ad7f11f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:10.659208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8511fb1-3329-46f5-a0a8-edac2ad7f11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:10.668729 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-b8511fb1-3329-46f5-a0a8-edac2ad7f11f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:42:10.668729 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:42:10.668729 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:42:10.668729 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:42:10.668729 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:42:10.668729 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:42:10.668729 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:42:10.668729 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:42:10.668729 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:42:10.668729 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:42:10.668729 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:42:10.668729 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:42:10.668729 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:42:10.669775 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:42:10.669775 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:42:10.669775 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:42:10.669775 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:42:10.669775 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:42:10.669775 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:42:10.669775 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:42:10.669775 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:42:10.669775 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:42:10.669775 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:42:10.669775 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:42:10.669775 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:42:10.669775 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:42:10.669775 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:42:10.669775 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:42:10.679829 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1401/2771] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:42:10 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 22 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:42:13.006196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:13.996031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:14.103545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f67d8-8f1c-410e-85e3-e956033feb4f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:14.109509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c30f67d8-8f1c-410e-85e3-e956033feb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:14.148001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f67d8-8f1c-410e-85e3-e956033feb4f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:14.154616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae244cf-689c-47ae-a923-57432c232e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:14.156819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae244cf-689c-47ae-a923-57432c232e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:14.157361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae244cf-689c-47ae-a923-57432c232e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:14.157905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae244cf-689c-47ae-a923-57432c232e28 admin admin] PATH_INFO: `/v3/users/284ca0eca1c04f948354125f33d1c308` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:14.159628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae244cf-689c-47ae-a923-57432c232e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=284ca0eca1c04f948354125f33d1c308)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:14.161910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae244cf-689c-47ae-a923-57432c232e28 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:14.354626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8511fb1-3329-46f5-a0a8-edac2ad7f11f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:14.359042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b8511fb1-3329-46f5-a0a8-edac2ad7f11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:14.381342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8511fb1-3329-46f5-a0a8-edac2ad7f11f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:14.386707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c65d8b-9949-484f-a779-806cce44e1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:14.387374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c65d8b-9949-484f-a779-806cce44e1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:14.387656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c65d8b-9949-484f-a779-806cce44e1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:14.387930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c65d8b-9949-484f-a779-806cce44e1d6 admin admin] PATH_INFO: `/v3/users/afd74c321da04ddb95acd071cbd767cd` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:14.397215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c65d8b-9949-484f-a779-806cce44e1d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd74c321da04ddb95acd071cbd767cd)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:14.400124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c65d8b-9949-484f-a779-806cce44e1d6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:14.432707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ae244cf-689c-47ae-a923-57432c232e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '284ca0eca1c04f948354125f33d1c308'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:14.605364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ae244cf-689c-47ae-a923-57432c232e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '284ca0eca1c04f948354125f33d1c308'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:14.605505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ae244cf-689c-47ae-a923-57432c232e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '284ca0eca1c04f948354125f33d1c308'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:14.615149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ae244cf-689c-47ae-a923-57432c232e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '284ca0eca1c04f948354125f33d1c308'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:14.629015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ae244cf-689c-47ae-a923-57432c232e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '284ca0eca1c04f948354125f33d1c308'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:14.636825 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1371/2772] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:42:14 2022] DELETE /identity/v3/users/284ca0eca1c04f948354125f33d1c308 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:14.641118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b9cb-7549-442d-850d-1cefb2c259b7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:14.642020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b9cb-7549-442d-850d-1cefb2c259b7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:14.642618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b9cb-7549-442d-850d-1cefb2c259b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:14.672861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8350b9cb-7549-442d-850d-1cefb2c259b7 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:14.674903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8350b9cb-7549-442d-850d-1cefb2c259b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:14.783469 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1372/2773] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:14.805012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350b9cb-7549-442d-850d-1cefb2c259b7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:14.806777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8350b9cb-7549-442d-850d-1cefb2c259b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:14.903228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350b9cb-7549-442d-850d-1cefb2c259b7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:14.938321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2646179-3c14-47c0-9e39-4aec33b947ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:14.938961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2646179-3c14-47c0-9e39-4aec33b947ec service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:14.939244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2646179-3c14-47c0-9e39-4aec33b947ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:14.939521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2646179-3c14-47c0-9e39-4aec33b947ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:14.965034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b3c65d8b-9949-484f-a779-806cce44e1d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd74c321da04ddb95acd071cbd767cd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:14.966143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b3c65d8b-9949-484f-a779-806cce44e1d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd74c321da04ddb95acd071cbd767cd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:14.990321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2646179-3c14-47c0-9e39-4aec33b947ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:14.995989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2646179-3c14-47c0-9e39-4aec33b947ec service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:15.014243 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1373/2774] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:42:15.103435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b3c65d8b-9949-484f-a779-806cce44e1d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd74c321da04ddb95acd071cbd767cd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:15.104796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b3c65d8b-9949-484f-a779-806cce44e1d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd74c321da04ddb95acd071cbd767cd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:15.130742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b3c65d8b-9949-484f-a779-806cce44e1d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd74c321da04ddb95acd071cbd767cd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:15.155774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:15.163920 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1402/2775] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:42:14 2022] DELETE /identity/v3/users/afd74c321da04ddb95acd071cbd767cd => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:15.874687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee0830-f5f7-47f1-929d-9fae5d4f9e9e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:15.874968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee0830-f5f7-47f1-929d-9fae5d4f9e9e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:15.875441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee0830-f5f7-47f1-929d-9fae5d4f9e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:15.930978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-11ee0830-f5f7-47f1-929d-9fae5d4f9e9e None None] MFA Rules not processed for user `f40a67254cfd47e2b7822d1359ce408f`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:15.932658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-11ee0830-f5f7-47f1-929d-9fae5d4f9e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:16.062617 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1374/2776] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:16.078661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c65d8b-9949-484f-a779-806cce44e1d6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:16.080124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b3c65d8b-9949-484f-a779-806cce44e1d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:16.101223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee0830-f5f7-47f1-929d-9fae5d4f9e9e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:16.102670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-11ee0830-f5f7-47f1-929d-9fae5d4f9e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:16.202184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c65d8b-9949-484f-a779-806cce44e1d6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:16.210144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153771b-0a00-44b0-8365-c46a03e0e013 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:16.211027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153771b-0a00-44b0-8365-c46a03e0e013 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:16.211438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153771b-0a00-44b0-8365-c46a03e0e013 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:16.211944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153771b-0a00-44b0-8365-c46a03e0e013 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:16.215056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee0830-f5f7-47f1-929d-9fae5d4f9e9e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:16.222538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4b036-404e-4a4e-9c94-84cc9075f68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:16.223500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153771b-0a00-44b0-8365-c46a03e0e013 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:16.223645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4b036-404e-4a4e-9c94-84cc9075f68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:16.223862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4b036-404e-4a4e-9c94-84cc9075f68c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:16.224135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4b036-404e-4a4e-9c94-84cc9075f68c admin admin] PATH_INFO: `/v3/projects/2936c03bbeee48a585b66453179cba76` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:16.225323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4b036-404e-4a4e-9c94-84cc9075f68c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2936c03bbeee48a585b66453179cba76)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:16.226505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153771b-0a00-44b0-8365-c46a03e0e013 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:16.227648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4b036-404e-4a4e-9c94-84cc9075f68c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:16.239452 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1403/2777] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:42:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:16.240817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153771b-0a00-44b0-8365-c46a03e0e013 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:16.242674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0153771b-0a00-44b0-8365-c46a03e0e013 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:16.260208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153771b-0a00-44b0-8365-c46a03e0e013 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:16.266632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3d5eb-baf9-4500-8c53-37188be0648f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:16.267612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3d5eb-baf9-4500-8c53-37188be0648f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:16.268085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3d5eb-baf9-4500-8c53-37188be0648f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:16.268577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3d5eb-baf9-4500-8c53-37188be0648f admin admin] PATH_INFO: `/v3/users/3f7c26be27ef4db883f1ffc9f9855ed7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:16.270980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3d5eb-baf9-4500-8c53-37188be0648f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f7c26be27ef4db883f1ffc9f9855ed7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:16.274048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3d5eb-baf9-4500-8c53-37188be0648f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:16.485227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-82a4b036-404e-4a4e-9c94-84cc9075f68c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2936c03bbeee48a585b66453179cba76', 'request_id': 'req-82a4b036-404e-4a4e-9c94-84cc9075f68c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:16.490745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-82a4b036-404e-4a4e-9c94-84cc9075f68c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2936c03bbeee48a585b66453179cba76', 'request_id': 'req-82a4b036-404e-4a4e-9c94-84cc9075f68c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:16.497272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-82a4b036-404e-4a4e-9c94-84cc9075f68c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2936c03bbeee48a585b66453179cba76', 'request_id': 'req-82a4b036-404e-4a4e-9c94-84cc9075f68c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:16.630067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-82a4b036-404e-4a4e-9c94-84cc9075f68c admin admin] The token cache is being invalidate because project 2936c03bbeee48a585b66453179cba76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:42:16.630450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-82a4b036-404e-4a4e-9c94-84cc9075f68c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:16.633820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-82a4b036-404e-4a4e-9c94-84cc9075f68c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:16.635030 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1375/2778] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:16 2022] DELETE /identity/v3/projects/2936c03bbeee48a585b66453179cba76 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:42:16.635938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4b036-404e-4a4e-9c94-84cc9075f68c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:16.639418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-82a4b036-404e-4a4e-9c94-84cc9075f68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:16.813129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a8c3d5eb-baf9-4500-8c53-37188be0648f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f7c26be27ef4db883f1ffc9f9855ed7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:16.816966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a8c3d5eb-baf9-4500-8c53-37188be0648f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f7c26be27ef4db883f1ffc9f9855ed7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:16.824066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4b036-404e-4a4e-9c94-84cc9075f68c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:16.842180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787bb32-8c99-49e3-bd8a-58cdfcee35de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:16.845871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787bb32-8c99-49e3-bd8a-58cdfcee35de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:16.846233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787bb32-8c99-49e3-bd8a-58cdfcee35de admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:16.847205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787bb32-8c99-49e3-bd8a-58cdfcee35de admin admin] PATH_INFO: `/v3/projects/4d1c84c5c0f4408188e3c2e8f9fc748a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:16.856462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787bb32-8c99-49e3-bd8a-58cdfcee35de admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1c84c5c0f4408188e3c2e8f9fc748a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:16.863000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787bb32-8c99-49e3-bd8a-58cdfcee35de admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:16.908509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a8c3d5eb-baf9-4500-8c53-37188be0648f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f7c26be27ef4db883f1ffc9f9855ed7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:16.910472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a8c3d5eb-baf9-4500-8c53-37188be0648f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f7c26be27ef4db883f1ffc9f9855ed7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:16.934320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a8c3d5eb-baf9-4500-8c53-37188be0648f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f7c26be27ef4db883f1ffc9f9855ed7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:16.952537 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1404/2779] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:42:16 2022] DELETE /identity/v3/users/3f7c26be27ef4db883f1ffc9f9855ed7 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:16.956083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:16.961170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314e8cc-b117-4874-b3c7-1724a50f990b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:16.961170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314e8cc-b117-4874-b3c7-1724a50f990b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:16.961170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314e8cc-b117-4874-b3c7-1724a50f990b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:17.000874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5314e8cc-b117-4874-b3c7-1724a50f990b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:17.002434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5314e8cc-b117-4874-b3c7-1724a50f990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:17.090603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7787bb32-8c99-49e3-bd8a-58cdfcee35de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1c84c5c0f4408188e3c2e8f9fc748a', 'request_id': 'req-7787bb32-8c99-49e3-bd8a-58cdfcee35de'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:17.094671 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1405/2780] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:17.096299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3643d7-5473-45c6-82d8-f704c49651d6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:17.096678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3643d7-5473-45c6-82d8-f704c49651d6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:17.096950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3643d7-5473-45c6-82d8-f704c49651d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:17.103254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7787bb32-8c99-49e3-bd8a-58cdfcee35de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1c84c5c0f4408188e3c2e8f9fc748a', 'request_id': 'req-7787bb32-8c99-49e3-bd8a-58cdfcee35de'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:17.116673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7787bb32-8c99-49e3-bd8a-58cdfcee35de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1c84c5c0f4408188e3c2e8f9fc748a', 'request_id': 'req-7787bb32-8c99-49e3-bd8a-58cdfcee35de'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:17.149363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-fa3643d7-5473-45c6-82d8-f704c49651d6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:17.150671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fa3643d7-5473-45c6-82d8-f704c49651d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:17.230767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7787bb32-8c99-49e3-bd8a-58cdfcee35de admin admin] The token cache is being invalidate because project 4d1c84c5c0f4408188e3c2e8f9fc748a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:42:17.231765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7787bb32-8c99-49e3-bd8a-58cdfcee35de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:17.233349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7787bb32-8c99-49e3-bd8a-58cdfcee35de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:17.235028 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1376/2781] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:16 2022] DELETE /identity/v3/projects/4d1c84c5c0f4408188e3c2e8f9fc748a => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:17.244203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fabab-93b9-42ae-9e73-609f8a813e74 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:17.244740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fabab-93b9-42ae-9e73-609f8a813e74 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:17.245196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fabab-93b9-42ae-9e73-609f8a813e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:17.299667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d25fabab-93b9-42ae-9e73-609f8a813e74 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:17.299896 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1406/2782] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:17.299987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d25fabab-93b9-42ae-9e73-609f8a813e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:17.300927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3643d7-5473-45c6-82d8-f704c49651d6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:17.318702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3643d7-5473-45c6-82d8-f704c49651d6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:17.323714 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1377/2783] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:17.328089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509e7f8-fe7f-4cff-a0b9-9cb15adf009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:17.330316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509e7f8-fe7f-4cff-a0b9-9cb15adf009a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:17.330316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509e7f8-fe7f-4cff-a0b9-9cb15adf009a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:17.330316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509e7f8-fe7f-4cff-a0b9-9cb15adf009a admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:17.330316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509e7f8-fe7f-4cff-a0b9-9cb15adf009a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:42:17.337322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874edd5-76fa-4074-96b1-f71095ec791d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:17.337609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874edd5-76fa-4074-96b1-f71095ec791d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:17.337874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874edd5-76fa-4074-96b1-f71095ec791d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:17.341301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509e7f8-fe7f-4cff-a0b9-9cb15adf009a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:17.343506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509e7f8-fe7f-4cff-a0b9-9cb15adf009a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:17.358583 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1407/2784] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:42:17.363626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509e7f8-fe7f-4cff-a0b9-9cb15adf009a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:17.375973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509e7f8-fe7f-4cff-a0b9-9cb15adf009a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:17.382026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b874edd5-76fa-4074-96b1-f71095ec791d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:17.382026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b874edd5-76fa-4074-96b1-f71095ec791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:17.383658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6b33b-f434-4cb6-b100-682ff9e1aca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:17.384617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6b33b-f434-4cb6-b100-682ff9e1aca2 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:17.384923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6b33b-f434-4cb6-b100-682ff9e1aca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:17.385298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6b33b-f434-4cb6-b100-682ff9e1aca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:17.386793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6b33b-f434-4cb6-b100-682ff9e1aca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:17.396251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6b33b-f434-4cb6-b100-682ff9e1aca2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:17.397274 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1378/2785] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:17.398342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874edd5-76fa-4074-96b1-f71095ec791d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:17.411044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874edd5-76fa-4074-96b1-f71095ec791d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:17.417310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb642edc-74dd-46bb-b44d-d22b4d2ce8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:17.418159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb642edc-74dd-46bb-b44d-d22b4d2ce8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:17.418422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb642edc-74dd-46bb-b44d-d22b4d2ce8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:17.418879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb642edc-74dd-46bb-b44d-d22b4d2ce8d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:17.419571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb642edc-74dd-46bb-b44d-d22b4d2ce8d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:42:17.420449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb642edc-74dd-46bb-b44d-d22b4d2ce8d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:17.422075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb642edc-74dd-46bb-b44d-d22b4d2ce8d1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:17.440896 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1379/2786] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:42:17.441986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb642edc-74dd-46bb-b44d-d22b4d2ce8d1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:17.455470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb642edc-74dd-46bb-b44d-d22b4d2ce8d1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:17.462492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00225f5-76c7-4db6-887a-d30122de1a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:17.467407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00225f5-76c7-4db6-887a-d30122de1a3d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:17.468720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00225f5-76c7-4db6-887a-d30122de1a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:17.469138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00225f5-76c7-4db6-887a-d30122de1a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:17.469958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00225f5-76c7-4db6-887a-d30122de1a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:17.472025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00225f5-76c7-4db6-887a-d30122de1a3d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:17.545142 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1408/2787] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:42:17 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:42:17.546896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6b33b-f434-4cb6-b100-682ff9e1aca2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:17.548196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6fb6b33b-f434-4cb6-b100-682ff9e1aca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:17.648185 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1380/2788] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:42:17 2022] POST /identity/v3/projects => generated 413 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:42:17.648185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00225f5-76c7-4db6-887a-d30122de1a3d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:17.648671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6b33b-f434-4cb6-b100-682ff9e1aca2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:17.773072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00225f5-76c7-4db6-887a-d30122de1a3d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:17.780003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a6eea-fb88-4d4a-807e-09f61207c90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:17.780947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a6eea-fb88-4d4a-807e-09f61207c90c admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:17.781450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a6eea-fb88-4d4a-807e-09f61207c90c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:17.781862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a6eea-fb88-4d4a-807e-09f61207c90c admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:17.782578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a6eea-fb88-4d4a-807e-09f61207c90c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:17.783359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:17.784089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:17.784972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a6eea-fb88-4d4a-807e-09f61207c90c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:17.785345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:17.785692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7 admin admin] PATH_INFO: `/v3/projects/36e20864d1964d7b8110ad48ba654711` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:17.790799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e20864d1964d7b8110ad48ba654711)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:17.793990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:17.957756 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1381/2789] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:42:17 2022] POST /identity/v3/users => generated 293 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:42:17.969251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a6eea-fb88-4d4a-807e-09f61207c90c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:17.981440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a6eea-fb88-4d4a-807e-09f61207c90c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:17.988753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd1f6a-a384-4338-9586-d77d2f6e23a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:17.991841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd1f6a-a384-4338-9586-d77d2f6e23a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:17.991841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd1f6a-a384-4338-9586-d77d2f6e23a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:17.991841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd1f6a-a384-4338-9586-d77d2f6e23a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:17.991841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd1f6a-a384-4338-9586-d77d2f6e23a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:17.994195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd1f6a-a384-4338-9586-d77d2f6e23a6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:18.020001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e20864d1964d7b8110ad48ba654711', 'request_id': 'req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:18.030121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e20864d1964d7b8110ad48ba654711', 'request_id': 'req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:18.108257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e20864d1964d7b8110ad48ba654711', 'request_id': 'req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:18.111597 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1382/2790] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:42:17 2022] POST /identity/v3/users => generated 307 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:42:18.116512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd1f6a-a384-4338-9586-d77d2f6e23a6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:18.122413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7 admin admin] The token cache is being invalidate because project 36e20864d1964d7b8110ad48ba654711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:42:18.124235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:18.125429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:18.128157 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1409/2791] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:17 2022] DELETE /identity/v3/projects/36e20864d1964d7b8110ad48ba654711 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:18.129559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:18.131526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:18.150993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd1f6a-a384-4338-9586-d77d2f6e23a6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:18.218778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75e3ed-2a2e-4d31-8c3a-9136662b19f7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:18.225709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be69a5-24a1-430b-b713-96484e3aa099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:18.227476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be69a5-24a1-430b-b713-96484e3aa099 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:18.228105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be69a5-24a1-430b-b713-96484e3aa099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:18.228559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be69a5-24a1-430b-b713-96484e3aa099 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:18.229469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be69a5-24a1-430b-b713-96484e3aa099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:18.231805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be69a5-24a1-430b-b713-96484e3aa099 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:18.246657 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1410/2792] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:42:18.249765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c822e66-ba97-4ff2-94b4-6a9d50a97b18 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:18.250311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c822e66-ba97-4ff2-94b4-6a9d50a97b18 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:18.251420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c822e66-ba97-4ff2-94b4-6a9d50a97b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:18.279585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0c822e66-ba97-4ff2-94b4-6a9d50a97b18 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:18.281381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0c822e66-ba97-4ff2-94b4-6a9d50a97b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:18.296208 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1411/2793] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:18.297558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c822e66-ba97-4ff2-94b4-6a9d50a97b18 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:18.299159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2f7eb-42bf-43e6-bae4-2dfe813754e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:18.299788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f7eb-42bf-43e6-bae4-2dfe813754e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:18.300072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f7eb-42bf-43e6-bae4-2dfe813754e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:18.300446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f7eb-42bf-43e6-bae4-2dfe813754e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:18.301157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2f7eb-42bf-43e6-bae4-2dfe813754e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:18.305799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2f7eb-42bf-43e6-bae4-2dfe813754e6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:18.311360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c822e66-ba97-4ff2-94b4-6a9d50a97b18 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:18.319010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2e699-17e8-4e20-81ee-df4cffe557fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:18.319010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2e699-17e8-4e20-81ee-df4cffe557fd admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:18.319010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2e699-17e8-4e20-81ee-df4cffe557fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:18.319010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2e699-17e8-4e20-81ee-df4cffe557fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:18.319509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2e699-17e8-4e20-81ee-df4cffe557fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:18.321434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2e699-17e8-4e20-81ee-df4cffe557fd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:18.332819 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1383/2794] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:42:18.344224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3399d4-ee98-450b-8495-52ba2b4206b6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:18.344224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3399d4-ee98-450b-8495-52ba2b4206b6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:18.344489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3399d4-ee98-450b-8495-52ba2b4206b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:18.358056 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1412/2795] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:42:18.361988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2e699-17e8-4e20-81ee-df4cffe557fd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:18.399432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1a3399d4-ee98-450b-8495-52ba2b4206b6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:18.399593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d2c2e699-17e8-4e20-81ee-df4cffe557fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:18.404451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1a3399d4-ee98-450b-8495-52ba2b4206b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:18.432300 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1384/2796] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:18.433966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3399d4-ee98-450b-8495-52ba2b4206b6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:18.467051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2e699-17e8-4e20-81ee-df4cffe557fd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:18.490130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3399d4-ee98-450b-8495-52ba2b4206b6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:18.491636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e326e-aaf7-454c-88a2-c78772018a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:18.492849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e326e-aaf7-454c-88a2-c78772018a7a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:18.493134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e326e-aaf7-454c-88a2-c78772018a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:18.493419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e326e-aaf7-454c-88a2-c78772018a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:18.494077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e326e-aaf7-454c-88a2-c78772018a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:18.495797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e326e-aaf7-454c-88a2-c78772018a7a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:18.511438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332f624-1935-4464-baa7-e7a1bf8dc2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:18.511438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332f624-1935-4464-baa7-e7a1bf8dc2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:18.511438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332f624-1935-4464-baa7-e7a1bf8dc2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:18.511438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332f624-1935-4464-baa7-e7a1bf8dc2ca admin admin] PATH_INFO: `/v3/projects/d0b2fd77da7144c9ad5b4246be5f5cfc/users/98e0b9c7adff4237aa67bbf1b7c79d2e/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:18.518838 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1413/2797] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:42:18.519714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e326e-aaf7-454c-88a2-c78772018a7a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:18.536011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e326e-aaf7-454c-88a2-c78772018a7a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:18.546922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ee246-5055-468b-860c-3c941126992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:18.547873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ee246-5055-468b-860c-3c941126992d admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:18.548327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ee246-5055-468b-860c-3c941126992d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:18.548773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ee246-5055-468b-860c-3c941126992d admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:18.549608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ee246-5055-468b-860c-3c941126992d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:42:18.550009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ee246-5055-468b-860c-3c941126992d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:18.551941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ee246-5055-468b-860c-3c941126992d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:18.567560 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1414/2798] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:42:18.570141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ee246-5055-468b-860c-3c941126992d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:18.573760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332f624-1935-4464-baa7-e7a1bf8dc2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b2fd77da7144c9ad5b4246be5f5cfc, user_id=98e0b9c7adff4237aa67bbf1b7c79d2e, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:18.580720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332f624-1935-4464-baa7-e7a1bf8dc2ca admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:18.582297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ee246-5055-468b-860c-3c941126992d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:18.588953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de317f08-892c-4550-b6f0-ad955f0a7cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:18.589856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de317f08-892c-4550-b6f0-ad955f0a7cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:18.590453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de317f08-892c-4550-b6f0-ad955f0a7cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:18.590925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de317f08-892c-4550-b6f0-ad955f0a7cd4 admin admin] PATH_INFO: `/v3/projects/541b6d193f8247b9bc8a50cf6aa64c2c/users/6822cb5afa6948858fa10c47e10ccda6/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:18.610626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de317f08-892c-4550-b6f0-ad955f0a7cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=541b6d193f8247b9bc8a50cf6aa64c2c, user_id=6822cb5afa6948858fa10c47e10ccda6, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:18.616734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de317f08-892c-4550-b6f0-ad955f0a7cd4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:18.696404 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1385/2799] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:42:18 2022] PUT /identity/v3/projects/d0b2fd77da7144c9ad5b4246be5f5cfc/users/98e0b9c7adff4237aa67bbf1b7c79d2e/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:18.701768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332f624-1935-4464-baa7-e7a1bf8dc2ca admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:18.757089 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1415/2800] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:42:18 2022] PUT /identity/v3/projects/541b6d193f8247b9bc8a50cf6aa64c2c/users/6822cb5afa6948858fa10c47e10ccda6/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:18.780583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43db4bb-df96-464e-82b2-a64a0368eecd None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:18.780583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43db4bb-df96-464e-82b2-a64a0368eecd None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:18.780583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43db4bb-df96-464e-82b2-a64a0368eecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:18.812714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e43db4bb-df96-464e-82b2-a64a0368eecd None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:18.815183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e43db4bb-df96-464e-82b2-a64a0368eecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:18.863039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332f624-1935-4464-baa7-e7a1bf8dc2ca admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:18.914780 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1416/2801] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:18.921145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f2227-e19c-4855-a6e3-e4eb400b232d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:18.921493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f2227-e19c-4855-a6e3-e4eb400b232d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:18.921870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f2227-e19c-4855-a6e3-e4eb400b232d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:18.974886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3b7f2227-e19c-4855-a6e3-e4eb400b232d None None] MFA Rules not processed for user `6822cb5afa6948858fa10c47e10ccda6`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:18.976727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3b7f2227-e19c-4855-a6e3-e4eb400b232d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:18.991502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689748d9-c0b6-40ff-b9b2-9f34d4110235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:18.992126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689748d9-c0b6-40ff-b9b2-9f34d4110235 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:18.992452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689748d9-c0b6-40ff-b9b2-9f34d4110235 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:18.992725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689748d9-c0b6-40ff-b9b2-9f34d4110235 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:18.993369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689748d9-c0b6-40ff-b9b2-9f34d4110235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:18.997822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689748d9-c0b6-40ff-b9b2-9f34d4110235 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:19.064563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:19.076996 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1417/2802] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:19.078285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f2227-e19c-4855-a6e3-e4eb400b232d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:19.079748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3b7f2227-e19c-4855-a6e3-e4eb400b232d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:19.161053 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1386/2803] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:42:18 2022] POST /identity/v3/projects => generated 389 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:42:19.163151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689748d9-c0b6-40ff-b9b2-9f34d4110235 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:19.168491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-689748d9-c0b6-40ff-b9b2-9f34d4110235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:19.170701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f2227-e19c-4855-a6e3-e4eb400b232d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:19.262094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689748d9-c0b6-40ff-b9b2-9f34d4110235 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:19.267311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac2b60-ff8a-4c69-bdf8-c49baed016c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:19.268007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac2b60-ff8a-4c69-bdf8-c49baed016c1 service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:19.268386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac2b60-ff8a-4c69-bdf8-c49baed016c1 service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:19.268729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac2b60-ff8a-4c69-bdf8-c49baed016c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:19.282112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056a6bd-bf2e-419a-9347-21d37d1cb44b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:19.282839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056a6bd-bf2e-419a-9347-21d37d1cb44b service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:19.283184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056a6bd-bf2e-419a-9347-21d37d1cb44b service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:19.283537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056a6bd-bf2e-419a-9347-21d37d1cb44b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:19.343557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac2b60-ff8a-4c69-bdf8-c49baed016c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:19.345717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac2b60-ff8a-4c69-bdf8-c49baed016c1 service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:19.368864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056a6bd-bf2e-419a-9347-21d37d1cb44b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:19.370752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056a6bd-bf2e-419a-9347-21d37d1cb44b service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:19.373437 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1387/2804] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:42:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:19.377343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b954759-8b49-4e84-8901-802d38df4680 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:19.377640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b954759-8b49-4e84-8901-802d38df4680 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:19.377920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b954759-8b49-4e84-8901-802d38df4680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:19.384640 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1418/2805] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:19.385532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056a6bd-bf2e-419a-9347-21d37d1cb44b service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:19.394106 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-0b954759-8b49-4e84-8901-802d38df4680 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:42:19.394106 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:42:19.394106 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:42:19.394106 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:42:19.394106 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:42:19.394106 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:42:19.394106 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:42:19.394106 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:42:19.394106 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:42:19.394106 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:42:19.394106 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:42:19.394106 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:42:19.394106 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:42:19.395138 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:42:19.395138 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:42:19.395138 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:42:19.395138 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:42:19.395138 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:42:19.395138 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:42:19.395138 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:42:19.395138 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:42:19.395138 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:42:19.395138 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:42:19.395138 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:42:19.395138 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:42:19.395138 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:42:19.395138 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:42:19.395138 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:42:19.396293 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1388/2806] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:42:19 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 22 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:42:19.432152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056a6bd-bf2e-419a-9347-21d37d1cb44b service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:19.443074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39174834-ed37-4cf3-b46c-279e2ae814bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:19.456514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39174834-ed37-4cf3-b46c-279e2ae814bd admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:19.456514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39174834-ed37-4cf3-b46c-279e2ae814bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:19.456514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39174834-ed37-4cf3-b46c-279e2ae814bd admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:19.456514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39174834-ed37-4cf3-b46c-279e2ae814bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:19.457494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39174834-ed37-4cf3-b46c-279e2ae814bd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:19.501757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f03f6a-c1ff-4611-bc5b-3383020a99e3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:19.502033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f03f6a-c1ff-4611-bc5b-3383020a99e3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:19.502303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f03f6a-c1ff-4611-bc5b-3383020a99e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:19.526838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-13f03f6a-c1ff-4611-bc5b-3383020a99e3 None None] MFA Rules not processed for user `4f4affe28e084a7eb873d9a1f0f79fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:19.529378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-13f03f6a-c1ff-4611-bc5b-3383020a99e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:19.636386 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1419/2807] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:42:19 2022] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:42:19.647705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39174834-ed37-4cf3-b46c-279e2ae814bd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:19.665720 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1389/2808] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:42:19.676998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39174834-ed37-4cf3-b46c-279e2ae814bd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:19.700694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2691aae-d477-4cbe-af66-70be4d86a3f9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:19.701838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2691aae-d477-4cbe-af66-70be4d86a3f9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:19.702924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2691aae-d477-4cbe-af66-70be4d86a3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:19.718045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998af1e4-b290-46c7-8909-814c8fb6dfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:19.720286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998af1e4-b290-46c7-8909-814c8fb6dfb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:19.722362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998af1e4-b290-46c7-8909-814c8fb6dfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:19.722362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998af1e4-b290-46c7-8909-814c8fb6dfb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:19.722362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998af1e4-b290-46c7-8909-814c8fb6dfb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:19.729044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998af1e4-b290-46c7-8909-814c8fb6dfb6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:19.746519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f2691aae-d477-4cbe-af66-70be4d86a3f9 None None] MFA Rules not processed for user `c0493ef2484140f69c1817efaaa51f98`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:19.748984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f2691aae-d477-4cbe-af66-70be4d86a3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:19.751864 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1420/2809] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:42:19.757188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998af1e4-b290-46c7-8909-814c8fb6dfb6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:19.779330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998af1e4-b290-46c7-8909-814c8fb6dfb6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:19.796194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beca5d0-ccfb-4d01-8a91-9b652fb04dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:19.797359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beca5d0-ccfb-4d01-8a91-9b652fb04dfd admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:19.797520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beca5d0-ccfb-4d01-8a91-9b652fb04dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:19.797729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beca5d0-ccfb-4d01-8a91-9b652fb04dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:19.798429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beca5d0-ccfb-4d01-8a91-9b652fb04dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:19.800252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beca5d0-ccfb-4d01-8a91-9b652fb04dfd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:19.826415 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1421/2810] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:42:19.830526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beca5d0-ccfb-4d01-8a91-9b652fb04dfd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:19.853210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beca5d0-ccfb-4d01-8a91-9b652fb04dfd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:19.859919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbe89f-eb47-4a4d-833d-0d0cd81113ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:19.860634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbe89f-eb47-4a4d-833d-0d0cd81113ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:19.860914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbe89f-eb47-4a4d-833d-0d0cd81113ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:19.861191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbe89f-eb47-4a4d-833d-0d0cd81113ed admin admin] PATH_INFO: `/v3/projects/7b1f727e0ec54ec1afa8f14d5d17152c/users/a99963f0b57247d990ba02d4bc3e55e3/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:19.876025 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1390/2811] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:19.883414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbe89f-eb47-4a4d-833d-0d0cd81113ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b1f727e0ec54ec1afa8f14d5d17152c, user_id=a99963f0b57247d990ba02d4bc3e55e3, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:19.887144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbe89f-eb47-4a4d-833d-0d0cd81113ed admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:19.996753 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1422/2812] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:42:19 2022] PUT /identity/v3/projects/7b1f727e0ec54ec1afa8f14d5d17152c/users/a99963f0b57247d990ba02d4bc3e55e3/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:20.003549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd908f-1cfa-4cb9-9a33-0b02e4f2f6f6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:20.003828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd908f-1cfa-4cb9-9a33-0b02e4f2f6f6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:20.004147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd908f-1cfa-4cb9-9a33-0b02e4f2f6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:20.027639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-48dd908f-1cfa-4cb9-9a33-0b02e4f2f6f6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:20.029347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-48dd908f-1cfa-4cb9-9a33-0b02e4f2f6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:20.113482 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1391/2813] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:20.133229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbe89f-eb47-4a4d-833d-0d0cd81113ed admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:20.136988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d8dbe89f-eb47-4a4d-833d-0d0cd81113ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:20.221182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbe89f-eb47-4a4d-833d-0d0cd81113ed admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:20.225432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d0a43-fe9a-4e8b-8c45-b19adbbf52df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:20.226406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d0a43-fe9a-4e8b-8c45-b19adbbf52df service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:20.226876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d0a43-fe9a-4e8b-8c45-b19adbbf52df service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:20.227486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d0a43-fe9a-4e8b-8c45-b19adbbf52df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:20.243982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d0a43-fe9a-4e8b-8c45-b19adbbf52df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:20.245592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d0a43-fe9a-4e8b-8c45-b19adbbf52df service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:20.268462 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1423/2814] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:20.290059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:20.985343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7a4f0-36e1-45a7-9ec9-6880cf0fa084 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:20.985343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7a4f0-36e1-45a7-9ec9-6880cf0fa084 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:20.985343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7a4f0-36e1-45a7-9ec9-6880cf0fa084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:21.071435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-11e7a4f0-36e1-45a7-9ec9-6880cf0fa084 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:21.080296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-11e7a4f0-36e1-45a7-9ec9-6880cf0fa084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:21.287673 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1392/2815] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:42:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:42:21.313693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d0a43-fe9a-4e8b-8c45-b19adbbf52df service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:21.317323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-682d0a43-fe9a-4e8b-8c45-b19adbbf52df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:21.477579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d0a43-fe9a-4e8b-8c45-b19adbbf52df service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:21.485021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227c55f-beea-4de6-b1c4-e04dad43f46d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:21.505635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227c55f-beea-4de6-b1c4-e04dad43f46d service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:21.507801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227c55f-beea-4de6-b1c4-e04dad43f46d service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:21.508302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227c55f-beea-4de6-b1c4-e04dad43f46d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:21.554073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227c55f-beea-4de6-b1c4-e04dad43f46d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:21.558032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227c55f-beea-4de6-b1c4-e04dad43f46d service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:21.599021 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1424/2816] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:42:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:42:21.763366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7a4f0-36e1-45a7-9ec9-6880cf0fa084 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:21.766519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-11e7a4f0-36e1-45a7-9ec9-6880cf0fa084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:21.942809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7a4f0-36e1-45a7-9ec9-6880cf0fa084 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:21.952117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0676d8-acf6-4413-939e-3e39156bc642 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:21.953133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0676d8-acf6-4413-939e-3e39156bc642 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:21.953416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0676d8-acf6-4413-939e-3e39156bc642 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:21.953693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0676d8-acf6-4413-939e-3e39156bc642 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:21.955652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2d0676d8-acf6-4413-939e-3e39156bc642 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:22.043668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0676d8-acf6-4413-939e-3e39156bc642 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:22.045870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0676d8-acf6-4413-939e-3e39156bc642 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:22.057254 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1393/2817] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:42:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:22.215213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eae15-66c7-4ddc-8541-fc21961aa5ca None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:22.215770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eae15-66c7-4ddc-8541-fc21961aa5ca None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:22.216115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eae15-66c7-4ddc-8541-fc21961aa5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:22.226707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-b14eae15-66c7-4ddc-8541-fc21961aa5ca None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:42:22.226707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:42:22.226707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:42:22.226707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:42:22.226707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:42:22.226707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:42:22.226707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:42:22.226707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:42:22.226707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:42:22.226707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:42:22.226707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:42:22.226707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:42:22.226707 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:42:22.227923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:42:22.227923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:42:22.227923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:42:22.227923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:42:22.227923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:42:22.227923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:42:22.227923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:42:22.227923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:42:22.227923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:42:22.227923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:42:22.227923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:42:22.227923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:42:22.227923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:42:22.227923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:42:22.227923 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:42:22.229708 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1425/2818] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:42:22 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 15 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:42:22.288764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28658e-00b8-4372-b599-74a6cd583878 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:22.294323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28658e-00b8-4372-b599-74a6cd583878 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:22.294323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28658e-00b8-4372-b599-74a6cd583878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:22.331267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4e28658e-00b8-4372-b599-74a6cd583878 None None] MFA Rules not processed for user `d1f1f8e372994677b491a2d2f9a74bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:22.336409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4e28658e-00b8-4372-b599-74a6cd583878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:22.372245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:22.499156 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1394/2819] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:22.994399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf666f0-0f81-4d7a-bf7c-f5fce1c0a75b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:22.994862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf666f0-0f81-4d7a-bf7c-f5fce1c0a75b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:22.995288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf666f0-0f81-4d7a-bf7c-f5fce1c0a75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:23.035731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-adf666f0-0f81-4d7a-bf7c-f5fce1c0a75b None None] MFA Rules not processed for user `f40a67254cfd47e2b7822d1359ce408f`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:23.039964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-adf666f0-0f81-4d7a-bf7c-f5fce1c0a75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:23.149973 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1426/2820] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:23.629680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f179e-e71e-403c-83f3-43a3cf0d676b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:23.630529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f179e-e71e-403c-83f3-43a3cf0d676b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:23.630974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f179e-e71e-403c-83f3-43a3cf0d676b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:23.637797 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-362f179e-e71e-403c-83f3-43a3cf0d676b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:42:23.637797 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:42:23.637797 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:42:23.637797 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:42:23.637797 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:42:23.637797 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:42:23.637797 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:42:23.637797 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:42:23.637797 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:42:23.637797 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:42:23.637797 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:42:23.637797 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:42:23.637797 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:42:23.639930 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:42:23.639930 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:42:23.639930 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:42:23.639930 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:42:23.639930 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:42:23.639930 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:42:23.639930 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:42:23.639930 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:42:23.639930 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:42:23.639930 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:42:23.639930 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:42:23.639930 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:42:23.639930 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:42:23.639930 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:42:23.639930 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:42:23.669822 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1395/2821] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:42:23 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 28 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:42:23.901845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e0cf2-1059-4bad-95eb-2ee628b50a51 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:23.902839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e0cf2-1059-4bad-95eb-2ee628b50a51 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:23.903320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e0cf2-1059-4bad-95eb-2ee628b50a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:23.936209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4d0e0cf2-1059-4bad-95eb-2ee628b50a51 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:23.947792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4d0e0cf2-1059-4bad-95eb-2ee628b50a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:23.990851 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1427/2822] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:42:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:24.015004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f179e-e71e-403c-83f3-43a3cf0d676b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:24.044139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:24.046533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f179e-e71e-403c-83f3-43a3cf0d676b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:24.056800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c29505-c56c-4b80-a476-4a9d3876998e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:24.058587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c29505-c56c-4b80-a476-4a9d3876998e service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:24.059088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c29505-c56c-4b80-a476-4a9d3876998e service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:24.059558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c29505-c56c-4b80-a476-4a9d3876998e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:24.077490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c29505-c56c-4b80-a476-4a9d3876998e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:24.080091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c29505-c56c-4b80-a476-4a9d3876998e service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:24.095284 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1396/2823] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:42:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:42:24.914587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:26.470198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fe47c-fcf1-48c7-bd77-4a911a09fbae None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:26.470813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fe47c-fcf1-48c7-bd77-4a911a09fbae None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:26.480820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fe47c-fcf1-48c7-bd77-4a911a09fbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:26.569423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bd8fe47c-fcf1-48c7-bd77-4a911a09fbae None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:26.571120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bd8fe47c-fcf1-48c7-bd77-4a911a09fbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:26.602379 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1428/2824] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:42:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:26.633115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c29505-c56c-4b80-a476-4a9d3876998e service swift] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:26.652603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c29505-c56c-4b80-a476-4a9d3876998e service swift] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:26.671901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4311f-1a75-4c24-8e4c-f76722b060c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:26.674076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4311f-1a75-4c24-8e4c-f76722b060c1 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:26.674366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4311f-1a75-4c24-8e4c-f76722b060c1 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:26.674642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4311f-1a75-4c24-8e4c-f76722b060c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:26.687298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4311f-1a75-4c24-8e4c-f76722b060c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:26.689431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4311f-1a75-4c24-8e4c-f76722b060c1 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:26.698704 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1397/2825] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:42:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:42:27.398057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164ce6b-8299-47bb-ac33-94460a6b275f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:27.398321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164ce6b-8299-47bb-ac33-94460a6b275f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:27.399994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164ce6b-8299-47bb-ac33-94460a6b275f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:27.445718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b164ce6b-8299-47bb-ac33-94460a6b275f None None] MFA Rules not processed for user `6822cb5afa6948858fa10c47e10ccda6`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:27.447097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b164ce6b-8299-47bb-ac33-94460a6b275f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:27.559901 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1429/2826] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:28.189314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=8 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:28.230677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a156c7-2e9a-48f3-8c67-e62bb63da497 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:28.231236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a156c7-2e9a-48f3-8c67-e62bb63da497 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:28.231680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a156c7-2e9a-48f3-8c67-e62bb63da497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:28.283481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a9a156c7-2e9a-48f3-8c67-e62bb63da497 None None] MFA Rules not processed for user `6822cb5afa6948858fa10c47e10ccda6`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:28.287228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a9a156c7-2e9a-48f3-8c67-e62bb63da497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:28.341082 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1398/2827] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:28.943868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:30.778272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:33.854835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:36.915032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:38.040099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:39.361072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe94022-40a5-405e-aa13-db36d81ef302 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:39.362698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe94022-40a5-405e-aa13-db36d81ef302 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:39.363208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe94022-40a5-405e-aa13-db36d81ef302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:39.447219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4fe94022-40a5-405e-aa13-db36d81ef302 None None] MFA Rules not processed for user `a99963f0b57247d990ba02d4bc3e55e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:39.450347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4fe94022-40a5-405e-aa13-db36d81ef302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:39.608085 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1430/2828] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:39.666273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a156c7-2e9a-48f3-8c67-e62bb63da497 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:39.680612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a156c7-2e9a-48f3-8c67-e62bb63da497 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:39.688861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371d321-ba6f-4461-8d43-54a3e0b914f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:39.689692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371d321-ba6f-4461-8d43-54a3e0b914f1 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:39.689967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371d321-ba6f-4461-8d43-54a3e0b914f1 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:39.690251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371d321-ba6f-4461-8d43-54a3e0b914f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:39.700910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371d321-ba6f-4461-8d43-54a3e0b914f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:39.702770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371d321-ba6f-4461-8d43-54a3e0b914f1 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:39.724314 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1399/2829] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:42:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:40.065404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe94022-40a5-405e-aa13-db36d81ef302 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:40.067408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4fe94022-40a5-405e-aa13-db36d81ef302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:40.103217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe94022-40a5-405e-aa13-db36d81ef302 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:40.118477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd67e86-00df-410b-bb62-ba67711b126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:40.119202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd67e86-00df-410b-bb62-ba67711b126e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:40.119619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd67e86-00df-410b-bb62-ba67711b126e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:40.119948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd67e86-00df-410b-bb62-ba67711b126e admin admin] PATH_INFO: `/v3/users/eab4fe38f4aa4180b5b4ea27fb01b06b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:40.123089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd67e86-00df-410b-bb62-ba67711b126e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab4fe38f4aa4180b5b4ea27fb01b06b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:40.136538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd67e86-00df-410b-bb62-ba67711b126e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:40.180185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c5d31-d057-4013-903a-96f3c82d6929 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:40.180907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c5d31-d057-4013-903a-96f3c82d6929 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:40.181456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c5d31-d057-4013-903a-96f3c82d6929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:40.189846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:40.285326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-435c5d31-d057-4013-903a-96f3c82d6929 None None] MFA Rules not processed for user `98e0b9c7adff4237aa67bbf1b7c79d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:40.286800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-435c5d31-d057-4013-903a-96f3c82d6929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:40.441315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7fd67e86-00df-410b-bb62-ba67711b126e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab4fe38f4aa4180b5b4ea27fb01b06b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:40.442705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7fd67e86-00df-410b-bb62-ba67711b126e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab4fe38f4aa4180b5b4ea27fb01b06b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:40.477571 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1400/2830] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:40 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:40.478575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c5d31-d057-4013-903a-96f3c82d6929 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:40.488505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-435c5d31-d057-4013-903a-96f3c82d6929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:40.511320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c5d31-d057-4013-903a-96f3c82d6929 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:40.517449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cb282-48fc-488a-90fb-199900366f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:40.518401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cb282-48fc-488a-90fb-199900366f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:40.518867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cb282-48fc-488a-90fb-199900366f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:40.519323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cb282-48fc-488a-90fb-199900366f6d admin admin] PATH_INFO: `/v3/users/f40a67254cfd47e2b7822d1359ce408f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:40.521131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cb282-48fc-488a-90fb-199900366f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f40a67254cfd47e2b7822d1359ce408f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:40.523649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cb282-48fc-488a-90fb-199900366f6d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:40.532369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7fd67e86-00df-410b-bb62-ba67711b126e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab4fe38f4aa4180b5b4ea27fb01b06b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:40.533310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7fd67e86-00df-410b-bb62-ba67711b126e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab4fe38f4aa4180b5b4ea27fb01b06b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:40.558561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7fd67e86-00df-410b-bb62-ba67711b126e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab4fe38f4aa4180b5b4ea27fb01b06b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:40.585920 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1431/2831] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:42:40 2022] DELETE /identity/v3/users/eab4fe38f4aa4180b5b4ea27fb01b06b => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:40.587879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f143a-5b00-4f96-a570-2e4efbc2f525 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:40.588389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f143a-5b00-4f96-a570-2e4efbc2f525 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:40.588955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f143a-5b00-4f96-a570-2e4efbc2f525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:40.621486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bd9f143a-5b00-4f96-a570-2e4efbc2f525 None None] MFA Rules not processed for user `98e0b9c7adff4237aa67bbf1b7c79d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:40.624781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bd9f143a-5b00-4f96-a570-2e4efbc2f525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:40.770945 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1432/2832] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:40 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:40.860324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:40.870127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-934cb282-48fc-488a-90fb-199900366f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f40a67254cfd47e2b7822d1359ce408f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:41.019498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-934cb282-48fc-488a-90fb-199900366f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f40a67254cfd47e2b7822d1359ce408f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:41.020540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-934cb282-48fc-488a-90fb-199900366f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f40a67254cfd47e2b7822d1359ce408f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:41.045296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-934cb282-48fc-488a-90fb-199900366f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f40a67254cfd47e2b7822d1359ce408f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:41.066706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-934cb282-48fc-488a-90fb-199900366f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f40a67254cfd47e2b7822d1359ce408f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:41.081141 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1401/2833] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:42:40 2022] DELETE /identity/v3/users/f40a67254cfd47e2b7822d1359ce408f => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:41.330644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f143a-5b00-4f96-a570-2e4efbc2f525 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:41.341362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bd9f143a-5b00-4f96-a570-2e4efbc2f525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:41.509838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f143a-5b00-4f96-a570-2e4efbc2f525 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:41.922041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d95ed-9b33-47c0-8850-57be215fea67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:41.922041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d95ed-9b33-47c0-8850-57be215fea67 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:41.922041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d95ed-9b33-47c0-8850-57be215fea67 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:41.922041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d95ed-9b33-47c0-8850-57be215fea67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:41.927385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-578d95ed-9b33-47c0-8850-57be215fea67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:41.927385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d95ed-9b33-47c0-8850-57be215fea67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:41.927385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d95ed-9b33-47c0-8850-57be215fea67 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:41.927385 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1433/2834] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:42:41 2022] GET /identity/v3/auth/tokens => generated 3290 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:42.099602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd248f-e816-4789-90e1-9b5f82295c9e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:42.100137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd248f-e816-4789-90e1-9b5f82295c9e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:42.104307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd248f-e816-4789-90e1-9b5f82295c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:42.108439 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-b3cd248f-e816-4789-90e1-9b5f82295c9e None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:42:42.108439 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:42:42.108439 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:42:42.108439 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:42:42.108439 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:42:42.108439 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:42:42.108439 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:42:42.108439 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:42:42.108439 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:42:42.108439 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:42:42.108439 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:42:42.108439 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:42:42.108439 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:42:42.109632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:42:42.109632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:42:42.109632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:42:42.109632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:42:42.109632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:42:42.109632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:42:42.109632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:42:42.109632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:42:42.109632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:42:42.109632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:42:42.109632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:42:42.109632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:42:42.109632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:42:42.109632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:42:42.109632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:42:42.142887 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1402/2835] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:42:42 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 35 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:42:42.147626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d95ed-9b33-47c0-8850-57be215fea67 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:42.147626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-578d95ed-9b33-47c0-8850-57be215fea67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:42.148607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd248f-e816-4789-90e1-9b5f82295c9e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:42.150297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b3cd248f-e816-4789-90e1-9b5f82295c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:42.316784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd248f-e816-4789-90e1-9b5f82295c9e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:42.338742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d95ed-9b33-47c0-8850-57be215fea67 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:42.345058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5315045-48a6-43c5-8d51-aad29507ddd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:42.345847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5315045-48a6-43c5-8d51-aad29507ddd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:42.347303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5315045-48a6-43c5-8d51-aad29507ddd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:42.348614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5315045-48a6-43c5-8d51-aad29507ddd0 admin admin] PATH_INFO: `/v3/projects/4a75c85087244b31b3ed8b1908c8ade5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:42.354111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5315045-48a6-43c5-8d51-aad29507ddd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a75c85087244b31b3ed8b1908c8ade5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:42.354949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:42.354949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:42.355261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:42.355447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54 admin admin] PATH_INFO: `/v3/projects/58b3dd9918d0412a9441e5b405948450` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:42.360870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5315045-48a6-43c5-8d51-aad29507ddd0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:42.361017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b3dd9918d0412a9441e5b405948450)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:42.363347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:42.569069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d5315045-48a6-43c5-8d51-aad29507ddd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a75c85087244b31b3ed8b1908c8ade5', 'request_id': 'req-d5315045-48a6-43c5-8d51-aad29507ddd0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:42.585154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d5315045-48a6-43c5-8d51-aad29507ddd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a75c85087244b31b3ed8b1908c8ade5', 'request_id': 'req-d5315045-48a6-43c5-8d51-aad29507ddd0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:42.606003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d5315045-48a6-43c5-8d51-aad29507ddd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a75c85087244b31b3ed8b1908c8ade5', 'request_id': 'req-d5315045-48a6-43c5-8d51-aad29507ddd0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:42.635555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b3dd9918d0412a9441e5b405948450', 'request_id': 'req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:42.660340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b3dd9918d0412a9441e5b405948450', 'request_id': 'req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:42.744147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d5315045-48a6-43c5-8d51-aad29507ddd0 admin admin] The token cache is being invalidate because project 4a75c85087244b31b3ed8b1908c8ade5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:42:42.744834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d5315045-48a6-43c5-8d51-aad29507ddd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:42.747903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d5315045-48a6-43c5-8d51-aad29507ddd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:42.753075 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1403/2836] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:42 2022] DELETE /identity/v3/projects/4a75c85087244b31b3ed8b1908c8ade5 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:42.779834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6973e16-fc79-4e28-8337-7728faaf4079 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:42.780440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6973e16-fc79-4e28-8337-7728faaf4079 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:42.782512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6973e16-fc79-4e28-8337-7728faaf4079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:42.821897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a6973e16-fc79-4e28-8337-7728faaf4079 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:42.827810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a6973e16-fc79-4e28-8337-7728faaf4079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:42.870938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b3dd9918d0412a9441e5b405948450', 'request_id': 'req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:42.894529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54 admin admin] The token cache is being invalidate because project 58b3dd9918d0412a9441e5b405948450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:42:42.897349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:42.899380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:42.908820 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1434/2837] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:42 2022] DELETE /identity/v3/projects/58b3dd9918d0412a9441e5b405948450 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:42.913735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:42.931354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:42.981357 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1404/2838] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:42.984520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed49ff5-13e5-47f8-bbdc-fb4581528983 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:42.985089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed49ff5-13e5-47f8-bbdc-fb4581528983 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:42.993163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed49ff5-13e5-47f8-bbdc-fb4581528983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:43.073491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-aed49ff5-13e5-47f8-bbdc-fb4581528983 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:43.078122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aed49ff5-13e5-47f8-bbdc-fb4581528983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:43.117342 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1405/2839] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:43.119380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed49ff5-13e5-47f8-bbdc-fb4581528983 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:43.137734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed49ff5-13e5-47f8-bbdc-fb4581528983 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:43.142182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5a9be-dfe4-4899-a961-6b7b636d2e54 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:43.144902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c76dd0-0824-46e3-8f7b-e25ac1296e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:43.145822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c76dd0-0824-46e3-8f7b-e25ac1296e0d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:43.146332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c76dd0-0824-46e3-8f7b-e25ac1296e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:43.148386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c76dd0-0824-46e3-8f7b-e25ac1296e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:43.149298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c76dd0-0824-46e3-8f7b-e25ac1296e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:42:43.149863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c76dd0-0824-46e3-8f7b-e25ac1296e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:43.152183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c76dd0-0824-46e3-8f7b-e25ac1296e0d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:43.157792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3e3c5-70c9-4e10-a36a-ff544161618c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:43.158387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3e3c5-70c9-4e10-a36a-ff544161618c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:43.158664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3e3c5-70c9-4e10-a36a-ff544161618c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:43.158929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3e3c5-70c9-4e10-a36a-ff544161618c admin admin] PATH_INFO: `/v3/users/ff2da905c9c944f9ae470e2ad3bbd64a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:43.160839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3e3c5-70c9-4e10-a36a-ff544161618c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff2da905c9c944f9ae470e2ad3bbd64a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:43.167243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3e3c5-70c9-4e10-a36a-ff544161618c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:43.176787 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1406/2840] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:42:43.178186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c76dd0-0824-46e3-8f7b-e25ac1296e0d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:43.195244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c76dd0-0824-46e3-8f7b-e25ac1296e0d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:43.205630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4ce3c-9d5a-43e4-8a65-5a3e7003b919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:43.207263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4ce3c-9d5a-43e4-8a65-5a3e7003b919 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:43.208454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4ce3c-9d5a-43e4-8a65-5a3e7003b919 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:43.208992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4ce3c-9d5a-43e4-8a65-5a3e7003b919 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:43.211359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4ce3c-9d5a-43e4-8a65-5a3e7003b919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:43.215385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4ce3c-9d5a-43e4-8a65-5a3e7003b919 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:43.355031 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1407/2841] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:42:43 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:42:43.360259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4ce3c-9d5a-43e4-8a65-5a3e7003b919 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:43.442178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-86d3e3c5-70c9-4e10-a36a-ff544161618c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff2da905c9c944f9ae470e2ad3bbd64a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:43.445543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-86d3e3c5-70c9-4e10-a36a-ff544161618c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff2da905c9c944f9ae470e2ad3bbd64a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:43.510868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4ce3c-9d5a-43e4-8a65-5a3e7003b919 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:43.517750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3af11-a922-4872-ba71-df067f21def4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:43.518713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3af11-a922-4872-ba71-df067f21def4 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:43.519157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3af11-a922-4872-ba71-df067f21def4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:43.519589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3af11-a922-4872-ba71-df067f21def4 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:43.520750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3af11-a922-4872-ba71-df067f21def4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:43.524384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3af11-a922-4872-ba71-df067f21def4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:43.573150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-86d3e3c5-70c9-4e10-a36a-ff544161618c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff2da905c9c944f9ae470e2ad3bbd64a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:43.573921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-86d3e3c5-70c9-4e10-a36a-ff544161618c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff2da905c9c944f9ae470e2ad3bbd64a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:43.603771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-86d3e3c5-70c9-4e10-a36a-ff544161618c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff2da905c9c944f9ae470e2ad3bbd64a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:43.636335 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1435/2842] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:42:42 2022] DELETE /identity/v3/users/ff2da905c9c944f9ae470e2ad3bbd64a => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:43.674329 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1408/2843] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:42:43 2022] POST /identity/v3/users => generated 287 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:42:43.678391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3e3c5-70c9-4e10-a36a-ff544161618c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:43.689813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-86d3e3c5-70c9-4e10-a36a-ff544161618c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:43.831352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:43.840066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3e3c5-70c9-4e10-a36a-ff544161618c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:43.842550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04b6ec-13d1-4079-b2b0-44ee54d37995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:43.843330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04b6ec-13d1-4079-b2b0-44ee54d37995 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:43.843978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04b6ec-13d1-4079-b2b0-44ee54d37995 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:43.844488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04b6ec-13d1-4079-b2b0-44ee54d37995 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:43.845282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04b6ec-13d1-4079-b2b0-44ee54d37995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:43.847098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04b6ec-13d1-4079-b2b0-44ee54d37995 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:43.863561 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1436/2844] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:42:43.869674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3af11-a922-4872-ba71-df067f21def4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:43.886836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3af11-a922-4872-ba71-df067f21def4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:43.901901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e140de1-d81a-491a-ad4d-94b05154ac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:43.904354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e140de1-d81a-491a-ad4d-94b05154ac7d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:43.907298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e140de1-d81a-491a-ad4d-94b05154ac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:43.907808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e140de1-d81a-491a-ad4d-94b05154ac7d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:43.908805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e140de1-d81a-491a-ad4d-94b05154ac7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:43.911270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e140de1-d81a-491a-ad4d-94b05154ac7d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:43.943616 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1409/2845] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:42:43.946657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04b6ec-13d1-4079-b2b0-44ee54d37995 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:43.960436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04b6ec-13d1-4079-b2b0-44ee54d37995 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:43.970617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a2dca-142e-409e-b3da-443955c409af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:43.971604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2dca-142e-409e-b3da-443955c409af admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:43.972137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2dca-142e-409e-b3da-443955c409af admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:43.972562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2dca-142e-409e-b3da-443955c409af admin admin] PATH_INFO: `/v3/projects/a5ccff4ddab04a47b292ccc5f5387e78/users/bb90f64664c74949ad58644bcbdafdfc/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:43.999937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:44.028539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a2dca-142e-409e-b3da-443955c409af admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ccff4ddab04a47b292ccc5f5387e78, user_id=bb90f64664c74949ad58644bcbdafdfc, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:44.032966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a2dca-142e-409e-b3da-443955c409af admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:44.122504 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1437/2846] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:42:43 2022] PUT /identity/v3/projects/a5ccff4ddab04a47b292ccc5f5387e78/users/bb90f64664c74949ad58644bcbdafdfc/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:44.127610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f639772-0b13-4b51-a0eb-554829434bd8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:44.128605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f639772-0b13-4b51-a0eb-554829434bd8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:44.128999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f639772-0b13-4b51-a0eb-554829434bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:44.151313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6f639772-0b13-4b51-a0eb-554829434bd8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:44.153693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6f639772-0b13-4b51-a0eb-554829434bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:44.239535 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1410/2847] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:42:44.291692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a2dca-142e-409e-b3da-443955c409af admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:44.294343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e07a2dca-142e-409e-b3da-443955c409af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:44.451061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a2dca-142e-409e-b3da-443955c409af admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:44.456702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee883d-555d-4946-95ab-a0ee6f104262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:44.458054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee883d-555d-4946-95ab-a0ee6f104262 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:44.458654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee883d-555d-4946-95ab-a0ee6f104262 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:44.459143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee883d-555d-4946-95ab-a0ee6f104262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:44.484288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee883d-555d-4946-95ab-a0ee6f104262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:44.484288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee883d-555d-4946-95ab-a0ee6f104262 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:44.491153 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1438/2848] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:42:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:45.364326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f639772-0b13-4b51-a0eb-554829434bd8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:45.364326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6f639772-0b13-4b51-a0eb-554829434bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:45.390318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f639772-0b13-4b51-a0eb-554829434bd8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:45.404750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd6abb-4750-4332-99d5-bbe7be39f37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:45.405820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd6abb-4750-4332-99d5-bbe7be39f37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:45.421621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd6abb-4750-4332-99d5-bbe7be39f37d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:45.421621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd6abb-4750-4332-99d5-bbe7be39f37d admin admin] PATH_INFO: `/v3/projects/f8e12ca98ca249628fc4edb3bc6a1675` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:45.421621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd6abb-4750-4332-99d5-bbe7be39f37d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8e12ca98ca249628fc4edb3bc6a1675)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:45.421621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd6abb-4750-4332-99d5-bbe7be39f37d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:45.666925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-01cd6abb-4750-4332-99d5-bbe7be39f37d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8e12ca98ca249628fc4edb3bc6a1675', 'request_id': 'req-01cd6abb-4750-4332-99d5-bbe7be39f37d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:45.679154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-01cd6abb-4750-4332-99d5-bbe7be39f37d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8e12ca98ca249628fc4edb3bc6a1675', 'request_id': 'req-01cd6abb-4750-4332-99d5-bbe7be39f37d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:45.706135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-01cd6abb-4750-4332-99d5-bbe7be39f37d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8e12ca98ca249628fc4edb3bc6a1675', 'request_id': 'req-01cd6abb-4750-4332-99d5-bbe7be39f37d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:45.844155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-01cd6abb-4750-4332-99d5-bbe7be39f37d admin admin] The token cache is being invalidate because project f8e12ca98ca249628fc4edb3bc6a1675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:42:45.844666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-01cd6abb-4750-4332-99d5-bbe7be39f37d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:45.847080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-01cd6abb-4750-4332-99d5-bbe7be39f37d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:45.850430 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1411/2849] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:45 2022] DELETE /identity/v3/projects/f8e12ca98ca249628fc4edb3bc6a1675 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:45.854393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a794e-e20b-48ea-b90b-5f23a5b80437 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:45.854912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a794e-e20b-48ea-b90b-5f23a5b80437 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:45.854912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a794e-e20b-48ea-b90b-5f23a5b80437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:45.906512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-767a794e-e20b-48ea-b90b-5f23a5b80437 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:45.909214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-767a794e-e20b-48ea-b90b-5f23a5b80437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:46.036279 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1439/2850] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:46.036560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a5f4a-8cf9-4630-a392-f1ec9bf26438 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:46.037058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a5f4a-8cf9-4630-a392-f1ec9bf26438 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:46.037635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a5f4a-8cf9-4630-a392-f1ec9bf26438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:46.116272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-377a5f4a-8cf9-4630-a392-f1ec9bf26438 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:46.117799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-377a5f4a-8cf9-4630-a392-f1ec9bf26438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:46.154885 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1412/2851] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:46.158201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a794e-e20b-48ea-b90b-5f23a5b80437 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:46.175995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a794e-e20b-48ea-b90b-5f23a5b80437 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:46.193433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c9d70-50b4-4ebd-8331-205dc280639f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:46.195553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c9d70-50b4-4ebd-8331-205dc280639f admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:46.195553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c9d70-50b4-4ebd-8331-205dc280639f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:46.195553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c9d70-50b4-4ebd-8331-205dc280639f admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:46.195814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c9d70-50b4-4ebd-8331-205dc280639f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:42:46.195981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c9d70-50b4-4ebd-8331-205dc280639f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:46.198386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c9d70-50b4-4ebd-8331-205dc280639f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:46.220609 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1440/2852] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:42:46.224103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a5f4a-8cf9-4630-a392-f1ec9bf26438 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:46.239192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a5f4a-8cf9-4630-a392-f1ec9bf26438 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:46.257356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d979847-41f8-41ca-8e59-13cd8ffda340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:46.258306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d979847-41f8-41ca-8e59-13cd8ffda340 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:46.260177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d979847-41f8-41ca-8e59-13cd8ffda340 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:46.260705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d979847-41f8-41ca-8e59-13cd8ffda340 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:46.261526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d979847-41f8-41ca-8e59-13cd8ffda340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:46.270612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d979847-41f8-41ca-8e59-13cd8ffda340 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:46.423140 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1413/2853] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:42:46 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:42:46.427085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c9d70-50b4-4ebd-8331-205dc280639f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:46.441057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c9d70-50b4-4ebd-8331-205dc280639f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:46.520455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82138873-fee8-418b-96e3-74fc7b588540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:46.520455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82138873-fee8-418b-96e3-74fc7b588540 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:46.520455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82138873-fee8-418b-96e3-74fc7b588540 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:46.520455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82138873-fee8-418b-96e3-74fc7b588540 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:46.520815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82138873-fee8-418b-96e3-74fc7b588540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:46.523442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82138873-fee8-418b-96e3-74fc7b588540 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:46.705901 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1441/2854] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:42:46 2022] POST /identity/v3/users => generated 292 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:42:46.712020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d979847-41f8-41ca-8e59-13cd8ffda340 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:46.729896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d979847-41f8-41ca-8e59-13cd8ffda340 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:46.745976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca3710-71df-436e-a551-6c073d736574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:46.746612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca3710-71df-436e-a551-6c073d736574 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:46.747107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca3710-71df-436e-a551-6c073d736574 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:46.748378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca3710-71df-436e-a551-6c073d736574 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:46.751742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca3710-71df-436e-a551-6c073d736574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:46.758249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca3710-71df-436e-a551-6c073d736574 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:46.788074 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1414/2855] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:42:46.793666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82138873-fee8-418b-96e3-74fc7b588540 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:46.805579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82138873-fee8-418b-96e3-74fc7b588540 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:46.811293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e39012-aaad-42c6-bb14-10b28fa7afbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:46.812378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e39012-aaad-42c6-bb14-10b28fa7afbf admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:46.812847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e39012-aaad-42c6-bb14-10b28fa7afbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:46.813335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e39012-aaad-42c6-bb14-10b28fa7afbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:46.814185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e39012-aaad-42c6-bb14-10b28fa7afbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:46.816067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e39012-aaad-42c6-bb14-10b28fa7afbf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:46.829908 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1442/2856] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:42:46.834792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca3710-71df-436e-a551-6c073d736574 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:46.848554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca3710-71df-436e-a551-6c073d736574 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:46.854679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b8cda-9f62-411a-8e31-332a40185b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:46.855348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b8cda-9f62-411a-8e31-332a40185b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:46.855696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b8cda-9f62-411a-8e31-332a40185b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:46.855976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b8cda-9f62-411a-8e31-332a40185b76 admin admin] PATH_INFO: `/v3/projects/788d72c01cd64a22acb68c0a76f4724a/users/eab2b4c7767e467c825c79719ed2a9ff/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:46.895028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b8cda-9f62-411a-8e31-332a40185b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=788d72c01cd64a22acb68c0a76f4724a, user_id=eab2b4c7767e467c825c79719ed2a9ff, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:46.912380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b8cda-9f62-411a-8e31-332a40185b76 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:47.052215 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1415/2857] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:42:46 2022] PUT /identity/v3/projects/788d72c01cd64a22acb68c0a76f4724a/users/eab2b4c7767e467c825c79719ed2a9ff/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:47.065950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff095a2c-fa3f-43b9-b6a0-40daf92612dd None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:47.066976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff095a2c-fa3f-43b9-b6a0-40daf92612dd None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:47.067474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff095a2c-fa3f-43b9-b6a0-40daf92612dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:47.099249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ff095a2c-fa3f-43b9-b6a0-40daf92612dd None None] MFA Rules not processed for user `eab2b4c7767e467c825c79719ed2a9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:47.100776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ff095a2c-fa3f-43b9-b6a0-40daf92612dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:47.225188 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1443/2858] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:47.226729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b8cda-9f62-411a-8e31-332a40185b76 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:47.362546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b8cda-9f62-411a-8e31-332a40185b76 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:47.375107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c28fc4-f412-41da-9aa0-0f6821a5973c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:47.375877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c28fc4-f412-41da-9aa0-0f6821a5973c admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:47.376295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c28fc4-f412-41da-9aa0-0f6821a5973c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:47.376670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c28fc4-f412-41da-9aa0-0f6821a5973c admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:47.377649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c28fc4-f412-41da-9aa0-0f6821a5973c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:47.381216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c28fc4-f412-41da-9aa0-0f6821a5973c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:47.464213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:47.549730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:47.565630 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1416/2859] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:42:47 2022] POST /identity/v3/projects => generated 385 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:42:47.570602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff095a2c-fa3f-43b9-b6a0-40daf92612dd None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:47.580626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff095a2c-fa3f-43b9-b6a0-40daf92612dd None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:47.661834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3048b7-551d-41b2-84f6-6d4dcdb06226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:47.662376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3048b7-551d-41b2-84f6-6d4dcdb06226 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:47.662833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3048b7-551d-41b2-84f6-6d4dcdb06226 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:47.663121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3048b7-551d-41b2-84f6-6d4dcdb06226 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:47.663763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3048b7-551d-41b2-84f6-6d4dcdb06226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:47.666659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3048b7-551d-41b2-84f6-6d4dcdb06226 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:47.838932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c28fc4-f412-41da-9aa0-0f6821a5973c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:47.855224 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1444/2860] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:42:47 2022] POST /identity/v3/users => generated 299 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:42:47.867905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c28fc4-f412-41da-9aa0-0f6821a5973c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:47.895887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a127c-35c3-46d5-89da-c88a4f26a9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:47.900792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a127c-35c3-46d5-89da-c88a4f26a9fe admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:47.901559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a127c-35c3-46d5-89da-c88a4f26a9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:47.902264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a127c-35c3-46d5-89da-c88a4f26a9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:47.904070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a127c-35c3-46d5-89da-c88a4f26a9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:47.908015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a127c-35c3-46d5-89da-c88a4f26a9fe admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:47.980229 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1417/2861] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:42:47.992464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3048b7-551d-41b2-84f6-6d4dcdb06226 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:48.031047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3048b7-551d-41b2-84f6-6d4dcdb06226 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:48.048095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff92f7-d15d-4219-b72f-492815d90a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:48.055216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff92f7-d15d-4219-b72f-492815d90a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:48.055216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff92f7-d15d-4219-b72f-492815d90a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:48.055216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff92f7-d15d-4219-b72f-492815d90a16 admin admin] PATH_INFO: `/v3/projects/212c56922b44473db8f9171aac0555cb/users/e86f76902ff54b42870d70271986285c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:48.085303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff92f7-d15d-4219-b72f-492815d90a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=212c56922b44473db8f9171aac0555cb, user_id=e86f76902ff54b42870d70271986285c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:48.088243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff92f7-d15d-4219-b72f-492815d90a16 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:48.229946 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1445/2862] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:42:47 2022] PUT /identity/v3/projects/212c56922b44473db8f9171aac0555cb/users/e86f76902ff54b42870d70271986285c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:48.235609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a127c-35c3-46d5-89da-c88a4f26a9fe admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:48.246728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a127c-35c3-46d5-89da-c88a4f26a9fe admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:48.485792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4a984-0adf-437a-9f0e-f64fe52cbffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:48.485792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4a984-0adf-437a-9f0e-f64fe52cbffd admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:48.485792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4a984-0adf-437a-9f0e-f64fe52cbffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:48.485792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4a984-0adf-437a-9f0e-f64fe52cbffd admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:48.486248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4a984-0adf-437a-9f0e-f64fe52cbffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:48.487665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4a984-0adf-437a-9f0e-f64fe52cbffd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:48.542378 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1418/2863] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:42:48.546126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff92f7-d15d-4219-b72f-492815d90a16 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:48.572076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff92f7-d15d-4219-b72f-492815d90a16 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:48.589404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b0119-0c31-41ef-a14a-071b78c1988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:48.590244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b0119-0c31-41ef-a14a-071b78c1988f admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:48.590659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b0119-0c31-41ef-a14a-071b78c1988f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:48.591046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b0119-0c31-41ef-a14a-071b78c1988f admin admin] PATH_INFO: `/v3/projects/212c56922b44473db8f9171aac0555cb/users/e86f76902ff54b42870d70271986285c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:48.602038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b0119-0c31-41ef-a14a-071b78c1988f admin admin] RBAC: Authorizing `identity:create_grant(project_id=212c56922b44473db8f9171aac0555cb, user_id=e86f76902ff54b42870d70271986285c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:48.602038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b0119-0c31-41ef-a14a-071b78c1988f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:48.638689 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1446/2864] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:42:48 2022] PUT /identity/v3/projects/212c56922b44473db8f9171aac0555cb/users/e86f76902ff54b42870d70271986285c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:48.639963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31399d84-9a90-4e69-959a-bec5252cfe71 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:48.640483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31399d84-9a90-4e69-959a-bec5252cfe71 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:48.640589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31399d84-9a90-4e69-959a-bec5252cfe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:48.697476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-31399d84-9a90-4e69-959a-bec5252cfe71 None None] MFA Rules not processed for user `e86f76902ff54b42870d70271986285c`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:48.698375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-31399d84-9a90-4e69-959a-bec5252cfe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:48.889113 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1419/2865] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:48.902569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b0119-0c31-41ef-a14a-071b78c1988f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:48.905767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-564b0119-0c31-41ef-a14a-071b78c1988f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:49.025673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b0119-0c31-41ef-a14a-071b78c1988f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:49.032971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b657c6-91cb-4a63-a546-060bd9ec187e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:49.033719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b657c6-91cb-4a63-a546-060bd9ec187e service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:49.034129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b657c6-91cb-4a63-a546-060bd9ec187e service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:49.034951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b657c6-91cb-4a63-a546-060bd9ec187e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:49.062122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b657c6-91cb-4a63-a546-060bd9ec187e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:49.064412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b657c6-91cb-4a63-a546-060bd9ec187e service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:49.079185 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1447/2866] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:42:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:49.928974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:50.136970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:51.635368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31399d84-9a90-4e69-959a-bec5252cfe71 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:51.638425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-31399d84-9a90-4e69-959a-bec5252cfe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:51.805712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31399d84-9a90-4e69-959a-bec5252cfe71 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:51.828450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e3ee4-80bf-4ded-a122-04a0100531cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:51.829130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e3ee4-80bf-4ded-a122-04a0100531cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:51.833408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e3ee4-80bf-4ded-a122-04a0100531cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:51.833408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e3ee4-80bf-4ded-a122-04a0100531cb admin admin] PATH_INFO: `/v3/users/a99963f0b57247d990ba02d4bc3e55e3` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:51.833408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e3ee4-80bf-4ded-a122-04a0100531cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a99963f0b57247d990ba02d4bc3e55e3)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:51.837047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e3ee4-80bf-4ded-a122-04a0100531cb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:51.852899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:51.962030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b657c6-91cb-4a63-a546-060bd9ec187e service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:51.975610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b657c6-91cb-4a63-a546-060bd9ec187e service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:51.993856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658fc8d-245b-4cab-857f-505963943681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:51.994887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658fc8d-245b-4cab-857f-505963943681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:51.995432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658fc8d-245b-4cab-857f-505963943681 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:51.995918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658fc8d-245b-4cab-857f-505963943681 admin admin] PATH_INFO: `/v3/users/eab2b4c7767e467c825c79719ed2a9ff` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:51.998702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658fc8d-245b-4cab-857f-505963943681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab2b4c7767e467c825c79719ed2a9ff)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:52.011814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658fc8d-245b-4cab-857f-505963943681 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:52.186839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:52.189218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-543e3ee4-80bf-4ded-a122-04a0100531cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a99963f0b57247d990ba02d4bc3e55e3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:52.291200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a658fc8d-245b-4cab-857f-505963943681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab2b4c7767e467c825c79719ed2a9ff'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:52.292829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a658fc8d-245b-4cab-857f-505963943681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab2b4c7767e467c825c79719ed2a9ff'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:52.308577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-543e3ee4-80bf-4ded-a122-04a0100531cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a99963f0b57247d990ba02d4bc3e55e3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:52.310169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-543e3ee4-80bf-4ded-a122-04a0100531cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a99963f0b57247d990ba02d4bc3e55e3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:52.331473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-543e3ee4-80bf-4ded-a122-04a0100531cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a99963f0b57247d990ba02d4bc3e55e3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:52.350037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-543e3ee4-80bf-4ded-a122-04a0100531cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a99963f0b57247d990ba02d4bc3e55e3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:52.361510 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1420/2867] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:42:51 2022] DELETE /identity/v3/users/a99963f0b57247d990ba02d4bc3e55e3 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:52.364214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79bb81-81db-4672-b1df-65150e7d77b4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:52.365209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79bb81-81db-4672-b1df-65150e7d77b4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:52.365680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79bb81-81db-4672-b1df-65150e7d77b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:52.380538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-0e79bb81-81db-4672-b1df-65150e7d77b4 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:42:52.380538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:42:52.380538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:42:52.380538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:42:52.380538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:42:52.380538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:42:52.380538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:42:52.380538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:42:52.380538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:42:52.380538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:42:52.380538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:42:52.380538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:42:52.380538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:42:52.381600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:42:52.381600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:42:52.381600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:42:52.381600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:42:52.381600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:42:52.381600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:42:52.381600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:42:52.381600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:42:52.381600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:42:52.381600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:42:52.381600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:42:52.381600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:42:52.381600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:42:52.381600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:42:52.381600 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:42:52.382571 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1421/2868] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:42:52 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 17 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:42:52.420764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a658fc8d-245b-4cab-857f-505963943681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab2b4c7767e467c825c79719ed2a9ff'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:52.420764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a658fc8d-245b-4cab-857f-505963943681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab2b4c7767e467c825c79719ed2a9ff'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:52.449635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a658fc8d-245b-4cab-857f-505963943681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab2b4c7767e467c825c79719ed2a9ff'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:52.489010 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1448/2869] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:42:51 2022] DELETE /identity/v3/users/eab2b4c7767e467c825c79719ed2a9ff => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:52.493134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be0f2e-612d-458e-8a9c-297bf49acf6b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:52.495191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be0f2e-612d-458e-8a9c-297bf49acf6b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:52.495191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be0f2e-612d-458e-8a9c-297bf49acf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:52.550160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-19be0f2e-612d-458e-8a9c-297bf49acf6b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:52.551434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-19be0f2e-612d-458e-8a9c-297bf49acf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:52.599123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0f181-11b4-4fb7-98b2-7c35a18ff53f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:52.599938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0f181-11b4-4fb7-98b2-7c35a18ff53f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:52.600397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0f181-11b4-4fb7-98b2-7c35a18ff53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:52.665242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4ae0f181-11b4-4fb7-98b2-7c35a18ff53f None None] MFA Rules not processed for user `c0493ef2484140f69c1817efaaa51f98`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:52.667678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4ae0f181-11b4-4fb7-98b2-7c35a18ff53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:52.790853 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1422/2870] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:52.812120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be0f2e-612d-458e-8a9c-297bf49acf6b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:52.813901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-19be0f2e-612d-458e-8a9c-297bf49acf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:52.853364 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1449/2871] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:52.983019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be44751-c756-41be-abae-b7f43d60a2ba None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:52.985654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be44751-c756-41be-abae-b7f43d60a2ba None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:52.986227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be44751-c756-41be-abae-b7f43d60a2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:53.018503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be0f2e-612d-458e-8a9c-297bf49acf6b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:53.031931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0be44751-c756-41be-abae-b7f43d60a2ba None None] MFA Rules not processed for user `4f4affe28e084a7eb873d9a1f0f79fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:53.035029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0be44751-c756-41be-abae-b7f43d60a2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:53.036272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd006f84-9558-4f16-9e27-21d3c01257b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:53.036896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd006f84-9558-4f16-9e27-21d3c01257b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:53.037175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd006f84-9558-4f16-9e27-21d3c01257b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:53.037444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd006f84-9558-4f16-9e27-21d3c01257b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:53.095500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd006f84-9558-4f16-9e27-21d3c01257b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:53.097130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd006f84-9558-4f16-9e27-21d3c01257b2 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:53.136863 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1423/2872] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:42:53.146643 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1450/2873] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:42:53.246076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:53.553285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd006f84-9558-4f16-9e27-21d3c01257b2 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:53.554785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cd006f84-9558-4f16-9e27-21d3c01257b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:53.584935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd006f84-9558-4f16-9e27-21d3c01257b2 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:53.605334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d61e9-1572-4d93-bc4a-6c93171fa8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:53.606524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d61e9-1572-4d93-bc4a-6c93171fa8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:53.608098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d61e9-1572-4d93-bc4a-6c93171fa8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:53.608098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d61e9-1572-4d93-bc4a-6c93171fa8ce admin admin] PATH_INFO: `/v3/projects/7b1f727e0ec54ec1afa8f14d5d17152c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:53.612975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d61e9-1572-4d93-bc4a-6c93171fa8ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b1f727e0ec54ec1afa8f14d5d17152c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:53.614920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d61e9-1572-4d93-bc4a-6c93171fa8ce admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:53.773310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-171d61e9-1572-4d93-bc4a-6c93171fa8ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b1f727e0ec54ec1afa8f14d5d17152c', 'request_id': 'req-171d61e9-1572-4d93-bc4a-6c93171fa8ce'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:53.786100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-171d61e9-1572-4d93-bc4a-6c93171fa8ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b1f727e0ec54ec1afa8f14d5d17152c', 'request_id': 'req-171d61e9-1572-4d93-bc4a-6c93171fa8ce'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:53.790606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:53.801184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-171d61e9-1572-4d93-bc4a-6c93171fa8ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b1f727e0ec54ec1afa8f14d5d17152c', 'request_id': 'req-171d61e9-1572-4d93-bc4a-6c93171fa8ce'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:53.914630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-171d61e9-1572-4d93-bc4a-6c93171fa8ce admin admin] The token cache is being invalidate because project 7b1f727e0ec54ec1afa8f14d5d17152c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:42:53.915012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-171d61e9-1572-4d93-bc4a-6c93171fa8ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:53.915852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-171d61e9-1572-4d93-bc4a-6c93171fa8ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:53.917726 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1424/2874] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:53 2022] DELETE /identity/v3/projects/7b1f727e0ec54ec1afa8f14d5d17152c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:53.923420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0a03b-57ad-4d3e-8258-a08223ac93eb None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:53.923912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0a03b-57ad-4d3e-8258-a08223ac93eb None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:53.924292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0a03b-57ad-4d3e-8258-a08223ac93eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:53.961625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d61e9-1572-4d93-bc4a-6c93171fa8ce admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:53.963249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-171d61e9-1572-4d93-bc4a-6c93171fa8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:53.984626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1fb0a03b-57ad-4d3e-8258-a08223ac93eb None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:53.987083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1fb0a03b-57ad-4d3e-8258-a08223ac93eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:54.079655 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1451/2875] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:54.080866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0a03b-57ad-4d3e-8258-a08223ac93eb None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:54.082466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1fb0a03b-57ad-4d3e-8258-a08223ac93eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:54.098931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0a03b-57ad-4d3e-8258-a08223ac93eb None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:54.118663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a9fa8-ea46-4f12-bcd6-f755fb63726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:54.120265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a9fa8-ea46-4f12-bcd6-f755fb63726f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:54.123378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a9fa8-ea46-4f12-bcd6-f755fb63726f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:54.123769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a9fa8-ea46-4f12-bcd6-f755fb63726f admin admin] PATH_INFO: `/v3/projects/788d72c01cd64a22acb68c0a76f4724a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:54.128527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a9fa8-ea46-4f12-bcd6-f755fb63726f admin admin] RBAC: Authorizing `identity:delete_project(project_id=788d72c01cd64a22acb68c0a76f4724a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:54.131150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a9fa8-ea46-4f12-bcd6-f755fb63726f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:54.137851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d61e9-1572-4d93-bc4a-6c93171fa8ce admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:54.159434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b11db-f078-4512-807d-b4470a245043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:54.160428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b11db-f078-4512-807d-b4470a245043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:54.160887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b11db-f078-4512-807d-b4470a245043 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:54.161410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b11db-f078-4512-807d-b4470a245043 admin admin] PATH_INFO: `/v3/users/98e0b9c7adff4237aa67bbf1b7c79d2e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:54.163951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b11db-f078-4512-807d-b4470a245043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e0b9c7adff4237aa67bbf1b7c79d2e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:54.166443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b11db-f078-4512-807d-b4470a245043 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:54.348488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fd3a9fa8-ea46-4f12-bcd6-f755fb63726f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '788d72c01cd64a22acb68c0a76f4724a', 'request_id': 'req-fd3a9fa8-ea46-4f12-bcd6-f755fb63726f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:54.357168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fd3a9fa8-ea46-4f12-bcd6-f755fb63726f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '788d72c01cd64a22acb68c0a76f4724a', 'request_id': 'req-fd3a9fa8-ea46-4f12-bcd6-f755fb63726f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:54.377013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:54.465791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-075b11db-f078-4512-807d-b4470a245043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e0b9c7adff4237aa67bbf1b7c79d2e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:54.474407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fd3a9fa8-ea46-4f12-bcd6-f755fb63726f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '788d72c01cd64a22acb68c0a76f4724a', 'request_id': 'req-fd3a9fa8-ea46-4f12-bcd6-f755fb63726f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:54.493011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fd3a9fa8-ea46-4f12-bcd6-f755fb63726f admin admin] The token cache is being invalidate because project 788d72c01cd64a22acb68c0a76f4724a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:42:54.494390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fd3a9fa8-ea46-4f12-bcd6-f755fb63726f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:54.495355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fd3a9fa8-ea46-4f12-bcd6-f755fb63726f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:54.497528 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1452/2876] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:54 2022] DELETE /identity/v3/projects/788d72c01cd64a22acb68c0a76f4724a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:54.499165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7993b2-0b6c-423b-aba7-6d30e4673613 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:54.500193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7993b2-0b6c-423b-aba7-6d30e4673613 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:54.500629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7993b2-0b6c-423b-aba7-6d30e4673613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:54.547795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5f7993b2-0b6c-423b-aba7-6d30e4673613 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:54.554754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5f7993b2-0b6c-423b-aba7-6d30e4673613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:54.595302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-075b11db-f078-4512-807d-b4470a245043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e0b9c7adff4237aa67bbf1b7c79d2e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:54.596716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-075b11db-f078-4512-807d-b4470a245043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e0b9c7adff4237aa67bbf1b7c79d2e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:54.611966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-075b11db-f078-4512-807d-b4470a245043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e0b9c7adff4237aa67bbf1b7c79d2e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:54.640499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-075b11db-f078-4512-807d-b4470a245043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e0b9c7adff4237aa67bbf1b7c79d2e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:54.657513 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1425/2877] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:42:53 2022] DELETE /identity/v3/users/98e0b9c7adff4237aa67bbf1b7c79d2e => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:54.659814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b11db-f078-4512-807d-b4470a245043 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:54.667536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-075b11db-f078-4512-807d-b4470a245043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:54.709751 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1453/2878] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:54.712108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7993b2-0b6c-423b-aba7-6d30e4673613 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:54.767718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7993b2-0b6c-423b-aba7-6d30e4673613 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:54.926555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b11db-f078-4512-807d-b4470a245043 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:54.942969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea511f6d-f729-47fc-ae67-309c37fea9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:54.951286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511f6d-f729-47fc-ae67-309c37fea9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:54.951286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511f6d-f729-47fc-ae67-309c37fea9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:54.951286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511f6d-f729-47fc-ae67-309c37fea9ee admin admin] PATH_INFO: `/v3/users/e86f76902ff54b42870d70271986285c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:54.951286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea511f6d-f729-47fc-ae67-309c37fea9ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=e86f76902ff54b42870d70271986285c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:54.963924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea511f6d-f729-47fc-ae67-309c37fea9ee admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:55.092056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5041c-7fef-4bc6-8a31-421877a8403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:55.095378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5041c-7fef-4bc6-8a31-421877a8403e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:55.100268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5041c-7fef-4bc6-8a31-421877a8403e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:55.100268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5041c-7fef-4bc6-8a31-421877a8403e admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:55.100268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5041c-7fef-4bc6-8a31-421877a8403e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:42:55.101070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5041c-7fef-4bc6-8a31-421877a8403e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:55.107531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5041c-7fef-4bc6-8a31-421877a8403e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:55.148512 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1454/2879] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:42:55.152779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5041c-7fef-4bc6-8a31-421877a8403e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:55.181660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5041c-7fef-4bc6-8a31-421877a8403e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:55.190669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d932bf2-ee2a-4413-973c-37c8742da740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:55.191578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d932bf2-ee2a-4413-973c-37c8742da740 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:55.192076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d932bf2-ee2a-4413-973c-37c8742da740 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:55.192764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d932bf2-ee2a-4413-973c-37c8742da740 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:55.193564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d932bf2-ee2a-4413-973c-37c8742da740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:55.195648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d932bf2-ee2a-4413-973c-37c8742da740 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:55.340875 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1455/2880] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:42:55 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:42:55.344743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d932bf2-ee2a-4413-973c-37c8742da740 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:55.367391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea511f6d-f729-47fc-ae67-309c37fea9ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e86f76902ff54b42870d70271986285c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:55.470861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d932bf2-ee2a-4413-973c-37c8742da740 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:55.488657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f13a8b-a883-4f5a-a14f-7d2da0ad999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:55.489297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f13a8b-a883-4f5a-a14f-7d2da0ad999c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:55.489634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f13a8b-a883-4f5a-a14f-7d2da0ad999c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:55.489913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f13a8b-a883-4f5a-a14f-7d2da0ad999c admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:55.490554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f13a8b-a883-4f5a-a14f-7d2da0ad999c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:55.492990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f13a8b-a883-4f5a-a14f-7d2da0ad999c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:55.502831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea511f6d-f729-47fc-ae67-309c37fea9ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e86f76902ff54b42870d70271986285c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:55.511364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea511f6d-f729-47fc-ae67-309c37fea9ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e86f76902ff54b42870d70271986285c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:55.514881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea511f6d-f729-47fc-ae67-309c37fea9ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e86f76902ff54b42870d70271986285c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:55.560085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea511f6d-f729-47fc-ae67-309c37fea9ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e86f76902ff54b42870d70271986285c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:55.570568 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1426/2881] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:42:54 2022] DELETE /identity/v3/users/e86f76902ff54b42870d70271986285c => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:55.571747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea511f6d-f729-47fc-ae67-309c37fea9ee admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:55.574849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ea511f6d-f729-47fc-ae67-309c37fea9ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:55.719633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea511f6d-f729-47fc-ae67-309c37fea9ee admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:55.726039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2ad23-67c6-475d-b107-b0e5aa1f0ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:55.726995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2ad23-67c6-475d-b107-b0e5aa1f0ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:55.727993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2ad23-67c6-475d-b107-b0e5aa1f0ede admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:55.728496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2ad23-67c6-475d-b107-b0e5aa1f0ede admin admin] PATH_INFO: `/v3/projects/d0b2fd77da7144c9ad5b4246be5f5cfc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:55.732038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2ad23-67c6-475d-b107-b0e5aa1f0ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0b2fd77da7144c9ad5b4246be5f5cfc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:55.736138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2ad23-67c6-475d-b107-b0e5aa1f0ede admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:55.766385 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1456/2882] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:42:55 2022] POST /identity/v3/users => generated 290 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:42:55.772287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f13a8b-a883-4f5a-a14f-7d2da0ad999c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:55.774864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-66f13a8b-a883-4f5a-a14f-7d2da0ad999c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:55.807438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f13a8b-a883-4f5a-a14f-7d2da0ad999c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:55.822474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113ee23-9750-43eb-b0fc-6b38de79049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:55.823273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113ee23-9750-43eb-b0fc-6b38de79049c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:55.825864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113ee23-9750-43eb-b0fc-6b38de79049c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:55.826028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113ee23-9750-43eb-b0fc-6b38de79049c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:55.827451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113ee23-9750-43eb-b0fc-6b38de79049c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:55.829617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113ee23-9750-43eb-b0fc-6b38de79049c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:55.855895 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1457/2883] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:42:55.859779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113ee23-9750-43eb-b0fc-6b38de79049c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:55.891537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113ee23-9750-43eb-b0fc-6b38de79049c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:55.897616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e3ea0-a9eb-4a1b-8b98-9c2037b899b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:55.898464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e3ea0-a9eb-4a1b-8b98-9c2037b899b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:55.898750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e3ea0-a9eb-4a1b-8b98-9c2037b899b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:55.899023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e3ea0-a9eb-4a1b-8b98-9c2037b899b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:55.900317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e3ea0-a9eb-4a1b-8b98-9c2037b899b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:55.903461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e3ea0-a9eb-4a1b-8b98-9c2037b899b8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:55.934777 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1458/2884] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:42:55.935573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e3ea0-a9eb-4a1b-8b98-9c2037b899b8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:55.963704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e3ea0-a9eb-4a1b-8b98-9c2037b899b8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:55.983206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2db2ad23-67c6-475d-b107-b0e5aa1f0ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0b2fd77da7144c9ad5b4246be5f5cfc', 'request_id': 'req-2db2ad23-67c6-475d-b107-b0e5aa1f0ede'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:55.993361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2db2ad23-67c6-475d-b107-b0e5aa1f0ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0b2fd77da7144c9ad5b4246be5f5cfc', 'request_id': 'req-2db2ad23-67c6-475d-b107-b0e5aa1f0ede'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:56.004187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2db2ad23-67c6-475d-b107-b0e5aa1f0ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0b2fd77da7144c9ad5b4246be5f5cfc', 'request_id': 'req-2db2ad23-67c6-475d-b107-b0e5aa1f0ede'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:56.084048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959db3e-d8dc-436e-b737-70cdce05b44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:56.085580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959db3e-d8dc-436e-b737-70cdce05b44e admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:56.086013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959db3e-d8dc-436e-b737-70cdce05b44e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:56.086433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959db3e-d8dc-436e-b737-70cdce05b44e admin admin] PATH_INFO: `/v3/projects/253bab1df8ec4b0da7dd0e5212feb787/users/6cae3b62c5af4bf9ad5be777429d4568/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:56.109283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959db3e-d8dc-436e-b737-70cdce05b44e admin admin] RBAC: Authorizing `identity:create_grant(project_id=253bab1df8ec4b0da7dd0e5212feb787, user_id=6cae3b62c5af4bf9ad5be777429d4568, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:56.113821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959db3e-d8dc-436e-b737-70cdce05b44e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:56.116687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2db2ad23-67c6-475d-b107-b0e5aa1f0ede admin admin] The token cache is being invalidate because project d0b2fd77da7144c9ad5b4246be5f5cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:42:56.116687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2db2ad23-67c6-475d-b107-b0e5aa1f0ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:56.117185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2db2ad23-67c6-475d-b107-b0e5aa1f0ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:56.119942 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1427/2885] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:55 2022] DELETE /identity/v3/projects/d0b2fd77da7144c9ad5b4246be5f5cfc => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:56.136544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb70da3-64d6-401c-8e47-302de88a5c3e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:56.137715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb70da3-64d6-401c-8e47-302de88a5c3e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:56.138119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb70da3-64d6-401c-8e47-302de88a5c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:56.140515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:56.183171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9bb70da3-64d6-401c-8e47-302de88a5c3e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:56.185568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9bb70da3-64d6-401c-8e47-302de88a5c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:56.209797 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1428/2886] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:42:56.211470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b94cf-f404-40d0-ae6b-5815a86a1de9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:56.212609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b94cf-f404-40d0-ae6b-5815a86a1de9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:56.214686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b94cf-f404-40d0-ae6b-5815a86a1de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:56.239577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-569b94cf-f404-40d0-ae6b-5815a86a1de9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:56.241003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-569b94cf-f404-40d0-ae6b-5815a86a1de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:56.275406 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1459/2887] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:42:55 2022] PUT /identity/v3/projects/253bab1df8ec4b0da7dd0e5212feb787/users/6cae3b62c5af4bf9ad5be777429d4568/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:56.278345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959db3e-d8dc-436e-b737-70cdce05b44e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:56.280587 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1429/2888] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:56.355234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec314a7-a010-4301-aa3d-ab7d5e3e857b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:56.355648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec314a7-a010-4301-aa3d-ab7d5e3e857b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:56.356711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec314a7-a010-4301-aa3d-ab7d5e3e857b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:56.411940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959db3e-d8dc-436e-b737-70cdce05b44e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:56.427245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07532f58-eafd-47cc-b756-414a95f0e6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:56.429027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07532f58-eafd-47cc-b756-414a95f0e6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:56.430245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07532f58-eafd-47cc-b756-414a95f0e6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:56.431821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07532f58-eafd-47cc-b756-414a95f0e6d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:56.432666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07532f58-eafd-47cc-b756-414a95f0e6d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:42:56.434091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07532f58-eafd-47cc-b756-414a95f0e6d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:56.437214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07532f58-eafd-47cc-b756-414a95f0e6d7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:56.452033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1ec314a7-a010-4301-aa3d-ab7d5e3e857b None None] MFA Rules not processed for user `6cae3b62c5af4bf9ad5be777429d4568`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:56.453657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1ec314a7-a010-4301-aa3d-ab7d5e3e857b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:56.471949 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1460/2889] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:42:56.473210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07532f58-eafd-47cc-b756-414a95f0e6d7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:56.484845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07532f58-eafd-47cc-b756-414a95f0e6d7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:56.490726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87235d99-7327-4a3f-bb57-88477a95aef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:56.491681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87235d99-7327-4a3f-bb57-88477a95aef6 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:56.492556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87235d99-7327-4a3f-bb57-88477a95aef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:56.494534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87235d99-7327-4a3f-bb57-88477a95aef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:56.496503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87235d99-7327-4a3f-bb57-88477a95aef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:56.498776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87235d99-7327-4a3f-bb57-88477a95aef6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:56.615122 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1430/2890] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:56.627861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec314a7-a010-4301-aa3d-ab7d5e3e857b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:56.663294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1ec314a7-a010-4301-aa3d-ab7d5e3e857b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:56.668948 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1461/2891] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:42:56 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:42:56.677485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87235d99-7327-4a3f-bb57-88477a95aef6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:56.813318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87235d99-7327-4a3f-bb57-88477a95aef6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:56.824927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d91f2-4ab2-421d-8a01-d0f3c2112f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:56.826280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d91f2-4ab2-421d-8a01-d0f3c2112f63 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:56.826790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d91f2-4ab2-421d-8a01-d0f3c2112f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:56.827321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d91f2-4ab2-421d-8a01-d0f3c2112f63 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:56.828490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d91f2-4ab2-421d-8a01-d0f3c2112f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:56.830754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d91f2-4ab2-421d-8a01-d0f3c2112f63 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:56.886114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:56.894887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec314a7-a010-4301-aa3d-ab7d5e3e857b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:57.007212 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1462/2892] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:42:56 2022] POST /identity/v3/users => generated 291 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:42:57.008518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d91f2-4ab2-421d-8a01-d0f3c2112f63 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:57.052299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d91f2-4ab2-421d-8a01-d0f3c2112f63 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:57.081052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eaaec9-f0e3-4f1a-a810-1bf6a266582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:57.081726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaaec9-f0e3-4f1a-a810-1bf6a266582a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:57.082005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaaec9-f0e3-4f1a-a810-1bf6a266582a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:57.082270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaaec9-f0e3-4f1a-a810-1bf6a266582a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:57.084013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37632cc1-d8d9-4db8-a07e-638c6a543e8d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:57.084678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37632cc1-d8d9-4db8-a07e-638c6a543e8d service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:57.084962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37632cc1-d8d9-4db8-a07e-638c6a543e8d service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:57.085238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37632cc1-d8d9-4db8-a07e-638c6a543e8d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:57.088933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eaaec9-f0e3-4f1a-a810-1bf6a266582a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:57.090678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eaaec9-f0e3-4f1a-a810-1bf6a266582a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:57.149856 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1463/2893] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:42:57.149856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eaaec9-f0e3-4f1a-a810-1bf6a266582a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:57.173523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eaaec9-f0e3-4f1a-a810-1bf6a266582a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:57.181127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87faccf-45ac-4ade-b9bc-2687be3392e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:57.182366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87faccf-45ac-4ade-b9bc-2687be3392e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:57.182929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87faccf-45ac-4ade-b9bc-2687be3392e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:57.183409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87faccf-45ac-4ade-b9bc-2687be3392e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:57.184890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87faccf-45ac-4ade-b9bc-2687be3392e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:57.186720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87faccf-45ac-4ade-b9bc-2687be3392e2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:57.205635 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1464/2894] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:42:57.206947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87faccf-45ac-4ade-b9bc-2687be3392e2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:57.222823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87faccf-45ac-4ade-b9bc-2687be3392e2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:57.234951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc8ee4-5cfa-4f44-a317-b46aca0264ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:57.235792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc8ee4-5cfa-4f44-a317-b46aca0264ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:57.236401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc8ee4-5cfa-4f44-a317-b46aca0264ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:57.236685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc8ee4-5cfa-4f44-a317-b46aca0264ed admin admin] PATH_INFO: `/v3/projects/7bac987530e04d23a770e70ed07a0a36/users/42217ef789054d53a80b59bad1364562/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:57.296922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc8ee4-5cfa-4f44-a317-b46aca0264ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bac987530e04d23a770e70ed07a0a36, user_id=42217ef789054d53a80b59bad1364562, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:57.305537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37632cc1-d8d9-4db8-a07e-638c6a543e8d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:57.306951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37632cc1-d8d9-4db8-a07e-638c6a543e8d service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:57.310260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc8ee4-5cfa-4f44-a317-b46aca0264ed admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:57.324921 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1431/2895] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:42:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:57.325871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37632cc1-d8d9-4db8-a07e-638c6a543e8d service glance] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:57.328843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-37632cc1-d8d9-4db8-a07e-638c6a543e8d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:57.359741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37632cc1-d8d9-4db8-a07e-638c6a543e8d service glance] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:57.370707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ede168-860f-4bfd-95c7-6c148ab3db23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:57.372005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ede168-860f-4bfd-95c7-6c148ab3db23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:57.373609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ede168-860f-4bfd-95c7-6c148ab3db23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:57.375184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ede168-860f-4bfd-95c7-6c148ab3db23 admin admin] PATH_INFO: `/v3/projects/212c56922b44473db8f9171aac0555cb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:57.377224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ede168-860f-4bfd-95c7-6c148ab3db23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=212c56922b44473db8f9171aac0555cb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:57.383192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ede168-860f-4bfd-95c7-6c148ab3db23 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:57.462643 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1465/2896] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:42:57 2022] PUT /identity/v3/projects/7bac987530e04d23a770e70ed07a0a36/users/42217ef789054d53a80b59bad1364562/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:57.466134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3050c67-f367-4fac-8d7a-7e6071a027ee None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:57.467794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3050c67-f367-4fac-8d7a-7e6071a027ee None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:57.468265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3050c67-f367-4fac-8d7a-7e6071a027ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:57.509206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f3050c67-f367-4fac-8d7a-7e6071a027ee None None] MFA Rules not processed for user `42217ef789054d53a80b59bad1364562`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:57.510695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f3050c67-f367-4fac-8d7a-7e6071a027ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:57.635450 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1466/2897] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:57.644853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e4ede168-860f-4bfd-95c7-6c148ab3db23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212c56922b44473db8f9171aac0555cb', 'request_id': 'req-e4ede168-860f-4bfd-95c7-6c148ab3db23'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:57.656254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3050c67-f367-4fac-8d7a-7e6071a027ee None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:57.658730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f3050c67-f367-4fac-8d7a-7e6071a027ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:57.660195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e4ede168-860f-4bfd-95c7-6c148ab3db23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212c56922b44473db8f9171aac0555cb', 'request_id': 'req-e4ede168-860f-4bfd-95c7-6c148ab3db23'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:57.674842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e4ede168-860f-4bfd-95c7-6c148ab3db23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212c56922b44473db8f9171aac0555cb', 'request_id': 'req-e4ede168-860f-4bfd-95c7-6c148ab3db23'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:57.774588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3050c67-f367-4fac-8d7a-7e6071a027ee None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:57.813394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e4ede168-860f-4bfd-95c7-6c148ab3db23 admin admin] The token cache is being invalidate because project 212c56922b44473db8f9171aac0555cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:42:57.813836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e4ede168-860f-4bfd-95c7-6c148ab3db23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:57.817538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e4ede168-860f-4bfd-95c7-6c148ab3db23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:42:57.821245 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1432/2898] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:42:57 2022] DELETE /identity/v3/projects/212c56922b44473db8f9171aac0555cb => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:57.825196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbf241-9dc6-46fe-9265-675ac643e530 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:57.825196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbf241-9dc6-46fe-9265-675ac643e530 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:57.825458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbf241-9dc6-46fe-9265-675ac643e530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:57.854738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-40fbf241-9dc6-46fe-9265-675ac643e530 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:57.857411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-40fbf241-9dc6-46fe-9265-675ac643e530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:57.868621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14444c1a-5e84-4fe8-95a1-0f783d05061d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:57.869406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444c1a-5e84-4fe8-95a1-0f783d05061d service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:57.871649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444c1a-5e84-4fe8-95a1-0f783d05061d service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:57.871649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444c1a-5e84-4fe8-95a1-0f783d05061d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:57.873503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-14444c1a-5e84-4fe8-95a1-0f783d05061d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:57.947949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14444c1a-5e84-4fe8-95a1-0f783d05061d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:57.949864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14444c1a-5e84-4fe8-95a1-0f783d05061d service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:57.961521 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1433/2899] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:42:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:57.964794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fae8d2-a1c2-48c2-9522-ff675d7490cd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:57.965991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fae8d2-a1c2-48c2-9522-ff675d7490cd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:57.966985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fae8d2-a1c2-48c2-9522-ff675d7490cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:57.970305 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1467/2900] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:42:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:57.990429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14444c1a-5e84-4fe8-95a1-0f783d05061d service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:57.992681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-14444c1a-5e84-4fe8-95a1-0f783d05061d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:57.994917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-92fae8d2-a1c2-48c2-9522-ff675d7490cd None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:57.996107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-92fae8d2-a1c2-48c2-9522-ff675d7490cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:58.126014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14444c1a-5e84-4fe8-95a1-0f783d05061d service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:58.137763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d9416-54f3-40c5-9a38-9082f65c47d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:58.137763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d9416-54f3-40c5-9a38-9082f65c47d8 service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:58.137763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d9416-54f3-40c5-9a38-9082f65c47d8 service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:58.137763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d9416-54f3-40c5-9a38-9082f65c47d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:58.144548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d9416-54f3-40c5-9a38-9082f65c47d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:58.146480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d9416-54f3-40c5-9a38-9082f65c47d8 service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:58.159999 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1434/2901] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:58.159999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35960700-dad6-45be-8e3e-8976fcfa0cf6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:58.159999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35960700-dad6-45be-8e3e-8976fcfa0cf6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:58.159999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35960700-dad6-45be-8e3e-8976fcfa0cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:58.162265 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1468/2902] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:42:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 04:42:58.162837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3995c-73e6-43f3-ab83-323fa7e81ce1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:58.163315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3995c-73e6-43f3-ab83-323fa7e81ce1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:58.163733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3995c-73e6-43f3-ab83-323fa7e81ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:58.201423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f4a3995c-73e6-43f3-ab83-323fa7e81ce1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:58.202852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f4a3995c-73e6-43f3-ab83-323fa7e81ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:58.212769 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1469/2903] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:58.218718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3995c-73e6-43f3-ab83-323fa7e81ce1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:58.221230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-35960700-dad6-45be-8e3e-8976fcfa0cf6 None None] MFA Rules not processed for user `bb90f64664c74949ad58644bcbdafdfc`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:58.223112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-35960700-dad6-45be-8e3e-8976fcfa0cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:58.238696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3995c-73e6-43f3-ab83-323fa7e81ce1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:58.251884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73de78-a5b8-4623-9e0c-5bc9054848f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:58.253454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73de78-a5b8-4623-9e0c-5bc9054848f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:58.253829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73de78-a5b8-4623-9e0c-5bc9054848f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:58.254760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73de78-a5b8-4623-9e0c-5bc9054848f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:58.255515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73de78-a5b8-4623-9e0c-5bc9054848f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:42:58.256366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73de78-a5b8-4623-9e0c-5bc9054848f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:58.258111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73de78-a5b8-4623-9e0c-5bc9054848f6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:58.273898 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1470/2904] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:42:58.278568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73de78-a5b8-4623-9e0c-5bc9054848f6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:58.319269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73de78-a5b8-4623-9e0c-5bc9054848f6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:58.325565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbd7e1-7440-4864-acb8-a9477d0aa052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:58.326334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbd7e1-7440-4864-acb8-a9477d0aa052 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:58.326615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbd7e1-7440-4864-acb8-a9477d0aa052 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:58.326888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbd7e1-7440-4864-acb8-a9477d0aa052 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:58.327525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbbd7e1-7440-4864-acb8-a9477d0aa052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:58.329479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbbd7e1-7440-4864-acb8-a9477d0aa052 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:58.335162 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1435/2905] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:58.346442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35960700-dad6-45be-8e3e-8976fcfa0cf6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:58.348614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-35960700-dad6-45be-8e3e-8976fcfa0cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:58.439270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35960700-dad6-45be-8e3e-8976fcfa0cf6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:58.448270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad22243-3cf1-4f97-8730-56b2cbf8f541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:58.448270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad22243-3cf1-4f97-8730-56b2cbf8f541 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:58.448270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad22243-3cf1-4f97-8730-56b2cbf8f541 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:58.448270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad22243-3cf1-4f97-8730-56b2cbf8f541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:58.457147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad22243-3cf1-4f97-8730-56b2cbf8f541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:58.459046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad22243-3cf1-4f97-8730-56b2cbf8f541 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:58.470893 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1436/2906] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:42:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:42:58.489410 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1471/2907] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:42:58 2022] POST /identity/v3/projects => generated 375 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:42:58.492826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad22243-3cf1-4f97-8730-56b2cbf8f541 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:58.505589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad22243-3cf1-4f97-8730-56b2cbf8f541 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:58.517198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbb077-5293-48ed-9de9-c8651e62f1c1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:58.517487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbb077-5293-48ed-9de9-c8651e62f1c1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:58.517767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbb077-5293-48ed-9de9-c8651e62f1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:58.524582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-94fbb077-5293-48ed-9de9-c8651e62f1c1 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:42:58.524582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:42:58.524582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:42:58.524582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:42:58.524582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:42:58.524582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:42:58.524582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:42:58.524582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:42:58.524582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:42:58.524582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:42:58.524582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:42:58.524582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:42:58.524582 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:42:58.525735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:42:58.525735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:42:58.525735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:42:58.525735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:42:58.525735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:42:58.525735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:42:58.525735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:42:58.525735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:42:58.525735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:42:58.525735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:42:58.525735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:42:58.525735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:42:58.525735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:42:58.525735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:42:58.525735 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:42:58.536731 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1472/2908] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:42:58 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 17 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:42:58.621145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b0ce2-21b5-4863-9518-93f0d65dc76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:58.623076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b0ce2-21b5-4863-9518-93f0d65dc76b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:58.623598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b0ce2-21b5-4863-9518-93f0d65dc76b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:58.624223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b0ce2-21b5-4863-9518-93f0d65dc76b admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:58.625293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b0ce2-21b5-4863-9518-93f0d65dc76b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:58.628823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b0ce2-21b5-4863-9518-93f0d65dc76b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:58.768414 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1437/2909] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:42:58 2022] POST /identity/v3/users => generated 288 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:42:58.772975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbb077-5293-48ed-9de9-c8651e62f1c1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:58.799235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbb077-5293-48ed-9de9-c8651e62f1c1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:58.813688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433cefe-41b6-4ddc-8a5c-2bf381b5122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:58.814306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433cefe-41b6-4ddc-8a5c-2bf381b5122d admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:58.814579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433cefe-41b6-4ddc-8a5c-2bf381b5122d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:58.814846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433cefe-41b6-4ddc-8a5c-2bf381b5122d admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:58.815482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433cefe-41b6-4ddc-8a5c-2bf381b5122d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:58.820056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433cefe-41b6-4ddc-8a5c-2bf381b5122d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:58.843074 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1473/2910] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:42:58.845440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b0ce2-21b5-4863-9518-93f0d65dc76b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:58.856462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b0ce2-21b5-4863-9518-93f0d65dc76b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:58.864924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d969f-9bbd-4679-8860-c5f3b19abe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:58.865864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d969f-9bbd-4679-8860-c5f3b19abe0b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:58.866208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d969f-9bbd-4679-8860-c5f3b19abe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:58.866576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d969f-9bbd-4679-8860-c5f3b19abe0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:58.867299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d969f-9bbd-4679-8860-c5f3b19abe0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:58.869446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d969f-9bbd-4679-8860-c5f3b19abe0b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:58.896443 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1438/2911] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:42:58.898782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433cefe-41b6-4ddc-8a5c-2bf381b5122d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:58.910447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433cefe-41b6-4ddc-8a5c-2bf381b5122d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:58.917165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383b969-0f94-4dd3-98d1-0dc834f0a381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:58.918611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383b969-0f94-4dd3-98d1-0dc834f0a381 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:58.919100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383b969-0f94-4dd3-98d1-0dc834f0a381 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:58.919598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383b969-0f94-4dd3-98d1-0dc834f0a381 admin admin] PATH_INFO: `/v3/projects/cbe47e4f64ed40f6a0bf07c4d0668c17/users/48e68ec125814d3590e37f9cc7aa9d51/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:58.950292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383b969-0f94-4dd3-98d1-0dc834f0a381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe47e4f64ed40f6a0bf07c4d0668c17, user_id=48e68ec125814d3590e37f9cc7aa9d51, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:58.955317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383b969-0f94-4dd3-98d1-0dc834f0a381 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:59.006281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:42:59.042636 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1474/2912] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:42:58 2022] PUT /identity/v3/projects/cbe47e4f64ed40f6a0bf07c4d0668c17/users/48e68ec125814d3590e37f9cc7aa9d51/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:42:59.118688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294e777-1d09-49f1-9ae6-a485bf626d89 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:59.119260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294e777-1d09-49f1-9ae6-a485bf626d89 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:59.119684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294e777-1d09-49f1-9ae6-a485bf626d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:59.155515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a294e777-1d09-49f1-9ae6-a485bf626d89 None None] MFA Rules not processed for user `48e68ec125814d3590e37f9cc7aa9d51`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:42:59.157175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a294e777-1d09-49f1-9ae6-a485bf626d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:42:59.237693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383b969-0f94-4dd3-98d1-0dc834f0a381 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:59.238720 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1439/2913] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:42:59.316556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383b969-0f94-4dd3-98d1-0dc834f0a381 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:59.322136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4323a05-3020-405b-9088-29d11f5ecc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:59.322951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4323a05-3020-405b-9088-29d11f5ecc93 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:59.323380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4323a05-3020-405b-9088-29d11f5ecc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:59.323814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4323a05-3020-405b-9088-29d11f5ecc93 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:59.324836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4323a05-3020-405b-9088-29d11f5ecc93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:59.326898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4323a05-3020-405b-9088-29d11f5ecc93 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:59.499464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294e777-1d09-49f1-9ae6-a485bf626d89 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:59.508569 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1475/2914] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:42:59 2022] POST /identity/v3/projects => generated 375 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:42:59.512672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294e777-1d09-49f1-9ae6-a485bf626d89 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:59.695236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644ca7c-37f7-46a7-a94e-499e704954db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:59.700069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644ca7c-37f7-46a7-a94e-499e704954db admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:59.700069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644ca7c-37f7-46a7-a94e-499e704954db admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:59.700069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644ca7c-37f7-46a7-a94e-499e704954db admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:59.700069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644ca7c-37f7-46a7-a94e-499e704954db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:59.702116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644ca7c-37f7-46a7-a94e-499e704954db admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:59.867029 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1440/2915] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:42:59 2022] POST /identity/v3/users => generated 294 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:42:59.870424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4323a05-3020-405b-9088-29d11f5ecc93 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:59.888388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4323a05-3020-405b-9088-29d11f5ecc93 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:59.898618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a2bc5-fd66-4e6d-8f49-4ea9eef60e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:59.899651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a2bc5-fd66-4e6d-8f49-4ea9eef60e7a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:59.901406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a2bc5-fd66-4e6d-8f49-4ea9eef60e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:59.901871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a2bc5-fd66-4e6d-8f49-4ea9eef60e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:42:59.903093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a2bc5-fd66-4e6d-8f49-4ea9eef60e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:42:59.906101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a2bc5-fd66-4e6d-8f49-4ea9eef60e7a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:42:59.952326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644ca7c-37f7-46a7-a94e-499e704954db admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:42:59.955176 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1476/2916] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:42:59.969364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644ca7c-37f7-46a7-a94e-499e704954db admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:42:59.980274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9aadd2-c264-431e-90eb-b356364cb616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:42:59.988928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aadd2-c264-431e-90eb-b356364cb616 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:42:59.988928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aadd2-c264-431e-90eb-b356364cb616 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:42:59.988928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aadd2-c264-431e-90eb-b356364cb616 admin admin] PATH_INFO: `/v3/projects/f3a3fe5b51b347ada4ed8ec28f494116/users/50eb07b5e2984154b9913bc35f8047dc/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:00.007253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:00.029794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9aadd2-c264-431e-90eb-b356364cb616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a3fe5b51b347ada4ed8ec28f494116, user_id=50eb07b5e2984154b9913bc35f8047dc, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:00.034688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9aadd2-c264-431e-90eb-b356364cb616 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:00.180987 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1441/2917] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:42:59 2022] PUT /identity/v3/projects/f3a3fe5b51b347ada4ed8ec28f494116/users/50eb07b5e2984154b9913bc35f8047dc/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:00.187251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a2bc5-fd66-4e6d-8f49-4ea9eef60e7a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:00.204761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a2bc5-fd66-4e6d-8f49-4ea9eef60e7a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:00.282444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73a1d1-1c03-4f0f-a5ea-63858ef6acb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:00.283273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73a1d1-1c03-4f0f-a5ea-63858ef6acb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:00.283621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73a1d1-1c03-4f0f-a5ea-63858ef6acb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:00.283963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73a1d1-1c03-4f0f-a5ea-63858ef6acb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:00.285354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73a1d1-1c03-4f0f-a5ea-63858ef6acb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:00.287110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73a1d1-1c03-4f0f-a5ea-63858ef6acb5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:00.301063 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1477/2918] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:00.305654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9aadd2-c264-431e-90eb-b356364cb616 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:00.327372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9aadd2-c264-431e-90eb-b356364cb616 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:00.343231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1c66b-9288-429b-a93a-b5db27a8f319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:00.360887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1c66b-9288-429b-a93a-b5db27a8f319 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:00.360887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1c66b-9288-429b-a93a-b5db27a8f319 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:00.360887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1c66b-9288-429b-a93a-b5db27a8f319 admin admin] PATH_INFO: `/v3/projects/f3a3fe5b51b347ada4ed8ec28f494116/users/50eb07b5e2984154b9913bc35f8047dc/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:00.381328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1c66b-9288-429b-a93a-b5db27a8f319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a3fe5b51b347ada4ed8ec28f494116, user_id=50eb07b5e2984154b9913bc35f8047dc, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:00.389453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1c66b-9288-429b-a93a-b5db27a8f319 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:00.436791 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1442/2919] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:00 2022] PUT /identity/v3/projects/f3a3fe5b51b347ada4ed8ec28f494116/users/50eb07b5e2984154b9913bc35f8047dc/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:00.443256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b2292-46cf-47f2-9d47-ee483d6d98d1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:00.443742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b2292-46cf-47f2-9d47-ee483d6d98d1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:00.444265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b2292-46cf-47f2-9d47-ee483d6d98d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:00.522476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d86b2292-46cf-47f2-9d47-ee483d6d98d1 None None] MFA Rules not processed for user `50eb07b5e2984154b9913bc35f8047dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:00.524730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d86b2292-46cf-47f2-9d47-ee483d6d98d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:00.694231 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1478/2920] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:00.695105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1c66b-9288-429b-a93a-b5db27a8f319 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:00.725832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1c66b-9288-429b-a93a-b5db27a8f319 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:00.734436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821bb94-37cf-4ec7-ab0a-b7ac7172c8fc tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50eb07b5e2984154b9913bc35f8047dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a3fe5b51b347ada4ed8ec28f494116', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:00.735141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821bb94-37cf-4ec7-ab0a-b7ac7172c8fc tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:00.735608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821bb94-37cf-4ec7-ab0a-b7ac7172c8fc tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:00.735861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821bb94-37cf-4ec7-ab0a-b7ac7172c8fc tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:00.736622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821bb94-37cf-4ec7-ab0a-b7ac7172c8fc tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:00.737025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821bb94-37cf-4ec7-ab0a-b7ac7172c8fc tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:00.739438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821bb94-37cf-4ec7-ab0a-b7ac7172c8fc tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:00.761725 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1443/2921] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:00.766399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b2292-46cf-47f2-9d47-ee483d6d98d1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:00.803417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b2292-46cf-47f2-9d47-ee483d6d98d1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:00.819888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a71fcd-cef7-41b4-a99a-bea80c0e3c4a tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50eb07b5e2984154b9913bc35f8047dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a3fe5b51b347ada4ed8ec28f494116', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:00.820550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a71fcd-cef7-41b4-a99a-bea80c0e3c4a tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:00.820859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a71fcd-cef7-41b4-a99a-bea80c0e3c4a tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:00.821112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a71fcd-cef7-41b4-a99a-bea80c0e3c4a tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:00.821752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a71fcd-cef7-41b4-a99a-bea80c0e3c4a tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:00.823714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a71fcd-cef7-41b4-a99a-bea80c0e3c4a tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:00.856482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821bb94-37cf-4ec7-ab0a-b7ac7172c8fc tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:00.856482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d821bb94-37cf-4ec7-ab0a-b7ac7172c8fc tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:01.030051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821bb94-37cf-4ec7-ab0a-b7ac7172c8fc tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:01.043864 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1479/2922] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:43:00 2022] POST /identity/v3/projects => generated 371 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:01.045586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a71fcd-cef7-41b4-a99a-bea80c0e3c4a tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:01.244822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a71fcd-cef7-41b4-a99a-bea80c0e3c4a tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:01.268463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e92c1f-a858-42c5-8fe9-373dfc475f70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50eb07b5e2984154b9913bc35f8047dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a3fe5b51b347ada4ed8ec28f494116', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:01.268785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abff858-5694-4872-89df-02ecec64f221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:01.269366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e92c1f-a858-42c5-8fe9-373dfc475f70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:01.269637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e92c1f-a858-42c5-8fe9-373dfc475f70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:01.269909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e92c1f-a858-42c5-8fe9-373dfc475f70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:01.270237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abff858-5694-4872-89df-02ecec64f221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:01.270592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e92c1f-a858-42c5-8fe9-373dfc475f70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:01.270884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e92c1f-a858-42c5-8fe9-373dfc475f70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:01.271200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abff858-5694-4872-89df-02ecec64f221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:01.272817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e92c1f-a858-42c5-8fe9-373dfc475f70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:01.273087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abff858-5694-4872-89df-02ecec64f221 admin admin] PATH_INFO: `/v3/users/42217ef789054d53a80b59bad1364562` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:01.278894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abff858-5694-4872-89df-02ecec64f221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42217ef789054d53a80b59bad1364562)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:01.282406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abff858-5694-4872-89df-02ecec64f221 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:01.322527 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1480/2923] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:43:01.462562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e92c1f-a858-42c5-8fe9-373dfc475f70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:01.464784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-02e92c1f-a858-42c5-8fe9-373dfc475f70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:01.610304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e92c1f-a858-42c5-8fe9-373dfc475f70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:01.617212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62171c13-575b-4895-8f31-1d73d5db782d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:01.617849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62171c13-575b-4895-8f31-1d73d5db782d service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:01.618301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62171c13-575b-4895-8f31-1d73d5db782d service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:01.618585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62171c13-575b-4895-8f31-1d73d5db782d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:01.664872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6abff858-5694-4872-89df-02ecec64f221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42217ef789054d53a80b59bad1364562'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:01.670571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62171c13-575b-4895-8f31-1d73d5db782d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:01.674844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62171c13-575b-4895-8f31-1d73d5db782d service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:01.704657 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1481/2924] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:43:01.730955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e8f35-7b13-45f4-a80e-10f36193e4ab None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:01.731490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e8f35-7b13-45f4-a80e-10f36193e4ab None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:01.732037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e8f35-7b13-45f4-a80e-10f36193e4ab None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:01.733566 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1482/2925] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:43:01.738744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e8f35-7b13-45f4-a80e-10f36193e4ab None None] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:43:01.782375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e8f35-7b13-45f4-a80e-10f36193e4ab None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:01.813583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e8f35-7b13-45f4-a80e-10f36193e4ab None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:01.828881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ac83a-2b8e-4c65-a7b8-472e702b0e3d tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50eb07b5e2984154b9913bc35f8047dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a3fe5b51b347ada4ed8ec28f494116', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:01.829769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ac83a-2b8e-4c65-a7b8-472e702b0e3d tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:01.830124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ac83a-2b8e-4c65-a7b8-472e702b0e3d tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:01.830464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ac83a-2b8e-4c65-a7b8-472e702b0e3d tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] PATH_INFO: `/v3/projects/8f25cb73e84f4be7b6e48586926de7a6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:01.833349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ac83a-2b8e-4c65-a7b8-472e702b0e3d tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorizing `identity:get_project(project_id=8f25cb73e84f4be7b6e48586926de7a6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:01.835514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ac83a-2b8e-4c65-a7b8-472e702b0e3d tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:01.840193 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1483/2926] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:43:01 2022] GET /identity/v3/projects/8f25cb73e84f4be7b6e48586926de7a6 => generated 371 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:01.908653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6abff858-5694-4872-89df-02ecec64f221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42217ef789054d53a80b59bad1364562'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:01.909318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6abff858-5694-4872-89df-02ecec64f221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42217ef789054d53a80b59bad1364562'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:01.919614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6abff858-5694-4872-89df-02ecec64f221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42217ef789054d53a80b59bad1364562'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:01.962747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6abff858-5694-4872-89df-02ecec64f221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42217ef789054d53a80b59bad1364562'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:01.982140 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1444/2927] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:43:00 2022] DELETE /identity/v3/users/42217ef789054d53a80b59bad1364562 => generated 0 bytes in 1139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:01.986831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849f329-2030-488b-b6e8-3420bb412aed None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:01.987112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849f329-2030-488b-b6e8-3420bb412aed None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:01.987978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849f329-2030-488b-b6e8-3420bb412aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:02.045567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d849f329-2030-488b-b6e8-3420bb412aed None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:02.047665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d849f329-2030-488b-b6e8-3420bb412aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:02.256365 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1484/2928] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:02.312727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abff858-5694-4872-89df-02ecec64f221 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:02.314603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6abff858-5694-4872-89df-02ecec64f221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:02.466981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abff858-5694-4872-89df-02ecec64f221 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:02.485937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fb17b-4db3-4e9d-9c89-9e69be193598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:02.486584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fb17b-4db3-4e9d-9c89-9e69be193598 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:02.486869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fb17b-4db3-4e9d-9c89-9e69be193598 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:02.487144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fb17b-4db3-4e9d-9c89-9e69be193598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:02.555305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fb17b-4db3-4e9d-9c89-9e69be193598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:02.556847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fb17b-4db3-4e9d-9c89-9e69be193598 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:02.590850 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1445/2929] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:02.628277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a12e64-06b4-4b3f-af8c-1e26e66d6eba None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:02.629209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a12e64-06b4-4b3f-af8c-1e26e66d6eba None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:02.629624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a12e64-06b4-4b3f-af8c-1e26e66d6eba None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:02.631896 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1485/2930] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:43:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:43:02.638517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fb17b-4db3-4e9d-9c89-9e69be193598 service neutron] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:43:02.641156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1a8fb17b-4db3-4e9d-9c89-9e69be193598 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:02.747916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fb17b-4db3-4e9d-9c89-9e69be193598 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:02.750777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1a8fb17b-4db3-4e9d-9c89-9e69be193598 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:02.852970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fb17b-4db3-4e9d-9c89-9e69be193598 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:02.862479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba510ffe-cf69-4de2-9c71-8c6885bcfffb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50eb07b5e2984154b9913bc35f8047dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a3fe5b51b347ada4ed8ec28f494116', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:02.863193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba510ffe-cf69-4de2-9c71-8c6885bcfffb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:02.863414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba510ffe-cf69-4de2-9c71-8c6885bcfffb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:02.863885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba510ffe-cf69-4de2-9c71-8c6885bcfffb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] PATH_INFO: `/v3/projects/8f25cb73e84f4be7b6e48586926de7a6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:02.865812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba510ffe-cf69-4de2-9c71-8c6885bcfffb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorizing `identity:get_project(project_id=8f25cb73e84f4be7b6e48586926de7a6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:02.867927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba510ffe-cf69-4de2-9c71-8c6885bcfffb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:02.870208 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1446/2931] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:43:02 2022] GET /identity/v3/projects/8f25cb73e84f4be7b6e48586926de7a6 => generated 371 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:02.974587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a12e64-06b4-4b3f-af8c-1e26e66d6eba None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:02.988777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:02.994795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a12e64-06b4-4b3f-af8c-1e26e66d6eba None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:03.011171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d516231-c5d0-481d-a181-59b225c0fc70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50eb07b5e2984154b9913bc35f8047dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a3fe5b51b347ada4ed8ec28f494116', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:03.012617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d516231-c5d0-481d-a181-59b225c0fc70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:03.013234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d516231-c5d0-481d-a181-59b225c0fc70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:03.013850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d516231-c5d0-481d-a181-59b225c0fc70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:03.014757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d516231-c5d0-481d-a181-59b225c0fc70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:03.015275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d516231-c5d0-481d-a181-59b225c0fc70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:03.017448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d516231-c5d0-481d-a181-59b225c0fc70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:03.062051 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1486/2932] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:03.062937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba510ffe-cf69-4de2-9c71-8c6885bcfffb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:03.084496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba510ffe-cf69-4de2-9c71-8c6885bcfffb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:03.091200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97edbd-bfee-40f3-8f01-e6f26bcd90ff tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50eb07b5e2984154b9913bc35f8047dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a3fe5b51b347ada4ed8ec28f494116', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:03.091889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97edbd-bfee-40f3-8f01-e6f26bcd90ff tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:03.092190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97edbd-bfee-40f3-8f01-e6f26bcd90ff tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:03.092658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97edbd-bfee-40f3-8f01-e6f26bcd90ff tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:03.094219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97edbd-bfee-40f3-8f01-e6f26bcd90ff tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:03.096823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97edbd-bfee-40f3-8f01-e6f26bcd90ff tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:03.149069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:03.223068 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1447/2933] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:43:03 2022] POST /identity/v3/users => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:03.224614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d516231-c5d0-481d-a181-59b225c0fc70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:03.237351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d516231-c5d0-481d-a181-59b225c0fc70 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:03.252502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465a98e-249b-40e9-9cbd-a0d412fe4aa3 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50eb07b5e2984154b9913bc35f8047dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a3fe5b51b347ada4ed8ec28f494116', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:03.253737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465a98e-249b-40e9-9cbd-a0d412fe4aa3 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:03.261421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465a98e-249b-40e9-9cbd-a0d412fe4aa3 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:03.261421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465a98e-249b-40e9-9cbd-a0d412fe4aa3 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:03.261421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465a98e-249b-40e9-9cbd-a0d412fe4aa3 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:03.261421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465a98e-249b-40e9-9cbd-a0d412fe4aa3 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:03.264443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465a98e-249b-40e9-9cbd-a0d412fe4aa3 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:03.281631 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1487/2934] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:03.306175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b1437-d610-47e8-9cd6-341ca151cf2e None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:03.306620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b1437-d610-47e8-9cd6-341ca151cf2e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:03.306993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b1437-d610-47e8-9cd6-341ca151cf2e None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:03.308746 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1448/2935] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:43:03.313973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465a98e-249b-40e9-9cbd-a0d412fe4aa3 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:43:03.340609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465a98e-249b-40e9-9cbd-a0d412fe4aa3 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:03.366864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465a98e-249b-40e9-9cbd-a0d412fe4aa3 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:03.381573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735d1a8-06b5-437b-b198-6d877d4e9e85 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50eb07b5e2984154b9913bc35f8047dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a3fe5b51b347ada4ed8ec28f494116', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:03.383370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735d1a8-06b5-437b-b198-6d877d4e9e85 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:03.383370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735d1a8-06b5-437b-b198-6d877d4e9e85 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:03.383370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735d1a8-06b5-437b-b198-6d877d4e9e85 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] PATH_INFO: `/v3/projects/8f25cb73e84f4be7b6e48586926de7a6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:03.384252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735d1a8-06b5-437b-b198-6d877d4e9e85 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorizing `identity:get_project(project_id=8f25cb73e84f4be7b6e48586926de7a6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:03.386313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735d1a8-06b5-437b-b198-6d877d4e9e85 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:03.389272 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1488/2936] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:43:03 2022] GET /identity/v3/projects/8f25cb73e84f4be7b6e48586926de7a6 => generated 371 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:04.234500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:04.396351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604330c-2719-493a-be69-e02f2c44d1e9 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:04.396719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604330c-2719-493a-be69-e02f2c44d1e9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:04.397335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604330c-2719-493a-be69-e02f2c44d1e9 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:04.399395 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1449/2937] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:43:04.406996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735d1a8-06b5-437b-b198-6d877d4e9e85 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:43:04.424033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735d1a8-06b5-437b-b198-6d877d4e9e85 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:04.443303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735d1a8-06b5-437b-b198-6d877d4e9e85 tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:04.456392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8a920-ea66-4790-b612-34438542192f tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50eb07b5e2984154b9913bc35f8047dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a3fe5b51b347ada4ed8ec28f494116', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:04.457096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8a920-ea66-4790-b612-34438542192f tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:04.457384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8a920-ea66-4790-b612-34438542192f tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:04.457857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8a920-ea66-4790-b612-34438542192f tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] PATH_INFO: `/v3/projects/8f25cb73e84f4be7b6e48586926de7a6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:04.459335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8a920-ea66-4790-b612-34438542192f tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorizing `identity:get_project(project_id=8f25cb73e84f4be7b6e48586926de7a6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:04.462104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8a920-ea66-4790-b612-34438542192f tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:04.473668 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1489/2938] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:43:04 2022] GET /identity/v3/projects/8f25cb73e84f4be7b6e48586926de7a6 => generated 371 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:04.517836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604330c-2719-493a-be69-e02f2c44d1e9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:04.539009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604330c-2719-493a-be69-e02f2c44d1e9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:04.566195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7f223-2d5b-4fc8-ba43-6f4ff84444db tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50eb07b5e2984154b9913bc35f8047dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a3fe5b51b347ada4ed8ec28f494116', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:04.566195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7f223-2d5b-4fc8-ba43-6f4ff84444db tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:04.566195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7f223-2d5b-4fc8-ba43-6f4ff84444db tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:04.566595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7f223-2d5b-4fc8-ba43-6f4ff84444db tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] PATH_INFO: `/v3/users/7fd137a30dd940b1a691f711f56207a8` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:04.614199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7f223-2d5b-4fc8-ba43-6f4ff84444db tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7fd137a30dd940b1a691f711f56207a8)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:04.623354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7f223-2d5b-4fc8-ba43-6f4ff84444db tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:04.714305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8a920-ea66-4790-b612-34438542192f tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:04.716839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-27b8a920-ea66-4790-b612-34438542192f tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:04.759505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8a920-ea66-4790-b612-34438542192f tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:04.776906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dba0bd-d04b-4683-bca5-5c864c2b1e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:04.778198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dba0bd-d04b-4683-bca5-5c864c2b1e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:04.778474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dba0bd-d04b-4683-bca5-5c864c2b1e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:04.778736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dba0bd-d04b-4683-bca5-5c864c2b1e2e admin admin] PATH_INFO: `/v3/projects/7bac987530e04d23a770e70ed07a0a36` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:04.782600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dba0bd-d04b-4683-bca5-5c864c2b1e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bac987530e04d23a770e70ed07a0a36)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:04.784845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dba0bd-d04b-4683-bca5-5c864c2b1e2e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:04.819220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1f7f223-2d5b-4fc8-ba43-6f4ff84444db tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd137a30dd940b1a691f711f56207a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:04.950124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:04.950784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1f7f223-2d5b-4fc8-ba43-6f4ff84444db tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd137a30dd940b1a691f711f56207a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:04.951455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1f7f223-2d5b-4fc8-ba43-6f4ff84444db tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd137a30dd940b1a691f711f56207a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:04.963122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1f7f223-2d5b-4fc8-ba43-6f4ff84444db tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd137a30dd940b1a691f711f56207a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:04.983466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1f7f223-2d5b-4fc8-ba43-6f4ff84444db tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd137a30dd940b1a691f711f56207a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:04.991998 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1450/2939] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:43:04 2022] DELETE /identity/v3/users/7fd137a30dd940b1a691f711f56207a8 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:05.001784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7f223-2d5b-4fc8-ba43-6f4ff84444db tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:05.004874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a1f7f223-2d5b-4fc8-ba43-6f4ff84444db tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:05.032278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94dba0bd-d04b-4683-bca5-5c864c2b1e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bac987530e04d23a770e70ed07a0a36', 'request_id': 'req-94dba0bd-d04b-4683-bca5-5c864c2b1e2e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:05.040777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94dba0bd-d04b-4683-bca5-5c864c2b1e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bac987530e04d23a770e70ed07a0a36', 'request_id': 'req-94dba0bd-d04b-4683-bca5-5c864c2b1e2e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:05.100609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7f223-2d5b-4fc8-ba43-6f4ff84444db tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:05.247807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d73fba-58d5-4248-a614-998874223ccb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50eb07b5e2984154b9913bc35f8047dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3a3fe5b51b347ada4ed8ec28f494116', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:05.248729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d73fba-58d5-4248-a614-998874223ccb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:05.249013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d73fba-58d5-4248-a614-998874223ccb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:05.249685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d73fba-58d5-4248-a614-998874223ccb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] PATH_INFO: `/v3/projects/8f25cb73e84f4be7b6e48586926de7a6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:05.251048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d73fba-58d5-4248-a614-998874223ccb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8f25cb73e84f4be7b6e48586926de7a6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:05.251260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94dba0bd-d04b-4683-bca5-5c864c2b1e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bac987530e04d23a770e70ed07a0a36', 'request_id': 'req-94dba0bd-d04b-4683-bca5-5c864c2b1e2e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:05.253456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d73fba-58d5-4248-a614-998874223ccb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:05.272621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94dba0bd-d04b-4683-bca5-5c864c2b1e2e admin admin] The token cache is being invalidate because project 7bac987530e04d23a770e70ed07a0a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:43:05.273173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94dba0bd-d04b-4683-bca5-5c864c2b1e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:05.274285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94dba0bd-d04b-4683-bca5-5c864c2b1e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:05.284087 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1490/2940] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:04 2022] DELETE /identity/v3/projects/7bac987530e04d23a770e70ed07a0a36 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:43:05.285991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8370a9-d746-4613-9140-c104a28aa01b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:05.286590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8370a9-d746-4613-9140-c104a28aa01b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:05.287016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8370a9-d746-4613-9140-c104a28aa01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:05.347505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9b8370a9-d746-4613-9140-c104a28aa01b None None] MFA Rules not processed for user `bb90f64664c74949ad58644bcbdafdfc`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:05.354315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9b8370a9-d746-4613-9140-c104a28aa01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:05.503229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-87d73fba-58d5-4248-a614-998874223ccb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f25cb73e84f4be7b6e48586926de7a6', 'request_id': 'req-87d73fba-58d5-4248-a614-998874223ccb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:05.526567 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1491/2941] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:05.528950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80142802-389a-4b0a-ad46-9c58fdfd2a7d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:05.529391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80142802-389a-4b0a-ad46-9c58fdfd2a7d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:05.529802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80142802-389a-4b0a-ad46-9c58fdfd2a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:05.548269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-87d73fba-58d5-4248-a614-998874223ccb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f25cb73e84f4be7b6e48586926de7a6', 'request_id': 'req-87d73fba-58d5-4248-a614-998874223ccb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:05.581015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-87d73fba-58d5-4248-a614-998874223ccb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f25cb73e84f4be7b6e48586926de7a6', 'request_id': 'req-87d73fba-58d5-4248-a614-998874223ccb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:05.596020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-80142802-389a-4b0a-ad46-9c58fdfd2a7d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:05.597435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-80142802-389a-4b0a-ad46-9c58fdfd2a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:05.733573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-87d73fba-58d5-4248-a614-998874223ccb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] The token cache is being invalidate because project 8f25cb73e84f4be7b6e48586926de7a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:43:05.733887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-87d73fba-58d5-4248-a614-998874223ccb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:05.734601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-87d73fba-58d5-4248-a614-998874223ccb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:05.738399 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1451/2942] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:05 2022] DELETE /identity/v3/projects/8f25cb73e84f4be7b6e48586926de7a6 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:05.747040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d73fba-58d5-4248-a614-998874223ccb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:05.750917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-87d73fba-58d5-4248-a614-998874223ccb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:05.797175 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1492/2943] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:05.803030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107edc7-cf52-434b-8e26-dbde387161de None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:05.803316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107edc7-cf52-434b-8e26-dbde387161de None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:05.803806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107edc7-cf52-434b-8e26-dbde387161de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:05.849035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0107edc7-cf52-434b-8e26-dbde387161de None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:05.850272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0107edc7-cf52-434b-8e26-dbde387161de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:05.869522 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1493/2944] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:43:05.875511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107edc7-cf52-434b-8e26-dbde387161de None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:05.904949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107edc7-cf52-434b-8e26-dbde387161de None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:05.917317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d73fba-58d5-4248-a614-998874223ccb tempest-QuotasAdminTestV236-1570550963 tempest-QuotasAdminTestV236-1570550963-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:05.920380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f50b0-9b17-4d4d-9cec-0386a1b6b8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:05.920380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f50b0-9b17-4d4d-9cec-0386a1b6b8ef admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:05.920380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f50b0-9b17-4d4d-9cec-0386a1b6b8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:05.920380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f50b0-9b17-4d4d-9cec-0386a1b6b8ef admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:05.921557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f50b0-9b17-4d4d-9cec-0386a1b6b8ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:05.922107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f50b0-9b17-4d4d-9cec-0386a1b6b8ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:05.923947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f50b0-9b17-4d4d-9cec-0386a1b6b8ef admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:05.936329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cd2f8-6192-430d-81d8-0904a403e457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:05.937051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cd2f8-6192-430d-81d8-0904a403e457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:05.937394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cd2f8-6192-430d-81d8-0904a403e457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:05.937675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cd2f8-6192-430d-81d8-0904a403e457 admin admin] PATH_INFO: `/v3/users/48e68ec125814d3590e37f9cc7aa9d51` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:05.947879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cd2f8-6192-430d-81d8-0904a403e457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e68ec125814d3590e37f9cc7aa9d51)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:05.953404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cd2f8-6192-430d-81d8-0904a403e457 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:05.960497 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1494/2945] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:05.962309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f50b0-9b17-4d4d-9cec-0386a1b6b8ef admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:05.987930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f50b0-9b17-4d4d-9cec-0386a1b6b8ef admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:06.018845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6b399-ee80-49f7-aab3-1f7f95d764d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:06.029711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6b399-ee80-49f7-aab3-1f7f95d764d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:06.029711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6b399-ee80-49f7-aab3-1f7f95d764d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:06.029711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6b399-ee80-49f7-aab3-1f7f95d764d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:06.029711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6b399-ee80-49f7-aab3-1f7f95d764d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:06.029711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6b399-ee80-49f7-aab3-1f7f95d764d0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:06.163983 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1495/2946] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:43:05 2022] POST /identity/v3/projects => generated 403 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:06.172077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6b399-ee80-49f7-aab3-1f7f95d764d0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:06.276881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-751cd2f8-6192-430d-81d8-0904a403e457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e68ec125814d3590e37f9cc7aa9d51'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:06.314935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6b399-ee80-49f7-aab3-1f7f95d764d0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:06.323933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313234c-1e9a-48ac-8e52-f1e29f39eea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:06.325606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313234c-1e9a-48ac-8e52-f1e29f39eea5 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:06.326336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313234c-1e9a-48ac-8e52-f1e29f39eea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:06.327385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313234c-1e9a-48ac-8e52-f1e29f39eea5 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:06.328332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6313234c-1e9a-48ac-8e52-f1e29f39eea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:06.333063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6313234c-1e9a-48ac-8e52-f1e29f39eea5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:06.393841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-751cd2f8-6192-430d-81d8-0904a403e457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e68ec125814d3590e37f9cc7aa9d51'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:06.394480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-751cd2f8-6192-430d-81d8-0904a403e457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e68ec125814d3590e37f9cc7aa9d51'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:06.407773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-751cd2f8-6192-430d-81d8-0904a403e457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e68ec125814d3590e37f9cc7aa9d51'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:06.429965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-751cd2f8-6192-430d-81d8-0904a403e457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e68ec125814d3590e37f9cc7aa9d51'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:06.442462 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1452/2947] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:43:05 2022] DELETE /identity/v3/users/48e68ec125814d3590e37f9cc7aa9d51 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:06.444123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843e016-f810-4ab6-8205-6ed2d3cbf44c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:06.444715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843e016-f810-4ab6-8205-6ed2d3cbf44c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:06.445162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843e016-f810-4ab6-8205-6ed2d3cbf44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:06.447662 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1496/2948] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:43:06 2022] POST /identity/v3/users => generated 302 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:06.451182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79eed3-b29d-4a77-a93d-13687542908d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:06.451904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79eed3-b29d-4a77-a93d-13687542908d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:06.452542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79eed3-b29d-4a77-a93d-13687542908d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:06.456942 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-4843e016-f810-4ab6-8205-6ed2d3cbf44c None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:43:06.456942 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:43:06.456942 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:43:06.456942 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:43:06.456942 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:43:06.456942 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:43:06.456942 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:43:06.456942 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:43:06.456942 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:43:06.456942 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:43:06.456942 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:43:06.456942 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:43:06.456942 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:43:06.457894 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:43:06.457894 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:43:06.457894 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:43:06.457894 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:43:06.457894 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:43:06.457894 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:43:06.457894 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:43:06.457894 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:43:06.457894 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:43:06.457894 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:43:06.457894 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:43:06.457894 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:43:06.457894 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:43:06.457894 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:43:06.457894 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:43:06.458826 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1453/2949] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:43:06 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 15 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:43:06.494246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843e016-f810-4ab6-8205-6ed2d3cbf44c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:06.494246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4843e016-f810-4ab6-8205-6ed2d3cbf44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:06.533981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3d79eed3-b29d-4a77-a93d-13687542908d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:06.537177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3d79eed3-b29d-4a77-a93d-13687542908d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:06.628708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843e016-f810-4ab6-8205-6ed2d3cbf44c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:06.632294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:06.633532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d9fe1-8788-4ff4-90ea-322c7c1c6462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:06.634142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d9fe1-8788-4ff4-90ea-322c7c1c6462 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:06.634421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d9fe1-8788-4ff4-90ea-322c7c1c6462 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:06.635015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d9fe1-8788-4ff4-90ea-322c7c1c6462 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:06.635325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d9fe1-8788-4ff4-90ea-322c7c1c6462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:06.643778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d9fe1-8788-4ff4-90ea-322c7c1c6462 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:06.667923 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1454/2950] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:06.675094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d9fe1-8788-4ff4-90ea-322c7c1c6462 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:06.689959 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1497/2951] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:06.702369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79eed3-b29d-4a77-a93d-13687542908d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:06.703762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3d79eed3-b29d-4a77-a93d-13687542908d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:06.706765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d9fe1-8788-4ff4-90ea-322c7c1c6462 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:06.722702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c9e2f-b479-43d0-9973-8c9ded427a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:06.728936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c9e2f-b479-43d0-9973-8c9ded427a27 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:06.728936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c9e2f-b479-43d0-9973-8c9ded427a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:06.728936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c9e2f-b479-43d0-9973-8c9ded427a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:06.728936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c9e2f-b479-43d0-9973-8c9ded427a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:06.728936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c9e2f-b479-43d0-9973-8c9ded427a27 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:06.754959 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1455/2952] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:06.755877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c9e2f-b479-43d0-9973-8c9ded427a27 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:06.775037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c9e2f-b479-43d0-9973-8c9ded427a27 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:06.791460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da3589-fda7-44f8-b26d-c6b085d287fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:06.792134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da3589-fda7-44f8-b26d-c6b085d287fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:06.792780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da3589-fda7-44f8-b26d-c6b085d287fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:06.792780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da3589-fda7-44f8-b26d-c6b085d287fa admin admin] PATH_INFO: `/v3/projects/7b296dbb8b5647498a6a42689659ed79/users/b8232920ed3f45aaa5b3c6d3844bcd86/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:06.826214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da3589-fda7-44f8-b26d-c6b085d287fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b296dbb8b5647498a6a42689659ed79, user_id=b8232920ed3f45aaa5b3c6d3844bcd86, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:06.826738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79eed3-b29d-4a77-a93d-13687542908d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:06.831881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da3589-fda7-44f8-b26d-c6b085d287fa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:06.838042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3c6bc-a1e9-4a55-aed7-65126473c995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:06.838042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3c6bc-a1e9-4a55-aed7-65126473c995 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:06.838042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3c6bc-a1e9-4a55-aed7-65126473c995 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:06.838042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3c6bc-a1e9-4a55-aed7-65126473c995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:06.859324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3c6bc-a1e9-4a55-aed7-65126473c995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:06.862699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3c6bc-a1e9-4a55-aed7-65126473c995 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:06.900879 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1498/2953] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:43:07.046492 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1456/2954] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:06 2022] PUT /identity/v3/projects/7b296dbb8b5647498a6a42689659ed79/users/b8232920ed3f45aaa5b3c6d3844bcd86/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:07.047032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc097ff-0626-4247-817e-4b679571040a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:07.050082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc097ff-0626-4247-817e-4b679571040a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:07.050082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc097ff-0626-4247-817e-4b679571040a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:07.093510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-cfc097ff-0626-4247-817e-4b679571040a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:07.096730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cfc097ff-0626-4247-817e-4b679571040a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:07.206276 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1499/2955] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:43:07.219774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da3589-fda7-44f8-b26d-c6b085d287fa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:07.221910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-06da3589-fda7-44f8-b26d-c6b085d287fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:07.360333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da3589-fda7-44f8-b26d-c6b085d287fa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:07.367098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7b019-01c0-4959-a54e-80954be20ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:07.368197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7b019-01c0-4959-a54e-80954be20ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:07.368681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7b019-01c0-4959-a54e-80954be20ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:07.369636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7b019-01c0-4959-a54e-80954be20ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:07.384323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7b019-01c0-4959-a54e-80954be20ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:07.386087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7b019-01c0-4959-a54e-80954be20ad8 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:07.423815 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1457/2956] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:07.808584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc097ff-0626-4247-817e-4b679571040a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:07.811004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cfc097ff-0626-4247-817e-4b679571040a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:07.832355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc097ff-0626-4247-817e-4b679571040a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:07.845037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3863e-8723-405f-9912-986ae7b63b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:07.846189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3863e-8723-405f-9912-986ae7b63b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:07.846603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3863e-8723-405f-9912-986ae7b63b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:07.846948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3863e-8723-405f-9912-986ae7b63b90 admin admin] PATH_INFO: `/v3/projects/cbe47e4f64ed40f6a0bf07c4d0668c17` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:07.859613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3863e-8723-405f-9912-986ae7b63b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe47e4f64ed40f6a0bf07c4d0668c17)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:07.866912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3863e-8723-405f-9912-986ae7b63b90 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:08.067452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e8e3863e-8723-405f-9912-986ae7b63b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe47e4f64ed40f6a0bf07c4d0668c17', 'request_id': 'req-e8e3863e-8723-405f-9912-986ae7b63b90'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:08.079206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e8e3863e-8723-405f-9912-986ae7b63b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe47e4f64ed40f6a0bf07c4d0668c17', 'request_id': 'req-e8e3863e-8723-405f-9912-986ae7b63b90'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:08.187321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e8e3863e-8723-405f-9912-986ae7b63b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe47e4f64ed40f6a0bf07c4d0668c17', 'request_id': 'req-e8e3863e-8723-405f-9912-986ae7b63b90'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:08.205454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e8e3863e-8723-405f-9912-986ae7b63b90 admin admin] The token cache is being invalidate because project cbe47e4f64ed40f6a0bf07c4d0668c17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:43:08.205746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e8e3863e-8723-405f-9912-986ae7b63b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:08.208513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e8e3863e-8723-405f-9912-986ae7b63b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:08.214192 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1500/2957] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:07 2022] DELETE /identity/v3/projects/cbe47e4f64ed40f6a0bf07c4d0668c17 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:08.218469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7b019-01c0-4959-a54e-80954be20ad8 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:08.229213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7b019-01c0-4959-a54e-80954be20ad8 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:08.254271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a5021-2735-426e-b0b0-4950461a5fe0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:08.254271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a5021-2735-426e-b0b0-4950461a5fe0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:08.254271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a5021-2735-426e-b0b0-4950461a5fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:08.273571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f30a5021-2735-426e-b0b0-4950461a5fe0 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:08.274781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f30a5021-2735-426e-b0b0-4950461a5fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:08.294409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e53cd2-f1c0-49c8-8aa1-3a20ef8e6b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:08.294968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e53cd2-f1c0-49c8-8aa1-3a20ef8e6b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:08.295249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e53cd2-f1c0-49c8-8aa1-3a20ef8e6b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:08.295526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e53cd2-f1c0-49c8-8aa1-3a20ef8e6b4c admin admin] PATH_INFO: `/v3/users/50eb07b5e2984154b9913bc35f8047dc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:08.296686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e53cd2-f1c0-49c8-8aa1-3a20ef8e6b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=50eb07b5e2984154b9913bc35f8047dc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:08.298817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e53cd2-f1c0-49c8-8aa1-3a20ef8e6b4c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:08.345968 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1501/2958] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:43:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:43:08.363793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a5021-2735-426e-b0b0-4950461a5fe0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:08.366016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f30a5021-2735-426e-b0b0-4950461a5fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:08.485225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a5021-2735-426e-b0b0-4950461a5fe0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:08.491925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d5d38-1047-4c78-8922-4e76bab589ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:08.492562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d5d38-1047-4c78-8922-4e76bab589ae service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:08.493170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d5d38-1047-4c78-8922-4e76bab589ae service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:08.493524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d5d38-1047-4c78-8922-4e76bab589ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:08.505427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d5d38-1047-4c78-8922-4e76bab589ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:08.508304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d5d38-1047-4c78-8922-4e76bab589ae service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:08.521906 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1502/2959] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:43:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:08.570838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f0e53cd2-f1c0-49c8-8aa1-3a20ef8e6b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50eb07b5e2984154b9913bc35f8047dc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:08.696994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f0e53cd2-f1c0-49c8-8aa1-3a20ef8e6b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50eb07b5e2984154b9913bc35f8047dc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:08.697782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f0e53cd2-f1c0-49c8-8aa1-3a20ef8e6b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50eb07b5e2984154b9913bc35f8047dc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:08.708026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f0e53cd2-f1c0-49c8-8aa1-3a20ef8e6b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50eb07b5e2984154b9913bc35f8047dc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:08.742567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f0e53cd2-f1c0-49c8-8aa1-3a20ef8e6b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50eb07b5e2984154b9913bc35f8047dc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:08.762419 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1458/2960] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:43:08 2022] DELETE /identity/v3/users/50eb07b5e2984154b9913bc35f8047dc => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:09.076941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d5d38-1047-4c78-8922-4e76bab589ae service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:09.079840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d80d5d38-1047-4c78-8922-4e76bab589ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:09.118185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d5d38-1047-4c78-8922-4e76bab589ae service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:09.211718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f47bd-a33e-414c-b45f-795fec67ea9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:09.211718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f47bd-a33e-414c-b45f-795fec67ea9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:09.211718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f47bd-a33e-414c-b45f-795fec67ea9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:09.211718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f47bd-a33e-414c-b45f-795fec67ea9a admin admin] PATH_INFO: `/v3/users/6cae3b62c5af4bf9ad5be777429d4568` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:09.212281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f47bd-a33e-414c-b45f-795fec67ea9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cae3b62c5af4bf9ad5be777429d4568)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:09.214566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f47bd-a33e-414c-b45f-795fec67ea9a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:09.689250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4f0f47bd-a33e-414c-b45f-795fec67ea9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cae3b62c5af4bf9ad5be777429d4568'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:09.689250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4f0f47bd-a33e-414c-b45f-795fec67ea9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cae3b62c5af4bf9ad5be777429d4568'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:09.822752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4f0f47bd-a33e-414c-b45f-795fec67ea9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cae3b62c5af4bf9ad5be777429d4568'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:09.823452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4f0f47bd-a33e-414c-b45f-795fec67ea9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cae3b62c5af4bf9ad5be777429d4568'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:09.856790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4f0f47bd-a33e-414c-b45f-795fec67ea9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cae3b62c5af4bf9ad5be777429d4568'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:09.879673 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1503/2961] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:43:09 2022] DELETE /identity/v3/users/6cae3b62c5af4bf9ad5be777429d4568 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:09.883893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fe3ee-e3db-4e04-8c9b-f31549f82058 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:09.884394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fe3ee-e3db-4e04-8c9b-f31549f82058 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:09.884494 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fe3ee-e3db-4e04-8c9b-f31549f82058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:09.910357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9a2fe3ee-e3db-4e04-8c9b-f31549f82058 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:09.911879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9a2fe3ee-e3db-4e04-8c9b-f31549f82058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:10.000205 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1459/2962] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:10.009337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f47bd-a33e-414c-b45f-795fec67ea9a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:10.010900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4f0f47bd-a33e-414c-b45f-795fec67ea9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:10.071383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f47bd-a33e-414c-b45f-795fec67ea9a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:10.075569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b3d99-bd7f-4e74-97a8-e15927ab2f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:10.076322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b3d99-bd7f-4e74-97a8-e15927ab2f4d service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:10.076668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b3d99-bd7f-4e74-97a8-e15927ab2f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:10.077005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b3d99-bd7f-4e74-97a8-e15927ab2f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:10.086969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b3d99-bd7f-4e74-97a8-e15927ab2f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:10.088491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b3d99-bd7f-4e74-97a8-e15927ab2f4d service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:10.099231 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1504/2963] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:10.156464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:10.285928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fe3ee-e3db-4e04-8c9b-f31549f82058 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:10.287999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9a2fe3ee-e3db-4e04-8c9b-f31549f82058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:10.335469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fe3ee-e3db-4e04-8c9b-f31549f82058 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:10.347692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63effa2-36e4-43ac-88e0-7b8dc50e3361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:10.353460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63effa2-36e4-43ac-88e0-7b8dc50e3361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:10.354189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63effa2-36e4-43ac-88e0-7b8dc50e3361 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:10.354645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63effa2-36e4-43ac-88e0-7b8dc50e3361 admin admin] PATH_INFO: `/v3/projects/f3a3fe5b51b347ada4ed8ec28f494116` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:10.356870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63effa2-36e4-43ac-88e0-7b8dc50e3361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a3fe5b51b347ada4ed8ec28f494116)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:10.359579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63effa2-36e4-43ac-88e0-7b8dc50e3361 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:10.537480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e63effa2-36e4-43ac-88e0-7b8dc50e3361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a3fe5b51b347ada4ed8ec28f494116', 'request_id': 'req-e63effa2-36e4-43ac-88e0-7b8dc50e3361'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:10.546532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e63effa2-36e4-43ac-88e0-7b8dc50e3361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a3fe5b51b347ada4ed8ec28f494116', 'request_id': 'req-e63effa2-36e4-43ac-88e0-7b8dc50e3361'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:10.552960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e63effa2-36e4-43ac-88e0-7b8dc50e3361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a3fe5b51b347ada4ed8ec28f494116', 'request_id': 'req-e63effa2-36e4-43ac-88e0-7b8dc50e3361'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:10.619087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e63effa2-36e4-43ac-88e0-7b8dc50e3361 admin admin] The token cache is being invalidate because project f3a3fe5b51b347ada4ed8ec28f494116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:43:10.619590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e63effa2-36e4-43ac-88e0-7b8dc50e3361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:10.621821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e63effa2-36e4-43ac-88e0-7b8dc50e3361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:10.624056 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1460/2964] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:10 2022] DELETE /identity/v3/projects/f3a3fe5b51b347ada4ed8ec28f494116 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:10.630426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2cd69-bbca-41c4-b2c8-a354f8c2a967 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:10.630945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2cd69-bbca-41c4-b2c8-a354f8c2a967 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:10.631372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2cd69-bbca-41c4-b2c8-a354f8c2a967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:10.665723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-58c2cd69-bbca-41c4-b2c8-a354f8c2a967 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:10.667185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-58c2cd69-bbca-41c4-b2c8-a354f8c2a967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:10.804432 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1505/2965] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:10.814650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ff9e0-2b58-4096-a24c-a9d604c13a8f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:10.815316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ff9e0-2b58-4096-a24c-a9d604c13a8f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:10.815784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ff9e0-2b58-4096-a24c-a9d604c13a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:10.846317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f80ff9e0-2b58-4096-a24c-a9d604c13a8f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:10.849080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f80ff9e0-2b58-4096-a24c-a9d604c13a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:10.862694 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1461/2966] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:43:10.867240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2cd69-bbca-41c4-b2c8-a354f8c2a967 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:10.880112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2cd69-bbca-41c4-b2c8-a354f8c2a967 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:10.885455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f6380-866f-425a-a402-c5f3df3f8668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:10.890917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f6380-866f-425a-a402-c5f3df3f8668 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:10.890917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f6380-866f-425a-a402-c5f3df3f8668 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:10.890917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f6380-866f-425a-a402-c5f3df3f8668 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:10.890917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f6380-866f-425a-a402-c5f3df3f8668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:10.890917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f6380-866f-425a-a402-c5f3df3f8668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:10.890917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f6380-866f-425a-a402-c5f3df3f8668 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:10.909835 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1506/2967] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:10.912250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ff9e0-2b58-4096-a24c-a9d604c13a8f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:10.930965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ff9e0-2b58-4096-a24c-a9d604c13a8f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:10.937242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32649edf-6761-4c0d-bc86-9d962e2ad3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:10.938262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32649edf-6761-4c0d-bc86-9d962e2ad3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:10.938787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32649edf-6761-4c0d-bc86-9d962e2ad3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:10.939272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32649edf-6761-4c0d-bc86-9d962e2ad3e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:10.940130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32649edf-6761-4c0d-bc86-9d962e2ad3e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:10.942606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32649edf-6761-4c0d-bc86-9d962e2ad3e1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:10.956861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f6380-866f-425a-a402-c5f3df3f8668 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:10.960439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4e8f6380-866f-425a-a402-c5f3df3f8668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:10.992751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f6380-866f-425a-a402-c5f3df3f8668 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:11.002714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c5e75-a320-418a-bea2-83c85eab8937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:11.003760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c5e75-a320-418a-bea2-83c85eab8937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:11.004306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c5e75-a320-418a-bea2-83c85eab8937 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:11.004959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c5e75-a320-418a-bea2-83c85eab8937 admin admin] PATH_INFO: `/v3/projects/253bab1df8ec4b0da7dd0e5212feb787` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:11.006447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c5e75-a320-418a-bea2-83c85eab8937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=253bab1df8ec4b0da7dd0e5212feb787)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:11.012449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c5e75-a320-418a-bea2-83c85eab8937 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:11.147774 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1462/2968] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:43:10 2022] POST /identity/v3/projects => generated 393 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:11.155737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32649edf-6761-4c0d-bc86-9d962e2ad3e1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:11.250535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32649edf-6761-4c0d-bc86-9d962e2ad3e1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:11.259818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-be7c5e75-a320-418a-bea2-83c85eab8937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253bab1df8ec4b0da7dd0e5212feb787', 'request_id': 'req-be7c5e75-a320-418a-bea2-83c85eab8937'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:11.269411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-be7c5e75-a320-418a-bea2-83c85eab8937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253bab1df8ec4b0da7dd0e5212feb787', 'request_id': 'req-be7c5e75-a320-418a-bea2-83c85eab8937'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:11.279239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:11.388644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4848feb-be83-44da-8e53-60f3625dc4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:11.389451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4848feb-be83-44da-8e53-60f3625dc4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:11.389800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4848feb-be83-44da-8e53-60f3625dc4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:11.390136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4848feb-be83-44da-8e53-60f3625dc4a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:11.390848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4848feb-be83-44da-8e53-60f3625dc4a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:11.393003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4848feb-be83-44da-8e53-60f3625dc4a8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:11.406925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-be7c5e75-a320-418a-bea2-83c85eab8937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253bab1df8ec4b0da7dd0e5212feb787', 'request_id': 'req-be7c5e75-a320-418a-bea2-83c85eab8937'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:11.427006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-be7c5e75-a320-418a-bea2-83c85eab8937 admin admin] The token cache is being invalidate because project 253bab1df8ec4b0da7dd0e5212feb787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:43:11.427672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-be7c5e75-a320-418a-bea2-83c85eab8937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:11.431854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-be7c5e75-a320-418a-bea2-83c85eab8937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:11.435084 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1507/2969] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:10 2022] DELETE /identity/v3/projects/253bab1df8ec4b0da7dd0e5212feb787 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:43:11.441360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acabff-e5d2-4d3e-8b58-385362b4bb58 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:11.442833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acabff-e5d2-4d3e-8b58-385362b4bb58 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:11.444804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acabff-e5d2-4d3e-8b58-385362b4bb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:11.485932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b0acabff-e5d2-4d3e-8b58-385362b4bb58 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:11.487593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b0acabff-e5d2-4d3e-8b58-385362b4bb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:11.501099 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1508/2970] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:43:11.513296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ceba6-7bbd-4d6f-9bba-a25516e322f4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:11.514395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ceba6-7bbd-4d6f-9bba-a25516e322f4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:11.515083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ceba6-7bbd-4d6f-9bba-a25516e322f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:11.547546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-927ceba6-7bbd-4d6f-9bba-a25516e322f4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:11.549193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-927ceba6-7bbd-4d6f-9bba-a25516e322f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:11.579976 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1463/2971] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:43:11 2022] POST /identity/v3/users => generated 297 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:11.582775 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1509/2972] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:43:11.584572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4848feb-be83-44da-8e53-60f3625dc4a8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:11.587154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ceba6-7bbd-4d6f-9bba-a25516e322f4 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:11.587307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a4848feb-be83-44da-8e53-60f3625dc4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:11.600903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4848feb-be83-44da-8e53-60f3625dc4a8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:11.601277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ceba6-7bbd-4d6f-9bba-a25516e322f4 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:11.606728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975725fd-620d-4107-814a-3162be2ab0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:11.607327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975725fd-620d-4107-814a-3162be2ab0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:11.607603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975725fd-620d-4107-814a-3162be2ab0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:11.607876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975725fd-620d-4107-814a-3162be2ab0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:11.610009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74993b63-d218-4a7a-b203-6e3f527a9454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:11.611354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74993b63-d218-4a7a-b203-6e3f527a9454 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:11.612036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74993b63-d218-4a7a-b203-6e3f527a9454 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:11.612784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74993b63-d218-4a7a-b203-6e3f527a9454 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:11.614197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74993b63-d218-4a7a-b203-6e3f527a9454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:11.615287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74993b63-d218-4a7a-b203-6e3f527a9454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:11.618543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975725fd-620d-4107-814a-3162be2ab0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:11.618770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74993b63-d218-4a7a-b203-6e3f527a9454 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:11.620316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975725fd-620d-4107-814a-3162be2ab0f2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:11.645489 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1510/2973] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:11.649084 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1464/2974] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:11.661417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975725fd-620d-4107-814a-3162be2ab0f2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:11.671145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74993b63-d218-4a7a-b203-6e3f527a9454 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:11.681936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975725fd-620d-4107-814a-3162be2ab0f2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:11.685862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74993b63-d218-4a7a-b203-6e3f527a9454 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:11.692120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bb8cf-6c0a-4961-92e7-ccd9a7561176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:11.693141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb8cf-6c0a-4961-92e7-ccd9a7561176 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:11.693639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb8cf-6c0a-4961-92e7-ccd9a7561176 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:11.694122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb8cf-6c0a-4961-92e7-ccd9a7561176 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:11.695070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bb8cf-6c0a-4961-92e7-ccd9a7561176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:11.698182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bb8cf-6c0a-4961-92e7-ccd9a7561176 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:11.711464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd623a78-4486-432a-992e-6dabe97badfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:11.712578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd623a78-4486-432a-992e-6dabe97badfc admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:11.712861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd623a78-4486-432a-992e-6dabe97badfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:11.713315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd623a78-4486-432a-992e-6dabe97badfc admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:11.713982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd623a78-4486-432a-992e-6dabe97badfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:11.724047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd623a78-4486-432a-992e-6dabe97badfc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:11.743526 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1465/2975] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:11.746457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd623a78-4486-432a-992e-6dabe97badfc admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:11.777890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd623a78-4486-432a-992e-6dabe97badfc admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:11.784667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1209a7-f8b2-4966-9c92-333b3397c882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:11.785942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1209a7-f8b2-4966-9c92-333b3397c882 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:11.786399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1209a7-f8b2-4966-9c92-333b3397c882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:11.806816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1209a7-f8b2-4966-9c92-333b3397c882 admin admin] PATH_INFO: `/v3/projects/c1b8a17e29c4436a9c51b4fc7b963822/users/a498ce4dafbd4ef69ee8fee961f83dc0/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:11.814901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1209a7-f8b2-4966-9c92-333b3397c882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b8a17e29c4436a9c51b4fc7b963822, user_id=a498ce4dafbd4ef69ee8fee961f83dc0, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:11.820409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1209a7-f8b2-4966-9c92-333b3397c882 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:11.952105 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1511/2976] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:43:11 2022] POST /identity/v3/projects => generated 365 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:11.963904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bb8cf-6c0a-4961-92e7-ccd9a7561176 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:11.980383 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1466/2977] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:11 2022] PUT /identity/v3/projects/c1b8a17e29c4436a9c51b4fc7b963822/users/a498ce4dafbd4ef69ee8fee961f83dc0/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:43:12.002286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fef60c-8178-4cdf-b3c0-0d700dc7d12e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:12.002965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fef60c-8178-4cdf-b3c0-0d700dc7d12e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:12.003437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fef60c-8178-4cdf-b3c0-0d700dc7d12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:12.066296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-05fef60c-8178-4cdf-b3c0-0d700dc7d12e None None] MFA Rules not processed for user `a498ce4dafbd4ef69ee8fee961f83dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:12.068648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-05fef60c-8178-4cdf-b3c0-0d700dc7d12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:12.119494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bb8cf-6c0a-4961-92e7-ccd9a7561176 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:12.135287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c1b16-4461-4eb7-98e1-3278b8dda6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:12.135967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c1b16-4461-4eb7-98e1-3278b8dda6bd admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:12.136347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c1b16-4461-4eb7-98e1-3278b8dda6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:12.136857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c1b16-4461-4eb7-98e1-3278b8dda6bd admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:12.137591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c1b16-4461-4eb7-98e1-3278b8dda6bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:12.140230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c1b16-4461-4eb7-98e1-3278b8dda6bd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:12.275915 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1467/2978] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:43:12.277040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fef60c-8178-4cdf-b3c0-0d700dc7d12e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:12.305541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fef60c-8178-4cdf-b3c0-0d700dc7d12e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:12.321622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d28479-e673-404d-8d89-30e362ab75e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:12.322466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d28479-e673-404d-8d89-30e362ab75e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:12.322888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d28479-e673-404d-8d89-30e362ab75e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:12.325474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d28479-e673-404d-8d89-30e362ab75e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:12.326472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d28479-e673-404d-8d89-30e362ab75e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:12.328682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d28479-e673-404d-8d89-30e362ab75e2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:12.343419 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1512/2979] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:43:11 2022] POST /identity/v3/users => generated 283 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:12.347636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c1b16-4461-4eb7-98e1-3278b8dda6bd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:12.365383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c1b16-4461-4eb7-98e1-3278b8dda6bd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:12.379491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f639bd-eab0-4981-b775-ccfca6940a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:12.380273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f639bd-eab0-4981-b775-ccfca6940a6c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:12.380658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f639bd-eab0-4981-b775-ccfca6940a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:12.381029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f639bd-eab0-4981-b775-ccfca6940a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:12.381795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f639bd-eab0-4981-b775-ccfca6940a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:12.384334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f639bd-eab0-4981-b775-ccfca6940a6c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:12.413979 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1513/2980] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:12.418727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f639bd-eab0-4981-b775-ccfca6940a6c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:12.442842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f639bd-eab0-4981-b775-ccfca6940a6c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:12.455054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e4609-dcba-4759-a003-f60494ae03ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:12.455694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e4609-dcba-4759-a003-f60494ae03ef admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:12.456134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e4609-dcba-4759-a003-f60494ae03ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:12.457141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e4609-dcba-4759-a003-f60494ae03ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:12.458382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e4609-dcba-4759-a003-f60494ae03ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:12.469385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e4609-dcba-4759-a003-f60494ae03ef admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:12.469865 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1468/2981] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:43:12 2022] POST /identity/v3/projects => generated 393 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:12.469865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d28479-e673-404d-8d89-30e362ab75e2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:12.483179 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1514/2982] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:12.484369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e4609-dcba-4759-a003-f60494ae03ef admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:12.528896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e4609-dcba-4759-a003-f60494ae03ef admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:12.578458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d28479-e673-404d-8d89-30e362ab75e2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:12.584549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fb579-c0f5-4239-8daa-1c5adf388bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:12.585535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fb579-c0f5-4239-8daa-1c5adf388bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:12.585979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fb579-c0f5-4239-8daa-1c5adf388bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:12.586582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fb579-c0f5-4239-8daa-1c5adf388bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:12.587763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fb579-c0f5-4239-8daa-1c5adf388bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:12.591665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fb579-c0f5-4239-8daa-1c5adf388bf5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:12.618912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2378c-c88e-4891-90b7-834c4f3c5ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:12.619871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2378c-c88e-4891-90b7-834c4f3c5ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:12.620280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2378c-c88e-4891-90b7-834c4f3c5ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:12.621428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2378c-c88e-4891-90b7-834c4f3c5ac0 admin admin] PATH_INFO: `/v3/projects/ff8743cde75f4f6da3a5742c66742898/users/6c5f4f0d776f4ad1a11f5408c0652bf9/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:12.645244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2378c-c88e-4891-90b7-834c4f3c5ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8743cde75f4f6da3a5742c66742898, user_id=6c5f4f0d776f4ad1a11f5408c0652bf9, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:12.649414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2378c-c88e-4891-90b7-834c4f3c5ac0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:12.735816 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1469/2983] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:43:12 2022] POST /identity/v3/users => generated 303 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:12.737079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fb579-c0f5-4239-8daa-1c5adf388bf5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:12.749499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fb579-c0f5-4239-8daa-1c5adf388bf5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:12.754844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95d702-9878-4300-b52e-eaf9d7a8979d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:12.755461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95d702-9878-4300-b52e-eaf9d7a8979d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:12.755751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95d702-9878-4300-b52e-eaf9d7a8979d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:12.756026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95d702-9878-4300-b52e-eaf9d7a8979d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:12.756740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95d702-9878-4300-b52e-eaf9d7a8979d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:12.758451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95d702-9878-4300-b52e-eaf9d7a8979d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:12.775317 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1470/2984] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:12.775317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95d702-9878-4300-b52e-eaf9d7a8979d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:12.785072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95d702-9878-4300-b52e-eaf9d7a8979d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:12.790325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03dc06-13cc-44d3-875e-bda88081d2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:12.790994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03dc06-13cc-44d3-875e-bda88081d2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:12.791262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03dc06-13cc-44d3-875e-bda88081d2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:12.791539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03dc06-13cc-44d3-875e-bda88081d2b2 admin admin] PATH_INFO: `/v3/projects/88ce1a9a88144d5aa9351054aa57af9a/users/6706d1d062a44604aca55958a697cf6c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:12.807097 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1515/2985] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:12 2022] PUT /identity/v3/projects/ff8743cde75f4f6da3a5742c66742898/users/6c5f4f0d776f4ad1a11f5408c0652bf9/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:12.807097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2378c-c88e-4891-90b7-834c4f3c5ac0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:12.813609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bfd2378c-c88e-4891-90b7-834c4f3c5ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:12.820326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03dc06-13cc-44d3-875e-bda88081d2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ce1a9a88144d5aa9351054aa57af9a, user_id=6706d1d062a44604aca55958a697cf6c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:12.823561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03dc06-13cc-44d3-875e-bda88081d2b2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:12.935821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2378c-c88e-4891-90b7-834c4f3c5ac0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:12.950849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e0b9d-41b4-484b-a774-58d7edb42d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:12.951763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e0b9d-41b4-484b-a774-58d7edb42d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:12.952248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e0b9d-41b4-484b-a774-58d7edb42d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:12.952972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e0b9d-41b4-484b-a774-58d7edb42d0e admin admin] PATH_INFO: `/v3/users/d1f1f8e372994677b491a2d2f9a74bf2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:12.954562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e0b9d-41b4-484b-a774-58d7edb42d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f1f8e372994677b491a2d2f9a74bf2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:12.958385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e0b9d-41b4-484b-a774-58d7edb42d0e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:13.265594 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1471/2986] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:12 2022] PUT /identity/v3/projects/88ce1a9a88144d5aa9351054aa57af9a/users/6706d1d062a44604aca55958a697cf6c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:13.267725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5855ef-1a28-4c7d-8419-ff54595c1f0e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:13.268596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5855ef-1a28-4c7d-8419-ff54595c1f0e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:13.269072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5855ef-1a28-4c7d-8419-ff54595c1f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:13.312905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-de5855ef-1a28-4c7d-8419-ff54595c1f0e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:13.312905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-de5855ef-1a28-4c7d-8419-ff54595c1f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:13.373256 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1472/2987] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:13.373990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5855ef-1a28-4c7d-8419-ff54595c1f0e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:13.391994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5855ef-1a28-4c7d-8419-ff54595c1f0e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:13.403080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd81c65-fc83-4df4-a572-d43f552a9497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:13.403080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd81c65-fc83-4df4-a572-d43f552a9497 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:13.403080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd81c65-fc83-4df4-a572-d43f552a9497 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:13.403080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd81c65-fc83-4df4-a572-d43f552a9497 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:13.403732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd81c65-fc83-4df4-a572-d43f552a9497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:13.403732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd81c65-fc83-4df4-a572-d43f552a9497 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:13.413360 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1473/2988] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:13.414209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd81c65-fc83-4df4-a572-d43f552a9497 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:13.417202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7bd81c65-fc83-4df4-a572-d43f552a9497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:13.454145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c33e0b9d-41b4-484b-a774-58d7edb42d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f1f8e372994677b491a2d2f9a74bf2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:13.473375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c33e0b9d-41b4-484b-a774-58d7edb42d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f1f8e372994677b491a2d2f9a74bf2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:13.549840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd81c65-fc83-4df4-a572-d43f552a9497 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:13.563810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451bea9-5ffd-49c1-8771-c0eff4bc2807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:13.564991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451bea9-5ffd-49c1-8771-c0eff4bc2807 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:13.565448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451bea9-5ffd-49c1-8771-c0eff4bc2807 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:13.565894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451bea9-5ffd-49c1-8771-c0eff4bc2807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:13.576755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451bea9-5ffd-49c1-8771-c0eff4bc2807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:13.582321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451bea9-5ffd-49c1-8771-c0eff4bc2807 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:13.590494 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1474/2989] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:13.591772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451bea9-5ffd-49c1-8771-c0eff4bc2807 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:13.603028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451bea9-5ffd-49c1-8771-c0eff4bc2807 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:13.609436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cd689-e51d-4a39-b88a-b74e6c17e6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:13.610104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cd689-e51d-4a39-b88a-b74e6c17e6d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:13.610382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cd689-e51d-4a39-b88a-b74e6c17e6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:13.610847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cd689-e51d-4a39-b88a-b74e6c17e6d5 admin admin] PATH_INFO: `/v3/projects/88ce1a9a88144d5aa9351054aa57af9a/users/6706d1d062a44604aca55958a697cf6c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:13.612925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cd689-e51d-4a39-b88a-b74e6c17e6d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ce1a9a88144d5aa9351054aa57af9a, user_id=6706d1d062a44604aca55958a697cf6c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:13.615586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cd689-e51d-4a39-b88a-b74e6c17e6d5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:13.640233 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1475/2990] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:13 2022] PUT /identity/v3/projects/88ce1a9a88144d5aa9351054aa57af9a/users/6706d1d062a44604aca55958a697cf6c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:13.644140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f54e0d-159f-4a64-9ec5-f1c5a431c0f1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:13.644454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f54e0d-159f-4a64-9ec5-f1c5a431c0f1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:13.644454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f54e0d-159f-4a64-9ec5-f1c5a431c0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:13.680496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d2f54e0d-159f-4a64-9ec5-f1c5a431c0f1 None None] MFA Rules not processed for user `6706d1d062a44604aca55958a697cf6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:13.681818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d2f54e0d-159f-4a64-9ec5-f1c5a431c0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:13.737216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c33e0b9d-41b4-484b-a774-58d7edb42d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f1f8e372994677b491a2d2f9a74bf2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:13.743177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c33e0b9d-41b4-484b-a774-58d7edb42d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f1f8e372994677b491a2d2f9a74bf2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:13.773606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c33e0b9d-41b4-484b-a774-58d7edb42d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f1f8e372994677b491a2d2f9a74bf2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:13.811326 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1476/2992] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:13 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:13.812148 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1516/2992] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:43:12 2022] DELETE /identity/v3/users/d1f1f8e372994677b491a2d2f9a74bf2 => generated 0 bytes in 1003 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:13.813552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2462ed2-307e-4e79-84a2-3fc03d0002dc None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:13.813692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bc060-e4dd-4211-8ad6-429b939a7620 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:13.813893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bc060-e4dd-4211-8ad6-429b939a7620 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:13.814924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bc060-e4dd-4211-8ad6-429b939a7620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:13.816269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2462ed2-307e-4e79-84a2-3fc03d0002dc None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:13.832912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2462ed2-307e-4e79-84a2-3fc03d0002dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:13.847212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b2462ed2-307e-4e79-84a2-3fc03d0002dc None None] MFA Rules not processed for user `a498ce4dafbd4ef69ee8fee961f83dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:13.849816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b2462ed2-307e-4e79-84a2-3fc03d0002dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:13.861487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-603bc060-e4dd-4211-8ad6-429b939a7620 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:13.864341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-603bc060-e4dd-4211-8ad6-429b939a7620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:13.939108 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1477/2993] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:13.959177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2462ed2-307e-4e79-84a2-3fc03d0002dc None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:13.960711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b2462ed2-307e-4e79-84a2-3fc03d0002dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:13.978439 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1517/2994] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:14.002951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bc060-e4dd-4211-8ad6-429b939a7620 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:14.006882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-603bc060-e4dd-4211-8ad6-429b939a7620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:14.062485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2462ed2-307e-4e79-84a2-3fc03d0002dc None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:14.081237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a9ea5-6059-48a9-abbc-d75b61e9f3c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:14.083356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a9ea5-6059-48a9-abbc-d75b61e9f3c4 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:14.083646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a9ea5-6059-48a9-abbc-d75b61e9f3c4 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:14.083924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a9ea5-6059-48a9-abbc-d75b61e9f3c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:14.096399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f76a9ea5-6059-48a9-abbc-d75b61e9f3c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:14.121891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a9ea5-6059-48a9-abbc-d75b61e9f3c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:14.124406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a9ea5-6059-48a9-abbc-d75b61e9f3c4 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:14.136409 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1478/2995] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:13 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:14.198941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bc060-e4dd-4211-8ad6-429b939a7620 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:14.206836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f3e04-05ec-4810-8e2f-9f9d6b7bf669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:14.207574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f3e04-05ec-4810-8e2f-9f9d6b7bf669 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:14.208008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f3e04-05ec-4810-8e2f-9f9d6b7bf669 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:14.208391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f3e04-05ec-4810-8e2f-9f9d6b7bf669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:14.223981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f3e04-05ec-4810-8e2f-9f9d6b7bf669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:14.223981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f3e04-05ec-4810-8e2f-9f9d6b7bf669 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:14.239979 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1518/2996] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:14.297053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:15.340614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a9ea5-6059-48a9-abbc-d75b61e9f3c4 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:15.343006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f76a9ea5-6059-48a9-abbc-d75b61e9f3c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:15.369141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a9ea5-6059-48a9-abbc-d75b61e9f3c4 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:15.384882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c7835-ccc7-4881-badc-19b096817978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:15.385788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c7835-ccc7-4881-badc-19b096817978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:15.387828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c7835-ccc7-4881-badc-19b096817978 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:15.388303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c7835-ccc7-4881-badc-19b096817978 admin admin] PATH_INFO: `/v3/projects/e5865b7b9da947b2a324cb31d5c658bd` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:15.389822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c7835-ccc7-4881-badc-19b096817978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5865b7b9da947b2a324cb31d5c658bd)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:15.391897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c7835-ccc7-4881-badc-19b096817978 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:15.772894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0f2c7835-ccc7-4881-badc-19b096817978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5865b7b9da947b2a324cb31d5c658bd', 'request_id': 'req-0f2c7835-ccc7-4881-badc-19b096817978'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:15.789145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0f2c7835-ccc7-4881-badc-19b096817978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5865b7b9da947b2a324cb31d5c658bd', 'request_id': 'req-0f2c7835-ccc7-4881-badc-19b096817978'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:15.797334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0f2c7835-ccc7-4881-badc-19b096817978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5865b7b9da947b2a324cb31d5c658bd', 'request_id': 'req-0f2c7835-ccc7-4881-badc-19b096817978'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:16.049193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0f2c7835-ccc7-4881-badc-19b096817978 admin admin] The token cache is being invalidate because project e5865b7b9da947b2a324cb31d5c658bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:43:16.049193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0f2c7835-ccc7-4881-badc-19b096817978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:16.049193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0f2c7835-ccc7-4881-badc-19b096817978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:16.049193 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1479/2997] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:15 2022] DELETE /identity/v3/projects/e5865b7b9da947b2a324cb31d5c658bd => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:16.051753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f3e04-05ec-4810-8e2f-9f9d6b7bf669 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:16.062449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f3e04-05ec-4810-8e2f-9f9d6b7bf669 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:16.098121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:16.189562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a2853-c586-4aa5-bbbc-94c0ed1168cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:16.190242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a2853-c586-4aa5-bbbc-94c0ed1168cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:16.190522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a2853-c586-4aa5-bbbc-94c0ed1168cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:16.190796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a2853-c586-4aa5-bbbc-94c0ed1168cb admin admin] PATH_INFO: `/v3/users/471a8afd4a664ccfa3fa753a1cf34ae8` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:16.195876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a2853-c586-4aa5-bbbc-94c0ed1168cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=471a8afd4a664ccfa3fa753a1cf34ae8)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:16.209673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a2853-c586-4aa5-bbbc-94c0ed1168cb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:16.434478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-262a2853-c586-4aa5-bbbc-94c0ed1168cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471a8afd4a664ccfa3fa753a1cf34ae8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:16.435653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-262a2853-c586-4aa5-bbbc-94c0ed1168cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471a8afd4a664ccfa3fa753a1cf34ae8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:16.543820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-262a2853-c586-4aa5-bbbc-94c0ed1168cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471a8afd4a664ccfa3fa753a1cf34ae8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:16.545303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-262a2853-c586-4aa5-bbbc-94c0ed1168cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471a8afd4a664ccfa3fa753a1cf34ae8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:16.569375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-262a2853-c586-4aa5-bbbc-94c0ed1168cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471a8afd4a664ccfa3fa753a1cf34ae8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:16.604433 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1519/2998] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:43:16 2022] DELETE /identity/v3/users/471a8afd4a664ccfa3fa753a1cf34ae8 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:17.158998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:17.290045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c7835-ccc7-4881-badc-19b096817978 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:17.291533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0f2c7835-ccc7-4881-badc-19b096817978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:17.305653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c7835-ccc7-4881-badc-19b096817978 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:17.378067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5970a5-a46e-4d13-97d0-29ce755c35cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:17.378640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5970a5-a46e-4d13-97d0-29ce755c35cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:17.378923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5970a5-a46e-4d13-97d0-29ce755c35cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:17.379329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5970a5-a46e-4d13-97d0-29ce755c35cb admin admin] PATH_INFO: `/v3/projects/3f8eccffe64c41388566ed2dbee7d79f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:17.380541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5970a5-a46e-4d13-97d0-29ce755c35cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f8eccffe64c41388566ed2dbee7d79f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:17.382576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5970a5-a46e-4d13-97d0-29ce755c35cb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:17.515612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:17.532373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-da5970a5-a46e-4d13-97d0-29ce755c35cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f8eccffe64c41388566ed2dbee7d79f', 'request_id': 'req-da5970a5-a46e-4d13-97d0-29ce755c35cb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:17.543349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-da5970a5-a46e-4d13-97d0-29ce755c35cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f8eccffe64c41388566ed2dbee7d79f', 'request_id': 'req-da5970a5-a46e-4d13-97d0-29ce755c35cb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:17.550751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-da5970a5-a46e-4d13-97d0-29ce755c35cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f8eccffe64c41388566ed2dbee7d79f', 'request_id': 'req-da5970a5-a46e-4d13-97d0-29ce755c35cb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:17.602459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138c505-82e7-4f34-a767-ab6f001d5c00 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:17.602955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138c505-82e7-4f34-a767-ab6f001d5c00 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:17.603543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138c505-82e7-4f34-a767-ab6f001d5c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:17.638032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c138c505-82e7-4f34-a767-ab6f001d5c00 None None] MFA Rules not processed for user `bb90f64664c74949ad58644bcbdafdfc`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:17.648115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c138c505-82e7-4f34-a767-ab6f001d5c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:17.668411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-da5970a5-a46e-4d13-97d0-29ce755c35cb admin admin] The token cache is being invalidate because project 3f8eccffe64c41388566ed2dbee7d79f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:43:17.668730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-da5970a5-a46e-4d13-97d0-29ce755c35cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:17.670459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-da5970a5-a46e-4d13-97d0-29ce755c35cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:17.679589 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1480/2999] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:17 2022] DELETE /identity/v3/projects/3f8eccffe64c41388566ed2dbee7d79f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:17.684481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1cf78-faa7-487b-972b-d29573d5a8d4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:17.700038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1cf78-faa7-487b-972b-d29573d5a8d4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:17.700038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1cf78-faa7-487b-972b-d29573d5a8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:17.784388 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1520/3000] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:43:17.790002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-79d1cf78-faa7-487b-972b-d29573d5a8d4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:17.791626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-79d1cf78-faa7-487b-972b-d29573d5a8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:17.926870 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1481/3001] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:17.934938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c084-28aa-4b4d-8e7e-9793acfb17ce None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:17.935222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c084-28aa-4b4d-8e7e-9793acfb17ce None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:17.935495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c084-28aa-4b4d-8e7e-9793acfb17ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:18.024676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1968c084-28aa-4b4d-8e7e-9793acfb17ce None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:18.028661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1968c084-28aa-4b4d-8e7e-9793acfb17ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:18.049840 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1521/3002] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:18.051326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1cf78-faa7-487b-972b-d29573d5a8d4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:18.063972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1cf78-faa7-487b-972b-d29573d5a8d4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:18.072264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e40aea-d889-4600-a900-3d35841393d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:18.073149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e40aea-d889-4600-a900-3d35841393d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:18.075066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e40aea-d889-4600-a900-3d35841393d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:18.075646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e40aea-d889-4600-a900-3d35841393d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:18.077266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e40aea-d889-4600-a900-3d35841393d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:18.077794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e40aea-d889-4600-a900-3d35841393d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:18.079899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e40aea-d889-4600-a900-3d35841393d3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:18.098359 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1482/3003] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:18.103049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968c084-28aa-4b4d-8e7e-9793acfb17ce None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:18.115740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968c084-28aa-4b4d-8e7e-9793acfb17ce None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:18.128805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6538e64-400f-42f3-9c78-277e006cd45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:18.128805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6538e64-400f-42f3-9c78-277e006cd45a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:18.130246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6538e64-400f-42f3-9c78-277e006cd45a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:18.130631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6538e64-400f-42f3-9c78-277e006cd45a admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:18.132363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6538e64-400f-42f3-9c78-277e006cd45a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:18.140544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6538e64-400f-42f3-9c78-277e006cd45a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:18.294136 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1522/3004] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:43:18 2022] POST /identity/v3/projects => generated 375 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:18.298044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e40aea-d889-4600-a900-3d35841393d3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:18.314098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e40aea-d889-4600-a900-3d35841393d3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:18.405936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebb998-47a2-4792-afd5-d4c8f6d31da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:18.418752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebb998-47a2-4792-afd5-d4c8f6d31da4 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:18.418752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebb998-47a2-4792-afd5-d4c8f6d31da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:18.418752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebb998-47a2-4792-afd5-d4c8f6d31da4 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:18.418752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebb998-47a2-4792-afd5-d4c8f6d31da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:18.418752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebb998-47a2-4792-afd5-d4c8f6d31da4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:18.514365 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1483/3005] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:43:18 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:18.518497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6538e64-400f-42f3-9c78-277e006cd45a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:18.531341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6538e64-400f-42f3-9c78-277e006cd45a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:18.536870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7c160-099a-44b3-b331-fe11630d080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:18.537810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7c160-099a-44b3-b331-fe11630d080c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:18.538305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7c160-099a-44b3-b331-fe11630d080c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:18.538791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7c160-099a-44b3-b331-fe11630d080c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:18.539683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7c160-099a-44b3-b331-fe11630d080c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:18.541603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7c160-099a-44b3-b331-fe11630d080c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:18.553909 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1523/3006] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:18.558043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebb998-47a2-4792-afd5-d4c8f6d31da4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:18.574979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebb998-47a2-4792-afd5-d4c8f6d31da4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:18.581709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae39723-d812-445e-bbce-b95de1f97584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:18.582890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae39723-d812-445e-bbce-b95de1f97584 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:18.583389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae39723-d812-445e-bbce-b95de1f97584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:18.583877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae39723-d812-445e-bbce-b95de1f97584 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:18.584821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae39723-d812-445e-bbce-b95de1f97584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:18.587187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae39723-d812-445e-bbce-b95de1f97584 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:18.594452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3358f-0b5d-4a42-b078-62c68625d4c9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:18.594965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3358f-0b5d-4a42-b078-62c68625d4c9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:18.595471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3358f-0b5d-4a42-b078-62c68625d4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:18.603088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-83b3358f-0b5d-4a42-b078-62c68625d4c9 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:43:18.603088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:43:18.603088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:43:18.603088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:43:18.603088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:43:18.603088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:43:18.603088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:43:18.603088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:43:18.603088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:43:18.603088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:43:18.603088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:43:18.603088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:43:18.603088 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:43:18.604074 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:43:18.604074 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:43:18.604074 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:43:18.604074 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:43:18.604074 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:43:18.604074 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:43:18.604074 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:43:18.604074 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:43:18.604074 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:43:18.604074 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:43:18.604074 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:43:18.604074 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:43:18.604074 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:43:18.604074 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:43:18.604074 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:43:18.608888 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1524/3007] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:43:18 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 17 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:43:18.618820 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1484/3008] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:18.638014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3358f-0b5d-4a42-b078-62c68625d4c9 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:18.667037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3358f-0b5d-4a42-b078-62c68625d4c9 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:18.673345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3750cb7-ede6-49fd-9ca1-290ff988c503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:18.674074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3750cb7-ede6-49fd-9ca1-290ff988c503 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:18.674467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3750cb7-ede6-49fd-9ca1-290ff988c503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:18.674843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3750cb7-ede6-49fd-9ca1-290ff988c503 admin admin] PATH_INFO: `/v3/projects/48f0152fd4e84063ad8eaa691d1e14af/users/92c87c182de244ca95b93cc62f3bc744/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:18.692588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3750cb7-ede6-49fd-9ca1-290ff988c503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f0152fd4e84063ad8eaa691d1e14af, user_id=92c87c182de244ca95b93cc62f3bc744, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:18.695629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3750cb7-ede6-49fd-9ca1-290ff988c503 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:18.781675 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1525/3009] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:18 2022] PUT /identity/v3/projects/48f0152fd4e84063ad8eaa691d1e14af/users/92c87c182de244ca95b93cc62f3bc744/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:18.783563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac500-e76e-4ca5-a6dc-63909aeeae12 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:18.783982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac500-e76e-4ca5-a6dc-63909aeeae12 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:18.784379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac500-e76e-4ca5-a6dc-63909aeeae12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:18.817596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-09aac500-e76e-4ca5-a6dc-63909aeeae12 None None] MFA Rules not processed for user `92c87c182de244ca95b93cc62f3bc744`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:18.818997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-09aac500-e76e-4ca5-a6dc-63909aeeae12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:18.911688 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1485/3010] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:18.915946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3750cb7-ede6-49fd-9ca1-290ff988c503 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:19.032505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3750cb7-ede6-49fd-9ca1-290ff988c503 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:19.039158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65958913-8edf-4479-b157-fcb12bfce273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:19.040141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65958913-8edf-4479-b157-fcb12bfce273 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:19.040913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65958913-8edf-4479-b157-fcb12bfce273 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:19.041369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65958913-8edf-4479-b157-fcb12bfce273 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:19.042333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65958913-8edf-4479-b157-fcb12bfce273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:19.046518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65958913-8edf-4479-b157-fcb12bfce273 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:19.179014 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1526/3011] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:43:18 2022] POST /identity/v3/projects => generated 375 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:19.179875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aac500-e76e-4ca5-a6dc-63909aeeae12 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:19.197431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aac500-e76e-4ca5-a6dc-63909aeeae12 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:19.290186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356e575-095b-44d2-a25b-390511ca04ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:19.290855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356e575-095b-44d2-a25b-390511ca04ed admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:19.291138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356e575-095b-44d2-a25b-390511ca04ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:19.291472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356e575-095b-44d2-a25b-390511ca04ed admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:19.292125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356e575-095b-44d2-a25b-390511ca04ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:19.295259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356e575-095b-44d2-a25b-390511ca04ed admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:19.391957 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1486/3012] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:43:19 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:43:19.395754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65958913-8edf-4479-b157-fcb12bfce273 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:19.409551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65958913-8edf-4479-b157-fcb12bfce273 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:19.414584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afeddb7-2e0d-4338-bdd3-5fd2a0183c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:19.415372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afeddb7-2e0d-4338-bdd3-5fd2a0183c0b admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:19.416189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afeddb7-2e0d-4338-bdd3-5fd2a0183c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:19.416189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afeddb7-2e0d-4338-bdd3-5fd2a0183c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:19.417116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afeddb7-2e0d-4338-bdd3-5fd2a0183c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:19.419053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afeddb7-2e0d-4338-bdd3-5fd2a0183c0b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:19.436563 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1527/3013] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:19.447036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356e575-095b-44d2-a25b-390511ca04ed admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:19.470265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356e575-095b-44d2-a25b-390511ca04ed admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:19.475920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29995f-e78b-4874-b7d6-dd7e47bfe1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:19.477222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29995f-e78b-4874-b7d6-dd7e47bfe1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:19.477783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29995f-e78b-4874-b7d6-dd7e47bfe1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:19.478200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29995f-e78b-4874-b7d6-dd7e47bfe1aa admin admin] PATH_INFO: `/v3/projects/9796b60c7eba42aaaaca8b95a161e349/users/6d9720e9f5dd459facdc7bad89ff4d47/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:19.498707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29995f-e78b-4874-b7d6-dd7e47bfe1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9796b60c7eba42aaaaca8b95a161e349, user_id=6d9720e9f5dd459facdc7bad89ff4d47, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:19.501946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29995f-e78b-4874-b7d6-dd7e47bfe1aa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:19.647246 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1487/3014] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:19 2022] PUT /identity/v3/projects/9796b60c7eba42aaaaca8b95a161e349/users/6d9720e9f5dd459facdc7bad89ff4d47/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:19.651969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afeddb7-2e0d-4338-bdd3-5fd2a0183c0b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:19.682397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afeddb7-2e0d-4338-bdd3-5fd2a0183c0b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:19.797191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc17e3-8609-420c-bbec-dfed519f1f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:19.798147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc17e3-8609-420c-bbec-dfed519f1f16 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:19.798769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc17e3-8609-420c-bbec-dfed519f1f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:19.799263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc17e3-8609-420c-bbec-dfed519f1f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:19.800800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc17e3-8609-420c-bbec-dfed519f1f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:19.803236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc17e3-8609-420c-bbec-dfed519f1f16 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:19.823134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29995f-e78b-4874-b7d6-dd7e47bfe1aa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:19.824478 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1528/3015] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:19.836765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29995f-e78b-4874-b7d6-dd7e47bfe1aa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:19.844116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb51a38-c58e-4932-a81e-041b79ce289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:19.845197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb51a38-c58e-4932-a81e-041b79ce289a admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:19.846248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb51a38-c58e-4932-a81e-041b79ce289a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:19.846874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb51a38-c58e-4932-a81e-041b79ce289a admin admin] PATH_INFO: `/v3/projects/9796b60c7eba42aaaaca8b95a161e349/users/6d9720e9f5dd459facdc7bad89ff4d47/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:19.850646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb51a38-c58e-4932-a81e-041b79ce289a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9796b60c7eba42aaaaca8b95a161e349, user_id=6d9720e9f5dd459facdc7bad89ff4d47, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:19.854173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb51a38-c58e-4932-a81e-041b79ce289a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:19.869382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:19.920591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:19.922746 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1488/3016] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:19 2022] PUT /identity/v3/projects/9796b60c7eba42aaaaca8b95a161e349/users/6d9720e9f5dd459facdc7bad89ff4d47/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:19.940243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be114939-d8f6-4ebc-a634-c046fefef1fd None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:19.950315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be114939-d8f6-4ebc-a634-c046fefef1fd None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:19.950585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be114939-d8f6-4ebc-a634-c046fefef1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:19.969721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d036e-a645-4686-8131-fdf325ce036b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:19.970010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d036e-a645-4686-8131-fdf325ce036b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:19.982246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d036e-a645-4686-8131-fdf325ce036b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:20.055076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-be114939-d8f6-4ebc-a634-c046fefef1fd None None] MFA Rules not processed for user `6d9720e9f5dd459facdc7bad89ff4d47`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:20.057099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-be114939-d8f6-4ebc-a634-c046fefef1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:20.090289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7e8d036e-a645-4686-8131-fdf325ce036b None None] MFA Rules not processed for user `b8232920ed3f45aaa5b3c6d3844bcd86`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:20.091627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7e8d036e-a645-4686-8131-fdf325ce036b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:20.217497 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1529/3017] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:20.231579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be114939-d8f6-4ebc-a634-c046fefef1fd None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:20.232314 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1489/3018] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:19 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:20.261618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be114939-d8f6-4ebc-a634-c046fefef1fd None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:20.273324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003661f1-a132-49e0-b8b5-2509f86475c6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9720e9f5dd459facdc7bad89ff4d47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9796b60c7eba42aaaaca8b95a161e349', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:20.282829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003661f1-a132-49e0-b8b5-2509f86475c6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:20.283218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003661f1-a132-49e0-b8b5-2509f86475c6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:20.283603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003661f1-a132-49e0-b8b5-2509f86475c6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:20.284494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003661f1-a132-49e0-b8b5-2509f86475c6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:20.284963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003661f1-a132-49e0-b8b5-2509f86475c6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:20.286762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003661f1-a132-49e0-b8b5-2509f86475c6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:20.334420 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1530/3019] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:20.338355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d036e-a645-4686-8131-fdf325ce036b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:20.372516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d036e-a645-4686-8131-fdf325ce036b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:20.393360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb901b-36cd-4cca-a647-f18e9b2459cb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9720e9f5dd459facdc7bad89ff4d47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9796b60c7eba42aaaaca8b95a161e349', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:20.394695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb901b-36cd-4cca-a647-f18e9b2459cb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:20.395144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb901b-36cd-4cca-a647-f18e9b2459cb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:20.395920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb901b-36cd-4cca-a647-f18e9b2459cb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:20.396477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb901b-36cd-4cca-a647-f18e9b2459cb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:20.404624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb901b-36cd-4cca-a647-f18e9b2459cb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:20.565443 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1490/3020] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:43:20 2022] POST /identity/v3/projects => generated 369 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:20.570004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003661f1-a132-49e0-b8b5-2509f86475c6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:20.598065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb901b-36cd-4cca-a647-f18e9b2459cb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:20.611036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dccb901b-36cd-4cca-a647-f18e9b2459cb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:20.611278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003661f1-a132-49e0-b8b5-2509f86475c6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:20.807409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c18ea9-4ff9-4b6e-b64e-4d15d35682a8 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9720e9f5dd459facdc7bad89ff4d47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9796b60c7eba42aaaaca8b95a161e349', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:20.809077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c18ea9-4ff9-4b6e-b64e-4d15d35682a8 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:20.809549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c18ea9-4ff9-4b6e-b64e-4d15d35682a8 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:20.809978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c18ea9-4ff9-4b6e-b64e-4d15d35682a8 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:20.810930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c18ea9-4ff9-4b6e-b64e-4d15d35682a8 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:20.811457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c18ea9-4ff9-4b6e-b64e-4d15d35682a8 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:20.813316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c18ea9-4ff9-4b6e-b64e-4d15d35682a8 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:20.818641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb901b-36cd-4cca-a647-f18e9b2459cb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:20.830956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7f901-ad29-499b-88b2-47bd5e57ceb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:20.831604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7f901-ad29-499b-88b2-47bd5e57ceb8 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:20.832152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7f901-ad29-499b-88b2-47bd5e57ceb8 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:20.832502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7f901-ad29-499b-88b2-47bd5e57ceb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:20.846775 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1531/3021] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:20.854570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c18ea9-4ff9-4b6e-b64e-4d15d35682a8 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:20.861326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-80c18ea9-4ff9-4b6e-b64e-4d15d35682a8 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:20.890072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c18ea9-4ff9-4b6e-b64e-4d15d35682a8 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:20.894510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:20.905769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8de654-d136-4ecd-a2c3-c7041a7f8d8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:20.906685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8de654-d136-4ecd-a2c3-c7041a7f8d8b service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:20.909869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8de654-d136-4ecd-a2c3-c7041a7f8d8b service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:20.909869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8de654-d136-4ecd-a2c3-c7041a7f8d8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:20.919972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8de654-d136-4ecd-a2c3-c7041a7f8d8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:20.921630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8de654-d136-4ecd-a2c3-c7041a7f8d8b service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:20.930460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7f901-ad29-499b-88b2-47bd5e57ceb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:20.932151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7f901-ad29-499b-88b2-47bd5e57ceb8 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:20.946138 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1532/3022] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:20.947263 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1491/3023] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:20 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:21.012049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456c4d0-ef9c-4057-a805-3afdd6791b92 None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:21.012511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456c4d0-ef9c-4057-a805-3afdd6791b92 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:21.012938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456c4d0-ef9c-4057-a805-3afdd6791b92 None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:21.015541 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1533/3024] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:43:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:43:21.023466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7f901-ad29-499b-88b2-47bd5e57ceb8 service nova] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:43:21.034362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e913f5-5c89-43b5-b98d-932e989aa31e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:21.034716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e913f5-5c89-43b5-b98d-932e989aa31e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:21.035123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e913f5-5c89-43b5-b98d-932e989aa31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:21.041655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7f901-ad29-499b-88b2-47bd5e57ceb8 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:21.055851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7f901-ad29-499b-88b2-47bd5e57ceb8 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:21.063911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bc534-9b00-4c62-99f1-dfacafbd18e4 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9720e9f5dd459facdc7bad89ff4d47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9796b60c7eba42aaaaca8b95a161e349', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:21.064697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bc534-9b00-4c62-99f1-dfacafbd18e4 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:21.065045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bc534-9b00-4c62-99f1-dfacafbd18e4 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:21.065404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bc534-9b00-4c62-99f1-dfacafbd18e4 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] PATH_INFO: `/v3/projects/d5c57bd1ab8345f38252fc4fd0fb6a7f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:21.066651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bc534-9b00-4c62-99f1-dfacafbd18e4 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorizing `identity:get_project(project_id=d5c57bd1ab8345f38252fc4fd0fb6a7f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:21.069876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bc534-9b00-4c62-99f1-dfacafbd18e4 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:21.072445 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1492/3025] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:43:21 2022] GET /identity/v3/projects/d5c57bd1ab8345f38252fc4fd0fb6a7f => generated 369 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:21.074995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a8e913f5-5c89-43b5-b98d-932e989aa31e None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:21.080965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a8e913f5-5c89-43b5-b98d-932e989aa31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:21.217487 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1534/3026] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:43:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:21.232751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bc534-9b00-4c62-99f1-dfacafbd18e4 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:21.235209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-be9bc534-9b00-4c62-99f1-dfacafbd18e4 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:21.403499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bc534-9b00-4c62-99f1-dfacafbd18e4 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:21.423107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90905e38-1048-47c7-9ca5-423b42ef72a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:21.424312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90905e38-1048-47c7-9ca5-423b42ef72a1 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:21.424601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90905e38-1048-47c7-9ca5-423b42ef72a1 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:21.424884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90905e38-1048-47c7-9ca5-423b42ef72a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:21.446278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90905e38-1048-47c7-9ca5-423b42ef72a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:21.447703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90905e38-1048-47c7-9ca5-423b42ef72a1 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:21.475433 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1493/3027] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:43:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:22.037158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d799f-440d-41ce-b632-60b61178addc None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:22.044744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d799f-440d-41ce-b632-60b61178addc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:22.044744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d799f-440d-41ce-b632-60b61178addc None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:22.044744 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1535/3028] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:43:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:43:22.051542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90905e38-1048-47c7-9ca5-423b42ef72a1 service swift] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:43:22.066933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:22.086597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90905e38-1048-47c7-9ca5-423b42ef72a1 service swift] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:22.119887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90905e38-1048-47c7-9ca5-423b42ef72a1 service swift] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:22.137319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c4196-e3b1-40ba-b36b-79510b805574 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9720e9f5dd459facdc7bad89ff4d47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9796b60c7eba42aaaaca8b95a161e349', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:22.138267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c4196-e3b1-40ba-b36b-79510b805574 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:22.138685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c4196-e3b1-40ba-b36b-79510b805574 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:22.142612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c4196-e3b1-40ba-b36b-79510b805574 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] PATH_INFO: `/v3/projects/d5c57bd1ab8345f38252fc4fd0fb6a7f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:22.145042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c4196-e3b1-40ba-b36b-79510b805574 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorizing `identity:get_project(project_id=d5c57bd1ab8345f38252fc4fd0fb6a7f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:22.148318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c4196-e3b1-40ba-b36b-79510b805574 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:22.172621 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1494/3029] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:43:22 2022] GET /identity/v3/projects/d5c57bd1ab8345f38252fc4fd0fb6a7f => generated 369 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:22.249700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d799f-440d-41ce-b632-60b61178addc None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:22.273176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d799f-440d-41ce-b632-60b61178addc None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:22.286352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5baef-8dba-468f-943c-538c8982e7a6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9720e9f5dd459facdc7bad89ff4d47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9796b60c7eba42aaaaca8b95a161e349', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:22.287218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5baef-8dba-468f-943c-538c8982e7a6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:22.288821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5baef-8dba-468f-943c-538c8982e7a6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:22.289305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5baef-8dba-468f-943c-538c8982e7a6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:22.291741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5baef-8dba-468f-943c-538c8982e7a6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:22.295358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5baef-8dba-468f-943c-538c8982e7a6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:22.301421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5baef-8dba-468f-943c-538c8982e7a6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:22.337378 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1536/3030] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:22.342296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c4196-e3b1-40ba-b36b-79510b805574 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:22.352908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c4196-e3b1-40ba-b36b-79510b805574 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:22.386127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fc523-04f8-44a4-aac2-4c4de309b666 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9720e9f5dd459facdc7bad89ff4d47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9796b60c7eba42aaaaca8b95a161e349', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:22.387591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fc523-04f8-44a4-aac2-4c4de309b666 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:22.388070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fc523-04f8-44a4-aac2-4c4de309b666 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:22.388572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fc523-04f8-44a4-aac2-4c4de309b666 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:22.389446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fc523-04f8-44a4-aac2-4c4de309b666 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:22.400886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fc523-04f8-44a4-aac2-4c4de309b666 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:22.665461 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1495/3031] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:43:22 2022] POST /identity/v3/users => generated 381 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:22.670372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5baef-8dba-468f-943c-538c8982e7a6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:22.687830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5baef-8dba-468f-943c-538c8982e7a6 tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:22.702450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3302ca-c36d-4f76-bd5c-ed58317655eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9720e9f5dd459facdc7bad89ff4d47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9796b60c7eba42aaaaca8b95a161e349', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:22.704990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3302ca-c36d-4f76-bd5c-ed58317655eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:22.705281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3302ca-c36d-4f76-bd5c-ed58317655eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:22.705919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3302ca-c36d-4f76-bd5c-ed58317655eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:22.706624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3302ca-c36d-4f76-bd5c-ed58317655eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:22.706936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3302ca-c36d-4f76-bd5c-ed58317655eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:22.712512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3302ca-c36d-4f76-bd5c-ed58317655eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:22.754968 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1537/3032] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:22.782740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:23.286299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5834f-391d-4362-8759-c93cd9d0d59d None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:23.286719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5834f-391d-4362-8759-c93cd9d0d59d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:23.287093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5834f-391d-4362-8759-c93cd9d0d59d None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:23.288647 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1496/3033] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:43:23.296926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3302ca-c36d-4f76-bd5c-ed58317655eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:43:23.321776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3302ca-c36d-4f76-bd5c-ed58317655eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:23.337253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3302ca-c36d-4f76-bd5c-ed58317655eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:23.353105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8b5e-cfd9-4494-85f2-26e0d5661b0b tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9720e9f5dd459facdc7bad89ff4d47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9796b60c7eba42aaaaca8b95a161e349', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:23.354054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8b5e-cfd9-4494-85f2-26e0d5661b0b tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:23.354524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8b5e-cfd9-4494-85f2-26e0d5661b0b tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:23.355612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8b5e-cfd9-4494-85f2-26e0d5661b0b tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] PATH_INFO: `/v3/projects/d5c57bd1ab8345f38252fc4fd0fb6a7f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:23.359690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db8b5e-cfd9-4494-85f2-26e0d5661b0b tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorizing `identity:get_project(project_id=d5c57bd1ab8345f38252fc4fd0fb6a7f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:23.370175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db8b5e-cfd9-4494-85f2-26e0d5661b0b tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:23.379659 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1538/3034] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:43:23 2022] GET /identity/v3/projects/d5c57bd1ab8345f38252fc4fd0fb6a7f => generated 369 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:23.885919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:24.314719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:24.469342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07f208-8464-4bc7-84fd-cbde988f87c5 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:24.469731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07f208-8464-4bc7-84fd-cbde988f87c5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:24.470066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07f208-8464-4bc7-84fd-cbde988f87c5 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:24.471479 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1497/3035] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:43:24.479021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8b5e-cfd9-4494-85f2-26e0d5661b0b tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:43:24.500811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8b5e-cfd9-4494-85f2-26e0d5661b0b tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:24.518312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8b5e-cfd9-4494-85f2-26e0d5661b0b tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:24.529981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14dae9-a092-435b-9249-7b298f9da3ca tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9720e9f5dd459facdc7bad89ff4d47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9796b60c7eba42aaaaca8b95a161e349', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:24.530629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14dae9-a092-435b-9249-7b298f9da3ca tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:24.530908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14dae9-a092-435b-9249-7b298f9da3ca tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:24.531189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14dae9-a092-435b-9249-7b298f9da3ca tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] PATH_INFO: `/v3/projects/d5c57bd1ab8345f38252fc4fd0fb6a7f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:24.532806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14dae9-a092-435b-9249-7b298f9da3ca tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorizing `identity:get_project(project_id=d5c57bd1ab8345f38252fc4fd0fb6a7f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:24.535006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14dae9-a092-435b-9249-7b298f9da3ca tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:24.541534 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1539/3036] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:43:24 2022] GET /identity/v3/projects/d5c57bd1ab8345f38252fc4fd0fb6a7f => generated 369 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:24.601672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07f208-8464-4bc7-84fd-cbde988f87c5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:24.633192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07f208-8464-4bc7-84fd-cbde988f87c5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:24.651090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407be5b-9b6c-4a0d-b651-dacacc8c013f tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9720e9f5dd459facdc7bad89ff4d47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9796b60c7eba42aaaaca8b95a161e349', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:24.652460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407be5b-9b6c-4a0d-b651-dacacc8c013f tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:24.652788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407be5b-9b6c-4a0d-b651-dacacc8c013f tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:24.653211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407be5b-9b6c-4a0d-b651-dacacc8c013f tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] PATH_INFO: `/v3/users/df31d2d23bc4451696c7a2728ccabf58` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:24.694486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407be5b-9b6c-4a0d-b651-dacacc8c013f tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorizing `identity:delete_user(user_id=df31d2d23bc4451696c7a2728ccabf58)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:24.694486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407be5b-9b6c-4a0d-b651-dacacc8c013f tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:24.844958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5407be5b-9b6c-4a0d-b651-dacacc8c013f tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df31d2d23bc4451696c7a2728ccabf58'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:24.967756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5407be5b-9b6c-4a0d-b651-dacacc8c013f tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df31d2d23bc4451696c7a2728ccabf58'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:24.969820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5407be5b-9b6c-4a0d-b651-dacacc8c013f tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df31d2d23bc4451696c7a2728ccabf58'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:24.978604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5407be5b-9b6c-4a0d-b651-dacacc8c013f tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df31d2d23bc4451696c7a2728ccabf58'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:25.009635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5407be5b-9b6c-4a0d-b651-dacacc8c013f tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df31d2d23bc4451696c7a2728ccabf58'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:25.029433 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1498/3037] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:43:24 2022] DELETE /identity/v3/users/df31d2d23bc4451696c7a2728ccabf58 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:25.033233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14dae9-a092-435b-9249-7b298f9da3ca tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:25.035484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2e14dae9-a092-435b-9249-7b298f9da3ca tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:25.063082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14dae9-a092-435b-9249-7b298f9da3ca tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:25.200666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:25.203781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7dcdcf-f359-4011-9b35-00ed41ac41eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9720e9f5dd459facdc7bad89ff4d47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9796b60c7eba42aaaaca8b95a161e349', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:25.204762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dcdcf-f359-4011-9b35-00ed41ac41eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:25.205231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dcdcf-f359-4011-9b35-00ed41ac41eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:25.209819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dcdcf-f359-4011-9b35-00ed41ac41eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] PATH_INFO: `/v3/projects/d5c57bd1ab8345f38252fc4fd0fb6a7f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:25.209819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7dcdcf-f359-4011-9b35-00ed41ac41eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d5c57bd1ab8345f38252fc4fd0fb6a7f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:25.213608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7dcdcf-f359-4011-9b35-00ed41ac41eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:25.390884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-de7dcdcf-f359-4011-9b35-00ed41ac41eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c57bd1ab8345f38252fc4fd0fb6a7f', 'request_id': 'req-de7dcdcf-f359-4011-9b35-00ed41ac41eb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:25.407673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-de7dcdcf-f359-4011-9b35-00ed41ac41eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c57bd1ab8345f38252fc4fd0fb6a7f', 'request_id': 'req-de7dcdcf-f359-4011-9b35-00ed41ac41eb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:25.502696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-de7dcdcf-f359-4011-9b35-00ed41ac41eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c57bd1ab8345f38252fc4fd0fb6a7f', 'request_id': 'req-de7dcdcf-f359-4011-9b35-00ed41ac41eb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:25.524143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-de7dcdcf-f359-4011-9b35-00ed41ac41eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] The token cache is being invalidate because project d5c57bd1ab8345f38252fc4fd0fb6a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:43:25.526764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-de7dcdcf-f359-4011-9b35-00ed41ac41eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:25.530177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-de7dcdcf-f359-4011-9b35-00ed41ac41eb tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:25.533284 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1540/3038] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:25 2022] DELETE /identity/v3/projects/d5c57bd1ab8345f38252fc4fd0fb6a7f => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:25.539116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407be5b-9b6c-4a0d-b651-dacacc8c013f tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:25.542182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5407be5b-9b6c-4a0d-b651-dacacc8c013f tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:25.666332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f549fd3-3db5-4d93-8d78-83811d0cc1b7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:25.666745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f549fd3-3db5-4d93-8d78-83811d0cc1b7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:25.667201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f549fd3-3db5-4d93-8d78-83811d0cc1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:25.674772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-8f549fd3-3db5-4d93-8d78-83811d0cc1b7 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:43:25.674772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:43:25.674772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:43:25.674772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:43:25.674772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:43:25.674772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:43:25.674772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:43:25.674772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:43:25.674772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:43:25.674772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:43:25.674772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:43:25.674772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:43:25.674772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:43:25.675890 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:43:25.675890 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:43:25.675890 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:43:25.675890 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:43:25.675890 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:43:25.675890 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:43:25.675890 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:43:25.675890 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:43:25.675890 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:43:25.675890 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:43:25.675890 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:43:25.675890 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:43:25.675890 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:43:25.675890 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:43:25.675890 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:43:25.678034 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1541/3039] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:43:25 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 13 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 04:43:25.728688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407be5b-9b6c-4a0d-b651-dacacc8c013f tempest-QuotasAdminTestV257-1388609619 tempest-QuotasAdminTestV257-1388609619-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:25.891798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:25.935436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f81d6e-466d-4ff2-9f29-5ba2824f8675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:25.940962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f81d6e-466d-4ff2-9f29-5ba2824f8675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:25.944688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f81d6e-466d-4ff2-9f29-5ba2824f8675 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:25.945241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f81d6e-466d-4ff2-9f29-5ba2824f8675 admin admin] PATH_INFO: `/v3/users/92c87c182de244ca95b93cc62f3bc744` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:25.957672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f81d6e-466d-4ff2-9f29-5ba2824f8675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c87c182de244ca95b93cc62f3bc744)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:25.971905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f81d6e-466d-4ff2-9f29-5ba2824f8675 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:26.301281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-57f81d6e-466d-4ff2-9f29-5ba2824f8675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c87c182de244ca95b93cc62f3bc744'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:26.430960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-57f81d6e-466d-4ff2-9f29-5ba2824f8675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c87c182de244ca95b93cc62f3bc744'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:26.430960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-57f81d6e-466d-4ff2-9f29-5ba2824f8675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c87c182de244ca95b93cc62f3bc744'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:26.459824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-57f81d6e-466d-4ff2-9f29-5ba2824f8675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c87c182de244ca95b93cc62f3bc744'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:26.504647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-57f81d6e-466d-4ff2-9f29-5ba2824f8675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c87c182de244ca95b93cc62f3bc744'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:26.520600 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1499/3040] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:43:25 2022] DELETE /identity/v3/users/92c87c182de244ca95b93cc62f3bc744 => generated 0 bytes in 982 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:26.525153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1e758-221b-40f3-8655-d8f12d83004c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:26.526303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1e758-221b-40f3-8655-d8f12d83004c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:26.526303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1e758-221b-40f3-8655-d8f12d83004c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:26.584312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-98a1e758-221b-40f3-8655-d8f12d83004c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:26.585801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-98a1e758-221b-40f3-8655-d8f12d83004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:26.729101 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1542/3041] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:26.759107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f81d6e-466d-4ff2-9f29-5ba2824f8675 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:26.762414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-57f81d6e-466d-4ff2-9f29-5ba2824f8675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:26.957034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f81d6e-466d-4ff2-9f29-5ba2824f8675 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:26.970641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92e080-2451-47bd-9ab4-62af9d958d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:26.973873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92e080-2451-47bd-9ab4-62af9d958d07 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:26.974630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92e080-2451-47bd-9ab4-62af9d958d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:26.978149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92e080-2451-47bd-9ab4-62af9d958d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:27.004280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92e080-2451-47bd-9ab4-62af9d958d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:27.005819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92e080-2451-47bd-9ab4-62af9d958d07 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:27.032552 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1500/3042] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:27.571369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:28.150090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:29.752682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1e758-221b-40f3-8655-d8f12d83004c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:29.753247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-98a1e758-221b-40f3-8655-d8f12d83004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:29.755397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92e080-2451-47bd-9ab4-62af9d958d07 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:29.756934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1d92e080-2451-47bd-9ab4-62af9d958d07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:29.778241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1e758-221b-40f3-8655-d8f12d83004c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:29.793917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b7378-4419-498a-9699-55f637819b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:29.798160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b7378-4419-498a-9699-55f637819b11 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:29.798160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b7378-4419-498a-9699-55f637819b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:29.798160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b7378-4419-498a-9699-55f637819b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:29.800993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-eb4b7378-4419-498a-9699-55f637819b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:29.805595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92e080-2451-47bd-9ab4-62af9d958d07 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:29.824568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1735a1-6ec5-4503-b070-89a176a01ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:29.825365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1735a1-6ec5-4503-b070-89a176a01ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:29.825750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1735a1-6ec5-4503-b070-89a176a01ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:29.826144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1735a1-6ec5-4503-b070-89a176a01ff3 admin admin] PATH_INFO: `/v3/projects/48f0152fd4e84063ad8eaa691d1e14af` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:29.827551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1735a1-6ec5-4503-b070-89a176a01ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48f0152fd4e84063ad8eaa691d1e14af)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:29.829611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1735a1-6ec5-4503-b070-89a176a01ff3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:30.034630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b7378-4419-498a-9699-55f637819b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:30.036113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b7378-4419-498a-9699-55f637819b11 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:30.061357 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1543/3043] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:30.067364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-be1735a1-6ec5-4503-b070-89a176a01ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48f0152fd4e84063ad8eaa691d1e14af', 'request_id': 'req-be1735a1-6ec5-4503-b070-89a176a01ff3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:30.096806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-be1735a1-6ec5-4503-b070-89a176a01ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48f0152fd4e84063ad8eaa691d1e14af', 'request_id': 'req-be1735a1-6ec5-4503-b070-89a176a01ff3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:30.112942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-be1735a1-6ec5-4503-b070-89a176a01ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48f0152fd4e84063ad8eaa691d1e14af', 'request_id': 'req-be1735a1-6ec5-4503-b070-89a176a01ff3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:30.354865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-be1735a1-6ec5-4503-b070-89a176a01ff3 admin admin] The token cache is being invalidate because project 48f0152fd4e84063ad8eaa691d1e14af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:43:30.354865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-be1735a1-6ec5-4503-b070-89a176a01ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:30.354865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-be1735a1-6ec5-4503-b070-89a176a01ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:30.356673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b7378-4419-498a-9699-55f637819b11 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:30.358385 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1501/3044] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:29 2022] DELETE /identity/v3/projects/48f0152fd4e84063ad8eaa691d1e14af => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:43:30.374764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b7378-4419-498a-9699-55f637819b11 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:30.603604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49053d3-2740-4666-b24a-a3dc58637df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:30.603604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49053d3-2740-4666-b24a-a3dc58637df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:30.603604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49053d3-2740-4666-b24a-a3dc58637df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:30.603604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49053d3-2740-4666-b24a-a3dc58637df6 admin admin] PATH_INFO: `/v3/users/6d9720e9f5dd459facdc7bad89ff4d47` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:30.606118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49053d3-2740-4666-b24a-a3dc58637df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d9720e9f5dd459facdc7bad89ff4d47)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:30.606118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49053d3-2740-4666-b24a-a3dc58637df6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:30.613613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1735a1-6ec5-4503-b070-89a176a01ff3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:30.615548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-be1735a1-6ec5-4503-b070-89a176a01ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:30.715591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1735a1-6ec5-4503-b070-89a176a01ff3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:30.720523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca33847-662d-4d92-8d23-10d282a142b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:30.721683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca33847-662d-4d92-8d23-10d282a142b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:30.722128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca33847-662d-4d92-8d23-10d282a142b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:30.722569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca33847-662d-4d92-8d23-10d282a142b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:30.725053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cca33847-662d-4d92-8d23-10d282a142b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:30.887541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca33847-662d-4d92-8d23-10d282a142b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:30.890343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca33847-662d-4d92-8d23-10d282a142b2 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:30.910045 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1502/3045] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:43:31.078234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b49053d3-2740-4666-b24a-a3dc58637df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d9720e9f5dd459facdc7bad89ff4d47'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:31.081812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b49053d3-2740-4666-b24a-a3dc58637df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d9720e9f5dd459facdc7bad89ff4d47'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:31.274041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b49053d3-2740-4666-b24a-a3dc58637df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d9720e9f5dd459facdc7bad89ff4d47'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:31.274826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b49053d3-2740-4666-b24a-a3dc58637df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d9720e9f5dd459facdc7bad89ff4d47'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:31.307886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b49053d3-2740-4666-b24a-a3dc58637df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d9720e9f5dd459facdc7bad89ff4d47'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:31.352638 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1544/3046] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:43:30 2022] DELETE /identity/v3/users/6d9720e9f5dd459facdc7bad89ff4d47 => generated 0 bytes in 996 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:43:32.924979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:33.035313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dae525-3b53-4285-a339-1a76735fc961 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:33.037394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dae525-3b53-4285-a339-1a76735fc961 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:33.037394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dae525-3b53-4285-a339-1a76735fc961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:33.176280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-21dae525-3b53-4285-a339-1a76735fc961 None None] MFA Rules not processed for user `6c5f4f0d776f4ad1a11f5408c0652bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:33.181346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-21dae525-3b53-4285-a339-1a76735fc961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:33.284665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:33.396207 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1503/3047] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:33.396433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e0aaa-6ae8-4a48-af80-2315fa21f2d4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:33.396433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e0aaa-6ae8-4a48-af80-2315fa21f2d4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:33.396433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e0aaa-6ae8-4a48-af80-2315fa21f2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:33.437465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e05e0aaa-6ae8-4a48-af80-2315fa21f2d4 None None] MFA Rules not processed for user `6c5f4f0d776f4ad1a11f5408c0652bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:33.446719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e05e0aaa-6ae8-4a48-af80-2315fa21f2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:33.492234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6281ab-0e58-4eeb-84a8-50df3e406e48 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:33.499420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6281ab-0e58-4eeb-84a8-50df3e406e48 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:33.499420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6281ab-0e58-4eeb-84a8-50df3e406e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:33.506002 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1545/3048] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:33.542458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-aa6281ab-0e58-4eeb-84a8-50df3e406e48 None None] MFA Rules not processed for user `4f4affe28e084a7eb873d9a1f0f79fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:33.544057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aa6281ab-0e58-4eeb-84a8-50df3e406e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:33.550944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e0aaa-6ae8-4a48-af80-2315fa21f2d4 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:33.560439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e05e0aaa-6ae8-4a48-af80-2315fa21f2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:33.632505 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1504/3049] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:43:33.633996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6281ab-0e58-4eeb-84a8-50df3e406e48 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:33.636649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aa6281ab-0e58-4eeb-84a8-50df3e406e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:33.755201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6281ab-0e58-4eeb-84a8-50df3e406e48 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:33.763106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fd28f-1144-4ed8-a2d8-b42c08882513 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:33.763995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fd28f-1144-4ed8-a2d8-b42c08882513 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:33.766091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fd28f-1144-4ed8-a2d8-b42c08882513 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:33.766091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fd28f-1144-4ed8-a2d8-b42c08882513 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:33.792888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fd28f-1144-4ed8-a2d8-b42c08882513 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:33.794823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fd28f-1144-4ed8-a2d8-b42c08882513 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:33.808326 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1505/3050] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:33.833855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e0aaa-6ae8-4a48-af80-2315fa21f2d4 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:33.847666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d52105-38b3-4139-9ec3-3a91c9d37125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:33.848704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d52105-38b3-4139-9ec3-3a91c9d37125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:33.849273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d52105-38b3-4139-9ec3-3a91c9d37125 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:33.849700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d52105-38b3-4139-9ec3-3a91c9d37125 admin admin] PATH_INFO: `/v3/projects/9796b60c7eba42aaaaca8b95a161e349` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:33.853530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d52105-38b3-4139-9ec3-3a91c9d37125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9796b60c7eba42aaaaca8b95a161e349)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:33.861859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d52105-38b3-4139-9ec3-3a91c9d37125 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:34.114443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-13d52105-38b3-4139-9ec3-3a91c9d37125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9796b60c7eba42aaaaca8b95a161e349', 'request_id': 'req-13d52105-38b3-4139-9ec3-3a91c9d37125'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:34.133107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-13d52105-38b3-4139-9ec3-3a91c9d37125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9796b60c7eba42aaaaca8b95a161e349', 'request_id': 'req-13d52105-38b3-4139-9ec3-3a91c9d37125'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:34.249261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-13d52105-38b3-4139-9ec3-3a91c9d37125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9796b60c7eba42aaaaca8b95a161e349', 'request_id': 'req-13d52105-38b3-4139-9ec3-3a91c9d37125'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:34.274184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-13d52105-38b3-4139-9ec3-3a91c9d37125 admin admin] The token cache is being invalidate because project 9796b60c7eba42aaaaca8b95a161e349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:43:34.274486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-13d52105-38b3-4139-9ec3-3a91c9d37125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:34.279232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-13d52105-38b3-4139-9ec3-3a91c9d37125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:34.283636 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1546/3051] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:33 2022] DELETE /identity/v3/projects/9796b60c7eba42aaaaca8b95a161e349 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:43:34.293386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf78564-7303-499f-bf84-56405a9e5e89 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:34.300064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf78564-7303-499f-bf84-56405a9e5e89 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:34.300064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf78564-7303-499f-bf84-56405a9e5e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:34.334875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45f390-589a-46e9-834b-49a52991f231 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:34.337018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45f390-589a-46e9-834b-49a52991f231 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:34.337557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45f390-589a-46e9-834b-49a52991f231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:34.381005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1cf78564-7303-499f-bf84-56405a9e5e89 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:34.383189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1cf78564-7303-499f-bf84-56405a9e5e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:34.383314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-4a45f390-589a-46e9-834b-49a52991f231 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:43:34.383314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:43:34.383314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:43:34.383314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:43:34.383314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:43:34.383314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:43:34.383314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:43:34.383314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:43:34.383314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:43:34.383314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:43:34.383314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:43:34.383314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:43:34.383314 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:43:34.384282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:43:34.384282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:43:34.384282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:43:34.384282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:43:34.384282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:43:34.384282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:43:34.384282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:43:34.384282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:43:34.384282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:43:34.384282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:43:34.384282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:43:34.384282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:43:34.384282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:43:34.384282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:43:34.384282 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:43:34.419516 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1547/3052] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:43:34 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 66 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:43:34.419516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd68daa-412f-4a51-9cd0-6212291e076e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:34.419516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd68daa-412f-4a51-9cd0-6212291e076e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:34.419516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd68daa-412f-4a51-9cd0-6212291e076e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:34.499109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9bd68daa-412f-4a51-9cd0-6212291e076e None None] MFA Rules not processed for user `6c5f4f0d776f4ad1a11f5408c0652bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:34.506588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9bd68daa-412f-4a51-9cd0-6212291e076e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:34.611143 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1506/3053] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:34.618920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4204b1-0d16-4085-bc07-7d5710af54e2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:34.624883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4204b1-0d16-4085-bc07-7d5710af54e2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:34.626667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4204b1-0d16-4085-bc07-7d5710af54e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:34.700747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ac4204b1-0d16-4085-bc07-7d5710af54e2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:34.703928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ac4204b1-0d16-4085-bc07-7d5710af54e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:34.712313 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1548/3054] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:34.747172 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1507/3055] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:34.748128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd68daa-412f-4a51-9cd0-6212291e076e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:34.786972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd68daa-412f-4a51-9cd0-6212291e076e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:34.818584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87ef21-3c73-4f05-bdc8-906d8fd02b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:34.819227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87ef21-3c73-4f05-bdc8-906d8fd02b14 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:34.819692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87ef21-3c73-4f05-bdc8-906d8fd02b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:34.819972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87ef21-3c73-4f05-bdc8-906d8fd02b14 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:34.821054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87ef21-3c73-4f05-bdc8-906d8fd02b14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:34.821363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87ef21-3c73-4f05-bdc8-906d8fd02b14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:34.824272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87ef21-3c73-4f05-bdc8-906d8fd02b14 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:34.861395 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1549/3056] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:34.862602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4204b1-0d16-4085-bc07-7d5710af54e2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:34.875148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4204b1-0d16-4085-bc07-7d5710af54e2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:34.895160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaed13-a358-4af7-b424-b33e9a027140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:34.896155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaed13-a358-4af7-b424-b33e9a027140 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:34.896902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaed13-a358-4af7-b424-b33e9a027140 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:34.901766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaed13-a358-4af7-b424-b33e9a027140 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:34.901766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaed13-a358-4af7-b424-b33e9a027140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:34.903932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaed13-a358-4af7-b424-b33e9a027140 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:35.095643 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1508/3057] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:43:34 2022] POST /identity/v3/projects => generated 407 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:35.101123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87ef21-3c73-4f05-bdc8-906d8fd02b14 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:35.119826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87ef21-3c73-4f05-bdc8-906d8fd02b14 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:35.254800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d6523-663b-47bd-9f38-398c93ebfc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:35.254800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6523-663b-47bd-9f38-398c93ebfc74 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:35.254800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6523-663b-47bd-9f38-398c93ebfc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:35.254800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6523-663b-47bd-9f38-398c93ebfc74 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:35.255249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d6523-663b-47bd-9f38-398c93ebfc74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:35.261621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d6523-663b-47bd-9f38-398c93ebfc74 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:35.275046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:35.382180 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1550/3058] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:43:35 2022] POST /identity/v3/users => generated 304 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:43:35.387005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaed13-a358-4af7-b424-b33e9a027140 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:35.408007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaed13-a358-4af7-b424-b33e9a027140 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:35.423591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6185a-72bc-4107-807c-86f1354f93ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:35.426740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6185a-72bc-4107-807c-86f1354f93ca admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:35.427279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6185a-72bc-4107-807c-86f1354f93ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:35.428011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6185a-72bc-4107-807c-86f1354f93ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:35.429725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6185a-72bc-4107-807c-86f1354f93ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:35.434675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6185a-72bc-4107-807c-86f1354f93ca admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:35.470240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d6523-663b-47bd-9f38-398c93ebfc74 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:35.484391 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1509/3059] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:35.486071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d6523-663b-47bd-9f38-398c93ebfc74 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:35.503039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf957e3-b2c0-40fd-8cc1-ec399d65fde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:35.503688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf957e3-b2c0-40fd-8cc1-ec399d65fde2 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:35.512989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf957e3-b2c0-40fd-8cc1-ec399d65fde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:35.512989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf957e3-b2c0-40fd-8cc1-ec399d65fde2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:35.512989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf957e3-b2c0-40fd-8cc1-ec399d65fde2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:35.512989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf957e3-b2c0-40fd-8cc1-ec399d65fde2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:35.531132 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1551/3060] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:35.531429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6185a-72bc-4107-807c-86f1354f93ca admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:35.547198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6185a-72bc-4107-807c-86f1354f93ca admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:35.556030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8be540-face-48a9-824d-7aeac0109176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:35.557941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8be540-face-48a9-824d-7aeac0109176 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:35.558441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8be540-face-48a9-824d-7aeac0109176 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:35.559431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8be540-face-48a9-824d-7aeac0109176 admin admin] PATH_INFO: `/v3/projects/e78d81ae85df4c4e8d4ce99867f5acc1/users/2ca6f8adf6a642dc8beefc1e7b38ff80/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:35.599176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8be540-face-48a9-824d-7aeac0109176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78d81ae85df4c4e8d4ce99867f5acc1, user_id=2ca6f8adf6a642dc8beefc1e7b38ff80, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:35.603408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8be540-face-48a9-824d-7aeac0109176 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:35.786162 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1510/3061] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:35 2022] PUT /identity/v3/projects/e78d81ae85df4c4e8d4ce99867f5acc1/users/2ca6f8adf6a642dc8beefc1e7b38ff80/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:35.799375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be12c5-c3ee-4206-a628-05a809c1ff67 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:35.799642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be12c5-c3ee-4206-a628-05a809c1ff67 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:35.800024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be12c5-c3ee-4206-a628-05a809c1ff67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:35.878165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-45be12c5-c3ee-4206-a628-05a809c1ff67 None None] MFA Rules not processed for user `2ca6f8adf6a642dc8beefc1e7b38ff80`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:35.879896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-45be12c5-c3ee-4206-a628-05a809c1ff67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:35.920315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8be540-face-48a9-824d-7aeac0109176 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:35.922637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aa8be540-face-48a9-824d-7aeac0109176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:36.070374 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1552/3062] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:35 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:36.072784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be12c5-c3ee-4206-a628-05a809c1ff67 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:36.128046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8be540-face-48a9-824d-7aeac0109176 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:36.158428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab81d06-aa49-4fe3-90c0-a4e578813dc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:36.158825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab81d06-aa49-4fe3-90c0-a4e578813dc7 service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:36.159936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab81d06-aa49-4fe3-90c0-a4e578813dc7 service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:36.159936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab81d06-aa49-4fe3-90c0-a4e578813dc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:36.169081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fab81d06-aa49-4fe3-90c0-a4e578813dc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:36.202840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab81d06-aa49-4fe3-90c0-a4e578813dc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:36.206084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab81d06-aa49-4fe3-90c0-a4e578813dc7 service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:36.217778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be12c5-c3ee-4206-a628-05a809c1ff67 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:36.222389 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1511/3063] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:36.247570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98df72-f08c-4a37-a3e5-5d50513f1307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:36.249539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98df72-f08c-4a37-a3e5-5d50513f1307 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:36.249823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98df72-f08c-4a37-a3e5-5d50513f1307 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:36.250105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98df72-f08c-4a37-a3e5-5d50513f1307 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:36.253697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98df72-f08c-4a37-a3e5-5d50513f1307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:36.261938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98df72-f08c-4a37-a3e5-5d50513f1307 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:36.423449 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1553/3064] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:43:36 2022] POST /identity/v3/projects => generated 409 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:36.424097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab81d06-aa49-4fe3-90c0-a4e578813dc7 service placement] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:36.441138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab81d06-aa49-4fe3-90c0-a4e578813dc7 service placement] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:36.629051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff55db-7f21-432d-b987-1292d8061948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:36.629798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff55db-7f21-432d-b987-1292d8061948 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:36.630087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff55db-7f21-432d-b987-1292d8061948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:36.630363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff55db-7f21-432d-b987-1292d8061948 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:36.631015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff55db-7f21-432d-b987-1292d8061948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:36.635204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff55db-7f21-432d-b987-1292d8061948 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:36.801790 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1512/3065] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:43:36 2022] POST /identity/v3/users => generated 311 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:36.805871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98df72-f08c-4a37-a3e5-5d50513f1307 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:36.825508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98df72-f08c-4a37-a3e5-5d50513f1307 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:36.832054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8a041-58db-47b8-bf44-fd50799c8985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:36.836866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8a041-58db-47b8-bf44-fd50799c8985 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:36.836866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8a041-58db-47b8-bf44-fd50799c8985 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:36.836866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8a041-58db-47b8-bf44-fd50799c8985 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:36.836866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8a041-58db-47b8-bf44-fd50799c8985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:36.836866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8a041-58db-47b8-bf44-fd50799c8985 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:36.858632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff55db-7f21-432d-b987-1292d8061948 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:36.869515 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1554/3066] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:36.877239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff55db-7f21-432d-b987-1292d8061948 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:36.879610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d509e-4412-4f40-b587-66d598625afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:36.880574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d509e-4412-4f40-b587-66d598625afa admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:36.881036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d509e-4412-4f40-b587-66d598625afa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:36.881536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d509e-4412-4f40-b587-66d598625afa admin admin] PATH_INFO: `/v3/projects/ed27d61f65314a4a9e03ebab12fb9f39/users/2e007d47a40b495b91ceb54b78e5a07c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:36.903762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d509e-4412-4f40-b587-66d598625afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed27d61f65314a4a9e03ebab12fb9f39, user_id=2e007d47a40b495b91ceb54b78e5a07c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:36.907094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d509e-4412-4f40-b587-66d598625afa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:37.003158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b527dc8-e311-4d47-92a5-712914328277 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:37.003721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b527dc8-e311-4d47-92a5-712914328277 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:37.004200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b527dc8-e311-4d47-92a5-712914328277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:37.023490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-8b527dc8-e311-4d47-92a5-712914328277 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:43:37.023490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:43:37.023490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:43:37.023490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:43:37.023490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:43:37.023490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:43:37.023490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:43:37.023490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:43:37.023490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:43:37.023490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:43:37.023490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:43:37.023490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:43:37.023490 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:43:37.024638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:43:37.024638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:43:37.024638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:43:37.024638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:43:37.024638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:43:37.024638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:43:37.024638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:43:37.024638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:43:37.024638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:43:37.024638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:43:37.024638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:43:37.024638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:43:37.024638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:43:37.024638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:43:37.024638 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:43:37.031413 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1555/3067] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:43:37 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 29 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:43:37.055762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932f32b-3c3d-44ef-ad92-fe952849766f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:37.057084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932f32b-3c3d-44ef-ad92-fe952849766f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:37.057535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932f32b-3c3d-44ef-ad92-fe952849766f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:37.075962 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1513/3068] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:36 2022] PUT /identity/v3/projects/ed27d61f65314a4a9e03ebab12fb9f39/users/2e007d47a40b495b91ceb54b78e5a07c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:37.084967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d509e-4412-4f40-b587-66d598625afa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:37.095446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:37.101886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8932f32b-3c3d-44ef-ad92-fe952849766f None None] MFA Rules not processed for user `6c5f4f0d776f4ad1a11f5408c0652bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:37.105571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8932f32b-3c3d-44ef-ad92-fe952849766f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:37.237976 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1556/3069] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:37.304117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d509e-4412-4f40-b587-66d598625afa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:37.314776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18c7d0-20a9-426f-b33e-b63dd6eafb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:37.315579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18c7d0-20a9-426f-b33e-b63dd6eafb03 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:37.315935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18c7d0-20a9-426f-b33e-b63dd6eafb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:37.316327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18c7d0-20a9-426f-b33e-b63dd6eafb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:37.317186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18c7d0-20a9-426f-b33e-b63dd6eafb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:37.321713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18c7d0-20a9-426f-b33e-b63dd6eafb03 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:37.343598 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1514/3070] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:37.345019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932f32b-3c3d-44ef-ad92-fe952849766f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:37.360954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932f32b-3c3d-44ef-ad92-fe952849766f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:37.367594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc471873-fa1a-4c1e-bfd6-68c4ec074d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:37.368460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471873-fa1a-4c1e-bfd6-68c4ec074d80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:37.368814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471873-fa1a-4c1e-bfd6-68c4ec074d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:37.369277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471873-fa1a-4c1e-bfd6-68c4ec074d80 admin admin] PATH_INFO: `/v3/projects/ed27d61f65314a4a9e03ebab12fb9f39/users/2e007d47a40b495b91ceb54b78e5a07c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:37.372914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc471873-fa1a-4c1e-bfd6-68c4ec074d80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed27d61f65314a4a9e03ebab12fb9f39, user_id=2e007d47a40b495b91ceb54b78e5a07c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:37.379574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc471873-fa1a-4c1e-bfd6-68c4ec074d80 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:37.417614 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1557/3071] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:37 2022] PUT /identity/v3/projects/ed27d61f65314a4a9e03ebab12fb9f39/users/2e007d47a40b495b91ceb54b78e5a07c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:37.419939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5a47d-5702-4d35-80c0-abff19e11dd9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:37.420362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5a47d-5702-4d35-80c0-abff19e11dd9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:37.423039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5a47d-5702-4d35-80c0-abff19e11dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:37.478777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-82f5a47d-5702-4d35-80c0-abff19e11dd9 None None] MFA Rules not processed for user `2e007d47a40b495b91ceb54b78e5a07c`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:37.481956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-82f5a47d-5702-4d35-80c0-abff19e11dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:37.670156 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1515/3072] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:37 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:37.671639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc471873-fa1a-4c1e-bfd6-68c4ec074d80 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:37.783234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:37.836454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc471873-fa1a-4c1e-bfd6-68c4ec074d80 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:37.849085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd44a00-218e-4dd9-958e-a19e65bacfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:37.850045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd44a00-218e-4dd9-958e-a19e65bacfc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:37.850520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd44a00-218e-4dd9-958e-a19e65bacfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:37.851106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd44a00-218e-4dd9-958e-a19e65bacfc5 admin admin] PATH_INFO: `/v3/users/2ca6f8adf6a642dc8beefc1e7b38ff80` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:37.853147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd44a00-218e-4dd9-958e-a19e65bacfc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca6f8adf6a642dc8beefc1e7b38ff80)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:37.856980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd44a00-218e-4dd9-958e-a19e65bacfc5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:38.362081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35480fdd-f3c9-4936-9d80-91c00870c1d7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:38.362822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35480fdd-f3c9-4936-9d80-91c00870c1d7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:38.363547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35480fdd-f3c9-4936-9d80-91c00870c1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:38.375581 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-35480fdd-f3c9-4936-9d80-91c00870c1d7 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:43:38.375581 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:43:38.375581 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:43:38.375581 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:43:38.375581 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:43:38.375581 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:43:38.375581 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:43:38.375581 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:43:38.375581 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:43:38.375581 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:43:38.375581 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:43:38.375581 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:43:38.375581 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:43:38.376632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:43:38.376632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:43:38.376632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:43:38.376632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:43:38.376632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:43:38.376632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:43:38.376632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:43:38.376632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:43:38.376632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:43:38.376632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:43:38.376632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:43:38.376632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:43:38.376632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:43:38.376632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:43:38.376632 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:43:38.377948 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1516/3073] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:43:38 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 18 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:43:38.407503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af14ff-ff31-4dca-b82e-9255c73792a7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:38.407503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af14ff-ff31-4dca-b82e-9255c73792a7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:38.407503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af14ff-ff31-4dca-b82e-9255c73792a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:38.458613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-11af14ff-ff31-4dca-b82e-9255c73792a7 None None] MFA Rules not processed for user `6c5f4f0d776f4ad1a11f5408c0652bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:38.461200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-11af14ff-ff31-4dca-b82e-9255c73792a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:38.570703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9bd44a00-218e-4dd9-958e-a19e65bacfc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca6f8adf6a642dc8beefc1e7b38ff80'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:38.574542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9bd44a00-218e-4dd9-958e-a19e65bacfc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca6f8adf6a642dc8beefc1e7b38ff80'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:38.640004 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1517/3074] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:38.736521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9bd44a00-218e-4dd9-958e-a19e65bacfc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca6f8adf6a642dc8beefc1e7b38ff80'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:38.737732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9bd44a00-218e-4dd9-958e-a19e65bacfc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca6f8adf6a642dc8beefc1e7b38ff80'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:38.770100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9bd44a00-218e-4dd9-958e-a19e65bacfc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca6f8adf6a642dc8beefc1e7b38ff80'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:38.826605 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1558/3075] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:43:37 2022] DELETE /identity/v3/users/2ca6f8adf6a642dc8beefc1e7b38ff80 => generated 0 bytes in 1155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:38.830572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e115a-10e1-4541-8fa5-3531d1fb584d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:38.831176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e115a-10e1-4541-8fa5-3531d1fb584d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:38.838286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e115a-10e1-4541-8fa5-3531d1fb584d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:38.865611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ac7e115a-10e1-4541-8fa5-3531d1fb584d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:38.878778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd44a00-218e-4dd9-958e-a19e65bacfc5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:38.880377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9bd44a00-218e-4dd9-958e-a19e65bacfc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:38.882557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ac7e115a-10e1-4541-8fa5-3531d1fb584d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:39.088278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd44a00-218e-4dd9-958e-a19e65bacfc5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:39.105868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b247e3-6bbb-43a2-aa59-5191b0b32848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:39.106761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b247e3-6bbb-43a2-aa59-5191b0b32848 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:39.107400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b247e3-6bbb-43a2-aa59-5191b0b32848 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:39.108256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b247e3-6bbb-43a2-aa59-5191b0b32848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:39.113229 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1518/3076] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:39.115076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-85b247e3-6bbb-43a2-aa59-5191b0b32848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:39.137558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b247e3-6bbb-43a2-aa59-5191b0b32848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:39.140000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b247e3-6bbb-43a2-aa59-5191b0b32848 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:39.155073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e115a-10e1-4541-8fa5-3531d1fb584d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:39.157173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ac7e115a-10e1-4541-8fa5-3531d1fb584d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:39.180458 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1559/3077] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:43:39.189584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e115a-10e1-4541-8fa5-3531d1fb584d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:39.198207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00268dcd-dc91-439d-b42b-1c45c466034c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:39.199315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00268dcd-dc91-439d-b42b-1c45c466034c service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:39.199793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00268dcd-dc91-439d-b42b-1c45c466034c service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:39.200323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00268dcd-dc91-439d-b42b-1c45c466034c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:39.230318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00268dcd-dc91-439d-b42b-1c45c466034c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:39.230318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00268dcd-dc91-439d-b42b-1c45c466034c service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:39.284854 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1519/3078] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:43:39.553982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:39.938452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:40.124435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d95c1d-3f8c-4371-af90-b0e9754bc337 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:40.125155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d95c1d-3f8c-4371-af90-b0e9754bc337 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:40.125155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d95c1d-3f8c-4371-af90-b0e9754bc337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:40.131620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-97d95c1d-3f8c-4371-af90-b0e9754bc337 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:43:40.131620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:43:40.131620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:43:40.131620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:43:40.131620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:43:40.131620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:43:40.131620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:43:40.131620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:43:40.131620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:43:40.131620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:43:40.131620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:43:40.131620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:43:40.131620 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:43:40.132847 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:43:40.132847 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:43:40.132847 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:43:40.132847 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:43:40.132847 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:43:40.132847 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:43:40.132847 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:43:40.132847 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:43:40.132847 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:43:40.132847 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:43:40.132847 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:43:40.132847 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:43:40.132847 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:43:40.132847 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:43:40.132847 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:43:40.145337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:40.151054 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1560/3079] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:43:40 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 22 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:43:41.240767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:41.548663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:41.763322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00268dcd-dc91-439d-b42b-1c45c466034c service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:41.765241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-00268dcd-dc91-439d-b42b-1c45c466034c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:41.898960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00268dcd-dc91-439d-b42b-1c45c466034c service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:41.905687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b29092-1db1-433d-bd4a-ea99d1560427 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:41.906490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b29092-1db1-433d-bd4a-ea99d1560427 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:41.906774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b29092-1db1-433d-bd4a-ea99d1560427 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:41.907046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b29092-1db1-433d-bd4a-ea99d1560427 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:41.909005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-03b29092-1db1-433d-bd4a-ea99d1560427 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:41.924141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d95c1d-3f8c-4371-af90-b0e9754bc337 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:41.926437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-97d95c1d-3f8c-4371-af90-b0e9754bc337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:41.950375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b29092-1db1-433d-bd4a-ea99d1560427 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:41.954805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b29092-1db1-433d-bd4a-ea99d1560427 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:41.985169 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1520/3080] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:42.014316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d95c1d-3f8c-4371-af90-b0e9754bc337 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:42.037768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa337395-e633-4851-a339-aa67a5705761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:42.038432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa337395-e633-4851-a339-aa67a5705761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:42.038712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa337395-e633-4851-a339-aa67a5705761 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:42.038983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa337395-e633-4851-a339-aa67a5705761 admin admin] PATH_INFO: `/v3/projects/e78d81ae85df4c4e8d4ce99867f5acc1` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:42.046708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa337395-e633-4851-a339-aa67a5705761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78d81ae85df4c4e8d4ce99867f5acc1)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:42.055727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa337395-e633-4851-a339-aa67a5705761 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:42.358952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aa337395-e633-4851-a339-aa67a5705761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78d81ae85df4c4e8d4ce99867f5acc1', 'request_id': 'req-aa337395-e633-4851-a339-aa67a5705761'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:42.371016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aa337395-e633-4851-a339-aa67a5705761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78d81ae85df4c4e8d4ce99867f5acc1', 'request_id': 'req-aa337395-e633-4851-a339-aa67a5705761'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:42.468195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aa337395-e633-4851-a339-aa67a5705761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78d81ae85df4c4e8d4ce99867f5acc1', 'request_id': 'req-aa337395-e633-4851-a339-aa67a5705761'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:42.523663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aa337395-e633-4851-a339-aa67a5705761 admin admin] The token cache is being invalidate because project e78d81ae85df4c4e8d4ce99867f5acc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:43:42.523663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aa337395-e633-4851-a339-aa67a5705761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:42.532721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aa337395-e633-4851-a339-aa67a5705761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:42.536337 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1561/3081] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:41 2022] DELETE /identity/v3/projects/e78d81ae85df4c4e8d4ce99867f5acc1 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:42.540060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b29092-1db1-433d-bd4a-ea99d1560427 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:42.563555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b29092-1db1-433d-bd4a-ea99d1560427 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:42.596310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:42.654170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa337395-e633-4851-a339-aa67a5705761 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:42.655610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-aa337395-e633-4851-a339-aa67a5705761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:42.811653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e837e01-3199-4619-b404-d88160361370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:42.812804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e837e01-3199-4619-b404-d88160361370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:42.813159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e837e01-3199-4619-b404-d88160361370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:42.813423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e837e01-3199-4619-b404-d88160361370 admin admin] PATH_INFO: `/v3/users/2e007d47a40b495b91ceb54b78e5a07c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:42.814911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e837e01-3199-4619-b404-d88160361370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e007d47a40b495b91ceb54b78e5a07c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:42.817510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e837e01-3199-4619-b404-d88160361370 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:42.913515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa337395-e633-4851-a339-aa67a5705761 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:42.935134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2689ab-10cb-4a0a-9404-dc91344e61cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:42.935134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2689ab-10cb-4a0a-9404-dc91344e61cb service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:42.935134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2689ab-10cb-4a0a-9404-dc91344e61cb service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:42.935134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2689ab-10cb-4a0a-9404-dc91344e61cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:42.937738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6b2689ab-10cb-4a0a-9404-dc91344e61cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:43.028604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2689ab-10cb-4a0a-9404-dc91344e61cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:43.030925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2689ab-10cb-4a0a-9404-dc91344e61cb service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:43.042946 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1562/3082] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:42 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:43:43.054906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2689ab-10cb-4a0a-9404-dc91344e61cb service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:43.054906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6b2689ab-10cb-4a0a-9404-dc91344e61cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:43.080238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2689ab-10cb-4a0a-9404-dc91344e61cb service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:43.112102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2cd8e-af03-4628-8da9-0514139cd04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:43.113718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2cd8e-af03-4628-8da9-0514139cd04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:43.114261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2cd8e-af03-4628-8da9-0514139cd04f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:43.119420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2cd8e-af03-4628-8da9-0514139cd04f admin admin] PATH_INFO: `/v3/users/bb90f64664c74949ad58644bcbdafdfc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:43.124410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2cd8e-af03-4628-8da9-0514139cd04f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb90f64664c74949ad58644bcbdafdfc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:43.127492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2cd8e-af03-4628-8da9-0514139cd04f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:43.182448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1e837e01-3199-4619-b404-d88160361370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e007d47a40b495b91ceb54b78e5a07c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:43.268868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1e837e01-3199-4619-b404-d88160361370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e007d47a40b495b91ceb54b78e5a07c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:43.270690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1e837e01-3199-4619-b404-d88160361370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e007d47a40b495b91ceb54b78e5a07c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:43.284972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1e837e01-3199-4619-b404-d88160361370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e007d47a40b495b91ceb54b78e5a07c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:43.314999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1e837e01-3199-4619-b404-d88160361370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e007d47a40b495b91ceb54b78e5a07c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:43.330658 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1521/3083] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:43:42 2022] DELETE /identity/v3/users/2e007d47a40b495b91ceb54b78e5a07c => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:43.332377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068fe79-0e34-4c6e-a639-ff5a9c054006 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:43.332660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068fe79-0e34-4c6e-a639-ff5a9c054006 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:43.332929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068fe79-0e34-4c6e-a639-ff5a9c054006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:43.382382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2068fe79-0e34-4c6e-a639-ff5a9c054006 None None] MFA Rules not processed for user `a498ce4dafbd4ef69ee8fee961f83dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:43.389496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2068fe79-0e34-4c6e-a639-ff5a9c054006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:43.391717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2e2cd8e-af03-4628-8da9-0514139cd04f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb90f64664c74949ad58644bcbdafdfc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:43.392467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2e2cd8e-af03-4628-8da9-0514139cd04f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb90f64664c74949ad58644bcbdafdfc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:43.461409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2e2cd8e-af03-4628-8da9-0514139cd04f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb90f64664c74949ad58644bcbdafdfc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:43.462307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2e2cd8e-af03-4628-8da9-0514139cd04f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb90f64664c74949ad58644bcbdafdfc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:43.492700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2e2cd8e-af03-4628-8da9-0514139cd04f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb90f64664c74949ad58644bcbdafdfc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:43.524809 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1563/3084] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:43:43 2022] DELETE /identity/v3/users/bb90f64664c74949ad58644bcbdafdfc => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:43.532076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:43.556245 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1522/3085] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:43.857109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:44.318676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2cd8e-af03-4628-8da9-0514139cd04f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:44.320117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c2e2cd8e-af03-4628-8da9-0514139cd04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:44.555301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2cd8e-af03-4628-8da9-0514139cd04f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:44.577218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a12ed0-a000-4cf9-a653-07606490a031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:44.581484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a12ed0-a000-4cf9-a653-07606490a031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:44.583347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a12ed0-a000-4cf9-a653-07606490a031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:44.585482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a12ed0-a000-4cf9-a653-07606490a031 admin admin] PATH_INFO: `/v3/projects/a5ccff4ddab04a47b292ccc5f5387e78` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:44.594024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a12ed0-a000-4cf9-a653-07606490a031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ccff4ddab04a47b292ccc5f5387e78)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:44.602330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a12ed0-a000-4cf9-a653-07606490a031 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:44.838754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2a12ed0-a000-4cf9-a653-07606490a031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ccff4ddab04a47b292ccc5f5387e78', 'request_id': 'req-c2a12ed0-a000-4cf9-a653-07606490a031'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:44.869379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2a12ed0-a000-4cf9-a653-07606490a031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ccff4ddab04a47b292ccc5f5387e78', 'request_id': 'req-c2a12ed0-a000-4cf9-a653-07606490a031'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:45.187829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2a12ed0-a000-4cf9-a653-07606490a031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ccff4ddab04a47b292ccc5f5387e78', 'request_id': 'req-c2a12ed0-a000-4cf9-a653-07606490a031'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:45.201393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2a12ed0-a000-4cf9-a653-07606490a031 admin admin] The token cache is being invalidate because project a5ccff4ddab04a47b292ccc5f5387e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:43:45.201968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2a12ed0-a000-4cf9-a653-07606490a031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:45.202981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2a12ed0-a000-4cf9-a653-07606490a031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:45.204996 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1564/3086] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:44 2022] DELETE /identity/v3/projects/a5ccff4ddab04a47b292ccc5f5387e78 => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:45.210087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632d4c-727d-4d73-a7e8-5a879d419e98 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:45.210616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632d4c-727d-4d73-a7e8-5a879d419e98 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:45.210616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632d4c-727d-4d73-a7e8-5a879d419e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:45.236795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-dd632d4c-727d-4d73-a7e8-5a879d419e98 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:45.238467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dd632d4c-727d-4d73-a7e8-5a879d419e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:45.326683 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1523/3087] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:45.334152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cf2b5-2643-4637-88db-6318a5bff454 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:45.334694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cf2b5-2643-4637-88db-6318a5bff454 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:45.342786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cf2b5-2643-4637-88db-6318a5bff454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:45.382428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-731cf2b5-2643-4637-88db-6318a5bff454 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:45.382428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-731cf2b5-2643-4637-88db-6318a5bff454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:45.421514 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1565/3088] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:45.428810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd632d4c-727d-4d73-a7e8-5a879d419e98 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:45.441462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd632d4c-727d-4d73-a7e8-5a879d419e98 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:45.459242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba503b4-2aaf-409a-b531-d14c689c528e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:45.460805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba503b4-2aaf-409a-b531-d14c689c528e admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:45.464676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba503b4-2aaf-409a-b531-d14c689c528e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:45.465292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba503b4-2aaf-409a-b531-d14c689c528e admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:45.466014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba503b4-2aaf-409a-b531-d14c689c528e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:45.466330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba503b4-2aaf-409a-b531-d14c689c528e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:45.476956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba503b4-2aaf-409a-b531-d14c689c528e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:45.519661 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1524/3089] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:45.520737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cf2b5-2643-4637-88db-6318a5bff454 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:45.535261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cf2b5-2643-4637-88db-6318a5bff454 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:45.543054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9113b7-9f78-4d1e-a71f-6b539ac0070c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:45.543054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9113b7-9f78-4d1e-a71f-6b539ac0070c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:45.543054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9113b7-9f78-4d1e-a71f-6b539ac0070c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:45.543725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9113b7-9f78-4d1e-a71f-6b539ac0070c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:45.544635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9113b7-9f78-4d1e-a71f-6b539ac0070c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:45.547066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9113b7-9f78-4d1e-a71f-6b539ac0070c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:45.618863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba503b4-2aaf-409a-b531-d14c689c528e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:45.622101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2ba503b4-2aaf-409a-b531-d14c689c528e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:45.650335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba503b4-2aaf-409a-b531-d14c689c528e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:45.671251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a36466-e8db-4fb3-8741-4e74db36f735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:45.673939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a36466-e8db-4fb3-8741-4e74db36f735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:45.675040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a36466-e8db-4fb3-8741-4e74db36f735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:45.675645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a36466-e8db-4fb3-8741-4e74db36f735 admin admin] PATH_INFO: `/v3/projects/ed27d61f65314a4a9e03ebab12fb9f39` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:45.677023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a36466-e8db-4fb3-8741-4e74db36f735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed27d61f65314a4a9e03ebab12fb9f39)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:45.684584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a36466-e8db-4fb3-8741-4e74db36f735 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:45.703897 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1566/3090] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:43:45 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:43:45.712566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9113b7-9f78-4d1e-a71f-6b539ac0070c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:45.827365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:45.894001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9113b7-9f78-4d1e-a71f-6b539ac0070c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:45.918163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291512bd-6efc-4589-859d-d15cf8766725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:45.924373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291512bd-6efc-4589-859d-d15cf8766725 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:45.924719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291512bd-6efc-4589-859d-d15cf8766725 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:45.924992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291512bd-6efc-4589-859d-d15cf8766725 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:45.927894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291512bd-6efc-4589-859d-d15cf8766725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:45.933814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291512bd-6efc-4589-859d-d15cf8766725 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:45.995111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-78a36466-e8db-4fb3-8741-4e74db36f735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed27d61f65314a4a9e03ebab12fb9f39', 'request_id': 'req-78a36466-e8db-4fb3-8741-4e74db36f735'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:46.035511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-78a36466-e8db-4fb3-8741-4e74db36f735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed27d61f65314a4a9e03ebab12fb9f39', 'request_id': 'req-78a36466-e8db-4fb3-8741-4e74db36f735'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:46.072256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-78a36466-e8db-4fb3-8741-4e74db36f735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed27d61f65314a4a9e03ebab12fb9f39', 'request_id': 'req-78a36466-e8db-4fb3-8741-4e74db36f735'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:46.190275 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1567/3091] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:43:45 2022] POST /identity/v3/users => generated 293 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:46.193665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291512bd-6efc-4589-859d-d15cf8766725 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:46.246315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-78a36466-e8db-4fb3-8741-4e74db36f735 admin admin] The token cache is being invalidate because project ed27d61f65314a4a9e03ebab12fb9f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:43:46.247239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-78a36466-e8db-4fb3-8741-4e74db36f735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:46.249164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291512bd-6efc-4589-859d-d15cf8766725 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:46.249395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-78a36466-e8db-4fb3-8741-4e74db36f735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:46.251629 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1525/3092] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:45 2022] DELETE /identity/v3/projects/ed27d61f65314a4a9e03ebab12fb9f39 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:46.258334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9de0b-ba29-4780-aabc-96f0f5e68e2a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:46.263726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9de0b-ba29-4780-aabc-96f0f5e68e2a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:46.267038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:46.267038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9de0b-ba29-4780-aabc-96f0f5e68e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:46.363990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-65b9de0b-ba29-4780-aabc-96f0f5e68e2a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:46.365312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-65b9de0b-ba29-4780-aabc-96f0f5e68e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:46.414967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e86a0d-d163-4f1d-9960-13227a331107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:46.416483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e86a0d-d163-4f1d-9960-13227a331107 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:46.417811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e86a0d-d163-4f1d-9960-13227a331107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:46.418318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e86a0d-d163-4f1d-9960-13227a331107 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:46.419244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e86a0d-d163-4f1d-9960-13227a331107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:46.436757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e86a0d-d163-4f1d-9960-13227a331107 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:46.457290 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1568/3093] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:46.461098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e86a0d-d163-4f1d-9960-13227a331107 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:46.465688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f7e86a0d-d163-4f1d-9960-13227a331107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:46.486168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e86a0d-d163-4f1d-9960-13227a331107 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:46.492912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310b784-dedc-4f84-bf95-5e5794ca2366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:46.493999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310b784-dedc-4f84-bf95-5e5794ca2366 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:46.494729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310b784-dedc-4f84-bf95-5e5794ca2366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:46.496704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310b784-dedc-4f84-bf95-5e5794ca2366 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:46.496704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310b784-dedc-4f84-bf95-5e5794ca2366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:46.498117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310b784-dedc-4f84-bf95-5e5794ca2366 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:46.523067 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1569/3094] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:46.528925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310b784-dedc-4f84-bf95-5e5794ca2366 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:46.550516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310b784-dedc-4f84-bf95-5e5794ca2366 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:46.564857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912ebf3-9aae-49ff-b124-814f5fdd0cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:46.565946 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1526/3095] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:46.567279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912ebf3-9aae-49ff-b124-814f5fdd0cba admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:46.568857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912ebf3-9aae-49ff-b124-814f5fdd0cba admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:46.569246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912ebf3-9aae-49ff-b124-814f5fdd0cba admin admin] PATH_INFO: `/v3/projects/3b1896a4899d4c37af1be6a7f91249c0/users/83867771c9a1442cba2837c1132df88d/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:46.589232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92c17a-2cb3-4bb0-af99-bcf23fbc1f97 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:46.594290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92c17a-2cb3-4bb0-af99-bcf23fbc1f97 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:46.594290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92c17a-2cb3-4bb0-af99-bcf23fbc1f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:46.608576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912ebf3-9aae-49ff-b124-814f5fdd0cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1896a4899d4c37af1be6a7f91249c0, user_id=83867771c9a1442cba2837c1132df88d, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:46.618216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0e92c17a-2cb3-4bb0-af99-bcf23fbc1f97 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:46.626792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0e92c17a-2cb3-4bb0-af99-bcf23fbc1f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:46.631163 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1527/3096] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:46.631825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912ebf3-9aae-49ff-b124-814f5fdd0cba admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:46.635006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92c17a-2cb3-4bb0-af99-bcf23fbc1f97 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:46.667201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92c17a-2cb3-4bb0-af99-bcf23fbc1f97 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:46.672955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e6c03-498c-460a-b68e-bacd9dd51a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:46.674353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e6c03-498c-460a-b68e-bacd9dd51a34 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:46.674898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e6c03-498c-460a-b68e-bacd9dd51a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:46.675383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e6c03-498c-460a-b68e-bacd9dd51a34 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:46.676375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e6c03-498c-460a-b68e-bacd9dd51a34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:46.676980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e6c03-498c-460a-b68e-bacd9dd51a34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:46.679335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e6c03-498c-460a-b68e-bacd9dd51a34 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:46.698007 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1528/3097] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:43:46.702852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e6c03-498c-460a-b68e-bacd9dd51a34 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:46.719386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e6c03-498c-460a-b68e-bacd9dd51a34 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:46.741671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349bd74-5385-4ab0-85b1-8165b3ea8926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:46.741671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349bd74-5385-4ab0-85b1-8165b3ea8926 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:46.741671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349bd74-5385-4ab0-85b1-8165b3ea8926 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:46.741671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349bd74-5385-4ab0-85b1-8165b3ea8926 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:46.742193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349bd74-5385-4ab0-85b1-8165b3ea8926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:46.742193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349bd74-5385-4ab0-85b1-8165b3ea8926 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:46.837891 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1570/3098] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:46 2022] PUT /identity/v3/projects/3b1896a4899d4c37af1be6a7f91249c0/users/83867771c9a1442cba2837c1132df88d/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:46.840555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fe471-621e-4e64-8c51-b2a5584727da None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:46.840905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fe471-621e-4e64-8c51-b2a5584727da None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:46.845594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fe471-621e-4e64-8c51-b2a5584727da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:46.886772 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1529/3099] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:43:46 2022] POST /identity/v3/projects => generated 393 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:46.889805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349bd74-5385-4ab0-85b1-8165b3ea8926 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:46.894731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-905fe471-621e-4e64-8c51-b2a5584727da None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:46.896084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-905fe471-621e-4e64-8c51-b2a5584727da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:47.039378 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1571/3100] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:47.088215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fe471-621e-4e64-8c51-b2a5584727da None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:47.090533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-905fe471-621e-4e64-8c51-b2a5584727da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:47.169264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349bd74-5385-4ab0-85b1-8165b3ea8926 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:47.181912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531da02-a65e-486b-9e80-7e1bc7c5e86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:47.183060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531da02-a65e-486b-9e80-7e1bc7c5e86d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:47.183351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531da02-a65e-486b-9e80-7e1bc7c5e86d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:47.183700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531da02-a65e-486b-9e80-7e1bc7c5e86d admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:47.184375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531da02-a65e-486b-9e80-7e1bc7c5e86d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:47.204414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531da02-a65e-486b-9e80-7e1bc7c5e86d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:47.255220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fe471-621e-4e64-8c51-b2a5584727da None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:47.272596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d2939-68f5-4238-8317-adb9250f46b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:47.273488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d2939-68f5-4238-8317-adb9250f46b6 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:47.276838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d2939-68f5-4238-8317-adb9250f46b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:47.276838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d2939-68f5-4238-8317-adb9250f46b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:47.302868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d2939-68f5-4238-8317-adb9250f46b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:47.304337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d2939-68f5-4238-8317-adb9250f46b6 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:47.328984 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1572/3101] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:43:47.363104 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1530/3102] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:43:46 2022] POST /identity/v3/users => generated 297 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:47.365836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d2939-68f5-4238-8317-adb9250f46b6 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:47.377293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d2939-68f5-4238-8317-adb9250f46b6 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:47.400825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd4e02-0053-4015-8301-ab7208ef83c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:47.407166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd4e02-0053-4015-8301-ab7208ef83c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:47.407166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd4e02-0053-4015-8301-ab7208ef83c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:47.407166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd4e02-0053-4015-8301-ab7208ef83c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:47.407994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd4e02-0053-4015-8301-ab7208ef83c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:47.413873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd4e02-0053-4015-8301-ab7208ef83c0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:47.454157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531da02-a65e-486b-9e80-7e1bc7c5e86d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:47.465463 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1573/3103] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:47.466167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531da02-a65e-486b-9e80-7e1bc7c5e86d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:47.487611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac049dcc-f3b4-4312-8b91-d355f28dcf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:47.488267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac049dcc-f3b4-4312-8b91-d355f28dcf0d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:47.488550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac049dcc-f3b4-4312-8b91-d355f28dcf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:47.492586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac049dcc-f3b4-4312-8b91-d355f28dcf0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:47.495698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac049dcc-f3b4-4312-8b91-d355f28dcf0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:47.502656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac049dcc-f3b4-4312-8b91-d355f28dcf0d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:47.519965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:47.529478 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1531/3104] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:43:47.532691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd4e02-0053-4015-8301-ab7208ef83c0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:47.550863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd4e02-0053-4015-8301-ab7208ef83c0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:47.573104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf014f7-89ee-41bf-8ea7-3fe74bab368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:47.573809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf014f7-89ee-41bf-8ea7-3fe74bab368e admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:47.575707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf014f7-89ee-41bf-8ea7-3fe74bab368e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:47.576153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf014f7-89ee-41bf-8ea7-3fe74bab368e admin admin] PATH_INFO: `/v3/projects/65baa404f2e644379e5a921ee18a7aa6/users/bf88a0ecb8024a209f66473a2eb0bf80/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:47.626703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf014f7-89ee-41bf-8ea7-3fe74bab368e admin admin] RBAC: Authorizing `identity:create_grant(project_id=65baa404f2e644379e5a921ee18a7aa6, user_id=bf88a0ecb8024a209f66473a2eb0bf80, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:47.629881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf014f7-89ee-41bf-8ea7-3fe74bab368e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:47.738260 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1574/3105] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:47 2022] PUT /identity/v3/projects/65baa404f2e644379e5a921ee18a7aa6/users/bf88a0ecb8024a209f66473a2eb0bf80/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:47.754774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca7429-8652-4ef5-808b-cad9c78f37e8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:47.755186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca7429-8652-4ef5-808b-cad9c78f37e8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:47.755856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca7429-8652-4ef5-808b-cad9c78f37e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:47.825768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3cca7429-8652-4ef5-808b-cad9c78f37e8 None None] MFA Rules not processed for user `bf88a0ecb8024a209f66473a2eb0bf80`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:47.827378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3cca7429-8652-4ef5-808b-cad9c78f37e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:47.966820 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1532/3106] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:48.355004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf014f7-89ee-41bf-8ea7-3fe74bab368e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:48.357023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-abf014f7-89ee-41bf-8ea7-3fe74bab368e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:48.534674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf014f7-89ee-41bf-8ea7-3fe74bab368e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:48.549001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dbb46-239e-4638-bda8-a851f366f62f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:48.549638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dbb46-239e-4638-bda8-a851f366f62f service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:48.549908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dbb46-239e-4638-bda8-a851f366f62f service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:48.550361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dbb46-239e-4638-bda8-a851f366f62f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:48.568967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278dbb46-239e-4638-bda8-a851f366f62f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:48.570894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278dbb46-239e-4638-bda8-a851f366f62f service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:48.605016 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1575/3107] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:48 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:48.993574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca7429-8652-4ef5-808b-cad9c78f37e8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:49.012968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:49.198849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca7429-8652-4ef5-808b-cad9c78f37e8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:49.209853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9f5b5-3799-4d2d-a540-8124f9183689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:49.211012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9f5b5-3799-4d2d-a540-8124f9183689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:49.211514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9f5b5-3799-4d2d-a540-8124f9183689 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:49.212772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9f5b5-3799-4d2d-a540-8124f9183689 admin admin] PATH_INFO: `/v3/users/bf88a0ecb8024a209f66473a2eb0bf80` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:49.214643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9f5b5-3799-4d2d-a540-8124f9183689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf88a0ecb8024a209f66473a2eb0bf80)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:49.217550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9f5b5-3799-4d2d-a540-8124f9183689 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:49.514729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f0e9f5b5-3799-4d2d-a540-8124f9183689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf88a0ecb8024a209f66473a2eb0bf80'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:49.622415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f0e9f5b5-3799-4d2d-a540-8124f9183689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf88a0ecb8024a209f66473a2eb0bf80'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:49.623111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f0e9f5b5-3799-4d2d-a540-8124f9183689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf88a0ecb8024a209f66473a2eb0bf80'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:49.637053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f0e9f5b5-3799-4d2d-a540-8124f9183689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf88a0ecb8024a209f66473a2eb0bf80'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:49.675783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f0e9f5b5-3799-4d2d-a540-8124f9183689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf88a0ecb8024a209f66473a2eb0bf80'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:49.677658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dbb46-239e-4638-bda8-a851f366f62f service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:49.680443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-278dbb46-239e-4638-bda8-a851f366f62f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:49.716294 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1533/3108] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:43:48 2022] DELETE /identity/v3/users/bf88a0ecb8024a209f66473a2eb0bf80 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:49.724734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dbb46-239e-4638-bda8-a851f366f62f service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:49.728226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76c948-493d-4f21-bed9-9bd7436f104c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:49.730005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76c948-493d-4f21-bed9-9bd7436f104c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:49.730632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76c948-493d-4f21-bed9-9bd7436f104c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:49.789597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ce76c948-493d-4f21-bed9-9bd7436f104c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:49.790821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ce76c948-493d-4f21-bed9-9bd7436f104c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:49.796144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc96be-b81b-476f-a7fc-3511fb330d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:49.797256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc96be-b81b-476f-a7fc-3511fb330d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:49.797865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc96be-b81b-476f-a7fc-3511fb330d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:49.798342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc96be-b81b-476f-a7fc-3511fb330d77 admin admin] PATH_INFO: `/v3/users/b8232920ed3f45aaa5b3c6d3844bcd86` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:49.801890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc96be-b81b-476f-a7fc-3511fb330d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8232920ed3f45aaa5b3c6d3844bcd86)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:49.804077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc96be-b81b-476f-a7fc-3511fb330d77 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:49.805180 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1534/3109] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:43:49.823646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76c948-493d-4f21-bed9-9bd7436f104c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:49.826948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ce76c948-493d-4f21-bed9-9bd7436f104c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:49.929871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76c948-493d-4f21-bed9-9bd7436f104c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:49.935690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcf4ee-366f-4986-b354-8aae38c5bbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:49.936341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcf4ee-366f-4986-b354-8aae38c5bbcf service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:49.936667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcf4ee-366f-4986-b354-8aae38c5bbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:49.936999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcf4ee-366f-4986-b354-8aae38c5bbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:49.950181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcf4ee-366f-4986-b354-8aae38c5bbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:49.951731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcf4ee-366f-4986-b354-8aae38c5bbcf service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:49.964580 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1535/3110] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:43:50.042544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-35cc96be-b81b-476f-a7fc-3511fb330d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8232920ed3f45aaa5b3c6d3844bcd86'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:50.046199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-35cc96be-b81b-476f-a7fc-3511fb330d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8232920ed3f45aaa5b3c6d3844bcd86'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:50.150705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-35cc96be-b81b-476f-a7fc-3511fb330d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8232920ed3f45aaa5b3c6d3844bcd86'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:50.151489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-35cc96be-b81b-476f-a7fc-3511fb330d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8232920ed3f45aaa5b3c6d3844bcd86'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:50.167764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-35cc96be-b81b-476f-a7fc-3511fb330d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8232920ed3f45aaa5b3c6d3844bcd86'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:50.187952 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1576/3111] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:43:49 2022] DELETE /identity/v3/users/b8232920ed3f45aaa5b3c6d3844bcd86 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:50.377067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:51.373949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcf4ee-366f-4986-b354-8aae38c5bbcf service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:51.376726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cafcf4ee-366f-4986-b354-8aae38c5bbcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:51.412094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcf4ee-366f-4986-b354-8aae38c5bbcf service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:51.467009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc96be-b81b-476f-a7fc-3511fb330d77 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:51.467009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-35cc96be-b81b-476f-a7fc-3511fb330d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:51.580129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363f16b-1669-43fd-908f-ec0c04d72379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:51.580997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363f16b-1669-43fd-908f-ec0c04d72379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:51.581445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363f16b-1669-43fd-908f-ec0c04d72379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:51.581879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363f16b-1669-43fd-908f-ec0c04d72379 admin admin] PATH_INFO: `/v3/projects/65baa404f2e644379e5a921ee18a7aa6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:51.583327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363f16b-1669-43fd-908f-ec0c04d72379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65baa404f2e644379e5a921ee18a7aa6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:51.586872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363f16b-1669-43fd-908f-ec0c04d72379 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:51.611433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc96be-b81b-476f-a7fc-3511fb330d77 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:51.625054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd4242-09e5-43b7-8c05-48bff9a37746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:51.626166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd4242-09e5-43b7-8c05-48bff9a37746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:51.626706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd4242-09e5-43b7-8c05-48bff9a37746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:51.627242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd4242-09e5-43b7-8c05-48bff9a37746 admin admin] PATH_INFO: `/v3/projects/7b296dbb8b5647498a6a42689659ed79` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:51.629182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd4242-09e5-43b7-8c05-48bff9a37746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b296dbb8b5647498a6a42689659ed79)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:51.631493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd4242-09e5-43b7-8c05-48bff9a37746 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:51.749562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a363f16b-1669-43fd-908f-ec0c04d72379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65baa404f2e644379e5a921ee18a7aa6', 'request_id': 'req-a363f16b-1669-43fd-908f-ec0c04d72379'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:51.758703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a363f16b-1669-43fd-908f-ec0c04d72379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65baa404f2e644379e5a921ee18a7aa6', 'request_id': 'req-a363f16b-1669-43fd-908f-ec0c04d72379'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:51.766578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a363f16b-1669-43fd-908f-ec0c04d72379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65baa404f2e644379e5a921ee18a7aa6', 'request_id': 'req-a363f16b-1669-43fd-908f-ec0c04d72379'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:51.809966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f9cd4242-09e5-43b7-8c05-48bff9a37746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b296dbb8b5647498a6a42689659ed79', 'request_id': 'req-f9cd4242-09e5-43b7-8c05-48bff9a37746'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:51.816817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f9cd4242-09e5-43b7-8c05-48bff9a37746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b296dbb8b5647498a6a42689659ed79', 'request_id': 'req-f9cd4242-09e5-43b7-8c05-48bff9a37746'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:51.845460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a363f16b-1669-43fd-908f-ec0c04d72379 admin admin] The token cache is being invalidate because project 65baa404f2e644379e5a921ee18a7aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:43:51.845756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a363f16b-1669-43fd-908f-ec0c04d72379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:51.847089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a363f16b-1669-43fd-908f-ec0c04d72379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:51.858945 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1536/3112] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:51 2022] DELETE /identity/v3/projects/65baa404f2e644379e5a921ee18a7aa6 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:51.860580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e098fdf-131e-4406-9ad3-e5405155925d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:51.861007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e098fdf-131e-4406-9ad3-e5405155925d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:51.861113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e098fdf-131e-4406-9ad3-e5405155925d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:51.905748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8e098fdf-131e-4406-9ad3-e5405155925d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:51.906998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8e098fdf-131e-4406-9ad3-e5405155925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:51.945008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f9cd4242-09e5-43b7-8c05-48bff9a37746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b296dbb8b5647498a6a42689659ed79', 'request_id': 'req-f9cd4242-09e5-43b7-8c05-48bff9a37746'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:51.969441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f9cd4242-09e5-43b7-8c05-48bff9a37746 admin admin] The token cache is being invalidate because project 7b296dbb8b5647498a6a42689659ed79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:43:51.969627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f9cd4242-09e5-43b7-8c05-48bff9a37746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:51.975394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f9cd4242-09e5-43b7-8c05-48bff9a37746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:51.977852 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1577/3113] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:51 2022] DELETE /identity/v3/projects/7b296dbb8b5647498a6a42689659ed79 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:43:51.983020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095984f-3b33-4e91-91e4-bba998c7fec4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:51.983483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095984f-3b33-4e91-91e4-bba998c7fec4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:51.983996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095984f-3b33-4e91-91e4-bba998c7fec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:52.016371 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1537/3114] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:52.019466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83985bd6-2eba-4ff7-8553-a5ed49d44743 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:52.019974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83985bd6-2eba-4ff7-8553-a5ed49d44743 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:52.020447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83985bd6-2eba-4ff7-8553-a5ed49d44743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:52.039284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2095984f-3b33-4e91-91e4-bba998c7fec4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:52.042128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2095984f-3b33-4e91-91e4-bba998c7fec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:52.053212 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1578/3115] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:43:52.065732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-83985bd6-2eba-4ff7-8553-a5ed49d44743 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:52.066718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-83985bd6-2eba-4ff7-8553-a5ed49d44743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:52.071730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:52.081238 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1538/3116] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:52.085310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095984f-3b33-4e91-91e4-bba998c7fec4 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:52.100300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095984f-3b33-4e91-91e4-bba998c7fec4 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:52.108481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23529db9-7552-49fc-a8e2-57ca3d018c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:52.109940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23529db9-7552-49fc-a8e2-57ca3d018c92 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:52.110418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23529db9-7552-49fc-a8e2-57ca3d018c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:52.110856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23529db9-7552-49fc-a8e2-57ca3d018c92 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:52.111754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23529db9-7552-49fc-a8e2-57ca3d018c92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:52.112498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23529db9-7552-49fc-a8e2-57ca3d018c92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:52.114768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23529db9-7552-49fc-a8e2-57ca3d018c92 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:52.132060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac37de6-e930-4c51-84d0-5c0566e31c6c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:52.132658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac37de6-e930-4c51-84d0-5c0566e31c6c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:52.133090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac37de6-e930-4c51-84d0-5c0566e31c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:52.133207 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1579/3117] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:52.138027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23529db9-7552-49fc-a8e2-57ca3d018c92 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:52.162052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23529db9-7552-49fc-a8e2-57ca3d018c92 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:52.175452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-aac37de6-e930-4c51-84d0-5c0566e31c6c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:52.177126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aac37de6-e930-4c51-84d0-5c0566e31c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:52.184756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4f698-22c2-4a1c-8241-ec9c9a813a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:52.185406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4f698-22c2-4a1c-8241-ec9c9a813a1d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:52.186411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4f698-22c2-4a1c-8241-ec9c9a813a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:52.186735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4f698-22c2-4a1c-8241-ec9c9a813a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:52.188130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4f698-22c2-4a1c-8241-ec9c9a813a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:52.193597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4f698-22c2-4a1c-8241-ec9c9a813a1d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:52.200602 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1539/3118] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:52.211282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac37de6-e930-4c51-84d0-5c0566e31c6c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:52.221806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac37de6-e930-4c51-84d0-5c0566e31c6c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:52.232712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9fbe5-5815-467d-bba4-76de1f279817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:52.234064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9fbe5-5815-467d-bba4-76de1f279817 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:52.234064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9fbe5-5815-467d-bba4-76de1f279817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:52.234064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9fbe5-5815-467d-bba4-76de1f279817 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:52.234569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9fbe5-5815-467d-bba4-76de1f279817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:52.234858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9fbe5-5815-467d-bba4-76de1f279817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:52.240696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9fbe5-5815-467d-bba4-76de1f279817 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:52.263441 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1540/3119] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:52.269354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9fbe5-5815-467d-bba4-76de1f279817 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:52.303288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9fbe5-5815-467d-bba4-76de1f279817 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:52.325156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b287930-a5cc-4239-a865-89938c294805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:52.325782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b287930-a5cc-4239-a865-89938c294805 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:52.326061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b287930-a5cc-4239-a865-89938c294805 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:52.326824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b287930-a5cc-4239-a865-89938c294805 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:52.327162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b287930-a5cc-4239-a865-89938c294805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:52.331768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b287930-a5cc-4239-a865-89938c294805 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:52.350730 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1580/3120] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:43:52 2022] POST /identity/v3/projects => generated 399 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:52.354932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4f698-22c2-4a1c-8241-ec9c9a813a1d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:52.478196 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1541/3121] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:43:52 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:52.484573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b287930-a5cc-4239-a865-89938c294805 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:52.549718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4f698-22c2-4a1c-8241-ec9c9a813a1d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:52.630315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eda4e9-f452-4680-ac41-0de23f89be6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:52.631297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eda4e9-f452-4680-ac41-0de23f89be6c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:52.631915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eda4e9-f452-4680-ac41-0de23f89be6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:52.632912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eda4e9-f452-4680-ac41-0de23f89be6c admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:52.634528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eda4e9-f452-4680-ac41-0de23f89be6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:52.637697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eda4e9-f452-4680-ac41-0de23f89be6c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:52.671324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b287930-a5cc-4239-a865-89938c294805 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:52.678865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dedb6b-7ad6-4bb1-883b-99cdd3456e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:52.679700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dedb6b-7ad6-4bb1-883b-99cdd3456e7b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:52.680227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dedb6b-7ad6-4bb1-883b-99cdd3456e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:52.680696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dedb6b-7ad6-4bb1-883b-99cdd3456e7b admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:52.681523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dedb6b-7ad6-4bb1-883b-99cdd3456e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:52.684632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dedb6b-7ad6-4bb1-883b-99cdd3456e7b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:52.749934 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1581/3122] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:43:52 2022] POST /identity/v3/users => generated 300 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:52.754180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eda4e9-f452-4680-ac41-0de23f89be6c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:52.768040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eda4e9-f452-4680-ac41-0de23f89be6c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:52.802547 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1542/3123] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:43:52 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:52.806355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dedb6b-7ad6-4bb1-883b-99cdd3456e7b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:52.811695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e159fcc-3c45-4847-aa53-119b81d52572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:52.815656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e159fcc-3c45-4847-aa53-119b81d52572 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:52.819864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e159fcc-3c45-4847-aa53-119b81d52572 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:52.819864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e159fcc-3c45-4847-aa53-119b81d52572 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:52.819864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e159fcc-3c45-4847-aa53-119b81d52572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:52.824400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e159fcc-3c45-4847-aa53-119b81d52572 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:52.837550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dedb6b-7ad6-4bb1-883b-99cdd3456e7b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:52.849373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d733ebf-e92a-4be9-bb71-ba80aada438d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:52.850474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d733ebf-e92a-4be9-bb71-ba80aada438d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:52.851052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d733ebf-e92a-4be9-bb71-ba80aada438d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:52.851537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d733ebf-e92a-4be9-bb71-ba80aada438d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:52.852428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d733ebf-e92a-4be9-bb71-ba80aada438d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:52.855357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d733ebf-e92a-4be9-bb71-ba80aada438d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:52.862445 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1582/3124] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:43:52.865611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e159fcc-3c45-4847-aa53-119b81d52572 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:52.872061 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1543/3125] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:52.877318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d733ebf-e92a-4be9-bb71-ba80aada438d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:52.890290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e159fcc-3c45-4847-aa53-119b81d52572 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:52.903414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d733ebf-e92a-4be9-bb71-ba80aada438d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:52.905297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe370a-8a9d-4736-b2d9-f96dc8d92410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:52.905965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe370a-8a9d-4736-b2d9-f96dc8d92410 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:52.906320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe370a-8a9d-4736-b2d9-f96dc8d92410 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:52.906697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe370a-8a9d-4736-b2d9-f96dc8d92410 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:52.907781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe370a-8a9d-4736-b2d9-f96dc8d92410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:52.914502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe370a-8a9d-4736-b2d9-f96dc8d92410 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:52.916079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d5b2b-d2e6-4ac0-8d63-e5a9c8397c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:52.917529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d5b2b-d2e6-4ac0-8d63-e5a9c8397c8a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:52.918692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d5b2b-d2e6-4ac0-8d63-e5a9c8397c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:52.919195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d5b2b-d2e6-4ac0-8d63-e5a9c8397c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:52.920941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d5b2b-d2e6-4ac0-8d63-e5a9c8397c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:52.926274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d5b2b-d2e6-4ac0-8d63-e5a9c8397c8a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:52.975678 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1544/3126] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:52.978481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d5b2b-d2e6-4ac0-8d63-e5a9c8397c8a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:52.984776 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1583/3127] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:52.985893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe370a-8a9d-4736-b2d9-f96dc8d92410 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:52.989562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-426d5b2b-d2e6-4ac0-8d63-e5a9c8397c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:53.025276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe370a-8a9d-4736-b2d9-f96dc8d92410 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:53.030943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d5b2b-d2e6-4ac0-8d63-e5a9c8397c8a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:53.040198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d443e4-f397-4636-9058-33994292aa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:53.047008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d443e4-f397-4636-9058-33994292aa45 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:53.047008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d443e4-f397-4636-9058-33994292aa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:53.047008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d443e4-f397-4636-9058-33994292aa45 admin admin] PATH_INFO: `/v3/projects/0b2ef28fea57405191162c673ef041ab/users/180b1bccee82402bb715656b26072471/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:53.052319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ac772-2c2e-42a2-8846-8d73587a32f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:53.053051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ac772-2c2e-42a2-8846-8d73587a32f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:53.053276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ac772-2c2e-42a2-8846-8d73587a32f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:53.053553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ac772-2c2e-42a2-8846-8d73587a32f2 admin admin] PATH_INFO: `/v3/users/6c5f4f0d776f4ad1a11f5408c0652bf9` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:53.059392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ac772-2c2e-42a2-8846-8d73587a32f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c5f4f0d776f4ad1a11f5408c0652bf9)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:53.070839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ac772-2c2e-42a2-8846-8d73587a32f2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:53.076773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:53.082979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d443e4-f397-4636-9058-33994292aa45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2ef28fea57405191162c673ef041ab, user_id=180b1bccee82402bb715656b26072471, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:53.097306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d443e4-f397-4636-9058-33994292aa45 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:53.107257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:53.199940 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1584/3128] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:52 2022] PUT /identity/v3/projects/0b2ef28fea57405191162c673ef041ab/users/180b1bccee82402bb715656b26072471/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:53.200729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d443e4-f397-4636-9058-33994292aa45 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:53.335648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a85ac772-2c2e-42a2-8846-8d73587a32f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c5f4f0d776f4ad1a11f5408c0652bf9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:53.359531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d443e4-f397-4636-9058-33994292aa45 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:53.390881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90c6c5-a0be-427b-9b80-2f791a43d129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:53.391884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90c6c5-a0be-427b-9b80-2f791a43d129 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:53.392411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90c6c5-a0be-427b-9b80-2f791a43d129 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:53.393442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90c6c5-a0be-427b-9b80-2f791a43d129 admin admin] PATH_INFO: `/v3/projects/0738bf249acb440c89a87e1e60b0f674/users/c3ec389b3acf49ad89b73b74a1224caf/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:53.404012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a85ac772-2c2e-42a2-8846-8d73587a32f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c5f4f0d776f4ad1a11f5408c0652bf9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:53.404689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a85ac772-2c2e-42a2-8846-8d73587a32f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c5f4f0d776f4ad1a11f5408c0652bf9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:53.412639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a85ac772-2c2e-42a2-8846-8d73587a32f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c5f4f0d776f4ad1a11f5408c0652bf9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:53.418498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90c6c5-a0be-427b-9b80-2f791a43d129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0738bf249acb440c89a87e1e60b0f674, user_id=c3ec389b3acf49ad89b73b74a1224caf, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:53.422043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90c6c5-a0be-427b-9b80-2f791a43d129 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:53.441257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a85ac772-2c2e-42a2-8846-8d73587a32f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c5f4f0d776f4ad1a11f5408c0652bf9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:53.455072 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1545/3129] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:43:52 2022] DELETE /identity/v3/users/6c5f4f0d776f4ad1a11f5408c0652bf9 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:53.461954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc73b64-801f-47ea-920f-e9cf0b3e8663 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:53.462491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc73b64-801f-47ea-920f-e9cf0b3e8663 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:53.462980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc73b64-801f-47ea-920f-e9cf0b3e8663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:53.488486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-acc73b64-801f-47ea-920f-e9cf0b3e8663 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:53.491425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-acc73b64-801f-47ea-920f-e9cf0b3e8663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:53.515755 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1585/3130] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:53 2022] PUT /identity/v3/projects/0738bf249acb440c89a87e1e60b0f674/users/c3ec389b3acf49ad89b73b74a1224caf/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:53.527187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f5687-9095-48b9-86ba-b2a79a6ad4a0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:53.527611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f5687-9095-48b9-86ba-b2a79a6ad4a0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:53.528074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f5687-9095-48b9-86ba-b2a79a6ad4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:53.611101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-412f5687-9095-48b9-86ba-b2a79a6ad4a0 None None] MFA Rules not processed for user `c3ec389b3acf49ad89b73b74a1224caf`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:53.612224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-412f5687-9095-48b9-86ba-b2a79a6ad4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:53.673246 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1546/3131] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:53.711141 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1586/3132] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:53 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:53.716059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc73b64-801f-47ea-920f-e9cf0b3e8663 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:53.727651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-acc73b64-801f-47ea-920f-e9cf0b3e8663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:53.738370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f5687-9095-48b9-86ba-b2a79a6ad4a0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:53.740702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-412f5687-9095-48b9-86ba-b2a79a6ad4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:53.874525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc73b64-801f-47ea-920f-e9cf0b3e8663 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:53.889310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f5687-9095-48b9-86ba-b2a79a6ad4a0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:53.901749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21678946-031c-437d-a3cf-86f1b735a9d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:53.903379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21678946-031c-437d-a3cf-86f1b735a9d8 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:53.904406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21678946-031c-437d-a3cf-86f1b735a9d8 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:53.904869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21678946-031c-437d-a3cf-86f1b735a9d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:53.923259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21678946-031c-437d-a3cf-86f1b735a9d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:53.925269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21678946-031c-437d-a3cf-86f1b735a9d8 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:53.954377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:53.986864 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1587/3133] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:54.002326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21678946-031c-437d-a3cf-86f1b735a9d8 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:54.006543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-21678946-031c-437d-a3cf-86f1b735a9d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:54.036023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2353684-c6e6-4744-830f-f6a8fedef6b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:54.038113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2353684-c6e6-4744-830f-f6a8fedef6b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:54.038403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2353684-c6e6-4744-830f-f6a8fedef6b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:54.038670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2353684-c6e6-4744-830f-f6a8fedef6b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:54.138731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:54.241289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2353684-c6e6-4744-830f-f6a8fedef6b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:54.247265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2353684-c6e6-4744-830f-f6a8fedef6b8 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:54.286960 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1547/3134] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:54.288031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2353684-c6e6-4744-830f-f6a8fedef6b8 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:54.293510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d2353684-c6e6-4744-830f-f6a8fedef6b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:54.326867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2353684-c6e6-4744-830f-f6a8fedef6b8 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:54.336881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070d803-878c-484a-bc28-64fa4334a309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:54.338774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070d803-878c-484a-bc28-64fa4334a309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:54.338774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070d803-878c-484a-bc28-64fa4334a309 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:54.338774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070d803-878c-484a-bc28-64fa4334a309 admin admin] PATH_INFO: `/v3/users/c3ec389b3acf49ad89b73b74a1224caf` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:54.340024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21678946-031c-437d-a3cf-86f1b735a9d8 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:54.345593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070d803-878c-484a-bc28-64fa4334a309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3ec389b3acf49ad89b73b74a1224caf)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:54.350637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070d803-878c-484a-bc28-64fa4334a309 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:54.390458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f87645-f40f-4971-97a6-cc8717b0ebda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:54.391505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f87645-f40f-4971-97a6-cc8717b0ebda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:54.392022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f87645-f40f-4971-97a6-cc8717b0ebda admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:54.392532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f87645-f40f-4971-97a6-cc8717b0ebda admin admin] PATH_INFO: `/v3/projects/ff8743cde75f4f6da3a5742c66742898` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:54.401333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f87645-f40f-4971-97a6-cc8717b0ebda admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff8743cde75f4f6da3a5742c66742898)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:54.403551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f87645-f40f-4971-97a6-cc8717b0ebda admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:54.652608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b070d803-878c-484a-bc28-64fa4334a309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3ec389b3acf49ad89b73b74a1224caf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:54.665958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b2f87645-f40f-4971-97a6-cc8717b0ebda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff8743cde75f4f6da3a5742c66742898', 'request_id': 'req-b2f87645-f40f-4971-97a6-cc8717b0ebda'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:54.690672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b2f87645-f40f-4971-97a6-cc8717b0ebda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff8743cde75f4f6da3a5742c66742898', 'request_id': 'req-b2f87645-f40f-4971-97a6-cc8717b0ebda'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:54.714470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:54.770590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b070d803-878c-484a-bc28-64fa4334a309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3ec389b3acf49ad89b73b74a1224caf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:54.771267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b070d803-878c-484a-bc28-64fa4334a309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3ec389b3acf49ad89b73b74a1224caf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:54.780444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b070d803-878c-484a-bc28-64fa4334a309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3ec389b3acf49ad89b73b74a1224caf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:54.794434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b070d803-878c-484a-bc28-64fa4334a309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3ec389b3acf49ad89b73b74a1224caf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:54.800842 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1548/3135] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:43:54 2022] DELETE /identity/v3/users/c3ec389b3acf49ad89b73b74a1224caf => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:54.805472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0730b-0cba-42e5-873c-ab616228cb2d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:54.805763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0730b-0cba-42e5-873c-ab616228cb2d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:54.806046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0730b-0cba-42e5-873c-ab616228cb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:54.827832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0cf0730b-0cba-42e5-873c-ab616228cb2d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:54.829322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0cf0730b-0cba-42e5-873c-ab616228cb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:54.884122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b2f87645-f40f-4971-97a6-cc8717b0ebda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff8743cde75f4f6da3a5742c66742898', 'request_id': 'req-b2f87645-f40f-4971-97a6-cc8717b0ebda'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:54.912228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b2f87645-f40f-4971-97a6-cc8717b0ebda admin admin] The token cache is being invalidate because project ff8743cde75f4f6da3a5742c66742898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:43:54.912902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b2f87645-f40f-4971-97a6-cc8717b0ebda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:54.913804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b2f87645-f40f-4971-97a6-cc8717b0ebda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:54.916080 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1588/3136] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:54 2022] DELETE /identity/v3/projects/ff8743cde75f4f6da3a5742c66742898 => generated 0 bytes in 914 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:54.923114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bbc33-4511-476b-9904-26782ebd9dfb None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:54.930786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bbc33-4511-476b-9904-26782ebd9dfb None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:54.930786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bbc33-4511-476b-9904-26782ebd9dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:54.931027 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1549/3137] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:43:54.940288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0730b-0cba-42e5-873c-ab616228cb2d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:54.942192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0cf0730b-0cba-42e5-873c-ab616228cb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:54.955858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-066bbc33-4511-476b-9904-26782ebd9dfb None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:54.958368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-066bbc33-4511-476b-9904-26782ebd9dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:54.981370 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1589/3138] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:54.985416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b0968-44f4-40ba-a0d7-42854016246e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:54.985984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b0968-44f4-40ba-a0d7-42854016246e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:54.986261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b0968-44f4-40ba-a0d7-42854016246e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:55.012900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b33b0968-44f4-40ba-a0d7-42854016246e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:55.014183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b33b0968-44f4-40ba-a0d7-42854016246e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:55.024893 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1590/3139] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:55.027380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0730b-0cba-42e5-873c-ab616228cb2d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:55.028095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b0968-44f4-40ba-a0d7-42854016246e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:55.031735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e45c1-5682-4a1b-9d9e-a207181108ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:55.038344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e45c1-5682-4a1b-9d9e-a207181108ce service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:55.038344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e45c1-5682-4a1b-9d9e-a207181108ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:55.038344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e45c1-5682-4a1b-9d9e-a207181108ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:55.042842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b0968-44f4-40ba-a0d7-42854016246e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:55.047604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e45c1-5682-4a1b-9d9e-a207181108ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:55.048707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb62a4-11d4-43b4-b804-f8135d25fa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:55.049287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e45c1-5682-4a1b-9d9e-a207181108ce service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:55.049844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb62a4-11d4-43b4-b804-f8135d25fa21 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:55.050856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb62a4-11d4-43b4-b804-f8135d25fa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:55.051301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb62a4-11d4-43b4-b804-f8135d25fa21 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:55.052299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb62a4-11d4-43b4-b804-f8135d25fa21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:55.052757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb62a4-11d4-43b4-b804-f8135d25fa21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:55.054692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb62a4-11d4-43b4-b804-f8135d25fa21 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:55.076617 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1550/3140] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:43:55.077381 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1591/3141] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:55.081553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e45c1-5682-4a1b-9d9e-a207181108ce service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:55.095725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e45c1-5682-4a1b-9d9e-a207181108ce service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:55.102115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ffaac-dc56-4bbe-ad5f-434d75a43904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:55.102889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ffaac-dc56-4bbe-ad5f-434d75a43904 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:55.103179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ffaac-dc56-4bbe-ad5f-434d75a43904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:55.103453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ffaac-dc56-4bbe-ad5f-434d75a43904 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:55.104575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ffaac-dc56-4bbe-ad5f-434d75a43904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:55.106578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ffaac-dc56-4bbe-ad5f-434d75a43904 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:55.226586 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1551/3142] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:43:55 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:43:55.230550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb62a4-11d4-43b4-b804-f8135d25fa21 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:55.244387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb62a4-11d4-43b4-b804-f8135d25fa21 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:55.316132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930a6e1-87bf-4317-b089-00e0319519e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:55.316804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930a6e1-87bf-4317-b089-00e0319519e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:55.317216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930a6e1-87bf-4317-b089-00e0319519e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:55.317323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930a6e1-87bf-4317-b089-00e0319519e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:55.318118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930a6e1-87bf-4317-b089-00e0319519e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:55.320359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930a6e1-87bf-4317-b089-00e0319519e8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:55.426021 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1592/3143] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:43:55 2022] POST /identity/v3/users => generated 294 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:55.433312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ffaac-dc56-4bbe-ad5f-434d75a43904 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:55.454821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ffaac-dc56-4bbe-ad5f-434d75a43904 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:55.467975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b544b0-5a54-43d7-9306-d7edf930ac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:55.468609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b544b0-5a54-43d7-9306-d7edf930ac95 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:55.472590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b544b0-5a54-43d7-9306-d7edf930ac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:55.477916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b544b0-5a54-43d7-9306-d7edf930ac95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:55.477916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b544b0-5a54-43d7-9306-d7edf930ac95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:55.477916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b544b0-5a54-43d7-9306-d7edf930ac95 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:55.502595 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1552/3144] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:55.506240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930a6e1-87bf-4317-b089-00e0319519e8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:55.527234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930a6e1-87bf-4317-b089-00e0319519e8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:55.539858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618762e1-5de0-472a-b70f-4d26d7c3c834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:55.540523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618762e1-5de0-472a-b70f-4d26d7c3c834 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:55.540802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618762e1-5de0-472a-b70f-4d26d7c3c834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:55.541545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618762e1-5de0-472a-b70f-4d26d7c3c834 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:55.542225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618762e1-5de0-472a-b70f-4d26d7c3c834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:55.543785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618762e1-5de0-472a-b70f-4d26d7c3c834 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:55.576342 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1593/3145] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:55.583577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b544b0-5a54-43d7-9306-d7edf930ac95 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:55.599532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b544b0-5a54-43d7-9306-d7edf930ac95 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:55.611519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389024f7-2d01-4bcb-ad05-ef5cf30f7764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:55.612686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389024f7-2d01-4bcb-ad05-ef5cf30f7764 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:55.613182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389024f7-2d01-4bcb-ad05-ef5cf30f7764 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:55.613708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389024f7-2d01-4bcb-ad05-ef5cf30f7764 admin admin] PATH_INFO: `/v3/projects/b6a23c895331412bb3665a23309ac67e/users/6a748d5fb1964482a0de820de06260da/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:55.640810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389024f7-2d01-4bcb-ad05-ef5cf30f7764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a23c895331412bb3665a23309ac67e, user_id=6a748d5fb1964482a0de820de06260da, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:55.644033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389024f7-2d01-4bcb-ad05-ef5cf30f7764 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:55.719876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:55.770421 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1553/3146] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:55 2022] PUT /identity/v3/projects/b6a23c895331412bb3665a23309ac67e/users/6a748d5fb1964482a0de820de06260da/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:55.775295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be452f2-1bdb-423a-9289-cdd8da4acd15 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:55.780009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be452f2-1bdb-423a-9289-cdd8da4acd15 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:55.780009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be452f2-1bdb-423a-9289-cdd8da4acd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:55.781566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:55.812259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3be452f2-1bdb-423a-9289-cdd8da4acd15 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:55.814045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3be452f2-1bdb-423a-9289-cdd8da4acd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:55.895625 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1594/3147] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:55.971396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389024f7-2d01-4bcb-ad05-ef5cf30f7764 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:56.061057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389024f7-2d01-4bcb-ad05-ef5cf30f7764 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:56.067064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8624457-7d8c-445a-bdde-4df1a44a3c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:56.068973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624457-7d8c-445a-bdde-4df1a44a3c2f service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:56.068973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624457-7d8c-445a-bdde-4df1a44a3c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:56.068973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624457-7d8c-445a-bdde-4df1a44a3c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:56.083510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8624457-7d8c-445a-bdde-4df1a44a3c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:56.085818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8624457-7d8c-445a-bdde-4df1a44a3c2f service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:56.098174 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1554/3148] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:56.565499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be452f2-1bdb-423a-9289-cdd8da4acd15 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:56.573717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3be452f2-1bdb-423a-9289-cdd8da4acd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:56.602048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be452f2-1bdb-423a-9289-cdd8da4acd15 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:56.611487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcaafd-8af4-4274-aaa5-6496972cfe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:56.613344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcaafd-8af4-4274-aaa5-6496972cfe83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:56.616957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcaafd-8af4-4274-aaa5-6496972cfe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:56.617243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcaafd-8af4-4274-aaa5-6496972cfe83 admin admin] PATH_INFO: `/v3/projects/0738bf249acb440c89a87e1e60b0f674` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:56.622869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcaafd-8af4-4274-aaa5-6496972cfe83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0738bf249acb440c89a87e1e60b0f674)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:56.623277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcaafd-8af4-4274-aaa5-6496972cfe83 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:56.799796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-effcaafd-8af4-4274-aaa5-6496972cfe83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0738bf249acb440c89a87e1e60b0f674', 'request_id': 'req-effcaafd-8af4-4274-aaa5-6496972cfe83'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:56.809373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-effcaafd-8af4-4274-aaa5-6496972cfe83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0738bf249acb440c89a87e1e60b0f674', 'request_id': 'req-effcaafd-8af4-4274-aaa5-6496972cfe83'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:56.953763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-effcaafd-8af4-4274-aaa5-6496972cfe83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0738bf249acb440c89a87e1e60b0f674', 'request_id': 'req-effcaafd-8af4-4274-aaa5-6496972cfe83'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:56.983150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-effcaafd-8af4-4274-aaa5-6496972cfe83 admin admin] The token cache is being invalidate because project 0738bf249acb440c89a87e1e60b0f674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:43:56.983981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-effcaafd-8af4-4274-aaa5-6496972cfe83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:56.984953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-effcaafd-8af4-4274-aaa5-6496972cfe83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:43:56.987956 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1595/3149] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:43:56 2022] DELETE /identity/v3/projects/0738bf249acb440c89a87e1e60b0f674 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:56.994664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd688878-d467-4e2d-8cf6-af6d263cf07b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:56.996319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd688878-d467-4e2d-8cf6-af6d263cf07b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:56.996847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd688878-d467-4e2d-8cf6-af6d263cf07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:57.049612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bd688878-d467-4e2d-8cf6-af6d263cf07b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:57.051281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bd688878-d467-4e2d-8cf6-af6d263cf07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:57.237302 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1555/3150] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:57.246456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624917d-69ec-4dc8-af7f-ee48b752bded None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:57.246753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624917d-69ec-4dc8-af7f-ee48b752bded None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:57.246998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624917d-69ec-4dc8-af7f-ee48b752bded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:57.280807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8624917d-69ec-4dc8-af7f-ee48b752bded None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:57.282146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8624917d-69ec-4dc8-af7f-ee48b752bded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:57.292778 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1596/3151] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:57.301621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd688878-d467-4e2d-8cf6-af6d263cf07b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:57.315454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd688878-d467-4e2d-8cf6-af6d263cf07b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:57.322078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da468e2f-e92c-4ba1-921f-a6a46c06b3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:57.326214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da468e2f-e92c-4ba1-921f-a6a46c06b3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:57.326214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da468e2f-e92c-4ba1-921f-a6a46c06b3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:57.326214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da468e2f-e92c-4ba1-921f-a6a46c06b3a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:57.326214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da468e2f-e92c-4ba1-921f-a6a46c06b3a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:43:57.326214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da468e2f-e92c-4ba1-921f-a6a46c06b3a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:57.327620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da468e2f-e92c-4ba1-921f-a6a46c06b3a2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:57.350488 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1556/3152] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:43:57.351826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624917d-69ec-4dc8-af7f-ee48b752bded None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:57.370437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624917d-69ec-4dc8-af7f-ee48b752bded None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:57.376715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530cf06-6e95-452e-9b32-84088e24c158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:57.377431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530cf06-6e95-452e-9b32-84088e24c158 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:57.377721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530cf06-6e95-452e-9b32-84088e24c158 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:57.377995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530cf06-6e95-452e-9b32-84088e24c158 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:57.378745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530cf06-6e95-452e-9b32-84088e24c158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:57.381106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530cf06-6e95-452e-9b32-84088e24c158 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:57.451454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:57.519195 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1597/3153] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:43:57 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:43:57.522537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da468e2f-e92c-4ba1-921f-a6a46c06b3a2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:57.534317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da468e2f-e92c-4ba1-921f-a6a46c06b3a2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:57.606714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee5ae6-ce21-4210-a0e5-9caf6ceca42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:57.607732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee5ae6-ce21-4210-a0e5-9caf6ceca42d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:57.608016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee5ae6-ce21-4210-a0e5-9caf6ceca42d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:57.608325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee5ae6-ce21-4210-a0e5-9caf6ceca42d admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:57.609210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee5ae6-ce21-4210-a0e5-9caf6ceca42d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:57.611370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee5ae6-ce21-4210-a0e5-9caf6ceca42d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:57.805158 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1557/3154] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:43:57 2022] POST /identity/v3/users => generated 294 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:43:57.811491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530cf06-6e95-452e-9b32-84088e24c158 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:57.827534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530cf06-6e95-452e-9b32-84088e24c158 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:57.842328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3ba99-ad71-4cd5-a0ee-8c5fcec298cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:57.844340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3ba99-ad71-4cd5-a0ee-8c5fcec298cc admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:57.844924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3ba99-ad71-4cd5-a0ee-8c5fcec298cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:57.845376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3ba99-ad71-4cd5-a0ee-8c5fcec298cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:57.846402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3ba99-ad71-4cd5-a0ee-8c5fcec298cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:57.848682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3ba99-ad71-4cd5-a0ee-8c5fcec298cc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:57.875606 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1598/3155] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:57.881495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee5ae6-ce21-4210-a0e5-9caf6ceca42d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:57.905560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee5ae6-ce21-4210-a0e5-9caf6ceca42d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:57.914234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af7c3b-faaf-4101-b0e8-11b7ea08f1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:57.915136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af7c3b-faaf-4101-b0e8-11b7ea08f1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:57.915571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af7c3b-faaf-4101-b0e8-11b7ea08f1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:57.916023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af7c3b-faaf-4101-b0e8-11b7ea08f1d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:57.917701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af7c3b-faaf-4101-b0e8-11b7ea08f1d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:57.921170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af7c3b-faaf-4101-b0e8-11b7ea08f1d5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:57.945971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3ba99-ad71-4cd5-a0ee-8c5fcec298cc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:57.946767 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1558/3156] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:43:57.963779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3ba99-ad71-4cd5-a0ee-8c5fcec298cc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:57.977588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781f5c1-ebae-40af-b277-1aa2f87f6b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:57.978281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781f5c1-ebae-40af-b277-1aa2f87f6b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:57.979213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781f5c1-ebae-40af-b277-1aa2f87f6b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:57.979719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781f5c1-ebae-40af-b277-1aa2f87f6b4c admin admin] PATH_INFO: `/v3/projects/4b1fca82aba64e7197467816e31033bb/users/3182a04be19f4db586a6dbe1c53b9bdd/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:58.012142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781f5c1-ebae-40af-b277-1aa2f87f6b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1fca82aba64e7197467816e31033bb, user_id=3182a04be19f4db586a6dbe1c53b9bdd, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:58.016371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781f5c1-ebae-40af-b277-1aa2f87f6b4c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:58.137270 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1599/3157] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:43:57 2022] PUT /identity/v3/projects/4b1fca82aba64e7197467816e31033bb/users/3182a04be19f4db586a6dbe1c53b9bdd/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:43:58.142877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1bd95-d724-4997-b160-c5bb6868af58 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:58.143685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1bd95-d724-4997-b160-c5bb6868af58 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:58.144112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1bd95-d724-4997-b160-c5bb6868af58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:58.204524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e2d1bd95-d724-4997-b160-c5bb6868af58 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:43:58.208652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e2d1bd95-d724-4997-b160-c5bb6868af58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:58.216958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:43:58.349471 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1559/3158] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:43:58.398632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781f5c1-ebae-40af-b277-1aa2f87f6b4c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:58.402911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7781f5c1-ebae-40af-b277-1aa2f87f6b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:58.582045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781f5c1-ebae-40af-b277-1aa2f87f6b4c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:58.591792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206eed6f-b54f-4d05-a0f3-091cd6fe917d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:58.592446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206eed6f-b54f-4d05-a0f3-091cd6fe917d service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:58.592722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206eed6f-b54f-4d05-a0f3-091cd6fe917d service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:58.592991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206eed6f-b54f-4d05-a0f3-091cd6fe917d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:58.626104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206eed6f-b54f-4d05-a0f3-091cd6fe917d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:58.627789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206eed6f-b54f-4d05-a0f3-091cd6fe917d service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:58.657629 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1600/3159] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:58.701412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1bd95-d724-4997-b160-c5bb6868af58 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:43:58.702826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e2d1bd95-d724-4997-b160-c5bb6868af58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:58.875014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1bd95-d724-4997-b160-c5bb6868af58 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:43:58.905259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dd07c-e21e-4c4e-a532-e323dcba57ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:43:58.906730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dd07c-e21e-4c4e-a532-e323dcba57ff service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:43:58.907273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dd07c-e21e-4c4e-a532-e323dcba57ff service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:43:58.907767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dd07c-e21e-4c4e-a532-e323dcba57ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:43:58.910350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-433dd07c-e21e-4c4e-a532-e323dcba57ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:43:58.932025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433dd07c-e21e-4c4e-a532-e323dcba57ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:43:58.935631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433dd07c-e21e-4c4e-a532-e323dcba57ff service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:43:58.966859 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1560/3160] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:43:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:43:59.897188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:00.645431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:01.003178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e68dca-f247-4338-891c-9534fd31031f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.003732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e68dca-f247-4338-891c-9534fd31031f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.003732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e68dca-f247-4338-891c-9534fd31031f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.095220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a5e68dca-f247-4338-891c-9534fd31031f None None] MFA Rules not processed for user `83867771c9a1442cba2837c1132df88d`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:01.096520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a5e68dca-f247-4338-891c-9534fd31031f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:01.220637 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1601/3161] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:01.221582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dd07c-e21e-4c4e-a532-e323dcba57ff service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.223210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-433dd07c-e21e-4c4e-a532-e323dcba57ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:01.275930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dd07c-e21e-4c4e-a532-e323dcba57ff service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.298517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695ce95-bb38-444c-be0d-a23e7f9f883b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.298517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695ce95-bb38-444c-be0d-a23e7f9f883b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.298517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695ce95-bb38-444c-be0d-a23e7f9f883b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.298517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695ce95-bb38-444c-be0d-a23e7f9f883b admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.299233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695ce95-bb38-444c-be0d-a23e7f9f883b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.299233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695ce95-bb38-444c-be0d-a23e7f9f883b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.448757 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1561/3162] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:44:01 2022] POST /identity/v3/projects => generated 387 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:01.452866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e68dca-f247-4338-891c-9534fd31031f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.471610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e68dca-f247-4338-891c-9534fd31031f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.568116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81079d6a-0bac-4266-b534-4cfad5e8a4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.569627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81079d6a-0bac-4266-b534-4cfad5e8a4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.569627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81079d6a-0bac-4266-b534-4cfad5e8a4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.570287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81079d6a-0bac-4266-b534-4cfad5e8a4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.570787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81079d6a-0bac-4266-b534-4cfad5e8a4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.573502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81079d6a-0bac-4266-b534-4cfad5e8a4c8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.687371 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1602/3163] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:44:01 2022] POST /identity/v3/users => generated 300 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:01.689800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695ce95-bb38-444c-be0d-a23e7f9f883b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.702232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695ce95-bb38-444c-be0d-a23e7f9f883b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.707688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab88bce-af7f-4869-b64a-e7ef00c96438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.708510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88bce-af7f-4869-b64a-e7ef00c96438 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.708859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88bce-af7f-4869-b64a-e7ef00c96438 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.709219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88bce-af7f-4869-b64a-e7ef00c96438 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.709952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab88bce-af7f-4869-b64a-e7ef00c96438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.711881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab88bce-af7f-4869-b64a-e7ef00c96438 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.727240 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1562/3164] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:01.736423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81079d6a-0bac-4266-b534-4cfad5e8a4c8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.762175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81079d6a-0bac-4266-b534-4cfad5e8a4c8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.785298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547893ed-1e9f-4092-92d8-040eb8933d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:01.794195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547893ed-1e9f-4092-92d8-040eb8933d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:01.794818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547893ed-1e9f-4092-92d8-040eb8933d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:01.795298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547893ed-1e9f-4092-92d8-040eb8933d1a admin admin] PATH_INFO: `/v3/projects/afd683ccf6674e33a101d957f16e948e/users/da1014ef8b0a4b2c8da27a90eb92fe69/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:01.844361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547893ed-1e9f-4092-92d8-040eb8933d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd683ccf6674e33a101d957f16e948e, user_id=da1014ef8b0a4b2c8da27a90eb92fe69, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:01.847220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547893ed-1e9f-4092-92d8-040eb8933d1a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:01.931048 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1603/3165] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:44:01 2022] PUT /identity/v3/projects/afd683ccf6674e33a101d957f16e948e/users/da1014ef8b0a4b2c8da27a90eb92fe69/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:01.932681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab88bce-af7f-4869-b64a-e7ef00c96438 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:01.974619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab88bce-af7f-4869-b64a-e7ef00c96438 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:01.988443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:02.154486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9778ec4-2970-4527-be6b-d285ea6e9316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:02.155616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9778ec4-2970-4527-be6b-d285ea6e9316 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.156283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9778ec4-2970-4527-be6b-d285ea6e9316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.156574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9778ec4-2970-4527-be6b-d285ea6e9316 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.158096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9778ec4-2970-4527-be6b-d285ea6e9316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:02.159188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9778ec4-2970-4527-be6b-d285ea6e9316 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:02.164825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:02.175174 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1563/3166] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:02.179178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547893ed-1e9f-4092-92d8-040eb8933d1a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:02.191920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547893ed-1e9f-4092-92d8-040eb8933d1a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:02.197877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889d918-7835-45df-a0ec-44422a923013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:02.198591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889d918-7835-45df-a0ec-44422a923013 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:02.198797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889d918-7835-45df-a0ec-44422a923013 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:02.199067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889d918-7835-45df-a0ec-44422a923013 admin admin] PATH_INFO: `/v3/projects/afd683ccf6674e33a101d957f16e948e/users/da1014ef8b0a4b2c8da27a90eb92fe69/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:02.201957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889d918-7835-45df-a0ec-44422a923013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd683ccf6674e33a101d957f16e948e, user_id=da1014ef8b0a4b2c8da27a90eb92fe69, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:02.205034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889d918-7835-45df-a0ec-44422a923013 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:02.222568 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1604/3167] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:44:02 2022] PUT /identity/v3/projects/afd683ccf6674e33a101d957f16e948e/users/da1014ef8b0a4b2c8da27a90eb92fe69/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:03.044954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:03.214341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9778ec4-2970-4527-be6b-d285ea6e9316 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.216135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d9778ec4-2970-4527-be6b-d285ea6e9316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:03.243838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9778ec4-2970-4527-be6b-d285ea6e9316 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:03.343442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0ff16-e4e1-4c89-b732-5f08a7633e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:03.344189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0ff16-e4e1-4c89-b732-5f08a7633e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.344597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0ff16-e4e1-4c89-b732-5f08a7633e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.344876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0ff16-e4e1-4c89-b732-5f08a7633e48 admin admin] PATH_INFO: `/v3/users/c0493ef2484140f69c1817efaaa51f98` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.346169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0ff16-e4e1-4c89-b732-5f08a7633e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0493ef2484140f69c1817efaaa51f98)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:03.348283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0ff16-e4e1-4c89-b732-5f08a7633e48 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:03.598873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-34e0ff16-e4e1-4c89-b732-5f08a7633e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0493ef2484140f69c1817efaaa51f98'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:03.731305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-34e0ff16-e4e1-4c89-b732-5f08a7633e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0493ef2484140f69c1817efaaa51f98'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:03.732444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-34e0ff16-e4e1-4c89-b732-5f08a7633e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0493ef2484140f69c1817efaaa51f98'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:03.743251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-34e0ff16-e4e1-4c89-b732-5f08a7633e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0493ef2484140f69c1817efaaa51f98'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:03.769891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-34e0ff16-e4e1-4c89-b732-5f08a7633e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0493ef2484140f69c1817efaaa51f98'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:03.782225 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1564/3168] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:44:03 2022] DELETE /identity/v3/users/c0493ef2484140f69c1817efaaa51f98 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:03.786653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e5f2b-ce83-4496-9ef4-5d46fa7d5237 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:03.787170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e5f2b-ce83-4496-9ef4-5d46fa7d5237 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:03.787524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e5f2b-ce83-4496-9ef4-5d46fa7d5237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:03.829080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1a9e5f2b-ce83-4496-9ef4-5d46fa7d5237 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:03.830587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1a9e5f2b-ce83-4496-9ef4-5d46fa7d5237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:03.977664 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1605/3169] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:03.996675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0ff16-e4e1-4c89-b732-5f08a7633e48 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:03.998891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-34e0ff16-e4e1-4c89-b732-5f08a7633e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:04.147136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0ff16-e4e1-4c89-b732-5f08a7633e48 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:04.156429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2f928-fead-40d0-bf46-9de5ce935d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:04.157449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2f928-fead-40d0-bf46-9de5ce935d5a service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.157964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2f928-fead-40d0-bf46-9de5ce935d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.158403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2f928-fead-40d0-bf46-9de5ce935d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.182251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2f928-fead-40d0-bf46-9de5ce935d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:04.188067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2f928-fead-40d0-bf46-9de5ce935d5a service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:04.208634 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1565/3170] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:44:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:04.485095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:04.781410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e5f2b-ce83-4496-9ef4-5d46fa7d5237 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:04.782952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1a9e5f2b-ce83-4496-9ef4-5d46fa7d5237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:04.798730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e5f2b-ce83-4496-9ef4-5d46fa7d5237 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:04.805627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94382afc-e724-4578-b80c-2389ee6dd54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:04.807308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94382afc-e724-4578-b80c-2389ee6dd54a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:04.809194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94382afc-e724-4578-b80c-2389ee6dd54a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:04.809194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94382afc-e724-4578-b80c-2389ee6dd54a admin admin] PATH_INFO: `/v3/projects/8511e600620148c2b51cb7fe446763eb` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:04.811538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94382afc-e724-4578-b80c-2389ee6dd54a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8511e600620148c2b51cb7fe446763eb)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:04.813841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94382afc-e724-4578-b80c-2389ee6dd54a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:04.962180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94382afc-e724-4578-b80c-2389ee6dd54a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8511e600620148c2b51cb7fe446763eb', 'request_id': 'req-94382afc-e724-4578-b80c-2389ee6dd54a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:04.985509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94382afc-e724-4578-b80c-2389ee6dd54a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8511e600620148c2b51cb7fe446763eb', 'request_id': 'req-94382afc-e724-4578-b80c-2389ee6dd54a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:05.068190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94382afc-e724-4578-b80c-2389ee6dd54a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8511e600620148c2b51cb7fe446763eb', 'request_id': 'req-94382afc-e724-4578-b80c-2389ee6dd54a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:05.089551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94382afc-e724-4578-b80c-2389ee6dd54a admin admin] The token cache is being invalidate because project 8511e600620148c2b51cb7fe446763eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:05.090241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94382afc-e724-4578-b80c-2389ee6dd54a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:05.093363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94382afc-e724-4578-b80c-2389ee6dd54a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:05.097111 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1606/3171] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:44:04 2022] DELETE /identity/v3/projects/8511e600620148c2b51cb7fe446763eb => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:05.101135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2f928-fead-40d0-bf46-9de5ce935d5a service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:05.117676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2f928-fead-40d0-bf46-9de5ce935d5a service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:05.241992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa81630-bc31-45de-8017-2f937ed17ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:05.242877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa81630-bc31-45de-8017-2f937ed17ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:05.243354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa81630-bc31-45de-8017-2f937ed17ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:05.244058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa81630-bc31-45de-8017-2f937ed17ee6 admin admin] PATH_INFO: `/v3/users/801f94c1f2a348589c33b52c9cf02584` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:05.245752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa81630-bc31-45de-8017-2f937ed17ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=801f94c1f2a348589c33b52c9cf02584)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:05.248464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa81630-bc31-45de-8017-2f937ed17ee6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:05.388621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:05.516419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-eaa81630-bc31-45de-8017-2f937ed17ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '801f94c1f2a348589c33b52c9cf02584'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:05.587851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed8518-5bb5-4198-b694-26757ad09a0f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:05.589432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed8518-5bb5-4198-b694-26757ad09a0f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:05.589906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed8518-5bb5-4198-b694-26757ad09a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:05.623410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-cbed8518-5bb5-4198-b694-26757ad09a0f None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:05.628644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cbed8518-5bb5-4198-b694-26757ad09a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:05.639166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-eaa81630-bc31-45de-8017-2f937ed17ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '801f94c1f2a348589c33b52c9cf02584'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:05.640390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-eaa81630-bc31-45de-8017-2f937ed17ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '801f94c1f2a348589c33b52c9cf02584'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:05.652431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-eaa81630-bc31-45de-8017-2f937ed17ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '801f94c1f2a348589c33b52c9cf02584'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:05.733173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-eaa81630-bc31-45de-8017-2f937ed17ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '801f94c1f2a348589c33b52c9cf02584'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:05.754144 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1566/3172] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:44:05 2022] DELETE /identity/v3/users/801f94c1f2a348589c33b52c9cf02584 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:05.814101 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1607/3173] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:44:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:05.840566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa81630-bc31-45de-8017-2f937ed17ee6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:05.844683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-eaa81630-bc31-45de-8017-2f937ed17ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:05.993356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa81630-bc31-45de-8017-2f937ed17ee6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:06.010130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ea59e-dcd2-4865-968b-ffeb938b034f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:06.011407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ea59e-dcd2-4865-968b-ffeb938b034f service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:06.011689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ea59e-dcd2-4865-968b-ffeb938b034f service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:06.013679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ea59e-dcd2-4865-968b-ffeb938b034f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:06.117260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ea59e-dcd2-4865-968b-ffeb938b034f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:06.120189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ea59e-dcd2-4865-968b-ffeb938b034f service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:06.150356 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1567/3174] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:44:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:06.605847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:06.657781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed8518-5bb5-4198-b694-26757ad09a0f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:06.659314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cbed8518-5bb5-4198-b694-26757ad09a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:06.706631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed8518-5bb5-4198-b694-26757ad09a0f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:06.897356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddba1af-c1fb-4ce8-abd1-44a135eca522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:06.900095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddba1af-c1fb-4ce8-abd1-44a135eca522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:06.900810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddba1af-c1fb-4ce8-abd1-44a135eca522 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:06.901281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddba1af-c1fb-4ce8-abd1-44a135eca522 admin admin] PATH_INFO: `/v3/projects/ec38230faef14dfebc11b3916089b542` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:06.903016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddba1af-c1fb-4ce8-abd1-44a135eca522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec38230faef14dfebc11b3916089b542)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:06.905525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddba1af-c1fb-4ce8-abd1-44a135eca522 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:07.149493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5ddba1af-c1fb-4ce8-abd1-44a135eca522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec38230faef14dfebc11b3916089b542', 'request_id': 'req-5ddba1af-c1fb-4ce8-abd1-44a135eca522'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:07.175715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5ddba1af-c1fb-4ce8-abd1-44a135eca522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec38230faef14dfebc11b3916089b542', 'request_id': 'req-5ddba1af-c1fb-4ce8-abd1-44a135eca522'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:07.189919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:07.308943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5ddba1af-c1fb-4ce8-abd1-44a135eca522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec38230faef14dfebc11b3916089b542', 'request_id': 'req-5ddba1af-c1fb-4ce8-abd1-44a135eca522'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:07.339259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5ddba1af-c1fb-4ce8-abd1-44a135eca522 admin admin] The token cache is being invalidate because project ec38230faef14dfebc11b3916089b542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:07.339610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5ddba1af-c1fb-4ce8-abd1-44a135eca522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:07.341910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5ddba1af-c1fb-4ce8-abd1-44a135eca522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:07.344841 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1608/3175] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:44:06 2022] DELETE /identity/v3/projects/ec38230faef14dfebc11b3916089b542 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:07.349783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df487101-818d-458a-9f10-a06ab081fc78 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:07.350579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df487101-818d-458a-9f10-a06ab081fc78 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:07.351377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df487101-818d-458a-9f10-a06ab081fc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:07.438538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-df487101-818d-458a-9f10-a06ab081fc78 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:07.440580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-df487101-818d-458a-9f10-a06ab081fc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:07.634869 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1568/3176] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:07.642730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8d823-dd71-4ce1-b04c-bba9462e56d0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:07.643239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8d823-dd71-4ce1-b04c-bba9462e56d0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:07.643681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8d823-dd71-4ce1-b04c-bba9462e56d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:07.714537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-71c8d823-dd71-4ce1-b04c-bba9462e56d0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:07.737872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-71c8d823-dd71-4ce1-b04c-bba9462e56d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:07.790206 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1609/3177] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:07.796701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df487101-818d-458a-9f10-a06ab081fc78 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:07.825879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df487101-818d-458a-9f10-a06ab081fc78 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:07.855493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae1d22-8205-46d9-80d3-a3cb236bddab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:07.860579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae1d22-8205-46d9-80d3-a3cb236bddab admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:07.861372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae1d22-8205-46d9-80d3-a3cb236bddab admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:07.861999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae1d22-8205-46d9-80d3-a3cb236bddab admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:07.864741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae1d22-8205-46d9-80d3-a3cb236bddab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:07.865384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae1d22-8205-46d9-80d3-a3cb236bddab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:07.869646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae1d22-8205-46d9-80d3-a3cb236bddab admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:07.913198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8d823-dd71-4ce1-b04c-bba9462e56d0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:07.930678 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1569/3178] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:44:07.938497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8d823-dd71-4ce1-b04c-bba9462e56d0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:07.958716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8ac30-d79c-45b6-8963-9597a73f1ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:07.959739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8ac30-d79c-45b6-8963-9597a73f1ece admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:07.960596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8ac30-d79c-45b6-8963-9597a73f1ece admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:07.961492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8ac30-d79c-45b6-8963-9597a73f1ece admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:07.965886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8ac30-d79c-45b6-8963-9597a73f1ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:07.971955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8ac30-d79c-45b6-8963-9597a73f1ece admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:08.118965 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1610/3179] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:44:07 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:08.119331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae1d22-8205-46d9-80d3-a3cb236bddab admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:08.137454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae1d22-8205-46d9-80d3-a3cb236bddab admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:08.278507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:08.308467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:08.345115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cae8d6-b744-493b-8a38-25d933a68320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:08.345959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cae8d6-b744-493b-8a38-25d933a68320 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:08.346250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cae8d6-b744-493b-8a38-25d933a68320 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:08.348427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cae8d6-b744-493b-8a38-25d933a68320 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:08.349377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cae8d6-b744-493b-8a38-25d933a68320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:08.355699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cae8d6-b744-493b-8a38-25d933a68320 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:08.470813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8ac30-d79c-45b6-8963-9597a73f1ece admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:08.480564 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1570/3180] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:44:08 2022] POST /identity/v3/users => generated 287 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:44:08.490946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8ac30-d79c-45b6-8963-9597a73f1ece admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:08.507906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea77e9a-6da4-41da-8b94-c05bf8ff3908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:08.508575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea77e9a-6da4-41da-8b94-c05bf8ff3908 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:08.508856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea77e9a-6da4-41da-8b94-c05bf8ff3908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:08.509197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea77e9a-6da4-41da-8b94-c05bf8ff3908 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:08.511154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea77e9a-6da4-41da-8b94-c05bf8ff3908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:08.513508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea77e9a-6da4-41da-8b94-c05bf8ff3908 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:08.544453 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1611/3181] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:08.548990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cae8d6-b744-493b-8a38-25d933a68320 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:08.563677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cae8d6-b744-493b-8a38-25d933a68320 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:08.586564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a2901-7221-4737-bbd5-7276c7af3e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:08.587208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a2901-7221-4737-bbd5-7276c7af3e8f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:08.587532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a2901-7221-4737-bbd5-7276c7af3e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:08.592765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a2901-7221-4737-bbd5-7276c7af3e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:08.594621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a2901-7221-4737-bbd5-7276c7af3e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:08.599693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a2901-7221-4737-bbd5-7276c7af3e8f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:08.643898 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1571/3182] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:08.647570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea77e9a-6da4-41da-8b94-c05bf8ff3908 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:08.669490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea77e9a-6da4-41da-8b94-c05bf8ff3908 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:08.684048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c41d67-dd53-45c1-8f59-eeb52c5f255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:08.685857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c41d67-dd53-45c1-8f59-eeb52c5f255a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:08.686390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c41d67-dd53-45c1-8f59-eeb52c5f255a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:08.687044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c41d67-dd53-45c1-8f59-eeb52c5f255a admin admin] PATH_INFO: `/v3/projects/4a11f6bfb3144711964b5a5f6365c487/users/429a0f884ff149d19932610ddaeecf9a/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:08.735590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c41d67-dd53-45c1-8f59-eeb52c5f255a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a11f6bfb3144711964b5a5f6365c487, user_id=429a0f884ff149d19932610ddaeecf9a, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:08.743491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c41d67-dd53-45c1-8f59-eeb52c5f255a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:08.852982 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1612/3183] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:44:08 2022] PUT /identity/v3/projects/4a11f6bfb3144711964b5a5f6365c487/users/429a0f884ff149d19932610ddaeecf9a/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:08.953220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c160d-15c3-4648-8de6-3a03d3aeeef8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:08.953809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c160d-15c3-4648-8de6-3a03d3aeeef8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:08.954251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c160d-15c3-4648-8de6-3a03d3aeeef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:09.019540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f79c160d-15c3-4648-8de6-3a03d3aeeef8 None None] MFA Rules not processed for user `429a0f884ff149d19932610ddaeecf9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:09.020909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f79c160d-15c3-4648-8de6-3a03d3aeeef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:09.231711 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1572/3184] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:09.232690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c41d67-dd53-45c1-8f59-eeb52c5f255a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:09.331399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c41d67-dd53-45c1-8f59-eeb52c5f255a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:09.345275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96793b70-fbc4-4f53-bb2d-190df46df5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:09.346831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96793b70-fbc4-4f53-bb2d-190df46df5db admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:09.348486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96793b70-fbc4-4f53-bb2d-190df46df5db admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:09.348833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96793b70-fbc4-4f53-bb2d-190df46df5db admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:09.349558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96793b70-fbc4-4f53-bb2d-190df46df5db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:09.356748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96793b70-fbc4-4f53-bb2d-190df46df5db admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:09.427780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:09.501008 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1613/3185] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:44:09 2022] POST /identity/v3/projects => generated 375 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:09.503302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c160d-15c3-4648-8de6-3a03d3aeeef8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:09.547464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c160d-15c3-4648-8de6-3a03d3aeeef8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:09.587079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:09.718563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e16b4-8a47-43ed-8e02-173424e8b8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:09.719832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e16b4-8a47-43ed-8e02-173424e8b8cc admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:09.720319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e16b4-8a47-43ed-8e02-173424e8b8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:09.720755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e16b4-8a47-43ed-8e02-173424e8b8cc admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:09.721562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e16b4-8a47-43ed-8e02-173424e8b8cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:09.723699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e16b4-8a47-43ed-8e02-173424e8b8cc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:09.921411 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1573/3186] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:44:09 2022] POST /identity/v3/users => generated 294 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:09.925279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96793b70-fbc4-4f53-bb2d-190df46df5db admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:09.970876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96793b70-fbc4-4f53-bb2d-190df46df5db admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:09.987925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2924c-a28b-49a0-91a5-2dfc91ef4a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:09.994104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2924c-a28b-49a0-91a5-2dfc91ef4a6d admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:09.994104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2924c-a28b-49a0-91a5-2dfc91ef4a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:09.994104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2924c-a28b-49a0-91a5-2dfc91ef4a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:09.994104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2924c-a28b-49a0-91a5-2dfc91ef4a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:09.994104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2924c-a28b-49a0-91a5-2dfc91ef4a6d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:10.008429 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1614/3187] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:10.014343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e16b4-8a47-43ed-8e02-173424e8b8cc admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:10.028974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e16b4-8a47-43ed-8e02-173424e8b8cc admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:10.046452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334694ec-6afd-49a3-98ec-526aa69d1fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:10.047583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334694ec-6afd-49a3-98ec-526aa69d1fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:10.047876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334694ec-6afd-49a3-98ec-526aa69d1fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:10.048174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334694ec-6afd-49a3-98ec-526aa69d1fc4 admin admin] PATH_INFO: `/v3/projects/661fcec0ed364cf782ee5edc422910b7/users/2cd95336ff214ec1966ffa4ea09136e1/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:10.084370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334694ec-6afd-49a3-98ec-526aa69d1fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=661fcec0ed364cf782ee5edc422910b7, user_id=2cd95336ff214ec1966ffa4ea09136e1, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:10.094125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334694ec-6afd-49a3-98ec-526aa69d1fc4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:10.248868 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1574/3188] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:44:10 2022] PUT /identity/v3/projects/661fcec0ed364cf782ee5edc422910b7/users/2cd95336ff214ec1966ffa4ea09136e1/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:10.249119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2924c-a28b-49a0-91a5-2dfc91ef4a6d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:10.262598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2924c-a28b-49a0-91a5-2dfc91ef4a6d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:10.394513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:10.426563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529d265-cfb8-4c82-9b2f-c48646f6d9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:10.427297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529d265-cfb8-4c82-9b2f-c48646f6d9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:10.427694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529d265-cfb8-4c82-9b2f-c48646f6d9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:10.428043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529d265-cfb8-4c82-9b2f-c48646f6d9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:10.428851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529d265-cfb8-4c82-9b2f-c48646f6d9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:10.430759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529d265-cfb8-4c82-9b2f-c48646f6d9d1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:10.465942 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1615/3189] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:10.470427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334694ec-6afd-49a3-98ec-526aa69d1fc4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:10.499194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334694ec-6afd-49a3-98ec-526aa69d1fc4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:10.507361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95a9c4-7210-4acc-b7df-4be5c7547a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:10.516121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95a9c4-7210-4acc-b7df-4be5c7547a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:10.517814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95a9c4-7210-4acc-b7df-4be5c7547a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:10.519232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95a9c4-7210-4acc-b7df-4be5c7547a7c admin admin] PATH_INFO: `/v3/projects/661fcec0ed364cf782ee5edc422910b7/users/2cd95336ff214ec1966ffa4ea09136e1/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:10.527453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95a9c4-7210-4acc-b7df-4be5c7547a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=661fcec0ed364cf782ee5edc422910b7, user_id=2cd95336ff214ec1966ffa4ea09136e1, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:10.530583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95a9c4-7210-4acc-b7df-4be5c7547a7c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:10.558106 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1575/3190] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:44:10 2022] PUT /identity/v3/projects/661fcec0ed364cf782ee5edc422910b7/users/2cd95336ff214ec1966ffa4ea09136e1/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:10.558343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619acd-d9e7-40be-bbb4-47baf9f4d498 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:10.558632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619acd-d9e7-40be-bbb4-47baf9f4d498 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:10.561634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619acd-d9e7-40be-bbb4-47baf9f4d498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:10.642688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d8619acd-d9e7-40be-bbb4-47baf9f4d498 None None] MFA Rules not processed for user `2cd95336ff214ec1966ffa4ea09136e1`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:10.644590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d8619acd-d9e7-40be-bbb4-47baf9f4d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:10.765068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:10.867884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf0bd9-836c-4ae5-8a6e-def210c064b5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:10.868520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf0bd9-836c-4ae5-8a6e-def210c064b5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:10.870073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf0bd9-836c-4ae5-8a6e-def210c064b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:10.872523 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1616/3191] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:10.913636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ffdf0bd9-836c-4ae5-8a6e-def210c064b5 None None] MFA Rules not processed for user `429a0f884ff149d19932610ddaeecf9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:10.915542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ffdf0bd9-836c-4ae5-8a6e-def210c064b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:11.036673 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1576/3192] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:11.201240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:11.748049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619acd-d9e7-40be-bbb4-47baf9f4d498 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:11.749528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d8619acd-d9e7-40be-bbb4-47baf9f4d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:11.765294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:11.945307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619acd-d9e7-40be-bbb4-47baf9f4d498 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:11.967975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe563c-dc57-40c2-8b43-69e7a8908e04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:11.969433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe563c-dc57-40c2-8b43-69e7a8908e04 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:11.970215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe563c-dc57-40c2-8b43-69e7a8908e04 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:11.970924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe563c-dc57-40c2-8b43-69e7a8908e04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:11.995589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe563c-dc57-40c2-8b43-69e7a8908e04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:12.003289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe563c-dc57-40c2-8b43-69e7a8908e04 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:12.035162 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1617/3193] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:44:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:12.456310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:13.574622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01ad56-2cba-4fcb-804f-185905ff6871 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:13.578513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01ad56-2cba-4fcb-804f-185905ff6871 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:13.584255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01ad56-2cba-4fcb-804f-185905ff6871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:13.636517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0d01ad56-2cba-4fcb-804f-185905ff6871 None None] MFA Rules not processed for user `6a748d5fb1964482a0de820de06260da`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:13.638087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0d01ad56-2cba-4fcb-804f-185905ff6871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:13.706411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f25e7-7910-4367-b585-a0433db61447 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:13.707360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f25e7-7910-4367-b585-a0433db61447 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:13.707827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f25e7-7910-4367-b585-a0433db61447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:13.824679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d65f25e7-7910-4367-b585-a0433db61447 None None] MFA Rules not processed for user `180b1bccee82402bb715656b26072471`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:13.826209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d65f25e7-7910-4367-b585-a0433db61447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:13.829434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:13.899433 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1577/3194] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:13.903526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01ad56-2cba-4fcb-804f-185905ff6871 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:13.907205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0d01ad56-2cba-4fcb-804f-185905ff6871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:13.970246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01ad56-2cba-4fcb-804f-185905ff6871 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:14.013325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7d83d-69ed-454a-acbc-7b573594aa36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:14.013976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7d83d-69ed-454a-acbc-7b573594aa36 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:14.014252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7d83d-69ed-454a-acbc-7b573594aa36 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:14.014528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7d83d-69ed-454a-acbc-7b573594aa36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:14.020360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a3c7d83d-69ed-454a-acbc-7b573594aa36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:14.084590 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1618/3195] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:14.096284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7d83d-69ed-454a-acbc-7b573594aa36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:14.098017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7d83d-69ed-454a-acbc-7b573594aa36 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:14.159747 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1578/3196] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:44:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:14.204477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f25e7-7910-4367-b585-a0433db61447 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:14.226915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f25e7-7910-4367-b585-a0433db61447 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:14.246103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cbf5c-a329-4abb-ba64-b242e1f12dc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:14.247008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cbf5c-a329-4abb-ba64-b242e1f12dc1 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:14.247464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cbf5c-a329-4abb-ba64-b242e1f12dc1 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:14.247921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cbf5c-a329-4abb-ba64-b242e1f12dc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:14.274710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cbf5c-a329-4abb-ba64-b242e1f12dc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:14.278563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cbf5c-a329-4abb-ba64-b242e1f12dc1 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:14.302347 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1619/3197] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:44:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:14.364217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7d83d-69ed-454a-acbc-7b573594aa36 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:14.378771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7d83d-69ed-454a-acbc-7b573594aa36 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:14.390531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742ef4a-9f8e-495c-a0a5-9a1c19577d58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:14.391953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742ef4a-9f8e-495c-a0a5-9a1c19577d58 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:14.392467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742ef4a-9f8e-495c-a0a5-9a1c19577d58 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:14.393054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742ef4a-9f8e-495c-a0a5-9a1c19577d58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:14.403783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742ef4a-9f8e-495c-a0a5-9a1c19577d58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:14.405843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742ef4a-9f8e-495c-a0a5-9a1c19577d58 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:14.418341 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1579/3198] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:44:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:44:15.543432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e177a-d8e0-4eb2-b8c7-d5a07a439946 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:15.544748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e177a-d8e0-4eb2-b8c7-d5a07a439946 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:15.545336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e177a-d8e0-4eb2-b8c7-d5a07a439946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:15.633792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e46e177a-d8e0-4eb2-b8c7-d5a07a439946 None None] MFA Rules not processed for user `3182a04be19f4db586a6dbe1c53b9bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:15.655614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e46e177a-d8e0-4eb2-b8c7-d5a07a439946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:16.122586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:16.165220 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1620/3199] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 623 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:17.676959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742ef4a-9f8e-495c-a0a5-9a1c19577d58 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:17.691315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742ef4a-9f8e-495c-a0a5-9a1c19577d58 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:17.732863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9f3a4-e5c5-4a86-ab6d-593b498a8b95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:17.733817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f3a4-e5c5-4a86-ab6d-593b498a8b95 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:17.734276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f3a4-e5c5-4a86-ab6d-593b498a8b95 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:17.734933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f3a4-e5c5-4a86-ab6d-593b498a8b95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:17.786916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9f3a4-e5c5-4a86-ab6d-593b498a8b95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:17.791874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9f3a4-e5c5-4a86-ab6d-593b498a8b95 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:17.827279 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1580/3200] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:44:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:21.827018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7a3c0-c3f7-4db7-9d35-5ffce0505360 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:21.827528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7a3c0-c3f7-4db7-9d35-5ffce0505360 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:21.827620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7a3c0-c3f7-4db7-9d35-5ffce0505360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:21.909647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed4da-b493-4360-9636-8251bc89bd0f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:21.910218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed4da-b493-4360-9636-8251bc89bd0f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:21.910218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed4da-b493-4360-9636-8251bc89bd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:21.936955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-20d7a3c0-c3f7-4db7-9d35-5ffce0505360 None None] MFA Rules not processed for user `da1014ef8b0a4b2c8da27a90eb92fe69`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:21.939123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-20d7a3c0-c3f7-4db7-9d35-5ffce0505360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:21.953650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f2bed4da-b493-4360-9636-8251bc89bd0f None None] MFA Rules not processed for user `180b1bccee82402bb715656b26072471`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:21.954910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f2bed4da-b493-4360-9636-8251bc89bd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:21.970224 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1581/3201] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:22.140861 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1621/3202] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:22.151259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bed4da-b493-4360-9636-8251bc89bd0f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:22.153310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f2bed4da-b493-4360-9636-8251bc89bd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:22.215756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:22.417571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bed4da-b493-4360-9636-8251bc89bd0f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:22.427975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11c175-2f03-441a-86a4-4c0025f4478e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:22.429067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11c175-2f03-441a-86a4-4c0025f4478e service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:22.430169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11c175-2f03-441a-86a4-4c0025f4478e service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:22.430801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11c175-2f03-441a-86a4-4c0025f4478e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:22.433116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9e11c175-2f03-441a-86a4-4c0025f4478e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:22.542283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11c175-2f03-441a-86a4-4c0025f4478e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:22.544323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11c175-2f03-441a-86a4-4c0025f4478e service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:22.557297 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1582/3203] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:44:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:22.863348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d8023-9c31-4255-b5bb-fd47b8f7bb01 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:22.863858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d8023-9c31-4255-b5bb-fd47b8f7bb01 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:22.864222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d8023-9c31-4255-b5bb-fd47b8f7bb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:22.875374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-542d8023-9c31-4255-b5bb-fd47b8f7bb01 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:44:22.875374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:44:22.875374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:44:22.875374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:44:22.875374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:44:22.875374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:44:22.875374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:44:22.875374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:44:22.875374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:44:22.875374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:44:22.875374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:44:22.875374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:44:22.875374 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:44:22.881131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:44:22.881131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:44:22.881131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:44:22.881131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:44:22.881131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:44:22.881131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:44:22.881131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:44:22.881131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:44:22.881131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:44:22.881131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:44:22.881131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:44:22.881131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:44:22.881131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:44:22.881131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:44:22.881131 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:44:22.882783 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1622/3204] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:44:22 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 19 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:44:22.986724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211b7e2-5b75-4526-8925-a38a8a9a9381 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:22.988039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211b7e2-5b75-4526-8925-a38a8a9a9381 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:22.988640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211b7e2-5b75-4526-8925-a38a8a9a9381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:22.998108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-f211b7e2-5b75-4526-8925-a38a8a9a9381 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:44:22.998108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:44:22.998108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:44:22.998108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:44:22.998108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:44:22.998108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:44:22.998108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:44:22.998108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:44:22.998108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:44:22.998108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:44:22.998108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:44:22.998108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:44:22.998108 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:44:23.003907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:44:23.003907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:44:23.003907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:44:23.003907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:44:23.003907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:44:23.003907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:44:23.003907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:44:23.003907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:44:23.003907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:44:23.003907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:44:23.003907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:44:23.003907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:44:23.003907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:44:23.003907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:44:23.003907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:44:23.005115 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1583/3205] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:44:22 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 17 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:44:24.723558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf682c-829b-44fe-b861-14cc97cf5c8a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:24.724805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf682c-829b-44fe-b861-14cc97cf5c8a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:24.725287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf682c-829b-44fe-b861-14cc97cf5c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:24.789011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2edf682c-829b-44fe-b861-14cc97cf5c8a None None] MFA Rules not processed for user `3182a04be19f4db586a6dbe1c53b9bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:24.791203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2edf682c-829b-44fe-b861-14cc97cf5c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:24.863599 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1623/3206] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:32.872326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=53 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:34.754927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=38 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:34.758108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211b7e2-5b75-4526-8925-a38a8a9a9381 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:34.760623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f211b7e2-5b75-4526-8925-a38a8a9a9381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:34.857621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211b7e2-5b75-4526-8925-a38a8a9a9381 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:34.865669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef8fa9-efe3-41c8-9397-d0155574d7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:34.866420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef8fa9-efe3-41c8-9397-d0155574d7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:34.869771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef8fa9-efe3-41c8-9397-d0155574d7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:34.869771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef8fa9-efe3-41c8-9397-d0155574d7ef admin admin] PATH_INFO: `/v3/users/180b1bccee82402bb715656b26072471` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:34.869771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef8fa9-efe3-41c8-9397-d0155574d7ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=180b1bccee82402bb715656b26072471)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:34.870535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef8fa9-efe3-41c8-9397-d0155574d7ef admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:35.099898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-eaef8fa9-efe3-41c8-9397-d0155574d7ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '180b1bccee82402bb715656b26072471'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:35.250034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-eaef8fa9-efe3-41c8-9397-d0155574d7ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '180b1bccee82402bb715656b26072471'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:35.250625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-eaef8fa9-efe3-41c8-9397-d0155574d7ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '180b1bccee82402bb715656b26072471'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:35.263199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-eaef8fa9-efe3-41c8-9397-d0155574d7ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '180b1bccee82402bb715656b26072471'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:35.285541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-eaef8fa9-efe3-41c8-9397-d0155574d7ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '180b1bccee82402bb715656b26072471'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:35.289235 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1584/3207] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:44:34 2022] DELETE /identity/v3/users/180b1bccee82402bb715656b26072471 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:35.711018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf682c-829b-44fe-b861-14cc97cf5c8a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:35.728852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf682c-829b-44fe-b861-14cc97cf5c8a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:35.814617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c79b8-1967-489c-9b2d-4e9b4f6975de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:35.815886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c79b8-1967-489c-9b2d-4e9b4f6975de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:35.815886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c79b8-1967-489c-9b2d-4e9b4f6975de admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:35.816235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c79b8-1967-489c-9b2d-4e9b4f6975de admin admin] PATH_INFO: `/v3/projects/0b2ef28fea57405191162c673ef041ab` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:35.818312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c79b8-1967-489c-9b2d-4e9b4f6975de admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2ef28fea57405191162c673ef041ab)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:35.822740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c79b8-1967-489c-9b2d-4e9b4f6975de admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:35.962297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-839c79b8-1967-489c-9b2d-4e9b4f6975de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2ef28fea57405191162c673ef041ab', 'request_id': 'req-839c79b8-1967-489c-9b2d-4e9b4f6975de'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:35.988615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-839c79b8-1967-489c-9b2d-4e9b4f6975de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2ef28fea57405191162c673ef041ab', 'request_id': 'req-839c79b8-1967-489c-9b2d-4e9b4f6975de'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:36.552240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-839c79b8-1967-489c-9b2d-4e9b4f6975de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2ef28fea57405191162c673ef041ab', 'request_id': 'req-839c79b8-1967-489c-9b2d-4e9b4f6975de'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:36.574026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-839c79b8-1967-489c-9b2d-4e9b4f6975de admin admin] The token cache is being invalidate because project 0b2ef28fea57405191162c673ef041ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:36.591903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-839c79b8-1967-489c-9b2d-4e9b4f6975de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:36.592194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-839c79b8-1967-489c-9b2d-4e9b4f6975de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:36.596303 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1624/3208] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:44:35 2022] DELETE /identity/v3/projects/0b2ef28fea57405191162c673ef041ab => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:36.601205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5aef2-f694-4b30-bd1a-547fd641a5c4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:36.602597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5aef2-f694-4b30-bd1a-547fd641a5c4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:36.602891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5aef2-f694-4b30-bd1a-547fd641a5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:36.634784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a8d5aef2-f694-4b30-bd1a-547fd641a5c4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:36.636496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a8d5aef2-f694-4b30-bd1a-547fd641a5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:36.756823 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1585/3209] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:36.766948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4630e1f-3f99-4344-84cc-37a8b9098fdd None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:36.767233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4630e1f-3f99-4344-84cc-37a8b9098fdd None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:36.767514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4630e1f-3f99-4344-84cc-37a8b9098fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:36.802825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f4630e1f-3f99-4344-84cc-37a8b9098fdd None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:36.804433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f4630e1f-3f99-4344-84cc-37a8b9098fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:36.818568 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1625/3210] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:36.823331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5aef2-f694-4b30-bd1a-547fd641a5c4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:36.836253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5aef2-f694-4b30-bd1a-547fd641a5c4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:36.863495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a42c91-359e-4d95-8872-35b5ddddd20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:36.864429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a42c91-359e-4d95-8872-35b5ddddd20f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:36.866151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a42c91-359e-4d95-8872-35b5ddddd20f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:36.867209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a42c91-359e-4d95-8872-35b5ddddd20f admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:36.869937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a42c91-359e-4d95-8872-35b5ddddd20f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:36.870514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a42c91-359e-4d95-8872-35b5ddddd20f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:36.889414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a42c91-359e-4d95-8872-35b5ddddd20f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:36.931281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4630e1f-3f99-4344-84cc-37a8b9098fdd None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:36.932032 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1586/3211] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:44:36.968875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4630e1f-3f99-4344-84cc-37a8b9098fdd None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:36.983575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01203d-db56-4050-a07e-d0a2250ffa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:36.984859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01203d-db56-4050-a07e-d0a2250ffa69 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:36.985145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01203d-db56-4050-a07e-d0a2250ffa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:36.985590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01203d-db56-4050-a07e-d0a2250ffa69 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:36.987434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01203d-db56-4050-a07e-d0a2250ffa69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:36.989329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01203d-db56-4050-a07e-d0a2250ffa69 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:37.100388 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1626/3212] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:44:36 2022] POST /identity/v3/projects => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:37.105909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a42c91-359e-4d95-8872-35b5ddddd20f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:37.116555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a42c91-359e-4d95-8872-35b5ddddd20f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:37.122441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:37.220900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f2551-8b2e-4404-824e-a0932cf4a544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:37.221607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f2551-8b2e-4404-824e-a0932cf4a544 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:37.222109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f2551-8b2e-4404-824e-a0932cf4a544 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:37.222498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f2551-8b2e-4404-824e-a0932cf4a544 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:37.223209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f2551-8b2e-4404-824e-a0932cf4a544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:37.227781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f2551-8b2e-4404-824e-a0932cf4a544 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:37.323055 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1587/3213] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:44:37 2022] POST /identity/v3/users => generated 284 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:37.325842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01203d-db56-4050-a07e-d0a2250ffa69 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:37.349780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01203d-db56-4050-a07e-d0a2250ffa69 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:37.362688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af535713-2848-4e7a-b2aa-4c7aee84801c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:37.363749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535713-2848-4e7a-b2aa-4c7aee84801c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:37.364029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535713-2848-4e7a-b2aa-4c7aee84801c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:37.364354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535713-2848-4e7a-b2aa-4c7aee84801c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:37.365107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af535713-2848-4e7a-b2aa-4c7aee84801c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:37.366815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af535713-2848-4e7a-b2aa-4c7aee84801c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:37.382003 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1627/3214] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:37.386677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f2551-8b2e-4404-824e-a0932cf4a544 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:37.397985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f2551-8b2e-4404-824e-a0932cf4a544 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:37.404317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddc0c8-3d51-4ffc-8798-0002409e1a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:37.404942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddc0c8-3d51-4ffc-8798-0002409e1a4a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:37.405220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddc0c8-3d51-4ffc-8798-0002409e1a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:37.405681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddc0c8-3d51-4ffc-8798-0002409e1a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:37.406538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddc0c8-3d51-4ffc-8798-0002409e1a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:37.408459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddc0c8-3d51-4ffc-8798-0002409e1a4a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:37.423856 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1588/3215] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:37.428093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af535713-2848-4e7a-b2aa-4c7aee84801c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:37.440646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af535713-2848-4e7a-b2aa-4c7aee84801c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:37.445937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069ab54-fad2-4922-862a-8e625d9d2668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:37.446610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069ab54-fad2-4922-862a-8e625d9d2668 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:37.446894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069ab54-fad2-4922-862a-8e625d9d2668 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:37.447164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069ab54-fad2-4922-862a-8e625d9d2668 admin admin] PATH_INFO: `/v3/projects/bc08332299ea49fe822f7501e09f92ef/users/40def5e61b2142e9b33b6c5aba059388/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:37.469143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069ab54-fad2-4922-862a-8e625d9d2668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc08332299ea49fe822f7501e09f92ef, user_id=40def5e61b2142e9b33b6c5aba059388, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:37.471914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069ab54-fad2-4922-862a-8e625d9d2668 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:37.562351 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1628/3216] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:44:37 2022] PUT /identity/v3/projects/bc08332299ea49fe822f7501e09f92ef/users/40def5e61b2142e9b33b6c5aba059388/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:37.567491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bd420-2f90-4c27-b5be-c578e033aaef None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:37.567732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bd420-2f90-4c27-b5be-c578e033aaef None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:37.568014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bd420-2f90-4c27-b5be-c578e033aaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:37.593993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-163bd420-2f90-4c27-b5be-c578e033aaef None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:37.597247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-163bd420-2f90-4c27-b5be-c578e033aaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:37.706338 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1589/3217] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:37.728306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069ab54-fad2-4922-862a-8e625d9d2668 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:37.730428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f069ab54-fad2-4922-862a-8e625d9d2668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:37.792972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:37.824472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069ab54-fad2-4922-862a-8e625d9d2668 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:37.830317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6463284-ecf1-42b2-9e9a-fa555b30cbd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:37.835195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6463284-ecf1-42b2-9e9a-fa555b30cbd2 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:37.835195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6463284-ecf1-42b2-9e9a-fa555b30cbd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:37.835195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6463284-ecf1-42b2-9e9a-fa555b30cbd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:37.843142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6463284-ecf1-42b2-9e9a-fa555b30cbd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:37.844851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6463284-ecf1-42b2-9e9a-fa555b30cbd2 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:37.857346 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1629/3218] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:41.180068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bd420-2f90-4c27-b5be-c578e033aaef None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:41.185680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-163bd420-2f90-4c27-b5be-c578e033aaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:41.214915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bd420-2f90-4c27-b5be-c578e033aaef None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:41.222860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae48a55-2991-471c-a08c-ec4fa8ce3798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:41.223452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae48a55-2991-471c-a08c-ec4fa8ce3798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:41.223738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae48a55-2991-471c-a08c-ec4fa8ce3798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:41.224016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae48a55-2991-471c-a08c-ec4fa8ce3798 admin admin] PATH_INFO: `/v3/users/a498ce4dafbd4ef69ee8fee961f83dc0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:41.225210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae48a55-2991-471c-a08c-ec4fa8ce3798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a498ce4dafbd4ef69ee8fee961f83dc0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:41.227731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae48a55-2991-471c-a08c-ec4fa8ce3798 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:41.497204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bae48a55-2991-471c-a08c-ec4fa8ce3798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a498ce4dafbd4ef69ee8fee961f83dc0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:41.554820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bae48a55-2991-471c-a08c-ec4fa8ce3798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a498ce4dafbd4ef69ee8fee961f83dc0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:41.555584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bae48a55-2991-471c-a08c-ec4fa8ce3798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a498ce4dafbd4ef69ee8fee961f83dc0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:41.578056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bae48a55-2991-471c-a08c-ec4fa8ce3798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a498ce4dafbd4ef69ee8fee961f83dc0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:41.613230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bae48a55-2991-471c-a08c-ec4fa8ce3798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a498ce4dafbd4ef69ee8fee961f83dc0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:41.617446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:41.628247 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1590/3219] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:44:41 2022] DELETE /identity/v3/users/a498ce4dafbd4ef69ee8fee961f83dc0 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:41.629842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cdbc1-2fae-47a2-975f-c82735ec31e8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:41.630329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cdbc1-2fae-47a2-975f-c82735ec31e8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:41.630436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cdbc1-2fae-47a2-975f-c82735ec31e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:41.661503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ab6cdbc1-2fae-47a2-975f-c82735ec31e8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:41.670576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ab6cdbc1-2fae-47a2-975f-c82735ec31e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:41.827840 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1630/3220] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:41.843678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae48a55-2991-471c-a08c-ec4fa8ce3798 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:41.851401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bae48a55-2991-471c-a08c-ec4fa8ce3798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:41.952852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae48a55-2991-471c-a08c-ec4fa8ce3798 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:41.957484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fed6a4-ebe3-48d4-8bf1-233289f4db9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:41.959170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fed6a4-ebe3-48d4-8bf1-233289f4db9d service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:41.959645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fed6a4-ebe3-48d4-8bf1-233289f4db9d service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:41.960108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fed6a4-ebe3-48d4-8bf1-233289f4db9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:41.974293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fed6a4-ebe3-48d4-8bf1-233289f4db9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:41.976360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fed6a4-ebe3-48d4-8bf1-233289f4db9d service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:41.993602 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1591/3221] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:42.543527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cdbc1-2fae-47a2-975f-c82735ec31e8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:42.545704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ab6cdbc1-2fae-47a2-975f-c82735ec31e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:42.569632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cdbc1-2fae-47a2-975f-c82735ec31e8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:42.599464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:42.600565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:42.602827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:42.603126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1 admin admin] PATH_INFO: `/v3/projects/c1b8a17e29c4436a9c51b4fc7b963822` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:42.608992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b8a17e29c4436a9c51b4fc7b963822)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:42.610936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:42.800936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b8a17e29c4436a9c51b4fc7b963822', 'request_id': 'req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:42.808107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b8a17e29c4436a9c51b4fc7b963822', 'request_id': 'req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:42.930427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b8a17e29c4436a9c51b4fc7b963822', 'request_id': 'req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:42.952755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1 admin admin] The token cache is being invalidate because project c1b8a17e29c4436a9c51b4fc7b963822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:42.953051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:42.954044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:42.955563 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1631/3222] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:44:42 2022] DELETE /identity/v3/projects/c1b8a17e29c4436a9c51b4fc7b963822 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:42.964185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fed6a4-ebe3-48d4-8bf1-233289f4db9d service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:42.989588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fed6a4-ebe3-48d4-8bf1-233289f4db9d service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:43.078765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59394a-1457-45c4-9cc4-9af418f7f18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:43.079808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59394a-1457-45c4-9cc4-9af418f7f18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:43.080092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59394a-1457-45c4-9cc4-9af418f7f18e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:43.080401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59394a-1457-45c4-9cc4-9af418f7f18e admin admin] PATH_INFO: `/v3/users/6706d1d062a44604aca55958a697cf6c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:43.082016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59394a-1457-45c4-9cc4-9af418f7f18e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6706d1d062a44604aca55958a697cf6c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:43.084176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59394a-1457-45c4-9cc4-9af418f7f18e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:43.318396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6f59394a-1457-45c4-9cc4-9af418f7f18e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6706d1d062a44604aca55958a697cf6c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:43.468242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6f59394a-1457-45c4-9cc4-9af418f7f18e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6706d1d062a44604aca55958a697cf6c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:43.470821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6f59394a-1457-45c4-9cc4-9af418f7f18e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6706d1d062a44604aca55958a697cf6c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:43.480704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6f59394a-1457-45c4-9cc4-9af418f7f18e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6706d1d062a44604aca55958a697cf6c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:43.522092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6f59394a-1457-45c4-9cc4-9af418f7f18e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6706d1d062a44604aca55958a697cf6c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:43.539122 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1592/3223] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:44:42 2022] DELETE /identity/v3/users/6706d1d062a44604aca55958a697cf6c => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:44.086913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:44.088788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:44.115914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a9746-9a5d-431a-8b26-b59b1bd116b1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:44.277037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:44.290861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008a124-ad6e-4844-97cb-c3897c7dce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:44.293003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008a124-ad6e-4844-97cb-c3897c7dce4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:44.293599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008a124-ad6e-4844-97cb-c3897c7dce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:44.294055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008a124-ad6e-4844-97cb-c3897c7dce4f admin admin] PATH_INFO: `/v3/projects/88ce1a9a88144d5aa9351054aa57af9a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:44.297842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008a124-ad6e-4844-97cb-c3897c7dce4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ce1a9a88144d5aa9351054aa57af9a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:44.301329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008a124-ad6e-4844-97cb-c3897c7dce4f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:44.459608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0008a124-ad6e-4844-97cb-c3897c7dce4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ce1a9a88144d5aa9351054aa57af9a', 'request_id': 'req-0008a124-ad6e-4844-97cb-c3897c7dce4f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:44.479698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0008a124-ad6e-4844-97cb-c3897c7dce4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ce1a9a88144d5aa9351054aa57af9a', 'request_id': 'req-0008a124-ad6e-4844-97cb-c3897c7dce4f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:44.575681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0008a124-ad6e-4844-97cb-c3897c7dce4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ce1a9a88144d5aa9351054aa57af9a', 'request_id': 'req-0008a124-ad6e-4844-97cb-c3897c7dce4f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:44.593545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0008a124-ad6e-4844-97cb-c3897c7dce4f admin admin] The token cache is being invalidate because project 88ce1a9a88144d5aa9351054aa57af9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:44.594074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0008a124-ad6e-4844-97cb-c3897c7dce4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:44.594864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0008a124-ad6e-4844-97cb-c3897c7dce4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:44.601212 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1632/3224] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:44:44 2022] DELETE /identity/v3/projects/88ce1a9a88144d5aa9351054aa57af9a => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:44.603876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e8299-e9f7-458e-b857-d49fb06f980b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:44.604794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e8299-e9f7-458e-b857-d49fb06f980b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:44.605244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e8299-e9f7-458e-b857-d49fb06f980b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:44.630317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-256e8299-e9f7-458e-b857-d49fb06f980b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:44.632091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-256e8299-e9f7-458e-b857-d49fb06f980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:44.655734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:44.735607 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1593/3225] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:44.737694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b201da9-c5b5-4737-b15f-bfa4f18f6b3b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:44.737694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b201da9-c5b5-4737-b15f-bfa4f18f6b3b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:44.737898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b201da9-c5b5-4737-b15f-bfa4f18f6b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:44.780391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1b201da9-c5b5-4737-b15f-bfa4f18f6b3b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:44.781624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1b201da9-c5b5-4737-b15f-bfa4f18f6b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:44.794493 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1633/3226] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:44.798492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e8299-e9f7-458e-b857-d49fb06f980b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:44.813079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e8299-e9f7-458e-b857-d49fb06f980b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:44.821456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156f357-13b5-42e2-94f2-8829c1393b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:44.822983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156f357-13b5-42e2-94f2-8829c1393b7c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:44.822983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156f357-13b5-42e2-94f2-8829c1393b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:44.823885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156f357-13b5-42e2-94f2-8829c1393b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:44.824892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156f357-13b5-42e2-94f2-8829c1393b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:44.825476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156f357-13b5-42e2-94f2-8829c1393b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:44.828718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156f357-13b5-42e2-94f2-8829c1393b7c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:44.849118 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1594/3227] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:44:44.853899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b201da9-c5b5-4737-b15f-bfa4f18f6b3b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:44.865317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b201da9-c5b5-4737-b15f-bfa4f18f6b3b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:44.874560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354307c-e6d6-4def-8cb9-c488952f9130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:44.875200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354307c-e6d6-4def-8cb9-c488952f9130 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:44.875484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354307c-e6d6-4def-8cb9-c488952f9130 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:44.875761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354307c-e6d6-4def-8cb9-c488952f9130 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:44.876433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354307c-e6d6-4def-8cb9-c488952f9130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:44.881728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354307c-e6d6-4def-8cb9-c488952f9130 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:45.018318 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1634/3228] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:44:44 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:45.022376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156f357-13b5-42e2-94f2-8829c1393b7c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:45.039135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156f357-13b5-42e2-94f2-8829c1393b7c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:45.145993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116d7bd-7ae8-4ed4-a453-ff56e03460a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:45.146669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116d7bd-7ae8-4ed4-a453-ff56e03460a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:45.146956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116d7bd-7ae8-4ed4-a453-ff56e03460a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:45.147241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116d7bd-7ae8-4ed4-a453-ff56e03460a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:45.148123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116d7bd-7ae8-4ed4-a453-ff56e03460a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:45.151723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116d7bd-7ae8-4ed4-a453-ff56e03460a3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:45.265428 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1595/3229] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:44:45 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:45.267075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354307c-e6d6-4def-8cb9-c488952f9130 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:45.279158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354307c-e6d6-4def-8cb9-c488952f9130 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:45.284343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ba84c-1d4a-4880-967f-0ff417957624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:45.288491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ba84c-1d4a-4880-967f-0ff417957624 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:45.288491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ba84c-1d4a-4880-967f-0ff417957624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:45.288491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ba84c-1d4a-4880-967f-0ff417957624 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:45.288491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ba84c-1d4a-4880-967f-0ff417957624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:45.288491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ba84c-1d4a-4880-967f-0ff417957624 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:45.309647 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1635/3230] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:45.310589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116d7bd-7ae8-4ed4-a453-ff56e03460a3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:45.330956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116d7bd-7ae8-4ed4-a453-ff56e03460a3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:45.343678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6d729-ccf4-4c57-a578-92b30f627f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:45.344713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6d729-ccf4-4c57-a578-92b30f627f17 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:45.346000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6d729-ccf4-4c57-a578-92b30f627f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:45.346552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6d729-ccf4-4c57-a578-92b30f627f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:45.348257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6d729-ccf4-4c57-a578-92b30f627f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:45.350893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6d729-ccf4-4c57-a578-92b30f627f17 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:45.372208 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1596/3231] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:45.376616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ba84c-1d4a-4880-967f-0ff417957624 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:45.411038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ba84c-1d4a-4880-967f-0ff417957624 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:45.428649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5e371-5c1f-414a-8e4b-25cde26170a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:45.430266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5e371-5c1f-414a-8e4b-25cde26170a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:45.430779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5e371-5c1f-414a-8e4b-25cde26170a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:45.431235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5e371-5c1f-414a-8e4b-25cde26170a7 admin admin] PATH_INFO: `/v3/projects/93e3e7ec15b6423d9e3ca3063e00f607/users/c06b45e7beaf458eafb6470351b22f91/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:45.476287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5e371-5c1f-414a-8e4b-25cde26170a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e3e7ec15b6423d9e3ca3063e00f607, user_id=c06b45e7beaf458eafb6470351b22f91, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:45.480105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5e371-5c1f-414a-8e4b-25cde26170a7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:45.618331 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1636/3232] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:44:45 2022] PUT /identity/v3/projects/93e3e7ec15b6423d9e3ca3063e00f607/users/c06b45e7beaf458eafb6470351b22f91/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:45.630446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcfe60-8e9a-4f70-9f16-aa911fc32bf7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:45.630960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcfe60-8e9a-4f70-9f16-aa911fc32bf7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:45.631509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcfe60-8e9a-4f70-9f16-aa911fc32bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:45.716499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-cdbcfe60-8e9a-4f70-9f16-aa911fc32bf7 None None] MFA Rules not processed for user `c06b45e7beaf458eafb6470351b22f91`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:45.725464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cdbcfe60-8e9a-4f70-9f16-aa911fc32bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:45.903283 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1597/3233] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:45.906947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5e371-5c1f-414a-8e4b-25cde26170a7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:46.062410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5e371-5c1f-414a-8e4b-25cde26170a7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:46.078354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40e4a9-f510-4215-aa5b-3873e4d6a8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:46.079425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40e4a9-f510-4215-aa5b-3873e4d6a8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:46.081149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40e4a9-f510-4215-aa5b-3873e4d6a8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:46.082850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40e4a9-f510-4215-aa5b-3873e4d6a8c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:46.084839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40e4a9-f510-4215-aa5b-3873e4d6a8c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:46.089403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40e4a9-f510-4215-aa5b-3873e4d6a8c3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:46.237185 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1637/3234] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:44:45 2022] POST /identity/v3/projects => generated 377 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:46.237555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcfe60-8e9a-4f70-9f16-aa911fc32bf7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:46.259605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcfe60-8e9a-4f70-9f16-aa911fc32bf7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:46.339357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:46.395350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90a8af-b0d3-425a-b161-daef7225a775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:46.396827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90a8af-b0d3-425a-b161-daef7225a775 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:46.399425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90a8af-b0d3-425a-b161-daef7225a775 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:46.402540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90a8af-b0d3-425a-b161-daef7225a775 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:46.406170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90a8af-b0d3-425a-b161-daef7225a775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:46.409140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90a8af-b0d3-425a-b161-daef7225a775 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:46.544182 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1598/3235] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:44:46 2022] POST /identity/v3/users => generated 295 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:44:46.548405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40e4a9-f510-4215-aa5b-3873e4d6a8c3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:46.557080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:46.566938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40e4a9-f510-4215-aa5b-3873e4d6a8c3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:46.584552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d19058-3079-4796-9d65-6934c0c0a9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:46.585414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d19058-3079-4796-9d65-6934c0c0a9dc admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:46.587176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d19058-3079-4796-9d65-6934c0c0a9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:46.587620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d19058-3079-4796-9d65-6934c0c0a9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:46.589198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d19058-3079-4796-9d65-6934c0c0a9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:46.593521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d19058-3079-4796-9d65-6934c0c0a9dc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:46.624317 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1638/3236] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:46.625700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90a8af-b0d3-425a-b161-daef7225a775 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:46.645727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90a8af-b0d3-425a-b161-daef7225a775 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:46.659670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81822d95-2604-43a9-90b0-9bc57623e7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:46.660706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81822d95-2604-43a9-90b0-9bc57623e7aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:46.661865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81822d95-2604-43a9-90b0-9bc57623e7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:46.662954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81822d95-2604-43a9-90b0-9bc57623e7aa admin admin] PATH_INFO: `/v3/projects/ffd1a024ffaa4365900209f4a9275207/users/c5bc1eb1f56d498da7668b3baab7787c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:46.700262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81822d95-2604-43a9-90b0-9bc57623e7aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd1a024ffaa4365900209f4a9275207, user_id=c5bc1eb1f56d498da7668b3baab7787c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:46.709648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81822d95-2604-43a9-90b0-9bc57623e7aa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:46.816545 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1599/3237] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:44:46 2022] PUT /identity/v3/projects/ffd1a024ffaa4365900209f4a9275207/users/c5bc1eb1f56d498da7668b3baab7787c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:46.821494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d19058-3079-4796-9d65-6934c0c0a9dc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:46.837088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d19058-3079-4796-9d65-6934c0c0a9dc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:46.982748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e25ad-d069-472a-ba06-823b8c70a1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:46.984829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e25ad-d069-472a-ba06-823b8c70a1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:46.985300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e25ad-d069-472a-ba06-823b8c70a1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:46.987055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e25ad-d069-472a-ba06-823b8c70a1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:46.988130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e25ad-d069-472a-ba06-823b8c70a1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:47.004190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e25ad-d069-472a-ba06-823b8c70a1d1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:47.031784 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1639/3238] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:47.035093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81822d95-2604-43a9-90b0-9bc57623e7aa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:47.050084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81822d95-2604-43a9-90b0-9bc57623e7aa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:47.065933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17abd1b-d757-4818-8774-458991c46e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:47.066623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17abd1b-d757-4818-8774-458991c46e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:47.066902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17abd1b-d757-4818-8774-458991c46e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:47.067175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17abd1b-d757-4818-8774-458991c46e4c admin admin] PATH_INFO: `/v3/projects/ffd1a024ffaa4365900209f4a9275207/users/c5bc1eb1f56d498da7668b3baab7787c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:47.073880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17abd1b-d757-4818-8774-458991c46e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd1a024ffaa4365900209f4a9275207, user_id=c5bc1eb1f56d498da7668b3baab7787c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:47.078600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17abd1b-d757-4818-8774-458991c46e4c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:47.108187 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1600/3239] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:44:47 2022] PUT /identity/v3/projects/ffd1a024ffaa4365900209f4a9275207/users/c5bc1eb1f56d498da7668b3baab7787c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:47.120497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ce45f-31ef-4d1b-8c0e-60ff5f57359c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:47.120893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ce45f-31ef-4d1b-8c0e-60ff5f57359c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:47.121175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ce45f-31ef-4d1b-8c0e-60ff5f57359c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:47.180999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0d5ce45f-31ef-4d1b-8c0e-60ff5f57359c None None] MFA Rules not processed for user `c5bc1eb1f56d498da7668b3baab7787c`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:47.185269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0d5ce45f-31ef-4d1b-8c0e-60ff5f57359c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:47.351214 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1640/3240] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:47.545524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17abd1b-d757-4818-8774-458991c46e4c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:47.554281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c17abd1b-d757-4818-8774-458991c46e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:47.829365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17abd1b-d757-4818-8774-458991c46e4c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:47.847244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c00547-5b2e-4f31-aa39-b94cc6e83529 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:47.848041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c00547-5b2e-4f31-aa39-b94cc6e83529 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:47.848606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c00547-5b2e-4f31-aa39-b94cc6e83529 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:47.848949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c00547-5b2e-4f31-aa39-b94cc6e83529 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:47.871658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c00547-5b2e-4f31-aa39-b94cc6e83529 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:47.896607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c00547-5b2e-4f31-aa39-b94cc6e83529 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:47.929251 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1601/3241] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:44:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:48.497323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ce45f-31ef-4d1b-8c0e-60ff5f57359c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:48.707804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5aeb0-f124-4033-bc47-2eddb44fdb3e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:48.708515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5aeb0-f124-4033-bc47-2eddb44fdb3e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:48.709217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5aeb0-f124-4033-bc47-2eddb44fdb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:48.737523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ce45f-31ef-4d1b-8c0e-60ff5f57359c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:48.753986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a398d-a04f-40fe-84ac-87ea991c2278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:48.756268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a398d-a04f-40fe-84ac-87ea991c2278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:48.757111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a398d-a04f-40fe-84ac-87ea991c2278 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:48.759406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a398d-a04f-40fe-84ac-87ea991c2278 admin admin] PATH_INFO: `/v3/users/c06b45e7beaf458eafb6470351b22f91` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:48.761498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a398d-a04f-40fe-84ac-87ea991c2278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c06b45e7beaf458eafb6470351b22f91)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:48.764122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a398d-a04f-40fe-84ac-87ea991c2278 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:48.799383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6bd5aeb0-f124-4033-bc47-2eddb44fdb3e None None] MFA Rules not processed for user `40def5e61b2142e9b33b6c5aba059388`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:48.802823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6bd5aeb0-f124-4033-bc47-2eddb44fdb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:48.817142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:49.009144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:49.068202 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1602/3242] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:49.120657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2a9a398d-a04f-40fe-84ac-87ea991c2278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c06b45e7beaf458eafb6470351b22f91'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:49.122254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2a9a398d-a04f-40fe-84ac-87ea991c2278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c06b45e7beaf458eafb6470351b22f91'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:49.149157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5aeb0-f124-4033-bc47-2eddb44fdb3e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:49.185431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5aeb0-f124-4033-bc47-2eddb44fdb3e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:49.204311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2a9a398d-a04f-40fe-84ac-87ea991c2278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c06b45e7beaf458eafb6470351b22f91'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:49.205379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2a9a398d-a04f-40fe-84ac-87ea991c2278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c06b45e7beaf458eafb6470351b22f91'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:49.207229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a52c8d-c06d-49ad-b956-51c85040e3f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:49.208655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a52c8d-c06d-49ad-b956-51c85040e3f2 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:49.208655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a52c8d-c06d-49ad-b956-51c85040e3f2 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:49.209046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a52c8d-c06d-49ad-b956-51c85040e3f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:49.219253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-71a52c8d-c06d-49ad-b956-51c85040e3f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:49.245763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a52c8d-c06d-49ad-b956-51c85040e3f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:49.251095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a52c8d-c06d-49ad-b956-51c85040e3f2 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:49.263254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2a9a398d-a04f-40fe-84ac-87ea991c2278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c06b45e7beaf458eafb6470351b22f91'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:49.306613 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1603/3243] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:44:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:44:49.334260 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1641/3244] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:44:48 2022] DELETE /identity/v3/users/c06b45e7beaf458eafb6470351b22f91 => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:49.336611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faad77-91f2-472a-883e-b95106cddeda None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:49.337341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faad77-91f2-472a-883e-b95106cddeda None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:49.337848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3faad77-91f2-472a-883e-b95106cddeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:49.397829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e3faad77-91f2-472a-883e-b95106cddeda None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:49.400099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e3faad77-91f2-472a-883e-b95106cddeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:49.598324 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1604/3245] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:49.617738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a398d-a04f-40fe-84ac-87ea991c2278 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:49.625103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2a9a398d-a04f-40fe-84ac-87ea991c2278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:49.731743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a398d-a04f-40fe-84ac-87ea991c2278 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:49.737215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dce0e9-6d7c-420a-9d79-45cbbc180d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:49.738152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dce0e9-6d7c-420a-9d79-45cbbc180d3f service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:49.738590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dce0e9-6d7c-420a-9d79-45cbbc180d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:49.739074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dce0e9-6d7c-420a-9d79-45cbbc180d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:49.753152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dce0e9-6d7c-420a-9d79-45cbbc180d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:49.756046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dce0e9-6d7c-420a-9d79-45cbbc180d3f service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:49.787262 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1642/3246] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:51.667792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3faad77-91f2-472a-883e-b95106cddeda None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:51.671102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e3faad77-91f2-472a-883e-b95106cddeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:51.707903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3faad77-91f2-472a-883e-b95106cddeda None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:51.726688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ae62c-9a57-404d-818f-a873076fb8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:51.727411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ae62c-9a57-404d-818f-a873076fb8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:51.743118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ae62c-9a57-404d-818f-a873076fb8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:51.743747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ae62c-9a57-404d-818f-a873076fb8d8 admin admin] PATH_INFO: `/v3/projects/93e3e7ec15b6423d9e3ca3063e00f607` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:51.746927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ae62c-9a57-404d-818f-a873076fb8d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93e3e7ec15b6423d9e3ca3063e00f607)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:51.750714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ae62c-9a57-404d-818f-a873076fb8d8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:51.952388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aa6ae62c-9a57-404d-818f-a873076fb8d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93e3e7ec15b6423d9e3ca3063e00f607', 'request_id': 'req-aa6ae62c-9a57-404d-818f-a873076fb8d8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:51.970032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aa6ae62c-9a57-404d-818f-a873076fb8d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93e3e7ec15b6423d9e3ca3063e00f607', 'request_id': 'req-aa6ae62c-9a57-404d-818f-a873076fb8d8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:51.995168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aa6ae62c-9a57-404d-818f-a873076fb8d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93e3e7ec15b6423d9e3ca3063e00f607', 'request_id': 'req-aa6ae62c-9a57-404d-818f-a873076fb8d8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:52.085751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aa6ae62c-9a57-404d-818f-a873076fb8d8 admin admin] The token cache is being invalidate because project 93e3e7ec15b6423d9e3ca3063e00f607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:52.086421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aa6ae62c-9a57-404d-818f-a873076fb8d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:52.090174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aa6ae62c-9a57-404d-818f-a873076fb8d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:52.092579 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1605/3247] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:44:51 2022] DELETE /identity/v3/projects/93e3e7ec15b6423d9e3ca3063e00f607 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:52.096580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dce0e9-6d7c-420a-9d79-45cbbc180d3f service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:52.110118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dce0e9-6d7c-420a-9d79-45cbbc180d3f service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:52.205858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640e7d5-3eec-4538-b598-f19e568e208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:52.206551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640e7d5-3eec-4538-b598-f19e568e208d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:52.206999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640e7d5-3eec-4538-b598-f19e568e208d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:52.207346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640e7d5-3eec-4538-b598-f19e568e208d admin admin] PATH_INFO: `/v3/users/c5bc1eb1f56d498da7668b3baab7787c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:52.209775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a640e7d5-3eec-4538-b598-f19e568e208d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5bc1eb1f56d498da7668b3baab7787c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:52.212862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a640e7d5-3eec-4538-b598-f19e568e208d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:52.537474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:52.557799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a640e7d5-3eec-4538-b598-f19e568e208d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5bc1eb1f56d498da7668b3baab7787c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:52.559613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a640e7d5-3eec-4538-b598-f19e568e208d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5bc1eb1f56d498da7668b3baab7787c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:52.663997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a640e7d5-3eec-4538-b598-f19e568e208d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5bc1eb1f56d498da7668b3baab7787c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:52.666893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c8fc5-22a2-4d33-9a0b-d324d27e9b09 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:52.671096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a640e7d5-3eec-4538-b598-f19e568e208d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5bc1eb1f56d498da7668b3baab7787c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:52.671725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c8fc5-22a2-4d33-9a0b-d324d27e9b09 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:52.671725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c8fc5-22a2-4d33-9a0b-d324d27e9b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:52.706297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a640e7d5-3eec-4538-b598-f19e568e208d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5bc1eb1f56d498da7668b3baab7787c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:52.728741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-900c8fc5-22a2-4d33-9a0b-d324d27e9b09 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:52.735415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-900c8fc5-22a2-4d33-9a0b-d324d27e9b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:52.762857 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1643/3248] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:44:52 2022] DELETE /identity/v3/users/c5bc1eb1f56d498da7668b3baab7787c => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:52.901200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:52.929731 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1606/3249] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:44:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:52.948140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640e7d5-3eec-4538-b598-f19e568e208d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:52.949792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a640e7d5-3eec-4538-b598-f19e568e208d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:53.117752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640e7d5-3eec-4538-b598-f19e568e208d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:53.129675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bc9fc-3e71-489b-8766-e5717abfa81b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:53.130258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bc9fc-3e71-489b-8766-e5717abfa81b service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:53.130530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bc9fc-3e71-489b-8766-e5717abfa81b service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:53.130894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bc9fc-3e71-489b-8766-e5717abfa81b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:53.255748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bc9fc-3e71-489b-8766-e5717abfa81b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:53.255748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bc9fc-3e71-489b-8766-e5717abfa81b service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:53.272580 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1644/3250] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:44:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:54.821914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c8fc5-22a2-4d33-9a0b-d324d27e9b09 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:54.824991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-900c8fc5-22a2-4d33-9a0b-d324d27e9b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:54.920407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c8fc5-22a2-4d33-9a0b-d324d27e9b09 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:55.143398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b17f2-4b3c-44c0-9ef1-eb46ee979917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:55.145431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b17f2-4b3c-44c0-9ef1-eb46ee979917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:55.146769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b17f2-4b3c-44c0-9ef1-eb46ee979917 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:55.148792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b17f2-4b3c-44c0-9ef1-eb46ee979917 admin admin] PATH_INFO: `/v3/projects/ffd1a024ffaa4365900209f4a9275207` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:55.153792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b17f2-4b3c-44c0-9ef1-eb46ee979917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd1a024ffaa4365900209f4a9275207)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:55.160522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b17f2-4b3c-44c0-9ef1-eb46ee979917 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:55.388771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-634b17f2-4b3c-44c0-9ef1-eb46ee979917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd1a024ffaa4365900209f4a9275207', 'request_id': 'req-634b17f2-4b3c-44c0-9ef1-eb46ee979917'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:55.405302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-634b17f2-4b3c-44c0-9ef1-eb46ee979917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd1a024ffaa4365900209f4a9275207', 'request_id': 'req-634b17f2-4b3c-44c0-9ef1-eb46ee979917'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:55.417655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-634b17f2-4b3c-44c0-9ef1-eb46ee979917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd1a024ffaa4365900209f4a9275207', 'request_id': 'req-634b17f2-4b3c-44c0-9ef1-eb46ee979917'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:55.536457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-634b17f2-4b3c-44c0-9ef1-eb46ee979917 admin admin] The token cache is being invalidate because project ffd1a024ffaa4365900209f4a9275207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:55.536786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-634b17f2-4b3c-44c0-9ef1-eb46ee979917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:55.538419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-634b17f2-4b3c-44c0-9ef1-eb46ee979917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:55.543171 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1607/3251] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:44:54 2022] DELETE /identity/v3/projects/ffd1a024ffaa4365900209f4a9275207 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:55.550024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064c781-1c19-4ca3-b521-846e79b0f18e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:55.551374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064c781-1c19-4ca3-b521-846e79b0f18e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:55.551932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064c781-1c19-4ca3-b521-846e79b0f18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:55.636575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c064c781-1c19-4ca3-b521-846e79b0f18e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:55.641738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c064c781-1c19-4ca3-b521-846e79b0f18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:55.705888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc5efb-da8f-41d4-b335-75b8145450b4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:55.705888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc5efb-da8f-41d4-b335-75b8145450b4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:55.705888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc5efb-da8f-41d4-b335-75b8145450b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:55.741383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:55.753718 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1645/3252] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:55.760589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-fcfc5efb-da8f-41d4-b335-75b8145450b4 None None] MFA Rules not processed for user `40def5e61b2142e9b33b6c5aba059388`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:55.768835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fcfc5efb-da8f-41d4-b335-75b8145450b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:55.769007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26359bed-eba6-4b77-8fd4-3b025efd520e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:55.769007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26359bed-eba6-4b77-8fd4-3b025efd520e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:55.769007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26359bed-eba6-4b77-8fd4-3b025efd520e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:55.862851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-26359bed-eba6-4b77-8fd4-3b025efd520e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:55.866440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-26359bed-eba6-4b77-8fd4-3b025efd520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:55.976971 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1608/3253] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:55.984048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc5efb-da8f-41d4-b335-75b8145450b4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:56.000074 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1646/3254] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:56.003370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26359bed-eba6-4b77-8fd4-3b025efd520e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:56.005916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fcfc5efb-da8f-41d4-b335-75b8145450b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:56.048708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26359bed-eba6-4b77-8fd4-3b025efd520e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:56.071556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc4d0d-b6ca-4d55-a914-b3a08da1b56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:56.072202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc4d0d-b6ca-4d55-a914-b3a08da1b56f admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:56.072484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc4d0d-b6ca-4d55-a914-b3a08da1b56f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:56.072752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc4d0d-b6ca-4d55-a914-b3a08da1b56f admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:56.073411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc4d0d-b6ca-4d55-a914-b3a08da1b56f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:56.073710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc4d0d-b6ca-4d55-a914-b3a08da1b56f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:56.088914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc4d0d-b6ca-4d55-a914-b3a08da1b56f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:56.161707 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1647/3255] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:44:56.169323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc4d0d-b6ca-4d55-a914-b3a08da1b56f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:56.196662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d8fc4d0d-b6ca-4d55-a914-b3a08da1b56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:56.221550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:56.258596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc4d0d-b6ca-4d55-a914-b3a08da1b56f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:56.291011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97212cb1-75b9-4280-80f4-7ec0be6e15cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:56.292062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97212cb1-75b9-4280-80f4-7ec0be6e15cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:56.292379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97212cb1-75b9-4280-80f4-7ec0be6e15cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:56.293051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97212cb1-75b9-4280-80f4-7ec0be6e15cf admin admin] PATH_INFO: `/v3/users/6a748d5fb1964482a0de820de06260da` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:56.295239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97212cb1-75b9-4280-80f4-7ec0be6e15cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a748d5fb1964482a0de820de06260da)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:56.298027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97212cb1-75b9-4280-80f4-7ec0be6e15cf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:56.339094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc5efb-da8f-41d4-b335-75b8145450b4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:56.357357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb60e1-81d6-4db9-ab7f-f24d10d13fe7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:56.358537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb60e1-81d6-4db9-ab7f-f24d10d13fe7 service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:56.358537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb60e1-81d6-4db9-ab7f-f24d10d13fe7 service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:56.361175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb60e1-81d6-4db9-ab7f-f24d10d13fe7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:56.369316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4dbb60e1-81d6-4db9-ab7f-f24d10d13fe7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:56.400721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb60e1-81d6-4db9-ab7f-f24d10d13fe7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:56.403220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb60e1-81d6-4db9-ab7f-f24d10d13fe7 service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:56.443872 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1609/3256] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:44:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:44:56.444899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb60e1-81d6-4db9-ab7f-f24d10d13fe7 service placement] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:56.482357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb60e1-81d6-4db9-ab7f-f24d10d13fe7 service placement] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:56.495896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e910c19-565c-4026-b1e2-bc771801d187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:56.496584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e910c19-565c-4026-b1e2-bc771801d187 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:56.496863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e910c19-565c-4026-b1e2-bc771801d187 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:56.497136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e910c19-565c-4026-b1e2-bc771801d187 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:56.497791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e910c19-565c-4026-b1e2-bc771801d187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:56.501852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e910c19-565c-4026-b1e2-bc771801d187 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:56.622643 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1610/3257] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:44:56 2022] POST /identity/v3/projects => generated 393 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:56.628533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e910c19-565c-4026-b1e2-bc771801d187 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:56.675890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-97212cb1-75b9-4280-80f4-7ec0be6e15cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a748d5fb1964482a0de820de06260da'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:56.677208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-97212cb1-75b9-4280-80f4-7ec0be6e15cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a748d5fb1964482a0de820de06260da'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:56.740541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e910c19-565c-4026-b1e2-bc771801d187 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:56.746760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fcc98-c7e0-423a-8c88-68581352aac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:56.753799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fcc98-c7e0-423a-8c88-68581352aac2 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:56.753799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fcc98-c7e0-423a-8c88-68581352aac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:56.753799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fcc98-c7e0-423a-8c88-68581352aac2 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:56.753799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fcc98-c7e0-423a-8c88-68581352aac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:56.753799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fcc98-c7e0-423a-8c88-68581352aac2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:56.832741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-97212cb1-75b9-4280-80f4-7ec0be6e15cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a748d5fb1964482a0de820de06260da'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:56.833380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-97212cb1-75b9-4280-80f4-7ec0be6e15cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a748d5fb1964482a0de820de06260da'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:56.871555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-97212cb1-75b9-4280-80f4-7ec0be6e15cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a748d5fb1964482a0de820de06260da'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:56.873911 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1611/3258] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:44:56 2022] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:56.880002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fcc98-c7e0-423a-8c88-68581352aac2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:56.887216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d77fcc98-c7e0-423a-8c88-68581352aac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:56.905214 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1648/3259] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:44:56 2022] DELETE /identity/v3/users/6a748d5fb1964482a0de820de06260da => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:56.952369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fcc98-c7e0-423a-8c88-68581352aac2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:57.096595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3a696-d833-4730-955b-5d0be52235c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:57.098321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3a696-d833-4730-955b-5d0be52235c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:57.098512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3a696-d833-4730-955b-5d0be52235c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:57.098793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3a696-d833-4730-955b-5d0be52235c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:57.115024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3a696-d833-4730-955b-5d0be52235c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:57.117419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3a696-d833-4730-955b-5d0be52235c3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:57.134009 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1612/3260] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:57.138104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97212cb1-75b9-4280-80f4-7ec0be6e15cf admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:57.153186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97212cb1-75b9-4280-80f4-7ec0be6e15cf admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:57.162219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f08586-7233-4dd0-9d84-15e961225ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:57.163830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f08586-7233-4dd0-9d84-15e961225ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:57.165505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f08586-7233-4dd0-9d84-15e961225ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:57.166213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f08586-7233-4dd0-9d84-15e961225ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:57.167132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f08586-7233-4dd0-9d84-15e961225ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:57.168998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f08586-7233-4dd0-9d84-15e961225ff9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:57.189290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3a696-d833-4730-955b-5d0be52235c3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:57.201386 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1649/3261] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:57.201909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3a696-d833-4730-955b-5d0be52235c3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:57.210072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f5ed8-dabb-41e7-93fa-6a7d0d535e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:57.211583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f5ed8-dabb-41e7-93fa-6a7d0d535e1a admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:57.221006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f5ed8-dabb-41e7-93fa-6a7d0d535e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:57.221006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f5ed8-dabb-41e7-93fa-6a7d0d535e1a admin admin] PATH_INFO: `/v3/projects/5312a0924666461dbcab3046927c0113/users/71d6fe2178594cdaa5b910dd0e181f3d/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:57.273117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f5ed8-dabb-41e7-93fa-6a7d0d535e1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5312a0924666461dbcab3046927c0113, user_id=71d6fe2178594cdaa5b910dd0e181f3d, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:57.284396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f5ed8-dabb-41e7-93fa-6a7d0d535e1a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:57.413888 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1613/3262] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:44:57 2022] PUT /identity/v3/projects/5312a0924666461dbcab3046927c0113/users/71d6fe2178594cdaa5b910dd0e181f3d/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:57.419670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66678f-fde9-4928-a78a-0a32981d523b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:57.420449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66678f-fde9-4928-a78a-0a32981d523b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:57.420981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66678f-fde9-4928-a78a-0a32981d523b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:57.477494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2f66678f-fde9-4928-a78a-0a32981d523b None None] MFA Rules not processed for user `71d6fe2178594cdaa5b910dd0e181f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:57.479080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2f66678f-fde9-4928-a78a-0a32981d523b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:57.531735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f5ed8-dabb-41e7-93fa-6a7d0d535e1a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:57.533693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a10f5ed8-dabb-41e7-93fa-6a7d0d535e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:57.609933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:57.709818 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1650/3263] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:57.714300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66678f-fde9-4928-a78a-0a32981d523b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:57.769093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:57.773198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f5ed8-dabb-41e7-93fa-6a7d0d535e1a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:57.795540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5a94e-1471-4a87-ab4e-13756572f82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:57.813036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5a94e-1471-4a87-ab4e-13756572f82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:57.814580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5a94e-1471-4a87-ab4e-13756572f82c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:57.815565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5a94e-1471-4a87-ab4e-13756572f82c admin admin] PATH_INFO: `/v3/projects/b6a23c895331412bb3665a23309ac67e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:57.817984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5a94e-1471-4a87-ab4e-13756572f82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a23c895331412bb3665a23309ac67e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:57.829737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66678f-fde9-4928-a78a-0a32981d523b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:57.836397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5a94e-1471-4a87-ab4e-13756572f82c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:57.837268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f96b2e-a5d5-44d5-be2a-3aa27fbce828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:57.838117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f96b2e-a5d5-44d5-be2a-3aa27fbce828 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:57.838471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f96b2e-a5d5-44d5-be2a-3aa27fbce828 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:57.838836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f96b2e-a5d5-44d5-be2a-3aa27fbce828 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:57.839724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f96b2e-a5d5-44d5-be2a-3aa27fbce828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:57.844802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f96b2e-a5d5-44d5-be2a-3aa27fbce828 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:58.015829 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1651/3264] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:44:57 2022] POST /identity/v3/projects => generated 393 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:58.021333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f96b2e-a5d5-44d5-be2a-3aa27fbce828 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:58.055253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-61a5a94e-1471-4a87-ab4e-13756572f82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a23c895331412bb3665a23309ac67e', 'request_id': 'req-61a5a94e-1471-4a87-ab4e-13756572f82c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:58.076279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-61a5a94e-1471-4a87-ab4e-13756572f82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a23c895331412bb3665a23309ac67e', 'request_id': 'req-61a5a94e-1471-4a87-ab4e-13756572f82c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:58.097762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-61a5a94e-1471-4a87-ab4e-13756572f82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a23c895331412bb3665a23309ac67e', 'request_id': 'req-61a5a94e-1471-4a87-ab4e-13756572f82c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:58.196855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-61a5a94e-1471-4a87-ab4e-13756572f82c admin admin] The token cache is being invalidate because project b6a23c895331412bb3665a23309ac67e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:44:58.197216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-61a5a94e-1471-4a87-ab4e-13756572f82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:58.197869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-61a5a94e-1471-4a87-ab4e-13756572f82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:44:58.208592 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1614/3265] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:44:57 2022] DELETE /identity/v3/projects/b6a23c895331412bb3665a23309ac67e => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:44:58.216580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d290b-cb0e-4349-853a-03813fe1d46b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:58.218031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d290b-cb0e-4349-853a-03813fe1d46b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:58.218031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d290b-cb0e-4349-853a-03813fe1d46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:58.286845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f96b2e-a5d5-44d5-be2a-3aa27fbce828 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:58.290450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d92d290b-cb0e-4349-853a-03813fe1d46b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:58.300117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d92d290b-cb0e-4349-853a-03813fe1d46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:58.304785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc0b59-5b64-41a3-88c5-f2b700cf7ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:58.306059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc0b59-5b64-41a3-88c5-f2b700cf7ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:58.306990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc0b59-5b64-41a3-88c5-f2b700cf7ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:58.307269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc0b59-5b64-41a3-88c5-f2b700cf7ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:58.309661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc0b59-5b64-41a3-88c5-f2b700cf7ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:58.311318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc0b59-5b64-41a3-88c5-f2b700cf7ee0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:58.318639 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1615/3266] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:58.328384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b4e83-f4ee-4ebf-8273-b6b254f9c3a1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:58.338762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b4e83-f4ee-4ebf-8273-b6b254f9c3a1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:58.338762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b4e83-f4ee-4ebf-8273-b6b254f9c3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:58.358682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-053b4e83-f4ee-4ebf-8273-b6b254f9c3a1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:58.371566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-053b4e83-f4ee-4ebf-8273-b6b254f9c3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:58.407923 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1616/3267] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:44:58.418885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b4e83-f4ee-4ebf-8273-b6b254f9c3a1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:58.439325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b4e83-f4ee-4ebf-8273-b6b254f9c3a1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:58.445842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc376ab0-989f-4f43-90d9-3b0f96da024f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:58.446664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc376ab0-989f-4f43-90d9-3b0f96da024f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:58.451136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc376ab0-989f-4f43-90d9-3b0f96da024f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:58.451136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc376ab0-989f-4f43-90d9-3b0f96da024f admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:58.451136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc376ab0-989f-4f43-90d9-3b0f96da024f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:44:58.451136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc376ab0-989f-4f43-90d9-3b0f96da024f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:58.451136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc376ab0-989f-4f43-90d9-3b0f96da024f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:58.464239 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1617/3268] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:44:58.468950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc376ab0-989f-4f43-90d9-3b0f96da024f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:58.475178 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1652/3269] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:44:58 2022] POST /identity/v3/users => generated 303 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:58.480683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc0b59-5b64-41a3-88c5-f2b700cf7ee0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:58.481896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc376ab0-989f-4f43-90d9-3b0f96da024f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:58.483143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e7fc0b59-5b64-41a3-88c5-f2b700cf7ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:58.486919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1da47-687e-47c1-805a-2e6bbf49588e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:58.487538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1da47-687e-47c1-805a-2e6bbf49588e admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:58.487815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1da47-687e-47c1-805a-2e6bbf49588e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:58.488331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1da47-687e-47c1-805a-2e6bbf49588e admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:58.488971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1da47-687e-47c1-805a-2e6bbf49588e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:58.499489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1da47-687e-47c1-805a-2e6bbf49588e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:58.529085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc0b59-5b64-41a3-88c5-f2b700cf7ee0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:58.534635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937021a-97e2-4fe5-844a-7c158e1e4ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:58.535490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937021a-97e2-4fe5-844a-7c158e1e4ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:58.535930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937021a-97e2-4fe5-844a-7c158e1e4ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:58.536390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937021a-97e2-4fe5-844a-7c158e1e4ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:58.537208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937021a-97e2-4fe5-844a-7c158e1e4ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:58.539533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937021a-97e2-4fe5-844a-7c158e1e4ea9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:58.552526 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1653/3270] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:58.556899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937021a-97e2-4fe5-844a-7c158e1e4ea9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:58.568293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937021a-97e2-4fe5-844a-7c158e1e4ea9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:58.586838 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1618/3271] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:44:58 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:58.589217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfbccd-dc99-495a-bba9-4c03df873435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:58.590869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1da47-687e-47c1-805a-2e6bbf49588e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:58.591738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfbccd-dc99-495a-bba9-4c03df873435 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:58.593286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfbccd-dc99-495a-bba9-4c03df873435 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:58.594178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfbccd-dc99-495a-bba9-4c03df873435 admin admin] PATH_INFO: `/v3/projects/0638d5eae53b42bbb40af7b40b08b6cb/users/ae80f67a229d466abdb0943c4a4e75bd/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:58.647108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfbccd-dc99-495a-bba9-4c03df873435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0638d5eae53b42bbb40af7b40b08b6cb, user_id=ae80f67a229d466abdb0943c4a4e75bd, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:58.657065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfbccd-dc99-495a-bba9-4c03df873435 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:58.708866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:58.733604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1da47-687e-47c1-805a-2e6bbf49588e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:58.743334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfc19a-03a8-4a3e-a8cd-57f5d38c085b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:58.756440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfc19a-03a8-4a3e-a8cd-57f5d38c085b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:58.756440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfc19a-03a8-4a3e-a8cd-57f5d38c085b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:58.756440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfc19a-03a8-4a3e-a8cd-57f5d38c085b admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:58.756440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfc19a-03a8-4a3e-a8cd-57f5d38c085b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:58.756440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfc19a-03a8-4a3e-a8cd-57f5d38c085b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:58.808759 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1654/3272] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:44:58 2022] PUT /identity/v3/projects/0638d5eae53b42bbb40af7b40b08b6cb/users/ae80f67a229d466abdb0943c4a4e75bd/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:44:58.809900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfbccd-dc99-495a-bba9-4c03df873435 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:58.894848 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1619/3273] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:44:58 2022] POST /identity/v3/users => generated 289 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:44:58.896006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfc19a-03a8-4a3e-a8cd-57f5d38c085b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:58.915642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfc19a-03a8-4a3e-a8cd-57f5d38c085b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:59.020955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfbccd-dc99-495a-bba9-4c03df873435 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:59.028950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0f6d1-9666-4b4e-8135-ed87386da498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:59.029889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0f6d1-9666-4b4e-8135-ed87386da498 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:59.030339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0f6d1-9666-4b4e-8135-ed87386da498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:59.030772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0f6d1-9666-4b4e-8135-ed87386da498 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:59.032290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0f6d1-9666-4b4e-8135-ed87386da498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:59.036438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0f6d1-9666-4b4e-8135-ed87386da498 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:59.050623 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1655/3274] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:44:59.055680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0f6d1-9666-4b4e-8135-ed87386da498 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:59.087732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0f6d1-9666-4b4e-8135-ed87386da498 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:59.096062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cf7ab-2ceb-4a40-8ec2-f0b665da7fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:59.096912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cf7ab-2ceb-4a40-8ec2-f0b665da7fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:59.097100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cf7ab-2ceb-4a40-8ec2-f0b665da7fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:59.097250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cf7ab-2ceb-4a40-8ec2-f0b665da7fd3 admin admin] PATH_INFO: `/v3/projects/0638d5eae53b42bbb40af7b40b08b6cb/users/ae80f67a229d466abdb0943c4a4e75bd/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:59.099917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cf7ab-2ceb-4a40-8ec2-f0b665da7fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0638d5eae53b42bbb40af7b40b08b6cb, user_id=ae80f67a229d466abdb0943c4a4e75bd, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:59.103632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cf7ab-2ceb-4a40-8ec2-f0b665da7fd3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:59.120215 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1656/3275] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:44:59 2022] PUT /identity/v3/projects/0638d5eae53b42bbb40af7b40b08b6cb/users/ae80f67a229d466abdb0943c4a4e75bd/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:59.131369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b6147-c0b4-4207-b7b3-bde523836829 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:59.132207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b6147-c0b4-4207-b7b3-bde523836829 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:59.132664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b6147-c0b4-4207-b7b3-bde523836829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:59.147827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c5e20-5c10-4b2f-ac0e-5f64ca94083d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:59.149507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c5e20-5c10-4b2f-ac0e-5f64ca94083d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:59.149899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c5e20-5c10-4b2f-ac0e-5f64ca94083d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:59.150244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c5e20-5c10-4b2f-ac0e-5f64ca94083d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:59.150972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c5e20-5c10-4b2f-ac0e-5f64ca94083d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:59.153860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c5e20-5c10-4b2f-ac0e-5f64ca94083d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:59.170939 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1620/3276] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:44:59.182391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c5e20-5c10-4b2f-ac0e-5f64ca94083d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:59.203247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c5e20-5c10-4b2f-ac0e-5f64ca94083d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:59.210576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ee9b6147-c0b4-4207-b7b3-bde523836829 None None] MFA Rules not processed for user `ae80f67a229d466abdb0943c4a4e75bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:59.213495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ee9b6147-c0b4-4207-b7b3-bde523836829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:59.347335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbd677-7ad5-4deb-b6b6-a7900b7ed036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:59.348333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbd677-7ad5-4deb-b6b6-a7900b7ed036 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:59.348751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbd677-7ad5-4deb-b6b6-a7900b7ed036 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:59.352754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbd677-7ad5-4deb-b6b6-a7900b7ed036 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:59.352754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbd677-7ad5-4deb-b6b6-a7900b7ed036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:59.353414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbd677-7ad5-4deb-b6b6-a7900b7ed036 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:59.365659 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1657/3277] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:59.372344 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1621/3278] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:44:59.377097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b6147-c0b4-4207-b7b3-bde523836829 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:59.390627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b6147-c0b4-4207-b7b3-bde523836829 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:59.403184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e50e2-aac0-43bf-afe6-f3dbb2ec54f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:59.405495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e50e2-aac0-43bf-afe6-f3dbb2ec54f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:59.406037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e50e2-aac0-43bf-afe6-f3dbb2ec54f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:59.406322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e50e2-aac0-43bf-afe6-f3dbb2ec54f1 admin admin] PATH_INFO: `/v3/projects/69cabedeede3400e97dc66f4cd3e1e26/users/918c83baf9594597b600109d02d30e87/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:59.426530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e50e2-aac0-43bf-afe6-f3dbb2ec54f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69cabedeede3400e97dc66f4cd3e1e26, user_id=918c83baf9594597b600109d02d30e87, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:59.429263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e50e2-aac0-43bf-afe6-f3dbb2ec54f1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:59.515422 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1658/3279] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:44:59 2022] PUT /identity/v3/projects/69cabedeede3400e97dc66f4cd3e1e26/users/918c83baf9594597b600109d02d30e87/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:44:59.518816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ec6b-9eca-451f-903a-814d3f47fd65 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:59.519613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ec6b-9eca-451f-903a-814d3f47fd65 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:59.520107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ec6b-9eca-451f-903a-814d3f47fd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:59.546950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-aa98ec6b-9eca-451f-903a-814d3f47fd65 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:44:59.548821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aa98ec6b-9eca-451f-903a-814d3f47fd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:59.565898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:44:59.656887 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1622/3280] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:44:59.665719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e50e2-aac0-43bf-afe6-f3dbb2ec54f1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:44:59.672604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d91e50e2-aac0-43bf-afe6-f3dbb2ec54f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:44:59.745489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e50e2-aac0-43bf-afe6-f3dbb2ec54f1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:44:59.752111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac61288-197d-4d9a-a6ed-ec8c2877e581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:44:59.752801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac61288-197d-4d9a-a6ed-ec8c2877e581 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:44:59.753081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac61288-197d-4d9a-a6ed-ec8c2877e581 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:44:59.753353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac61288-197d-4d9a-a6ed-ec8c2877e581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:44:59.783317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac61288-197d-4d9a-a6ed-ec8c2877e581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:44:59.786237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac61288-197d-4d9a-a6ed-ec8c2877e581 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:44:59.828199 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1659/3281] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:45:02.682205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98ec6b-9eca-451f-903a-814d3f47fd65 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:02.686636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aa98ec6b-9eca-451f-903a-814d3f47fd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:02.700279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:02.800706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98ec6b-9eca-451f-903a-814d3f47fd65 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:02.806775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac61288-197d-4d9a-a6ed-ec8c2877e581 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:02.826099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac61288-197d-4d9a-a6ed-ec8c2877e581 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:02.835631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928b2be-9aca-41e0-81e9-16589eeba9e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:02.845168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a572c-15fa-473d-b689-f4cbf60a2c5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:02.845872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928b2be-9aca-41e0-81e9-16589eeba9e1 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:02.846340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928b2be-9aca-41e0-81e9-16589eeba9e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:02.847487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928b2be-9aca-41e0-81e9-16589eeba9e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:02.847824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a572c-15fa-473d-b689-f4cbf60a2c5f service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:02.849184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a572c-15fa-473d-b689-f4cbf60a2c5f service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:02.849652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a572c-15fa-473d-b689-f4cbf60a2c5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:02.867857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7928b2be-9aca-41e0-81e9-16589eeba9e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:02.924472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928b2be-9aca-41e0-81e9-16589eeba9e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:02.942957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928b2be-9aca-41e0-81e9-16589eeba9e1 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:02.975276 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1660/3282] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:03.056025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a572c-15fa-473d-b689-f4cbf60a2c5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:03.058018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a572c-15fa-473d-b689-f4cbf60a2c5f service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:03.088130 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1623/3283] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:02 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:03.651302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097fc1f-5d07-4784-8298-c57eade21bb5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:03.651302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097fc1f-5d07-4784-8298-c57eade21bb5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:03.651302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097fc1f-5d07-4784-8298-c57eade21bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:03.660437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-5097fc1f-5d07-4784-8298-c57eade21bb5 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:03.660437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:45:03.660437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:45:03.660437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:45:03.660437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:45:03.660437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:45:03.660437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:45:03.660437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:45:03.660437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:45:03.660437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:45:03.660437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:45:03.660437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:45:03.660437 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:45:03.661659 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:45:03.661659 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:45:03.661659 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:45:03.661659 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:45:03.661659 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:45:03.661659 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:45:03.661659 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:45:03.661659 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:45:03.661659 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:45:03.661659 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:45:03.661659 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:45:03.661659 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:45:03.661659 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:45:03.661659 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:03.661659 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:45:03.675891 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1661/3284] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:45:03 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 27 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 04:45:03.754893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a572c-15fa-473d-b689-f4cbf60a2c5f service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:03.795078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a572c-15fa-473d-b689-f4cbf60a2c5f service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:03.827413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8684cad-ff40-4be8-a732-4b8c81c9b602 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:03.832400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8684cad-ff40-4be8-a732-4b8c81c9b602 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:03.832746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8684cad-ff40-4be8-a732-4b8c81c9b602 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:03.833194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8684cad-ff40-4be8-a732-4b8c81c9b602 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:03.836379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e8684cad-ff40-4be8-a732-4b8c81c9b602 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:03.965685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8684cad-ff40-4be8-a732-4b8c81c9b602 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:03.967333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8684cad-ff40-4be8-a732-4b8c81c9b602 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:03.991485 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1624/3285] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:04.018632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097fc1f-5d07-4784-8298-c57eade21bb5 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:04.071859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097fc1f-5d07-4784-8298-c57eade21bb5 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:04.079037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50120b8b-421c-418d-8b44-f8ac457f8ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:04.080097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50120b8b-421c-418d-8b44-f8ac457f8ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:04.081631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50120b8b-421c-418d-8b44-f8ac457f8ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:04.083023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50120b8b-421c-418d-8b44-f8ac457f8ea3 admin admin] PATH_INFO: `/v3/users/71d6fe2178594cdaa5b910dd0e181f3d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:04.084791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50120b8b-421c-418d-8b44-f8ac457f8ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d6fe2178594cdaa5b910dd0e181f3d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:04.091781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50120b8b-421c-418d-8b44-f8ac457f8ea3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:04.311463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:04.344694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-50120b8b-421c-418d-8b44-f8ac457f8ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d6fe2178594cdaa5b910dd0e181f3d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:04.350134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-50120b8b-421c-418d-8b44-f8ac457f8ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d6fe2178594cdaa5b910dd0e181f3d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:04.437331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-50120b8b-421c-418d-8b44-f8ac457f8ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d6fe2178594cdaa5b910dd0e181f3d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:04.438438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-50120b8b-421c-418d-8b44-f8ac457f8ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d6fe2178594cdaa5b910dd0e181f3d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:04.460220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-50120b8b-421c-418d-8b44-f8ac457f8ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d6fe2178594cdaa5b910dd0e181f3d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:04.489899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fe77c-e148-433f-8a4f-fe6fe5f4275c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:04.491396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fe77c-e148-433f-8a4f-fe6fe5f4275c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:04.492559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fe77c-e148-433f-8a4f-fe6fe5f4275c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:04.496340 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1662/3286] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:45:04 2022] DELETE /identity/v3/users/71d6fe2178594cdaa5b910dd0e181f3d => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:04.535563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ea2fe77c-e148-433f-8a4f-fe6fe5f4275c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:04.537071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ea2fe77c-e148-433f-8a4f-fe6fe5f4275c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:04.625802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:04.673552 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1625/3287] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:04.705146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50120b8b-421c-418d-8b44-f8ac457f8ea3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:04.707477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-50120b8b-421c-418d-8b44-f8ac457f8ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:04.971157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50120b8b-421c-418d-8b44-f8ac457f8ea3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:04.988400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7d223-cf15-43da-990c-26aed5cb0784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:04.989048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7d223-cf15-43da-990c-26aed5cb0784 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:04.989417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7d223-cf15-43da-990c-26aed5cb0784 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:04.989703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7d223-cf15-43da-990c-26aed5cb0784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:05.020621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7d223-cf15-43da-990c-26aed5cb0784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:05.020621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7d223-cf15-43da-990c-26aed5cb0784 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:05.050873 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1663/3288] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:05.483869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fe77c-e148-433f-8a4f-fe6fe5f4275c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:05.486679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ea2fe77c-e148-433f-8a4f-fe6fe5f4275c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:05.649824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fe77c-e148-433f-8a4f-fe6fe5f4275c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:05.666319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed3d71-6431-4b8f-9827-5173dc9f733e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:05.667468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3d71-6431-4b8f-9827-5173dc9f733e service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:05.667834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3d71-6431-4b8f-9827-5173dc9f733e service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:05.668252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3d71-6431-4b8f-9827-5173dc9f733e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:05.670234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-40ed3d71-6431-4b8f-9827-5173dc9f733e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:05.889091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed3d71-6431-4b8f-9827-5173dc9f733e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:05.895622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed3d71-6431-4b8f-9827-5173dc9f733e service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:05.931416 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1626/3289] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:06.395926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7d223-cf15-43da-990c-26aed5cb0784 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:06.397468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-36d7d223-cf15-43da-990c-26aed5cb0784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:06.430356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7d223-cf15-43da-990c-26aed5cb0784 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:06.463083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca9495-b715-45cd-b148-30ef391fc61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:06.463882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca9495-b715-45cd-b148-30ef391fc61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:06.471243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca9495-b715-45cd-b148-30ef391fc61e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:06.471243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca9495-b715-45cd-b148-30ef391fc61e admin admin] PATH_INFO: `/v3/projects/5312a0924666461dbcab3046927c0113` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:06.479111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca9495-b715-45cd-b148-30ef391fc61e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5312a0924666461dbcab3046927c0113)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:06.482299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca9495-b715-45cd-b148-30ef391fc61e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:06.642491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8eca9495-b715-45cd-b148-30ef391fc61e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5312a0924666461dbcab3046927c0113', 'request_id': 'req-8eca9495-b715-45cd-b148-30ef391fc61e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:06.665855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8eca9495-b715-45cd-b148-30ef391fc61e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5312a0924666461dbcab3046927c0113', 'request_id': 'req-8eca9495-b715-45cd-b148-30ef391fc61e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:06.758906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8eca9495-b715-45cd-b148-30ef391fc61e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5312a0924666461dbcab3046927c0113', 'request_id': 'req-8eca9495-b715-45cd-b148-30ef391fc61e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:06.779062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8eca9495-b715-45cd-b148-30ef391fc61e admin admin] The token cache is being invalidate because project 5312a0924666461dbcab3046927c0113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:06.783866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8eca9495-b715-45cd-b148-30ef391fc61e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:06.792711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8eca9495-b715-45cd-b148-30ef391fc61e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:06.805554 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1664/3290] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:45:06 2022] DELETE /identity/v3/projects/5312a0924666461dbcab3046927c0113 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:06.807081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed3d71-6431-4b8f-9827-5173dc9f733e service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:06.845715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed3d71-6431-4b8f-9827-5173dc9f733e service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:06.953087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81661d-388f-4fb8-95b2-a07f92983b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:06.954586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81661d-388f-4fb8-95b2-a07f92983b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:06.954967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81661d-388f-4fb8-95b2-a07f92983b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:06.955321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81661d-388f-4fb8-95b2-a07f92983b78 admin admin] PATH_INFO: `/v3/users/ae80f67a229d466abdb0943c4a4e75bd` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:06.956649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81661d-388f-4fb8-95b2-a07f92983b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae80f67a229d466abdb0943c4a4e75bd)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:06.958789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81661d-388f-4fb8-95b2-a07f92983b78 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:06.986824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:07.317954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9c81661d-388f-4fb8-95b2-a07f92983b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae80f67a229d466abdb0943c4a4e75bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:07.456871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9c81661d-388f-4fb8-95b2-a07f92983b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae80f67a229d466abdb0943c4a4e75bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:07.457775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9c81661d-388f-4fb8-95b2-a07f92983b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae80f67a229d466abdb0943c4a4e75bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:07.490591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9c81661d-388f-4fb8-95b2-a07f92983b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae80f67a229d466abdb0943c4a4e75bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:07.573762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9c81661d-388f-4fb8-95b2-a07f92983b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae80f67a229d466abdb0943c4a4e75bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:07.599368 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1627/3291] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:45:06 2022] DELETE /identity/v3/users/ae80f67a229d466abdb0943c4a4e75bd => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:08.445284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca9495-b715-45cd-b148-30ef391fc61e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:08.446885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8eca9495-b715-45cd-b148-30ef391fc61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:08.483933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca9495-b715-45cd-b148-30ef391fc61e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:08.599140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:08.654264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d0052-1310-477e-b456-23386add3ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:08.654939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d0052-1310-477e-b456-23386add3ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:08.655219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d0052-1310-477e-b456-23386add3ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:08.655493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d0052-1310-477e-b456-23386add3ad7 admin admin] PATH_INFO: `/v3/projects/0638d5eae53b42bbb40af7b40b08b6cb` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:08.656908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d0052-1310-477e-b456-23386add3ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0638d5eae53b42bbb40af7b40b08b6cb)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:08.658901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d0052-1310-477e-b456-23386add3ad7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:08.862561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ed7d0052-1310-477e-b456-23386add3ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0638d5eae53b42bbb40af7b40b08b6cb', 'request_id': 'req-ed7d0052-1310-477e-b456-23386add3ad7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:08.871823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ed7d0052-1310-477e-b456-23386add3ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0638d5eae53b42bbb40af7b40b08b6cb', 'request_id': 'req-ed7d0052-1310-477e-b456-23386add3ad7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:08.966217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ed7d0052-1310-477e-b456-23386add3ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0638d5eae53b42bbb40af7b40b08b6cb', 'request_id': 'req-ed7d0052-1310-477e-b456-23386add3ad7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:09.011050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ed7d0052-1310-477e-b456-23386add3ad7 admin admin] The token cache is being invalidate because project 0638d5eae53b42bbb40af7b40b08b6cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:09.011352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ed7d0052-1310-477e-b456-23386add3ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:09.012154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ed7d0052-1310-477e-b456-23386add3ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:09.014689 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1665/3292] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:45:08 2022] DELETE /identity/v3/projects/0638d5eae53b42bbb40af7b40b08b6cb => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:09.021129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74c678-5bbd-490a-88e4-5ca3973635aa None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:09.021680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74c678-5bbd-490a-88e4-5ca3973635aa None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:09.022180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74c678-5bbd-490a-88e4-5ca3973635aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:09.058172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3d74c678-5bbd-490a-88e4-5ca3973635aa None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:09.060748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3d74c678-5bbd-490a-88e4-5ca3973635aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:09.159703 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1628/3293] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:09.168833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bf4a2-2601-443b-b8e0-825ad3d9bc8d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:09.169120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bf4a2-2601-443b-b8e0-825ad3d9bc8d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:09.169398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bf4a2-2601-443b-b8e0-825ad3d9bc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:09.254087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3f2bf4a2-2601-443b-b8e0-825ad3d9bc8d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:09.255352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3f2bf4a2-2601-443b-b8e0-825ad3d9bc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:09.292724 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1666/3294] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:09.297096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74c678-5bbd-490a-88e4-5ca3973635aa None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:09.314921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74c678-5bbd-490a-88e4-5ca3973635aa None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:09.328549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62561fd-2cf0-4408-b3b1-aa768256b168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:09.329330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62561fd-2cf0-4408-b3b1-aa768256b168 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:09.330664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62561fd-2cf0-4408-b3b1-aa768256b168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:09.331067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62561fd-2cf0-4408-b3b1-aa768256b168 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:09.334384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62561fd-2cf0-4408-b3b1-aa768256b168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:09.334802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62561fd-2cf0-4408-b3b1-aa768256b168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:09.339119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62561fd-2cf0-4408-b3b1-aa768256b168 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:09.375776 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1629/3295] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:09.377798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bf4a2-2601-443b-b8e0-825ad3d9bc8d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:09.395929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bf4a2-2601-443b-b8e0-825ad3d9bc8d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:09.414539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559efa6-46a9-4524-aa78-7917e23366d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:09.420252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559efa6-46a9-4524-aa78-7917e23366d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:09.420252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559efa6-46a9-4524-aa78-7917e23366d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:09.420252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559efa6-46a9-4524-aa78-7917e23366d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:09.420252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559efa6-46a9-4524-aa78-7917e23366d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:09.420252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559efa6-46a9-4524-aa78-7917e23366d2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:09.573704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62561fd-2cf0-4408-b3b1-aa768256b168 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:09.574081 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1667/3296] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:45:09 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:09.587991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62561fd-2cf0-4408-b3b1-aa768256b168 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:09.736708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b2da3-e206-47c6-93ba-30f24a044e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:09.738418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b2da3-e206-47c6-93ba-30f24a044e7b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:09.738883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b2da3-e206-47c6-93ba-30f24a044e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:09.739320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b2da3-e206-47c6-93ba-30f24a044e7b admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:09.740126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b2da3-e206-47c6-93ba-30f24a044e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:09.743131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b2da3-e206-47c6-93ba-30f24a044e7b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:09.923034 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1630/3297] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:45:09 2022] POST /identity/v3/users => generated 287 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:09.926924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559efa6-46a9-4524-aa78-7917e23366d2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:09.952671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559efa6-46a9-4524-aa78-7917e23366d2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:09.990893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ced2d-55d9-4049-bed0-bcda85ffd7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:09.991358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ced2d-55d9-4049-bed0-bcda85ffd7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:09.992639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ced2d-55d9-4049-bed0-bcda85ffd7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:09.992995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ced2d-55d9-4049-bed0-bcda85ffd7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:09.993667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ced2d-55d9-4049-bed0-bcda85ffd7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:09.995294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ced2d-55d9-4049-bed0-bcda85ffd7c8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:10.015193 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1668/3298] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:10.017202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b2da3-e206-47c6-93ba-30f24a044e7b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:10.037049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b2da3-e206-47c6-93ba-30f24a044e7b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:10.046939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d420ea-cde4-46b9-b0a2-7f2db3b23d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:10.048025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d420ea-cde4-46b9-b0a2-7f2db3b23d74 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:10.048362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d420ea-cde4-46b9-b0a2-7f2db3b23d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:10.048642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d420ea-cde4-46b9-b0a2-7f2db3b23d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:10.049543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d420ea-cde4-46b9-b0a2-7f2db3b23d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:10.051191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d420ea-cde4-46b9-b0a2-7f2db3b23d74 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:10.060202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:10.070732 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1631/3299] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:10.072113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ced2d-55d9-4049-bed0-bcda85ffd7c8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:10.091913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ced2d-55d9-4049-bed0-bcda85ffd7c8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:10.098071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032edce1-9c8b-4d46-9ef8-444b99fc5391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:10.098756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032edce1-9c8b-4d46-9ef8-444b99fc5391 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:10.099494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032edce1-9c8b-4d46-9ef8-444b99fc5391 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:10.099763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032edce1-9c8b-4d46-9ef8-444b99fc5391 admin admin] PATH_INFO: `/v3/projects/0b28bde5419546d5b579d083926fb3f2/users/ef00130944f345a3bab4f719916774e3/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:10.127694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032edce1-9c8b-4d46-9ef8-444b99fc5391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b28bde5419546d5b579d083926fb3f2, user_id=ef00130944f345a3bab4f719916774e3, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:10.132295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032edce1-9c8b-4d46-9ef8-444b99fc5391 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:10.198791 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1669/3300] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:45:10 2022] PUT /identity/v3/projects/0b28bde5419546d5b579d083926fb3f2/users/ef00130944f345a3bab4f719916774e3/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:10.212811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21034f99-191b-4083-98e0-8d1c981c2414 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:10.213172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21034f99-191b-4083-98e0-8d1c981c2414 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:10.213435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21034f99-191b-4083-98e0-8d1c981c2414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:10.299890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-21034f99-191b-4083-98e0-8d1c981c2414 None None] MFA Rules not processed for user `ef00130944f345a3bab4f719916774e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:10.306503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-21034f99-191b-4083-98e0-8d1c981c2414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:10.483830 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1632/3301] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:10.501536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032edce1-9c8b-4d46-9ef8-444b99fc5391 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:10.503721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-032edce1-9c8b-4d46-9ef8-444b99fc5391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:10.692230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:10.705997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032edce1-9c8b-4d46-9ef8-444b99fc5391 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:10.728134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae98018-11f8-403f-88d9-b936b7f63f20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:10.730069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae98018-11f8-403f-88d9-b936b7f63f20 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:10.731401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae98018-11f8-403f-88d9-b936b7f63f20 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:10.734691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae98018-11f8-403f-88d9-b936b7f63f20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:10.778364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae98018-11f8-403f-88d9-b936b7f63f20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:10.780032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae98018-11f8-403f-88d9-b936b7f63f20 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:10.827393 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1670/3302] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:12.307689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21034f99-191b-4083-98e0-8d1c981c2414 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:12.330321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21034f99-191b-4083-98e0-8d1c981c2414 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:12.354184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e0e76-3314-46a4-af33-10c4fcaef52c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:12.354816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e0e76-3314-46a4-af33-10c4fcaef52c service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:12.355097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e0e76-3314-46a4-af33-10c4fcaef52c service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:12.355370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e0e76-3314-46a4-af33-10c4fcaef52c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:12.361990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-274e0e76-3314-46a4-af33-10c4fcaef52c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:12.586301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e0e76-3314-46a4-af33-10c4fcaef52c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:12.588384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e0e76-3314-46a4-af33-10c4fcaef52c service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:12.606024 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1633/3303] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:12.720922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae98018-11f8-403f-88d9-b936b7f63f20 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:12.722362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7ae98018-11f8-403f-88d9-b936b7f63f20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:12.889436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae98018-11f8-403f-88d9-b936b7f63f20 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:12.897279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed8ea5-5134-489f-9192-0e659620fa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:12.900146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed8ea5-5134-489f-9192-0e659620fa8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:12.900608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed8ea5-5134-489f-9192-0e659620fa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:12.901101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed8ea5-5134-489f-9192-0e659620fa8b admin admin] PATH_INFO: `/v3/users/4f4affe28e084a7eb873d9a1f0f79fe9` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:12.905005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed8ea5-5134-489f-9192-0e659620fa8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f4affe28e084a7eb873d9a1f0f79fe9)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:12.923814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed8ea5-5134-489f-9192-0e659620fa8b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:13.312438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d6ed8ea5-5134-489f-9192-0e659620fa8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f4affe28e084a7eb873d9a1f0f79fe9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:13.314478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d6ed8ea5-5134-489f-9192-0e659620fa8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f4affe28e084a7eb873d9a1f0f79fe9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:13.472880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d6ed8ea5-5134-489f-9192-0e659620fa8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f4affe28e084a7eb873d9a1f0f79fe9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:13.473948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d6ed8ea5-5134-489f-9192-0e659620fa8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f4affe28e084a7eb873d9a1f0f79fe9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:13.497164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d6ed8ea5-5134-489f-9192-0e659620fa8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f4affe28e084a7eb873d9a1f0f79fe9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:13.532202 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1671/3304] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:45:12 2022] DELETE /identity/v3/users/4f4affe28e084a7eb873d9a1f0f79fe9 => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:13.561114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ce94e-432c-4f34-9952-c5cfbe2d1dcf None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:13.561941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ce94e-432c-4f34-9952-c5cfbe2d1dcf None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:13.562438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ce94e-432c-4f34-9952-c5cfbe2d1dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:13.609681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-267ce94e-432c-4f34-9952-c5cfbe2d1dcf None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:13.611348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-267ce94e-432c-4f34-9952-c5cfbe2d1dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:13.788799 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1634/3305] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:13.848453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed8ea5-5134-489f-9192-0e659620fa8b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:13.848453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d6ed8ea5-5134-489f-9192-0e659620fa8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:13.983412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed8ea5-5134-489f-9192-0e659620fa8b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:13.994685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c6d20-ac68-4f43-bb34-65f50588ffb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:13.995399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c6d20-ac68-4f43-bb34-65f50588ffb4 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:13.996722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c6d20-ac68-4f43-bb34-65f50588ffb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:13.997077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c6d20-ac68-4f43-bb34-65f50588ffb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:14.037023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c6d20-ac68-4f43-bb34-65f50588ffb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:14.041710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c6d20-ac68-4f43-bb34-65f50588ffb4 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:14.082788 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1672/3306] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:14.810222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ce94e-432c-4f34-9952-c5cfbe2d1dcf None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:14.816948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-267ce94e-432c-4f34-9952-c5cfbe2d1dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:14.833052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ce94e-432c-4f34-9952-c5cfbe2d1dcf None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:14.841555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fb0b3-2dbd-4022-9d64-50d63d358159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:14.842459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fb0b3-2dbd-4022-9d64-50d63d358159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:14.842924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fb0b3-2dbd-4022-9d64-50d63d358159 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:14.843356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fb0b3-2dbd-4022-9d64-50d63d358159 admin admin] PATH_INFO: `/v3/users/ef00130944f345a3bab4f719916774e3` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:14.844841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fb0b3-2dbd-4022-9d64-50d63d358159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef00130944f345a3bab4f719916774e3)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:14.846947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fb0b3-2dbd-4022-9d64-50d63d358159 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:14.873098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:14.988156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c6d20-ac68-4f43-bb34-65f50588ffb4 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:14.989838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0f4c6d20-ac68-4f43-bb34-65f50588ffb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:15.065804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c6d20-ac68-4f43-bb34-65f50588ffb4 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:15.073356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e63c9-64ed-41bd-9258-21fe87a6f570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:15.075484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e63c9-64ed-41bd-9258-21fe87a6f570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:15.077298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e63c9-64ed-41bd-9258-21fe87a6f570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:15.077783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e63c9-64ed-41bd-9258-21fe87a6f570 admin admin] PATH_INFO: `/v3/projects/d85e7650a4374066922085ef5115c973` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:15.090174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e63c9-64ed-41bd-9258-21fe87a6f570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85e7650a4374066922085ef5115c973)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:15.095797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e63c9-64ed-41bd-9258-21fe87a6f570 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:15.106874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:15.547737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-075e63c9-64ed-41bd-9258-21fe87a6f570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85e7650a4374066922085ef5115c973', 'request_id': 'req-075e63c9-64ed-41bd-9258-21fe87a6f570'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:15.557200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-075e63c9-64ed-41bd-9258-21fe87a6f570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85e7650a4374066922085ef5115c973', 'request_id': 'req-075e63c9-64ed-41bd-9258-21fe87a6f570'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:15.563145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c50fb0b3-2dbd-4022-9d64-50d63d358159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef00130944f345a3bab4f719916774e3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:15.774249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-075e63c9-64ed-41bd-9258-21fe87a6f570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85e7650a4374066922085ef5115c973', 'request_id': 'req-075e63c9-64ed-41bd-9258-21fe87a6f570'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:15.796376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-075e63c9-64ed-41bd-9258-21fe87a6f570 admin admin] The token cache is being invalidate because project d85e7650a4374066922085ef5115c973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:15.802635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-075e63c9-64ed-41bd-9258-21fe87a6f570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:15.802635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-075e63c9-64ed-41bd-9258-21fe87a6f570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:15.802635 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1673/3307] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:45:14 2022] DELETE /identity/v3/projects/d85e7650a4374066922085ef5115c973 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:15.806151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e63c9-64ed-41bd-9258-21fe87a6f570 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:15.832142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-075e63c9-64ed-41bd-9258-21fe87a6f570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:15.912370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c50fb0b3-2dbd-4022-9d64-50d63d358159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef00130944f345a3bab4f719916774e3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:15.912993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c50fb0b3-2dbd-4022-9d64-50d63d358159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef00130944f345a3bab4f719916774e3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:15.921569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c50fb0b3-2dbd-4022-9d64-50d63d358159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef00130944f345a3bab4f719916774e3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:15.955821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c50fb0b3-2dbd-4022-9d64-50d63d358159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef00130944f345a3bab4f719916774e3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:16.000793 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1635/3308] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:45:14 2022] DELETE /identity/v3/users/ef00130944f345a3bab4f719916774e3 => generated 0 bytes in 1191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:16.007369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff874141-6203-42b0-beb4-570019608bba None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:16.009745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff874141-6203-42b0-beb4-570019608bba None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:16.009745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff874141-6203-42b0-beb4-570019608bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:16.096597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e63c9-64ed-41bd-9258-21fe87a6f570 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:16.113345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ff874141-6203-42b0-beb4-570019608bba None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:16.114597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ff874141-6203-42b0-beb4-570019608bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:16.251399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206539d-a09b-42b5-89da-bbb1953ce6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:16.253858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206539d-a09b-42b5-89da-bbb1953ce6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:16.254218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206539d-a09b-42b5-89da-bbb1953ce6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:16.256136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206539d-a09b-42b5-89da-bbb1953ce6d3 admin admin] PATH_INFO: `/v3/users/63fe5047410145f7bbe2d46493d6a000` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:16.259084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206539d-a09b-42b5-89da-bbb1953ce6d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63fe5047410145f7bbe2d46493d6a000)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:16.264028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206539d-a09b-42b5-89da-bbb1953ce6d3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:16.327102 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1636/3309] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:16.336013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fed3ba-c371-4179-b48a-2fd1f09726ef None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:16.337358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fed3ba-c371-4179-b48a-2fd1f09726ef None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:16.340484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fed3ba-c371-4179-b48a-2fd1f09726ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:16.423529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-16fed3ba-c371-4179-b48a-2fd1f09726ef None None] MFA Rules not processed for user `918c83baf9594597b600109d02d30e87`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:16.426123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-16fed3ba-c371-4179-b48a-2fd1f09726ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:16.531031 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1637/3310] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:16.541407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fed3ba-c371-4179-b48a-2fd1f09726ef None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:16.544348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-16fed3ba-c371-4179-b48a-2fd1f09726ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:16.656446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fed3ba-c371-4179-b48a-2fd1f09726ef None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:16.662765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf033be-361d-405c-893c-9b906998bb2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:16.663699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf033be-361d-405c-893c-9b906998bb2c service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:16.664196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf033be-361d-405c-893c-9b906998bb2c service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:16.665056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf033be-361d-405c-893c-9b906998bb2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:16.668611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dbf033be-361d-405c-893c-9b906998bb2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:16.699062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf033be-361d-405c-893c-9b906998bb2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:16.700744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf033be-361d-405c-893c-9b906998bb2c service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:16.705686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e206539d-a09b-42b5-89da-bbb1953ce6d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63fe5047410145f7bbe2d46493d6a000'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:16.709308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e206539d-a09b-42b5-89da-bbb1953ce6d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63fe5047410145f7bbe2d46493d6a000'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:16.721203 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1638/3311] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:16.722361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf033be-361d-405c-893c-9b906998bb2c service placement] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:16.724024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dbf033be-361d-405c-893c-9b906998bb2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:16.808604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf033be-361d-405c-893c-9b906998bb2c service placement] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:16.813446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e163962-7307-4fdb-988f-a5de1998d1f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:16.814088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e163962-7307-4fdb-988f-a5de1998d1f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:16.814533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e163962-7307-4fdb-988f-a5de1998d1f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:16.814960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e163962-7307-4fdb-988f-a5de1998d1f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:16.827052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e163962-7307-4fdb-988f-a5de1998d1f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:16.828572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e163962-7307-4fdb-988f-a5de1998d1f1 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:16.840019 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1639/3312] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:16.840913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e163962-7307-4fdb-988f-a5de1998d1f1 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:16.842243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4e163962-7307-4fdb-988f-a5de1998d1f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:16.858180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e163962-7307-4fdb-988f-a5de1998d1f1 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:16.862893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aed9f0-b0e5-41fc-80e6-adc4b4fda729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:16.863521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aed9f0-b0e5-41fc-80e6-adc4b4fda729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:16.863803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aed9f0-b0e5-41fc-80e6-adc4b4fda729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:16.864080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aed9f0-b0e5-41fc-80e6-adc4b4fda729 admin admin] PATH_INFO: `/v3/users/40def5e61b2142e9b33b6c5aba059388` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:16.865246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aed9f0-b0e5-41fc-80e6-adc4b4fda729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40def5e61b2142e9b33b6c5aba059388)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:16.868830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aed9f0-b0e5-41fc-80e6-adc4b4fda729 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:17.076644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e206539d-a09b-42b5-89da-bbb1953ce6d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63fe5047410145f7bbe2d46493d6a000'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:17.076644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e206539d-a09b-42b5-89da-bbb1953ce6d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63fe5047410145f7bbe2d46493d6a000'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:17.089066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e206539d-a09b-42b5-89da-bbb1953ce6d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63fe5047410145f7bbe2d46493d6a000'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:17.104011 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1674/3313] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:45:15 2022] DELETE /identity/v3/users/63fe5047410145f7bbe2d46493d6a000 => generated 0 bytes in 1298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:17.105446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ce00c-cc74-41df-b2fb-9246668a7bd5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:17.105940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ce00c-cc74-41df-b2fb-9246668a7bd5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:17.106220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ce00c-cc74-41df-b2fb-9246668a7bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:17.128810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-cb3ce00c-cc74-41df-b2fb-9246668a7bd5 None None] MFA Rules not processed for user `918c83baf9594597b600109d02d30e87`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:17.130114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cb3ce00c-cc74-41df-b2fb-9246668a7bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:17.208522 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1675/3314] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:17.221794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ce00c-cc74-41df-b2fb-9246668a7bd5 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:17.223297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cb3ce00c-cc74-41df-b2fb-9246668a7bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:17.337074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-58aed9f0-b0e5-41fc-80e6-adc4b4fda729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40def5e61b2142e9b33b6c5aba059388'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:17.353120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ce00c-cc74-41df-b2fb-9246668a7bd5 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:17.365010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb2062-2fe9-4389-a097-b6acbaa64178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:17.365677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb2062-2fe9-4389-a097-b6acbaa64178 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:17.365929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb2062-2fe9-4389-a097-b6acbaa64178 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:17.366872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb2062-2fe9-4389-a097-b6acbaa64178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:17.369006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fdbb2062-2fe9-4389-a097-b6acbaa64178 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:17.385064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb2062-2fe9-4389-a097-b6acbaa64178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:17.387104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb2062-2fe9-4389-a097-b6acbaa64178 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:17.430750 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1676/3315] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:45:17.490536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-58aed9f0-b0e5-41fc-80e6-adc4b4fda729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40def5e61b2142e9b33b6c5aba059388'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:17.491336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-58aed9f0-b0e5-41fc-80e6-adc4b4fda729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40def5e61b2142e9b33b6c5aba059388'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:17.501258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-58aed9f0-b0e5-41fc-80e6-adc4b4fda729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40def5e61b2142e9b33b6c5aba059388'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:17.530406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-58aed9f0-b0e5-41fc-80e6-adc4b4fda729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40def5e61b2142e9b33b6c5aba059388'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:17.540246 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1640/3316] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:45:16 2022] DELETE /identity/v3/users/40def5e61b2142e9b33b6c5aba059388 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:17.625793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb2062-2fe9-4389-a097-b6acbaa64178 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:17.627248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fdbb2062-2fe9-4389-a097-b6acbaa64178 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:17.852896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb2062-2fe9-4389-a097-b6acbaa64178 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:17.964952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:17.965618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:17.965900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:17.966184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce admin admin] PATH_INFO: `/v3/projects/ad797a2bd4a84ea4adb86c37f9905a21` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:17.967322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad797a2bd4a84ea4adb86c37f9905a21)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:17.970053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:17.974282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd734e1d-f12d-476f-8f81-5f96cf1f3be3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:17.974686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd734e1d-f12d-476f-8f81-5f96cf1f3be3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:17.975068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd734e1d-f12d-476f-8f81-5f96cf1f3be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:17.990404 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-fd734e1d-f12d-476f-8f81-5f96cf1f3be3 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:17.990404 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:45:17.990404 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:45:17.990404 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:45:17.990404 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:45:17.990404 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:45:17.990404 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:45:17.990404 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:45:17.990404 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:45:17.990404 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:45:17.990404 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:45:17.990404 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:45:17.990404 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:45:17.998073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:45:17.998073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:45:17.998073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:45:17.998073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:45:17.998073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:45:17.998073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:45:17.998073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:45:17.998073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:45:17.998073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:45:17.998073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:45:17.998073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:45:17.998073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:45:17.998073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:45:17.998073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:17.998073 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:45:18.004261 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1641/3317] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:45:17 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 19 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:45:18.028747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf061e-4115-45cd-a404-373c9558a398 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:18.028977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf061e-4115-45cd-a404-373c9558a398 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:18.029193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf061e-4115-45cd-a404-373c9558a398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:18.060134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e1bf061e-4115-45cd-a404-373c9558a398 None None] MFA Rules not processed for user `918c83baf9594597b600109d02d30e87`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:18.062011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e1bf061e-4115-45cd-a404-373c9558a398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:18.133968 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1642/3318] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:18.135008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf061e-4115-45cd-a404-373c9558a398 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:18.136528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e1bf061e-4115-45cd-a404-373c9558a398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:18.158451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf061e-4115-45cd-a404-373c9558a398 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:18.158590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad797a2bd4a84ea4adb86c37f9905a21', 'request_id': 'req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.166392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad797a2bd4a84ea4adb86c37f9905a21', 'request_id': 'req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.237582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dff7f-3c69-4cef-9b85-32a60a0c0ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:18.238550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dff7f-3c69-4cef-9b85-32a60a0c0ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:18.239216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dff7f-3c69-4cef-9b85-32a60a0c0ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:18.239583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dff7f-3c69-4cef-9b85-32a60a0c0ef6 admin admin] PATH_INFO: `/v3/projects/bc08332299ea49fe822f7501e09f92ef` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:18.241483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402dff7f-3c69-4cef-9b85-32a60a0c0ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc08332299ea49fe822f7501e09f92ef)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:18.244193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402dff7f-3c69-4cef-9b85-32a60a0c0ef6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:18.245479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad797a2bd4a84ea4adb86c37f9905a21', 'request_id': 'req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.265303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce admin admin] The token cache is being invalidate because project ad797a2bd4a84ea4adb86c37f9905a21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:18.265631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.266220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.273445 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1677/3319] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:45:17 2022] DELETE /identity/v3/projects/ad797a2bd4a84ea4adb86c37f9905a21 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:18.273445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:18.275273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:18.294555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f8b8b-a454-4859-a9f6-b05cfb0242ce admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:18.301582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a231a03-19e7-43d1-be0b-9d92addc58a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:18.302246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231a03-19e7-43d1-be0b-9d92addc58a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:18.302563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231a03-19e7-43d1-be0b-9d92addc58a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:18.302935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231a03-19e7-43d1-be0b-9d92addc58a6 admin admin] PATH_INFO: `/v3/projects/0b28bde5419546d5b579d083926fb3f2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:18.304220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a231a03-19e7-43d1-be0b-9d92addc58a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b28bde5419546d5b579d083926fb3f2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:18.306316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a231a03-19e7-43d1-be0b-9d92addc58a6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:18.464439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:18.492173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-402dff7f-3c69-4cef-9b85-32a60a0c0ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc08332299ea49fe822f7501e09f92ef', 'request_id': 'req-402dff7f-3c69-4cef-9b85-32a60a0c0ef6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.502522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a231a03-19e7-43d1-be0b-9d92addc58a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b28bde5419546d5b579d083926fb3f2', 'request_id': 'req-5a231a03-19e7-43d1-be0b-9d92addc58a6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.503191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-402dff7f-3c69-4cef-9b85-32a60a0c0ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc08332299ea49fe822f7501e09f92ef', 'request_id': 'req-402dff7f-3c69-4cef-9b85-32a60a0c0ef6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.519045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a231a03-19e7-43d1-be0b-9d92addc58a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b28bde5419546d5b579d083926fb3f2', 'request_id': 'req-5a231a03-19e7-43d1-be0b-9d92addc58a6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.528525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-402dff7f-3c69-4cef-9b85-32a60a0c0ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc08332299ea49fe822f7501e09f92ef', 'request_id': 'req-402dff7f-3c69-4cef-9b85-32a60a0c0ef6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.660917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a231a03-19e7-43d1-be0b-9d92addc58a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b28bde5419546d5b579d083926fb3f2', 'request_id': 'req-5a231a03-19e7-43d1-be0b-9d92addc58a6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.674299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a231a03-19e7-43d1-be0b-9d92addc58a6 admin admin] The token cache is being invalidate because project 0b28bde5419546d5b579d083926fb3f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:18.674629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a231a03-19e7-43d1-be0b-9d92addc58a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.675435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a231a03-19e7-43d1-be0b-9d92addc58a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.677206 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1678/3320] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:45:18 2022] DELETE /identity/v3/projects/0b28bde5419546d5b579d083926fb3f2 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:18.678498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a9139-2b94-4186-947e-11afdb587085 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:18.679604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a9139-2b94-4186-947e-11afdb587085 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:18.679890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a9139-2b94-4186-947e-11afdb587085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:18.700635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-115a9139-2b94-4186-947e-11afdb587085 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:18.702768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-115a9139-2b94-4186-947e-11afdb587085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:18.776609 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1679/3321] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:18.777872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c11eba-3571-46b2-ac07-0f0c83b19bbf None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:18.778162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c11eba-3571-46b2-ac07-0f0c83b19bbf None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:18.778509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c11eba-3571-46b2-ac07-0f0c83b19bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:18.787135 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-31c11eba-3571-46b2-ac07-0f0c83b19bbf None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:18.787135 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:45:18.787135 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:45:18.787135 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:45:18.787135 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:45:18.787135 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:45:18.787135 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:45:18.787135 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:45:18.787135 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:45:18.787135 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:45:18.787135 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:45:18.787135 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:45:18.787135 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:45:18.788195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:45:18.788195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:45:18.788195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:45:18.788195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:45:18.788195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:45:18.788195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:45:18.788195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:45:18.788195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:45:18.788195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:45:18.788195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:45:18.788195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:45:18.788195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:45:18.788195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:45:18.788195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:18.788195 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:45:18.789422 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1680/3322] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:45:18 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:45:18.831818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d9ee4-4c27-4ce6-9389-2be81177adfc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:18.831818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d9ee4-4c27-4ce6-9389-2be81177adfc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:18.831818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d9ee4-4c27-4ce6-9389-2be81177adfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:18.838458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-402dff7f-3c69-4cef-9b85-32a60a0c0ef6 admin admin] The token cache is being invalidate because project bc08332299ea49fe822f7501e09f92ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:18.838458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-402dff7f-3c69-4cef-9b85-32a60a0c0ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.838458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-402dff7f-3c69-4cef-9b85-32a60a0c0ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:18.838458 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1643/3323] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:45:18 2022] DELETE /identity/v3/projects/bc08332299ea49fe822f7501e09f92ef => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:18.838458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1b51e-5855-46f2-b929-e6596813b7bf None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:18.839613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1b51e-5855-46f2-b929-e6596813b7bf None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:18.839613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1b51e-5855-46f2-b929-e6596813b7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:18.839856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-139d9ee4-4c27-4ce6-9389-2be81177adfc None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:18.839856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-139d9ee4-4c27-4ce6-9389-2be81177adfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:18.844263 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1681/3324] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:18.849741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca03951-5e11-4795-b272-a5f0d3c4c8e8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:18.849741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca03951-5e11-4795-b272-a5f0d3c4c8e8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:18.849741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca03951-5e11-4795-b272-a5f0d3c4c8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:18.854037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3ba1b51e-5855-46f2-b929-e6596813b7bf None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:18.855407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3ba1b51e-5855-46f2-b929-e6596813b7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:18.869970 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1644/3325] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:18.871598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c4e0d-7999-4df4-9ba1-569d9dde5ef4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:18.871889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c4e0d-7999-4df4-9ba1-569d9dde5ef4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:18.872181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c4e0d-7999-4df4-9ba1-569d9dde5ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:18.875938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0ca03951-5e11-4795-b272-a5f0d3c4c8e8 None None] MFA Rules not processed for user `918c83baf9594597b600109d02d30e87`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:18.877734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0ca03951-5e11-4795-b272-a5f0d3c4c8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:18.897348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2f5c4e0d-7999-4df4-9ba1-569d9dde5ef4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:18.901415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2f5c4e0d-7999-4df4-9ba1-569d9dde5ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:18.916401 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1645/3326] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:18.918352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3543709-8be7-46cc-918f-eadeb4ceaae9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:18.918811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3543709-8be7-46cc-918f-eadeb4ceaae9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:18.919269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3543709-8be7-46cc-918f-eadeb4ceaae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:18.981646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a3543709-8be7-46cc-918f-eadeb4ceaae9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:18.983014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a3543709-8be7-46cc-918f-eadeb4ceaae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:19.005062 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1646/3327] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:19.005062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3543709-8be7-46cc-918f-eadeb4ceaae9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.010051 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1682/3328] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:19.012285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b2853-d127-4553-971d-23f6ca38ce8a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.013029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b2853-d127-4553-971d-23f6ca38ce8a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.014371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b2853-d127-4553-971d-23f6ca38ce8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.032308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3543709-8be7-46cc-918f-eadeb4ceaae9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.055699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef1657-ddf9-489f-b90e-3129a373b723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.068086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef1657-ddf9-489f-b90e-3129a373b723 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.068086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef1657-ddf9-489f-b90e-3129a373b723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.068086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef1657-ddf9-489f-b90e-3129a373b723 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.069406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2b1b2853-d127-4553-971d-23f6ca38ce8a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:19.069511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef1657-ddf9-489f-b90e-3129a373b723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:19.069511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef1657-ddf9-489f-b90e-3129a373b723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.069776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2b1b2853-d127-4553-971d-23f6ca38ce8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:19.069881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef1657-ddf9-489f-b90e-3129a373b723 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.070934 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1683/3329] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:19.072069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b2853-d127-4553-971d-23f6ca38ce8a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.075549 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1647/3330] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:19.080926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef1657-ddf9-489f-b90e-3129a373b723 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.086128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b2853-d127-4553-971d-23f6ca38ce8a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.093226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bff9b-18bf-45f3-8ebc-3eabecd3931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.095786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef1657-ddf9-489f-b90e-3129a373b723 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.096646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bff9b-18bf-45f3-8ebc-3eabecd3931e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.097209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bff9b-18bf-45f3-8ebc-3eabecd3931e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.097708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bff9b-18bf-45f3-8ebc-3eabecd3931e admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.098807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bff9b-18bf-45f3-8ebc-3eabecd3931e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:19.099548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bff9b-18bf-45f3-8ebc-3eabecd3931e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.107454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bff9b-18bf-45f3-8ebc-3eabecd3931e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.113741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65817a7b-69ea-4e15-9ba9-4069b8468125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.114362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65817a7b-69ea-4e15-9ba9-4069b8468125 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.115178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65817a7b-69ea-4e15-9ba9-4069b8468125 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.115178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65817a7b-69ea-4e15-9ba9-4069b8468125 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.115636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65817a7b-69ea-4e15-9ba9-4069b8468125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:19.115938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65817a7b-69ea-4e15-9ba9-4069b8468125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.118193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65817a7b-69ea-4e15-9ba9-4069b8468125 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.119247 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1684/3331] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:19.120449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bff9b-18bf-45f3-8ebc-3eabecd3931e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.135968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bff9b-18bf-45f3-8ebc-3eabecd3931e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.139788 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1648/3332] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:19.141300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65817a7b-69ea-4e15-9ba9-4069b8468125 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.151503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc88cb-0998-4ae2-acb3-409a1eb2d813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.152598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc88cb-0998-4ae2-acb3-409a1eb2d813 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.152958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc88cb-0998-4ae2-acb3-409a1eb2d813 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.153161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc88cb-0998-4ae2-acb3-409a1eb2d813 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.153814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc88cb-0998-4ae2-acb3-409a1eb2d813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.154658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65817a7b-69ea-4e15-9ba9-4069b8468125 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.155880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc88cb-0998-4ae2-acb3-409a1eb2d813 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.160364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ace534-731a-46fd-885f-79141cce3fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.161879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ace534-731a-46fd-885f-79141cce3fda admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.161879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ace534-731a-46fd-885f-79141cce3fda admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.161879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ace534-731a-46fd-885f-79141cce3fda admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.162294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ace534-731a-46fd-885f-79141cce3fda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.166018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ace534-731a-46fd-885f-79141cce3fda admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.326040 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1649/3333] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:45:19 2022] POST /identity/v3/projects => generated 393 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:19.327396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ace534-731a-46fd-885f-79141cce3fda admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.346010 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1685/3334] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:45:19 2022] POST /identity/v3/projects => generated 377 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:19.346010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc88cb-0998-4ae2-acb3-409a1eb2d813 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.408334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ace534-731a-46fd-885f-79141cce3fda admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.415999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca415e7-b405-4ca1-9df6-2b25fcbeaacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.416805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca415e7-b405-4ca1-9df6-2b25fcbeaacf admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.417069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc88cb-0998-4ae2-acb3-409a1eb2d813 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.417201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca415e7-b405-4ca1-9df6-2b25fcbeaacf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.417500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca415e7-b405-4ca1-9df6-2b25fcbeaacf admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.418217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca415e7-b405-4ca1-9df6-2b25fcbeaacf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.420323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca415e7-b405-4ca1-9df6-2b25fcbeaacf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.422548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587b1c3-9645-4d5d-8db2-92c5a940753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.423164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587b1c3-9645-4d5d-8db2-92c5a940753d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.423446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587b1c3-9645-4d5d-8db2-92c5a940753d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.423743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587b1c3-9645-4d5d-8db2-92c5a940753d admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.424674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587b1c3-9645-4d5d-8db2-92c5a940753d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.426666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587b1c3-9645-4d5d-8db2-92c5a940753d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.630284 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1686/3335] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:45:19 2022] POST /identity/v3/users => generated 297 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:19.631541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b29c9-53a3-4727-b229-63d4a2921740 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.631956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b29c9-53a3-4727-b229-63d4a2921740 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.632390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b29c9-53a3-4727-b229-63d4a2921740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.633321 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1650/3336] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:45:19 2022] POST /identity/v3/projects => generated 381 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:19.635208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca415e7-b405-4ca1-9df6-2b25fcbeaacf admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.639642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-150b29c9-53a3-4727-b229-63d4a2921740 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:19.639642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:45:19.639642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:45:19.639642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:45:19.639642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:45:19.639642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:45:19.639642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:45:19.639642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:45:19.639642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:45:19.639642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:45:19.639642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:45:19.639642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:45:19.639642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:45:19.641621 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:45:19.641621 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:45:19.641621 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:45:19.641621 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:45:19.641621 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:45:19.641621 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:45:19.641621 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:45:19.641621 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:45:19.641621 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:45:19.641621 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:45:19.641621 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:45:19.641621 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:45:19.641621 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:45:19.641621 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:19.641621 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:45:19.642934 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1687/3337] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:45:19 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:45:19.642934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b29c9-53a3-4727-b229-63d4a2921740 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.776990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca415e7-b405-4ca1-9df6-2b25fcbeaacf admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.787171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae745ef-c75d-469a-87c5-4586ff097085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.788622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae745ef-c75d-469a-87c5-4586ff097085 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.789296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae745ef-c75d-469a-87c5-4586ff097085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.792779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae745ef-c75d-469a-87c5-4586ff097085 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.794884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae745ef-c75d-469a-87c5-4586ff097085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.797477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae745ef-c75d-469a-87c5-4586ff097085 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.809208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b29c9-53a3-4727-b229-63d4a2921740 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.815747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7b430-168f-437a-9bfc-ab046a280b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.820523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7b430-168f-437a-9bfc-ab046a280b52 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.820523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7b430-168f-437a-9bfc-ab046a280b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.820523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7b430-168f-437a-9bfc-ab046a280b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.820523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7b430-168f-437a-9bfc-ab046a280b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.820523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7b430-168f-437a-9bfc-ab046a280b52 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.838944 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1688/3338] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:19.838944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7b430-168f-437a-9bfc-ab046a280b52 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:19.870998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7b430-168f-437a-9bfc-ab046a280b52 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:19.877482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d4fec-f08f-46d9-9992-3adb0d0a0975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:19.879049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d4fec-f08f-46d9-9992-3adb0d0a0975 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:19.879601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d4fec-f08f-46d9-9992-3adb0d0a0975 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:19.880252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d4fec-f08f-46d9-9992-3adb0d0a0975 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:19.881353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d4fec-f08f-46d9-9992-3adb0d0a0975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:19.887398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d4fec-f08f-46d9-9992-3adb0d0a0975 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:19.913841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:20.000813 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1651/3339] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:45:19 2022] POST /identity/v3/users => generated 289 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:20.002569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e61885-6350-499c-ae51-e83948444aab None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.003201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e61885-6350-499c-ae51-e83948444aab None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.003827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e61885-6350-499c-ae51-e83948444aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:20.031701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c6e61885-6350-499c-ae51-e83948444aab None None] MFA Rules not processed for user `918c83baf9594597b600109d02d30e87`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:20.032997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c6e61885-6350-499c-ae51-e83948444aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:20.070246 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1689/3340] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:45:19 2022] POST /identity/v3/users => generated 291 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:20.070246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d4fec-f08f-46d9-9992-3adb0d0a0975 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:20.084925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d4fec-f08f-46d9-9992-3adb0d0a0975 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:20.091363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3e268-ce32-425f-af3e-ecc44871c055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:20.092446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3e268-ce32-425f-af3e-ecc44871c055 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.094461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3e268-ce32-425f-af3e-ecc44871c055 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.094863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3e268-ce32-425f-af3e-ecc44871c055 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:20.095788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3e268-ce32-425f-af3e-ecc44871c055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:20.102321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3e268-ce32-425f-af3e-ecc44871c055 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:20.128506 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1690/3341] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:20.128506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3e268-ce32-425f-af3e-ecc44871c055 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:20.134080 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1652/3342] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:20.135300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e61885-6350-499c-ae51-e83948444aab None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:20.141511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3e268-ce32-425f-af3e-ecc44871c055 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:20.146471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d3ce5-9489-432d-8145-52c053764c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:20.147051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3ce5-9489-432d-8145-52c053764c34 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.147887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3ce5-9489-432d-8145-52c053764c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.149101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3ce5-9489-432d-8145-52c053764c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:20.149764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d3ce5-9489-432d-8145-52c053764c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:20.154099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d3ce5-9489-432d-8145-52c053764c34 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:20.158261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e61885-6350-499c-ae51-e83948444aab None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:20.165310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824e281-6743-45db-ac24-a069123e8ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:20.166352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824e281-6743-45db-ac24-a069123e8ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.166995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824e281-6743-45db-ac24-a069123e8ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.167517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824e281-6743-45db-ac24-a069123e8ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:20.170319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824e281-6743-45db-ac24-a069123e8ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:20.172846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824e281-6743-45db-ac24-a069123e8ca1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:20.176386 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1691/3343] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:20.176540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d3ce5-9489-432d-8145-52c053764c34 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:20.192749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d3ce5-9489-432d-8145-52c053764c34 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:20.199280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55107b3a-b543-45e3-9ce6-390a0d32d4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:20.205940 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1653/3344] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:20.206913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55107b3a-b543-45e3-9ce6-390a0d32d4ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.207123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824e281-6743-45db-ac24-a069123e8ca1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:20.207248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55107b3a-b543-45e3-9ce6-390a0d32d4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.207471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55107b3a-b543-45e3-9ce6-390a0d32d4ac admin admin] PATH_INFO: `/v3/projects/2af96350c6f54d8e950515db49bfe636/users/cbe11b2ecfb14310b17134863d58e51e/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:20.232852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55107b3a-b543-45e3-9ce6-390a0d32d4ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af96350c6f54d8e950515db49bfe636, user_id=cbe11b2ecfb14310b17134863d58e51e, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:20.237966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55107b3a-b543-45e3-9ce6-390a0d32d4ac admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:20.255367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824e281-6743-45db-ac24-a069123e8ca1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:20.264472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c3d8d-4c74-4e0e-8842-e2096dacb0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:20.265178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c3d8d-4c74-4e0e-8842-e2096dacb0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.265441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c3d8d-4c74-4e0e-8842-e2096dacb0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.265712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c3d8d-4c74-4e0e-8842-e2096dacb0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:20.266361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c3d8d-4c74-4e0e-8842-e2096dacb0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:20.271130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c3d8d-4c74-4e0e-8842-e2096dacb0a4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:20.316320 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1654/3345] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:20.317496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c3d8d-4c74-4e0e-8842-e2096dacb0a4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:20.330446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c3d8d-4c74-4e0e-8842-e2096dacb0a4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:20.340682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a707706-528e-412c-a79b-836f3c5cb5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:20.342403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a707706-528e-412c-a79b-836f3c5cb5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.342928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a707706-528e-412c-a79b-836f3c5cb5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.343673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a707706-528e-412c-a79b-836f3c5cb5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:20.344437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a707706-528e-412c-a79b-836f3c5cb5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:20.346149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a707706-528e-412c-a79b-836f3c5cb5d6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:20.363396 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1655/3346] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:20.363396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a707706-528e-412c-a79b-836f3c5cb5d6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:20.374279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a707706-528e-412c-a79b-836f3c5cb5d6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:20.379029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f11e70-756c-4f91-9233-6dcf334ef24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:20.379865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f11e70-756c-4f91-9233-6dcf334ef24a admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.380288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f11e70-756c-4f91-9233-6dcf334ef24a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.380786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f11e70-756c-4f91-9233-6dcf334ef24a admin admin] PATH_INFO: `/v3/projects/ba61ff97f8464381935337f271a234e3/users/2243337b74ad4cf09d54d5d86def7361/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:20.404068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f11e70-756c-4f91-9233-6dcf334ef24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba61ff97f8464381935337f271a234e3, user_id=2243337b74ad4cf09d54d5d86def7361, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:20.407141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f11e70-756c-4f91-9233-6dcf334ef24a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:20.489269 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1692/3347] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:45:20 2022] PUT /identity/v3/projects/2af96350c6f54d8e950515db49bfe636/users/cbe11b2ecfb14310b17134863d58e51e/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:20.494188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55107b3a-b543-45e3-9ce6-390a0d32d4ac admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:20.577501 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1656/3348] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:45:20 2022] PUT /identity/v3/projects/ba61ff97f8464381935337f271a234e3/users/2243337b74ad4cf09d54d5d86def7361/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:20.577501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4817556-8826-486d-9112-e96b90e2f63c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.577501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4817556-8826-486d-9112-e96b90e2f63c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.577501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4817556-8826-486d-9112-e96b90e2f63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:20.611209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55107b3a-b543-45e3-9ce6-390a0d32d4ac admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:20.624419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a4817556-8826-486d-9112-e96b90e2f63c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:20.625671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a4817556-8826-486d-9112-e96b90e2f63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:20.707871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716bcd0-e054-4317-9adb-bf476efa31b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:20.707871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716bcd0-e054-4317-9adb-bf476efa31b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.707871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716bcd0-e054-4317-9adb-bf476efa31b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.707871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716bcd0-e054-4317-9adb-bf476efa31b5 admin admin] PATH_INFO: `/v3/projects/fd348d4b04624e0593b80d3897e8e1b4/users/77d45f37045041a8baca21ee3698043e/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:20.708268 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1657/3349] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:20.708268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892b37e-c57a-44fa-a6ad-97fe30a03243 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.708268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892b37e-c57a-44fa-a6ad-97fe30a03243 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.708268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892b37e-c57a-44fa-a6ad-97fe30a03243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:20.716506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716bcd0-e054-4317-9adb-bf476efa31b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd348d4b04624e0593b80d3897e8e1b4, user_id=77d45f37045041a8baca21ee3698043e, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:20.719201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716bcd0-e054-4317-9adb-bf476efa31b5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:20.741185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2892b37e-c57a-44fa-a6ad-97fe30a03243 None None] MFA Rules not processed for user `2243337b74ad4cf09d54d5d86def7361`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:20.744405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2892b37e-c57a-44fa-a6ad-97fe30a03243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:20.832014 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1658/3350] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:20.833344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe2e0b-a79f-4a7d-bfdd-b2f5a1cecbac None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.833628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe2e0b-a79f-4a7d-bfdd-b2f5a1cecbac None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.833898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe2e0b-a79f-4a7d-bfdd-b2f5a1cecbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:20.842426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-3dfe2e0b-a79f-4a7d-bfdd-b2f5a1cecbac None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:20.842426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:45:20.842426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:45:20.842426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:45:20.842426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:45:20.842426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:45:20.842426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:45:20.842426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:45:20.842426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:45:20.842426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:45:20.842426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:45:20.842426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:45:20.842426 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:45:20.843436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:45:20.843436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:45:20.843436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:45:20.843436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:45:20.843436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:45:20.843436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:45:20.843436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:45:20.843436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:45:20.843436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:45:20.843436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:45:20.843436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:45:20.843436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:45:20.843436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:45:20.843436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:20.843436 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:45:20.844493 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1659/3351] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:45:20 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:45:20.844493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe2e0b-a79f-4a7d-bfdd-b2f5a1cecbac None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:20.846037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3dfe2e0b-a79f-4a7d-bfdd-b2f5a1cecbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:20.879721 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1693/3352] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:45:20 2022] PUT /identity/v3/projects/fd348d4b04624e0593b80d3897e8e1b4/users/77d45f37045041a8baca21ee3698043e/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:20.879721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716bcd0-e054-4317-9adb-bf476efa31b5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:20.946453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe2e0b-a79f-4a7d-bfdd-b2f5a1cecbac None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:20.952887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec6457-663c-414e-b94b-3635d0c2db36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:20.953401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716bcd0-e054-4317-9adb-bf476efa31b5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:20.953863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec6457-663c-414e-b94b-3635d0c2db36 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.953863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec6457-663c-414e-b94b-3635d0c2db36 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.953863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec6457-663c-414e-b94b-3635d0c2db36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:20.957463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae51df2-2500-4f4f-b877-9aa9c8f9fdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:20.958076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae51df2-2500-4f4f-b877-9aa9c8f9fdc5 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.958534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae51df2-2500-4f4f-b877-9aa9c8f9fdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.960554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae51df2-2500-4f4f-b877-9aa9c8f9fdc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:20.962706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae51df2-2500-4f4f-b877-9aa9c8f9fdc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:20.962866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec6457-663c-414e-b94b-3635d0c2db36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:20.964231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec6457-663c-414e-b94b-3635d0c2db36 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:20.965838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae51df2-2500-4f4f-b877-9aa9c8f9fdc5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:20.976831 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1660/3353] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:20.978251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4313-5064-440f-9422-c06b27ff2f58 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:20.978601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4313-5064-440f-9422-c06b27ff2f58 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:20.979070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4313-5064-440f-9422-c06b27ff2f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:21.002203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-dffe4313-5064-440f-9422-c06b27ff2f58 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:21.003422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dffe4313-5064-440f-9422-c06b27ff2f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:21.015629 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1661/3354] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:21.015629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60fc5d-22d4-402a-a8f8-5c15d7403487 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:21.015629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60fc5d-22d4-402a-a8f8-5c15d7403487 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:21.015629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60fc5d-22d4-402a-a8f8-5c15d7403487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:21.040901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3c60fc5d-22d4-402a-a8f8-5c15d7403487 None None] MFA Rules not processed for user `918c83baf9594597b600109d02d30e87`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:21.041994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3c60fc5d-22d4-402a-a8f8-5c15d7403487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:21.085865 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1694/3355] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:45:20 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:21.087009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae51df2-2500-4f4f-b877-9aa9c8f9fdc5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:21.088947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8ae51df2-2500-4f4f-b877-9aa9c8f9fdc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:21.114704 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1662/3356] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:21.114704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60fc5d-22d4-402a-a8f8-5c15d7403487 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:21.155276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60fc5d-22d4-402a-a8f8-5c15d7403487 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:21.167599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae51df2-2500-4f4f-b877-9aa9c8f9fdc5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:21.173611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527d8de-9b18-4e3b-88a6-89095b8bdf56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:21.174688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d8de-9b18-4e3b-88a6-89095b8bdf56 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:21.175195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d8de-9b18-4e3b-88a6-89095b8bdf56 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:21.175707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d8de-9b18-4e3b-88a6-89095b8bdf56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:21.243028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283835a1-5898-4ef5-abad-0c55d18a6b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:21.243787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283835a1-5898-4ef5-abad-0c55d18a6b5b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:21.244149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283835a1-5898-4ef5-abad-0c55d18a6b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:21.244533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283835a1-5898-4ef5-abad-0c55d18a6b5b admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:21.245251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283835a1-5898-4ef5-abad-0c55d18a6b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:21.247517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283835a1-5898-4ef5-abad-0c55d18a6b5b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:21.266674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527d8de-9b18-4e3b-88a6-89095b8bdf56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:21.269059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527d8de-9b18-4e3b-88a6-89095b8bdf56 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:21.281889 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1695/3357] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:21.473210 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1663/3358] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:45:21 2022] POST /identity/v3/users => generated 294 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:21.477478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527d8de-9b18-4e3b-88a6-89095b8bdf56 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:21.487760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527d8de-9b18-4e3b-88a6-89095b8bdf56 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:21.504208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399918a3-c7b6-46e2-a5d2-91ae24932404 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:21.510228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399918a3-c7b6-46e2-a5d2-91ae24932404 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:21.510228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399918a3-c7b6-46e2-a5d2-91ae24932404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:21.513089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-399918a3-c7b6-46e2-a5d2-91ae24932404 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:21.513089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:45:21.513089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:45:21.513089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:45:21.513089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:45:21.513089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:45:21.513089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:45:21.513089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:45:21.513089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:45:21.513089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:45:21.513089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:45:21.513089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:45:21.513089 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:45:21.514088 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:45:21.514088 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:45:21.514088 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:45:21.514088 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:45:21.514088 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:45:21.514088 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:45:21.514088 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:45:21.514088 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:45:21.514088 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:45:21.514088 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:45:21.514088 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:45:21.514088 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:45:21.514088 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:45:21.514088 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:21.514088 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:45:21.525084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b85958-b021-4ca4-b9db-d7a0282331e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:21.525084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b85958-b021-4ca4-b9db-d7a0282331e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:21.535894 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1664/3359] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:45:21 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 21 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 04:45:21.548646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b85958-b021-4ca4-b9db-d7a0282331e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:21.548646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b85958-b021-4ca4-b9db-d7a0282331e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:21.548646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b85958-b021-4ca4-b9db-d7a0282331e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:21.548646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b85958-b021-4ca4-b9db-d7a0282331e1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:21.552852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b0781-62e0-4154-9cf9-8db0a0f166f5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:21.552852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b0781-62e0-4154-9cf9-8db0a0f166f5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:21.552852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b0781-62e0-4154-9cf9-8db0a0f166f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:21.579223 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1696/3360] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:21.584334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b85958-b021-4ca4-b9db-d7a0282331e1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:21.609354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-748b0781-62e0-4154-9cf9-8db0a0f166f5 None None] MFA Rules not processed for user `918c83baf9594597b600109d02d30e87`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:21.611038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-748b0781-62e0-4154-9cf9-8db0a0f166f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:21.624405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b85958-b021-4ca4-b9db-d7a0282331e1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:21.639560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39baade8-8347-438e-aab7-cc450fea9b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:21.640492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baade8-8347-438e-aab7-cc450fea9b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:21.640987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baade8-8347-438e-aab7-cc450fea9b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:21.641449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baade8-8347-438e-aab7-cc450fea9b54 admin admin] PATH_INFO: `/v3/projects/21226b3a7e484eeabcf096a561359b08/users/6d835ecb5d3b422e9979ad346163cb1e/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:21.676348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39baade8-8347-438e-aab7-cc450fea9b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21226b3a7e484eeabcf096a561359b08, user_id=6d835ecb5d3b422e9979ad346163cb1e, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:21.679971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39baade8-8347-438e-aab7-cc450fea9b54 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:21.705546 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1665/3361] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:21.820229 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1697/3362] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:45:21 2022] PUT /identity/v3/projects/21226b3a7e484eeabcf096a561359b08/users/6d835ecb5d3b422e9979ad346163cb1e/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:21.824686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b0781-62e0-4154-9cf9-8db0a0f166f5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:21.845617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b0781-62e0-4154-9cf9-8db0a0f166f5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:22.002115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b48064-762b-4c35-910f-e98046937788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:22.003074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b48064-762b-4c35-910f-e98046937788 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:22.003673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b48064-762b-4c35-910f-e98046937788 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:22.003954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b48064-762b-4c35-910f-e98046937788 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:22.004771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b48064-762b-4c35-910f-e98046937788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:22.006585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b48064-762b-4c35-910f-e98046937788 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:22.021658 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1666/3363] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:22.022764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39baade8-8347-438e-aab7-cc450fea9b54 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:22.035300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39baade8-8347-438e-aab7-cc450fea9b54 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:22.044651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebc1bf-8f0f-4aab-aaf2-d9726bb603d6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:22.045338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebc1bf-8f0f-4aab-aaf2-d9726bb603d6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:22.045837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebc1bf-8f0f-4aab-aaf2-d9726bb603d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:22.050358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ff0cc-48ad-4bd2-b578-3c0fc5e31dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:22.053462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ff0cc-48ad-4bd2-b578-3c0fc5e31dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:22.055749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ff0cc-48ad-4bd2-b578-3c0fc5e31dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:22.056254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ff0cc-48ad-4bd2-b578-3c0fc5e31dc3 admin admin] PATH_INFO: `/v3/projects/21226b3a7e484eeabcf096a561359b08/users/6d835ecb5d3b422e9979ad346163cb1e/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:22.062325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ff0cc-48ad-4bd2-b578-3c0fc5e31dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21226b3a7e484eeabcf096a561359b08, user_id=6d835ecb5d3b422e9979ad346163cb1e, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:22.079631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ff0cc-48ad-4bd2-b578-3c0fc5e31dc3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:22.089563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-baebc1bf-8f0f-4aab-aaf2-d9726bb603d6 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:22.093424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-baebc1bf-8f0f-4aab-aaf2-d9726bb603d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:22.115265 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1698/3364] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:45:22 2022] PUT /identity/v3/projects/21226b3a7e484eeabcf096a561359b08/users/6d835ecb5d3b422e9979ad346163cb1e/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:22.127362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dd412-0c49-40c1-a275-1116eeb44cca None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:22.128868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dd412-0c49-40c1-a275-1116eeb44cca None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:22.135509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dd412-0c49-40c1-a275-1116eeb44cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:22.179113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8c0dd412-0c49-40c1-a275-1116eeb44cca None None] MFA Rules not processed for user `6d835ecb5d3b422e9979ad346163cb1e`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:22.180387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8c0dd412-0c49-40c1-a275-1116eeb44cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:22.193022 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1667/3365] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:45:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:22.194663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19681171-aee9-4d7b-ac23-d0871f1d29b6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:22.195006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19681171-aee9-4d7b-ac23-d0871f1d29b6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:22.195496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19681171-aee9-4d7b-ac23-d0871f1d29b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:22.202598 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-19681171-aee9-4d7b-ac23-d0871f1d29b6 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:22.202598 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:45:22.202598 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:45:22.202598 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:45:22.202598 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:45:22.202598 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:45:22.202598 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:45:22.202598 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:45:22.202598 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:45:22.202598 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:45:22.202598 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:45:22.202598 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:45:22.202598 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:45:22.203622 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:45:22.203622 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:45:22.203622 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:45:22.203622 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:45:22.203622 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:45:22.203622 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:45:22.203622 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:45:22.203622 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:45:22.203622 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:45:22.203622 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:45:22.203622 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:45:22.203622 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:45:22.203622 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:45:22.203622 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:22.203622 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:45:22.225993 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1668/3366] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:45:22 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 16 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:45:22.225993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19681171-aee9-4d7b-ac23-d0871f1d29b6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:22.225993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-19681171-aee9-4d7b-ac23-d0871f1d29b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:22.285180 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1699/3367] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:22.285180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cbcd0-d274-4b56-b443-4f0cc0751f86 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:22.285180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cbcd0-d274-4b56-b443-4f0cc0751f86 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:22.285180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cbcd0-d274-4b56-b443-4f0cc0751f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:22.305804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-168cbcd0-d274-4b56-b443-4f0cc0751f86 None None] MFA Rules not processed for user `918c83baf9594597b600109d02d30e87`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:22.307647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-168cbcd0-d274-4b56-b443-4f0cc0751f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:22.320439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19681171-aee9-4d7b-ac23-d0871f1d29b6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:22.326440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6351fd-58ef-4442-be76-651ba93e57a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:22.327062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6351fd-58ef-4442-be76-651ba93e57a3 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:22.327345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6351fd-58ef-4442-be76-651ba93e57a3 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:22.327621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6351fd-58ef-4442-be76-651ba93e57a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:22.338688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6351fd-58ef-4442-be76-651ba93e57a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:22.341117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6351fd-58ef-4442-be76-651ba93e57a3 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:22.354135 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1669/3368] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:45:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:45:22.358143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b50e-ba02-4233-adf7-2606dd5aa8e2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:22.359007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b50e-ba02-4233-adf7-2606dd5aa8e2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:22.359270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b50e-ba02-4233-adf7-2606dd5aa8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:22.384679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4663b50e-ba02-4233-adf7-2606dd5aa8e2 None None] MFA Rules not processed for user `2243337b74ad4cf09d54d5d86def7361`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:22.386194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4663b50e-ba02-4233-adf7-2606dd5aa8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:22.388337 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1700/3369] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:22.480002 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1670/3370] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:22.591390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:22.671202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df3df8-b58b-4222-829b-2beb4de3fc9a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:22.671748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df3df8-b58b-4222-829b-2beb4de3fc9a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:22.671868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df3df8-b58b-4222-829b-2beb4de3fc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:22.682796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-92df3df8-b58b-4222-829b-2beb4de3fc9a None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:22.682796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:45:22.682796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:45:22.682796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:45:22.682796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:45:22.682796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:45:22.682796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:45:22.682796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:45:22.682796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:45:22.682796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:45:22.682796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:45:22.682796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:45:22.682796 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:45:22.683883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:45:22.683883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:45:22.683883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:45:22.683883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:45:22.683883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:45:22.683883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:45:22.683883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:45:22.683883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:45:22.683883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:45:22.683883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:45:22.683883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:45:22.683883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:45:22.683883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:45:22.683883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:22.683883 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:45:22.685017 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1701/3371] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:45:22 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:45:22.724003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663b50e-ba02-4233-adf7-2606dd5aa8e2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:22.728949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4663b50e-ba02-4233-adf7-2606dd5aa8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:22.845127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663b50e-ba02-4233-adf7-2606dd5aa8e2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:22.855287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb03496-8d22-45db-8f9b-5b63ec4d2a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:22.855924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb03496-8d22-45db-8f9b-5b63ec4d2a76 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:22.856918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb03496-8d22-45db-8f9b-5b63ec4d2a76 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:22.857193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb03496-8d22-45db-8f9b-5b63ec4d2a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:22.871835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb03496-8d22-45db-8f9b-5b63ec4d2a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:22.873498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb03496-8d22-45db-8f9b-5b63ec4d2a76 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:22.884025 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1671/3372] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:24.060698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:24.338141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6ba05-9f96-4db0-822f-0597eb212103 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:24.340993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6ba05-9f96-4db0-822f-0597eb212103 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:24.340993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6ba05-9f96-4db0-822f-0597eb212103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:24.420777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1be6ba05-9f96-4db0-822f-0597eb212103 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:24.424364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1be6ba05-9f96-4db0-822f-0597eb212103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:24.435370 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1702/3373] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:45:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:24.454849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb03496-8d22-45db-8f9b-5b63ec4d2a76 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:24.467868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb03496-8d22-45db-8f9b-5b63ec4d2a76 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:24.478538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31893993-1d66-4e81-96c7-9f6b9972b198 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:24.484379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31893993-1d66-4e81-96c7-9f6b9972b198 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:24.484379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31893993-1d66-4e81-96c7-9f6b9972b198 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:24.484379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31893993-1d66-4e81-96c7-9f6b9972b198 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:24.495789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31893993-1d66-4e81-96c7-9f6b9972b198 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:24.498407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31893993-1d66-4e81-96c7-9f6b9972b198 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:24.521359 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1672/3374] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:45:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:45:26.843784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd80a2-4698-4257-9508-cc29fa8c0282 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:26.844819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd80a2-4698-4257-9508-cc29fa8c0282 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:26.845341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd80a2-4698-4257-9508-cc29fa8c0282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:26.892011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-93fd80a2-4698-4257-9508-cc29fa8c0282 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:26.894580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-93fd80a2-4698-4257-9508-cc29fa8c0282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:26.919507 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1703/3375] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:45:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:26.935132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31893993-1d66-4e81-96c7-9f6b9972b198 service swift] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:26.967058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31893993-1d66-4e81-96c7-9f6b9972b198 service swift] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:26.976756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:26.991319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8252f5-0595-48c6-a40d-2c5eb0cf016b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:26.993582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8252f5-0595-48c6-a40d-2c5eb0cf016b service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:26.996089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8252f5-0595-48c6-a40d-2c5eb0cf016b service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:26.996618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8252f5-0595-48c6-a40d-2c5eb0cf016b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:27.017782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8252f5-0595-48c6-a40d-2c5eb0cf016b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:27.023782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8252f5-0595-48c6-a40d-2c5eb0cf016b service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:27.037002 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1673/3376] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:45:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:45:28.503871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:29.031687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd80a2-4698-4257-9508-cc29fa8c0282 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:29.033538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-93fd80a2-4698-4257-9508-cc29fa8c0282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:29.142908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd80a2-4698-4257-9508-cc29fa8c0282 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:29.160203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fbb4d-a700-48cc-8cc6-34c90d7dc4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:29.169275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fbb4d-a700-48cc-8cc6-34c90d7dc4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:29.169275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fbb4d-a700-48cc-8cc6-34c90d7dc4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:29.169275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fbb4d-a700-48cc-8cc6-34c90d7dc4a0 admin admin] PATH_INFO: `/v3/users/918c83baf9594597b600109d02d30e87` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:29.169275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fbb4d-a700-48cc-8cc6-34c90d7dc4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=918c83baf9594597b600109d02d30e87)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:29.175660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fbb4d-a700-48cc-8cc6-34c90d7dc4a0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:29.468732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-402fbb4d-a700-48cc-8cc6-34c90d7dc4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918c83baf9594597b600109d02d30e87'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:29.470430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-402fbb4d-a700-48cc-8cc6-34c90d7dc4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918c83baf9594597b600109d02d30e87'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:29.633080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-402fbb4d-a700-48cc-8cc6-34c90d7dc4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918c83baf9594597b600109d02d30e87'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:29.642863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-402fbb4d-a700-48cc-8cc6-34c90d7dc4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918c83baf9594597b600109d02d30e87'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:29.672872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-402fbb4d-a700-48cc-8cc6-34c90d7dc4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918c83baf9594597b600109d02d30e87'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:29.715811 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1704/3377] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:45:29 2022] DELETE /identity/v3/users/918c83baf9594597b600109d02d30e87 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:30.262146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:31.053552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8252f5-0595-48c6-a40d-2c5eb0cf016b service swift] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:31.070602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8252f5-0595-48c6-a40d-2c5eb0cf016b service swift] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:31.140351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:31.226194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693aa19a-3250-4f84-b200-34e3d960c214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:31.239038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aa19a-3250-4f84-b200-34e3d960c214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:31.241819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aa19a-3250-4f84-b200-34e3d960c214 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:31.242038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aa19a-3250-4f84-b200-34e3d960c214 admin admin] PATH_INFO: `/v3/projects/69cabedeede3400e97dc66f4cd3e1e26` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:31.244701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693aa19a-3250-4f84-b200-34e3d960c214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69cabedeede3400e97dc66f4cd3e1e26)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:31.246883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693aa19a-3250-4f84-b200-34e3d960c214 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:31.425174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-693aa19a-3250-4f84-b200-34e3d960c214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69cabedeede3400e97dc66f4cd3e1e26', 'request_id': 'req-693aa19a-3250-4f84-b200-34e3d960c214'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:31.439331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-693aa19a-3250-4f84-b200-34e3d960c214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69cabedeede3400e97dc66f4cd3e1e26', 'request_id': 'req-693aa19a-3250-4f84-b200-34e3d960c214'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:31.456338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-693aa19a-3250-4f84-b200-34e3d960c214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69cabedeede3400e97dc66f4cd3e1e26', 'request_id': 'req-693aa19a-3250-4f84-b200-34e3d960c214'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:31.532901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-693aa19a-3250-4f84-b200-34e3d960c214 admin admin] The token cache is being invalidate because project 69cabedeede3400e97dc66f4cd3e1e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:31.946492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-693aa19a-3250-4f84-b200-34e3d960c214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:31.946492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-693aa19a-3250-4f84-b200-34e3d960c214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:31.946492 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1674/3378] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:45:31 2022] DELETE /identity/v3/projects/69cabedeede3400e97dc66f4cd3e1e26 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:31.997028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed90b9e-1440-45ee-84d7-e527dd40d857 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:31.997028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed90b9e-1440-45ee-84d7-e527dd40d857 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:31.997028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed90b9e-1440-45ee-84d7-e527dd40d857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:31.997028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9ed90b9e-1440-45ee-84d7-e527dd40d857 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:31.997028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9ed90b9e-1440-45ee-84d7-e527dd40d857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:31.997028 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1705/3379] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:32.001534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99610f6-aef2-4dcc-ac62-3b2b42fe68a4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:32.001534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99610f6-aef2-4dcc-ac62-3b2b42fe68a4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:32.001534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99610f6-aef2-4dcc-ac62-3b2b42fe68a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:32.001534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b99610f6-aef2-4dcc-ac62-3b2b42fe68a4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:32.001534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b99610f6-aef2-4dcc-ac62-3b2b42fe68a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:32.001534 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1675/3380] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:32.003510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed90b9e-1440-45ee-84d7-e527dd40d857 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:32.003510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed90b9e-1440-45ee-84d7-e527dd40d857 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:32.003510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d27f9d-71d5-4614-8216-0e7f3b75f260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:32.003510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d27f9d-71d5-4614-8216-0e7f3b75f260 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:32.005463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d27f9d-71d5-4614-8216-0e7f3b75f260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:32.005463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d27f9d-71d5-4614-8216-0e7f3b75f260 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:32.005463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d27f9d-71d5-4614-8216-0e7f3b75f260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:32.005463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d27f9d-71d5-4614-8216-0e7f3b75f260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:32.005463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d27f9d-71d5-4614-8216-0e7f3b75f260 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:32.006621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:32.006948 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1706/3381] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:32.007236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99610f6-aef2-4dcc-ac62-3b2b42fe68a4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:32.007236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99610f6-aef2-4dcc-ac62-3b2b42fe68a4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:32.009654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac1418-5062-4e9c-9d32-66a3363be96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:32.010224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac1418-5062-4e9c-9d32-66a3363be96b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:32.010507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac1418-5062-4e9c-9d32-66a3363be96b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:32.010780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac1418-5062-4e9c-9d32-66a3363be96b admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:32.011747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac1418-5062-4e9c-9d32-66a3363be96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:32.013428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac1418-5062-4e9c-9d32-66a3363be96b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:32.193977 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1676/3382] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:45:31 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:32.195176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d27f9d-71d5-4614-8216-0e7f3b75f260 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:32.207392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d27f9d-71d5-4614-8216-0e7f3b75f260 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:32.334172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39f8a0-5dee-4d00-ac57-ee3a636eabc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:32.336201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39f8a0-5dee-4d00-ac57-ee3a636eabc8 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:32.339122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39f8a0-5dee-4d00-ac57-ee3a636eabc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:32.339122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39f8a0-5dee-4d00-ac57-ee3a636eabc8 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:32.339122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c39f8a0-5dee-4d00-ac57-ee3a636eabc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:32.339583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c39f8a0-5dee-4d00-ac57-ee3a636eabc8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:32.432910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac1418-5062-4e9c-9d32-66a3363be96b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:32.433765 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1707/3383] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:45:32 2022] POST /identity/v3/users => generated 287 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:32.450000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac1418-5062-4e9c-9d32-66a3363be96b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:32.462775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c57eca-57a6-46f5-aa31-ad232c79bea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:32.464378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c57eca-57a6-46f5-aa31-ad232c79bea3 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:32.464908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c57eca-57a6-46f5-aa31-ad232c79bea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:32.465431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c57eca-57a6-46f5-aa31-ad232c79bea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:32.466502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c57eca-57a6-46f5-aa31-ad232c79bea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:32.472520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c57eca-57a6-46f5-aa31-ad232c79bea3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:32.503194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39f8a0-5dee-4d00-ac57-ee3a636eabc8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:32.503499 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1677/3384] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:32.536872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39f8a0-5dee-4d00-ac57-ee3a636eabc8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:32.561683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e7250-f48f-4228-895c-e6c4b5fd10d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:32.562225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e7250-f48f-4228-895c-e6c4b5fd10d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:32.562515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e7250-f48f-4228-895c-e6c4b5fd10d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:32.562972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e7250-f48f-4228-895c-e6c4b5fd10d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:32.563630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e7250-f48f-4228-895c-e6c4b5fd10d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:32.565278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e7250-f48f-4228-895c-e6c4b5fd10d7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:32.597462 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1708/3385] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:32.599604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c57eca-57a6-46f5-aa31-ad232c79bea3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:32.620907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c57eca-57a6-46f5-aa31-ad232c79bea3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:32.633314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196b32a-7018-4729-8776-764643966223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:32.634439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196b32a-7018-4729-8776-764643966223 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:32.635013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196b32a-7018-4729-8776-764643966223 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:32.635520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196b32a-7018-4729-8776-764643966223 admin admin] PATH_INFO: `/v3/projects/f48d18e5655d4b149d95044a5a9831ba/users/01c948ccddaa4a33a764b003826969fe/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:32.658636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196b32a-7018-4729-8776-764643966223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48d18e5655d4b149d95044a5a9831ba, user_id=01c948ccddaa4a33a764b003826969fe, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:32.661698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196b32a-7018-4729-8776-764643966223 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:32.764400 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1678/3386] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:45:32 2022] PUT /identity/v3/projects/f48d18e5655d4b149d95044a5a9831ba/users/01c948ccddaa4a33a764b003826969fe/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:32.777060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a8cad-9bf1-4092-a37a-cf75001ef9ce None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:32.795785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a8cad-9bf1-4092-a37a-cf75001ef9ce None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:32.795785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a8cad-9bf1-4092-a37a-cf75001ef9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:32.836058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0b0a8cad-9bf1-4092-a37a-cf75001ef9ce None None] MFA Rules not processed for user `01c948ccddaa4a33a764b003826969fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:32.837502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0b0a8cad-9bf1-4092-a37a-cf75001ef9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:32.945380 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1709/3387] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:32.946757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caa64e-8dc2-4005-af51-638af1f6ccee None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:32.947111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caa64e-8dc2-4005-af51-638af1f6ccee None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:32.947462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caa64e-8dc2-4005-af51-638af1f6ccee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:32.977823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-67caa64e-8dc2-4005-af51-638af1f6ccee None None] MFA Rules not processed for user `01c948ccddaa4a33a764b003826969fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:32.979266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-67caa64e-8dc2-4005-af51-638af1f6ccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:32.992691 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1679/3388] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:33.076397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a8cad-9bf1-4092-a37a-cf75001ef9ce None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:33.078343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0b0a8cad-9bf1-4092-a37a-cf75001ef9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:33.193666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:33.257821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a8cad-9bf1-4092-a37a-cf75001ef9ce None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:33.264530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f16eee-7854-4f01-adfc-1aeb3804cd65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:33.265388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f16eee-7854-4f01-adfc-1aeb3804cd65 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:33.265971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f16eee-7854-4f01-adfc-1aeb3804cd65 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:33.266343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f16eee-7854-4f01-adfc-1aeb3804cd65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:33.285931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f16eee-7854-4f01-adfc-1aeb3804cd65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:33.288367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f16eee-7854-4f01-adfc-1aeb3804cd65 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:33.314422 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1710/3389] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:33.512597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:33.520124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39734-5b68-4ba8-af78-2ff2dc0db1b3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:33.520517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39734-5b68-4ba8-af78-2ff2dc0db1b3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:33.520859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39734-5b68-4ba8-af78-2ff2dc0db1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:33.530221 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-33b39734-5b68-4ba8-af78-2ff2dc0db1b3 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:33.530221 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:45:33.530221 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:45:33.530221 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:45:33.530221 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:45:33.530221 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:45:33.530221 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:45:33.530221 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:45:33.530221 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:45:33.530221 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:45:33.530221 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:45:33.530221 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:45:33.530221 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:45:33.531319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:45:33.531319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:45:33.531319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:45:33.531319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:45:33.531319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:45:33.531319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:45:33.531319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:45:33.531319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:45:33.531319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:45:33.531319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:45:33.531319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:45:33.531319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:45:33.531319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:45:33.531319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:33.531319 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:45:33.549071 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1680/3390] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:45:33 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 23 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 04:45:34.539293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:35.265652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:35.614280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e0382-a704-4a8d-b560-03a7cde45da8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:35.614849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e0382-a704-4a8d-b560-03a7cde45da8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:35.615369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e0382-a704-4a8d-b560-03a7cde45da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:35.675049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-394e0382-a704-4a8d-b560-03a7cde45da8 None None] MFA Rules not processed for user `cbe11b2ecfb14310b17134863d58e51e`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:35.677328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-394e0382-a704-4a8d-b560-03a7cde45da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:35.875270 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1711/3391] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:36.116992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b39734-5b68-4ba8-af78-2ff2dc0db1b3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:36.145830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:36.152241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b39734-5b68-4ba8-af78-2ff2dc0db1b3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:36.179376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484edd51-2f78-422f-a4b3-684ecee48908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:36.180146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484edd51-2f78-422f-a4b3-684ecee48908 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:36.182290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484edd51-2f78-422f-a4b3-684ecee48908 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:36.182861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484edd51-2f78-422f-a4b3-684ecee48908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:36.206094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484edd51-2f78-422f-a4b3-684ecee48908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:36.211750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484edd51-2f78-422f-a4b3-684ecee48908 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:36.236268 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1681/3392] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:36 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:36.317237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:37.747578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:37.812571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b11433-5733-4f0c-9f6b-f4a21688c9fa None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:37.812852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b11433-5733-4f0c-9f6b-f4a21688c9fa None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:37.813125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b11433-5733-4f0c-9f6b-f4a21688c9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:37.854304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b6b11433-5733-4f0c-9f6b-f4a21688c9fa None None] MFA Rules not processed for user `77d45f37045041a8baca21ee3698043e`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:37.855546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b6b11433-5733-4f0c-9f6b-f4a21688c9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:38.049633 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1712/3393] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:38.051408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601c71d-6469-4435-846d-b1d21c710df2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:38.051876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601c71d-6469-4435-846d-b1d21c710df2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:38.052113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601c71d-6469-4435-846d-b1d21c710df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:38.087300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c601c71d-6469-4435-846d-b1d21c710df2 None None] MFA Rules not processed for user `77d45f37045041a8baca21ee3698043e`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:38.088588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c601c71d-6469-4435-846d-b1d21c710df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:38.105652 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1682/3394] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:38.242180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b11433-5733-4f0c-9f6b-f4a21688c9fa None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:38.283649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b11433-5733-4f0c-9f6b-f4a21688c9fa None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:38.297414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b935a6-5967-4d9a-89e7-ad8efc09e3e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:38.298051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b935a6-5967-4d9a-89e7-ad8efc09e3e4 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:38.298604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b935a6-5967-4d9a-89e7-ad8efc09e3e4 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:38.300432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b935a6-5967-4d9a-89e7-ad8efc09e3e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:38.313086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b935a6-5967-4d9a-89e7-ad8efc09e3e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:38.315098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b935a6-5967-4d9a-89e7-ad8efc09e3e4 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:38.367743 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1713/3395] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:39.114111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a200c1-de10-4850-9dea-001aed82baa0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:39.114692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a200c1-de10-4850-9dea-001aed82baa0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:39.114692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a200c1-de10-4850-9dea-001aed82baa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:39.122130 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-c0a200c1-de10-4850-9dea-001aed82baa0 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:39.122130 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:45:39.122130 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:45:39.122130 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:45:39.122130 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:45:39.122130 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:45:39.122130 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:45:39.122130 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:45:39.122130 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:45:39.122130 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:45:39.122130 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:45:39.122130 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:45:39.122130 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:45:39.123521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:45:39.123521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:45:39.123521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:45:39.123521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:45:39.123521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:45:39.123521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:45:39.123521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:45:39.123521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:45:39.123521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:45:39.123521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:45:39.123521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:45:39.123521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:45:39.123521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:45:39.123521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:39.123521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:45:39.127570 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1683/3396] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:45:39 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:45:39.415583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:46.073620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b935a6-5967-4d9a-89e7-ad8efc09e3e4 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:46.075416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-43b935a6-5967-4d9a-89e7-ad8efc09e3e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:46.278071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b935a6-5967-4d9a-89e7-ad8efc09e3e4 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:46.294269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cdcbd-73ce-4cf4-90d9-b58ca440a234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:46.296654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cdcbd-73ce-4cf4-90d9-b58ca440a234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:46.296940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cdcbd-73ce-4cf4-90d9-b58ca440a234 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:46.297669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cdcbd-73ce-4cf4-90d9-b58ca440a234 admin admin] PATH_INFO: `/v3/users/3182a04be19f4db586a6dbe1c53b9bdd` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:46.299323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cdcbd-73ce-4cf4-90d9-b58ca440a234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3182a04be19f4db586a6dbe1c53b9bdd)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:46.301482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cdcbd-73ce-4cf4-90d9-b58ca440a234 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:46.554383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:46.586413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ba0cdcbd-73ce-4cf4-90d9-b58ca440a234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3182a04be19f4db586a6dbe1c53b9bdd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:46.587557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ba0cdcbd-73ce-4cf4-90d9-b58ca440a234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3182a04be19f4db586a6dbe1c53b9bdd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:46.696492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ba0cdcbd-73ce-4cf4-90d9-b58ca440a234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3182a04be19f4db586a6dbe1c53b9bdd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:46.697165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ba0cdcbd-73ce-4cf4-90d9-b58ca440a234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3182a04be19f4db586a6dbe1c53b9bdd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:46.726920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ba0cdcbd-73ce-4cf4-90d9-b58ca440a234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3182a04be19f4db586a6dbe1c53b9bdd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:46.742319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ada13-dbeb-492b-8e28-c3960def6083 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:46.743315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ada13-dbeb-492b-8e28-c3960def6083 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:46.743777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ada13-dbeb-492b-8e28-c3960def6083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:46.779070 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1714/3397] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:45:46 2022] DELETE /identity/v3/users/3182a04be19f4db586a6dbe1c53b9bdd => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:46.791373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-aa1ada13-dbeb-492b-8e28-c3960def6083 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:46.793067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aa1ada13-dbeb-492b-8e28-c3960def6083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:46.902485 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1684/3398] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:45:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:46.930672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cdcbd-73ce-4cf4-90d9-b58ca440a234 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:46.932495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ba0cdcbd-73ce-4cf4-90d9-b58ca440a234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:47.158210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cdcbd-73ce-4cf4-90d9-b58ca440a234 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:47.186722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b3e75-432b-404d-b498-e7d880e69c91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:47.187891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b3e75-432b-404d-b498-e7d880e69c91 service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:47.190360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b3e75-432b-404d-b498-e7d880e69c91 service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:47.190360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b3e75-432b-404d-b498-e7d880e69c91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:47.204566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b3e75-432b-404d-b498-e7d880e69c91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:47.206617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b3e75-432b-404d-b498-e7d880e69c91 service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:47.244489 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1715/3399] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:45:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:45:47.319761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ada13-dbeb-492b-8e28-c3960def6083 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:47.321596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aa1ada13-dbeb-492b-8e28-c3960def6083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:47.431391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ada13-dbeb-492b-8e28-c3960def6083 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:47.440774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3740ff3-4d93-445d-88a6-c622172ba557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:47.440774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3740ff3-4d93-445d-88a6-c622172ba557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:47.440774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3740ff3-4d93-445d-88a6-c622172ba557 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:47.440774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3740ff3-4d93-445d-88a6-c622172ba557 admin admin] PATH_INFO: `/v3/projects/4b1fca82aba64e7197467816e31033bb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:47.442013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3740ff3-4d93-445d-88a6-c622172ba557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1fca82aba64e7197467816e31033bb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:47.443941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3740ff3-4d93-445d-88a6-c622172ba557 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:47.459300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:47.628571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3740ff3-4d93-445d-88a6-c622172ba557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1fca82aba64e7197467816e31033bb', 'request_id': 'req-f3740ff3-4d93-445d-88a6-c622172ba557'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.649284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3740ff3-4d93-445d-88a6-c622172ba557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1fca82aba64e7197467816e31033bb', 'request_id': 'req-f3740ff3-4d93-445d-88a6-c622172ba557'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.656454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3740ff3-4d93-445d-88a6-c622172ba557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1fca82aba64e7197467816e31033bb', 'request_id': 'req-f3740ff3-4d93-445d-88a6-c622172ba557'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.758024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3740ff3-4d93-445d-88a6-c622172ba557 admin admin] The token cache is being invalidate because project 4b1fca82aba64e7197467816e31033bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:47.758768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3740ff3-4d93-445d-88a6-c622172ba557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.760569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3740ff3-4d93-445d-88a6-c622172ba557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:47.775562 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1685/3400] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:45:47 2022] DELETE /identity/v3/projects/4b1fca82aba64e7197467816e31033bb => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:47.777080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbcf9b-fa12-428b-966f-550a2980bbda None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:47.777313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbcf9b-fa12-428b-966f-550a2980bbda None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:47.777505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbcf9b-fa12-428b-966f-550a2980bbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:47.824668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-50bbcf9b-fa12-428b-966f-550a2980bbda None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:47.825823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-50bbcf9b-fa12-428b-966f-550a2980bbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:47.994175 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1716/3401] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:48.001862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7a032-f846-4583-bc76-ac443095e21b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:48.002659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7a032-f846-4583-bc76-ac443095e21b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:48.003211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7a032-f846-4583-bc76-ac443095e21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:48.021593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca194c40-227c-44df-ac30-7411c58ff8dc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:48.022323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca194c40-227c-44df-ac30-7411c58ff8dc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:48.022323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca194c40-227c-44df-ac30-7411c58ff8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:48.034176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-78a7a032-f846-4583-bc76-ac443095e21b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:48.035704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-78a7a032-f846-4583-bc76-ac443095e21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:48.049774 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1686/3402] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:48.056287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7a032-f846-4583-bc76-ac443095e21b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:48.067641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ca194c40-227c-44df-ac30-7411c58ff8dc None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:48.067641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ca194c40-227c-44df-ac30-7411c58ff8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:48.073000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7a032-f846-4583-bc76-ac443095e21b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:48.085562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ceb38d-b22f-40aa-bd2d-1e32185ba90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:48.086709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ceb38d-b22f-40aa-bd2d-1e32185ba90d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:48.087239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ceb38d-b22f-40aa-bd2d-1e32185ba90d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:48.087753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ceb38d-b22f-40aa-bd2d-1e32185ba90d admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:48.088700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ceb38d-b22f-40aa-bd2d-1e32185ba90d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:48.089324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ceb38d-b22f-40aa-bd2d-1e32185ba90d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:48.091366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ceb38d-b22f-40aa-bd2d-1e32185ba90d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:48.114134 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1687/3403] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:48.119739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ceb38d-b22f-40aa-bd2d-1e32185ba90d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:48.140285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ceb38d-b22f-40aa-bd2d-1e32185ba90d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:48.151191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e70deb-a296-4e98-b538-005897fa5c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:48.152042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e70deb-a296-4e98-b538-005897fa5c16 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:48.152542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e70deb-a296-4e98-b538-005897fa5c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:48.153557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e70deb-a296-4e98-b538-005897fa5c16 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:48.154603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e70deb-a296-4e98-b538-005897fa5c16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:48.156817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e70deb-a296-4e98-b538-005897fa5c16 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:48.186596 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1717/3404] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:45:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:48.201545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca194c40-227c-44df-ac30-7411c58ff8dc None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:48.203531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ca194c40-227c-44df-ac30-7411c58ff8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:48.291388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca194c40-227c-44df-ac30-7411c58ff8dc None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:48.296884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc679f02-b0d5-4dee-b990-9c48ce3ce405 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:48.297757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc679f02-b0d5-4dee-b990-9c48ce3ce405 service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:48.298042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc679f02-b0d5-4dee-b990-9c48ce3ce405 service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:48.298506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc679f02-b0d5-4dee-b990-9c48ce3ce405 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:48.309128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc679f02-b0d5-4dee-b990-9c48ce3ce405 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:48.310926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc679f02-b0d5-4dee-b990-9c48ce3ce405 service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:48.311644 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1688/3405] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:45:48 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:48.316059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e70deb-a296-4e98-b538-005897fa5c16 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:48.331209 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1718/3406] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:45:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:45:48.364400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:48.438916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e70deb-a296-4e98-b538-005897fa5c16 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:48.444530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c6f70-0905-42d6-b103-5469a60ed8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:48.447738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c6f70-0905-42d6-b103-5469a60ed8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:48.447738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c6f70-0905-42d6-b103-5469a60ed8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:48.447738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c6f70-0905-42d6-b103-5469a60ed8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:48.447738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c6f70-0905-42d6-b103-5469a60ed8e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:48.449078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c6f70-0905-42d6-b103-5469a60ed8e0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:48.564423 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1689/3407] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:45:48 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:48.565960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc679f02-b0d5-4dee-b990-9c48ce3ce405 service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:48.578014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc679f02-b0d5-4dee-b990-9c48ce3ce405 service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:48.582860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff483ab-0a71-4cff-bfc7-16c48454e926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:48.590298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff483ab-0a71-4cff-bfc7-16c48454e926 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:48.590298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff483ab-0a71-4cff-bfc7-16c48454e926 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:48.590298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff483ab-0a71-4cff-bfc7-16c48454e926 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:48.590298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff483ab-0a71-4cff-bfc7-16c48454e926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:48.590298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff483ab-0a71-4cff-bfc7-16c48454e926 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:48.598878 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1719/3408] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:45:48.604335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c6f70-0905-42d6-b103-5469a60ed8e0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:48.616577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c6f70-0905-42d6-b103-5469a60ed8e0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:48.621559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc551011-aa56-40ca-9b61-3b42c227460a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:48.622172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc551011-aa56-40ca-9b61-3b42c227460a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:48.622455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc551011-aa56-40ca-9b61-3b42c227460a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:48.622732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc551011-aa56-40ca-9b61-3b42c227460a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:48.623405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc551011-aa56-40ca-9b61-3b42c227460a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:48.625169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc551011-aa56-40ca-9b61-3b42c227460a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:48.636459 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1690/3409] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:48.640628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff483ab-0a71-4cff-bfc7-16c48454e926 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:48.653516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff483ab-0a71-4cff-bfc7-16c48454e926 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:48.659247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243d74d-260f-4f88-94a9-ee3f829b0431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:48.660054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243d74d-260f-4f88-94a9-ee3f829b0431 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:48.660387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243d74d-260f-4f88-94a9-ee3f829b0431 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:48.660663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243d74d-260f-4f88-94a9-ee3f829b0431 admin admin] PATH_INFO: `/v3/projects/a397128fb9fd47feb1a5a57b9497c0be/users/6190ea907d0544438eb3491462cfc49b/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:48.688913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243d74d-260f-4f88-94a9-ee3f829b0431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a397128fb9fd47feb1a5a57b9497c0be, user_id=6190ea907d0544438eb3491462cfc49b, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:48.692734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243d74d-260f-4f88-94a9-ee3f829b0431 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:48.724203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc551011-aa56-40ca-9b61-3b42c227460a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:48.726719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fc551011-aa56-40ca-9b61-3b42c227460a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:48.746772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc551011-aa56-40ca-9b61-3b42c227460a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:48.759213 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1720/3410] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:45:48 2022] PUT /identity/v3/projects/a397128fb9fd47feb1a5a57b9497c0be/users/6190ea907d0544438eb3491462cfc49b/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:48.763520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243d74d-260f-4f88-94a9-ee3f829b0431 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:48.772058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7243d74d-260f-4f88-94a9-ee3f829b0431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:48.772241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863113e-0a48-4a45-80a2-48f837b1c33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:48.772241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863113e-0a48-4a45-80a2-48f837b1c33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:48.772241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863113e-0a48-4a45-80a2-48f837b1c33e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:48.772241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863113e-0a48-4a45-80a2-48f837b1c33e admin admin] PATH_INFO: `/v3/users/429a0f884ff149d19932610ddaeecf9a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:48.773146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863113e-0a48-4a45-80a2-48f837b1c33e admin admin] RBAC: Authorizing `identity:delete_user(user_id=429a0f884ff149d19932610ddaeecf9a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:48.774519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863113e-0a48-4a45-80a2-48f837b1c33e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:48.864878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243d74d-260f-4f88-94a9-ee3f829b0431 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:48.871198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a9cde-803a-4768-b135-bb395131cf37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:48.872062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a9cde-803a-4768-b135-bb395131cf37 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:48.872463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a9cde-803a-4768-b135-bb395131cf37 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:48.872816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a9cde-803a-4768-b135-bb395131cf37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:48.875113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e11a9cde-803a-4768-b135-bb395131cf37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:49.001976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a9cde-803a-4768-b135-bb395131cf37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:49.007115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a9cde-803a-4768-b135-bb395131cf37 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:49.014470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d863113e-0a48-4a45-80a2-48f837b1c33e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '429a0f884ff149d19932610ddaeecf9a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.032955 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1721/3411] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:49.034330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b33147-05e3-49c0-9725-3f47fcf289f1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:49.034627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b33147-05e3-49c0-9725-3f47fcf289f1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:49.034945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b33147-05e3-49c0-9725-3f47fcf289f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:49.070372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-81b33147-05e3-49c0-9725-3f47fcf289f1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:49.073494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-81b33147-05e3-49c0-9725-3f47fcf289f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:49.128627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d863113e-0a48-4a45-80a2-48f837b1c33e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '429a0f884ff149d19932610ddaeecf9a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.129729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d863113e-0a48-4a45-80a2-48f837b1c33e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '429a0f884ff149d19932610ddaeecf9a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.142991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d863113e-0a48-4a45-80a2-48f837b1c33e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '429a0f884ff149d19932610ddaeecf9a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.190194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d863113e-0a48-4a45-80a2-48f837b1c33e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '429a0f884ff149d19932610ddaeecf9a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:49.215490 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1691/3412] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:45:48 2022] DELETE /identity/v3/users/429a0f884ff149d19932610ddaeecf9a => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:49.221007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86019f10-ae9d-41f5-a731-766449b240fd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:49.222141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86019f10-ae9d-41f5-a731-766449b240fd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:49.223022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86019f10-ae9d-41f5-a731-766449b240fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:49.230872 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1722/3413] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:49.233456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baf235-a395-4c1e-af7b-4fd73b0f8ff1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:49.236551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baf235-a395-4c1e-af7b-4fd73b0f8ff1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:49.238839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baf235-a395-4c1e-af7b-4fd73b0f8ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:49.287330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-86019f10-ae9d-41f5-a731-766449b240fd None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:49.289355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-86019f10-ae9d-41f5-a731-766449b240fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:49.304592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-86baf235-a395-4c1e-af7b-4fd73b0f8ff1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:49.305819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-86baf235-a395-4c1e-af7b-4fd73b0f8ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:49.413394 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1692/3414] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:45:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:49.416527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86019f10-ae9d-41f5-a731-766449b240fd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:49.419122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-86019f10-ae9d-41f5-a731-766449b240fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:49.473318 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1723/3415] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:49.473938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baf235-a395-4c1e-af7b-4fd73b0f8ff1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:49.476804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-86baf235-a395-4c1e-af7b-4fd73b0f8ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:49.590792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86019f10-ae9d-41f5-a731-766449b240fd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:49.602725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de5286-ae57-45a0-a433-34667ba730be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:49.603792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de5286-ae57-45a0-a433-34667ba730be service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:49.604257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de5286-ae57-45a0-a433-34667ba730be service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:49.604724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de5286-ae57-45a0-a433-34667ba730be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:49.659070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baf235-a395-4c1e-af7b-4fd73b0f8ff1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:49.660585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de5286-ae57-45a0-a433-34667ba730be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:49.662220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de5286-ae57-45a0-a433-34667ba730be service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:49.686204 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1693/3416] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:49.686204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de5286-ae57-45a0-a433-34667ba730be service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:49.696851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de5286-ae57-45a0-a433-34667ba730be service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:49.697702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cd4ee-5f0a-486e-a1ba-cb929b848ac5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:49.698862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cd4ee-5f0a-486e-a1ba-cb929b848ac5 service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:49.698862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cd4ee-5f0a-486e-a1ba-cb929b848ac5 service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:49.699159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cd4ee-5f0a-486e-a1ba-cb929b848ac5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:49.703412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33051494-8407-495f-8c3c-4eefd6d23964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:49.703914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33051494-8407-495f-8c3c-4eefd6d23964 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:49.704244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33051494-8407-495f-8c3c-4eefd6d23964 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:49.704528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33051494-8407-495f-8c3c-4eefd6d23964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:49.717302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60cd4ee-5f0a-486e-a1ba-cb929b848ac5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:49.720592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60cd4ee-5f0a-486e-a1ba-cb929b848ac5 service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:49.728154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33051494-8407-495f-8c3c-4eefd6d23964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:49.732341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33051494-8407-495f-8c3c-4eefd6d23964 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:49.735531 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1724/3417] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:45:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:45:49.753126 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1694/3418] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:50.416136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cd4ee-5f0a-486e-a1ba-cb929b848ac5 service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:50.417911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b60cd4ee-5f0a-486e-a1ba-cb929b848ac5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:50.459241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cd4ee-5f0a-486e-a1ba-cb929b848ac5 service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:50.475725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24e840-72a3-4f6b-8ffb-1070c4e006b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:50.481381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24e840-72a3-4f6b-8ffb-1070c4e006b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:50.482424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24e840-72a3-4f6b-8ffb-1070c4e006b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:50.482786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24e840-72a3-4f6b-8ffb-1070c4e006b3 admin admin] PATH_INFO: `/v3/users/6822cb5afa6948858fa10c47e10ccda6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:50.484298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24e840-72a3-4f6b-8ffb-1070c4e006b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6822cb5afa6948858fa10c47e10ccda6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:50.489825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24e840-72a3-4f6b-8ffb-1070c4e006b3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:50.699128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33051494-8407-495f-8c3c-4eefd6d23964 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:50.700915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-33051494-8407-495f-8c3c-4eefd6d23964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:50.712835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:50.726662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33051494-8407-495f-8c3c-4eefd6d23964 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:50.728968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af5159-181c-4303-b261-9f36384e495f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:50.729811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af5159-181c-4303-b261-9f36384e495f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:50.730260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af5159-181c-4303-b261-9f36384e495f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:50.730708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af5159-181c-4303-b261-9f36384e495f admin admin] PATH_INFO: `/v3/projects/4a11f6bfb3144711964b5a5f6365c487` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:50.733602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af5159-181c-4303-b261-9f36384e495f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a11f6bfb3144711964b5a5f6365c487)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:50.737447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af5159-181c-4303-b261-9f36384e495f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:50.744947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ec24e840-72a3-4f6b-8ffb-1070c4e006b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6822cb5afa6948858fa10c47e10ccda6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:50.747347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ec24e840-72a3-4f6b-8ffb-1070c4e006b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6822cb5afa6948858fa10c47e10ccda6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:50.843465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ec24e840-72a3-4f6b-8ffb-1070c4e006b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6822cb5afa6948858fa10c47e10ccda6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:50.844783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ec24e840-72a3-4f6b-8ffb-1070c4e006b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6822cb5afa6948858fa10c47e10ccda6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:50.862202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ec24e840-72a3-4f6b-8ffb-1070c4e006b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6822cb5afa6948858fa10c47e10ccda6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:50.870249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-76af5159-181c-4303-b261-9f36384e495f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a11f6bfb3144711964b5a5f6365c487', 'request_id': 'req-76af5159-181c-4303-b261-9f36384e495f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:50.887059 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1725/3419] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:45:50 2022] DELETE /identity/v3/users/6822cb5afa6948858fa10c47e10ccda6 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:50.893219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b9ec9-09a3-456a-9c92-7f3b1e402018 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:50.894328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b9ec9-09a3-456a-9c92-7f3b1e402018 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:50.894875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b9ec9-09a3-456a-9c92-7f3b1e402018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:50.901170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-76af5159-181c-4303-b261-9f36384e495f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a11f6bfb3144711964b5a5f6365c487', 'request_id': 'req-76af5159-181c-4303-b261-9f36384e495f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:50.918479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-76af5159-181c-4303-b261-9f36384e495f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a11f6bfb3144711964b5a5f6365c487', 'request_id': 'req-76af5159-181c-4303-b261-9f36384e495f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:50.934129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1d0b9ec9-09a3-456a-9c92-7f3b1e402018 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:50.936367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1d0b9ec9-09a3-456a-9c92-7f3b1e402018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:51.041078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-76af5159-181c-4303-b261-9f36384e495f admin admin] The token cache is being invalidate because project 4a11f6bfb3144711964b5a5f6365c487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:51.041809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-76af5159-181c-4303-b261-9f36384e495f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:51.042758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-76af5159-181c-4303-b261-9f36384e495f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:51.045438 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1695/3420] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:45:50 2022] DELETE /identity/v3/projects/4a11f6bfb3144711964b5a5f6365c487 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:51.051240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af5159-181c-4303-b261-9f36384e495f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:51.052188 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1726/3421] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:51.055444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-76af5159-181c-4303-b261-9f36384e495f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:51.078091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b9ec9-09a3-456a-9c92-7f3b1e402018 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:51.079807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1d0b9ec9-09a3-456a-9c92-7f3b1e402018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:51.243666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b9ec9-09a3-456a-9c92-7f3b1e402018 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:51.247534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38349ae-c31a-462a-b8c8-f5cbc12bb617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:51.248182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38349ae-c31a-462a-b8c8-f5cbc12bb617 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:51.248460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38349ae-c31a-462a-b8c8-f5cbc12bb617 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:51.248742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38349ae-c31a-462a-b8c8-f5cbc12bb617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:51.251043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c38349ae-c31a-462a-b8c8-f5cbc12bb617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:51.256904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af5159-181c-4303-b261-9f36384e495f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:51.265834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38349ae-c31a-462a-b8c8-f5cbc12bb617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:51.267991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38349ae-c31a-462a-b8c8-f5cbc12bb617 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:51.277414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e1323-b66d-4658-af5a-2bf0af22a510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:51.278685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e1323-b66d-4658-af5a-2bf0af22a510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:51.279519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e1323-b66d-4658-af5a-2bf0af22a510 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:51.280219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e1323-b66d-4658-af5a-2bf0af22a510 admin admin] PATH_INFO: `/v3/users/2cd95336ff214ec1966ffa4ea09136e1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:51.280359 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1727/3422] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:45:51.290178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e1323-b66d-4658-af5a-2bf0af22a510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd95336ff214ec1966ffa4ea09136e1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:51.319098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e1323-b66d-4658-af5a-2bf0af22a510 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:51.516822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:51.571694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-638e1323-b66d-4658-af5a-2bf0af22a510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd95336ff214ec1966ffa4ea09136e1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:51.664965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-638e1323-b66d-4658-af5a-2bf0af22a510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd95336ff214ec1966ffa4ea09136e1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:51.665642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-638e1323-b66d-4658-af5a-2bf0af22a510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd95336ff214ec1966ffa4ea09136e1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:51.674612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-638e1323-b66d-4658-af5a-2bf0af22a510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd95336ff214ec1966ffa4ea09136e1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:51.687326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-638e1323-b66d-4658-af5a-2bf0af22a510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd95336ff214ec1966ffa4ea09136e1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:51.695242 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1696/3423] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:45:51 2022] DELETE /identity/v3/users/2cd95336ff214ec1966ffa4ea09136e1 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:51.739224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38349ae-c31a-462a-b8c8-f5cbc12bb617 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:51.741654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c38349ae-c31a-462a-b8c8-f5cbc12bb617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:51.770082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38349ae-c31a-462a-b8c8-f5cbc12bb617 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:51.877373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45602832-bc86-437f-878e-697a602db6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:51.878308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45602832-bc86-437f-878e-697a602db6a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:51.878602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45602832-bc86-437f-878e-697a602db6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:51.879081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45602832-bc86-437f-878e-697a602db6a3 admin admin] PATH_INFO: `/v3/projects/541b6d193f8247b9bc8a50cf6aa64c2c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:51.881237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45602832-bc86-437f-878e-697a602db6a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=541b6d193f8247b9bc8a50cf6aa64c2c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:51.889331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45602832-bc86-437f-878e-697a602db6a3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:52.161167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-45602832-bc86-437f-878e-697a602db6a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '541b6d193f8247b9bc8a50cf6aa64c2c', 'request_id': 'req-45602832-bc86-437f-878e-697a602db6a3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:52.169313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-45602832-bc86-437f-878e-697a602db6a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '541b6d193f8247b9bc8a50cf6aa64c2c', 'request_id': 'req-45602832-bc86-437f-878e-697a602db6a3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:52.306423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-45602832-bc86-437f-878e-697a602db6a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '541b6d193f8247b9bc8a50cf6aa64c2c', 'request_id': 'req-45602832-bc86-437f-878e-697a602db6a3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:52.324812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-45602832-bc86-437f-878e-697a602db6a3 admin admin] The token cache is being invalidate because project 541b6d193f8247b9bc8a50cf6aa64c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:52.325338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-45602832-bc86-437f-878e-697a602db6a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:52.326170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-45602832-bc86-437f-878e-697a602db6a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:52.339461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e1323-b66d-4658-af5a-2bf0af22a510 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:52.343752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-638e1323-b66d-4658-af5a-2bf0af22a510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:52.344221 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1728/3424] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:45:51 2022] DELETE /identity/v3/projects/541b6d193f8247b9bc8a50cf6aa64c2c => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:52.348986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf3614-6188-42eb-a3c1-98e252ad4b8e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:52.349924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf3614-6188-42eb-a3c1-98e252ad4b8e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:52.350386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf3614-6188-42eb-a3c1-98e252ad4b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:52.370548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e1323-b66d-4658-af5a-2bf0af22a510 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:52.409303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-84bf3614-6188-42eb-a3c1-98e252ad4b8e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:52.426674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-84bf3614-6188-42eb-a3c1-98e252ad4b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:52.551207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1c1dc-0bb5-43a1-9208-c8c82620846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:52.551849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1c1dc-0bb5-43a1-9208-c8c82620846d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:52.552126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1c1dc-0bb5-43a1-9208-c8c82620846d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:52.552549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1c1dc-0bb5-43a1-9208-c8c82620846d admin admin] PATH_INFO: `/v3/users/cbe11b2ecfb14310b17134863d58e51e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:52.553834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1c1dc-0bb5-43a1-9208-c8c82620846d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe11b2ecfb14310b17134863d58e51e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:52.557051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1c1dc-0bb5-43a1-9208-c8c82620846d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:52.605779 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1729/3425] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:52.607820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf3614-6188-42eb-a3c1-98e252ad4b8e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:52.614563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-84bf3614-6188-42eb-a3c1-98e252ad4b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:52.639223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf3614-6188-42eb-a3c1-98e252ad4b8e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:52.653446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389af45b-8a1f-435f-861e-4e2ae291dce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:52.654503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389af45b-8a1f-435f-861e-4e2ae291dce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:52.654984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389af45b-8a1f-435f-861e-4e2ae291dce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:52.655470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389af45b-8a1f-435f-861e-4e2ae291dce4 admin admin] PATH_INFO: `/v3/users/77d45f37045041a8baca21ee3698043e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:52.659224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389af45b-8a1f-435f-861e-4e2ae291dce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d45f37045041a8baca21ee3698043e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:52.661274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389af45b-8a1f-435f-861e-4e2ae291dce4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:52.908053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d4f1c1dc-0bb5-43a1-9208-c8c82620846d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe11b2ecfb14310b17134863d58e51e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:52.986044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-389af45b-8a1f-435f-861e-4e2ae291dce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d45f37045041a8baca21ee3698043e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:52.986640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-389af45b-8a1f-435f-861e-4e2ae291dce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d45f37045041a8baca21ee3698043e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.057563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d4f1c1dc-0bb5-43a1-9208-c8c82620846d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe11b2ecfb14310b17134863d58e51e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.060340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d4f1c1dc-0bb5-43a1-9208-c8c82620846d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe11b2ecfb14310b17134863d58e51e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.090285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d4f1c1dc-0bb5-43a1-9208-c8c82620846d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe11b2ecfb14310b17134863d58e51e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.126883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d4f1c1dc-0bb5-43a1-9208-c8c82620846d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe11b2ecfb14310b17134863d58e51e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.140620 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1697/3426] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:45:52 2022] DELETE /identity/v3/users/cbe11b2ecfb14310b17134863d58e51e => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:45:53.142560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27c41d-6bf5-4902-ad6b-0c9d68c69037 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:53.148780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27c41d-6bf5-4902-ad6b-0c9d68c69037 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:53.149581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27c41d-6bf5-4902-ad6b-0c9d68c69037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:53.158129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-389af45b-8a1f-435f-861e-4e2ae291dce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d45f37045041a8baca21ee3698043e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.158771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-389af45b-8a1f-435f-861e-4e2ae291dce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d45f37045041a8baca21ee3698043e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.184051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-389af45b-8a1f-435f-861e-4e2ae291dce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d45f37045041a8baca21ee3698043e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.205336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-cd27c41d-6bf5-4902-ad6b-0c9d68c69037 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:53.206911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cd27c41d-6bf5-4902-ad6b-0c9d68c69037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:53.219617 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1730/3427] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:45:52 2022] DELETE /identity/v3/users/77d45f37045041a8baca21ee3698043e => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:53.220711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389af45b-8a1f-435f-861e-4e2ae291dce4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:53.226860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-389af45b-8a1f-435f-861e-4e2ae291dce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:53.334067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389af45b-8a1f-435f-861e-4e2ae291dce4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:53.340222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b451dd-f504-4c46-af82-3125342a9256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:53.340959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b451dd-f504-4c46-af82-3125342a9256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:53.341362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b451dd-f504-4c46-af82-3125342a9256 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:53.341752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b451dd-f504-4c46-af82-3125342a9256 admin admin] PATH_INFO: `/v3/projects/661fcec0ed364cf782ee5edc422910b7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:53.343388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b451dd-f504-4c46-af82-3125342a9256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=661fcec0ed364cf782ee5edc422910b7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:53.345044 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1698/3428] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:53.345591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b451dd-f504-4c46-af82-3125342a9256 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:53.349337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27c41d-6bf5-4902-ad6b-0c9d68c69037 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:53.380127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27c41d-6bf5-4902-ad6b-0c9d68c69037 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:53.399416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d69ec-a376-4dc1-b018-06f57a850b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:53.404486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d69ec-a376-4dc1-b018-06f57a850b5b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:53.404486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d69ec-a376-4dc1-b018-06f57a850b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:53.404486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d69ec-a376-4dc1-b018-06f57a850b5b admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:53.404486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d69ec-a376-4dc1-b018-06f57a850b5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:53.405290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d69ec-a376-4dc1-b018-06f57a850b5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:53.407314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d69ec-a376-4dc1-b018-06f57a850b5b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:53.438081 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1699/3429] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:53.442322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d69ec-a376-4dc1-b018-06f57a850b5b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:53.460868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d69ec-a376-4dc1-b018-06f57a850b5b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:53.466145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b7f29-5ad2-4e60-ae38-01dbcce0d3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:53.466964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b7f29-5ad2-4e60-ae38-01dbcce0d3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:53.467414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b7f29-5ad2-4e60-ae38-01dbcce0d3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:53.467856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b7f29-5ad2-4e60-ae38-01dbcce0d3e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:53.468762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b7f29-5ad2-4e60-ae38-01dbcce0d3e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:53.471095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b7f29-5ad2-4e60-ae38-01dbcce0d3e3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:53.510501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c5b451dd-f504-4c46-af82-3125342a9256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '661fcec0ed364cf782ee5edc422910b7', 'request_id': 'req-c5b451dd-f504-4c46-af82-3125342a9256'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.525596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c5b451dd-f504-4c46-af82-3125342a9256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '661fcec0ed364cf782ee5edc422910b7', 'request_id': 'req-c5b451dd-f504-4c46-af82-3125342a9256'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.594135 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1700/3430] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:45:53 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:53.604485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b7f29-5ad2-4e60-ae38-01dbcce0d3e3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:53.649519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c5b451dd-f504-4c46-af82-3125342a9256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '661fcec0ed364cf782ee5edc422910b7', 'request_id': 'req-c5b451dd-f504-4c46-af82-3125342a9256'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.669843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c5b451dd-f504-4c46-af82-3125342a9256 admin admin] The token cache is being invalidate because project 661fcec0ed364cf782ee5edc422910b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:53.670141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c5b451dd-f504-4c46-af82-3125342a9256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.670827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c5b451dd-f504-4c46-af82-3125342a9256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:53.672484 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1731/3431] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:45:53 2022] DELETE /identity/v3/projects/661fcec0ed364cf782ee5edc422910b7 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:53.677909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e138db-7454-4c52-80de-2aeb8f8a0a27 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:53.678235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e138db-7454-4c52-80de-2aeb8f8a0a27 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:53.678528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e138db-7454-4c52-80de-2aeb8f8a0a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:53.723868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b7f29-5ad2-4e60-ae38-01dbcce0d3e3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:53.726124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c2e138db-7454-4c52-80de-2aeb8f8a0a27 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:53.727590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c2e138db-7454-4c52-80de-2aeb8f8a0a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:53.731842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acdc4c-c4a7-4b27-9004-80e2000f6eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:53.733033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acdc4c-c4a7-4b27-9004-80e2000f6eac admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:53.733537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acdc4c-c4a7-4b27-9004-80e2000f6eac admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:53.734063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acdc4c-c4a7-4b27-9004-80e2000f6eac admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:53.734870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46acdc4c-c4a7-4b27-9004-80e2000f6eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:53.737233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46acdc4c-c4a7-4b27-9004-80e2000f6eac admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:53.744694 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1732/3432] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:53.752930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5baa41-196f-49c1-acb4-c18f694a5e8e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:53.753224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5baa41-196f-49c1-acb4-c18f694a5e8e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:53.754107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5baa41-196f-49c1-acb4-c18f694a5e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:53.780992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bb5baa41-196f-49c1-acb4-c18f694a5e8e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:53.784125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bb5baa41-196f-49c1-acb4-c18f694a5e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:53.871117 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1733/3433] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:53.874027 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1701/3434] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:45:53 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:45:53.874630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acdc4c-c4a7-4b27-9004-80e2000f6eac admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:53.878618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5baa41-196f-49c1-acb4-c18f694a5e8e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:53.880111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-46acdc4c-c4a7-4b27-9004-80e2000f6eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:53.890758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:53.926652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5baa41-196f-49c1-acb4-c18f694a5e8e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:53.933178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acdc4c-c4a7-4b27-9004-80e2000f6eac admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:53.950771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd45308-1d64-4214-a4ff-b6ce982488da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:53.950771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd45308-1d64-4214-a4ff-b6ce982488da admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:53.951141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd45308-1d64-4214-a4ff-b6ce982488da admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:53.951614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd45308-1d64-4214-a4ff-b6ce982488da admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:53.952313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd45308-1d64-4214-a4ff-b6ce982488da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:53.952646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd45308-1d64-4214-a4ff-b6ce982488da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:53.955052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd45308-1d64-4214-a4ff-b6ce982488da admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:53.991375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaaa4b-3318-4aad-970e-56a17b446406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:53.991375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaaa4b-3318-4aad-970e-56a17b446406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:53.991375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaaa4b-3318-4aad-970e-56a17b446406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:53.991375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaaa4b-3318-4aad-970e-56a17b446406 admin admin] PATH_INFO: `/v3/projects/fd348d4b04624e0593b80d3897e8e1b4` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:53.991733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eaaa4b-3318-4aad-970e-56a17b446406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd348d4b04624e0593b80d3897e8e1b4)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:53.991733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eaaa4b-3318-4aad-970e-56a17b446406 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.008968 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1734/3435] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:54.008968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd45308-1d64-4214-a4ff-b6ce982488da admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.011241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5bd45308-1d64-4214-a4ff-b6ce982488da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:54.019706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:54.038070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd45308-1d64-4214-a4ff-b6ce982488da admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.050756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c0d45-822d-4391-924a-9d85265162fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:54.051904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c0d45-822d-4391-924a-9d85265162fc admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.052204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c0d45-822d-4391-924a-9d85265162fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.052817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c0d45-822d-4391-924a-9d85265162fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.053529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c0d45-822d-4391-924a-9d85265162fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:54.055160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c0d45-822d-4391-924a-9d85265162fc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.072907 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1735/3436] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:54.073802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c0d45-822d-4391-924a-9d85265162fc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.086256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c0d45-822d-4391-924a-9d85265162fc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.093887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64598d1e-f1b0-4c66-bc70-bc0525a5e8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:54.094770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598d1e-f1b0-4c66-bc70-bc0525a5e8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.095242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598d1e-f1b0-4c66-bc70-bc0525a5e8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.095689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598d1e-f1b0-4c66-bc70-bc0525a5e8c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.096580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64598d1e-f1b0-4c66-bc70-bc0525a5e8c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:54.101815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64598d1e-f1b0-4c66-bc70-bc0525a5e8c2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.230494 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1736/3437] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:45:54 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:54.231475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64598d1e-f1b0-4c66-bc70-bc0525a5e8c2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.236148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-37eaaa4b-3318-4aad-970e-56a17b446406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd348d4b04624e0593b80d3897e8e1b4', 'request_id': 'req-37eaaa4b-3318-4aad-970e-56a17b446406'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:54.269075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-37eaaa4b-3318-4aad-970e-56a17b446406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd348d4b04624e0593b80d3897e8e1b4', 'request_id': 'req-37eaaa4b-3318-4aad-970e-56a17b446406'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:54.279544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-37eaaa4b-3318-4aad-970e-56a17b446406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd348d4b04624e0593b80d3897e8e1b4', 'request_id': 'req-37eaaa4b-3318-4aad-970e-56a17b446406'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:54.364086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64598d1e-f1b0-4c66-bc70-bc0525a5e8c2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.370382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-37eaaa4b-3318-4aad-970e-56a17b446406 admin admin] The token cache is being invalidate because project fd348d4b04624e0593b80d3897e8e1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:54.370926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-37eaaa4b-3318-4aad-970e-56a17b446406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:54.371220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaf84c-fa91-4175-95f3-eda3ca0118ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:54.371656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-37eaaa4b-3318-4aad-970e-56a17b446406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:54.371796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf84c-fa91-4175-95f3-eda3ca0118ba admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.371945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf84c-fa91-4175-95f3-eda3ca0118ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.372294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf84c-fa91-4175-95f3-eda3ca0118ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.373125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaf84c-fa91-4175-95f3-eda3ca0118ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:54.374473 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1702/3438] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:45:53 2022] DELETE /identity/v3/projects/fd348d4b04624e0593b80d3897e8e1b4 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:54.374688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaf84c-fa91-4175-95f3-eda3ca0118ba admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.375577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaaa4b-3318-4aad-970e-56a17b446406 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.382176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-37eaaa4b-3318-4aad-970e-56a17b446406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:54.393432 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1737/3439] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:54.394533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaf84c-fa91-4175-95f3-eda3ca0118ba admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.402615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2ceaf84c-fa91-4175-95f3-eda3ca0118ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:54.417607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaf84c-fa91-4175-95f3-eda3ca0118ba admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.422692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746c852-5a5f-4523-a0f1-9ec9336f3164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:54.423324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746c852-5a5f-4523-a0f1-9ec9336f3164 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.423758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746c852-5a5f-4523-a0f1-9ec9336f3164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.424439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746c852-5a5f-4523-a0f1-9ec9336f3164 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.425087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746c852-5a5f-4523-a0f1-9ec9336f3164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:54.427077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746c852-5a5f-4523-a0f1-9ec9336f3164 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.501398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaaa4b-3318-4aad-970e-56a17b446406 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.507648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea50f8e-b27d-472a-b060-6426dafd755f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:54.508384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea50f8e-b27d-472a-b060-6426dafd755f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.508675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea50f8e-b27d-472a-b060-6426dafd755f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.508949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea50f8e-b27d-472a-b060-6426dafd755f admin admin] PATH_INFO: `/v3/projects/2af96350c6f54d8e950515db49bfe636` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.510324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea50f8e-b27d-472a-b060-6426dafd755f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af96350c6f54d8e950515db49bfe636)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:54.512357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea50f8e-b27d-472a-b060-6426dafd755f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.547599 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1738/3440] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:45:54 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:54.549227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28358f13-d5a6-41eb-b9dd-9f78cced463c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.549513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28358f13-d5a6-41eb-b9dd-9f78cced463c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.549789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28358f13-d5a6-41eb-b9dd-9f78cced463c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.573964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-28358f13-d5a6-41eb-b9dd-9f78cced463c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:54.575708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-28358f13-d5a6-41eb-b9dd-9f78cced463c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:54.584983 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1739/3441] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:54.586454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28358f13-d5a6-41eb-b9dd-9f78cced463c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.587921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-28358f13-d5a6-41eb-b9dd-9f78cced463c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:54.601019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28358f13-d5a6-41eb-b9dd-9f78cced463c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.606422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a78d26-e6a0-46b0-a078-a298ef74c174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:54.606855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a78d26-e6a0-46b0-a078-a298ef74c174 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.607130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a78d26-e6a0-46b0-a078-a298ef74c174 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.607401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a78d26-e6a0-46b0-a078-a298ef74c174 admin admin] PATH_INFO: `/v3/projects/f4bbd6d469ce4f5c95f82f57a7feba93/users/71d3824322374a279c8efee8b072eb10/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.626402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a78d26-e6a0-46b0-a078-a298ef74c174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4bbd6d469ce4f5c95f82f57a7feba93, user_id=71d3824322374a279c8efee8b072eb10, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:54.629481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a78d26-e6a0-46b0-a078-a298ef74c174 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.717652 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1740/3442] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:45:54 2022] PUT /identity/v3/projects/f4bbd6d469ce4f5c95f82f57a7feba93/users/71d3824322374a279c8efee8b072eb10/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:54.718507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a78d26-e6a0-46b0-a078-a298ef74c174 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:54.729874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2ea50f8e-b27d-472a-b060-6426dafd755f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af96350c6f54d8e950515db49bfe636', 'request_id': 'req-2ea50f8e-b27d-472a-b060-6426dafd755f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:54.735558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:54.739333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2ea50f8e-b27d-472a-b060-6426dafd755f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af96350c6f54d8e950515db49bfe636', 'request_id': 'req-2ea50f8e-b27d-472a-b060-6426dafd755f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:54.747618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2ea50f8e-b27d-472a-b060-6426dafd755f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af96350c6f54d8e950515db49bfe636', 'request_id': 'req-2ea50f8e-b27d-472a-b060-6426dafd755f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:54.817168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a78d26-e6a0-46b0-a078-a298ef74c174 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:54.822175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2ea50f8e-b27d-472a-b060-6426dafd755f admin admin] The token cache is being invalidate because project 2af96350c6f54d8e950515db49bfe636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:54.822802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2ea50f8e-b27d-472a-b060-6426dafd755f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:54.823995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2ea50f8e-b27d-472a-b060-6426dafd755f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:54.830954 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1703/3443] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:45:54 2022] DELETE /identity/v3/projects/2af96350c6f54d8e950515db49bfe636 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:54.832735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e85c02-c9f4-49a0-b523-023d03375ea4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.833021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e85c02-c9f4-49a0-b523-023d03375ea4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.833295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e85c02-c9f4-49a0-b523-023d03375ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.874681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-73e85c02-c9f4-49a0-b523-023d03375ea4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:54.875976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-73e85c02-c9f4-49a0-b523-023d03375ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:54.913516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2094d2-4ad1-44b5-8b8a-9541d548a4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:54.914608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2094d2-4ad1-44b5-8b8a-9541d548a4eb admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.915157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2094d2-4ad1-44b5-8b8a-9541d548a4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.915645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2094d2-4ad1-44b5-8b8a-9541d548a4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.916532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2094d2-4ad1-44b5-8b8a-9541d548a4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:54.918161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2094d2-4ad1-44b5-8b8a-9541d548a4eb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:54.930064 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1741/3444] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:54.939905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661db55e-b781-4392-8a64-2dd06d90df43 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.939905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661db55e-b781-4392-8a64-2dd06d90df43 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.939905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661db55e-b781-4392-8a64-2dd06d90df43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.977439 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1704/3445] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:54.978742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdba170-89ef-4cc0-b836-f7750b27b156 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:54.979023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdba170-89ef-4cc0-b836-f7750b27b156 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:54.979297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdba170-89ef-4cc0-b836-f7750b27b156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:54.984106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-661db55e-b781-4392-8a64-2dd06d90df43 None None] MFA Rules not processed for user `71d3824322374a279c8efee8b072eb10`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:54.985546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-661db55e-b781-4392-8a64-2dd06d90df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:55.001739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-fbdba170-89ef-4cc0-b836-f7750b27b156 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:55.002941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fbdba170-89ef-4cc0-b836-f7750b27b156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:55.012821 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1705/3446] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:55.013652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdba170-89ef-4cc0-b836-f7750b27b156 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:55.015141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fbdba170-89ef-4cc0-b836-f7750b27b156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:55.027832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdba170-89ef-4cc0-b836-f7750b27b156 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:55.033177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d143bfe-c6bc-47dd-927d-bb2de4a5e3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:55.033876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d143bfe-c6bc-47dd-927d-bb2de4a5e3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.034214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d143bfe-c6bc-47dd-927d-bb2de4a5e3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.034559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d143bfe-c6bc-47dd-927d-bb2de4a5e3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.035208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d143bfe-c6bc-47dd-927d-bb2de4a5e3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:55.037744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d143bfe-c6bc-47dd-927d-bb2de4a5e3d4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:55.053223 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1706/3447] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:55.053715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d143bfe-c6bc-47dd-927d-bb2de4a5e3d4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:55.067628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d143bfe-c6bc-47dd-927d-bb2de4a5e3d4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:55.077312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644c96f-cfcd-4416-8495-bb39f73c3910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:55.077928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644c96f-cfcd-4416-8495-bb39f73c3910 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.078215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644c96f-cfcd-4416-8495-bb39f73c3910 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.079259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644c96f-cfcd-4416-8495-bb39f73c3910 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.079926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644c96f-cfcd-4416-8495-bb39f73c3910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:55.080256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644c96f-cfcd-4416-8495-bb39f73c3910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:55.085649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644c96f-cfcd-4416-8495-bb39f73c3910 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:55.123672 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1707/3448] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:55.123672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9542e2-6b0e-4748-9d94-df84d50d15fd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.124316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9542e2-6b0e-4748-9d94-df84d50d15fd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.124633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9542e2-6b0e-4748-9d94-df84d50d15fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.130602 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1742/3449] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:55.132002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661db55e-b781-4392-8a64-2dd06d90df43 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:55.154136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661db55e-b781-4392-8a64-2dd06d90df43 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:55.161224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526301f-4bd4-4ae2-bd8c-63634820f684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:55.164430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526301f-4bd4-4ae2-bd8c-63634820f684 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.164990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526301f-4bd4-4ae2-bd8c-63634820f684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.165861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526301f-4bd4-4ae2-bd8c-63634820f684 admin admin] PATH_INFO: `/v3/projects/ed7dcec401394866b7d9fdacb5e294dc/users/dd816cdc446443d5b3772afc7221fa79/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.170391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ba9542e2-6b0e-4748-9d94-df84d50d15fd None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:55.171797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ba9542e2-6b0e-4748-9d94-df84d50d15fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:55.188580 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1708/3450] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:55.188580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9542e2-6b0e-4748-9d94-df84d50d15fd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:55.195586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526301f-4bd4-4ae2-bd8c-63634820f684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed7dcec401394866b7d9fdacb5e294dc, user_id=dd816cdc446443d5b3772afc7221fa79, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:55.198913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526301f-4bd4-4ae2-bd8c-63634820f684 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:55.202394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9542e2-6b0e-4748-9d94-df84d50d15fd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:55.215139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88012f74-0121-48ee-a7df-d7ef49145036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:55.220017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88012f74-0121-48ee-a7df-d7ef49145036 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.220017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88012f74-0121-48ee-a7df-d7ef49145036 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.220017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88012f74-0121-48ee-a7df-d7ef49145036 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.220017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88012f74-0121-48ee-a7df-d7ef49145036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:55.220017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88012f74-0121-48ee-a7df-d7ef49145036 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:55.318844 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1743/3451] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:45:55 2022] PUT /identity/v3/projects/ed7dcec401394866b7d9fdacb5e294dc/users/dd816cdc446443d5b3772afc7221fa79/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:55.320003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526301f-4bd4-4ae2-bd8c-63634820f684 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:55.322059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f526301f-4bd4-4ae2-bd8c-63634820f684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:55.426071 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1709/3452] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:45:55 2022] POST /identity/v3/projects => generated 391 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:55.426071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88012f74-0121-48ee-a7df-d7ef49145036 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:55.426648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526301f-4bd4-4ae2-bd8c-63634820f684 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:55.516640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88012f74-0121-48ee-a7df-d7ef49145036 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:55.522584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5c77e-2048-4181-a272-6b6126632c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:55.523060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5c77e-2048-4181-a272-6b6126632c0c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.523341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5c77e-2048-4181-a272-6b6126632c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.523611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5c77e-2048-4181-a272-6b6126632c0c admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.524883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5c77e-2048-4181-a272-6b6126632c0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:45:55.525341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5c77e-2048-4181-a272-6b6126632c0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:55.527139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5c77e-2048-4181-a272-6b6126632c0c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:55.542776 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1710/3453] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:45:55.543821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024c1a6-6693-46df-b707-9a3594f005f3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.544109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024c1a6-6693-46df-b707-9a3594f005f3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.544408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024c1a6-6693-46df-b707-9a3594f005f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.546568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b28a8e-2fc5-4372-8bbb-22038b3ff96f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:55.547357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b28a8e-2fc5-4372-8bbb-22038b3ff96f service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.547754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b28a8e-2fc5-4372-8bbb-22038b3ff96f service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.548037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b28a8e-2fc5-4372-8bbb-22038b3ff96f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.591467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f024c1a6-6693-46df-b707-9a3594f005f3 None None] MFA Rules not processed for user `dd816cdc446443d5b3772afc7221fa79`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:55.592964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f024c1a6-6693-46df-b707-9a3594f005f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:55.645694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b28a8e-2fc5-4372-8bbb-22038b3ff96f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:55.649025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b28a8e-2fc5-4372-8bbb-22038b3ff96f service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:55.665045 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1744/3454] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:55.666001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b28a8e-2fc5-4372-8bbb-22038b3ff96f service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:55.689237 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1711/3455] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:55.689473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b28a8e-2fc5-4372-8bbb-22038b3ff96f service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:55.689588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024c1a6-6693-46df-b707-9a3594f005f3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:55.689842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e0d11-f5a1-47c6-bd83-1a3bd9ade5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:55.690978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e0d11-f5a1-47c6-bd83-1a3bd9ade5de admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.691631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e0d11-f5a1-47c6-bd83-1a3bd9ade5de admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.691909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e0d11-f5a1-47c6-bd83-1a3bd9ade5de admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.693488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e0d11-f5a1-47c6-bd83-1a3bd9ade5de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:55.695998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e0d11-f5a1-47c6-bd83-1a3bd9ade5de admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:55.699455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024c1a6-6693-46df-b707-9a3594f005f3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:55.714404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf904ee9-acea-4161-a9bf-95905a2e4637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:55.715292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf904ee9-acea-4161-a9bf-95905a2e4637 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:55.715550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf904ee9-acea-4161-a9bf-95905a2e4637 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:55.715874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf904ee9-acea-4161-a9bf-95905a2e4637 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:55.717174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf904ee9-acea-4161-a9bf-95905a2e4637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:55.719176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf904ee9-acea-4161-a9bf-95905a2e4637 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:55.897303 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1745/3456] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:45:55 2022] POST /identity/v3/users => generated 296 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:55.898571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e0d11-f5a1-47c6-bd83-1a3bd9ade5de admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:55.906087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7c1e0d11-f5a1-47c6-bd83-1a3bd9ade5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:55.910530 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1712/3457] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:45:55 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:55.910530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf904ee9-acea-4161-a9bf-95905a2e4637 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:55.943293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e0d11-f5a1-47c6-bd83-1a3bd9ade5de admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:56.039552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:56.068824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf904ee9-acea-4161-a9bf-95905a2e4637 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:56.075590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad9e6f-2909-480e-b9b3-8972e9cc1654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:56.076445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad9e6f-2909-480e-b9b3-8972e9cc1654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:56.076924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad9e6f-2909-480e-b9b3-8972e9cc1654 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:56.077276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad9e6f-2909-480e-b9b3-8972e9cc1654 admin admin] PATH_INFO: `/v3/users/2243337b74ad4cf09d54d5d86def7361` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:56.078527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad9e6f-2909-480e-b9b3-8972e9cc1654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2243337b74ad4cf09d54d5d86def7361)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:56.080336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08b44e-67fb-488d-a3f0-64144fe84a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:56.080653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad9e6f-2909-480e-b9b3-8972e9cc1654 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:56.080906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08b44e-67fb-488d-a3f0-64144fe84a97 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:56.081190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08b44e-67fb-488d-a3f0-64144fe84a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:56.081467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08b44e-67fb-488d-a3f0-64144fe84a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:56.082111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08b44e-67fb-488d-a3f0-64144fe84a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:56.087723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08b44e-67fb-488d-a3f0-64144fe84a97 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:56.218983 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1713/3458] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:45:55 2022] POST /identity/v3/projects => generated 377 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:56.219918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08b44e-67fb-488d-a3f0-64144fe84a97 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:56.325870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-01ad9e6f-2909-480e-b9b3-8972e9cc1654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2243337b74ad4cf09d54d5d86def7361'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:56.329233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-01ad9e6f-2909-480e-b9b3-8972e9cc1654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2243337b74ad4cf09d54d5d86def7361'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:56.339691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08b44e-67fb-488d-a3f0-64144fe84a97 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:56.351025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6fa7e-b024-4fdf-9457-c753cf09954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:56.352012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6fa7e-b024-4fdf-9457-c753cf09954b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:56.352547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6fa7e-b024-4fdf-9457-c753cf09954b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:56.353009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6fa7e-b024-4fdf-9457-c753cf09954b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:56.353870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6fa7e-b024-4fdf-9457-c753cf09954b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:56.357724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6fa7e-b024-4fdf-9457-c753cf09954b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:56.369161 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1714/3459] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:56.370381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6fa7e-b024-4fdf-9457-c753cf09954b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:56.386492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6fa7e-b024-4fdf-9457-c753cf09954b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:56.395789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e070d45-db48-4506-bc1a-a875ecc66a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:56.398430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e070d45-db48-4506-bc1a-a875ecc66a8a admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:56.398895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e070d45-db48-4506-bc1a-a875ecc66a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:56.399432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e070d45-db48-4506-bc1a-a875ecc66a8a admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:56.400097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e070d45-db48-4506-bc1a-a875ecc66a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:56.402990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e070d45-db48-4506-bc1a-a875ecc66a8a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:56.411310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-01ad9e6f-2909-480e-b9b3-8972e9cc1654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2243337b74ad4cf09d54d5d86def7361'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:56.413189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-01ad9e6f-2909-480e-b9b3-8972e9cc1654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2243337b74ad4cf09d54d5d86def7361'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:56.444684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-01ad9e6f-2909-480e-b9b3-8972e9cc1654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2243337b74ad4cf09d54d5d86def7361'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:56.468452 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1746/3460] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:45:55 2022] DELETE /identity/v3/users/2243337b74ad4cf09d54d5d86def7361 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:56.468452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad9e6f-2909-480e-b9b3-8972e9cc1654 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:56.475319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-01ad9e6f-2909-480e-b9b3-8972e9cc1654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:56.539463 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1715/3461] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:45:56 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:56.545896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e070d45-db48-4506-bc1a-a875ecc66a8a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:56.545896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5e070d45-db48-4506-bc1a-a875ecc66a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:56.571635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e070d45-db48-4506-bc1a-a875ecc66a8a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:56.639415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad9e6f-2909-480e-b9b3-8972e9cc1654 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:56.653153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46dc67-b724-41b5-8e2b-218f3472d3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:56.653789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46dc67-b724-41b5-8e2b-218f3472d3ff admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:56.654413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46dc67-b724-41b5-8e2b-218f3472d3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:56.654688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46dc67-b724-41b5-8e2b-218f3472d3ff admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:56.656321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46dc67-b724-41b5-8e2b-218f3472d3ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:56.662642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46dc67-b724-41b5-8e2b-218f3472d3ff admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:56.699179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:56.703682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a56c98-7622-46fb-8a4f-4940a1890017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:56.706447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a56c98-7622-46fb-8a4f-4940a1890017 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:56.706447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a56c98-7622-46fb-8a4f-4940a1890017 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:56.706447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a56c98-7622-46fb-8a4f-4940a1890017 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:56.706447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a56c98-7622-46fb-8a4f-4940a1890017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:56.710282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a56c98-7622-46fb-8a4f-4940a1890017 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:56.745003 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1716/3462] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:56.746872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1db81d-ba9c-43ba-ba22-5721ac0c9ee7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:56.748515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1db81d-ba9c-43ba-ba22-5721ac0c9ee7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:56.748938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1db81d-ba9c-43ba-ba22-5721ac0c9ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:56.753581 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1747/3463] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:45:56 2022] POST /identity/v3/users => generated 295 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:45:56.754592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46dc67-b724-41b5-8e2b-218f3472d3ff admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:56.757210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-db46dc67-b724-41b5-8e2b-218f3472d3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:56.790712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46dc67-b724-41b5-8e2b-218f3472d3ff admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:56.801881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7ea18-ceff-47ff-9820-266fe4736b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:56.802556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7ea18-ceff-47ff-9820-266fe4736b83 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:56.802830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7ea18-ceff-47ff-9820-266fe4736b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:56.803096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7ea18-ceff-47ff-9820-266fe4736b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:56.803828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7ea18-ceff-47ff-9820-266fe4736b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:56.805461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7ea18-ceff-47ff-9820-266fe4736b83 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:56.812566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7d1db81d-ba9c-43ba-ba22-5721ac0c9ee7 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:56.815244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7d1db81d-ba9c-43ba-ba22-5721ac0c9ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:56.832027 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1717/3464] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:56.833253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1db81d-ba9c-43ba-ba22-5721ac0c9ee7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:56.836890 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1748/3465] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:56.839639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7ea18-ceff-47ff-9820-266fe4736b83 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:56.870694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7ea18-ceff-47ff-9820-266fe4736b83 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:56.877848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec784b-d95e-400c-a068-3746ede561e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:56.878472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec784b-d95e-400c-a068-3746ede561e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:56.878780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec784b-d95e-400c-a068-3746ede561e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:56.879009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec784b-d95e-400c-a068-3746ede561e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:56.879361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1db81d-ba9c-43ba-ba22-5721ac0c9ee7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:56.879800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec784b-d95e-400c-a068-3746ede561e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:56.882252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec784b-d95e-400c-a068-3746ede561e2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:56.885510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb5193-0c08-4f7d-9c3d-abe4eb799d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:56.886203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb5193-0c08-4f7d-9c3d-abe4eb799d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:56.886631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb5193-0c08-4f7d-9c3d-abe4eb799d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:56.886961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb5193-0c08-4f7d-9c3d-abe4eb799d43 admin admin] PATH_INFO: `/v3/projects/43ed2e29126a453e8ab63c6821a1211b/users/4c83d15d07a34dc4950c8b514aa178ab/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:56.906580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb5193-0c08-4f7d-9c3d-abe4eb799d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ed2e29126a453e8ab63c6821a1211b, user_id=4c83d15d07a34dc4950c8b514aa178ab, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:56.909943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb5193-0c08-4f7d-9c3d-abe4eb799d43 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:56.911223 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1749/3466] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:56.912373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec784b-d95e-400c-a068-3746ede561e2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:56.925252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec784b-d95e-400c-a068-3746ede561e2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:56.952667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed1605-f1bd-4b98-a5e1-29266e561a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:56.953571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed1605-f1bd-4b98-a5e1-29266e561a61 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:56.954040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed1605-f1bd-4b98-a5e1-29266e561a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:56.954475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed1605-f1bd-4b98-a5e1-29266e561a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:56.955288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed1605-f1bd-4b98-a5e1-29266e561a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:56.957110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed1605-f1bd-4b98-a5e1-29266e561a61 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:56.990673 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1750/3468] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:56.992282 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1718/3468] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:45:56 2022] PUT /identity/v3/projects/43ed2e29126a453e8ab63c6821a1211b/users/4c83d15d07a34dc4950c8b514aa178ab/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:56.995415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e94d6c-b700-4f8f-a972-259ea1817c44 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:56.995415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e94d6c-b700-4f8f-a972-259ea1817c44 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:56.995415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e94d6c-b700-4f8f-a972-259ea1817c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:56.997239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed1605-f1bd-4b98-a5e1-29266e561a61 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:57.004698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6fed1605-f1bd-4b98-a5e1-29266e561a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:57.018080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c8e94d6c-b700-4f8f-a972-259ea1817c44 None None] MFA Rules not processed for user `83867771c9a1442cba2837c1132df88d`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:57.019553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c8e94d6c-b700-4f8f-a972-259ea1817c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:57.105880 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1719/3469] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:57.107019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e94d6c-b700-4f8f-a972-259ea1817c44 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:57.119203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed1605-f1bd-4b98-a5e1-29266e561a61 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:57.195925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6920f-6ba9-4cc0-9c83-bfbfc5d30f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:57.196933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6920f-6ba9-4cc0-9c83-bfbfc5d30f2d service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:57.196933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6920f-6ba9-4cc0-9c83-bfbfc5d30f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:57.199798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6920f-6ba9-4cc0-9c83-bfbfc5d30f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:57.211432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e94d6c-b700-4f8f-a972-259ea1817c44 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:57.212375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6920f-6ba9-4cc0-9c83-bfbfc5d30f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:57.214554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6920f-6ba9-4cc0-9c83-bfbfc5d30f2d service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:57.218367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc9666-875c-4564-ac0a-58252100a754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:57.219187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc9666-875c-4564-ac0a-58252100a754 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:57.219567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc9666-875c-4564-ac0a-58252100a754 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:57.219959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc9666-875c-4564-ac0a-58252100a754 admin admin] PATH_INFO: `/v3/projects/fd2ed0782b9e4a23842ea96bdc018090/users/b45883d3057142c3b5eac714e26e27b6/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:57.229354 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1751/3470] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:57.230226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6920f-6ba9-4cc0-9c83-bfbfc5d30f2d service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:57.240889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc9666-875c-4564-ac0a-58252100a754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2ed0782b9e4a23842ea96bdc018090, user_id=b45883d3057142c3b5eac714e26e27b6, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:57.241304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6920f-6ba9-4cc0-9c83-bfbfc5d30f2d service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:57.246051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc9666-875c-4564-ac0a-58252100a754 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:57.247328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba0df7-e6f4-447c-8ef9-eeaa0fd7fd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:57.248253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba0df7-e6f4-447c-8ef9-eeaa0fd7fd6e admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:57.248538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba0df7-e6f4-447c-8ef9-eeaa0fd7fd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:57.248812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba0df7-e6f4-447c-8ef9-eeaa0fd7fd6e admin admin] PATH_INFO: `/v3/projects/6821f5646cb840d3aa0511de1fdb3084/users/45a257bfdfce4bd8ae0c916558075d42/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:57.268095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba0df7-e6f4-447c-8ef9-eeaa0fd7fd6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6821f5646cb840d3aa0511de1fdb3084, user_id=45a257bfdfce4bd8ae0c916558075d42, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:57.271960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba0df7-e6f4-447c-8ef9-eeaa0fd7fd6e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:57.358352 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1720/3471] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:45:57 2022] PUT /identity/v3/projects/fd2ed0782b9e4a23842ea96bdc018090/users/b45883d3057142c3b5eac714e26e27b6/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:57.363434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5fa52-6545-47a5-96f4-e10229788cb9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:57.363655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5fa52-6545-47a5-96f4-e10229788cb9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:57.363937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5fa52-6545-47a5-96f4-e10229788cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:57.384136 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1752/3472] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:45:57 2022] PUT /identity/v3/projects/6821f5646cb840d3aa0511de1fdb3084/users/45a257bfdfce4bd8ae0c916558075d42/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:57.384136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9189848-50fb-418a-9ff9-e6fc30a254f7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:57.384136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9189848-50fb-418a-9ff9-e6fc30a254f7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:57.384136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9189848-50fb-418a-9ff9-e6fc30a254f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:57.394299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a9c5fa52-6545-47a5-96f4-e10229788cb9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:57.395888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a9c5fa52-6545-47a5-96f4-e10229788cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:57.428299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c9189848-50fb-418a-9ff9-e6fc30a254f7 None None] MFA Rules not processed for user `83867771c9a1442cba2837c1132df88d`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:57.429620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c9189848-50fb-418a-9ff9-e6fc30a254f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:57.485068 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1721/3473] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:57.486113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5fa52-6545-47a5-96f4-e10229788cb9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:57.503030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5fa52-6545-47a5-96f4-e10229788cb9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:57.504073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aea13e-162d-4886-b849-9ba93b93214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:57.505460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aea13e-162d-4886-b849-9ba93b93214f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:57.505460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aea13e-162d-4886-b849-9ba93b93214f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:57.505825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aea13e-162d-4886-b849-9ba93b93214f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:57.506614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aea13e-162d-4886-b849-9ba93b93214f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:57.508385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aea13e-162d-4886-b849-9ba93b93214f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:57.525769 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1722/3474] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:45:57.527107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d7a06-db72-4b87-98b1-7fc75471c3a9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:57.527390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d7a06-db72-4b87-98b1-7fc75471c3a9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:57.527665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d7a06-db72-4b87-98b1-7fc75471c3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:57.549038 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1753/3475] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:57.550437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9189848-50fb-418a-9ff9-e6fc30a254f7 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:57.551840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-110d7a06-db72-4b87-98b1-7fc75471c3a9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:57.554081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-110d7a06-db72-4b87-98b1-7fc75471c3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:57.563992 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1723/3476] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:57.564910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d7a06-db72-4b87-98b1-7fc75471c3a9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:57.577790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d7a06-db72-4b87-98b1-7fc75471c3a9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:57.587120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8376a10-f9fd-45b0-869a-cb9912882f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:57.588645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8376a10-f9fd-45b0-869a-cb9912882f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:57.588986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8376a10-f9fd-45b0-869a-cb9912882f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:57.590217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8376a10-f9fd-45b0-869a-cb9912882f88 admin admin] PATH_INFO: `/v3/projects/fd2ed0782b9e4a23842ea96bdc018090/users/b45883d3057142c3b5eac714e26e27b6/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:57.601768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8376a10-f9fd-45b0-869a-cb9912882f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2ed0782b9e4a23842ea96bdc018090, user_id=b45883d3057142c3b5eac714e26e27b6, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:57.601768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8376a10-f9fd-45b0-869a-cb9912882f88 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:57.627870 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1724/3477] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:45:57 2022] PUT /identity/v3/projects/fd2ed0782b9e4a23842ea96bdc018090/users/b45883d3057142c3b5eac714e26e27b6/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:57.628929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8376a10-f9fd-45b0-869a-cb9912882f88 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:57.664066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9189848-50fb-418a-9ff9-e6fc30a254f7 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:57.745750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8376a10-f9fd-45b0-869a-cb9912882f88 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:57.754708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c463d0-e262-47be-9b08-07d6862e0f8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:57.756034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c463d0-e262-47be-9b08-07d6862e0f8a service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:57.756584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c463d0-e262-47be-9b08-07d6862e0f8a service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:57.757320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c463d0-e262-47be-9b08-07d6862e0f8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:57.835324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dab278-8dc7-4b6d-837e-33dab418fd42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:57.835977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dab278-8dc7-4b6d-837e-33dab418fd42 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:57.836351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dab278-8dc7-4b6d-837e-33dab418fd42 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:57.836574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dab278-8dc7-4b6d-837e-33dab418fd42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:57.850631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c463d0-e262-47be-9b08-07d6862e0f8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:57.852233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c463d0-e262-47be-9b08-07d6862e0f8a service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:57.874149 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1725/3478] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:57.875571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931608-24b4-46b4-b98e-5a30f0accc3e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:57.875983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931608-24b4-46b4-b98e-5a30f0accc3e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:57.876359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931608-24b4-46b4-b98e-5a30f0accc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:57.925275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dab278-8dc7-4b6d-837e-33dab418fd42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:57.930428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ab931608-24b4-46b4-b98e-5a30f0accc3e None None] MFA Rules not processed for user `b45883d3057142c3b5eac714e26e27b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:57.930562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dab278-8dc7-4b6d-837e-33dab418fd42 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:57.930685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ab931608-24b4-46b4-b98e-5a30f0accc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:57.940215 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1754/3479] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:57.940215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dab278-8dc7-4b6d-837e-33dab418fd42 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:57.941646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e0dab278-8dc7-4b6d-837e-33dab418fd42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:57.957389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dab278-8dc7-4b6d-837e-33dab418fd42 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:57.985917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651076af-67a2-4ffb-81f3-471157805e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:57.986561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651076af-67a2-4ffb-81f3-471157805e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:57.996361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651076af-67a2-4ffb-81f3-471157805e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:57.996361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651076af-67a2-4ffb-81f3-471157805e86 admin admin] PATH_INFO: `/v3/projects/ba61ff97f8464381935337f271a234e3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:57.996361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651076af-67a2-4ffb-81f3-471157805e86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba61ff97f8464381935337f271a234e3)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:57.996361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651076af-67a2-4ffb-81f3-471157805e86 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:58.110083 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1726/3480] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:58.120911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df263063-a34d-47f9-aa25-69d7199034fd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:58.121348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df263063-a34d-47f9-aa25-69d7199034fd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:58.121498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df263063-a34d-47f9-aa25-69d7199034fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:58.155680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-df263063-a34d-47f9-aa25-69d7199034fd None None] MFA Rules not processed for user `dd816cdc446443d5b3772afc7221fa79`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:58.157071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-df263063-a34d-47f9-aa25-69d7199034fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:58.197055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-651076af-67a2-4ffb-81f3-471157805e86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba61ff97f8464381935337f271a234e3', 'request_id': 'req-651076af-67a2-4ffb-81f3-471157805e86'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:58.216787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-651076af-67a2-4ffb-81f3-471157805e86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba61ff97f8464381935337f271a234e3', 'request_id': 'req-651076af-67a2-4ffb-81f3-471157805e86'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:58.274099 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1727/3481] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:45:58.312839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-651076af-67a2-4ffb-81f3-471157805e86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba61ff97f8464381935337f271a234e3', 'request_id': 'req-651076af-67a2-4ffb-81f3-471157805e86'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:58.326421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-651076af-67a2-4ffb-81f3-471157805e86 admin admin] The token cache is being invalidate because project ba61ff97f8464381935337f271a234e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:45:58.326783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-651076af-67a2-4ffb-81f3-471157805e86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:58.327576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-651076af-67a2-4ffb-81f3-471157805e86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:58.334558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df263063-a34d-47f9-aa25-69d7199034fd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:58.334857 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1755/3482] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:45:57 2022] DELETE /identity/v3/projects/ba61ff97f8464381935337f271a234e3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:58.338320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:58.352672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df263063-a34d-47f9-aa25-69d7199034fd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:58.495652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60206430-cb78-42ea-b11f-35a3f481d774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:58.496692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60206430-cb78-42ea-b11f-35a3f481d774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:58.497145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60206430-cb78-42ea-b11f-35a3f481d774 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:58.497667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60206430-cb78-42ea-b11f-35a3f481d774 admin admin] PATH_INFO: `/v3/users/6d835ecb5d3b422e9979ad346163cb1e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:58.499048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60206430-cb78-42ea-b11f-35a3f481d774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d835ecb5d3b422e9979ad346163cb1e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:58.501468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60206430-cb78-42ea-b11f-35a3f481d774 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:58.548525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417abb7-96d8-4a27-a5ab-c5a8e2488129 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:58.549547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417abb7-96d8-4a27-a5ab-c5a8e2488129 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:58.550021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417abb7-96d8-4a27-a5ab-c5a8e2488129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:58.560239 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-7417abb7-96d8-4a27-a5ab-c5a8e2488129 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:58.560239 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:45:58.560239 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:45:58.560239 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:45:58.560239 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:45:58.560239 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:45:58.560239 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:45:58.560239 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:45:58.560239 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:45:58.560239 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:45:58.560239 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:45:58.560239 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:45:58.560239 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:45:58.563048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:45:58.563048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:45:58.563048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:45:58.563048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:45:58.563048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:45:58.563048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:45:58.563048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:45:58.563048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:45:58.563048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:45:58.563048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:45:58.563048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:45:58.563048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:45:58.563048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:45:58.563048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:45:58.563048 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:45:58.565985 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1756/3483] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:45:58 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 18 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:45:58.601063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417abb7-96d8-4a27-a5ab-c5a8e2488129 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:58.604780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7417abb7-96d8-4a27-a5ab-c5a8e2488129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:58.725119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-60206430-cb78-42ea-b11f-35a3f481d774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d835ecb5d3b422e9979ad346163cb1e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:58.781017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417abb7-96d8-4a27-a5ab-c5a8e2488129 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:58.797328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb9542-8fcf-4d6a-b001-b6419e6f8be1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:58.798021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb9542-8fcf-4d6a-b001-b6419e6f8be1 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:58.798367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb9542-8fcf-4d6a-b001-b6419e6f8be1 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:58.798643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb9542-8fcf-4d6a-b001-b6419e6f8be1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:58.799157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-60206430-cb78-42ea-b11f-35a3f481d774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d835ecb5d3b422e9979ad346163cb1e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:58.800351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-60206430-cb78-42ea-b11f-35a3f481d774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d835ecb5d3b422e9979ad346163cb1e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:58.804233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-effb9542-8fcf-4d6a-b001-b6419e6f8be1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:58.820979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-60206430-cb78-42ea-b11f-35a3f481d774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d835ecb5d3b422e9979ad346163cb1e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:58.842475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-60206430-cb78-42ea-b11f-35a3f481d774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d835ecb5d3b422e9979ad346163cb1e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:58.856796 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1728/3484] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:45:58 2022] DELETE /identity/v3/users/6d835ecb5d3b422e9979ad346163cb1e => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:58.914672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb9542-8fcf-4d6a-b001-b6419e6f8be1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:58.917666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb9542-8fcf-4d6a-b001-b6419e6f8be1 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:58.933373 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1757/3485] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:45:59.220735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60206430-cb78-42ea-b11f-35a3f481d774 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:59.221683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-60206430-cb78-42ea-b11f-35a3f481d774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:59.261609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:45:59.325691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60206430-cb78-42ea-b11f-35a3f481d774 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:45:59.335832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa2497-f094-4f5d-a55a-7bfb7642ce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:45:59.338076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa2497-f094-4f5d-a55a-7bfb7642ce4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:59.339169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa2497-f094-4f5d-a55a-7bfb7642ce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:59.339618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa2497-f094-4f5d-a55a-7bfb7642ce4f admin admin] PATH_INFO: `/v3/users/71d3824322374a279c8efee8b072eb10` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:59.342199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa2497-f094-4f5d-a55a-7bfb7642ce4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d3824322374a279c8efee8b072eb10)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:45:59.346104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa2497-f094-4f5d-a55a-7bfb7642ce4f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:45:59.597846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-13fa2497-f094-4f5d-a55a-7bfb7642ce4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d3824322374a279c8efee8b072eb10'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:59.694154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-13fa2497-f094-4f5d-a55a-7bfb7642ce4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d3824322374a279c8efee8b072eb10'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:59.694796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-13fa2497-f094-4f5d-a55a-7bfb7642ce4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d3824322374a279c8efee8b072eb10'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:59.705356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-13fa2497-f094-4f5d-a55a-7bfb7642ce4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d3824322374a279c8efee8b072eb10'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:59.731322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-13fa2497-f094-4f5d-a55a-7bfb7642ce4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d3824322374a279c8efee8b072eb10'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:45:59.750285 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1729/3486] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:45:59 2022] DELETE /identity/v3/users/71d3824322374a279c8efee8b072eb10 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:45:59.750438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf2280-1748-4f1d-84b3-d228866a7c2c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:45:59.750438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf2280-1748-4f1d-84b3-d228866a7c2c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:45:59.750650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf2280-1748-4f1d-84b3-d228866a7c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:45:59.783916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bfcf2280-1748-4f1d-84b3-d228866a7c2c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:45:59.785385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bfcf2280-1748-4f1d-84b3-d228866a7c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:45:59.882506 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1758/3487] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:45:59.908911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa2497-f094-4f5d-a55a-7bfb7642ce4f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:45:59.911497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-13fa2497-f094-4f5d-a55a-7bfb7642ce4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:00.027607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa2497-f094-4f5d-a55a-7bfb7642ce4f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:00.032481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708c058-f923-4e4d-9c9a-3deb7a7fb398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:00.033605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708c058-f923-4e4d-9c9a-3deb7a7fb398 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:00.034114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708c058-f923-4e4d-9c9a-3deb7a7fb398 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:00.034692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708c058-f923-4e4d-9c9a-3deb7a7fb398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:00.073423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008ba9a-f1e3-478e-8483-be9ba71491b2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:00.074406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008ba9a-f1e3-478e-8483-be9ba71491b2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:00.078841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008ba9a-f1e3-478e-8483-be9ba71491b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:00.085298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708c058-f923-4e4d-9c9a-3deb7a7fb398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:00.088521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708c058-f923-4e4d-9c9a-3deb7a7fb398 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:00.103629 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1730/3488] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:00.116832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9008ba9a-f1e3-478e-8483-be9ba71491b2 None None] MFA Rules not processed for user `dd816cdc446443d5b3772afc7221fa79`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:00.118351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9008ba9a-f1e3-478e-8483-be9ba71491b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:00.201038 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1759/3489] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:00.323677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708c058-f923-4e4d-9c9a-3deb7a7fb398 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:00.325230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9708c058-f923-4e4d-9c9a-3deb7a7fb398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:00.352244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708c058-f923-4e4d-9c9a-3deb7a7fb398 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:00.358030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a526014-0893-4ab3-8162-56af34b2e68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:00.358731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a526014-0893-4ab3-8162-56af34b2e68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:00.359072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a526014-0893-4ab3-8162-56af34b2e68a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:00.359479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a526014-0893-4ab3-8162-56af34b2e68a admin admin] PATH_INFO: `/v3/projects/21226b3a7e484eeabcf096a561359b08` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:00.360722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a526014-0893-4ab3-8162-56af34b2e68a admin admin] RBAC: Authorizing `identity:delete_project(project_id=21226b3a7e484eeabcf096a561359b08)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:00.362777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a526014-0893-4ab3-8162-56af34b2e68a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:00.521337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7a526014-0893-4ab3-8162-56af34b2e68a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21226b3a7e484eeabcf096a561359b08', 'request_id': 'req-7a526014-0893-4ab3-8162-56af34b2e68a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:00.537918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7a526014-0893-4ab3-8162-56af34b2e68a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21226b3a7e484eeabcf096a561359b08', 'request_id': 'req-7a526014-0893-4ab3-8162-56af34b2e68a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:00.554342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7a526014-0893-4ab3-8162-56af34b2e68a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21226b3a7e484eeabcf096a561359b08', 'request_id': 'req-7a526014-0893-4ab3-8162-56af34b2e68a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:00.645484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7a526014-0893-4ab3-8162-56af34b2e68a admin admin] The token cache is being invalidate because project 21226b3a7e484eeabcf096a561359b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:00.646365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7a526014-0893-4ab3-8162-56af34b2e68a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:00.647685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7a526014-0893-4ab3-8162-56af34b2e68a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:00.650183 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1731/3490] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:46:00 2022] DELETE /identity/v3/projects/21226b3a7e484eeabcf096a561359b08 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:00.655776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f458df-8feb-4784-bc53-175db00f3397 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:00.656062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f458df-8feb-4784-bc53-175db00f3397 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:00.656365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f458df-8feb-4784-bc53-175db00f3397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:00.679314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a7f458df-8feb-4784-bc53-175db00f3397 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:00.680920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a7f458df-8feb-4784-bc53-175db00f3397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:00.775832 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1760/3491] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:00.780006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2785d2-db5c-466f-b3c7-e6d2e13eb437 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:00.780535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2785d2-db5c-466f-b3c7-e6d2e13eb437 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:00.780630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2785d2-db5c-466f-b3c7-e6d2e13eb437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:00.784931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:00.827515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3a2785d2-db5c-466f-b3c7-e6d2e13eb437 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:00.827515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3a2785d2-db5c-466f-b3c7-e6d2e13eb437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:00.832748 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1732/3492] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:00.837503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f458df-8feb-4784-bc53-175db00f3397 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:00.848820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f458df-8feb-4784-bc53-175db00f3397 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:00.855660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6017f-6f8e-4ed8-840f-85945ac9f067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:00.856442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6017f-6f8e-4ed8-840f-85945ac9f067 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:00.856773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6017f-6f8e-4ed8-840f-85945ac9f067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:00.857043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6017f-6f8e-4ed8-840f-85945ac9f067 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:00.857704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6017f-6f8e-4ed8-840f-85945ac9f067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:46:00.858007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6017f-6f8e-4ed8-840f-85945ac9f067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:00.860653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6017f-6f8e-4ed8-840f-85945ac9f067 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:00.878728 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1761/3493] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:46:00.884016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2785d2-db5c-466f-b3c7-e6d2e13eb437 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:00.897579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2785d2-db5c-466f-b3c7-e6d2e13eb437 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:00.905183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0259e-8aa4-46e9-bf79-d4ee4332be10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:00.906276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0259e-8aa4-46e9-bf79-d4ee4332be10 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:00.907067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0259e-8aa4-46e9-bf79-d4ee4332be10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:00.907227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0259e-8aa4-46e9-bf79-d4ee4332be10 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:00.912441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0259e-8aa4-46e9-bf79-d4ee4332be10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:00.913229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0259e-8aa4-46e9-bf79-d4ee4332be10 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:01.063241 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1733/3494] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:46:00 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:01.067906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6017f-6f8e-4ed8-840f-85945ac9f067 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:01.080124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6017f-6f8e-4ed8-840f-85945ac9f067 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:01.207675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0cb6a-dfc1-4b87-ac80-f8b31779d106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:01.209076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0cb6a-dfc1-4b87-ac80-f8b31779d106 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:01.210569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0cb6a-dfc1-4b87-ac80-f8b31779d106 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:01.211974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0cb6a-dfc1-4b87-ac80-f8b31779d106 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:01.214313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0cb6a-dfc1-4b87-ac80-f8b31779d106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:01.234003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0cb6a-dfc1-4b87-ac80-f8b31779d106 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:01.278373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:01.363403 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1762/3495] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:46:01 2022] POST /identity/v3/users => generated 290 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:01.369088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0259e-8aa4-46e9-bf79-d4ee4332be10 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:01.384945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0259e-8aa4-46e9-bf79-d4ee4332be10 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:01.394964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5bec6-6212-41ea-a73b-228487c551bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:01.395236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5bec6-6212-41ea-a73b-228487c551bb admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:01.399475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5bec6-6212-41ea-a73b-228487c551bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:01.399698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5bec6-6212-41ea-a73b-228487c551bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:01.400412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5bec6-6212-41ea-a73b-228487c551bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:01.402087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5bec6-6212-41ea-a73b-228487c551bb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:01.435839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0cb6a-dfc1-4b87-ac80-f8b31779d106 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:01.436780 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1734/3496] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:01.461211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0cb6a-dfc1-4b87-ac80-f8b31779d106 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:01.485175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845305b-be25-4aab-a43e-fb077ee0f6cd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:01.485407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845305b-be25-4aab-a43e-fb077ee0f6cd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:01.491901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845305b-be25-4aab-a43e-fb077ee0f6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:01.494728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ed13c-ccb1-489e-9960-309f956e6728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:01.495132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ed13c-ccb1-489e-9960-309f956e6728 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:01.495254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ed13c-ccb1-489e-9960-309f956e6728 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:01.498914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ed13c-ccb1-489e-9960-309f956e6728 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:01.500792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ed13c-ccb1-489e-9960-309f956e6728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:01.502439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ed13c-ccb1-489e-9960-309f956e6728 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:01.551151 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1763/3497] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:01.552848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ed13c-ccb1-489e-9960-309f956e6728 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:01.570772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6845305b-be25-4aab-a43e-fb077ee0f6cd None None] MFA Rules not processed for user `45a257bfdfce4bd8ae0c916558075d42`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:01.572627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6845305b-be25-4aab-a43e-fb077ee0f6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:01.582527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ed13c-ccb1-489e-9960-309f956e6728 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:01.604478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abebc33-731e-4561-813b-0602b17cefe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:01.605169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abebc33-731e-4561-813b-0602b17cefe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:01.605442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abebc33-731e-4561-813b-0602b17cefe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:01.605715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abebc33-731e-4561-813b-0602b17cefe3 admin admin] PATH_INFO: `/v3/projects/ca77829bae6547be8060314ca60c68f7/users/47601a541c1b4114b7c70524b7550d34/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:01.644598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abebc33-731e-4561-813b-0602b17cefe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca77829bae6547be8060314ca60c68f7, user_id=47601a541c1b4114b7c70524b7550d34, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:01.644598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abebc33-731e-4561-813b-0602b17cefe3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:01.686777 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1735/3498] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:01.688857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e51818-35f8-4657-8c4c-28eb8ad82235 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:01.689585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e51818-35f8-4657-8c4c-28eb8ad82235 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:01.690048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e51818-35f8-4657-8c4c-28eb8ad82235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:01.732581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-85e51818-35f8-4657-8c4c-28eb8ad82235 None None] MFA Rules not processed for user `45a257bfdfce4bd8ae0c916558075d42`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:01.741297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-85e51818-35f8-4657-8c4c-28eb8ad82235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:01.769122 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1736/3499] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:01.778915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49d33f-1b34-4b63-8a6f-c7376e3e35c0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:01.779255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49d33f-1b34-4b63-8a6f-c7376e3e35c0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:01.779470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49d33f-1b34-4b63-8a6f-c7376e3e35c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:01.812196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ca49d33f-1b34-4b63-8a6f-c7376e3e35c0 None None] MFA Rules not processed for user `45a257bfdfce4bd8ae0c916558075d42`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:01.813901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ca49d33f-1b34-4b63-8a6f-c7376e3e35c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:01.823259 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1764/3500] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:46:01 2022] PUT /identity/v3/projects/ca77829bae6547be8060314ca60c68f7/users/47601a541c1b4114b7c70524b7550d34/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:01.834326 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1737/3501] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:01.834560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d74ee-f7d4-443b-ad84-921280a88109 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:01.834560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d74ee-f7d4-443b-ad84-921280a88109 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:01.834560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d74ee-f7d4-443b-ad84-921280a88109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:01.842839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49d33f-1b34-4b63-8a6f-c7376e3e35c0 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:01.847575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ca49d33f-1b34-4b63-8a6f-c7376e3e35c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:01.889080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d51d74ee-f7d4-443b-ad84-921280a88109 None None] MFA Rules not processed for user `47601a541c1b4114b7c70524b7550d34`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:01.890317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d51d74ee-f7d4-443b-ad84-921280a88109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:02.035445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49d33f-1b34-4b63-8a6f-c7376e3e35c0 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:02.080905 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1765/3502] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:02.086126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf96ce-bf73-43f9-ac25-f06d6d34e126 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:02.086126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf96ce-bf73-43f9-ac25-f06d6d34e126 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:02.087265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf96ce-bf73-43f9-ac25-f06d6d34e126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:02.161257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c9088-7e9b-4569-97d6-809980dc942e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:02.163865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c9088-7e9b-4569-97d6-809980dc942e service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:02.163865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c9088-7e9b-4569-97d6-809980dc942e service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:02.163865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c9088-7e9b-4569-97d6-809980dc942e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:02.172699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9faf96ce-bf73-43f9-ac25-f06d6d34e126 None None] MFA Rules not processed for user `6190ea907d0544438eb3491462cfc49b`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:02.174953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9faf96ce-bf73-43f9-ac25-f06d6d34e126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:02.329521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c9088-7e9b-4569-97d6-809980dc942e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:02.331166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c9088-7e9b-4569-97d6-809980dc942e service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:02.362212 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1738/3503] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:46:02.363136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c9088-7e9b-4569-97d6-809980dc942e service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:02.370422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ad5c9088-7e9b-4569-97d6-809980dc942e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:02.415100 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1766/3504] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:02.416382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf96ce-bf73-43f9-ac25-f06d6d34e126 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:02.418050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9faf96ce-bf73-43f9-ac25-f06d6d34e126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:02.459966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf96ce-bf73-43f9-ac25-f06d6d34e126 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:02.476327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98365973-9827-49e0-b8f8-b26f08853fb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:02.477014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98365973-9827-49e0-b8f8-b26f08853fb0 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:02.477299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98365973-9827-49e0-b8f8-b26f08853fb0 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:02.477575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98365973-9827-49e0-b8f8-b26f08853fb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:02.525399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98365973-9827-49e0-b8f8-b26f08853fb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:02.527116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98365973-9827-49e0-b8f8-b26f08853fb0 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:02.545759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c9088-7e9b-4569-97d6-809980dc942e service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:02.552705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bb4b6-c3ba-4766-85e2-7ab52043266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:02.555456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bb4b6-c3ba-4766-85e2-7ab52043266c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:02.555456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bb4b6-c3ba-4766-85e2-7ab52043266c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:02.555456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bb4b6-c3ba-4766-85e2-7ab52043266c admin admin] PATH_INFO: `/v3/projects/f4bbd6d469ce4f5c95f82f57a7feba93` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:02.556124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66bb4b6-c3ba-4766-85e2-7ab52043266c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4bbd6d469ce4f5c95f82f57a7feba93)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:02.557806 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1767/3505] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:02.558287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66bb4b6-c3ba-4766-85e2-7ab52043266c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:02.562217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98365973-9827-49e0-b8f8-b26f08853fb0 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:02.568207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-98365973-9827-49e0-b8f8-b26f08853fb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:02.618987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98365973-9827-49e0-b8f8-b26f08853fb0 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:02.636292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041a892-43ec-4815-98af-eed0f7f3bc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:02.637150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041a892-43ec-4815-98af-eed0f7f3bc7d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:02.637600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041a892-43ec-4815-98af-eed0f7f3bc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:02.638223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041a892-43ec-4815-98af-eed0f7f3bc7d admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:02.639047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041a892-43ec-4815-98af-eed0f7f3bc7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:02.645378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041a892-43ec-4815-98af-eed0f7f3bc7d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:02.913783 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1768/3506] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:46:02 2022] POST /identity/v3/projects => generated 379 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:02.921911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041a892-43ec-4815-98af-eed0f7f3bc7d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:03.002754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f66bb4b6-c3ba-4766-85e2-7ab52043266c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4bbd6d469ce4f5c95f82f57a7feba93', 'request_id': 'req-f66bb4b6-c3ba-4766-85e2-7ab52043266c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:03.022892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f66bb4b6-c3ba-4766-85e2-7ab52043266c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4bbd6d469ce4f5c95f82f57a7feba93', 'request_id': 'req-f66bb4b6-c3ba-4766-85e2-7ab52043266c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:03.045299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f66bb4b6-c3ba-4766-85e2-7ab52043266c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4bbd6d469ce4f5c95f82f57a7feba93', 'request_id': 'req-f66bb4b6-c3ba-4766-85e2-7ab52043266c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:03.103952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:03.113090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041a892-43ec-4815-98af-eed0f7f3bc7d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:03.124507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323bebe-7d03-4a96-a138-c4d52e4d12c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:03.128150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323bebe-7d03-4a96-a138-c4d52e4d12c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:03.128795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323bebe-7d03-4a96-a138-c4d52e4d12c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:03.129896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323bebe-7d03-4a96-a138-c4d52e4d12c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:03.131983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323bebe-7d03-4a96-a138-c4d52e4d12c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:03.135414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323bebe-7d03-4a96-a138-c4d52e4d12c0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:03.183633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f66bb4b6-c3ba-4766-85e2-7ab52043266c admin admin] The token cache is being invalidate because project f4bbd6d469ce4f5c95f82f57a7feba93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:03.183633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f66bb4b6-c3ba-4766-85e2-7ab52043266c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:03.183633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f66bb4b6-c3ba-4766-85e2-7ab52043266c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:03.184709 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1739/3507] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:46:02 2022] DELETE /identity/v3/projects/f4bbd6d469ce4f5c95f82f57a7feba93 => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:03.199227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973c9a4-44ad-4062-924e-f4a394f51a35 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:03.200789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973c9a4-44ad-4062-924e-f4a394f51a35 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:03.200789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973c9a4-44ad-4062-924e-f4a394f51a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:03.225593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d973c9a4-44ad-4062-924e-f4a394f51a35 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:03.227065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d973c9a4-44ad-4062-924e-f4a394f51a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:03.248358 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1740/3508] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:03.248358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0af19-72f2-4338-b8d7-252fd4dfa6a3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:03.248358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0af19-72f2-4338-b8d7-252fd4dfa6a3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:03.248358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0af19-72f2-4338-b8d7-252fd4dfa6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:03.269162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-60e0af19-72f2-4338-b8d7-252fd4dfa6a3 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:03.281643 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1769/3509] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:46:02 2022] POST /identity/v3/users => generated 296 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:03.283892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660386e6-ffaa-4abd-a14e-3f6506aedfe8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:03.284190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660386e6-ffaa-4abd-a14e-3f6506aedfe8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:03.284532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660386e6-ffaa-4abd-a14e-3f6506aedfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:03.287196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:03.288076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-60e0af19-72f2-4338-b8d7-252fd4dfa6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:03.370834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-660386e6-ffaa-4abd-a14e-3f6506aedfe8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:03.372305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-660386e6-ffaa-4abd-a14e-3f6506aedfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:03.402582 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1770/3510] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:03.403774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660386e6-ffaa-4abd-a14e-3f6506aedfe8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:03.408626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-660386e6-ffaa-4abd-a14e-3f6506aedfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:03.458768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660386e6-ffaa-4abd-a14e-3f6506aedfe8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:03.484986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53450da-0d1f-4da2-b31e-ad4987517f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:03.486109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53450da-0d1f-4da2-b31e-ad4987517f02 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:03.486387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53450da-0d1f-4da2-b31e-ad4987517f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:03.489625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53450da-0d1f-4da2-b31e-ad4987517f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:03.490654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53450da-0d1f-4da2-b31e-ad4987517f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:03.495903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53450da-0d1f-4da2-b31e-ad4987517f02 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:03.504733 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1741/3511] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:46:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:03.506707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0af19-72f2-4338-b8d7-252fd4dfa6a3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:03.534075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0af19-72f2-4338-b8d7-252fd4dfa6a3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:03.549459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ca77e-5dcc-481b-b291-c0188f81c1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:03.550487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ca77e-5dcc-481b-b291-c0188f81c1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:03.551030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ca77e-5dcc-481b-b291-c0188f81c1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:03.551611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ca77e-5dcc-481b-b291-c0188f81c1b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:03.553249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ca77e-5dcc-481b-b291-c0188f81c1b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:46:03.555081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ca77e-5dcc-481b-b291-c0188f81c1b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:03.559079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ca77e-5dcc-481b-b291-c0188f81c1b1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:03.570295 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1771/3512] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:03.586037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53450da-0d1f-4da2-b31e-ad4987517f02 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:03.586037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b53450da-0d1f-4da2-b31e-ad4987517f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:03.592775 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1742/3513] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:46:03.595846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ca77e-5dcc-481b-b291-c0188f81c1b1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:03.625548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ca77e-5dcc-481b-b291-c0188f81c1b1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:03.663603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540c80b-11be-4b9e-a601-65c1fa6739a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:03.664942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540c80b-11be-4b9e-a601-65c1fa6739a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:03.664942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540c80b-11be-4b9e-a601-65c1fa6739a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:03.669069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540c80b-11be-4b9e-a601-65c1fa6739a1 admin admin] PATH_INFO: `/v3/projects/e1ea00bfb0fc49478c17c5a74fb507a3/users/b5107de485614d708f9225c9f96819bf/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:03.705340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540c80b-11be-4b9e-a601-65c1fa6739a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ea00bfb0fc49478c17c5a74fb507a3, user_id=b5107de485614d708f9225c9f96819bf, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:03.708032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540c80b-11be-4b9e-a601-65c1fa6739a1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:03.727373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53450da-0d1f-4da2-b31e-ad4987517f02 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:03.735394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c23dd-06c2-41e3-af95-e7259a74fe65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:03.735875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c23dd-06c2-41e3-af95-e7259a74fe65 service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:03.736174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c23dd-06c2-41e3-af95-e7259a74fe65 service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:03.736816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c23dd-06c2-41e3-af95-e7259a74fe65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:03.748731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c23dd-06c2-41e3-af95-e7259a74fe65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:03.751489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c23dd-06c2-41e3-af95-e7259a74fe65 service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:03.764258 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1772/3514] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:46:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:46:03.765154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c23dd-06c2-41e3-af95-e7259a74fe65 service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:03.789531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c23dd-06c2-41e3-af95-e7259a74fe65 service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:03.800361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9b113-c9ba-46dc-80d2-7b76db8bdada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:03.801442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9b113-c9ba-46dc-80d2-7b76db8bdada admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:03.801828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9b113-c9ba-46dc-80d2-7b76db8bdada admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:03.802410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9b113-c9ba-46dc-80d2-7b76db8bdada admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:03.803153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9b113-c9ba-46dc-80d2-7b76db8bdada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:03.806109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9b113-c9ba-46dc-80d2-7b76db8bdada admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:03.987268 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1743/3515] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:46:03 2022] PUT /identity/v3/projects/e1ea00bfb0fc49478c17c5a74fb507a3/users/b5107de485614d708f9225c9f96819bf/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:03.992493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a3a37-3462-4a8a-83b7-e0a389ef9a95 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:03.995782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a3a37-3462-4a8a-83b7-e0a389ef9a95 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:03.996727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a3a37-3462-4a8a-83b7-e0a389ef9a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:04.006425 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1773/3516] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:46:03 2022] POST /identity/v3/projects => generated 381 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:04.006976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9b113-c9ba-46dc-80d2-7b76db8bdada admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:04.026002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-b20a3a37-3462-4a8a-83b7-e0a389ef9a95 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:46:04.026002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:46:04.026002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:46:04.026002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:46:04.026002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:46:04.026002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:46:04.026002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:46:04.026002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:46:04.026002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:46:04.026002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:46:04.026002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:46:04.026002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:46:04.026002 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:46:04.027548 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:46:04.027548 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:46:04.027548 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:46:04.027548 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:46:04.027548 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:46:04.027548 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:46:04.027548 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:46:04.027548 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:46:04.027548 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:46:04.027548 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:46:04.027548 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:46:04.027548 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:46:04.027548 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:46:04.027548 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:46:04.027548 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:46:04.042470 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1744/3517] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:46:03 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 52 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:46:04.047352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a3a37-3462-4a8a-83b7-e0a389ef9a95 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:04.143625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9b113-c9ba-46dc-80d2-7b76db8bdada admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:04.156423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483966d-3b07-4f84-9146-a858df698ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:04.158891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483966d-3b07-4f84-9146-a858df698ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:04.159256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483966d-3b07-4f84-9146-a858df698ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:04.160363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483966d-3b07-4f84-9146-a858df698ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:04.171420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483966d-3b07-4f84-9146-a858df698ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:04.178431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483966d-3b07-4f84-9146-a858df698ab4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:04.205008 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1774/3518] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:04.207934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483966d-3b07-4f84-9146-a858df698ab4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:04.235082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483966d-3b07-4f84-9146-a858df698ab4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:04.246236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a3a37-3462-4a8a-83b7-e0a389ef9a95 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:04.252122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297a862-e056-45fd-99fe-8612abfc0607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:04.252122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297a862-e056-45fd-99fe-8612abfc0607 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:04.252122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297a862-e056-45fd-99fe-8612abfc0607 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:04.253041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297a862-e056-45fd-99fe-8612abfc0607 admin admin] PATH_INFO: `/v3/projects/e1ea00bfb0fc49478c17c5a74fb507a3/users/b5107de485614d708f9225c9f96819bf/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:04.261625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297a862-e056-45fd-99fe-8612abfc0607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ea00bfb0fc49478c17c5a74fb507a3, user_id=b5107de485614d708f9225c9f96819bf, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:04.262413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea9bde-293c-423c-a9b0-b2b49ea1dbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:04.264781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea9bde-293c-423c-a9b0-b2b49ea1dbaa admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:04.265185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea9bde-293c-423c-a9b0-b2b49ea1dbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:04.265659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea9bde-293c-423c-a9b0-b2b49ea1dbaa admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:04.266829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea9bde-293c-423c-a9b0-b2b49ea1dbaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:04.269026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297a862-e056-45fd-99fe-8612abfc0607 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:04.274869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea9bde-293c-423c-a9b0-b2b49ea1dbaa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:04.307768 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1775/3519] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:46:04 2022] PUT /identity/v3/projects/e1ea00bfb0fc49478c17c5a74fb507a3/users/b5107de485614d708f9225c9f96819bf/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:04.311437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765503c0-cf6c-4283-81f7-818ba4bda608 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:04.319348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765503c0-cf6c-4283-81f7-818ba4bda608 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:04.319348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765503c0-cf6c-4283-81f7-818ba4bda608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:04.367153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-765503c0-cf6c-4283-81f7-818ba4bda608 None None] MFA Rules not processed for user `47601a541c1b4114b7c70524b7550d34`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:04.372554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-765503c0-cf6c-4283-81f7-818ba4bda608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:04.456427 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1745/3520] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:46:04 2022] POST /identity/v3/users => generated 291 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:04.460872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea9bde-293c-423c-a9b0-b2b49ea1dbaa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:04.480579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea9bde-293c-423c-a9b0-b2b49ea1dbaa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:04.531537 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1776/3521] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:04.636459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923750e9-4018-4050-94c6-2979adf463a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:04.637398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923750e9-4018-4050-94c6-2979adf463a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:04.637912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923750e9-4018-4050-94c6-2979adf463a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:04.638398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923750e9-4018-4050-94c6-2979adf463a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:04.639318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923750e9-4018-4050-94c6-2979adf463a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:04.643312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923750e9-4018-4050-94c6-2979adf463a7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:04.656142 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1746/3522] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:04.660120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765503c0-cf6c-4283-81f7-818ba4bda608 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:04.689753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765503c0-cf6c-4283-81f7-818ba4bda608 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:04.697467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31967b-e435-48e8-9c6d-bd5346312a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:04.697973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31967b-e435-48e8-9c6d-bd5346312a0d admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:04.698351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31967b-e435-48e8-9c6d-bd5346312a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:04.698691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31967b-e435-48e8-9c6d-bd5346312a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:04.699418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31967b-e435-48e8-9c6d-bd5346312a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:04.701136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31967b-e435-48e8-9c6d-bd5346312a0d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:04.723906 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1777/3523] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:04.724734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923750e9-4018-4050-94c6-2979adf463a7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:04.740273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923750e9-4018-4050-94c6-2979adf463a7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:04.752414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc33d3d-2685-49b7-97aa-810836dbf45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:04.753105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc33d3d-2685-49b7-97aa-810836dbf45f admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:04.753531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc33d3d-2685-49b7-97aa-810836dbf45f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:04.753836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc33d3d-2685-49b7-97aa-810836dbf45f admin admin] PATH_INFO: `/v3/projects/425a0c60a86b496a9ca63ab6c2f17e88/users/c29134a8844e4130a74eb6358adeff5a/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:04.787447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc33d3d-2685-49b7-97aa-810836dbf45f admin admin] RBAC: Authorizing `identity:create_grant(project_id=425a0c60a86b496a9ca63ab6c2f17e88, user_id=c29134a8844e4130a74eb6358adeff5a, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:04.792049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc33d3d-2685-49b7-97aa-810836dbf45f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:04.809272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:04.872798 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1747/3524] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:46:04 2022] PUT /identity/v3/projects/425a0c60a86b496a9ca63ab6c2f17e88/users/c29134a8844e4130a74eb6358adeff5a/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:04.886326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f2307-eb98-469d-9722-df7e80e68cb7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:04.890938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f2307-eb98-469d-9722-df7e80e68cb7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:04.891296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f2307-eb98-469d-9722-df7e80e68cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:05.007039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-486f2307-eb98-469d-9722-df7e80e68cb7 None None] MFA Rules not processed for user `c29134a8844e4130a74eb6358adeff5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:05.011278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-486f2307-eb98-469d-9722-df7e80e68cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:05.239771 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1778/3525] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:05.251411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc33d3d-2685-49b7-97aa-810836dbf45f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:05.254539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7fc33d3d-2685-49b7-97aa-810836dbf45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:05.531924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc33d3d-2685-49b7-97aa-810836dbf45f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:05.539162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88aa61-7658-4b5f-aec6-08e456b7b3f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:05.544331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88aa61-7658-4b5f-aec6-08e456b7b3f5 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:05.544925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88aa61-7658-4b5f-aec6-08e456b7b3f5 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:05.545605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88aa61-7658-4b5f-aec6-08e456b7b3f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:05.554356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd934b-700b-4344-8e97-e57341e45700 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:05.555891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd934b-700b-4344-8e97-e57341e45700 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:05.555891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd934b-700b-4344-8e97-e57341e45700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:05.561001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88aa61-7658-4b5f-aec6-08e456b7b3f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:05.563339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88aa61-7658-4b5f-aec6-08e456b7b3f5 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:05.606390 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1748/3526] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:05.640506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2bbd934b-700b-4344-8e97-e57341e45700 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:05.646674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2bbd934b-700b-4344-8e97-e57341e45700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:05.706420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88aa61-7658-4b5f-aec6-08e456b7b3f5 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:05.804489 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1779/3527] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:46:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:05.806241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd934b-700b-4344-8e97-e57341e45700 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:05.849246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88aa61-7658-4b5f-aec6-08e456b7b3f5 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:05.857425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f5a92-fdc6-4107-b61d-8d5d12a3902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:05.858231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f5a92-fdc6-4107-b61d-8d5d12a3902a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:05.858439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f5a92-fdc6-4107-b61d-8d5d12a3902a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:05.866906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f5a92-fdc6-4107-b61d-8d5d12a3902a admin admin] PATH_INFO: `/v3/users/c29134a8844e4130a74eb6358adeff5a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:05.871542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f5a92-fdc6-4107-b61d-8d5d12a3902a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c29134a8844e4130a74eb6358adeff5a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:05.873741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f5a92-fdc6-4107-b61d-8d5d12a3902a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:06.002978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:06.161266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd934b-700b-4344-8e97-e57341e45700 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:06.169754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728aa36-3378-4d62-a350-e5a5e34db43d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:06.170849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728aa36-3378-4d62-a350-e5a5e34db43d service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:06.171311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728aa36-3378-4d62-a350-e5a5e34db43d service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:06.171799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728aa36-3378-4d62-a350-e5a5e34db43d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:06.206739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728aa36-3378-4d62-a350-e5a5e34db43d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:06.216033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728aa36-3378-4d62-a350-e5a5e34db43d service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:06.227909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1c0f5a92-fdc6-4107-b61d-8d5d12a3902a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c29134a8844e4130a74eb6358adeff5a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:06.272830 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1780/3528] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:46:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:46:06.333921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1c0f5a92-fdc6-4107-b61d-8d5d12a3902a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c29134a8844e4130a74eb6358adeff5a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:06.333921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1c0f5a92-fdc6-4107-b61d-8d5d12a3902a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c29134a8844e4130a74eb6358adeff5a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:06.342016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1c0f5a92-fdc6-4107-b61d-8d5d12a3902a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c29134a8844e4130a74eb6358adeff5a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:06.599467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1c0f5a92-fdc6-4107-b61d-8d5d12a3902a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c29134a8844e4130a74eb6358adeff5a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:06.602119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bac4c-9822-4a48-a778-7a0d69361bf5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:06.602119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bac4c-9822-4a48-a778-7a0d69361bf5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:06.602119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bac4c-9822-4a48-a778-7a0d69361bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:06.603797 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1749/3529] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:46:05 2022] DELETE /identity/v3/users/c29134a8844e4130a74eb6358adeff5a => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:06.604605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7a7bac4c-9822-4a48-a778-7a0d69361bf5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:06.604605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7a7bac4c-9822-4a48-a778-7a0d69361bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:06.644177 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1781/3530] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:06.719853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f5a92-fdc6-4107-b61d-8d5d12a3902a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:06.723371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1c0f5a92-fdc6-4107-b61d-8d5d12a3902a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:06.885440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f5a92-fdc6-4107-b61d-8d5d12a3902a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:06.898389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23251766-b190-4409-8ca9-e87bd67664a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:06.899042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23251766-b190-4409-8ca9-e87bd67664a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:06.899593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23251766-b190-4409-8ca9-e87bd67664a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:06.899868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23251766-b190-4409-8ca9-e87bd67664a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:06.924729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23251766-b190-4409-8ca9-e87bd67664a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:06.926532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23251766-b190-4409-8ca9-e87bd67664a0 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:06.976814 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1750/3531] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:07.063016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bac4c-9822-4a48-a778-7a0d69361bf5 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:07.064637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7a7bac4c-9822-4a48-a778-7a0d69361bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:07.098611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bac4c-9822-4a48-a778-7a0d69361bf5 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:07.109449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8a63b-a38d-4849-b472-b91367a15649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:07.110032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8a63b-a38d-4849-b472-b91367a15649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:07.110314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8a63b-a38d-4849-b472-b91367a15649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:07.110589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8a63b-a38d-4849-b472-b91367a15649 admin admin] PATH_INFO: `/v3/users/47601a541c1b4114b7c70524b7550d34` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:07.114810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8a63b-a38d-4849-b472-b91367a15649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47601a541c1b4114b7c70524b7550d34)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:07.121704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8a63b-a38d-4849-b472-b91367a15649 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:07.415090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-96f8a63b-a38d-4849-b472-b91367a15649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47601a541c1b4114b7c70524b7550d34'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:07.417627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-96f8a63b-a38d-4849-b472-b91367a15649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47601a541c1b4114b7c70524b7550d34'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:07.533594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-96f8a63b-a38d-4849-b472-b91367a15649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47601a541c1b4114b7c70524b7550d34'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:07.534308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-96f8a63b-a38d-4849-b472-b91367a15649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47601a541c1b4114b7c70524b7550d34'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:07.559695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-96f8a63b-a38d-4849-b472-b91367a15649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47601a541c1b4114b7c70524b7550d34'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:07.580637 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1782/3532] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:46:07 2022] DELETE /identity/v3/users/47601a541c1b4114b7c70524b7550d34 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:07.587358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9081c-3e36-4cec-85ff-b8ff8310686f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:07.587857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9081c-3e36-4cec-85ff-b8ff8310686f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:07.588113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9081c-3e36-4cec-85ff-b8ff8310686f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:07.620962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a6a9081c-3e36-4cec-85ff-b8ff8310686f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:07.623880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a6a9081c-3e36-4cec-85ff-b8ff8310686f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:07.725759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:07.728491 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1751/3533] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:07.805978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8a63b-a38d-4849-b472-b91367a15649 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:07.809156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-96f8a63b-a38d-4849-b472-b91367a15649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:07.844037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:07.950156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8a63b-a38d-4849-b472-b91367a15649 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:07.959700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff54183-d9f2-4afa-8036-1e32b0127888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:07.962379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff54183-d9f2-4afa-8036-1e32b0127888 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:07.962379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff54183-d9f2-4afa-8036-1e32b0127888 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:07.962379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff54183-d9f2-4afa-8036-1e32b0127888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:07.987571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff54183-d9f2-4afa-8036-1e32b0127888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:07.989082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff54183-d9f2-4afa-8036-1e32b0127888 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:08.022244 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1783/3534] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:08.703888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9081c-3e36-4cec-85ff-b8ff8310686f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:08.705393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a6a9081c-3e36-4cec-85ff-b8ff8310686f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:08.731749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9081c-3e36-4cec-85ff-b8ff8310686f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:08.743996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:08.744901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:08.745190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:08.745463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af admin admin] PATH_INFO: `/v3/projects/425a0c60a86b496a9ca63ab6c2f17e88` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:08.746721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af admin admin] RBAC: Authorizing `identity:delete_project(project_id=425a0c60a86b496a9ca63ab6c2f17e88)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:08.748687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:08.969983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '425a0c60a86b496a9ca63ab6c2f17e88', 'request_id': 'req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:08.984842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '425a0c60a86b496a9ca63ab6c2f17e88', 'request_id': 'req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:09.006370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '425a0c60a86b496a9ca63ab6c2f17e88', 'request_id': 'req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:09.156721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af admin admin] The token cache is being invalidate because project 425a0c60a86b496a9ca63ab6c2f17e88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:09.161168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:09.174897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:09.190970 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1752/3535] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:46:08 2022] DELETE /identity/v3/projects/425a0c60a86b496a9ca63ab6c2f17e88 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:09.196152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f8af9-4182-4c48-9f9a-746d939ea27d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:09.196617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f8af9-4182-4c48-9f9a-746d939ea27d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:09.196720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f8af9-4182-4c48-9f9a-746d939ea27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:09.268502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f00f8af9-4182-4c48-9f9a-746d939ea27d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:09.271527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f00f8af9-4182-4c48-9f9a-746d939ea27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:09.279302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:09.295495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:09.296967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:09.347063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:09.513787 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1784/3536] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:09.515062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f8af9-4182-4c48-9f9a-746d939ea27d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:09.516561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f00f8af9-4182-4c48-9f9a-746d939ea27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:09.533634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f8af9-4182-4c48-9f9a-746d939ea27d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:09.549071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4923b4-29e8-48d9-9c7c-72054fee5f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:09.549736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4923b4-29e8-48d9-9c7c-72054fee5f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:09.550017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4923b4-29e8-48d9-9c7c-72054fee5f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:09.550295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4923b4-29e8-48d9-9c7c-72054fee5f0a admin admin] PATH_INFO: `/v3/projects/ca77829bae6547be8060314ca60c68f7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:09.569238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4923b4-29e8-48d9-9c7c-72054fee5f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca77829bae6547be8060314ca60c68f7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:09.576405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4923b4-29e8-48d9-9c7c-72054fee5f0a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:09.739525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1e013-5e34-4df6-8bb1-0b9ae6ea54af admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:09.754152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a4741-8b3f-4a95-a534-10bbac329a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:09.754819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a4741-8b3f-4a95-a534-10bbac329a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:09.759709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a4741-8b3f-4a95-a534-10bbac329a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:09.760042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a4741-8b3f-4a95-a534-10bbac329a0c admin admin] PATH_INFO: `/v3/users/45a257bfdfce4bd8ae0c916558075d42` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:09.765723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a4741-8b3f-4a95-a534-10bbac329a0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a257bfdfce4bd8ae0c916558075d42)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:09.768056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a4741-8b3f-4a95-a534-10bbac329a0c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:09.859663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3d4923b4-29e8-48d9-9c7c-72054fee5f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca77829bae6547be8060314ca60c68f7', 'request_id': 'req-3d4923b4-29e8-48d9-9c7c-72054fee5f0a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:09.884225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3d4923b4-29e8-48d9-9c7c-72054fee5f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca77829bae6547be8060314ca60c68f7', 'request_id': 'req-3d4923b4-29e8-48d9-9c7c-72054fee5f0a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:09.977720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3d4923b4-29e8-48d9-9c7c-72054fee5f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca77829bae6547be8060314ca60c68f7', 'request_id': 'req-3d4923b4-29e8-48d9-9c7c-72054fee5f0a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:09.996487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3d4923b4-29e8-48d9-9c7c-72054fee5f0a admin admin] The token cache is being invalidate because project ca77829bae6547be8060314ca60c68f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:09.996837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3d4923b4-29e8-48d9-9c7c-72054fee5f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:09.997518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3d4923b4-29e8-48d9-9c7c-72054fee5f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.000679 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1785/3537] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:46:09 2022] DELETE /identity/v3/projects/ca77829bae6547be8060314ca60c68f7 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:10.001983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b3bf-b6e4-483c-9031-f7bd7435b3f8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:10.002269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b3bf-b6e4-483c-9031-f7bd7435b3f8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:10.002544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b3bf-b6e4-483c-9031-f7bd7435b3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:10.029300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0f29b3bf-b6e4-483c-9031-f7bd7435b3f8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:10.031531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0f29b3bf-b6e4-483c-9031-f7bd7435b3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:10.063046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8c0a4741-8b3f-4a95-a534-10bbac329a0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a257bfdfce4bd8ae0c916558075d42'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.174725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8c0a4741-8b3f-4a95-a534-10bbac329a0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a257bfdfce4bd8ae0c916558075d42'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.175647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8c0a4741-8b3f-4a95-a534-10bbac329a0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a257bfdfce4bd8ae0c916558075d42'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.185566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8c0a4741-8b3f-4a95-a534-10bbac329a0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a257bfdfce4bd8ae0c916558075d42'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.217153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8c0a4741-8b3f-4a95-a534-10bbac329a0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a257bfdfce4bd8ae0c916558075d42'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:10.235881 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1753/3538] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:46:09 2022] DELETE /identity/v3/users/45a257bfdfce4bd8ae0c916558075d42 => generated 0 bytes in 941 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:10.240222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a8893-e87d-4fc9-9b6c-0f5aac9c1148 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:10.240222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a8893-e87d-4fc9-9b6c-0f5aac9c1148 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:10.240222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a8893-e87d-4fc9-9b6c-0f5aac9c1148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:10.252047 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1786/3539] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:10.257736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29b3bf-b6e4-483c-9031-f7bd7435b3f8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:10.285011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29b3bf-b6e4-483c-9031-f7bd7435b3f8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:10.291107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1e4a8893-e87d-4fc9-9b6c-0f5aac9c1148 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:10.293492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1e4a8893-e87d-4fc9-9b6c-0f5aac9c1148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:10.409439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811083c-c2ab-4a1d-b93e-c395f63ed10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:10.410443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811083c-c2ab-4a1d-b93e-c395f63ed10e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:10.410906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811083c-c2ab-4a1d-b93e-c395f63ed10e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:10.412671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811083c-c2ab-4a1d-b93e-c395f63ed10e admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:10.413549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811083c-c2ab-4a1d-b93e-c395f63ed10e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:46:10.414036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811083c-c2ab-4a1d-b93e-c395f63ed10e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:10.415856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811083c-c2ab-4a1d-b93e-c395f63ed10e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:10.442205 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1754/3540] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:10.443897 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1787/3541] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:46:10.453156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a917284-6d00-415c-9c2f-f03e06e07329 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:10.453707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a917284-6d00-415c-9c2f-f03e06e07329 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:10.454159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a917284-6d00-415c-9c2f-f03e06e07329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:10.455048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a8893-e87d-4fc9-9b6c-0f5aac9c1148 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:10.509358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1a917284-6d00-415c-9c2f-f03e06e07329 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:10.510957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1a917284-6d00-415c-9c2f-f03e06e07329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:10.515468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a8893-e87d-4fc9-9b6c-0f5aac9c1148 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:10.528723 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1788/3542] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:10.532849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a917284-6d00-415c-9c2f-f03e06e07329 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:10.534702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22d4d6-860f-4502-9aef-baa26f32b611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:10.537603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d4d6-860f-4502-9aef-baa26f32b611 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:10.539442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d4d6-860f-4502-9aef-baa26f32b611 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:10.540608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d4d6-860f-4502-9aef-baa26f32b611 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:10.541352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22d4d6-860f-4502-9aef-baa26f32b611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:10.544370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22d4d6-860f-4502-9aef-baa26f32b611 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:10.554717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a917284-6d00-415c-9c2f-f03e06e07329 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:10.567116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b1252-baf9-46c4-adce-93f84225f90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:10.568415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b1252-baf9-46c4-adce-93f84225f90a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:10.568701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b1252-baf9-46c4-adce-93f84225f90a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:10.568981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b1252-baf9-46c4-adce-93f84225f90a admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:10.569664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b1252-baf9-46c4-adce-93f84225f90a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:46:10.569961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b1252-baf9-46c4-adce-93f84225f90a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:10.571599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b1252-baf9-46c4-adce-93f84225f90a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:10.596349 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1789/3543] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:46:10.601851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b1252-baf9-46c4-adce-93f84225f90a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:10.624008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b1252-baf9-46c4-adce-93f84225f90a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:10.635047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3993be0-b3cf-4615-9b51-531fbe3ceb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:10.635655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3993be0-b3cf-4615-9b51-531fbe3ceb4c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:10.635944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3993be0-b3cf-4615-9b51-531fbe3ceb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:10.636245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3993be0-b3cf-4615-9b51-531fbe3ceb4c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:10.636916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3993be0-b3cf-4615-9b51-531fbe3ceb4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:10.638892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3993be0-b3cf-4615-9b51-531fbe3ceb4c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:10.693540 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1755/3544] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:46:10 2022] POST /identity/v3/projects => generated 359 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:10.695552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:10.697343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22d4d6-860f-4502-9aef-baa26f32b611 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:10.772722 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1790/3545] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:46:10 2022] POST /identity/v3/projects => generated 401 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:46:10.777711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3993be0-b3cf-4615-9b51-531fbe3ceb4c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:10.800139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:10.885898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22d4d6-860f-4502-9aef-baa26f32b611 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:10.962569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3993be0-b3cf-4615-9b51-531fbe3ceb4c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:10.977320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6c122-f106-4d58-b380-797af4b860f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:10.978250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6c122-f106-4d58-b380-797af4b860f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:10.978716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6c122-f106-4d58-b380-797af4b860f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:10.979165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6c122-f106-4d58-b380-797af4b860f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:10.980008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6c122-f106-4d58-b380-797af4b860f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:10.984941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6c122-f106-4d58-b380-797af4b860f5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:11.053870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acb6de-5190-47fe-ae48-2e3b0a926f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:11.054559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acb6de-5190-47fe-ae48-2e3b0a926f41 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:11.054843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acb6de-5190-47fe-ae48-2e3b0a926f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:11.055170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acb6de-5190-47fe-ae48-2e3b0a926f41 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:11.055917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acb6de-5190-47fe-ae48-2e3b0a926f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:11.058178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acb6de-5190-47fe-ae48-2e3b0a926f41 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:11.152973 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1791/3546] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:46:10 2022] POST /identity/v3/users => generated 301 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:11.158337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6c122-f106-4d58-b380-797af4b860f5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:11.201566 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1756/3547] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:46:10 2022] POST /identity/v3/users => generated 280 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:11.203135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acb6de-5190-47fe-ae48-2e3b0a926f41 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:11.215159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6c122-f106-4d58-b380-797af4b860f5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:11.230638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acb6de-5190-47fe-ae48-2e3b0a926f41 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:11.240409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49abcb4-55b4-442e-99bd-cc0f7d9c06f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:11.241440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49abcb4-55b4-442e-99bd-cc0f7d9c06f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:11.241954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49abcb4-55b4-442e-99bd-cc0f7d9c06f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:11.243854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b980b5-4c9a-4d18-a143-05059b16aa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:11.244334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49abcb4-55b4-442e-99bd-cc0f7d9c06f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:11.244880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b980b5-4c9a-4d18-a143-05059b16aa02 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:11.245319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b980b5-4c9a-4d18-a143-05059b16aa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:11.245751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b980b5-4c9a-4d18-a143-05059b16aa02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:11.246149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49abcb4-55b4-442e-99bd-cc0f7d9c06f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:11.247627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b980b5-4c9a-4d18-a143-05059b16aa02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:11.248793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b980b5-4c9a-4d18-a143-05059b16aa02 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:11.250449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49abcb4-55b4-442e-99bd-cc0f7d9c06f4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:11.279584 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1757/3548] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:11.280857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b980b5-4c9a-4d18-a143-05059b16aa02 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:11.286650 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1792/3549] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:11.290771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49abcb4-55b4-442e-99bd-cc0f7d9c06f4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:11.306446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b980b5-4c9a-4d18-a143-05059b16aa02 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:11.316176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49abcb4-55b4-442e-99bd-cc0f7d9c06f4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:11.319443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1f6fb-5479-473a-ad3f-7fee1202d476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:11.320352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1f6fb-5479-473a-ad3f-7fee1202d476 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:11.320813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1f6fb-5479-473a-ad3f-7fee1202d476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:11.321403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1f6fb-5479-473a-ad3f-7fee1202d476 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:11.321579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df2340-efcb-4577-8d9e-68cdae24e6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:11.322176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df2340-efcb-4577-8d9e-68cdae24e6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:11.322451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df2340-efcb-4577-8d9e-68cdae24e6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:11.322719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df2340-efcb-4577-8d9e-68cdae24e6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:11.322945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1f6fb-5479-473a-ad3f-7fee1202d476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:11.323847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df2340-efcb-4577-8d9e-68cdae24e6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:11.325146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1f6fb-5479-473a-ad3f-7fee1202d476 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:11.325858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df2340-efcb-4577-8d9e-68cdae24e6f5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:11.340588 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1758/3550] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:11.343943 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1793/3551] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:46:11.345150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df2340-efcb-4577-8d9e-68cdae24e6f5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:11.345812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1f6fb-5479-473a-ad3f-7fee1202d476 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:11.358046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1f6fb-5479-473a-ad3f-7fee1202d476 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:11.364858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df2340-efcb-4577-8d9e-68cdae24e6f5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:11.365807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249621f4-4098-442a-b20b-276d91b59a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:11.367016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249621f4-4098-442a-b20b-276d91b59a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:11.367502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249621f4-4098-442a-b20b-276d91b59a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:11.367948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249621f4-4098-442a-b20b-276d91b59a3b admin admin] PATH_INFO: `/v3/projects/f4185d79a6094e40ac474cf89d438d82/users/e0b2967fe54c42859db5e36293550a40/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:11.371794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc4ccb-4f97-4bec-82cc-14d07ee1113b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:11.374263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc4ccb-4f97-4bec-82cc-14d07ee1113b admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:11.374961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc4ccb-4f97-4bec-82cc-14d07ee1113b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:11.375242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc4ccb-4f97-4bec-82cc-14d07ee1113b admin admin] PATH_INFO: `/v3/projects/68c2fd692f8a4b5ab14422a2503be621/users/b1a81761578c490a8ddb7395e9ce2e0d/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:11.398182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc4ccb-4f97-4bec-82cc-14d07ee1113b admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c2fd692f8a4b5ab14422a2503be621, user_id=b1a81761578c490a8ddb7395e9ce2e0d, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:11.399541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249621f4-4098-442a-b20b-276d91b59a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4185d79a6094e40ac474cf89d438d82, user_id=e0b2967fe54c42859db5e36293550a40, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:11.402690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249621f4-4098-442a-b20b-276d91b59a3b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:11.409953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc4ccb-4f97-4bec-82cc-14d07ee1113b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:11.503335 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1759/3552] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:46:11 2022] PUT /identity/v3/projects/f4185d79a6094e40ac474cf89d438d82/users/e0b2967fe54c42859db5e36293550a40/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:11.505573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249621f4-4098-442a-b20b-276d91b59a3b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:11.507653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-249621f4-4098-442a-b20b-276d91b59a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:11.531541 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1794/3553] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:46:11 2022] PUT /identity/v3/projects/68c2fd692f8a4b5ab14422a2503be621/users/b1a81761578c490a8ddb7395e9ce2e0d/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:11.533678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268ac65-69ba-4741-8e82-684e336925ea None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:11.534018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268ac65-69ba-4741-8e82-684e336925ea None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:11.534277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268ac65-69ba-4741-8e82-684e336925ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:11.591461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0268ac65-69ba-4741-8e82-684e336925ea None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:11.592735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0268ac65-69ba-4741-8e82-684e336925ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:11.745934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249621f4-4098-442a-b20b-276d91b59a3b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:11.779869 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1795/3554] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:11.779869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a3cfa-9e43-4026-a534-9ed15f6423ef None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:11.779869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a3cfa-9e43-4026-a534-9ed15f6423ef None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:11.779869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a3cfa-9e43-4026-a534-9ed15f6423ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:11.837629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5e8a3cfa-9e43-4026-a534-9ed15f6423ef None None] MFA Rules not processed for user `b1a81761578c490a8ddb7395e9ce2e0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:11.838900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5e8a3cfa-9e43-4026-a534-9ed15f6423ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:11.843642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:11.874562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c50795-c700-4569-bea2-ace8be349880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:11.875512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c50795-c700-4569-bea2-ace8be349880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:11.875922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c50795-c700-4569-bea2-ace8be349880 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:11.876200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c50795-c700-4569-bea2-ace8be349880 admin admin] PATH_INFO: `/v3/projects/6821f5646cb840d3aa0511de1fdb3084` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:11.877889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c50795-c700-4569-bea2-ace8be349880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6821f5646cb840d3aa0511de1fdb3084)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:11.883458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c50795-c700-4569-bea2-ace8be349880 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:12.046454 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1796/3555] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:12.047462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a3cfa-9e43-4026-a534-9ed15f6423ef None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:12.055343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5e8a3cfa-9e43-4026-a534-9ed15f6423ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:12.122107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-74c50795-c700-4569-bea2-ace8be349880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6821f5646cb840d3aa0511de1fdb3084', 'request_id': 'req-74c50795-c700-4569-bea2-ace8be349880'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.159404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-74c50795-c700-4569-bea2-ace8be349880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6821f5646cb840d3aa0511de1fdb3084', 'request_id': 'req-74c50795-c700-4569-bea2-ace8be349880'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.179057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-74c50795-c700-4569-bea2-ace8be349880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6821f5646cb840d3aa0511de1fdb3084', 'request_id': 'req-74c50795-c700-4569-bea2-ace8be349880'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.264830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-74c50795-c700-4569-bea2-ace8be349880 admin admin] The token cache is being invalidate because project 6821f5646cb840d3aa0511de1fdb3084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:12.265130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-74c50795-c700-4569-bea2-ace8be349880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.267471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-74c50795-c700-4569-bea2-ace8be349880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:12.267984 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1760/3556] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:46:11 2022] DELETE /identity/v3/projects/6821f5646cb840d3aa0511de1fdb3084 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:12.268905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c50795-c700-4569-bea2-ace8be349880 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:12.279649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-74c50795-c700-4569-bea2-ace8be349880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:12.341283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a3cfa-9e43-4026-a534-9ed15f6423ef None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:12.468990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147adc42-f08f-4007-8928-bff093f10e27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:12.469616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147adc42-f08f-4007-8928-bff093f10e27 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:12.469890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147adc42-f08f-4007-8928-bff093f10e27 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:12.470157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147adc42-f08f-4007-8928-bff093f10e27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:12.476511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-147adc42-f08f-4007-8928-bff093f10e27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:12.494637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:12.496346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c50795-c700-4569-bea2-ace8be349880 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:12.522181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b215a19-03ef-4f61-9224-05ee0db84327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:12.523514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b215a19-03ef-4f61-9224-05ee0db84327 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:12.528704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b215a19-03ef-4f61-9224-05ee0db84327 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:12.529384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b215a19-03ef-4f61-9224-05ee0db84327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:12.532215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9b215a19-03ef-4f61-9224-05ee0db84327 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:12.624572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147adc42-f08f-4007-8928-bff093f10e27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:12.626558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147adc42-f08f-4007-8928-bff093f10e27 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:12.639742 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1797/3557] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:12.641758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761a87c-5019-4570-9257-fcc6092a7f19 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:12.642281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761a87c-5019-4570-9257-fcc6092a7f19 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:12.642880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761a87c-5019-4570-9257-fcc6092a7f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:12.680995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0761a87c-5019-4570-9257-fcc6092a7f19 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:12.682508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0761a87c-5019-4570-9257-fcc6092a7f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:12.686635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b215a19-03ef-4f61-9224-05ee0db84327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:12.688687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b215a19-03ef-4f61-9224-05ee0db84327 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:12.692680 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1798/3558] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:12.700547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744f90c-8a51-4f44-8bfd-7b57b3689f8a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:12.700968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744f90c-8a51-4f44-8bfd-7b57b3689f8a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:12.701717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744f90c-8a51-4f44-8bfd-7b57b3689f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:12.709135 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1761/3559] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:12.759314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3744f90c-8a51-4f44-8bfd-7b57b3689f8a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:12.761758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3744f90c-8a51-4f44-8bfd-7b57b3689f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:12.819109 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1799/3560] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:12.830993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b215a19-03ef-4f61-9224-05ee0db84327 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:12.830993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9b215a19-03ef-4f61-9224-05ee0db84327 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:12.831533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744f90c-8a51-4f44-8bfd-7b57b3689f8a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:12.858642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b215a19-03ef-4f61-9224-05ee0db84327 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:12.859174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744f90c-8a51-4f44-8bfd-7b57b3689f8a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:12.865897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa61f1-b3e6-422c-8a67-8df2a1126819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:12.866622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa61f1-b3e6-422c-8a67-8df2a1126819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:12.867113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa61f1-b3e6-422c-8a67-8df2a1126819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:12.867214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa61f1-b3e6-422c-8a67-8df2a1126819 admin admin] PATH_INFO: `/v3/users/b1a81761578c490a8ddb7395e9ce2e0d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:12.871926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa61f1-b3e6-422c-8a67-8df2a1126819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a81761578c490a8ddb7395e9ce2e0d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:12.874008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa61f1-b3e6-422c-8a67-8df2a1126819 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:12.892241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b55206-f5e5-4814-bd5a-1263287b3a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:12.893050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b55206-f5e5-4814-bd5a-1263287b3a29 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:12.893329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b55206-f5e5-4814-bd5a-1263287b3a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:12.896840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b55206-f5e5-4814-bd5a-1263287b3a29 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:12.896840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b55206-f5e5-4814-bd5a-1263287b3a29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:46:12.896840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b55206-f5e5-4814-bd5a-1263287b3a29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:12.900729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b55206-f5e5-4814-bd5a-1263287b3a29 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:12.946112 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1800/3561] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:46:12.947347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b55206-f5e5-4814-bd5a-1263287b3a29 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:12.976192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b55206-f5e5-4814-bd5a-1263287b3a29 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:12.992143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776e148-68f6-4022-8799-79f691b28975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:12.993645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776e148-68f6-4022-8799-79f691b28975 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:12.994229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776e148-68f6-4022-8799-79f691b28975 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:12.994794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776e148-68f6-4022-8799-79f691b28975 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:12.995664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776e148-68f6-4022-8799-79f691b28975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:12.999797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776e148-68f6-4022-8799-79f691b28975 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:13.131469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:13.150558 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1801/3562] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:46:12 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:13.156877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776e148-68f6-4022-8799-79f691b28975 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:13.221952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-03aa61f1-b3e6-422c-8a67-8df2a1126819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a81761578c490a8ddb7395e9ce2e0d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:13.390897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776e148-68f6-4022-8799-79f691b28975 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:13.398279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-03aa61f1-b3e6-422c-8a67-8df2a1126819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a81761578c490a8ddb7395e9ce2e0d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:13.398664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-03aa61f1-b3e6-422c-8a67-8df2a1126819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a81761578c490a8ddb7395e9ce2e0d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:13.409373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-03aa61f1-b3e6-422c-8a67-8df2a1126819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a81761578c490a8ddb7395e9ce2e0d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:13.419210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d892db-1676-46fa-81a2-8a0ca12216ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:13.419849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d892db-1676-46fa-81a2-8a0ca12216ef admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:13.420130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d892db-1676-46fa-81a2-8a0ca12216ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:13.421501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d892db-1676-46fa-81a2-8a0ca12216ef admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:13.422031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d892db-1676-46fa-81a2-8a0ca12216ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:13.424537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d892db-1676-46fa-81a2-8a0ca12216ef admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:13.452602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-03aa61f1-b3e6-422c-8a67-8df2a1126819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a81761578c490a8ddb7395e9ce2e0d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:13.466719 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1762/3563] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:46:12 2022] DELETE /identity/v3/users/b1a81761578c490a8ddb7395e9ce2e0d => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:13.472647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be90240-90a8-43ae-9489-c86105925d18 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:13.474909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be90240-90a8-43ae-9489-c86105925d18 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:13.475428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be90240-90a8-43ae-9489-c86105925d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:13.510018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5be90240-90a8-43ae-9489-c86105925d18 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:13.512033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5be90240-90a8-43ae-9489-c86105925d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:13.543472 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1802/3564] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:46:13 2022] POST /identity/v3/users => generated 291 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:13.547463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d892db-1676-46fa-81a2-8a0ca12216ef admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:13.549263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d5d892db-1676-46fa-81a2-8a0ca12216ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:13.578438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d892db-1676-46fa-81a2-8a0ca12216ef admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:13.694945 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1763/3565] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:13.727855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e37f2-d185-4908-a342-ab2ed8cdddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:13.732464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e37f2-d185-4908-a342-ab2ed8cdddc8 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:13.732908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e37f2-d185-4908-a342-ab2ed8cdddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:13.733921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e37f2-d185-4908-a342-ab2ed8cdddc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:13.734862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e37f2-d185-4908-a342-ab2ed8cdddc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:13.745899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e37f2-d185-4908-a342-ab2ed8cdddc8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:13.778178 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1803/3566] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:46:13.782271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be90240-90a8-43ae-9489-c86105925d18 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:13.798013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be90240-90a8-43ae-9489-c86105925d18 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:13.813635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588b0ef-9584-4150-98b8-46a2827cce78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:13.814566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588b0ef-9584-4150-98b8-46a2827cce78 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:13.814873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588b0ef-9584-4150-98b8-46a2827cce78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:13.815217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588b0ef-9584-4150-98b8-46a2827cce78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:13.816074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588b0ef-9584-4150-98b8-46a2827cce78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:13.821167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588b0ef-9584-4150-98b8-46a2827cce78 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:13.848832 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1764/3567] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:13.851227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e37f2-d185-4908-a342-ab2ed8cdddc8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:13.865161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e37f2-d185-4908-a342-ab2ed8cdddc8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:13.874401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76554553-94e6-401d-a254-7c39f2e6399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:13.876971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76554553-94e6-401d-a254-7c39f2e6399b admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:13.877367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76554553-94e6-401d-a254-7c39f2e6399b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:13.878546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76554553-94e6-401d-a254-7c39f2e6399b admin admin] PATH_INFO: `/v3/projects/e84bbf4628c144be8c336b08d9dc7482/users/0d9a43514b8d4c9ba725074185734bf7/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:13.891144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588b0ef-9584-4150-98b8-46a2827cce78 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:13.893108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7588b0ef-9584-4150-98b8-46a2827cce78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:13.962747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76554553-94e6-401d-a254-7c39f2e6399b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84bbf4628c144be8c336b08d9dc7482, user_id=0d9a43514b8d4c9ba725074185734bf7, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:13.972354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76554553-94e6-401d-a254-7c39f2e6399b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:14.027303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588b0ef-9584-4150-98b8-46a2827cce78 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:14.031788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16c96c-2cbb-4ad9-872b-94fe8e39c414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:14.032446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16c96c-2cbb-4ad9-872b-94fe8e39c414 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:14.033435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16c96c-2cbb-4ad9-872b-94fe8e39c414 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:14.033739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16c96c-2cbb-4ad9-872b-94fe8e39c414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:14.045555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16c96c-2cbb-4ad9-872b-94fe8e39c414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:14.047236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16c96c-2cbb-4ad9-872b-94fe8e39c414 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:14.070035 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1765/3568] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:46:14.073541 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1804/3569] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:46:13 2022] PUT /identity/v3/projects/e84bbf4628c144be8c336b08d9dc7482/users/0d9a43514b8d4c9ba725074185734bf7/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:14.078965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731df602-20b8-4c37-be05-cce3a5a7fb10 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:14.079495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731df602-20b8-4c37-be05-cce3a5a7fb10 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:14.079987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731df602-20b8-4c37-be05-cce3a5a7fb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:14.128567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-731df602-20b8-4c37-be05-cce3a5a7fb10 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:14.131801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-731df602-20b8-4c37-be05-cce3a5a7fb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:14.294133 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1766/3570] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:14.310141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76554553-94e6-401d-a254-7c39f2e6399b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:14.381219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:14.495457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76554553-94e6-401d-a254-7c39f2e6399b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:14.509038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228dfcb-4d85-48a0-ab29-39e691ffaf34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:14.516056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228dfcb-4d85-48a0-ab29-39e691ffaf34 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:14.516589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228dfcb-4d85-48a0-ab29-39e691ffaf34 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:14.517607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228dfcb-4d85-48a0-ab29-39e691ffaf34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:14.543944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228dfcb-4d85-48a0-ab29-39e691ffaf34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:14.545569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228dfcb-4d85-48a0-ab29-39e691ffaf34 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:14.563228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:14.575318 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1805/3571] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:15.697391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd1602-7db1-4388-ac28-a3882f544528 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:15.703033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd1602-7db1-4388-ac28-a3882f544528 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:15.703033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd1602-7db1-4388-ac28-a3882f544528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:15.789949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-dfbd1602-7db1-4388-ac28-a3882f544528 None None] MFA Rules not processed for user `4c83d15d07a34dc4950c8b514aa178ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:15.794711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dfbd1602-7db1-4388-ac28-a3882f544528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:15.894924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:15.967484 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1767/3572] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:15.968249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bc2b3-d88b-4ccd-8625-069087329586 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:15.970848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bc2b3-d88b-4ccd-8625-069087329586 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:15.971634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bc2b3-d88b-4ccd-8625-069087329586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:16.054934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bc8bc2b3-d88b-4ccd-8625-069087329586 None None] MFA Rules not processed for user `4c83d15d07a34dc4950c8b514aa178ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:16.060238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bc8bc2b3-d88b-4ccd-8625-069087329586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:16.080698 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1806/3573] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:16.143473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd1602-7db1-4388-ac28-a3882f544528 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:16.145035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dfbd1602-7db1-4388-ac28-a3882f544528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:16.346383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd1602-7db1-4388-ac28-a3882f544528 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:16.357675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a7e89-8c2e-43f3-b1e1-20d0ddfbf134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:16.358303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7e89-8c2e-43f3-b1e1-20d0ddfbf134 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:16.358579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7e89-8c2e-43f3-b1e1-20d0ddfbf134 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:16.358848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7e89-8c2e-43f3-b1e1-20d0ddfbf134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:16.383718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a7e89-8c2e-43f3-b1e1-20d0ddfbf134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:16.383954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a7e89-8c2e-43f3-b1e1-20d0ddfbf134 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:16.395660 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1768/3574] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:16 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:16.654917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:16.812267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df79a86-1d01-4f71-8188-85d2891653f1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:16.812767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df79a86-1d01-4f71-8188-85d2891653f1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:16.813274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df79a86-1d01-4f71-8188-85d2891653f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:16.825636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-2df79a86-1d01-4f71-8188-85d2891653f1 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:46:16.825636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:46:16.825636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:46:16.825636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:46:16.825636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:46:16.825636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:46:16.825636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:46:16.825636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:46:16.825636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:46:16.825636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:46:16.825636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:46:16.825636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:46:16.825636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:46:16.826570 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:46:16.826570 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:46:16.826570 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:46:16.826570 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:46:16.826570 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:46:16.826570 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:46:16.826570 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:46:16.826570 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:46:16.826570 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:46:16.826570 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:46:16.826570 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:46:16.826570 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:46:16.826570 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:46:16.826570 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:46:16.826570 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:46:16.828878 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1807/3575] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:46:16 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 18 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:46:16.910804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:16.939870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:17.061441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a7e89-8c2e-43f3-b1e1-20d0ddfbf134 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:17.063431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-026a7e89-8c2e-43f3-b1e1-20d0ddfbf134 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:17.105602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a7e89-8c2e-43f3-b1e1-20d0ddfbf134 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:17.111074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc514f2-9e53-4726-a82d-5ca5b8222aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:17.111929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc514f2-9e53-4726-a82d-5ca5b8222aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:17.112374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc514f2-9e53-4726-a82d-5ca5b8222aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:17.112785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc514f2-9e53-4726-a82d-5ca5b8222aaa admin admin] PATH_INFO: `/v3/projects/68c2fd692f8a4b5ab14422a2503be621` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:17.114946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc514f2-9e53-4726-a82d-5ca5b8222aaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c2fd692f8a4b5ab14422a2503be621)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:17.117501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc514f2-9e53-4726-a82d-5ca5b8222aaa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:17.311540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dbc514f2-9e53-4726-a82d-5ca5b8222aaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c2fd692f8a4b5ab14422a2503be621', 'request_id': 'req-dbc514f2-9e53-4726-a82d-5ca5b8222aaa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:17.320713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dbc514f2-9e53-4726-a82d-5ca5b8222aaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c2fd692f8a4b5ab14422a2503be621', 'request_id': 'req-dbc514f2-9e53-4726-a82d-5ca5b8222aaa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:17.332064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dbc514f2-9e53-4726-a82d-5ca5b8222aaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c2fd692f8a4b5ab14422a2503be621', 'request_id': 'req-dbc514f2-9e53-4726-a82d-5ca5b8222aaa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:17.430120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dbc514f2-9e53-4726-a82d-5ca5b8222aaa admin admin] The token cache is being invalidate because project 68c2fd692f8a4b5ab14422a2503be621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:17.430724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dbc514f2-9e53-4726-a82d-5ca5b8222aaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:17.431592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dbc514f2-9e53-4726-a82d-5ca5b8222aaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:17.433666 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1769/3576] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:46:17 2022] DELETE /identity/v3/projects/68c2fd692f8a4b5ab14422a2503be621 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:17.449991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb5385-1744-4c5f-9297-79e5469e4eba None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:17.451070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb5385-1744-4c5f-9297-79e5469e4eba None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:17.451527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb5385-1744-4c5f-9297-79e5469e4eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:17.522699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7dbb5385-1744-4c5f-9297-79e5469e4eba None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:17.524839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7dbb5385-1744-4c5f-9297-79e5469e4eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:17.702578 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1808/3577] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:17.710630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04279e9-a5ad-420e-9b8b-9d664eea163f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:17.711114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04279e9-a5ad-420e-9b8b-9d664eea163f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:17.711590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04279e9-a5ad-420e-9b8b-9d664eea163f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:17.751898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b04279e9-a5ad-420e-9b8b-9d664eea163f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:17.754649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b04279e9-a5ad-420e-9b8b-9d664eea163f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:17.768947 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1770/3578] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:17.773293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb5385-1744-4c5f-9297-79e5469e4eba None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:17.791135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb5385-1744-4c5f-9297-79e5469e4eba None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:17.802211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd9cf1-c404-4248-aad5-d7dd6c07a5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:17.803024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd9cf1-c404-4248-aad5-d7dd6c07a5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:17.803369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd9cf1-c404-4248-aad5-d7dd6c07a5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:17.803756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd9cf1-c404-4248-aad5-d7dd6c07a5f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:17.804688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd9cf1-c404-4248-aad5-d7dd6c07a5f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:46:17.805176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd9cf1-c404-4248-aad5-d7dd6c07a5f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:17.807472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd9cf1-c404-4248-aad5-d7dd6c07a5f5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:17.823831 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1809/3579] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:46:17.829697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04279e9-a5ad-420e-9b8b-9d664eea163f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:17.859829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04279e9-a5ad-420e-9b8b-9d664eea163f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:17.879605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ba56a-799e-43f6-a614-19e96af9617d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:17.883437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ba56a-799e-43f6-a614-19e96af9617d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:17.888601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ba56a-799e-43f6-a614-19e96af9617d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:17.890660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ba56a-799e-43f6-a614-19e96af9617d admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:17.892846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ba56a-799e-43f6-a614-19e96af9617d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:17.893580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ba56a-799e-43f6-a614-19e96af9617d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:18.031229 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1771/3580] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:46:17 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:46:18.032765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd9cf1-c404-4248-aad5-d7dd6c07a5f5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:18.059146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd9cf1-c404-4248-aad5-d7dd6c07a5f5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:18.301271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5c98a-2a9a-4a7b-ada9-6cd5725b8f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:18.302224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5c98a-2a9a-4a7b-ada9-6cd5725b8f29 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:18.302334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5c98a-2a9a-4a7b-ada9-6cd5725b8f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:18.302765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5c98a-2a9a-4a7b-ada9-6cd5725b8f29 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:18.303575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5c98a-2a9a-4a7b-ada9-6cd5725b8f29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:18.305597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5c98a-2a9a-4a7b-ada9-6cd5725b8f29 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:18.367666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:18.427600 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1810/3581] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:46:18 2022] POST /identity/v3/users => generated 289 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:18.431922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ba56a-799e-43f6-a614-19e96af9617d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:18.446859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ba56a-799e-43f6-a614-19e96af9617d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:18.466593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7081c-0fa8-4d23-8e24-59cb5cc94d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:18.467545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7081c-0fa8-4d23-8e24-59cb5cc94d62 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:18.467996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7081c-0fa8-4d23-8e24-59cb5cc94d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:18.468482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7081c-0fa8-4d23-8e24-59cb5cc94d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:18.469310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7081c-0fa8-4d23-8e24-59cb5cc94d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:18.472865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:18.475287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7081c-0fa8-4d23-8e24-59cb5cc94d62 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:18.524175 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1772/3582] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:18.529084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5c98a-2a9a-4a7b-ada9-6cd5725b8f29 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:18.542472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5c98a-2a9a-4a7b-ada9-6cd5725b8f29 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:18.563564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2a8fc-bce5-4c71-a487-4f495c5b1e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:18.565343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2a8fc-bce5-4c71-a487-4f495c5b1e2e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:18.566323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2a8fc-bce5-4c71-a487-4f495c5b1e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:18.571352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2a8fc-bce5-4c71-a487-4f495c5b1e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:18.582358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2a8fc-bce5-4c71-a487-4f495c5b1e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:18.582358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2a8fc-bce5-4c71-a487-4f495c5b1e2e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:18.618828 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1811/3583] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:46:18.622492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7081c-0fa8-4d23-8e24-59cb5cc94d62 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:18.642697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7081c-0fa8-4d23-8e24-59cb5cc94d62 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:18.661314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0d0a5-3bb9-4f26-a4f5-009b4b85d31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:18.669660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0d0a5-3bb9-4f26-a4f5-009b4b85d31e admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:18.670383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0d0a5-3bb9-4f26-a4f5-009b4b85d31e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:18.671163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0d0a5-3bb9-4f26-a4f5-009b4b85d31e admin admin] PATH_INFO: `/v3/projects/7929f66d29064429b0958af19edc5e9b/users/8115953d94074d32a4aee216289feb36/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:18.725385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0d0a5-3bb9-4f26-a4f5-009b4b85d31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7929f66d29064429b0958af19edc5e9b, user_id=8115953d94074d32a4aee216289feb36, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:18.728354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0d0a5-3bb9-4f26-a4f5-009b4b85d31e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:18.850067 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1773/3584] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:46:18 2022] PUT /identity/v3/projects/7929f66d29064429b0958af19edc5e9b/users/8115953d94074d32a4aee216289feb36/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:18.855135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98e247-ea2f-4cd3-a4d7-d54fc574f0e2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:18.855506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98e247-ea2f-4cd3-a4d7-d54fc574f0e2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:18.855859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98e247-ea2f-4cd3-a4d7-d54fc574f0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:18.892066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5a98e247-ea2f-4cd3-a4d7-d54fc574f0e2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:18.893440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5a98e247-ea2f-4cd3-a4d7-d54fc574f0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:19.064046 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1812/3585] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:19.277001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0d0a5-3bb9-4f26-a4f5-009b4b85d31e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:19.279675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b0b0d0a5-3bb9-4f26-a4f5-009b4b85d31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:19.456332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0d0a5-3bb9-4f26-a4f5-009b4b85d31e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:19.467138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ed773-4591-4236-815a-63ef6f35915e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:19.472014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ed773-4591-4236-815a-63ef6f35915e service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:19.472586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ed773-4591-4236-815a-63ef6f35915e service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:19.476844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ed773-4591-4236-815a-63ef6f35915e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:19.484684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:19.509720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ed773-4591-4236-815a-63ef6f35915e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:19.511636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ed773-4591-4236-815a-63ef6f35915e service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:19.533913 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1774/3586] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:19.575584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:20.114659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98e247-ea2f-4cd3-a4d7-d54fc574f0e2 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:20.116593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5a98e247-ea2f-4cd3-a4d7-d54fc574f0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:20.401542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98e247-ea2f-4cd3-a4d7-d54fc574f0e2 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:20.425013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7477b4d-4bc7-4193-9b6a-53703b5899fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:20.425819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7477b4d-4bc7-4193-9b6a-53703b5899fd service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:20.426272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7477b4d-4bc7-4193-9b6a-53703b5899fd service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:20.427343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7477b4d-4bc7-4193-9b6a-53703b5899fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:20.437124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f7477b4d-4bc7-4193-9b6a-53703b5899fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:20.464048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7477b4d-4bc7-4193-9b6a-53703b5899fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:20.466886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7477b4d-4bc7-4193-9b6a-53703b5899fd service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:20.481062 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1813/3587] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:21.363314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:21.718189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:23.112441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:23.643643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:23.878391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ed773-4591-4236-815a-63ef6f35915e service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:23.880691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e28ed773-4591-4236-815a-63ef6f35915e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:23.902549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ed773-4591-4236-815a-63ef6f35915e service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:23.909427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89f2a1-fe32-41e5-853a-c14324b1da2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:23.910386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89f2a1-fe32-41e5-853a-c14324b1da2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:23.911299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89f2a1-fe32-41e5-853a-c14324b1da2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:23.911774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89f2a1-fe32-41e5-853a-c14324b1da2d admin admin] PATH_INFO: `/v3/users/01c948ccddaa4a33a764b003826969fe` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:23.913587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89f2a1-fe32-41e5-853a-c14324b1da2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=01c948ccddaa4a33a764b003826969fe)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:23.916482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89f2a1-fe32-41e5-853a-c14324b1da2d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:24.019249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:24.137152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6c89f2a1-fe32-41e5-853a-c14324b1da2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01c948ccddaa4a33a764b003826969fe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:24.203459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6c89f2a1-fe32-41e5-853a-c14324b1da2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01c948ccddaa4a33a764b003826969fe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:24.204107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6c89f2a1-fe32-41e5-853a-c14324b1da2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01c948ccddaa4a33a764b003826969fe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:24.218402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6c89f2a1-fe32-41e5-853a-c14324b1da2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01c948ccddaa4a33a764b003826969fe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:24.269897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6c89f2a1-fe32-41e5-853a-c14324b1da2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01c948ccddaa4a33a764b003826969fe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:24.289557 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1775/3588] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:46:23 2022] DELETE /identity/v3/users/01c948ccddaa4a33a764b003826969fe => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:24.291364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60ecb2-884f-417f-bb73-2ed454cdde17 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:24.291870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60ecb2-884f-417f-bb73-2ed454cdde17 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:24.291967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60ecb2-884f-417f-bb73-2ed454cdde17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:24.326877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4b60ecb2-884f-417f-bb73-2ed454cdde17 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:24.328431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4b60ecb2-884f-417f-bb73-2ed454cdde17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:24.394629 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1814/3589] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:24.480156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89f2a1-fe32-41e5-853a-c14324b1da2d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:24.482576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6c89f2a1-fe32-41e5-853a-c14324b1da2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:24.663376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89f2a1-fe32-41e5-853a-c14324b1da2d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:24.671570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c30f3-0b72-47c1-a4ef-5c459ba7a972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:24.673166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c30f3-0b72-47c1-a4ef-5c459ba7a972 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:24.674987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c30f3-0b72-47c1-a4ef-5c459ba7a972 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:24.675466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c30f3-0b72-47c1-a4ef-5c459ba7a972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:24.710373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c30f3-0b72-47c1-a4ef-5c459ba7a972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:24.712655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c30f3-0b72-47c1-a4ef-5c459ba7a972 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:24.730092 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1776/3590] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:25.207694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:25.403883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:26.323138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:27.877050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:28.501923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60ecb2-884f-417f-bb73-2ed454cdde17 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:28.509158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4b60ecb2-884f-417f-bb73-2ed454cdde17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:28.556370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60ecb2-884f-417f-bb73-2ed454cdde17 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:28.578795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08699f4-744a-447c-bac4-c8d4a2deb547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:28.579800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08699f4-744a-447c-bac4-c8d4a2deb547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:28.580316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08699f4-744a-447c-bac4-c8d4a2deb547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:28.581331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08699f4-744a-447c-bac4-c8d4a2deb547 admin admin] PATH_INFO: `/v3/projects/f48d18e5655d4b149d95044a5a9831ba` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:28.587561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08699f4-744a-447c-bac4-c8d4a2deb547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f48d18e5655d4b149d95044a5a9831ba)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:28.611157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08699f4-744a-447c-bac4-c8d4a2deb547 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:28.764886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707750e-4328-4830-b459-d47c356b9fcd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:28.765174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707750e-4328-4830-b459-d47c356b9fcd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:28.766027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707750e-4328-4830-b459-d47c356b9fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:28.812683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f08699f4-744a-447c-bac4-c8d4a2deb547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f48d18e5655d4b149d95044a5a9831ba', 'request_id': 'req-f08699f4-744a-447c-bac4-c8d4a2deb547'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:28.821826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:28.825210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f08699f4-744a-447c-bac4-c8d4a2deb547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f48d18e5655d4b149d95044a5a9831ba', 'request_id': 'req-f08699f4-744a-447c-bac4-c8d4a2deb547'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:28.840862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1707750e-4328-4830-b459-d47c356b9fcd None None] MFA Rules not processed for user `b5107de485614d708f9225c9f96819bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:28.842186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1707750e-4328-4830-b459-d47c356b9fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:28.850343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:28.988045 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1777/3591] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:28.997290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f08699f4-744a-447c-bac4-c8d4a2deb547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f48d18e5655d4b149d95044a5a9831ba', 'request_id': 'req-f08699f4-744a-447c-bac4-c8d4a2deb547'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:29.002072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707750e-4328-4830-b459-d47c356b9fcd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:29.005821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1707750e-4328-4830-b459-d47c356b9fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:29.041178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f08699f4-744a-447c-bac4-c8d4a2deb547 admin admin] The token cache is being invalidate because project f48d18e5655d4b149d95044a5a9831ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:29.041513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f08699f4-744a-447c-bac4-c8d4a2deb547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:29.043959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f08699f4-744a-447c-bac4-c8d4a2deb547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:29.048320 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1815/3592] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:46:28 2022] DELETE /identity/v3/projects/f48d18e5655d4b149d95044a5a9831ba => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:29.057888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a7487-584b-4191-9243-abe69629ae1e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:29.061535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a7487-584b-4191-9243-abe69629ae1e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:29.062075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a7487-584b-4191-9243-abe69629ae1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:29.135935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-503a7487-584b-4191-9243-abe69629ae1e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:29.139844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-503a7487-584b-4191-9243-abe69629ae1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:29.211897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707750e-4328-4830-b459-d47c356b9fcd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:29.225866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23ab8b-c906-4854-8dd9-faf41b4491f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:29.226506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23ab8b-c906-4854-8dd9-faf41b4491f5 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:29.226787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23ab8b-c906-4854-8dd9-faf41b4491f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:29.227060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23ab8b-c906-4854-8dd9-faf41b4491f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:29.242560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-eb23ab8b-c906-4854-8dd9-faf41b4491f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:29.382392 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1816/3593] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:29.392136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27278e1-d27b-43ea-b019-27ab9b3c5d4e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:29.393339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27278e1-d27b-43ea-b019-27ab9b3c5d4e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:29.393621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27278e1-d27b-43ea-b019-27ab9b3c5d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:29.470938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d27278e1-d27b-43ea-b019-27ab9b3c5d4e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:29.478603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d27278e1-d27b-43ea-b019-27ab9b3c5d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:29.523291 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1817/3594] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:29.527978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27278e1-d27b-43ea-b019-27ab9b3c5d4e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:29.534586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23ab8b-c906-4854-8dd9-faf41b4491f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:29.537160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23ab8b-c906-4854-8dd9-faf41b4491f5 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:29.556308 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1778/3595] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:46:29.565869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27278e1-d27b-43ea-b019-27ab9b3c5d4e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:29.588057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4c483-eac5-4521-8514-0b7c63f1e1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:29.588846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4c483-eac5-4521-8514-0b7c63f1e1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:29.589224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4c483-eac5-4521-8514-0b7c63f1e1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:29.589781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4c483-eac5-4521-8514-0b7c63f1e1c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:29.599790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4c483-eac5-4521-8514-0b7c63f1e1c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:46:29.605149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4c483-eac5-4521-8514-0b7c63f1e1c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:29.614522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4c483-eac5-4521-8514-0b7c63f1e1c9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:29.682257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23ab8b-c906-4854-8dd9-faf41b4491f5 service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:29.688688 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1818/3596] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:46:29.715112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23ab8b-c906-4854-8dd9-faf41b4491f5 service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:29.734638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49daef-d2ff-43c6-88d2-135758655162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:29.735125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49daef-d2ff-43c6-88d2-135758655162 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:29.735477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49daef-d2ff-43c6-88d2-135758655162 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:29.736103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49daef-d2ff-43c6-88d2-135758655162 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:29.737173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49daef-d2ff-43c6-88d2-135758655162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:29.741407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49daef-d2ff-43c6-88d2-135758655162 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:29.804073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4c483-eac5-4521-8514-0b7c63f1e1c9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:29.808331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-52d4c483-eac5-4521-8514-0b7c63f1e1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:29.865788 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1779/3597] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:46:29 2022] POST /identity/v3/projects => generated 401 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:29.869620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49daef-d2ff-43c6-88d2-135758655162 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:29.878588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:29.883107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4c483-eac5-4521-8514-0b7c63f1e1c9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:30.059784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49daef-d2ff-43c6-88d2-135758655162 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:30.067753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d067e-111b-4303-ab2d-dce142f19d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:30.069005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d067e-111b-4303-ab2d-dce142f19d17 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:30.069542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d067e-111b-4303-ab2d-dce142f19d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:30.069987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d067e-111b-4303-ab2d-dce142f19d17 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:30.072599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d067e-111b-4303-ab2d-dce142f19d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:30.075133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d067e-111b-4303-ab2d-dce142f19d17 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:30.088912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef707ec6-d4f5-4a76-805d-5e3d108d5809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:30.089560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef707ec6-d4f5-4a76-805d-5e3d108d5809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:30.089845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef707ec6-d4f5-4a76-805d-5e3d108d5809 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:30.090106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef707ec6-d4f5-4a76-805d-5e3d108d5809 admin admin] PATH_INFO: `/v3/users/4c83d15d07a34dc4950c8b514aa178ab` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:30.091660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef707ec6-d4f5-4a76-805d-5e3d108d5809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c83d15d07a34dc4950c8b514aa178ab)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:30.107861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef707ec6-d4f5-4a76-805d-5e3d108d5809 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:30.251473 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1780/3598] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:46:29 2022] POST /identity/v3/users => generated 301 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:30.252913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d067e-111b-4303-ab2d-dce142f19d17 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:30.283465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d067e-111b-4303-ab2d-dce142f19d17 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:30.304902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6d157-f0a9-47e5-9315-6171922036be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:30.305895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6d157-f0a9-47e5-9315-6171922036be admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:30.312330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6d157-f0a9-47e5-9315-6171922036be admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:30.312330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6d157-f0a9-47e5-9315-6171922036be admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:30.312330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6d157-f0a9-47e5-9315-6171922036be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:30.312330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6d157-f0a9-47e5-9315-6171922036be admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:30.349598 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1781/3599] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:30.349598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6d157-f0a9-47e5-9315-6171922036be admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:30.366560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6d157-f0a9-47e5-9315-6171922036be admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:30.380344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125054f-339b-4506-9cd8-1b2bc7e8f920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:30.381767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125054f-339b-4506-9cd8-1b2bc7e8f920 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:30.383247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125054f-339b-4506-9cd8-1b2bc7e8f920 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:30.383710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125054f-339b-4506-9cd8-1b2bc7e8f920 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:30.385738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125054f-339b-4506-9cd8-1b2bc7e8f920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:30.388830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125054f-339b-4506-9cd8-1b2bc7e8f920 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:30.420757 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1782/3600] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:30.424804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125054f-339b-4506-9cd8-1b2bc7e8f920 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:30.444030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125054f-339b-4506-9cd8-1b2bc7e8f920 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:30.450728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ef707ec6-d4f5-4a76-805d-5e3d108d5809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c83d15d07a34dc4950c8b514aa178ab'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:30.452521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ef707ec6-d4f5-4a76-805d-5e3d108d5809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c83d15d07a34dc4950c8b514aa178ab'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:30.479522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb52f5-8ca8-4c60-86f1-5332f9afbbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:30.480369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb52f5-8ca8-4c60-86f1-5332f9afbbb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:30.480740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb52f5-8ca8-4c60-86f1-5332f9afbbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:30.481094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb52f5-8ca8-4c60-86f1-5332f9afbbb2 admin admin] PATH_INFO: `/v3/projects/3a53d0c55b2141b2af926af390b7b6e2/users/3ed80014e2b34d599e154a8965cdfb56/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:30.518064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb52f5-8ca8-4c60-86f1-5332f9afbbb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a53d0c55b2141b2af926af390b7b6e2, user_id=3ed80014e2b34d599e154a8965cdfb56, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:30.520948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb52f5-8ca8-4c60-86f1-5332f9afbbb2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:30.597209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ef707ec6-d4f5-4a76-805d-5e3d108d5809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c83d15d07a34dc4950c8b514aa178ab'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:30.598478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ef707ec6-d4f5-4a76-805d-5e3d108d5809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c83d15d07a34dc4950c8b514aa178ab'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:30.638067 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1783/3601] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:46:30 2022] PUT /identity/v3/projects/3a53d0c55b2141b2af926af390b7b6e2/users/3ed80014e2b34d599e154a8965cdfb56/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:30.654306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924bbb8-0c46-465d-81a1-081f18ba7ca2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:30.654497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924bbb8-0c46-465d-81a1-081f18ba7ca2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:30.654775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924bbb8-0c46-465d-81a1-081f18ba7ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:30.658442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:30.664419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ef707ec6-d4f5-4a76-805d-5e3d108d5809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c83d15d07a34dc4950c8b514aa178ab'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:30.743581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0924bbb8-0c46-465d-81a1-081f18ba7ca2 None None] MFA Rules not processed for user `3ed80014e2b34d599e154a8965cdfb56`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:30.745061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0924bbb8-0c46-465d-81a1-081f18ba7ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:30.745657 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1819/3602] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:46:29 2022] DELETE /identity/v3/users/4c83d15d07a34dc4950c8b514aa178ab => generated 0 bytes in 945 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:30.919865 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1784/3603] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:30 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:30.924917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef707ec6-d4f5-4a76-805d-5e3d108d5809 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:30.926700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ef707ec6-d4f5-4a76-805d-5e3d108d5809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:31.187635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef707ec6-d4f5-4a76-805d-5e3d108d5809 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:31.198847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086339f5-7405-4eb3-b6c5-c350ff88fb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:31.201462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086339f5-7405-4eb3-b6c5-c350ff88fb3e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:31.201765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086339f5-7405-4eb3-b6c5-c350ff88fb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:31.202372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086339f5-7405-4eb3-b6c5-c350ff88fb3e admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:31.203040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086339f5-7405-4eb3-b6c5-c350ff88fb3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:31.210619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086339f5-7405-4eb3-b6c5-c350ff88fb3e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:31.409837 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1820/3604] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:46:30 2022] POST /identity/v3/projects => generated 401 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:31.414935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924bbb8-0c46-465d-81a1-081f18ba7ca2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:31.432469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924bbb8-0c46-465d-81a1-081f18ba7ca2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:31.509191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45cb17-e490-420a-aa9e-21441d2dd68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:31.509191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45cb17-e490-420a-aa9e-21441d2dd68a admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:31.509610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45cb17-e490-420a-aa9e-21441d2dd68a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:31.509610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45cb17-e490-420a-aa9e-21441d2dd68a admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:31.510220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45cb17-e490-420a-aa9e-21441d2dd68a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:31.513000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45cb17-e490-420a-aa9e-21441d2dd68a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:31.683292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086339f5-7405-4eb3-b6c5-c350ff88fb3e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:31.685262 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1785/3605] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:46:31 2022] POST /identity/v3/users => generated 307 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:31.697876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086339f5-7405-4eb3-b6c5-c350ff88fb3e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:31.716137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab351be-853d-4301-90c8-44afe2d9f0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:31.761802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab351be-853d-4301-90c8-44afe2d9f0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:31.761802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab351be-853d-4301-90c8-44afe2d9f0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:31.761802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab351be-853d-4301-90c8-44afe2d9f0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:31.761802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab351be-853d-4301-90c8-44afe2d9f0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:31.761802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab351be-853d-4301-90c8-44afe2d9f0f7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:31.764918 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1821/3606] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:31.767443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45cb17-e490-420a-aa9e-21441d2dd68a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:31.806731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45cb17-e490-420a-aa9e-21441d2dd68a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:31.826582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7b78e-b6e6-4b05-9307-09f62bdc6e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:31.827505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7b78e-b6e6-4b05-9307-09f62bdc6e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:31.827980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7b78e-b6e6-4b05-9307-09f62bdc6e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:31.830480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7b78e-b6e6-4b05-9307-09f62bdc6e0b admin admin] PATH_INFO: `/v3/projects/17bd8ccdb52c491f9685897b81d34c1d/users/484b276835a240998da8d107b873b22a/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:31.884021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7b78e-b6e6-4b05-9307-09f62bdc6e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=17bd8ccdb52c491f9685897b81d34c1d, user_id=484b276835a240998da8d107b873b22a, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:31.886896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7b78e-b6e6-4b05-9307-09f62bdc6e0b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:32.049996 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1786/3607] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:46:31 2022] PUT /identity/v3/projects/17bd8ccdb52c491f9685897b81d34c1d/users/484b276835a240998da8d107b873b22a/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:32.054660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab351be-853d-4301-90c8-44afe2d9f0f7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:32.067846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab351be-853d-4301-90c8-44afe2d9f0f7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:32.074631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7b78e-b6e6-4b05-9307-09f62bdc6e0b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:32.076732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dba7b78e-b6e6-4b05-9307-09f62bdc6e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:32.476080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e02ff-f309-4165-87cc-e520c2a44f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:32.478976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7b78e-b6e6-4b05-9307-09f62bdc6e0b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:32.479832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e02ff-f309-4165-87cc-e520c2a44f42 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:32.479832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e02ff-f309-4165-87cc-e520c2a44f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:32.479832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e02ff-f309-4165-87cc-e520c2a44f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:32.486901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e02ff-f309-4165-87cc-e520c2a44f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:32.496741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e02ff-f309-4165-87cc-e520c2a44f42 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:32.503070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f2647-8c86-44bf-805b-37f076be3b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:32.508744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f2647-8c86-44bf-805b-37f076be3b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:32.510164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f2647-8c86-44bf-805b-37f076be3b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:32.511487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f2647-8c86-44bf-805b-37f076be3b9e admin admin] PATH_INFO: `/v3/projects/43ed2e29126a453e8ab63c6821a1211b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:32.515306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f2647-8c86-44bf-805b-37f076be3b9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ed2e29126a453e8ab63c6821a1211b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:32.543779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f2647-8c86-44bf-805b-37f076be3b9e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:32.566114 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1822/3608] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:32.572267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e02ff-f309-4165-87cc-e520c2a44f42 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:32.612845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e02ff-f309-4165-87cc-e520c2a44f42 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:32.653093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f31d30-2771-49e6-a85e-5892ce40cb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:32.655362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f31d30-2771-49e6-a85e-5892ce40cb39 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:32.655881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f31d30-2771-49e6-a85e-5892ce40cb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:32.656253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f31d30-2771-49e6-a85e-5892ce40cb39 admin admin] PATH_INFO: `/v3/projects/17bd8ccdb52c491f9685897b81d34c1d/users/484b276835a240998da8d107b873b22a/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:32.659692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f31d30-2771-49e6-a85e-5892ce40cb39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17bd8ccdb52c491f9685897b81d34c1d, user_id=484b276835a240998da8d107b873b22a, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:32.676921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f31d30-2771-49e6-a85e-5892ce40cb39 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:32.719539 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1823/3609] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:46:32 2022] PUT /identity/v3/projects/17bd8ccdb52c491f9685897b81d34c1d/users/484b276835a240998da8d107b873b22a/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:32.731250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957168b-d424-426e-a259-dd2f8b3258ee None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:32.731547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957168b-d424-426e-a259-dd2f8b3258ee None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:32.731989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957168b-d424-426e-a259-dd2f8b3258ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:32.754932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5a3f2647-8c86-44bf-805b-37f076be3b9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ed2e29126a453e8ab63c6821a1211b', 'request_id': 'req-5a3f2647-8c86-44bf-805b-37f076be3b9e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:32.763997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5a3f2647-8c86-44bf-805b-37f076be3b9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ed2e29126a453e8ab63c6821a1211b', 'request_id': 'req-5a3f2647-8c86-44bf-805b-37f076be3b9e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:32.777807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5a3f2647-8c86-44bf-805b-37f076be3b9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ed2e29126a453e8ab63c6821a1211b', 'request_id': 'req-5a3f2647-8c86-44bf-805b-37f076be3b9e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:32.786371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:32.808381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1957168b-d424-426e-a259-dd2f8b3258ee None None] MFA Rules not processed for user `484b276835a240998da8d107b873b22a`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:32.809901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1957168b-d424-426e-a259-dd2f8b3258ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:32.900586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5a3f2647-8c86-44bf-805b-37f076be3b9e admin admin] The token cache is being invalidate because project 43ed2e29126a453e8ab63c6821a1211b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:32.903918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5a3f2647-8c86-44bf-805b-37f076be3b9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:32.904922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5a3f2647-8c86-44bf-805b-37f076be3b9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:32.909058 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1787/3610] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:46:32 2022] DELETE /identity/v3/projects/43ed2e29126a453e8ab63c6821a1211b => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:32.925529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084cd6d-e7c5-453f-a179-b22457eb8df2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:32.926632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084cd6d-e7c5-453f-a179-b22457eb8df2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:32.926919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084cd6d-e7c5-453f-a179-b22457eb8df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:32.946742 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1824/3611] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:32 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:32.951755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957168b-d424-426e-a259-dd2f8b3258ee None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:32.994940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957168b-d424-426e-a259-dd2f8b3258ee None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:33.007844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d084cd6d-e7c5-453f-a179-b22457eb8df2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:33.016092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d084cd6d-e7c5-453f-a179-b22457eb8df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:33.038927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a74108-0667-4f4d-8883-2a14c9f9342e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '484b276835a240998da8d107b873b22a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17bd8ccdb52c491f9685897b81d34c1d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:33.040544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a74108-0667-4f4d-8883-2a14c9f9342e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:33.042296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a74108-0667-4f4d-8883-2a14c9f9342e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:33.048723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a74108-0667-4f4d-8883-2a14c9f9342e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:33.052487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a74108-0667-4f4d-8883-2a14c9f9342e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:33.053936 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-c4a74108-0667-4f4d-8883-2a14c9f9342e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:46:33.053936 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:46:33.053936 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:46:33.058553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a74108-0667-4f4d-8883-2a14c9f9342e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:33.169212 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1788/3612] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:33.180397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d960573-da96-44ac-909a-0429d3d83fad None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:33.180912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d960573-da96-44ac-909a-0429d3d83fad None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:33.181460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d960573-da96-44ac-909a-0429d3d83fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:33.217365 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1825/3613] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:46:32 2022] POST /identity/v3/roles => generated 240 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:33.221017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a74108-0667-4f4d-8883-2a14c9f9342e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:33.248758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6d960573-da96-44ac-909a-0429d3d83fad None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:33.250697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6d960573-da96-44ac-909a-0429d3d83fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:33.254821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a74108-0667-4f4d-8883-2a14c9f9342e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:33.283184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2721b-8acd-41fd-8593-9b07b948f95e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '484b276835a240998da8d107b873b22a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17bd8ccdb52c491f9685897b81d34c1d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:33.283378 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1789/3614] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:33.283471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2721b-8acd-41fd-8593-9b07b948f95e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:33.283471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2721b-8acd-41fd-8593-9b07b948f95e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:33.283471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2721b-8acd-41fd-8593-9b07b948f95e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] PATH_INFO: `/v3/projects/3a53d0c55b2141b2af926af390b7b6e2/users/3ed80014e2b34d599e154a8965cdfb56/roles/0273c920ab494e4ba245373e7a988f64` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:33.283686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d960573-da96-44ac-909a-0429d3d83fad None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:33.292402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2721b-8acd-41fd-8593-9b07b948f95e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3a53d0c55b2141b2af926af390b7b6e2, user_id=3ed80014e2b34d599e154a8965cdfb56, role_id=0273c920ab494e4ba245373e7a988f64)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:33.312104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2721b-8acd-41fd-8593-9b07b948f95e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:33.313046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d960573-da96-44ac-909a-0429d3d83fad None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:33.335906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c31e1-c673-40a5-9bdc-5d3123216ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:33.337022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c31e1-c673-40a5-9bdc-5d3123216ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:33.337530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c31e1-c673-40a5-9bdc-5d3123216ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:33.338512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c31e1-c673-40a5-9bdc-5d3123216ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:33.354335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c31e1-c673-40a5-9bdc-5d3123216ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:46:33.354785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c31e1-c673-40a5-9bdc-5d3123216ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:33.359439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c31e1-c673-40a5-9bdc-5d3123216ad0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:33.418618 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1826/3615] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:46:33 2022] PUT /identity/v3/projects/3a53d0c55b2141b2af926af390b7b6e2/users/3ed80014e2b34d599e154a8965cdfb56/roles/0273c920ab494e4ba245373e7a988f64 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:33.424521 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1790/3616] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:46:33.434122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2721b-8acd-41fd-8593-9b07b948f95e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:33.435416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c31e1-c673-40a5-9bdc-5d3123216ad0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:33.439340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7ac2721b-8acd-41fd-8593-9b07b948f95e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:33.483294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c31e1-c673-40a5-9bdc-5d3123216ad0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:33.665121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2721b-8acd-41fd-8593-9b07b948f95e tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:33.682667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafe449-99df-487c-bbb0-7f331dce65fc tempest-ApplicationCredentialsV3AdminTest-684093002 tempest-ApplicationCredentialsV3AdminTest-684093002-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ed80014e2b34d599e154a8965cdfb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a53d0c55b2141b2af926af390b7b6e2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1162519520'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:33.683543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafe449-99df-487c-bbb0-7f331dce65fc tempest-ApplicationCredentialsV3AdminTest-684093002 tempest-ApplicationCredentialsV3AdminTest-684093002-project] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:33.684067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafe449-99df-487c-bbb0-7f331dce65fc tempest-ApplicationCredentialsV3AdminTest-684093002 tempest-ApplicationCredentialsV3AdminTest-684093002-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:33.684426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafe449-99df-487c-bbb0-7f331dce65fc tempest-ApplicationCredentialsV3AdminTest-684093002 tempest-ApplicationCredentialsV3AdminTest-684093002-project] PATH_INFO: `/v3/users/3ed80014e2b34d599e154a8965cdfb56/application_credentials` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:33.686103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafe449-99df-487c-bbb0-7f331dce65fc tempest-ApplicationCredentialsV3AdminTest-684093002 tempest-ApplicationCredentialsV3AdminTest-684093002-project] RBAC: Authorizing `identity:create_application_credential(user_id=3ed80014e2b34d599e154a8965cdfb56)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:33.688457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafe449-99df-487c-bbb0-7f331dce65fc tempest-ApplicationCredentialsV3AdminTest-684093002 tempest-ApplicationCredentialsV3AdminTest-684093002-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:33.715970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ab5ab-6dce-4e54-9b9a-f6cd3a0fa520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:33.720185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ab5ab-6dce-4e54-9b9a-f6cd3a0fa520 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:33.721270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ab5ab-6dce-4e54-9b9a-f6cd3a0fa520 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:33.721554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ab5ab-6dce-4e54-9b9a-f6cd3a0fa520 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:33.724062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ab5ab-6dce-4e54-9b9a-f6cd3a0fa520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:33.732404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ab5ab-6dce-4e54-9b9a-f6cd3a0fa520 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:33.790111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:33.875371 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1791/3617] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:46:33 2022] POST /identity/v3/projects => generated 371 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:33.876394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ab5ab-6dce-4e54-9b9a-f6cd3a0fa520 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:33.960862 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1827/3618] 10.222.0.76 () {60 vars in 1315 bytes} [Sat Aug 27 04:46:33 2022] POST /identity/v3/users/3ed80014e2b34d599e154a8965cdfb56/application_credentials => generated 659 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:33.968425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f799a-0f5f-44d4-a4f7-a88957caac2a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:33.968707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f799a-0f5f-44d4-a4f7-a88957caac2a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:33.969249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f799a-0f5f-44d4-a4f7-a88957caac2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:34.025708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-729f799a-0f5f-44d4-a4f7-a88957caac2a None None] MFA Rules not processed for user `3ed80014e2b34d599e154a8965cdfb56`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:34.031997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-729f799a-0f5f-44d4-a4f7-a88957caac2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:34.095957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ab5ab-6dce-4e54-9b9a-f6cd3a0fa520 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:34.102711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb591087-b1b0-4b6a-95cb-da16e5b7a6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:34.104094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb591087-b1b0-4b6a-95cb-da16e5b7a6da admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:34.104642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb591087-b1b0-4b6a-95cb-da16e5b7a6da admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:34.105284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb591087-b1b0-4b6a-95cb-da16e5b7a6da admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:34.106252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb591087-b1b0-4b6a-95cb-da16e5b7a6da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:34.108787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb591087-b1b0-4b6a-95cb-da16e5b7a6da admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:34.206325 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1792/3619] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:46:33 2022] POST /identity/v3/users => generated 286 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:34.213827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb591087-b1b0-4b6a-95cb-da16e5b7a6da admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:34.229567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb591087-b1b0-4b6a-95cb-da16e5b7a6da admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:34.243572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea8049-73a1-45f9-a39b-3de1e39e08a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:34.248422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea8049-73a1-45f9-a39b-3de1e39e08a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:34.248762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea8049-73a1-45f9-a39b-3de1e39e08a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:34.249040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea8049-73a1-45f9-a39b-3de1e39e08a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:34.250955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea8049-73a1-45f9-a39b-3de1e39e08a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:34.255967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea8049-73a1-45f9-a39b-3de1e39e08a5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:34.272900 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1793/3620] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:34 2022] GET /identity/v3/roles => generated 1651 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:34.276924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea8049-73a1-45f9-a39b-3de1e39e08a5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:34.311902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea8049-73a1-45f9-a39b-3de1e39e08a5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:34.325926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ed66d-285a-431f-8f05-13c1624881a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:34.328332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ed66d-285a-431f-8f05-13c1624881a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:34.328894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ed66d-285a-431f-8f05-13c1624881a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:34.329262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ed66d-285a-431f-8f05-13c1624881a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:34.330248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ed66d-285a-431f-8f05-13c1624881a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:34.334175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ed66d-285a-431f-8f05-13c1624881a0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:34.353489 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1794/3621] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:34 2022] GET /identity/v3/roles => generated 1651 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:46:34.356243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ed66d-285a-431f-8f05-13c1624881a0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:34.364601 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1828/3622] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:33 2022] POST /identity/v3/auth/tokens => generated 3394 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 27 04:46:34.367177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f799a-0f5f-44d4-a4f7-a88957caac2a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:34.382207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ed66d-285a-431f-8f05-13c1624881a0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:34.389338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb492b9-408b-441f-acf5-a04deae19c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:34.390129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb492b9-408b-441f-acf5-a04deae19c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:34.390473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb492b9-408b-441f-acf5-a04deae19c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:34.390819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb492b9-408b-441f-acf5-a04deae19c40 admin admin] PATH_INFO: `/v3/projects/cb4daa9f777240578e1113cf0b5a5385/users/e30f8cfc3aca4b0eb27d413cc8e032f2/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:34.422157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb492b9-408b-441f-acf5-a04deae19c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4daa9f777240578e1113cf0b5a5385, user_id=e30f8cfc3aca4b0eb27d413cc8e032f2, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:34.434671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb492b9-408b-441f-acf5-a04deae19c40 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:34.548320 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1795/3623] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:46:34 2022] PUT /identity/v3/projects/cb4daa9f777240578e1113cf0b5a5385/users/e30f8cfc3aca4b0eb27d413cc8e032f2/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:34.550088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30990ff-b134-4b48-8e49-b79fd24161ff None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:34.551818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30990ff-b134-4b48-8e49-b79fd24161ff None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:34.551818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30990ff-b134-4b48-8e49-b79fd24161ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:34.561789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f799a-0f5f-44d4-a4f7-a88957caac2a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:34.582309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:34.615463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f30990ff-b134-4b48-8e49-b79fd24161ff None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:34.617206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f30990ff-b134-4b48-8e49-b79fd24161ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:34.758582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acdc2a-1e44-41d7-8035-7ea7e33332e9 tempest-ApplicationCredentialsV3AdminTest-684093002 tempest-ApplicationCredentialsV3AdminTest-684093002-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ed80014e2b34d599e154a8965cdfb56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a53d0c55b2141b2af926af390b7b6e2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1162519520'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:34.758582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acdc2a-1e44-41d7-8035-7ea7e33332e9 tempest-ApplicationCredentialsV3AdminTest-684093002 tempest-ApplicationCredentialsV3AdminTest-684093002-project] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:34.759887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acdc2a-1e44-41d7-8035-7ea7e33332e9 tempest-ApplicationCredentialsV3AdminTest-684093002 tempest-ApplicationCredentialsV3AdminTest-684093002-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:34.760268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acdc2a-1e44-41d7-8035-7ea7e33332e9 tempest-ApplicationCredentialsV3AdminTest-684093002 tempest-ApplicationCredentialsV3AdminTest-684093002-project] PATH_INFO: `/v3/users/3ed80014e2b34d599e154a8965cdfb56/application_credentials/3827d815383f4517b3ff54edaefe0624` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:34.764273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acdc2a-1e44-41d7-8035-7ea7e33332e9 tempest-ApplicationCredentialsV3AdminTest-684093002 tempest-ApplicationCredentialsV3AdminTest-684093002-project] RBAC: Authorizing `identity:delete_application_credential(user_id=3ed80014e2b34d599e154a8965cdfb56, application_credential_id=3827d815383f4517b3ff54edaefe0624)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:34.766548 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1796/3624] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:34.767680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acdc2a-1e44-41d7-8035-7ea7e33332e9 tempest-ApplicationCredentialsV3AdminTest-684093002 tempest-ApplicationCredentialsV3AdminTest-684093002-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:34.845938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30990ff-b134-4b48-8e49-b79fd24161ff None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:34.847389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f30990ff-b134-4b48-8e49-b79fd24161ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:34.888848 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1829/3625] 10.222.0.76 () {58 vars in 1395 bytes} [Sat Aug 27 04:46:34 2022] DELETE /identity/v3/users/3ed80014e2b34d599e154a8965cdfb56/application_credentials/3827d815383f4517b3ff54edaefe0624 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:34.895147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6481c-2bba-4c49-b365-b9e66e35e65e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:34.895447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6481c-2bba-4c49-b365-b9e66e35e65e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:34.897783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6481c-2bba-4c49-b365-b9e66e35e65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:35.004238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30990ff-b134-4b48-8e49-b79fd24161ff None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:35.010776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7291067-59ec-4cc1-b9a0-1a1cb453e344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:35.011834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7291067-59ec-4cc1-b9a0-1a1cb453e344 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:35.012369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7291067-59ec-4cc1-b9a0-1a1cb453e344 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:35.013810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7291067-59ec-4cc1-b9a0-1a1cb453e344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:35.023589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-68e6481c-2bba-4c49-b365-b9e66e35e65e None None] MFA Rules not processed for user `e0b2967fe54c42859db5e36293550a40`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:35.026606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7291067-59ec-4cc1-b9a0-1a1cb453e344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:35.028406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7291067-59ec-4cc1-b9a0-1a1cb453e344 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:35.036690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-68e6481c-2bba-4c49-b365-b9e66e35e65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:35.056816 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1797/3626] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:46:35.059006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7291067-59ec-4cc1-b9a0-1a1cb453e344 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:35.276109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7291067-59ec-4cc1-b9a0-1a1cb453e344 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:35.288125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a9bee-6606-46fa-be7d-39ca52926afd tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '484b276835a240998da8d107b873b22a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17bd8ccdb52c491f9685897b81d34c1d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:35.288991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a9bee-6606-46fa-be7d-39ca52926afd tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:35.289383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a9bee-6606-46fa-be7d-39ca52926afd tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:35.289767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a9bee-6606-46fa-be7d-39ca52926afd tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] PATH_INFO: `/v3/roles/0273c920ab494e4ba245373e7a988f64` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:35.291655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a9bee-6606-46fa-be7d-39ca52926afd tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0273c920ab494e4ba245373e7a988f64)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:35.293591 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-ec2a9bee-6606-46fa-be7d-39ca52926afd tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:46:35.293591 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:46:35.293591 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:46:35.295038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a9bee-6606-46fa-be7d-39ca52926afd tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:35.321151 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1830/3627] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:34 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:35.321480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a409f9d-ad01-4720-bced-1df713bd1006 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:35.321825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a409f9d-ad01-4720-bced-1df713bd1006 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:35.322065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a409f9d-ad01-4720-bced-1df713bd1006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:35.384652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4a409f9d-ad01-4720-bced-1df713bd1006 None None] MFA Rules not processed for user `dd816cdc446443d5b3772afc7221fa79`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:35.386157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4a409f9d-ad01-4720-bced-1df713bd1006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:35.593917 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1831/3628] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:35.595030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a409f9d-ad01-4720-bced-1df713bd1006 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:35.596734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4a409f9d-ad01-4720-bced-1df713bd1006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:35.599076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ec2a9bee-6606-46fa-be7d-39ca52926afd tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] Invalidating the token cache because role 0273c920ab494e4ba245373e7a988f64 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:35.599572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ec2a9bee-6606-46fa-be7d-39ca52926afd tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:35.600505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ec2a9bee-6606-46fa-be7d-39ca52926afd tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:35.604088 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1798/3629] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:46:35 2022] DELETE /identity/v3/roles/0273c920ab494e4ba245373e7a988f64 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:35.609755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a9bee-6606-46fa-be7d-39ca52926afd tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:35.611198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ec2a9bee-6606-46fa-be7d-39ca52926afd tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:35.775317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:35.837668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:35.915034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a409f9d-ad01-4720-bced-1df713bd1006 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:35.995092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a9bee-6606-46fa-be7d-39ca52926afd tempest-ApplicationCredentialsV3AdminTest-542928418 tempest-ApplicationCredentialsV3AdminTest-542928418-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:36.008469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e786e8-958f-4604-9e8d-18b5135df7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:36.009155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e786e8-958f-4604-9e8d-18b5135df7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:36.009577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e786e8-958f-4604-9e8d-18b5135df7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:36.010460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e786e8-958f-4604-9e8d-18b5135df7a4 admin admin] PATH_INFO: `/v3/users/3ed80014e2b34d599e154a8965cdfb56` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:36.011640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e786e8-958f-4604-9e8d-18b5135df7a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed80014e2b34d599e154a8965cdfb56)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:36.014545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e786e8-958f-4604-9e8d-18b5135df7a4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:36.094183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663d5f3-e56b-4f8f-8a03-a1002854f6c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:36.098498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663d5f3-e56b-4f8f-8a03-a1002854f6c4 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:36.100501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663d5f3-e56b-4f8f-8a03-a1002854f6c4 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:36.102861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663d5f3-e56b-4f8f-8a03-a1002854f6c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:36.108503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c663d5f3-e56b-4f8f-8a03-a1002854f6c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:36.322602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663d5f3-e56b-4f8f-8a03-a1002854f6c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:36.326657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663d5f3-e56b-4f8f-8a03-a1002854f6c4 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:36.348333 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1832/3630] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:35 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:36.381023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-52e786e8-958f-4604-9e8d-18b5135df7a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed80014e2b34d599e154a8965cdfb56'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:36.517464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-52e786e8-958f-4604-9e8d-18b5135df7a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed80014e2b34d599e154a8965cdfb56'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:36.518101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-52e786e8-958f-4604-9e8d-18b5135df7a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed80014e2b34d599e154a8965cdfb56'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:36.534559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-52e786e8-958f-4604-9e8d-18b5135df7a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed80014e2b34d599e154a8965cdfb56'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:36.622180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-52e786e8-958f-4604-9e8d-18b5135df7a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed80014e2b34d599e154a8965cdfb56'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:36.668525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be8543-a444-4208-aded-51057512bd40 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:36.668756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be8543-a444-4208-aded-51057512bd40 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:36.669228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be8543-a444-4208-aded-51057512bd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:36.675157 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1799/3631] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:46:35 2022] DELETE /identity/v3/users/3ed80014e2b34d599e154a8965cdfb56 => generated 0 bytes in 1051 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:36.737028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-54be8543-a444-4208-aded-51057512bd40 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:36.778369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-54be8543-a444-4208-aded-51057512bd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:37.107729 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1833/3632] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:37.154013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e786e8-958f-4604-9e8d-18b5135df7a4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:37.157098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-52e786e8-958f-4604-9e8d-18b5135df7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:37.175132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:37.344231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e786e8-958f-4604-9e8d-18b5135df7a4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:37.359055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3deb116-e083-4a1f-983f-bb11daf40981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:37.365417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deb116-e083-4a1f-983f-bb11daf40981 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:37.365955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deb116-e083-4a1f-983f-bb11daf40981 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:37.366379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deb116-e083-4a1f-983f-bb11daf40981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:37.380328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:37.382734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3deb116-e083-4a1f-983f-bb11daf40981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:37.385633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3deb116-e083-4a1f-983f-bb11daf40981 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:37.404862 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1800/3633] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:37.904639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631f013-122f-4da4-a621-42a6d60ddfc3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:37.905149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631f013-122f-4da4-a621-42a6d60ddfc3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:37.905823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631f013-122f-4da4-a621-42a6d60ddfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:37.920959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:38.008328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1631f013-122f-4da4-a621-42a6d60ddfc3 None None] MFA Rules not processed for user `0d9a43514b8d4c9ba725074185734bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:38.009630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1631f013-122f-4da4-a621-42a6d60ddfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:38.243754 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1834/3634] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:38.257480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d8c0e-6781-4bd1-bee9-900366d82efc None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:38.258620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d8c0e-6781-4bd1-bee9-900366d82efc None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:38.259108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d8c0e-6781-4bd1-bee9-900366d82efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:38.286494 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b98d8c0e-6781-4bd1-bee9-900366d82efc None None] MFA Rules not processed for user `0d9a43514b8d4c9ba725074185734bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:38.288214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b98d8c0e-6781-4bd1-bee9-900366d82efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:38.303555 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1801/3635] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:38.312612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631f013-122f-4da4-a621-42a6d60ddfc3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:38.314314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1631f013-122f-4da4-a621-42a6d60ddfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:38.343728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:38.489122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631f013-122f-4da4-a621-42a6d60ddfc3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:38.513526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ae4de-fb80-4fdd-8b65-83bab8b2c986 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:38.515327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ae4de-fb80-4fdd-8b65-83bab8b2c986 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:38.516392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ae4de-fb80-4fdd-8b65-83bab8b2c986 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:38.516758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ae4de-fb80-4fdd-8b65-83bab8b2c986 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:38.535668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ae4de-fb80-4fdd-8b65-83bab8b2c986 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:38.538849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ae4de-fb80-4fdd-8b65-83bab8b2c986 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:38.556123 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1835/3636] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:38.878209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:39.619879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d8c0e-6781-4bd1-bee9-900366d82efc None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:39.622546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b98d8c0e-6781-4bd1-bee9-900366d82efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:39.699684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d8c0e-6781-4bd1-bee9-900366d82efc None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:39.720864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c9530-12d3-43e9-8748-307e37861710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:39.735576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c9530-12d3-43e9-8748-307e37861710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:39.736626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c9530-12d3-43e9-8748-307e37861710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:39.737629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c9530-12d3-43e9-8748-307e37861710 admin admin] PATH_INFO: `/v3/projects/3a53d0c55b2141b2af926af390b7b6e2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:39.745087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c9530-12d3-43e9-8748-307e37861710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a53d0c55b2141b2af926af390b7b6e2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:39.751435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c9530-12d3-43e9-8748-307e37861710 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:39.783235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966b087-4cdb-402b-b9ae-5502db472f8e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:39.783813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966b087-4cdb-402b-b9ae-5502db472f8e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:39.783813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966b087-4cdb-402b-b9ae-5502db472f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:39.793780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-b966b087-4cdb-402b-b9ae-5502db472f8e None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:46:39.793780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:46:39.793780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:46:39.793780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:46:39.793780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:46:39.793780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:46:39.793780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:46:39.793780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:46:39.793780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:46:39.793780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:46:39.793780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:46:39.793780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:46:39.793780 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:46:39.794869 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:46:39.794869 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:46:39.794869 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:46:39.794869 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:46:39.794869 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:46:39.794869 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:46:39.794869 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:46:39.794869 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:46:39.794869 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:46:39.794869 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:46:39.794869 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:46:39.794869 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:46:39.794869 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:46:39.794869 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:46:39.794869 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:46:39.802523 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1836/3637] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:46:39 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 22 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:46:39.868983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63d37b-dadb-4596-84b1-7d810ba73321 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:39.874829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63d37b-dadb-4596-84b1-7d810ba73321 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:39.874829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63d37b-dadb-4596-84b1-7d810ba73321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:39.918670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7c63d37b-dadb-4596-84b1-7d810ba73321 None None] MFA Rules not processed for user `0d9a43514b8d4c9ba725074185734bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:39.923110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7c63d37b-dadb-4596-84b1-7d810ba73321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:39.949197 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1837/3638] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:40.020888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-464c9530-12d3-43e9-8748-307e37861710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a53d0c55b2141b2af926af390b7b6e2', 'request_id': 'req-464c9530-12d3-43e9-8748-307e37861710'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:40.040725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-464c9530-12d3-43e9-8748-307e37861710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a53d0c55b2141b2af926af390b7b6e2', 'request_id': 'req-464c9530-12d3-43e9-8748-307e37861710'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:40.055854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-464c9530-12d3-43e9-8748-307e37861710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a53d0c55b2141b2af926af390b7b6e2', 'request_id': 'req-464c9530-12d3-43e9-8748-307e37861710'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:40.212219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-464c9530-12d3-43e9-8748-307e37861710 admin admin] The token cache is being invalidate because project 3a53d0c55b2141b2af926af390b7b6e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:40.215152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-464c9530-12d3-43e9-8748-307e37861710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:40.215152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-464c9530-12d3-43e9-8748-307e37861710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:40.219750 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1802/3639] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:46:39 2022] DELETE /identity/v3/projects/3a53d0c55b2141b2af926af390b7b6e2 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:40.241325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63d37b-dadb-4596-84b1-7d810ba73321 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:40.260645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63d37b-dadb-4596-84b1-7d810ba73321 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:40.527923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756353e-dfc0-4cdf-86fe-6dd51a16ab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:40.533799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756353e-dfc0-4cdf-86fe-6dd51a16ab40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:40.533799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756353e-dfc0-4cdf-86fe-6dd51a16ab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:40.533799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756353e-dfc0-4cdf-86fe-6dd51a16ab40 admin admin] PATH_INFO: `/v3/users/484b276835a240998da8d107b873b22a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:40.533799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756353e-dfc0-4cdf-86fe-6dd51a16ab40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=484b276835a240998da8d107b873b22a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:40.533799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756353e-dfc0-4cdf-86fe-6dd51a16ab40 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:40.765016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1756353e-dfc0-4cdf-86fe-6dd51a16ab40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '484b276835a240998da8d107b873b22a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:40.765877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1756353e-dfc0-4cdf-86fe-6dd51a16ab40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '484b276835a240998da8d107b873b22a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:40.912096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1756353e-dfc0-4cdf-86fe-6dd51a16ab40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '484b276835a240998da8d107b873b22a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:40.915691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1756353e-dfc0-4cdf-86fe-6dd51a16ab40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '484b276835a240998da8d107b873b22a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:40.938663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1756353e-dfc0-4cdf-86fe-6dd51a16ab40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '484b276835a240998da8d107b873b22a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:40.977882 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1838/3640] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:46:40 2022] DELETE /identity/v3/users/484b276835a240998da8d107b873b22a => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:41.026327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:42.226070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745209e-1999-4924-a357-07dd5e278413 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:42.226952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745209e-1999-4924-a357-07dd5e278413 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:42.227370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745209e-1999-4924-a357-07dd5e278413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:42.234384 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-a745209e-1999-4924-a357-07dd5e278413 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:46:42.234384 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:46:42.234384 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:46:42.234384 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:46:42.234384 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:46:42.234384 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:46:42.234384 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:46:42.234384 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:46:42.234384 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:46:42.234384 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:46:42.234384 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:46:42.234384 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:46:42.234384 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:46:42.235394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:46:42.235394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:46:42.235394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:46:42.235394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:46:42.235394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:46:42.235394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:46:42.235394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:46:42.235394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:46:42.235394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:46:42.235394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:46:42.235394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:46:42.235394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:46:42.235394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:46:42.235394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:46:42.235394 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:46:42.238720 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1803/3641] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:46:42 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:46:43.638747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756353e-dfc0-4cdf-86fe-6dd51a16ab40 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:43.641844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1756353e-dfc0-4cdf-86fe-6dd51a16ab40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:43.669810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:43.839664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756353e-dfc0-4cdf-86fe-6dd51a16ab40 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:43.845105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8580ef4-c9ec-4b4b-8a66-e84ae52019bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:43.846194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8580ef4-c9ec-4b4b-8a66-e84ae52019bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:43.846629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8580ef4-c9ec-4b4b-8a66-e84ae52019bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:43.847039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8580ef4-c9ec-4b4b-8a66-e84ae52019bc admin admin] PATH_INFO: `/v3/projects/17bd8ccdb52c491f9685897b81d34c1d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:43.857684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8580ef4-c9ec-4b4b-8a66-e84ae52019bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=17bd8ccdb52c491f9685897b81d34c1d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:43.859944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8580ef4-c9ec-4b4b-8a66-e84ae52019bc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:44.063398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8580ef4-c9ec-4b4b-8a66-e84ae52019bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17bd8ccdb52c491f9685897b81d34c1d', 'request_id': 'req-b8580ef4-c9ec-4b4b-8a66-e84ae52019bc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:44.079337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8580ef4-c9ec-4b4b-8a66-e84ae52019bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17bd8ccdb52c491f9685897b81d34c1d', 'request_id': 'req-b8580ef4-c9ec-4b4b-8a66-e84ae52019bc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:44.151535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8580ef4-c9ec-4b4b-8a66-e84ae52019bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17bd8ccdb52c491f9685897b81d34c1d', 'request_id': 'req-b8580ef4-c9ec-4b4b-8a66-e84ae52019bc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:44.179036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8580ef4-c9ec-4b4b-8a66-e84ae52019bc admin admin] The token cache is being invalidate because project 17bd8ccdb52c491f9685897b81d34c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:44.179385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8580ef4-c9ec-4b4b-8a66-e84ae52019bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:44.182932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8580ef4-c9ec-4b4b-8a66-e84ae52019bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:44.186618 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1839/3642] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:46:43 2022] DELETE /identity/v3/projects/17bd8ccdb52c491f9685897b81d34c1d => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:44.192693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfb298-4c20-4320-a46a-35c9c2a2d549 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:44.196899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfb298-4c20-4320-a46a-35c9c2a2d549 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:44.196899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfb298-4c20-4320-a46a-35c9c2a2d549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:44.241843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c5dfb298-4c20-4320-a46a-35c9c2a2d549 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:44.243638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c5dfb298-4c20-4320-a46a-35c9c2a2d549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:44.452849 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1804/3643] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:44.462678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69b58-154e-47cb-87b5-0ea94e965026 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:44.463644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69b58-154e-47cb-87b5-0ea94e965026 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:44.463946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69b58-154e-47cb-87b5-0ea94e965026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:44.513061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-22a69b58-154e-47cb-87b5-0ea94e965026 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:44.514614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-22a69b58-154e-47cb-87b5-0ea94e965026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:44.555296 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1840/3644] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:44.559304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfb298-4c20-4320-a46a-35c9c2a2d549 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:44.580944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfb298-4c20-4320-a46a-35c9c2a2d549 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:44.592697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ee108-8f33-43d0-93b8-7904b1edc861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:44.593626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ee108-8f33-43d0-93b8-7904b1edc861 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:44.594606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ee108-8f33-43d0-93b8-7904b1edc861 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:44.595498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ee108-8f33-43d0-93b8-7904b1edc861 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:44.599523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ee108-8f33-43d0-93b8-7904b1edc861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:46:44.600095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ee108-8f33-43d0-93b8-7904b1edc861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:44.607377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ee108-8f33-43d0-93b8-7904b1edc861 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:44.644792 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1805/3645] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:46:44.650523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a69b58-154e-47cb-87b5-0ea94e965026 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:44.661220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a69b58-154e-47cb-87b5-0ea94e965026 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:44.683453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70925714-8fc3-4ef9-9903-7e39a221bfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:44.686097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70925714-8fc3-4ef9-9903-7e39a221bfdf admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:44.687731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70925714-8fc3-4ef9-9903-7e39a221bfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:44.688220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70925714-8fc3-4ef9-9903-7e39a221bfdf admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:44.689116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70925714-8fc3-4ef9-9903-7e39a221bfdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:44.693743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70925714-8fc3-4ef9-9903-7e39a221bfdf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:44.890445 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1841/3646] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:46:44 2022] POST /identity/v3/projects => generated 371 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:46:44.895928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ee108-8f33-43d0-93b8-7904b1edc861 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:44.913669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ee108-8f33-43d0-93b8-7904b1edc861 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:44.968042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:45.093042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f345f55-222f-4da2-b94a-ff1604b400ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:45.097522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f345f55-222f-4da2-b94a-ff1604b400ff admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:45.098175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f345f55-222f-4da2-b94a-ff1604b400ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:45.098693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f345f55-222f-4da2-b94a-ff1604b400ff admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:45.099559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f345f55-222f-4da2-b94a-ff1604b400ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:45.111122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f345f55-222f-4da2-b94a-ff1604b400ff admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:45.214866 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1806/3647] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:46:44 2022] POST /identity/v3/users => generated 286 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:45.221084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70925714-8fc3-4ef9-9903-7e39a221bfdf admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:45.236863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70925714-8fc3-4ef9-9903-7e39a221bfdf admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:45.247108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31801f7d-80bb-4f85-8188-7af2ea3e36c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:45.247108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31801f7d-80bb-4f85-8188-7af2ea3e36c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:45.247532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31801f7d-80bb-4f85-8188-7af2ea3e36c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:45.247532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31801f7d-80bb-4f85-8188-7af2ea3e36c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:45.249292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31801f7d-80bb-4f85-8188-7af2ea3e36c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:45.250895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31801f7d-80bb-4f85-8188-7af2ea3e36c0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:45.285960 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1842/3648] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:45.287391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f345f55-222f-4da2-b94a-ff1604b400ff admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:45.302807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f345f55-222f-4da2-b94a-ff1604b400ff admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:45.325200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae4dca-9eb0-497b-b14f-db4e88b12b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:45.326126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4dca-9eb0-497b-b14f-db4e88b12b6e admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:45.326563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4dca-9eb0-497b-b14f-db4e88b12b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:45.326988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4dca-9eb0-497b-b14f-db4e88b12b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:45.327854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae4dca-9eb0-497b-b14f-db4e88b12b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:45.329679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae4dca-9eb0-497b-b14f-db4e88b12b6e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:45.355654 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1807/3649] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:45.364438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31801f7d-80bb-4f85-8188-7af2ea3e36c0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:45.394065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31801f7d-80bb-4f85-8188-7af2ea3e36c0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:45.420057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc79a8-0b1d-4401-bd0a-7ac8bd7b3c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:45.427340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc79a8-0b1d-4401-bd0a-7ac8bd7b3c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:45.431867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc79a8-0b1d-4401-bd0a-7ac8bd7b3c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:45.432351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc79a8-0b1d-4401-bd0a-7ac8bd7b3c2d admin admin] PATH_INFO: `/v3/projects/8a9067a0a3414fdeb18b7d0bc115daea/users/3cbae6232ac64effb735c751ec4119b4/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:45.505878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc79a8-0b1d-4401-bd0a-7ac8bd7b3c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9067a0a3414fdeb18b7d0bc115daea, user_id=3cbae6232ac64effb735c751ec4119b4, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:45.537760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc79a8-0b1d-4401-bd0a-7ac8bd7b3c2d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:45.673252 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1843/3650] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:46:45 2022] PUT /identity/v3/projects/8a9067a0a3414fdeb18b7d0bc115daea/users/3cbae6232ac64effb735c751ec4119b4/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:45.681597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b71f00-ec55-41a0-b29c-04574fb07498 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:45.682154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b71f00-ec55-41a0-b29c-04574fb07498 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:45.688872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b71f00-ec55-41a0-b29c-04574fb07498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:45.750514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-61b71f00-ec55-41a0-b29c-04574fb07498 None None] MFA Rules not processed for user `3cbae6232ac64effb735c751ec4119b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:45.755276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-61b71f00-ec55-41a0-b29c-04574fb07498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:45.877344 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1808/3651] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:45.883505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc79a8-0b1d-4401-bd0a-7ac8bd7b3c2d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:45.897809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adbeec-b719-440e-8d95-43c2ef29cf14 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:45.899840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adbeec-b719-440e-8d95-43c2ef29cf14 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:45.900242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adbeec-b719-440e-8d95-43c2ef29cf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:45.964408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-42adbeec-b719-440e-8d95-43c2ef29cf14 None None] MFA Rules not processed for user `8115953d94074d32a4aee216289feb36`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:45.965663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-42adbeec-b719-440e-8d95-43c2ef29cf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:45.994112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:46.028897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc79a8-0b1d-4401-bd0a-7ac8bd7b3c2d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:46.035536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be1734-a70a-44b7-a93d-bb445a514a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:46.036475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1734-a70a-44b7-a93d-bb445a514a56 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:46.036756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1734-a70a-44b7-a93d-bb445a514a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:46.037023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1734-a70a-44b7-a93d-bb445a514a56 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:46.037670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be1734-a70a-44b7-a93d-bb445a514a56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:46.039705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be1734-a70a-44b7-a93d-bb445a514a56 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:46.123075 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1809/3652] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:46.134538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adbeec-b719-440e-8d95-43c2ef29cf14 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:46.136143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-42adbeec-b719-440e-8d95-43c2ef29cf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:46.182331 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1844/3653] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:46:45 2022] POST /identity/v3/projects => generated 375 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:46.183487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be1734-a70a-44b7-a93d-bb445a514a56 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:46.326745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adbeec-b719-440e-8d95-43c2ef29cf14 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:46.352035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:46.380212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be1734-a70a-44b7-a93d-bb445a514a56 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:46.391692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844ba54-9dc5-4bf9-ae51-342a3247855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:46.392359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844ba54-9dc5-4bf9-ae51-342a3247855b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:46.392644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844ba54-9dc5-4bf9-ae51-342a3247855b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:46.392918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844ba54-9dc5-4bf9-ae51-342a3247855b admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:46.393682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844ba54-9dc5-4bf9-ae51-342a3247855b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:46.397664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844ba54-9dc5-4bf9-ae51-342a3247855b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:46.505090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0936b-3b32-4edd-83c1-74b4dccb496c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:46.507089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0936b-3b32-4edd-83c1-74b4dccb496c service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:46.507089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0936b-3b32-4edd-83c1-74b4dccb496c service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:46.510058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0936b-3b32-4edd-83c1-74b4dccb496c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:46.543018 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1845/3654] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:46:46 2022] POST /identity/v3/users => generated 294 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:46.546479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844ba54-9dc5-4bf9-ae51-342a3247855b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:46.567799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844ba54-9dc5-4bf9-ae51-342a3247855b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:46.580869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1878a62-a81d-428f-80d0-f54a65c154ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:46.581646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1878a62-a81d-428f-80d0-f54a65c154ff admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:46.582091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1878a62-a81d-428f-80d0-f54a65c154ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:46.583565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1878a62-a81d-428f-80d0-f54a65c154ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:46.583565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1878a62-a81d-428f-80d0-f54a65c154ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:46.585172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1878a62-a81d-428f-80d0-f54a65c154ff admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:46.611311 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1846/3655] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:46.612335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1878a62-a81d-428f-80d0-f54a65c154ff admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:46.643136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1878a62-a81d-428f-80d0-f54a65c154ff admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:46.647826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0936b-3b32-4edd-83c1-74b4dccb496c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:46.648999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8f5b2-a3d7-4f75-88b9-3311e1806225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:46.649931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8f5b2-a3d7-4f75-88b9-3311e1806225 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:46.650210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8f5b2-a3d7-4f75-88b9-3311e1806225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:46.650490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8f5b2-a3d7-4f75-88b9-3311e1806225 admin admin] PATH_INFO: `/v3/projects/c871fcc36eeb49d98fed497ed36e5f29/users/d56625c3138f4fcb90ac5607690cb18e/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:46.656792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0936b-3b32-4edd-83c1-74b4dccb496c service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:46.684573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8f5b2-a3d7-4f75-88b9-3311e1806225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c871fcc36eeb49d98fed497ed36e5f29, user_id=d56625c3138f4fcb90ac5607690cb18e, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:46.693007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8f5b2-a3d7-4f75-88b9-3311e1806225 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:46.734426 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1810/3656] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:46.811775 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1847/3657] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:46:46 2022] PUT /identity/v3/projects/c871fcc36eeb49d98fed497ed36e5f29/users/d56625c3138f4fcb90ac5607690cb18e/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:46.816339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0936b-3b32-4edd-83c1-74b4dccb496c service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:46.857672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0936b-3b32-4edd-83c1-74b4dccb496c service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:47.035746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ee82c-4f08-4078-8612-2ac37360250b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:47.036530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ee82c-4f08-4078-8612-2ac37360250b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:47.039563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:47.041632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ee82c-4f08-4078-8612-2ac37360250b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:47.041632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ee82c-4f08-4078-8612-2ac37360250b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:47.041916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ee82c-4f08-4078-8612-2ac37360250b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:47.043437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ee82c-4f08-4078-8612-2ac37360250b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:47.086125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8f5b2-a3d7-4f75-88b9-3311e1806225 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:47.088341 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1811/3658] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:46:47.107437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8f5b2-a3d7-4f75-88b9-3311e1806225 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:47.134434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115b938-6ecb-42a9-b9cc-55d0b592d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:47.135137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b938-6ecb-42a9-b9cc-55d0b592d775 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:47.135417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b938-6ecb-42a9-b9cc-55d0b592d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:47.135691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b938-6ecb-42a9-b9cc-55d0b592d775 admin admin] PATH_INFO: `/v3/projects/c871fcc36eeb49d98fed497ed36e5f29/users/d56625c3138f4fcb90ac5607690cb18e/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:47.138640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115b938-6ecb-42a9-b9cc-55d0b592d775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c871fcc36eeb49d98fed497ed36e5f29, user_id=d56625c3138f4fcb90ac5607690cb18e, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:47.141333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115b938-6ecb-42a9-b9cc-55d0b592d775 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:47.179802 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1848/3659] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:46:47 2022] PUT /identity/v3/projects/c871fcc36eeb49d98fed497ed36e5f29/users/d56625c3138f4fcb90ac5607690cb18e/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:47.189433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96485a3-63ee-423c-a17d-5d67eaaf0c7a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:47.190144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96485a3-63ee-423c-a17d-5d67eaaf0c7a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:47.190563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96485a3-63ee-423c-a17d-5d67eaaf0c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:47.282192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a96485a3-63ee-423c-a17d-5d67eaaf0c7a None None] MFA Rules not processed for user `d56625c3138f4fcb90ac5607690cb18e`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:47.283840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a96485a3-63ee-423c-a17d-5d67eaaf0c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:47.508468 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1812/3660] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:47.510476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115b938-6ecb-42a9-b9cc-55d0b592d775 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:47.527211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115b938-6ecb-42a9-b9cc-55d0b592d775 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:47.547562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9306c-7ac8-406b-885a-9b5647b2dd97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd56625c3138f4fcb90ac5607690cb18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c871fcc36eeb49d98fed497ed36e5f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:47.548224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9306c-7ac8-406b-885a-9b5647b2dd97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:47.548512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9306c-7ac8-406b-885a-9b5647b2dd97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:47.551275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9306c-7ac8-406b-885a-9b5647b2dd97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:47.551275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9306c-7ac8-406b-885a-9b5647b2dd97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:47.551536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9306c-7ac8-406b-885a-9b5647b2dd97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:47.565719 n-d-852088-5 devstack@keystone.service[82083]: WARNING keystone.server.flask.common [None req-1fe9306c-7ac8-406b-885a-9b5647b2dd97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 27 04:46:47.772248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96485a3-63ee-423c-a17d-5d67eaaf0c7a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:47.787365 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1849/3661] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:46:47 2022] POST /identity/v3/projects => generated 351 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:47.795182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96485a3-63ee-423c-a17d-5d67eaaf0c7a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:47.947477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56fd00-dcc0-4dba-82b0-578c94370e3a tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd56625c3138f4fcb90ac5607690cb18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c871fcc36eeb49d98fed497ed36e5f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:47.948112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56fd00-dcc0-4dba-82b0-578c94370e3a tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:47.948427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56fd00-dcc0-4dba-82b0-578c94370e3a tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:47.948741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56fd00-dcc0-4dba-82b0-578c94370e3a tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:47.949543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56fd00-dcc0-4dba-82b0-578c94370e3a tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:47.951254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56fd00-dcc0-4dba-82b0-578c94370e3a tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:48.110265 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1813/3662] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:46:47 2022] POST /identity/v3/projects => generated 350 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:46:48.115000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9306c-7ac8-406b-885a-9b5647b2dd97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:48.140417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9306c-7ac8-406b-885a-9b5647b2dd97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:48.220237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:48.288574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734ef81-df56-40da-a5bf-7f9339e03152 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd56625c3138f4fcb90ac5607690cb18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c871fcc36eeb49d98fed497ed36e5f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:48.291236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734ef81-df56-40da-a5bf-7f9339e03152 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:48.291236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734ef81-df56-40da-a5bf-7f9339e03152 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:48.291236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734ef81-df56-40da-a5bf-7f9339e03152 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] PATH_INFO: `/v3/users/3cbae6232ac64effb735c751ec4119b4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:48.292116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734ef81-df56-40da-a5bf-7f9339e03152 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorizing `identity:get_user(user_id=3cbae6232ac64effb735c751ec4119b4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:48.295674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734ef81-df56-40da-a5bf-7f9339e03152 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:48.304641 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1850/3663] 10.222.0.76 () {58 vars in 1221 bytes} [Sat Aug 27 04:46:48 2022] GET /identity/v3/users/3cbae6232ac64effb735c751ec4119b4 => generated 286 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:46:48.304955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56fd00-dcc0-4dba-82b0-578c94370e3a tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:48.319541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56fd00-dcc0-4dba-82b0-578c94370e3a tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:48.342368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de45f8-4413-4e23-bbda-efa3908bb764 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd56625c3138f4fcb90ac5607690cb18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c871fcc36eeb49d98fed497ed36e5f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:48.343744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de45f8-4413-4e23-bbda-efa3908bb764 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:48.348205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de45f8-4413-4e23-bbda-efa3908bb764 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:48.349469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de45f8-4413-4e23-bbda-efa3908bb764 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:48.351815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de45f8-4413-4e23-bbda-efa3908bb764 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:48.365925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de45f8-4413-4e23-bbda-efa3908bb764 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:48.492424 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1814/3664] 10.222.0.76 () {60 vars in 1162 bytes} [Sat Aug 27 04:46:48 2022] POST /identity/v3/credentials => generated 430 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:48.497104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734ef81-df56-40da-a5bf-7f9339e03152 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:48.514844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734ef81-df56-40da-a5bf-7f9339e03152 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:48.526549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fe9a7-98cb-4e7e-81d1-8d7d7459ed97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd56625c3138f4fcb90ac5607690cb18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c871fcc36eeb49d98fed497ed36e5f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:48.527208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fe9a7-98cb-4e7e-81d1-8d7d7459ed97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:48.527493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fe9a7-98cb-4e7e-81d1-8d7d7459ed97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:48.527769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fe9a7-98cb-4e7e-81d1-8d7d7459ed97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] PATH_INFO: `/v3/credentials/d5b0cd5f31fc9975713130492a26a220321aeee66ee2a7d732428eeecf7dd2cb` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:48.538695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fe9a7-98cb-4e7e-81d1-8d7d7459ed97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=d5b0cd5f31fc9975713130492a26a220321aeee66ee2a7d732428eeecf7dd2cb)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:48.545223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fe9a7-98cb-4e7e-81d1-8d7d7459ed97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:48.551225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fe9a7-98cb-4e7e-81d1-8d7d7459ed97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=d5b0cd5f31fc9975713130492a26a220321aeee66ee2a7d732428eeecf7dd2cb)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:48.553087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fe9a7-98cb-4e7e-81d1-8d7d7459ed97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:48.683305 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1851/3665] 10.222.0.76 () {60 vars in 1358 bytes} [Sat Aug 27 04:46:48 2022] PATCH /identity/v3/credentials/d5b0cd5f31fc9975713130492a26a220321aeee66ee2a7d732428eeecf7dd2cb => generated 436 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:46:48.685061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de45f8-4413-4e23-bbda-efa3908bb764 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:48.698611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de45f8-4413-4e23-bbda-efa3908bb764 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:48.703462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c9b8f-0306-44b6-994a-c4ac74393ee4 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd56625c3138f4fcb90ac5607690cb18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c871fcc36eeb49d98fed497ed36e5f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:48.704483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c9b8f-0306-44b6-994a-c4ac74393ee4 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:48.704775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c9b8f-0306-44b6-994a-c4ac74393ee4 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:48.705250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c9b8f-0306-44b6-994a-c4ac74393ee4 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] PATH_INFO: `/v3/credentials/d5b0cd5f31fc9975713130492a26a220321aeee66ee2a7d732428eeecf7dd2cb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:48.708243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c9b8f-0306-44b6-994a-c4ac74393ee4 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=d5b0cd5f31fc9975713130492a26a220321aeee66ee2a7d732428eeecf7dd2cb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:48.710104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c9b8f-0306-44b6-994a-c4ac74393ee4 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:48.721530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fe9a7-98cb-4e7e-81d1-8d7d7459ed97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:48.741081 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1815/3666] 10.222.0.76 () {58 vars in 1335 bytes} [Sat Aug 27 04:46:48 2022] GET /identity/v3/credentials/d5b0cd5f31fc9975713130492a26a220321aeee66ee2a7d732428eeecf7dd2cb => generated 436 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:46:48.747166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fe9a7-98cb-4e7e-81d1-8d7d7459ed97 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:48.764361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc6d55-8289-42d8-aa40-733385f6b66f tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd56625c3138f4fcb90ac5607690cb18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c871fcc36eeb49d98fed497ed36e5f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:48.765219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc6d55-8289-42d8-aa40-733385f6b66f tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:48.765610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc6d55-8289-42d8-aa40-733385f6b66f tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:48.766167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc6d55-8289-42d8-aa40-733385f6b66f tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] PATH_INFO: `/v3/credentials/d5b0cd5f31fc9975713130492a26a220321aeee66ee2a7d732428eeecf7dd2cb` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:48.772877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc6d55-8289-42d8-aa40-733385f6b66f tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=d5b0cd5f31fc9975713130492a26a220321aeee66ee2a7d732428eeecf7dd2cb)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:48.775227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc6d55-8289-42d8-aa40-733385f6b66f tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:48.903036 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1852/3667] 10.222.0.76 () {58 vars in 1338 bytes} [Sat Aug 27 04:46:48 2022] DELETE /identity/v3/credentials/d5b0cd5f31fc9975713130492a26a220321aeee66ee2a7d732428eeecf7dd2cb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:48.912464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c9b8f-0306-44b6-994a-c4ac74393ee4 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:48.928889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c9b8f-0306-44b6-994a-c4ac74393ee4 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:48.961038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe7601-84e0-4288-a0e8-32b99de382df tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd56625c3138f4fcb90ac5607690cb18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c871fcc36eeb49d98fed497ed36e5f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:48.961038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe7601-84e0-4288-a0e8-32b99de382df tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:48.965563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe7601-84e0-4288-a0e8-32b99de382df tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:48.966835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe7601-84e0-4288-a0e8-32b99de382df tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:48.967545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe7601-84e0-4288-a0e8-32b99de382df tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:48.969396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe7601-84e0-4288-a0e8-32b99de382df tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:49.099799 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1816/3668] 10.222.0.76 () {60 vars in 1162 bytes} [Sat Aug 27 04:46:48 2022] POST /identity/v3/credentials => generated 430 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:49.104179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc6d55-8289-42d8-aa40-733385f6b66f tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:49.119165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc6d55-8289-42d8-aa40-733385f6b66f tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:49.127091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3b5ee-7537-4f8a-81e9-3722529f8e93 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd56625c3138f4fcb90ac5607690cb18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c871fcc36eeb49d98fed497ed36e5f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:49.127804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3b5ee-7537-4f8a-81e9-3722529f8e93 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:49.128362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3b5ee-7537-4f8a-81e9-3722529f8e93 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:49.128892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3b5ee-7537-4f8a-81e9-3722529f8e93 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:49.129639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3b5ee-7537-4f8a-81e9-3722529f8e93 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:49.132129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3b5ee-7537-4f8a-81e9-3722529f8e93 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:49.240781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe7601-84e0-4288-a0e8-32b99de382df tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:49.256966 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1853/3669] 10.222.0.76 () {60 vars in 1162 bytes} [Sat Aug 27 04:46:49 2022] POST /identity/v3/credentials => generated 431 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:46:49.265851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe7601-84e0-4288-a0e8-32b99de382df tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:49.287870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414360a-0bfa-4a3c-8914-e2c39e24559d tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd56625c3138f4fcb90ac5607690cb18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c871fcc36eeb49d98fed497ed36e5f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:49.290367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414360a-0bfa-4a3c-8914-e2c39e24559d tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:49.290810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414360a-0bfa-4a3c-8914-e2c39e24559d tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:49.291695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414360a-0bfa-4a3c-8914-e2c39e24559d tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:49.292957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414360a-0bfa-4a3c-8914-e2c39e24559d tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:49.296131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414360a-0bfa-4a3c-8914-e2c39e24559d tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:49.323665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414360a-0bfa-4a3c-8914-e2c39e24559d tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:49.328069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414360a-0bfa-4a3c-8914-e2c39e24559d tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:49.341506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414360a-0bfa-4a3c-8914-e2c39e24559d tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:49.355741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414360a-0bfa-4a3c-8914-e2c39e24559d tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:49.355741 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1817/3670] 10.222.0.76 () {58 vars in 1140 bytes} [Sat Aug 27 04:46:49 2022] GET /identity/v3/credentials => generated 946 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:46:49.359687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3b5ee-7537-4f8a-81e9-3722529f8e93 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:49.417369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3b5ee-7537-4f8a-81e9-3722529f8e93 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:49.433119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91671587-f286-4e00-bcb7-b00df8e16518 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd56625c3138f4fcb90ac5607690cb18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c871fcc36eeb49d98fed497ed36e5f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:49.455799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91671587-f286-4e00-bcb7-b00df8e16518 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:49.458061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91671587-f286-4e00-bcb7-b00df8e16518 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:49.461541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91671587-f286-4e00-bcb7-b00df8e16518 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] PATH_INFO: `/v3/credentials/0a303e1094db7ff87620a72df4705ea95f2ed86ca23b0818ad3a05c692e7051b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:49.486185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91671587-f286-4e00-bcb7-b00df8e16518 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=0a303e1094db7ff87620a72df4705ea95f2ed86ca23b0818ad3a05c692e7051b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:49.501584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91671587-f286-4e00-bcb7-b00df8e16518 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:49.660226 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1854/3671] 10.222.0.76 () {58 vars in 1338 bytes} [Sat Aug 27 04:46:49 2022] DELETE /identity/v3/credentials/0a303e1094db7ff87620a72df4705ea95f2ed86ca23b0818ad3a05c692e7051b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:49.662534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414360a-0bfa-4a3c-8914-e2c39e24559d tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:49.678742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414360a-0bfa-4a3c-8914-e2c39e24559d tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:49.696542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292f1e6-916d-4e6d-b2d5-2a88c88f6bb7 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd56625c3138f4fcb90ac5607690cb18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c871fcc36eeb49d98fed497ed36e5f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:49.698124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292f1e6-916d-4e6d-b2d5-2a88c88f6bb7 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:49.698556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292f1e6-916d-4e6d-b2d5-2a88c88f6bb7 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:49.699187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292f1e6-916d-4e6d-b2d5-2a88c88f6bb7 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] PATH_INFO: `/v3/credentials/0c90a16e68b59d2542e61940a153396a0c9254dccd04785331d4174dcd25da22` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:49.701841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292f1e6-916d-4e6d-b2d5-2a88c88f6bb7 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=0c90a16e68b59d2542e61940a153396a0c9254dccd04785331d4174dcd25da22)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:49.705482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292f1e6-916d-4e6d-b2d5-2a88c88f6bb7 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:49.816243 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1818/3672] 10.222.0.76 () {58 vars in 1338 bytes} [Sat Aug 27 04:46:49 2022] DELETE /identity/v3/credentials/0c90a16e68b59d2542e61940a153396a0c9254dccd04785331d4174dcd25da22 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:49.824092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91671587-f286-4e00-bcb7-b00df8e16518 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:49.854845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91671587-f286-4e00-bcb7-b00df8e16518 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:49.883651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c222536-5b89-49fd-94e6-ab656f8b0b00 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd56625c3138f4fcb90ac5607690cb18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c871fcc36eeb49d98fed497ed36e5f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:49.884983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c222536-5b89-49fd-94e6-ab656f8b0b00 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:49.886662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c222536-5b89-49fd-94e6-ab656f8b0b00 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:49.890320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c222536-5b89-49fd-94e6-ab656f8b0b00 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] PATH_INFO: `/v3/projects/5db4814adeeb43f2b37d6248383a0954` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:49.897453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c222536-5b89-49fd-94e6-ab656f8b0b00 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5db4814adeeb43f2b37d6248383a0954)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:49.905505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c222536-5b89-49fd-94e6-ab656f8b0b00 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:50.214025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2c222536-5b89-49fd-94e6-ab656f8b0b00 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db4814adeeb43f2b37d6248383a0954', 'request_id': 'req-2c222536-5b89-49fd-94e6-ab656f8b0b00'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:50.242353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2c222536-5b89-49fd-94e6-ab656f8b0b00 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db4814adeeb43f2b37d6248383a0954', 'request_id': 'req-2c222536-5b89-49fd-94e6-ab656f8b0b00'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:50.351228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2c222536-5b89-49fd-94e6-ab656f8b0b00 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db4814adeeb43f2b37d6248383a0954', 'request_id': 'req-2c222536-5b89-49fd-94e6-ab656f8b0b00'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:50.384755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2c222536-5b89-49fd-94e6-ab656f8b0b00 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] The token cache is being invalidate because project 5db4814adeeb43f2b37d6248383a0954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:50.392640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2c222536-5b89-49fd-94e6-ab656f8b0b00 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:50.396276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2c222536-5b89-49fd-94e6-ab656f8b0b00 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:50.413490 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1855/3673] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:46:49 2022] DELETE /identity/v3/projects/5db4814adeeb43f2b37d6248383a0954 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:50.422620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292f1e6-916d-4e6d-b2d5-2a88c88f6bb7 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:50.422620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f292f1e6-916d-4e6d-b2d5-2a88c88f6bb7 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:50.504912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292f1e6-916d-4e6d-b2d5-2a88c88f6bb7 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:50.524089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:50.726380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d7ffc-2dc8-48ef-91ee-3cd6caaadbeb tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd56625c3138f4fcb90ac5607690cb18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c871fcc36eeb49d98fed497ed36e5f29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:50.727043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d7ffc-2dc8-48ef-91ee-3cd6caaadbeb tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:50.727492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d7ffc-2dc8-48ef-91ee-3cd6caaadbeb tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:50.727997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d7ffc-2dc8-48ef-91ee-3cd6caaadbeb tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] PATH_INFO: `/v3/projects/05093834302d478b9db31a7443be36bc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:50.734287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d7ffc-2dc8-48ef-91ee-3cd6caaadbeb tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorizing `identity:delete_project(project_id=05093834302d478b9db31a7443be36bc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:50.748025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d7ffc-2dc8-48ef-91ee-3cd6caaadbeb tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:51.057426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fb0d7ffc-2dc8-48ef-91ee-3cd6caaadbeb tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05093834302d478b9db31a7443be36bc', 'request_id': 'req-fb0d7ffc-2dc8-48ef-91ee-3cd6caaadbeb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:51.081627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fb0d7ffc-2dc8-48ef-91ee-3cd6caaadbeb tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05093834302d478b9db31a7443be36bc', 'request_id': 'req-fb0d7ffc-2dc8-48ef-91ee-3cd6caaadbeb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:51.106804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fb0d7ffc-2dc8-48ef-91ee-3cd6caaadbeb tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05093834302d478b9db31a7443be36bc', 'request_id': 'req-fb0d7ffc-2dc8-48ef-91ee-3cd6caaadbeb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:51.282174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fb0d7ffc-2dc8-48ef-91ee-3cd6caaadbeb tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] The token cache is being invalidate because project 05093834302d478b9db31a7443be36bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:51.282722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fb0d7ffc-2dc8-48ef-91ee-3cd6caaadbeb tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:51.287737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fb0d7ffc-2dc8-48ef-91ee-3cd6caaadbeb tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:51.289958 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1819/3674] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:46:50 2022] DELETE /identity/v3/projects/05093834302d478b9db31a7443be36bc => generated 0 bytes in 872 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:51.294149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c222536-5b89-49fd-94e6-ab656f8b0b00 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:51.296457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2c222536-5b89-49fd-94e6-ab656f8b0b00 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:51.546059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:51.709639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c222536-5b89-49fd-94e6-ab656f8b0b00 tempest-CredentialsTestJSON-1530105789 tempest-CredentialsTestJSON-1530105789-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:52.000055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466d6e2-4fe0-4b44-9255-6cda69cf6470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:52.000055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d6e2-4fe0-4b44-9255-6cda69cf6470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:52.000055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d6e2-4fe0-4b44-9255-6cda69cf6470 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:52.000055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d6e2-4fe0-4b44-9255-6cda69cf6470 admin admin] PATH_INFO: `/v3/users/3cbae6232ac64effb735c751ec4119b4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:52.003887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466d6e2-4fe0-4b44-9255-6cda69cf6470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cbae6232ac64effb735c751ec4119b4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:52.003887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466d6e2-4fe0-4b44-9255-6cda69cf6470 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:52.392873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3466d6e2-4fe0-4b44-9255-6cda69cf6470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cbae6232ac64effb735c751ec4119b4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:52.394372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3466d6e2-4fe0-4b44-9255-6cda69cf6470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cbae6232ac64effb735c751ec4119b4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:52.550862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3466d6e2-4fe0-4b44-9255-6cda69cf6470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cbae6232ac64effb735c751ec4119b4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:52.552270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3466d6e2-4fe0-4b44-9255-6cda69cf6470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cbae6232ac64effb735c751ec4119b4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:52.602138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3466d6e2-4fe0-4b44-9255-6cda69cf6470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cbae6232ac64effb735c751ec4119b4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:52.663970 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1856/3675] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:46:51 2022] DELETE /identity/v3/users/3cbae6232ac64effb735c751ec4119b4 => generated 0 bytes in 1370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:52.668632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf6f9f-5b30-4f08-a1ad-3de8ffe0d8c4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:52.673332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf6f9f-5b30-4f08-a1ad-3de8ffe0d8c4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:52.673332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf6f9f-5b30-4f08-a1ad-3de8ffe0d8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:52.755482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2ccf6f9f-5b30-4f08-a1ad-3de8ffe0d8c4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:52.766779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2ccf6f9f-5b30-4f08-a1ad-3de8ffe0d8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:52.990428 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1820/3676] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:53.031912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466d6e2-4fe0-4b44-9255-6cda69cf6470 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:53.034172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3466d6e2-4fe0-4b44-9255-6cda69cf6470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:53.185064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466d6e2-4fe0-4b44-9255-6cda69cf6470 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:53.195316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781cd8c-c61c-44b6-8e73-f12f72734a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:53.197216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781cd8c-c61c-44b6-8e73-f12f72734a79 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:53.200307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781cd8c-c61c-44b6-8e73-f12f72734a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:53.200307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781cd8c-c61c-44b6-8e73-f12f72734a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:53.229717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781cd8c-c61c-44b6-8e73-f12f72734a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:53.240711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781cd8c-c61c-44b6-8e73-f12f72734a79 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:53.280624 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1857/3677] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:55.473972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf6f9f-5b30-4f08-a1ad-3de8ffe0d8c4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:55.475448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2ccf6f9f-5b30-4f08-a1ad-3de8ffe0d8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:55.511032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf6f9f-5b30-4f08-a1ad-3de8ffe0d8c4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:55.533544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f53244-9f05-4d69-a16e-d66656fb975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:55.535225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f53244-9f05-4d69-a16e-d66656fb975f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:55.535512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f53244-9f05-4d69-a16e-d66656fb975f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:55.535788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f53244-9f05-4d69-a16e-d66656fb975f admin admin] PATH_INFO: `/v3/projects/8a9067a0a3414fdeb18b7d0bc115daea` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:55.543346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f53244-9f05-4d69-a16e-d66656fb975f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a9067a0a3414fdeb18b7d0bc115daea)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:55.545528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f53244-9f05-4d69-a16e-d66656fb975f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:55.732393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:55.771225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-67f53244-9f05-4d69-a16e-d66656fb975f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a9067a0a3414fdeb18b7d0bc115daea', 'request_id': 'req-67f53244-9f05-4d69-a16e-d66656fb975f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:55.805023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-67f53244-9f05-4d69-a16e-d66656fb975f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a9067a0a3414fdeb18b7d0bc115daea', 'request_id': 'req-67f53244-9f05-4d69-a16e-d66656fb975f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:55.818066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-67f53244-9f05-4d69-a16e-d66656fb975f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a9067a0a3414fdeb18b7d0bc115daea', 'request_id': 'req-67f53244-9f05-4d69-a16e-d66656fb975f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:55.950213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-67f53244-9f05-4d69-a16e-d66656fb975f admin admin] The token cache is being invalidate because project 8a9067a0a3414fdeb18b7d0bc115daea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:55.950584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-67f53244-9f05-4d69-a16e-d66656fb975f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:55.951186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-67f53244-9f05-4d69-a16e-d66656fb975f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:55.955665 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1821/3678] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:46:55 2022] DELETE /identity/v3/projects/8a9067a0a3414fdeb18b7d0bc115daea => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:55.957616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781cd8c-c61c-44b6-8e73-f12f72734a79 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:55.984606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781cd8c-c61c-44b6-8e73-f12f72734a79 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:56.004551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:56.233707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10344571-50b4-41ae-a06d-49e847cf25ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:56.239541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10344571-50b4-41ae-a06d-49e847cf25ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:56.239541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10344571-50b4-41ae-a06d-49e847cf25ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:56.240810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10344571-50b4-41ae-a06d-49e847cf25ce admin admin] PATH_INFO: `/v3/users/d56625c3138f4fcb90ac5607690cb18e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:56.250650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10344571-50b4-41ae-a06d-49e847cf25ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d56625c3138f4fcb90ac5607690cb18e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:56.258208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10344571-50b4-41ae-a06d-49e847cf25ce admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:56.749562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6a2cf-0703-4cd3-bcc6-2e7a6efb9d3e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:56.750584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6a2cf-0703-4cd3-bcc6-2e7a6efb9d3e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:56.751037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6a2cf-0703-4cd3-bcc6-2e7a6efb9d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:56.824896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0bd6a2cf-0703-4cd3-bcc6-2e7a6efb9d3e None None] MFA Rules not processed for user `e30f8cfc3aca4b0eb27d413cc8e032f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:56.826306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0bd6a2cf-0703-4cd3-bcc6-2e7a6efb9d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:57.125143 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1822/3679] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:46:57.135712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c252ce-4ade-4e01-b4e8-515c23a5e00e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:57.136451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c252ce-4ade-4e01-b4e8-515c23a5e00e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:57.138013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c252ce-4ade-4e01-b4e8-515c23a5e00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:57.251479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-28c252ce-4ade-4e01-b4e8-515c23a5e00e None None] MFA Rules not processed for user `e30f8cfc3aca4b0eb27d413cc8e032f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:57.256315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-28c252ce-4ade-4e01-b4e8-515c23a5e00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:57.283885 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1823/3680] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:46:57.301565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c252ce-4ade-4e01-b4e8-515c23a5e00e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:57.307007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-28c252ce-4ade-4e01-b4e8-515c23a5e00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:57.443871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-10344571-50b4-41ae-a06d-49e847cf25ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd56625c3138f4fcb90ac5607690cb18e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:57.444289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-10344571-50b4-41ae-a06d-49e847cf25ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd56625c3138f4fcb90ac5607690cb18e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:57.528700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-10344571-50b4-41ae-a06d-49e847cf25ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd56625c3138f4fcb90ac5607690cb18e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:57.529560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-10344571-50b4-41ae-a06d-49e847cf25ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd56625c3138f4fcb90ac5607690cb18e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:57.569465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-10344571-50b4-41ae-a06d-49e847cf25ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd56625c3138f4fcb90ac5607690cb18e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:57.601138 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1858/3681] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:46:55 2022] DELETE /identity/v3/users/d56625c3138f4fcb90ac5607690cb18e => generated 0 bytes in 1645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:57.713740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c252ce-4ade-4e01-b4e8-515c23a5e00e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:57.841262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812ce3c-47be-462e-bd65-33368447da3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:57.842201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812ce3c-47be-462e-bd65-33368447da3c service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:57.842562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812ce3c-47be-462e-bd65-33368447da3c service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:57.842907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812ce3c-47be-462e-bd65-33368447da3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:57.844795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0812ce3c-47be-462e-bd65-33368447da3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:57.936744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812ce3c-47be-462e-bd65-33368447da3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:57.938522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812ce3c-47be-462e-bd65-33368447da3c service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:57.966615 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1824/3682] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:46:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:46:58.100212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10344571-50b4-41ae-a06d-49e847cf25ce admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:58.109588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-10344571-50b4-41ae-a06d-49e847cf25ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:58.216445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10344571-50b4-41ae-a06d-49e847cf25ce admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:58.230567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3cd61-3160-4fa6-a6fe-d4ce112759cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:58.231657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3cd61-3160-4fa6-a6fe-d4ce112759cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:58.232196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3cd61-3160-4fa6-a6fe-d4ce112759cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:58.232912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3cd61-3160-4fa6-a6fe-d4ce112759cb admin admin] PATH_INFO: `/v3/users/83867771c9a1442cba2837c1132df88d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:58.234944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3cd61-3160-4fa6-a6fe-d4ce112759cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=83867771c9a1442cba2837c1132df88d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:58.237900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3cd61-3160-4fa6-a6fe-d4ce112759cb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:58.492195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fba3cd61-3160-4fa6-a6fe-d4ce112759cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83867771c9a1442cba2837c1132df88d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:58.493335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fba3cd61-3160-4fa6-a6fe-d4ce112759cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83867771c9a1442cba2837c1132df88d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:58.614880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fba3cd61-3160-4fa6-a6fe-d4ce112759cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83867771c9a1442cba2837c1132df88d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:58.616088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:58.617147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fba3cd61-3160-4fa6-a6fe-d4ce112759cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83867771c9a1442cba2837c1132df88d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:58.661168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fba3cd61-3160-4fa6-a6fe-d4ce112759cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83867771c9a1442cba2837c1132df88d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:58.705751 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1859/3683] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:46:58 2022] DELETE /identity/v3/users/83867771c9a1442cba2837c1132df88d => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:58.827704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812ce3c-47be-462e-bd65-33368447da3c service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:58.829448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0812ce3c-47be-462e-bd65-33368447da3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:58.854432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812ce3c-47be-462e-bd65-33368447da3c service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:58.961823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dac53c-fcd9-4ca1-80b9-71790480d738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:58.962695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dac53c-fcd9-4ca1-80b9-71790480d738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:58.963123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dac53c-fcd9-4ca1-80b9-71790480d738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:58.963542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dac53c-fcd9-4ca1-80b9-71790480d738 admin admin] PATH_INFO: `/v3/users/e0b2967fe54c42859db5e36293550a40` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:58.965029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dac53c-fcd9-4ca1-80b9-71790480d738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b2967fe54c42859db5e36293550a40)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:58.967755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dac53c-fcd9-4ca1-80b9-71790480d738 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:58.999977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720766a-4dec-4552-b0ed-e43e617a5c77 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:59.008541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720766a-4dec-4552-b0ed-e43e617a5c77 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:59.008541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720766a-4dec-4552-b0ed-e43e617a5c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:59.009105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-d720766a-4dec-4552-b0ed-e43e617a5c77 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:46:59.009105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:46:59.009105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:46:59.009105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:46:59.009105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:46:59.009105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:46:59.009105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:46:59.009105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:46:59.009105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:46:59.009105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:46:59.009105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:46:59.009105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:46:59.009105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:46:59.010009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:46:59.010009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:46:59.010009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:46:59.010009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:46:59.010009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:46:59.010009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:46:59.010009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:46:59.010009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:46:59.010009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:46:59.010009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:46:59.010009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:46:59.010009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:46:59.010009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:46:59.010009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:46:59.010009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:46:59.013041 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1860/3684] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:46:58 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 04:46:59.310133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:46:59.447349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720766a-4dec-4552-b0ed-e43e617a5c77 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:59.451868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-80dac53c-fcd9-4ca1-80b9-71790480d738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b2967fe54c42859db5e36293550a40'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:59.451990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d720766a-4dec-4552-b0ed-e43e617a5c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:59.477493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720766a-4dec-4552-b0ed-e43e617a5c77 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:59.486754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a69352-2792-4514-a7b0-57055b301062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:46:59.486754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a69352-2792-4514-a7b0-57055b301062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:59.486754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a69352-2792-4514-a7b0-57055b301062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:59.486754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a69352-2792-4514-a7b0-57055b301062 admin admin] PATH_INFO: `/v3/projects/c871fcc36eeb49d98fed497ed36e5f29` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:59.487210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a69352-2792-4514-a7b0-57055b301062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c871fcc36eeb49d98fed497ed36e5f29)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:46:59.487210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a69352-2792-4514-a7b0-57055b301062 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:46:59.546033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-80dac53c-fcd9-4ca1-80b9-71790480d738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b2967fe54c42859db5e36293550a40'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:59.546667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-80dac53c-fcd9-4ca1-80b9-71790480d738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b2967fe54c42859db5e36293550a40'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:59.570925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-80dac53c-fcd9-4ca1-80b9-71790480d738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b2967fe54c42859db5e36293550a40'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:59.593657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-80dac53c-fcd9-4ca1-80b9-71790480d738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b2967fe54c42859db5e36293550a40'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:59.603346 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1825/3685] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:46:58 2022] DELETE /identity/v3/users/e0b2967fe54c42859db5e36293550a40 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:46:59.645174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e7a69352-2792-4514-a7b0-57055b301062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c871fcc36eeb49d98fed497ed36e5f29', 'request_id': 'req-e7a69352-2792-4514-a7b0-57055b301062'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:59.654764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e7a69352-2792-4514-a7b0-57055b301062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c871fcc36eeb49d98fed497ed36e5f29', 'request_id': 'req-e7a69352-2792-4514-a7b0-57055b301062'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:59.702930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dac53c-fcd9-4ca1-80b9-71790480d738 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:46:59.704836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-80dac53c-fcd9-4ca1-80b9-71790480d738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:46:59.756923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e7a69352-2792-4514-a7b0-57055b301062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c871fcc36eeb49d98fed497ed36e5f29', 'request_id': 'req-e7a69352-2792-4514-a7b0-57055b301062'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:59.792400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e7a69352-2792-4514-a7b0-57055b301062 admin admin] The token cache is being invalidate because project c871fcc36eeb49d98fed497ed36e5f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:46:59.792768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e7a69352-2792-4514-a7b0-57055b301062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:59.793910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e7a69352-2792-4514-a7b0-57055b301062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:46:59.795510 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1861/3686] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:46:59 2022] DELETE /identity/v3/projects/c871fcc36eeb49d98fed497ed36e5f29 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:46:59.801502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d6305-44c5-42a5-abd9-938ba875df59 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:46:59.801781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d6305-44c5-42a5-abd9-938ba875df59 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:46:59.804381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d6305-44c5-42a5-abd9-938ba875df59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:46:59.932891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dac53c-fcd9-4ca1-80b9-71790480d738 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:46:59.937401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2d2d6305-44c5-42a5-abd9-938ba875df59 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:46:59.942706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2d2d6305-44c5-42a5-abd9-938ba875df59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:00.099264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeafd09-eb81-443a-9617-f84ac646d735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:00.100352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeafd09-eb81-443a-9617-f84ac646d735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:00.100862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeafd09-eb81-443a-9617-f84ac646d735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:00.101982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeafd09-eb81-443a-9617-f84ac646d735 admin admin] PATH_INFO: `/v3/projects/3b1896a4899d4c37af1be6a7f91249c0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:00.104569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeafd09-eb81-443a-9617-f84ac646d735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1896a4899d4c37af1be6a7f91249c0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:00.107511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeafd09-eb81-443a-9617-f84ac646d735 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:00.199179 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1862/3687] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:00.201293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0323d-dfd4-4039-bc5b-82d91417d55c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:00.201640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0323d-dfd4-4039-bc5b-82d91417d55c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:00.201924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0323d-dfd4-4039-bc5b-82d91417d55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:00.235166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0eb0323d-dfd4-4039-bc5b-82d91417d55c None None] MFA Rules not processed for user `8115953d94074d32a4aee216289feb36`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:00.239386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0eb0323d-dfd4-4039-bc5b-82d91417d55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:00.344214 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1863/3688] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:00.345304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b200319-f715-4ca4-b882-8d8c8fc3890c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:00.351073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b200319-f715-4ca4-b882-8d8c8fc3890c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:00.351073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b200319-f715-4ca4-b882-8d8c8fc3890c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:00.368950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1aeafd09-eb81-443a-9617-f84ac646d735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1896a4899d4c37af1be6a7f91249c0', 'request_id': 'req-1aeafd09-eb81-443a-9617-f84ac646d735'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:00.385994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1b200319-f715-4ca4-b882-8d8c8fc3890c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:00.387252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1b200319-f715-4ca4-b882-8d8c8fc3890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:00.399125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1aeafd09-eb81-443a-9617-f84ac646d735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1896a4899d4c37af1be6a7f91249c0', 'request_id': 'req-1aeafd09-eb81-443a-9617-f84ac646d735'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:00.431215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1aeafd09-eb81-443a-9617-f84ac646d735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1896a4899d4c37af1be6a7f91249c0', 'request_id': 'req-1aeafd09-eb81-443a-9617-f84ac646d735'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:00.527950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1aeafd09-eb81-443a-9617-f84ac646d735 admin admin] The token cache is being invalidate because project 3b1896a4899d4c37af1be6a7f91249c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:00.529881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1aeafd09-eb81-443a-9617-f84ac646d735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:00.532591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1aeafd09-eb81-443a-9617-f84ac646d735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:00.537477 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1826/3689] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:46:59 2022] DELETE /identity/v3/projects/3b1896a4899d4c37af1be6a7f91249c0 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:00.543435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeafd09-eb81-443a-9617-f84ac646d735 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:00.546079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1aeafd09-eb81-443a-9617-f84ac646d735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:00.549309 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1864/3690] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:00.550744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b200319-f715-4ca4-b882-8d8c8fc3890c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:00.556466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1b200319-f715-4ca4-b882-8d8c8fc3890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:00.590054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b200319-f715-4ca4-b882-8d8c8fc3890c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:00.592884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeafd09-eb81-443a-9617-f84ac646d735 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:00.598196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebeacc1-55fb-4e5d-86db-3372d6cfc365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:00.598863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeacc1-55fb-4e5d-86db-3372d6cfc365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:00.605126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bae202-7412-486f-b281-805d0c49c735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:00.605911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeacc1-55fb-4e5d-86db-3372d6cfc365 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:00.606219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeacc1-55fb-4e5d-86db-3372d6cfc365 admin admin] PATH_INFO: `/v3/users/da1014ef8b0a4b2c8da27a90eb92fe69` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:00.608052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebeacc1-55fb-4e5d-86db-3372d6cfc365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da1014ef8b0a4b2c8da27a90eb92fe69)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:00.615818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebeacc1-55fb-4e5d-86db-3372d6cfc365 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:00.624074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae202-7412-486f-b281-805d0c49c735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:00.624570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae202-7412-486f-b281-805d0c49c735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:00.624994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae202-7412-486f-b281-805d0c49c735 admin admin] PATH_INFO: `/v3/projects/f4185d79a6094e40ac474cf89d438d82` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:00.626689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bae202-7412-486f-b281-805d0c49c735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4185d79a6094e40ac474cf89d438d82)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:00.631015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bae202-7412-486f-b281-805d0c49c735 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:00.800780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d8bae202-7412-486f-b281-805d0c49c735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4185d79a6094e40ac474cf89d438d82', 'request_id': 'req-d8bae202-7412-486f-b281-805d0c49c735'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:00.820427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d8bae202-7412-486f-b281-805d0c49c735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4185d79a6094e40ac474cf89d438d82', 'request_id': 'req-d8bae202-7412-486f-b281-805d0c49c735'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:00.842952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d8bae202-7412-486f-b281-805d0c49c735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4185d79a6094e40ac474cf89d438d82', 'request_id': 'req-d8bae202-7412-486f-b281-805d0c49c735'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:00.985013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d8bae202-7412-486f-b281-805d0c49c735 admin admin] The token cache is being invalidate because project f4185d79a6094e40ac474cf89d438d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:00.985687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d8bae202-7412-486f-b281-805d0c49c735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:00.988834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d8bae202-7412-486f-b281-805d0c49c735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:00.993818 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1827/3691] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:00 2022] DELETE /identity/v3/projects/f4185d79a6094e40ac474cf89d438d82 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:00.996663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bae202-7412-486f-b281-805d0c49c735 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:00.999889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d8bae202-7412-486f-b281-805d0c49c735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:01.000611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ebeacc1-55fb-4e5d-86db-3372d6cfc365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da1014ef8b0a4b2c8da27a90eb92fe69'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:01.002002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ebeacc1-55fb-4e5d-86db-3372d6cfc365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da1014ef8b0a4b2c8da27a90eb92fe69'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:01.023784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:01.105526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ebeacc1-55fb-4e5d-86db-3372d6cfc365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da1014ef8b0a4b2c8da27a90eb92fe69'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:01.105994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ebeacc1-55fb-4e5d-86db-3372d6cfc365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da1014ef8b0a4b2c8da27a90eb92fe69'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:01.140462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ebeacc1-55fb-4e5d-86db-3372d6cfc365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da1014ef8b0a4b2c8da27a90eb92fe69'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:01.179125 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1865/3692] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:47:00 2022] DELETE /identity/v3/users/da1014ef8b0a4b2c8da27a90eb92fe69 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:01.183200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566863bd-0ec0-4ff9-bc3a-473ef3f9af21 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:01.183481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566863bd-0ec0-4ff9-bc3a-473ef3f9af21 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:01.187424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566863bd-0ec0-4ff9-bc3a-473ef3f9af21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:01.229899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-566863bd-0ec0-4ff9-bc3a-473ef3f9af21 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:01.231146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-566863bd-0ec0-4ff9-bc3a-473ef3f9af21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:01.231375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bae202-7412-486f-b281-805d0c49c735 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:01.236890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:01.371019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9a549-31d5-4d6c-b761-b01f173c1229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:01.371582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9a549-31d5-4d6c-b761-b01f173c1229 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:01.371875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9a549-31d5-4d6c-b761-b01f173c1229 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:01.372155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9a549-31d5-4d6c-b761-b01f173c1229 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:01.372861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9a549-31d5-4d6c-b761-b01f173c1229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:01.373167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9a549-31d5-4d6c-b761-b01f173c1229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:01.374865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9a549-31d5-4d6c-b761-b01f173c1229 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:01.387479 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1866/3693] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:01.400697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74568737-031c-433b-abb3-fe19de4d6c9d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:01.400697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74568737-031c-433b-abb3-fe19de4d6c9d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:01.400697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74568737-031c-433b-abb3-fe19de4d6c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:01.406207 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1828/3694] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:01.411237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9a549-31d5-4d6c-b761-b01f173c1229 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:01.413429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e5a9a549-31d5-4d6c-b761-b01f173c1229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:01.439340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9a549-31d5-4d6c-b761-b01f173c1229 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:01.455945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-74568737-031c-433b-abb3-fe19de4d6c9d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:01.460522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-74568737-031c-433b-abb3-fe19de4d6c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:01.467272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32711fd-5f55-4206-8282-bed921342cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:01.467916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32711fd-5f55-4206-8282-bed921342cde admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:01.468215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32711fd-5f55-4206-8282-bed921342cde admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:01.475560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32711fd-5f55-4206-8282-bed921342cde admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:01.475560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32711fd-5f55-4206-8282-bed921342cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:01.475560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32711fd-5f55-4206-8282-bed921342cde admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:01.485872 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1867/3695] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:01.491328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74568737-031c-433b-abb3-fe19de4d6c9d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:01.514498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74568737-031c-433b-abb3-fe19de4d6c9d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:01.531628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c1fdf-41b0-4e8a-97d4-537b760ddd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:01.532448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c1fdf-41b0-4e8a-97d4-537b760ddd8b admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:01.533127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c1fdf-41b0-4e8a-97d4-537b760ddd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:01.533727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c1fdf-41b0-4e8a-97d4-537b760ddd8b admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:01.535792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c1fdf-41b0-4e8a-97d4-537b760ddd8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:01.536278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c1fdf-41b0-4e8a-97d4-537b760ddd8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:01.539285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c1fdf-41b0-4e8a-97d4-537b760ddd8b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:01.591680 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1868/3696] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:01.597087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c1fdf-41b0-4e8a-97d4-537b760ddd8b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:01.619577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c1fdf-41b0-4e8a-97d4-537b760ddd8b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:01.626407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac851c-235d-4934-8fc7-867ab7bc9546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:01.627211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac851c-235d-4934-8fc7-867ab7bc9546 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:01.627605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac851c-235d-4934-8fc7-867ab7bc9546 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:01.628066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac851c-235d-4934-8fc7-867ab7bc9546 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:01.629462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac851c-235d-4934-8fc7-867ab7bc9546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:01.631081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac851c-235d-4934-8fc7-867ab7bc9546 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:01.641227 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1829/3697] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:01 2022] POST /identity/v3/projects => generated 367 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:01.645436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32711fd-5f55-4206-8282-bed921342cde admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:01.792730 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1869/3698] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:01 2022] POST /identity/v3/projects => generated 399 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:47:01.792730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac851c-235d-4934-8fc7-867ab7bc9546 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:01.794685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5fac851c-235d-4934-8fc7-867ab7bc9546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:01.826302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32711fd-5f55-4206-8282-bed921342cde admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:01.905768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:01.926601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a009a-f83c-4069-abca-7a75e267c94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:01.928202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a009a-f83c-4069-abca-7a75e267c94d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:01.928566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a009a-f83c-4069-abca-7a75e267c94d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:01.928934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a009a-f83c-4069-abca-7a75e267c94d admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:01.929782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a009a-f83c-4069-abca-7a75e267c94d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:01.942013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a009a-f83c-4069-abca-7a75e267c94d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:01.947768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac851c-235d-4934-8fc7-867ab7bc9546 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:01.975019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b139d-957c-4ab3-b620-449ba63a6977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:01.975843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b139d-957c-4ab3-b620-449ba63a6977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:01.976295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b139d-957c-4ab3-b620-449ba63a6977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:01.976693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b139d-957c-4ab3-b620-449ba63a6977 admin admin] PATH_INFO: `/v3/users/0d9a43514b8d4c9ba725074185734bf7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:01.985160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b139d-957c-4ab3-b620-449ba63a6977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9a43514b8d4c9ba725074185734bf7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:01.987289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b139d-957c-4ab3-b620-449ba63a6977 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:02.089083 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1830/3699] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:01 2022] POST /identity/v3/users => generated 284 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:47:02.089600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a009a-f83c-4069-abca-7a75e267c94d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:02.101711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a009a-f83c-4069-abca-7a75e267c94d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:02.120437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c2223-1adc-4259-807d-fc09f68831e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:02.123069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:02.123869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c2223-1adc-4259-807d-fc09f68831e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:02.127010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c2223-1adc-4259-807d-fc09f68831e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:02.127010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c2223-1adc-4259-807d-fc09f68831e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:02.127519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c2223-1adc-4259-807d-fc09f68831e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:02.133490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c2223-1adc-4259-807d-fc09f68831e1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:02.286733 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1831/3700] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:02 2022] POST /identity/v3/users => generated 300 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:02.286733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21e217-ddf3-4e24-90fd-1df215f524d0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:02.286733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21e217-ddf3-4e24-90fd-1df215f524d0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:02.286733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21e217-ddf3-4e24-90fd-1df215f524d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:02.296824 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-bc21e217-ddf3-4e24-90fd-1df215f524d0 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:47:02.296824 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:47:02.296824 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:47:02.296824 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:47:02.296824 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:47:02.296824 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:47:02.296824 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:47:02.296824 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:47:02.296824 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:47:02.296824 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:47:02.296824 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:47:02.296824 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:47:02.296824 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:47:02.297707 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:47:02.297707 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:47:02.297707 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:47:02.297707 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:47:02.297707 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:47:02.297707 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:47:02.297707 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:47:02.297707 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:47:02.297707 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:47:02.297707 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:47:02.297707 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:47:02.297707 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:47:02.297707 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:47:02.297707 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:47:02.297707 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:47:02.300741 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1832/3701] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:47:02 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 16 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:47:02.302753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21e217-ddf3-4e24-90fd-1df215f524d0 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:02.347040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ae1b139d-957c-4ab3-b620-449ba63a6977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9a43514b8d4c9ba725074185734bf7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:02.347821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ae1b139d-957c-4ab3-b620-449ba63a6977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9a43514b8d4c9ba725074185734bf7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:02.353711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21e217-ddf3-4e24-90fd-1df215f524d0 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:02.360614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b470a8a-ee15-4241-8cf2-ad6d7e1d7352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:02.361708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b470a8a-ee15-4241-8cf2-ad6d7e1d7352 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:02.362082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b470a8a-ee15-4241-8cf2-ad6d7e1d7352 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:02.362465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b470a8a-ee15-4241-8cf2-ad6d7e1d7352 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:02.363339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b470a8a-ee15-4241-8cf2-ad6d7e1d7352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:02.365404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b470a8a-ee15-4241-8cf2-ad6d7e1d7352 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:02.389108 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1833/3702] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:02.390900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b470a8a-ee15-4241-8cf2-ad6d7e1d7352 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:02.392972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2b470a8a-ee15-4241-8cf2-ad6d7e1d7352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:02.424514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b470a8a-ee15-4241-8cf2-ad6d7e1d7352 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:02.430314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ae1b139d-957c-4ab3-b620-449ba63a6977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9a43514b8d4c9ba725074185734bf7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:02.430314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ae1b139d-957c-4ab3-b620-449ba63a6977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9a43514b8d4c9ba725074185734bf7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:02.431636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132d2be-8d99-4819-ad2e-06c6638ab2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:02.432548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132d2be-8d99-4819-ad2e-06c6638ab2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:02.433052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132d2be-8d99-4819-ad2e-06c6638ab2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:02.433618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132d2be-8d99-4819-ad2e-06c6638ab2cf admin admin] PATH_INFO: `/v3/projects/afd683ccf6674e33a101d957f16e948e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:02.435042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132d2be-8d99-4819-ad2e-06c6638ab2cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd683ccf6674e33a101d957f16e948e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:02.438608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132d2be-8d99-4819-ad2e-06c6638ab2cf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:02.449585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ae1b139d-957c-4ab3-b620-449ba63a6977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9a43514b8d4c9ba725074185734bf7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:02.470948 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1870/3703] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:47:01 2022] DELETE /identity/v3/users/0d9a43514b8d4c9ba725074185734bf7 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:02.471871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b139d-957c-4ab3-b620-449ba63a6977 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:02.473540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ae1b139d-957c-4ab3-b620-449ba63a6977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:02.621047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b139d-957c-4ab3-b620-449ba63a6977 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:02.628582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6132d2be-8d99-4819-ad2e-06c6638ab2cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd683ccf6674e33a101d957f16e948e', 'request_id': 'req-6132d2be-8d99-4819-ad2e-06c6638ab2cf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:02.656607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6132d2be-8d99-4819-ad2e-06c6638ab2cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd683ccf6674e33a101d957f16e948e', 'request_id': 'req-6132d2be-8d99-4819-ad2e-06c6638ab2cf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:02.686379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6132d2be-8d99-4819-ad2e-06c6638ab2cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd683ccf6674e33a101d957f16e948e', 'request_id': 'req-6132d2be-8d99-4819-ad2e-06c6638ab2cf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:02.753428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ae962-4343-4694-b8d1-4d70c8aa652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:02.754355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ae962-4343-4694-b8d1-4d70c8aa652e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:02.754814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ae962-4343-4694-b8d1-4d70c8aa652e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:02.755259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ae962-4343-4694-b8d1-4d70c8aa652e admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:02.756083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ae962-4343-4694-b8d1-4d70c8aa652e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:02.757890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ae962-4343-4694-b8d1-4d70c8aa652e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:02.775921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6132d2be-8d99-4819-ad2e-06c6638ab2cf admin admin] The token cache is being invalidate because project afd683ccf6674e33a101d957f16e948e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:02.779199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6132d2be-8d99-4819-ad2e-06c6638ab2cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:02.779199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6132d2be-8d99-4819-ad2e-06c6638ab2cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:02.780549 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1834/3704] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:02 2022] DELETE /identity/v3/projects/afd683ccf6674e33a101d957f16e948e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:02.784751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132d2be-8d99-4819-ad2e-06c6638ab2cf admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:02.788129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6132d2be-8d99-4819-ad2e-06c6638ab2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:02.789590 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1871/3705] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:02.791306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9783554-6c8b-4600-9990-1e9d206f5a82 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:02.792565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9783554-6c8b-4600-9990-1e9d206f5a82 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:02.796039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9783554-6c8b-4600-9990-1e9d206f5a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:02.820465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132d2be-8d99-4819-ad2e-06c6638ab2cf admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:02.833038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bcbf3-5f7c-479a-90f6-eb4d1f0b87a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:02.835192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bcbf3-5f7c-479a-90f6-eb4d1f0b87a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:02.835790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bcbf3-5f7c-479a-90f6-eb4d1f0b87a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:02.839057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bcbf3-5f7c-479a-90f6-eb4d1f0b87a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:02.839878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600bcbf3-5f7c-479a-90f6-eb4d1f0b87a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:02.841783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600bcbf3-5f7c-479a-90f6-eb4d1f0b87a6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:02.844471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b9783554-6c8b-4600-9990-1e9d206f5a82 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:02.845885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b9783554-6c8b-4600-9990-1e9d206f5a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:02.864504 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1835/3706] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:02.869277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bcbf3-5f7c-479a-90f6-eb4d1f0b87a6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:02.870776 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1872/3707] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:02.878697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9783554-6c8b-4600-9990-1e9d206f5a82 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:02.882147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-600bcbf3-5f7c-479a-90f6-eb4d1f0b87a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:02.901386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bcbf3-5f7c-479a-90f6-eb4d1f0b87a6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:02.906571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e8bf8-f925-403f-9008-2295bfebf9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:02.907400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e8bf8-f925-403f-9008-2295bfebf9fe admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:02.907825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e8bf8-f925-403f-9008-2295bfebf9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:02.908285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e8bf8-f925-403f-9008-2295bfebf9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:02.909112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e8bf8-f925-403f-9008-2295bfebf9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:02.911040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e8bf8-f925-403f-9008-2295bfebf9fe admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:02.911927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9783554-6c8b-4600-9990-1e9d206f5a82 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:02.922438 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1836/3708] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:02.926642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0c7d4-f3d5-427f-812f-011a6a9ff53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:02.926787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757edcc2-fad9-4077-acff-00cbb8e20547 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:02.926787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757edcc2-fad9-4077-acff-00cbb8e20547 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:02.926787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757edcc2-fad9-4077-acff-00cbb8e20547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:02.927040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0c7d4-f3d5-427f-812f-011a6a9ff53f admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:02.927461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0c7d4-f3d5-427f-812f-011a6a9ff53f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:02.927835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0c7d4-f3d5-427f-812f-011a6a9ff53f admin admin] PATH_INFO: `/v3/projects/66d34cf0eea14f9d9722b2edb0921dc7/users/d61ae6d8848144879c684495014a0aad/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:02.967959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-757edcc2-fad9-4077-acff-00cbb8e20547 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:02.969432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0c7d4-f3d5-427f-812f-011a6a9ff53f admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d34cf0eea14f9d9722b2edb0921dc7, user_id=d61ae6d8848144879c684495014a0aad, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:02.969565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-757edcc2-fad9-4077-acff-00cbb8e20547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:02.973559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0c7d4-f3d5-427f-812f-011a6a9ff53f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:02.996427 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1837/3709] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:02.998556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757edcc2-fad9-4077-acff-00cbb8e20547 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:03.015011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757edcc2-fad9-4077-acff-00cbb8e20547 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:03.028120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321aee60-d869-4d48-98fd-64723649d930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:03.028828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321aee60-d869-4d48-98fd-64723649d930 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:03.029104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321aee60-d869-4d48-98fd-64723649d930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:03.031539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321aee60-d869-4d48-98fd-64723649d930 admin admin] PATH_INFO: `/v3/projects/9d030b9911da4ef8aa39dbf0fe1b744b/users/177c105f6d484e8abfeb9bc118a1260d/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:03.065996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321aee60-d869-4d48-98fd-64723649d930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d030b9911da4ef8aa39dbf0fe1b744b, user_id=177c105f6d484e8abfeb9bc118a1260d, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:03.069360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321aee60-d869-4d48-98fd-64723649d930 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:03.078544 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1873/3710] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:02 2022] PUT /identity/v3/projects/66d34cf0eea14f9d9722b2edb0921dc7/users/d61ae6d8848144879c684495014a0aad/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:03.079673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0c7d4-f3d5-427f-812f-011a6a9ff53f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:03.212985 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1838/3711] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:02 2022] PUT /identity/v3/projects/9d030b9911da4ef8aa39dbf0fe1b744b/users/177c105f6d484e8abfeb9bc118a1260d/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:03.214909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4613e6-cbf7-4a14-b7d8-eb1364712634 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:03.215201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4613e6-cbf7-4a14-b7d8-eb1364712634 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:03.215488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4613e6-cbf7-4a14-b7d8-eb1364712634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:03.245997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0c7d4-f3d5-427f-812f-011a6a9ff53f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:03.294486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8c4613e6-cbf7-4a14-b7d8-eb1364712634 None None] MFA Rules not processed for user `d61ae6d8848144879c684495014a0aad`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:03.295765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8c4613e6-cbf7-4a14-b7d8-eb1364712634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:03.384403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1e2b6-24fe-470e-b88b-86b366dfd176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:03.385664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1e2b6-24fe-470e-b88b-86b366dfd176 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:03.386049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1e2b6-24fe-470e-b88b-86b366dfd176 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:03.386572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1e2b6-24fe-470e-b88b-86b366dfd176 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:03.387336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1e2b6-24fe-470e-b88b-86b366dfd176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:03.387703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1e2b6-24fe-470e-b88b-86b366dfd176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:03.389391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1e2b6-24fe-470e-b88b-86b366dfd176 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:03.420748 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1874/3712] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:03.422125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428a75f-6f6c-416b-8c8e-bd74d38a21d4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:03.422466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428a75f-6f6c-416b-8c8e-bd74d38a21d4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:03.422811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428a75f-6f6c-416b-8c8e-bd74d38a21d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:03.458476 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1839/3713] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:03.464809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4613e6-cbf7-4a14-b7d8-eb1364712634 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:03.465801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f428a75f-6f6c-416b-8c8e-bd74d38a21d4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:03.467551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f428a75f-6f6c-416b-8c8e-bd74d38a21d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:03.478286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8c4613e6-cbf7-4a14-b7d8-eb1364712634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:03.488784 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1875/3714] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:03.489637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428a75f-6f6c-416b-8c8e-bd74d38a21d4 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:03.502511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:03.508577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4613e6-cbf7-4a14-b7d8-eb1364712634 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:03.514799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428a75f-6f6c-416b-8c8e-bd74d38a21d4 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:03.521682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ff21e-9070-46ee-b9c4-1af4089624f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:03.522184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:03.522313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ff21e-9070-46ee-b9c4-1af4089624f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:03.522548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ff21e-9070-46ee-b9c4-1af4089624f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:03.522821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ff21e-9070-46ee-b9c4-1af4089624f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:03.523224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:03.523463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ff21e-9070-46ee-b9c4-1af4089624f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:03.523709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:03.524090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a admin admin] PATH_INFO: `/v3/projects/e84bbf4628c144be8c336b08d9dc7482` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:03.525941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ff21e-9070-46ee-b9c4-1af4089624f3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:03.526293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84bbf4628c144be8c336b08d9dc7482)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:03.533119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:03.546308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:03.697557 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1876/3715] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:03 2022] POST /identity/v3/projects => generated 391 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:03.698162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ff21e-9070-46ee-b9c4-1af4089624f3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:03.816035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84bbf4628c144be8c336b08d9dc7482', 'request_id': 'req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:03.823647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84bbf4628c144be8c336b08d9dc7482', 'request_id': 'req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:03.833127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84bbf4628c144be8c336b08d9dc7482', 'request_id': 'req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:03.843919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ff21e-9070-46ee-b9c4-1af4089624f3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:03.921550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9ba4d-eb0e-4099-8bfa-2d32b8d77517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:03.922176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9ba4d-eb0e-4099-8bfa-2d32b8d77517 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:03.922447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9ba4d-eb0e-4099-8bfa-2d32b8d77517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:03.922870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9ba4d-eb0e-4099-8bfa-2d32b8d77517 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:03.923586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9ba4d-eb0e-4099-8bfa-2d32b8d77517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:03.925670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9ba4d-eb0e-4099-8bfa-2d32b8d77517 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:04.050200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a admin admin] The token cache is being invalidate because project e84bbf4628c144be8c336b08d9dc7482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:04.050938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:04.055608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:04.060750 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1840/3716] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:03 2022] DELETE /identity/v3/projects/e84bbf4628c144be8c336b08d9dc7482 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:04.060750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:04.060750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:04.104116 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1877/3717] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:03 2022] POST /identity/v3/projects => generated 367 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:04.104116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9ba4d-eb0e-4099-8bfa-2d32b8d77517 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:04.110873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e1d9ba4d-eb0e-4099-8bfa-2d32b8d77517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:04.225167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd27f1-3b21-4c99-8b4a-fa8e0300187a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:04.290010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9ba4d-eb0e-4099-8bfa-2d32b8d77517 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:04.305315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceeb7d2-cbc4-4cbf-b7df-e3caa317188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:04.306293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceeb7d2-cbc4-4cbf-b7df-e3caa317188d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.306987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceeb7d2-cbc4-4cbf-b7df-e3caa317188d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.307373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceeb7d2-cbc4-4cbf-b7df-e3caa317188d admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.308238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceeb7d2-cbc4-4cbf-b7df-e3caa317188d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:04.310969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceeb7d2-cbc4-4cbf-b7df-e3caa317188d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:04.336071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c80455-ad60-4e2d-a9f3-e18175673e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:04.336586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c80455-ad60-4e2d-a9f3-e18175673e87 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.337147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c80455-ad60-4e2d-a9f3-e18175673e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.337678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c80455-ad60-4e2d-a9f3-e18175673e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.341336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f9c80455-ad60-4e2d-a9f3-e18175673e87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:04.363932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c80455-ad60-4e2d-a9f3-e18175673e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:04.365639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c80455-ad60-4e2d-a9f3-e18175673e87 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:04.378044 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1841/3718] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:04.388965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fb139-315e-443c-877d-e01a0bab2444 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.388965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fb139-315e-443c-877d-e01a0bab2444 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.388965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fb139-315e-443c-877d-e01a0bab2444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.433297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-851fb139-315e-443c-877d-e01a0bab2444 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:04.434534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-851fb139-315e-443c-877d-e01a0bab2444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:04.443334 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1878/3719] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:04 2022] POST /identity/v3/users => generated 296 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:04.444499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceeb7d2-cbc4-4cbf-b7df-e3caa317188d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:04.445288 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1842/3720] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:04.445926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fb139-315e-443c-877d-e01a0bab2444 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:04.454821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7ceeb7d2-cbc4-4cbf-b7df-e3caa317188d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:04.458560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fb139-315e-443c-877d-e01a0bab2444 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:04.469176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceeb7d2-cbc4-4cbf-b7df-e3caa317188d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:04.470986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafe33d-00c4-4cca-a7b7-2afc8e2974ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:04.472398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafe33d-00c4-4cca-a7b7-2afc8e2974ee admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.473134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafe33d-00c4-4cca-a7b7-2afc8e2974ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.473661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafe33d-00c4-4cca-a7b7-2afc8e2974ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.474879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafe33d-00c4-4cca-a7b7-2afc8e2974ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:04.475687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522638ff-f59e-4af7-938a-ad6cb791a7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:04.476183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafe33d-00c4-4cca-a7b7-2afc8e2974ee admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:04.477514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522638ff-f59e-4af7-938a-ad6cb791a7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.478263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522638ff-f59e-4af7-938a-ad6cb791a7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.478263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522638ff-f59e-4af7-938a-ad6cb791a7f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.479093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522638ff-f59e-4af7-938a-ad6cb791a7f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:04.488438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522638ff-f59e-4af7-938a-ad6cb791a7f5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:04.490458 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1843/3721] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:04.492121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c6ba2-90c6-492a-b92b-2ce4a9d5f543 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.492386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c6ba2-90c6-492a-b92b-2ce4a9d5f543 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.492687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c6ba2-90c6-492a-b92b-2ce4a9d5f543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.516882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-be8c6ba2-90c6-492a-b92b-2ce4a9d5f543 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:04.518109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-be8c6ba2-90c6-492a-b92b-2ce4a9d5f543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:04.534188 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1844/3722] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:04.535802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c6ba2-90c6-492a-b92b-2ce4a9d5f543 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:04.549685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c6ba2-90c6-492a-b92b-2ce4a9d5f543 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:04.556005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079f648-e8a8-49df-9fed-e88cc397677c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:04.556995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079f648-e8a8-49df-9fed-e88cc397677c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.557541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079f648-e8a8-49df-9fed-e88cc397677c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.558066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079f648-e8a8-49df-9fed-e88cc397677c admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.558985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079f648-e8a8-49df-9fed-e88cc397677c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:04.561292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079f648-e8a8-49df-9fed-e88cc397677c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:04.575030 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1845/3723] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:04.576372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079f648-e8a8-49df-9fed-e88cc397677c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:04.599436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079f648-e8a8-49df-9fed-e88cc397677c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:04.616358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295793c-ae89-4952-8de7-87a947cacdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:04.617281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295793c-ae89-4952-8de7-87a947cacdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.617697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295793c-ae89-4952-8de7-87a947cacdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.618196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295793c-ae89-4952-8de7-87a947cacdf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.619428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295793c-ae89-4952-8de7-87a947cacdf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:04.623440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295793c-ae89-4952-8de7-87a947cacdf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:04.625421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295793c-ae89-4952-8de7-87a947cacdf4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:04.645355 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1846/3724] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:04.646970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295793c-ae89-4952-8de7-87a947cacdf4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:04.670983 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1879/3725] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:04 2022] POST /identity/v3/users => generated 290 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:04.728482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295793c-ae89-4952-8de7-87a947cacdf4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:04.728589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522638ff-f59e-4af7-938a-ad6cb791a7f5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:04.728674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cb6f3-9e3d-4c3a-b2e6-ca8200da6ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:04.728794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522638ff-f59e-4af7-938a-ad6cb791a7f5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:04.728878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cb6f3-9e3d-4c3a-b2e6-ca8200da6ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.728878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cb6f3-9e3d-4c3a-b2e6-ca8200da6ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.728878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cb6f3-9e3d-4c3a-b2e6-ca8200da6ac3 admin admin] PATH_INFO: `/v3/projects/594434f66502439bb7de37a9097943fb/users/5dd6f28443ba41e1923d26a4e67b51aa/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.729157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42bdea-750e-4510-8b19-f725691dbb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:04.729157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42bdea-750e-4510-8b19-f725691dbb9f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.729157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42bdea-750e-4510-8b19-f725691dbb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.729157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42bdea-750e-4510-8b19-f725691dbb9f admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.729452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42bdea-750e-4510-8b19-f725691dbb9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:04.729452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42bdea-750e-4510-8b19-f725691dbb9f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:04.729606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cb6f3-9e3d-4c3a-b2e6-ca8200da6ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=594434f66502439bb7de37a9097943fb, user_id=5dd6f28443ba41e1923d26a4e67b51aa, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:04.729606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cb6f3-9e3d-4c3a-b2e6-ca8200da6ac3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:04.843429 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1880/3726] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:04 2022] POST /identity/v3/projects => generated 395 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:04.843429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42bdea-750e-4510-8b19-f725691dbb9f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:04.845799 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1847/3727] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:04 2022] PUT /identity/v3/projects/594434f66502439bb7de37a9097943fb/users/5dd6f28443ba41e1923d26a4e67b51aa/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:04.846937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cb6f3-9e3d-4c3a-b2e6-ca8200da6ac3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:04.922005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42bdea-750e-4510-8b19-f725691dbb9f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:04.928229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611f0bb-58dc-4bfd-b3b4-485b353593dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:04.928862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611f0bb-58dc-4bfd-b3b4-485b353593dc admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.929143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611f0bb-58dc-4bfd-b3b4-485b353593dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.929416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611f0bb-58dc-4bfd-b3b4-485b353593dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.930061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611f0bb-58dc-4bfd-b3b4-485b353593dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:04.931723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611f0bb-58dc-4bfd-b3b4-485b353593dc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:04.946594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cb6f3-9e3d-4c3a-b2e6-ca8200da6ac3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:04.955971 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1881/3728] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:04.959254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbc07c-4a24-4c14-a850-160f24d93a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:04.963512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbc07c-4a24-4c14-a850-160f24d93a98 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.963512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbc07c-4a24-4c14-a850-160f24d93a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.963512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbc07c-4a24-4c14-a850-160f24d93a98 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.963512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbc07c-4a24-4c14-a850-160f24d93a98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:04.964640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbc07c-4a24-4c14-a850-160f24d93a98 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:04.967490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bb1fb-6d01-43b3-bb55-fdcadfde3c7f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:04.967592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bb1fb-6d01-43b3-bb55-fdcadfde3c7f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:04.967804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bb1fb-6d01-43b3-bb55-fdcadfde3c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:04.996348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d09bb1fb-6d01-43b3-bb55-fdcadfde3c7f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:04.997980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d09bb1fb-6d01-43b3-bb55-fdcadfde3c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:05.013639 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1882/3729] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:05.013639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bb1fb-6d01-43b3-bb55-fdcadfde3c7f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:05.024707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bb1fb-6d01-43b3-bb55-fdcadfde3c7f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:05.031573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd0daa-600d-4bde-8a68-302f9e0eeecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:05.032482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0daa-600d-4bde-8a68-302f9e0eeecc admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:05.032908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0daa-600d-4bde-8a68-302f9e0eeecc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:05.033649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0daa-600d-4bde-8a68-302f9e0eeecc admin admin] PATH_INFO: `/v3/projects/f7de3ceb5e10469ca82109d18a06127f/users/3e88b7e1e1e544fd92b9b8a084eee0aa/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:05.055400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd0daa-600d-4bde-8a68-302f9e0eeecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7de3ceb5e10469ca82109d18a06127f, user_id=3e88b7e1e1e544fd92b9b8a084eee0aa, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:05.058870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd0daa-600d-4bde-8a68-302f9e0eeecc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:05.061211 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1848/3730] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:04 2022] POST /identity/v3/users => generated 298 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:05.062343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbc07c-4a24-4c14-a850-160f24d93a98 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:05.140030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbc07c-4a24-4c14-a850-160f24d93a98 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:05.145235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a0ff1-0ef9-46cc-bead-8fee9b3d34bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:05.146013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a0ff1-0ef9-46cc-bead-8fee9b3d34bd service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:05.146392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a0ff1-0ef9-46cc-bead-8fee9b3d34bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:05.146758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a0ff1-0ef9-46cc-bead-8fee9b3d34bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:05.159150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a0ff1-0ef9-46cc-bead-8fee9b3d34bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:05.161677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a0ff1-0ef9-46cc-bead-8fee9b3d34bd service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:05.176781 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1849/3731] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:05.178221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a0ff1-0ef9-46cc-bead-8fee9b3d34bd service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:05.194647 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1883/3732] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:05 2022] PUT /identity/v3/projects/f7de3ceb5e10469ca82109d18a06127f/users/3e88b7e1e1e544fd92b9b8a084eee0aa/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:05.198590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd0daa-600d-4bde-8a68-302f9e0eeecc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:05.210780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a0ff1-0ef9-46cc-bead-8fee9b3d34bd service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:05.322486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd0daa-600d-4bde-8a68-302f9e0eeecc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:05.334636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930eaa9-f025-4c9c-8589-c2eb09ecc067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:05.336132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930eaa9-f025-4c9c-8589-c2eb09ecc067 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:05.336642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c66b75-cac4-412b-b6bd-f9cc9ec0f787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:05.336842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930eaa9-f025-4c9c-8589-c2eb09ecc067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:05.337280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c66b75-cac4-412b-b6bd-f9cc9ec0f787 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:05.337388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930eaa9-f025-4c9c-8589-c2eb09ecc067 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:05.337558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c66b75-cac4-412b-b6bd-f9cc9ec0f787 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:05.337840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c66b75-cac4-412b-b6bd-f9cc9ec0f787 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:05.338504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c66b75-cac4-412b-b6bd-f9cc9ec0f787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:05.339071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930eaa9-f025-4c9c-8589-c2eb09ecc067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:05.340137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c66b75-cac4-412b-b6bd-f9cc9ec0f787 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:05.341810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930eaa9-f025-4c9c-8589-c2eb09ecc067 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:05.356210 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1850/3733] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:05.359380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930eaa9-f025-4c9c-8589-c2eb09ecc067 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:05.370073 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1884/3734] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:05.371082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c66b75-cac4-412b-b6bd-f9cc9ec0f787 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:05.377940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930eaa9-f025-4c9c-8589-c2eb09ecc067 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:05.382003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d58e4-d793-488b-b325-9d7f0b4f37f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:05.382806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d58e4-d793-488b-b325-9d7f0b4f37f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:05.383309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d58e4-d793-488b-b325-9d7f0b4f37f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:05.383725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d58e4-d793-488b-b325-9d7f0b4f37f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:05.384096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c66b75-cac4-412b-b6bd-f9cc9ec0f787 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:05.384806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d58e4-d793-488b-b325-9d7f0b4f37f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:05.386883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d58e4-d793-488b-b325-9d7f0b4f37f0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:05.389367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568a77d-2f15-4bcc-9f6d-bf0df55938c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:05.390116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568a77d-2f15-4bcc-9f6d-bf0df55938c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:05.390401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568a77d-2f15-4bcc-9f6d-bf0df55938c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:05.390684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568a77d-2f15-4bcc-9f6d-bf0df55938c8 admin admin] PATH_INFO: `/v3/projects/f7de3ceb5e10469ca82109d18a06127f/users/3e88b7e1e1e544fd92b9b8a084eee0aa/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:05.394495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568a77d-2f15-4bcc-9f6d-bf0df55938c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7de3ceb5e10469ca82109d18a06127f, user_id=3e88b7e1e1e544fd92b9b8a084eee0aa, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:05.397414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568a77d-2f15-4bcc-9f6d-bf0df55938c8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:05.414879 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1851/3736] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:47:05.415999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d58e4-d793-488b-b325-9d7f0b4f37f0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:05.419566 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1885/3736] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:05 2022] PUT /identity/v3/projects/f7de3ceb5e10469ca82109d18a06127f/users/3e88b7e1e1e544fd92b9b8a084eee0aa/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:05.422346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a7086-a537-4a6c-835d-4e867a643d7c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:05.422346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a7086-a537-4a6c-835d-4e867a643d7c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:05.422346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a7086-a537-4a6c-835d-4e867a643d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:05.433901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d58e4-d793-488b-b325-9d7f0b4f37f0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:05.459074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a50a7086-a537-4a6c-835d-4e867a643d7c None None] MFA Rules not processed for user `3e88b7e1e1e544fd92b9b8a084eee0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:05.460825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a50a7086-a537-4a6c-835d-4e867a643d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:05.532748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:05.544086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e55f2-4e5a-4bf1-b82c-272f2e4d0874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:05.545039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e55f2-4e5a-4bf1-b82c-272f2e4d0874 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:05.545469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e55f2-4e5a-4bf1-b82c-272f2e4d0874 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:05.545883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e55f2-4e5a-4bf1-b82c-272f2e4d0874 admin admin] PATH_INFO: `/v3/projects/1ed4a584a4494dac8db442e3f7d4504c/users/800659cebb0445b48f1abb0fa51ca4ec/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:05.565301 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1886/3737] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:05.566247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a7086-a537-4a6c-835d-4e867a643d7c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:05.567560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e55f2-4e5a-4bf1-b82c-272f2e4d0874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed4a584a4494dac8db442e3f7d4504c, user_id=800659cebb0445b48f1abb0fa51ca4ec, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:05.571393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e55f2-4e5a-4bf1-b82c-272f2e4d0874 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:05.577919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a7086-a537-4a6c-835d-4e867a643d7c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:05.584550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bf9f4-67f5-475d-ac0f-8f012a68c052 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e88b7e1e1e544fd92b9b8a084eee0aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7de3ceb5e10469ca82109d18a06127f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:05.585280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bf9f4-67f5-475d-ac0f-8f012a68c052 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:05.585694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bf9f4-67f5-475d-ac0f-8f012a68c052 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:05.586702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bf9f4-67f5-475d-ac0f-8f012a68c052 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:05.586864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bf9f4-67f5-475d-ac0f-8f012a68c052 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:05.587991 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-b03bf9f4-67f5-475d-ac0f-8f012a68c052 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:47:05.587991 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:47:05.587991 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:47:05.589221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bf9f4-67f5-475d-ac0f-8f012a68c052 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:05.700683 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1852/3738] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:05 2022] PUT /identity/v3/projects/1ed4a584a4494dac8db442e3f7d4504c/users/800659cebb0445b48f1abb0fa51ca4ec/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:05.713024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6fe09-0a5f-454e-97a2-7d763d85fee2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:05.713386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6fe09-0a5f-454e-97a2-7d763d85fee2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:05.713730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6fe09-0a5f-454e-97a2-7d763d85fee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:05.723592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:05.746088 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1887/3739] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:47:05 2022] POST /identity/v3/services => generated 239 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:05.748097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bf9f4-67f5-475d-ac0f-8f012a68c052 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:05.792721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-19d6fe09-0a5f-454e-97a2-7d763d85fee2 None None] MFA Rules not processed for user `800659cebb0445b48f1abb0fa51ca4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:05.794788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-19d6fe09-0a5f-454e-97a2-7d763d85fee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:05.795785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bf9f4-67f5-475d-ac0f-8f012a68c052 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:05.871218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514ebbd-c02f-4327-a2f1-d91a159ed716 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e88b7e1e1e544fd92b9b8a084eee0aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7de3ceb5e10469ca82109d18a06127f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:05.872552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514ebbd-c02f-4327-a2f1-d91a159ed716 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:05.873084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514ebbd-c02f-4327-a2f1-d91a159ed716 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:05.873584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514ebbd-c02f-4327-a2f1-d91a159ed716 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] PATH_INFO: `/v3/services/457a51c3b42b4621b157ff1994fce70c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:05.874428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514ebbd-c02f-4327-a2f1-d91a159ed716 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorizing `identity:delete_service(service_id=457a51c3b42b4621b157ff1994fce70c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:05.875809 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-c514ebbd-c02f-4327-a2f1-d91a159ed716 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:47:05.875809 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:47:05.875809 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:47:05.877233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514ebbd-c02f-4327-a2f1-d91a159ed716 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:05.929111 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1853/3740] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:05 2022] POST /identity/v3/auth/tokens => generated 3404 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:05.939593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52f0a5-58e1-414b-ae73-9e8e6c3137c7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:05.940020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52f0a5-58e1-414b-ae73-9e8e6c3137c7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:05.940447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52f0a5-58e1-414b-ae73-9e8e6c3137c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:05.974260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4d52f0a5-58e1-414b-ae73-9e8e6c3137c7 None None] MFA Rules not processed for user `800659cebb0445b48f1abb0fa51ca4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:05.975574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4d52f0a5-58e1-414b-ae73-9e8e6c3137c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:05.988230 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1854/3741] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:05 2022] POST /identity/v3/auth/tokens => generated 3404 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:06.000543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52f0a5-58e1-414b-ae73-9e8e6c3137c7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.007846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4d52f0a5-58e1-414b-ae73-9e8e6c3137c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:06.138253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52f0a5-58e1-414b-ae73-9e8e6c3137c7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.144803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88857bc0-8beb-41e8-a76d-4b6a39e259e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.145421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88857bc0-8beb-41e8-a76d-4b6a39e259e0 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.145703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88857bc0-8beb-41e8-a76d-4b6a39e259e0 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.145976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88857bc0-8beb-41e8-a76d-4b6a39e259e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.158626 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1888/3742] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:05 2022] DELETE /identity/v3/services/457a51c3b42b4621b157ff1994fce70c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:06.164287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514ebbd-c02f-4327-a2f1-d91a159ed716 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.172769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88857bc0-8beb-41e8-a76d-4b6a39e259e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.176010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88857bc0-8beb-41e8-a76d-4b6a39e259e0 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.189716 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1855/3743] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:05 2022] GET /identity/v3/auth/tokens => generated 3404 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:06.197338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514ebbd-c02f-4327-a2f1-d91a159ed716 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.201083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426d2ec-9135-4d40-86b0-86d3e5221eda tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e88b7e1e1e544fd92b9b8a084eee0aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7de3ceb5e10469ca82109d18a06127f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.206776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426d2ec-9135-4d40-86b0-86d3e5221eda tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.206776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426d2ec-9135-4d40-86b0-86d3e5221eda tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.206776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426d2ec-9135-4d40-86b0-86d3e5221eda tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.207529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426d2ec-9135-4d40-86b0-86d3e5221eda tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.209742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426d2ec-9135-4d40-86b0-86d3e5221eda tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.218739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39e017-9f61-4810-8575-5211c1f8746a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.219017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39e017-9f61-4810-8575-5211c1f8746a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.219491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39e017-9f61-4810-8575-5211c1f8746a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.241837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7c39e017-9f61-4810-8575-5211c1f8746a None None] MFA Rules not processed for user `800659cebb0445b48f1abb0fa51ca4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:06.243267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7c39e017-9f61-4810-8575-5211c1f8746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:06.311636 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1889/3744] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:06 2022] POST /identity/v3/services => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:06.311992 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1856/3745] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:06 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:06.318929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426d2ec-9135-4d40-86b0-86d3e5221eda tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.418075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426d2ec-9135-4d40-86b0-86d3e5221eda tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.439782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcefeb-0721-489d-ab7e-db26ae25bd4e tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e88b7e1e1e544fd92b9b8a084eee0aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7de3ceb5e10469ca82109d18a06127f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.441064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcefeb-0721-489d-ab7e-db26ae25bd4e tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.447064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcefeb-0721-489d-ab7e-db26ae25bd4e tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.447352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea5225-b34e-4cd9-93a5-561ec6615c9f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.447352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea5225-b34e-4cd9-93a5-561ec6615c9f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.447352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea5225-b34e-4cd9-93a5-561ec6615c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.456622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcefeb-0721-489d-ab7e-db26ae25bd4e tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] PATH_INFO: `/v3/services/3dda580a4a154c4d8bc2f6e181b585a5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.457640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcefeb-0721-489d-ab7e-db26ae25bd4e tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorizing `identity:update_service(service_id=3dda580a4a154c4d8bc2f6e181b585a5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.469396 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-8bbcefeb-0721-489d-ab7e-db26ae25bd4e tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:47:06.469396 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:47:06.469396 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:47:06.470326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcefeb-0721-489d-ab7e-db26ae25bd4e tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.511124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-61ea5225-b34e-4cd9-93a5-561ec6615c9f None None] MFA Rules not processed for user `800659cebb0445b48f1abb0fa51ca4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:06.512289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-61ea5225-b34e-4cd9-93a5-561ec6615c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:06.596287 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1857/3746] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:06 2022] POST /identity/v3/auth/tokens => generated 3406 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:06.629867 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1890/3747] 10.222.0.76 () {60 vars in 1252 bytes} [Sat Aug 27 04:47:06 2022] PATCH /identity/v3/services/3dda580a4a154c4d8bc2f6e181b585a5 => generated 284 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:06.632426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea5225-b34e-4cd9-93a5-561ec6615c9f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.652556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea5225-b34e-4cd9-93a5-561ec6615c9f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.659758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58dfd3-a081-4556-9350-9466876b01f4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.660298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58dfd3-a081-4556-9350-9466876b01f4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.660743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58dfd3-a081-4556-9350-9466876b01f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.720622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058fe63-8550-4555-ac71-ef4e0fba9803 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e88b7e1e1e544fd92b9b8a084eee0aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7de3ceb5e10469ca82109d18a06127f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.723701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3c58dfd3-a081-4556-9350-9466876b01f4 None None] MFA Rules not processed for user `800659cebb0445b48f1abb0fa51ca4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:06.724553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058fe63-8550-4555-ac71-ef4e0fba9803 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.725568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058fe63-8550-4555-ac71-ef4e0fba9803 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.727084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058fe63-8550-4555-ac71-ef4e0fba9803 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] PATH_INFO: `/v3/services/3dda580a4a154c4d8bc2f6e181b585a5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.728263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3c58dfd3-a081-4556-9350-9466876b01f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:06.728943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058fe63-8550-4555-ac71-ef4e0fba9803 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorizing `identity:get_service(service_id=3dda580a4a154c4d8bc2f6e181b585a5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.731573 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-c058fe63-8550-4555-ac71-ef4e0fba9803 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:47:06.731573 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:47:06.731573 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:47:06.734342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058fe63-8550-4555-ac71-ef4e0fba9803 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.769185 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1858/3748] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:47:06 2022] GET /identity/v3/services/3dda580a4a154c4d8bc2f6e181b585a5 => generated 284 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:06.769185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058fe63-8550-4555-ac71-ef4e0fba9803 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:06.798486 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1891/3749] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:06 2022] POST /identity/v3/auth/tokens => generated 3406 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:06.809593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058fe63-8550-4555-ac71-ef4e0fba9803 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:06.835602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d952926-cd1c-4520-ad09-1319687b6c9d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.835602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d952926-cd1c-4520-ad09-1319687b6c9d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.835602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d952926-cd1c-4520-ad09-1319687b6c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.838030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbae1a-e327-47e4-9327-1dd0a8ed7b64 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e88b7e1e1e544fd92b9b8a084eee0aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7de3ceb5e10469ca82109d18a06127f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:06.838030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbae1a-e327-47e4-9327-1dd0a8ed7b64 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:06.838030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbae1a-e327-47e4-9327-1dd0a8ed7b64 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:06.838322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbae1a-e327-47e4-9327-1dd0a8ed7b64 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] PATH_INFO: `/v3/services/3dda580a4a154c4d8bc2f6e181b585a5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:06.838322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbae1a-e327-47e4-9327-1dd0a8ed7b64 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3dda580a4a154c4d8bc2f6e181b585a5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:06.842057 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-b0dbae1a-e327-47e4-9327-1dd0a8ed7b64 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:47:06.842057 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:47:06.842057 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:47:06.844636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbae1a-e327-47e4-9327-1dd0a8ed7b64 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:06.865590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2d952926-cd1c-4520-ad09-1319687b6c9d None None] MFA Rules not processed for user `800659cebb0445b48f1abb0fa51ca4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:06.867084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2d952926-cd1c-4520-ad09-1319687b6c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:06.877468 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1892/3750] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:06 2022] POST /identity/v3/auth/tokens => generated 3406 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:06.913905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d952926-cd1c-4520-ad09-1319687b6c9d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:07.013628 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1859/3751] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:06 2022] DELETE /identity/v3/services/3dda580a4a154c4d8bc2f6e181b585a5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:07.016506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbae1a-e327-47e4-9327-1dd0a8ed7b64 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:07.094673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbae1a-e327-47e4-9327-1dd0a8ed7b64 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:07.112670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b718d-323e-4186-908e-56f54a817816 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e88b7e1e1e544fd92b9b8a084eee0aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7de3ceb5e10469ca82109d18a06127f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:07.117826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b718d-323e-4186-908e-56f54a817816 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:07.118548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b718d-323e-4186-908e-56f54a817816 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:07.118649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b718d-323e-4186-908e-56f54a817816 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] PATH_INFO: `/v3/services/3dda580a4a154c4d8bc2f6e181b585a5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:07.129209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b718d-323e-4186-908e-56f54a817816 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorizing `identity:get_service(service_id=3dda580a4a154c4d8bc2f6e181b585a5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:07.134732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b718d-323e-4186-908e-56f54a817816 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:07.163197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d952926-cd1c-4520-ad09-1319687b6c9d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:07.166762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-893b718d-323e-4186-908e-56f54a817816 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Could not find service: 3dda580a4a154c4d8bc2f6e181b585a5.: keystone.exception.ServiceNotFound: Could not find service: 3dda580a4a154c4d8bc2f6e181b585a5. Aug 27 04:47:07.166762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:47:07.166762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 04:47:07.166762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 04:47:07.166762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 04:47:07.166762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 04:47:07.166762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 04:47:07.166762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:47:07.166762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 3dda580a4a154c4d8bc2f6e181b585a5. Aug 27 04:47:07.166762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:47:07.166762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:47:07.166762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:47:07.166762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:47:07.166762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:47:07.166762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:47:07.166762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:47:07.168032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:47:07.168032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:47:07.168032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:47:07.168032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:47:07.168032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:47:07.168032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:47:07.168032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:47:07.168032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 04:47:07.168032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 04:47:07.168032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 04:47:07.168032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 04:47:07.168032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:47:07.168032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:47:07.168032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:47:07.168032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:47:07.168032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:47:07.168032 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:47:07.169184 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:47:07.169184 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:47:07.169184 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:47:07.169184 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:47:07.169184 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:47:07.169184 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:47:07.169184 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:47:07.169184 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:47:07.169184 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:47:07.169184 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:47:07.169184 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 04:47:07.169184 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 04:47:07.169184 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 3dda580a4a154c4d8bc2f6e181b585a5. Aug 27 04:47:07.169184 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:47:07.180705 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1860/3752] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:47:07 2022] GET /identity/v3/services/3dda580a4a154c4d8bc2f6e181b585a5 => generated 113 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:47:07.181924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b718d-323e-4186-908e-56f54a817816 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:07.205854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:07.217714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b718d-323e-4186-908e-56f54a817816 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:07.231650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5253890-3159-437c-adc9-ad5839db6d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:07.232331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5253890-3159-437c-adc9-ad5839db6d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:07.232607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5253890-3159-437c-adc9-ad5839db6d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:07.232880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5253890-3159-437c-adc9-ad5839db6d2f admin admin] PATH_INFO: `/v3/users/800659cebb0445b48f1abb0fa51ca4ec` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:07.234504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a427a-3cc5-436a-9490-9f8f153c3ca7 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e88b7e1e1e544fd92b9b8a084eee0aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7de3ceb5e10469ca82109d18a06127f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:07.235111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a427a-3cc5-436a-9490-9f8f153c3ca7 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:07.235386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a427a-3cc5-436a-9490-9f8f153c3ca7 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:07.235654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a427a-3cc5-436a-9490-9f8f153c3ca7 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:07.236469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5253890-3159-437c-adc9-ad5839db6d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=800659cebb0445b48f1abb0fa51ca4ec)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:07.237923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a427a-3cc5-436a-9490-9f8f153c3ca7 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:07.240059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5253890-3159-437c-adc9-ad5839db6d2f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:07.241358 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-f59a427a-3cc5-436a-9490-9f8f153c3ca7 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:47:07.241358 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:47:07.241358 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:47:07.244857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a427a-3cc5-436a-9490-9f8f153c3ca7 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:07.318069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:07.420361 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1861/3753] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:07 2022] POST /identity/v3/services => generated 275 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:07.424005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a427a-3cc5-436a-9490-9f8f153c3ca7 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:07.457365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a427a-3cc5-436a-9490-9f8f153c3ca7 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:07.466878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a404af-7d9e-4a46-bfc6-691d133ff993 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:07.467837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a404af-7d9e-4a46-bfc6-691d133ff993 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:07.468627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a404af-7d9e-4a46-bfc6-691d133ff993 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:07.469051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a404af-7d9e-4a46-bfc6-691d133ff993 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:07.472310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-96a404af-7d9e-4a46-bfc6-691d133ff993 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:07.554398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d5253890-3159-437c-adc9-ad5839db6d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800659cebb0445b48f1abb0fa51ca4ec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:07.555883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d5253890-3159-437c-adc9-ad5839db6d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800659cebb0445b48f1abb0fa51ca4ec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:07.559692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a404af-7d9e-4a46-bfc6-691d133ff993 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:07.562995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a404af-7d9e-4a46-bfc6-691d133ff993 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:07.592919 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1862/3754] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:07 2022] GET /identity/v3/auth/tokens => generated 3489 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:07.593821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a404af-7d9e-4a46-bfc6-691d133ff993 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:07.625575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a404af-7d9e-4a46-bfc6-691d133ff993 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:07.630627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2b065-3dd4-4ede-8b9c-a9cdf10b9f02 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e88b7e1e1e544fd92b9b8a084eee0aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7de3ceb5e10469ca82109d18a06127f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:07.631401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2b065-3dd4-4ede-8b9c-a9cdf10b9f02 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:07.634007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2b065-3dd4-4ede-8b9c-a9cdf10b9f02 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:07.634537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2b065-3dd4-4ede-8b9c-a9cdf10b9f02 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:07.635867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2b065-3dd4-4ede-8b9c-a9cdf10b9f02 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:07.640309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2b065-3dd4-4ede-8b9c-a9cdf10b9f02 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:07.654134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d5253890-3159-437c-adc9-ad5839db6d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800659cebb0445b48f1abb0fa51ca4ec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:07.654754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d5253890-3159-437c-adc9-ad5839db6d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800659cebb0445b48f1abb0fa51ca4ec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:07.675408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d5253890-3159-437c-adc9-ad5839db6d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800659cebb0445b48f1abb0fa51ca4ec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:07.697649 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1893/3755] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:47:06 2022] DELETE /identity/v3/users/800659cebb0445b48f1abb0fa51ca4ec => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:07.702698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b1675-ec16-404b-a180-74e6dd83990f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:07.703378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b1675-ec16-404b-a180-74e6dd83990f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:07.703879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b1675-ec16-404b-a180-74e6dd83990f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:07.733386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-522b1675-ec16-404b-a180-74e6dd83990f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:07.734779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-522b1675-ec16-404b-a180-74e6dd83990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:07.817944 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1863/3756] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:07 2022] POST /identity/v3/services => generated 274 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:07.821989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2b065-3dd4-4ede-8b9c-a9cdf10b9f02 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:07.827950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5fa2b065-3dd4-4ede-8b9c-a9cdf10b9f02 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:07.853400 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1894/3757] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:07 2022] POST /identity/v3/auth/tokens => generated 3574 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:07.862805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b1675-ec16-404b-a180-74e6dd83990f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:07.865053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-522b1675-ec16-404b-a180-74e6dd83990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:07.883393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2b065-3dd4-4ede-8b9c-a9cdf10b9f02 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:08.020296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81454b2-478d-4e56-bd21-708a2e724f8d tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e88b7e1e1e544fd92b9b8a084eee0aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7de3ceb5e10469ca82109d18a06127f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:08.020917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81454b2-478d-4e56-bd21-708a2e724f8d tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:08.021206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81454b2-478d-4e56-bd21-708a2e724f8d tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:08.021486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81454b2-478d-4e56-bd21-708a2e724f8d tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:08.022189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81454b2-478d-4e56-bd21-708a2e724f8d tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:08.023801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81454b2-478d-4e56-bd21-708a2e724f8d tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:08.037776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b1675-ec16-404b-a180-74e6dd83990f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:08.041759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd732b57-bf00-41be-b4fc-4fdc4101e758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:08.042354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd732b57-bf00-41be-b4fc-4fdc4101e758 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:08.042704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd732b57-bf00-41be-b4fc-4fdc4101e758 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:08.042987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd732b57-bf00-41be-b4fc-4fdc4101e758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:08.058498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd732b57-bf00-41be-b4fc-4fdc4101e758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:08.060399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd732b57-bf00-41be-b4fc-4fdc4101e758 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:08.076915 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1895/3758] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:07 2022] GET /identity/v3/auth/tokens => generated 3574 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:47:08.078078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd732b57-bf00-41be-b4fc-4fdc4101e758 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:08.079883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cd732b57-bf00-41be-b4fc-4fdc4101e758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:08.105786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd732b57-bf00-41be-b4fc-4fdc4101e758 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:08.125303 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1864/3759] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:07 2022] POST /identity/v3/services => generated 273 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:47:08.125924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b4120-eca0-419b-8573-226d1fe06169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:08.126844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81454b2-478d-4e56-bd21-708a2e724f8d tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:08.134569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b4120-eca0-419b-8573-226d1fe06169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:08.134861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b4120-eca0-419b-8573-226d1fe06169 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:08.136480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b4120-eca0-419b-8573-226d1fe06169 admin admin] PATH_INFO: `/v3/users/e30f8cfc3aca4b0eb27d413cc8e032f2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:08.141016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b4120-eca0-419b-8573-226d1fe06169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e30f8cfc3aca4b0eb27d413cc8e032f2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:08.148468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b4120-eca0-419b-8573-226d1fe06169 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:08.192213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81454b2-478d-4e56-bd21-708a2e724f8d tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:08.199600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e41c6-5759-4e8c-96e7-38e82e59ef39 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e88b7e1e1e544fd92b9b8a084eee0aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7de3ceb5e10469ca82109d18a06127f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:08.201193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e41c6-5759-4e8c-96e7-38e82e59ef39 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:08.201523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e41c6-5759-4e8c-96e7-38e82e59ef39 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:08.202223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e41c6-5759-4e8c-96e7-38e82e59ef39 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:08.203090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e41c6-5759-4e8c-96e7-38e82e59ef39 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:08.204444 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-1c1e41c6-5759-4e8c-96e7-38e82e59ef39 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:47:08.204444 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:47:08.204444 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:47:08.207878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e41c6-5759-4e8c-96e7-38e82e59ef39 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:08.221990 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1865/3760] 10.222.0.76 () {58 vars in 1131 bytes} [Sat Aug 27 04:47:08 2022] GET /identity/v3/services => generated 2977 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:47:08.226391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e41c6-5759-4e8c-96e7-38e82e59ef39 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:08.248309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e41c6-5759-4e8c-96e7-38e82e59ef39 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:08.257031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725aaac1-962e-4d52-bb0a-c698d3fd4601 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e88b7e1e1e544fd92b9b8a084eee0aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7de3ceb5e10469ca82109d18a06127f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:08.258010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725aaac1-962e-4d52-bb0a-c698d3fd4601 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:08.258515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725aaac1-962e-4d52-bb0a-c698d3fd4601 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:08.259360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725aaac1-962e-4d52-bb0a-c698d3fd4601 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:08.260494 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725aaac1-962e-4d52-bb0a-c698d3fd4601 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1468577265) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:08.261113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725aaac1-962e-4d52-bb0a-c698d3fd4601 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:08.263185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725aaac1-962e-4d52-bb0a-c698d3fd4601 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:08.279822 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1866/3761] 10.222.0.76 () {58 vars in 1222 bytes} [Sat Aug 27 04:47:08 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1468577265 => generated 418 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:08.288613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725aaac1-962e-4d52-bb0a-c698d3fd4601 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:08.304252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725aaac1-962e-4d52-bb0a-c698d3fd4601 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:08.312635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e4cf5-526d-4780-9bd6-e36d87d58d91 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e88b7e1e1e544fd92b9b8a084eee0aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7de3ceb5e10469ca82109d18a06127f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:08.313377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e4cf5-526d-4780-9bd6-e36d87d58d91 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:08.313739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e4cf5-526d-4780-9bd6-e36d87d58d91 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:08.314094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e4cf5-526d-4780-9bd6-e36d87d58d91 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:08.315548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e4cf5-526d-4780-9bd6-e36d87d58d91 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1181707607) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:08.317024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e4cf5-526d-4780-9bd6-e36d87d58d91 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:08.319885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e4cf5-526d-4780-9bd6-e36d87d58d91 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:08.327356 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1867/3762] 10.222.0.76 () {58 vars in 1222 bytes} [Sat Aug 27 04:47:08 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1181707607 => generated 417 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:08.333254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e4cf5-526d-4780-9bd6-e36d87d58d91 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:08.349887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e4cf5-526d-4780-9bd6-e36d87d58d91 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:08.360779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db2c6a-5315-47b3-86f2-96dae172c7e6 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e88b7e1e1e544fd92b9b8a084eee0aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7de3ceb5e10469ca82109d18a06127f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:08.361435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db2c6a-5315-47b3-86f2-96dae172c7e6 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:08.361721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db2c6a-5315-47b3-86f2-96dae172c7e6 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:08.362168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db2c6a-5315-47b3-86f2-96dae172c7e6 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:08.364832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db2c6a-5315-47b3-86f2-96dae172c7e6 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-350052021) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:08.366866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db2c6a-5315-47b3-86f2-96dae172c7e6 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:08.368517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db2c6a-5315-47b3-86f2-96dae172c7e6 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:08.390764 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1868/3763] 10.222.0.76 () {58 vars in 1220 bytes} [Sat Aug 27 04:47:08 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-350052021 => generated 415 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:08.392795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db2c6a-5315-47b3-86f2-96dae172c7e6 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:08.411409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db2c6a-5315-47b3-86f2-96dae172c7e6 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:08.425186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b6006-7567-471c-9129-dca103cb7bc7 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e88b7e1e1e544fd92b9b8a084eee0aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7de3ceb5e10469ca82109d18a06127f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:08.425749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b6006-7567-471c-9129-dca103cb7bc7 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:08.426027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b6006-7567-471c-9129-dca103cb7bc7 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:08.426350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b6006-7567-471c-9129-dca103cb7bc7 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] PATH_INFO: `/v3/services/8c57c9b01fa6432fa45cdeb8214668b7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:08.427111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b6006-7567-471c-9129-dca103cb7bc7 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8c57c9b01fa6432fa45cdeb8214668b7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:08.430862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b6006-7567-471c-9129-dca103cb7bc7 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:08.597018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bb2b4120-eca0-419b-8573-226d1fe06169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e30f8cfc3aca4b0eb27d413cc8e032f2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:08.598253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bb2b4120-eca0-419b-8573-226d1fe06169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e30f8cfc3aca4b0eb27d413cc8e032f2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:08.630900 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1869/3764] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:08 2022] DELETE /identity/v3/services/8c57c9b01fa6432fa45cdeb8214668b7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:08.632863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b6006-7567-471c-9129-dca103cb7bc7 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:08.680955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b6006-7567-471c-9129-dca103cb7bc7 tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:08.708341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e1cea-88ec-410d-be3d-af1b4e94363c tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e88b7e1e1e544fd92b9b8a084eee0aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7de3ceb5e10469ca82109d18a06127f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:08.710777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e1cea-88ec-410d-be3d-af1b4e94363c tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:08.711105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e1cea-88ec-410d-be3d-af1b4e94363c tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:08.711398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e1cea-88ec-410d-be3d-af1b4e94363c tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] PATH_INFO: `/v3/services/6edbf8736031461aa027cc8b331cba27` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:08.712712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e1cea-88ec-410d-be3d-af1b4e94363c tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6edbf8736031461aa027cc8b331cba27)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:08.715744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e1cea-88ec-410d-be3d-af1b4e94363c tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:08.732346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bb2b4120-eca0-419b-8573-226d1fe06169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e30f8cfc3aca4b0eb27d413cc8e032f2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:08.733545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bb2b4120-eca0-419b-8573-226d1fe06169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e30f8cfc3aca4b0eb27d413cc8e032f2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:08.766812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bb2b4120-eca0-419b-8573-226d1fe06169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e30f8cfc3aca4b0eb27d413cc8e032f2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:08.801770 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1896/3765] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:47:08 2022] DELETE /identity/v3/users/e30f8cfc3aca4b0eb27d413cc8e032f2 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:08.899341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:08.899528 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1870/3766] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:08 2022] DELETE /identity/v3/services/6edbf8736031461aa027cc8b331cba27 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:47:08.899629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b4120-eca0-419b-8573-226d1fe06169 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:08.899629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bb2b4120-eca0-419b-8573-226d1fe06169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:09.057911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b4120-eca0-419b-8573-226d1fe06169 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:09.103317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f82d4a-6dbe-44d9-87c0-00447ad9ddcb tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e88b7e1e1e544fd92b9b8a084eee0aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7de3ceb5e10469ca82109d18a06127f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:09.103977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f82d4a-6dbe-44d9-87c0-00447ad9ddcb tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:09.107179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f82d4a-6dbe-44d9-87c0-00447ad9ddcb tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:09.107179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f82d4a-6dbe-44d9-87c0-00447ad9ddcb tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] PATH_INFO: `/v3/services/3d6e58bf058e4cd681cb67fd6c850db2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:09.107179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f82d4a-6dbe-44d9-87c0-00447ad9ddcb tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3d6e58bf058e4cd681cb67fd6c850db2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:09.107179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f82d4a-6dbe-44d9-87c0-00447ad9ddcb tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:09.305470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e1cea-88ec-410d-be3d-af1b4e94363c tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:09.308189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7c4e1cea-88ec-410d-be3d-af1b4e94363c tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:09.312191 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1897/3767] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:08 2022] DELETE /identity/v3/services/3d6e58bf058e4cd681cb67fd6c850db2 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:09.367824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e1cea-88ec-410d-be3d-af1b4e94363c tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:09.600293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695939ee-5fcb-4de9-9825-05f4bb9efebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:09.601238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695939ee-5fcb-4de9-9825-05f4bb9efebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:09.601800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695939ee-5fcb-4de9-9825-05f4bb9efebd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:09.602082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695939ee-5fcb-4de9-9825-05f4bb9efebd admin admin] PATH_INFO: `/v3/users/d61ae6d8848144879c684495014a0aad` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:09.603284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695939ee-5fcb-4de9-9825-05f4bb9efebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d61ae6d8848144879c684495014a0aad)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:09.605484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695939ee-5fcb-4de9-9825-05f4bb9efebd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:09.754457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f82d4a-6dbe-44d9-87c0-00447ad9ddcb tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:09.761433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b5f82d4a-6dbe-44d9-87c0-00447ad9ddcb tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:09.783306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f82d4a-6dbe-44d9-87c0-00447ad9ddcb tempest-ServicesTestJSON-401103110 tempest-ServicesTestJSON-401103110-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:09.789851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19957d96-0c67-45b9-b553-88a9a301aca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:09.790927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19957d96-0c67-45b9-b553-88a9a301aca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:09.791893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19957d96-0c67-45b9-b553-88a9a301aca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:09.792640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19957d96-0c67-45b9-b553-88a9a301aca0 admin admin] PATH_INFO: `/v3/projects/cb4daa9f777240578e1113cf0b5a5385` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:09.818892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19957d96-0c67-45b9-b553-88a9a301aca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb4daa9f777240578e1113cf0b5a5385)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:09.823944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19957d96-0c67-45b9-b553-88a9a301aca0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:09.970553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-695939ee-5fcb-4de9-9825-05f4bb9efebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd61ae6d8848144879c684495014a0aad'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:10.071914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-19957d96-0c67-45b9-b553-88a9a301aca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb4daa9f777240578e1113cf0b5a5385', 'request_id': 'req-19957d96-0c67-45b9-b553-88a9a301aca0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:10.083038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-19957d96-0c67-45b9-b553-88a9a301aca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb4daa9f777240578e1113cf0b5a5385', 'request_id': 'req-19957d96-0c67-45b9-b553-88a9a301aca0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:10.086539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-695939ee-5fcb-4de9-9825-05f4bb9efebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd61ae6d8848144879c684495014a0aad'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:10.087160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-695939ee-5fcb-4de9-9825-05f4bb9efebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd61ae6d8848144879c684495014a0aad'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:10.100823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-695939ee-5fcb-4de9-9825-05f4bb9efebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd61ae6d8848144879c684495014a0aad'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:10.129262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-695939ee-5fcb-4de9-9825-05f4bb9efebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd61ae6d8848144879c684495014a0aad'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:10.146195 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1871/3768] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:47:09 2022] DELETE /identity/v3/users/d61ae6d8848144879c684495014a0aad => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:10.152788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695939ee-5fcb-4de9-9825-05f4bb9efebd admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:10.154228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-695939ee-5fcb-4de9-9825-05f4bb9efebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:10.280568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-19957d96-0c67-45b9-b553-88a9a301aca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb4daa9f777240578e1113cf0b5a5385', 'request_id': 'req-19957d96-0c67-45b9-b553-88a9a301aca0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:10.305602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-19957d96-0c67-45b9-b553-88a9a301aca0 admin admin] The token cache is being invalidate because project cb4daa9f777240578e1113cf0b5a5385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:10.306846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695939ee-5fcb-4de9-9825-05f4bb9efebd admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:10.307384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-19957d96-0c67-45b9-b553-88a9a301aca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:10.310768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-19957d96-0c67-45b9-b553-88a9a301aca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:10.314996 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1898/3769] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:09 2022] DELETE /identity/v3/projects/cb4daa9f777240578e1113cf0b5a5385 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:10.317657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f275043-0dc0-49d5-b526-f1f91685d01c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:10.319198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f275043-0dc0-49d5-b526-f1f91685d01c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:10.320440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1caa8-4188-428e-879a-739acff479a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:10.326614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f275043-0dc0-49d5-b526-f1f91685d01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:10.326985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1caa8-4188-428e-879a-739acff479a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:10.326985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1caa8-4188-428e-879a-739acff479a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:10.326985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1caa8-4188-428e-879a-739acff479a2 admin admin] PATH_INFO: `/v3/projects/1ed4a584a4494dac8db442e3f7d4504c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:10.327235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1caa8-4188-428e-879a-739acff479a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed4a584a4494dac8db442e3f7d4504c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:10.331345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1caa8-4188-428e-879a-739acff479a2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:10.357833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8f275043-0dc0-49d5-b526-f1f91685d01c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:10.364428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8f275043-0dc0-49d5-b526-f1f91685d01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:10.397995 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1899/3770] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:10.416526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf6ddb-217c-418c-b99b-d97b98235149 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:10.417077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf6ddb-217c-418c-b99b-d97b98235149 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:10.417501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf6ddb-217c-418c-b99b-d97b98235149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:10.460858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3ccf6ddb-217c-418c-b99b-d97b98235149 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:10.462275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3ccf6ddb-217c-418c-b99b-d97b98235149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:10.474437 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1900/3771] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:10.475394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf6ddb-217c-418c-b99b-d97b98235149 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:10.483121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3ccf6ddb-217c-418c-b99b-d97b98235149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:10.504369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:10.627121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf6ddb-217c-418c-b99b-d97b98235149 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:10.641429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01356ce-cd93-4e1e-bab2-7b3e1b535d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:10.642080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01356ce-cd93-4e1e-bab2-7b3e1b535d2d service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:10.642372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01356ce-cd93-4e1e-bab2-7b3e1b535d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:10.642644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01356ce-cd93-4e1e-bab2-7b3e1b535d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:10.694265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01356ce-cd93-4e1e-bab2-7b3e1b535d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:10.695914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01356ce-cd93-4e1e-bab2-7b3e1b535d2d service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:10.698237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-26e1caa8-4188-428e-879a-739acff479a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed4a584a4494dac8db442e3f7d4504c', 'request_id': 'req-26e1caa8-4188-428e-879a-739acff479a2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:10.718138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-26e1caa8-4188-428e-879a-739acff479a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed4a584a4494dac8db442e3f7d4504c', 'request_id': 'req-26e1caa8-4188-428e-879a-739acff479a2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:10.731224 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1901/3772] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:10.734525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86330d8-0fef-4d07-9d7a-6e78ffb59f44 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:10.735173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-26e1caa8-4188-428e-879a-739acff479a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed4a584a4494dac8db442e3f7d4504c', 'request_id': 'req-26e1caa8-4188-428e-879a-739acff479a2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:10.738951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86330d8-0fef-4d07-9d7a-6e78ffb59f44 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:10.739245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86330d8-0fef-4d07-9d7a-6e78ffb59f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:10.800749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a86330d8-0fef-4d07-9d7a-6e78ffb59f44 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:10.804814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a86330d8-0fef-4d07-9d7a-6e78ffb59f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:10.956970 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1902/3773] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:10.961385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86330d8-0fef-4d07-9d7a-6e78ffb59f44 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:10.985796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-26e1caa8-4188-428e-879a-739acff479a2 admin admin] The token cache is being invalidate because project 1ed4a584a4494dac8db442e3f7d4504c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:10.991232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-26e1caa8-4188-428e-879a-739acff479a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:10.991232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-26e1caa8-4188-428e-879a-739acff479a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:10.991232 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1872/3774] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:10 2022] DELETE /identity/v3/projects/1ed4a584a4494dac8db442e3f7d4504c => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:10.992006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86330d8-0fef-4d07-9d7a-6e78ffb59f44 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:10.997824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205dbf2-af2f-45bf-8cf6-2a4854983a5f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:10.999244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205dbf2-af2f-45bf-8cf6-2a4854983a5f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:11.001209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205dbf2-af2f-45bf-8cf6-2a4854983a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:11.003463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b28ff2-b407-4518-9758-75d501da998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:11.004459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b28ff2-b407-4518-9758-75d501da998e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:11.005359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b28ff2-b407-4518-9758-75d501da998e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:11.005795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b28ff2-b407-4518-9758-75d501da998e admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:11.006614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b28ff2-b407-4518-9758-75d501da998e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:11.007073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b28ff2-b407-4518-9758-75d501da998e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:11.008886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b28ff2-b407-4518-9758-75d501da998e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:11.043202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b205dbf2-af2f-45bf-8cf6-2a4854983a5f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:11.044192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b205dbf2-af2f-45bf-8cf6-2a4854983a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:11.062464 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1903/3775] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:47:11.065008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b28ff2-b407-4518-9758-75d501da998e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:11.074105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e7b28ff2-b407-4518-9758-75d501da998e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:11.076651 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1873/3776] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:11.087487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157b6fc-f6bb-4f2b-9da5-5eccb0b1b31e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:11.088048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157b6fc-f6bb-4f2b-9da5-5eccb0b1b31e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:11.088585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157b6fc-f6bb-4f2b-9da5-5eccb0b1b31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:11.122205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b28ff2-b407-4518-9758-75d501da998e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:11.136030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b545ab9-252a-4849-9817-800b823b42fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:11.136747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b545ab9-252a-4849-9817-800b823b42fb admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:11.137026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b545ab9-252a-4849-9817-800b823b42fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:11.137316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b545ab9-252a-4849-9817-800b823b42fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:11.137984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b545ab9-252a-4849-9817-800b823b42fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:11.145043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b545ab9-252a-4849-9817-800b823b42fb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:11.147368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6157b6fc-f6bb-4f2b-9da5-5eccb0b1b31e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:11.149740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6157b6fc-f6bb-4f2b-9da5-5eccb0b1b31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:11.195610 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1874/3777] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:11.199279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157b6fc-f6bb-4f2b-9da5-5eccb0b1b31e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:11.217251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157b6fc-f6bb-4f2b-9da5-5eccb0b1b31e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:11.230827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec718ad-4e3f-4c82-92be-a01df18d1ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:11.231682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec718ad-4e3f-4c82-92be-a01df18d1ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:11.231972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec718ad-4e3f-4c82-92be-a01df18d1ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:11.232279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec718ad-4e3f-4c82-92be-a01df18d1ec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:11.232959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec718ad-4e3f-4c82-92be-a01df18d1ec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:11.233880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec718ad-4e3f-4c82-92be-a01df18d1ec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:11.235939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec718ad-4e3f-4c82-92be-a01df18d1ec3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:11.261255 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1875/3778] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:11.265383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec718ad-4e3f-4c82-92be-a01df18d1ec3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:11.304319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec718ad-4e3f-4c82-92be-a01df18d1ec3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:11.317854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c6723-b4e9-4798-b927-736d46a07425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:11.319114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c6723-b4e9-4798-b927-736d46a07425 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:11.319904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c6723-b4e9-4798-b927-736d46a07425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:11.321433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c6723-b4e9-4798-b927-736d46a07425 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:11.322390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c6723-b4e9-4798-b927-736d46a07425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:11.325714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:11.329391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c6723-b4e9-4798-b927-736d46a07425 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:11.336351 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1904/3779] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:11 2022] POST /identity/v3/projects => generated 375 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:47:11.339330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b545ab9-252a-4849-9817-800b823b42fb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:11.484593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b545ab9-252a-4849-9817-800b823b42fb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:11.490783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74cab9-2e8b-4b00-a869-f9623eb88aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:11.491967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74cab9-2e8b-4b00-a869-f9623eb88aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:11.494052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74cab9-2e8b-4b00-a869-f9623eb88aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:11.501489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74cab9-2e8b-4b00-a869-f9623eb88aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:11.508774 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1876/3780] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:11 2022] POST /identity/v3/projects => generated 365 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:11.510314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c6723-b4e9-4798-b927-736d46a07425 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:11.511629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74cab9-2e8b-4b00-a869-f9623eb88aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:11.528461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74cab9-2e8b-4b00-a869-f9623eb88aa5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:11.679414 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1905/3781] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:11 2022] POST /identity/v3/users => generated 288 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:11.687520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74cab9-2e8b-4b00-a869-f9623eb88aa5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:11.720902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74cab9-2e8b-4b00-a869-f9623eb88aa5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:11.726292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c6723-b4e9-4798-b927-736d46a07425 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:11.740647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99be4d-e53b-48b9-8437-e2e6aa785667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:11.740853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99be4d-e53b-48b9-8437-e2e6aa785667 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:11.744371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99be4d-e53b-48b9-8437-e2e6aa785667 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:11.745196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbf78e-a18f-47fd-9272-71ae70be4e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:11.745609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99be4d-e53b-48b9-8437-e2e6aa785667 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:11.747031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99be4d-e53b-48b9-8437-e2e6aa785667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:11.747852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbf78e-a18f-47fd-9272-71ae70be4e0c admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:11.753006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbf78e-a18f-47fd-9272-71ae70be4e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:11.753484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbf78e-a18f-47fd-9272-71ae70be4e0c admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:11.757191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99be4d-e53b-48b9-8437-e2e6aa785667 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:11.764413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effbf78e-a18f-47fd-9272-71ae70be4e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:11.777525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effbf78e-a18f-47fd-9272-71ae70be4e0c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:11.780293 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1906/3782] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:11.784043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99be4d-e53b-48b9-8437-e2e6aa785667 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:11.805645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99be4d-e53b-48b9-8437-e2e6aa785667 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:11.820867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e520fab-4885-41bc-a1a8-42aafda96999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:11.821698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e520fab-4885-41bc-a1a8-42aafda96999 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:11.822129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e520fab-4885-41bc-a1a8-42aafda96999 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:11.827049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e520fab-4885-41bc-a1a8-42aafda96999 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:11.827049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e520fab-4885-41bc-a1a8-42aafda96999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:11.827049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e520fab-4885-41bc-a1a8-42aafda96999 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:11.859259 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1907/3783] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:11.860983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e520fab-4885-41bc-a1a8-42aafda96999 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:11.881897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e520fab-4885-41bc-a1a8-42aafda96999 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:11.898100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73a21d-dba5-4007-bb3b-db84f20512c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:11.898794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73a21d-dba5-4007-bb3b-db84f20512c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:11.899075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73a21d-dba5-4007-bb3b-db84f20512c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:11.899348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73a21d-dba5-4007-bb3b-db84f20512c7 admin admin] PATH_INFO: `/v3/projects/c2743ef5b6bf4dea97d585fa121bdf6f/users/59fbc90b125c402bbee94241a3a609d5/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:11.936063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73a21d-dba5-4007-bb3b-db84f20512c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2743ef5b6bf4dea97d585fa121bdf6f, user_id=59fbc90b125c402bbee94241a3a609d5, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:11.939084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73a21d-dba5-4007-bb3b-db84f20512c7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:11.958700 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1877/3784] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:11 2022] POST /identity/v3/users => generated 283 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:11.968609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbf78e-a18f-47fd-9272-71ae70be4e0c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:11.995138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbf78e-a18f-47fd-9272-71ae70be4e0c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:12.013396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d6f57-4e48-4b0d-9901-90b18e0c2a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:12.014180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d6f57-4e48-4b0d-9901-90b18e0c2a77 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:12.014529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d6f57-4e48-4b0d-9901-90b18e0c2a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:12.014899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d6f57-4e48-4b0d-9901-90b18e0c2a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:12.015628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d6f57-4e48-4b0d-9901-90b18e0c2a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:12.021893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d6f57-4e48-4b0d-9901-90b18e0c2a77 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:12.038597 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1908/3785] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:11 2022] PUT /identity/v3/projects/c2743ef5b6bf4dea97d585fa121bdf6f/users/59fbc90b125c402bbee94241a3a609d5/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:47:12.043862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55145-cb37-47d1-9788-a37805117ae6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:12.050438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55145-cb37-47d1-9788-a37805117ae6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:12.050438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55145-cb37-47d1-9788-a37805117ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:12.055111 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1878/3786] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:12.056144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d6f57-4e48-4b0d-9901-90b18e0c2a77 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:12.078859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d6f57-4e48-4b0d-9901-90b18e0c2a77 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:12.084989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c9b55145-cb37-47d1-9788-a37805117ae6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:12.090506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c9b55145-cb37-47d1-9788-a37805117ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:12.203895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af7bc5-789f-41de-8eaa-6400fe5f98c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:12.205360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af7bc5-789f-41de-8eaa-6400fe5f98c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:12.206686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af7bc5-789f-41de-8eaa-6400fe5f98c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:12.207214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af7bc5-789f-41de-8eaa-6400fe5f98c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:12.208568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af7bc5-789f-41de-8eaa-6400fe5f98c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:12.211741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af7bc5-789f-41de-8eaa-6400fe5f98c4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:12.226811 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1909/3787] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:12.238212 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1879/3788] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:12.242297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b55145-cb37-47d1-9788-a37805117ae6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:12.250360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af7bc5-789f-41de-8eaa-6400fe5f98c4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:12.253443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-85af7bc5-789f-41de-8eaa-6400fe5f98c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:12.257090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b55145-cb37-47d1-9788-a37805117ae6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:12.267453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac425b89-bf6d-43ed-83a1-be84d5eeffe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:12.273774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac425b89-bf6d-43ed-83a1-be84d5eeffe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:12.273774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac425b89-bf6d-43ed-83a1-be84d5eeffe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:12.273774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac425b89-bf6d-43ed-83a1-be84d5eeffe7 admin admin] PATH_INFO: `/v3/projects/c316f3abda1e4ce89ef4dbb5aed6ef2a/users/e8effe2815bd4452b6d0c0eebd63877a/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:12.311637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac425b89-bf6d-43ed-83a1-be84d5eeffe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c316f3abda1e4ce89ef4dbb5aed6ef2a, user_id=e8effe2815bd4452b6d0c0eebd63877a, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:12.319043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac425b89-bf6d-43ed-83a1-be84d5eeffe7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:12.355496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af7bc5-789f-41de-8eaa-6400fe5f98c4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:12.360533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1139ff-ec30-4bee-b80f-ccb4e3666e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:12.361207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1139ff-ec30-4bee-b80f-ccb4e3666e54 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:12.361494 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1139ff-ec30-4bee-b80f-ccb4e3666e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:12.361837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1139ff-ec30-4bee-b80f-ccb4e3666e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:12.372757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1139ff-ec30-4bee-b80f-ccb4e3666e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:12.374222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1139ff-ec30-4bee-b80f-ccb4e3666e54 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:12.386912 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1880/3789] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:12.446998 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1910/3790] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:12 2022] PUT /identity/v3/projects/c316f3abda1e4ce89ef4dbb5aed6ef2a/users/e8effe2815bd4452b6d0c0eebd63877a/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:12.448988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab771a39-fc0a-45d8-ad0c-463e80bfabad None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:12.449354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab771a39-fc0a-45d8-ad0c-463e80bfabad None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:12.449833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab771a39-fc0a-45d8-ad0c-463e80bfabad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:12.530154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:12.534662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ab771a39-fc0a-45d8-ad0c-463e80bfabad None None] MFA Rules not processed for user `e8effe2815bd4452b6d0c0eebd63877a`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:12.539756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ab771a39-fc0a-45d8-ad0c-463e80bfabad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:12.702986 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1881/3791] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:12.722826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac425b89-bf6d-43ed-83a1-be84d5eeffe7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:12.724671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ac425b89-bf6d-43ed-83a1-be84d5eeffe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:12.910815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac425b89-bf6d-43ed-83a1-be84d5eeffe7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:12.927283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b41c81-1221-44a8-ad2e-853b6c5aedc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:12.927986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b41c81-1221-44a8-ad2e-853b6c5aedc2 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:12.928295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b41c81-1221-44a8-ad2e-853b6c5aedc2 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:12.928578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b41c81-1221-44a8-ad2e-853b6c5aedc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:12.948293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b41c81-1221-44a8-ad2e-853b6c5aedc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:12.949966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b41c81-1221-44a8-ad2e-853b6c5aedc2 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:12.977848 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1911/3792] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:13.001125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82fb1d-2314-4c80-8d13-c9d5a7614d1e None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:13.001698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82fb1d-2314-4c80-8d13-c9d5a7614d1e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:13.001698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82fb1d-2314-4c80-8d13-c9d5a7614d1e None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:13.004533 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1882/3793] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:47:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:47:13.009950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b41c81-1221-44a8-ad2e-853b6c5aedc2 service nova] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:47:13.039271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b41c81-1221-44a8-ad2e-853b6c5aedc2 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:13.058975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b41c81-1221-44a8-ad2e-853b6c5aedc2 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:13.071662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bedc76-e011-4325-be85-05d93c5da73d tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8effe2815bd4452b6d0c0eebd63877a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c316f3abda1e4ce89ef4dbb5aed6ef2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:13.072430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bedc76-e011-4325-be85-05d93c5da73d tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:13.072715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bedc76-e011-4325-be85-05d93c5da73d tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:13.072993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bedc76-e011-4325-be85-05d93c5da73d tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] PATH_INFO: `/v3/projects/c316f3abda1e4ce89ef4dbb5aed6ef2a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:13.076861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bedc76-e011-4325-be85-05d93c5da73d tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] RBAC: Authorizing `identity:get_project(project_id=c316f3abda1e4ce89ef4dbb5aed6ef2a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:13.078689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bedc76-e011-4325-be85-05d93c5da73d tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:13.086821 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1912/3794] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:47:13 2022] GET /identity/v3/projects/c316f3abda1e4ce89ef4dbb5aed6ef2a => generated 365 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:13.142132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6284bfa-68ee-442d-9c3f-dbeae565f7cc None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:13.142363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6284bfa-68ee-442d-9c3f-dbeae565f7cc None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:13.142643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6284bfa-68ee-442d-9c3f-dbeae565f7cc None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:13.145115 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1883/3795] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:47:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:47:13.151809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bedc76-e011-4325-be85-05d93c5da73d tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:47:13.176737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bedc76-e011-4325-be85-05d93c5da73d tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:13.196951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bedc76-e011-4325-be85-05d93c5da73d tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:13.207650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b52c6-e10c-4f66-a7cb-7a4441a3c93e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8effe2815bd4452b6d0c0eebd63877a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c316f3abda1e4ce89ef4dbb5aed6ef2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:13.208333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b52c6-e10c-4f66-a7cb-7a4441a3c93e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:13.208615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b52c6-e10c-4f66-a7cb-7a4441a3c93e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:13.208887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b52c6-e10c-4f66-a7cb-7a4441a3c93e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] PATH_INFO: `/v3/projects/c316f3abda1e4ce89ef4dbb5aed6ef2a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:13.211477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b52c6-e10c-4f66-a7cb-7a4441a3c93e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] RBAC: Authorizing `identity:get_project(project_id=c316f3abda1e4ce89ef4dbb5aed6ef2a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:13.213363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b52c6-e10c-4f66-a7cb-7a4441a3c93e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:13.215535 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1913/3796] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:47:13 2022] GET /identity/v3/projects/c316f3abda1e4ce89ef4dbb5aed6ef2a => generated 365 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:13.220467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:13.305039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5eea0-0897-45ab-a903-0fbc839c15a0 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:13.305039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5eea0-0897-45ab-a903-0fbc839c15a0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:13.305039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5eea0-0897-45ab-a903-0fbc839c15a0 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:13.305039 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1884/3797] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:47:13.305902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b52c6-e10c-4f66-a7cb-7a4441a3c93e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:47:13.333328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b52c6-e10c-4f66-a7cb-7a4441a3c93e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:13.352989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b52c6-e10c-4f66-a7cb-7a4441a3c93e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:13.361410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e070205-2c6c-4e83-8977-9a62b400381e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8effe2815bd4452b6d0c0eebd63877a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c316f3abda1e4ce89ef4dbb5aed6ef2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:13.363306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e070205-2c6c-4e83-8977-9a62b400381e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:13.363553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e070205-2c6c-4e83-8977-9a62b400381e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:13.363833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e070205-2c6c-4e83-8977-9a62b400381e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] PATH_INFO: `/v3/projects/c316f3abda1e4ce89ef4dbb5aed6ef2a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:13.369334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e070205-2c6c-4e83-8977-9a62b400381e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] RBAC: Authorizing `identity:get_project(project_id=c316f3abda1e4ce89ef4dbb5aed6ef2a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:13.371252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e070205-2c6c-4e83-8977-9a62b400381e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:13.376350 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1914/3798] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:47:13 2022] GET /identity/v3/projects/c316f3abda1e4ce89ef4dbb5aed6ef2a => generated 365 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:13.407888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:13.419540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765f38b-844f-4c24-b0b4-04c59d194301 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:13.420376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765f38b-844f-4c24-b0b4-04c59d194301 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:13.420376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765f38b-844f-4c24-b0b4-04c59d194301 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:13.421902 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1885/3799] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:47:13.435660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e070205-2c6c-4e83-8977-9a62b400381e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:47:13.461741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e070205-2c6c-4e83-8977-9a62b400381e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:13.478442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e070205-2c6c-4e83-8977-9a62b400381e tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:13.491960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a119640-f09b-4373-8b35-e0a0c464eca0 tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8effe2815bd4452b6d0c0eebd63877a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c316f3abda1e4ce89ef4dbb5aed6ef2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:13.492691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a119640-f09b-4373-8b35-e0a0c464eca0 tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:13.492976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a119640-f09b-4373-8b35-e0a0c464eca0 tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:13.493252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a119640-f09b-4373-8b35-e0a0c464eca0 tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] PATH_INFO: `/v3/projects/c316f3abda1e4ce89ef4dbb5aed6ef2a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:13.494608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a119640-f09b-4373-8b35-e0a0c464eca0 tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] RBAC: Authorizing `identity:get_project(project_id=c316f3abda1e4ce89ef4dbb5aed6ef2a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:13.496600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a119640-f09b-4373-8b35-e0a0c464eca0 tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:13.508412 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1915/3800] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:47:13 2022] GET /identity/v3/projects/c316f3abda1e4ce89ef4dbb5aed6ef2a => generated 365 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:13.541329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7da5c-54c1-45b6-b4d5-c42e9d584351 None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:13.541854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7da5c-54c1-45b6-b4d5-c42e9d584351 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:13.542310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7da5c-54c1-45b6-b4d5-c42e9d584351 None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:13.550721 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1886/3801] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 04:47:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:47:13.563554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a119640-f09b-4373-8b35-e0a0c464eca0 tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 04:47:13.585480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a119640-f09b-4373-8b35-e0a0c464eca0 tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:13.612460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a119640-f09b-4373-8b35-e0a0c464eca0 tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:13.621193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116e3d5-1829-4961-8c51-e97d8c572bed tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8effe2815bd4452b6d0c0eebd63877a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c316f3abda1e4ce89ef4dbb5aed6ef2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:13.621848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116e3d5-1829-4961-8c51-e97d8c572bed tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:13.622936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116e3d5-1829-4961-8c51-e97d8c572bed tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:13.623227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116e3d5-1829-4961-8c51-e97d8c572bed tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] PATH_INFO: `/v3/projects/c316f3abda1e4ce89ef4dbb5aed6ef2a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:13.625719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116e3d5-1829-4961-8c51-e97d8c572bed tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] RBAC: Authorizing `identity:get_project(project_id=c316f3abda1e4ce89ef4dbb5aed6ef2a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:13.627546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116e3d5-1829-4961-8c51-e97d8c572bed tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:13.629305 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1916/3802] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 04:47:13 2022] GET /identity/v3/projects/c316f3abda1e4ce89ef4dbb5aed6ef2a => generated 365 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:13.684620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7da5c-54c1-45b6-b4d5-c42e9d584351 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:13.686125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116e3d5-1829-4961-8c51-e97d8c572bed tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:13.688298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-62c7da5c-54c1-45b6-b4d5-c42e9d584351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:13.837831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116e3d5-1829-4961-8c51-e97d8c572bed tempest-QuotasTestJSON-1296385888 tempest-QuotasTestJSON-1296385888-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:13.852988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ce087-7988-48ca-9b57-5f7b744f306f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:13.853837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ce087-7988-48ca-9b57-5f7b744f306f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:13.853997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7da5c-54c1-45b6-b4d5-c42e9d584351 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:13.854404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ce087-7988-48ca-9b57-5f7b744f306f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:13.854821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ce087-7988-48ca-9b57-5f7b744f306f admin admin] PATH_INFO: `/v3/users/e8effe2815bd4452b6d0c0eebd63877a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:13.856669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ce087-7988-48ca-9b57-5f7b744f306f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8effe2815bd4452b6d0c0eebd63877a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:13.858768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ce087-7988-48ca-9b57-5f7b744f306f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:13.874253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ade20f-ef03-4b77-abdf-e20bb124023c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:13.875006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ade20f-ef03-4b77-abdf-e20bb124023c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:13.875289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ade20f-ef03-4b77-abdf-e20bb124023c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:13.875565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ade20f-ef03-4b77-abdf-e20bb124023c admin admin] PATH_INFO: `/v3/projects/66d34cf0eea14f9d9722b2edb0921dc7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:13.878464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ade20f-ef03-4b77-abdf-e20bb124023c admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d34cf0eea14f9d9722b2edb0921dc7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:13.880464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ade20f-ef03-4b77-abdf-e20bb124023c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:14.232490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-111ce087-7988-48ca-9b57-5f7b744f306f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8effe2815bd4452b6d0c0eebd63877a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:14.233662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-53ade20f-ef03-4b77-abdf-e20bb124023c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d34cf0eea14f9d9722b2edb0921dc7', 'request_id': 'req-53ade20f-ef03-4b77-abdf-e20bb124023c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:14.234848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-111ce087-7988-48ca-9b57-5f7b744f306f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8effe2815bd4452b6d0c0eebd63877a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:14.265306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-53ade20f-ef03-4b77-abdf-e20bb124023c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d34cf0eea14f9d9722b2edb0921dc7', 'request_id': 'req-53ade20f-ef03-4b77-abdf-e20bb124023c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:14.286271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-53ade20f-ef03-4b77-abdf-e20bb124023c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d34cf0eea14f9d9722b2edb0921dc7', 'request_id': 'req-53ade20f-ef03-4b77-abdf-e20bb124023c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:14.349256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-111ce087-7988-48ca-9b57-5f7b744f306f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8effe2815bd4452b6d0c0eebd63877a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:14.350105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-111ce087-7988-48ca-9b57-5f7b744f306f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8effe2815bd4452b6d0c0eebd63877a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:14.370006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-111ce087-7988-48ca-9b57-5f7b744f306f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8effe2815bd4452b6d0c0eebd63877a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:14.407161 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1917/3803] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:47:13 2022] DELETE /identity/v3/users/e8effe2815bd4452b6d0c0eebd63877a => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:14.408098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c6045-e867-47be-87fb-74ee22ab3c34 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:14.408419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c6045-e867-47be-87fb-74ee22ab3c34 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:14.408736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c6045-e867-47be-87fb-74ee22ab3c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:14.447720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-53ade20f-ef03-4b77-abdf-e20bb124023c admin admin] The token cache is being invalidate because project 66d34cf0eea14f9d9722b2edb0921dc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:14.448953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-53ade20f-ef03-4b77-abdf-e20bb124023c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:14.452098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-53ade20f-ef03-4b77-abdf-e20bb124023c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:14.456408 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1887/3804] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:13 2022] DELETE /identity/v3/projects/66d34cf0eea14f9d9722b2edb0921dc7 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:14.460593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7b8c6045-e867-47be-87fb-74ee22ab3c34 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:14.460722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ade20f-ef03-4b77-abdf-e20bb124023c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:14.461994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-53ade20f-ef03-4b77-abdf-e20bb124023c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:14.463674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7b8c6045-e867-47be-87fb-74ee22ab3c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:14.629008 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1918/3805] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:14.629008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c6045-e867-47be-87fb-74ee22ab3c34 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:14.630391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7b8c6045-e867-47be-87fb-74ee22ab3c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:14.654918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c6045-e867-47be-87fb-74ee22ab3c34 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:14.668409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c3f55-6e91-40c4-a6c6-bd11988d6779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:14.669270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c3f55-6e91-40c4-a6c6-bd11988d6779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:14.669647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c3f55-6e91-40c4-a6c6-bd11988d6779 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:14.670046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c3f55-6e91-40c4-a6c6-bd11988d6779 admin admin] PATH_INFO: `/v3/users/8115953d94074d32a4aee216289feb36` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:14.676270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c3f55-6e91-40c4-a6c6-bd11988d6779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8115953d94074d32a4aee216289feb36)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:14.677495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c3f55-6e91-40c4-a6c6-bd11988d6779 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:14.769643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ade20f-ef03-4b77-abdf-e20bb124023c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:14.778804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbb63d-bef2-481c-ba5c-f2bd7ed092af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:14.779748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbb63d-bef2-481c-ba5c-f2bd7ed092af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:14.780333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbb63d-bef2-481c-ba5c-f2bd7ed092af admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:14.780817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbb63d-bef2-481c-ba5c-f2bd7ed092af admin admin] PATH_INFO: `/v3/users/3e88b7e1e1e544fd92b9b8a084eee0aa` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:14.782217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbb63d-bef2-481c-ba5c-f2bd7ed092af admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e88b7e1e1e544fd92b9b8a084eee0aa)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:14.786200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbb63d-bef2-481c-ba5c-f2bd7ed092af admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:14.913055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-253c3f55-6e91-40c4-a6c6-bd11988d6779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8115953d94074d32a4aee216289feb36'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:14.915364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-253c3f55-6e91-40c4-a6c6-bd11988d6779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8115953d94074d32a4aee216289feb36'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:14.919526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:14.996511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-253c3f55-6e91-40c4-a6c6-bd11988d6779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8115953d94074d32a4aee216289feb36'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:14.997405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-253c3f55-6e91-40c4-a6c6-bd11988d6779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8115953d94074d32a4aee216289feb36'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:15.021522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-253c3f55-6e91-40c4-a6c6-bd11988d6779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8115953d94074d32a4aee216289feb36'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:15.021923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3cbb63d-bef2-481c-ba5c-f2bd7ed092af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e88b7e1e1e544fd92b9b8a084eee0aa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:15.050798 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1919/3806] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:47:14 2022] DELETE /identity/v3/users/8115953d94074d32a4aee216289feb36 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:15.052861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c3f55-6e91-40c4-a6c6-bd11988d6779 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:15.054695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-253c3f55-6e91-40c4-a6c6-bd11988d6779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:15.110817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3cbb63d-bef2-481c-ba5c-f2bd7ed092af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e88b7e1e1e544fd92b9b8a084eee0aa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:15.111681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3cbb63d-bef2-481c-ba5c-f2bd7ed092af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e88b7e1e1e544fd92b9b8a084eee0aa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:15.122633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3cbb63d-bef2-481c-ba5c-f2bd7ed092af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e88b7e1e1e544fd92b9b8a084eee0aa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:15.146231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3cbb63d-bef2-481c-ba5c-f2bd7ed092af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e88b7e1e1e544fd92b9b8a084eee0aa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:15.159325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c3f55-6e91-40c4-a6c6-bd11988d6779 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:15.171794 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1888/3807] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:47:14 2022] DELETE /identity/v3/users/3e88b7e1e1e544fd92b9b8a084eee0aa => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:15.172819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d35e24-6280-4571-925d-c7f12cae514c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:15.179016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbb63d-bef2-481c-ba5c-f2bd7ed092af admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:15.179273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d35e24-6280-4571-925d-c7f12cae514c service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:15.179273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d35e24-6280-4571-925d-c7f12cae514c service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:15.179273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d35e24-6280-4571-925d-c7f12cae514c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:15.179508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f3cbb63d-bef2-481c-ba5c-f2bd7ed092af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:15.187554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-43d35e24-6280-4571-925d-c7f12cae514c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:15.338924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbb63d-bef2-481c-ba5c-f2bd7ed092af admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:15.354065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78aa540-4da7-4540-a157-fd16f5699216 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:15.354065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78aa540-4da7-4540-a157-fd16f5699216 service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:15.354065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78aa540-4da7-4540-a157-fd16f5699216 service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:15.355440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78aa540-4da7-4540-a157-fd16f5699216 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:15.362287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a78aa540-4da7-4540-a157-fd16f5699216 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:15.392030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78aa540-4da7-4540-a157-fd16f5699216 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:15.404474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78aa540-4da7-4540-a157-fd16f5699216 service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:15.422810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d35e24-6280-4571-925d-c7f12cae514c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:15.429744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d35e24-6280-4571-925d-c7f12cae514c service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:15.445577 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1889/3808] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:15.450798 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1920/3809] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:16.317775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:16.669422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78aa540-4da7-4540-a157-fd16f5699216 service placement] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:16.672778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a78aa540-4da7-4540-a157-fd16f5699216 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:16.874973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78aa540-4da7-4540-a157-fd16f5699216 service placement] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:16.881487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540c8e8-a099-43d7-81cb-096b44ff352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:16.882176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540c8e8-a099-43d7-81cb-096b44ff352e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:16.882615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540c8e8-a099-43d7-81cb-096b44ff352e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:16.882886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540c8e8-a099-43d7-81cb-096b44ff352e admin admin] PATH_INFO: `/v3/projects/c316f3abda1e4ce89ef4dbb5aed6ef2a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:16.884118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540c8e8-a099-43d7-81cb-096b44ff352e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c316f3abda1e4ce89ef4dbb5aed6ef2a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:16.886128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540c8e8-a099-43d7-81cb-096b44ff352e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:17.014567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d35e24-6280-4571-925d-c7f12cae514c service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:17.017466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-43d35e24-6280-4571-925d-c7f12cae514c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:17.035249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d35e24-6280-4571-925d-c7f12cae514c service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:17.046122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:17.047484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:17.048129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:17.049757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe admin admin] PATH_INFO: `/v3/projects/7929f66d29064429b0958af19edc5e9b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:17.051541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7929f66d29064429b0958af19edc5e9b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:17.063937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:17.122484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0540c8e8-a099-43d7-81cb-096b44ff352e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c316f3abda1e4ce89ef4dbb5aed6ef2a', 'request_id': 'req-0540c8e8-a099-43d7-81cb-096b44ff352e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:17.136027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0540c8e8-a099-43d7-81cb-096b44ff352e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c316f3abda1e4ce89ef4dbb5aed6ef2a', 'request_id': 'req-0540c8e8-a099-43d7-81cb-096b44ff352e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:17.156980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0540c8e8-a099-43d7-81cb-096b44ff352e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c316f3abda1e4ce89ef4dbb5aed6ef2a', 'request_id': 'req-0540c8e8-a099-43d7-81cb-096b44ff352e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:17.263537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7929f66d29064429b0958af19edc5e9b', 'request_id': 'req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:17.271361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0540c8e8-a099-43d7-81cb-096b44ff352e admin admin] The token cache is being invalidate because project c316f3abda1e4ce89ef4dbb5aed6ef2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:17.273085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0540c8e8-a099-43d7-81cb-096b44ff352e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:17.273085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0540c8e8-a099-43d7-81cb-096b44ff352e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:17.277485 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1890/3810] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:16 2022] DELETE /identity/v3/projects/c316f3abda1e4ce89ef4dbb5aed6ef2a => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:17.281517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7929f66d29064429b0958af19edc5e9b', 'request_id': 'req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:17.283674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f39f3-7a50-4702-ad8d-5d1328102472 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:17.284656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f39f3-7a50-4702-ad8d-5d1328102472 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:17.285147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f39f3-7a50-4702-ad8d-5d1328102472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:17.314564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1a9f39f3-7a50-4702-ad8d-5d1328102472 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:17.316777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1a9f39f3-7a50-4702-ad8d-5d1328102472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:17.379169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7929f66d29064429b0958af19edc5e9b', 'request_id': 'req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:17.406115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe admin admin] The token cache is being invalidate because project 7929f66d29064429b0958af19edc5e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:17.406403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:17.407123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:17.410282 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1921/3811] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:17 2022] DELETE /identity/v3/projects/7929f66d29064429b0958af19edc5e9b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:47:17.412044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:17.413760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:17.430133 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1891/3812] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:17.431723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaab039-2a18-4af6-a2aa-4a21302de722 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:17.432376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaab039-2a18-4af6-a2aa-4a21302de722 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:17.433128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaab039-2a18-4af6-a2aa-4a21302de722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:17.459460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-baaab039-2a18-4af6-a2aa-4a21302de722 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:17.460991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-baaab039-2a18-4af6-a2aa-4a21302de722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:17.471647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ab3ac-ffef-446a-a9b1-99d2f9d81dbe admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:17.473000 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1892/3813] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:17.474831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f116ed-8d47-40dd-8b3a-052562347354 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:17.475215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f116ed-8d47-40dd-8b3a-052562347354 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:17.475688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f116ed-8d47-40dd-8b3a-052562347354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:17.502774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a30172-c040-419b-ad7a-0ef9f89c0d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:17.503462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a30172-c040-419b-ad7a-0ef9f89c0d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:17.503751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a30172-c040-419b-ad7a-0ef9f89c0d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:17.504017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a30172-c040-419b-ad7a-0ef9f89c0d17 admin admin] PATH_INFO: `/v3/projects/f7de3ceb5e10469ca82109d18a06127f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:17.505236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-46f116ed-8d47-40dd-8b3a-052562347354 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:17.506453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a30172-c040-419b-ad7a-0ef9f89c0d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7de3ceb5e10469ca82109d18a06127f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:17.507636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-46f116ed-8d47-40dd-8b3a-052562347354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:17.509751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a30172-c040-419b-ad7a-0ef9f89c0d17 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:17.526820 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1893/3814] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:17.528518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0fbca-ff31-4753-9397-1cc5d3cdf995 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:17.528930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0fbca-ff31-4753-9397-1cc5d3cdf995 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:17.529216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0fbca-ff31-4753-9397-1cc5d3cdf995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:17.554218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c0a0fbca-ff31-4753-9397-1cc5d3cdf995 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:17.555448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c0a0fbca-ff31-4753-9397-1cc5d3cdf995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:17.565815 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1894/3815] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:17.567802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0fbca-ff31-4753-9397-1cc5d3cdf995 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:17.589927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0fbca-ff31-4753-9397-1cc5d3cdf995 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:17.607001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b775b90-621f-4ac7-b1e1-a571971fba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:17.608285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b775b90-621f-4ac7-b1e1-a571971fba72 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:17.608582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b775b90-621f-4ac7-b1e1-a571971fba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:17.609033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b775b90-621f-4ac7-b1e1-a571971fba72 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:17.609725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b775b90-621f-4ac7-b1e1-a571971fba72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:17.610035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b775b90-621f-4ac7-b1e1-a571971fba72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:17.616895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b775b90-621f-4ac7-b1e1-a571971fba72 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:17.644517 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1895/3816] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:17.645964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b775b90-621f-4ac7-b1e1-a571971fba72 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:17.673720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:17.684060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b775b90-621f-4ac7-b1e1-a571971fba72 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:17.708146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de4528-619b-4630-81f2-371eb9b02bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:17.708842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de4528-619b-4630-81f2-371eb9b02bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:17.709130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de4528-619b-4630-81f2-371eb9b02bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:17.709407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de4528-619b-4630-81f2-371eb9b02bb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:17.711807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de4528-619b-4630-81f2-371eb9b02bb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:17.712133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de4528-619b-4630-81f2-371eb9b02bb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:17.716030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de4528-619b-4630-81f2-371eb9b02bb6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:17.725881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40a30172-c040-419b-ad7a-0ef9f89c0d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7de3ceb5e10469ca82109d18a06127f', 'request_id': 'req-40a30172-c040-419b-ad7a-0ef9f89c0d17'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:17.750785 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1896/3817] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:17.754850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de4528-619b-4630-81f2-371eb9b02bb6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:17.759630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40a30172-c040-419b-ad7a-0ef9f89c0d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7de3ceb5e10469ca82109d18a06127f', 'request_id': 'req-40a30172-c040-419b-ad7a-0ef9f89c0d17'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:17.781112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de4528-619b-4630-81f2-371eb9b02bb6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:17.886100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40a30172-c040-419b-ad7a-0ef9f89c0d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7de3ceb5e10469ca82109d18a06127f', 'request_id': 'req-40a30172-c040-419b-ad7a-0ef9f89c0d17'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:17.914624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40a30172-c040-419b-ad7a-0ef9f89c0d17 admin admin] The token cache is being invalidate because project f7de3ceb5e10469ca82109d18a06127f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:17.916298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6b7b4-eb1a-4281-94e7-eb1de8663516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:17.917120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6b7b4-eb1a-4281-94e7-eb1de8663516 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:17.917552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6b7b4-eb1a-4281-94e7-eb1de8663516 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:17.917821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40a30172-c040-419b-ad7a-0ef9f89c0d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:17.918150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6b7b4-eb1a-4281-94e7-eb1de8663516 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:17.918941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6b7b4-eb1a-4281-94e7-eb1de8663516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:17.919760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40a30172-c040-419b-ad7a-0ef9f89c0d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:17.922204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6b7b4-eb1a-4281-94e7-eb1de8663516 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:17.928629 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1922/3818] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:17 2022] DELETE /identity/v3/projects/f7de3ceb5e10469ca82109d18a06127f => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:17.928629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a30172-c040-419b-ad7a-0ef9f89c0d17 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:17.946205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-40a30172-c040-419b-ad7a-0ef9f89c0d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:17.963419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a30172-c040-419b-ad7a-0ef9f89c0d17 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:17.970248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a805d5-531d-425b-948c-053af0bcb423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:17.971771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a805d5-531d-425b-948c-053af0bcb423 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:17.972234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a805d5-531d-425b-948c-053af0bcb423 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:17.972971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a805d5-531d-425b-948c-053af0bcb423 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:17.973773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a805d5-531d-425b-948c-053af0bcb423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:17.978447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a805d5-531d-425b-948c-053af0bcb423 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:18.076023 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1897/3819] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:17 2022] POST /identity/v3/projects => generated 385 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:18.079037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0661c3-1aab-4bdb-9870-2d3d00974b36 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:18.079809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0661c3-1aab-4bdb-9870-2d3d00974b36 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:18.079809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0661c3-1aab-4bdb-9870-2d3d00974b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:18.108712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2e0661c3-1aab-4bdb-9870-2d3d00974b36 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:18.115082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2e0661c3-1aab-4bdb-9870-2d3d00974b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:18.117038 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1923/3820] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:17 2022] POST /identity/v3/projects => generated 397 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:18.120749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a805d5-531d-425b-948c-053af0bcb423 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:18.135581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-89a805d5-531d-425b-948c-053af0bcb423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:18.291030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a805d5-531d-425b-948c-053af0bcb423 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:18.296390 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1898/3821] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:18.299643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0661c3-1aab-4bdb-9870-2d3d00974b36 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:18.309712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62689e-5ee6-4219-a711-0c6b146ee186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:18.310694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62689e-5ee6-4219-a711-0c6b146ee186 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:18.311170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62689e-5ee6-4219-a711-0c6b146ee186 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:18.311592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62689e-5ee6-4219-a711-0c6b146ee186 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:18.312706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62689e-5ee6-4219-a711-0c6b146ee186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:18.318107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62689e-5ee6-4219-a711-0c6b146ee186 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:18.343969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0661c3-1aab-4bdb-9870-2d3d00974b36 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:18.386971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151cd6e-c81e-4a6e-b351-62a683e0c3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:18.388210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151cd6e-c81e-4a6e-b351-62a683e0c3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:18.388484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151cd6e-c81e-4a6e-b351-62a683e0c3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:18.389617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151cd6e-c81e-4a6e-b351-62a683e0c3f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:18.390285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151cd6e-c81e-4a6e-b351-62a683e0c3f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:18.395308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151cd6e-c81e-4a6e-b351-62a683e0c3f2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:18.471097 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1924/3822] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:18 2022] POST /identity/v3/users => generated 293 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:18.474594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2bbb3-056b-40b9-bc38-ca2f78582423 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:18.475607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2bbb3-056b-40b9-bc38-ca2f78582423 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:18.476068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2bbb3-056b-40b9-bc38-ca2f78582423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:18.509929 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1899/3823] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:18 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:18.509929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151cd6e-c81e-4a6e-b351-62a683e0c3f2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:18.528156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151cd6e-c81e-4a6e-b351-62a683e0c3f2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:18.542024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f53481-3605-4f7c-be9c-05aed950bd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:18.543167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f53481-3605-4f7c-be9c-05aed950bd95 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:18.543509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f53481-3605-4f7c-be9c-05aed950bd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:18.543888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f53481-3605-4f7c-be9c-05aed950bd95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:18.545974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f53481-3605-4f7c-be9c-05aed950bd95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:18.548559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-70a2bbb3-056b-40b9-bc38-ca2f78582423 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:18.548733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f53481-3605-4f7c-be9c-05aed950bd95 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:18.551129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-70a2bbb3-056b-40b9-bc38-ca2f78582423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:18.566666 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1900/3824] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:18.567989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f53481-3605-4f7c-be9c-05aed950bd95 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:18.574616 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1925/3825] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:18.574616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2bbb3-056b-40b9-bc38-ca2f78582423 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:18.585806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f53481-3605-4f7c-be9c-05aed950bd95 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:18.593476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b1d18-9c89-4f93-b9a2-139543fcd366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:18.594364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b1d18-9c89-4f93-b9a2-139543fcd366 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:18.594844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b1d18-9c89-4f93-b9a2-139543fcd366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:18.595351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b1d18-9c89-4f93-b9a2-139543fcd366 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:18.605554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b1d18-9c89-4f93-b9a2-139543fcd366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:18.605697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2bbb3-056b-40b9-bc38-ca2f78582423 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:18.605778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b1d18-9c89-4f93-b9a2-139543fcd366 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:18.621507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7db0bb-2356-42ba-a854-f7c4294878bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:18.621507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7db0bb-2356-42ba-a854-f7c4294878bc admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:18.621823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7db0bb-2356-42ba-a854-f7c4294878bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:18.622096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7db0bb-2356-42ba-a854-f7c4294878bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:18.622778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7db0bb-2356-42ba-a854-f7c4294878bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:18.624392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7db0bb-2356-42ba-a854-f7c4294878bc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:18.646093 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1901/3826] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:18.648588 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1926/3827] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:18.650441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b1d18-9c89-4f93-b9a2-139543fcd366 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:18.653213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7db0bb-2356-42ba-a854-f7c4294878bc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:18.682873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b1d18-9c89-4f93-b9a2-139543fcd366 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:18.683731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7db0bb-2356-42ba-a854-f7c4294878bc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:18.695394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563c932-bdd8-4c96-b2db-e8d012ef7f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:18.696213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563c932-bdd8-4c96-b2db-e8d012ef7f89 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:18.698646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563c932-bdd8-4c96-b2db-e8d012ef7f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:18.699013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563c932-bdd8-4c96-b2db-e8d012ef7f89 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:18.699766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563c932-bdd8-4c96-b2db-e8d012ef7f89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:18.700069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563c932-bdd8-4c96-b2db-e8d012ef7f89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:18.700510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c7bef-8fc1-446b-9963-b2e25a569026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:18.701137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c7bef-8fc1-446b-9963-b2e25a569026 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:18.701420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c7bef-8fc1-446b-9963-b2e25a569026 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:18.701691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c7bef-8fc1-446b-9963-b2e25a569026 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:18.702073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563c932-bdd8-4c96-b2db-e8d012ef7f89 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:18.702331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c7bef-8fc1-446b-9963-b2e25a569026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:18.703912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c7bef-8fc1-446b-9963-b2e25a569026 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:18.719344 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1902/3828] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:18.720525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563c932-bdd8-4c96-b2db-e8d012ef7f89 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:18.744498 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1927/3829] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:18.745471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c7bef-8fc1-446b-9963-b2e25a569026 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:18.746814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563c932-bdd8-4c96-b2db-e8d012ef7f89 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:18.757987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a9745-8622-469d-8a11-e75b2ca1e7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:18.758675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a9745-8622-469d-8a11-e75b2ca1e7a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:18.758960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a9745-8622-469d-8a11-e75b2ca1e7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:18.759329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a9745-8622-469d-8a11-e75b2ca1e7a7 admin admin] PATH_INFO: `/v3/projects/c01c4dacccbe4617bb1878ed965492df/users/7c73bd94a9954b559161544afb5b5555/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:18.767640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c7bef-8fc1-446b-9963-b2e25a569026 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:18.793737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a9745-8622-469d-8a11-e75b2ca1e7a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01c4dacccbe4617bb1878ed965492df, user_id=7c73bd94a9954b559161544afb5b5555, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:18.808199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a9745-8622-469d-8a11-e75b2ca1e7a7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:18.813729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e421c-b238-41ed-a60a-844723f3a67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:18.813729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e421c-b238-41ed-a60a-844723f3a67b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:18.813729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e421c-b238-41ed-a60a-844723f3a67b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:18.813729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e421c-b238-41ed-a60a-844723f3a67b admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:18.815203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e421c-b238-41ed-a60a-844723f3a67b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:18.815203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e421c-b238-41ed-a60a-844723f3a67b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:18.923106 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1903/3830] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:18 2022] PUT /identity/v3/projects/c01c4dacccbe4617bb1878ed965492df/users/7c73bd94a9954b559161544afb5b5555/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:18.933855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a9745-8622-469d-8a11-e75b2ca1e7a7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:18.944541 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1928/3831] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:18 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:18.944541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab573ec1-5b48-4dd8-a6a4-1b34cafccb64 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:18.944541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab573ec1-5b48-4dd8-a6a4-1b34cafccb64 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:18.944541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab573ec1-5b48-4dd8-a6a4-1b34cafccb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:18.949615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:19.006763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ab573ec1-5b48-4dd8-a6a4-1b34cafccb64 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:19.008108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ab573ec1-5b48-4dd8-a6a4-1b34cafccb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:19.136618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a9745-8622-469d-8a11-e75b2ca1e7a7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:19.278969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54d30b-17bc-415b-8e7e-3181e9592486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:19.280687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54d30b-17bc-415b-8e7e-3181e9592486 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:19.281439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54d30b-17bc-415b-8e7e-3181e9592486 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:19.282086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54d30b-17bc-415b-8e7e-3181e9592486 admin admin] PATH_INFO: `/v3/projects/7cd251c2ac1f4f7b98f3c9fffdb4dbcd/users/419210a4f7744db6a2571ae341744361/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:19.334812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54d30b-17bc-415b-8e7e-3181e9592486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd251c2ac1f4f7b98f3c9fffdb4dbcd, user_id=419210a4f7744db6a2571ae341744361, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:19.343329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54d30b-17bc-415b-8e7e-3181e9592486 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:19.352035 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1929/3832] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:19.352963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab573ec1-5b48-4dd8-a6a4-1b34cafccb64 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:19.365219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab573ec1-5b48-4dd8-a6a4-1b34cafccb64 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:19.378090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790d928-aac6-4f54-b181-682310f7c589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:19.379110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790d928-aac6-4f54-b181-682310f7c589 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:19.379540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790d928-aac6-4f54-b181-682310f7c589 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:19.380005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790d928-aac6-4f54-b181-682310f7c589 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:19.380849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790d928-aac6-4f54-b181-682310f7c589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:19.384527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790d928-aac6-4f54-b181-682310f7c589 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:19.447891 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1904/3833] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:18 2022] PUT /identity/v3/projects/7cd251c2ac1f4f7b98f3c9fffdb4dbcd/users/419210a4f7744db6a2571ae341744361/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:19.451404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6c172-7365-4c47-8309-07a898c95de4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:19.451697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6c172-7365-4c47-8309-07a898c95de4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:19.451976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6c172-7365-4c47-8309-07a898c95de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:19.566056 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1930/3834] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:19 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:19.567138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790d928-aac6-4f54-b181-682310f7c589 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:19.571261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d5c6c172-7365-4c47-8309-07a898c95de4 None None] MFA Rules not processed for user `177c105f6d484e8abfeb9bc118a1260d`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:19.572541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d5c6c172-7365-4c47-8309-07a898c95de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:19.574247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4790d928-aac6-4f54-b181-682310f7c589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:19.643901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:19.765137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790d928-aac6-4f54-b181-682310f7c589 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:19.812411 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1905/3835] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:19.812411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc6d31-9e9f-4ef5-b115-efff313598b1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:19.812411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc6d31-9e9f-4ef5-b115-efff313598b1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:19.812411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc6d31-9e9f-4ef5-b115-efff313598b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:19.863489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d7fc6d31-9e9f-4ef5-b115-efff313598b1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:19.865134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d7fc6d31-9e9f-4ef5-b115-efff313598b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:19.910527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175bf1b-f20e-4e51-8de8-b448c9dfeff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:19.911169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175bf1b-f20e-4e51-8de8-b448c9dfeff5 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:19.911449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175bf1b-f20e-4e51-8de8-b448c9dfeff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:19.911720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175bf1b-f20e-4e51-8de8-b448c9dfeff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:19.951297 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1906/3836] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:19.952713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc6d31-9e9f-4ef5-b115-efff313598b1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:19.972252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc6d31-9e9f-4ef5-b115-efff313598b1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:19.990686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e4d96-f22f-4973-b8c7-8d19ccbaf753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:19.991765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e4d96-f22f-4973-b8c7-8d19ccbaf753 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:19.993580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e4d96-f22f-4973-b8c7-8d19ccbaf753 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:19.993580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e4d96-f22f-4973-b8c7-8d19ccbaf753 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:19.996597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e4d96-f22f-4973-b8c7-8d19ccbaf753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:19.998446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e4d96-f22f-4973-b8c7-8d19ccbaf753 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:20.041503 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1907/3837] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:20.053507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d9187-2fc9-4729-8c8e-d56858c48124 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:20.055080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d9187-2fc9-4729-8c8e-d56858c48124 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:20.056906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d9187-2fc9-4729-8c8e-d56858c48124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:20.059145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:20.144532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-593d9187-2fc9-4729-8c8e-d56858c48124 None None] MFA Rules not processed for user `177c105f6d484e8abfeb9bc118a1260d`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:20.149793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-593d9187-2fc9-4729-8c8e-d56858c48124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:20.168692 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1908/3838] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:20.170029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d9187-2fc9-4729-8c8e-d56858c48124 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:20.199642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d9187-2fc9-4729-8c8e-d56858c48124 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:20.201529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175bf1b-f20e-4e51-8de8-b448c9dfeff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:20.209469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfa098-391a-4039-a9d6-9411bc72bace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:20.210357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfa098-391a-4039-a9d6-9411bc72bace service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:20.210467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175bf1b-f20e-4e51-8de8-b448c9dfeff5 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:20.210991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfa098-391a-4039-a9d6-9411bc72bace service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:20.211464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfa098-391a-4039-a9d6-9411bc72bace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:20.236294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfa098-391a-4039-a9d6-9411bc72bace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:20.241711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfa098-391a-4039-a9d6-9411bc72bace service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:20.241873 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1931/3839] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:20.242608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175bf1b-f20e-4e51-8de8-b448c9dfeff5 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:20.266216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175bf1b-f20e-4e51-8de8-b448c9dfeff5 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:20.269416 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1909/3840] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:20.273147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfa098-391a-4039-a9d6-9411bc72bace service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:20.277084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-98bfa098-391a-4039-a9d6-9411bc72bace service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:20.285317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cf55d-1575-48e7-b327-88c1e6c45a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:20.289539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cf55d-1575-48e7-b327-88c1e6c45a3f admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:20.291245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cf55d-1575-48e7-b327-88c1e6c45a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:20.291717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cf55d-1575-48e7-b327-88c1e6c45a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:20.297511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423cf55d-1575-48e7-b327-88c1e6c45a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:20.301866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423cf55d-1575-48e7-b327-88c1e6c45a3f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:20.340732 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1932/3841] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:20.343532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cf55d-1575-48e7-b327-88c1e6c45a3f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:20.370279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cf55d-1575-48e7-b327-88c1e6c45a3f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:20.379706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becdae5-10e7-443b-a5a3-0bd7eaca6899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:20.380550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becdae5-10e7-443b-a5a3-0bd7eaca6899 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:20.380845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becdae5-10e7-443b-a5a3-0bd7eaca6899 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:20.381121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becdae5-10e7-443b-a5a3-0bd7eaca6899 admin admin] PATH_INFO: `/v3/projects/bd8211065c4d4f9b88bbcb0648f29ae9/users/9309ee18ace24551aff055cc59b8c545/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:20.423440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becdae5-10e7-443b-a5a3-0bd7eaca6899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8211065c4d4f9b88bbcb0648f29ae9, user_id=9309ee18ace24551aff055cc59b8c545, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:20.428773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becdae5-10e7-443b-a5a3-0bd7eaca6899 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:20.511550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfa098-391a-4039-a9d6-9411bc72bace service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:20.529679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a8b52-f98c-481c-a755-b6e5aff7c447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:20.530644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a8b52-f98c-481c-a755-b6e5aff7c447 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:20.531016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a8b52-f98c-481c-a755-b6e5aff7c447 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:20.531390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a8b52-f98c-481c-a755-b6e5aff7c447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:20.575273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a8b52-f98c-481c-a755-b6e5aff7c447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:20.579907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a8b52-f98c-481c-a755-b6e5aff7c447 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:20.587124 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1933/3842] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:20 2022] PUT /identity/v3/projects/bd8211065c4d4f9b88bbcb0648f29ae9/users/9309ee18ace24551aff055cc59b8c545/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:20.597724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989c32b-312c-4ebd-9973-80b118e46a08 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:20.598009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989c32b-312c-4ebd-9973-80b118e46a08 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:20.598288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989c32b-312c-4ebd-9973-80b118e46a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:20.604541 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1910/3843] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:20 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:20.688543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6989c32b-312c-4ebd-9973-80b118e46a08 None None] MFA Rules not processed for user `9309ee18ace24551aff055cc59b8c545`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:20.691688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6989c32b-312c-4ebd-9973-80b118e46a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:21.018557 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1934/3844] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:21.026611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a8b52-f98c-481c-a755-b6e5aff7c447 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:21.045868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a8b52-f98c-481c-a755-b6e5aff7c447 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:21.135241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:21.211056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c10e9-782f-4bfe-a2ac-248a5301b482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:21.225585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c10e9-782f-4bfe-a2ac-248a5301b482 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:21.226051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c10e9-782f-4bfe-a2ac-248a5301b482 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:21.226346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c10e9-782f-4bfe-a2ac-248a5301b482 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:21.227401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c10e9-782f-4bfe-a2ac-248a5301b482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:21.230705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c10e9-782f-4bfe-a2ac-248a5301b482 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:21.401633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989c32b-312c-4ebd-9973-80b118e46a08 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:21.412638 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1911/3845] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:21 2022] POST /identity/v3/projects => generated 381 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:21.416090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989c32b-312c-4ebd-9973-80b118e46a08 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:21.419134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:21.540907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268797dd-13c1-47cb-8cce-ec244df6004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:21.541673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268797dd-13c1-47cb-8cce-ec244df6004b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:21.542017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268797dd-13c1-47cb-8cce-ec244df6004b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:21.542353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268797dd-13c1-47cb-8cce-ec244df6004b admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:21.543173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268797dd-13c1-47cb-8cce-ec244df6004b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:21.546216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268797dd-13c1-47cb-8cce-ec244df6004b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:21.646197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a7e7a-9849-460b-8ca9-d5791fdc4ed5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:21.646197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a7e7a-9849-460b-8ca9-d5791fdc4ed5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:21.646197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a7e7a-9849-460b-8ca9-d5791fdc4ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:21.675979 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1935/3846] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:21 2022] POST /identity/v3/users => generated 291 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:21.677165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268797dd-13c1-47cb-8cce-ec244df6004b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:21.712359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268797dd-13c1-47cb-8cce-ec244df6004b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:21.739824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b7e9e-e6db-48cb-86a5-c75ecc888d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:21.743411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b7e9e-e6db-48cb-86a5-c75ecc888d4e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:21.746248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b7e9e-e6db-48cb-86a5-c75ecc888d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:21.747047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b7e9e-e6db-48cb-86a5-c75ecc888d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:21.748717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b7e9e-e6db-48cb-86a5-c75ecc888d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:21.750249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-220a7e7a-9849-460b-8ca9-d5791fdc4ed5 None None] MFA Rules not processed for user `5dd6f28443ba41e1923d26a4e67b51aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:21.754641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-220a7e7a-9849-460b-8ca9-d5791fdc4ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:21.757029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b7e9e-e6db-48cb-86a5-c75ecc888d4e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:21.786591 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1936/3847] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:21.790601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b7e9e-e6db-48cb-86a5-c75ecc888d4e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:21.800991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b7e9e-e6db-48cb-86a5-c75ecc888d4e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:21.805960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a939dcc-17f5-4314-a9c8-c94c45250591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:21.806764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a939dcc-17f5-4314-a9c8-c94c45250591 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:21.807077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a939dcc-17f5-4314-a9c8-c94c45250591 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:21.807424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a939dcc-17f5-4314-a9c8-c94c45250591 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:21.808073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a939dcc-17f5-4314-a9c8-c94c45250591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:21.809804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a939dcc-17f5-4314-a9c8-c94c45250591 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:21.822919 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1937/3848] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:21.828514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a939dcc-17f5-4314-a9c8-c94c45250591 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:21.860340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a939dcc-17f5-4314-a9c8-c94c45250591 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:21.867894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097be0eb-9b4c-424b-9cc8-0c93805c0927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:21.869902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097be0eb-9b4c-424b-9cc8-0c93805c0927 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:21.883006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097be0eb-9b4c-424b-9cc8-0c93805c0927 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:21.883981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097be0eb-9b4c-424b-9cc8-0c93805c0927 admin admin] PATH_INFO: `/v3/projects/73abe1b324174d2d8b6ea36e0dfa96f3/users/d39eef2a33394f148b707b357c802b1b/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:21.920199 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1912/3849] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:21.923561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999da25-8401-4cdb-b990-9f8a222c0ea7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:21.923715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999da25-8401-4cdb-b990-9f8a222c0ea7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:21.924239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999da25-8401-4cdb-b990-9f8a222c0ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:21.954286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097be0eb-9b4c-424b-9cc8-0c93805c0927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73abe1b324174d2d8b6ea36e0dfa96f3, user_id=d39eef2a33394f148b707b357c802b1b, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:21.960274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097be0eb-9b4c-424b-9cc8-0c93805c0927 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:21.967524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d999da25-8401-4cdb-b990-9f8a222c0ea7 None None] MFA Rules not processed for user `5dd6f28443ba41e1923d26a4e67b51aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:21.969061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d999da25-8401-4cdb-b990-9f8a222c0ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:21.984425 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1913/3850] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:21.997752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999da25-8401-4cdb-b990-9f8a222c0ea7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:21.999376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d999da25-8401-4cdb-b990-9f8a222c0ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:22.076841 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1938/3851] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:21 2022] PUT /identity/v3/projects/73abe1b324174d2d8b6ea36e0dfa96f3/users/d39eef2a33394f148b707b357c802b1b/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:47:22.079179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c667b52-b274-475b-93b5-3f1e37e8cb8b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:22.079641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c667b52-b274-475b-93b5-3f1e37e8cb8b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:22.080762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c667b52-b274-475b-93b5-3f1e37e8cb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:22.100845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-6c667b52-b274-475b-93b5-3f1e37e8cb8b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:47:22.100845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:47:22.100845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:47:22.100845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:47:22.100845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:47:22.100845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:47:22.100845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:47:22.100845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:47:22.100845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:47:22.100845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:47:22.100845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:47:22.100845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:47:22.100845 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:47:22.114082 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:47:22.114082 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:47:22.114082 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:47:22.114082 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:47:22.114082 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:47:22.114082 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:47:22.114082 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:47:22.114082 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:47:22.114082 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:47:22.114082 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:47:22.114082 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:47:22.114082 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:47:22.114082 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:47:22.114082 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:47:22.114082 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:47:22.120492 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1939/3852] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:47:22 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 25 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:47:22.120492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11ac0e-71bb-4ed2-988d-f631078f5b3f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:22.120492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11ac0e-71bb-4ed2-988d-f631078f5b3f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:22.120492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11ac0e-71bb-4ed2-988d-f631078f5b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:22.132236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999da25-8401-4cdb-b990-9f8a222c0ea7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:22.201111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4f11ac0e-71bb-4ed2-988d-f631078f5b3f None None] MFA Rules not processed for user `d39eef2a33394f148b707b357c802b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:22.202773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4f11ac0e-71bb-4ed2-988d-f631078f5b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:22.265583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:22.302073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5839ec-8529-4ba2-8e47-71c4f718aad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:22.303555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5839ec-8529-4ba2-8e47-71c4f718aad8 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:22.323064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5839ec-8529-4ba2-8e47-71c4f718aad8 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:22.323415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5839ec-8529-4ba2-8e47-71c4f718aad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:22.388334 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1940/3853] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:22.388334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fec36-671a-4081-b6a6-1d6c7ea5f9ff None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:22.388334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fec36-671a-4081-b6a6-1d6c7ea5f9ff None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:22.388960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fec36-671a-4081-b6a6-1d6c7ea5f9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:22.421505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5839ec-8529-4ba2-8e47-71c4f718aad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:22.424818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5839ec-8529-4ba2-8e47-71c4f718aad8 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:22.447754 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1914/3854] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:47:22.455913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b72fec36-671a-4081-b6a6-1d6c7ea5f9ff None None] MFA Rules not processed for user `7c73bd94a9954b559161544afb5b5555`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:22.457422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b72fec36-671a-4081-b6a6-1d6c7ea5f9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:22.471564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5839ec-8529-4ba2-8e47-71c4f718aad8 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:22.607268 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1941/3855] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:22.607268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12ac12-120d-4eb8-b20a-78d14781385d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:22.607268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12ac12-120d-4eb8-b20a-78d14781385d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:22.607268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12ac12-120d-4eb8-b20a-78d14781385d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:22.627687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5b12ac12-120d-4eb8-b20a-78d14781385d None None] MFA Rules not processed for user `7c73bd94a9954b559161544afb5b5555`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:22.636105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5b12ac12-120d-4eb8-b20a-78d14781385d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:22.665410 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1942/3856] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:22.665626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5839ec-8529-4ba2-8e47-71c4f718aad8 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:22.665626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c470e-ccc6-40e8-91b5-23af36ec8706 tempest-IdentityV3ProjectsTest-986113611 tempest-IdentityV3ProjectsTest-986113611-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9309ee18ace24551aff055cc59b8c545', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8211065c4d4f9b88bbcb0648f29ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:22.667716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c470e-ccc6-40e8-91b5-23af36ec8706 tempest-IdentityV3ProjectsTest-986113611 tempest-IdentityV3ProjectsTest-986113611-project] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:22.668010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c470e-ccc6-40e8-91b5-23af36ec8706 tempest-IdentityV3ProjectsTest-986113611 tempest-IdentityV3ProjectsTest-986113611-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:22.668308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c470e-ccc6-40e8-91b5-23af36ec8706 tempest-IdentityV3ProjectsTest-986113611 tempest-IdentityV3ProjectsTest-986113611-project] PATH_INFO: `/v3/users/9309ee18ace24551aff055cc59b8c545/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:22.669288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12ac12-120d-4eb8-b20a-78d14781385d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:22.670875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c470e-ccc6-40e8-91b5-23af36ec8706 tempest-IdentityV3ProjectsTest-986113611 tempest-IdentityV3ProjectsTest-986113611-project] RBAC: Authorizing `identity:list_user_projects(user_id=9309ee18ace24551aff055cc59b8c545)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:22.673417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c470e-ccc6-40e8-91b5-23af36ec8706 tempest-IdentityV3ProjectsTest-986113611 tempest-IdentityV3ProjectsTest-986113611-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:22.705321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12ac12-120d-4eb8-b20a-78d14781385d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:22.707652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d322c-4755-4d18-818b-326cfacba430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:22.708332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d322c-4755-4d18-818b-326cfacba430 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:22.708614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d322c-4755-4d18-818b-326cfacba430 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:22.708886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d322c-4755-4d18-818b-326cfacba430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:22.726690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d322c-4755-4d18-818b-326cfacba430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:22.728816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d322c-4755-4d18-818b-326cfacba430 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:22.761119 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1943/3857] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:22.811804 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1915/3858] 10.222.0.76 () {58 vars in 1248 bytes} [Sat Aug 27 04:47:22 2022] GET /identity/v3/users/9309ee18ace24551aff055cc59b8c545/projects => generated 515 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:22.816121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91c7de-31c1-4505-a4c7-61aa63ac478c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:22.816431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91c7de-31c1-4505-a4c7-61aa63ac478c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:22.816702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91c7de-31c1-4505-a4c7-61aa63ac478c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:22.829053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:22.868936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5e91c7de-31c1-4505-a4c7-61aa63ac478c None None] MFA Rules not processed for user `9309ee18ace24551aff055cc59b8c545`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:22.869187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5e91c7de-31c1-4505-a4c7-61aa63ac478c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:22.890195 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1944/3859] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:22.895723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecdf94-36ef-42bc-b0b6-fefc5c09dd3a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:22.900497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecdf94-36ef-42bc-b0b6-fefc5c09dd3a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:22.900497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecdf94-36ef-42bc-b0b6-fefc5c09dd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:22.940827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-00ecdf94-36ef-42bc-b0b6-fefc5c09dd3a None None] MFA Rules not processed for user `9309ee18ace24551aff055cc59b8c545`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:22.942453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-00ecdf94-36ef-42bc-b0b6-fefc5c09dd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:23.060967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.models.token_model [None req-00ecdf94-36ef-42bc-b0b6-fefc5c09dd3a None None] User 9309ee18ace24551aff055cc59b8c545 has no access to project 73abe1b324174d2d8b6ea36e0dfa96f3 {{(pid=82082) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Aug 27 04:47:23.066115 n-d-852088-5 devstack@keystone.service[82082]: WARNING keystone.server.flask.application [None req-00ecdf94-36ef-42bc-b0b6-fefc5c09dd3a None None] Authorization failed. The request you have made requires authentication. from 10.222.0.76: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 27 04:47:23.068012 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1916/3860] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:22 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 174 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 27 04:47:23.074713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91c7de-31c1-4505-a4c7-61aa63ac478c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:23.211829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91c7de-31c1-4505-a4c7-61aa63ac478c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:23.223678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c566e8d-782b-432b-b583-0136508cfd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:23.224373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c566e8d-782b-432b-b583-0136508cfd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:23.224643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c566e8d-782b-432b-b583-0136508cfd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:23.224919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c566e8d-782b-432b-b583-0136508cfd49 admin admin] PATH_INFO: `/v3/users/9309ee18ace24551aff055cc59b8c545` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:23.232388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c566e8d-782b-432b-b583-0136508cfd49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9309ee18ace24551aff055cc59b8c545)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:23.234396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c566e8d-782b-432b-b583-0136508cfd49 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:23.301088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2539508-586b-485d-8db8-b6be6a992f38 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:23.302387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2539508-586b-485d-8db8-b6be6a992f38 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:23.302858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2539508-586b-485d-8db8-b6be6a992f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:23.317375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-f2539508-586b-485d-8db8-b6be6a992f38 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:47:23.317375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:47:23.317375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:47:23.317375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:47:23.317375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:47:23.317375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:47:23.317375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:47:23.317375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:47:23.317375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:47:23.317375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:47:23.317375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:47:23.317375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:47:23.317375 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:47:23.322568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:47:23.322568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:47:23.322568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:47:23.322568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:47:23.322568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:47:23.322568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:47:23.322568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:47:23.322568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:47:23.322568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:47:23.322568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:47:23.322568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:47:23.322568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:47:23.322568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:47:23.322568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:47:23.322568 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:47:23.331539 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1917/3861] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:47:23 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 21 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:47:23.491169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4c566e8d-782b-432b-b583-0136508cfd49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9309ee18ace24551aff055cc59b8c545'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:23.492210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4c566e8d-782b-432b-b583-0136508cfd49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9309ee18ace24551aff055cc59b8c545'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:23.568856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4c566e8d-782b-432b-b583-0136508cfd49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9309ee18ace24551aff055cc59b8c545'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:23.569498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4c566e8d-782b-432b-b583-0136508cfd49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9309ee18ace24551aff055cc59b8c545'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:23.604972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4c566e8d-782b-432b-b583-0136508cfd49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9309ee18ace24551aff055cc59b8c545'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:23.627776 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1945/3862] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:47:23 2022] DELETE /identity/v3/users/9309ee18ace24551aff055cc59b8c545 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:23.631915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2c6ef-b7eb-4775-9f26-38263858299e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:23.632510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2c6ef-b7eb-4775-9f26-38263858299e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:23.632510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2c6ef-b7eb-4775-9f26-38263858299e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:23.683440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-74f2c6ef-b7eb-4775-9f26-38263858299e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:23.683440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-74f2c6ef-b7eb-4775-9f26-38263858299e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:23.853920 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1918/3863] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:24.046664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c566e8d-782b-432b-b583-0136508cfd49 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:24.048764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4c566e8d-782b-432b-b583-0136508cfd49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:24.166692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c566e8d-782b-432b-b583-0136508cfd49 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:24.192955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f832f3-0be8-46eb-932e-b60a8120c4a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:24.197271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f832f3-0be8-46eb-932e-b60a8120c4a4 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:24.197271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f832f3-0be8-46eb-932e-b60a8120c4a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:24.197271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f832f3-0be8-46eb-932e-b60a8120c4a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:24.210872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f832f3-0be8-46eb-932e-b60a8120c4a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:24.212662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f832f3-0be8-46eb-932e-b60a8120c4a4 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:24.248751 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1946/3864] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:24.283756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:24.934020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:25.743576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2c6ef-b7eb-4775-9f26-38263858299e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:25.745353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-74f2c6ef-b7eb-4775-9f26-38263858299e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:25.764243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2c6ef-b7eb-4775-9f26-38263858299e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:25.776987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb34c3f-becf-4e56-8d9e-d65706504c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:25.778262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb34c3f-becf-4e56-8d9e-d65706504c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:25.778714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb34c3f-becf-4e56-8d9e-d65706504c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:25.779146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb34c3f-becf-4e56-8d9e-d65706504c38 admin admin] PATH_INFO: `/v3/users/7c73bd94a9954b559161544afb5b5555` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:25.781526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb34c3f-becf-4e56-8d9e-d65706504c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c73bd94a9954b559161544afb5b5555)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:25.785817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb34c3f-becf-4e56-8d9e-d65706504c38 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:26.061303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-efb34c3f-becf-4e56-8d9e-d65706504c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c73bd94a9954b559161544afb5b5555'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:26.169835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-efb34c3f-becf-4e56-8d9e-d65706504c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c73bd94a9954b559161544afb5b5555'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:26.171013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-efb34c3f-becf-4e56-8d9e-d65706504c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c73bd94a9954b559161544afb5b5555'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:26.184285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-efb34c3f-becf-4e56-8d9e-d65706504c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c73bd94a9954b559161544afb5b5555'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:26.208012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-efb34c3f-becf-4e56-8d9e-d65706504c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c73bd94a9954b559161544afb5b5555'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:26.224258 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1919/3865] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:47:25 2022] DELETE /identity/v3/users/7c73bd94a9954b559161544afb5b5555 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:26.471598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:26.972804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=83,keystone:DELETE=11,keystone:INSERT=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:27.672419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f832f3-0be8-46eb-932e-b60a8120c4a4 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:27.675775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-35f832f3-0be8-46eb-932e-b60a8120c4a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:27.722013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f832f3-0be8-46eb-932e-b60a8120c4a4 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:27.838469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5c81c-3089-47f7-951e-4716cf708309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:27.839624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5c81c-3089-47f7-951e-4716cf708309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:27.840079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5c81c-3089-47f7-951e-4716cf708309 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:27.840563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5c81c-3089-47f7-951e-4716cf708309 admin admin] PATH_INFO: `/v3/projects/bd8211065c4d4f9b88bbcb0648f29ae9` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:27.842059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5c81c-3089-47f7-951e-4716cf708309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8211065c4d4f9b88bbcb0648f29ae9)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:27.844985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5c81c-3089-47f7-951e-4716cf708309 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:27.942487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb34c3f-becf-4e56-8d9e-d65706504c38 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:27.944663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-efb34c3f-becf-4e56-8d9e-d65706504c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:27.979476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb34c3f-becf-4e56-8d9e-d65706504c38 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:27.987496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecabd63-37fe-4c29-b96f-027d784ec997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:27.989328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecabd63-37fe-4c29-b96f-027d784ec997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:27.992265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecabd63-37fe-4c29-b96f-027d784ec997 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:27.992820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecabd63-37fe-4c29-b96f-027d784ec997 admin admin] PATH_INFO: `/v3/projects/c01c4dacccbe4617bb1878ed965492df` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:27.994483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecabd63-37fe-4c29-b96f-027d784ec997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c01c4dacccbe4617bb1878ed965492df)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:27.996739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecabd63-37fe-4c29-b96f-027d784ec997 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:28.085131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-64d5c81c-3089-47f7-951e-4716cf708309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8211065c4d4f9b88bbcb0648f29ae9', 'request_id': 'req-64d5c81c-3089-47f7-951e-4716cf708309'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:28.117220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-64d5c81c-3089-47f7-951e-4716cf708309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8211065c4d4f9b88bbcb0648f29ae9', 'request_id': 'req-64d5c81c-3089-47f7-951e-4716cf708309'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:28.224986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-64d5c81c-3089-47f7-951e-4716cf708309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8211065c4d4f9b88bbcb0648f29ae9', 'request_id': 'req-64d5c81c-3089-47f7-951e-4716cf708309'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:28.247596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-64d5c81c-3089-47f7-951e-4716cf708309 admin admin] The token cache is being invalidate because project bd8211065c4d4f9b88bbcb0648f29ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:28.248269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-64d5c81c-3089-47f7-951e-4716cf708309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:28.250641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-64d5c81c-3089-47f7-951e-4716cf708309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:28.253461 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1947/3866] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:27 2022] DELETE /identity/v3/projects/bd8211065c4d4f9b88bbcb0648f29ae9 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:28.257908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5c81c-3089-47f7-951e-4716cf708309 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:28.261179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-64d5c81c-3089-47f7-951e-4716cf708309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:28.270527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:28.317490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aecabd63-37fe-4c29-b96f-027d784ec997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c01c4dacccbe4617bb1878ed965492df', 'request_id': 'req-aecabd63-37fe-4c29-b96f-027d784ec997'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:28.336616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aecabd63-37fe-4c29-b96f-027d784ec997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c01c4dacccbe4617bb1878ed965492df', 'request_id': 'req-aecabd63-37fe-4c29-b96f-027d784ec997'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:28.352231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aecabd63-37fe-4c29-b96f-027d784ec997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c01c4dacccbe4617bb1878ed965492df', 'request_id': 'req-aecabd63-37fe-4c29-b96f-027d784ec997'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:28.389550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5c81c-3089-47f7-951e-4716cf708309 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:28.441377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aecabd63-37fe-4c29-b96f-027d784ec997 admin admin] The token cache is being invalidate because project c01c4dacccbe4617bb1878ed965492df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:28.441948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aecabd63-37fe-4c29-b96f-027d784ec997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:28.443514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aecabd63-37fe-4c29-b96f-027d784ec997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:28.451244 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1920/3867] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:27 2022] DELETE /identity/v3/projects/c01c4dacccbe4617bb1878ed965492df => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:28.453088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732e7e-6b13-47f7-bb89-c83310cfcd98 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:28.455621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732e7e-6b13-47f7-bb89-c83310cfcd98 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:28.458506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732e7e-6b13-47f7-bb89-c83310cfcd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:28.463875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:28.475375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc98aac-7710-4264-8931-58e3b4d6f829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:28.476031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc98aac-7710-4264-8931-58e3b4d6f829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:28.476355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc98aac-7710-4264-8931-58e3b4d6f829 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:28.476616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc98aac-7710-4264-8931-58e3b4d6f829 admin admin] PATH_INFO: `/v3/users/d39eef2a33394f148b707b357c802b1b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:28.480967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc98aac-7710-4264-8931-58e3b4d6f829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39eef2a33394f148b707b357c802b1b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:28.486347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc98aac-7710-4264-8931-58e3b4d6f829 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:28.552028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-93732e7e-6b13-47f7-bb89-c83310cfcd98 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:28.566843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-93732e7e-6b13-47f7-bb89-c83310cfcd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:28.597094 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1921/3868] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:28.606506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c559bc-8d0d-4cf5-8909-023ba88b0038 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:28.606858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c559bc-8d0d-4cf5-8909-023ba88b0038 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:28.608143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c559bc-8d0d-4cf5-8909-023ba88b0038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:28.640522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-75c559bc-8d0d-4cf5-8909-023ba88b0038 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:28.666557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-75c559bc-8d0d-4cf5-8909-023ba88b0038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:28.679631 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1922/3869] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:28.687514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c559bc-8d0d-4cf5-8909-023ba88b0038 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:28.711018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c559bc-8d0d-4cf5-8909-023ba88b0038 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:28.719120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a12876-cd43-4a9c-b16c-55a96d0761cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:28.720814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a12876-cd43-4a9c-b16c-55a96d0761cf admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:28.721610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a12876-cd43-4a9c-b16c-55a96d0761cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:28.721610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a12876-cd43-4a9c-b16c-55a96d0761cf admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:28.722392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a12876-cd43-4a9c-b16c-55a96d0761cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:28.722774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a12876-cd43-4a9c-b16c-55a96d0761cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:28.724539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a12876-cd43-4a9c-b16c-55a96d0761cf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:28.756093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0dc98aac-7710-4264-8931-58e3b4d6f829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39eef2a33394f148b707b357c802b1b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:28.758813 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1923/3870] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:47:28.762741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0dc98aac-7710-4264-8931-58e3b4d6f829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39eef2a33394f148b707b357c802b1b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:28.763295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a12876-cd43-4a9c-b16c-55a96d0761cf admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:28.788874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a12876-cd43-4a9c-b16c-55a96d0761cf admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:28.807670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240eb831-3628-4f35-a8a6-0f5c7484de14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:28.809404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240eb831-3628-4f35-a8a6-0f5c7484de14 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:28.809918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240eb831-3628-4f35-a8a6-0f5c7484de14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:28.810615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240eb831-3628-4f35-a8a6-0f5c7484de14 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:28.812041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240eb831-3628-4f35-a8a6-0f5c7484de14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:28.821202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240eb831-3628-4f35-a8a6-0f5c7484de14 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:28.863190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0dc98aac-7710-4264-8931-58e3b4d6f829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39eef2a33394f148b707b357c802b1b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:28.864108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0dc98aac-7710-4264-8931-58e3b4d6f829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39eef2a33394f148b707b357c802b1b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:28.905306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0dc98aac-7710-4264-8931-58e3b4d6f829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39eef2a33394f148b707b357c802b1b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:28.935480 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1948/3871] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:47:28 2022] DELETE /identity/v3/users/d39eef2a33394f148b707b357c802b1b => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:29.032511 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1924/3872] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:28 2022] POST /identity/v3/projects => generated 387 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:29.033658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc98aac-7710-4264-8931-58e3b4d6f829 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:29.038107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0dc98aac-7710-4264-8931-58e3b4d6f829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:29.160483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc98aac-7710-4264-8931-58e3b4d6f829 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:29.263793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:29.287508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00b922-e31e-4f1b-824f-a4f042cccb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:29.288464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00b922-e31e-4f1b-824f-a4f042cccb9f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:29.288874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00b922-e31e-4f1b-824f-a4f042cccb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:29.291715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00b922-e31e-4f1b-824f-a4f042cccb9f admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:29.292572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00b922-e31e-4f1b-824f-a4f042cccb9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:29.295106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00b922-e31e-4f1b-824f-a4f042cccb9f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:29.430711 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1949/3873] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:29 2022] POST /identity/v3/users => generated 294 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:47:29.435058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240eb831-3628-4f35-a8a6-0f5c7484de14 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:29.451071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240eb831-3628-4f35-a8a6-0f5c7484de14 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:29.466231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96561d0f-8d8c-4597-88e8-6a38d32e02cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:29.466984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96561d0f-8d8c-4597-88e8-6a38d32e02cf admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:29.467338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96561d0f-8d8c-4597-88e8-6a38d32e02cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:29.467687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96561d0f-8d8c-4597-88e8-6a38d32e02cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:29.468449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96561d0f-8d8c-4597-88e8-6a38d32e02cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:29.470157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96561d0f-8d8c-4597-88e8-6a38d32e02cf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:29.504013 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1925/3874] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:29.505784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00b922-e31e-4f1b-824f-a4f042cccb9f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:29.518824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00b922-e31e-4f1b-824f-a4f042cccb9f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:29.531528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b43d16-1123-4c5e-aa37-b1b345c02572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:29.532498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b43d16-1123-4c5e-aa37-b1b345c02572 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:29.533628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b43d16-1123-4c5e-aa37-b1b345c02572 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:29.535248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b43d16-1123-4c5e-aa37-b1b345c02572 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:29.536153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b43d16-1123-4c5e-aa37-b1b345c02572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:29.538703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b43d16-1123-4c5e-aa37-b1b345c02572 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:29.556001 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1950/3875] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:29.560375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96561d0f-8d8c-4597-88e8-6a38d32e02cf admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:29.572096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:29.577845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96561d0f-8d8c-4597-88e8-6a38d32e02cf admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:29.586700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b15cc8-112c-44d3-9793-152ff9621ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:29.587738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b15cc8-112c-44d3-9793-152ff9621ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:29.588430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b15cc8-112c-44d3-9793-152ff9621ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:29.588885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b15cc8-112c-44d3-9793-152ff9621ceb admin admin] PATH_INFO: `/v3/projects/5c9eb4bbda084c9d8f1503b888a2ddfb/users/8af9568c510340c1adfcafe10ae44002/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:29.618192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b15cc8-112c-44d3-9793-152ff9621ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9eb4bbda084c9d8f1503b888a2ddfb, user_id=8af9568c510340c1adfcafe10ae44002, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:29.626232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b15cc8-112c-44d3-9793-152ff9621ceb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:29.722622 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1926/3876] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:29 2022] PUT /identity/v3/projects/5c9eb4bbda084c9d8f1503b888a2ddfb/users/8af9568c510340c1adfcafe10ae44002/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:29.723697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec46090-533b-4523-83bc-014a1bf64207 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:29.724085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec46090-533b-4523-83bc-014a1bf64207 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:29.724456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec46090-533b-4523-83bc-014a1bf64207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:29.750901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-eec46090-533b-4523-83bc-014a1bf64207 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:29.752271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-eec46090-533b-4523-83bc-014a1bf64207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:29.904425 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1951/3877] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:29.921841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b15cc8-112c-44d3-9793-152ff9621ceb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:29.924279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a9b15cc8-112c-44d3-9793-152ff9621ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:30.074476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b15cc8-112c-44d3-9793-152ff9621ceb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:30.086336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a0409-6951-4e5f-8721-e9268ae6de02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:30.087740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a0409-6951-4e5f-8721-e9268ae6de02 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:30.088238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a0409-6951-4e5f-8721-e9268ae6de02 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:30.088666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a0409-6951-4e5f-8721-e9268ae6de02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:30.107096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a0409-6951-4e5f-8721-e9268ae6de02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:30.110401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a0409-6951-4e5f-8721-e9268ae6de02 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:30.124943 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1927/3878] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:30.159026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec46090-533b-4523-83bc-014a1bf64207 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:30.162133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-eec46090-533b-4523-83bc-014a1bf64207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:30.215324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec46090-533b-4523-83bc-014a1bf64207 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:30.230810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e18c05-5360-4c05-b38e-b822770fe255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:30.232400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e18c05-5360-4c05-b38e-b822770fe255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:30.232870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e18c05-5360-4c05-b38e-b822770fe255 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:30.233322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e18c05-5360-4c05-b38e-b822770fe255 admin admin] PATH_INFO: `/v3/projects/73abe1b324174d2d8b6ea36e0dfa96f3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:30.236253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e18c05-5360-4c05-b38e-b822770fe255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73abe1b324174d2d8b6ea36e0dfa96f3)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:30.241597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e18c05-5360-4c05-b38e-b822770fe255 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:30.283645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:30.432257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-57e18c05-5360-4c05-b38e-b822770fe255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73abe1b324174d2d8b6ea36e0dfa96f3', 'request_id': 'req-57e18c05-5360-4c05-b38e-b822770fe255'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:30.451845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-57e18c05-5360-4c05-b38e-b822770fe255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73abe1b324174d2d8b6ea36e0dfa96f3', 'request_id': 'req-57e18c05-5360-4c05-b38e-b822770fe255'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:30.562366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-57e18c05-5360-4c05-b38e-b822770fe255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73abe1b324174d2d8b6ea36e0dfa96f3', 'request_id': 'req-57e18c05-5360-4c05-b38e-b822770fe255'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:30.578608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:30.599421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-57e18c05-5360-4c05-b38e-b822770fe255 admin admin] The token cache is being invalidate because project 73abe1b324174d2d8b6ea36e0dfa96f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:30.600413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-57e18c05-5360-4c05-b38e-b822770fe255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:30.602805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-57e18c05-5360-4c05-b38e-b822770fe255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:30.609138 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1952/3879] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:30 2022] DELETE /identity/v3/projects/73abe1b324174d2d8b6ea36e0dfa96f3 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:30.612936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14bf0b-1196-48c2-a3df-aaf216052451 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:30.613439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14bf0b-1196-48c2-a3df-aaf216052451 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:30.613910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14bf0b-1196-48c2-a3df-aaf216052451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:30.658934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2b14bf0b-1196-48c2-a3df-aaf216052451 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:30.660519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2b14bf0b-1196-48c2-a3df-aaf216052451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:30.732186 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1928/3880] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:30.741738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88aec7-8882-424f-95d1-73b321446ae4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:30.742377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88aec7-8882-424f-95d1-73b321446ae4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:30.742756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88aec7-8882-424f-95d1-73b321446ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:30.807387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ef88aec7-8882-424f-95d1-73b321446ae4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:30.811009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ef88aec7-8882-424f-95d1-73b321446ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:30.860480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14bf0b-1196-48c2-a3df-aaf216052451 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:30.872504 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1953/3881] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:30.875508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14bf0b-1196-48c2-a3df-aaf216052451 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:30.884754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4586f-c502-468d-8df1-cde9acf0c8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:30.887393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4586f-c502-468d-8df1-cde9acf0c8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:30.887718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4586f-c502-468d-8df1-cde9acf0c8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:30.888047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4586f-c502-468d-8df1-cde9acf0c8f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:30.888839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4586f-c502-468d-8df1-cde9acf0c8f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:30.889148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4586f-c502-468d-8df1-cde9acf0c8f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:30.891712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4586f-c502-468d-8df1-cde9acf0c8f8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:30.946366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88aec7-8882-424f-95d1-73b321446ae4 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:30.955873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88aec7-8882-424f-95d1-73b321446ae4 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:30.956564 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1929/3882] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:30.968862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aba36-2e90-48b0-8b12-1196f198b2f4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:30.969154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aba36-2e90-48b0-8b12-1196f198b2f4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:30.969433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aba36-2e90-48b0-8b12-1196f198b2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:30.985707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80b798-e164-49cc-8598-f3f8d9a39491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:30.989510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80b798-e164-49cc-8598-f3f8d9a39491 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:30.989861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80b798-e164-49cc-8598-f3f8d9a39491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:30.990134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80b798-e164-49cc-8598-f3f8d9a39491 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:30.990811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80b798-e164-49cc-8598-f3f8d9a39491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:31.001024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80b798-e164-49cc-8598-f3f8d9a39491 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:31.074227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-552aba36-2e90-48b0-8b12-1196f198b2f4 None None] MFA Rules not processed for user `59fbc90b125c402bbee94241a3a609d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:31.077740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-552aba36-2e90-48b0-8b12-1196f198b2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:31.132036 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1954/3883] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:30 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:31.136010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80b798-e164-49cc-8598-f3f8d9a39491 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:31.207551 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1930/3884] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:31.223132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552aba36-2e90-48b0-8b12-1196f198b2f4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:31.225366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-552aba36-2e90-48b0-8b12-1196f198b2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:31.294069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80b798-e164-49cc-8598-f3f8d9a39491 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:31.316483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231db91-1331-4bd2-ad75-7d8f2628252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:31.317934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231db91-1331-4bd2-ad75-7d8f2628252e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:31.318566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231db91-1331-4bd2-ad75-7d8f2628252e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:31.319036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231db91-1331-4bd2-ad75-7d8f2628252e admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:31.320243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231db91-1331-4bd2-ad75-7d8f2628252e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:31.324615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231db91-1331-4bd2-ad75-7d8f2628252e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:31.383057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552aba36-2e90-48b0-8b12-1196f198b2f4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:31.453138 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1955/3885] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:31 2022] POST /identity/v3/users => generated 299 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:47:31.454347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231db91-1331-4bd2-ad75-7d8f2628252e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:31.486747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231db91-1331-4bd2-ad75-7d8f2628252e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:31.499267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c964d5d-1802-4869-b977-eb23c72b0e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:31.501460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c964d5d-1802-4869-b977-eb23c72b0e73 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:31.502374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c964d5d-1802-4869-b977-eb23c72b0e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:31.504076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c964d5d-1802-4869-b977-eb23c72b0e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:31.505469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c964d5d-1802-4869-b977-eb23c72b0e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:31.508103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c964d5d-1802-4869-b977-eb23c72b0e73 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:31.511785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:31.535059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f90fd-e017-4f72-9b76-e5e765e614f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:31.536090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f90fd-e017-4f72-9b76-e5e765e614f5 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:31.537024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f90fd-e017-4f72-9b76-e5e765e614f5 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:31.537397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f90fd-e017-4f72-9b76-e5e765e614f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:31.538888 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1956/3886] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:31.545956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c964d5d-1802-4869-b977-eb23c72b0e73 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:31.571482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c964d5d-1802-4869-b977-eb23c72b0e73 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:31.586495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9825a-af63-4790-875b-e13b5adaf7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:31.587433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9825a-af63-4790-875b-e13b5adaf7ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:31.587958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9825a-af63-4790-875b-e13b5adaf7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:31.589071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9825a-af63-4790-875b-e13b5adaf7ef admin admin] PATH_INFO: `/v3/projects/ac826ef0e53d42448cfa844394a7cf91/users/5c9d1fa089a645db91207e5d4dd0f23c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:31.629690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9825a-af63-4790-875b-e13b5adaf7ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac826ef0e53d42448cfa844394a7cf91, user_id=5c9d1fa089a645db91207e5d4dd0f23c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:31.634655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9825a-af63-4790-875b-e13b5adaf7ef admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:31.679177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f90fd-e017-4f72-9b76-e5e765e614f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:31.683073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f90fd-e017-4f72-9b76-e5e765e614f5 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:31.708128 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1931/3887] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:47:31.756515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f90fd-e017-4f72-9b76-e5e765e614f5 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:31.759519 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1957/3888] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:31 2022] PUT /identity/v3/projects/ac826ef0e53d42448cfa844394a7cf91/users/5c9d1fa089a645db91207e5d4dd0f23c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:31.763256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:31.783856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f90fd-e017-4f72-9b76-e5e765e614f5 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:31.881705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303d0a1-b4a9-42d6-8152-5d85b784253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:31.882646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303d0a1-b4a9-42d6-8152-5d85b784253e admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:31.882929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303d0a1-b4a9-42d6-8152-5d85b784253e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:31.883200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303d0a1-b4a9-42d6-8152-5d85b784253e admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:31.883846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303d0a1-b4a9-42d6-8152-5d85b784253e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:31.886853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303d0a1-b4a9-42d6-8152-5d85b784253e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:31.908115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9825a-af63-4790-875b-e13b5adaf7ef admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:31.926068 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1932/3889] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:31.929397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9825a-af63-4790-875b-e13b5adaf7ef admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:31.937971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae3c97-36a8-40ba-a91d-6d9a9ce7ef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:31.941988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae3c97-36a8-40ba-a91d-6d9a9ce7ef84 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:31.941988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae3c97-36a8-40ba-a91d-6d9a9ce7ef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:31.941988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae3c97-36a8-40ba-a91d-6d9a9ce7ef84 admin admin] PATH_INFO: `/v3/projects/ac826ef0e53d42448cfa844394a7cf91/users/5c9d1fa089a645db91207e5d4dd0f23c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:31.942605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae3c97-36a8-40ba-a91d-6d9a9ce7ef84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac826ef0e53d42448cfa844394a7cf91, user_id=5c9d1fa089a645db91207e5d4dd0f23c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:31.946504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae3c97-36a8-40ba-a91d-6d9a9ce7ef84 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:31.975397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03c948-9e8a-4699-ad95-211f2783313c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:31.975711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03c948-9e8a-4699-ad95-211f2783313c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:31.975991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03c948-9e8a-4699-ad95-211f2783313c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:31.984701 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1958/3890] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:31 2022] PUT /identity/v3/projects/ac826ef0e53d42448cfa844394a7cf91/users/5c9d1fa089a645db91207e5d4dd0f23c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:32.011211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8d03c948-9e8a-4699-ad95-211f2783313c None None] MFA Rules not processed for user `5c9d1fa089a645db91207e5d4dd0f23c`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:32.013915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8d03c948-9e8a-4699-ad95-211f2783313c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:32.117888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:32.126178 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1933/3891] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:32.133233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae3c97-36a8-40ba-a91d-6d9a9ce7ef84 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:32.225354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae3c97-36a8-40ba-a91d-6d9a9ce7ef84 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:32.241261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f0416-c372-4616-9716-3a8ed558669c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:32.241898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f0416-c372-4616-9716-3a8ed558669c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:32.242178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f0416-c372-4616-9716-3a8ed558669c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:32.242446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f0416-c372-4616-9716-3a8ed558669c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:32.243150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f0416-c372-4616-9716-3a8ed558669c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:32.245362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f0416-c372-4616-9716-3a8ed558669c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:32.363856 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1959/3892] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:32 2022] POST /identity/v3/projects => generated 387 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:32.365480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03c948-9e8a-4699-ad95-211f2783313c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:32.380014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03c948-9e8a-4699-ad95-211f2783313c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:32.537641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27e51d-4f01-46e9-a144-2327e9e4d8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:32.538269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27e51d-4f01-46e9-a144-2327e9e4d8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:32.538554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27e51d-4f01-46e9-a144-2327e9e4d8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:32.539049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27e51d-4f01-46e9-a144-2327e9e4d8c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:32.539718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27e51d-4f01-46e9-a144-2327e9e4d8c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:32.541717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27e51d-4f01-46e9-a144-2327e9e4d8c3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:32.673005 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1934/3893] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:32 2022] POST /identity/v3/users => generated 294 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:47:32.677364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f0416-c372-4616-9716-3a8ed558669c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:32.695542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f0416-c372-4616-9716-3a8ed558669c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:32.708091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e74b0-7bbf-4a5d-b060-e722056b4c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:32.708847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e74b0-7bbf-4a5d-b060-e722056b4c71 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:32.709041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e74b0-7bbf-4a5d-b060-e722056b4c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:32.711797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e74b0-7bbf-4a5d-b060-e722056b4c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:32.712527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e74b0-7bbf-4a5d-b060-e722056b4c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:32.716531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e74b0-7bbf-4a5d-b060-e722056b4c71 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:32.744636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27e51d-4f01-46e9-a144-2327e9e4d8c3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:32.747869 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1960/3894] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:32.762558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27e51d-4f01-46e9-a144-2327e9e4d8c3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:32.780010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:32.787290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa3bca-2143-43c4-b146-bd3477bc66dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:32.787842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa3bca-2143-43c4-b146-bd3477bc66dc admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:32.788121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa3bca-2143-43c4-b146-bd3477bc66dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:32.788486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa3bca-2143-43c4-b146-bd3477bc66dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:32.789138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa3bca-2143-43c4-b146-bd3477bc66dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:32.790799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa3bca-2143-43c4-b146-bd3477bc66dc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:32.816426 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1935/3895] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:47:32.819155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e74b0-7bbf-4a5d-b060-e722056b4c71 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:32.834672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e74b0-7bbf-4a5d-b060-e722056b4c71 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:32.850063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b62c0-9a0f-4564-9408-7ba48ea1b10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:32.851057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b62c0-9a0f-4564-9408-7ba48ea1b10f admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:32.851542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b62c0-9a0f-4564-9408-7ba48ea1b10f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:32.851980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b62c0-9a0f-4564-9408-7ba48ea1b10f admin admin] PATH_INFO: `/v3/projects/84428c1f5dc84c1ab256c2d2a2ea1977/users/14a3e6622b6b4ce6a6498a00cc26c7e0/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:32.888980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b62c0-9a0f-4564-9408-7ba48ea1b10f admin admin] RBAC: Authorizing `identity:create_grant(project_id=84428c1f5dc84c1ab256c2d2a2ea1977, user_id=14a3e6622b6b4ce6a6498a00cc26c7e0, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:32.903501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b62c0-9a0f-4564-9408-7ba48ea1b10f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:33.026457 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1961/3896] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:32 2022] PUT /identity/v3/projects/84428c1f5dc84c1ab256c2d2a2ea1977/users/14a3e6622b6b4ce6a6498a00cc26c7e0/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:33.037738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd2433-e6b0-4ba7-90f2-3931cfb64592 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:33.038168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd2433-e6b0-4ba7-90f2-3931cfb64592 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:33.038614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd2433-e6b0-4ba7-90f2-3931cfb64592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:33.115811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3ffd2433-e6b0-4ba7-90f2-3931cfb64592 None None] MFA Rules not processed for user `14a3e6622b6b4ce6a6498a00cc26c7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:33.122316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3ffd2433-e6b0-4ba7-90f2-3931cfb64592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:33.340931 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1936/3897] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:33.353170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b62c0-9a0f-4564-9408-7ba48ea1b10f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:33.354955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6d0b62c0-9a0f-4564-9408-7ba48ea1b10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:33.418759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd2433-e6b0-4ba7-90f2-3931cfb64592 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:33.420914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3ffd2433-e6b0-4ba7-90f2-3931cfb64592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:33.544810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b62c0-9a0f-4564-9408-7ba48ea1b10f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:33.552589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e183fd-0f6a-4650-ac4a-5a90402fc789 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:33.553239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e183fd-0f6a-4650-ac4a-5a90402fc789 service glance] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:33.553523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e183fd-0f6a-4650-ac4a-5a90402fc789 service glance] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:33.553798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e183fd-0f6a-4650-ac4a-5a90402fc789 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:33.700616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd2433-e6b0-4ba7-90f2-3931cfb64592 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:33.715901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756eb20-cb8f-4c9f-9506-f138df97fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:33.717082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756eb20-cb8f-4c9f-9506-f138df97fec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:33.717553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756eb20-cb8f-4c9f-9506-f138df97fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:33.720854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756eb20-cb8f-4c9f-9506-f138df97fec9 admin admin] PATH_INFO: `/v3/users/177c105f6d484e8abfeb9bc118a1260d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:33.723442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756eb20-cb8f-4c9f-9506-f138df97fec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=177c105f6d484e8abfeb9bc118a1260d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:33.723657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e183fd-0f6a-4650-ac4a-5a90402fc789 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:33.726513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e183fd-0f6a-4650-ac4a-5a90402fc789 service glance] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:33.726881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756eb20-cb8f-4c9f-9506-f138df97fec9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:33.753353 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1962/3898] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:34.023374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:34.056539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d756eb20-cb8f-4c9f-9506-f138df97fec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177c105f6d484e8abfeb9bc118a1260d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:34.125962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d756eb20-cb8f-4c9f-9506-f138df97fec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177c105f6d484e8abfeb9bc118a1260d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:34.127067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d756eb20-cb8f-4c9f-9506-f138df97fec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177c105f6d484e8abfeb9bc118a1260d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:34.135547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d756eb20-cb8f-4c9f-9506-f138df97fec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177c105f6d484e8abfeb9bc118a1260d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:34.164585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d756eb20-cb8f-4c9f-9506-f138df97fec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177c105f6d484e8abfeb9bc118a1260d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:34.180280 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1937/3899] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:47:33 2022] DELETE /identity/v3/users/177c105f6d484e8abfeb9bc118a1260d => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:34.749950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e183fd-0f6a-4650-ac4a-5a90402fc789 service glance] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:34.767759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e183fd-0f6a-4650-ac4a-5a90402fc789 service glance] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:34.922041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b78b51-7b78-4ba3-b03d-43394704cb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:34.922814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b78b51-7b78-4ba3-b03d-43394704cb97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:34.923197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b78b51-7b78-4ba3-b03d-43394704cb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:34.923642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b78b51-7b78-4ba3-b03d-43394704cb97 admin admin] PATH_INFO: `/v3/users/5c9d1fa089a645db91207e5d4dd0f23c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:34.926777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b78b51-7b78-4ba3-b03d-43394704cb97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c9d1fa089a645db91207e5d4dd0f23c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:34.928899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b78b51-7b78-4ba3-b03d-43394704cb97 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:35.267010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-35b78b51-7b78-4ba3-b03d-43394704cb97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c9d1fa089a645db91207e5d4dd0f23c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:35.269038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-35b78b51-7b78-4ba3-b03d-43394704cb97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c9d1fa089a645db91207e5d4dd0f23c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:35.280953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:35.319444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756eb20-cb8f-4c9f-9506-f138df97fec9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:35.321055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d756eb20-cb8f-4c9f-9506-f138df97fec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:35.363057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-35b78b51-7b78-4ba3-b03d-43394704cb97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c9d1fa089a645db91207e5d4dd0f23c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:35.363942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-35b78b51-7b78-4ba3-b03d-43394704cb97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c9d1fa089a645db91207e5d4dd0f23c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:35.380521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756eb20-cb8f-4c9f-9506-f138df97fec9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:35.388272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-35b78b51-7b78-4ba3-b03d-43394704cb97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c9d1fa089a645db91207e5d4dd0f23c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:35.404070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f430c-75f5-4635-bdfc-fc4b56b4fd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:35.404763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f430c-75f5-4635-bdfc-fc4b56b4fd9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:35.405050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f430c-75f5-4635-bdfc-fc4b56b4fd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:35.405313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f430c-75f5-4635-bdfc-fc4b56b4fd9d admin admin] PATH_INFO: `/v3/projects/9d030b9911da4ef8aa39dbf0fe1b744b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:35.414161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f430c-75f5-4635-bdfc-fc4b56b4fd9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d030b9911da4ef8aa39dbf0fe1b744b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:35.418457 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1963/3900] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:47:34 2022] DELETE /identity/v3/users/5c9d1fa089a645db91207e5d4dd0f23c => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:35.424149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f430c-75f5-4635-bdfc-fc4b56b4fd9d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:35.429826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7301af-3b22-4091-87fb-c748f7093cf5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:35.434174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7301af-3b22-4091-87fb-c748f7093cf5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:35.434648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7301af-3b22-4091-87fb-c748f7093cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:35.479573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5c7301af-3b22-4091-87fb-c748f7093cf5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:35.487604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5c7301af-3b22-4091-87fb-c748f7093cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:35.642611 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1964/3901] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:35.658548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7e1f430c-75f5-4635-bdfc-fc4b56b4fd9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d030b9911da4ef8aa39dbf0fe1b744b', 'request_id': 'req-7e1f430c-75f5-4635-bdfc-fc4b56b4fd9d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:35.670762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7301af-3b22-4091-87fb-c748f7093cf5 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:35.673821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5c7301af-3b22-4091-87fb-c748f7093cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:35.685820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7e1f430c-75f5-4635-bdfc-fc4b56b4fd9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d030b9911da4ef8aa39dbf0fe1b744b', 'request_id': 'req-7e1f430c-75f5-4635-bdfc-fc4b56b4fd9d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:35.703451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7e1f430c-75f5-4635-bdfc-fc4b56b4fd9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d030b9911da4ef8aa39dbf0fe1b744b', 'request_id': 'req-7e1f430c-75f5-4635-bdfc-fc4b56b4fd9d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:35.787703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7301af-3b22-4091-87fb-c748f7093cf5 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:35.905982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d828e8-539c-4836-8638-ebe9f43f9da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:35.909349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d828e8-539c-4836-8638-ebe9f43f9da0 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:35.909857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d828e8-539c-4836-8638-ebe9f43f9da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:35.910313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d828e8-539c-4836-8638-ebe9f43f9da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:35.941256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7e1f430c-75f5-4635-bdfc-fc4b56b4fd9d admin admin] The token cache is being invalidate because project 9d030b9911da4ef8aa39dbf0fe1b744b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:35.941555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7e1f430c-75f5-4635-bdfc-fc4b56b4fd9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:35.942347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7e1f430c-75f5-4635-bdfc-fc4b56b4fd9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:35.945521 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1938/3902] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:35 2022] DELETE /identity/v3/projects/9d030b9911da4ef8aa39dbf0fe1b744b => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:35.963357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e6392-1350-45c3-b948-aa2b9716b728 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:35.964688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e6392-1350-45c3-b948-aa2b9716b728 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:35.965114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e6392-1350-45c3-b948-aa2b9716b728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:36.009227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0c2e6392-1350-45c3-b948-aa2b9716b728 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:36.012028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0c2e6392-1350-45c3-b948-aa2b9716b728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:36.072374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d828e8-539c-4836-8638-ebe9f43f9da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:36.074222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d828e8-539c-4836-8638-ebe9f43f9da0 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:36.102001 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1965/3903] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:36.146732 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1939/3904] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:36.150817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab037e2-851b-43d6-86f2-47118a4d6402 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:36.152269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab037e2-851b-43d6-86f2-47118a4d6402 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:36.154567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab037e2-851b-43d6-86f2-47118a4d6402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:36.182476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-dab037e2-851b-43d6-86f2-47118a4d6402 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:36.183768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dab037e2-851b-43d6-86f2-47118a4d6402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:36.202680 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1966/3905] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:36.204825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e6392-1350-45c3-b948-aa2b9716b728 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:36.222831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e6392-1350-45c3-b948-aa2b9716b728 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:36.230434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d6eeb-db53-46ec-9ef7-7ff209b8eb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:36.231554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d6eeb-db53-46ec-9ef7-7ff209b8eb1f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:36.232037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d6eeb-db53-46ec-9ef7-7ff209b8eb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:36.232493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d6eeb-db53-46ec-9ef7-7ff209b8eb1f admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:36.241877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d6eeb-db53-46ec-9ef7-7ff209b8eb1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:36.241877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d6eeb-db53-46ec-9ef7-7ff209b8eb1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:36.241877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d6eeb-db53-46ec-9ef7-7ff209b8eb1f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:36.262821 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1940/3906] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:36.264208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab037e2-851b-43d6-86f2-47118a4d6402 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:36.277326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab037e2-851b-43d6-86f2-47118a4d6402 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:36.290492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f22c92-9f7f-4409-8b32-88f4a3963d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:36.291374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f22c92-9f7f-4409-8b32-88f4a3963d1b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:36.291664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f22c92-9f7f-4409-8b32-88f4a3963d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:36.292064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f22c92-9f7f-4409-8b32-88f4a3963d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:36.292877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f22c92-9f7f-4409-8b32-88f4a3963d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:36.295349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f22c92-9f7f-4409-8b32-88f4a3963d1b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:36.482168 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1967/3907] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:36 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:36.486066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d6eeb-db53-46ec-9ef7-7ff209b8eb1f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:36.501006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d6eeb-db53-46ec-9ef7-7ff209b8eb1f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:36.560777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:36.687391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1f020-3f12-4c65-abbd-2314e20e0ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:36.688007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1f020-3f12-4c65-abbd-2314e20e0ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:36.688485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1f020-3f12-4c65-abbd-2314e20e0ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:36.689996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1f020-3f12-4c65-abbd-2314e20e0ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:36.690933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1f020-3f12-4c65-abbd-2314e20e0ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:36.693029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1f020-3f12-4c65-abbd-2314e20e0ac1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:36.843144 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1941/3908] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:36 2022] POST /identity/v3/users => generated 291 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:47:36.848138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f22c92-9f7f-4409-8b32-88f4a3963d1b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:36.859467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f22c92-9f7f-4409-8b32-88f4a3963d1b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:36.869084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:36.881633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916db5af-978d-4b09-b90c-d1b48e0b1adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:36.882640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916db5af-978d-4b09-b90c-d1b48e0b1adb admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:36.883073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916db5af-978d-4b09-b90c-d1b48e0b1adb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:36.883495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916db5af-978d-4b09-b90c-d1b48e0b1adb admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:36.884493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916db5af-978d-4b09-b90c-d1b48e0b1adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:36.892709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916db5af-978d-4b09-b90c-d1b48e0b1adb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:36.925751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1f020-3f12-4c65-abbd-2314e20e0ac1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:36.931044 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1968/3909] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:36.948245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1f020-3f12-4c65-abbd-2314e20e0ac1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:36.976575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894d35c-3dd1-4636-941d-54af6994f681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:36.978007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894d35c-3dd1-4636-941d-54af6994f681 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:36.981476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894d35c-3dd1-4636-941d-54af6994f681 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:36.981943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894d35c-3dd1-4636-941d-54af6994f681 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:36.983896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894d35c-3dd1-4636-941d-54af6994f681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:36.997447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894d35c-3dd1-4636-941d-54af6994f681 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:37.019651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916db5af-978d-4b09-b90c-d1b48e0b1adb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:37.036061 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1942/3910] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:37.060988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916db5af-978d-4b09-b90c-d1b48e0b1adb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:37.078189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7abe2-7b0e-4de7-beb4-a6202f4df462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:37.078892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7abe2-7b0e-4de7-beb4-a6202f4df462 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:37.081114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7abe2-7b0e-4de7-beb4-a6202f4df462 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:37.083324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7abe2-7b0e-4de7-beb4-a6202f4df462 admin admin] PATH_INFO: `/v3/projects/bdae27a758524b3e9d33a225b9e19d92/users/10f307547cc64c8f85248fd0444aabd4/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:37.129403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7abe2-7b0e-4de7-beb4-a6202f4df462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdae27a758524b3e9d33a225b9e19d92, user_id=10f307547cc64c8f85248fd0444aabd4, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:37.135541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894d35c-3dd1-4636-941d-54af6994f681 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:37.137889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a894d35c-3dd1-4636-941d-54af6994f681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:37.154299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7abe2-7b0e-4de7-beb4-a6202f4df462 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:37.166151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894d35c-3dd1-4636-941d-54af6994f681 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:37.172213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f21c46-48d4-4a50-a75b-452f1e00be60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:37.177246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f21c46-48d4-4a50-a75b-452f1e00be60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:37.177246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f21c46-48d4-4a50-a75b-452f1e00be60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:37.177246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f21c46-48d4-4a50-a75b-452f1e00be60 admin admin] PATH_INFO: `/v3/users/5dd6f28443ba41e1923d26a4e67b51aa` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:37.177246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f21c46-48d4-4a50-a75b-452f1e00be60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd6f28443ba41e1923d26a4e67b51aa)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:37.184260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f21c46-48d4-4a50-a75b-452f1e00be60 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:37.262319 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1969/3911] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:37 2022] PUT /identity/v3/projects/bdae27a758524b3e9d33a225b9e19d92/users/10f307547cc64c8f85248fd0444aabd4/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:37.269593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273e43a-39b1-43c6-9d25-809987db75e4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:37.270036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273e43a-39b1-43c6-9d25-809987db75e4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:37.270536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273e43a-39b1-43c6-9d25-809987db75e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:37.308315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1273e43a-39b1-43c6-9d25-809987db75e4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:37.309966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1273e43a-39b1-43c6-9d25-809987db75e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:37.395642 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1970/3912] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:37.409337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273e43a-39b1-43c6-9d25-809987db75e4 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:37.411120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1273e43a-39b1-43c6-9d25-809987db75e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:37.435884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d6f21c46-48d4-4a50-a75b-452f1e00be60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd6f28443ba41e1923d26a4e67b51aa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:37.510081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273e43a-39b1-43c6-9d25-809987db75e4 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:37.516711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa8750-1821-428c-93d9-7fc48605613b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:37.518157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8750-1821-428c-93d9-7fc48605613b service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:37.518490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8750-1821-428c-93d9-7fc48605613b service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:37.518817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8750-1821-428c-93d9-7fc48605613b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:37.533484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa8750-1821-428c-93d9-7fc48605613b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:37.535209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa8750-1821-428c-93d9-7fc48605613b service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:37.539238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d6f21c46-48d4-4a50-a75b-452f1e00be60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd6f28443ba41e1923d26a4e67b51aa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:37.540200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d6f21c46-48d4-4a50-a75b-452f1e00be60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd6f28443ba41e1923d26a4e67b51aa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:37.552462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d6f21c46-48d4-4a50-a75b-452f1e00be60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd6f28443ba41e1923d26a4e67b51aa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:37.563541 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1971/3913] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:47:37.567189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:37.572139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d6f21c46-48d4-4a50-a75b-452f1e00be60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd6f28443ba41e1923d26a4e67b51aa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:37.583592 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1943/3914] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:47:37 2022] DELETE /identity/v3/users/5dd6f28443ba41e1923d26a4e67b51aa => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:37.782119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa8750-1821-428c-93d9-7fc48605613b service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:37.783769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-94fa8750-1821-428c-93d9-7fc48605613b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:37.798067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa8750-1821-428c-93d9-7fc48605613b service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:37.872321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405368ed-68b9-463c-b0b8-cf0e5c308e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:37.873991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405368ed-68b9-463c-b0b8-cf0e5c308e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:37.874501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405368ed-68b9-463c-b0b8-cf0e5c308e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:37.875495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405368ed-68b9-463c-b0b8-cf0e5c308e17 admin admin] PATH_INFO: `/v3/projects/ac826ef0e53d42448cfa844394a7cf91` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:37.877776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405368ed-68b9-463c-b0b8-cf0e5c308e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac826ef0e53d42448cfa844394a7cf91)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:37.881712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405368ed-68b9-463c-b0b8-cf0e5c308e17 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:38.110376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-405368ed-68b9-463c-b0b8-cf0e5c308e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac826ef0e53d42448cfa844394a7cf91', 'request_id': 'req-405368ed-68b9-463c-b0b8-cf0e5c308e17'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:38.124233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-405368ed-68b9-463c-b0b8-cf0e5c308e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac826ef0e53d42448cfa844394a7cf91', 'request_id': 'req-405368ed-68b9-463c-b0b8-cf0e5c308e17'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:38.159485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39aadb-7883-41ba-9de7-841f390f8eb8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:38.159900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39aadb-7883-41ba-9de7-841f390f8eb8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:38.160338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39aadb-7883-41ba-9de7-841f390f8eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:38.193869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0b39aadb-7883-41ba-9de7-841f390f8eb8 None None] MFA Rules not processed for user `419210a4f7744db6a2571ae341744361`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:38.195484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0b39aadb-7883-41ba-9de7-841f390f8eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:38.214186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-405368ed-68b9-463c-b0b8-cf0e5c308e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac826ef0e53d42448cfa844394a7cf91', 'request_id': 'req-405368ed-68b9-463c-b0b8-cf0e5c308e17'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:38.237750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-405368ed-68b9-463c-b0b8-cf0e5c308e17 admin admin] The token cache is being invalidate because project ac826ef0e53d42448cfa844394a7cf91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:38.238547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-405368ed-68b9-463c-b0b8-cf0e5c308e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:38.257756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-405368ed-68b9-463c-b0b8-cf0e5c308e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:38.261957 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1972/3915] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:37 2022] DELETE /identity/v3/projects/ac826ef0e53d42448cfa844394a7cf91 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:38.263051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405368ed-68b9-463c-b0b8-cf0e5c308e17 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:38.267793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-405368ed-68b9-463c-b0b8-cf0e5c308e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:38.370003 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1944/3916] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:38.371828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39aadb-7883-41ba-9de7-841f390f8eb8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:38.375633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0b39aadb-7883-41ba-9de7-841f390f8eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:38.394671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405368ed-68b9-463c-b0b8-cf0e5c308e17 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:38.398741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39aadb-7883-41ba-9de7-841f390f8eb8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:38.404436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978749f-b07d-42c4-8e35-57f270890cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:38.405892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978749f-b07d-42c4-8e35-57f270890cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:38.406306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978749f-b07d-42c4-8e35-57f270890cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:38.406686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978749f-b07d-42c4-8e35-57f270890cf5 admin admin] PATH_INFO: `/v3/projects/594434f66502439bb7de37a9097943fb` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:38.409301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978749f-b07d-42c4-8e35-57f270890cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=594434f66502439bb7de37a9097943fb)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:38.411950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978749f-b07d-42c4-8e35-57f270890cf5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:38.420006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea9982-7dae-4c51-9628-a6c7b730c5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:38.420716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea9982-7dae-4c51-9628-a6c7b730c5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:38.421162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea9982-7dae-4c51-9628-a6c7b730c5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:38.421445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea9982-7dae-4c51-9628-a6c7b730c5cf admin admin] PATH_INFO: `/v3/users/14a3e6622b6b4ce6a6498a00cc26c7e0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:38.422601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea9982-7dae-4c51-9628-a6c7b730c5cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a3e6622b6b4ce6a6498a00cc26c7e0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:38.425835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea9982-7dae-4c51-9628-a6c7b730c5cf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:38.538045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:38.728413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5eea9982-7dae-4c51-9628-a6c7b730c5cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a3e6622b6b4ce6a6498a00cc26c7e0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:38.751784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d978749f-b07d-42c4-8e35-57f270890cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594434f66502439bb7de37a9097943fb', 'request_id': 'req-d978749f-b07d-42c4-8e35-57f270890cf5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:38.760918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d978749f-b07d-42c4-8e35-57f270890cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594434f66502439bb7de37a9097943fb', 'request_id': 'req-d978749f-b07d-42c4-8e35-57f270890cf5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:38.834083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5eea9982-7dae-4c51-9628-a6c7b730c5cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a3e6622b6b4ce6a6498a00cc26c7e0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:38.835098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5eea9982-7dae-4c51-9628-a6c7b730c5cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a3e6622b6b4ce6a6498a00cc26c7e0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:38.857330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5eea9982-7dae-4c51-9628-a6c7b730c5cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a3e6622b6b4ce6a6498a00cc26c7e0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:38.915340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5eea9982-7dae-4c51-9628-a6c7b730c5cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a3e6622b6b4ce6a6498a00cc26c7e0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:38.929656 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1945/3917] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:47:38 2022] DELETE /identity/v3/users/14a3e6622b6b4ce6a6498a00cc26c7e0 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:38.932969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34977d-8382-4cb9-b28e-1bc0f0258e58 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:38.933704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34977d-8382-4cb9-b28e-1bc0f0258e58 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:38.944782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34977d-8382-4cb9-b28e-1bc0f0258e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:38.984434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8a34977d-8382-4cb9-b28e-1bc0f0258e58 None None] MFA Rules not processed for user `419210a4f7744db6a2571ae341744361`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:38.987028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8a34977d-8382-4cb9-b28e-1bc0f0258e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:39.040224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d978749f-b07d-42c4-8e35-57f270890cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594434f66502439bb7de37a9097943fb', 'request_id': 'req-d978749f-b07d-42c4-8e35-57f270890cf5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:39.059474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d978749f-b07d-42c4-8e35-57f270890cf5 admin admin] The token cache is being invalidate because project 594434f66502439bb7de37a9097943fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:39.060127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d978749f-b07d-42c4-8e35-57f270890cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:39.062348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d978749f-b07d-42c4-8e35-57f270890cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:39.066020 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1973/3918] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:38 2022] DELETE /identity/v3/projects/594434f66502439bb7de37a9097943fb => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:39.075745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:39.076433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0fa78-04b3-4fa2-b30e-5da28b78eb46 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:39.077367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0fa78-04b3-4fa2-b30e-5da28b78eb46 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:39.077820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0fa78-04b3-4fa2-b30e-5da28b78eb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:39.107926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bee0fa78-04b3-4fa2-b30e-5da28b78eb46 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:39.109973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bee0fa78-04b3-4fa2-b30e-5da28b78eb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:39.113120 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1946/3919] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:39.129365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34977d-8382-4cb9-b28e-1bc0f0258e58 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:39.129816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8a34977d-8382-4cb9-b28e-1bc0f0258e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:39.228241 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1974/3920] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:39.228786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0399e41-4aa3-40fe-841b-4a3f098f97f3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:39.229205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0399e41-4aa3-40fe-841b-4a3f098f97f3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:39.229535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0399e41-4aa3-40fe-841b-4a3f098f97f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:39.257691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d0399e41-4aa3-40fe-841b-4a3f098f97f3 None None] MFA Rules not processed for user `59fbc90b125c402bbee94241a3a609d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:39.259233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d0399e41-4aa3-40fe-841b-4a3f098f97f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:39.276317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34977d-8382-4cb9-b28e-1bc0f0258e58 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:39.283719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ecf3e-39d7-4926-8f05-39883259a2f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:39.284475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ecf3e-39d7-4926-8f05-39883259a2f4 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:39.284762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ecf3e-39d7-4926-8f05-39883259a2f4 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:39.285086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ecf3e-39d7-4926-8f05-39883259a2f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:39.287128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f81ecf3e-39d7-4926-8f05-39883259a2f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:39.301248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ecf3e-39d7-4926-8f05-39883259a2f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:39.302980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ecf3e-39d7-4926-8f05-39883259a2f4 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:39.315412 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1947/3921] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:39 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:39.317180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0ae2e-45b1-4578-b864-6a16589f7f04 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:39.317399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0ae2e-45b1-4578-b864-6a16589f7f04 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:39.317687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0ae2e-45b1-4578-b864-6a16589f7f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:39.343971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-34d0ae2e-45b1-4578-b864-6a16589f7f04 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:39.345393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-34d0ae2e-45b1-4578-b864-6a16589f7f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:39.345732 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1975/3922] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:39.383119 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1948/3923] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:39.384273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0399e41-4aa3-40fe-841b-4a3f098f97f3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:39.396875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0399e41-4aa3-40fe-841b-4a3f098f97f3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:39.402862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3e114-cad7-4751-86bc-3dae42e6ae91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:39.406552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3e114-cad7-4751-86bc-3dae42e6ae91 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:39.406885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3e114-cad7-4751-86bc-3dae42e6ae91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:39.407227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3e114-cad7-4751-86bc-3dae42e6ae91 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:39.408283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3e114-cad7-4751-86bc-3dae42e6ae91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:39.408593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3e114-cad7-4751-86bc-3dae42e6ae91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:39.410658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3e114-cad7-4751-86bc-3dae42e6ae91 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:39.441194 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1976/3924] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:47:39.445699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0ae2e-45b1-4578-b864-6a16589f7f04 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:39.455982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0ae2e-45b1-4578-b864-6a16589f7f04 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:39.461910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ab3f4-558d-4639-a812-d77e4f5da94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:39.462699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ab3f4-558d-4639-a812-d77e4f5da94d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:39.463096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ab3f4-558d-4639-a812-d77e4f5da94d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:39.463515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ab3f4-558d-4639-a812-d77e4f5da94d admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:39.464777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ab3f4-558d-4639-a812-d77e4f5da94d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:39.466620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ab3f4-558d-4639-a812-d77e4f5da94d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:39.586135 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1949/3925] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:39 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:39.589950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3e114-cad7-4751-86bc-3dae42e6ae91 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:39.600217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3e114-cad7-4751-86bc-3dae42e6ae91 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:39.764106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2969652-6b98-4697-ba6a-585669186b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:39.766289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2969652-6b98-4697-ba6a-585669186b3f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:39.767407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2969652-6b98-4697-ba6a-585669186b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:39.770588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2969652-6b98-4697-ba6a-585669186b3f admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:39.770588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2969652-6b98-4697-ba6a-585669186b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:39.771672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2969652-6b98-4697-ba6a-585669186b3f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:39.886807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ab3f4-558d-4639-a812-d77e4f5da94d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:39.908372 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1977/3926] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:39 2022] POST /identity/v3/users => generated 287 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:39.916000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ab3f4-558d-4639-a812-d77e4f5da94d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:39.930419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17973f-cfb9-4254-9c97-e3ebe4c9ec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:39.931232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17973f-cfb9-4254-9c97-e3ebe4c9ec7b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:39.931688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17973f-cfb9-4254-9c97-e3ebe4c9ec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:39.932286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17973f-cfb9-4254-9c97-e3ebe4c9ec7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:39.933097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17973f-cfb9-4254-9c97-e3ebe4c9ec7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:39.943817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17973f-cfb9-4254-9c97-e3ebe4c9ec7b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:39.989332 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1950/3927] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:39.993440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2969652-6b98-4697-ba6a-585669186b3f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:40.007380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2969652-6b98-4697-ba6a-585669186b3f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:40.035953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2f29e-d55c-409f-b033-f51e83967747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:40.036944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2f29e-d55c-409f-b033-f51e83967747 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:40.037211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2f29e-d55c-409f-b033-f51e83967747 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:40.037478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2f29e-d55c-409f-b033-f51e83967747 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:40.039901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2f29e-d55c-409f-b033-f51e83967747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:40.042984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2f29e-d55c-409f-b033-f51e83967747 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:40.077133 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1978/3928] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:40.078151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17973f-cfb9-4254-9c97-e3ebe4c9ec7b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:40.103254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17973f-cfb9-4254-9c97-e3ebe4c9ec7b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:40.108703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37809fde-575f-4bfd-8c04-d9acef091715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:40.109661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37809fde-575f-4bfd-8c04-d9acef091715 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:40.110144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37809fde-575f-4bfd-8c04-d9acef091715 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:40.111226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37809fde-575f-4bfd-8c04-d9acef091715 admin admin] PATH_INFO: `/v3/projects/0fd4d0ce0f8f463498d4d36ec1b49e7a/users/d87d78d0e7444dbcb60cac6425bbc367/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:40.150638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37809fde-575f-4bfd-8c04-d9acef091715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd4d0ce0f8f463498d4d36ec1b49e7a, user_id=d87d78d0e7444dbcb60cac6425bbc367, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:40.153541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37809fde-575f-4bfd-8c04-d9acef091715 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:40.294155 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1951/3929] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:40 2022] PUT /identity/v3/projects/0fd4d0ce0f8f463498d4d36ec1b49e7a/users/d87d78d0e7444dbcb60cac6425bbc367/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:40.305051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cb409-e0b5-46d5-b3e9-a7e6e1a2aa84 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:40.305769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cb409-e0b5-46d5-b3e9-a7e6e1a2aa84 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:40.306871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cb409-e0b5-46d5-b3e9-a7e6e1a2aa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:40.356124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2f1cb409-e0b5-46d5-b3e9-a7e6e1a2aa84 None None] MFA Rules not processed for user `d87d78d0e7444dbcb60cac6425bbc367`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:40.359065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:40.361096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2f1cb409-e0b5-46d5-b3e9-a7e6e1a2aa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:40.452928 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1979/3930] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:40.454123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fe6d4-62ab-43bd-b18d-7bf7e1bffd1b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:40.455132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fe6d4-62ab-43bd-b18d-7bf7e1bffd1b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:40.455545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fe6d4-62ab-43bd-b18d-7bf7e1bffd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:40.504453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-be0fe6d4-62ab-43bd-b18d-7bf7e1bffd1b None None] MFA Rules not processed for user `d87d78d0e7444dbcb60cac6425bbc367`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:40.510069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-be0fe6d4-62ab-43bd-b18d-7bf7e1bffd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:40.540996 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1952/3931] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:40.596871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:40.980867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa1635-19d4-4bc7-9c26-a7d932bdbd68 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:40.981303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa1635-19d4-4bc7-9c26-a7d932bdbd68 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:40.981687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa1635-19d4-4bc7-9c26-a7d932bdbd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:40.997337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-b8aa1635-19d4-4bc7-9c26-a7d932bdbd68 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:47:40.997337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:47:40.997337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:47:40.997337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:47:40.997337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:47:40.997337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:47:40.997337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:47:40.997337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:47:40.997337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:47:40.997337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:47:40.997337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:47:40.997337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:47:40.997337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:47:41.002625 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:47:41.002625 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:47:41.002625 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:47:41.002625 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:47:41.002625 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:47:41.002625 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:47:41.002625 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:47:41.002625 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:47:41.002625 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:47:41.002625 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:47:41.002625 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:47:41.002625 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:47:41.002625 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:47:41.002625 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:47:41.002625 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:47:41.013079 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1980/3932] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:47:40 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 35 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:47:41.122287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fe6d4-62ab-43bd-b18d-7bf7e1bffd1b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:41.231500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:41.243819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fe6d4-62ab-43bd-b18d-7bf7e1bffd1b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:41.250846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04f7de-f462-4931-8338-74b7f5f5c0cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:41.251771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04f7de-f462-4931-8338-74b7f5f5c0cd service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:41.252422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04f7de-f462-4931-8338-74b7f5f5c0cd service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:41.252920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04f7de-f462-4931-8338-74b7f5f5c0cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:41.277474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa1635-19d4-4bc7-9c26-a7d932bdbd68 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:41.281487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b8aa1635-19d4-4bc7-9c26-a7d932bdbd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:41.305739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04f7de-f462-4931-8338-74b7f5f5c0cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:41.311664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04f7de-f462-4931-8338-74b7f5f5c0cd service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:41.353004 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1953/3933] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:47:41.525340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa1635-19d4-4bc7-9c26-a7d932bdbd68 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:41.533287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b14e1-680d-4c68-ac97-88fcda438494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:41.534590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b14e1-680d-4c68-ac97-88fcda438494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:41.534590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b14e1-680d-4c68-ac97-88fcda438494 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:41.540811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b14e1-680d-4c68-ac97-88fcda438494 admin admin] PATH_INFO: `/v3/projects/84428c1f5dc84c1ab256c2d2a2ea1977` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:41.554844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b14e1-680d-4c68-ac97-88fcda438494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84428c1f5dc84c1ab256c2d2a2ea1977)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:41.557015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b14e1-680d-4c68-ac97-88fcda438494 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:41.772885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-394b14e1-680d-4c68-ac97-88fcda438494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84428c1f5dc84c1ab256c2d2a2ea1977', 'request_id': 'req-394b14e1-680d-4c68-ac97-88fcda438494'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:41.791065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-394b14e1-680d-4c68-ac97-88fcda438494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84428c1f5dc84c1ab256c2d2a2ea1977', 'request_id': 'req-394b14e1-680d-4c68-ac97-88fcda438494'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:41.877001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-394b14e1-680d-4c68-ac97-88fcda438494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84428c1f5dc84c1ab256c2d2a2ea1977', 'request_id': 'req-394b14e1-680d-4c68-ac97-88fcda438494'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:41.904617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-394b14e1-680d-4c68-ac97-88fcda438494 admin admin] The token cache is being invalidate because project 84428c1f5dc84c1ab256c2d2a2ea1977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:41.905181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-394b14e1-680d-4c68-ac97-88fcda438494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:41.905939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-394b14e1-680d-4c68-ac97-88fcda438494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:41.911487 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1981/3934] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:41 2022] DELETE /identity/v3/projects/84428c1f5dc84c1ab256c2d2a2ea1977 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:47:41.917173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecffd6-08ef-493a-8e3c-d28cf9fa56f6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:41.917694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecffd6-08ef-493a-8e3c-d28cf9fa56f6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:41.918120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecffd6-08ef-493a-8e3c-d28cf9fa56f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:41.947451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:41.992197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c3ecffd6-08ef-493a-8e3c-d28cf9fa56f6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:41.993540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c3ecffd6-08ef-493a-8e3c-d28cf9fa56f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:42.120816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629824e-fc2a-4d99-a9e7-875670d0db09 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:42.122105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629824e-fc2a-4d99-a9e7-875670d0db09 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:42.122799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629824e-fc2a-4d99-a9e7-875670d0db09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:42.132854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-f629824e-fc2a-4d99-a9e7-875670d0db09 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:47:42.132854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:47:42.132854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:47:42.132854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:47:42.132854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:47:42.132854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:47:42.132854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:47:42.132854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:47:42.132854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:47:42.132854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:47:42.132854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:47:42.132854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:47:42.132854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:47:42.133807 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:47:42.133807 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:47:42.133807 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:47:42.133807 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:47:42.133807 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:47:42.133807 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:47:42.133807 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:47:42.133807 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:47:42.133807 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:47:42.133807 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:47:42.133807 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:47:42.133807 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:47:42.133807 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:47:42.133807 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:47:42.133807 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:47:42.134705 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1982/3935] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:47:42 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 15 msecs (HTTP/1.1 400) 5 headers in 186 bytes (3 switches on core 0) Aug 27 04:47:42.166911 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1954/3936] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:42.171852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcf162-13de-4ebe-a374-0600d9c90661 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:42.172139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcf162-13de-4ebe-a374-0600d9c90661 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:42.172464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcf162-13de-4ebe-a374-0600d9c90661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:42.238556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c1dcf162-13de-4ebe-a374-0600d9c90661 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:42.243574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c1dcf162-13de-4ebe-a374-0600d9c90661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:42.263119 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1983/3937] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:42.267192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecffd6-08ef-493a-8e3c-d28cf9fa56f6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:42.280886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecffd6-08ef-493a-8e3c-d28cf9fa56f6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:42.296246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36dc275-1069-4a62-8041-da5e5e0a3d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:42.297762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dc275-1069-4a62-8041-da5e5e0a3d5e admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:42.300141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dc275-1069-4a62-8041-da5e5e0a3d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:42.302535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dc275-1069-4a62-8041-da5e5e0a3d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:42.304738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36dc275-1069-4a62-8041-da5e5e0a3d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:42.306086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36dc275-1069-4a62-8041-da5e5e0a3d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:42.309172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36dc275-1069-4a62-8041-da5e5e0a3d5e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:42.365613 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1955/3938] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:42.366794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcf162-13de-4ebe-a374-0600d9c90661 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:42.379174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcf162-13de-4ebe-a374-0600d9c90661 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:42.390500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174c91a-2a65-495a-a419-095dc48e0d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:42.391358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174c91a-2a65-495a-a419-095dc48e0d82 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:42.392368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174c91a-2a65-495a-a419-095dc48e0d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:42.392800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174c91a-2a65-495a-a419-095dc48e0d82 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:42.393590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174c91a-2a65-495a-a419-095dc48e0d82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:42.395638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174c91a-2a65-495a-a419-095dc48e0d82 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:42.465794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:42.561655 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1984/3939] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:42 2022] POST /identity/v3/projects => generated 381 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:42.570013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36dc275-1069-4a62-8041-da5e5e0a3d5e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:42.581830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36dc275-1069-4a62-8041-da5e5e0a3d5e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:42.655949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd988828-39e8-4d1c-a1e2-4560f7b2cf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:42.657107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd988828-39e8-4d1c-a1e2-4560f7b2cf44 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:42.658452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd988828-39e8-4d1c-a1e2-4560f7b2cf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:42.658923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd988828-39e8-4d1c-a1e2-4560f7b2cf44 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:42.659811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd988828-39e8-4d1c-a1e2-4560f7b2cf44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:42.662229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd988828-39e8-4d1c-a1e2-4560f7b2cf44 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:42.771866 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1956/3940] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:42 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:42.773375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174c91a-2a65-495a-a419-095dc48e0d82 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:42.797298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174c91a-2a65-495a-a419-095dc48e0d82 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:42.804940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00ace0-7721-41f7-b85f-0f432f7c7844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:42.806695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00ace0-7721-41f7-b85f-0f432f7c7844 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:42.807303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00ace0-7721-41f7-b85f-0f432f7c7844 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:42.808593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00ace0-7721-41f7-b85f-0f432f7c7844 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:42.810415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00ace0-7721-41f7-b85f-0f432f7c7844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:42.814227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00ace0-7721-41f7-b85f-0f432f7c7844 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:42.855153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd988828-39e8-4d1c-a1e2-4560f7b2cf44 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:42.867913 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1985/3941] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:42.877575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd988828-39e8-4d1c-a1e2-4560f7b2cf44 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:42.877575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf742a3-8ff7-493e-a8ac-e77e5259add1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:42.877575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf742a3-8ff7-493e-a8ac-e77e5259add1 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:42.878213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf742a3-8ff7-493e-a8ac-e77e5259add1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:42.878700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf742a3-8ff7-493e-a8ac-e77e5259add1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:42.879358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf742a3-8ff7-493e-a8ac-e77e5259add1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:42.881278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf742a3-8ff7-493e-a8ac-e77e5259add1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:42.903578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00ace0-7721-41f7-b85f-0f432f7c7844 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:42.913726 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1957/3942] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:42.918894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00ace0-7721-41f7-b85f-0f432f7c7844 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:42.924855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7780e-c4e4-42cc-924a-f1ca4458fa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:42.925638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7780e-c4e4-42cc-924a-f1ca4458fa14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:42.926911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7780e-c4e4-42cc-924a-f1ca4458fa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:42.927198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7780e-c4e4-42cc-924a-f1ca4458fa14 admin admin] PATH_INFO: `/v3/projects/7d20a6d2a51841e681885a6d914631c3/users/ef21c25463c94888b1d71bb5d9fa08f6/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:42.973166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7780e-c4e4-42cc-924a-f1ca4458fa14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d20a6d2a51841e681885a6d914631c3, user_id=ef21c25463c94888b1d71bb5d9fa08f6, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:42.976062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7780e-c4e4-42cc-924a-f1ca4458fa14 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:43.129850 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1986/3943] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:42 2022] PUT /identity/v3/projects/7d20a6d2a51841e681885a6d914631c3/users/ef21c25463c94888b1d71bb5d9fa08f6/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:43.140839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd06a6e-3b6e-4853-8432-88a15f115feb None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:43.141163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd06a6e-3b6e-4853-8432-88a15f115feb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:43.141448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd06a6e-3b6e-4853-8432-88a15f115feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:43.186000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:43.230157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9fd06a6e-3b6e-4853-8432-88a15f115feb None None] MFA Rules not processed for user `ef21c25463c94888b1d71bb5d9fa08f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:43.235552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9fd06a6e-3b6e-4853-8432-88a15f115feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:43.523840 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1958/3944] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:43.529002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7780e-c4e4-42cc-924a-f1ca4458fa14 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:43.580677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:43.657739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7780e-c4e4-42cc-924a-f1ca4458fa14 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:43.665804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3ff11-913e-4df3-b1f2-6741b9eea085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:43.666898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3ff11-913e-4df3-b1f2-6741b9eea085 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:43.667184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3ff11-913e-4df3-b1f2-6741b9eea085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:43.667458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3ff11-913e-4df3-b1f2-6741b9eea085 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:43.668279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3ff11-913e-4df3-b1f2-6741b9eea085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:43.671001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3ff11-913e-4df3-b1f2-6741b9eea085 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:43.834212 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1987/3945] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:43 2022] POST /identity/v3/projects => generated 383 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:43.839357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd06a6e-3b6e-4853-8432-88a15f115feb None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:43.857617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd06a6e-3b6e-4853-8432-88a15f115feb None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:43.970148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb87c78-7a62-4f07-9a63-90e9334e2947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:43.971766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb87c78-7a62-4f07-9a63-90e9334e2947 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:43.971903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb87c78-7a62-4f07-9a63-90e9334e2947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:43.972321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb87c78-7a62-4f07-9a63-90e9334e2947 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:43.973486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb87c78-7a62-4f07-9a63-90e9334e2947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:43.976801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb87c78-7a62-4f07-9a63-90e9334e2947 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:44.140731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3ff11-913e-4df3-b1f2-6741b9eea085 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:44.141058 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1959/3946] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:43 2022] POST /identity/v3/users => generated 292 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:44.156559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3ff11-913e-4df3-b1f2-6741b9eea085 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:44.168499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd413340-6e5a-43d7-bf72-148be1c30105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:44.169138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd413340-6e5a-43d7-bf72-148be1c30105 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:44.169414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd413340-6e5a-43d7-bf72-148be1c30105 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:44.169687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd413340-6e5a-43d7-bf72-148be1c30105 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:44.170344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd413340-6e5a-43d7-bf72-148be1c30105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:44.171946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd413340-6e5a-43d7-bf72-148be1c30105 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:44.207386 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1988/3947] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:47:44.211543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb87c78-7a62-4f07-9a63-90e9334e2947 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:44.226115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb87c78-7a62-4f07-9a63-90e9334e2947 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:44.246988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80488c-dd01-40b9-a654-4b9d551905f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:44.247806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80488c-dd01-40b9-a654-4b9d551905f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:44.248089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80488c-dd01-40b9-a654-4b9d551905f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:44.248415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80488c-dd01-40b9-a654-4b9d551905f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:44.249079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80488c-dd01-40b9-a654-4b9d551905f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:44.252149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80488c-dd01-40b9-a654-4b9d551905f0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:44.279481 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1960/3948] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:44.284281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd413340-6e5a-43d7-bf72-148be1c30105 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:44.299751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd413340-6e5a-43d7-bf72-148be1c30105 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:44.324939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9695710-d4c2-49ef-86ac-a1e4d278c71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:44.325885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9695710-d4c2-49ef-86ac-a1e4d278c71a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:44.326322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9695710-d4c2-49ef-86ac-a1e4d278c71a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:44.326778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9695710-d4c2-49ef-86ac-a1e4d278c71a admin admin] PATH_INFO: `/v3/projects/4c6431379f834fefb790ba65ac06e292/users/a7b1394368764aaa8e3e9124f4986d73/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:44.345602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9695710-d4c2-49ef-86ac-a1e4d278c71a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6431379f834fefb790ba65ac06e292, user_id=a7b1394368764aaa8e3e9124f4986d73, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:44.348778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9695710-d4c2-49ef-86ac-a1e4d278c71a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:44.383259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:44.426977 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1989/3949] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:44 2022] PUT /identity/v3/projects/4c6431379f834fefb790ba65ac06e292/users/a7b1394368764aaa8e3e9124f4986d73/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:44.444497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a273ade-84dc-4026-9860-2ca275b5eecc None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:44.445540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a273ade-84dc-4026-9860-2ca275b5eecc None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:44.445904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a273ade-84dc-4026-9860-2ca275b5eecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:44.498618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4a273ade-84dc-4026-9860-2ca275b5eecc None None] MFA Rules not processed for user `a7b1394368764aaa8e3e9124f4986d73`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:44.500375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4a273ade-84dc-4026-9860-2ca275b5eecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:44.760893 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1961/3950] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:44.762322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9695710-d4c2-49ef-86ac-a1e4d278c71a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:44.941390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9695710-d4c2-49ef-86ac-a1e4d278c71a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:44.958041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32806649-39cf-4d6e-8db3-742988b585c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:44.961466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32806649-39cf-4d6e-8db3-742988b585c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:44.961466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32806649-39cf-4d6e-8db3-742988b585c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:44.961466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32806649-39cf-4d6e-8db3-742988b585c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:44.967305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32806649-39cf-4d6e-8db3-742988b585c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:44.971687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32806649-39cf-4d6e-8db3-742988b585c3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:45.130965 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1990/3951] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:44 2022] POST /identity/v3/projects => generated 381 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:45.134702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a273ade-84dc-4026-9860-2ca275b5eecc None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:45.169696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a273ade-84dc-4026-9860-2ca275b5eecc None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:45.366553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:45.527167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc894c2f-f6ba-4545-860f-2cf26fbf856b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:45.527851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc894c2f-f6ba-4545-860f-2cf26fbf856b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:45.530670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc894c2f-f6ba-4545-860f-2cf26fbf856b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:45.546573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc894c2f-f6ba-4545-860f-2cf26fbf856b admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:45.549545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc894c2f-f6ba-4545-860f-2cf26fbf856b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:45.551563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc894c2f-f6ba-4545-860f-2cf26fbf856b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:45.686329 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1962/3952] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:45 2022] POST /identity/v3/users => generated 297 bytes in 552 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:45.688151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32806649-39cf-4d6e-8db3-742988b585c3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:45.709851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32806649-39cf-4d6e-8db3-742988b585c3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:45.727058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eea4f4-0bfd-4982-804b-b34353925a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:45.728222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eea4f4-0bfd-4982-804b-b34353925a96 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:45.728802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eea4f4-0bfd-4982-804b-b34353925a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:45.729226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eea4f4-0bfd-4982-804b-b34353925a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:45.732602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eea4f4-0bfd-4982-804b-b34353925a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:45.734415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eea4f4-0bfd-4982-804b-b34353925a96 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:45.775035 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1991/3953] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:45.781321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc894c2f-f6ba-4545-860f-2cf26fbf856b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:45.809767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc894c2f-f6ba-4545-860f-2cf26fbf856b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:45.835302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff70015-8f6c-4ae3-a2ad-65d8553bc3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:45.843824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff70015-8f6c-4ae3-a2ad-65d8553bc3e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:45.844116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff70015-8f6c-4ae3-a2ad-65d8553bc3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:45.844429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff70015-8f6c-4ae3-a2ad-65d8553bc3e2 admin admin] PATH_INFO: `/v3/projects/b4387ff6e835468dba5d3eddc4144053/users/b103853692bb4742a4faa0d150afef72/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:45.882152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff70015-8f6c-4ae3-a2ad-65d8553bc3e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4387ff6e835468dba5d3eddc4144053, user_id=b103853692bb4742a4faa0d150afef72, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:45.887546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff70015-8f6c-4ae3-a2ad-65d8553bc3e2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:46.037111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eea4f4-0bfd-4982-804b-b34353925a96 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:46.037532 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1963/3954] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:45 2022] PUT /identity/v3/projects/b4387ff6e835468dba5d3eddc4144053/users/b103853692bb4742a4faa0d150afef72/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:46.053277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eea4f4-0bfd-4982-804b-b34353925a96 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:46.205537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e17b0-cb5b-4f69-9581-638f24a38328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:46.206166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e17b0-cb5b-4f69-9581-638f24a38328 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:46.206444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e17b0-cb5b-4f69-9581-638f24a38328 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:46.206715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e17b0-cb5b-4f69-9581-638f24a38328 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:46.207361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e17b0-cb5b-4f69-9581-638f24a38328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:46.209083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e17b0-cb5b-4f69-9581-638f24a38328 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:46.232599 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1992/3955] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:47:46.233387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff70015-8f6c-4ae3-a2ad-65d8553bc3e2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:46.258225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff70015-8f6c-4ae3-a2ad-65d8553bc3e2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:46.271550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9fb79-16f4-40df-b2f5-23f05fced7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:46.275458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9fb79-16f4-40df-b2f5-23f05fced7df admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:46.275458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9fb79-16f4-40df-b2f5-23f05fced7df admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:46.275458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9fb79-16f4-40df-b2f5-23f05fced7df admin admin] PATH_INFO: `/v3/projects/b4387ff6e835468dba5d3eddc4144053/users/b103853692bb4742a4faa0d150afef72/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:46.285324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9fb79-16f4-40df-b2f5-23f05fced7df admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4387ff6e835468dba5d3eddc4144053, user_id=b103853692bb4742a4faa0d150afef72, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:46.298598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9fb79-16f4-40df-b2f5-23f05fced7df admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:46.361144 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1964/3956] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:46 2022] PUT /identity/v3/projects/b4387ff6e835468dba5d3eddc4144053/users/b103853692bb4742a4faa0d150afef72/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:46.371668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d38c8a-15f7-4bb2-b657-13230fc77a0d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:46.371956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d38c8a-15f7-4bb2-b657-13230fc77a0d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:46.372259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d38c8a-15f7-4bb2-b657-13230fc77a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:46.420672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-96d38c8a-15f7-4bb2-b657-13230fc77a0d None None] MFA Rules not processed for user `b103853692bb4742a4faa0d150afef72`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:46.424076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-96d38c8a-15f7-4bb2-b657-13230fc77a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:46.564425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:46.581365 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1993/3957] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:46.590991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9fb79-16f4-40df-b2f5-23f05fced7df admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:46.596585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ace9fb79-16f4-40df-b2f5-23f05fced7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:46.884835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9fb79-16f4-40df-b2f5-23f05fced7df admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:46.930777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4a81d-aac2-4fb2-addf-9341916a26ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:46.931561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4a81d-aac2-4fb2-addf-9341916a26ff service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:46.931921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4a81d-aac2-4fb2-addf-9341916a26ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:46.932346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4a81d-aac2-4fb2-addf-9341916a26ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:47.181473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4a81d-aac2-4fb2-addf-9341916a26ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:47.184689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4a81d-aac2-4fb2-addf-9341916a26ff service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:47.203992 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1965/3958] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:47.453685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:48.373598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:50.070321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:50.309622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa19a74-85d3-436e-980d-5030bbf420b2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:50.310097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa19a74-85d3-436e-980d-5030bbf420b2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:50.310746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa19a74-85d3-436e-980d-5030bbf420b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:50.381537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-efa19a74-85d3-436e-980d-5030bbf420b2 None None] MFA Rules not processed for user `8af9568c510340c1adfcafe10ae44002`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:50.382800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-efa19a74-85d3-436e-980d-5030bbf420b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:50.569848 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1994/3959] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:50.577262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4a81d-aac2-4fb2-addf-9341916a26ff service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:50.579378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-31d4a81d-aac2-4fb2-addf-9341916a26ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:50.600380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:50.701110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4a81d-aac2-4fb2-addf-9341916a26ff service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:50.710924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1304f-12bf-4fbb-802c-2f0489217b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:50.711582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1304f-12bf-4fbb-802c-2f0489217b18 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:50.711852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1304f-12bf-4fbb-802c-2f0489217b18 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:50.712352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1304f-12bf-4fbb-802c-2f0489217b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:50.724294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1304f-12bf-4fbb-802c-2f0489217b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:50.726183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1304f-12bf-4fbb-802c-2f0489217b18 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:50.740544 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1966/3960] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:51.601713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69259c0d-9544-46fc-9299-a7056b9648e8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:51.602754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69259c0d-9544-46fc-9299-a7056b9648e8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:51.603245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69259c0d-9544-46fc-9299-a7056b9648e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:51.715310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-69259c0d-9544-46fc-9299-a7056b9648e8 None None] MFA Rules not processed for user `6190ea907d0544438eb3491462cfc49b`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:51.718325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-69259c0d-9544-46fc-9299-a7056b9648e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:51.753827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:52.003072 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1995/3961] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:52.017894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59144-27db-41f0-ad66-4f017b196a87 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:52.019459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59144-27db-41f0-ad66-4f017b196a87 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:52.019888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59144-27db-41f0-ad66-4f017b196a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:52.103129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f5e59144-27db-41f0-ad66-4f017b196a87 None None] MFA Rules not processed for user `6190ea907d0544438eb3491462cfc49b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:52.109278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f5e59144-27db-41f0-ad66-4f017b196a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:52.139288 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1967/3962] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:53.530404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17e33e-e267-42fb-9bbf-aa7995b5e11c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:53.531004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17e33e-e267-42fb-9bbf-aa7995b5e11c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:53.531361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17e33e-e267-42fb-9bbf-aa7995b5e11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:53.599183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ad17e33e-e267-42fb-9bbf-aa7995b5e11c None None] MFA Rules not processed for user `10f307547cc64c8f85248fd0444aabd4`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:53.601112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ad17e33e-e267-42fb-9bbf-aa7995b5e11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:53.755722 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1996/3963] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:53.765529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2552419-dd85-4ef1-b2a3-af3948ce85f2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:53.766158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2552419-dd85-4ef1-b2a3-af3948ce85f2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:53.766158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2552419-dd85-4ef1-b2a3-af3948ce85f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:53.809243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e2552419-dd85-4ef1-b2a3-af3948ce85f2 None None] MFA Rules not processed for user `10f307547cc64c8f85248fd0444aabd4`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:53.809243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e2552419-dd85-4ef1-b2a3-af3948ce85f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:53.819707 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1968/3964] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:53.832770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17e33e-e267-42fb-9bbf-aa7995b5e11c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:53.835952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ad17e33e-e267-42fb-9bbf-aa7995b5e11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:53.889661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17e33e-e267-42fb-9bbf-aa7995b5e11c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:53.905188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974b32a-7244-401c-a96d-b19e3f4fbdda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:53.906550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974b32a-7244-401c-a96d-b19e3f4fbdda service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:53.906890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974b32a-7244-401c-a96d-b19e3f4fbdda service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:53.907425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974b32a-7244-401c-a96d-b19e3f4fbdda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:53.947712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974b32a-7244-401c-a96d-b19e3f4fbdda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:53.953112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974b32a-7244-401c-a96d-b19e3f4fbdda service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:54.033503 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1997/3965] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:47:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:47:54.890285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736dd80-a47d-4ad4-8e77-81628b0caa25 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:54.890830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736dd80-a47d-4ad4-8e77-81628b0caa25 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:54.890830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736dd80-a47d-4ad4-8e77-81628b0caa25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:54.901027 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-9736dd80-a47d-4ad4-8e77-81628b0caa25 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:47:54.901027 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:47:54.901027 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:47:54.901027 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:47:54.901027 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:47:54.901027 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:47:54.901027 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:47:54.901027 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:47:54.901027 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:47:54.901027 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:47:54.901027 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:47:54.901027 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:47:54.901027 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:47:54.901863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:47:54.901863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:47:54.901863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:47:54.901863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:47:54.901863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:47:54.901863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:47:54.901863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:47:54.901863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:47:54.901863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:47:54.901863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:47:54.901863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:47:54.901863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:47:54.901863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:47:54.901863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:47:54.901863 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:47:54.908430 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1969/3966] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:47:54 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 19 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:47:54.965849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa783ff-c29b-4a1b-9c0a-415119b5e6f2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:54.966402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa783ff-c29b-4a1b-9c0a-415119b5e6f2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:54.966402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa783ff-c29b-4a1b-9c0a-415119b5e6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:54.982799 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-efa783ff-c29b-4a1b-9c0a-415119b5e6f2 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:47:54.982799 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:47:54.982799 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:47:54.982799 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:47:54.982799 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:47:54.982799 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:47:54.982799 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:47:54.982799 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:47:54.982799 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:47:54.982799 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:47:54.982799 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:47:54.982799 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:47:54.982799 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:47:54.988024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:47:54.988024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:47:54.988024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:47:54.988024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:47:54.988024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:47:54.988024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:47:54.988024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:47:54.988024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:47:54.988024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:47:54.988024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:47:54.988024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:47:54.988024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:47:54.988024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:47:54.988024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:47:54.988024 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:47:54.989073 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1998/3967] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:47:54 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 28 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:47:56.108775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736dd80-a47d-4ad4-8e77-81628b0caa25 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:56.112670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9736dd80-a47d-4ad4-8e77-81628b0caa25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:56.309649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736dd80-a47d-4ad4-8e77-81628b0caa25 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:56.325367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a32fb0-f81c-4d2b-a5aa-2ddb2dc78633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:56.328283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a32fb0-f81c-4d2b-a5aa-2ddb2dc78633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:56.329634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a32fb0-f81c-4d2b-a5aa-2ddb2dc78633 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:56.332120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a32fb0-f81c-4d2b-a5aa-2ddb2dc78633 admin admin] PATH_INFO: `/v3/users/419210a4f7744db6a2571ae341744361` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:56.338297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a32fb0-f81c-4d2b-a5aa-2ddb2dc78633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=419210a4f7744db6a2571ae341744361)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:56.351055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a32fb0-f81c-4d2b-a5aa-2ddb2dc78633 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:56.409224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e81f8-012f-4c43-ac06-3f79bc1cffa0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:56.411030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e81f8-012f-4c43-ac06-3f79bc1cffa0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:56.411140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e81f8-012f-4c43-ac06-3f79bc1cffa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:56.461992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2a9e81f8-012f-4c43-ac06-3f79bc1cffa0 None None] MFA Rules not processed for user `59fbc90b125c402bbee94241a3a609d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:56.472215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2a9e81f8-012f-4c43-ac06-3f79bc1cffa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:56.627590 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 1999/3968] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:56.690416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b9a32fb0-f81c-4d2b-a5aa-2ddb2dc78633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419210a4f7744db6a2571ae341744361'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:56.824778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b9a32fb0-f81c-4d2b-a5aa-2ddb2dc78633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419210a4f7744db6a2571ae341744361'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:56.825690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b9a32fb0-f81c-4d2b-a5aa-2ddb2dc78633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419210a4f7744db6a2571ae341744361'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:56.847998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b9a32fb0-f81c-4d2b-a5aa-2ddb2dc78633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419210a4f7744db6a2571ae341744361'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:56.897314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b9a32fb0-f81c-4d2b-a5aa-2ddb2dc78633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419210a4f7744db6a2571ae341744361'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:56.907364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:56.917365 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1970/3969] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:47:56 2022] DELETE /identity/v3/users/419210a4f7744db6a2571ae341744361 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:57.792958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e81f8-012f-4c43-ac06-3f79bc1cffa0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:57.819332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e81f8-012f-4c43-ac06-3f79bc1cffa0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:58.011395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:47:58.130255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6aae6-cad2-4628-a231-94b50016cee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:58.131743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6aae6-cad2-4628-a231-94b50016cee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:58.138052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6aae6-cad2-4628-a231-94b50016cee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:58.138620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6aae6-cad2-4628-a231-94b50016cee9 admin admin] PATH_INFO: `/v3/projects/7cd251c2ac1f4f7b98f3c9fffdb4dbcd` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:58.143210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6aae6-cad2-4628-a231-94b50016cee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cd251c2ac1f4f7b98f3c9fffdb4dbcd)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:58.145501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6aae6-cad2-4628-a231-94b50016cee9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:58.365954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-16b6aae6-cad2-4628-a231-94b50016cee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd251c2ac1f4f7b98f3c9fffdb4dbcd', 'request_id': 'req-16b6aae6-cad2-4628-a231-94b50016cee9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:58.401352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-16b6aae6-cad2-4628-a231-94b50016cee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd251c2ac1f4f7b98f3c9fffdb4dbcd', 'request_id': 'req-16b6aae6-cad2-4628-a231-94b50016cee9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:58.493531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-16b6aae6-cad2-4628-a231-94b50016cee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd251c2ac1f4f7b98f3c9fffdb4dbcd', 'request_id': 'req-16b6aae6-cad2-4628-a231-94b50016cee9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:58.510328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-16b6aae6-cad2-4628-a231-94b50016cee9 admin admin] The token cache is being invalidate because project 7cd251c2ac1f4f7b98f3c9fffdb4dbcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:47:58.510810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-16b6aae6-cad2-4628-a231-94b50016cee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:58.511609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-16b6aae6-cad2-4628-a231-94b50016cee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:47:58.517163 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2000/3970] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:47:57 2022] DELETE /identity/v3/projects/7cd251c2ac1f4f7b98f3c9fffdb4dbcd => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:58.533986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d958a19-f0c2-42b8-a20b-cb7157db6b7d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:58.534836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d958a19-f0c2-42b8-a20b-cb7157db6b7d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:58.535302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d958a19-f0c2-42b8-a20b-cb7157db6b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:58.570032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4d958a19-f0c2-42b8-a20b-cb7157db6b7d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:58.572570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4d958a19-f0c2-42b8-a20b-cb7157db6b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:58.687049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcff2f7-fc60-4d3c-8a80-2503e805530d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:58.690662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcff2f7-fc60-4d3c-8a80-2503e805530d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:58.693764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcff2f7-fc60-4d3c-8a80-2503e805530d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:58.708994 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1971/3971] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:47:58.710914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0f55a-26c5-47e4-856a-cdd8590bde1c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:58.711439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0f55a-26c5-47e4-856a-cdd8590bde1c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:58.711875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0f55a-26c5-47e4-856a-cdd8590bde1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:58.744406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3bcff2f7-fc60-4d3c-8a80-2503e805530d None None] MFA Rules not processed for user `8af9568c510340c1adfcafe10ae44002`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:58.745799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3bcff2f7-fc60-4d3c-8a80-2503e805530d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:58.756022 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-40d0f55a-26c5-47e4-856a-cdd8590bde1c None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:47:58.756022 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:47:58.756022 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:47:58.756022 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:47:58.756022 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:47:58.756022 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:47:58.756022 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:47:58.756022 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:47:58.756022 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:47:58.756022 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:47:58.756022 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:47:58.756022 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:47:58.756022 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:47:58.757101 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:47:58.757101 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:47:58.757101 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:47:58.757101 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:47:58.757101 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:47:58.757101 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:47:58.757101 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:47:58.757101 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:47:58.757101 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:47:58.757101 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:47:58.757101 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:47:58.757101 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:47:58.757101 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:47:58.757101 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:47:58.757101 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:47:58.761332 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1972/3972] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:47:58 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 51 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:47:58.820348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30a1d0-9049-4f09-b2ce-0d7369c296f5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:58.820348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30a1d0-9049-4f09-b2ce-0d7369c296f5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:58.820348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30a1d0-9049-4f09-b2ce-0d7369c296f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:58.837275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9b30a1d0-9049-4f09-b2ce-0d7369c296f5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:58.849888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9b30a1d0-9049-4f09-b2ce-0d7369c296f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:47:58.910715 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1973/3973] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:58.915668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30a1d0-9049-4f09-b2ce-0d7369c296f5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:58.930634 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2001/3974] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:47:58.979627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30a1d0-9049-4f09-b2ce-0d7369c296f5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:58.996834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6edfda-cec3-4994-8cc1-58542b478415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:58.997937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6edfda-cec3-4994-8cc1-58542b478415 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:58.998621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6edfda-cec3-4994-8cc1-58542b478415 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:58.999122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6edfda-cec3-4994-8cc1-58542b478415 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:59.000005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6edfda-cec3-4994-8cc1-58542b478415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:47:59.000590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6edfda-cec3-4994-8cc1-58542b478415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:59.003256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6edfda-cec3-4994-8cc1-58542b478415 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:59.041987 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1974/3975] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:47:59.042130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcff2f7-fc60-4d3c-8a80-2503e805530d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:59.060144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcff2f7-fc60-4d3c-8a80-2503e805530d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:59.079726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28defe1a-4765-4a67-b8d3-5b50ddf0de8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:59.080781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28defe1a-4765-4a67-b8d3-5b50ddf0de8a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:59.081234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28defe1a-4765-4a67-b8d3-5b50ddf0de8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:59.081691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28defe1a-4765-4a67-b8d3-5b50ddf0de8a admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:59.082488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28defe1a-4765-4a67-b8d3-5b50ddf0de8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:59.084750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28defe1a-4765-4a67-b8d3-5b50ddf0de8a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:59.332697 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2002/3976] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:47:59 2022] POST /identity/v3/projects => generated 373 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:59.337302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6edfda-cec3-4994-8cc1-58542b478415 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:59.350440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6edfda-cec3-4994-8cc1-58542b478415 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:59.474339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25177ea4-033d-4e6d-b20a-aabca23ce55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:59.475285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25177ea4-033d-4e6d-b20a-aabca23ce55d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:59.475690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25177ea4-033d-4e6d-b20a-aabca23ce55d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:59.476076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25177ea4-033d-4e6d-b20a-aabca23ce55d admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:59.476678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25177ea4-033d-4e6d-b20a-aabca23ce55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:59.490483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25177ea4-033d-4e6d-b20a-aabca23ce55d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:59.599175 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1975/3977] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:47:59 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:47:59.603029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28defe1a-4765-4a67-b8d3-5b50ddf0de8a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:59.618299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28defe1a-4765-4a67-b8d3-5b50ddf0de8a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:59.631446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e25ae9-994d-42e6-8739-de5caa57f036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:59.632220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e25ae9-994d-42e6-8739-de5caa57f036 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:59.632575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e25ae9-994d-42e6-8739-de5caa57f036 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:59.632938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e25ae9-994d-42e6-8739-de5caa57f036 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:59.633673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e25ae9-994d-42e6-8739-de5caa57f036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:59.635356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e25ae9-994d-42e6-8739-de5caa57f036 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:59.670521 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2003/3978] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:59.670647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25177ea4-033d-4e6d-b20a-aabca23ce55d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:59.685282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25177ea4-033d-4e6d-b20a-aabca23ce55d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:59.704489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36df8c5-a4b8-4bf6-854a-f7cae98cd469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:59.704489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36df8c5-a4b8-4bf6-854a-f7cae98cd469 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:59.704489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36df8c5-a4b8-4bf6-854a-f7cae98cd469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:59.704489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36df8c5-a4b8-4bf6-854a-f7cae98cd469 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:59.705046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36df8c5-a4b8-4bf6-854a-f7cae98cd469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:59.706662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36df8c5-a4b8-4bf6-854a-f7cae98cd469 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:59.743957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e25ae9-994d-42e6-8739-de5caa57f036 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:47:59.755781 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1976/3979] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:47:59.761021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e25ae9-994d-42e6-8739-de5caa57f036 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:47:59.780305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a1164-5fc2-4f4f-840c-ac14f9f5657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:47:59.781847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a1164-5fc2-4f4f-840c-ac14f9f5657e admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:59.783719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a1164-5fc2-4f4f-840c-ac14f9f5657e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:59.784199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a1164-5fc2-4f4f-840c-ac14f9f5657e admin admin] PATH_INFO: `/v3/projects/a3f9953aa720463aa062c0715d7146cb/users/73b00135aa2e42c3af6ac6c1afa4fd4e/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:59.803400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a1164-5fc2-4f4f-840c-ac14f9f5657e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f9953aa720463aa062c0715d7146cb, user_id=73b00135aa2e42c3af6ac6c1afa4fd4e, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:47:59.807177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a1164-5fc2-4f4f-840c-ac14f9f5657e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:47:59.895613 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2004/3980] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:47:59 2022] PUT /identity/v3/projects/a3f9953aa720463aa062c0715d7146cb/users/73b00135aa2e42c3af6ac6c1afa4fd4e/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:47:59.907875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b05ec4-ac0d-4ca0-9528-dc14fa68ad70 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:47:59.908639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b05ec4-ac0d-4ca0-9528-dc14fa68ad70 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:47:59.908639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b05ec4-ac0d-4ca0-9528-dc14fa68ad70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:47:59.951194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-71b05ec4-ac0d-4ca0-9528-dc14fa68ad70 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:47:59.963831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-71b05ec4-ac0d-4ca0-9528-dc14fa68ad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:00.044292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:00.072360 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1977/3981] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:00.104947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a1164-5fc2-4f4f-840c-ac14f9f5657e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:00.106466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f16a1164-5fc2-4f4f-840c-ac14f9f5657e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:00.134628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:00.245940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a1164-5fc2-4f4f-840c-ac14f9f5657e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:00.267722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc1c7d-7bdc-41ac-8dc5-4ab773c69c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:00.267722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc1c7d-7bdc-41ac-8dc5-4ab773c69c6a service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:00.267722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc1c7d-7bdc-41ac-8dc5-4ab773c69c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:00.267722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc1c7d-7bdc-41ac-8dc5-4ab773c69c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:00.292313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc1c7d-7bdc-41ac-8dc5-4ab773c69c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:00.294267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc1c7d-7bdc-41ac-8dc5-4ab773c69c6a service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:00.307233 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2005/3982] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:00.556105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263bbe-8c21-4969-85c3-ba522f9772ea None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:00.556411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263bbe-8c21-4969-85c3-ba522f9772ea None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:00.556685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc263bbe-8c21-4969-85c3-ba522f9772ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:00.563099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-bc263bbe-8c21-4969-85c3-ba522f9772ea None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:00.563099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:48:00.563099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:48:00.563099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:48:00.563099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:48:00.563099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:48:00.563099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:48:00.563099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:48:00.563099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:48:00.563099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:48:00.563099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:48:00.563099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:48:00.563099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:48:00.564214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:48:00.564214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:48:00.564214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:48:00.564214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:48:00.564214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:48:00.564214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:48:00.564214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:48:00.564214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:48:00.564214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:48:00.564214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:48:00.564214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:48:00.564214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:48:00.564214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:48:00.564214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:00.564214 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:48:00.565310 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1978/3983] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:48:00 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 9 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:48:07.147020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc1c7d-7bdc-41ac-8dc5-4ab773c69c6a service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:07.150008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c9cc1c7d-7bdc-41ac-8dc5-4ab773c69c6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:07.170641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc1c7d-7bdc-41ac-8dc5-4ab773c69c6a service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:07.183795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1eb676-fd29-4575-bbb3-6b07b6f325de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:07.184694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1eb676-fd29-4575-bbb3-6b07b6f325de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:07.185142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1eb676-fd29-4575-bbb3-6b07b6f325de admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:07.185564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1eb676-fd29-4575-bbb3-6b07b6f325de admin admin] PATH_INFO: `/v3/users/10f307547cc64c8f85248fd0444aabd4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:07.186916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1eb676-fd29-4575-bbb3-6b07b6f325de admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f307547cc64c8f85248fd0444aabd4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:07.189496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1eb676-fd29-4575-bbb3-6b07b6f325de admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:07.467255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ee1eb676-fd29-4575-bbb3-6b07b6f325de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f307547cc64c8f85248fd0444aabd4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:07.467966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ee1eb676-fd29-4575-bbb3-6b07b6f325de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f307547cc64c8f85248fd0444aabd4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:07.585022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ee1eb676-fd29-4575-bbb3-6b07b6f325de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f307547cc64c8f85248fd0444aabd4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:07.585759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ee1eb676-fd29-4575-bbb3-6b07b6f325de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f307547cc64c8f85248fd0444aabd4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:07.629315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ee1eb676-fd29-4575-bbb3-6b07b6f325de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f307547cc64c8f85248fd0444aabd4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:07.672035 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2006/3984] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:07 2022] DELETE /identity/v3/users/10f307547cc64c8f85248fd0444aabd4 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:08.978084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc263bbe-8c21-4969-85c3-ba522f9772ea None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:08.979995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bc263bbe-8c21-4969-85c3-ba522f9772ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:09.170705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc263bbe-8c21-4969-85c3-ba522f9772ea None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:09.179183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f8ec8-10db-4454-abb4-1538b65d702a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:09.180819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f8ec8-10db-4454-abb4-1538b65d702a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:09.181296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f8ec8-10db-4454-abb4-1538b65d702a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:09.181758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f8ec8-10db-4454-abb4-1538b65d702a admin admin] PATH_INFO: `/v3/projects/bdae27a758524b3e9d33a225b9e19d92` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:09.184288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f8ec8-10db-4454-abb4-1538b65d702a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdae27a758524b3e9d33a225b9e19d92)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:09.190035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f8ec8-10db-4454-abb4-1538b65d702a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:09.355145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-121f8ec8-10db-4454-abb4-1538b65d702a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdae27a758524b3e9d33a225b9e19d92', 'request_id': 'req-121f8ec8-10db-4454-abb4-1538b65d702a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:09.365388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-121f8ec8-10db-4454-abb4-1538b65d702a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdae27a758524b3e9d33a225b9e19d92', 'request_id': 'req-121f8ec8-10db-4454-abb4-1538b65d702a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:09.378094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-121f8ec8-10db-4454-abb4-1538b65d702a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdae27a758524b3e9d33a225b9e19d92', 'request_id': 'req-121f8ec8-10db-4454-abb4-1538b65d702a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:09.491450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-121f8ec8-10db-4454-abb4-1538b65d702a admin admin] The token cache is being invalidate because project bdae27a758524b3e9d33a225b9e19d92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:09.491785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-121f8ec8-10db-4454-abb4-1538b65d702a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:09.492753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-121f8ec8-10db-4454-abb4-1538b65d702a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:09.495248 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1979/3985] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:08 2022] DELETE /identity/v3/projects/bdae27a758524b3e9d33a225b9e19d92 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:09.511339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5751536-27f3-4691-9257-10e24726dc0f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:09.512229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5751536-27f3-4691-9257-10e24726dc0f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:09.512679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5751536-27f3-4691-9257-10e24726dc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:09.541219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e5751536-27f3-4691-9257-10e24726dc0f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:09.543253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e5751536-27f3-4691-9257-10e24726dc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:09.692064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa90ab-a2e4-420c-8c25-b3ae98e33e75 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:09.692450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa90ab-a2e4-420c-8c25-b3ae98e33e75 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:09.692682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa90ab-a2e4-420c-8c25-b3ae98e33e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:09.694819 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2007/3986] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:09.729641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-01fa90ab-a2e4-420c-8c25-b3ae98e33e75 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:09.730900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-01fa90ab-a2e4-420c-8c25-b3ae98e33e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:09.757957 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1980/3987] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:48:09.758367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5751536-27f3-4691-9257-10e24726dc0f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:09.778549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5751536-27f3-4691-9257-10e24726dc0f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:09.801759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f10c6-f25b-4d39-a130-a1cf4ad2e929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:09.802410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f10c6-f25b-4d39-a130-a1cf4ad2e929 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:09.802695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f10c6-f25b-4d39-a130-a1cf4ad2e929 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:09.802973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f10c6-f25b-4d39-a130-a1cf4ad2e929 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:09.803644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f10c6-f25b-4d39-a130-a1cf4ad2e929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:48:09.803974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f10c6-f25b-4d39-a130-a1cf4ad2e929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:09.805615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f10c6-f25b-4d39-a130-a1cf4ad2e929 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:09.850875 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2008/3988] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:09.852105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa90ab-a2e4-420c-8c25-b3ae98e33e75 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:09.868922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa90ab-a2e4-420c-8c25-b3ae98e33e75 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:09.877679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106a013-c1d3-42fa-9974-4e8693966d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:09.878303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106a013-c1d3-42fa-9974-4e8693966d58 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:09.878581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106a013-c1d3-42fa-9974-4e8693966d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:09.878853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106a013-c1d3-42fa-9974-4e8693966d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:09.879489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106a013-c1d3-42fa-9974-4e8693966d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:09.881526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106a013-c1d3-42fa-9974-4e8693966d58 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:09.987336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8618b50-5288-493e-b985-62161b34aa4c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:09.987652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8618b50-5288-493e-b985-62161b34aa4c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:09.987903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8618b50-5288-493e-b985-62161b34aa4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:10.025648 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1981/3989] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:09 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:10.026297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d8618b50-5288-493e-b985-62161b34aa4c None None] MFA Rules not processed for user `8af9568c510340c1adfcafe10ae44002`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:10.026959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d8618b50-5288-493e-b985-62161b34aa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:10.032718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106a013-c1d3-42fa-9974-4e8693966d58 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:10.041994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:10.131779 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2009/3990] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:48:10.144926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8618b50-5288-493e-b985-62161b34aa4c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:10.152068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d8618b50-5288-493e-b985-62161b34aa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:10.261300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106a013-c1d3-42fa-9974-4e8693966d58 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:10.271045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335e501-fd50-47df-ae03-d542ce4d7a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:10.271676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335e501-fd50-47df-ae03-d542ce4d7a0e admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:10.271961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335e501-fd50-47df-ae03-d542ce4d7a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:10.272267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335e501-fd50-47df-ae03-d542ce4d7a0e admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:10.272914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335e501-fd50-47df-ae03-d542ce4d7a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:10.281941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335e501-fd50-47df-ae03-d542ce4d7a0e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:10.303922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:10.323414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8618b50-5288-493e-b985-62161b34aa4c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:10.327824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cf5cd-87ec-4c74-914e-7a8a3eb0535b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:10.328027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cf5cd-87ec-4c74-914e-7a8a3eb0535b service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:10.328341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cf5cd-87ec-4c74-914e-7a8a3eb0535b service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:10.328586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cf5cd-87ec-4c74-914e-7a8a3eb0535b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:10.330497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-610cf5cd-87ec-4c74-914e-7a8a3eb0535b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:10.394508 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1982/3991] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:10 2022] POST /identity/v3/users => generated 283 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:10.395675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335e501-fd50-47df-ae03-d542ce4d7a0e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:10.412079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335e501-fd50-47df-ae03-d542ce4d7a0e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:10.417903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0955e-c1c2-44c0-8e2e-e0f3b903cc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:10.418909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0955e-c1c2-44c0-8e2e-e0f3b903cc4d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:10.419428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0955e-c1c2-44c0-8e2e-e0f3b903cc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:10.419929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0955e-c1c2-44c0-8e2e-e0f3b903cc4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:10.420823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0955e-c1c2-44c0-8e2e-e0f3b903cc4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:10.423138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0955e-c1c2-44c0-8e2e-e0f3b903cc4d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:10.437951 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1983/3992] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:10.441350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0955e-c1c2-44c0-8e2e-e0f3b903cc4d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:10.449193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cf5cd-87ec-4c74-914e-7a8a3eb0535b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:10.451398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cf5cd-87ec-4c74-914e-7a8a3eb0535b service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:10.466179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0955e-c1c2-44c0-8e2e-e0f3b903cc4d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:10.472332 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2010/3993] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:10.480555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585f6ff-c536-4441-87a7-4e0733332d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:10.483854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585f6ff-c536-4441-87a7-4e0733332d8b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:10.484196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585f6ff-c536-4441-87a7-4e0733332d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:10.484576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585f6ff-c536-4441-87a7-4e0733332d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:10.485311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585f6ff-c536-4441-87a7-4e0733332d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:10.487087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585f6ff-c536-4441-87a7-4e0733332d8b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:10.523322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cf5cd-87ec-4c74-914e-7a8a3eb0535b service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:10.523838 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1984/3994] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:48:10.541544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cf5cd-87ec-4c74-914e-7a8a3eb0535b service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:10.549135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b343661-cbfb-4fa4-a81a-5f5d1eec808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:10.550462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b343661-cbfb-4fa4-a81a-5f5d1eec808b admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:10.551049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b343661-cbfb-4fa4-a81a-5f5d1eec808b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:10.552318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b343661-cbfb-4fa4-a81a-5f5d1eec808b admin admin] PATH_INFO: `/v3/projects/d9810a6d61ab4eb281b5bc5d5ecff6fa/users/a60798780db14e00a12cbae6f8253ee2/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:10.594376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b343661-cbfb-4fa4-a81a-5f5d1eec808b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9810a6d61ab4eb281b5bc5d5ecff6fa, user_id=a60798780db14e00a12cbae6f8253ee2, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:10.597952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b343661-cbfb-4fa4-a81a-5f5d1eec808b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:10.744800 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2011/3995] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:10 2022] PUT /identity/v3/projects/d9810a6d61ab4eb281b5bc5d5ecff6fa/users/a60798780db14e00a12cbae6f8253ee2/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:48:10.744903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606e34e-8bd9-4fc2-a44c-ab636c70c13f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:10.744903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606e34e-8bd9-4fc2-a44c-ab636c70c13f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:10.745065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606e34e-8bd9-4fc2-a44c-ab636c70c13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:10.784454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7606e34e-8bd9-4fc2-a44c-ab636c70c13f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:10.785994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7606e34e-8bd9-4fc2-a44c-ab636c70c13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:10.909374 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1985/3996] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:10.939282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b343661-cbfb-4fa4-a81a-5f5d1eec808b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:10.944799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2b343661-cbfb-4fa4-a81a-5f5d1eec808b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:11.037778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86bcc4-f9db-49ce-b100-dc279f11d24f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:11.038305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86bcc4-f9db-49ce-b100-dc279f11d24f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:11.038421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86bcc4-f9db-49ce-b100-dc279f11d24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:11.046631 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-3c86bcc4-f9db-49ce-b100-dc279f11d24f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:11.046631 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:48:11.046631 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:48:11.046631 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:48:11.046631 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:48:11.046631 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:48:11.046631 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:48:11.046631 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:48:11.046631 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:48:11.046631 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:48:11.046631 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:48:11.046631 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:48:11.046631 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:48:11.048393 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:48:11.048393 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:48:11.048393 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:48:11.048393 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:48:11.048393 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:48:11.048393 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:48:11.048393 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:48:11.048393 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:48:11.048393 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:48:11.048393 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:48:11.048393 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:48:11.048393 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:48:11.048393 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:48:11.048393 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:11.048393 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:48:11.057047 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1986/3997] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:48:11 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 22 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 04:48:11.145680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b343661-cbfb-4fa4-a81a-5f5d1eec808b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:11.151536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f8c1a-5b09-42a9-850a-5e21634120be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:11.152702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f8c1a-5b09-42a9-850a-5e21634120be service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:11.153434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f8c1a-5b09-42a9-850a-5e21634120be service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:11.153785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f8c1a-5b09-42a9-850a-5e21634120be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:11.166052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f8c1a-5b09-42a9-850a-5e21634120be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:11.167679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f8c1a-5b09-42a9-850a-5e21634120be service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:11.179861 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2012/3998] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:11.239951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:12.824825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86bcc4-f9db-49ce-b100-dc279f11d24f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:12.826779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3c86bcc4-f9db-49ce-b100-dc279f11d24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:12.862041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86bcc4-f9db-49ce-b100-dc279f11d24f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:12.872144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d267f3a-d49d-442c-af00-a222eb27829b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:12.874120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d267f3a-d49d-442c-af00-a222eb27829b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:12.874458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d267f3a-d49d-442c-af00-a222eb27829b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:12.875534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d267f3a-d49d-442c-af00-a222eb27829b admin admin] PATH_INFO: `/v3/users/59fbc90b125c402bbee94241a3a609d5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:12.876937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d267f3a-d49d-442c-af00-a222eb27829b admin admin] RBAC: Authorizing `identity:delete_user(user_id=59fbc90b125c402bbee94241a3a609d5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:12.881461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d267f3a-d49d-442c-af00-a222eb27829b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:13.207238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3d267f3a-d49d-442c-af00-a222eb27829b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59fbc90b125c402bbee94241a3a609d5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:13.319682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3d267f3a-d49d-442c-af00-a222eb27829b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59fbc90b125c402bbee94241a3a609d5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:13.320357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3d267f3a-d49d-442c-af00-a222eb27829b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59fbc90b125c402bbee94241a3a609d5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:13.333132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3d267f3a-d49d-442c-af00-a222eb27829b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59fbc90b125c402bbee94241a3a609d5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:13.366357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3d267f3a-d49d-442c-af00-a222eb27829b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59fbc90b125c402bbee94241a3a609d5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:13.391246 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1987/3999] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:12 2022] DELETE /identity/v3/users/59fbc90b125c402bbee94241a3a609d5 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:14.298786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f8c1a-5b09-42a9-850a-5e21634120be service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:14.322806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f8c1a-5b09-42a9-850a-5e21634120be service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:14.495784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7364e7d-495d-4228-ba7a-70982bbfcb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:14.496847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7364e7d-495d-4228-ba7a-70982bbfcb3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:14.497876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7364e7d-495d-4228-ba7a-70982bbfcb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:14.499729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7364e7d-495d-4228-ba7a-70982bbfcb3f admin admin] PATH_INFO: `/v3/projects/c2743ef5b6bf4dea97d585fa121bdf6f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:14.507624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7364e7d-495d-4228-ba7a-70982bbfcb3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2743ef5b6bf4dea97d585fa121bdf6f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:14.525701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7364e7d-495d-4228-ba7a-70982bbfcb3f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:14.710968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b7364e7d-495d-4228-ba7a-70982bbfcb3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2743ef5b6bf4dea97d585fa121bdf6f', 'request_id': 'req-b7364e7d-495d-4228-ba7a-70982bbfcb3f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:14.729043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b7364e7d-495d-4228-ba7a-70982bbfcb3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2743ef5b6bf4dea97d585fa121bdf6f', 'request_id': 'req-b7364e7d-495d-4228-ba7a-70982bbfcb3f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:14.839644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b7364e7d-495d-4228-ba7a-70982bbfcb3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2743ef5b6bf4dea97d585fa121bdf6f', 'request_id': 'req-b7364e7d-495d-4228-ba7a-70982bbfcb3f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:14.861754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b7364e7d-495d-4228-ba7a-70982bbfcb3f admin admin] The token cache is being invalidate because project c2743ef5b6bf4dea97d585fa121bdf6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:14.862070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b7364e7d-495d-4228-ba7a-70982bbfcb3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:14.862954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b7364e7d-495d-4228-ba7a-70982bbfcb3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:14.869321 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2013/4000] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:14 2022] DELETE /identity/v3/projects/c2743ef5b6bf4dea97d585fa121bdf6f => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:48:14.876739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa910b3-a04a-4661-a755-699a584e46d1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:14.884429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa910b3-a04a-4661-a755-699a584e46d1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:14.884429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa910b3-a04a-4661-a755-699a584e46d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:14.945116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6fa910b3-a04a-4661-a755-699a584e46d1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:14.949209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6fa910b3-a04a-4661-a755-699a584e46d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:15.074742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:15.155810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb0984-60c3-4973-8271-c2375fdc1291 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:15.156880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb0984-60c3-4973-8271-c2375fdc1291 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:15.157285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb0984-60c3-4973-8271-c2375fdc1291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:15.169411 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1988/4001] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:15.217356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-aafb0984-60c3-4973-8271-c2375fdc1291 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:15.219402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-aafb0984-60c3-4973-8271-c2375fdc1291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:15.257610 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2014/4002] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:15.258902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa910b3-a04a-4661-a755-699a584e46d1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:15.273940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa910b3-a04a-4661-a755-699a584e46d1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:15.285855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca00c9-98c6-42e9-92ba-60fa1e08df67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:15.286480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca00c9-98c6-42e9-92ba-60fa1e08df67 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:15.287172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca00c9-98c6-42e9-92ba-60fa1e08df67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:15.287604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca00c9-98c6-42e9-92ba-60fa1e08df67 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:15.288584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca00c9-98c6-42e9-92ba-60fa1e08df67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:48:15.289425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca00c9-98c6-42e9-92ba-60fa1e08df67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:15.291619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca00c9-98c6-42e9-92ba-60fa1e08df67 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:15.341478 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1989/4003] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:15.346209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb0984-60c3-4973-8271-c2375fdc1291 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:15.360622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb0984-60c3-4973-8271-c2375fdc1291 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:15.369272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6006fa9-c876-43c4-b19a-3f00dbf4d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:15.374274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6006fa9-c876-43c4-b19a-3f00dbf4d9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:15.375522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6006fa9-c876-43c4-b19a-3f00dbf4d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:15.376902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6006fa9-c876-43c4-b19a-3f00dbf4d9e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:15.378629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6006fa9-c876-43c4-b19a-3f00dbf4d9e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:15.383292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6006fa9-c876-43c4-b19a-3f00dbf4d9e5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:15.531453 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2015/4004] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:15 2022] POST /identity/v3/projects => generated 367 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:48:15.533399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca00c9-98c6-42e9-92ba-60fa1e08df67 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:15.554713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca00c9-98c6-42e9-92ba-60fa1e08df67 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:15.565413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7333fc1-0392-4489-972e-7d0ec35a552c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:15.566000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7333fc1-0392-4489-972e-7d0ec35a552c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:15.566540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7333fc1-0392-4489-972e-7d0ec35a552c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:15.628709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f7333fc1-0392-4489-972e-7d0ec35a552c None None] MFA Rules not processed for user `73b00135aa2e42c3af6ac6c1afa4fd4e`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:15.630210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f7333fc1-0392-4489-972e-7d0ec35a552c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:15.706627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9ad9d-4e04-472f-b17b-ba31aab86dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:15.707730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ad9d-4e04-472f-b17b-ba31aab86dfb admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:15.708563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ad9d-4e04-472f-b17b-ba31aab86dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:15.709054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ad9d-4e04-472f-b17b-ba31aab86dfb admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:15.710388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9ad9d-4e04-472f-b17b-ba31aab86dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:15.713851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9ad9d-4e04-472f-b17b-ba31aab86dfb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:15.720241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:15.765179 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2016/4005] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:15.774473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7333fc1-0392-4489-972e-7d0ec35a552c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:15.775270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f7333fc1-0392-4489-972e-7d0ec35a552c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:15.834766 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1990/4006] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:15 2022] POST /identity/v3/users => generated 284 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:15.837499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9ad9d-4e04-472f-b17b-ba31aab86dfb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:15.866801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9ad9d-4e04-472f-b17b-ba31aab86dfb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:15.877325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aab4b5-12dc-4545-87d0-3fb2f03719e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:15.899749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aab4b5-12dc-4545-87d0-3fb2f03719e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:15.902142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aab4b5-12dc-4545-87d0-3fb2f03719e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:15.902584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aab4b5-12dc-4545-87d0-3fb2f03719e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:15.904906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aab4b5-12dc-4545-87d0-3fb2f03719e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:15.913843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aab4b5-12dc-4545-87d0-3fb2f03719e6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:15.955779 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1991/4007] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:48:15.959282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7333fc1-0392-4489-972e-7d0ec35a552c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:15.960969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aab4b5-12dc-4545-87d0-3fb2f03719e6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:15.986895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aab4b5-12dc-4545-87d0-3fb2f03719e6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:15.987546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5152b8c-9d86-4e75-ba91-55b32388e9a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:15.989181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5152b8c-9d86-4e75-ba91-55b32388e9a5 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:15.989614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5152b8c-9d86-4e75-ba91-55b32388e9a5 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:15.990125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5152b8c-9d86-4e75-ba91-55b32388e9a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:15.995521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37d0e6-6270-49d2-a3db-44021f52738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:15.996155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37d0e6-6270-49d2-a3db-44021f52738f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:15.996466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37d0e6-6270-49d2-a3db-44021f52738f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:15.999054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37d0e6-6270-49d2-a3db-44021f52738f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:15.999890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37d0e6-6270-49d2-a3db-44021f52738f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:16.005563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37d0e6-6270-49d2-a3db-44021f52738f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:16.011442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5152b8c-9d86-4e75-ba91-55b32388e9a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:16.021728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5152b8c-9d86-4e75-ba91-55b32388e9a5 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:16.038653 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1992/4008] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:48:16.043602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37d0e6-6270-49d2-a3db-44021f52738f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:16.048311 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2017/4009] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:48:16.064025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37d0e6-6270-49d2-a3db-44021f52738f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:16.072043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835e70c-fde6-460f-8ec0-9191e0cd06b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:16.072825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835e70c-fde6-460f-8ec0-9191e0cd06b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:16.073280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835e70c-fde6-460f-8ec0-9191e0cd06b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:16.074110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835e70c-fde6-460f-8ec0-9191e0cd06b8 admin admin] PATH_INFO: `/v3/projects/aca54410d79a44068dd187a8588c5d5f/users/d76389598559470bb230d1fd48172dd4/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:16.132761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835e70c-fde6-460f-8ec0-9191e0cd06b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca54410d79a44068dd187a8588c5d5f, user_id=d76389598559470bb230d1fd48172dd4, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:16.136655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835e70c-fde6-460f-8ec0-9191e0cd06b8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:16.218071 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1993/4010] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:16 2022] PUT /identity/v3/projects/aca54410d79a44068dd187a8588c5d5f/users/d76389598559470bb230d1fd48172dd4/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:16.230029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e74ac3-6cdb-4e33-bb86-60d4868080bc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:16.230319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e74ac3-6cdb-4e33-bb86-60d4868080bc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:16.230694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e74ac3-6cdb-4e33-bb86-60d4868080bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:16.304492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-88e74ac3-6cdb-4e33-bb86-60d4868080bc None None] MFA Rules not processed for user `d76389598559470bb230d1fd48172dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:16.307846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-88e74ac3-6cdb-4e33-bb86-60d4868080bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:16.488496 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2018/4011] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:16.496427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835e70c-fde6-460f-8ec0-9191e0cd06b8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:16.749000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835e70c-fde6-460f-8ec0-9191e0cd06b8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:16.771337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf55e2d-7fc0-4b22-ad59-06c809ec3943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:16.772190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf55e2d-7fc0-4b22-ad59-06c809ec3943 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:16.772626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf55e2d-7fc0-4b22-ad59-06c809ec3943 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:16.773160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf55e2d-7fc0-4b22-ad59-06c809ec3943 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:16.773978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf55e2d-7fc0-4b22-ad59-06c809ec3943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:16.776368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf55e2d-7fc0-4b22-ad59-06c809ec3943 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:16.956127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:16.970187 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1994/4012] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:16 2022] POST /identity/v3/projects => generated 367 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:16.974175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e74ac3-6cdb-4e33-bb86-60d4868080bc None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:16.994697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e74ac3-6cdb-4e33-bb86-60d4868080bc None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:17.133412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97352e4f-f26b-45d1-8c72-3125b4079443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:17.134047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97352e4f-f26b-45d1-8c72-3125b4079443 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:17.134328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97352e4f-f26b-45d1-8c72-3125b4079443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:17.134606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97352e4f-f26b-45d1-8c72-3125b4079443 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:17.135247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97352e4f-f26b-45d1-8c72-3125b4079443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:17.142673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97352e4f-f26b-45d1-8c72-3125b4079443 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:17.275178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:17.283747 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2019/4013] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:16 2022] POST /identity/v3/users => generated 290 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:17.289446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf55e2d-7fc0-4b22-ad59-06c809ec3943 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:17.311910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf55e2d-7fc0-4b22-ad59-06c809ec3943 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:17.338459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a2c73-b741-43f6-9831-78b745e845fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:17.339094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a2c73-b741-43f6-9831-78b745e845fc admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:17.339850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a2c73-b741-43f6-9831-78b745e845fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:17.339850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a2c73-b741-43f6-9831-78b745e845fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:17.340468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a2c73-b741-43f6-9831-78b745e845fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:17.342247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a2c73-b741-43f6-9831-78b745e845fc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:17.402967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97352e4f-f26b-45d1-8c72-3125b4079443 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:17.403170 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1995/4014] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:17.419710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97352e4f-f26b-45d1-8c72-3125b4079443 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:17.445472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39666a-0817-466a-8703-8ac5b9db8a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:17.446247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39666a-0817-466a-8703-8ac5b9db8a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:17.446754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39666a-0817-466a-8703-8ac5b9db8a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:17.448578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39666a-0817-466a-8703-8ac5b9db8a6b admin admin] PATH_INFO: `/v3/projects/0ba75a402b8d4166a2b40d9f489578e1/users/fa46c7f9d10a49579c5817fd703f7753/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:17.503896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39666a-0817-466a-8703-8ac5b9db8a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba75a402b8d4166a2b40d9f489578e1, user_id=fa46c7f9d10a49579c5817fd703f7753, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:17.521785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39666a-0817-466a-8703-8ac5b9db8a6b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:17.625166 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2020/4015] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:17 2022] PUT /identity/v3/projects/0ba75a402b8d4166a2b40d9f489578e1/users/fa46c7f9d10a49579c5817fd703f7753/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:48:17.629204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a2c73-b741-43f6-9831-78b745e845fc admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:17.640815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a2c73-b741-43f6-9831-78b745e845fc admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:17.851915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bc2ed-21ae-4a31-808e-61a0bdb21c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:17.852579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bc2ed-21ae-4a31-808e-61a0bdb21c7b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:17.852859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bc2ed-21ae-4a31-808e-61a0bdb21c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:17.853131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bc2ed-21ae-4a31-808e-61a0bdb21c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:17.853790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bc2ed-21ae-4a31-808e-61a0bdb21c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:17.855458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bc2ed-21ae-4a31-808e-61a0bdb21c7b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:17.880688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39666a-0817-466a-8703-8ac5b9db8a6b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:17.898882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39666a-0817-466a-8703-8ac5b9db8a6b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:17.900038 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1996/4016] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:17.920899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d8fa4-4b9a-41b7-821d-de26d5b4c684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:17.921634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d8fa4-4b9a-41b7-821d-de26d5b4c684 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:17.921903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d8fa4-4b9a-41b7-821d-de26d5b4c684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:17.922553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d8fa4-4b9a-41b7-821d-de26d5b4c684 admin admin] PATH_INFO: `/v3/projects/0ba75a402b8d4166a2b40d9f489578e1/users/fa46c7f9d10a49579c5817fd703f7753/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:17.934734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d8fa4-4b9a-41b7-821d-de26d5b4c684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba75a402b8d4166a2b40d9f489578e1, user_id=fa46c7f9d10a49579c5817fd703f7753, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:17.934734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d8fa4-4b9a-41b7-821d-de26d5b4c684 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:17.961569 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2021/4017] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:17 2022] PUT /identity/v3/projects/0ba75a402b8d4166a2b40d9f489578e1/users/fa46c7f9d10a49579c5817fd703f7753/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:17.973679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0941a93-4ea7-4c98-83fa-37153e38d29e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:17.975867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0941a93-4ea7-4c98-83fa-37153e38d29e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:17.977951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0941a93-4ea7-4c98-83fa-37153e38d29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:18.026957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b0941a93-4ea7-4c98-83fa-37153e38d29e None None] MFA Rules not processed for user `fa46c7f9d10a49579c5817fd703f7753`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:18.028957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b0941a93-4ea7-4c98-83fa-37153e38d29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:18.207626 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1997/4018] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:18.212515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d8fa4-4b9a-41b7-821d-de26d5b4c684 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:18.225519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d8fa4-4b9a-41b7-821d-de26d5b4c684 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:18.236021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092952f-c6af-44c0-8a7b-7e6a8a75091e tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa46c7f9d10a49579c5817fd703f7753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ba75a402b8d4166a2b40d9f489578e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:18.237072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092952f-c6af-44c0-8a7b-7e6a8a75091e tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:18.237283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092952f-c6af-44c0-8a7b-7e6a8a75091e tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:18.237600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092952f-c6af-44c0-8a7b-7e6a8a75091e tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] PATH_INFO: `/v3/regions` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:18.238251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092952f-c6af-44c0-8a7b-7e6a8a75091e tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:18.242244 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-1092952f-c6af-44c0-8a7b-7e6a8a75091e tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:18.242244 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:48:18.242244 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:48:18.243150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092952f-c6af-44c0-8a7b-7e6a8a75091e tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:18.388120 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2022/4019] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:48:18 2022] POST /identity/v3/regions => generated 223 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:18.389069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0941a93-4ea7-4c98-83fa-37153e38d29e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:18.403939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0941a93-4ea7-4c98-83fa-37153e38d29e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:18.444691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e671c2-e43b-4331-be56-2d9deece2897 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa46c7f9d10a49579c5817fd703f7753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ba75a402b8d4166a2b40d9f489578e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:18.445562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e671c2-e43b-4331-be56-2d9deece2897 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:18.445909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e671c2-e43b-4331-be56-2d9deece2897 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:18.446212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e671c2-e43b-4331-be56-2d9deece2897 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] PATH_INFO: `/v3/regions` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:18.446872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e671c2-e43b-4331-be56-2d9deece2897 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:18.448070 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-e7e671c2-e43b-4331-be56-2d9deece2897 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:18.448070 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:48:18.448070 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:48:18.449001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e671c2-e43b-4331-be56-2d9deece2897 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:18.586822 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1998/4020] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:48:18 2022] POST /identity/v3/regions => generated 223 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:48:18.588686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092952f-c6af-44c0-8a7b-7e6a8a75091e tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:18.604687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092952f-c6af-44c0-8a7b-7e6a8a75091e tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:18.651551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb466f9c-90d3-410c-b56e-f8edd28fa2e0 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa46c7f9d10a49579c5817fd703f7753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ba75a402b8d4166a2b40d9f489578e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:18.651551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb466f9c-90d3-410c-b56e-f8edd28fa2e0 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:18.651551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb466f9c-90d3-410c-b56e-f8edd28fa2e0 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:18.651829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb466f9c-90d3-410c-b56e-f8edd28fa2e0 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] PATH_INFO: `/v3/regions/7c54dc98-1072-4638-b1f7-1ed3de2b8264` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:18.651829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb466f9c-90d3-410c-b56e-f8edd28fa2e0 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorizing `identity:create_region(region_id=7c54dc98-1072-4638-b1f7-1ed3de2b8264)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:18.653164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb466f9c-90d3-410c-b56e-f8edd28fa2e0 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:18.747338 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2023/4021] 10.222.0.76 () {60 vars in 1259 bytes} [Sat Aug 27 04:48:18 2022] PUT /identity/v3/regions/7c54dc98-1072-4638-b1f7-1ed3de2b8264 => generated 231 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:18.751548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e671c2-e43b-4331-be56-2d9deece2897 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:18.774165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e671c2-e43b-4331-be56-2d9deece2897 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:18.776803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9788fb-e5d4-4188-bd2c-2e653317ee77 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:18.777110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9788fb-e5d4-4188-bd2c-2e653317ee77 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:18.777388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9788fb-e5d4-4188-bd2c-2e653317ee77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:18.803148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3588124-8ef6-4a47-8ad1-7b3d92ea8726 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa46c7f9d10a49579c5817fd703f7753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ba75a402b8d4166a2b40d9f489578e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:18.803148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3588124-8ef6-4a47-8ad1-7b3d92ea8726 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:18.803148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3588124-8ef6-4a47-8ad1-7b3d92ea8726 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:18.803424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3588124-8ef6-4a47-8ad1-7b3d92ea8726 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] PATH_INFO: `/v3/regions/7c54dc98-1072-4638-b1f7-1ed3de2b8264` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:18.803424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3588124-8ef6-4a47-8ad1-7b3d92ea8726 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7c54dc98-1072-4638-b1f7-1ed3de2b8264)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:18.804839 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-e3588124-8ef6-4a47-8ad1-7b3d92ea8726 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:18.804839 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:48:18.804839 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:48:18.809661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3588124-8ef6-4a47-8ad1-7b3d92ea8726 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:18.830611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3b9788fb-e5d4-4188-bd2c-2e653317ee77 None None] MFA Rules not processed for user `73b00135aa2e42c3af6ac6c1afa4fd4e`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:18.832027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3b9788fb-e5d4-4188-bd2c-2e653317ee77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:18.966828 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 1999/4022] 10.222.0.76 () {58 vars in 1242 bytes} [Sat Aug 27 04:48:18 2022] DELETE /identity/v3/regions/7c54dc98-1072-4638-b1f7-1ed3de2b8264 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:18.972312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3588124-8ef6-4a47-8ad1-7b3d92ea8726 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:18.998474 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2024/4023] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:19.045903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:19.082625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3588124-8ef6-4a47-8ad1-7b3d92ea8726 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:19.109144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f5d4a-f1d0-4b21-8484-123d07b5a394 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa46c7f9d10a49579c5817fd703f7753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ba75a402b8d4166a2b40d9f489578e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:19.109950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f5d4a-f1d0-4b21-8484-123d07b5a394 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:19.110253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f5d4a-f1d0-4b21-8484-123d07b5a394 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:19.110582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f5d4a-f1d0-4b21-8484-123d07b5a394 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] PATH_INFO: `/v3/regions` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:19.111266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f5d4a-f1d0-4b21-8484-123d07b5a394 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:19.120121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f5d4a-f1d0-4b21-8484-123d07b5a394 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:19.315227 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2000/4024] 10.222.0.76 () {60 vars in 1150 bytes} [Sat Aug 27 04:48:18 2022] POST /identity/v3/regions => generated 253 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:48:19.321199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9788fb-e5d4-4188-bd2c-2e653317ee77 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:19.344294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9788fb-e5d4-4188-bd2c-2e653317ee77 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:19.396866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca4003-caaf-4eec-b7c2-93fe98c4b283 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa46c7f9d10a49579c5817fd703f7753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ba75a402b8d4166a2b40d9f489578e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:19.401313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca4003-caaf-4eec-b7c2-93fe98c4b283 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:19.403179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca4003-caaf-4eec-b7c2-93fe98c4b283 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:19.403566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca4003-caaf-4eec-b7c2-93fe98c4b283 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] PATH_INFO: `/v3/regions/ef8a25d1f90f46e8a5b58d080566cb3a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:19.406181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca4003-caaf-4eec-b7c2-93fe98c4b283 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorizing `identity:update_region(region_id=ef8a25d1f90f46e8a5b58d080566cb3a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:19.409518 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-2eca4003-caaf-4eec-b7c2-93fe98c4b283 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:19.409518 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:48:19.409518 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:48:19.411788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca4003-caaf-4eec-b7c2-93fe98c4b283 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:19.602262 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2025/4025] 10.222.0.76 () {60 vars in 1250 bytes} [Sat Aug 27 04:48:19 2022] PATCH /identity/v3/regions/ef8a25d1f90f46e8a5b58d080566cb3a => generated 254 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:19.606330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f5d4a-f1d0-4b21-8484-123d07b5a394 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:19.630822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f5d4a-f1d0-4b21-8484-123d07b5a394 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:19.689398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b81f78-d8be-4534-b8c6-86fab96462f3 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa46c7f9d10a49579c5817fd703f7753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ba75a402b8d4166a2b40d9f489578e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:19.690662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b81f78-d8be-4534-b8c6-86fab96462f3 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:19.691119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b81f78-d8be-4534-b8c6-86fab96462f3 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:19.693029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b81f78-d8be-4534-b8c6-86fab96462f3 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] PATH_INFO: `/v3/regions/ef8a25d1f90f46e8a5b58d080566cb3a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:19.693996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b81f78-d8be-4534-b8c6-86fab96462f3 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorizing `identity:get_region(region_id=ef8a25d1f90f46e8a5b58d080566cb3a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:19.698944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b81f78-d8be-4534-b8c6-86fab96462f3 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:19.710282 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2001/4026] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:48:19 2022] GET /identity/v3/regions/ef8a25d1f90f46e8a5b58d080566cb3a => generated 254 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:19.714754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca4003-caaf-4eec-b7c2-93fe98c4b283 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:19.737957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca4003-caaf-4eec-b7c2-93fe98c4b283 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:19.747337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c20e38-9a55-4889-a2b1-868f7f6afd0f tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa46c7f9d10a49579c5817fd703f7753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ba75a402b8d4166a2b40d9f489578e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:19.747995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c20e38-9a55-4889-a2b1-868f7f6afd0f tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:19.748339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c20e38-9a55-4889-a2b1-868f7f6afd0f tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:19.748976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c20e38-9a55-4889-a2b1-868f7f6afd0f tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] PATH_INFO: `/v3/regions/ef8a25d1f90f46e8a5b58d080566cb3a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:19.750088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c20e38-9a55-4889-a2b1-868f7f6afd0f tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ef8a25d1f90f46e8a5b58d080566cb3a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:19.751395 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-91c20e38-9a55-4889-a2b1-868f7f6afd0f tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:19.751395 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:48:19.751395 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:48:19.756410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c20e38-9a55-4889-a2b1-868f7f6afd0f tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:19.917303 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2026/4027] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:48:19 2022] DELETE /identity/v3/regions/ef8a25d1f90f46e8a5b58d080566cb3a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:48:19.922898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b81f78-d8be-4534-b8c6-86fab96462f3 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:19.939072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b81f78-d8be-4534-b8c6-86fab96462f3 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:19.983362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8804f-ad26-47ba-8797-c0377215d945 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa46c7f9d10a49579c5817fd703f7753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ba75a402b8d4166a2b40d9f489578e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:19.986538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8804f-ad26-47ba-8797-c0377215d945 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:19.986538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8804f-ad26-47ba-8797-c0377215d945 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:19.986538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8804f-ad26-47ba-8797-c0377215d945 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] PATH_INFO: `/v3/regions` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:19.990316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8804f-ad26-47ba-8797-c0377215d945 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:19.992314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8804f-ad26-47ba-8797-c0377215d945 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:20.010896 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2002/4028] 10.222.0.76 () {58 vars in 1128 bytes} [Sat Aug 27 04:48:19 2022] GET /identity/v3/regions => generated 668 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:20.015860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c20e38-9a55-4889-a2b1-868f7f6afd0f tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:20.031145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c20e38-9a55-4889-a2b1-868f7f6afd0f tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:20.036000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94593128-a5cb-4092-874e-b8443be16b23 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa46c7f9d10a49579c5817fd703f7753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ba75a402b8d4166a2b40d9f489578e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:20.036749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94593128-a5cb-4092-874e-b8443be16b23 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:20.037213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94593128-a5cb-4092-874e-b8443be16b23 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:20.037590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94593128-a5cb-4092-874e-b8443be16b23 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] PATH_INFO: `/v3/regions/ef8a25d1f90f46e8a5b58d080566cb3a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:20.038249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94593128-a5cb-4092-874e-b8443be16b23 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ef8a25d1f90f46e8a5b58d080566cb3a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:20.053293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94593128-a5cb-4092-874e-b8443be16b23 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:20.060974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:20.086854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-94593128-a5cb-4092-874e-b8443be16b23 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Could not find region: ef8a25d1f90f46e8a5b58d080566cb3a.: keystone.exception.RegionNotFound: Could not find region: ef8a25d1f90f46e8a5b58d080566cb3a. Aug 27 04:48:20.086854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:48:20.086854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Aug 27 04:48:20.086854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Aug 27 04:48:20.086854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Aug 27 04:48:20.086854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Aug 27 04:48:20.086854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Aug 27 04:48:20.086854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 27 04:48:20.086854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: ef8a25d1f90f46e8a5b58d080566cb3a. Aug 27 04:48:20.086854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:48:20.086854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:48:20.086854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:48:20.086854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:48:20.086854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:48:20.086854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:48:20.086854 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:48:20.094461 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:48:20.094461 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:48:20.094461 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:48:20.094461 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:48:20.094461 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:48:20.094461 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:48:20.094461 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:48:20.094461 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Aug 27 04:48:20.094461 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Aug 27 04:48:20.094461 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:48:20.094461 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:48:20.094461 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Aug 27 04:48:20.094461 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 27 04:48:20.094461 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: ef8a25d1f90f46e8a5b58d080566cb3a. Aug 27 04:48:20.094461 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:48:20.094461 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2027/4029] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:48:20 2022] DELETE /identity/v3/regions/ef8a25d1f90f46e8a5b58d080566cb3a => generated 112 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:48:20.096797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8804f-ad26-47ba-8797-c0377215d945 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:20.111292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8804f-ad26-47ba-8797-c0377215d945 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:20.132254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470c8a0-ff03-46cf-8823-92016927f73a tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa46c7f9d10a49579c5817fd703f7753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ba75a402b8d4166a2b40d9f489578e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:20.132254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470c8a0-ff03-46cf-8823-92016927f73a tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:20.132254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470c8a0-ff03-46cf-8823-92016927f73a tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:20.132720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470c8a0-ff03-46cf-8823-92016927f73a tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] PATH_INFO: `/v3/regions` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:20.132720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470c8a0-ff03-46cf-8823-92016927f73a tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:20.137333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470c8a0-ff03-46cf-8823-92016927f73a tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:20.155257 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2003/4030] 10.222.0.76 () {58 vars in 1128 bytes} [Sat Aug 27 04:48:20 2022] GET /identity/v3/regions => generated 668 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:20.159472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6607b-d094-47b7-b903-3a4eed1e33a7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:20.159472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6607b-d094-47b7-b903-3a4eed1e33a7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:20.159472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6607b-d094-47b7-b903-3a4eed1e33a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:20.169141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470c8a0-ff03-46cf-8823-92016927f73a tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:20.170473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-e5c6607b-d094-47b7-b903-3a4eed1e33a7 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:20.170473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:48:20.170473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:48:20.170473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:48:20.170473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:48:20.170473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:48:20.170473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:48:20.170473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:48:20.170473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:48:20.170473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:48:20.170473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:48:20.170473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:48:20.170473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:48:20.171951 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:48:20.171951 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:48:20.171951 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:48:20.171951 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:48:20.171951 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:48:20.171951 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:48:20.171951 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:48:20.171951 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:48:20.171951 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:48:20.171951 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:48:20.171951 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:48:20.171951 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:48:20.171951 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:48:20.171951 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:20.171951 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:48:20.183069 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2028/4031] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:48:20 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 25 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:48:20.230031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470c8a0-ff03-46cf-8823-92016927f73a tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:20.260910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1091ac2-6cfe-4120-8299-71ac50888fec tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa46c7f9d10a49579c5817fd703f7753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ba75a402b8d4166a2b40d9f489578e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:20.261930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1091ac2-6cfe-4120-8299-71ac50888fec tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:20.262456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1091ac2-6cfe-4120-8299-71ac50888fec tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:20.262945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1091ac2-6cfe-4120-8299-71ac50888fec tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] PATH_INFO: `/v3/regions` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:20.263848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1091ac2-6cfe-4120-8299-71ac50888fec tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:20.266458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1091ac2-6cfe-4120-8299-71ac50888fec tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:20.414928 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2004/4032] 10.222.0.76 () {60 vars in 1150 bytes} [Sat Aug 27 04:48:20 2022] POST /identity/v3/regions => generated 254 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:20.419142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6607b-d094-47b7-b903-3a4eed1e33a7 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:20.504532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6607b-d094-47b7-b903-3a4eed1e33a7 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:20.521530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95e33c-4efa-4cf0-bfcd-c03f1542b25c tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa46c7f9d10a49579c5817fd703f7753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ba75a402b8d4166a2b40d9f489578e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:20.522291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95e33c-4efa-4cf0-bfcd-c03f1542b25c tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:20.522457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95e33c-4efa-4cf0-bfcd-c03f1542b25c tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:20.522706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95e33c-4efa-4cf0-bfcd-c03f1542b25c tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] PATH_INFO: `/v3/regions` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:20.523342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95e33c-4efa-4cf0-bfcd-c03f1542b25c tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Adding query filter params (parent_region_id=40d53f60796c48989bc2c16a39a5a7aa) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:48:20.524288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95e33c-4efa-4cf0-bfcd-c03f1542b25c tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:20.525632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95e33c-4efa-4cf0-bfcd-c03f1542b25c tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:20.573000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1091ac2-6cfe-4120-8299-71ac50888fec tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:20.574778 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2029/4033] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:48:20 2022] GET /identity/v3/regions?parent_region_id=40d53f60796c48989bc2c16a39a5a7aa => generated 400 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:20.597357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1091ac2-6cfe-4120-8299-71ac50888fec tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:20.614971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb26da-8415-4908-bdd3-c6dcef586829 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa46c7f9d10a49579c5817fd703f7753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ba75a402b8d4166a2b40d9f489578e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:20.615735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb26da-8415-4908-bdd3-c6dcef586829 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:20.616096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb26da-8415-4908-bdd3-c6dcef586829 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:20.616528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb26da-8415-4908-bdd3-c6dcef586829 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] PATH_INFO: `/v3/regions/942f886e95fd47d696e28c1143ef9a43` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:20.617200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb26da-8415-4908-bdd3-c6dcef586829 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorizing `identity:delete_region(region_id=942f886e95fd47d696e28c1143ef9a43)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:20.618957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb26da-8415-4908-bdd3-c6dcef586829 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:20.740797 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2005/4034] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:48:20 2022] DELETE /identity/v3/regions/942f886e95fd47d696e28c1143ef9a43 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:20.745611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95e33c-4efa-4cf0-bfcd-c03f1542b25c tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:20.761148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95e33c-4efa-4cf0-bfcd-c03f1542b25c tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:20.787403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0b2ec-3469-4584-bc77-ef5bfca2098f tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa46c7f9d10a49579c5817fd703f7753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ba75a402b8d4166a2b40d9f489578e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:20.787403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0b2ec-3469-4584-bc77-ef5bfca2098f tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:20.787403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0b2ec-3469-4584-bc77-ef5bfca2098f tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:20.787663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0b2ec-3469-4584-bc77-ef5bfca2098f tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] PATH_INFO: `/v3/regions/dca9f533345a4ecaa7db5218c293a844` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:20.787663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0b2ec-3469-4584-bc77-ef5bfca2098f tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorizing `identity:delete_region(region_id=dca9f533345a4ecaa7db5218c293a844)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:20.790807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0b2ec-3469-4584-bc77-ef5bfca2098f tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:20.972318 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2030/4035] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:48:20 2022] DELETE /identity/v3/regions/dca9f533345a4ecaa7db5218c293a844 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:20.976578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb26da-8415-4908-bdd3-c6dcef586829 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:20.999719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb26da-8415-4908-bdd3-c6dcef586829 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:21.094324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece2ada-0249-4d1d-94c3-c89dbe0b5d88 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa46c7f9d10a49579c5817fd703f7753', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ba75a402b8d4166a2b40d9f489578e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:21.095250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece2ada-0249-4d1d-94c3-c89dbe0b5d88 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:21.095721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece2ada-0249-4d1d-94c3-c89dbe0b5d88 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:21.100039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece2ada-0249-4d1d-94c3-c89dbe0b5d88 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] PATH_INFO: `/v3/regions/40d53f60796c48989bc2c16a39a5a7aa` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:21.101632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece2ada-0249-4d1d-94c3-c89dbe0b5d88 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorizing `identity:delete_region(region_id=40d53f60796c48989bc2c16a39a5a7aa)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:21.103482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece2ada-0249-4d1d-94c3-c89dbe0b5d88 tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:21.226237 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2006/4036] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:48:20 2022] DELETE /identity/v3/regions/40d53f60796c48989bc2c16a39a5a7aa => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:21.231300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0b2ec-3469-4584-bc77-ef5bfca2098f tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:21.423708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0b2ec-3469-4584-bc77-ef5bfca2098f tempest-RegionsTestJSON-1614209887 tempest-RegionsTestJSON-1614209887-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:21.455198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b78023-6a7a-4c88-97ec-ba503ee05807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:21.455860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b78023-6a7a-4c88-97ec-ba503ee05807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:21.456141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b78023-6a7a-4c88-97ec-ba503ee05807 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:21.456446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b78023-6a7a-4c88-97ec-ba503ee05807 admin admin] PATH_INFO: `/v3/users/d76389598559470bb230d1fd48172dd4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:21.458854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b78023-6a7a-4c88-97ec-ba503ee05807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d76389598559470bb230d1fd48172dd4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:21.460876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b78023-6a7a-4c88-97ec-ba503ee05807 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:21.788822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-49b78023-6a7a-4c88-97ec-ba503ee05807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd76389598559470bb230d1fd48172dd4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:21.789520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-49b78023-6a7a-4c88-97ec-ba503ee05807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd76389598559470bb230d1fd48172dd4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:21.904291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-49b78023-6a7a-4c88-97ec-ba503ee05807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd76389598559470bb230d1fd48172dd4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:21.905029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-49b78023-6a7a-4c88-97ec-ba503ee05807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd76389598559470bb230d1fd48172dd4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:21.949572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-49b78023-6a7a-4c88-97ec-ba503ee05807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd76389598559470bb230d1fd48172dd4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:21.979507 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2031/4037] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:21 2022] DELETE /identity/v3/users/d76389598559470bb230d1fd48172dd4 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:21.985039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f496ac-c639-4f18-b1e2-c1b893b3c260 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:21.985477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f496ac-c639-4f18-b1e2-c1b893b3c260 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:21.985819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f496ac-c639-4f18-b1e2-c1b893b3c260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:22.021365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-39f496ac-c639-4f18-b1e2-c1b893b3c260 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:22.022843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-39f496ac-c639-4f18-b1e2-c1b893b3c260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:22.121344 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2007/4038] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:22.147719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b78023-6a7a-4c88-97ec-ba503ee05807 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:22.152156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-49b78023-6a7a-4c88-97ec-ba503ee05807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:22.356230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b78023-6a7a-4c88-97ec-ba503ee05807 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:22.360533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8cb15-6292-461c-8a50-69292d73e1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:22.361309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8cb15-6292-461c-8a50-69292d73e1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:22.361595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8cb15-6292-461c-8a50-69292d73e1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:22.361868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8cb15-6292-461c-8a50-69292d73e1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:22.375894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8cb15-6292-461c-8a50-69292d73e1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:22.377814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8cb15-6292-461c-8a50-69292d73e1d0 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:22.394924 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2032/4039] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:22.574483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:24.325529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f496ac-c639-4f18-b1e2-c1b893b3c260 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:24.330059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-39f496ac-c639-4f18-b1e2-c1b893b3c260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:24.358656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f496ac-c639-4f18-b1e2-c1b893b3c260 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:24.374013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f7c61-8f70-4c1a-adc3-6da563df34ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:24.376025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f7c61-8f70-4c1a-adc3-6da563df34ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:24.376570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f7c61-8f70-4c1a-adc3-6da563df34ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:24.377284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f7c61-8f70-4c1a-adc3-6da563df34ac admin admin] PATH_INFO: `/v3/projects/aca54410d79a44068dd187a8588c5d5f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:24.381522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f7c61-8f70-4c1a-adc3-6da563df34ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=aca54410d79a44068dd187a8588c5d5f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:24.386361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f7c61-8f70-4c1a-adc3-6da563df34ac admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:24.500788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:24.654911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-978f7c61-8f70-4c1a-adc3-6da563df34ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aca54410d79a44068dd187a8588c5d5f', 'request_id': 'req-978f7c61-8f70-4c1a-adc3-6da563df34ac'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:24.668323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-978f7c61-8f70-4c1a-adc3-6da563df34ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aca54410d79a44068dd187a8588c5d5f', 'request_id': 'req-978f7c61-8f70-4c1a-adc3-6da563df34ac'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:24.682330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-978f7c61-8f70-4c1a-adc3-6da563df34ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aca54410d79a44068dd187a8588c5d5f', 'request_id': 'req-978f7c61-8f70-4c1a-adc3-6da563df34ac'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:24.804661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8cb15-6292-461c-8a50-69292d73e1d0 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:24.807567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-46b8cb15-6292-461c-8a50-69292d73e1d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:24.823668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-978f7c61-8f70-4c1a-adc3-6da563df34ac admin admin] The token cache is being invalidate because project aca54410d79a44068dd187a8588c5d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:24.824796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-978f7c61-8f70-4c1a-adc3-6da563df34ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:24.827499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-978f7c61-8f70-4c1a-adc3-6da563df34ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:24.829357 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2008/4040] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:24 2022] DELETE /identity/v3/projects/aca54410d79a44068dd187a8588c5d5f => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:24.835428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f7c61-8f70-4c1a-adc3-6da563df34ac admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:24.839230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-978f7c61-8f70-4c1a-adc3-6da563df34ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:24.842708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8cb15-6292-461c-8a50-69292d73e1d0 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:24.993472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518ed0a-868c-4792-83bb-cf1572a1dd5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:24.994443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518ed0a-868c-4792-83bb-cf1572a1dd5e service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:24.995487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518ed0a-868c-4792-83bb-cf1572a1dd5e service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:24.996327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518ed0a-868c-4792-83bb-cf1572a1dd5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:24.999217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d518ed0a-868c-4792-83bb-cf1572a1dd5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:25.029797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f7c61-8f70-4c1a-adc3-6da563df34ac admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:25.037188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646be5b8-749d-4748-a8d7-6c48362dfcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:25.038673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646be5b8-749d-4748-a8d7-6c48362dfcb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:25.038673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646be5b8-749d-4748-a8d7-6c48362dfcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:25.038673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646be5b8-749d-4748-a8d7-6c48362dfcb3 admin admin] PATH_INFO: `/v3/users/fa46c7f9d10a49579c5817fd703f7753` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:25.044145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646be5b8-749d-4748-a8d7-6c48362dfcb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa46c7f9d10a49579c5817fd703f7753)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:25.046919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646be5b8-749d-4748-a8d7-6c48362dfcb3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:25.137396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518ed0a-868c-4792-83bb-cf1572a1dd5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:25.139751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518ed0a-868c-4792-83bb-cf1572a1dd5e service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:25.181459 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2033/4041] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:48:25.359570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-646be5b8-749d-4748-a8d7-6c48362dfcb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa46c7f9d10a49579c5817fd703f7753'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:25.502359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-646be5b8-749d-4748-a8d7-6c48362dfcb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa46c7f9d10a49579c5817fd703f7753'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:25.503208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-646be5b8-749d-4748-a8d7-6c48362dfcb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa46c7f9d10a49579c5817fd703f7753'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:25.518841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-646be5b8-749d-4748-a8d7-6c48362dfcb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa46c7f9d10a49579c5817fd703f7753'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:25.551159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-646be5b8-749d-4748-a8d7-6c48362dfcb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa46c7f9d10a49579c5817fd703f7753'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:25.576268 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2009/4042] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:24 2022] DELETE /identity/v3/users/fa46c7f9d10a49579c5817fd703f7753 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:26.291684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518ed0a-868c-4792-83bb-cf1572a1dd5e service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:26.291684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d518ed0a-868c-4792-83bb-cf1572a1dd5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:26.334276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518ed0a-868c-4792-83bb-cf1572a1dd5e service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:26.430479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:26.450986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6593bb-d4ac-499a-bb9f-72b52bc3a595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:26.451652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6593bb-d4ac-499a-bb9f-72b52bc3a595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:26.451986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6593bb-d4ac-499a-bb9f-72b52bc3a595 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:26.452340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6593bb-d4ac-499a-bb9f-72b52bc3a595 admin admin] PATH_INFO: `/v3/users/8af9568c510340c1adfcafe10ae44002` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:26.456831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6593bb-d4ac-499a-bb9f-72b52bc3a595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af9568c510340c1adfcafe10ae44002)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:26.459867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6593bb-d4ac-499a-bb9f-72b52bc3a595 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:26.849878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4b6593bb-d4ac-499a-bb9f-72b52bc3a595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af9568c510340c1adfcafe10ae44002'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:26.850798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4b6593bb-d4ac-499a-bb9f-72b52bc3a595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af9568c510340c1adfcafe10ae44002'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:26.978907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4b6593bb-d4ac-499a-bb9f-72b52bc3a595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af9568c510340c1adfcafe10ae44002'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:26.980365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4b6593bb-d4ac-499a-bb9f-72b52bc3a595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af9568c510340c1adfcafe10ae44002'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:27.002347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4b6593bb-d4ac-499a-bb9f-72b52bc3a595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af9568c510340c1adfcafe10ae44002'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:27.053725 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2034/4043] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:26 2022] DELETE /identity/v3/users/8af9568c510340c1adfcafe10ae44002 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:27.378798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646be5b8-749d-4748-a8d7-6c48362dfcb3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:27.381148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-646be5b8-749d-4748-a8d7-6c48362dfcb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:27.413853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646be5b8-749d-4748-a8d7-6c48362dfcb3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:27.499420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:27.576097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058b11c-185e-4112-b6e8-3cc68a6abe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:27.576821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058b11c-185e-4112-b6e8-3cc68a6abe8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:27.577380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058b11c-185e-4112-b6e8-3cc68a6abe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:27.578564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058b11c-185e-4112-b6e8-3cc68a6abe8b admin admin] PATH_INFO: `/v3/projects/0ba75a402b8d4166a2b40d9f489578e1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:27.586133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058b11c-185e-4112-b6e8-3cc68a6abe8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba75a402b8d4166a2b40d9f489578e1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:27.588606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058b11c-185e-4112-b6e8-3cc68a6abe8b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:27.628472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6593bb-d4ac-499a-bb9f-72b52bc3a595 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:27.631333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4b6593bb-d4ac-499a-bb9f-72b52bc3a595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:27.666805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6593bb-d4ac-499a-bb9f-72b52bc3a595 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:27.686935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aadefe-1a93-4889-b11c-ba1b5853a199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:27.690053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aadefe-1a93-4889-b11c-ba1b5853a199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:27.690380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aadefe-1a93-4889-b11c-ba1b5853a199 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:27.690634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aadefe-1a93-4889-b11c-ba1b5853a199 admin admin] PATH_INFO: `/v3/projects/5c9eb4bbda084c9d8f1503b888a2ddfb` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:27.697040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aadefe-1a93-4889-b11c-ba1b5853a199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c9eb4bbda084c9d8f1503b888a2ddfb)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:27.705452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aadefe-1a93-4889-b11c-ba1b5853a199 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:27.843499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d058b11c-185e-4112-b6e8-3cc68a6abe8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba75a402b8d4166a2b40d9f489578e1', 'request_id': 'req-d058b11c-185e-4112-b6e8-3cc68a6abe8b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:27.857732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d058b11c-185e-4112-b6e8-3cc68a6abe8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba75a402b8d4166a2b40d9f489578e1', 'request_id': 'req-d058b11c-185e-4112-b6e8-3cc68a6abe8b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:27.877585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d058b11c-185e-4112-b6e8-3cc68a6abe8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba75a402b8d4166a2b40d9f489578e1', 'request_id': 'req-d058b11c-185e-4112-b6e8-3cc68a6abe8b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:28.078189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d058b11c-185e-4112-b6e8-3cc68a6abe8b admin admin] The token cache is being invalidate because project 0ba75a402b8d4166a2b40d9f489578e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:28.078189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d058b11c-185e-4112-b6e8-3cc68a6abe8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:28.078189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d058b11c-185e-4112-b6e8-3cc68a6abe8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:28.078189 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2010/4044] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:27 2022] DELETE /identity/v3/projects/0ba75a402b8d4166a2b40d9f489578e1 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:28.085397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4481b19-59c3-4966-a9b9-ac295f075408 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:28.085783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4481b19-59c3-4966-a9b9-ac295f075408 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:28.086161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4481b19-59c3-4966-a9b9-ac295f075408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:28.116115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-12aadefe-1a93-4889-b11c-ba1b5853a199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c9eb4bbda084c9d8f1503b888a2ddfb', 'request_id': 'req-12aadefe-1a93-4889-b11c-ba1b5853a199'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:28.131742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c4481b19-59c3-4966-a9b9-ac295f075408 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:28.133436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c4481b19-59c3-4966-a9b9-ac295f075408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:28.141501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-12aadefe-1a93-4889-b11c-ba1b5853a199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c9eb4bbda084c9d8f1503b888a2ddfb', 'request_id': 'req-12aadefe-1a93-4889-b11c-ba1b5853a199'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:28.245575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-12aadefe-1a93-4889-b11c-ba1b5853a199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c9eb4bbda084c9d8f1503b888a2ddfb', 'request_id': 'req-12aadefe-1a93-4889-b11c-ba1b5853a199'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:28.276779 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2011/4045] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:28.288113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef339e0-4353-47e1-ae3a-5ee90748b576 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:28.290181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef339e0-4353-47e1-ae3a-5ee90748b576 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:28.290506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef339e0-4353-47e1-ae3a-5ee90748b576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:28.299950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-12aadefe-1a93-4889-b11c-ba1b5853a199 admin admin] The token cache is being invalidate because project 5c9eb4bbda084c9d8f1503b888a2ddfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:28.300280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-12aadefe-1a93-4889-b11c-ba1b5853a199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:28.301361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-12aadefe-1a93-4889-b11c-ba1b5853a199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:28.304203 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2035/4046] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:27 2022] DELETE /identity/v3/projects/5c9eb4bbda084c9d8f1503b888a2ddfb => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:48:28.308963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8007228-a7d7-4256-b70e-25b897b4f056 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:28.309527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8007228-a7d7-4256-b70e-25b897b4f056 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:28.310160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8007228-a7d7-4256-b70e-25b897b4f056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:28.342004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-aef339e0-4353-47e1-ae3a-5ee90748b576 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:28.343314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aef339e0-4353-47e1-ae3a-5ee90748b576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:28.351264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b8007228-a7d7-4256-b70e-25b897b4f056 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:28.353620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b8007228-a7d7-4256-b70e-25b897b4f056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:28.367099 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2036/4047] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:28.376548 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2012/4048] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:28.376837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d7c6a-e9d0-4de0-9274-510703098900 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:28.379488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d7c6a-e9d0-4de0-9274-510703098900 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:28.379938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d7c6a-e9d0-4de0-9274-510703098900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:28.381196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef339e0-4353-47e1-ae3a-5ee90748b576 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:28.409408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef339e0-4353-47e1-ae3a-5ee90748b576 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:28.416958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497c97b-6791-48bf-b32d-0e4a1abebec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:28.417991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497c97b-6791-48bf-b32d-0e4a1abebec7 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:28.419430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497c97b-6791-48bf-b32d-0e4a1abebec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:28.419937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497c97b-6791-48bf-b32d-0e4a1abebec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:28.422771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497c97b-6791-48bf-b32d-0e4a1abebec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:48:28.423434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497c97b-6791-48bf-b32d-0e4a1abebec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:28.425733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497c97b-6791-48bf-b32d-0e4a1abebec7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:28.427637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-809d7c6a-e9d0-4de0-9274-510703098900 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:28.430468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-809d7c6a-e9d0-4de0-9274-510703098900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:28.457859 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2037/4049] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:28.459192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d7c6a-e9d0-4de0-9274-510703098900 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:28.480064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d7c6a-e9d0-4de0-9274-510703098900 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:28.500400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4c457-1059-4108-b23c-b44020b2c7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:28.500400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4c457-1059-4108-b23c-b44020b2c7ab admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:28.500400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4c457-1059-4108-b23c-b44020b2c7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:28.500400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4c457-1059-4108-b23c-b44020b2c7ab admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:28.501250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4c457-1059-4108-b23c-b44020b2c7ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:48:28.501250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4c457-1059-4108-b23c-b44020b2c7ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:28.503203 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2013/4050] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:28.505730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4c457-1059-4108-b23c-b44020b2c7ab admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:28.507280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497c97b-6791-48bf-b32d-0e4a1abebec7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:28.522901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497c97b-6791-48bf-b32d-0e4a1abebec7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:28.531384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a749e-0c78-4521-bfb0-c5d59f1d88da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:28.532813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a749e-0c78-4521-bfb0-c5d59f1d88da admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:28.533338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a749e-0c78-4521-bfb0-c5d59f1d88da admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:28.534414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a749e-0c78-4521-bfb0-c5d59f1d88da admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:28.536877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a749e-0c78-4521-bfb0-c5d59f1d88da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:28.539955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a749e-0c78-4521-bfb0-c5d59f1d88da admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:28.545348 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2038/4051] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:28.550625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4c457-1059-4108-b23c-b44020b2c7ab admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:28.576974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4c457-1059-4108-b23c-b44020b2c7ab admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:28.581430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d7f35-44ef-463f-b160-7566a659b424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:28.584035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d7f35-44ef-463f-b160-7566a659b424 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:28.584035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d7f35-44ef-463f-b160-7566a659b424 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:28.585883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d7f35-44ef-463f-b160-7566a659b424 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:28.586633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d7f35-44ef-463f-b160-7566a659b424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:28.592422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d7f35-44ef-463f-b160-7566a659b424 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:28.743226 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2014/4052] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:28 2022] POST /identity/v3/projects => generated 367 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:28.743607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a749e-0c78-4521-bfb0-c5d59f1d88da admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:28.748516 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2039/4053] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:28 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:28.753779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d7f35-44ef-463f-b160-7566a659b424 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:28.803733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:28.938982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d7f35-44ef-463f-b160-7566a659b424 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:28.947028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a749e-0c78-4521-bfb0-c5d59f1d88da admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:28.953670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeef09-8ed8-4ba1-9f8a-15a8de9e0ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:28.963529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cff40-62e3-4709-8f73-3220d1dbe50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:28.963834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeef09-8ed8-4ba1-9f8a-15a8de9e0ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:28.963928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cff40-62e3-4709-8f73-3220d1dbe50c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:28.963928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cff40-62e3-4709-8f73-3220d1dbe50c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:28.963928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cff40-62e3-4709-8f73-3220d1dbe50c admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:28.964252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeef09-8ed8-4ba1-9f8a-15a8de9e0ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:28.964252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeef09-8ed8-4ba1-9f8a-15a8de9e0ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:28.964428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03cff40-62e3-4709-8f73-3220d1dbe50c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:28.964524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeef09-8ed8-4ba1-9f8a-15a8de9e0ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:28.964524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeef09-8ed8-4ba1-9f8a-15a8de9e0ea1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:28.964702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03cff40-62e3-4709-8f73-3220d1dbe50c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:29.031439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:29.088029 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2015/4054] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:28 2022] POST /identity/v3/users => generated 284 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:29.094754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534689ea-3438-44c6-a217-a124752196e6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:29.096262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534689ea-3438-44c6-a217-a124752196e6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:29.096555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534689ea-3438-44c6-a217-a124752196e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:29.173060 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2040/4055] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:28 2022] POST /identity/v3/users => generated 287 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:29.174053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cff40-62e3-4709-8f73-3220d1dbe50c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:29.183781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-534689ea-3438-44c6-a217-a124752196e6 None None] MFA Rules not processed for user `a60798780db14e00a12cbae6f8253ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:29.185577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-534689ea-3438-44c6-a217-a124752196e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:29.202103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cff40-62e3-4709-8f73-3220d1dbe50c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:29.215396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7f99d-8cf3-4e3a-9841-713dd0e899df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:29.216488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7f99d-8cf3-4e3a-9841-713dd0e899df admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:29.216966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7f99d-8cf3-4e3a-9841-713dd0e899df admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:29.217415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7f99d-8cf3-4e3a-9841-713dd0e899df admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:29.220528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7f99d-8cf3-4e3a-9841-713dd0e899df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:29.222221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7f99d-8cf3-4e3a-9841-713dd0e899df admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:29.249001 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2041/4056] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:29.250999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7f99d-8cf3-4e3a-9841-713dd0e899df admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:29.288189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7f99d-8cf3-4e3a-9841-713dd0e899df admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:29.299914 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2016/4057] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:29.301085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534689ea-3438-44c6-a217-a124752196e6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:29.304210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736393c-a147-4cad-ada5-70c18f24726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:29.305344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736393c-a147-4cad-ada5-70c18f24726f admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:29.308790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736393c-a147-4cad-ada5-70c18f24726f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:29.309744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736393c-a147-4cad-ada5-70c18f24726f admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:29.310656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736393c-a147-4cad-ada5-70c18f24726f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:29.318286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736393c-a147-4cad-ada5-70c18f24726f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:29.328343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534689ea-3438-44c6-a217-a124752196e6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:29.334264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbff2d-a193-4146-8915-d21809f03607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:29.334898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbff2d-a193-4146-8915-d21809f03607 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:29.335236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbff2d-a193-4146-8915-d21809f03607 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:29.335455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbff2d-a193-4146-8915-d21809f03607 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:29.336112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbff2d-a193-4146-8915-d21809f03607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:29.339127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbff2d-a193-4146-8915-d21809f03607 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:29.345031 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2042/4058] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:29.347562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1117e1-92d2-4d6c-b9aa-626cd68ae7e7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:29.347853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1117e1-92d2-4d6c-b9aa-626cd68ae7e7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:29.349267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1117e1-92d2-4d6c-b9aa-626cd68ae7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:29.351953 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2017/4059] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:29.352960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbff2d-a193-4146-8915-d21809f03607 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:29.364323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbff2d-a193-4146-8915-d21809f03607 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:29.369883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8cdf9-1b4c-45f6-af9d-853c03e6c210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:29.371532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8cdf9-1b4c-45f6-af9d-853c03e6c210 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:29.371820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8cdf9-1b4c-45f6-af9d-853c03e6c210 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:29.372098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8cdf9-1b4c-45f6-af9d-853c03e6c210 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:29.372806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8cdf9-1b4c-45f6-af9d-853c03e6c210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:29.375071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8cdf9-1b4c-45f6-af9d-853c03e6c210 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:29.394336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-cf1117e1-92d2-4d6c-b9aa-626cd68ae7e7 None None] MFA Rules not processed for user `a60798780db14e00a12cbae6f8253ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:29.399414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cf1117e1-92d2-4d6c-b9aa-626cd68ae7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:29.399545 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2018/4060] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:29.399545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8cdf9-1b4c-45f6-af9d-853c03e6c210 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:29.421584 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2043/4061] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:29.422837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1117e1-92d2-4d6c-b9aa-626cd68ae7e7 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:29.427016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8cdf9-1b4c-45f6-af9d-853c03e6c210 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:29.433861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61fbd7-fa48-40bf-98aa-9d6ccb811c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:29.434834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61fbd7-fa48-40bf-98aa-9d6ccb811c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:29.435271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61fbd7-fa48-40bf-98aa-9d6ccb811c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:29.435708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61fbd7-fa48-40bf-98aa-9d6ccb811c6f admin admin] PATH_INFO: `/v3/projects/679b38eb20da4300b1e897856b7ecc69/users/50c5b073202d46838d1bd9fcbeac957f/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:29.452021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1117e1-92d2-4d6c-b9aa-626cd68ae7e7 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:29.459915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7719b-bda7-4728-8c8c-a721c713030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:29.462992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61fbd7-fa48-40bf-98aa-9d6ccb811c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=679b38eb20da4300b1e897856b7ecc69, user_id=50c5b073202d46838d1bd9fcbeac957f, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:29.464481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7719b-bda7-4728-8c8c-a721c713030b admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:29.464784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7719b-bda7-4728-8c8c-a721c713030b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:29.465069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7719b-bda7-4728-8c8c-a721c713030b admin admin] PATH_INFO: `/v3/projects/84ff348afb6a475794da787bfd285f42/users/f0ecd1aa50274a32b74a4e8701621be4/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:29.466636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61fbd7-fa48-40bf-98aa-9d6ccb811c6f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:29.489788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7719b-bda7-4728-8c8c-a721c713030b admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ff348afb6a475794da787bfd285f42, user_id=f0ecd1aa50274a32b74a4e8701621be4, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:29.493369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7719b-bda7-4728-8c8c-a721c713030b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:29.595576 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2019/4062] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:29 2022] PUT /identity/v3/projects/679b38eb20da4300b1e897856b7ecc69/users/50c5b073202d46838d1bd9fcbeac957f/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:29.596902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61fbd7-fa48-40bf-98aa-9d6ccb811c6f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:29.599918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dc61fbd7-fa48-40bf-98aa-9d6ccb811c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:29.615146 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2044/4063] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:29 2022] PUT /identity/v3/projects/84ff348afb6a475794da787bfd285f42/users/f0ecd1aa50274a32b74a4e8701621be4/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:29.616587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeb008-1c10-4e13-bce0-475bbb00b5ee None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:29.618876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeb008-1c10-4e13-bce0-475bbb00b5ee None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:29.618876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeb008-1c10-4e13-bce0-475bbb00b5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:29.675418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2ebeb008-1c10-4e13-bce0-475bbb00b5ee None None] MFA Rules not processed for user `50c5b073202d46838d1bd9fcbeac957f`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:29.676751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2ebeb008-1c10-4e13-bce0-475bbb00b5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:29.785883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61fbd7-fa48-40bf-98aa-9d6ccb811c6f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:29.849428 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2045/4064] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:29.851937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c17a77-4cec-4205-bc0f-83b4bfaf4716 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:29.866779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c17a77-4cec-4205-bc0f-83b4bfaf4716 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:29.866779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c17a77-4cec-4205-bc0f-83b4bfaf4716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:29.920795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-63c17a77-4cec-4205-bc0f-83b4bfaf4716 None None] MFA Rules not processed for user `f0ecd1aa50274a32b74a4e8701621be4`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:29.922403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-63c17a77-4cec-4205-bc0f-83b4bfaf4716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:29.946944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a0558-5da2-4045-9f68-89a1c3e6a969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:29.947574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a0558-5da2-4045-9f68-89a1c3e6a969 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:29.948438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a0558-5da2-4045-9f68-89a1c3e6a969 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:29.949930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a0558-5da2-4045-9f68-89a1c3e6a969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:30.037877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a0558-5da2-4045-9f68-89a1c3e6a969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:30.039719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a0558-5da2-4045-9f68-89a1c3e6a969 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:30.057269 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2020/4065] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:30.063158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a0558-5da2-4045-9f68-89a1c3e6a969 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:30.222197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a0558-5da2-4045-9f68-89a1c3e6a969 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:30.237495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c91a2c-3d4e-4109-b27b-689b72b458b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:30.238178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c91a2c-3d4e-4109-b27b-689b72b458b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:30.238462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c91a2c-3d4e-4109-b27b-689b72b458b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:30.238739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c91a2c-3d4e-4109-b27b-689b72b458b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:30.239600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c91a2c-3d4e-4109-b27b-689b72b458b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:30.245664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c91a2c-3d4e-4109-b27b-689b72b458b7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:30.255983 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2046/4066] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:30.257168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c17a77-4cec-4205-bc0f-83b4bfaf4716 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:30.258665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-63c17a77-4cec-4205-bc0f-83b4bfaf4716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:30.352739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c17a77-4cec-4205-bc0f-83b4bfaf4716 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:30.368214 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2021/4067] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:30 2022] POST /identity/v3/projects => generated 367 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:30.373232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c91a2c-3d4e-4109-b27b-689b72b458b7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:30.379133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da66b5-c192-4427-a01f-85b53a043d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:30.379764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da66b5-c192-4427-a01f-85b53a043d18 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:30.380053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da66b5-c192-4427-a01f-85b53a043d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:30.380354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da66b5-c192-4427-a01f-85b53a043d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:30.387970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-97da66b5-c192-4427-a01f-85b53a043d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:30.423437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da66b5-c192-4427-a01f-85b53a043d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:30.425143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da66b5-c192-4427-a01f-85b53a043d18 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:30.440210 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2047/4068] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:30.467155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c91a2c-3d4e-4109-b27b-689b72b458b7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:30.475098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bab707-e9db-4db6-9471-ab126c1b9135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:30.475244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bab707-e9db-4db6-9471-ab126c1b9135 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:30.475490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bab707-e9db-4db6-9471-ab126c1b9135 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:30.475768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bab707-e9db-4db6-9471-ab126c1b9135 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:30.476450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bab707-e9db-4db6-9471-ab126c1b9135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:30.478470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bab707-e9db-4db6-9471-ab126c1b9135 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:30.661086 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2022/4069] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:30 2022] POST /identity/v3/users => generated 290 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:30.665022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da66b5-c192-4427-a01f-85b53a043d18 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:30.686928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da66b5-c192-4427-a01f-85b53a043d18 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:30.694698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e284f-ab60-41db-b940-8fba36ef406a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:30.695547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e284f-ab60-41db-b940-8fba36ef406a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:30.696143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e284f-ab60-41db-b940-8fba36ef406a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:30.696909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e284f-ab60-41db-b940-8fba36ef406a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:30.698619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e284f-ab60-41db-b940-8fba36ef406a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:30.701518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e284f-ab60-41db-b940-8fba36ef406a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:30.715622 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2048/4070] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:30.719595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bab707-e9db-4db6-9471-ab126c1b9135 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:30.737304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bab707-e9db-4db6-9471-ab126c1b9135 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:30.747102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a376a-0215-4006-9aa7-e85d714fa164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:30.748036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a376a-0215-4006-9aa7-e85d714fa164 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:30.748501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a376a-0215-4006-9aa7-e85d714fa164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:30.749118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a376a-0215-4006-9aa7-e85d714fa164 admin admin] PATH_INFO: `/v3/projects/3b923435d495448f824f6b9d674946ab/users/d06115633c554812836abc61cfce529f/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:30.791344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a376a-0215-4006-9aa7-e85d714fa164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b923435d495448f824f6b9d674946ab, user_id=d06115633c554812836abc61cfce529f, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:30.798055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a376a-0215-4006-9aa7-e85d714fa164 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:30.892818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37460afb-6a24-4616-b3b0-098838f01ee1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:30.893859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37460afb-6a24-4616-b3b0-098838f01ee1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:30.894287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37460afb-6a24-4616-b3b0-098838f01ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:30.903175 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-37460afb-6a24-4616-b3b0-098838f01ee1 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:30.903175 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:48:30.903175 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:48:30.903175 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:48:30.903175 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:48:30.903175 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:48:30.903175 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:48:30.903175 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:48:30.903175 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:48:30.903175 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:48:30.903175 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:48:30.903175 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:48:30.903175 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:48:30.904259 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:48:30.904259 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:48:30.904259 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:48:30.904259 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:48:30.904259 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:48:30.904259 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:48:30.904259 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:48:30.904259 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:48:30.904259 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:48:30.904259 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:48:30.904259 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:48:30.904259 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:48:30.904259 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:48:30.904259 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:30.904259 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:48:30.916334 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2049/4071] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:48:30 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 27 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 04:48:30.935167 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2023/4072] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:30 2022] PUT /identity/v3/projects/3b923435d495448f824f6b9d674946ab/users/d06115633c554812836abc61cfce529f/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:48:30.937259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37460afb-6a24-4616-b3b0-098838f01ee1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:30.954280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a376a-0215-4006-9aa7-e85d714fa164 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:31.066431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37460afb-6a24-4616-b3b0-098838f01ee1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:31.081229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf88eb4-8297-4a4f-a020-9bd6bdfbec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:31.082296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf88eb4-8297-4a4f-a020-9bd6bdfbec96 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:31.082624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf88eb4-8297-4a4f-a020-9bd6bdfbec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:31.083149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf88eb4-8297-4a4f-a020-9bd6bdfbec96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:31.083899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf88eb4-8297-4a4f-a020-9bd6bdfbec96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:31.085864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf88eb4-8297-4a4f-a020-9bd6bdfbec96 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:31.103767 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2050/4073] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:31.106259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19faf-5d17-47ab-ad30-8f8fccca8e2d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:31.106686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19faf-5d17-47ab-ad30-8f8fccca8e2d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:31.115883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19faf-5d17-47ab-ad30-8f8fccca8e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:31.116019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a376a-0215-4006-9aa7-e85d714fa164 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:31.116805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af41277-e671-4d9d-a738-5cf44e7ea380 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:31.117940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af41277-e671-4d9d-a738-5cf44e7ea380 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:31.118441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af41277-e671-4d9d-a738-5cf44e7ea380 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:31.118706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af41277-e671-4d9d-a738-5cf44e7ea380 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:31.132303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-97c19faf-5d17-47ab-ad30-8f8fccca8e2d None None] MFA Rules not processed for user `a60798780db14e00a12cbae6f8253ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:31.134198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-97c19faf-5d17-47ab-ad30-8f8fccca8e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:31.222306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af41277-e671-4d9d-a738-5cf44e7ea380 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:31.224033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af41277-e671-4d9d-a738-5cf44e7ea380 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:31.246738 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2024/4074] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:31.247706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af41277-e671-4d9d-a738-5cf44e7ea380 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:31.248051 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2051/4075] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:31.259670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af41277-e671-4d9d-a738-5cf44e7ea380 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:31.265398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b90a9-6047-42c4-acc0-84c8933b22c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:31.266163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b90a9-6047-42c4-acc0-84c8933b22c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:31.266587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b90a9-6047-42c4-acc0-84c8933b22c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:31.266868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b90a9-6047-42c4-acc0-84c8933b22c4 admin admin] PATH_INFO: `/v3/projects/3b923435d495448f824f6b9d674946ab/users/d06115633c554812836abc61cfce529f/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:31.269214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b90a9-6047-42c4-acc0-84c8933b22c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b923435d495448f824f6b9d674946ab, user_id=d06115633c554812836abc61cfce529f, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:31.272118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b90a9-6047-42c4-acc0-84c8933b22c4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:31.293504 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2025/4076] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:31 2022] PUT /identity/v3/projects/3b923435d495448f824f6b9d674946ab/users/d06115633c554812836abc61cfce529f/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:31.295310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff5915-f9ef-414e-9d51-57a1925d67e6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:31.295736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff5915-f9ef-414e-9d51-57a1925d67e6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:31.296643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff5915-f9ef-414e-9d51-57a1925d67e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:31.319278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b90a9-6047-42c4-acc0-84c8933b22c4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:31.326703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a91b90a9-6047-42c4-acc0-84c8933b22c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:31.397848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9aff5915-f9ef-414e-9d51-57a1925d67e6 None None] MFA Rules not processed for user `d06115633c554812836abc61cfce529f`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:31.399361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9aff5915-f9ef-414e-9d51-57a1925d67e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:31.460551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b90a9-6047-42c4-acc0-84c8933b22c4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:31.468701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805859b7-05f4-4b67-b5d2-48948e0d6fe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:31.469401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805859b7-05f4-4b67-b5d2-48948e0d6fe1 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:31.469645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805859b7-05f4-4b67-b5d2-48948e0d6fe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:31.469857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805859b7-05f4-4b67-b5d2-48948e0d6fe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:31.473099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-805859b7-05f4-4b67-b5d2-48948e0d6fe1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:31.566322 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2052/4077] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:31.571526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff5915-f9ef-414e-9d51-57a1925d67e6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:31.591073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff5915-f9ef-414e-9d51-57a1925d67e6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:31.603916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fb76e-809b-4e11-979e-34b9e3de6031 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:31.604579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fb76e-809b-4e11-979e-34b9e3de6031 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:31.604856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fb76e-809b-4e11-979e-34b9e3de6031 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:31.605180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fb76e-809b-4e11-979e-34b9e3de6031 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:31.605833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15fb76e-809b-4e11-979e-34b9e3de6031 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:31.610218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15fb76e-809b-4e11-979e-34b9e3de6031 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:31.625851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805859b7-05f4-4b67-b5d2-48948e0d6fe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:31.627418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805859b7-05f4-4b67-b5d2-48948e0d6fe1 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:31.647800 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2026/4078] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:31.815853 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2053/4079] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:31 2022] POST /identity/v3/projects => generated 359 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:31.819576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805859b7-05f4-4b67-b5d2-48948e0d6fe1 service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:31.840216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805859b7-05f4-4b67-b5d2-48948e0d6fe1 service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:31.977083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a5032-23b9-4471-82c5-a1acc500ab9f tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:31.977719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a5032-23b9-4471-82c5-a1acc500ab9f tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:31.978006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a5032-23b9-4471-82c5-a1acc500ab9f tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:31.978375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a5032-23b9-4471-82c5-a1acc500ab9f tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:31.979045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a5032-23b9-4471-82c5-a1acc500ab9f tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:31.983472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a5032-23b9-4471-82c5-a1acc500ab9f tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:32.175279 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2027/4080] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:31 2022] POST /identity/v3/users => generated 373 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:32.180507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fb76e-809b-4e11-979e-34b9e3de6031 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:32.201561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fb76e-809b-4e11-979e-34b9e3de6031 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:32.209442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940e8cc-4473-47d4-bf9e-c117a4c86169 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:32.210194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940e8cc-4473-47d4-bf9e-c117a4c86169 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:32.210527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940e8cc-4473-47d4-bf9e-c117a4c86169 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:32.212029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940e8cc-4473-47d4-bf9e-c117a4c86169 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users/e0f5a7c8860145a1b5f61a887c26322a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:32.258094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:32.300068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940e8cc-4473-47d4-bf9e-c117a4c86169 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:get_user(user_id=e0f5a7c8860145a1b5f61a887c26322a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:32.308483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940e8cc-4473-47d4-bf9e-c117a4c86169 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:32.314249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a5032-23b9-4471-82c5-a1acc500ab9f tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:32.314632 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2054/4081] 10.222.0.76 () {58 vars in 1221 bytes} [Sat Aug 27 04:48:32 2022] GET /identity/v3/users/e0f5a7c8860145a1b5f61a887c26322a => generated 373 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:32.336749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a5032-23b9-4471-82c5-a1acc500ab9f tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:32.348979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79aaf4-4aa8-4dd6-aac2-9ffb77323103 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:32.351424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79aaf4-4aa8-4dd6-aac2-9ffb77323103 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:32.351892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79aaf4-4aa8-4dd6-aac2-9ffb77323103 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:32.352407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79aaf4-4aa8-4dd6-aac2-9ffb77323103 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users/e0f5a7c8860145a1b5f61a887c26322a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:32.354555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79aaf4-4aa8-4dd6-aac2-9ffb77323103 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e0f5a7c8860145a1b5f61a887c26322a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:32.364134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79aaf4-4aa8-4dd6-aac2-9ffb77323103 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:32.398218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72288c9-f019-4838-a889-704f4f61d81b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:32.398503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72288c9-f019-4838-a889-704f4f61d81b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:32.398857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72288c9-f019-4838-a889-704f4f61d81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:32.408801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-c72288c9-f019-4838-a889-704f4f61d81b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:32.408801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:48:32.408801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:48:32.408801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:48:32.408801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:48:32.408801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:48:32.408801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:48:32.408801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:48:32.408801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:48:32.408801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:48:32.408801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:48:32.408801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:48:32.408801 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:48:32.409910 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:48:32.409910 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:48:32.409910 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:48:32.409910 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:48:32.409910 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:48:32.409910 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:48:32.409910 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:48:32.409910 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:48:32.409910 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:48:32.409910 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:48:32.409910 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:48:32.409910 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:48:32.409910 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:48:32.409910 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:32.409910 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:48:32.410965 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2055/4082] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:48:32 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 13 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:48:32.428091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:32.435873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda60d42-9a98-44ff-ba25-287e34201faa None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:32.437340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda60d42-9a98-44ff-ba25-287e34201faa None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:32.437987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda60d42-9a98-44ff-ba25-287e34201faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:32.499596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-cda60d42-9a98-44ff-ba25-287e34201faa None None] MFA Rules not processed for user `a60798780db14e00a12cbae6f8253ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:32.505029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cda60d42-9a98-44ff-ba25-287e34201faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:32.568681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-da79aaf4-4aa8-4dd6-aac2-9ffb77323103 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f5a7c8860145a1b5f61a887c26322a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:32.678820 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2056/4083] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:32.681276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda60d42-9a98-44ff-ba25-287e34201faa None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:32.683729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cda60d42-9a98-44ff-ba25-287e34201faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:32.710044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-da79aaf4-4aa8-4dd6-aac2-9ffb77323103 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f5a7c8860145a1b5f61a887c26322a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:32.710856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-da79aaf4-4aa8-4dd6-aac2-9ffb77323103 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f5a7c8860145a1b5f61a887c26322a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:32.722229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-da79aaf4-4aa8-4dd6-aac2-9ffb77323103 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f5a7c8860145a1b5f61a887c26322a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:32.765186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-da79aaf4-4aa8-4dd6-aac2-9ffb77323103 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f5a7c8860145a1b5f61a887c26322a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:32.804767 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2028/4084] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:32 2022] DELETE /identity/v3/users/e0f5a7c8860145a1b5f61a887c26322a => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:32.804767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79aaf4-4aa8-4dd6-aac2-9ffb77323103 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:32.816593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-da79aaf4-4aa8-4dd6-aac2-9ffb77323103 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:32.822169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda60d42-9a98-44ff-ba25-287e34201faa None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:32.973238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68700a7-e154-4009-87b4-f81df3b54c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:32.976026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68700a7-e154-4009-87b4-f81df3b54c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:32.976026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68700a7-e154-4009-87b4-f81df3b54c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:32.984936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68700a7-e154-4009-87b4-f81df3b54c1b admin admin] PATH_INFO: `/v3/users/d87d78d0e7444dbcb60cac6425bbc367` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:32.986351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68700a7-e154-4009-87b4-f81df3b54c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87d78d0e7444dbcb60cac6425bbc367)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:32.988523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68700a7-e154-4009-87b4-f81df3b54c1b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:33.094661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79aaf4-4aa8-4dd6-aac2-9ffb77323103 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:33.107670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ddc47-eedf-43a0-85ee-30c7e189b130 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:33.110567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ddc47-eedf-43a0-85ee-30c7e189b130 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:33.111093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ddc47-eedf-43a0-85ee-30c7e189b130 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:33.111632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ddc47-eedf-43a0-85ee-30c7e189b130 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/projects/f897ec3d56654ddd99eac0473921eade` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:33.122022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ddc47-eedf-43a0-85ee-30c7e189b130 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f897ec3d56654ddd99eac0473921eade)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:33.125612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ddc47-eedf-43a0-85ee-30c7e189b130 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:33.379139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e68700a7-e154-4009-87b4-f81df3b54c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87d78d0e7444dbcb60cac6425bbc367'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:33.382143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4f5ddc47-eedf-43a0-85ee-30c7e189b130 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f897ec3d56654ddd99eac0473921eade', 'request_id': 'req-4f5ddc47-eedf-43a0-85ee-30c7e189b130'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:33.383569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e68700a7-e154-4009-87b4-f81df3b54c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87d78d0e7444dbcb60cac6425bbc367'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:33.399180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4f5ddc47-eedf-43a0-85ee-30c7e189b130 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f897ec3d56654ddd99eac0473921eade', 'request_id': 'req-4f5ddc47-eedf-43a0-85ee-30c7e189b130'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:33.413293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4f5ddc47-eedf-43a0-85ee-30c7e189b130 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f897ec3d56654ddd99eac0473921eade', 'request_id': 'req-4f5ddc47-eedf-43a0-85ee-30c7e189b130'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:33.507025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e68700a7-e154-4009-87b4-f81df3b54c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87d78d0e7444dbcb60cac6425bbc367'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:33.507665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e68700a7-e154-4009-87b4-f81df3b54c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87d78d0e7444dbcb60cac6425bbc367'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:33.529530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e68700a7-e154-4009-87b4-f81df3b54c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87d78d0e7444dbcb60cac6425bbc367'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:33.543815 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2057/4085] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:32 2022] DELETE /identity/v3/users/d87d78d0e7444dbcb60cac6425bbc367 => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:33.549221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f06cd6-1f82-4ab8-8abd-d9fe8fb38529 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:33.554508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f06cd6-1f82-4ab8-8abd-d9fe8fb38529 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:33.554508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f06cd6-1f82-4ab8-8abd-d9fe8fb38529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:33.590643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4f5ddc47-eedf-43a0-85ee-30c7e189b130 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] The token cache is being invalidate because project f897ec3d56654ddd99eac0473921eade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:33.598399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4f5ddc47-eedf-43a0-85ee-30c7e189b130 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:33.598399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4f5ddc47-eedf-43a0-85ee-30c7e189b130 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:33.598399 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2029/4086] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:32 2022] DELETE /identity/v3/projects/f897ec3d56654ddd99eac0473921eade => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:33.598737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-13f06cd6-1f82-4ab8-8abd-d9fe8fb38529 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:33.601391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ddc47-eedf-43a0-85ee-30c7e189b130 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:33.603751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-13f06cd6-1f82-4ab8-8abd-d9fe8fb38529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:33.605128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4f5ddc47-eedf-43a0-85ee-30c7e189b130 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:33.742733 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2058/4087] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:48:33.777540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ddc47-eedf-43a0-85ee-30c7e189b130 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:33.858235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f06cd6-1f82-4ab8-8abd-d9fe8fb38529 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:33.861565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-13f06cd6-1f82-4ab8-8abd-d9fe8fb38529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:34.167477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc745be7-27b8-421a-b48d-c14b03b3e664 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:34.168104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745be7-27b8-421a-b48d-c14b03b3e664 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:34.168612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745be7-27b8-421a-b48d-c14b03b3e664 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:34.168890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745be7-27b8-421a-b48d-c14b03b3e664 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:34.169528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc745be7-27b8-421a-b48d-c14b03b3e664 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:34.169976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:34.172122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc745be7-27b8-421a-b48d-c14b03b3e664 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:34.175356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f06cd6-1f82-4ab8-8abd-d9fe8fb38529 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:34.181202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9ae20-a6e4-43eb-9cb0-da45464dae69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:34.182021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9ae20-a6e4-43eb-9cb0-da45464dae69 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:34.182306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9ae20-a6e4-43eb-9cb0-da45464dae69 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:34.182581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9ae20-a6e4-43eb-9cb0-da45464dae69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:34.195649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9ae20-a6e4-43eb-9cb0-da45464dae69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:34.197016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9ae20-a6e4-43eb-9cb0-da45464dae69 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:34.215313 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2059/4088] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:34.315155 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2030/4089] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:33 2022] POST /identity/v3/projects => generated 360 bytes in 715 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:34.319055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9ae20-a6e4-43eb-9cb0-da45464dae69 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:34.338286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9ae20-a6e4-43eb-9cb0-da45464dae69 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:34.437325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6181d-2670-4518-9759-10f61d93654e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:34.437857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6181d-2670-4518-9759-10f61d93654e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:34.438344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6181d-2670-4518-9759-10f61d93654e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:34.462990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-2ea6181d-2670-4518-9759-10f61d93654e None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:34.462990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:48:34.462990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:48:34.462990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:48:34.462990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:48:34.462990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:48:34.462990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:48:34.462990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:48:34.462990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:48:34.462990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:48:34.462990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:48:34.462990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:48:34.462990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:48:34.463943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:48:34.463943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:48:34.463943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:48:34.463943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:48:34.463943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:48:34.463943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:48:34.463943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:48:34.463943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:48:34.463943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:48:34.463943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:48:34.463943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:48:34.463943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:48:34.463943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:48:34.463943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:34.463943 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:48:34.465011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:34.468579 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2031/4090] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:48:34 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 33 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 04:48:34.506812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802a6da-dcd7-4df4-a0f1-7bedd98a3785 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:34.508459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802a6da-dcd7-4df4-a0f1-7bedd98a3785 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:34.508902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802a6da-dcd7-4df4-a0f1-7bedd98a3785 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:34.509333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802a6da-dcd7-4df4-a0f1-7bedd98a3785 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:34.511007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802a6da-dcd7-4df4-a0f1-7bedd98a3785 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:34.513449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802a6da-dcd7-4df4-a0f1-7bedd98a3785 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:34.586029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6181d-2670-4518-9759-10f61d93654e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:34.589206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2ea6181d-2670-4518-9759-10f61d93654e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:34.635908 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2060/4091] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:34 2022] POST /identity/v3/users => generated 417 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:34.640643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802a6da-dcd7-4df4-a0f1-7bedd98a3785 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:34.681515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802a6da-dcd7-4df4-a0f1-7bedd98a3785 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:34.715568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f5eba-5c4f-4eb7-bef8-d0261ba4c96a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:34.716506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f5eba-5c4f-4eb7-bef8-d0261ba4c96a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:34.717002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f5eba-5c4f-4eb7-bef8-d0261ba4c96a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:34.717416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f5eba-5c4f-4eb7-bef8-d0261ba4c96a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:34.718492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f5eba-5c4f-4eb7-bef8-d0261ba4c96a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:34.721428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f5eba-5c4f-4eb7-bef8-d0261ba4c96a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:34.776081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6181d-2670-4518-9759-10f61d93654e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:34.784762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fd3bc-e470-40ee-a7e3-6abf1efdedf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:34.786037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fd3bc-e470-40ee-a7e3-6abf1efdedf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:34.786656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fd3bc-e470-40ee-a7e3-6abf1efdedf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:34.787739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fd3bc-e470-40ee-a7e3-6abf1efdedf6 admin admin] PATH_INFO: `/v3/users/73b00135aa2e42c3af6ac6c1afa4fd4e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:34.789929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fd3bc-e470-40ee-a7e3-6abf1efdedf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b00135aa2e42c3af6ac6c1afa4fd4e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:34.792591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fd3bc-e470-40ee-a7e3-6abf1efdedf6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:34.926313 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2061/4092] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:48:34 2022] POST /identity/v3/roles => generated 239 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:34.930536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3240fd-b921-4f69-8a1f-5fc98d8ee7e7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:34.933821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3240fd-b921-4f69-8a1f-5fc98d8ee7e7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:34.934407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3240fd-b921-4f69-8a1f-5fc98d8ee7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:35.009797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1e3240fd-b921-4f69-8a1f-5fc98d8ee7e7 None None] MFA Rules not processed for user `a60798780db14e00a12cbae6f8253ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:35.010705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1e3240fd-b921-4f69-8a1f-5fc98d8ee7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:35.170358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:35.172089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ae9fd3bc-e470-40ee-a7e3-6abf1efdedf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b00135aa2e42c3af6ac6c1afa4fd4e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:35.199291 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2062/4093] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:35.206106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3240fd-b921-4f69-8a1f-5fc98d8ee7e7 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:35.226122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3240fd-b921-4f69-8a1f-5fc98d8ee7e7 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:35.234415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c593fd-96f5-476c-bfb9-88663983619a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:35.236508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c593fd-96f5-476c-bfb9-88663983619a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:35.239102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c593fd-96f5-476c-bfb9-88663983619a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:35.239388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c593fd-96f5-476c-bfb9-88663983619a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users/d35cb56da2f3466594468bd73096f687` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:35.269810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ae9fd3bc-e470-40ee-a7e3-6abf1efdedf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b00135aa2e42c3af6ac6c1afa4fd4e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:35.270543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ae9fd3bc-e470-40ee-a7e3-6abf1efdedf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b00135aa2e42c3af6ac6c1afa4fd4e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:35.276739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c593fd-96f5-476c-bfb9-88663983619a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:get_user(user_id=d35cb56da2f3466594468bd73096f687)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:35.278980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c593fd-96f5-476c-bfb9-88663983619a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:35.282020 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2063/4094] 10.222.0.76 () {58 vars in 1221 bytes} [Sat Aug 27 04:48:35 2022] GET /identity/v3/users/d35cb56da2f3466594468bd73096f687 => generated 417 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:35.285427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ae9fd3bc-e470-40ee-a7e3-6abf1efdedf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b00135aa2e42c3af6ac6c1afa4fd4e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:35.285571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c593fd-96f5-476c-bfb9-88663983619a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:35.307924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c593fd-96f5-476c-bfb9-88663983619a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:35.308755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ae9fd3bc-e470-40ee-a7e3-6abf1efdedf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b00135aa2e42c3af6ac6c1afa4fd4e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:35.320317 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2032/4095] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:34 2022] DELETE /identity/v3/users/73b00135aa2e42c3af6ac6c1afa4fd4e => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:48:35.320471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a8439-2782-49d6-9c39-e91c183b82f4 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:35.320471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a8439-2782-49d6-9c39-e91c183b82f4 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:35.320769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a8439-2782-49d6-9c39-e91c183b82f4 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:35.321046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a8439-2782-49d6-9c39-e91c183b82f4 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/roles/a2af3064ca5b4370a60ecc0daef16146` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:35.322948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a8439-2782-49d6-9c39-e91c183b82f4 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:get_role(role_id=a2af3064ca5b4370a60ecc0daef16146)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:35.324296 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-d35a8439-2782-49d6-9c39-e91c183b82f4 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:35.324296 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:48:35.324296 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:48:35.324884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a8439-2782-49d6-9c39-e91c183b82f4 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:35.326487 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2064/4096] 10.222.0.76 () {58 vars in 1221 bytes} [Sat Aug 27 04:48:35 2022] GET /identity/v3/roles/a2af3064ca5b4370a60ecc0daef16146 => generated 239 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:48:35.331118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fd3bc-e470-40ee-a7e3-6abf1efdedf6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:35.332721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ae9fd3bc-e470-40ee-a7e3-6abf1efdedf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:35.442106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fd3bc-e470-40ee-a7e3-6abf1efdedf6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:35.455339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442c7b4-29a0-4ffc-b896-06c65d0c75e0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:35.456081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442c7b4-29a0-4ffc-b896-06c65d0c75e0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:35.463653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442c7b4-29a0-4ffc-b896-06c65d0c75e0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:35.463653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442c7b4-29a0-4ffc-b896-06c65d0c75e0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:35.463653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442c7b4-29a0-4ffc-b896-06c65d0c75e0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:35.463653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442c7b4-29a0-4ffc-b896-06c65d0c75e0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:35.521607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:35.603466 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2033/4097] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:35 2022] POST /identity/v3/projects => generated 360 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:35.607357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a8439-2782-49d6-9c39-e91c183b82f4 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:35.620779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a8439-2782-49d6-9c39-e91c183b82f4 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:35.706496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acf44c-a329-4a70-99d6-a379d98bf727 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:35.707376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acf44c-a329-4a70-99d6-a379d98bf727 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:35.708002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acf44c-a329-4a70-99d6-a379d98bf727 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:35.708474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acf44c-a329-4a70-99d6-a379d98bf727 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/projects/4065c7b707c643269374ec029999d93e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:35.710099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acf44c-a329-4a70-99d6-a379d98bf727 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:get_project(project_id=4065c7b707c643269374ec029999d93e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:35.713013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acf44c-a329-4a70-99d6-a379d98bf727 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:35.715745 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2065/4098] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:48:35 2022] GET /identity/v3/projects/4065c7b707c643269374ec029999d93e => generated 360 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:35.719885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442c7b4-29a0-4ffc-b896-06c65d0c75e0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:35.741224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442c7b4-29a0-4ffc-b896-06c65d0c75e0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:35.741224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43855d41-c166-4422-bcb0-46ad97513cd2 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:35.741224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43855d41-c166-4422-bcb0-46ad97513cd2 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:35.741605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43855d41-c166-4422-bcb0-46ad97513cd2 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:35.741605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43855d41-c166-4422-bcb0-46ad97513cd2 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/projects/4065c7b707c643269374ec029999d93e/users/d35cb56da2f3466594468bd73096f687/roles/a2af3064ca5b4370a60ecc0daef16146` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:35.741605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43855d41-c166-4422-bcb0-46ad97513cd2 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4065c7b707c643269374ec029999d93e, user_id=d35cb56da2f3466594468bd73096f687, role_id=a2af3064ca5b4370a60ecc0daef16146)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:35.745306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43855d41-c166-4422-bcb0-46ad97513cd2 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:35.847459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acf44c-a329-4a70-99d6-a379d98bf727 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:35.849232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-42acf44c-a329-4a70-99d6-a379d98bf727 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:35.880009 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2034/4099] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:35 2022] PUT /identity/v3/projects/4065c7b707c643269374ec029999d93e/users/d35cb56da2f3466594468bd73096f687/roles/a2af3064ca5b4370a60ecc0daef16146 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:35.881378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20fcdd-fb16-4809-8702-b3e92c8a0f56 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:35.881658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20fcdd-fb16-4809-8702-b3e92c8a0f56 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:35.881925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20fcdd-fb16-4809-8702-b3e92c8a0f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:35.895827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-0d20fcdd-fb16-4809-8702-b3e92c8a0f56 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:35.895827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:48:35.895827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:48:35.895827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:48:35.895827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:48:35.895827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:48:35.895827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:48:35.895827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:48:35.895827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:48:35.895827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:48:35.895827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:48:35.895827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:48:35.895827 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:48:35.896900 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:48:35.896900 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:48:35.896900 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:48:35.896900 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:48:35.896900 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:48:35.896900 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:48:35.896900 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:48:35.896900 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:48:35.896900 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:48:35.896900 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:48:35.896900 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:48:35.896900 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:48:35.896900 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:48:35.896900 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:35.896900 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:48:35.905929 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2035/4100] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:48:35 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 21 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:48:35.905929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20fcdd-fb16-4809-8702-b3e92c8a0f56 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:35.987887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20fcdd-fb16-4809-8702-b3e92c8a0f56 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:35.993185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18a257-03e1-4609-aef2-c7b771db766a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:35.993792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18a257-03e1-4609-aef2-c7b771db766a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:35.994076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18a257-03e1-4609-aef2-c7b771db766a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:35.994355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18a257-03e1-4609-aef2-c7b771db766a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:35.995016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18a257-03e1-4609-aef2-c7b771db766a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:35.996903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18a257-03e1-4609-aef2-c7b771db766a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:36.030618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acf44c-a329-4a70-99d6-a379d98bf727 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:36.137164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2d587-d4c2-4883-943d-dc2611c10ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:36.138117 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2036/4101] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:35 2022] POST /identity/v3/projects => generated 360 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:36.139322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18a257-03e1-4609-aef2-c7b771db766a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:36.142391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2d587-d4c2-4883-943d-dc2611c10ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:36.142947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2d587-d4c2-4883-943d-dc2611c10ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:36.143595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2d587-d4c2-4883-943d-dc2611c10ce0 admin admin] PATH_INFO: `/v3/projects/0fd4d0ce0f8f463498d4d36ec1b49e7a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:36.144450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3c18a257-03e1-4609-aef2-c7b771db766a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:36.145544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2d587-d4c2-4883-943d-dc2611c10ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd4d0ce0f8f463498d4d36ec1b49e7a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:36.148387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2d587-d4c2-4883-943d-dc2611c10ce0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:36.225582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18a257-03e1-4609-aef2-c7b771db766a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:36.231009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1781c8-76f5-49ca-9c9f-18b0b0d349bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:36.231645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1781c8-76f5-49ca-9c9f-18b0b0d349bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:36.231928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1781c8-76f5-49ca-9c9f-18b0b0d349bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:36.232236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1781c8-76f5-49ca-9c9f-18b0b0d349bf admin admin] PATH_INFO: `/v3/projects/a3f9953aa720463aa062c0715d7146cb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:36.233410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1781c8-76f5-49ca-9c9f-18b0b0d349bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3f9953aa720463aa062c0715d7146cb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:36.235708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1781c8-76f5-49ca-9c9f-18b0b0d349bf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:36.348693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fcc2d587-d4c2-4883-943d-dc2611c10ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd4d0ce0f8f463498d4d36ec1b49e7a', 'request_id': 'req-fcc2d587-d4c2-4883-943d-dc2611c10ce0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:36.380279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fcc2d587-d4c2-4883-943d-dc2611c10ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd4d0ce0f8f463498d4d36ec1b49e7a', 'request_id': 'req-fcc2d587-d4c2-4883-943d-dc2611c10ce0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:36.400351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ee1781c8-76f5-49ca-9c9f-18b0b0d349bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f9953aa720463aa062c0715d7146cb', 'request_id': 'req-ee1781c8-76f5-49ca-9c9f-18b0b0d349bf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:36.408992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ee1781c8-76f5-49ca-9c9f-18b0b0d349bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f9953aa720463aa062c0715d7146cb', 'request_id': 'req-ee1781c8-76f5-49ca-9c9f-18b0b0d349bf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:36.418118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ee1781c8-76f5-49ca-9c9f-18b0b0d349bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f9953aa720463aa062c0715d7146cb', 'request_id': 'req-ee1781c8-76f5-49ca-9c9f-18b0b0d349bf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:36.536274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fcc2d587-d4c2-4883-943d-dc2611c10ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd4d0ce0f8f463498d4d36ec1b49e7a', 'request_id': 'req-fcc2d587-d4c2-4883-943d-dc2611c10ce0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:36.555183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fcc2d587-d4c2-4883-943d-dc2611c10ce0 admin admin] The token cache is being invalidate because project 0fd4d0ce0f8f463498d4d36ec1b49e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:36.556219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fcc2d587-d4c2-4883-943d-dc2611c10ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:36.558911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fcc2d587-d4c2-4883-943d-dc2611c10ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:36.567819 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2066/4102] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:35 2022] DELETE /identity/v3/projects/0fd4d0ce0f8f463498d4d36ec1b49e7a => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:36.569362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc590a15-3a9d-44cd-a69e-0b6c917896b3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:36.569649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc590a15-3a9d-44cd-a69e-0b6c917896b3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:36.569924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc590a15-3a9d-44cd-a69e-0b6c917896b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:36.605594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-dc590a15-3a9d-44cd-a69e-0b6c917896b3 None None] MFA Rules not processed for user `a60798780db14e00a12cbae6f8253ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:36.606952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dc590a15-3a9d-44cd-a69e-0b6c917896b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:36.673284 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2067/4103] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:36.674793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc590a15-3a9d-44cd-a69e-0b6c917896b3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:36.676423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dc590a15-3a9d-44cd-a69e-0b6c917896b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:36.695477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ee1781c8-76f5-49ca-9c9f-18b0b0d349bf admin admin] The token cache is being invalidate because project a3f9953aa720463aa062c0715d7146cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:36.696020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ee1781c8-76f5-49ca-9c9f-18b0b0d349bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:36.700668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ee1781c8-76f5-49ca-9c9f-18b0b0d349bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:36.704041 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2037/4104] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:36 2022] DELETE /identity/v3/projects/a3f9953aa720463aa062c0715d7146cb => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:36.705677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e561be-c54d-47f0-a850-c3c8bdb31229 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:36.706148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e561be-c54d-47f0-a850-c3c8bdb31229 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:36.706574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e561be-c54d-47f0-a850-c3c8bdb31229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:36.736835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-19e561be-c54d-47f0-a850-c3c8bdb31229 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:36.745104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-19e561be-c54d-47f0-a850-c3c8bdb31229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:36.845226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc590a15-3a9d-44cd-a69e-0b6c917896b3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:36.853514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c63ba3-78e8-4db1-94f6-9511cd096923 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:36.854547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c63ba3-78e8-4db1-94f6-9511cd096923 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:36.855035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c63ba3-78e8-4db1-94f6-9511cd096923 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:36.855511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c63ba3-78e8-4db1-94f6-9511cd096923 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/projects/37c726dae9af453d985bad18918eb137` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:36.857300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c63ba3-78e8-4db1-94f6-9511cd096923 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:get_project(project_id=37c726dae9af453d985bad18918eb137)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:36.861982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c63ba3-78e8-4db1-94f6-9511cd096923 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:36.864841 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2068/4105] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:48:36 2022] GET /identity/v3/projects/37c726dae9af453d985bad18918eb137 => generated 360 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:36.866326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f7dc5-ee01-49ca-9ae1-d27a5261af2c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:36.866813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f7dc5-ee01-49ca-9ae1-d27a5261af2c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:36.867310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f7dc5-ee01-49ca-9ae1-d27a5261af2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:36.876265 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2038/4106] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:36.877895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e561be-c54d-47f0-a850-c3c8bdb31229 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:36.881266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-19e561be-c54d-47f0-a850-c3c8bdb31229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:36.893566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3b2f7dc5-ee01-49ca-9ae1-d27a5261af2c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:36.895183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3b2f7dc5-ee01-49ca-9ae1-d27a5261af2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:36.910232 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2069/4107] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:36.912468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5193a-5b42-4c8e-9392-f03a2a84fed1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:36.913434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e561be-c54d-47f0-a850-c3c8bdb31229 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:36.914589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5193a-5b42-4c8e-9392-f03a2a84fed1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:36.915244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5193a-5b42-4c8e-9392-f03a2a84fed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:36.943283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d735bda-c7a3-48ec-a437-ea73add2d676 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:36.944465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d735bda-c7a3-48ec-a437-ea73add2d676 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:36.944910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d735bda-c7a3-48ec-a437-ea73add2d676 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:36.945345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d735bda-c7a3-48ec-a437-ea73add2d676 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/projects/37c726dae9af453d985bad18918eb137/users/d35cb56da2f3466594468bd73096f687/roles/a2af3064ca5b4370a60ecc0daef16146` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:36.951325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d735bda-c7a3-48ec-a437-ea73add2d676 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:create_grant(project_id=37c726dae9af453d985bad18918eb137, user_id=d35cb56da2f3466594468bd73096f687, role_id=a2af3064ca5b4370a60ecc0daef16146)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:36.955079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d735bda-c7a3-48ec-a437-ea73add2d676 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:36.977629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-02f5193a-5b42-4c8e-9392-f03a2a84fed1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:36.979124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-02f5193a-5b42-4c8e-9392-f03a2a84fed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:36.990436 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2070/4108] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:36.991994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f81b8-941d-42b8-aada-11f7aa20ddab None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:36.992522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f81b8-941d-42b8-aada-11f7aa20ddab None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:36.993157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f81b8-941d-42b8-aada-11f7aa20ddab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:37.024324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6b3f81b8-941d-42b8-aada-11f7aa20ddab None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:37.026599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6b3f81b8-941d-42b8-aada-11f7aa20ddab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:37.036905 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2071/4109] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:37.038463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f81b8-941d-42b8-aada-11f7aa20ddab None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:37.056443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f81b8-941d-42b8-aada-11f7aa20ddab None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:37.067151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22bc45-282d-445d-be1b-1d97f2362491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:37.067151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22bc45-282d-445d-be1b-1d97f2362491 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:37.067532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22bc45-282d-445d-be1b-1d97f2362491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:37.067936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22bc45-282d-445d-be1b-1d97f2362491 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:37.068662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22bc45-282d-445d-be1b-1d97f2362491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:48:37.069031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22bc45-282d-445d-be1b-1d97f2362491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:37.070810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22bc45-282d-445d-be1b-1d97f2362491 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:37.102121 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2072/4110] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:37.102121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22bc45-282d-445d-be1b-1d97f2362491 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:37.123206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22bc45-282d-445d-be1b-1d97f2362491 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:37.125775 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2039/4111] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:36 2022] PUT /identity/v3/projects/37c726dae9af453d985bad18918eb137/users/d35cb56da2f3466594468bd73096f687/roles/a2af3064ca5b4370a60ecc0daef16146 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:37.126598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d735bda-c7a3-48ec-a437-ea73add2d676 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:37.205846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a2c4b-b231-47d2-b446-97be805fea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:37.212884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a2c4b-b231-47d2-b446-97be805fea39 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:37.212884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a2c4b-b231-47d2-b446-97be805fea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:37.212884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a2c4b-b231-47d2-b446-97be805fea39 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:37.212884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a2c4b-b231-47d2-b446-97be805fea39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:48:37.212884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a2c4b-b231-47d2-b446-97be805fea39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:37.212884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a2c4b-b231-47d2-b446-97be805fea39 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:37.224461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d735bda-c7a3-48ec-a437-ea73add2d676 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:37.240873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5461d7b-a7e7-4160-8baa-99967b4e9169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:37.241510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5461d7b-a7e7-4160-8baa-99967b4e9169 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:37.247446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5461d7b-a7e7-4160-8baa-99967b4e9169 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:37.247446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5461d7b-a7e7-4160-8baa-99967b4e9169 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:37.247446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5461d7b-a7e7-4160-8baa-99967b4e9169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:37.247446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5461d7b-a7e7-4160-8baa-99967b4e9169 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:37.249113 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2073/4112] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:37.253395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a2c4b-b231-47d2-b446-97be805fea39 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:37.352396 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2040/4113] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:37 2022] POST /identity/v3/projects => generated 363 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:37.355204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5461d7b-a7e7-4160-8baa-99967b4e9169 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:37.450611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a2c4b-b231-47d2-b446-97be805fea39 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:37.507593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:37.552751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5461d7b-a7e7-4160-8baa-99967b4e9169 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:37.560347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b18687-e3ef-4263-8350-159edcb31273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:37.562285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b18687-e3ef-4263-8350-159edcb31273 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:37.563214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b18687-e3ef-4263-8350-159edcb31273 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:37.563758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b18687-e3ef-4263-8350-159edcb31273 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:37.565273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b18687-e3ef-4263-8350-159edcb31273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:37.567637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b18687-e3ef-4263-8350-159edcb31273 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:37.591778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbed671-228d-4c2b-8a55-dbc4208bb03a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:37.592403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbed671-228d-4c2b-8a55-dbc4208bb03a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:37.592724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbed671-228d-4c2b-8a55-dbc4208bb03a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:37.593666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbed671-228d-4c2b-8a55-dbc4208bb03a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users/d35cb56da2f3466594468bd73096f687/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:37.596833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbed671-228d-4c2b-8a55-dbc4208bb03a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=d35cb56da2f3466594468bd73096f687)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:37.606290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbed671-228d-4c2b-8a55-dbc4208bb03a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:37.685409 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2074/4114] 10.222.0.76 () {58 vars in 1248 bytes} [Sat Aug 27 04:48:37 2022] GET /identity/v3/users/d35cb56da2f3466594468bd73096f687/projects => generated 844 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:37.690023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbed671-228d-4c2b-8a55-dbc4208bb03a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:37.716647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbed671-228d-4c2b-8a55-dbc4208bb03a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:37.730421 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2041/4115] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:37 2022] POST /identity/v3/projects => generated 397 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:37.731825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155a021-13c0-42be-a3b2-bc320ddd872b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:37.732109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155a021-13c0-42be-a3b2-bc320ddd872b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:37.735588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155a021-13c0-42be-a3b2-bc320ddd872b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:37.739131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433efd2-affa-49be-9c9d-d4a7f784038d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:37.740876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433efd2-affa-49be-9c9d-d4a7f784038d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:37.741955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433efd2-affa-49be-9c9d-d4a7f784038d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:37.743795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433efd2-affa-49be-9c9d-d4a7f784038d admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:37.743795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433efd2-affa-49be-9c9d-d4a7f784038d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:37.748117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433efd2-affa-49be-9c9d-d4a7f784038d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:37.752726 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-1155a021-13c0-42be-a3b2-bc320ddd872b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:37.752726 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:48:37.752726 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:48:37.752726 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:48:37.752726 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:48:37.752726 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:48:37.752726 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:48:37.752726 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:48:37.752726 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:48:37.752726 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:48:37.752726 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:48:37.752726 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:48:37.752726 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:48:37.754171 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:48:37.754171 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:48:37.754171 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:48:37.754171 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:48:37.754171 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:48:37.754171 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:48:37.754171 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:48:37.754171 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:48:37.754171 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:48:37.754171 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:48:37.754171 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:48:37.754171 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:48:37.754171 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:48:37.754171 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:37.754171 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:48:37.756666 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2042/4116] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:48:37 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 26 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:48:37.759856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155a021-13c0-42be-a3b2-bc320ddd872b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:37.926842 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2075/4117] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:37 2022] POST /identity/v3/users => generated 282 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:37.928324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433efd2-affa-49be-9c9d-d4a7f784038d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:37.941033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155a021-13c0-42be-a3b2-bc320ddd872b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:37.946711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ce8bc-4d48-452e-86f2-f553c42c3c88 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:37.947625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ce8bc-4d48-452e-86f2-f553c42c3c88 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:37.949662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:37.950215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ce8bc-4d48-452e-86f2-f553c42c3c88 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:37.950574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ce8bc-4d48-452e-86f2-f553c42c3c88 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/projects/37c726dae9af453d985bad18918eb137` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:37.951480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433efd2-affa-49be-9c9d-d4a7f784038d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:37.951843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ce8bc-4d48-452e-86f2-f553c42c3c88 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:delete_project(project_id=37c726dae9af453d985bad18918eb137)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:37.953972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ce8bc-4d48-452e-86f2-f553c42c3c88 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:38.094659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec12111-1188-4326-a5cc-09b19134e23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:38.101859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec12111-1188-4326-a5cc-09b19134e23b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:38.101859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec12111-1188-4326-a5cc-09b19134e23b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:38.101859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec12111-1188-4326-a5cc-09b19134e23b admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:38.101859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec12111-1188-4326-a5cc-09b19134e23b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:38.109843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec12111-1188-4326-a5cc-09b19134e23b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:38.237496 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2076/4118] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:37 2022] POST /identity/v3/users => generated 299 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:38.240709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d7d28-bf5d-4ae6-81ce-a69bd24e6e20 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:38.241152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d7d28-bf5d-4ae6-81ce-a69bd24e6e20 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:38.241601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d7d28-bf5d-4ae6-81ce-a69bd24e6e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:38.264607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-456ce8bc-4d48-452e-86f2-f553c42c3c88 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c726dae9af453d985bad18918eb137', 'request_id': 'req-456ce8bc-4d48-452e-86f2-f553c42c3c88'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:38.277673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-456ce8bc-4d48-452e-86f2-f553c42c3c88 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c726dae9af453d985bad18918eb137', 'request_id': 'req-456ce8bc-4d48-452e-86f2-f553c42c3c88'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:38.286299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1f9d7d28-bf5d-4ae6-81ce-a69bd24e6e20 None None] MFA Rules not processed for user `a60798780db14e00a12cbae6f8253ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:38.287674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1f9d7d28-bf5d-4ae6-81ce-a69bd24e6e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:38.290410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-456ce8bc-4d48-452e-86f2-f553c42c3c88 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c726dae9af453d985bad18918eb137', 'request_id': 'req-456ce8bc-4d48-452e-86f2-f553c42c3c88'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:38.411511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-456ce8bc-4d48-452e-86f2-f553c42c3c88 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] The token cache is being invalidate because project 37c726dae9af453d985bad18918eb137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:38.411943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-456ce8bc-4d48-452e-86f2-f553c42c3c88 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:38.412998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-456ce8bc-4d48-452e-86f2-f553c42c3c88 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:38.417712 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2043/4119] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:37 2022] DELETE /identity/v3/projects/37c726dae9af453d985bad18918eb137 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:38.417712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ce8bc-4d48-452e-86f2-f553c42c3c88 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:38.420736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-456ce8bc-4d48-452e-86f2-f553c42c3c88 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:38.432884 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2077/4120] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:38.433806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d7d28-bf5d-4ae6-81ce-a69bd24e6e20 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:38.435482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1f9d7d28-bf5d-4ae6-81ce-a69bd24e6e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:38.595416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d7d28-bf5d-4ae6-81ce-a69bd24e6e20 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:38.609854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6c562-beae-42fc-b77a-940fecbb8852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:38.610576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6c562-beae-42fc-b77a-940fecbb8852 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:38.610769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6c562-beae-42fc-b77a-940fecbb8852 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:38.611039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6c562-beae-42fc-b77a-940fecbb8852 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:38.611941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6c562-beae-42fc-b77a-940fecbb8852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:38.613472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6c562-beae-42fc-b77a-940fecbb8852 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:38.626738 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2078/4121] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:38 2022] GET /identity/v3/roles => generated 1650 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:38.627612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6c562-beae-42fc-b77a-940fecbb8852 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:38.636516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-abc6c562-beae-42fc-b77a-940fecbb8852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:38.682253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ce8bc-4d48-452e-86f2-f553c42c3c88 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:38.702559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d2393-2d74-4825-a3a3-f6986ea064c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:38.702559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d2393-2d74-4825-a3a3-f6986ea064c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:38.702559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d2393-2d74-4825-a3a3-f6986ea064c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:38.702559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d2393-2d74-4825-a3a3-f6986ea064c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:38.703027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d2393-2d74-4825-a3a3-f6986ea064c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:38.705194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d2393-2d74-4825-a3a3-f6986ea064c5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:38.735050 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2044/4122] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:38 2022] GET /identity/v3/roles => generated 1650 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:38.736318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d2393-2d74-4825-a3a3-f6986ea064c5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:38.761589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d2393-2d74-4825-a3a3-f6986ea064c5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:38.777634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6c562-beae-42fc-b77a-940fecbb8852 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:38.778899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eda4c-22f2-484c-a608-622df09c8415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:38.779675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eda4c-22f2-484c-a608-622df09c8415 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:38.779961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eda4c-22f2-484c-a608-622df09c8415 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:38.780894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eda4c-22f2-484c-a608-622df09c8415 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:38.781547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8eda4c-22f2-484c-a608-622df09c8415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:38.784940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8eda4c-22f2-484c-a608-622df09c8415 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:38.798423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d35150-4ae7-42c2-826a-b63e8b5c7fc8 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:38.799842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d35150-4ae7-42c2-826a-b63e8b5c7fc8 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:38.800172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d35150-4ae7-42c2-826a-b63e8b5c7fc8 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:38.800457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d35150-4ae7-42c2-826a-b63e8b5c7fc8 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/projects/4065c7b707c643269374ec029999d93e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:38.801924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d35150-4ae7-42c2-826a-b63e8b5c7fc8 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4065c7b707c643269374ec029999d93e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:38.806468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d35150-4ae7-42c2-826a-b63e8b5c7fc8 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:38.812906 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2045/4123] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:38 2022] GET /identity/v3/roles => generated 1650 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:38.812906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eda4c-22f2-484c-a608-622df09c8415 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:38.838795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eda4c-22f2-484c-a608-622df09c8415 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:38.857118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c504a-181c-40e6-917e-e250a27520d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:38.858083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c504a-181c-40e6-917e-e250a27520d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:38.858624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c504a-181c-40e6-917e-e250a27520d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:38.859179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c504a-181c-40e6-917e-e250a27520d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:38.859986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c504a-181c-40e6-917e-e250a27520d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:38.862145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c504a-181c-40e6-917e-e250a27520d6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:38.880192 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2046/4124] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:38 2022] GET /identity/v3/roles => generated 1650 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:38.881225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c504a-181c-40e6-917e-e250a27520d6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:38.894945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c504a-181c-40e6-917e-e250a27520d6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:38.900411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff25976-9da6-4cab-a98d-8504ab1b6f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:38.901714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff25976-9da6-4cab-a98d-8504ab1b6f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:38.902153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff25976-9da6-4cab-a98d-8504ab1b6f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:38.902601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff25976-9da6-4cab-a98d-8504ab1b6f45 admin admin] PATH_INFO: `/v3/projects/cc707bf026bb4d4dbe29de3711e3f223/users/12d8710270d44c65bf86cc42b692a43a/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:38.921104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff25976-9da6-4cab-a98d-8504ab1b6f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc707bf026bb4d4dbe29de3711e3f223, user_id=12d8710270d44c65bf86cc42b692a43a, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:38.923936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff25976-9da6-4cab-a98d-8504ab1b6f45 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:39.058716 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2047/4125] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:38 2022] PUT /identity/v3/projects/cc707bf026bb4d4dbe29de3711e3f223/users/12d8710270d44c65bf86cc42b692a43a/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:39.060487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff25976-9da6-4cab-a98d-8504ab1b6f45 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:39.172783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff25976-9da6-4cab-a98d-8504ab1b6f45 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:39.193424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-66d35150-4ae7-42c2-826a-b63e8b5c7fc8 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4065c7b707c643269374ec029999d93e', 'request_id': 'req-66d35150-4ae7-42c2-826a-b63e8b5c7fc8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:39.209551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-66d35150-4ae7-42c2-826a-b63e8b5c7fc8 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4065c7b707c643269374ec029999d93e', 'request_id': 'req-66d35150-4ae7-42c2-826a-b63e8b5c7fc8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:39.302033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-66d35150-4ae7-42c2-826a-b63e8b5c7fc8 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4065c7b707c643269374ec029999d93e', 'request_id': 'req-66d35150-4ae7-42c2-826a-b63e8b5c7fc8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:39.333275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-66d35150-4ae7-42c2-826a-b63e8b5c7fc8 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] The token cache is being invalidate because project 4065c7b707c643269374ec029999d93e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:39.335281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-66d35150-4ae7-42c2-826a-b63e8b5c7fc8 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:39.338954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-66d35150-4ae7-42c2-826a-b63e8b5c7fc8 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:39.343353 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2079/4126] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:38 2022] DELETE /identity/v3/projects/4065c7b707c643269374ec029999d93e => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:39.347444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bfa06-db9e-45fc-a933-ad9e056ea75a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:39.347444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bfa06-db9e-45fc-a933-ad9e056ea75a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:39.347444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bfa06-db9e-45fc-a933-ad9e056ea75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:39.388374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b52bfa06-db9e-45fc-a933-ad9e056ea75a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:39.390581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b52bfa06-db9e-45fc-a933-ad9e056ea75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:39.422681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12fefe-d291-4a7f-8eb6-8e1f81982016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:39.423776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12fefe-d291-4a7f-8eb6-8e1f81982016 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:39.424533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12fefe-d291-4a7f-8eb6-8e1f81982016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:39.425556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12fefe-d291-4a7f-8eb6-8e1f81982016 admin admin] PATH_INFO: `/v3/projects/51586c678a2d41af9cc7212eeb825e00/users/3a86ccf7e9b64eb185ea6667d44b097d/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:39.451907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12fefe-d291-4a7f-8eb6-8e1f81982016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51586c678a2d41af9cc7212eeb825e00, user_id=3a86ccf7e9b64eb185ea6667d44b097d, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:39.456594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12fefe-d291-4a7f-8eb6-8e1f81982016 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:39.482543 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2080/4127] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:39.482543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b189914-b9f5-4208-b384-72fee149f454 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:39.482543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b189914-b9f5-4208-b384-72fee149f454 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:39.482543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b189914-b9f5-4208-b384-72fee149f454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:39.490063 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-6b189914-b9f5-4208-b384-72fee149f454 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:39.490063 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:48:39.490063 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:48:39.490063 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:48:39.490063 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:48:39.490063 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:48:39.490063 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:48:39.490063 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:48:39.490063 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:48:39.490063 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:48:39.490063 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:48:39.490063 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:48:39.490063 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:48:39.491168 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:48:39.491168 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:48:39.491168 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:48:39.491168 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:48:39.491168 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:48:39.491168 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:48:39.491168 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:48:39.491168 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:48:39.491168 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:48:39.491168 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:48:39.491168 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:48:39.491168 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:48:39.491168 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:48:39.491168 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:39.491168 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:48:39.492035 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2081/4128] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:48:39 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 12 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:48:39.493093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b189914-b9f5-4208-b384-72fee149f454 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:39.494913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6b189914-b9f5-4208-b384-72fee149f454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:39.578840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b189914-b9f5-4208-b384-72fee149f454 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:39.583420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcbadf-fd9b-4e04-b557-999b8138312a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:39.584053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcbadf-fd9b-4e04-b557-999b8138312a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:39.584483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcbadf-fd9b-4e04-b557-999b8138312a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:39.584757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcbadf-fd9b-4e04-b557-999b8138312a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/roles/a2af3064ca5b4370a60ecc0daef16146` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:39.586315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcbadf-fd9b-4e04-b557-999b8138312a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a2af3064ca5b4370a60ecc0daef16146)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:39.587338 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-bbfcbadf-fd9b-4e04-b557-999b8138312a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:39.587338 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:48:39.587338 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:48:39.588303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcbadf-fd9b-4e04-b557-999b8138312a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:39.611002 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2048/4129] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:39 2022] PUT /identity/v3/projects/51586c678a2d41af9cc7212eeb825e00/users/3a86ccf7e9b64eb185ea6667d44b097d/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:39.612438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12fefe-d291-4a7f-8eb6-8e1f81982016 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:39.614097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0b12fefe-d291-4a7f-8eb6-8e1f81982016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:39.697752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12fefe-d291-4a7f-8eb6-8e1f81982016 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:39.705304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc9de0-d75d-4f45-b479-13c21556f44b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:39.706352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc9de0-d75d-4f45-b479-13c21556f44b service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:39.707086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc9de0-d75d-4f45-b479-13c21556f44b service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:39.707086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc9de0-d75d-4f45-b479-13c21556f44b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:39.752842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bbfcbadf-fd9b-4e04-b557-999b8138312a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invalidating the token cache because role a2af3064ca5b4370a60ecc0daef16146 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:39.753269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bbfcbadf-fd9b-4e04-b557-999b8138312a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:39.755556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bbfcbadf-fd9b-4e04-b557-999b8138312a tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:39.757169 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2082/4130] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:39 2022] DELETE /identity/v3/roles/a2af3064ca5b4370a60ecc0daef16146 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:39.763930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0754a-8f98-47e0-8998-278c41973b6a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:39.764251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0754a-8f98-47e0-8998-278c41973b6a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:39.765651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0754a-8f98-47e0-8998-278c41973b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:39.788484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-28e0754a-8f98-47e0-8998-278c41973b6a None None] MFA Rules not processed for user `a60798780db14e00a12cbae6f8253ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:39.789161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc9de0-d75d-4f45-b479-13c21556f44b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:39.789946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-28e0754a-8f98-47e0-8998-278c41973b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:39.790793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc9de0-d75d-4f45-b479-13c21556f44b service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:39.802706 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2049/4131] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:39.804010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b337-78fc-4614-8abc-abd4aa905ed3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:39.804329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b337-78fc-4614-8abc-abd4aa905ed3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:39.804599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b337-78fc-4614-8abc-abd4aa905ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:39.842408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1152b337-78fc-4614-8abc-abd4aa905ed3 None None] MFA Rules not processed for user `3a86ccf7e9b64eb185ea6667d44b097d`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:39.843774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1152b337-78fc-4614-8abc-abd4aa905ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:39.848635 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2083/4132] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:39.853083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0754a-8f98-47e0-8998-278c41973b6a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:39.857823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-28e0754a-8f98-47e0-8998-278c41973b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:39.897537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:39.934363 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2050/4133] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:39.934363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152b337-78fc-4614-8abc-abd4aa905ed3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:39.943340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1152b337-78fc-4614-8abc-abd4aa905ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:39.956741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0754a-8f98-47e0-8998-278c41973b6a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:39.966199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c42571-1c77-49b1-b214-d142cb7e14e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:39.966868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c42571-1c77-49b1-b214-d142cb7e14e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:39.967995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c42571-1c77-49b1-b214-d142cb7e14e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:39.967995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c42571-1c77-49b1-b214-d142cb7e14e6 admin admin] PATH_INFO: `/v3/users/6190ea907d0544438eb3491462cfc49b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:39.969254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c42571-1c77-49b1-b214-d142cb7e14e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6190ea907d0544438eb3491462cfc49b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:39.972803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c42571-1c77-49b1-b214-d142cb7e14e6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:40.108312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152b337-78fc-4614-8abc-abd4aa905ed3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:40.115418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f43787-ad98-497e-a877-e10becf3d010 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:40.116097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f43787-ad98-497e-a877-e10becf3d010 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:40.116409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f43787-ad98-497e-a877-e10becf3d010 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:40.116682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f43787-ad98-497e-a877-e10becf3d010 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users/d35cb56da2f3466594468bd73096f687` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:40.118085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f43787-ad98-497e-a877-e10becf3d010 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d35cb56da2f3466594468bd73096f687)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:40.120069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f43787-ad98-497e-a877-e10becf3d010 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:40.193379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-98c42571-1c77-49b1-b214-d142cb7e14e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6190ea907d0544438eb3491462cfc49b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:40.194739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-98c42571-1c77-49b1-b214-d142cb7e14e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6190ea907d0544438eb3491462cfc49b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:40.283579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-12f43787-ad98-497e-a877-e10becf3d010 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35cb56da2f3466594468bd73096f687'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:40.290870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-98c42571-1c77-49b1-b214-d142cb7e14e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6190ea907d0544438eb3491462cfc49b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:40.292818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-98c42571-1c77-49b1-b214-d142cb7e14e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6190ea907d0544438eb3491462cfc49b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:40.319698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-98c42571-1c77-49b1-b214-d142cb7e14e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6190ea907d0544438eb3491462cfc49b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:40.346251 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2084/4134] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:39 2022] DELETE /identity/v3/users/6190ea907d0544438eb3491462cfc49b => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:40.352533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c42571-1c77-49b1-b214-d142cb7e14e6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:40.354607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-98c42571-1c77-49b1-b214-d142cb7e14e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:40.388315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:40.418428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-12f43787-ad98-497e-a877-e10becf3d010 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35cb56da2f3466594468bd73096f687'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:40.419205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-12f43787-ad98-497e-a877-e10becf3d010 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35cb56da2f3466594468bd73096f687'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:40.432093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-12f43787-ad98-497e-a877-e10becf3d010 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35cb56da2f3466594468bd73096f687'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:40.456066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-12f43787-ad98-497e-a877-e10becf3d010 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35cb56da2f3466594468bd73096f687'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:40.464102 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2051/4135] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:39 2022] DELETE /identity/v3/users/d35cb56da2f3466594468bd73096f687 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:40.466102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a24a6-7019-49cf-873f-614ac337eb6d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:40.466685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a24a6-7019-49cf-873f-614ac337eb6d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:40.467146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a24a6-7019-49cf-873f-614ac337eb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:40.474922 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-1c4a24a6-7019-49cf-873f-614ac337eb6d None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:40.474922 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:48:40.474922 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:48:40.474922 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:48:40.474922 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:48:40.474922 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:48:40.474922 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:48:40.474922 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:48:40.474922 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:48:40.474922 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:48:40.474922 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:48:40.474922 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:48:40.474922 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:48:40.475890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:48:40.475890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:48:40.475890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:48:40.475890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:48:40.475890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:48:40.475890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:48:40.475890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:48:40.475890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:48:40.475890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:48:40.475890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:48:40.475890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:48:40.475890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:48:40.475890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:48:40.475890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:40.475890 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:48:40.476793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c42571-1c77-49b1-b214-d142cb7e14e6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:40.479043 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2052/4136] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:48:40 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:48:40.480402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a24a6-7019-49cf-873f-614ac337eb6d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:40.493650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1c4a24a6-7019-49cf-873f-614ac337eb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:40.607233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe800d75-5367-47a6-9423-8981532f4008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:40.607973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe800d75-5367-47a6-9423-8981532f4008 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:40.608936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe800d75-5367-47a6-9423-8981532f4008 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:40.609283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe800d75-5367-47a6-9423-8981532f4008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:40.611456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fe800d75-5367-47a6-9423-8981532f4008 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:40.685572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe800d75-5367-47a6-9423-8981532f4008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:40.689441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe800d75-5367-47a6-9423-8981532f4008 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:40.692885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a24a6-7019-49cf-873f-614ac337eb6d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:40.701029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:40.703059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:40.703059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:40.703841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/projects/e386d37aa17e4b42b2818bd5ad1cd1aa` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:40.704653 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2085/4137] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:40.706367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe800d75-5367-47a6-9423-8981532f4008 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:40.709187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fe800d75-5367-47a6-9423-8981532f4008 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:40.722981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e386d37aa17e4b42b2818bd5ad1cd1aa)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:40.725963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:40.839762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe800d75-5367-47a6-9423-8981532f4008 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:40.855454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c31907-42d7-4351-9cbc-498708a0b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:40.855454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c31907-42d7-4351-9cbc-498708a0b388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:40.855454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c31907-42d7-4351-9cbc-498708a0b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:40.855454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c31907-42d7-4351-9cbc-498708a0b388 admin admin] PATH_INFO: `/v3/users/f0ecd1aa50274a32b74a4e8701621be4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:40.855747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c31907-42d7-4351-9cbc-498708a0b388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ecd1aa50274a32b74a4e8701621be4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:40.855830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c31907-42d7-4351-9cbc-498708a0b388 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:40.899084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e386d37aa17e4b42b2818bd5ad1cd1aa', 'request_id': 'req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:40.907232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e386d37aa17e4b42b2818bd5ad1cd1aa', 'request_id': 'req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:40.916677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e386d37aa17e4b42b2818bd5ad1cd1aa', 'request_id': 'req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:41.045652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] The token cache is being invalidate because project e386d37aa17e4b42b2818bd5ad1cd1aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:41.047800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:41.047800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:41.052722 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2053/4138] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:40 2022] DELETE /identity/v3/projects/e386d37aa17e4b42b2818bd5ad1cd1aa => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:41.053563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:41.055007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:41.129580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a909df5-f7e7-4436-bdbe-5fec7dbc4b37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:41.135052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab8ae7-0d3b-4cd6-b0d7-ebdb75fcb833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:41.135770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab8ae7-0d3b-4cd6-b0d7-ebdb75fcb833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:41.136118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab8ae7-0d3b-4cd6-b0d7-ebdb75fcb833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:41.136510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab8ae7-0d3b-4cd6-b0d7-ebdb75fcb833 admin admin] PATH_INFO: `/v3/users/3a86ccf7e9b64eb185ea6667d44b097d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:41.137774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab8ae7-0d3b-4cd6-b0d7-ebdb75fcb833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a86ccf7e9b64eb185ea6667d44b097d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:41.140662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab8ae7-0d3b-4cd6-b0d7-ebdb75fcb833 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:41.173484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-96c31907-42d7-4351-9cbc-498708a0b388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ecd1aa50274a32b74a4e8701621be4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:41.174603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-96c31907-42d7-4351-9cbc-498708a0b388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ecd1aa50274a32b74a4e8701621be4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:41.281704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-96c31907-42d7-4351-9cbc-498708a0b388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ecd1aa50274a32b74a4e8701621be4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:41.282506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-96c31907-42d7-4351-9cbc-498708a0b388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ecd1aa50274a32b74a4e8701621be4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:41.305482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-96c31907-42d7-4351-9cbc-498708a0b388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ecd1aa50274a32b74a4e8701621be4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:41.328829 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2086/4139] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:40 2022] DELETE /identity/v3/users/f0ecd1aa50274a32b74a4e8701621be4 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:41.330795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c31907-42d7-4351-9cbc-498708a0b388 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:41.332671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-96c31907-42d7-4351-9cbc-498708a0b388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:41.463809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c31907-42d7-4351-9cbc-498708a0b388 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:41.474642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2ad67-cb54-4103-886d-e6ac615b2c85 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:41.475434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2ad67-cb54-4103-886d-e6ac615b2c85 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:41.475810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2ad67-cb54-4103-886d-e6ac615b2c85 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:41.476143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2ad67-cb54-4103-886d-e6ac615b2c85 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users/50c5b073202d46838d1bd9fcbeac957f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:41.483830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2ad67-cb54-4103-886d-e6ac615b2c85 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:update_user(user_id=50c5b073202d46838d1bd9fcbeac957f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:41.485080 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-b1d2ad67-cb54-4103-886d-e6ac615b2c85 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:41.485080 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:48:41.485080 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:48:41.486558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2ad67-cb54-4103-886d-e6ac615b2c85 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:41.610212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2eab8ae7-0d3b-4cd6-b0d7-ebdb75fcb833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a86ccf7e9b64eb185ea6667d44b097d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:41.674271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2eab8ae7-0d3b-4cd6-b0d7-ebdb75fcb833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a86ccf7e9b64eb185ea6667d44b097d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:41.675146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2eab8ae7-0d3b-4cd6-b0d7-ebdb75fcb833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a86ccf7e9b64eb185ea6667d44b097d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:41.676488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b1d2ad67-cb54-4103-886d-e6ac615b2c85 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '50c5b073202d46838d1bd9fcbeac957f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:41.685835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2eab8ae7-0d3b-4cd6-b0d7-ebdb75fcb833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a86ccf7e9b64eb185ea6667d44b097d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:41.711306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2eab8ae7-0d3b-4cd6-b0d7-ebdb75fcb833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a86ccf7e9b64eb185ea6667d44b097d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:41.719733 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2054/4140] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:41 2022] DELETE /identity/v3/users/3a86ccf7e9b64eb185ea6667d44b097d => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:41.721632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7936e3-d186-456b-a896-f5352176e0b3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:41.722850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7936e3-d186-456b-a896-f5352176e0b3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:41.723363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7936e3-d186-456b-a896-f5352176e0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:41.752153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b1d2ad67-cb54-4103-886d-e6ac615b2c85 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invalidating the token cache because user 50c5b073202d46838d1bd9fcbeac957f was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:41.754537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b1d2ad67-cb54-4103-886d-e6ac615b2c85 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:41.760999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b1d2ad67-cb54-4103-886d-e6ac615b2c85 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:41.760999 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2087/4141] 10.222.0.76 () {60 vars in 1243 bytes} [Sat Aug 27 04:48:41 2022] PATCH /identity/v3/users/50c5b073202d46838d1bd9fcbeac957f => generated 297 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:41.762029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2ad67-cb54-4103-886d-e6ac615b2c85 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:41.763569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b1d2ad67-cb54-4103-886d-e6ac615b2c85 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:41.786563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5e7936e3-d186-456b-a896-f5352176e0b3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:41.787799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5e7936e3-d186-456b-a896-f5352176e0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:41.843767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:41.863456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2ad67-cb54-4103-886d-e6ac615b2c85 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:41.876971 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2055/4142] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:41.878567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672d969-f994-4cdc-8e0e-12fa1d765af8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:41.879056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672d969-f994-4cdc-8e0e-12fa1d765af8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:41.879556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672d969-f994-4cdc-8e0e-12fa1d765af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:41.906998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c672d969-f994-4cdc-8e0e-12fa1d765af8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:41.908535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c672d969-f994-4cdc-8e0e-12fa1d765af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:41.920461 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2056/4143] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:41.923606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1331f3-2c54-41db-9c85-cb22515806bf None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:41.924148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1331f3-2c54-41db-9c85-cb22515806bf None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:41.924902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1331f3-2c54-41db-9c85-cb22515806bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:41.942137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da02e8-1945-4746-ba5d-1209d3f8ca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:41.942814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da02e8-1945-4746-ba5d-1209d3f8ca29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:41.943217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da02e8-1945-4746-ba5d-1209d3f8ca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:41.943625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da02e8-1945-4746-ba5d-1209d3f8ca29 admin admin] PATH_INFO: `/v3/projects/a397128fb9fd47feb1a5a57b9497c0be` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:41.945191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da02e8-1945-4746-ba5d-1209d3f8ca29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a397128fb9fd47feb1a5a57b9497c0be)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:41.948707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da02e8-1945-4746-ba5d-1209d3f8ca29 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:41.979123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-dd1331f3-2c54-41db-9c85-cb22515806bf None None] MFA Rules not processed for user `50c5b073202d46838d1bd9fcbeac957f`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:41.981064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dd1331f3-2c54-41db-9c85-cb22515806bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:41.994862 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2057/4144] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:41 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:48:41.995200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1331f3-2c54-41db-9c85-cb22515806bf None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:41.997213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dd1331f3-2c54-41db-9c85-cb22515806bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:42.077414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1331f3-2c54-41db-9c85-cb22515806bf None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:42.090295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8da02e8-1945-4746-ba5d-1209d3f8ca29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a397128fb9fd47feb1a5a57b9497c0be', 'request_id': 'req-b8da02e8-1945-4746-ba5d-1209d3f8ca29'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:42.103155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8da02e8-1945-4746-ba5d-1209d3f8ca29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a397128fb9fd47feb1a5a57b9497c0be', 'request_id': 'req-b8da02e8-1945-4746-ba5d-1209d3f8ca29'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:42.146227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f3993-1dc9-4b08-b88e-78ae1504b5b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:42.146928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f3993-1dc9-4b08-b88e-78ae1504b5b9 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:42.147173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f3993-1dc9-4b08-b88e-78ae1504b5b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:42.147447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f3993-1dc9-4b08-b88e-78ae1504b5b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:42.218947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8da02e8-1945-4746-ba5d-1209d3f8ca29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a397128fb9fd47feb1a5a57b9497c0be', 'request_id': 'req-b8da02e8-1945-4746-ba5d-1209d3f8ca29'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:42.221653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:42.232242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8da02e8-1945-4746-ba5d-1209d3f8ca29 admin admin] The token cache is being invalidate because project a397128fb9fd47feb1a5a57b9497c0be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:42.232242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8da02e8-1945-4746-ba5d-1209d3f8ca29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:42.232955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8da02e8-1945-4746-ba5d-1209d3f8ca29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:42.234881 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2088/4145] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:41 2022] DELETE /identity/v3/projects/a397128fb9fd47feb1a5a57b9497c0be => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:42.235916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da02e8-1945-4746-ba5d-1209d3f8ca29 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:42.238498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b8da02e8-1945-4746-ba5d-1209d3f8ca29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:42.251913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f3993-1dc9-4b08-b88e-78ae1504b5b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:42.253696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f3993-1dc9-4b08-b88e-78ae1504b5b9 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:42.265847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da02e8-1945-4746-ba5d-1209d3f8ca29 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:42.270860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72ecec-f9b6-471c-8288-d89dae56b73e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:42.272230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ecec-f9b6-471c-8288-d89dae56b73e service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:42.272616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ecec-f9b6-471c-8288-d89dae56b73e service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:42.273060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ecec-f9b6-471c-8288-d89dae56b73e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:42.275077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6d72ecec-f9b6-471c-8288-d89dae56b73e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:42.279166 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2058/4146] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:42.283657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f3993-1dc9-4b08-b88e-78ae1504b5b9 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:42.286454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9b5f3993-1dc9-4b08-b88e-78ae1504b5b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:42.301465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72ecec-f9b6-471c-8288-d89dae56b73e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:42.303000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72ecec-f9b6-471c-8288-d89dae56b73e service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:42.316725 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2089/4147] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:42.317890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72ecec-f9b6-471c-8288-d89dae56b73e service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:42.320307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6d72ecec-f9b6-471c-8288-d89dae56b73e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:42.334738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72ecec-f9b6-471c-8288-d89dae56b73e service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:42.339846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13122ab1-3c8e-4711-bf0b-01b76cd91517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:42.340746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13122ab1-3c8e-4711-bf0b-01b76cd91517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:42.341026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13122ab1-3c8e-4711-bf0b-01b76cd91517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:42.341297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13122ab1-3c8e-4711-bf0b-01b76cd91517 admin admin] PATH_INFO: `/v3/users/b5107de485614d708f9225c9f96819bf` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:42.342795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13122ab1-3c8e-4711-bf0b-01b76cd91517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5107de485614d708f9225c9f96819bf)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:42.345026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13122ab1-3c8e-4711-bf0b-01b76cd91517 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:42.382865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f3993-1dc9-4b08-b88e-78ae1504b5b9 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:42.387672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec23c8-ca58-4ef3-b412-d1ff49161d77 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:42.388341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec23c8-ca58-4ef3-b412-d1ff49161d77 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:42.388684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec23c8-ca58-4ef3-b412-d1ff49161d77 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:42.388980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec23c8-ca58-4ef3-b412-d1ff49161d77 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users/50c5b073202d46838d1bd9fcbeac957f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:42.392592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec23c8-ca58-4ef3-b412-d1ff49161d77 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:update_user(user_id=50c5b073202d46838d1bd9fcbeac957f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:42.392592 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-a1ec23c8-ca58-4ef3-b412-d1ff49161d77 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:42.392592 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:48:42.392592 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:48:42.393746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec23c8-ca58-4ef3-b412-d1ff49161d77 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:42.531724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1ec23c8-ca58-4ef3-b412-d1ff49161d77 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '50c5b073202d46838d1bd9fcbeac957f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:42.625332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-13122ab1-3c8e-4711-bf0b-01b76cd91517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5107de485614d708f9225c9f96819bf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:42.626458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-13122ab1-3c8e-4711-bf0b-01b76cd91517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5107de485614d708f9225c9f96819bf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:42.664191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1ec23c8-ca58-4ef3-b412-d1ff49161d77 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invalidating the token cache because user 50c5b073202d46838d1bd9fcbeac957f was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:42.664493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1ec23c8-ca58-4ef3-b412-d1ff49161d77 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:42.665219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1ec23c8-ca58-4ef3-b412-d1ff49161d77 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:42.667788 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2059/4148] 10.222.0.76 () {60 vars in 1243 bytes} [Sat Aug 27 04:48:42 2022] PATCH /identity/v3/users/50c5b073202d46838d1bd9fcbeac957f => generated 297 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:42.673519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec23c8-ca58-4ef3-b412-d1ff49161d77 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:42.674886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a1ec23c8-ca58-4ef3-b412-d1ff49161d77 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:42.714952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec23c8-ca58-4ef3-b412-d1ff49161d77 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:42.723026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d43e32-a272-4573-b115-fddfb8e0af1b tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:42.723825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d43e32-a272-4573-b115-fddfb8e0af1b tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:42.724227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d43e32-a272-4573-b115-fddfb8e0af1b tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:42.724652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d43e32-a272-4573-b115-fddfb8e0af1b tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users/50c5b073202d46838d1bd9fcbeac957f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:42.755308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d43e32-a272-4573-b115-fddfb8e0af1b tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:update_user(user_id=50c5b073202d46838d1bd9fcbeac957f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:42.757699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d43e32-a272-4573-b115-fddfb8e0af1b tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:42.788507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-13122ab1-3c8e-4711-bf0b-01b76cd91517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5107de485614d708f9225c9f96819bf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:42.789337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-13122ab1-3c8e-4711-bf0b-01b76cd91517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5107de485614d708f9225c9f96819bf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:42.811490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-13122ab1-3c8e-4711-bf0b-01b76cd91517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5107de485614d708f9225c9f96819bf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:42.833757 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2090/4149] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:42 2022] DELETE /identity/v3/users/b5107de485614d708f9225c9f96819bf => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:42.944734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7d43e32-a272-4573-b115-fddfb8e0af1b tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '50c5b073202d46838d1bd9fcbeac957f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:43.051955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7d43e32-a272-4573-b115-fddfb8e0af1b tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invalidating the token cache because user 50c5b073202d46838d1bd9fcbeac957f was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:43.052288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7d43e32-a272-4573-b115-fddfb8e0af1b tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:43.053029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7d43e32-a272-4573-b115-fddfb8e0af1b tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:43.061349 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2060/4150] 10.222.0.76 () {60 vars in 1243 bytes} [Sat Aug 27 04:48:42 2022] PATCH /identity/v3/users/50c5b073202d46838d1bd9fcbeac957f => generated 297 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:43.062200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1bb7f-f979-426e-9976-0cbc30c00495 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:43.062200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1bb7f-f979-426e-9976-0cbc30c00495 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:43.062200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1bb7f-f979-426e-9976-0cbc30c00495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:43.118388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-76c1bb7f-f979-426e-9976-0cbc30c00495 None None] MFA Rules not processed for user `50c5b073202d46838d1bd9fcbeac957f`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:43.119841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-76c1bb7f-f979-426e-9976-0cbc30c00495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:43.123472 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2091/4151] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:43 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:48:43.127792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d43e32-a272-4573-b115-fddfb8e0af1b tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:43.129270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a7d43e32-a272-4573-b115-fddfb8e0af1b tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:43.148613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d43e32-a272-4573-b115-fddfb8e0af1b tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:43.258167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f87c65-0b5b-491c-88fc-a238227cb4db tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:43.258547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f87c65-0b5b-491c-88fc-a238227cb4db tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:43.258834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f87c65-0b5b-491c-88fc-a238227cb4db tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:43.259116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f87c65-0b5b-491c-88fc-a238227cb4db tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users/50c5b073202d46838d1bd9fcbeac957f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:43.260522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f87c65-0b5b-491c-88fc-a238227cb4db tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:update_user(user_id=50c5b073202d46838d1bd9fcbeac957f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:43.263214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f87c65-0b5b-491c-88fc-a238227cb4db tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:43.418493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-38f87c65-0b5b-491c-88fc-a238227cb4db tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '50c5b073202d46838d1bd9fcbeac957f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:43.549377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1bb7f-f979-426e-9976-0cbc30c00495 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:43.551509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-76c1bb7f-f979-426e-9976-0cbc30c00495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:43.602111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-38f87c65-0b5b-491c-88fc-a238227cb4db tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invalidating the token cache because user 50c5b073202d46838d1bd9fcbeac957f was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:43.602344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-38f87c65-0b5b-491c-88fc-a238227cb4db tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:43.603490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-38f87c65-0b5b-491c-88fc-a238227cb4db tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:43.605970 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2061/4152] 10.222.0.76 () {60 vars in 1243 bytes} [Sat Aug 27 04:48:43 2022] PATCH /identity/v3/users/50c5b073202d46838d1bd9fcbeac957f => generated 297 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:43.614212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f87c65-0b5b-491c-88fc-a238227cb4db tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:43.617668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-38f87c65-0b5b-491c-88fc-a238227cb4db tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:43.634875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f87c65-0b5b-491c-88fc-a238227cb4db tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:43.648379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a9bd4-3603-432f-92fa-45ffe396a2ce tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:43.649503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a9bd4-3603-432f-92fa-45ffe396a2ce tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:43.650793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a9bd4-3603-432f-92fa-45ffe396a2ce tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:43.651298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a9bd4-3603-432f-92fa-45ffe396a2ce tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:43.653309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a9bd4-3603-432f-92fa-45ffe396a2ce tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:43.656345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a9bd4-3603-432f-92fa-45ffe396a2ce tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:43.717853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1bb7f-f979-426e-9976-0cbc30c00495 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:43.729180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6f53f-eeea-4d46-aeae-8c86d823bd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:43.729588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6f53f-eeea-4d46-aeae-8c86d823bd4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:43.730081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6f53f-eeea-4d46-aeae-8c86d823bd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:43.730599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6f53f-eeea-4d46-aeae-8c86d823bd4b admin admin] PATH_INFO: `/v3/users/ef21c25463c94888b1d71bb5d9fa08f6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:43.732091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6f53f-eeea-4d46-aeae-8c86d823bd4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef21c25463c94888b1d71bb5d9fa08f6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:43.736884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6f53f-eeea-4d46-aeae-8c86d823bd4b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:43.790157 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2062/4153] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:48:43 2022] POST /identity/v3/users => generated 265 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:43.791673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a9bd4-3603-432f-92fa-45ffe396a2ce tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:43.793560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-329a9bd4-3603-432f-92fa-45ffe396a2ce tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:43.817731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a9bd4-3603-432f-92fa-45ffe396a2ce tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:43.831758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:43.831758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:43.831758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:43.831758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c admin admin] PATH_INFO: `/v3/projects/e1ea00bfb0fc49478c17c5a74fb507a3` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:43.833651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ea00bfb0fc49478c17c5a74fb507a3)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:43.835985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:44.028215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-afc6f53f-eeea-4d46-aeae-8c86d823bd4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef21c25463c94888b1d71bb5d9fa08f6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:44.028935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-afc6f53f-eeea-4d46-aeae-8c86d823bd4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef21c25463c94888b1d71bb5d9fa08f6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:44.031771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ea00bfb0fc49478c17c5a74fb507a3', 'request_id': 'req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:44.038146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ea00bfb0fc49478c17c5a74fb507a3', 'request_id': 'req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:44.045449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ea00bfb0fc49478c17c5a74fb507a3', 'request_id': 'req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:44.195063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-afc6f53f-eeea-4d46-aeae-8c86d823bd4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef21c25463c94888b1d71bb5d9fa08f6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:44.195941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-afc6f53f-eeea-4d46-aeae-8c86d823bd4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef21c25463c94888b1d71bb5d9fa08f6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:44.210921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-afc6f53f-eeea-4d46-aeae-8c86d823bd4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef21c25463c94888b1d71bb5d9fa08f6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:44.235266 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2092/4154] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:43 2022] DELETE /identity/v3/users/ef21c25463c94888b1d71bb5d9fa08f6 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:44.237032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6f53f-eeea-4d46-aeae-8c86d823bd4b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:44.239832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-afc6f53f-eeea-4d46-aeae-8c86d823bd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:44.330316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c admin admin] The token cache is being invalidate because project e1ea00bfb0fc49478c17c5a74fb507a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:44.331057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:44.332000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:44.335409 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2063/4155] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:43 2022] DELETE /identity/v3/projects/e1ea00bfb0fc49478c17c5a74fb507a3 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:44.337694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:44.340385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:44.360719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6f53f-eeea-4d46-aeae-8c86d823bd4b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:44.376262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba789d7-4fcf-45c9-8672-91cdfe69355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:44.377031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba789d7-4fcf-45c9-8672-91cdfe69355c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:44.377382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba789d7-4fcf-45c9-8672-91cdfe69355c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:44.377857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba789d7-4fcf-45c9-8672-91cdfe69355c admin admin] PATH_INFO: `/v3/projects/84ff348afb6a475794da787bfd285f42` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:44.379169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba789d7-4fcf-45c9-8672-91cdfe69355c admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ff348afb6a475794da787bfd285f42)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:44.381425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba789d7-4fcf-45c9-8672-91cdfe69355c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:44.476286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:44.520224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f54bd-7c83-4764-9d0f-3fa5d5757a4c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:44.604720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ba789d7-4fcf-45c9-8672-91cdfe69355c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ff348afb6a475794da787bfd285f42', 'request_id': 'req-3ba789d7-4fcf-45c9-8672-91cdfe69355c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:44.620009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ba789d7-4fcf-45c9-8672-91cdfe69355c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ff348afb6a475794da787bfd285f42', 'request_id': 'req-3ba789d7-4fcf-45c9-8672-91cdfe69355c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:44.654569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aea53c-4386-4da1-9eee-f9cbb9d26545 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:44.655904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aea53c-4386-4da1-9eee-f9cbb9d26545 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:44.656456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aea53c-4386-4da1-9eee-f9cbb9d26545 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:44.657044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aea53c-4386-4da1-9eee-f9cbb9d26545 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users/0571d78ff45344698f6b911eb371a02d/password` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:44.732772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ba789d7-4fcf-45c9-8672-91cdfe69355c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ff348afb6a475794da787bfd285f42', 'request_id': 'req-3ba789d7-4fcf-45c9-8672-91cdfe69355c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:44.749917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ba789d7-4fcf-45c9-8672-91cdfe69355c admin admin] The token cache is being invalidate because project 84ff348afb6a475794da787bfd285f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:44.750339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ba789d7-4fcf-45c9-8672-91cdfe69355c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:44.751114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ba789d7-4fcf-45c9-8672-91cdfe69355c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:44.753809 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2093/4156] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:44 2022] DELETE /identity/v3/projects/84ff348afb6a475794da787bfd285f42 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:44.756874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d06b3d-dac6-4e5d-9b18-c0b22815d87a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:44.756874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d06b3d-dac6-4e5d-9b18-c0b22815d87a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:44.756874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d06b3d-dac6-4e5d-9b18-c0b22815d87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:44.846814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b5aea53c-4386-4da1-9eee-f9cbb9d26545 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0571d78ff45344698f6b911eb371a02d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:44.852297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-65d06b3d-dac6-4e5d-9b18-c0b22815d87a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:44.853821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-65d06b3d-dac6-4e5d-9b18-c0b22815d87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:44.973283 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2064/4157] 10.222.0.76 () {60 vars in 1269 bytes} [Sat Aug 27 04:48:44 2022] POST /identity/v3/users/0571d78ff45344698f6b911eb371a02d/password => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:44.975144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8053a4-e5b4-4cee-b30f-564682376697 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:44.975911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8053a4-e5b4-4cee-b30f-564682376697 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:44.976654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8053a4-e5b4-4cee-b30f-564682376697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:44.988046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:45.023505 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2094/4158] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:45.024818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d06b3d-dac6-4e5d-9b18-c0b22815d87a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:45.049007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-65d06b3d-dac6-4e5d-9b18-c0b22815d87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:45.049308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8a8053a4-e5b4-4cee-b30f-564682376697 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:45.049308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8a8053a4-e5b4-4cee-b30f-564682376697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:45.063338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d06b3d-dac6-4e5d-9b18-c0b22815d87a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:45.066673 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2065/4159] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:45.068625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c98d8-6dae-4b85-946e-8d522a6c6988 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:45.069509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c98d8-6dae-4b85-946e-8d522a6c6988 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:45.070575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c98d8-6dae-4b85-946e-8d522a6c6988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:45.079810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1405-9834-4aa4-a22d-9d865f2685e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:45.081272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1405-9834-4aa4-a22d-9d865f2685e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:45.082275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1405-9834-4aa4-a22d-9d865f2685e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:45.082958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1405-9834-4aa4-a22d-9d865f2685e5 admin admin] PATH_INFO: `/v3/projects/51586c678a2d41af9cc7212eeb825e00` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:45.084419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d1405-9834-4aa4-a22d-9d865f2685e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51586c678a2d41af9cc7212eeb825e00)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:45.086853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d1405-9834-4aa4-a22d-9d865f2685e5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:45.096476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-da4c98d8-6dae-4b85-946e-8d522a6c6988 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:45.098727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-da4c98d8-6dae-4b85-946e-8d522a6c6988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:45.112375 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2066/4160] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:45.117316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c98d8-6dae-4b85-946e-8d522a6c6988 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:45.117316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-da4c98d8-6dae-4b85-946e-8d522a6c6988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:45.235202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-080d1405-9834-4aa4-a22d-9d865f2685e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51586c678a2d41af9cc7212eeb825e00', 'request_id': 'req-080d1405-9834-4aa4-a22d-9d865f2685e5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:45.241465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:45.253389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-080d1405-9834-4aa4-a22d-9d865f2685e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51586c678a2d41af9cc7212eeb825e00', 'request_id': 'req-080d1405-9834-4aa4-a22d-9d865f2685e5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:45.276876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c98d8-6dae-4b85-946e-8d522a6c6988 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:45.338449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-080d1405-9834-4aa4-a22d-9d865f2685e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51586c678a2d41af9cc7212eeb825e00', 'request_id': 'req-080d1405-9834-4aa4-a22d-9d865f2685e5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:45.392144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-080d1405-9834-4aa4-a22d-9d865f2685e5 admin admin] The token cache is being invalidate because project 51586c678a2d41af9cc7212eeb825e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:45.395317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-080d1405-9834-4aa4-a22d-9d865f2685e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:45.396778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-080d1405-9834-4aa4-a22d-9d865f2685e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:45.397003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be57188-168c-49fe-8ea4-b61b9f916c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:45.397624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be57188-168c-49fe-8ea4-b61b9f916c2c service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:45.397969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be57188-168c-49fe-8ea4-b61b9f916c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:45.398172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be57188-168c-49fe-8ea4-b61b9f916c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:45.400053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0be57188-168c-49fe-8ea4-b61b9f916c2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:45.404522 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2095/4161] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:45 2022] DELETE /identity/v3/projects/51586c678a2d41af9cc7212eeb825e00 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:45.410201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7750fa7-47ef-4bbe-98a0-eb887ad30f5e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:45.410201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7750fa7-47ef-4bbe-98a0-eb887ad30f5e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:45.410201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7750fa7-47ef-4bbe-98a0-eb887ad30f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:45.494383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c7750fa7-47ef-4bbe-98a0-eb887ad30f5e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:45.499804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c7750fa7-47ef-4bbe-98a0-eb887ad30f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:45.579473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be57188-168c-49fe-8ea4-b61b9f916c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:45.582375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be57188-168c-49fe-8ea4-b61b9f916c2c service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:45.615593 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2096/4162] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:45.622464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7e934-64c2-4209-9272-8b43bb189690 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:45.622761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7e934-64c2-4209-9272-8b43bb189690 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:45.623038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7e934-64c2-4209-9272-8b43bb189690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:45.630341 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2067/4163] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:45.639849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e93b29-1fc8-480d-a145-884b8adf3a66 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:45.641408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e93b29-1fc8-480d-a145-884b8adf3a66 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:45.642879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e93b29-1fc8-480d-a145-884b8adf3a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:45.656654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bab7e934-64c2-4209-9272-8b43bb189690 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:45.659689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bab7e934-64c2-4209-9272-8b43bb189690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:45.688417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-68e93b29-1fc8-480d-a145-884b8adf3a66 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:45.691075 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2097/4164] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:45.692056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-68e93b29-1fc8-480d-a145-884b8adf3a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:45.700134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7e934-64c2-4209-9272-8b43bb189690 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:45.712476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7e934-64c2-4209-9272-8b43bb189690 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:45.714977 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2068/4165] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:45.715732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e93b29-1fc8-480d-a145-884b8adf3a66 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:45.729448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede72a5-e9a1-49e5-b906-7b8e30d44d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:45.740224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede72a5-e9a1-49e5-b906-7b8e30d44d0c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:45.740224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede72a5-e9a1-49e5-b906-7b8e30d44d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:45.740224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede72a5-e9a1-49e5-b906-7b8e30d44d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:45.740224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede72a5-e9a1-49e5-b906-7b8e30d44d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:48:45.740224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede72a5-e9a1-49e5-b906-7b8e30d44d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:45.740224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede72a5-e9a1-49e5-b906-7b8e30d44d0c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:45.741014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e93b29-1fc8-480d-a145-884b8adf3a66 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:45.762464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563ffb9-5f4c-43b9-a5cb-7be1d53ed546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:45.762464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563ffb9-5f4c-43b9-a5cb-7be1d53ed546 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:45.762831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563ffb9-5f4c-43b9-a5cb-7be1d53ed546 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:45.763196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563ffb9-5f4c-43b9-a5cb-7be1d53ed546 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:45.766270 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2098/4166] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:45.768790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f291b-47de-4040-8c58-ef33f9aa33cb None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:45.769308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f291b-47de-4040-8c58-ef33f9aa33cb None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:45.769932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f291b-47de-4040-8c58-ef33f9aa33cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:45.770664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563ffb9-5f4c-43b9-a5cb-7be1d53ed546 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:48:45.772306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563ffb9-5f4c-43b9-a5cb-7be1d53ed546 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:45.783335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563ffb9-5f4c-43b9-a5cb-7be1d53ed546 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:45.814110 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2069/4167] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:45.815222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563ffb9-5f4c-43b9-a5cb-7be1d53ed546 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:45.821621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1d9f291b-47de-4040-8c58-ef33f9aa33cb None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:45.826293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1d9f291b-47de-4040-8c58-ef33f9aa33cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:45.842697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563ffb9-5f4c-43b9-a5cb-7be1d53ed546 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:45.849049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d1ef1-fe87-42ca-9bf7-74e85b0e9dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:45.852667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d1ef1-fe87-42ca-9bf7-74e85b0e9dfd admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:45.852667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d1ef1-fe87-42ca-9bf7-74e85b0e9dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:45.852667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d1ef1-fe87-42ca-9bf7-74e85b0e9dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:45.852667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d1ef1-fe87-42ca-9bf7-74e85b0e9dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:45.853080 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2099/4168] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:45.853175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d1ef1-fe87-42ca-9bf7-74e85b0e9dfd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:45.853662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f291b-47de-4040-8c58-ef33f9aa33cb None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:45.874635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f291b-47de-4040-8c58-ef33f9aa33cb None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:45.887730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b575bdd-57c2-4878-bd7f-03179c60e6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:45.889998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b575bdd-57c2-4878-bd7f-03179c60e6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:45.890630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b575bdd-57c2-4878-bd7f-03179c60e6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:45.891081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b575bdd-57c2-4878-bd7f-03179c60e6f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:45.892520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b575bdd-57c2-4878-bd7f-03179c60e6f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:45.895216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b575bdd-57c2-4878-bd7f-03179c60e6f3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:46.041109 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2070/4169] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:45 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:46.042024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d1ef1-fe87-42ca-9bf7-74e85b0e9dfd admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:46.132013 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2100/4170] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:45 2022] POST /identity/v3/projects => generated 391 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:46.132013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaad8f-7481-48b4-9510-af56b80ba927 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:46.132013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaad8f-7481-48b4-9510-af56b80ba927 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:46.132013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaad8f-7481-48b4-9510-af56b80ba927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:46.138422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d1ef1-fe87-42ca-9bf7-74e85b0e9dfd admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:46.152872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6cfaad8f-7481-48b4-9510-af56b80ba927 None None] MFA Rules not processed for user `0571d78ff45344698f6b911eb371a02d`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:46.154073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6cfaad8f-7481-48b4-9510-af56b80ba927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:46.158113 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2101/4171] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:46 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:48:46.162020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaad8f-7481-48b4-9510-af56b80ba927 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:46.235712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22c0c9-eb94-4ede-a21c-7803dd258184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:46.236678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22c0c9-eb94-4ede-a21c-7803dd258184 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:46.237056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22c0c9-eb94-4ede-a21c-7803dd258184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:46.237406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22c0c9-eb94-4ede-a21c-7803dd258184 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:46.241079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22c0c9-eb94-4ede-a21c-7803dd258184 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:48:46.241079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22c0c9-eb94-4ede-a21c-7803dd258184 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:46.243332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22c0c9-eb94-4ede-a21c-7803dd258184 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:46.250217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaad8f-7481-48b4-9510-af56b80ba927 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:46.256709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919bdb6-8817-4413-abc2-471c443c3f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:46.257525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919bdb6-8817-4413-abc2-471c443c3f19 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:46.257799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919bdb6-8817-4413-abc2-471c443c3f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:46.258069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919bdb6-8817-4413-abc2-471c443c3f19 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:46.258852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919bdb6-8817-4413-abc2-471c443c3f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:46.260991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919bdb6-8817-4413-abc2-471c443c3f19 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:46.264363 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2071/4172] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:46.265388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22c0c9-eb94-4ede-a21c-7803dd258184 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:46.285211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22c0c9-eb94-4ede-a21c-7803dd258184 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:46.296564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22143536-df1d-4bb3-b199-2eaddd1be4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:46.297665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22143536-df1d-4bb3-b199-2eaddd1be4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:46.298049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22143536-df1d-4bb3-b199-2eaddd1be4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:46.298510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22143536-df1d-4bb3-b199-2eaddd1be4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:46.299667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22143536-df1d-4bb3-b199-2eaddd1be4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:46.304024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22143536-df1d-4bb3-b199-2eaddd1be4c8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:46.401484 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2102/4173] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:46 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:46.401484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919bdb6-8817-4413-abc2-471c443c3f19 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:46.403522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4919bdb6-8817-4413-abc2-471c443c3f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:46.438681 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2072/4174] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:46 2022] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:46.440271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22143536-df1d-4bb3-b199-2eaddd1be4c8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:46.442627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-22143536-df1d-4bb3-b199-2eaddd1be4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:46.457767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22143536-df1d-4bb3-b199-2eaddd1be4c8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:46.463864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:46.464805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:46.465096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:46.465434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255 admin admin] PATH_INFO: `/v3/projects/7d20a6d2a51841e681885a6d914631c3` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:46.466782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d20a6d2a51841e681885a6d914631c3)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:46.469045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:46.535270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919bdb6-8817-4413-abc2-471c443c3f19 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:46.541700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56975379-1e50-436b-97d7-c657448cf2ad tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:46.542838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56975379-1e50-436b-97d7-c657448cf2ad tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:46.543322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56975379-1e50-436b-97d7-c657448cf2ad tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:46.543847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56975379-1e50-436b-97d7-c657448cf2ad tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:46.574227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56975379-1e50-436b-97d7-c657448cf2ad tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:46.578217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56975379-1e50-436b-97d7-c657448cf2ad tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:46.587026 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2103/4175] 10.222.0.76 () {56 vars in 1263 bytes} [Sat Aug 27 04:48:46 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:46.588450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56975379-1e50-436b-97d7-c657448cf2ad tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:46.620355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56975379-1e50-436b-97d7-c657448cf2ad tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:46.633033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d20a6d2a51841e681885a6d914631c3', 'request_id': 'req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:46.648808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d20a6d2a51841e681885a6d914631c3', 'request_id': 'req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:46.657873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d20a6d2a51841e681885a6d914631c3', 'request_id': 'req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:46.705621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11732bba-31e2-4e63-ba21-c47c7b1d3dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:46.706228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11732bba-31e2-4e63-ba21-c47c7b1d3dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:46.706506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11732bba-31e2-4e63-ba21-c47c7b1d3dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:46.706773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11732bba-31e2-4e63-ba21-c47c7b1d3dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:46.707407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11732bba-31e2-4e63-ba21-c47c7b1d3dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:46.709357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11732bba-31e2-4e63-ba21-c47c7b1d3dd4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:46.761032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255 admin admin] The token cache is being invalidate because project 7d20a6d2a51841e681885a6d914631c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:46.764269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:46.765159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:46.766552 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2073/4176] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:46 2022] DELETE /identity/v3/projects/7d20a6d2a51841e681885a6d914631c3 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:46.774207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:46.775812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:46.804241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf1e1d-e0e1-40c7-8faa-4a29cc265255 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:46.810156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2adce6-f805-4991-9793-e9c08fb51f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:46.814953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2adce6-f805-4991-9793-e9c08fb51f17 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:46.814953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2adce6-f805-4991-9793-e9c08fb51f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:46.814953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2adce6-f805-4991-9793-e9c08fb51f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:46.814953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2adce6-f805-4991-9793-e9c08fb51f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:46.814953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2adce6-f805-4991-9793-e9c08fb51f17 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:46.834883 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2074/4177] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:46.835894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2adce6-f805-4991-9793-e9c08fb51f17 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:46.837997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-be2adce6-f805-4991-9793-e9c08fb51f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:46.854829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2adce6-f805-4991-9793-e9c08fb51f17 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:46.861990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a8206-f8b2-48fb-bab3-c27b795c6eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:46.866463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a8206-f8b2-48fb-bab3-c27b795c6eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:46.866463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a8206-f8b2-48fb-bab3-c27b795c6eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:46.866463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a8206-f8b2-48fb-bab3-c27b795c6eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:46.866463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a8206-f8b2-48fb-bab3-c27b795c6eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:46.866463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a8206-f8b2-48fb-bab3-c27b795c6eb3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:46.874953 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2104/4178] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:46 2022] POST /identity/v3/projects => generated 377 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:46.876796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11732bba-31e2-4e63-ba21-c47c7b1d3dd4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:46.882352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-11732bba-31e2-4e63-ba21-c47c7b1d3dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:46.886460 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2075/4179] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:46.887630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a8206-f8b2-48fb-bab3-c27b795c6eb3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:46.890111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8c6a8206-f8b2-48fb-bab3-c27b795c6eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:46.911826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a8206-f8b2-48fb-bab3-c27b795c6eb3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:47.003079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11732bba-31e2-4e63-ba21-c47c7b1d3dd4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:47.012603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafce27d-ad37-4ddd-8d8f-aa3ba9fc25bd tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:47.013260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafce27d-ad37-4ddd-8d8f-aa3ba9fc25bd tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:47.013544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafce27d-ad37-4ddd-8d8f-aa3ba9fc25bd tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:47.014738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafce27d-ad37-4ddd-8d8f-aa3ba9fc25bd tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users/0571d78ff45344698f6b911eb371a02d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:47.016382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafce27d-ad37-4ddd-8d8f-aa3ba9fc25bd tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0571d78ff45344698f6b911eb371a02d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:47.019018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafce27d-ad37-4ddd-8d8f-aa3ba9fc25bd tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:47.042025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece74f1-3921-43b9-82b6-8f8e85ded680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:47.042956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece74f1-3921-43b9-82b6-8f8e85ded680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:47.043420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece74f1-3921-43b9-82b6-8f8e85ded680 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:47.043848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece74f1-3921-43b9-82b6-8f8e85ded680 admin admin] PATH_INFO: `/v3/users/a7b1394368764aaa8e3e9124f4986d73` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:47.059236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece74f1-3921-43b9-82b6-8f8e85ded680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7b1394368764aaa8e3e9124f4986d73)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:47.062412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece74f1-3921-43b9-82b6-8f8e85ded680 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:47.190322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cafce27d-ad37-4ddd-8d8f-aa3ba9fc25bd tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0571d78ff45344698f6b911eb371a02d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:47.191364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cafce27d-ad37-4ddd-8d8f-aa3ba9fc25bd tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0571d78ff45344698f6b911eb371a02d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:47.299505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:47.369892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cafce27d-ad37-4ddd-8d8f-aa3ba9fc25bd tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0571d78ff45344698f6b911eb371a02d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:47.371097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cafce27d-ad37-4ddd-8d8f-aa3ba9fc25bd tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0571d78ff45344698f6b911eb371a02d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:47.392507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3ece74f1-3921-43b9-82b6-8f8e85ded680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7b1394368764aaa8e3e9124f4986d73'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:47.401188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cafce27d-ad37-4ddd-8d8f-aa3ba9fc25bd tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0571d78ff45344698f6b911eb371a02d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:47.422346 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2105/4180] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:46 2022] DELETE /identity/v3/users/0571d78ff45344698f6b911eb371a02d => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:47.423374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafce27d-ad37-4ddd-8d8f-aa3ba9fc25bd tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:47.424790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cafce27d-ad37-4ddd-8d8f-aa3ba9fc25bd tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:47.510922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3ece74f1-3921-43b9-82b6-8f8e85ded680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7b1394368764aaa8e3e9124f4986d73'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:47.511715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3ece74f1-3921-43b9-82b6-8f8e85ded680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7b1394368764aaa8e3e9124f4986d73'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:47.530315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3ece74f1-3921-43b9-82b6-8f8e85ded680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7b1394368764aaa8e3e9124f4986d73'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:47.567555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3ece74f1-3921-43b9-82b6-8f8e85ded680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7b1394368764aaa8e3e9124f4986d73'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:47.582570 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2076/4181] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:46 2022] DELETE /identity/v3/users/a7b1394368764aaa8e3e9124f4986d73 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:47.584354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece74f1-3921-43b9-82b6-8f8e85ded680 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:47.586955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3ece74f1-3921-43b9-82b6-8f8e85ded680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:47.609489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafce27d-ad37-4ddd-8d8f-aa3ba9fc25bd tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:47.723173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece74f1-3921-43b9-82b6-8f8e85ded680 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:47.738192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfec8c3-941b-4fc7-854c-11a5236e5a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:47.739078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfec8c3-941b-4fc7-854c-11a5236e5a21 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:47.739526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfec8c3-941b-4fc7-854c-11a5236e5a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:47.739947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfec8c3-941b-4fc7-854c-11a5236e5a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:47.740782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfec8c3-941b-4fc7-854c-11a5236e5a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:47.742310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e739d4c-0abe-4f3e-8990-802fd3d106ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:47.743190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739d4c-0abe-4f3e-8990-802fd3d106ac admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:47.743190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739d4c-0abe-4f3e-8990-802fd3d106ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:47.744308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739d4c-0abe-4f3e-8990-802fd3d106ac admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:47.744308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e739d4c-0abe-4f3e-8990-802fd3d106ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:47.746079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e739d4c-0abe-4f3e-8990-802fd3d106ac admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:47.755814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfec8c3-941b-4fc7-854c-11a5236e5a21 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:47.771123 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2106/4182] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:47.772316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfec8c3-941b-4fc7-854c-11a5236e5a21 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:47.776152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4bfec8c3-941b-4fc7-854c-11a5236e5a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:47.777911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:47.800175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfec8c3-941b-4fc7-854c-11a5236e5a21 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:47.813038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c4c69-4634-4e2e-893f-932a26de9981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:47.814408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c4c69-4634-4e2e-893f-932a26de9981 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:47.814699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c4c69-4634-4e2e-893f-932a26de9981 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:47.814974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c4c69-4634-4e2e-893f-932a26de9981 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:47.815622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c4c69-4634-4e2e-893f-932a26de9981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:47.818003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c4c69-4634-4e2e-893f-932a26de9981 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:47.831373 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2107/4183] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:47.839843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c4c69-4634-4e2e-893f-932a26de9981 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:47.839843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-499c4c69-4634-4e2e-893f-932a26de9981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:47.878095 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2077/4184] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:47 2022] POST /identity/v3/users => generated 289 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:47.882845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e739d4c-0abe-4f3e-8990-802fd3d106ac admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:47.887114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8e739d4c-0abe-4f3e-8990-802fd3d106ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:47.902279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e739d4c-0abe-4f3e-8990-802fd3d106ac admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:47.909252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50eb2b-9bf9-4a40-b020-730d6d9d96eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:47.910135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50eb2b-9bf9-4a40-b020-730d6d9d96eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:47.912876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50eb2b-9bf9-4a40-b020-730d6d9d96eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:47.912876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50eb2b-9bf9-4a40-b020-730d6d9d96eb admin admin] PATH_INFO: `/v3/projects/e19f9f3d8e434168a66baaa28ad2c791/users/c6607c92756d413c8adeef9947ede94d/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:47.931097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50eb2b-9bf9-4a40-b020-730d6d9d96eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19f9f3d8e434168a66baaa28ad2c791, user_id=c6607c92756d413c8adeef9947ede94d, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:47.934288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50eb2b-9bf9-4a40-b020-730d6d9d96eb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:48.008388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c4c69-4634-4e2e-893f-932a26de9981 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:48.019356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab88dde-2467-4365-876f-f6b01a551e37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:48.020819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab88dde-2467-4365-876f-f6b01a551e37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:48.021299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab88dde-2467-4365-876f-f6b01a551e37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:48.021871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab88dde-2467-4365-876f-f6b01a551e37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:48.022757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab88dde-2467-4365-876f-f6b01a551e37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:48.026921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab88dde-2467-4365-876f-f6b01a551e37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:48.038993 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2078/4185] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:47 2022] PUT /identity/v3/projects/e19f9f3d8e434168a66baaa28ad2c791/users/c6607c92756d413c8adeef9947ede94d/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:48.040065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50eb2b-9bf9-4a40-b020-730d6d9d96eb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:48.174674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50eb2b-9bf9-4a40-b020-730d6d9d96eb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:48.181288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e1d65-3272-49b9-ac96-0dc6babf86b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:48.182764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e1d65-3272-49b9-ac96-0dc6babf86b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:48.182764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e1d65-3272-49b9-ac96-0dc6babf86b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:48.182764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e1d65-3272-49b9-ac96-0dc6babf86b2 admin admin] PATH_INFO: `/v3/projects/61e3eba2e9aa46d8a041f0067f171ac0/users/a2baa0b58754432e9ca387dee69a909e/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:48.188516 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2108/4186] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:47 2022] POST /identity/v3/users => generated 367 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:48.190115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab88dde-2467-4365-876f-f6b01a551e37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:48.200348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e1d65-3272-49b9-ac96-0dc6babf86b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e3eba2e9aa46d8a041f0067f171ac0, user_id=a2baa0b58754432e9ca387dee69a909e, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:48.204035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab88dde-2467-4365-876f-f6b01a551e37 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:48.205150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e1d65-3272-49b9-ac96-0dc6babf86b2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:48.208640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91769cc-d66e-466a-9afa-ff859fb53232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:48.209417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91769cc-d66e-466a-9afa-ff859fb53232 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:48.209703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91769cc-d66e-466a-9afa-ff859fb53232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:48.210152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91769cc-d66e-466a-9afa-ff859fb53232 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:48.211244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91769cc-d66e-466a-9afa-ff859fb53232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:48.213112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91769cc-d66e-466a-9afa-ff859fb53232 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:48.225250 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2109/4187] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:48.230207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cfce8-4179-4cea-b088-5eb29369bc83 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:48.230497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cfce8-4179-4cea-b088-5eb29369bc83 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:48.230778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cfce8-4179-4cea-b088-5eb29369bc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:48.253692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-095cfce8-4179-4cea-b088-5eb29369bc83 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:48.255797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-095cfce8-4179-4cea-b088-5eb29369bc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:48.266018 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2110/4188] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:48.266639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cfce8-4179-4cea-b088-5eb29369bc83 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:48.343925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cfce8-4179-4cea-b088-5eb29369bc83 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:48.349079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e07f77-2e47-4202-b90a-81326336a0e3 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:48.349779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e07f77-2e47-4202-b90a-81326336a0e3 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:48.350070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e07f77-2e47-4202-b90a-81326336a0e3 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:48.350350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e07f77-2e47-4202-b90a-81326336a0e3 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:48.350986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e07f77-2e47-4202-b90a-81326336a0e3 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:48.352891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e07f77-2e47-4202-b90a-81326336a0e3 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:48.362359 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2079/4189] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:48 2022] PUT /identity/v3/projects/61e3eba2e9aa46d8a041f0067f171ac0/users/a2baa0b58754432e9ca387dee69a909e/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:48.363349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e1d65-3272-49b9-ac96-0dc6babf86b2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:48.433700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e1d65-3272-49b9-ac96-0dc6babf86b2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:48.438637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d99ea8-dc61-4cf2-ab76-070315c19278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:48.439240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d99ea8-dc61-4cf2-ab76-070315c19278 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:48.439538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d99ea8-dc61-4cf2-ab76-070315c19278 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:48.439784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d99ea8-dc61-4cf2-ab76-070315c19278 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:48.440450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d99ea8-dc61-4cf2-ab76-070315c19278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:48.442041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d99ea8-dc61-4cf2-ab76-070315c19278 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:48.452693 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2080/4190] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:48.453199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d99ea8-dc61-4cf2-ab76-070315c19278 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:48.454822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f3d99ea8-dc61-4cf2-ab76-070315c19278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:48.518382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d99ea8-dc61-4cf2-ab76-070315c19278 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:48.533198 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2111/4191] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:48 2022] POST /identity/v3/projects => generated 360 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:48.535496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e07f77-2e47-4202-b90a-81326336a0e3 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:48.539684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-11e07f77-2e47-4202-b90a-81326336a0e3 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:48.610114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9b082-0803-4b30-8713-15e2b96ef333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:48.612994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9b082-0803-4b30-8713-15e2b96ef333 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:48.612994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9b082-0803-4b30-8713-15e2b96ef333 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:48.613265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9b082-0803-4b30-8713-15e2b96ef333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:48.666236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e07f77-2e47-4202-b90a-81326336a0e3 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:48.671323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b37e0b-e9aa-47cd-8b02-bf630dc5dbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:48.672207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b37e0b-e9aa-47cd-8b02-bf630dc5dbf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:48.672348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b37e0b-e9aa-47cd-8b02-bf630dc5dbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:48.672535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b37e0b-e9aa-47cd-8b02-bf630dc5dbf1 admin admin] PATH_INFO: `/v3/users/a60798780db14e00a12cbae6f8253ee2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:48.673749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b37e0b-e9aa-47cd-8b02-bf630dc5dbf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a60798780db14e00a12cbae6f8253ee2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:48.675867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b37e0b-e9aa-47cd-8b02-bf630dc5dbf1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:48.700509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9b082-0803-4b30-8713-15e2b96ef333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:48.703154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9b082-0803-4b30-8713-15e2b96ef333 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:48.716527 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2081/4192] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:48.719006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8cb40-72ca-4e1c-827a-ff301ea22003 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:48.719295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8cb40-72ca-4e1c-827a-ff301ea22003 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:48.719569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8cb40-72ca-4e1c-827a-ff301ea22003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:48.750170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ffe8cb40-72ca-4e1c-827a-ff301ea22003 None None] MFA Rules not processed for user `a2baa0b58754432e9ca387dee69a909e`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:48.751385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ffe8cb40-72ca-4e1c-827a-ff301ea22003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:48.830550 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2082/4193] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:48.830550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8cb40-72ca-4e1c-827a-ff301ea22003 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:48.830550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ffe8cb40-72ca-4e1c-827a-ff301ea22003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:48.844101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8cb40-72ca-4e1c-827a-ff301ea22003 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:48.849179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a885a-fde7-4285-b050-8ba804e4f24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:48.849801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a885a-fde7-4285-b050-8ba804e4f24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:48.850081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a885a-fde7-4285-b050-8ba804e4f24d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:48.850351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a885a-fde7-4285-b050-8ba804e4f24d admin admin] PATH_INFO: `/v3/projects/4c6431379f834fefb790ba65ac06e292` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:48.851474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a885a-fde7-4285-b050-8ba804e4f24d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c6431379f834fefb790ba65ac06e292)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:48.853462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a885a-fde7-4285-b050-8ba804e4f24d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:48.861898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:49.043729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-858a885a-fde7-4285-b050-8ba804e4f24d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c6431379f834fefb790ba65ac06e292', 'request_id': 'req-858a885a-fde7-4285-b050-8ba804e4f24d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:49.047816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-18b37e0b-e9aa-47cd-8b02-bf630dc5dbf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a60798780db14e00a12cbae6f8253ee2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:49.049730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-18b37e0b-e9aa-47cd-8b02-bf630dc5dbf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a60798780db14e00a12cbae6f8253ee2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:49.050162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-858a885a-fde7-4285-b050-8ba804e4f24d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c6431379f834fefb790ba65ac06e292', 'request_id': 'req-858a885a-fde7-4285-b050-8ba804e4f24d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:49.059322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-858a885a-fde7-4285-b050-8ba804e4f24d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c6431379f834fefb790ba65ac06e292', 'request_id': 'req-858a885a-fde7-4285-b050-8ba804e4f24d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:49.147591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-18b37e0b-e9aa-47cd-8b02-bf630dc5dbf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a60798780db14e00a12cbae6f8253ee2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:49.148360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-18b37e0b-e9aa-47cd-8b02-bf630dc5dbf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a60798780db14e00a12cbae6f8253ee2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:49.188907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-18b37e0b-e9aa-47cd-8b02-bf630dc5dbf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a60798780db14e00a12cbae6f8253ee2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:49.221094 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2112/4194] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:48 2022] DELETE /identity/v3/users/a60798780db14e00a12cbae6f8253ee2 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:49.221094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b37e0b-e9aa-47cd-8b02-bf630dc5dbf1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:49.222693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-18b37e0b-e9aa-47cd-8b02-bf630dc5dbf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:49.237416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-858a885a-fde7-4285-b050-8ba804e4f24d admin admin] The token cache is being invalidate because project 4c6431379f834fefb790ba65ac06e292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:49.237838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-858a885a-fde7-4285-b050-8ba804e4f24d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:49.239746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-858a885a-fde7-4285-b050-8ba804e4f24d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:49.243072 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2083/4195] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:48 2022] DELETE /identity/v3/projects/4c6431379f834fefb790ba65ac06e292 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:49.243951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a885a-fde7-4285-b050-8ba804e4f24d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:49.247062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-858a885a-fde7-4285-b050-8ba804e4f24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:49.383460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a885a-fde7-4285-b050-8ba804e4f24d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:49.407591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b37e0b-e9aa-47cd-8b02-bf630dc5dbf1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:49.413078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f962a8-b27d-49e6-9c0e-5a9b32e812d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:49.414543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f962a8-b27d-49e6-9c0e-5a9b32e812d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:49.415039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f962a8-b27d-49e6-9c0e-5a9b32e812d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:49.415522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f962a8-b27d-49e6-9c0e-5a9b32e812d6 admin admin] PATH_INFO: `/v3/projects/67aa458680614a67ba71d6798958ef3c/users/b8bca4ba47094695b0993527509f61fa/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:49.441592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f962a8-b27d-49e6-9c0e-5a9b32e812d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67aa458680614a67ba71d6798958ef3c, user_id=b8bca4ba47094695b0993527509f61fa, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:49.444397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f962a8-b27d-49e6-9c0e-5a9b32e812d6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:49.476341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bc6d2-5b74-4b04-b724-d403e5e0fe95 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:49.477314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bc6d2-5b74-4b04-b724-d403e5e0fe95 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:49.477746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bc6d2-5b74-4b04-b724-d403e5e0fe95 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:49.478183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bc6d2-5b74-4b04-b724-d403e5e0fe95 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users/181d236855dc421ea02d344d124d09c9` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:49.499064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bc6d2-5b74-4b04-b724-d403e5e0fe95 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:update_user(user_id=181d236855dc421ea02d344d124d09c9)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:49.501649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bc6d2-5b74-4b04-b724-d403e5e0fe95 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:49.532351 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2113/4196] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:49 2022] PUT /identity/v3/projects/67aa458680614a67ba71d6798958ef3c/users/b8bca4ba47094695b0993527509f61fa/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:49.541791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f962a8-b27d-49e6-9c0e-5a9b32e812d6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:49.541791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b4f962a8-b27d-49e6-9c0e-5a9b32e812d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:49.614413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f962a8-b27d-49e6-9c0e-5a9b32e812d6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:49.619386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7951c-c0ef-4366-9f27-69d9d3f1e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:49.619997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7951c-c0ef-4366-9f27-69d9d3f1e39f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:49.620825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7951c-c0ef-4366-9f27-69d9d3f1e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:49.620825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7951c-c0ef-4366-9f27-69d9d3f1e39f admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:49.621345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7951c-c0ef-4366-9f27-69d9d3f1e39f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:49.624484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7951c-c0ef-4366-9f27-69d9d3f1e39f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:49.690812 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2084/4197] 10.222.0.76 () {60 vars in 1244 bytes} [Sat Aug 27 04:48:49 2022] PATCH /identity/v3/users/181d236855dc421ea02d344d124d09c9 => generated 524 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:49.691510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bc6d2-5b74-4b04-b724-d403e5e0fe95 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:49.693231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0e1bc6d2-5b74-4b04-b724-d403e5e0fe95 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:49.709955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bc6d2-5b74-4b04-b724-d403e5e0fe95 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:49.726624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a87289-1a07-4f45-88a3-1f27d303c600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:49.727366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a87289-1a07-4f45-88a3-1f27d303c600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:49.727653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a87289-1a07-4f45-88a3-1f27d303c600 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:49.727926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a87289-1a07-4f45-88a3-1f27d303c600 admin admin] PATH_INFO: `/v3/users/b103853692bb4742a4faa0d150afef72` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:49.729632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a87289-1a07-4f45-88a3-1f27d303c600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b103853692bb4742a4faa0d150afef72)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:49.731761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a87289-1a07-4f45-88a3-1f27d303c600 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:49.764587 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2114/4198] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:49 2022] POST /identity/v3/projects => generated 389 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:49.766321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063e502-e118-4621-a31d-3b72531f3d41 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:49.766605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063e502-e118-4621-a31d-3b72531f3d41 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:49.767147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063e502-e118-4621-a31d-3b72531f3d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:49.799722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1063e502-e118-4621-a31d-3b72531f3d41 None None] MFA Rules not processed for user `b8bca4ba47094695b0993527509f61fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:49.800768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1063e502-e118-4621-a31d-3b72531f3d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:49.879472 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2115/4199] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:49.880880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063e502-e118-4621-a31d-3b72531f3d41 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:49.882538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1063e502-e118-4621-a31d-3b72531f3d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:49.974356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64a87289-1a07-4f45-88a3-1f27d303c600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b103853692bb4742a4faa0d150afef72'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:49.975782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063e502-e118-4621-a31d-3b72531f3d41 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:49.987932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40406c88-aa39-46f4-8883-ee53358435d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:49.988706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40406c88-aa39-46f4-8883-ee53358435d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:49.994008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40406c88-aa39-46f4-8883-ee53358435d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:49.994008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40406c88-aa39-46f4-8883-ee53358435d6 admin admin] PATH_INFO: `/v3/projects/d9810a6d61ab4eb281b5bc5d5ecff6fa` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:49.994008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40406c88-aa39-46f4-8883-ee53358435d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9810a6d61ab4eb281b5bc5d5ecff6fa)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:49.994008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40406c88-aa39-46f4-8883-ee53358435d6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:50.067718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:50.098193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64a87289-1a07-4f45-88a3-1f27d303c600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b103853692bb4742a4faa0d150afef72'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:50.099155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64a87289-1a07-4f45-88a3-1f27d303c600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b103853692bb4742a4faa0d150afef72'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:50.135073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64a87289-1a07-4f45-88a3-1f27d303c600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b103853692bb4742a4faa0d150afef72'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:50.149537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64a87289-1a07-4f45-88a3-1f27d303c600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b103853692bb4742a4faa0d150afef72'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:50.162701 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2085/4200] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:49 2022] DELETE /identity/v3/users/b103853692bb4742a4faa0d150afef72 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:50.178465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a87289-1a07-4f45-88a3-1f27d303c600 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:50.183273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-64a87289-1a07-4f45-88a3-1f27d303c600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:50.215184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40406c88-aa39-46f4-8883-ee53358435d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9810a6d61ab4eb281b5bc5d5ecff6fa', 'request_id': 'req-40406c88-aa39-46f4-8883-ee53358435d6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:50.233619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40406c88-aa39-46f4-8883-ee53358435d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9810a6d61ab4eb281b5bc5d5ecff6fa', 'request_id': 'req-40406c88-aa39-46f4-8883-ee53358435d6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:50.341861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40406c88-aa39-46f4-8883-ee53358435d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9810a6d61ab4eb281b5bc5d5ecff6fa', 'request_id': 'req-40406c88-aa39-46f4-8883-ee53358435d6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:50.361283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40406c88-aa39-46f4-8883-ee53358435d6 admin admin] The token cache is being invalidate because project d9810a6d61ab4eb281b5bc5d5ecff6fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:50.361575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40406c88-aa39-46f4-8883-ee53358435d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:50.362265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a87289-1a07-4f45-88a3-1f27d303c600 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:50.362773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40406c88-aa39-46f4-8883-ee53358435d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:50.367991 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2116/4201] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:49 2022] DELETE /identity/v3/projects/d9810a6d61ab4eb281b5bc5d5ecff6fa => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:50.369106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40406c88-aa39-46f4-8883-ee53358435d6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:50.373159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-40406c88-aa39-46f4-8883-ee53358435d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:50.464348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87149501-8631-4c13-8640-19aae781cb5e tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:50.465052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87149501-8631-4c13-8640-19aae781cb5e tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:50.465342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87149501-8631-4c13-8640-19aae781cb5e tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:50.465620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87149501-8631-4c13-8640-19aae781cb5e tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users/181d236855dc421ea02d344d124d09c9` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:50.484915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87149501-8631-4c13-8640-19aae781cb5e tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:get_user(user_id=181d236855dc421ea02d344d124d09c9)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:50.487766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87149501-8631-4c13-8640-19aae781cb5e tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:50.490026 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2086/4202] 10.222.0.76 () {58 vars in 1221 bytes} [Sat Aug 27 04:48:50 2022] GET /identity/v3/users/181d236855dc421ea02d344d124d09c9 => generated 390 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:50.491217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87149501-8631-4c13-8640-19aae781cb5e tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:50.493128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-87149501-8631-4c13-8640-19aae781cb5e tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:50.540323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40406c88-aa39-46f4-8883-ee53358435d6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:50.545825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bff10e-9028-4b7f-ba24-99d45d7bc228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:50.546749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bff10e-9028-4b7f-ba24-99d45d7bc228 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:50.547046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bff10e-9028-4b7f-ba24-99d45d7bc228 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:50.549127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bff10e-9028-4b7f-ba24-99d45d7bc228 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:50.549127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bff10e-9028-4b7f-ba24-99d45d7bc228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:50.551557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bff10e-9028-4b7f-ba24-99d45d7bc228 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:50.585966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87149501-8631-4c13-8640-19aae781cb5e tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:50.595099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f150279-794d-46ea-b12a-66f372b73108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:50.595733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f150279-794d-46ea-b12a-66f372b73108 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:50.596017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f150279-794d-46ea-b12a-66f372b73108 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:50.596355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f150279-794d-46ea-b12a-66f372b73108 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:50.597061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f150279-794d-46ea-b12a-66f372b73108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:50.602189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f150279-794d-46ea-b12a-66f372b73108 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:50.662062 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2117/4203] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:50 2022] POST /identity/v3/users => generated 301 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:50.663078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcd7c8-0e49-45f3-bdd7-ba1d362f6191 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:50.663078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcd7c8-0e49-45f3-bdd7-ba1d362f6191 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:50.663376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcd7c8-0e49-45f3-bdd7-ba1d362f6191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:50.689543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-42fcd7c8-0e49-45f3-bdd7-ba1d362f6191 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:50.691543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-42fcd7c8-0e49-45f3-bdd7-ba1d362f6191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:50.693670 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2087/4204] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:50 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:50.695856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f150279-794d-46ea-b12a-66f372b73108 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:50.699173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0f150279-794d-46ea-b12a-66f372b73108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:50.858320 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2118/4205] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:50.858320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcd7c8-0e49-45f3-bdd7-ba1d362f6191 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:50.866196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f150279-794d-46ea-b12a-66f372b73108 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:50.879388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b502367-febc-4a8b-b9bf-35cfaf9260fa tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:50.880268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b502367-febc-4a8b-b9bf-35cfaf9260fa tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:50.880560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b502367-febc-4a8b-b9bf-35cfaf9260fa tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:50.880940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b502367-febc-4a8b-b9bf-35cfaf9260fa tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/projects/96c61fa79d364d6c923a3b7e14fd1b53` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:50.882493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b502367-febc-4a8b-b9bf-35cfaf9260fa tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:delete_project(project_id=96c61fa79d364d6c923a3b7e14fd1b53)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:50.886828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b502367-febc-4a8b-b9bf-35cfaf9260fa tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:50.898515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcd7c8-0e49-45f3-bdd7-ba1d362f6191 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:50.905924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d91f3-4989-418c-a689-e5729df26c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:50.906550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d91f3-4989-418c-a689-e5729df26c02 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:50.906828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d91f3-4989-418c-a689-e5729df26c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:50.907095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d91f3-4989-418c-a689-e5729df26c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:50.907824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d91f3-4989-418c-a689-e5729df26c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:50.909484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d91f3-4989-418c-a689-e5729df26c02 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:50.941891 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2119/4206] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:50.948830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73275a-d71c-46ed-ab70-14eabcf9356b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:50.949118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73275a-d71c-46ed-ab70-14eabcf9356b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:50.949395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73275a-d71c-46ed-ab70-14eabcf9356b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:51.024508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:51.042603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9e73275a-d71c-46ed-ab70-14eabcf9356b None None] MFA Rules not processed for user `12d8710270d44c65bf86cc42b692a43a`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:51.043864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9e73275a-d71c-46ed-ab70-14eabcf9356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:51.091481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4b502367-febc-4a8b-b9bf-35cfaf9260fa tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c61fa79d364d6c923a3b7e14fd1b53', 'request_id': 'req-4b502367-febc-4a8b-b9bf-35cfaf9260fa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:51.121251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4b502367-febc-4a8b-b9bf-35cfaf9260fa tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c61fa79d364d6c923a3b7e14fd1b53', 'request_id': 'req-4b502367-febc-4a8b-b9bf-35cfaf9260fa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:51.134796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4b502367-febc-4a8b-b9bf-35cfaf9260fa tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c61fa79d364d6c923a3b7e14fd1b53', 'request_id': 'req-4b502367-febc-4a8b-b9bf-35cfaf9260fa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:51.215527 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2120/4207] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:50 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:51.218055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73275a-d71c-46ed-ab70-14eabcf9356b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:51.259214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73275a-d71c-46ed-ab70-14eabcf9356b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:51.292483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4b502367-febc-4a8b-b9bf-35cfaf9260fa tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] The token cache is being invalidate because project 96c61fa79d364d6c923a3b7e14fd1b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:51.292838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4b502367-febc-4a8b-b9bf-35cfaf9260fa tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:51.293462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4b502367-febc-4a8b-b9bf-35cfaf9260fa tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:51.295051 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2088/4208] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:50 2022] DELETE /identity/v3/projects/96c61fa79d364d6c923a3b7e14fd1b53 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:51.298200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21178e73-98e1-43ca-b020-f80844e84f3f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:51.298719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21178e73-98e1-43ca-b020-f80844e84f3f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:51.300800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21178e73-98e1-43ca-b020-f80844e84f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:51.323981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-21178e73-98e1-43ca-b020-f80844e84f3f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:51.325213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-21178e73-98e1-43ca-b020-f80844e84f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:51.350544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eba0f0-a7e4-4af5-b5bd-693d92f8ff8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:51.351433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eba0f0-a7e4-4af5-b5bd-693d92f8ff8e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:51.358467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eba0f0-a7e4-4af5-b5bd-693d92f8ff8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:51.358467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eba0f0-a7e4-4af5-b5bd-693d92f8ff8e admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:51.358467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eba0f0-a7e4-4af5-b5bd-693d92f8ff8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:51.358467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eba0f0-a7e4-4af5-b5bd-693d92f8ff8e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:51.394906 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2089/4209] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:51.396488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21178e73-98e1-43ca-b020-f80844e84f3f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:51.398165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-21178e73-98e1-43ca-b020-f80844e84f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:51.411963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21178e73-98e1-43ca-b020-f80844e84f3f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:51.416993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e950d1b-b51e-4830-8275-2719e004534c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:51.417816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e950d1b-b51e-4830-8275-2719e004534c admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:51.418103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e950d1b-b51e-4830-8275-2719e004534c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:51.418436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e950d1b-b51e-4830-8275-2719e004534c admin admin] PATH_INFO: `/v3/projects/bd8201ec768c4a358f1f6d143ee6f4b9/users/364e8d763e264a4086eeb5193b062528/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:51.438770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e950d1b-b51e-4830-8275-2719e004534c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8201ec768c4a358f1f6d143ee6f4b9, user_id=364e8d763e264a4086eeb5193b062528, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:51.441634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e950d1b-b51e-4830-8275-2719e004534c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:51.460395 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2121/4210] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:51 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:51.461942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eba0f0-a7e4-4af5-b5bd-693d92f8ff8e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:51.464752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-87eba0f0-a7e4-4af5-b5bd-693d92f8ff8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:51.476998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eba0f0-a7e4-4af5-b5bd-693d92f8ff8e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:51.482123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa11cb-9403-40b4-9bf4-80033d51b919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:51.483281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa11cb-9403-40b4-9bf4-80033d51b919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:51.483578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa11cb-9403-40b4-9bf4-80033d51b919 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:51.483827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa11cb-9403-40b4-9bf4-80033d51b919 admin admin] PATH_INFO: `/v3/projects/b4387ff6e835468dba5d3eddc4144053` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:51.485211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa11cb-9403-40b4-9bf4-80033d51b919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4387ff6e835468dba5d3eddc4144053)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:51.487107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa11cb-9403-40b4-9bf4-80033d51b919 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:51.549067 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2090/4211] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:51 2022] PUT /identity/v3/projects/bd8201ec768c4a358f1f6d143ee6f4b9/users/364e8d763e264a4086eeb5193b062528/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:51.555796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b52dd-2c78-493b-8aba-339fb454035a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:51.555796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b52dd-2c78-493b-8aba-339fb454035a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:51.555796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b52dd-2c78-493b-8aba-339fb454035a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:51.573271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-216b52dd-2c78-493b-8aba-339fb454035a None None] MFA Rules not processed for user `12d8710270d44c65bf86cc42b692a43a`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:51.574606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-216b52dd-2c78-493b-8aba-339fb454035a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:51.641294 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2091/4212] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:51 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:51.642443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b52dd-2c78-493b-8aba-339fb454035a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:51.644609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-216b52dd-2c78-493b-8aba-339fb454035a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:51.685078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5baa11cb-9403-40b4-9bf4-80033d51b919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4387ff6e835468dba5d3eddc4144053', 'request_id': 'req-5baa11cb-9403-40b4-9bf4-80033d51b919'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:51.696689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5baa11cb-9403-40b4-9bf4-80033d51b919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4387ff6e835468dba5d3eddc4144053', 'request_id': 'req-5baa11cb-9403-40b4-9bf4-80033d51b919'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:51.753318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b52dd-2c78-493b-8aba-339fb454035a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:51.769750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5baa11cb-9403-40b4-9bf4-80033d51b919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4387ff6e835468dba5d3eddc4144053', 'request_id': 'req-5baa11cb-9403-40b4-9bf4-80033d51b919'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:51.782854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5baa11cb-9403-40b4-9bf4-80033d51b919 admin admin] The token cache is being invalidate because project b4387ff6e835468dba5d3eddc4144053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:51.783188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5baa11cb-9403-40b4-9bf4-80033d51b919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:51.783792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5baa11cb-9403-40b4-9bf4-80033d51b919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:51.785680 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2122/4213] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:51 2022] DELETE /identity/v3/projects/b4387ff6e835468dba5d3eddc4144053 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:51.786119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa11cb-9403-40b4-9bf4-80033d51b919 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:51.787404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5baa11cb-9403-40b4-9bf4-80033d51b919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:51.825634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f040dc5-6a77-4927-8e7c-6159a6ca59b0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd06115633c554812836abc61cfce529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b923435d495448f824f6b9d674946ab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:51.826328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f040dc5-6a77-4927-8e7c-6159a6ca59b0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:51.826638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f040dc5-6a77-4927-8e7c-6159a6ca59b0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:51.826925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f040dc5-6a77-4927-8e7c-6159a6ca59b0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] PATH_INFO: `/v3/users/181d236855dc421ea02d344d124d09c9` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:51.834427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f040dc5-6a77-4927-8e7c-6159a6ca59b0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorizing `identity:delete_user(user_id=181d236855dc421ea02d344d124d09c9)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:51.837320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f040dc5-6a77-4927-8e7c-6159a6ca59b0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:51.886278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa11cb-9403-40b4-9bf4-80033d51b919 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:51.891735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccd13b-fab3-4d48-9f70-4a859c007191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:51.892793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccd13b-fab3-4d48-9f70-4a859c007191 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:51.893083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccd13b-fab3-4d48-9f70-4a859c007191 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:51.893357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccd13b-fab3-4d48-9f70-4a859c007191 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:51.894019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccd13b-fab3-4d48-9f70-4a859c007191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:48:51.894325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccd13b-fab3-4d48-9f70-4a859c007191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:51.895959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccd13b-fab3-4d48-9f70-4a859c007191 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:51.915361 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2123/4214] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:51.916320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccd13b-fab3-4d48-9f70-4a859c007191 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:51.918451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f0ccd13b-fab3-4d48-9f70-4a859c007191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:51.934330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccd13b-fab3-4d48-9f70-4a859c007191 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:51.947478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279ddbb-32a0-4954-812d-07d96fa66529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:51.948354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279ddbb-32a0-4954-812d-07d96fa66529 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:51.948639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279ddbb-32a0-4954-812d-07d96fa66529 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:51.948912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279ddbb-32a0-4954-812d-07d96fa66529 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:51.949558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279ddbb-32a0-4954-812d-07d96fa66529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:51.951294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279ddbb-32a0-4954-812d-07d96fa66529 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:51.970630 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2124/4215] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:51.971735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279ddbb-32a0-4954-812d-07d96fa66529 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:51.973533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5279ddbb-32a0-4954-812d-07d96fa66529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:51.990008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279ddbb-32a0-4954-812d-07d96fa66529 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:51.996075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91d103-e82a-4670-9a60-2ce6a6a06bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:51.997003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91d103-e82a-4670-9a60-2ce6a6a06bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:51.997318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91d103-e82a-4670-9a60-2ce6a6a06bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:51.997563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91d103-e82a-4670-9a60-2ce6a6a06bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:51.998516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91d103-e82a-4670-9a60-2ce6a6a06bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:52.001560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91d103-e82a-4670-9a60-2ce6a6a06bd9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:52.015468 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2125/4216] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:52.016489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91d103-e82a-4670-9a60-2ce6a6a06bd9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:52.018508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7c91d103-e82a-4670-9a60-2ce6a6a06bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:52.043132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1f040dc5-6a77-4927-8e7c-6159a6ca59b0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181d236855dc421ea02d344d124d09c9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:52.123687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91d103-e82a-4670-9a60-2ce6a6a06bd9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:52.131847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0ea8b-d20e-443e-8d09-b6c70fa36831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:52.132742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0ea8b-d20e-443e-8d09-b6c70fa36831 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:52.133435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0ea8b-d20e-443e-8d09-b6c70fa36831 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:52.134424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0ea8b-d20e-443e-8d09-b6c70fa36831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:52.136813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6ab0ea8b-d20e-443e-8d09-b6c70fa36831 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:52.160666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1f040dc5-6a77-4927-8e7c-6159a6ca59b0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181d236855dc421ea02d344d124d09c9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:52.161593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1f040dc5-6a77-4927-8e7c-6159a6ca59b0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181d236855dc421ea02d344d124d09c9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:52.176264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1f040dc5-6a77-4927-8e7c-6159a6ca59b0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181d236855dc421ea02d344d124d09c9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:52.222682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0ea8b-d20e-443e-8d09-b6c70fa36831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:52.222682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0ea8b-d20e-443e-8d09-b6c70fa36831 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:52.223086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1f040dc5-6a77-4927-8e7c-6159a6ca59b0 tempest-UsersV3TestJSON-1701632775 tempest-UsersV3TestJSON-1701632775-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181d236855dc421ea02d344d124d09c9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:52.237820 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2092/4217] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:51 2022] DELETE /identity/v3/users/181d236855dc421ea02d344d124d09c9 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:52.239320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9068d30-6c39-4fd6-a568-454fd20010f9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:52.241398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9068d30-6c39-4fd6-a568-454fd20010f9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:52.241770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9068d30-6c39-4fd6-a568-454fd20010f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:52.242581 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2126/4218] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:52 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:52.243834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0ea8b-d20e-443e-8d09-b6c70fa36831 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:52.264932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0ea8b-d20e-443e-8d09-b6c70fa36831 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:52.267650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a9068d30-6c39-4fd6-a568-454fd20010f9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:52.269283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a9068d30-6c39-4fd6-a568-454fd20010f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:52.402243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa698b4c-ba70-4a4d-8b75-725d9f6f254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:52.402243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa698b4c-ba70-4a4d-8b75-725d9f6f254f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:52.402243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa698b4c-ba70-4a4d-8b75-725d9f6f254f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:52.402243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa698b4c-ba70-4a4d-8b75-725d9f6f254f admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:52.402727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa698b4c-ba70-4a4d-8b75-725d9f6f254f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:52.402727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa698b4c-ba70-4a4d-8b75-725d9f6f254f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:52.417493 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2093/4219] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:52.418582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9068d30-6c39-4fd6-a568-454fd20010f9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:52.420209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a9068d30-6c39-4fd6-a568-454fd20010f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:52.436556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9068d30-6c39-4fd6-a568-454fd20010f9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:52.442625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db34b4-7b2c-4052-8202-dbf8536e8bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:52.444812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db34b4-7b2c-4052-8202-dbf8536e8bae admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:52.445148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db34b4-7b2c-4052-8202-dbf8536e8bae admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:52.445433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db34b4-7b2c-4052-8202-dbf8536e8bae admin admin] PATH_INFO: `/v3/projects/038311d86fc14e2c9ee7080134cade60/users/414b65a0fcbd4e2d862d29c8f943b21c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:52.462995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db34b4-7b2c-4052-8202-dbf8536e8bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=038311d86fc14e2c9ee7080134cade60, user_id=414b65a0fcbd4e2d862d29c8f943b21c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:52.466188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db34b4-7b2c-4052-8202-dbf8536e8bae admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:52.622756 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2127/4220] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:52 2022] POST /identity/v3/projects => generated 387 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:52.624081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa698b4c-ba70-4a4d-8b75-725d9f6f254f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:52.629002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-aa698b4c-ba70-4a4d-8b75-725d9f6f254f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:52.646005 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2094/4221] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:52 2022] PUT /identity/v3/projects/038311d86fc14e2c9ee7080134cade60/users/414b65a0fcbd4e2d862d29c8f943b21c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:52.647400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db34b4-7b2c-4052-8202-dbf8536e8bae admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:52.653952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f7db34b4-7b2c-4052-8202-dbf8536e8bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:52.779631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:52.781204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa698b4c-ba70-4a4d-8b75-725d9f6f254f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:52.783944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db34b4-7b2c-4052-8202-dbf8536e8bae admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:52.791833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e437292-c2ef-4786-aea6-827742779192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:52.792475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e437292-c2ef-4786-aea6-827742779192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:52.792762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e437292-c2ef-4786-aea6-827742779192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:52.792872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb453adc-7f50-4f3e-af11-358ff3f1473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:52.793161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e437292-c2ef-4786-aea6-827742779192 admin admin] PATH_INFO: `/v3/users/50c5b073202d46838d1bd9fcbeac957f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:52.793536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb453adc-7f50-4f3e-af11-358ff3f1473f admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:52.793816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb453adc-7f50-4f3e-af11-358ff3f1473f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:52.794090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb453adc-7f50-4f3e-af11-358ff3f1473f admin admin] PATH_INFO: `/v3/projects/bd8201ec768c4a358f1f6d143ee6f4b9/users/364e8d763e264a4086eeb5193b062528/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:52.805694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb453adc-7f50-4f3e-af11-358ff3f1473f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8201ec768c4a358f1f6d143ee6f4b9, user_id=364e8d763e264a4086eeb5193b062528, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:52.808418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb453adc-7f50-4f3e-af11-358ff3f1473f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:52.813861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e437292-c2ef-4786-aea6-827742779192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c5b073202d46838d1bd9fcbeac957f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:52.816466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e437292-c2ef-4786-aea6-827742779192 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:52.830099 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2128/4222] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:52 2022] PUT /identity/v3/projects/bd8201ec768c4a358f1f6d143ee6f4b9/users/364e8d763e264a4086eeb5193b062528/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:52.832279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadefb4-9723-49d9-a1d2-36671f48e41b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:52.832752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadefb4-9723-49d9-a1d2-36671f48e41b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:52.833207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadefb4-9723-49d9-a1d2-36671f48e41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:52.878898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4dadefb4-9723-49d9-a1d2-36671f48e41b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:52.880127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4dadefb4-9723-49d9-a1d2-36671f48e41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:52.967545 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2129/4223] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:52.968535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadefb4-9723-49d9-a1d2-36671f48e41b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:52.973403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4dadefb4-9723-49d9-a1d2-36671f48e41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:52.988148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadefb4-9723-49d9-a1d2-36671f48e41b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:53.003608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557067e5-84d5-4345-9c92-c2df5ed775dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:53.004259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557067e5-84d5-4345-9c92-c2df5ed775dc admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:53.004535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557067e5-84d5-4345-9c92-c2df5ed775dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:53.004805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557067e5-84d5-4345-9c92-c2df5ed775dc admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:53.005440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557067e5-84d5-4345-9c92-c2df5ed775dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:53.007366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557067e5-84d5-4345-9c92-c2df5ed775dc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:53.151064 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2130/4224] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:52 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:53.152765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e2ca-0726-449b-9a61-5e88bd4ae05c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:53.153727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e2ca-0726-449b-9a61-5e88bd4ae05c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:53.155001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e2ca-0726-449b-9a61-5e88bd4ae05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:53.174095 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-84c2e2ca-0726-449b-9a61-5e88bd4ae05c None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:53.174095 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:48:53.174095 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:48:53.174095 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:48:53.174095 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:48:53.174095 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:48:53.174095 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:48:53.174095 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:48:53.174095 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:48:53.174095 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:48:53.174095 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:48:53.174095 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:48:53.174095 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:48:53.174981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:48:53.174981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:48:53.174981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:48:53.174981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:48:53.174981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:48:53.174981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:48:53.174981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:48:53.174981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:48:53.174981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:48:53.174981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:48:53.174981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:48:53.174981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:48:53.174981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:48:53.174981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:48:53.174981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:48:53.177209 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2131/4225] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:48:53 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 25 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:48:53.207442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5e437292-c2ef-4786-aea6-827742779192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c5b073202d46838d1bd9fcbeac957f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:53.209622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2e2ca-0726-449b-9a61-5e88bd4ae05c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:53.279177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2e2ca-0726-449b-9a61-5e88bd4ae05c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:53.293645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb5744-7368-4f8e-97c1-a6cf6b4d352a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:53.294277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb5744-7368-4f8e-97c1-a6cf6b4d352a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:53.294579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb5744-7368-4f8e-97c1-a6cf6b4d352a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:53.294855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb5744-7368-4f8e-97c1-a6cf6b4d352a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:53.297160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb5744-7368-4f8e-97c1-a6cf6b4d352a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:53.299039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb5744-7368-4f8e-97c1-a6cf6b4d352a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:53.334436 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2132/4226] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:53.337820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfdf58-9a44-4574-9502-47995ed229a1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:53.338122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfdf58-9a44-4574-9502-47995ed229a1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:53.338380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfdf58-9a44-4574-9502-47995ed229a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:53.341276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5e437292-c2ef-4786-aea6-827742779192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c5b073202d46838d1bd9fcbeac957f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:53.347300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5e437292-c2ef-4786-aea6-827742779192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c5b073202d46838d1bd9fcbeac957f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:53.372376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5e437292-c2ef-4786-aea6-827742779192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c5b073202d46838d1bd9fcbeac957f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:53.425173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5e437292-c2ef-4786-aea6-827742779192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c5b073202d46838d1bd9fcbeac957f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:53.449350 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2095/4227] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:52 2022] DELETE /identity/v3/users/50c5b073202d46838d1bd9fcbeac957f => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:53.454174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e437292-c2ef-4786-aea6-827742779192 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:53.456426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5e437292-c2ef-4786-aea6-827742779192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:53.469728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b6dfdf58-9a44-4574-9502-47995ed229a1 None None] MFA Rules not processed for user `364e8d763e264a4086eeb5193b062528`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:53.479180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b6dfdf58-9a44-4574-9502-47995ed229a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:53.624626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e437292-c2ef-4786-aea6-827742779192 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:53.634231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a546b7-3926-46aa-a00c-148386883172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:53.634935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a546b7-3926-46aa-a00c-148386883172 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:53.634935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a546b7-3926-46aa-a00c-148386883172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:53.635304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a546b7-3926-46aa-a00c-148386883172 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:53.635977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a546b7-3926-46aa-a00c-148386883172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:48:53.636325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a546b7-3926-46aa-a00c-148386883172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:53.637972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a546b7-3926-46aa-a00c-148386883172 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:53.684205 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2096/4228] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:53.686128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a546b7-3926-46aa-a00c-148386883172 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:53.691630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-09a546b7-3926-46aa-a00c-148386883172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:53.700143 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2133/4229] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:53 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:53.700143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfdf58-9a44-4574-9502-47995ed229a1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:53.704678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b6dfdf58-9a44-4574-9502-47995ed229a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:53.729637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a546b7-3926-46aa-a00c-148386883172 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:53.748717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfdf58-9a44-4574-9502-47995ed229a1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:53.753039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c85f62-14b9-44d3-bad4-cae75805d76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:53.753710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c85f62-14b9-44d3-bad4-cae75805d76c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:53.753960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c85f62-14b9-44d3-bad4-cae75805d76c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:53.755402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c85f62-14b9-44d3-bad4-cae75805d76c admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:53.756118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c85f62-14b9-44d3-bad4-cae75805d76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:53.757838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c85f62-14b9-44d3-bad4-cae75805d76c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:53.766201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49936173-3492-4592-b213-d43a7638385e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:53.766887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49936173-3492-4592-b213-d43a7638385e admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:53.767166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49936173-3492-4592-b213-d43a7638385e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:53.767441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49936173-3492-4592-b213-d43a7638385e admin admin] PATH_INFO: `/v3/projects/038311d86fc14e2c9ee7080134cade60/users/414b65a0fcbd4e2d862d29c8f943b21c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:53.769535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49936173-3492-4592-b213-d43a7638385e admin admin] RBAC: Authorizing `identity:create_grant(project_id=038311d86fc14e2c9ee7080134cade60, user_id=414b65a0fcbd4e2d862d29c8f943b21c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:53.772681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49936173-3492-4592-b213-d43a7638385e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:53.780741 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2097/4230] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:53.782737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a565724-aba8-4bd0-b2c0-e12f45adab34 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:53.783025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a565724-aba8-4bd0-b2c0-e12f45adab34 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:53.783942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a565724-aba8-4bd0-b2c0-e12f45adab34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:53.789493 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2134/4231] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:53 2022] PUT /identity/v3/projects/038311d86fc14e2c9ee7080134cade60/users/414b65a0fcbd4e2d862d29c8f943b21c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:53.791690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49936173-3492-4592-b213-d43a7638385e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:53.795541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-49936173-3492-4592-b213-d43a7638385e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:53.818197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3a565724-aba8-4bd0-b2c0-e12f45adab34 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:53.821186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3a565724-aba8-4bd0-b2c0-e12f45adab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:53.851093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:53.954305 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2098/4232] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:53.955420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a565724-aba8-4bd0-b2c0-e12f45adab34 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:53.981031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a565724-aba8-4bd0-b2c0-e12f45adab34 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:53.987794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cf967-b3cd-4df9-b167-2b809a4f2eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:53.988708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cf967-b3cd-4df9-b167-2b809a4f2eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:53.989127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cf967-b3cd-4df9-b167-2b809a4f2eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:53.989693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cf967-b3cd-4df9-b167-2b809a4f2eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:53.990923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cf967-b3cd-4df9-b167-2b809a4f2eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:53.994213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cf967-b3cd-4df9-b167-2b809a4f2eb5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:54.004249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49936173-3492-4592-b213-d43a7638385e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:54.025007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de269e2a-f383-4889-a71d-d218387e173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:54.027164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de269e2a-f383-4889-a71d-d218387e173e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:54.027164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de269e2a-f383-4889-a71d-d218387e173e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:54.027164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de269e2a-f383-4889-a71d-d218387e173e admin admin] PATH_INFO: `/v3/users/dd816cdc446443d5b3772afc7221fa79` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:54.027967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de269e2a-f383-4889-a71d-d218387e173e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd816cdc446443d5b3772afc7221fa79)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:54.031282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de269e2a-f383-4889-a71d-d218387e173e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:54.210603 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2099/4233] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:53 2022] POST /identity/v3/projects => generated 375 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:54.210603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cf967-b3cd-4df9-b167-2b809a4f2eb5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:54.358644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cf967-b3cd-4df9-b167-2b809a4f2eb5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:54.374837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04581df9-50e0-43be-bd6f-ae0e2d68683a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:54.375914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04581df9-50e0-43be-bd6f-ae0e2d68683a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:54.378341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04581df9-50e0-43be-bd6f-ae0e2d68683a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:54.378742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04581df9-50e0-43be-bd6f-ae0e2d68683a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:54.379464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04581df9-50e0-43be-bd6f-ae0e2d68683a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:54.382351 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-04581df9-50e0-43be-bd6f-ae0e2d68683a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:54.382351 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:48:54.382351 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:48:54.383448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04581df9-50e0-43be-bd6f-ae0e2d68683a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:54.384153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-de269e2a-f383-4889-a71d-d218387e173e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd816cdc446443d5b3772afc7221fa79'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:54.385682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-de269e2a-f383-4889-a71d-d218387e173e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd816cdc446443d5b3772afc7221fa79'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:54.471224 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2100/4234] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:48:54 2022] POST /identity/v3/domains => generated 275 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:54.471224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04581df9-50e0-43be-bd6f-ae0e2d68683a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:54.501471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-de269e2a-f383-4889-a71d-d218387e173e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd816cdc446443d5b3772afc7221fa79'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:54.502302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-de269e2a-f383-4889-a71d-d218387e173e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd816cdc446443d5b3772afc7221fa79'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:54.526177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-de269e2a-f383-4889-a71d-d218387e173e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd816cdc446443d5b3772afc7221fa79'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:54.554229 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2135/4235] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:53 2022] DELETE /identity/v3/users/dd816cdc446443d5b3772afc7221fa79 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:54.558372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f09e4-d579-48fa-8fdc-ee34642c0527 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:54.560205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f09e4-d579-48fa-8fdc-ee34642c0527 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:54.561834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f09e4-d579-48fa-8fdc-ee34642c0527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:54.612311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-df3f09e4-d579-48fa-8fdc-ee34642c0527 None None] MFA Rules not processed for user `414b65a0fcbd4e2d862d29c8f943b21c`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:54.613761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-df3f09e4-d579-48fa-8fdc-ee34642c0527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:54.622462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04581df9-50e0-43be-bd6f-ae0e2d68683a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:54.745732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fa41d-a35e-4673-bf81-5d732469003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:54.746487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fa41d-a35e-4673-bf81-5d732469003e admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:54.746643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fa41d-a35e-4673-bf81-5d732469003e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:54.746889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fa41d-a35e-4673-bf81-5d732469003e admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:54.750751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fa41d-a35e-4673-bf81-5d732469003e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:54.755453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fa41d-a35e-4673-bf81-5d732469003e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:54.771534 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2101/4236] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:54.771534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fa41d-a35e-4673-bf81-5d732469003e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:54.772076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-282fa41d-a35e-4673-bf81-5d732469003e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:54.777112 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2136/4237] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:54.783319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f09e4-d579-48fa-8fdc-ee34642c0527 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:54.784557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-df3f09e4-d579-48fa-8fdc-ee34642c0527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:54.800748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f09e4-d579-48fa-8fdc-ee34642c0527 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:54.812062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2ac9e-57ad-4bf6-a864-bd911674c790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:54.812823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2ac9e-57ad-4bf6-a864-bd911674c790 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:54.817003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2ac9e-57ad-4bf6-a864-bd911674c790 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:54.817417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2ac9e-57ad-4bf6-a864-bd911674c790 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:54.818157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2ac9e-57ad-4bf6-a864-bd911674c790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:54.820252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2ac9e-57ad-4bf6-a864-bd911674c790 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:54.869838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fa41d-a35e-4673-bf81-5d732469003e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:54.874223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8424c7-aea9-495b-9ed2-4f636b9ca295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:54.876630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8424c7-aea9-495b-9ed2-4f636b9ca295 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:54.876916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8424c7-aea9-495b-9ed2-4f636b9ca295 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:54.877188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8424c7-aea9-495b-9ed2-4f636b9ca295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:54.881432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ad8424c7-aea9-495b-9ed2-4f636b9ca295 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:54.922889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8424c7-aea9-495b-9ed2-4f636b9ca295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:54.924715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8424c7-aea9-495b-9ed2-4f636b9ca295 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:54.931588 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2137/4238] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:54 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:54.931588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2ac9e-57ad-4bf6-a864-bd911674c790 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:54.936378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fda2ac9e-57ad-4bf6-a864-bd911674c790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:54.939092 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2102/4239] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:54.940669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a70fa-a1c4-4e1e-a714-3bab08ae03cd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:54.940956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a70fa-a1c4-4e1e-a714-3bab08ae03cd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:54.941233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a70fa-a1c4-4e1e-a714-3bab08ae03cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:54.979029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-403a70fa-a1c4-4e1e-a714-3bab08ae03cd None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:54.981344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-403a70fa-a1c4-4e1e-a714-3bab08ae03cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:55.013318 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2103/4240] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:55.015397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a70fa-a1c4-4e1e-a714-3bab08ae03cd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:55.017470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-403a70fa-a1c4-4e1e-a714-3bab08ae03cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:55.047045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a70fa-a1c4-4e1e-a714-3bab08ae03cd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:55.058121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c496b-efd4-4272-9ff9-187b50996a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:55.059588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c496b-efd4-4272-9ff9-187b50996a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:55.061449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c496b-efd4-4272-9ff9-187b50996a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:55.061708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c496b-efd4-4272-9ff9-187b50996a95 admin admin] PATH_INFO: `/v3/projects/0736e03453ca4ec790545a32d5eeb750/users/509079c1e9024b76ae3c93523955ff10/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:55.084319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c496b-efd4-4272-9ff9-187b50996a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0736e03453ca4ec790545a32d5eeb750, user_id=509079c1e9024b76ae3c93523955ff10, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:55.087687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c496b-efd4-4272-9ff9-187b50996a95 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:55.173447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2ac9e-57ad-4bf6-a864-bd911674c790 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:55.187420 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2104/4241] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:55 2022] PUT /identity/v3/projects/0736e03453ca4ec790545a32d5eeb750/users/509079c1e9024b76ae3c93523955ff10/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:55.189388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c496b-efd4-4272-9ff9-187b50996a95 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:55.252681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:55.282577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:55.322282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9b364-bfca-4914-94fe-5a44d2a7059d tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:55.323247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9b364-bfca-4914-94fe-5a44d2a7059d tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:55.323734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9b364-bfca-4914-94fe-5a44d2a7059d tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:55.324188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9b364-bfca-4914-94fe-5a44d2a7059d tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/a226e1ab0e394962a30d247bb8de0703/config` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:55.325063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9b364-bfca-4914-94fe-5a44d2a7059d tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=a226e1ab0e394962a30d247bb8de0703)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:55.326812 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-55f9b364-bfca-4914-94fe-5a44d2a7059d tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:55.326812 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:48:55.326812 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:48:55.328822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9b364-bfca-4914-94fe-5a44d2a7059d tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:55.350972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c496b-efd4-4272-9ff9-187b50996a95 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:55.361104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e72c33-2820-4962-b406-7c0f5675a6b7 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '414b65a0fcbd4e2d862d29c8f943b21c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '038311d86fc14e2c9ee7080134cade60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:55.361769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e72c33-2820-4962-b406-7c0f5675a6b7 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:55.362055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e72c33-2820-4962-b406-7c0f5675a6b7 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:55.362330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e72c33-2820-4962-b406-7c0f5675a6b7 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:55.363037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e72c33-2820-4962-b406-7c0f5675a6b7 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:55.364856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e72c33-2820-4962-b406-7c0f5675a6b7 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:55.830804 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2105/4242] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:48:55 2022] POST /identity/v3/domains => generated 246 bytes in 643 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:55.831878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e72c33-2820-4962-b406-7c0f5675a6b7 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:55.867605 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2138/4243] 10.222.0.76 () {60 vars in 1269 bytes} [Sat Aug 27 04:48:54 2022] PUT /identity/v3/domains/a226e1ab0e394962a30d247bb8de0703/config => generated 138 bytes in 938 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:55.870920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9b364-bfca-4914-94fe-5a44d2a7059d tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:55.870920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-55f9b364-bfca-4914-94fe-5a44d2a7059d tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:55.946039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e72c33-2820-4962-b406-7c0f5675a6b7 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:55.957122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fb696-a537-42ea-8f87-e527ec986023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:55.960125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fb696-a537-42ea-8f87-e527ec986023 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:55.960125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fb696-a537-42ea-8f87-e527ec986023 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:55.960125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fb696-a537-42ea-8f87-e527ec986023 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:55.960843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505fb696-a537-42ea-8f87-e527ec986023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:55.993610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505fb696-a537-42ea-8f87-e527ec986023 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:56.017318 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2106/4244] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:56.021924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9b364-bfca-4914-94fe-5a44d2a7059d tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:56.022523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2fdc5-fcb5-44b9-8d61-aee12dbbfd33 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:56.023042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2fdc5-fcb5-44b9-8d61-aee12dbbfd33 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:56.023484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2fdc5-fcb5-44b9-8d61-aee12dbbfd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:56.073452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c8d2fdc5-fcb5-44b9-8d61-aee12dbbfd33 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:56.078095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c8d2fdc5-fcb5-44b9-8d61-aee12dbbfd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:56.080447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802bcdc-7166-4be9-ae31-5e1101277efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:56.081074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802bcdc-7166-4be9-ae31-5e1101277efe service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:56.081420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802bcdc-7166-4be9-ae31-5e1101277efe service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:56.081708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802bcdc-7166-4be9-ae31-5e1101277efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:56.093883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802bcdc-7166-4be9-ae31-5e1101277efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:56.095442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802bcdc-7166-4be9-ae31-5e1101277efe service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:56.107210 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2107/4245] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:56.108410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2fdc5-fcb5-44b9-8d61-aee12dbbfd33 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:56.112195 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2139/4246] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:56.113223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802bcdc-7166-4be9-ae31-5e1101277efe service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:56.203838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802bcdc-7166-4be9-ae31-5e1101277efe service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:56.210054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f821ed-0bdf-4995-94ad-0c0ab9d9d2c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:56.210728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f821ed-0bdf-4995-94ad-0c0ab9d9d2c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:56.211007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f821ed-0bdf-4995-94ad-0c0ab9d9d2c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:56.211462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f821ed-0bdf-4995-94ad-0c0ab9d9d2c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/a226e1ab0e394962a30d247bb8de0703/config/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:56.212755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f821ed-0bdf-4995-94ad-0c0ab9d9d2c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=a226e1ab0e394962a30d247bb8de0703, group=identity)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:56.214040 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-d9f821ed-0bdf-4995-94ad-0c0ab9d9d2c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:56.214040 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:48:56.214040 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:48:56.215134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f821ed-0bdf-4995-94ad-0c0ab9d9d2c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:56.227514 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2140/4247] 10.222.0.76 () {58 vars in 1275 bytes} [Sat Aug 27 04:48:56 2022] GET /identity/v3/domains/a226e1ab0e394962a30d247bb8de0703/config/identity => generated 45 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:48:56.228580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f821ed-0bdf-4995-94ad-0c0ab9d9d2c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:56.241192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f821ed-0bdf-4995-94ad-0c0ab9d9d2c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:56.247107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2fdc5-fcb5-44b9-8d61-aee12dbbfd33 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:56.248700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6fff4-87bc-4333-b99f-d5fc0effef3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:56.248700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6fff4-87bc-4333-b99f-d5fc0effef3f admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:56.249036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6fff4-87bc-4333-b99f-d5fc0effef3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:56.249454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6fff4-87bc-4333-b99f-d5fc0effef3f admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:56.250315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6fff4-87bc-4333-b99f-d5fc0effef3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:56.252423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6fff4-87bc-4333-b99f-d5fc0effef3f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:56.262620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06c20b-723e-4e23-aa96-25018aede373 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '414b65a0fcbd4e2d862d29c8f943b21c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '038311d86fc14e2c9ee7080134cade60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:56.263258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06c20b-723e-4e23-aa96-25018aede373 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:56.264209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06c20b-723e-4e23-aa96-25018aede373 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:56.265523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06c20b-723e-4e23-aa96-25018aede373 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:56.266186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06c20b-723e-4e23-aa96-25018aede373 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:56.269711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06c20b-723e-4e23-aa96-25018aede373 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:56.270458 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2141/4248] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:56.271777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6fff4-87bc-4333-b99f-d5fc0effef3f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:56.285685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6fff4-87bc-4333-b99f-d5fc0effef3f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:56.295546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699c6cb-463a-4cb8-9026-e5c15ea2b803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:56.296408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699c6cb-463a-4cb8-9026-e5c15ea2b803 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:56.296860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699c6cb-463a-4cb8-9026-e5c15ea2b803 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:56.297538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699c6cb-463a-4cb8-9026-e5c15ea2b803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:56.311287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699c6cb-463a-4cb8-9026-e5c15ea2b803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:56.313276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699c6cb-463a-4cb8-9026-e5c15ea2b803 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:56.327843 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2142/4249] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:48:56.329613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699c6cb-463a-4cb8-9026-e5c15ea2b803 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:56.344070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699c6cb-463a-4cb8-9026-e5c15ea2b803 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:56.356672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087a60f-aa37-455c-8f21-b20654e2949e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:56.357870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087a60f-aa37-455c-8f21-b20654e2949e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:56.358368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087a60f-aa37-455c-8f21-b20654e2949e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:56.358859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087a60f-aa37-455c-8f21-b20654e2949e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/a226e1ab0e394962a30d247bb8de0703/config/identity/driver` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:56.360636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087a60f-aa37-455c-8f21-b20654e2949e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=a226e1ab0e394962a30d247bb8de0703, group=identity, option=driver)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:56.362446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087a60f-aa37-455c-8f21-b20654e2949e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:56.371692 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2143/4250] 10.222.0.76 () {58 vars in 1296 bytes} [Sat Aug 27 04:48:56 2022] GET /identity/v3/domains/a226e1ab0e394962a30d247bb8de0703/config/identity/driver => generated 31 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:48:56.373691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087a60f-aa37-455c-8f21-b20654e2949e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:56.400480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087a60f-aa37-455c-8f21-b20654e2949e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:56.410890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2eb79-484b-4bf5-b92e-a1443c97109a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:56.412047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2eb79-484b-4bf5-b92e-a1443c97109a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:56.412047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2eb79-484b-4bf5-b92e-a1443c97109a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:56.412324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2eb79-484b-4bf5-b92e-a1443c97109a admin admin] PATH_INFO: `/v3/projects/542025c89be64b2a8c5d33e79058f6e2/users/ecae372a6933460d8acf92b44364d7ec/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:56.425864 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2108/4251] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:56 2022] POST /identity/v3/projects => generated 410 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:56.427329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06c20b-723e-4e23-aa96-25018aede373 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:56.445591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2eb79-484b-4bf5-b92e-a1443c97109a admin admin] RBAC: Authorizing `identity:create_grant(project_id=542025c89be64b2a8c5d33e79058f6e2, user_id=ecae372a6933460d8acf92b44364d7ec, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:56.448513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2eb79-484b-4bf5-b92e-a1443c97109a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:56.544093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06c20b-723e-4e23-aa96-25018aede373 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:56.562100 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2144/4252] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:56 2022] PUT /identity/v3/projects/542025c89be64b2a8c5d33e79058f6e2/users/ecae372a6933460d8acf92b44364d7ec/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:56.563518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2eb79-484b-4bf5-b92e-a1443c97109a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:56.652936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:56.654243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cee7e-a47d-4411-9f1f-e901d4ee27c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:56.656506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cee7e-a47d-4411-9f1f-e901d4ee27c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:56.657040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cee7e-a47d-4411-9f1f-e901d4ee27c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:56.657534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cee7e-a47d-4411-9f1f-e901d4ee27c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/a226e1ab0e394962a30d247bb8de0703/config/ldap` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:56.659085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cee7e-a47d-4411-9f1f-e901d4ee27c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=a226e1ab0e394962a30d247bb8de0703, group=ldap)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:56.660359 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-926cee7e-a47d-4411-9f1f-e901d4ee27c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:56.660359 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:48:56.660359 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:48:56.661920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cee7e-a47d-4411-9f1f-e901d4ee27c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:56.672925 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2109/4253] 10.222.0.76 () {58 vars in 1263 bytes} [Sat Aug 27 04:48:56 2022] GET /identity/v3/domains/a226e1ab0e394962a30d247bb8de0703/config/ldap => generated 106 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:56.674841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6bee3-0323-4db5-bd1e-4fa93fa052c8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:56.675301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6bee3-0323-4db5-bd1e-4fa93fa052c8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:56.675913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6bee3-0323-4db5-bd1e-4fa93fa052c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:56.716538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a7b6bee3-0323-4db5-bd1e-4fa93fa052c8 None None] MFA Rules not processed for user `ecae372a6933460d8acf92b44364d7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:56.718046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a7b6bee3-0323-4db5-bd1e-4fa93fa052c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:56.720603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2eb79-484b-4bf5-b92e-a1443c97109a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:56.726568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b766e19-6cb5-4f3b-9af1-3302205a6612 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '414b65a0fcbd4e2d862d29c8f943b21c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '038311d86fc14e2c9ee7080134cade60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:56.727518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b766e19-6cb5-4f3b-9af1-3302205a6612 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:56.727904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b766e19-6cb5-4f3b-9af1-3302205a6612 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:56.728526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b766e19-6cb5-4f3b-9af1-3302205a6612 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:56.729335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b766e19-6cb5-4f3b-9af1-3302205a6612 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:56.731597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b766e19-6cb5-4f3b-9af1-3302205a6612 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:56.875040 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2110/4254] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:56.877353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6bee3-0323-4db5-bd1e-4fa93fa052c8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:56.900427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6bee3-0323-4db5-bd1e-4fa93fa052c8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:56.922092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81be59-e03b-4f3c-b0fd-c9fb67d43206 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:56.922933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81be59-e03b-4f3c-b0fd-c9fb67d43206 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:56.923402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81be59-e03b-4f3c-b0fd-c9fb67d43206 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:56.923748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81be59-e03b-4f3c-b0fd-c9fb67d43206 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/a226e1ab0e394962a30d247bb8de0703/config/ldap/url` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:56.926926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81be59-e03b-4f3c-b0fd-c9fb67d43206 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=a226e1ab0e394962a30d247bb8de0703, group=ldap, option=url)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:56.928556 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2145/4255] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:56 2022] POST /identity/v3/users => generated 347 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:56.935131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81be59-e03b-4f3c-b0fd-c9fb67d43206 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:56.935609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b766e19-6cb5-4f3b-9af1-3302205a6612 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:56.948098 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2111/4256] 10.222.0.76 () {58 vars in 1275 bytes} [Sat Aug 27 04:48:56 2022] GET /identity/v3/domains/a226e1ab0e394962a30d247bb8de0703/config/ldap/url => generated 46 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:48:56.949528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81be59-e03b-4f3c-b0fd-c9fb67d43206 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:56.976819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81be59-e03b-4f3c-b0fd-c9fb67d43206 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:56.986826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8aa1ca-9c57-4860-ae12-e72a721e5a84 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '414b65a0fcbd4e2d862d29c8f943b21c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '038311d86fc14e2c9ee7080134cade60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:56.986826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8aa1ca-9c57-4860-ae12-e72a721e5a84 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:56.986826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8aa1ca-9c57-4860-ae12-e72a721e5a84 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:56.987141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8aa1ca-9c57-4860-ae12-e72a721e5a84 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:56.987141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8aa1ca-9c57-4860-ae12-e72a721e5a84 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:56.998821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8aa1ca-9c57-4860-ae12-e72a721e5a84 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:57.019208 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2112/4257] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:57.019208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8aa1ca-9c57-4860-ae12-e72a721e5a84 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:57.027020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8f8aa1ca-9c57-4860-ae12-e72a721e5a84 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:57.088587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b766e19-6cb5-4f3b-9af1-3302205a6612 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:57.100775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d6ce5-6543-47ba-ad68-598ea10d018f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:57.101574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d6ce5-6543-47ba-ad68-598ea10d018f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:57.103171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d6ce5-6543-47ba-ad68-598ea10d018f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:57.103553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d6ce5-6543-47ba-ad68-598ea10d018f admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:57.105505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d6ce5-6543-47ba-ad68-598ea10d018f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:57.109879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d6ce5-6543-47ba-ad68-598ea10d018f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:57.130180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8aa1ca-9c57-4860-ae12-e72a721e5a84 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:57.138130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:57.140063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:57.140620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:57.141122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09 admin admin] PATH_INFO: `/v3/projects/679b38eb20da4300b1e897856b7ecc69` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:57.142748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=679b38eb20da4300b1e897856b7ecc69)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:57.146470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:57.329185 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2146/4258] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:48:56 2022] POST /identity/v3/projects => generated 377 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:57.330381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d6ce5-6543-47ba-ad68-598ea10d018f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:57.412631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679b38eb20da4300b1e897856b7ecc69', 'request_id': 'req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:57.436696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679b38eb20da4300b1e897856b7ecc69', 'request_id': 'req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:57.453271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679b38eb20da4300b1e897856b7ecc69', 'request_id': 'req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:57.500417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d6ce5-6543-47ba-ad68-598ea10d018f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:57.534931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09 admin admin] The token cache is being invalidate because project 679b38eb20da4300b1e897856b7ecc69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:57.539362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:57.539362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:57.539362 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2113/4259] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:57 2022] DELETE /identity/v3/projects/679b38eb20da4300b1e897856b7ecc69 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:57.539362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:57.539732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:57.601088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db58ff-40fa-4a6f-b60b-3920bb02c779 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:57.602008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db58ff-40fa-4a6f-b60b-3920bb02c779 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:57.603262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db58ff-40fa-4a6f-b60b-3920bb02c779 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:57.603645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db58ff-40fa-4a6f-b60b-3920bb02c779 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/a226e1ab0e394962a30d247bb8de0703/config/ldap/user_tree_dn` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:57.609803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db58ff-40fa-4a6f-b60b-3920bb02c779 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=a226e1ab0e394962a30d247bb8de0703, group=ldap, option=user_tree_dn)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:57.611954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db58ff-40fa-4a6f-b60b-3920bb02c779 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:57.625360 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2147/4260] 10.222.0.76 () {58 vars in 1302 bytes} [Sat Aug 27 04:48:57 2022] GET /identity/v3/domains/a226e1ab0e394962a30d247bb8de0703/config/ldap/user_tree_dn => generated 63 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:48:57.630550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db58ff-40fa-4a6f-b60b-3920bb02c779 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:57.641498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-77db58ff-40fa-4a6f-b60b-3920bb02c779 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:57.674381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e59e0a-07a2-4aaa-8ba6-5dd4c9c37b09 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:57.681257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813f142-bfaa-410b-a050-e3e195c19b79 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '414b65a0fcbd4e2d862d29c8f943b21c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '038311d86fc14e2c9ee7080134cade60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:57.682144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813f142-bfaa-410b-a050-e3e195c19b79 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:57.682434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813f142-bfaa-410b-a050-e3e195c19b79 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:57.682819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813f142-bfaa-410b-a050-e3e195c19b79 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] PATH_INFO: `/v3/projects/09e58c2984564949994b1ea1a55f1540/users/98551f5d2bee492596b25260f1f0ba8b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:57.711124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813f142-bfaa-410b-a050-e3e195c19b79 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorizing `identity:create_grant(project_id=09e58c2984564949994b1ea1a55f1540, user_id=98551f5d2bee492596b25260f1f0ba8b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:57.717016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813f142-bfaa-410b-a050-e3e195c19b79 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:57.793836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db58ff-40fa-4a6f-b60b-3920bb02c779 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:57.805980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6d2f8-9d5a-466f-b1f2-0828597e8062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:57.806724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d2f8-9d5a-466f-b1f2-0828597e8062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:57.807012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d2f8-9d5a-466f-b1f2-0828597e8062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:57.807288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d2f8-9d5a-466f-b1f2-0828597e8062 admin admin] PATH_INFO: `/v3/projects/ed7dcec401394866b7d9fdacb5e294dc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:57.811385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6d2f8-9d5a-466f-b1f2-0828597e8062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed7dcec401394866b7d9fdacb5e294dc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:57.815760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6d2f8-9d5a-466f-b1f2-0828597e8062 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:57.859954 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2114/4261] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:57 2022] PUT /identity/v3/projects/09e58c2984564949994b1ea1a55f1540/users/98551f5d2bee492596b25260f1f0ba8b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:57.861364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813f142-bfaa-410b-a050-e3e195c19b79 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:57.865145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c813f142-bfaa-410b-a050-e3e195c19b79 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:58.028307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-feb6d2f8-9d5a-466f-b1f2-0828597e8062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed7dcec401394866b7d9fdacb5e294dc', 'request_id': 'req-feb6d2f8-9d5a-466f-b1f2-0828597e8062'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:58.037262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-feb6d2f8-9d5a-466f-b1f2-0828597e8062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed7dcec401394866b7d9fdacb5e294dc', 'request_id': 'req-feb6d2f8-9d5a-466f-b1f2-0828597e8062'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:58.060969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813f142-bfaa-410b-a050-e3e195c19b79 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:58.114823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-feb6d2f8-9d5a-466f-b1f2-0828597e8062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed7dcec401394866b7d9fdacb5e294dc', 'request_id': 'req-feb6d2f8-9d5a-466f-b1f2-0828597e8062'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:58.129618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-feb6d2f8-9d5a-466f-b1f2-0828597e8062 admin admin] The token cache is being invalidate because project ed7dcec401394866b7d9fdacb5e294dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:48:58.129867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213fd1a-d870-4f2a-8a3e-ad9549cef47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:58.130068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-feb6d2f8-9d5a-466f-b1f2-0828597e8062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:58.130572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213fd1a-d870-4f2a-8a3e-ad9549cef47b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:58.130846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213fd1a-d870-4f2a-8a3e-ad9549cef47b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:58.131008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-feb6d2f8-9d5a-466f-b1f2-0828597e8062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:58.131119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213fd1a-d870-4f2a-8a3e-ad9549cef47b admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:58.131738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213fd1a-d870-4f2a-8a3e-ad9549cef47b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:58.133122 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2148/4262] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:48:57 2022] DELETE /identity/v3/projects/ed7dcec401394866b7d9fdacb5e294dc => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:58.134042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6d2f8-9d5a-466f-b1f2-0828597e8062 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:58.135642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-feb6d2f8-9d5a-466f-b1f2-0828597e8062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:58.137287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213fd1a-d870-4f2a-8a3e-ad9549cef47b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:58.155489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6d2f8-9d5a-466f-b1f2-0828597e8062 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:58.161374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f35795-6f78-4eed-b4d1-21d9d259b0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:58.161614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35795-6f78-4eed-b4d1-21d9d259b0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:58.161946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35795-6f78-4eed-b4d1-21d9d259b0af admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:58.162295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35795-6f78-4eed-b4d1-21d9d259b0af admin admin] PATH_INFO: `/v3/users/d06115633c554812836abc61cfce529f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:58.163515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f35795-6f78-4eed-b4d1-21d9d259b0af admin admin] RBAC: Authorizing `identity:delete_user(user_id=d06115633c554812836abc61cfce529f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:58.165562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f35795-6f78-4eed-b4d1-21d9d259b0af admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:58.273297 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2115/4263] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:48:57 2022] POST /identity/v3/users => generated 295 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:48:58.274542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213fd1a-d870-4f2a-8a3e-ad9549cef47b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:58.277441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7213fd1a-d870-4f2a-8a3e-ad9549cef47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:58.428226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d5f35795-6f78-4eed-b4d1-21d9d259b0af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd06115633c554812836abc61cfce529f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:58.429523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d5f35795-6f78-4eed-b4d1-21d9d259b0af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd06115633c554812836abc61cfce529f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:58.443350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213fd1a-d870-4f2a-8a3e-ad9549cef47b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:58.448339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcd597-774c-456f-b53b-7859490e6da4 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:58.449097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd597-774c-456f-b53b-7859490e6da4 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:58.449379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd597-774c-456f-b53b-7859490e6da4 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:58.449655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd597-774c-456f-b53b-7859490e6da4 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/a226e1ab0e394962a30d247bb8de0703/config` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:58.452145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcd597-774c-456f-b53b-7859490e6da4 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=a226e1ab0e394962a30d247bb8de0703)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:58.453611 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-93dcd597-774c-456f-b53b-7859490e6da4 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:58.453611 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:48:58.453611 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:48:58.454209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcd597-774c-456f-b53b-7859490e6da4 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:58.575853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d5f35795-6f78-4eed-b4d1-21d9d259b0af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd06115633c554812836abc61cfce529f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:58.577832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d5f35795-6f78-4eed-b4d1-21d9d259b0af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd06115633c554812836abc61cfce529f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:58.593621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d5f35795-6f78-4eed-b4d1-21d9d259b0af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd06115633c554812836abc61cfce529f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:58.614859 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2149/4264] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:58 2022] DELETE /identity/v3/users/d06115633c554812836abc61cfce529f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:58.616299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e554b9-b042-4464-af55-cf5f9a728cef None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:58.617141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e554b9-b042-4464-af55-cf5f9a728cef None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:58.617431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e554b9-b042-4464-af55-cf5f9a728cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:58.636487 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2116/4265] 10.222.0.76 () {58 vars in 1251 bytes} [Sat Aug 27 04:48:58 2022] DELETE /identity/v3/domains/a226e1ab0e394962a30d247bb8de0703/config => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:58.639632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcd597-774c-456f-b53b-7859490e6da4 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:58.650247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-93dcd597-774c-456f-b53b-7859490e6da4 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:58.657098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:58.676205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcd597-774c-456f-b53b-7859490e6da4 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:58.754772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bbd76-3279-439f-b78a-7d702127b30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:58.755874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bbd76-3279-439f-b78a-7d702127b30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:58.755874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bbd76-3279-439f-b78a-7d702127b30c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:58.756115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bbd76-3279-439f-b78a-7d702127b30c admin admin] PATH_INFO: `/v3/users/b45883d3057142c3b5eac714e26e27b6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:58.757958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bbd76-3279-439f-b78a-7d702127b30c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45883d3057142c3b5eac714e26e27b6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:58.760058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bbd76-3279-439f-b78a-7d702127b30c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:58.875420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-86e554b9-b042-4464-af55-cf5f9a728cef None None] MFA Rules not processed for user `98551f5d2bee492596b25260f1f0ba8b`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:58.885127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-86e554b9-b042-4464-af55-cf5f9a728cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:58.908461 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2150/4266] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:58.909650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e554b9-b042-4464-af55-cf5f9a728cef None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:58.920728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-86e554b9-b042-4464-af55-cf5f9a728cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:58.952768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e554b9-b042-4464-af55-cf5f9a728cef None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:58.963572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1fe5b-6f22-44a2-bb41-ff8bc3968160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:58.964615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1fe5b-6f22-44a2-bb41-ff8bc3968160 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:58.968476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1fe5b-6f22-44a2-bb41-ff8bc3968160 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:58.969256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1fe5b-6f22-44a2-bb41-ff8bc3968160 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:58.969570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1fe5b-6f22-44a2-bb41-ff8bc3968160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:58.972622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1fe5b-6f22-44a2-bb41-ff8bc3968160 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:58.988919 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2151/4267] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:48:58.988919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1fe5b-6f22-44a2-bb41-ff8bc3968160 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:58.999748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-43f1fe5b-6f22-44a2-bb41-ff8bc3968160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:59.035774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:48:59.093001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d26bbd76-3279-439f-b78a-7d702127b30c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45883d3057142c3b5eac714e26e27b6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:59.095983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1fe5b-6f22-44a2-bb41-ff8bc3968160 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:59.100917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea599ab3-e501-4019-a2e6-a06f93270985 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:59.101774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea599ab3-e501-4019-a2e6-a06f93270985 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:59.102097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea599ab3-e501-4019-a2e6-a06f93270985 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:59.102461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea599ab3-e501-4019-a2e6-a06f93270985 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/a226e1ab0e394962a30d247bb8de0703` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:59.103838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea599ab3-e501-4019-a2e6-a06f93270985 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a226e1ab0e394962a30d247bb8de0703)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:59.105023 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-ea599ab3-e501-4019-a2e6-a06f93270985 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:59.105023 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:48:59.105023 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:48:59.106173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea599ab3-e501-4019-a2e6-a06f93270985 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:59.139550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ea599ab3-e501-4019-a2e6-a06f93270985 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a226e1ab0e394962a30d247bb8de0703'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:59.140786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ea599ab3-e501-4019-a2e6-a06f93270985 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a226e1ab0e394962a30d247bb8de0703'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:59.236455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d26bbd76-3279-439f-b78a-7d702127b30c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45883d3057142c3b5eac714e26e27b6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:59.237215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d26bbd76-3279-439f-b78a-7d702127b30c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45883d3057142c3b5eac714e26e27b6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:59.247850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d26bbd76-3279-439f-b78a-7d702127b30c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45883d3057142c3b5eac714e26e27b6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:59.285540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d26bbd76-3279-439f-b78a-7d702127b30c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45883d3057142c3b5eac714e26e27b6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:59.303289 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2117/4268] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:48:58 2022] DELETE /identity/v3/users/b45883d3057142c3b5eac714e26e27b6 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:59.307941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb11f05-527c-4d14-a214-046d14a486b6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:59.308258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb11f05-527c-4d14-a214-046d14a486b6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:59.308736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb11f05-527c-4d14-a214-046d14a486b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:59.354643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ea599ab3-e501-4019-a2e6-a06f93270985 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a226e1ab0e394962a30d247bb8de0703'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:59.359243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ea599ab3-e501-4019-a2e6-a06f93270985 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a226e1ab0e394962a30d247bb8de0703'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:59.378945 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2152/4269] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:48:58 2022] PATCH /identity/v3/domains/a226e1ab0e394962a30d247bb8de0703 => generated 276 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:48:59.384277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea599ab3-e501-4019-a2e6-a06f93270985 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:59.386616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ea599ab3-e501-4019-a2e6-a06f93270985 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:59.518833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4bb11f05-527c-4d14-a214-046d14a486b6 None None] MFA Rules not processed for user `98551f5d2bee492596b25260f1f0ba8b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:48:59.520140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4bb11f05-527c-4d14-a214-046d14a486b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:59.530180 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2118/4270] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:48:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:48:59.531263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb11f05-527c-4d14-a214-046d14a486b6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:59.542670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea599ab3-e501-4019-a2e6-a06f93270985 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:59.550767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4bb11f05-527c-4d14-a214-046d14a486b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:48:59.676188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776fac5-ecd7-450f-b6a1-f9d7fc6c1c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:59.676874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776fac5-ecd7-450f-b6a1-f9d7fc6c1c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:59.677279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776fac5-ecd7-450f-b6a1-f9d7fc6c1c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:59.677451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776fac5-ecd7-450f-b6a1-f9d7fc6c1c25 admin admin] PATH_INFO: `/v3/projects/3ccc4e90fbad4545aa8f905a7a6fa5fd/users/d0800b393bf04b7f89216157897ace6d/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:59.688573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb11f05-527c-4d14-a214-046d14a486b6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:59.698627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:48:59.699390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:48:59.699680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:48:59.700847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/a226e1ab0e394962a30d247bb8de0703` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:48:59.709824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776fac5-ecd7-450f-b6a1-f9d7fc6c1c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ccc4e90fbad4545aa8f905a7a6fa5fd, user_id=d0800b393bf04b7f89216157897ace6d, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:59.716766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776fac5-ecd7-450f-b6a1-f9d7fc6c1c25 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:59.726765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a226e1ab0e394962a30d247bb8de0703)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:48:59.727889 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:59.727889 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:48:59.727889 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:48:59.729387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:48:59.762409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a226e1ab0e394962a30d247bb8de0703'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:59.772914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a226e1ab0e394962a30d247bb8de0703'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:48:59.825187 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2153/4271] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:48:59 2022] PUT /identity/v3/projects/3ccc4e90fbad4545aa8f905a7a6fa5fd/users/d0800b393bf04b7f89216157897ace6d/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:48:59.830720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776fac5-ecd7-450f-b6a1-f9d7fc6c1c25 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:48:59.956193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776fac5-ecd7-450f-b6a1-f9d7fc6c1c25 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:48:59.984991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a226e1ab0e394962a30d247bb8de0703', 'request_id': 'req-304da103-0c96-4919-b16d-906a3ac487c8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.001186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a226e1ab0e394962a30d247bb8de0703', 'request_id': 'req-304da103-0c96-4919-b16d-906a3ac487c8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.018522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a226e1ab0e394962a30d247bb8de0703', 'request_id': 'req-304da103-0c96-4919-b16d-906a3ac487c8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.030462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:00.079718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb743eb-f07f-4953-b83d-a6d76ce6d5f1 tempest-test_project-1249730718 tempest-user-557347162] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98551f5d2bee492596b25260f1f0ba8b', 'user_domain_id': 'abf5ac8310004b38a09f5becbe7d33fe', 'system_scope': None, 'project_id': '09e58c2984564949994b1ea1a55f1540', 'project_domain_id': 'abf5ac8310004b38a09f5becbe7d33fe', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:00.080381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb743eb-f07f-4953-b83d-a6d76ce6d5f1 tempest-test_project-1249730718 tempest-user-557347162] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:00.080661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb743eb-f07f-4953-b83d-a6d76ce6d5f1 tempest-test_project-1249730718 tempest-user-557347162] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:00.080930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb743eb-f07f-4953-b83d-a6d76ce6d5f1 tempest-test_project-1249730718 tempest-user-557347162] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:00.092824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb743eb-f07f-4953-b83d-a6d76ce6d5f1 tempest-test_project-1249730718 tempest-user-557347162] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:00.094695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb743eb-f07f-4953-b83d-a6d76ce6d5f1 tempest-test_project-1249730718 tempest-user-557347162] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:00.105378 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2154/4272] 10.222.0.76 () {56 vars in 1284 bytes} [Sat Aug 27 04:48:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:00.106249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb743eb-f07f-4953-b83d-a6d76ce6d5f1 tempest-test_project-1249730718 tempest-user-557347162] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:00.192666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb743eb-f07f-4953-b83d-a6d76ce6d5f1 tempest-test_project-1249730718 tempest-user-557347162] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:00.198376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775051f-281e-483e-950a-6ab91b4537fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:00.199157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775051f-281e-483e-950a-6ab91b4537fe admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:00.199884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775051f-281e-483e-950a-6ab91b4537fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:00.199884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775051f-281e-483e-950a-6ab91b4537fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:00.214651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775051f-281e-483e-950a-6ab91b4537fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:00.214651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775051f-281e-483e-950a-6ab91b4537fe admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:00.219132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] The token cache is being invalidate because project a226e1ab0e394962a30d247bb8de0703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:00.220576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.221966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.233320 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2155/4273] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:00.234750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa0206-9862-4854-9a8c-4f9b5a12cf24 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:00.235096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa0206-9862-4854-9a8c-4f9b5a12cf24 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:00.235617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa0206-9862-4854-9a8c-4f9b5a12cf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:00.255012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a226e1ab0e394962a30d247bb8de0703', 'request_id': 'req-304da103-0c96-4919-b16d-906a3ac487c8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.262928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a226e1ab0e394962a30d247bb8de0703', 'request_id': 'req-304da103-0c96-4919-b16d-906a3ac487c8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.264492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a226e1ab0e394962a30d247bb8de0703', 'request_id': 'req-304da103-0c96-4919-b16d-906a3ac487c8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.277274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-15aa0206-9862-4854-9a8c-4f9b5a12cf24 None None] MFA Rules not processed for user `c6607c92756d413c8adeef9947ede94d`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:00.282157 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2119/4274] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:48:59 2022] DELETE /identity/v3/domains/a226e1ab0e394962a30d247bb8de0703 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:00.289062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-15aa0206-9862-4854-9a8c-4f9b5a12cf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:00.289305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:00.289673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:00.296240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:00.384752 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2156/4275] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:00.385655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa0206-9862-4854-9a8c-4f9b5a12cf24 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:00.387336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-15aa0206-9862-4854-9a8c-4f9b5a12cf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:00.405019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa0206-9862-4854-9a8c-4f9b5a12cf24 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:00.417815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:00.419397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:00.421310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:00.421939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18 admin admin] PATH_INFO: `/v3/projects/3b923435d495448f824f6b9d674946ab` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:00.423509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b923435d495448f824f6b9d674946ab)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:00.427738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:00.452321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304da103-0c96-4919-b16d-906a3ac487c8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:00.459461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a50ee-8a4f-4f7f-a574-2854b0227474 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '414b65a0fcbd4e2d862d29c8f943b21c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '038311d86fc14e2c9ee7080134cade60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:00.460139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a50ee-8a4f-4f7f-a574-2854b0227474 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:00.460483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a50ee-8a4f-4f7f-a574-2854b0227474 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:00.460816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a50ee-8a4f-4f7f-a574-2854b0227474 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] PATH_INFO: `/v3/users/98551f5d2bee492596b25260f1f0ba8b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:00.462086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a50ee-8a4f-4f7f-a574-2854b0227474 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorizing `identity:delete_user(user_id=98551f5d2bee492596b25260f1f0ba8b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:00.467022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a50ee-8a4f-4f7f-a574-2854b0227474 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:00.671681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b923435d495448f824f6b9d674946ab', 'request_id': 'req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.679948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b923435d495448f824f6b9d674946ab', 'request_id': 'req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.807607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b923435d495448f824f6b9d674946ab', 'request_id': 'req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.828374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c19a50ee-8a4f-4f7f-a574-2854b0227474 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98551f5d2bee492596b25260f1f0ba8b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.829868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18 admin admin] The token cache is being invalidate because project 3b923435d495448f824f6b9d674946ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:00.831887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.840326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.860571 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2157/4276] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:00 2022] DELETE /identity/v3/projects/3b923435d495448f824f6b9d674946ab => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:00.861907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:00.868712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:00.898009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c19a50ee-8a4f-4f7f-a574-2854b0227474 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98551f5d2bee492596b25260f1f0ba8b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.899504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c19a50ee-8a4f-4f7f-a574-2854b0227474 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98551f5d2bee492596b25260f1f0ba8b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.913246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c19a50ee-8a4f-4f7f-a574-2854b0227474 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98551f5d2bee492596b25260f1f0ba8b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.930043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c19a50ee-8a4f-4f7f-a574-2854b0227474 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98551f5d2bee492596b25260f1f0ba8b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:00.941735 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2120/4277] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:00 2022] DELETE /identity/v3/users/98551f5d2bee492596b25260f1f0ba8b => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:00.943807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a50ee-8a4f-4f7f-a574-2854b0227474 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:00.945841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c19a50ee-8a4f-4f7f-a574-2854b0227474 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:00.957153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3084a8-9cc8-45cc-9126-84e8a7a98a18 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:01.047792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cd0bf-9182-4f21-ae24-85ad53cf3437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:01.048825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cd0bf-9182-4f21-ae24-85ad53cf3437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:01.053901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cd0bf-9182-4f21-ae24-85ad53cf3437 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:01.053901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cd0bf-9182-4f21-ae24-85ad53cf3437 admin admin] PATH_INFO: `/v3/projects/fd2ed0782b9e4a23842ea96bdc018090` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:01.053901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cd0bf-9182-4f21-ae24-85ad53cf3437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2ed0782b9e4a23842ea96bdc018090)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:01.054269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cd0bf-9182-4f21-ae24-85ad53cf3437 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:01.058976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a50ee-8a4f-4f7f-a574-2854b0227474 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:01.068846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5ba64-5228-4d6c-a59e-493c4b6bc31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:01.070176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5ba64-5228-4d6c-a59e-493c4b6bc31a admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:01.071169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5ba64-5228-4d6c-a59e-493c4b6bc31a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:01.071871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5ba64-5228-4d6c-a59e-493c4b6bc31a admin admin] PATH_INFO: `/v3/projects/3ccc4e90fbad4545aa8f905a7a6fa5fd/users/d0800b393bf04b7f89216157897ace6d/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:01.074795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5ba64-5228-4d6c-a59e-493c4b6bc31a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ccc4e90fbad4545aa8f905a7a6fa5fd, user_id=d0800b393bf04b7f89216157897ace6d, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:01.080372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5ba64-5228-4d6c-a59e-493c4b6bc31a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:01.088060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=84,keystone:UPDATE=3,keystone:INSERT=8,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:01.100109 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2121/4278] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:00 2022] PUT /identity/v3/projects/3ccc4e90fbad4545aa8f905a7a6fa5fd/users/d0800b393bf04b7f89216157897ace6d/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:01.101383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5ba64-5228-4d6c-a59e-493c4b6bc31a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:01.106382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-faf5ba64-5228-4d6c-a59e-493c4b6bc31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:01.192930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7f2cd0bf-9182-4f21-ae24-85ad53cf3437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2ed0782b9e4a23842ea96bdc018090', 'request_id': 'req-7f2cd0bf-9182-4f21-ae24-85ad53cf3437'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:01.204031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7f2cd0bf-9182-4f21-ae24-85ad53cf3437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2ed0782b9e4a23842ea96bdc018090', 'request_id': 'req-7f2cd0bf-9182-4f21-ae24-85ad53cf3437'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:01.214398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5ba64-5228-4d6c-a59e-493c4b6bc31a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:01.286591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca62c4-655e-4f40-8553-f90cfec8ff68 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:01.287339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca62c4-655e-4f40-8553-f90cfec8ff68 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:01.287633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca62c4-655e-4f40-8553-f90cfec8ff68 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:01.287764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca62c4-655e-4f40-8553-f90cfec8ff68 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:01.288497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca62c4-655e-4f40-8553-f90cfec8ff68 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:01.289115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7f2cd0bf-9182-4f21-ae24-85ad53cf3437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2ed0782b9e4a23842ea96bdc018090', 'request_id': 'req-7f2cd0bf-9182-4f21-ae24-85ad53cf3437'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:01.290349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca62c4-655e-4f40-8553-f90cfec8ff68 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:01.309343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7f2cd0bf-9182-4f21-ae24-85ad53cf3437 admin admin] The token cache is being invalidate because project fd2ed0782b9e4a23842ea96bdc018090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:01.310037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7f2cd0bf-9182-4f21-ae24-85ad53cf3437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:01.311147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7f2cd0bf-9182-4f21-ae24-85ad53cf3437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:01.314442 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2158/4279] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:00 2022] DELETE /identity/v3/projects/fd2ed0782b9e4a23842ea96bdc018090 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:01.316530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d790b-5838-4bd2-9618-7bd8e47e077e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:01.317690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d790b-5838-4bd2-9618-7bd8e47e077e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:01.318196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d790b-5838-4bd2-9618-7bd8e47e077e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:01.344395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-444d790b-5838-4bd2-9618-7bd8e47e077e None None] MFA Rules not processed for user `c6607c92756d413c8adeef9947ede94d`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:01.345802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-444d790b-5838-4bd2-9618-7bd8e47e077e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:01.431885 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2159/4280] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:01.431885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d790b-5838-4bd2-9618-7bd8e47e077e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:01.438359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-444d790b-5838-4bd2-9618-7bd8e47e077e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:01.446000 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2122/4281] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:49:01 2022] POST /identity/v3/domains => generated 276 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:01.447327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8e98-c2b9-46e1-9924-7654eee00c37 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:01.447611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8e98-c2b9-46e1-9924-7654eee00c37 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:01.447941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8e98-c2b9-46e1-9924-7654eee00c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:01.490264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ef4a8e98-c2b9-46e1-9924-7654eee00c37 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:01.505446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ef4a8e98-c2b9-46e1-9924-7654eee00c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:01.543845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d790b-5838-4bd2-9618-7bd8e47e077e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:01.593136 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2123/4282] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:01.594519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a8e98-c2b9-46e1-9924-7654eee00c37 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:01.602304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ef4a8e98-c2b9-46e1-9924-7654eee00c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:01.620616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39340aa1-b4ec-4532-b550-bebae9e4888b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:01.621522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39340aa1-b4ec-4532-b550-bebae9e4888b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:01.622644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39340aa1-b4ec-4532-b550-bebae9e4888b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:01.622965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39340aa1-b4ec-4532-b550-bebae9e4888b admin admin] PATH_INFO: `/v3/users/12d8710270d44c65bf86cc42b692a43a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:01.625128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39340aa1-b4ec-4532-b550-bebae9e4888b admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d8710270d44c65bf86cc42b692a43a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:01.627062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39340aa1-b4ec-4532-b550-bebae9e4888b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:01.699751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a8e98-c2b9-46e1-9924-7654eee00c37 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:01.711067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898a7bf-2b37-496e-84ae-692ca4ff5402 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '414b65a0fcbd4e2d862d29c8f943b21c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '038311d86fc14e2c9ee7080134cade60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:01.712006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898a7bf-2b37-496e-84ae-692ca4ff5402 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:01.712330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898a7bf-2b37-496e-84ae-692ca4ff5402 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:01.712748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898a7bf-2b37-496e-84ae-692ca4ff5402 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] PATH_INFO: `/v3/projects/09e58c2984564949994b1ea1a55f1540` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:01.713965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898a7bf-2b37-496e-84ae-692ca4ff5402 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorizing `identity:delete_project(project_id=09e58c2984564949994b1ea1a55f1540)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:01.717911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898a7bf-2b37-496e-84ae-692ca4ff5402 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:01.986674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-39340aa1-b4ec-4532-b550-bebae9e4888b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d8710270d44c65bf86cc42b692a43a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:01.987553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-39340aa1-b4ec-4532-b550-bebae9e4888b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d8710270d44c65bf86cc42b692a43a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:01.992268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c898a7bf-2b37-496e-84ae-692ca4ff5402 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e58c2984564949994b1ea1a55f1540', 'request_id': 'req-c898a7bf-2b37-496e-84ae-692ca4ff5402'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:02.002490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c898a7bf-2b37-496e-84ae-692ca4ff5402 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e58c2984564949994b1ea1a55f1540', 'request_id': 'req-c898a7bf-2b37-496e-84ae-692ca4ff5402'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:02.009405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c898a7bf-2b37-496e-84ae-692ca4ff5402 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e58c2984564949994b1ea1a55f1540', 'request_id': 'req-c898a7bf-2b37-496e-84ae-692ca4ff5402'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:02.110820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-39340aa1-b4ec-4532-b550-bebae9e4888b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d8710270d44c65bf86cc42b692a43a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:02.111811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-39340aa1-b4ec-4532-b550-bebae9e4888b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d8710270d44c65bf86cc42b692a43a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:02.130219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-39340aa1-b4ec-4532-b550-bebae9e4888b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d8710270d44c65bf86cc42b692a43a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:02.147986 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2160/4283] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:01 2022] DELETE /identity/v3/users/12d8710270d44c65bf86cc42b692a43a => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:02.147986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c68fc-8ff5-4b4d-8a8c-52bd369dd1fc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:02.147986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c68fc-8ff5-4b4d-8a8c-52bd369dd1fc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:02.147986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c68fc-8ff5-4b4d-8a8c-52bd369dd1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:02.179696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-088c68fc-8ff5-4b4d-8a8c-52bd369dd1fc None None] MFA Rules not processed for user `d0800b393bf04b7f89216157897ace6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:02.181480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-088c68fc-8ff5-4b4d-8a8c-52bd369dd1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:02.242317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c898a7bf-2b37-496e-84ae-692ca4ff5402 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] The token cache is being invalidate because project 09e58c2984564949994b1ea1a55f1540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:02.244469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c898a7bf-2b37-496e-84ae-692ca4ff5402 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:02.244469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c898a7bf-2b37-496e-84ae-692ca4ff5402 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:02.248949 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2124/4284] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:01 2022] DELETE /identity/v3/projects/09e58c2984564949994b1ea1a55f1540 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:02.250420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8602717-7ae5-46eb-94fe-2a39b1ff260e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:02.250866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8602717-7ae5-46eb-94fe-2a39b1ff260e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:02.251245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8602717-7ae5-46eb-94fe-2a39b1ff260e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:02.274738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a8602717-7ae5-46eb-94fe-2a39b1ff260e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:02.277053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a8602717-7ae5-46eb-94fe-2a39b1ff260e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:02.311011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:02.312002 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2161/4285] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:02.312849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c68fc-8ff5-4b4d-8a8c-52bd369dd1fc None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:02.314398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-088c68fc-8ff5-4b4d-8a8c-52bd369dd1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:02.393473 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2125/4286] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:02.394217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8602717-7ae5-46eb-94fe-2a39b1ff260e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:02.395707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a8602717-7ae5-46eb-94fe-2a39b1ff260e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:02.454546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c68fc-8ff5-4b4d-8a8c-52bd369dd1fc None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:02.467074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01900e-a57c-42ef-b5e6-2f8d8f5e54bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:02.468379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01900e-a57c-42ef-b5e6-2f8d8f5e54bf service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:02.468379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01900e-a57c-42ef-b5e6-2f8d8f5e54bf service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:02.468379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01900e-a57c-42ef-b5e6-2f8d8f5e54bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:02.474035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0e01900e-a57c-42ef-b5e6-2f8d8f5e54bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:02.503101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8602717-7ae5-46eb-94fe-2a39b1ff260e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:02.508271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e79e8-365c-4b9b-8708-027ea0bc71a0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:02.509143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e79e8-365c-4b9b-8708-027ea0bc71a0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:02.509623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e79e8-365c-4b9b-8708-027ea0bc71a0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:02.510061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e79e8-365c-4b9b-8708-027ea0bc71a0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/161e308893f2437b8e1f2dcae593a34f/config` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:02.510905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e79e8-365c-4b9b-8708-027ea0bc71a0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=161e308893f2437b8e1f2dcae593a34f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:02.513072 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-781e79e8-365c-4b9b-8708-027ea0bc71a0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:02.513072 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:49:02.513072 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:49:02.514728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e79e8-365c-4b9b-8708-027ea0bc71a0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:02.581127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01900e-a57c-42ef-b5e6-2f8d8f5e54bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:02.583041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01900e-a57c-42ef-b5e6-2f8d8f5e54bf service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:02.593714 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2162/4287] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:02.595312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e512fb6-cad8-4919-8eb8-a168384a9326 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:02.595696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e512fb6-cad8-4919-8eb8-a168384a9326 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:02.596072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e512fb6-cad8-4919-8eb8-a168384a9326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:02.620333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8e512fb6-cad8-4919-8eb8-a168384a9326 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:02.621875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8e512fb6-cad8-4919-8eb8-a168384a9326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:02.635188 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2163/4288] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:02.636358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e512fb6-cad8-4919-8eb8-a168384a9326 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:02.639130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8e512fb6-cad8-4919-8eb8-a168384a9326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:02.678211 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2126/4289] 10.222.0.76 () {60 vars in 1269 bytes} [Sat Aug 27 04:49:02 2022] PUT /identity/v3/domains/161e308893f2437b8e1f2dcae593a34f/config => generated 138 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:02.679640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e79e8-365c-4b9b-8708-027ea0bc71a0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:02.691025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-781e79e8-365c-4b9b-8708-027ea0bc71a0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:02.776293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e512fb6-cad8-4919-8eb8-a168384a9326 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:02.786624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5f286-c85d-4bf8-9301-f80d896c6fe3 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '414b65a0fcbd4e2d862d29c8f943b21c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '038311d86fc14e2c9ee7080134cade60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:02.789485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5f286-c85d-4bf8-9301-f80d896c6fe3 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:02.789818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5f286-c85d-4bf8-9301-f80d896c6fe3 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:02.790047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5f286-c85d-4bf8-9301-f80d896c6fe3 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] PATH_INFO: `/v3/domains/abf5ac8310004b38a09f5becbe7d33fe` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:02.796406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e79e8-365c-4b9b-8708-027ea0bc71a0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:02.798216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5f286-c85d-4bf8-9301-f80d896c6fe3 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=abf5ac8310004b38a09f5becbe7d33fe)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:02.799873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5f286-c85d-4bf8-9301-f80d896c6fe3 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:02.800639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529ee3a-8fd7-40c7-9872-3f94566dd8b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:02.801485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529ee3a-8fd7-40c7-9872-3f94566dd8b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:02.802561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529ee3a-8fd7-40c7-9872-3f94566dd8b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:02.802861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529ee3a-8fd7-40c7-9872-3f94566dd8b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:02.829005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cfe5f286-c85d-4bf8-9301-f80d896c6fe3 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'abf5ac8310004b38a09f5becbe7d33fe'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:02.829777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cfe5f286-c85d-4bf8-9301-f80d896c6fe3 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'abf5ac8310004b38a09f5becbe7d33fe'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:02.833483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529ee3a-8fd7-40c7-9872-3f94566dd8b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:02.834974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529ee3a-8fd7-40c7-9872-3f94566dd8b3 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:02.866014 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2127/4290] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:02.867754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80ac49-4380-47b2-b563-b0fcfa850f72 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:02.868321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80ac49-4380-47b2-b563-b0fcfa850f72 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:02.868963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80ac49-4380-47b2-b563-b0fcfa850f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:02.918465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4c80ac49-4380-47b2-b563-b0fcfa850f72 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:02.919757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4c80ac49-4380-47b2-b563-b0fcfa850f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:02.986768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cfe5f286-c85d-4bf8-9301-f80d896c6fe3 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'abf5ac8310004b38a09f5becbe7d33fe'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:02.987405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cfe5f286-c85d-4bf8-9301-f80d896c6fe3 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'abf5ac8310004b38a09f5becbe7d33fe'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:02.993012 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2164/4291] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:49:02 2022] PATCH /identity/v3/domains/abf5ac8310004b38a09f5becbe7d33fe => generated 247 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:02.993881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5f286-c85d-4bf8-9301-f80d896c6fe3 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:03.004018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cfe5f286-c85d-4bf8-9301-f80d896c6fe3 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:03.088308 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2128/4292] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:03.091879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80ac49-4380-47b2-b563-b0fcfa850f72 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:03.095352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4c80ac49-4380-47b2-b563-b0fcfa850f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:03.103338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5f286-c85d-4bf8-9301-f80d896c6fe3 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:03.108517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80ac49-4380-47b2-b563-b0fcfa850f72 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:03.110523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931af59-5719-40a1-8389-865bd5535e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:03.111983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931af59-5719-40a1-8389-865bd5535e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:03.112291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931af59-5719-40a1-8389-865bd5535e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:03.113166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931af59-5719-40a1-8389-865bd5535e3f admin admin] PATH_INFO: `/v3/projects/cc707bf026bb4d4dbe29de3711e3f223` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:03.114261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4db15-2de8-4008-9bfd-75d3196cae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:03.115108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4db15-2de8-4008-9bfd-75d3196cae34 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:03.115229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931af59-5719-40a1-8389-865bd5535e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc707bf026bb4d4dbe29de3711e3f223)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:03.115642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4db15-2de8-4008-9bfd-75d3196cae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:03.116064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4db15-2de8-4008-9bfd-75d3196cae34 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:03.116899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4db15-2de8-4008-9bfd-75d3196cae34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:03.117374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4db15-2de8-4008-9bfd-75d3196cae34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:03.117745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931af59-5719-40a1-8389-865bd5535e3f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:03.119766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4db15-2de8-4008-9bfd-75d3196cae34 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:03.134466 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2129/4293] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:03.135683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4db15-2de8-4008-9bfd-75d3196cae34 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:03.140305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c4c4db15-2de8-4008-9bfd-75d3196cae34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:03.267730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4db15-2de8-4008-9bfd-75d3196cae34 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:03.274221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01210e37-bf44-4d5d-8bc7-ae2cf5960db6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:03.275470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01210e37-bf44-4d5d-8bc7-ae2cf5960db6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:03.275470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01210e37-bf44-4d5d-8bc7-ae2cf5960db6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:03.276223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01210e37-bf44-4d5d-8bc7-ae2cf5960db6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/161e308893f2437b8e1f2dcae593a34f/config` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:03.277038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01210e37-bf44-4d5d-8bc7-ae2cf5960db6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=161e308893f2437b8e1f2dcae593a34f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:03.278175 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-01210e37-bf44-4d5d-8bc7-ae2cf5960db6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:03.278175 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:49:03.278175 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:49:03.279879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01210e37-bf44-4d5d-8bc7-ae2cf5960db6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:03.338628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7931af59-5719-40a1-8389-865bd5535e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc707bf026bb4d4dbe29de3711e3f223', 'request_id': 'req-7931af59-5719-40a1-8389-865bd5535e3f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:03.350244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7931af59-5719-40a1-8389-865bd5535e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc707bf026bb4d4dbe29de3711e3f223', 'request_id': 'req-7931af59-5719-40a1-8389-865bd5535e3f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:03.489016 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2130/4294] 10.222.0.76 () {60 vars in 1271 bytes} [Sat Aug 27 04:49:03 2022] PATCH /identity/v3/domains/161e308893f2437b8e1f2dcae593a34f/config => generated 141 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:03.489016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01210e37-bf44-4d5d-8bc7-ae2cf5960db6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:03.493879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-01210e37-bf44-4d5d-8bc7-ae2cf5960db6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:03.562490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7931af59-5719-40a1-8389-865bd5535e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc707bf026bb4d4dbe29de3711e3f223', 'request_id': 'req-7931af59-5719-40a1-8389-865bd5535e3f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:03.602696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7931af59-5719-40a1-8389-865bd5535e3f admin admin] The token cache is being invalidate because project cc707bf026bb4d4dbe29de3711e3f223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:03.603006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7931af59-5719-40a1-8389-865bd5535e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:03.608754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7931af59-5719-40a1-8389-865bd5535e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:03.617847 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2165/4295] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:02 2022] DELETE /identity/v3/projects/cc707bf026bb4d4dbe29de3711e3f223 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:03.638057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bbd70-8558-4771-a11f-f4d6f6424a86 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:03.638937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bbd70-8558-4771-a11f-f4d6f6424a86 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:03.646822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bbd70-8558-4771-a11f-f4d6f6424a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:03.660894 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-cf1bbd70-8558-4771-a11f-f4d6f6424a86 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:49:03.660894 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:03.660894 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:03.660894 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:03.660894 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:03.660894 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:03.660894 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:03.660894 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:03.660894 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:03.660894 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:03.660894 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:03.660894 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:03.660894 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:49:03.661840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:49:03.661840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:49:03.661840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:49:03.661840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:49:03.661840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:49:03.661840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:49:03.661840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:49:03.661840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:49:03.661840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:49:03.661840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:49:03.661840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:49:03.661840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:49:03.661840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:49:03.661840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:49:03.661840 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:03.680031 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2166/4296] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:49:03 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 56 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:49:03.687563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01210e37-bf44-4d5d-8bc7-ae2cf5960db6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:03.693460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bbd70-8558-4771-a11f-f4d6f6424a86 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:03.693460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cf1bbd70-8558-4771-a11f-f4d6f6424a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:03.823472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '414b65a0fcbd4e2d862d29c8f943b21c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '038311d86fc14e2c9ee7080134cade60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:03.824372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:03.824828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:03.825390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] PATH_INFO: `/v3/domains/abf5ac8310004b38a09f5becbe7d33fe` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:03.844552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=abf5ac8310004b38a09f5becbe7d33fe)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:03.847025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:03.877772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bbd70-8558-4771-a11f-f4d6f6424a86 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:03.893479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b9f7e-4585-4b07-8ac0-c85c9ebd9ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:03.894617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b9f7e-4585-4b07-8ac0-c85c9ebd9ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:03.905080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b9f7e-4585-4b07-8ac0-c85c9ebd9ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:03.905080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b9f7e-4585-4b07-8ac0-c85c9ebd9ad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:03.905080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b9f7e-4585-4b07-8ac0-c85c9ebd9ad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:03.905080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b9f7e-4585-4b07-8ac0-c85c9ebd9ad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:03.905080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b9f7e-4585-4b07-8ac0-c85c9ebd9ad6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:03.920470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'abf5ac8310004b38a09f5becbe7d33fe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:03.926472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'abf5ac8310004b38a09f5becbe7d33fe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:03.936819 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2167/4297] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:03.937939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b9f7e-4585-4b07-8ac0-c85c9ebd9ad6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:03.970012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ef0b9f7e-4585-4b07-8ac0-c85c9ebd9ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:04.038345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b9f7e-4585-4b07-8ac0-c85c9ebd9ad6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:04.038345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788429b-2929-40d2-8b77-2d34c44672f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:04.038783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788429b-2929-40d2-8b77-2d34c44672f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:04.039066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788429b-2929-40d2-8b77-2d34c44672f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:04.039334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788429b-2929-40d2-8b77-2d34c44672f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:04.039974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788429b-2929-40d2-8b77-2d34c44672f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:04.042706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788429b-2929-40d2-8b77-2d34c44672f9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:04.158330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf5ac8310004b38a09f5becbe7d33fe', 'request_id': 'req-928526b6-5557-436d-a9bb-6300e2380551'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:04.167434 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2168/4298] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:03 2022] POST /identity/v3/projects => generated 387 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:04.168586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788429b-2929-40d2-8b77-2d34c44672f9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:04.172416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0788429b-2929-40d2-8b77-2d34c44672f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:04.174963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf5ac8310004b38a09f5becbe7d33fe', 'request_id': 'req-928526b6-5557-436d-a9bb-6300e2380551'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:04.192859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf5ac8310004b38a09f5becbe7d33fe', 'request_id': 'req-928526b6-5557-436d-a9bb-6300e2380551'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:04.238688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:04.296560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788429b-2929-40d2-8b77-2d34c44672f9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:04.304494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9106b4e-d154-4ae6-932c-9a296a528328 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:04.306352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9106b4e-d154-4ae6-932c-9a296a528328 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:04.306799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9106b4e-d154-4ae6-932c-9a296a528328 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:04.307090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9106b4e-d154-4ae6-932c-9a296a528328 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/161e308893f2437b8e1f2dcae593a34f/config` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:04.308429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9106b4e-d154-4ae6-932c-9a296a528328 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=161e308893f2437b8e1f2dcae593a34f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:04.310716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9106b4e-d154-4ae6-932c-9a296a528328 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:04.316533 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2169/4299] 10.222.0.76 () {58 vars in 1248 bytes} [Sat Aug 27 04:49:04 2022] GET /identity/v3/domains/161e308893f2437b8e1f2dcae593a34f/config => generated 141 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:04.317942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bf4dc-7eaa-41d0-a0a4-8df5c8006c79 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:04.318470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bf4dc-7eaa-41d0-a0a4-8df5c8006c79 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:04.318743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bf4dc-7eaa-41d0-a0a4-8df5c8006c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:04.338399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] The token cache is being invalidate because project abf5ac8310004b38a09f5becbe7d33fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:04.339413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:04.342295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:04.355103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'abf5ac8310004b38a09f5becbe7d33fe', 'request_id': 'req-928526b6-5557-436d-a9bb-6300e2380551'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:04.360735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-868bf4dc-7eaa-41d0-a0a4-8df5c8006c79 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:04.361991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-868bf4dc-7eaa-41d0-a0a4-8df5c8006c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:04.362536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'abf5ac8310004b38a09f5becbe7d33fe', 'request_id': 'req-928526b6-5557-436d-a9bb-6300e2380551'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:04.363661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'abf5ac8310004b38a09f5becbe7d33fe', 'request_id': 'req-928526b6-5557-436d-a9bb-6300e2380551'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:04.379073 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2131/4300] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:49:03 2022] DELETE /identity/v3/domains/abf5ac8310004b38a09f5becbe7d33fe => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:04.380360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:04.382549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:04.467702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:04.484982 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2170/4301] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:04.486139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bf4dc-7eaa-41d0-a0a4-8df5c8006c79 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:04.487592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-868bf4dc-7eaa-41d0-a0a4-8df5c8006c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:04.500698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bf4dc-7eaa-41d0-a0a4-8df5c8006c79 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:04.512259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928526b6-5557-436d-a9bb-6300e2380551 tempest-TestDefaultProjectId-647518524 tempest-TestDefaultProjectId-647518524-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:04.512802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16234a72-c5bc-455b-980a-43a57d0302fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:04.513027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16234a72-c5bc-455b-980a-43a57d0302fe admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:04.513915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16234a72-c5bc-455b-980a-43a57d0302fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:04.519935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16234a72-c5bc-455b-980a-43a57d0302fe admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:04.519935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16234a72-c5bc-455b-980a-43a57d0302fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:04.519935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16234a72-c5bc-455b-980a-43a57d0302fe admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:04.527247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7c264-429f-4e40-a828-12ec801a008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:04.528301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7c264-429f-4e40-a828-12ec801a008b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:04.528897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7c264-429f-4e40-a828-12ec801a008b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:04.530417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7c264-429f-4e40-a828-12ec801a008b admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:04.534360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7c264-429f-4e40-a828-12ec801a008b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:04.540846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7c264-429f-4e40-a828-12ec801a008b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:04.601596 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2171/4302] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:04 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:04.602856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16234a72-c5bc-455b-980a-43a57d0302fe admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:04.608497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-16234a72-c5bc-455b-980a-43a57d0302fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:04.637014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16234a72-c5bc-455b-980a-43a57d0302fe admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:04.646871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45b27d-985d-4a86-a928-9d2b0f602dc3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:04.648746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45b27d-985d-4a86-a928-9d2b0f602dc3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:04.652270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45b27d-985d-4a86-a928-9d2b0f602dc3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:04.652270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45b27d-985d-4a86-a928-9d2b0f602dc3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/161e308893f2437b8e1f2dcae593a34f/config` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:04.653639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45b27d-985d-4a86-a928-9d2b0f602dc3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=161e308893f2437b8e1f2dcae593a34f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:04.654606 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-ef45b27d-985d-4a86-a928-9d2b0f602dc3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:04.654606 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:49:04.654606 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:49:04.655684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45b27d-985d-4a86-a928-9d2b0f602dc3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:04.722000 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2132/4303] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:04 2022] POST /identity/v3/projects => generated 403 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:04.722000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7c264-429f-4e40-a828-12ec801a008b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:04.725053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c6d7c264-429f-4e40-a828-12ec801a008b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:04.817434 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2172/4304] 10.222.0.76 () {58 vars in 1251 bytes} [Sat Aug 27 04:49:04 2022] DELETE /identity/v3/domains/161e308893f2437b8e1f2dcae593a34f/config => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:04.817434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9d48-e07a-41e0-9d85-c4cc25b690c5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:04.817434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9d48-e07a-41e0-9d85-c4cc25b690c5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:04.821984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9d48-e07a-41e0-9d85-c4cc25b690c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:04.859683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7c264-429f-4e40-a828-12ec801a008b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:04.891057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2dfb7-5c9a-424a-9f35-4fd80a8559f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:04.891825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2dfb7-5c9a-424a-9f35-4fd80a8559f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:04.892467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2dfb7-5c9a-424a-9f35-4fd80a8559f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:04.892879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2dfb7-5c9a-424a-9f35-4fd80a8559f7 admin admin] PATH_INFO: `/v3/users/b8bca4ba47094695b0993527509f61fa` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:04.897057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2dfb7-5c9a-424a-9f35-4fd80a8559f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8bca4ba47094695b0993527509f61fa)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:04.897661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a79e9d48-e07a-41e0-9d85-c4cc25b690c5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:04.898932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a79e9d48-e07a-41e0-9d85-c4cc25b690c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:04.903415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2dfb7-5c9a-424a-9f35-4fd80a8559f7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:04.920226 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2173/4305] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:04.921367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e9d48-e07a-41e0-9d85-c4cc25b690c5 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:04.933798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e9d48-e07a-41e0-9d85-c4cc25b690c5 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:04.972895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92dc01-993c-40a7-bfa8-171b6f5421bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:04.974170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92dc01-993c-40a7-bfa8-171b6f5421bf admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:04.974465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92dc01-993c-40a7-bfa8-171b6f5421bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:04.974737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92dc01-993c-40a7-bfa8-171b6f5421bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:04.975393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92dc01-993c-40a7-bfa8-171b6f5421bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:04.977349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92dc01-993c-40a7-bfa8-171b6f5421bf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:05.009243 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2174/4306] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:05.010530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92dc01-993c-40a7-bfa8-171b6f5421bf admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:05.027411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92dc01-993c-40a7-bfa8-171b6f5421bf admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:05.036735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6dcdf-cfd3-4a4d-997b-9e85bda51368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:05.037625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6dcdf-cfd3-4a4d-997b-9e85bda51368 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:05.038068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6dcdf-cfd3-4a4d-997b-9e85bda51368 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:05.038486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6dcdf-cfd3-4a4d-997b-9e85bda51368 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:05.039313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6dcdf-cfd3-4a4d-997b-9e85bda51368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:05.045526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6dcdf-cfd3-4a4d-997b-9e85bda51368 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:05.173224 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2175/4307] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:05 2022] POST /identity/v3/users => generated 302 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:05.173224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6dcdf-cfd3-4a4d-997b-9e85bda51368 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:05.224867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-25a2dfb7-5c9a-424a-9f35-4fd80a8559f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8bca4ba47094695b0993527509f61fa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:05.308795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-25a2dfb7-5c9a-424a-9f35-4fd80a8559f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8bca4ba47094695b0993527509f61fa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:05.309527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-25a2dfb7-5c9a-424a-9f35-4fd80a8559f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8bca4ba47094695b0993527509f61fa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:05.322627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-25a2dfb7-5c9a-424a-9f35-4fd80a8559f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8bca4ba47094695b0993527509f61fa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:05.358180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-25a2dfb7-5c9a-424a-9f35-4fd80a8559f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8bca4ba47094695b0993527509f61fa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:05.372179 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2133/4308] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:04 2022] DELETE /identity/v3/users/b8bca4ba47094695b0993527509f61fa => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:05.373559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2dfb7-5c9a-424a-9f35-4fd80a8559f7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:05.379979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6dcdf-cfd3-4a4d-997b-9e85bda51368 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:05.381653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-25a2dfb7-5c9a-424a-9f35-4fd80a8559f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:05.539069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2dfb7-5c9a-424a-9f35-4fd80a8559f7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:05.540425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e902de1-cccb-4cf8-9d0f-005fabd5d8f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:05.541278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902de1-cccb-4cf8-9d0f-005fabd5d8f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:05.541856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902de1-cccb-4cf8-9d0f-005fabd5d8f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:05.542134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902de1-cccb-4cf8-9d0f-005fabd5d8f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/161e308893f2437b8e1f2dcae593a34f/config` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:05.543591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e902de1-cccb-4cf8-9d0f-005fabd5d8f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=161e308893f2437b8e1f2dcae593a34f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:05.544399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295abd9e-79b8-4ce3-b271-0e95ab51b917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:05.545741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295abd9e-79b8-4ce3-b271-0e95ab51b917 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:05.546130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295abd9e-79b8-4ce3-b271-0e95ab51b917 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:05.546246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e902de1-cccb-4cf8-9d0f-005fabd5d8f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:05.546461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295abd9e-79b8-4ce3-b271-0e95ab51b917 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:05.547137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295abd9e-79b8-4ce3-b271-0e95ab51b917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:05.547642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295abd9e-79b8-4ce3-b271-0e95ab51b917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:05.556856 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-2e902de1-cccb-4cf8-9d0f-005fabd5d8f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Could not find any options in domain configuration for domain 161e308893f2437b8e1f2dcae593a34f.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 161e308893f2437b8e1f2dcae593a34f. Aug 27 04:49:05.556856 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:05.556856 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:05.556856 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:05.556856 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:05.556856 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:05.556856 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:05.556856 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:05.556856 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:05.556856 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:05.556856 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:05.556856 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:05.556856 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 27 04:49:05.556856 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 27 04:49:05.558223 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 27 04:49:05.558223 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 27 04:49:05.558223 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:49:05.558223 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:49:05.558223 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 27 04:49:05.558223 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 27 04:49:05.558223 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 161e308893f2437b8e1f2dcae593a34f. Aug 27 04:49:05.558223 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:05.558728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295abd9e-79b8-4ce3-b271-0e95ab51b917 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:05.563255 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2176/4309] 10.222.0.76 () {58 vars in 1248 bytes} [Sat Aug 27 04:49:05 2022] GET /identity/v3/domains/161e308893f2437b8e1f2dcae593a34f/config => generated 151 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:49:05.564244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e902de1-cccb-4cf8-9d0f-005fabd5d8f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:05.567346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2e902de1-cccb-4cf8-9d0f-005fabd5d8f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:05.588836 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2134/4310] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:05.594499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295abd9e-79b8-4ce3-b271-0e95ab51b917 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:05.595141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-295abd9e-79b8-4ce3-b271-0e95ab51b917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:05.597254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:05.602093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e902de1-cccb-4cf8-9d0f-005fabd5d8f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:05.618964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52493bf3-de30-4b42-a83e-02897d6a5c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:05.619656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52493bf3-de30-4b42-a83e-02897d6a5c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:05.619951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52493bf3-de30-4b42-a83e-02897d6a5c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:05.620250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52493bf3-de30-4b42-a83e-02897d6a5c99 admin admin] PATH_INFO: `/v3/projects/f432cd31e9f04b8e8d23b4ed01719548/users/6d0d30cde3524bcbb71b777987ed88d7/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:05.629240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295abd9e-79b8-4ce3-b271-0e95ab51b917 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:05.642579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde59b7-f217-471a-83bb-95c00a714170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:05.643318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde59b7-f217-471a-83bb-95c00a714170 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:05.643655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde59b7-f217-471a-83bb-95c00a714170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:05.643865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde59b7-f217-471a-83bb-95c00a714170 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:05.644557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde59b7-f217-471a-83bb-95c00a714170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:05.656951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde59b7-f217-471a-83bb-95c00a714170 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:05.658639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52493bf3-de30-4b42-a83e-02897d6a5c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f432cd31e9f04b8e8d23b4ed01719548, user_id=6d0d30cde3524bcbb71b777987ed88d7, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:05.664000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52493bf3-de30-4b42-a83e-02897d6a5c99 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:05.673435 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2135/4311] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:05.676932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854f3f7-5d78-46af-8eef-dac92787c95a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:05.677222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854f3f7-5d78-46af-8eef-dac92787c95a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:05.677538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854f3f7-5d78-46af-8eef-dac92787c95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:05.716243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f854f3f7-5d78-46af-8eef-dac92787c95a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:05.718635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f854f3f7-5d78-46af-8eef-dac92787c95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:05.728070 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2136/4312] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:05.728743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854f3f7-5d78-46af-8eef-dac92787c95a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:05.730166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f854f3f7-5d78-46af-8eef-dac92787c95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:05.747036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854f3f7-5d78-46af-8eef-dac92787c95a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:05.759533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793a3d9-336a-4b1b-8995-85375cecc589 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:05.760334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793a3d9-336a-4b1b-8995-85375cecc589 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:05.760745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793a3d9-336a-4b1b-8995-85375cecc589 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:05.761192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793a3d9-336a-4b1b-8995-85375cecc589 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/161e308893f2437b8e1f2dcae593a34f/config` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:05.761908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793a3d9-336a-4b1b-8995-85375cecc589 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=161e308893f2437b8e1f2dcae593a34f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:05.764512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793a3d9-336a-4b1b-8995-85375cecc589 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:05.776785 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2137/4313] 10.222.0.76 () {58 vars in 1251 bytes} [Sat Aug 27 04:49:05 2022] DELETE /identity/v3/domains/161e308893f2437b8e1f2dcae593a34f/config => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:05.778031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793a3d9-336a-4b1b-8995-85375cecc589 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:05.798761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793a3d9-336a-4b1b-8995-85375cecc589 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:05.813962 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2177/4314] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:05 2022] PUT /identity/v3/projects/f432cd31e9f04b8e8d23b4ed01719548/users/6d0d30cde3524bcbb71b777987ed88d7/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:05.815252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52493bf3-de30-4b42-a83e-02897d6a5c99 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:05.915756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c7fb3-456a-4f62-8c0c-04fd5f179aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:05.917873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c7fb3-456a-4f62-8c0c-04fd5f179aaf admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:05.918377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c7fb3-456a-4f62-8c0c-04fd5f179aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:05.918807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c7fb3-456a-4f62-8c0c-04fd5f179aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:05.919931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c7fb3-456a-4f62-8c0c-04fd5f179aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:05.922273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c7fb3-456a-4f62-8c0c-04fd5f179aaf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:05.949655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52493bf3-de30-4b42-a83e-02897d6a5c99 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:05.956945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0919c-dd59-4368-9d12-52a2028a311f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:05.957641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0919c-dd59-4368-9d12-52a2028a311f admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:05.957924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0919c-dd59-4368-9d12-52a2028a311f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:05.958218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0919c-dd59-4368-9d12-52a2028a311f admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:05.964230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0919c-dd59-4368-9d12-52a2028a311f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:05.964230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0919c-dd59-4368-9d12-52a2028a311f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:05.977579 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2178/4315] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:05.979328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0919c-dd59-4368-9d12-52a2028a311f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:05.981407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-26a0919c-dd59-4368-9d12-52a2028a311f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:06.052567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:06.065218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0919c-dd59-4368-9d12-52a2028a311f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:06.070739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115382a-d790-46d7-8b0f-5a0e6e21a5ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:06.072265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115382a-d790-46d7-8b0f-5a0e6e21a5ad service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:06.072570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115382a-d790-46d7-8b0f-5a0e6e21a5ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:06.072740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115382a-d790-46d7-8b0f-5a0e6e21a5ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:06.073189 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2138/4316] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:05 2022] POST /identity/v3/projects => generated 375 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:06.074312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c7fb3-456a-4f62-8c0c-04fd5f179aaf admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:06.099508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115382a-d790-46d7-8b0f-5a0e6e21a5ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:06.105038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115382a-d790-46d7-8b0f-5a0e6e21a5ad service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:06.126341 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2179/4317] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:06.127399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115382a-d790-46d7-8b0f-5a0e6e21a5ad service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:06.150094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115382a-d790-46d7-8b0f-5a0e6e21a5ad service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:06.241687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c7fb3-456a-4f62-8c0c-04fd5f179aaf admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:06.264122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b827bd4-31c3-4697-87cf-f12263a3405b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:06.264495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b827bd4-31c3-4697-87cf-f12263a3405b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:06.264666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b827bd4-31c3-4697-87cf-f12263a3405b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:06.265114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b827bd4-31c3-4697-87cf-f12263a3405b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/161e308893f2437b8e1f2dcae593a34f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:06.270130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b827bd4-31c3-4697-87cf-f12263a3405b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=161e308893f2437b8e1f2dcae593a34f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:06.271207 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-2b827bd4-31c3-4697-87cf-f12263a3405b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:06.271207 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:49:06.271207 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:49:06.272503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b827bd4-31c3-4697-87cf-f12263a3405b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:06.304657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00a759-56ca-4a70-bb2a-1f70b0e2b1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:06.305296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00a759-56ca-4a70-bb2a-1f70b0e2b1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:06.305579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00a759-56ca-4a70-bb2a-1f70b0e2b1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:06.305856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00a759-56ca-4a70-bb2a-1f70b0e2b1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:06.306501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00a759-56ca-4a70-bb2a-1f70b0e2b1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:06.308148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00a759-56ca-4a70-bb2a-1f70b0e2b1e5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:06.359591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2b827bd4-31c3-4697-87cf-f12263a3405b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '161e308893f2437b8e1f2dcae593a34f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:06.363603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2b827bd4-31c3-4697-87cf-f12263a3405b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '161e308893f2437b8e1f2dcae593a34f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:06.363738 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2180/4318] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:06.364799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00a759-56ca-4a70-bb2a-1f70b0e2b1e5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:06.370958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4c00a759-56ca-4a70-bb2a-1f70b0e2b1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:06.412662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00a759-56ca-4a70-bb2a-1f70b0e2b1e5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:06.490659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b3b2b-1c45-4c57-84a3-e67dad233943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:06.491818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b3b2b-1c45-4c57-84a3-e67dad233943 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:06.492290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b3b2b-1c45-4c57-84a3-e67dad233943 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:06.492639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b3b2b-1c45-4c57-84a3-e67dad233943 admin admin] PATH_INFO: `/v3/projects/6101beb38227466b8f605906fb3ee224/users/ea78066a94f149e1b736d4795fd8d8f1/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:06.496098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2b827bd4-31c3-4697-87cf-f12263a3405b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '161e308893f2437b8e1f2dcae593a34f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:06.498316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2b827bd4-31c3-4697-87cf-f12263a3405b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '161e308893f2437b8e1f2dcae593a34f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:06.506364 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2139/4319] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:49:06 2022] PATCH /identity/v3/domains/161e308893f2437b8e1f2dcae593a34f => generated 277 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:06.508655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b827bd4-31c3-4697-87cf-f12263a3405b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:06.510524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2b827bd4-31c3-4697-87cf-f12263a3405b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:06.517785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b3b2b-1c45-4c57-84a3-e67dad233943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6101beb38227466b8f605906fb3ee224, user_id=ea78066a94f149e1b736d4795fd8d8f1, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:06.522807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b3b2b-1c45-4c57-84a3-e67dad233943 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:06.527377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b827bd4-31c3-4697-87cf-f12263a3405b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:06.532904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579fb73-e819-4d7f-98dd-1e08660e86fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:06.533916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579fb73-e819-4d7f-98dd-1e08660e86fc admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:06.534422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579fb73-e819-4d7f-98dd-1e08660e86fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:06.534863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579fb73-e819-4d7f-98dd-1e08660e86fc admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:06.537546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579fb73-e819-4d7f-98dd-1e08660e86fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:06.539513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579fb73-e819-4d7f-98dd-1e08660e86fc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:06.635772 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2181/4320] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:06 2022] PUT /identity/v3/projects/6101beb38227466b8f605906fb3ee224/users/ea78066a94f149e1b736d4795fd8d8f1/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:06.635772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b3b2b-1c45-4c57-84a3-e67dad233943 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:06.639872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-919b3b2b-1c45-4c57-84a3-e67dad233943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:06.659764 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2140/4321] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:06 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:06.661150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579fb73-e819-4d7f-98dd-1e08660e86fc admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:06.662987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5579fb73-e819-4d7f-98dd-1e08660e86fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:06.771491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b3b2b-1c45-4c57-84a3-e67dad233943 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:06.782031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1d69e-1580-4527-bfc0-a0888a3cf529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:06.782919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1d69e-1580-4527-bfc0-a0888a3cf529 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:06.786711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1d69e-1580-4527-bfc0-a0888a3cf529 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:06.786711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1d69e-1580-4527-bfc0-a0888a3cf529 admin admin] PATH_INFO: `/v3/projects/f432cd31e9f04b8e8d23b4ed01719548/users/6d0d30cde3524bcbb71b777987ed88d7/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:06.790652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1d69e-1580-4527-bfc0-a0888a3cf529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f432cd31e9f04b8e8d23b4ed01719548, user_id=6d0d30cde3524bcbb71b777987ed88d7, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:06.797367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1d69e-1580-4527-bfc0-a0888a3cf529 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:06.824817 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2182/4322] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:06 2022] PUT /identity/v3/projects/f432cd31e9f04b8e8d23b4ed01719548/users/6d0d30cde3524bcbb71b777987ed88d7/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:06.826384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832ba81-70c2-4aaf-b1c6-4f45a8c21ee1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:06.826705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832ba81-70c2-4aaf-b1c6-4f45a8c21ee1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:06.826982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832ba81-70c2-4aaf-b1c6-4f45a8c21ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:06.836754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579fb73-e819-4d7f-98dd-1e08660e86fc admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:06.901722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1832ba81-70c2-4aaf-b1c6-4f45a8c21ee1 None None] MFA Rules not processed for user `ea78066a94f149e1b736d4795fd8d8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:06.901722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1832ba81-70c2-4aaf-b1c6-4f45a8c21ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:07.010658 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2183/4323] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:06 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:07.011676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832ba81-70c2-4aaf-b1c6-4f45a8c21ee1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:07.038744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:07.039419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:07.039818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:07.040109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/161e308893f2437b8e1f2dcae593a34f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:07.069460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=161e308893f2437b8e1f2dcae593a34f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:07.071464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:07.131711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '161e308893f2437b8e1f2dcae593a34f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:07.143570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '161e308893f2437b8e1f2dcae593a34f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:07.180646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832ba81-70c2-4aaf-b1c6-4f45a8c21ee1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:07.186946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b19b0-e795-4062-af18-f3cdbdd2b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:07.189087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b19b0-e795-4062-af18-f3cdbdd2b584 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:07.189917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b19b0-e795-4062-af18-f3cdbdd2b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:07.189917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b19b0-e795-4062-af18-f3cdbdd2b584 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:07.190615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b19b0-e795-4062-af18-f3cdbdd2b584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:07.192744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b19b0-e795-4062-af18-f3cdbdd2b584 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:07.212222 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2184/4324] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:07.212222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c248-d062-4853-9933-cc3f6cad4698 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:07.218404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c248-d062-4853-9933-cc3f6cad4698 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:07.218404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c248-d062-4853-9933-cc3f6cad4698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:07.254369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-57b5c248-d062-4853-9933-cc3f6cad4698 None None] MFA Rules not processed for user `6d0d30cde3524bcbb71b777987ed88d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:07.256707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-57b5c248-d062-4853-9933-cc3f6cad4698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:07.286556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:07.331375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161e308893f2437b8e1f2dcae593a34f', 'request_id': 'req-8452dcac-a4b8-4197-a6fc-7797964322a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:07.347427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161e308893f2437b8e1f2dcae593a34f', 'request_id': 'req-8452dcac-a4b8-4197-a6fc-7797964322a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:07.361243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161e308893f2437b8e1f2dcae593a34f', 'request_id': 'req-8452dcac-a4b8-4197-a6fc-7797964322a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:07.409445 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2185/4325] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:07.410589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5c248-d062-4853-9933-cc3f6cad4698 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:07.411929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-57b5c248-d062-4853-9933-cc3f6cad4698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:07.426762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5c248-d062-4853-9933-cc3f6cad4698 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:07.494591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] The token cache is being invalidate because project 161e308893f2437b8e1f2dcae593a34f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:07.494884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:07.495873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:07.520299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19318903-44c3-4d7f-a27c-5a6191a1a17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:07.520935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318903-44c3-4d7f-a27c-5a6191a1a17e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:07.521218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318903-44c3-4d7f-a27c-5a6191a1a17e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:07.521547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318903-44c3-4d7f-a27c-5a6191a1a17e admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:07.522543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19318903-44c3-4d7f-a27c-5a6191a1a17e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:07.524973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19318903-44c3-4d7f-a27c-5a6191a1a17e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:07.531144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '161e308893f2437b8e1f2dcae593a34f', 'request_id': 'req-8452dcac-a4b8-4197-a6fc-7797964322a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:07.536416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '161e308893f2437b8e1f2dcae593a34f', 'request_id': 'req-8452dcac-a4b8-4197-a6fc-7797964322a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:07.537983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '161e308893f2437b8e1f2dcae593a34f', 'request_id': 'req-8452dcac-a4b8-4197-a6fc-7797964322a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:07.546756 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2141/4326] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:49:06 2022] DELETE /identity/v3/domains/161e308893f2437b8e1f2dcae593a34f => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:07.548977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:07.551230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:07.577483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452dcac-a4b8-4197-a6fc-7797964322a8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:07.583497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c01a74-246a-4749-b529-a48dc0f9a060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:07.584190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c01a74-246a-4749-b529-a48dc0f9a060 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:07.584497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c01a74-246a-4749-b529-a48dc0f9a060 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:07.584754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c01a74-246a-4749-b529-a48dc0f9a060 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:07.585453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c01a74-246a-4749-b529-a48dc0f9a060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:07.587081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c01a74-246a-4749-b529-a48dc0f9a060 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:07.598238 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2142/4327] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:07.600078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f768c2-4a6f-46da-b79e-0d2d96ead09a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:07.600388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f768c2-4a6f-46da-b79e-0d2d96ead09a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:07.600685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f768c2-4a6f-46da-b79e-0d2d96ead09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:07.629741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-60f768c2-4a6f-46da-b79e-0d2d96ead09a None None] MFA Rules not processed for user `509079c1e9024b76ae3c93523955ff10`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:07.630947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-60f768c2-4a6f-46da-b79e-0d2d96ead09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:07.668534 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2186/4328] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:07 2022] POST /identity/v3/projects => generated 403 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:07.668534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19318903-44c3-4d7f-a27c-5a6191a1a17e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:07.670423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-19318903-44c3-4d7f-a27c-5a6191a1a17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:07.731655 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2143/4329] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:07.733031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f768c2-4a6f-46da-b79e-0d2d96ead09a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:07.734641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-60f768c2-4a6f-46da-b79e-0d2d96ead09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:07.751827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19318903-44c3-4d7f-a27c-5a6191a1a17e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:07.766032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a169c4a-a11d-41b2-8625-6c1dbe241afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:07.766827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a169c4a-a11d-41b2-8625-6c1dbe241afc admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:07.767506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a169c4a-a11d-41b2-8625-6c1dbe241afc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:07.767506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a169c4a-a11d-41b2-8625-6c1dbe241afc admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:07.768355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a169c4a-a11d-41b2-8625-6c1dbe241afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:07.770368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a169c4a-a11d-41b2-8625-6c1dbe241afc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:07.828520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f768c2-4a6f-46da-b79e-0d2d96ead09a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:07.906502 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2187/4330] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:07 2022] POST /identity/v3/projects => generated 387 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:07.906502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a169c4a-a11d-41b2-8625-6c1dbe241afc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:07.925282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf4d90-c79a-41b8-a62a-2c5fbd231949 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:07.928245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf4d90-c79a-41b8-a62a-2c5fbd231949 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:07.928837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf4d90-c79a-41b8-a62a-2c5fbd231949 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:07.929612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf4d90-c79a-41b8-a62a-2c5fbd231949 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:07.931242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf4d90-c79a-41b8-a62a-2c5fbd231949 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:07.934894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf4d90-c79a-41b8-a62a-2c5fbd231949 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:08.029041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a169c4a-a11d-41b2-8625-6c1dbe241afc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:08.034358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7529ae7-552e-4376-a45f-c9bef65a5837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:08.035049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7529ae7-552e-4376-a45f-c9bef65a5837 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:08.035330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7529ae7-552e-4376-a45f-c9bef65a5837 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:08.035605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7529ae7-552e-4376-a45f-c9bef65a5837 admin admin] PATH_INFO: `/v3/projects/e77591a3419946c7b5ca6a26e5f3fc76/users/57e997b636c74fe28f2bcff8e8d2f7c0/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:08.052278 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2144/4331] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:49:07 2022] POST /identity/v3/domains => generated 276 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:08.052278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf4d90-c79a-41b8-a62a-2c5fbd231949 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:08.054749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c7cf4d90-c79a-41b8-a62a-2c5fbd231949 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:08.061417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7529ae7-552e-4376-a45f-c9bef65a5837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77591a3419946c7b5ca6a26e5f3fc76, user_id=57e997b636c74fe28f2bcff8e8d2f7c0, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:08.064268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7529ae7-552e-4376-a45f-c9bef65a5837 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:08.188504 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2188/4332] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:07 2022] PUT /identity/v3/projects/e77591a3419946c7b5ca6a26e5f3fc76/users/57e997b636c74fe28f2bcff8e8d2f7c0/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:08.189845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7529ae7-552e-4376-a45f-c9bef65a5837 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:08.191499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf4d90-c79a-41b8-a62a-2c5fbd231949 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:08.192381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e7529ae7-552e-4376-a45f-c9bef65a5837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:08.277940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:08.290485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7529ae7-552e-4376-a45f-c9bef65a5837 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:08.295791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:08.296642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:08.298015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:08.298411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4 admin admin] PATH_INFO: `/v3/projects/67aa458680614a67ba71d6798958ef3c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:08.299946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67aa458680614a67ba71d6798958ef3c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:08.302781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:08.314839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998822ff-49ff-4c9a-89be-2d030dcbf982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:08.315468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998822ff-49ff-4c9a-89be-2d030dcbf982 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:08.315748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998822ff-49ff-4c9a-89be-2d030dcbf982 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:08.316075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998822ff-49ff-4c9a-89be-2d030dcbf982 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:08.316772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998822ff-49ff-4c9a-89be-2d030dcbf982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:08.319081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998822ff-49ff-4c9a-89be-2d030dcbf982 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:08.443129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:08.446112 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2145/4333] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:08 2022] POST /identity/v3/users => generated 308 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:08.447098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998822ff-49ff-4c9a-89be-2d030dcbf982 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:08.474862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998822ff-49ff-4c9a-89be-2d030dcbf982 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:08.480244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67aa458680614a67ba71d6798958ef3c', 'request_id': 'req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:08.505374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67aa458680614a67ba71d6798958ef3c', 'request_id': 'req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:08.572701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67aa458680614a67ba71d6798958ef3c', 'request_id': 'req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:08.598732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f31c3-ad4d-47dc-98c9-0b53f2a05c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:08.599910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4 admin admin] The token cache is being invalidate because project 67aa458680614a67ba71d6798958ef3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:08.600304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:08.600989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:08.601255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f31c3-ad4d-47dc-98c9-0b53f2a05c79 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:08.601867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f31c3-ad4d-47dc-98c9-0b53f2a05c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:08.602337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f31c3-ad4d-47dc-98c9-0b53f2a05c79 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:08.602800 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2189/4334] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:08 2022] DELETE /identity/v3/projects/67aa458680614a67ba71d6798958ef3c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:08.603559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:08.603937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f31c3-ad4d-47dc-98c9-0b53f2a05c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:08.606820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:08.619448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f31c3-ad4d-47dc-98c9-0b53f2a05c79 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:08.724988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145c4c1-1bf6-4ff3-9e00-f088c242c2f4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:08.728880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962a3ae-5e80-49b9-844a-b9a988d7624e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:08.731784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962a3ae-5e80-49b9-844a-b9a988d7624e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:08.736556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962a3ae-5e80-49b9-844a-b9a988d7624e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:08.736933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962a3ae-5e80-49b9-844a-b9a988d7624e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/819244c2bc154fdb97f81f2a1a813d51/config` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:08.741250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962a3ae-5e80-49b9-844a-b9a988d7624e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=819244c2bc154fdb97f81f2a1a813d51)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:08.751456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962a3ae-5e80-49b9-844a-b9a988d7624e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:08.760431 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2146/4335] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:08 2022] POST /identity/v3/users => generated 294 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:08.760431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4253281-80d4-42a6-a542-29140cf9e020 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:08.760431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4253281-80d4-42a6-a542-29140cf9e020 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:08.760431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4253281-80d4-42a6-a542-29140cf9e020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:08.821335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d4253281-80d4-42a6-a542-29140cf9e020 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:08.822587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d4253281-80d4-42a6-a542-29140cf9e020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:08.833612 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2147/4336] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:08.834586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4253281-80d4-42a6-a542-29140cf9e020 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:08.839440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d4253281-80d4-42a6-a542-29140cf9e020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:08.869956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4253281-80d4-42a6-a542-29140cf9e020 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:08.881594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a40b22-faab-4d76-994b-4ad93fc7933b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:08.885213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a40b22-faab-4d76-994b-4ad93fc7933b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:08.885213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a40b22-faab-4d76-994b-4ad93fc7933b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:08.885213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a40b22-faab-4d76-994b-4ad93fc7933b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:08.885213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a40b22-faab-4d76-994b-4ad93fc7933b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:08.889250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a40b22-faab-4d76-994b-4ad93fc7933b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:08.909040 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2148/4337] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:08.910045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a40b22-faab-4d76-994b-4ad93fc7933b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:08.920512 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2190/4338] 10.222.0.76 () {60 vars in 1269 bytes} [Sat Aug 27 04:49:08 2022] PUT /identity/v3/domains/819244c2bc154fdb97f81f2a1a813d51/config => generated 138 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:08.922280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962a3ae-5e80-49b9-844a-b9a988d7624e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:08.924852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f962a3ae-5e80-49b9-844a-b9a988d7624e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:08.929262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-26a40b22-faab-4d76-994b-4ad93fc7933b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:08.961902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962a3ae-5e80-49b9-844a-b9a988d7624e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:08.962995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a40b22-faab-4d76-994b-4ad93fc7933b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:08.973249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451fc4d-09c0-4589-8229-6f40e9e3587b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:08.975364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451fc4d-09c0-4589-8229-6f40e9e3587b admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:08.975364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451fc4d-09c0-4589-8229-6f40e9e3587b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:08.975364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451fc4d-09c0-4589-8229-6f40e9e3587b admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:08.975670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451fc4d-09c0-4589-8229-6f40e9e3587b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:08.977663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0296f8-8b2a-4a42-85d0-c8ba87f6eb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:08.979349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0296f8-8b2a-4a42-85d0-c8ba87f6eb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:08.979735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451fc4d-09c0-4589-8229-6f40e9e3587b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:08.980204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0296f8-8b2a-4a42-85d0-c8ba87f6eb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:08.980493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0296f8-8b2a-4a42-85d0-c8ba87f6eb82 admin admin] PATH_INFO: `/v3/users/414b65a0fcbd4e2d862d29c8f943b21c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:08.983512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0296f8-8b2a-4a42-85d0-c8ba87f6eb82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=414b65a0fcbd4e2d862d29c8f943b21c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:08.985613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0296f8-8b2a-4a42-85d0-c8ba87f6eb82 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:08.992673 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2191/4339] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:08.993824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451fc4d-09c0-4589-8229-6f40e9e3587b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:08.995660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7451fc4d-09c0-4589-8229-6f40e9e3587b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:09.089194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451fc4d-09c0-4589-8229-6f40e9e3587b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:09.094597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e3443-f0cc-487d-bc1a-e002d556de19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:09.095240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e3443-f0cc-487d-bc1a-e002d556de19 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:09.095498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e3443-f0cc-487d-bc1a-e002d556de19 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:09.095768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e3443-f0cc-487d-bc1a-e002d556de19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:09.105694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e3443-f0cc-487d-bc1a-e002d556de19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:09.107730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e3443-f0cc-487d-bc1a-e002d556de19 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:09.122911 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2192/4340] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:09.123769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e3443-f0cc-487d-bc1a-e002d556de19 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:09.133814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e3443-f0cc-487d-bc1a-e002d556de19 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:09.138661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788f54-3723-4591-ae4a-cc8429c91971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:09.139336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788f54-3723-4591-ae4a-cc8429c91971 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:09.139616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788f54-3723-4591-ae4a-cc8429c91971 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:09.139892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788f54-3723-4591-ae4a-cc8429c91971 admin admin] PATH_INFO: `/v3/projects/11ba93008ea24011acf7f6447155c364/users/b68e391e6d1f4976846eb71d16012686/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:09.157582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17788f54-3723-4591-ae4a-cc8429c91971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ba93008ea24011acf7f6447155c364, user_id=b68e391e6d1f4976846eb71d16012686, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:09.160350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17788f54-3723-4591-ae4a-cc8429c91971 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:09.237041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6a0296f8-8b2a-4a42-85d0-c8ba87f6eb82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '414b65a0fcbd4e2d862d29c8f943b21c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:09.286499 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2193/4341] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:09 2022] PUT /identity/v3/projects/11ba93008ea24011acf7f6447155c364/users/b68e391e6d1f4976846eb71d16012686/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:09.287328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788f54-3723-4591-ae4a-cc8429c91971 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:09.337499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6a0296f8-8b2a-4a42-85d0-c8ba87f6eb82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '414b65a0fcbd4e2d862d29c8f943b21c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:09.338376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6a0296f8-8b2a-4a42-85d0-c8ba87f6eb82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '414b65a0fcbd4e2d862d29c8f943b21c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:09.353483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6a0296f8-8b2a-4a42-85d0-c8ba87f6eb82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '414b65a0fcbd4e2d862d29c8f943b21c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:09.410299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6a0296f8-8b2a-4a42-85d0-c8ba87f6eb82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '414b65a0fcbd4e2d862d29c8f943b21c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:09.423676 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2149/4342] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:08 2022] DELETE /identity/v3/users/414b65a0fcbd4e2d862d29c8f943b21c => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:09.428772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0296f8-8b2a-4a42-85d0-c8ba87f6eb82 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:09.441995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6a0296f8-8b2a-4a42-85d0-c8ba87f6eb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:09.497180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788f54-3723-4591-ae4a-cc8429c91971 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:09.586222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0296f8-8b2a-4a42-85d0-c8ba87f6eb82 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:09.599791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67285f31-50d2-4c1e-a10a-b0ec4cd93174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:09.600648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67285f31-50d2-4c1e-a10a-b0ec4cd93174 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:09.600969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67285f31-50d2-4c1e-a10a-b0ec4cd93174 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:09.601244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67285f31-50d2-4c1e-a10a-b0ec4cd93174 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:09.601944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67285f31-50d2-4c1e-a10a-b0ec4cd93174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:09.605036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67285f31-50d2-4c1e-a10a-b0ec4cd93174 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:09.619440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99be78-9b26-4b77-8169-241febd87ad2 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:09.619891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99be78-9b26-4b77-8169-241febd87ad2 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:09.620205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99be78-9b26-4b77-8169-241febd87ad2 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:09.620410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99be78-9b26-4b77-8169-241febd87ad2 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/819244c2bc154fdb97f81f2a1a813d51/config/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:09.621357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99be78-9b26-4b77-8169-241febd87ad2 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=819244c2bc154fdb97f81f2a1a813d51, group=identity)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:09.622469 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-bb99be78-9b26-4b77-8169-241febd87ad2 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:09.622469 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:49:09.622469 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:49:09.624072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99be78-9b26-4b77-8169-241febd87ad2 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:09.653136 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2150/4343] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:09.655198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67285f31-50d2-4c1e-a10a-b0ec4cd93174 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:09.658498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-67285f31-50d2-4c1e-a10a-b0ec4cd93174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:09.696989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67285f31-50d2-4c1e-a10a-b0ec4cd93174 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:09.705509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ef1aa-35ea-4fcf-bdcd-35071beb5a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:09.709578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ef1aa-35ea-4fcf-bdcd-35071beb5a8d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:09.709578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ef1aa-35ea-4fcf-bdcd-35071beb5a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:09.709578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ef1aa-35ea-4fcf-bdcd-35071beb5a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:09.709578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ef1aa-35ea-4fcf-bdcd-35071beb5a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:09.710397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ef1aa-35ea-4fcf-bdcd-35071beb5a8d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:09.724246 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2151/4344] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:09.725188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ef1aa-35ea-4fcf-bdcd-35071beb5a8d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:09.741241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ef1aa-35ea-4fcf-bdcd-35071beb5a8d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:09.744693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8138c4-2c82-464f-af1c-60602c9c60ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:09.745429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8138c4-2c82-464f-af1c-60602c9c60ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:09.745775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8138c4-2c82-464f-af1c-60602c9c60ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:09.746277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8138c4-2c82-464f-af1c-60602c9c60ed admin admin] PATH_INFO: `/v3/projects/e1264874f1194dcbb76d73e354978a36/users/bebbea8db144451e9d86f9ab2dbc2ad7/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:09.775590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8138c4-2c82-464f-af1c-60602c9c60ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1264874f1194dcbb76d73e354978a36, user_id=bebbea8db144451e9d86f9ab2dbc2ad7, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:09.784387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8138c4-2c82-464f-af1c-60602c9c60ed admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:09.812807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:09.829793 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2194/4345] 10.222.0.76 () {60 vars in 1297 bytes} [Sat Aug 27 04:49:09 2022] PATCH /identity/v3/domains/819244c2bc154fdb97f81f2a1a813d51/config/identity => generated 176 bytes in 543 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:09.833633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99be78-9b26-4b77-8169-241febd87ad2 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:09.864716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99be78-9b26-4b77-8169-241febd87ad2 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:09.888975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:09.893233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833df0f4-dd59-42a4-9732-33c077082019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:09.893233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833df0f4-dd59-42a4-9732-33c077082019 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:09.893233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833df0f4-dd59-42a4-9732-33c077082019 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:09.893233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833df0f4-dd59-42a4-9732-33c077082019 admin admin] PATH_INFO: `/v3/projects/11ba93008ea24011acf7f6447155c364/users/b68e391e6d1f4976846eb71d16012686/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:09.898417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833df0f4-dd59-42a4-9732-33c077082019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ba93008ea24011acf7f6447155c364, user_id=b68e391e6d1f4976846eb71d16012686, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:09.901870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833df0f4-dd59-42a4-9732-33c077082019 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:09.924987 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2152/4346] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:09 2022] PUT /identity/v3/projects/e1264874f1194dcbb76d73e354978a36/users/bebbea8db144451e9d86f9ab2dbc2ad7/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:09.926375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8138c4-2c82-464f-af1c-60602c9c60ed admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:09.929391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ee8138c4-2c82-464f-af1c-60602c9c60ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:09.949034 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2195/4347] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:09 2022] PUT /identity/v3/projects/11ba93008ea24011acf7f6447155c364/users/b68e391e6d1f4976846eb71d16012686/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:09.961606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef8dc8-a435-48d4-afcc-7e19379cdedc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:09.962052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef8dc8-a435-48d4-afcc-7e19379cdedc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:09.962437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef8dc8-a435-48d4-afcc-7e19379cdedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:10.005273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-67ef8dc8-a435-48d4-afcc-7e19379cdedc None None] MFA Rules not processed for user `bebbea8db144451e9d86f9ab2dbc2ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:10.006909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-67ef8dc8-a435-48d4-afcc-7e19379cdedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:10.103175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8138c4-2c82-464f-af1c-60602c9c60ed admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:10.123889 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2196/4348] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:10.125821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80b481-2417-40b4-8b2b-893e20554a85 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:10.126607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80b481-2417-40b4-8b2b-893e20554a85 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:10.127075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80b481-2417-40b4-8b2b-893e20554a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:10.204131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1b80b481-2417-40b4-8b2b-893e20554a85 None None] MFA Rules not processed for user `b68e391e6d1f4976846eb71d16012686`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:10.205949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1b80b481-2417-40b4-8b2b-893e20554a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:10.242964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecc936-492b-47df-9848-9de4f0b09f71 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:10.243853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecc936-492b-47df-9848-9de4f0b09f71 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:10.244291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecc936-492b-47df-9848-9de4f0b09f71 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:10.260235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecc936-492b-47df-9848-9de4f0b09f71 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/819244c2bc154fdb97f81f2a1a813d51/config/identity/driver` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:10.273881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecc936-492b-47df-9848-9de4f0b09f71 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=819244c2bc154fdb97f81f2a1a813d51, group=identity, option=driver)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:10.281318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecc936-492b-47df-9848-9de4f0b09f71 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:10.337204 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2197/4349] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:10 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:10.338601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80b481-2417-40b4-8b2b-893e20554a85 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:10.340100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1b80b481-2417-40b4-8b2b-893e20554a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:10.413465 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2153/4350] 10.222.0.76 () {60 vars in 1318 bytes} [Sat Aug 27 04:49:09 2022] PATCH /identity/v3/domains/819244c2bc154fdb97f81f2a1a813d51/config/identity/driver => generated 175 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:10.414680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecc936-492b-47df-9848-9de4f0b09f71 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:10.423323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a5ecc936-492b-47df-9848-9de4f0b09f71 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:10.466080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80b481-2417-40b4-8b2b-893e20554a85 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:10.473950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e40b35-807d-41b7-b52c-a363afdf597a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:10.474540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e40b35-807d-41b7-b52c-a363afdf597a service glance] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:10.474820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e40b35-807d-41b7-b52c-a363afdf597a service glance] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:10.475092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e40b35-807d-41b7-b52c-a363afdf597a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:10.477185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-75e40b35-807d-41b7-b52c-a363afdf597a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:10.595513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecc936-492b-47df-9848-9de4f0b09f71 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:10.617108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f6fa8-f8ae-4d36-85ba-e0f08c76383e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:10.617641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e40b35-807d-41b7-b52c-a363afdf597a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:10.618034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f6fa8-f8ae-4d36-85ba-e0f08c76383e service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:10.618034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f6fa8-f8ae-4d36-85ba-e0f08c76383e service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:10.618034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f6fa8-f8ae-4d36-85ba-e0f08c76383e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:10.629445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e40b35-807d-41b7-b52c-a363afdf597a service glance] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:10.635814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f6fa8-f8ae-4d36-85ba-e0f08c76383e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:10.637745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f6fa8-f8ae-4d36-85ba-e0f08c76383e service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:10.648031 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2198/4351] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:10.649316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e40b35-807d-41b7-b52c-a363afdf597a service glance] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:10.674903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e40b35-807d-41b7-b52c-a363afdf597a service glance] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:10.677863 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2154/4352] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:10 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:10.719128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793d4ad-a750-446d-a455-c034496d5d10 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:10.719128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793d4ad-a750-446d-a455-c034496d5d10 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:10.719128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793d4ad-a750-446d-a455-c034496d5d10 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:10.719443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793d4ad-a750-446d-a455-c034496d5d10 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/819244c2bc154fdb97f81f2a1a813d51/config/identity/driver` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:10.719769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793d4ad-a750-446d-a455-c034496d5d10 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=819244c2bc154fdb97f81f2a1a813d51, group=identity, option=driver)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:10.721448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793d4ad-a750-446d-a455-c034496d5d10 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:10.853535 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2199/4353] 10.222.0.76 () {58 vars in 1299 bytes} [Sat Aug 27 04:49:10 2022] DELETE /identity/v3/domains/819244c2bc154fdb97f81f2a1a813d51/config/identity/driver => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:10.853535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:10.853773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f6fa8-f8ae-4d36-85ba-e0f08c76383e service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:10.897891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f6fa8-f8ae-4d36-85ba-e0f08c76383e service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:10.921035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05ba03-0748-415b-bc1b-e2935ddf3ed8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:10.924178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05ba03-0748-415b-bc1b-e2935ddf3ed8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:10.924550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05ba03-0748-415b-bc1b-e2935ddf3ed8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:10.925170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05ba03-0748-415b-bc1b-e2935ddf3ed8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/819244c2bc154fdb97f81f2a1a813d51/config/identity/driver` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:10.928832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05ba03-0748-415b-bc1b-e2935ddf3ed8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=819244c2bc154fdb97f81f2a1a813d51, group=identity, option=driver)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:10.935648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05ba03-0748-415b-bc1b-e2935ddf3ed8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:10.964979 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-9c05ba03-0748-415b-bc1b-e2935ddf3ed8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Could not find option driver in group identity in domain configuration for domain 819244c2bc154fdb97f81f2a1a813d51.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 819244c2bc154fdb97f81f2a1a813d51. Aug 27 04:49:10.964979 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:10.964979 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:10.964979 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:10.964979 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:10.964979 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:10.964979 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:10.964979 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:10.964979 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:10.964979 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:10.964979 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:10.964979 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:10.964979 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 27 04:49:10.966109 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 27 04:49:10.966109 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 27 04:49:10.966109 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 27 04:49:10.966109 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:49:10.966109 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:49:10.966109 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 27 04:49:10.966109 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 27 04:49:10.966109 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 819244c2bc154fdb97f81f2a1a813d51. Aug 27 04:49:10.966109 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:10.974377 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2155/4354] 10.222.0.76 () {58 vars in 1296 bytes} [Sat Aug 27 04:49:10 2022] GET /identity/v3/domains/819244c2bc154fdb97f81f2a1a813d51/config/identity/driver => generated 171 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 27 04:49:10.975837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793d4ad-a750-446d-a455-c034496d5d10 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:10.993992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793d4ad-a750-446d-a455-c034496d5d10 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:11.012353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed52fb-0bf6-4c8e-9cc9-0f264c2216fe tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:11.013027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed52fb-0bf6-4c8e-9cc9-0f264c2216fe tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:11.013969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed52fb-0bf6-4c8e-9cc9-0f264c2216fe tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:11.014156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed52fb-0bf6-4c8e-9cc9-0f264c2216fe tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/819244c2bc154fdb97f81f2a1a813d51/config/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:11.014915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed52fb-0bf6-4c8e-9cc9-0f264c2216fe tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=819244c2bc154fdb97f81f2a1a813d51, group=identity)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:11.017111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed52fb-0bf6-4c8e-9cc9-0f264c2216fe tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:11.087698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05ba03-0748-415b-bc1b-e2935ddf3ed8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:11.089570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9c05ba03-0748-415b-bc1b-e2935ddf3ed8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:11.099316 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2200/4355] 10.222.0.76 () {58 vars in 1278 bytes} [Sat Aug 27 04:49:10 2022] DELETE /identity/v3/domains/819244c2bc154fdb97f81f2a1a813d51/config/identity => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:11.100337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed52fb-0bf6-4c8e-9cc9-0f264c2216fe tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:11.120572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed52fb-0bf6-4c8e-9cc9-0f264c2216fe tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:11.139938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71559f1-ced6-4c82-b3bd-0f88bab3f2ac tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:11.140674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71559f1-ced6-4c82-b3bd-0f88bab3f2ac tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:11.140963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71559f1-ced6-4c82-b3bd-0f88bab3f2ac tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:11.141391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71559f1-ced6-4c82-b3bd-0f88bab3f2ac tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/819244c2bc154fdb97f81f2a1a813d51/config/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:11.157410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71559f1-ced6-4c82-b3bd-0f88bab3f2ac tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=819244c2bc154fdb97f81f2a1a813d51, group=identity)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:11.159349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71559f1-ced6-4c82-b3bd-0f88bab3f2ac tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:11.188889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:11.199043 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-f71559f1-ced6-4c82-b3bd-0f88bab3f2ac tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Could not find group identity in domain configuration for domain 819244c2bc154fdb97f81f2a1a813d51.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 819244c2bc154fdb97f81f2a1a813d51. Aug 27 04:49:11.199043 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:11.199043 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:11.199043 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:11.199043 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:11.199043 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:11.199043 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:11.199043 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:11.199043 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:11.199043 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:11.199043 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:11.199043 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:11.199043 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 27 04:49:11.200382 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 27 04:49:11.200382 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 27 04:49:11.200382 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 27 04:49:11.200382 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:49:11.200382 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:49:11.200382 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 27 04:49:11.200382 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 27 04:49:11.200382 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 819244c2bc154fdb97f81f2a1a813d51. Aug 27 04:49:11.200382 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:11.200382 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2201/4356] 10.222.0.76 () {58 vars in 1275 bytes} [Sat Aug 27 04:49:11 2022] GET /identity/v3/domains/819244c2bc154fdb97f81f2a1a813d51/config/identity => generated 154 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 27 04:49:11.205856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71559f1-ced6-4c82-b3bd-0f88bab3f2ac tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:11.233567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71559f1-ced6-4c82-b3bd-0f88bab3f2ac tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:11.236200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05ba03-0748-415b-bc1b-e2935ddf3ed8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:11.247057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f975201-1289-4a82-849b-852fd558bbaf tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:11.247976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:11.248412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f975201-1289-4a82-849b-852fd558bbaf tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:11.248725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f975201-1289-4a82-849b-852fd558bbaf tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:11.249010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f975201-1289-4a82-849b-852fd558bbaf tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/819244c2bc154fdb97f81f2a1a813d51/config` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:11.254894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:11.254894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:11.254894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce admin admin] PATH_INFO: `/v3/projects/038311d86fc14e2c9ee7080134cade60` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:11.254894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=038311d86fc14e2c9ee7080134cade60)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:11.255334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f975201-1289-4a82-849b-852fd558bbaf tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=819244c2bc154fdb97f81f2a1a813d51)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:11.255417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:11.256111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f975201-1289-4a82-849b-852fd558bbaf tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:11.398526 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2202/4357] 10.222.0.76 () {58 vars in 1251 bytes} [Sat Aug 27 04:49:11 2022] DELETE /identity/v3/domains/819244c2bc154fdb97f81f2a1a813d51/config => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:11.399752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f975201-1289-4a82-849b-852fd558bbaf tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:11.420947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f975201-1289-4a82-849b-852fd558bbaf tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:11.432571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50d329-c97a-4a10-9d04-c61b2af67448 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:11.433381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50d329-c97a-4a10-9d04-c61b2af67448 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:11.433766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50d329-c97a-4a10-9d04-c61b2af67448 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:11.434147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50d329-c97a-4a10-9d04-c61b2af67448 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/819244c2bc154fdb97f81f2a1a813d51` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:11.438027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50d329-c97a-4a10-9d04-c61b2af67448 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=819244c2bc154fdb97f81f2a1a813d51)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:11.443058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50d329-c97a-4a10-9d04-c61b2af67448 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:11.486712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9f50d329-c97a-4a10-9d04-c61b2af67448 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '819244c2bc154fdb97f81f2a1a813d51'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:11.487565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9f50d329-c97a-4a10-9d04-c61b2af67448 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '819244c2bc154fdb97f81f2a1a813d51'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:11.510997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038311d86fc14e2c9ee7080134cade60', 'request_id': 'req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:11.521425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038311d86fc14e2c9ee7080134cade60', 'request_id': 'req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:11.531049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038311d86fc14e2c9ee7080134cade60', 'request_id': 'req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:11.682764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce admin admin] The token cache is being invalidate because project 038311d86fc14e2c9ee7080134cade60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:11.683423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:11.683728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:11.688541 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2156/4358] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:11 2022] DELETE /identity/v3/projects/038311d86fc14e2c9ee7080134cade60 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:49:11.688541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:11.688792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9f50d329-c97a-4a10-9d04-c61b2af67448 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '819244c2bc154fdb97f81f2a1a813d51'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:11.689205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9f50d329-c97a-4a10-9d04-c61b2af67448 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '819244c2bc154fdb97f81f2a1a813d51'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:11.689314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:11.701878 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2203/4359] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:49:11 2022] PATCH /identity/v3/domains/819244c2bc154fdb97f81f2a1a813d51 => generated 277 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:49:11.703225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273e9fb-6962-4b80-be2f-c94d881d7f53 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:11.703510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273e9fb-6962-4b80-be2f-c94d881d7f53 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:11.703986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273e9fb-6962-4b80-be2f-c94d881d7f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:11.728764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0273e9fb-6962-4b80-be2f-c94d881d7f53 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:11.729992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0273e9fb-6962-4b80-be2f-c94d881d7f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:11.872821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9eda2-9cf5-4cb4-b26c-48e73dd974ce admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:11.884655 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2204/4360] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:11.886356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273e9fb-6962-4b80-be2f-c94d881d7f53 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:11.889789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0273e9fb-6962-4b80-be2f-c94d881d7f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:12.034359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa0274-bedd-460b-8414-56b8299918cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:12.034946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0274-bedd-460b-8414-56b8299918cd service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:12.035276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0274-bedd-460b-8414-56b8299918cd service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:12.035630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0274-bedd-460b-8414-56b8299918cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:12.041738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-75fa0274-bedd-460b-8414-56b8299918cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:12.066451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273e9fb-6962-4b80-be2f-c94d881d7f53 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:12.071888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:12.072576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:12.072856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:12.073354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/819244c2bc154fdb97f81f2a1a813d51` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:12.104877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=819244c2bc154fdb97f81f2a1a813d51)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:12.105975 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:12.105975 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:49:12.105975 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:49:12.106975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:12.154265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '819244c2bc154fdb97f81f2a1a813d51'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:12.160734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '819244c2bc154fdb97f81f2a1a813d51'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:12.181272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa0274-bedd-460b-8414-56b8299918cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:12.183287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa0274-bedd-460b-8414-56b8299918cd service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:12.218628 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2157/4361] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:11 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:12.221172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ab347-6edc-4e63-b10c-059c264ea863 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:12.221464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ab347-6edc-4e63-b10c-059c264ea863 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:12.221736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ab347-6edc-4e63-b10c-059c264ea863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:12.260392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-df0ab347-6edc-4e63-b10c-059c264ea863 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:12.262274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-df0ab347-6edc-4e63-b10c-059c264ea863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:12.277585 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2158/4362] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:12.278415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ab347-6edc-4e63-b10c-059c264ea863 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:12.281335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-df0ab347-6edc-4e63-b10c-059c264ea863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:12.295733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ab347-6edc-4e63-b10c-059c264ea863 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:12.303030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7dc59b-f8fd-4751-8523-e16bef5f9e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:12.304057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dc59b-f8fd-4751-8523-e16bef5f9e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:12.304542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dc59b-f8fd-4751-8523-e16bef5f9e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:12.306666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dc59b-f8fd-4751-8523-e16bef5f9e1a admin admin] PATH_INFO: `/v3/users/ea78066a94f149e1b736d4795fd8d8f1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:12.312007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7dc59b-f8fd-4751-8523-e16bef5f9e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea78066a94f149e1b736d4795fd8d8f1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:12.315374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7dc59b-f8fd-4751-8523-e16bef5f9e1a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:12.355305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '819244c2bc154fdb97f81f2a1a813d51', 'request_id': 'req-d54b8b7e-706b-4315-a0a1-93f2e4256977'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:12.369441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '819244c2bc154fdb97f81f2a1a813d51', 'request_id': 'req-d54b8b7e-706b-4315-a0a1-93f2e4256977'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:12.481151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '819244c2bc154fdb97f81f2a1a813d51', 'request_id': 'req-d54b8b7e-706b-4315-a0a1-93f2e4256977'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:12.498983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] The token cache is being invalidate because project 819244c2bc154fdb97f81f2a1a813d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:12.499281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:12.499957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:12.525022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '819244c2bc154fdb97f81f2a1a813d51', 'request_id': 'req-d54b8b7e-706b-4315-a0a1-93f2e4256977'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:12.526809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '819244c2bc154fdb97f81f2a1a813d51', 'request_id': 'req-d54b8b7e-706b-4315-a0a1-93f2e4256977'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:12.527756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '819244c2bc154fdb97f81f2a1a813d51', 'request_id': 'req-d54b8b7e-706b-4315-a0a1-93f2e4256977'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:12.530975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ba7dc59b-f8fd-4751-8523-e16bef5f9e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea78066a94f149e1b736d4795fd8d8f1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:12.549886 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2205/4363] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:49:11 2022] DELETE /identity/v3/domains/819244c2bc154fdb97f81f2a1a813d51 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:12.553059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:12.554827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:12.631777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ba7dc59b-f8fd-4751-8523-e16bef5f9e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea78066a94f149e1b736d4795fd8d8f1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:12.638966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ba7dc59b-f8fd-4751-8523-e16bef5f9e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea78066a94f149e1b736d4795fd8d8f1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:12.665031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:12.678790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ba7dc59b-f8fd-4751-8523-e16bef5f9e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea78066a94f149e1b736d4795fd8d8f1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:12.690455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b8b7e-706b-4315-a0a1-93f2e4256977 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:12.698084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891be507-24fc-4ed7-a7d2-815d7a622612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:12.698716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891be507-24fc-4ed7-a7d2-815d7a622612 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:12.699287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891be507-24fc-4ed7-a7d2-815d7a622612 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:12.699287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891be507-24fc-4ed7-a7d2-815d7a622612 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:12.700021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891be507-24fc-4ed7-a7d2-815d7a622612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:12.700250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891be507-24fc-4ed7-a7d2-815d7a622612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:12.701871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891be507-24fc-4ed7-a7d2-815d7a622612 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:12.707420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ba7dc59b-f8fd-4751-8523-e16bef5f9e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea78066a94f149e1b736d4795fd8d8f1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:12.725644 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2159/4364] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:12 2022] DELETE /identity/v3/users/ea78066a94f149e1b736d4795fd8d8f1 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:12.725644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7dc59b-f8fd-4751-8523-e16bef5f9e1a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:12.725644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ba7dc59b-f8fd-4751-8523-e16bef5f9e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:12.732295 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2206/4365] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:12.732295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861afd9b-1785-4d2e-9daf-49dbb681fe37 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:12.732562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861afd9b-1785-4d2e-9daf-49dbb681fe37 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:12.732807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861afd9b-1785-4d2e-9daf-49dbb681fe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:12.793589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-861afd9b-1785-4d2e-9daf-49dbb681fe37 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:12.799523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-861afd9b-1785-4d2e-9daf-49dbb681fe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:12.899466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7dc59b-f8fd-4751-8523-e16bef5f9e1a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:12.913179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00f93a-d637-47df-b853-af13f46314db tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:12.913913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00f93a-d637-47df-b853-af13f46314db tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:12.914339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00f93a-d637-47df-b853-af13f46314db tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:12.914624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00f93a-d637-47df-b853-af13f46314db tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:12.915218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00f93a-d637-47df-b853-af13f46314db tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:12.916406 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-2e00f93a-d637-47df-b853-af13f46314db tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:12.916406 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:49:12.916406 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:49:12.919180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00f93a-d637-47df-b853-af13f46314db tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:12.932517 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2160/4366] 10.222.0.76 () {58 vars in 1173 bytes} [Sat Aug 27 04:49:12 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:12.938637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00f93a-d637-47df-b853-af13f46314db tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:12.955387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2e00f93a-d637-47df-b853-af13f46314db tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:12.962528 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2207/4367] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:12.963470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861afd9b-1785-4d2e-9daf-49dbb681fe37 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:12.968563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-861afd9b-1785-4d2e-9daf-49dbb681fe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:12.980801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00f93a-d637-47df-b853-af13f46314db tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:12.986865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e89a2-79f8-459e-ab3b-77d010c9b139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:12.987496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e89a2-79f8-459e-ab3b-77d010c9b139 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:12.987830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e89a2-79f8-459e-ab3b-77d010c9b139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:12.988115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e89a2-79f8-459e-ab3b-77d010c9b139 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:12.988801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e89a2-79f8-459e-ab3b-77d010c9b139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:12.991170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e89a2-79f8-459e-ab3b-77d010c9b139 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:12.994638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861afd9b-1785-4d2e-9daf-49dbb681fe37 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:13.007050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:13.011178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7933ec-bee7-4b07-9e66-dd59c02c7baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:13.012674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7933ec-bee7-4b07-9e66-dd59c02c7baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:13.012674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7933ec-bee7-4b07-9e66-dd59c02c7baf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:13.012674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7933ec-bee7-4b07-9e66-dd59c02c7baf admin admin] PATH_INFO: `/v3/users/c6607c92756d413c8adeef9947ede94d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:13.013671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7933ec-bee7-4b07-9e66-dd59c02c7baf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6607c92756d413c8adeef9947ede94d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:13.015656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7933ec-bee7-4b07-9e66-dd59c02c7baf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:13.149729 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2161/4368] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:12 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:13.151423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e89a2-79f8-459e-ab3b-77d010c9b139 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:13.220843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e89a2-79f8-459e-ab3b-77d010c9b139 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:13.226156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb0f00-a4e6-4aaa-b974-a6bcb2a08798 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:13.226802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0f00-a4e6-4aaa-b974-a6bcb2a08798 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:13.227081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0f00-a4e6-4aaa-b974-a6bcb2a08798 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:13.227354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0f00-a4e6-4aaa-b974-a6bcb2a08798 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:13.227939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb0f00-a4e6-4aaa-b974-a6bcb2a08798 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:13.229605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb0f00-a4e6-4aaa-b974-a6bcb2a08798 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:13.233754 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2162/4369] 10.222.0.76 () {58 vars in 1200 bytes} [Sat Aug 27 04:49:13 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:13.233754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb0f00-a4e6-4aaa-b974-a6bcb2a08798 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:13.236498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3cfb0f00-a4e6-4aaa-b974-a6bcb2a08798 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:13.308723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5f7933ec-bee7-4b07-9e66-dd59c02c7baf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6607c92756d413c8adeef9947ede94d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:13.309782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5f7933ec-bee7-4b07-9e66-dd59c02c7baf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6607c92756d413c8adeef9947ede94d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:13.321408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb0f00-a4e6-4aaa-b974-a6bcb2a08798 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:13.327905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a0d54-b633-4ec8-9785-b71b9100ac05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:13.328579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a0d54-b633-4ec8-9785-b71b9100ac05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:13.328867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a0d54-b633-4ec8-9785-b71b9100ac05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:13.329327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a0d54-b633-4ec8-9785-b71b9100ac05 admin admin] PATH_INFO: `/v3/users/6d0d30cde3524bcbb71b777987ed88d7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:13.330491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a0d54-b633-4ec8-9785-b71b9100ac05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d0d30cde3524bcbb71b777987ed88d7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:13.332473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a0d54-b633-4ec8-9785-b71b9100ac05 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:13.386919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5f7933ec-bee7-4b07-9e66-dd59c02c7baf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6607c92756d413c8adeef9947ede94d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:13.388862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5f7933ec-bee7-4b07-9e66-dd59c02c7baf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6607c92756d413c8adeef9947ede94d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:13.409248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5f7933ec-bee7-4b07-9e66-dd59c02c7baf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6607c92756d413c8adeef9947ede94d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:13.429932 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2208/4370] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:12 2022] DELETE /identity/v3/users/c6607c92756d413c8adeef9947ede94d => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:13.430799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7933ec-bee7-4b07-9e66-dd59c02c7baf admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:13.435967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5f7933ec-bee7-4b07-9e66-dd59c02c7baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:13.509550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7933ec-bee7-4b07-9e66-dd59c02c7baf admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:13.515003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f2434-a7d5-4da9-af5f-3976f1f88412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:13.516229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f2434-a7d5-4da9-af5f-3976f1f88412 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:13.516573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f2434-a7d5-4da9-af5f-3976f1f88412 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:13.516914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f2434-a7d5-4da9-af5f-3976f1f88412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:13.519094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-853f2434-a7d5-4da9-af5f-3976f1f88412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:13.594715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f2434-a7d5-4da9-af5f-3976f1f88412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:13.596237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f2434-a7d5-4da9-af5f-3976f1f88412 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:13.607151 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2209/4371] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:13.608140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f2434-a7d5-4da9-af5f-3976f1f88412 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:13.609649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-853f2434-a7d5-4da9-af5f-3976f1f88412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:13.636602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6e9a0d54-b633-4ec8-9785-b71b9100ac05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d0d30cde3524bcbb71b777987ed88d7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:13.641704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f2434-a7d5-4da9-af5f-3976f1f88412 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:13.648273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91b92d-83a7-4273-bee0-d0f114b64c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:13.649013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b92d-83a7-4273-bee0-d0f114b64c95 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:13.649510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b92d-83a7-4273-bee0-d0f114b64c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:13.649862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b92d-83a7-4273-bee0-d0f114b64c95 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:13.650655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91b92d-83a7-4273-bee0-d0f114b64c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:13.653207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91b92d-83a7-4273-bee0-d0f114b64c95 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:13.780212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6e9a0d54-b633-4ec8-9785-b71b9100ac05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d0d30cde3524bcbb71b777987ed88d7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:13.782512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6e9a0d54-b633-4ec8-9785-b71b9100ac05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d0d30cde3524bcbb71b777987ed88d7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:13.804042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6e9a0d54-b633-4ec8-9785-b71b9100ac05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d0d30cde3524bcbb71b777987ed88d7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:13.837419 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2210/4372] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:13 2022] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:13.837419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91b92d-83a7-4273-bee0-d0f114b64c95 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:13.839941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ad91b92d-83a7-4273-bee0-d0f114b64c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:13.865664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6e9a0d54-b633-4ec8-9785-b71b9100ac05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d0d30cde3524bcbb71b777987ed88d7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:13.879990 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2163/4373] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:13 2022] DELETE /identity/v3/users/6d0d30cde3524bcbb71b777987ed88d7 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:13.879990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a0d54-b633-4ec8-9785-b71b9100ac05 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:13.880405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6e9a0d54-b633-4ec8-9785-b71b9100ac05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:13.955079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91b92d-83a7-4273-bee0-d0f114b64c95 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:14.004629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a0d54-b633-4ec8-9785-b71b9100ac05 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:14.011914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30f189-7f84-4777-a568-d3aca58c4900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:14.012926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30f189-7f84-4777-a568-d3aca58c4900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:14.013502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30f189-7f84-4777-a568-d3aca58c4900 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:14.013931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30f189-7f84-4777-a568-d3aca58c4900 admin admin] PATH_INFO: `/v3/projects/e19f9f3d8e434168a66baaa28ad2c791` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:14.015313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30f189-7f84-4777-a568-d3aca58c4900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e19f9f3d8e434168a66baaa28ad2c791)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:14.018075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30f189-7f84-4777-a568-d3aca58c4900 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:14.029643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb6840-435d-4a5a-b4c8-30585ef85797 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:14.030467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb6840-435d-4a5a-b4c8-30585ef85797 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:14.031459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb6840-435d-4a5a-b4c8-30585ef85797 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:14.031842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb6840-435d-4a5a-b4c8-30585ef85797 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:14.033077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb6840-435d-4a5a-b4c8-30585ef85797 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:14.037911 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-fffb6840-435d-4a5a-b4c8-30585ef85797 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:14.037911 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:49:14.037911 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:49:14.037911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb6840-435d-4a5a-b4c8-30585ef85797 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:14.037911 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2211/4374] 10.222.0.76 () {58 vars in 1221 bytes} [Sat Aug 27 04:49:13 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:14.038556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb6840-435d-4a5a-b4c8-30585ef85797 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:14.040736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fffb6840-435d-4a5a-b4c8-30585ef85797 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:14.074087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb6840-435d-4a5a-b4c8-30585ef85797 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:14.082558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:14.089273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10728e-11a2-4928-89c8-dffaa554233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:14.090008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10728e-11a2-4928-89c8-dffaa554233d admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:14.090357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10728e-11a2-4928-89c8-dffaa554233d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:14.090729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10728e-11a2-4928-89c8-dffaa554233d admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:14.091586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10728e-11a2-4928-89c8-dffaa554233d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:14.093777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10728e-11a2-4928-89c8-dffaa554233d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:14.128596 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2212/4375] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:14.130246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08346a9b-c1c6-43f4-87b8-b326389b06da None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:14.130392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08346a9b-c1c6-43f4-87b8-b326389b06da None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:14.130592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08346a9b-c1c6-43f4-87b8-b326389b06da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:14.159610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-08346a9b-c1c6-43f4-87b8-b326389b06da None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:14.161003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-08346a9b-c1c6-43f4-87b8-b326389b06da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:14.174834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e30f189-7f84-4777-a568-d3aca58c4900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e19f9f3d8e434168a66baaa28ad2c791', 'request_id': 'req-4e30f189-7f84-4777-a568-d3aca58c4900'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:14.184250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e30f189-7f84-4777-a568-d3aca58c4900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e19f9f3d8e434168a66baaa28ad2c791', 'request_id': 'req-4e30f189-7f84-4777-a568-d3aca58c4900'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:14.193774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e30f189-7f84-4777-a568-d3aca58c4900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e19f9f3d8e434168a66baaa28ad2c791', 'request_id': 'req-4e30f189-7f84-4777-a568-d3aca58c4900'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:14.275665 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2213/4376] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:14.275665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08346a9b-c1c6-43f4-87b8-b326389b06da None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:14.287461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-08346a9b-c1c6-43f4-87b8-b326389b06da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:14.290682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e30f189-7f84-4777-a568-d3aca58c4900 admin admin] The token cache is being invalidate because project e19f9f3d8e434168a66baaa28ad2c791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:14.291028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e30f189-7f84-4777-a568-d3aca58c4900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:14.292092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e30f189-7f84-4777-a568-d3aca58c4900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:14.297013 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2164/4377] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:13 2022] DELETE /identity/v3/projects/e19f9f3d8e434168a66baaa28ad2c791 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:14.299201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30f189-7f84-4777-a568-d3aca58c4900 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:14.301200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4e30f189-7f84-4777-a568-d3aca58c4900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:14.321617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30f189-7f84-4777-a568-d3aca58c4900 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:14.330995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a87da2-3071-458a-a2b3-98e5a70160d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:14.331935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a87da2-3071-458a-a2b3-98e5a70160d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:14.333043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a87da2-3071-458a-a2b3-98e5a70160d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:14.333549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a87da2-3071-458a-a2b3-98e5a70160d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:14.334426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a87da2-3071-458a-a2b3-98e5a70160d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:14.336538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a87da2-3071-458a-a2b3-98e5a70160d5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:14.352338 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2165/4378] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:14.353466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a87da2-3071-458a-a2b3-98e5a70160d5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:14.357586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-94a87da2-3071-458a-a2b3-98e5a70160d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:14.446510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a87da2-3071-458a-a2b3-98e5a70160d5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:14.451438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08346a9b-c1c6-43f4-87b8-b326389b06da None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:14.451736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201cdd8-829d-4c53-a1d8-3fbcbef7b0ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:14.452557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201cdd8-829d-4c53-a1d8-3fbcbef7b0ee service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:14.453273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201cdd8-829d-4c53-a1d8-3fbcbef7b0ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:14.454302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201cdd8-829d-4c53-a1d8-3fbcbef7b0ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:14.457452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5201cdd8-829d-4c53-a1d8-3fbcbef7b0ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:14.464604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d7504-6454-4f46-811c-7ada784e4eb1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:14.465465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d7504-6454-4f46-811c-7ada784e4eb1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:14.465744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d7504-6454-4f46-811c-7ada784e4eb1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:14.466013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d7504-6454-4f46-811c-7ada784e4eb1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:14.468381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d7504-6454-4f46-811c-7ada784e4eb1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:14.470018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d7504-6454-4f46-811c-7ada784e4eb1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:14.471219 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2214/4379] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:14 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:14.472410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468a908-d57d-40d3-be23-aaee0ddc2d51 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:14.472674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468a908-d57d-40d3-be23-aaee0ddc2d51 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:14.472943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468a908-d57d-40d3-be23-aaee0ddc2d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:14.474231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201cdd8-829d-4c53-a1d8-3fbcbef7b0ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:14.475978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201cdd8-829d-4c53-a1d8-3fbcbef7b0ee service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:14.488752 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2166/4380] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:14.489963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201cdd8-829d-4c53-a1d8-3fbcbef7b0ee service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:14.500944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201cdd8-829d-4c53-a1d8-3fbcbef7b0ee service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:14.507744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bb581-fc07-4e81-a856-6450ecb3479a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:14.509216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bb581-fc07-4e81-a856-6450ecb3479a admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:14.509850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bb581-fc07-4e81-a856-6450ecb3479a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:14.510337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bb581-fc07-4e81-a856-6450ecb3479a admin admin] PATH_INFO: `/v3/projects/6611b3a536d64d248e1b054f67e417b9/users/e4cd4f1987b84a00b565e2416ee914f7/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:14.520699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6468a908-d57d-40d3-be23-aaee0ddc2d51 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:14.521971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6468a908-d57d-40d3-be23-aaee0ddc2d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:14.534799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bb581-fc07-4e81-a856-6450ecb3479a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6611b3a536d64d248e1b054f67e417b9, user_id=e4cd4f1987b84a00b565e2416ee914f7, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:14.542054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bb581-fc07-4e81-a856-6450ecb3479a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:14.542229 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2215/4381] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:14.542229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468a908-d57d-40d3-be23-aaee0ddc2d51 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:14.547176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6468a908-d57d-40d3-be23-aaee0ddc2d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:14.563743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468a908-d57d-40d3-be23-aaee0ddc2d51 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:14.572896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c13d8a-bbda-45b8-a424-244bd6133371 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:14.579553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c13d8a-bbda-45b8-a424-244bd6133371 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:14.579553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c13d8a-bbda-45b8-a424-244bd6133371 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:14.579553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c13d8a-bbda-45b8-a424-244bd6133371 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:14.579553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c13d8a-bbda-45b8-a424-244bd6133371 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:14.579895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c13d8a-bbda-45b8-a424-244bd6133371 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:14.585991 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2216/4382] 10.222.0.76 () {58 vars in 1188 bytes} [Sat Aug 27 04:49:14 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:14.588154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494cfd8-4a08-4bb1-b765-444e304c4dc1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:14.588459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494cfd8-4a08-4bb1-b765-444e304c4dc1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:14.588731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494cfd8-4a08-4bb1-b765-444e304c4dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:14.618823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e494cfd8-4a08-4bb1-b765-444e304c4dc1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:14.620080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e494cfd8-4a08-4bb1-b765-444e304c4dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:14.640201 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2167/4383] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:14 2022] PUT /identity/v3/projects/6611b3a536d64d248e1b054f67e417b9/users/e4cd4f1987b84a00b565e2416ee914f7/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:14.641121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bb581-fc07-4e81-a856-6450ecb3479a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:14.660125 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2217/4384] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:14.663301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fc77d-f26e-457c-9288-95cf43631606 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:14.663591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fc77d-f26e-457c-9288-95cf43631606 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:14.663857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fc77d-f26e-457c-9288-95cf43631606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:14.706310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0a1fc77d-f26e-457c-9288-95cf43631606 None None] MFA Rules not processed for user `e4cd4f1987b84a00b565e2416ee914f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:14.707630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0a1fc77d-f26e-457c-9288-95cf43631606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:14.765982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bb581-fc07-4e81-a856-6450ecb3479a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:14.770947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d3c1b-efed-46c8-bcbe-24eaf20659a5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:14.771603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3c1b-efed-46c8-bcbe-24eaf20659a5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:14.771886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3c1b-efed-46c8-bcbe-24eaf20659a5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:14.772182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3c1b-efed-46c8-bcbe-24eaf20659a5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:14.772834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d3c1b-efed-46c8-bcbe-24eaf20659a5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:14.774449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d3c1b-efed-46c8-bcbe-24eaf20659a5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:14.775706 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2168/4385] 10.222.0.76 () {58 vars in 1200 bytes} [Sat Aug 27 04:49:14 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:14.780279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d3c1b-efed-46c8-bcbe-24eaf20659a5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:14.810742 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2218/4386] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:14.811949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fc77d-f26e-457c-9288-95cf43631606 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:14.823624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fc77d-f26e-457c-9288-95cf43631606 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:14.831957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14a9cd-023c-4ecc-a70a-735f3084f900 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:14.835326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14a9cd-023c-4ecc-a70a-735f3084f900 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:14.835786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14a9cd-023c-4ecc-a70a-735f3084f900 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:14.836428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14a9cd-023c-4ecc-a70a-735f3084f900 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:14.838420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14a9cd-023c-4ecc-a70a-735f3084f900 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:14.851539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14a9cd-023c-4ecc-a70a-735f3084f900 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:14.856540 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2219/4387] 10.222.0.76 () {58 vars in 1203 bytes} [Sat Aug 27 04:49:14 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:14.859912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14a9cd-023c-4ecc-a70a-735f3084f900 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:14.871242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:14.945709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d3c1b-efed-46c8-bcbe-24eaf20659a5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:14.969527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b42001-3614-482b-a54e-225dc809f029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:14.970842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b42001-3614-482b-a54e-225dc809f029 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:14.971592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b42001-3614-482b-a54e-225dc809f029 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:14.972032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b42001-3614-482b-a54e-225dc809f029 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:14.973888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b42001-3614-482b-a54e-225dc809f029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:14.974718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b42001-3614-482b-a54e-225dc809f029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:14.978533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b42001-3614-482b-a54e-225dc809f029 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:14.999469 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2169/4388] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:14.999469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b42001-3614-482b-a54e-225dc809f029 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:15.002109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-26b42001-3614-482b-a54e-225dc809f029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:15.002208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14a9cd-023c-4ecc-a70a-735f3084f900 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:15.014891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905d06a-738a-4d95-bda2-bb4588787240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:15.015767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905d06a-738a-4d95-bda2-bb4588787240 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:15.016142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905d06a-738a-4d95-bda2-bb4588787240 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:15.017602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b42001-3614-482b-a54e-225dc809f029 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:15.018006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905d06a-738a-4d95-bda2-bb4588787240 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:15.018761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905d06a-738a-4d95-bda2-bb4588787240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:15.024947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dea42-03a7-406e-af5c-99f49434e38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:15.025099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905d06a-738a-4d95-bda2-bb4588787240 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:15.025594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dea42-03a7-406e-af5c-99f49434e38d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:15.036143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dea42-03a7-406e-af5c-99f49434e38d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:15.036811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dea42-03a7-406e-af5c-99f49434e38d admin admin] PATH_INFO: `/v3/projects/6101beb38227466b8f605906fb3ee224` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:15.038774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dea42-03a7-406e-af5c-99f49434e38d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6101beb38227466b8f605906fb3ee224)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:15.042313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dea42-03a7-406e-af5c-99f49434e38d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:15.168248 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2220/4389] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:14 2022] POST /identity/v3/projects => generated 373 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:15.169133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905d06a-738a-4d95-bda2-bb4588787240 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:15.273209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905d06a-738a-4d95-bda2-bb4588787240 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:15.280058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-319dea42-03a7-406e-af5c-99f49434e38d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6101beb38227466b8f605906fb3ee224', 'request_id': 'req-319dea42-03a7-406e-af5c-99f49434e38d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:15.293344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-319dea42-03a7-406e-af5c-99f49434e38d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6101beb38227466b8f605906fb3ee224', 'request_id': 'req-319dea42-03a7-406e-af5c-99f49434e38d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:15.308618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-319dea42-03a7-406e-af5c-99f49434e38d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6101beb38227466b8f605906fb3ee224', 'request_id': 'req-319dea42-03a7-406e-af5c-99f49434e38d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:15.342489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52a5a8-bd01-4e67-80ce-9a9ebcbd5b67 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:15.343168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52a5a8-bd01-4e67-80ce-9a9ebcbd5b67 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:15.344011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52a5a8-bd01-4e67-80ce-9a9ebcbd5b67 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:15.344340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52a5a8-bd01-4e67-80ce-9a9ebcbd5b67 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:15.345106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52a5a8-bd01-4e67-80ce-9a9ebcbd5b67 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:15.346734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52a5a8-bd01-4e67-80ce-9a9ebcbd5b67 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:15.351845 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2221/4390] 10.222.0.76 () {58 vars in 1209 bytes} [Sat Aug 27 04:49:15 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:15.352782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52a5a8-bd01-4e67-80ce-9a9ebcbd5b67 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:15.453642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52a5a8-bd01-4e67-80ce-9a9ebcbd5b67 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:15.475068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-319dea42-03a7-406e-af5c-99f49434e38d admin admin] The token cache is being invalidate because project 6101beb38227466b8f605906fb3ee224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:15.475647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-319dea42-03a7-406e-af5c-99f49434e38d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:15.476470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-319dea42-03a7-406e-af5c-99f49434e38d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:15.478773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf7afb-1358-4b72-81db-3a0f19cff5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:15.479405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf7afb-1358-4b72-81db-3a0f19cff5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:15.479681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf7afb-1358-4b72-81db-3a0f19cff5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:15.479948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf7afb-1358-4b72-81db-3a0f19cff5f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:15.481540 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2170/4391] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:14 2022] DELETE /identity/v3/projects/6101beb38227466b8f605906fb3ee224 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:15.483549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf7afb-1358-4b72-81db-3a0f19cff5f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:15.488722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dea42-03a7-406e-af5c-99f49434e38d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:15.491408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf7afb-1358-4b72-81db-3a0f19cff5f6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:15.493191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-319dea42-03a7-406e-af5c-99f49434e38d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:15.510830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dea42-03a7-406e-af5c-99f49434e38d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:15.517876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c3c45-00d8-48fb-874d-fe4a7df799e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:15.519035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c3c45-00d8-48fb-874d-fe4a7df799e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:15.519387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c3c45-00d8-48fb-874d-fe4a7df799e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:15.519734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c3c45-00d8-48fb-874d-fe4a7df799e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:15.521062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c3c45-00d8-48fb-874d-fe4a7df799e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:15.523657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c3c45-00d8-48fb-874d-fe4a7df799e3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:15.625771 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2222/4392] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:15 2022] POST /identity/v3/projects => generated 389 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:15.628354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf7afb-1358-4b72-81db-3a0f19cff5f6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:15.630779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-29bf7afb-1358-4b72-81db-3a0f19cff5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:15.691695 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2171/4393] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:15 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:15.692712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c3c45-00d8-48fb-874d-fe4a7df799e3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:15.694477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-196c3c45-00d8-48fb-874d-fe4a7df799e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:15.711243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c3c45-00d8-48fb-874d-fe4a7df799e3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:15.754052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf7afb-1358-4b72-81db-3a0f19cff5f6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:15.762900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a2d85-0e30-41be-907b-f52778472c4a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:15.763909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a2d85-0e30-41be-907b-f52778472c4a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:15.768467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a2d85-0e30-41be-907b-f52778472c4a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:15.768800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a2d85-0e30-41be-907b-f52778472c4a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:15.769469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a2d85-0e30-41be-907b-f52778472c4a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:15.771141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a2d85-0e30-41be-907b-f52778472c4a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:15.772312 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2223/4394] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:15 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:15.773067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a2d85-0e30-41be-907b-f52778472c4a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:15.782469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a00a2d85-0e30-41be-907b-f52778472c4a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:15.806530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52daf3-a679-4220-8007-eba3c76b05f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:15.809655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52daf3-a679-4220-8007-eba3c76b05f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:15.809655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52daf3-a679-4220-8007-eba3c76b05f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:15.809655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52daf3-a679-4220-8007-eba3c76b05f1 admin admin] PATH_INFO: `/v3/users/b68e391e6d1f4976846eb71d16012686` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:15.809655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52daf3-a679-4220-8007-eba3c76b05f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68e391e6d1f4976846eb71d16012686)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:15.811239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52daf3-a679-4220-8007-eba3c76b05f1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:15.897304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a2d85-0e30-41be-907b-f52778472c4a tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:15.903269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91b72c-39f2-4602-a2da-5f1ab3443ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:15.904626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91b72c-39f2-4602-a2da-5f1ab3443ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:15.904906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91b72c-39f2-4602-a2da-5f1ab3443ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:15.905317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91b72c-39f2-4602-a2da-5f1ab3443ca4 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:15.906048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91b72c-39f2-4602-a2da-5f1ab3443ca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:15.908201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91b72c-39f2-4602-a2da-5f1ab3443ca4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:16.060759 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2224/4395] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:15 2022] POST /identity/v3/users => generated 295 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:16.061970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91b72c-39f2-4602-a2da-5f1ab3443ca4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:16.075507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91b72c-39f2-4602-a2da-5f1ab3443ca4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:16.082112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6292eef-fa0d-4c50-918e-5f890a9457b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:16.082779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6292eef-fa0d-4c50-918e-5f890a9457b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:16.083469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6292eef-fa0d-4c50-918e-5f890a9457b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:16.083469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6292eef-fa0d-4c50-918e-5f890a9457b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:16.083972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6292eef-fa0d-4c50-918e-5f890a9457b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:16.086047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6292eef-fa0d-4c50-918e-5f890a9457b6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:16.116204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bf52daf3-a679-4220-8007-eba3c76b05f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68e391e6d1f4976846eb71d16012686'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:16.119425 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2225/4396] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:16.120332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6292eef-fa0d-4c50-918e-5f890a9457b6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:16.125183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e6292eef-fa0d-4c50-918e-5f890a9457b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:16.139838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6292eef-fa0d-4c50-918e-5f890a9457b6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:16.144854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:16.145593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:16.146010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:16.146351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f admin admin] PATH_INFO: `/v3/projects/f432cd31e9f04b8e8d23b4ed01719548` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:16.147664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f432cd31e9f04b8e8d23b4ed01719548)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:16.149660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:16.229827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bf52daf3-a679-4220-8007-eba3c76b05f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68e391e6d1f4976846eb71d16012686'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:16.229827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bf52daf3-a679-4220-8007-eba3c76b05f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68e391e6d1f4976846eb71d16012686'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:16.239152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bf52daf3-a679-4220-8007-eba3c76b05f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68e391e6d1f4976846eb71d16012686'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:16.253714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bf52daf3-a679-4220-8007-eba3c76b05f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68e391e6d1f4976846eb71d16012686'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:16.260282 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2172/4397] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:15 2022] DELETE /identity/v3/users/b68e391e6d1f4976846eb71d16012686 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:16.261385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52daf3-a679-4220-8007-eba3c76b05f1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:16.272059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bf52daf3-a679-4220-8007-eba3c76b05f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:16.309937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f432cd31e9f04b8e8d23b4ed01719548', 'request_id': 'req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:16.321002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f432cd31e9f04b8e8d23b4ed01719548', 'request_id': 'req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:16.390499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52daf3-a679-4220-8007-eba3c76b05f1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:16.409867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f432cd31e9f04b8e8d23b4ed01719548', 'request_id': 'req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:16.427355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f admin admin] The token cache is being invalidate because project f432cd31e9f04b8e8d23b4ed01719548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:16.428033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:16.428862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:16.433648 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2226/4398] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:16 2022] DELETE /identity/v3/projects/f432cd31e9f04b8e8d23b4ed01719548 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:16.433648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:16.433648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:16.474825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fff681-a262-48ee-b1ad-ccd7128b8451 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:16.475491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fff681-a262-48ee-b1ad-ccd7128b8451 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:16.475771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fff681-a262-48ee-b1ad-ccd7128b8451 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:16.476041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fff681-a262-48ee-b1ad-ccd7128b8451 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:16.476675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fff681-a262-48ee-b1ad-ccd7128b8451 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:16.478342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fff681-a262-48ee-b1ad-ccd7128b8451 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:16.483038 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2173/4399] 10.222.0.76 () {58 vars in 1218 bytes} [Sat Aug 27 04:49:16 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:16.483038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fff681-a262-48ee-b1ad-ccd7128b8451 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:16.483595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f5fff681-a262-48ee-b1ad-ccd7128b8451 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:16.539557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:16.555434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5cb49-0b21-46ea-8feb-57a0b200d74f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:16.564767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fff681-a262-48ee-b1ad-ccd7128b8451 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:16.569052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfcb91-e47d-4e31-8c53-9ec0c6ecd593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:16.570117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad683a-c9cd-4f69-b629-90194934ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:16.570253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfcb91-e47d-4e31-8c53-9ec0c6ecd593 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:16.570500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfcb91-e47d-4e31-8c53-9ec0c6ecd593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:16.570782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfcb91-e47d-4e31-8c53-9ec0c6ecd593 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:16.570994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad683a-c9cd-4f69-b629-90194934ad8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:16.571280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad683a-c9cd-4f69-b629-90194934ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:16.571447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfcb91-e47d-4e31-8c53-9ec0c6ecd593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:16.571602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad683a-c9cd-4f69-b629-90194934ad8b admin admin] PATH_INFO: `/v3/projects/c2dbe796c827459a89d34997ea26b72f/users/1bb0a6e4eb934a6992e40e9004d1cb70/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:16.578809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfcb91-e47d-4e31-8c53-9ec0c6ecd593 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:16.589244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad683a-c9cd-4f69-b629-90194934ad8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2dbe796c827459a89d34997ea26b72f, user_id=1bb0a6e4eb934a6992e40e9004d1cb70, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:16.592940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad683a-c9cd-4f69-b629-90194934ad8b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:16.601246 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2227/4400] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:16.602138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfcb91-e47d-4e31-8c53-9ec0c6ecd593 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:16.603894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e2bfcb91-e47d-4e31-8c53-9ec0c6ecd593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:16.619954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfcb91-e47d-4e31-8c53-9ec0c6ecd593 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:16.625542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd0a09-545e-4339-a777-4adb33f40e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:16.626493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0a09-545e-4339-a777-4adb33f40e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:16.626783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0a09-545e-4339-a777-4adb33f40e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:16.627061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0a09-545e-4339-a777-4adb33f40e71 admin admin] PATH_INFO: `/v3/users/509079c1e9024b76ae3c93523955ff10` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:16.628303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd0a09-545e-4339-a777-4adb33f40e71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=509079c1e9024b76ae3c93523955ff10)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:16.631516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd0a09-545e-4339-a777-4adb33f40e71 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:16.684810 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2174/4401] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:16 2022] PUT /identity/v3/projects/c2dbe796c827459a89d34997ea26b72f/users/1bb0a6e4eb934a6992e40e9004d1cb70/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:16.686089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad683a-c9cd-4f69-b629-90194934ad8b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:16.686244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:16.689911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4aad683a-c9cd-4f69-b629-90194934ad8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:16.779353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad683a-c9cd-4f69-b629-90194934ad8b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:16.787800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d614b26-edd1-471c-a13d-e4a0be625a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:16.788732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d614b26-edd1-471c-a13d-e4a0be625a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:16.789324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d614b26-edd1-471c-a13d-e4a0be625a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:16.790158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d614b26-edd1-471c-a13d-e4a0be625a66 admin admin] PATH_INFO: `/v3/users/bebbea8db144451e9d86f9ab2dbc2ad7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:16.793220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d614b26-edd1-471c-a13d-e4a0be625a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bebbea8db144451e9d86f9ab2dbc2ad7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:16.795437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d614b26-edd1-471c-a13d-e4a0be625a66 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:16.880289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bbfd0a09-545e-4339-a777-4adb33f40e71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '509079c1e9024b76ae3c93523955ff10'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:16.881309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bbfd0a09-545e-4339-a777-4adb33f40e71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '509079c1e9024b76ae3c93523955ff10'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:16.977684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bbfd0a09-545e-4339-a777-4adb33f40e71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '509079c1e9024b76ae3c93523955ff10'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:16.978903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bbfd0a09-545e-4339-a777-4adb33f40e71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '509079c1e9024b76ae3c93523955ff10'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:17.008719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bbfd0a09-545e-4339-a777-4adb33f40e71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '509079c1e9024b76ae3c93523955ff10'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:17.038918 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2228/4402] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:16 2022] DELETE /identity/v3/users/509079c1e9024b76ae3c93523955ff10 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:17.038918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd0a09-545e-4339-a777-4adb33f40e71 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:17.041033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bbfd0a09-545e-4339-a777-4adb33f40e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:17.058308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9d614b26-edd1-471c-a13d-e4a0be625a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bebbea8db144451e9d86f9ab2dbc2ad7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:17.156523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd0a09-545e-4339-a777-4adb33f40e71 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:17.161299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa3b70-94fa-419f-ae74-9daa8bd25c63 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:17.162102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa3b70-94fa-419f-ae74-9daa8bd25c63 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:17.162386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa3b70-94fa-419f-ae74-9daa8bd25c63 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:17.162662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa3b70-94fa-419f-ae74-9daa8bd25c63 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:17.163414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa3b70-94fa-419f-ae74-9daa8bd25c63 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:17.165166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa3b70-94fa-419f-ae74-9daa8bd25c63 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:17.169651 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2229/4403] 10.222.0.76 () {58 vars in 1248 bytes} [Sat Aug 27 04:49:17 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:17.169651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa3b70-94fa-419f-ae74-9daa8bd25c63 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:17.169870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9d614b26-edd1-471c-a13d-e4a0be625a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bebbea8db144451e9d86f9ab2dbc2ad7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:17.170103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9d614b26-edd1-471c-a13d-e4a0be625a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bebbea8db144451e9d86f9ab2dbc2ad7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:17.178071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9d614b26-edd1-471c-a13d-e4a0be625a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bebbea8db144451e9d86f9ab2dbc2ad7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:17.182383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9efa3b70-94fa-419f-ae74-9daa8bd25c63 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:17.205730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9d614b26-edd1-471c-a13d-e4a0be625a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bebbea8db144451e9d86f9ab2dbc2ad7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:17.224015 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2175/4404] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:16 2022] DELETE /identity/v3/users/bebbea8db144451e9d86f9ab2dbc2ad7 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:17.224015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d614b26-edd1-471c-a13d-e4a0be625a66 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:17.225310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9d614b26-edd1-471c-a13d-e4a0be625a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:17.317526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d614b26-edd1-471c-a13d-e4a0be625a66 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:17.322355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d5a3d-adfb-4d63-bd75-edcdcdc3e81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:17.322971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d5a3d-adfb-4d63-bd75-edcdcdc3e81b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:17.323267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d5a3d-adfb-4d63-bd75-edcdcdc3e81b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:17.323524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d5a3d-adfb-4d63-bd75-edcdcdc3e81b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:17.324190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d5a3d-adfb-4d63-bd75-edcdcdc3e81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:17.325911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d5a3d-adfb-4d63-bd75-edcdcdc3e81b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:17.337150 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2176/4405] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:17.338008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d5a3d-adfb-4d63-bd75-edcdcdc3e81b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:17.339761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1d8d5a3d-adfb-4d63-bd75-edcdcdc3e81b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:17.340615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa3b70-94fa-419f-ae74-9daa8bd25c63 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:17.353667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705a5d-611d-49e8-8c80-1467c535701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:17.354348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705a5d-611d-49e8-8c80-1467c535701a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:17.354630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705a5d-611d-49e8-8c80-1467c535701a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:17.354898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705a5d-611d-49e8-8c80-1467c535701a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:17.355549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb705a5d-611d-49e8-8c80-1467c535701a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:17.362942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d5a3d-adfb-4d63-bd75-edcdcdc3e81b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:17.363074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb705a5d-611d-49e8-8c80-1467c535701a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:17.363156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe4b4d-868f-4776-8845-84d460ff9017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:17.363156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe4b4d-868f-4776-8845-84d460ff9017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:17.363156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe4b4d-868f-4776-8845-84d460ff9017 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:17.363156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe4b4d-868f-4776-8845-84d460ff9017 admin admin] PATH_INFO: `/v3/projects/11ba93008ea24011acf7f6447155c364` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:17.363711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe4b4d-868f-4776-8845-84d460ff9017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ba93008ea24011acf7f6447155c364)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:17.365681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe4b4d-868f-4776-8845-84d460ff9017 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:17.386127 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2230/4406] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:17.386127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705a5d-611d-49e8-8c80-1467c535701a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:17.390179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cb705a5d-611d-49e8-8c80-1467c535701a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:17.477186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705a5d-611d-49e8-8c80-1467c535701a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:17.483283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd082a8f-8085-4818-868f-6873871bf902 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0800b393bf04b7f89216157897ace6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccc4e90fbad4545aa8f905a7a6fa5fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:17.483541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd082a8f-8085-4818-868f-6873871bf902 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:17.483827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd082a8f-8085-4818-868f-6873871bf902 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:17.484105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd082a8f-8085-4818-868f-6873871bf902 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:17.484799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd082a8f-8085-4818-868f-6873871bf902 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:17.485109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd082a8f-8085-4818-868f-6873871bf902 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:17.486715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd082a8f-8085-4818-868f-6873871bf902 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:17.513272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-59fe4b4d-868f-4776-8845-84d460ff9017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ba93008ea24011acf7f6447155c364', 'request_id': 'req-59fe4b4d-868f-4776-8845-84d460ff9017'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:17.513621 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2231/4407] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:17.514493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd082a8f-8085-4818-868f-6873871bf902 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:17.518255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bd082a8f-8085-4818-868f-6873871bf902 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:17.523082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-59fe4b4d-868f-4776-8845-84d460ff9017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ba93008ea24011acf7f6447155c364', 'request_id': 'req-59fe4b4d-868f-4776-8845-84d460ff9017'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:17.532568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-59fe4b4d-868f-4776-8845-84d460ff9017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ba93008ea24011acf7f6447155c364', 'request_id': 'req-59fe4b4d-868f-4776-8845-84d460ff9017'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:17.620384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-59fe4b4d-868f-4776-8845-84d460ff9017 admin admin] The token cache is being invalidate because project 11ba93008ea24011acf7f6447155c364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:17.620815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-59fe4b4d-868f-4776-8845-84d460ff9017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:17.622889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-59fe4b4d-868f-4776-8845-84d460ff9017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:17.625973 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2177/4408] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:17 2022] DELETE /identity/v3/projects/11ba93008ea24011acf7f6447155c364 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:17.627220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe4b4d-868f-4776-8845-84d460ff9017 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:17.632320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-59fe4b4d-868f-4776-8845-84d460ff9017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:17.668240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd082a8f-8085-4818-868f-6873871bf902 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:17.772600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe4b4d-868f-4776-8845-84d460ff9017 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:17.774860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ef625-a261-4122-ac24-1c8a7cca81fb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:17.775699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ef625-a261-4122-ac24-1c8a7cca81fb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:17.777057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ef625-a261-4122-ac24-1c8a7cca81fb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:17.777512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ef625-a261-4122-ac24-1c8a7cca81fb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:17.779275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b09f4-e39b-4e85-8639-d3d6be85af6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:17.779666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ef625-a261-4122-ac24-1c8a7cca81fb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:17.779987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b09f4-e39b-4e85-8639-d3d6be85af6f admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:17.780320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b09f4-e39b-4e85-8639-d3d6be85af6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:17.780595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b09f4-e39b-4e85-8639-d3d6be85af6f admin admin] PATH_INFO: `/v3/projects/c2dbe796c827459a89d34997ea26b72f/users/1bb0a6e4eb934a6992e40e9004d1cb70/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:17.782855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ef625-a261-4122-ac24-1c8a7cca81fb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:17.784984 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2232/4409] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:17 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:17.785165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b09f4-e39b-4e85-8639-d3d6be85af6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2dbe796c827459a89d34997ea26b72f, user_id=1bb0a6e4eb934a6992e40e9004d1cb70, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:17.787037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ef625-a261-4122-ac24-1c8a7cca81fb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:17.788921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b09f4-e39b-4e85-8639-d3d6be85af6f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:17.791451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:17.793954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e93ef625-a261-4122-ac24-1c8a7cca81fb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:17.815496 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2178/4410] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:17 2022] PUT /identity/v3/projects/c2dbe796c827459a89d34997ea26b72f/users/1bb0a6e4eb934a6992e40e9004d1cb70/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:17.815496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b09f4-e39b-4e85-8639-d3d6be85af6f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:17.815496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b34b09f4-e39b-4e85-8639-d3d6be85af6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:17.828763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ef625-a261-4122-ac24-1c8a7cca81fb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:17.870846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:17.905146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533ee3e-62e4-4c99-9e30-8eab0b0fc364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:17.905903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533ee3e-62e4-4c99-9e30-8eab0b0fc364 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:17.906158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533ee3e-62e4-4c99-9e30-8eab0b0fc364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:17.906434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533ee3e-62e4-4c99-9e30-8eab0b0fc364 admin admin] PATH_INFO: `/v3/projects/b6d126858dec4bb499603c7ca379370b/users/e96a441cd02645d88fdd290a1392effa/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:17.908827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b09f4-e39b-4e85-8639-d3d6be85af6f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:17.923053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7b0b0-96cd-4e8f-9ae0-7ade549eb1cb tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0800b393bf04b7f89216157897ace6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccc4e90fbad4545aa8f905a7a6fa5fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:17.923392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533ee3e-62e4-4c99-9e30-8eab0b0fc364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d126858dec4bb499603c7ca379370b, user_id=e96a441cd02645d88fdd290a1392effa, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:17.923900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7b0b0-96cd-4e8f-9ae0-7ade549eb1cb tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:17.924330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7b0b0-96cd-4e8f-9ae0-7ade549eb1cb tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:17.924533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7b0b0-96cd-4e8f-9ae0-7ade549eb1cb tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:17.925232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7b0b0-96cd-4e8f-9ae0-7ade549eb1cb tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:17.926539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533ee3e-62e4-4c99-9e30-8eab0b0fc364 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:17.928268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7b0b0-96cd-4e8f-9ae0-7ade549eb1cb tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:18.052928 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2179/4411] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:17 2022] POST /identity/v3/projects => generated 348 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:18.053920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7b0b0-96cd-4e8f-9ae0-7ade549eb1cb tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:18.060474 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2233/4412] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:17 2022] PUT /identity/v3/projects/b6d126858dec4bb499603c7ca379370b/users/e96a441cd02645d88fdd290a1392effa/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:18.068211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c67329-b7ca-4e0c-b7e5-e6d633a9ef9e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:18.068410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b8e7b0b0-96cd-4e8f-9ae0-7ade549eb1cb tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:18.068802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c67329-b7ca-4e0c-b7e5-e6d633a9ef9e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:18.068802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c67329-b7ca-4e0c-b7e5-e6d633a9ef9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:18.098255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-51c67329-b7ca-4e0c-b7e5-e6d633a9ef9e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:18.099640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-51c67329-b7ca-4e0c-b7e5-e6d633a9ef9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:18.173373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7b0b0-96cd-4e8f-9ae0-7ade549eb1cb tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:18.179713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:18.180495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:18.180778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:18.181052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6 admin admin] PATH_INFO: `/v3/projects/0736e03453ca4ec790545a32d5eeb750` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:18.182521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0736e03453ca4ec790545a32d5eeb750)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:18.185785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:18.198277 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2234/4413] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:18.198277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c67329-b7ca-4e0c-b7e5-e6d633a9ef9e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:18.201907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-51c67329-b7ca-4e0c-b7e5-e6d633a9ef9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:18.291129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c67329-b7ca-4e0c-b7e5-e6d633a9ef9e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:18.296941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11955531-4f20-4ad6-bfc5-c573892053f5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:18.302971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11955531-4f20-4ad6-bfc5-c573892053f5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:18.302971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11955531-4f20-4ad6-bfc5-c573892053f5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:18.302971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11955531-4f20-4ad6-bfc5-c573892053f5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:18.302971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11955531-4f20-4ad6-bfc5-c573892053f5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:18.303314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11955531-4f20-4ad6-bfc5-c573892053f5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:18.303314 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2235/4414] 10.222.0.76 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:18 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:18.303314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a5e00-c9d0-4ffe-ad86-1462fdd00b56 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:18.303314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a5e00-c9d0-4ffe-ad86-1462fdd00b56 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:18.303567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a5e00-c9d0-4ffe-ad86-1462fdd00b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:18.334203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-878a5e00-c9d0-4ffe-ad86-1462fdd00b56 None None] MFA Rules not processed for user `1bb0a6e4eb934a6992e40e9004d1cb70`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:18.335454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-878a5e00-c9d0-4ffe-ad86-1462fdd00b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:18.350148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0736e03453ca4ec790545a32d5eeb750', 'request_id': 'req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:18.355920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0736e03453ca4ec790545a32d5eeb750', 'request_id': 'req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:18.363750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0736e03453ca4ec790545a32d5eeb750', 'request_id': 'req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:18.412431 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2236/4415] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:18.413275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a5e00-c9d0-4ffe-ad86-1462fdd00b56 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:18.414780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-878a5e00-c9d0-4ffe-ad86-1462fdd00b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:18.461967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6 admin admin] The token cache is being invalidate because project 0736e03453ca4ec790545a32d5eeb750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:18.462654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:18.463163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:18.464798 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2180/4416] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:18 2022] DELETE /identity/v3/projects/0736e03453ca4ec790545a32d5eeb750 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:18.469047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:18.469470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:18.496262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a5e00-c9d0-4ffe-ad86-1462fdd00b56 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:18.502932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d5000-b474-4c87-8240-da3b271d18c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:18.504608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d5000-b474-4c87-8240-da3b271d18c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:18.504608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d5000-b474-4c87-8240-da3b271d18c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:18.504922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d5000-b474-4c87-8240-da3b271d18c3 admin admin] PATH_INFO: `/v3/projects/e1264874f1194dcbb76d73e354978a36` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:18.506223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d5000-b474-4c87-8240-da3b271d18c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1264874f1194dcbb76d73e354978a36)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:18.508647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d5000-b474-4c87-8240-da3b271d18c3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:18.565923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634372f-83a8-4a85-9c1b-f1fdc1b3cdf6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:18.570884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fc4b5-4ec8-45f2-af94-88168e11656a tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0800b393bf04b7f89216157897ace6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccc4e90fbad4545aa8f905a7a6fa5fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:18.572060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fc4b5-4ec8-45f2-af94-88168e11656a tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:18.572060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fc4b5-4ec8-45f2-af94-88168e11656a tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:18.572060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fc4b5-4ec8-45f2-af94-88168e11656a tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:18.572713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fc4b5-4ec8-45f2-af94-88168e11656a tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:18.573019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fc4b5-4ec8-45f2-af94-88168e11656a tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:18.574674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fc4b5-4ec8-45f2-af94-88168e11656a tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:18.594372 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2181/4417] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:18.594372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d103677-928a-4d26-aa8b-e6776e2ea114 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:18.594372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d103677-928a-4d26-aa8b-e6776e2ea114 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:18.594372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d103677-928a-4d26-aa8b-e6776e2ea114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:18.627939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9d103677-928a-4d26-aa8b-e6776e2ea114 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:18.629216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9d103677-928a-4d26-aa8b-e6776e2ea114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:18.632129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-863d5000-b474-4c87-8240-da3b271d18c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1264874f1194dcbb76d73e354978a36', 'request_id': 'req-863d5000-b474-4c87-8240-da3b271d18c3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:18.639973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-863d5000-b474-4c87-8240-da3b271d18c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1264874f1194dcbb76d73e354978a36', 'request_id': 'req-863d5000-b474-4c87-8240-da3b271d18c3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:18.706505 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2182/4418] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:18.708221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb635a-5e61-4ce5-8736-b12a9d17e138 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:18.708681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb635a-5e61-4ce5-8736-b12a9d17e138 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:18.709094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb635a-5e61-4ce5-8736-b12a9d17e138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:18.730714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d1eb635a-5e61-4ce5-8736-b12a9d17e138 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:18.733796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d1eb635a-5e61-4ce5-8736-b12a9d17e138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:18.745000 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2183/4419] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:18.754448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb635a-5e61-4ce5-8736-b12a9d17e138 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:18.754448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d1eb635a-5e61-4ce5-8736-b12a9d17e138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:18.779571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-863d5000-b474-4c87-8240-da3b271d18c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1264874f1194dcbb76d73e354978a36', 'request_id': 'req-863d5000-b474-4c87-8240-da3b271d18c3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:18.806689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-863d5000-b474-4c87-8240-da3b271d18c3 admin admin] The token cache is being invalidate because project e1264874f1194dcbb76d73e354978a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:18.806689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-863d5000-b474-4c87-8240-da3b271d18c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:18.808099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-863d5000-b474-4c87-8240-da3b271d18c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:18.811368 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2237/4420] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:18 2022] DELETE /identity/v3/projects/e1264874f1194dcbb76d73e354978a36 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:18.812199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d5000-b474-4c87-8240-da3b271d18c3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:18.817268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-863d5000-b474-4c87-8240-da3b271d18c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:18.894022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb635a-5e61-4ce5-8736-b12a9d17e138 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:18.900774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b985907-b0dc-4e9c-b2fa-ab5523249592 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:18.902166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b985907-b0dc-4e9c-b2fa-ab5523249592 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:18.902551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b985907-b0dc-4e9c-b2fa-ab5523249592 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:18.903071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b985907-b0dc-4e9c-b2fa-ab5523249592 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:18.904500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b985907-b0dc-4e9c-b2fa-ab5523249592 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:18.914457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b985907-b0dc-4e9c-b2fa-ab5523249592 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:18.914457 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2184/4421] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:49:18 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:18.914457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbe0a2-66fd-46f8-8102-01e7e8b91c7f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:18.914457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbe0a2-66fd-46f8-8102-01e7e8b91c7f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:18.914457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbe0a2-66fd-46f8-8102-01e7e8b91c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:18.932607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d5000-b474-4c87-8240-da3b271d18c3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:18.940735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a5dbe0a2-66fd-46f8-8102-01e7e8b91c7f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:18.941965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a5dbe0a2-66fd-46f8-8102-01e7e8b91c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:18.944091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebfc6e-d393-43b9-ad89-d33cfbe68458 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:18.944867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebfc6e-d393-43b9-ad89-d33cfbe68458 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:18.945265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebfc6e-d393-43b9-ad89-d33cfbe68458 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:18.945562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebfc6e-d393-43b9-ad89-d33cfbe68458 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:18.946410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebfc6e-d393-43b9-ad89-d33cfbe68458 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:18.949507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebfc6e-d393-43b9-ad89-d33cfbe68458 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:18.950917 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2185/4422] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:18.951649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbe0a2-66fd-46f8-8102-01e7e8b91c7f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:18.953034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a5dbe0a2-66fd-46f8-8102-01e7e8b91c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:19.034636 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2238/4423] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:18 2022] POST /identity/v3/services => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:19.035376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebfc6e-d393-43b9-ad89-d33cfbe68458 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:19.037267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-67ebfc6e-d393-43b9-ad89-d33cfbe68458 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:19.041826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbe0a2-66fd-46f8-8102-01e7e8b91c7f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:19.056943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbeef6-6b91-4313-be17-95dedb5178cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:19.057643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbeef6-6b91-4313-be17-95dedb5178cb service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.058069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbeef6-6b91-4313-be17-95dedb5178cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.058601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbeef6-6b91-4313-be17-95dedb5178cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.061320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c8fbeef6-6b91-4313-be17-95dedb5178cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:19.063770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebfc6e-d393-43b9-ad89-d33cfbe68458 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:19.069070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f472e6f-5bf1-441b-a655-9f0bcf6a56b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:19.069686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f472e6f-5bf1-441b-a655-9f0bcf6a56b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.073268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f472e6f-5bf1-441b-a655-9f0bcf6a56b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.073268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f472e6f-5bf1-441b-a655-9f0bcf6a56b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.073268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f472e6f-5bf1-441b-a655-9f0bcf6a56b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:19.073268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f472e6f-5bf1-441b-a655-9f0bcf6a56b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:19.073268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f472e6f-5bf1-441b-a655-9f0bcf6a56b4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:19.074620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbeef6-6b91-4313-be17-95dedb5178cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:19.076250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbeef6-6b91-4313-be17-95dedb5178cb service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:19.086119 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2239/4424] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:19.086760 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2186/4425] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:19.087768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe0587-8d28-48dd-a460-5b1b92ee258d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.088073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe0587-8d28-48dd-a460-5b1b92ee258d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.088237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2ed52-082e-4b3a-a8eb-1ffb6a8930bd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.088383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe0587-8d28-48dd-a460-5b1b92ee258d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.088606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2ed52-082e-4b3a-a8eb-1ffb6a8930bd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.088948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2ed52-082e-4b3a-a8eb-1ffb6a8930bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.110100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7dbe0587-8d28-48dd-a460-5b1b92ee258d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:19.111461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7dbe0587-8d28-48dd-a460-5b1b92ee258d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:19.121558 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2240/4426] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:19.122631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe0587-8d28-48dd-a460-5b1b92ee258d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:19.133732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7dbe0587-8d28-48dd-a460-5b1b92ee258d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:19.133925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e2d2ed52-082e-4b3a-a8eb-1ffb6a8930bd None None] MFA Rules not processed for user `57e997b636c74fe28f2bcff8e8d2f7c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:19.133925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e2d2ed52-082e-4b3a-a8eb-1ffb6a8930bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:19.155203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe0587-8d28-48dd-a460-5b1b92ee258d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:19.160506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb63dc-7a98-441a-a79c-4e75d2892e77 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:19.161308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb63dc-7a98-441a-a79c-4e75d2892e77 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.161701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb63dc-7a98-441a-a79c-4e75d2892e77 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.162544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb63dc-7a98-441a-a79c-4e75d2892e77 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.162841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb63dc-7a98-441a-a79c-4e75d2892e77 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:19.164928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb63dc-7a98-441a-a79c-4e75d2892e77 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:19.166464 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2241/4427] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:19 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:19.167677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66648d7-49be-495d-8fe8-0f59f7661967 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.168021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66648d7-49be-495d-8fe8-0f59f7661967 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.168398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66648d7-49be-495d-8fe8-0f59f7661967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.194781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d66648d7-49be-495d-8fe8-0f59f7661967 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:19.196093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d66648d7-49be-495d-8fe8-0f59f7661967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:19.210770 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2242/4428] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:19.211676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66648d7-49be-495d-8fe8-0f59f7661967 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:19.244283 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2187/4429] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:19 2022] POST /identity/v3/auth/tokens => generated 3385 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:19.244450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2ed52-082e-4b3a-a8eb-1ffb6a8930bd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:19.248844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66648d7-49be-495d-8fe8-0f59f7661967 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:19.254110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679a001-c35c-44af-b7ae-7b11736fe0f1 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:19.254977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679a001-c35c-44af-b7ae-7b11736fe0f1 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.263413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679a001-c35c-44af-b7ae-7b11736fe0f1 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.263413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679a001-c35c-44af-b7ae-7b11736fe0f1 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.263413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679a001-c35c-44af-b7ae-7b11736fe0f1 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:19.263413 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-1679a001-c35c-44af-b7ae-7b11736fe0f1 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:19.263413 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:49:19.263413 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:49:19.264871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679a001-c35c-44af-b7ae-7b11736fe0f1 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:19.264962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2ed52-082e-4b3a-a8eb-1ffb6a8930bd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:19.266251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95b372-23ab-4069-b9dc-5047d3488cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:19.267055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95b372-23ab-4069-b9dc-5047d3488cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.267340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95b372-23ab-4069-b9dc-5047d3488cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.267644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95b372-23ab-4069-b9dc-5047d3488cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.268332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95b372-23ab-4069-b9dc-5047d3488cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:19.270250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95b372-23ab-4069-b9dc-5047d3488cf7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:19.361358 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2243/4430] 10.222.0.76 () {60 vars in 1213 bytes} [Sat Aug 27 04:49:19 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:19.362676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7388d77-c2f7-4445-bf20-a9d9ca00bf60 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.363362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7388d77-c2f7-4445-bf20-a9d9ca00bf60 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.363362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7388d77-c2f7-4445-bf20-a9d9ca00bf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.384458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a7388d77-c2f7-4445-bf20-a9d9ca00bf60 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:19.385680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a7388d77-c2f7-4445-bf20-a9d9ca00bf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:19.400739 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2244/4431] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:19.400739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7388d77-c2f7-4445-bf20-a9d9ca00bf60 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:19.402525 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2188/4432] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:19 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:19.403195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95b372-23ab-4069-b9dc-5047d3488cf7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:19.413970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7388d77-c2f7-4445-bf20-a9d9ca00bf60 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:19.481651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:19.485308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95b372-23ab-4069-b9dc-5047d3488cf7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:19.490714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92832d7-7e33-4584-a529-fbe1310f0d10 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:19.490714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92832d7-7e33-4584-a529-fbe1310f0d10 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.490714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92832d7-7e33-4584-a529-fbe1310f0d10 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.491386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92832d7-7e33-4584-a529-fbe1310f0d10 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.491467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f2087-7292-4f71-954b-7c76cf206f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:19.491557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92832d7-7e33-4584-a529-fbe1310f0d10 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:19.491661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2087-7292-4f71-954b-7c76cf206f67 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.492042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2087-7292-4f71-954b-7c76cf206f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.492042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2087-7292-4f71-954b-7c76cf206f67 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.492769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f2087-7292-4f71-954b-7c76cf206f67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:19.493068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f2087-7292-4f71-954b-7c76cf206f67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:19.493193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92832d7-7e33-4584-a529-fbe1310f0d10 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:19.498405 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2245/4433] 10.222.0.76 () {58 vars in 1239 bytes} [Sat Aug 27 04:49:19 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:19.498607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f2087-7292-4f71-954b-7c76cf206f67 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:19.498698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a36fb1-44fe-429d-9b0b-7e7414d84d96 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.498698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a36fb1-44fe-429d-9b0b-7e7414d84d96 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.498698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a36fb1-44fe-429d-9b0b-7e7414d84d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.512600 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2189/4434] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:19.520762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f2087-7292-4f71-954b-7c76cf206f67 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:19.520914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-56a36fb1-44fe-429d-9b0b-7e7414d84d96 None None] MFA Rules not processed for user `57e997b636c74fe28f2bcff8e8d2f7c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:19.521987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-56a36fb1-44fe-429d-9b0b-7e7414d84d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:19.576392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:19.588877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f2087-7292-4f71-954b-7c76cf206f67 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:19.595643 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2246/4435] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:19 2022] POST /identity/v3/auth/tokens => generated 3385 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:19.595643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a36fb1-44fe-429d-9b0b-7e7414d84d96 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:19.597964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e27a3b-bd80-484a-acdb-28af5efef7c8 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:19.598665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e27a3b-bd80-484a-acdb-28af5efef7c8 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.599028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e27a3b-bd80-484a-acdb-28af5efef7c8 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.599382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e27a3b-bd80-484a-acdb-28af5efef7c8 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.600348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e27a3b-bd80-484a-acdb-28af5efef7c8 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:19.602673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e27a3b-bd80-484a-acdb-28af5efef7c8 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:19.607252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a36fb1-44fe-429d-9b0b-7e7414d84d96 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:19.612309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b69c73-49fe-41a8-8d4e-7c45f067c1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:19.617230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b69c73-49fe-41a8-8d4e-7c45f067c1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.617230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b69c73-49fe-41a8-8d4e-7c45f067c1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.617230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b69c73-49fe-41a8-8d4e-7c45f067c1b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.617230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b69c73-49fe-41a8-8d4e-7c45f067c1b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:19.617230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b69c73-49fe-41a8-8d4e-7c45f067c1b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:19.617230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b69c73-49fe-41a8-8d4e-7c45f067c1b8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:19.629913 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2247/4436] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:19.630781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b69c73-49fe-41a8-8d4e-7c45f067c1b8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:19.641245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b69c73-49fe-41a8-8d4e-7c45f067c1b8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:19.646934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888d48b-b2c5-4502-bddb-1a65803ae1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:19.647572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888d48b-b2c5-4502-bddb-1a65803ae1ff admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.647849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888d48b-b2c5-4502-bddb-1a65803ae1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.648122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888d48b-b2c5-4502-bddb-1a65803ae1ff admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.648814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888d48b-b2c5-4502-bddb-1a65803ae1ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:19.651059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888d48b-b2c5-4502-bddb-1a65803ae1ff admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:19.670318 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2190/4437] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:19 2022] POST /identity/v3/services => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:19.671098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e27a3b-bd80-484a-acdb-28af5efef7c8 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:19.696692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e27a3b-bd80-484a-acdb-28af5efef7c8 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:19.702835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b52c1-2a24-412f-830b-f9a1deb66676 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:19.703496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b52c1-2a24-412f-830b-f9a1deb66676 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.703830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b52c1-2a24-412f-830b-f9a1deb66676 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.704116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b52c1-2a24-412f-830b-f9a1deb66676 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.705495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b52c1-2a24-412f-830b-f9a1deb66676 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:19.707482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b52c1-2a24-412f-830b-f9a1deb66676 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:19.708643 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2191/4438] 10.222.0.76 () {58 vars in 1242 bytes} [Sat Aug 27 04:49:19 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:19.714688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b52c1-2a24-412f-830b-f9a1deb66676 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:19.732594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b52c1-2a24-412f-830b-f9a1deb66676 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:19.743736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bf773-0e88-4367-892d-76061973b17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:19.744910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bf773-0e88-4367-892d-76061973b17a admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.745820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bf773-0e88-4367-892d-76061973b17a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.749378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bf773-0e88-4367-892d-76061973b17a admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.749626 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2248/4439] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:19 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:19.749736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bf773-0e88-4367-892d-76061973b17a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:19.749847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888d48b-b2c5-4502-bddb-1a65803ae1ff admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:19.751418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bf773-0e88-4367-892d-76061973b17a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:19.752548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5888d48b-b2c5-4502-bddb-1a65803ae1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:19.853035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888d48b-b2c5-4502-bddb-1a65803ae1ff admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:19.871852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc201a8-1813-4461-a6a7-105659fc5a93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:19.872938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc201a8-1813-4461-a6a7-105659fc5a93 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:19.878737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc201a8-1813-4461-a6a7-105659fc5a93 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:19.878737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc201a8-1813-4461-a6a7-105659fc5a93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:19.879464 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2192/4440] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:19 2022] POST /identity/v3/projects => generated 403 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:19.879464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bf773-0e88-4367-892d-76061973b17a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:19.882612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc201a8-1813-4461-a6a7-105659fc5a93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:19.884247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc201a8-1813-4461-a6a7-105659fc5a93 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:19.906652 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2249/4441] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:19 2022] GET /identity/v3/auth/tokens => generated 3517 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:19.907618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc201a8-1813-4461-a6a7-105659fc5a93 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:19.931770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc201a8-1813-4461-a6a7-105659fc5a93 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:19.990156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bf773-0e88-4367-892d-76061973b17a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:20.007291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a227354-757d-4a06-8165-28607ce93535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:20.008095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a227354-757d-4a06-8165-28607ce93535 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:20.008609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a227354-757d-4a06-8165-28607ce93535 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:20.009582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a227354-757d-4a06-8165-28607ce93535 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:20.010340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a227354-757d-4a06-8165-28607ce93535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:20.012559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a227354-757d-4a06-8165-28607ce93535 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:20.024296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8aea3-340d-4d07-9aa5-219af7996d94 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:20.025128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8aea3-340d-4d07-9aa5-219af7996d94 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:20.025672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8aea3-340d-4d07-9aa5-219af7996d94 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:20.028055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8aea3-340d-4d07-9aa5-219af7996d94 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:20.028055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8aea3-340d-4d07-9aa5-219af7996d94 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:20.029277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8aea3-340d-4d07-9aa5-219af7996d94 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:20.132967 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2193/4442] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:19 2022] POST /identity/v3/projects => generated 385 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:20.134141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a227354-757d-4a06-8165-28607ce93535 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:20.139291 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2250/4443] 10.222.0.76 () {60 vars in 1213 bytes} [Sat Aug 27 04:49:19 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:20.140999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8aea3-340d-4d07-9aa5-219af7996d94 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:20.159600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8aea3-340d-4d07-9aa5-219af7996d94 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:20.214772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a227354-757d-4a06-8165-28607ce93535 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:20.221377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3986d-13eb-4b81-b345-7af7122d7871 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:20.222255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3986d-13eb-4b81-b345-7af7122d7871 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:20.222607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3986d-13eb-4b81-b345-7af7122d7871 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:20.222956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3986d-13eb-4b81-b345-7af7122d7871 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:20.223712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3986d-13eb-4b81-b345-7af7122d7871 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:20.225902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3986d-13eb-4b81-b345-7af7122d7871 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:20.226352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61264f-71ac-4823-ae2f-637cc6ba6032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:20.226980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61264f-71ac-4823-ae2f-637cc6ba6032 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:20.227672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61264f-71ac-4823-ae2f-637cc6ba6032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:20.227672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61264f-71ac-4823-ae2f-637cc6ba6032 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:20.228273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61264f-71ac-4823-ae2f-637cc6ba6032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:20.230056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61264f-71ac-4823-ae2f-637cc6ba6032 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:20.231016 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2194/4444] 10.222.0.76 () {58 vars in 1248 bytes} [Sat Aug 27 04:49:20 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:20.232649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3986d-13eb-4b81-b345-7af7122d7871 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:20.245994 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2251/4445] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:20.247156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61264f-71ac-4823-ae2f-637cc6ba6032 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:20.249843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5c61264f-71ac-4823-ae2f-637cc6ba6032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:20.253891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3986d-13eb-4b81-b345-7af7122d7871 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:20.275238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974594b4-07c0-4a43-a811-6e96040bfee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:20.277136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974594b4-07c0-4a43-a811-6e96040bfee4 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:20.279085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974594b4-07c0-4a43-a811-6e96040bfee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:20.279901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974594b4-07c0-4a43-a811-6e96040bfee4 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:20.295396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974594b4-07c0-4a43-a811-6e96040bfee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:20.295396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974594b4-07c0-4a43-a811-6e96040bfee4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:20.345940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61264f-71ac-4823-ae2f-637cc6ba6032 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:20.354249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42af9c-b16e-4e77-a150-7dfdb840e605 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0800b393bf04b7f89216157897ace6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ccc4e90fbad4545aa8f905a7a6fa5fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:20.358334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42af9c-b16e-4e77-a150-7dfdb840e605 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:20.358334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42af9c-b16e-4e77-a150-7dfdb840e605 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:20.358334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42af9c-b16e-4e77-a150-7dfdb840e605 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] PATH_INFO: `/v3/projects/48d46818df254c8eb31e1c575cf2e795` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:20.358334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42af9c-b16e-4e77-a150-7dfdb840e605 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] RBAC: Authorizing `identity:delete_project(project_id=48d46818df254c8eb31e1c575cf2e795)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:20.359960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42af9c-b16e-4e77-a150-7dfdb840e605 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:20.457313 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2195/4446] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:20 2022] POST /identity/v3/users => generated 302 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:20.458781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974594b4-07c0-4a43-a811-6e96040bfee4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:20.474369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974594b4-07c0-4a43-a811-6e96040bfee4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:20.482514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa2754-cb25-4fa8-ae44-9d97ff7519c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:20.484370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa2754-cb25-4fa8-ae44-9d97ff7519c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:20.484847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa2754-cb25-4fa8-ae44-9d97ff7519c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:20.485299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa2754-cb25-4fa8-ae44-9d97ff7519c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:20.485969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa2754-cb25-4fa8-ae44-9d97ff7519c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:20.489891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa2754-cb25-4fa8-ae44-9d97ff7519c3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:20.504341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bc42af9c-b16e-4e77-a150-7dfdb840e605 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48d46818df254c8eb31e1c575cf2e795', 'request_id': 'req-bc42af9c-b16e-4e77-a150-7dfdb840e605'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:20.510983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bc42af9c-b16e-4e77-a150-7dfdb840e605 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48d46818df254c8eb31e1c575cf2e795', 'request_id': 'req-bc42af9c-b16e-4e77-a150-7dfdb840e605'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:20.583793 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2196/4447] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:20 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:20.587696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa2754-cb25-4fa8-ae44-9d97ff7519c3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:20.601263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bc42af9c-b16e-4e77-a150-7dfdb840e605 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48d46818df254c8eb31e1c575cf2e795', 'request_id': 'req-bc42af9c-b16e-4e77-a150-7dfdb840e605'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:20.617492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bc42af9c-b16e-4e77-a150-7dfdb840e605 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] The token cache is being invalidate because project 48d46818df254c8eb31e1c575cf2e795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:20.617492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bc42af9c-b16e-4e77-a150-7dfdb840e605 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:20.621523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bc42af9c-b16e-4e77-a150-7dfdb840e605 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:20.623593 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2252/4448] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:20 2022] DELETE /identity/v3/projects/48d46818df254c8eb31e1c575cf2e795 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:20.624176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42af9c-b16e-4e77-a150-7dfdb840e605 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:20.628439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bc42af9c-b16e-4e77-a150-7dfdb840e605 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:20.682223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa2754-cb25-4fa8-ae44-9d97ff7519c3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:20.712863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42af9c-b16e-4e77-a150-7dfdb840e605 tempest-RoutersIpV6AdminTest-1569844316 tempest-RoutersIpV6AdminTest-1569844316-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:20.718001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782efb59-5fe9-4f8c-bb1a-8361d3060d43 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:20.718657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782efb59-5fe9-4f8c-bb1a-8361d3060d43 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:20.718965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782efb59-5fe9-4f8c-bb1a-8361d3060d43 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:20.720039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782efb59-5fe9-4f8c-bb1a-8361d3060d43 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:20.720039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782efb59-5fe9-4f8c-bb1a-8361d3060d43 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:20.721782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782efb59-5fe9-4f8c-bb1a-8361d3060d43 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:20.723078 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2253/4449] 10.222.0.76 () {58 vars in 1248 bytes} [Sat Aug 27 04:49:20 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:20.723846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782efb59-5fe9-4f8c-bb1a-8361d3060d43 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:20.727745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-782efb59-5fe9-4f8c-bb1a-8361d3060d43 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:20.748636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d255b4-3cc0-47ac-87ce-f93587139280 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:20.749262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d255b4-3cc0-47ac-87ce-f93587139280 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:20.749548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d255b4-3cc0-47ac-87ce-f93587139280 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:20.749832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d255b4-3cc0-47ac-87ce-f93587139280 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:20.750462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d255b4-3cc0-47ac-87ce-f93587139280 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:20.751808 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-76d255b4-3cc0-47ac-87ce-f93587139280 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:20.751808 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:49:20.751808 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:49:20.752809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d255b4-3cc0-47ac-87ce-f93587139280 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:20.760002 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2197/4450] 10.222.0.76 () {58 vars in 1191 bytes} [Sat Aug 27 04:49:20 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 762 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:20.762430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeaaf3-04b7-4a1b-88f5-2aebe507a51e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:20.763376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeaaf3-04b7-4a1b-88f5-2aebe507a51e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:20.763851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeaaf3-04b7-4a1b-88f5-2aebe507a51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:20.770724 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-1bbeaaf3-04b7-4a1b-88f5-2aebe507a51e None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:49:20.770724 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:20.770724 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:20.770724 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:20.770724 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:20.770724 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:20.770724 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:20.770724 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:20.770724 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:20.770724 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:20.770724 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:20.770724 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:20.770724 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:49:20.771765 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:49:20.771765 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:49:20.771765 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:49:20.771765 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:49:20.771765 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:49:20.771765 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:49:20.771765 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:49:20.771765 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:49:20.771765 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:49:20.771765 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:49:20.771765 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:49:20.771765 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:49:20.771765 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:49:20.771765 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:49:20.771765 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:20.798156 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2198/4451] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:49:20 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 23 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:49:20.798156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeaaf3-04b7-4a1b-88f5-2aebe507a51e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:20.798156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1bbeaaf3-04b7-4a1b-88f5-2aebe507a51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:20.830527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:20.844613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782efb59-5fe9-4f8c-bb1a-8361d3060d43 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:20.850442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8616a-d151-4212-b2f7-8463c3a2240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:20.851062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8616a-d151-4212-b2f7-8463c3a2240a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:20.851344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8616a-d151-4212-b2f7-8463c3a2240a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:20.851622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8616a-d151-4212-b2f7-8463c3a2240a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:20.852312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8616a-d151-4212-b2f7-8463c3a2240a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:20.854222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8616a-d151-4212-b2f7-8463c3a2240a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:20.866715 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2254/4452] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:20.867637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8616a-d151-4212-b2f7-8463c3a2240a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:20.869388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3dc8616a-d151-4212-b2f7-8463c3a2240a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:20.883498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8616a-d151-4212-b2f7-8463c3a2240a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:20.885042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeaaf3-04b7-4a1b-88f5-2aebe507a51e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:20.889732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be72f69-4086-47c3-87af-de968c556203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:20.890478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be72f69-4086-47c3-87af-de968c556203 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:20.890763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be72f69-4086-47c3-87af-de968c556203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:20.891036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be72f69-4086-47c3-87af-de968c556203 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:20.892010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be72f69-4086-47c3-87af-de968c556203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:20.894112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be72f69-4086-47c3-87af-de968c556203 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:20.897420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008a045-a20e-42a6-8e88-b406b9167d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:20.898294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008a045-a20e-42a6-8e88-b406b9167d2d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:20.899130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008a045-a20e-42a6-8e88-b406b9167d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:20.899586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008a045-a20e-42a6-8e88-b406b9167d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:20.900751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008a045-a20e-42a6-8e88-b406b9167d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:20.906601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008a045-a20e-42a6-8e88-b406b9167d2d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:20.908917 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2255/4453] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:20.909864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be72f69-4086-47c3-87af-de968c556203 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:20.911708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1be72f69-4086-47c3-87af-de968c556203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:20.938339 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2199/4454] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:20.939611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008a045-a20e-42a6-8e88-b406b9167d2d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:20.955450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008a045-a20e-42a6-8e88-b406b9167d2d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:20.963498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a44662-1e04-4f20-bcd9-c11a51738869 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:20.964583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a44662-1e04-4f20-bcd9-c11a51738869 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:20.965134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a44662-1e04-4f20-bcd9-c11a51738869 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:20.969005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a44662-1e04-4f20-bcd9-c11a51738869 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:20.970226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a44662-1e04-4f20-bcd9-c11a51738869 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:20.972618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:20.979148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a44662-1e04-4f20-bcd9-c11a51738869 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:20.986055 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2200/4455] 10.222.0.76 () {58 vars in 1269 bytes} [Sat Aug 27 04:49:20 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:20.987408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a44662-1e04-4f20-bcd9-c11a51738869 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:20.989887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-57a44662-1e04-4f20-bcd9-c11a51738869 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:21.007803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a44662-1e04-4f20-bcd9-c11a51738869 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:21.013428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be72f69-4086-47c3-87af-de968c556203 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:21.014504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbfb0c-01f2-46fc-bbea-a2899449ffb2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:21.015447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbfb0c-01f2-46fc-bbea-a2899449ffb2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:21.015665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbfb0c-01f2-46fc-bbea-a2899449ffb2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:21.016129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbfb0c-01f2-46fc-bbea-a2899449ffb2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/9c8500f7673b40fb9d471bd798e5294b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:21.016917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbfb0c-01f2-46fc-bbea-a2899449ffb2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=9c8500f7673b40fb9d471bd798e5294b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:21.018117 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-d8dbfb0c-01f2-46fc-bbea-a2899449ffb2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:21.018117 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:49:21.018117 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:49:21.019662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbfb0c-01f2-46fc-bbea-a2899449ffb2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:21.020838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc070ce8-9dc9-4a91-9be6-aa26a2306a02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:21.021889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc070ce8-9dc9-4a91-9be6-aa26a2306a02 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:21.022332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc070ce8-9dc9-4a91-9be6-aa26a2306a02 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:21.022766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc070ce8-9dc9-4a91-9be6-aa26a2306a02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:21.026141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fc070ce8-9dc9-4a91-9be6-aa26a2306a02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:21.029918 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2201/4456] 10.222.0.76 () {58 vars in 1290 bytes} [Sat Aug 27 04:49:20 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/9c8500f7673b40fb9d471bd798e5294b => generated 332 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:21.030948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbfb0c-01f2-46fc-bbea-a2899449ffb2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:21.049753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbfb0c-01f2-46fc-bbea-a2899449ffb2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:21.054826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59245f7f-ca79-498a-8a94-485a4eb81475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:21.055506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59245f7f-ca79-498a-8a94-485a4eb81475 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:21.055890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59245f7f-ca79-498a-8a94-485a4eb81475 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:21.056182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59245f7f-ca79-498a-8a94-485a4eb81475 admin admin] PATH_INFO: `/v3/projects/f800461258fb485ba56ba8e7a837f5bf/users/1599979f94f34b579e3cd4ac963de1d3/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:21.074375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59245f7f-ca79-498a-8a94-485a4eb81475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f800461258fb485ba56ba8e7a837f5bf, user_id=1599979f94f34b579e3cd4ac963de1d3, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:21.079019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59245f7f-ca79-498a-8a94-485a4eb81475 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:21.124916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc070ce8-9dc9-4a91-9be6-aa26a2306a02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:21.127567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc070ce8-9dc9-4a91-9be6-aa26a2306a02 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:21.156081 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2256/4457] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:20 2022] GET /identity/v3/auth/tokens => generated 3517 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:21.157289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc070ce8-9dc9-4a91-9be6-aa26a2306a02 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:21.171655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc070ce8-9dc9-4a91-9be6-aa26a2306a02 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:21.173647 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2202/4458] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:21 2022] PUT /identity/v3/projects/f800461258fb485ba56ba8e7a837f5bf/users/1599979f94f34b579e3cd4ac963de1d3/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:21.174556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59245f7f-ca79-498a-8a94-485a4eb81475 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:21.264617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59245f7f-ca79-498a-8a94-485a4eb81475 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:21.272571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7228c-ef67-4428-a7a7-e46e6475e730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:21.273328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7228c-ef67-4428-a7a7-e46e6475e730 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:21.273901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7228c-ef67-4428-a7a7-e46e6475e730 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:21.274408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7228c-ef67-4428-a7a7-e46e6475e730 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:21.275180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7228c-ef67-4428-a7a7-e46e6475e730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:21.277081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dbe38-9330-477e-a502-77c25eacb08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:21.277731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7228c-ef67-4428-a7a7-e46e6475e730 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:21.277892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dbe38-9330-477e-a502-77c25eacb08f admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:21.279186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dbe38-9330-477e-a502-77c25eacb08f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:21.279470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dbe38-9330-477e-a502-77c25eacb08f admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:21.280248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dbe38-9330-477e-a502-77c25eacb08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:21.282112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dbe38-9330-477e-a502-77c25eacb08f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:21.293090 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2203/4459] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:21.297515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7228c-ef67-4428-a7a7-e46e6475e730 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:21.308366 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2257/4460] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:21.321664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dbe38-9330-477e-a502-77c25eacb08f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:21.425984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7228c-ef67-4428-a7a7-e46e6475e730 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:21.445171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1921b46-6ee5-4e8b-aec9-ba5ba5b007da tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:21.445866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1921b46-6ee5-4e8b-aec9-ba5ba5b007da tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:21.446173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1921b46-6ee5-4e8b-aec9-ba5ba5b007da tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:21.446699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1921b46-6ee5-4e8b-aec9-ba5ba5b007da tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:21.447316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1921b46-6ee5-4e8b-aec9-ba5ba5b007da tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:21.449040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1921b46-6ee5-4e8b-aec9-ba5ba5b007da tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:21.454835 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2204/4461] 10.222.0.76 () {58 vars in 1248 bytes} [Sat Aug 27 04:49:21 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:21.459153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faa2f0-5a4f-46a5-95f9-e90fb24dd515 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:21.459448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faa2f0-5a4f-46a5-95f9-e90fb24dd515 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:21.459725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faa2f0-5a4f-46a5-95f9-e90fb24dd515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:21.484791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-65faa2f0-5a4f-46a5-95f9-e90fb24dd515 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:21.486917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-65faa2f0-5a4f-46a5-95f9-e90fb24dd515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:21.497756 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2205/4462] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:21 2022] POST /identity/v3/auth/tokens => generated 3504 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:21.498642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65faa2f0-5a4f-46a5-95f9-e90fb24dd515 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:21.508957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dbe38-9330-477e-a502-77c25eacb08f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:21.521806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07ade3-5050-4f9e-bccf-34264c0f353b tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:21.522323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07ade3-5050-4f9e-bccf-34264c0f353b tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:21.522608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07ade3-5050-4f9e-bccf-34264c0f353b tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:21.522886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07ade3-5050-4f9e-bccf-34264c0f353b tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/9c8500f7673b40fb9d471bd798e5294b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:21.523482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07ade3-5050-4f9e-bccf-34264c0f353b tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=9c8500f7673b40fb9d471bd798e5294b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:21.523719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65faa2f0-5a4f-46a5-95f9-e90fb24dd515 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:21.525110 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-cb07ade3-5050-4f9e-bccf-34264c0f353b tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:21.525110 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:49:21.525110 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:49:21.527764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07ade3-5050-4f9e-bccf-34264c0f353b tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:21.538211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4825494-82d8-4377-a2a1-a6d047192e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:21.539233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4825494-82d8-4377-a2a1-a6d047192e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:21.539641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4825494-82d8-4377-a2a1-a6d047192e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:21.539999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4825494-82d8-4377-a2a1-a6d047192e90 admin admin] PATH_INFO: `/v3/projects/d3a5882963a64230a88288ec5f0c5295/users/2e52c7d94fbe4fd393beabdbd5ebfe95/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:21.544191 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2258/4463] 10.222.0.76 () {58 vars in 1291 bytes} [Sat Aug 27 04:49:21 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/9c8500f7673b40fb9d471bd798e5294b => generated 0 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 27 04:49:21.545162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07ade3-5050-4f9e-bccf-34264c0f353b tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:21.558008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07ade3-5050-4f9e-bccf-34264c0f353b tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:21.564475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf6c21-8e00-4e93-a97d-90543467b36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:21.565309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf6c21-8e00-4e93-a97d-90543467b36a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:21.565597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf6c21-8e00-4e93-a97d-90543467b36a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:21.565866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf6c21-8e00-4e93-a97d-90543467b36a admin admin] PATH_INFO: `/v3/projects/caebb4e0980641faa46639172ed1a090/users/f4b1f34841e3438ba0b01ff956bfcb91/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:21.567912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4825494-82d8-4377-a2a1-a6d047192e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a5882963a64230a88288ec5f0c5295, user_id=2e52c7d94fbe4fd393beabdbd5ebfe95, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:21.571363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4825494-82d8-4377-a2a1-a6d047192e90 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:21.588505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf6c21-8e00-4e93-a97d-90543467b36a admin admin] RBAC: Authorizing `identity:create_grant(project_id=caebb4e0980641faa46639172ed1a090, user_id=f4b1f34841e3438ba0b01ff956bfcb91, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:21.594724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf6c21-8e00-4e93-a97d-90543467b36a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:21.658884 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2206/4464] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:21 2022] PUT /identity/v3/projects/d3a5882963a64230a88288ec5f0c5295/users/2e52c7d94fbe4fd393beabdbd5ebfe95/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:21.659996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4825494-82d8-4377-a2a1-a6d047192e90 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:21.702240 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2259/4465] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:21 2022] PUT /identity/v3/projects/caebb4e0980641faa46639172ed1a090/users/f4b1f34841e3438ba0b01ff956bfcb91/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:21.707176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf6c21-8e00-4e93-a97d-90543467b36a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:21.812750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4825494-82d8-4377-a2a1-a6d047192e90 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:21.824690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf6c21-8e00-4e93-a97d-90543467b36a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:21.837514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacc3c2-55f5-4c29-9742-6c1d32319723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:21.839470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacc3c2-55f5-4c29-9742-6c1d32319723 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:21.840627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacc3c2-55f5-4c29-9742-6c1d32319723 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:21.840950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacc3c2-55f5-4c29-9742-6c1d32319723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:21.910108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7054c-22e8-4578-ac07-b152313f9133 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:21.912538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7054c-22e8-4578-ac07-b152313f9133 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:21.912902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7054c-22e8-4578-ac07-b152313f9133 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:21.913270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7054c-22e8-4578-ac07-b152313f9133 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:21.913879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7054c-22e8-4578-ac07-b152313f9133 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:21.917535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7054c-22e8-4578-ac07-b152313f9133 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:21.921429 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2207/4466] 10.222.0.76 () {58 vars in 1257 bytes} [Sat Aug 27 04:49:21 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:21.925165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7054c-22e8-4578-ac07-b152313f9133 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:22.055002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacc3c2-55f5-4c29-9742-6c1d32319723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:22.056886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacc3c2-55f5-4c29-9742-6c1d32319723 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:22.070703 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2260/4467] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:21 2022] GET /identity/v3/auth/tokens => generated 3504 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:22.071978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e592-73a2-4ccd-8ecb-ca9efb7c4af6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:22.072316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e592-73a2-4ccd-8ecb-ca9efb7c4af6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:22.072596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e592-73a2-4ccd-8ecb-ca9efb7c4af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:22.088881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7054c-22e8-4578-ac07-b152313f9133 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:22.096384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4099496-5e53-4406-8ce1-a152a1ff6848 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:22.097108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4099496-5e53-4406-8ce1-a152a1ff6848 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:22.097352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4099496-5e53-4406-8ce1-a152a1ff6848 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:22.097631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4099496-5e53-4406-8ce1-a152a1ff6848 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/9c8500f7673b40fb9d471bd798e5294b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:22.100804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4099496-5e53-4406-8ce1-a152a1ff6848 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=9c8500f7673b40fb9d471bd798e5294b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:22.104688 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-b4099496-5e53-4406-8ce1-a152a1ff6848 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:22.104688 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:49:22.104688 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:49:22.108057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4099496-5e53-4406-8ce1-a152a1ff6848 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:22.115643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c456e592-73a2-4ccd-8ecb-ca9efb7c4af6 None None] MFA Rules not processed for user `2e52c7d94fbe4fd393beabdbd5ebfe95`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:22.116082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c456e592-73a2-4ccd-8ecb-ca9efb7c4af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:22.219615 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2208/4468] 10.222.0.76 () {58 vars in 1293 bytes} [Sat Aug 27 04:49:21 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/9c8500f7673b40fb9d471bd798e5294b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:22.221842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8808b37-11d4-4488-9714-053eabe75740 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:22.222327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8808b37-11d4-4488-9714-053eabe75740 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:22.222797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8808b37-11d4-4488-9714-053eabe75740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:22.246197 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2261/4469] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:22 2022] POST /identity/v3/auth/tokens => generated 3545 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:22.247302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456e592-73a2-4ccd-8ecb-ca9efb7c4af6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:22.269129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456e592-73a2-4ccd-8ecb-ca9efb7c4af6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:22.275724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b5c77-8f94-4c1c-a020-5ff1a687efe0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:22.276715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b5c77-8f94-4c1c-a020-5ff1a687efe0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:22.277001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b5c77-8f94-4c1c-a020-5ff1a687efe0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:22.277281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b5c77-8f94-4c1c-a020-5ff1a687efe0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:22.277881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b5c77-8f94-4c1c-a020-5ff1a687efe0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:22.280189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b5c77-8f94-4c1c-a020-5ff1a687efe0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:22.281797 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2262/4470] 10.222.0.76 () {58 vars in 1248 bytes} [Sat Aug 27 04:49:22 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:22.282862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b5c77-8f94-4c1c-a020-5ff1a687efe0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:22.309399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b5c77-8f94-4c1c-a020-5ff1a687efe0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:22.314060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e8808b37-11d4-4488-9714-053eabe75740 None None] MFA Rules not processed for user `f4b1f34841e3438ba0b01ff956bfcb91`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:22.317140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e8808b37-11d4-4488-9714-053eabe75740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:22.323644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dc74a-8897-41eb-b08b-3702ac26fca2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:22.324746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dc74a-8897-41eb-b08b-3702ac26fca2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:22.326292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dc74a-8897-41eb-b08b-3702ac26fca2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:22.326583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dc74a-8897-41eb-b08b-3702ac26fca2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:22.328827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345dc74a-8897-41eb-b08b-3702ac26fca2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:22.329312 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-345dc74a-8897-41eb-b08b-3702ac26fca2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:22.329312 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:49:22.329312 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:49:22.332926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345dc74a-8897-41eb-b08b-3702ac26fca2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:22.345879 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2263/4471] 10.222.0.76 () {58 vars in 1191 bytes} [Sat Aug 27 04:49:22 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 449 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:22.347658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dc74a-8897-41eb-b08b-3702ac26fca2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:22.371354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dc74a-8897-41eb-b08b-3702ac26fca2 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:22.380940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00700040-f3cf-49a8-a1b6-b74d4167cbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:22.381452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00700040-f3cf-49a8-a1b6-b74d4167cbf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:22.381928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00700040-f3cf-49a8-a1b6-b74d4167cbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:22.382456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00700040-f3cf-49a8-a1b6-b74d4167cbf2 admin admin] PATH_INFO: `/v3/users/2e52c7d94fbe4fd393beabdbd5ebfe95` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:22.385335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00700040-f3cf-49a8-a1b6-b74d4167cbf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e52c7d94fbe4fd393beabdbd5ebfe95)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:22.390232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00700040-f3cf-49a8-a1b6-b74d4167cbf2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:22.483592 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2209/4472] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:22 2022] POST /identity/v3/auth/tokens => generated 3527 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:22.484744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8808b37-11d4-4488-9714-053eabe75740 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:22.510259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8808b37-11d4-4488-9714-053eabe75740 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:22.526270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb09e5-b00d-4516-89b5-f5d01b223089 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:22.527186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb09e5-b00d-4516-89b5-f5d01b223089 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:22.527576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb09e5-b00d-4516-89b5-f5d01b223089 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:22.527962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb09e5-b00d-4516-89b5-f5d01b223089 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:22.529327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb09e5-b00d-4516-89b5-f5d01b223089 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:22.531267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb09e5-b00d-4516-89b5-f5d01b223089 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:22.534198 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2210/4473] 10.222.0.76 () {58 vars in 1242 bytes} [Sat Aug 27 04:49:22 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:22.534198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb09e5-b00d-4516-89b5-f5d01b223089 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:22.565476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb09e5-b00d-4516-89b5-f5d01b223089 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:22.575066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0bda1-d95d-4857-8dd5-41da5121aab7 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:22.577035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0bda1-d95d-4857-8dd5-41da5121aab7 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:22.577552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0bda1-d95d-4857-8dd5-41da5121aab7 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:22.578233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0bda1-d95d-4857-8dd5-41da5121aab7 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/9c8500f7673b40fb9d471bd798e5294b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:22.579687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0bda1-d95d-4857-8dd5-41da5121aab7 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=9c8500f7673b40fb9d471bd798e5294b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:22.583215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0bda1-d95d-4857-8dd5-41da5121aab7 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:22.598381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-6ea0bda1-d95d-4857-8dd5-41da5121aab7 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Could not find Endpoint Group: 9c8500f7673b40fb9d471bd798e5294b.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 9c8500f7673b40fb9d471bd798e5294b. Aug 27 04:49:22.598381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:22.598381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:22.598381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:22.598381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:22.598381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:22.598381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:22.598381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:22.598381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:22.598381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:22.598381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:22.598381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:22.598381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Aug 27 04:49:22.598381 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Aug 27 04:49:22.600539 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Aug 27 04:49:22.600539 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Aug 27 04:49:22.600539 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Aug 27 04:49:22.600539 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Aug 27 04:49:22.600539 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 9c8500f7673b40fb9d471bd798e5294b. Aug 27 04:49:22.600539 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:22.604980 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2211/4474] 10.222.0.76 () {58 vars in 1293 bytes} [Sat Aug 27 04:49:22 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/9c8500f7673b40fb9d471bd798e5294b => generated 120 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:49:22.607076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0bda1-d95d-4857-8dd5-41da5121aab7 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:22.609241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6ea0bda1-d95d-4857-8dd5-41da5121aab7 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:22.657155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-00700040-f3cf-49a8-a1b6-b74d4167cbf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e52c7d94fbe4fd393beabdbd5ebfe95'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:22.658242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-00700040-f3cf-49a8-a1b6-b74d4167cbf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e52c7d94fbe4fd393beabdbd5ebfe95'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:22.698846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0bda1-d95d-4857-8dd5-41da5121aab7 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:22.706499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480d358-3183-4f7f-88b0-767b82e134cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:22.706499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480d358-3183-4f7f-88b0-767b82e134cc service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:22.706499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480d358-3183-4f7f-88b0-767b82e134cc service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:22.706499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480d358-3183-4f7f-88b0-767b82e134cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:22.723281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480d358-3183-4f7f-88b0-767b82e134cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:22.724948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480d358-3183-4f7f-88b0-767b82e134cc service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:22.729789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:22.752980 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2212/4475] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:22 2022] GET /identity/v3/auth/tokens => generated 3527 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:22.754827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480d358-3183-4f7f-88b0-767b82e134cc service glance] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:22.785396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480d358-3183-4f7f-88b0-767b82e134cc service glance] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:22.795280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-00700040-f3cf-49a8-a1b6-b74d4167cbf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e52c7d94fbe4fd393beabdbd5ebfe95'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:22.798904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae346ebc-2cff-4f53-af45-9e95077ea8eb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:22.799781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae346ebc-2cff-4f53-af45-9e95077ea8eb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:22.800245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae346ebc-2cff-4f53-af45-9e95077ea8eb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:22.810432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae346ebc-2cff-4f53-af45-9e95077ea8eb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:22.810432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae346ebc-2cff-4f53-af45-9e95077ea8eb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:22.810432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae346ebc-2cff-4f53-af45-9e95077ea8eb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:22.810886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-00700040-f3cf-49a8-a1b6-b74d4167cbf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e52c7d94fbe4fd393beabdbd5ebfe95'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:22.812490 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2213/4476] 10.222.0.76 () {58 vars in 1251 bytes} [Sat Aug 27 04:49:22 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:22.816316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae346ebc-2cff-4f53-af45-9e95077ea8eb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:22.822704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ae346ebc-2cff-4f53-af45-9e95077ea8eb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:22.856285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae346ebc-2cff-4f53-af45-9e95077ea8eb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:22.863074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0394b91-7179-4994-aa98-09d0700521bc tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:22.863685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0394b91-7179-4994-aa98-09d0700521bc tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:22.863962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0394b91-7179-4994-aa98-09d0700521bc tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:22.864262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0394b91-7179-4994-aa98-09d0700521bc tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/services/418cd96f061e44d4a4318325acbcf66d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:22.864851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0394b91-7179-4994-aa98-09d0700521bc tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:delete_service(service_id=418cd96f061e44d4a4318325acbcf66d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:22.866539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0394b91-7179-4994-aa98-09d0700521bc tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:22.869614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-00700040-f3cf-49a8-a1b6-b74d4167cbf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e52c7d94fbe4fd393beabdbd5ebfe95'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:22.947128 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2264/4477] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:22 2022] DELETE /identity/v3/users/2e52c7d94fbe4fd393beabdbd5ebfe95 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:22.951366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00700040-f3cf-49a8-a1b6-b74d4167cbf2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:22.968328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:22.976257 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2214/4478] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:22 2022] DELETE /identity/v3/services/418cd96f061e44d4a4318325acbcf66d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:22.976549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-00700040-f3cf-49a8-a1b6-b74d4167cbf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:22.978696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d2174-a93f-4538-8c73-f09254bb7e10 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:22.979216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d2174-a93f-4538-8c73-f09254bb7e10 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:22.979703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d2174-a93f-4538-8c73-f09254bb7e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:23.054117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f43d2174-a93f-4538-8c73-f09254bb7e10 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:23.065375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f43d2174-a93f-4538-8c73-f09254bb7e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:23.364196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00700040-f3cf-49a8-a1b6-b74d4167cbf2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:23.367734 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2215/4479] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:23.368894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d2174-a93f-4538-8c73-f09254bb7e10 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:23.404418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b8f59-1669-4864-bbf5-af3da47424e2 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:23.404418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b8f59-1669-4864-bbf5-af3da47424e2 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:23.404418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b8f59-1669-4864-bbf5-af3da47424e2 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:23.404781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b8f59-1669-4864-bbf5-af3da47424e2 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:23.417968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b8f59-1669-4864-bbf5-af3da47424e2 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:23.421023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b8f59-1669-4864-bbf5-af3da47424e2 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:23.438805 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2265/4480] 10.222.0.76 () {58 vars in 1254 bytes} [Sat Aug 27 04:49:22 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:23.438805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6922ec-30a5-441e-926b-8be32ceab135 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:23.438805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6922ec-30a5-441e-926b-8be32ceab135 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:23.438805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6922ec-30a5-441e-926b-8be32ceab135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:23.536027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d2174-a93f-4538-8c73-f09254bb7e10 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:23.542333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170e3f9-a3b9-4a96-998f-d9892726326f tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:23.543138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170e3f9-a3b9-4a96-998f-d9892726326f tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:23.543816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170e3f9-a3b9-4a96-998f-d9892726326f tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:23.546923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170e3f9-a3b9-4a96-998f-d9892726326f tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:23.547869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170e3f9-a3b9-4a96-998f-d9892726326f tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:23.549737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170e3f9-a3b9-4a96-998f-d9892726326f tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:23.554754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6f6922ec-30a5-441e-926b-8be32ceab135 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:23.556336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6f6922ec-30a5-441e-926b-8be32ceab135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:23.659032 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2216/4481] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:23 2022] POST /identity/v3/services => generated 287 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:23.659290 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2266/4482] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:49:23 2022] POST /identity/v3/auth/tokens => generated 3328 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:23.660402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6922ec-30a5-441e-926b-8be32ceab135 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:23.666767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170e3f9-a3b9-4a96-998f-d9892726326f tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:23.671700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2170e3f9-a3b9-4a96-998f-d9892726326f tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:23.735697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6922ec-30a5-441e-926b-8be32ceab135 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:23.741107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:23.773537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849cf05-b750-4c0c-8ca6-ba45f183b4d6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:23.774496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849cf05-b750-4c0c-8ca6-ba45f183b4d6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:23.774817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849cf05-b750-4c0c-8ca6-ba45f183b4d6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:23.775167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849cf05-b750-4c0c-8ca6-ba45f183b4d6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:23.776117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849cf05-b750-4c0c-8ca6-ba45f183b4d6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:23.777902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849cf05-b750-4c0c-8ca6-ba45f183b4d6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:23.788949 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2267/4483] 10.222.0.76 () {58 vars in 1290 bytes} [Sat Aug 27 04:49:23 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:23.788949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849cf05-b750-4c0c-8ca6-ba45f183b4d6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:23.812842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170e3f9-a3b9-4a96-998f-d9892726326f tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:23.815714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849cf05-b750-4c0c-8ca6-ba45f183b4d6 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:23.818353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b6f6d-d82e-4b1a-9ea9-7f97e7ecceb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:23.819457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b6f6d-d82e-4b1a-9ea9-7f97e7ecceb7 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:23.819975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b6f6d-d82e-4b1a-9ea9-7f97e7ecceb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:23.820546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b6f6d-d82e-4b1a-9ea9-7f97e7ecceb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:23.821304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904d90b-83b1-463f-a48e-de22a70914d6 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:23.822021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904d90b-83b1-463f-a48e-de22a70914d6 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:23.822486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904d90b-83b1-463f-a48e-de22a70914d6 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:23.822856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904d90b-83b1-463f-a48e-de22a70914d6 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:23.823506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904d90b-83b1-463f-a48e-de22a70914d6 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:23.825241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904d90b-83b1-463f-a48e-de22a70914d6 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:23.838097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b6f6d-d82e-4b1a-9ea9-7f97e7ecceb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:23.842655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b6f6d-d82e-4b1a-9ea9-7f97e7ecceb7 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:23.889979 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2217/4484] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:23 2022] GET /identity/v3/auth/tokens => generated 3504 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:23.891453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b6f6d-d82e-4b1a-9ea9-7f97e7ecceb7 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:23.904802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b6f6d-d82e-4b1a-9ea9-7f97e7ecceb7 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:23.911492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec513c-adda-4ad7-9001-20926ec8cd49 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:23.912656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec513c-adda-4ad7-9001-20926ec8cd49 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:23.913214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec513c-adda-4ad7-9001-20926ec8cd49 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:23.913717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec513c-adda-4ad7-9001-20926ec8cd49 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:23.914913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec513c-adda-4ad7-9001-20926ec8cd49 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:23.917134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec513c-adda-4ad7-9001-20926ec8cd49 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:23.921183 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2218/4485] 10.222.0.76 () {58 vars in 1257 bytes} [Sat Aug 27 04:49:23 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:23.921183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec513c-adda-4ad7-9001-20926ec8cd49 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:23.923208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7aec513c-adda-4ad7-9001-20926ec8cd49 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:23.941607 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2268/4486] 10.222.0.76 () {60 vars in 1213 bytes} [Sat Aug 27 04:49:23 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:23.942765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904d90b-83b1-463f-a48e-de22a70914d6 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:23.967813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904d90b-83b1-463f-a48e-de22a70914d6 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:23.983317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75731a99-835b-4615-8eed-c3b8908650fa tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:23.984321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75731a99-835b-4615-8eed-c3b8908650fa tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:23.985105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75731a99-835b-4615-8eed-c3b8908650fa tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:23.990376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75731a99-835b-4615-8eed-c3b8908650fa tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:23.990376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75731a99-835b-4615-8eed-c3b8908650fa tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:23.990376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75731a99-835b-4615-8eed-c3b8908650fa tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:23.995186 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2269/4487] 10.222.0.76 () {58 vars in 1266 bytes} [Sat Aug 27 04:49:23 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:23.996427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75731a99-835b-4615-8eed-c3b8908650fa tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.022812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75731a99-835b-4615-8eed-c3b8908650fa tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.041544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8cd6a-b9ec-4ee1-bdf5-52f73a55cd11 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.042617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8cd6a-b9ec-4ee1-bdf5-52f73a55cd11 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.043111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8cd6a-b9ec-4ee1-bdf5-52f73a55cd11 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.043583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8cd6a-b9ec-4ee1-bdf5-52f73a55cd11 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.045029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8cd6a-b9ec-4ee1-bdf5-52f73a55cd11 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.048706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8cd6a-b9ec-4ee1-bdf5-52f73a55cd11 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.081071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec513c-adda-4ad7-9001-20926ec8cd49 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.100603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f48c21-ae64-4ca8-b06a-2fa58903edb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.100603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f48c21-ae64-4ca8-b06a-2fa58903edb1 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.100603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f48c21-ae64-4ca8-b06a-2fa58903edb1 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.100603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f48c21-ae64-4ca8-b06a-2fa58903edb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.130961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f48c21-ae64-4ca8-b06a-2fa58903edb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.132941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f48c21-ae64-4ca8-b06a-2fa58903edb1 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.151512 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2270/4488] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:23 2022] POST /identity/v3/services => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:24.154135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8cd6a-b9ec-4ee1-bdf5-52f73a55cd11 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.170122 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2219/4489] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:49:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:49:24.173254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f48c21-ae64-4ca8-b06a-2fa58903edb1 service swift] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.204899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8cd6a-b9ec-4ee1-bdf5-52f73a55cd11 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.214234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f48c21-ae64-4ca8-b06a-2fa58903edb1 service swift] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.236479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ec725-727c-433b-9b1c-f88c056146cd tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.237341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ec725-727c-433b-9b1c-f88c056146cd tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.237728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ec725-727c-433b-9b1c-f88c056146cd tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.238110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ec725-727c-433b-9b1c-f88c056146cd tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.239094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ec725-727c-433b-9b1c-f88c056146cd tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.239453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe565e-7f65-4787-bc52-a48b841eb302 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.240982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ec725-727c-433b-9b1c-f88c056146cd tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.242227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe565e-7f65-4787-bc52-a48b841eb302 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.243018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe565e-7f65-4787-bc52-a48b841eb302 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.243849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe565e-7f65-4787-bc52-a48b841eb302 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/ab27996436cc46718a663d1926f1173e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.245335 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2271/4490] 10.222.0.76 () {58 vars in 1308 bytes} [Sat Aug 27 04:49:24 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:24.246294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe565e-7f65-4787-bc52-a48b841eb302 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=ab27996436cc46718a663d1926f1173e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.251658 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-fdbe565e-7f65-4787-bc52-a48b841eb302 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:24.251658 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:49:24.251658 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:49:24.252002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ec725-727c-433b-9b1c-f88c056146cd tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.252100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe565e-7f65-4787-bc52-a48b841eb302 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.269896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ec725-727c-433b-9b1c-f88c056146cd tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.287237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f225d8e-b083-4db6-a27d-25f70cfc6088 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.288124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f225d8e-b083-4db6-a27d-25f70cfc6088 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.289471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f225d8e-b083-4db6-a27d-25f70cfc6088 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.289926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f225d8e-b083-4db6-a27d-25f70cfc6088 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.290958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f225d8e-b083-4db6-a27d-25f70cfc6088 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.302349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f225d8e-b083-4db6-a27d-25f70cfc6088 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.302349 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2272/4491] 10.222.0.76 () {58 vars in 1290 bytes} [Sat Aug 27 04:49:24 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:24.304785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f225d8e-b083-4db6-a27d-25f70cfc6088 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.328673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f225d8e-b083-4db6-a27d-25f70cfc6088 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.343903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c195a-6a71-4200-bbfc-6efb2435d8f8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.345432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c195a-6a71-4200-bbfc-6efb2435d8f8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.345995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c195a-6a71-4200-bbfc-6efb2435d8f8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.346209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c195a-6a71-4200-bbfc-6efb2435d8f8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.347692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c195a-6a71-4200-bbfc-6efb2435d8f8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.349486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c195a-6a71-4200-bbfc-6efb2435d8f8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.353587 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2273/4492] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:49:24 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 27 04:49:24.355651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c195a-6a71-4200-bbfc-6efb2435d8f8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.374270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c195a-6a71-4200-bbfc-6efb2435d8f8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.382751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd154d-3fe0-45fd-9153-b205f4dea01f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.383613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd154d-3fe0-45fd-9153-b205f4dea01f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.384000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd154d-3fe0-45fd-9153-b205f4dea01f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.384409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd154d-3fe0-45fd-9153-b205f4dea01f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.385153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd154d-3fe0-45fd-9153-b205f4dea01f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.389740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd154d-3fe0-45fd-9153-b205f4dea01f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.391470 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2274/4493] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:49:24 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:24.394911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd154d-3fe0-45fd-9153-b205f4dea01f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.412616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd154d-3fe0-45fd-9153-b205f4dea01f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.424490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b72e56-fef4-4c4b-8eb6-ca3d6b4e3d4f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.425954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b72e56-fef4-4c4b-8eb6-ca3d6b4e3d4f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.426341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b72e56-fef4-4c4b-8eb6-ca3d6b4e3d4f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.426784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b72e56-fef4-4c4b-8eb6-ca3d6b4e3d4f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.427643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b72e56-fef4-4c4b-8eb6-ca3d6b4e3d4f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.430492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b72e56-fef4-4c4b-8eb6-ca3d6b4e3d4f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.432634 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2275/4494] 10.222.0.76 () {58 vars in 1242 bytes} [Sat Aug 27 04:49:24 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:24.433109 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2220/4495] 10.222.0.76 () {60 vars in 1313 bytes} [Sat Aug 27 04:49:24 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/ab27996436cc46718a663d1926f1173e => generated 335 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:24.438084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b72e56-fef4-4c4b-8eb6-ca3d6b4e3d4f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.438293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe565e-7f65-4787-bc52-a48b841eb302 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.452800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe565e-7f65-4787-bc52-a48b841eb302 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.455398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b72e56-fef4-4c4b-8eb6-ca3d6b4e3d4f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.462549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895e4a3-0d04-43b4-ac05-a05829e98ff8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.463352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895e4a3-0d04-43b4-ac05-a05829e98ff8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.463752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895e4a3-0d04-43b4-ac05-a05829e98ff8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.464186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895e4a3-0d04-43b4-ac05-a05829e98ff8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.465042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895e4a3-0d04-43b4-ac05-a05829e98ff8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.466439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758edd3a-fa90-4db7-85b5-70abe58a239f tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.467344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758edd3a-fa90-4db7-85b5-70abe58a239f tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.467802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758edd3a-fa90-4db7-85b5-70abe58a239f tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.467924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895e4a3-0d04-43b4-ac05-a05829e98ff8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.470220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758edd3a-fa90-4db7-85b5-70abe58a239f tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/services/b3068734a4c342f6a1e5d761c8a282c5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.470583 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2276/4496] 10.222.0.76 () {58 vars in 1245 bytes} [Sat Aug 27 04:49:24 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:24.471211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758edd3a-fa90-4db7-85b5-70abe58a239f tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b3068734a4c342f6a1e5d761c8a282c5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.472869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758edd3a-fa90-4db7-85b5-70abe58a239f tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.475070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895e4a3-0d04-43b4-ac05-a05829e98ff8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.517291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895e4a3-0d04-43b4-ac05-a05829e98ff8 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.522974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d88d8b-67c4-4d8a-9fbb-054a9af222d0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.523636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d88d8b-67c4-4d8a-9fbb-054a9af222d0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.523943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d88d8b-67c4-4d8a-9fbb-054a9af222d0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.535410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d88d8b-67c4-4d8a-9fbb-054a9af222d0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.535410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d88d8b-67c4-4d8a-9fbb-054a9af222d0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.535410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d88d8b-67c4-4d8a-9fbb-054a9af222d0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.535410 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2277/4497] 10.222.0.76 () {58 vars in 1251 bytes} [Sat Aug 27 04:49:24 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:24.535410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d88d8b-67c4-4d8a-9fbb-054a9af222d0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.549137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d88d8b-67c4-4d8a-9fbb-054a9af222d0 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.557438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead80d0-811b-43ed-b644-e7bb1349075f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.557438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead80d0-811b-43ed-b644-e7bb1349075f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.557438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead80d0-811b-43ed-b644-e7bb1349075f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.557820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead80d0-811b-43ed-b644-e7bb1349075f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.566357 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2221/4498] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:24 2022] DELETE /identity/v3/services/b3068734a4c342f6a1e5d761c8a282c5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:24.566786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead80d0-811b-43ed-b644-e7bb1349075f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.568987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead80d0-811b-43ed-b644-e7bb1349075f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.570641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758edd3a-fa90-4db7-85b5-70abe58a239f tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.580628 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2278/4499] 10.222.0.76 () {58 vars in 1254 bytes} [Sat Aug 27 04:49:24 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 27 04:49:24.581813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead80d0-811b-43ed-b644-e7bb1349075f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.587036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:24.607113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead80d0-811b-43ed-b644-e7bb1349075f tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.618164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758edd3a-fa90-4db7-85b5-70abe58a239f tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.624802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf858098-5e49-4b4c-a45c-585a25d0fb17 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.627246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf858098-5e49-4b4c-a45c-585a25d0fb17 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.627614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf858098-5e49-4b4c-a45c-585a25d0fb17 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.640194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf858098-5e49-4b4c-a45c-585a25d0fb17 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/ab27996436cc46718a663d1926f1173e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.644478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf858098-5e49-4b4c-a45c-585a25d0fb17 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=ab27996436cc46718a663d1926f1173e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.647351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf858098-5e49-4b4c-a45c-585a25d0fb17 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.650211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22987ba-b523-4b40-83d8-34a68c364beb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.651490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22987ba-b523-4b40-83d8-34a68c364beb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.653724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22987ba-b523-4b40-83d8-34a68c364beb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.654682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22987ba-b523-4b40-83d8-34a68c364beb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.656054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22987ba-b523-4b40-83d8-34a68c364beb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.658100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22987ba-b523-4b40-83d8-34a68c364beb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.659576 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2279/4500] 10.222.0.76 () {58 vars in 1257 bytes} [Sat Aug 27 04:49:24 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:24.663677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22987ba-b523-4b40-83d8-34a68c364beb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.676734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22987ba-b523-4b40-83d8-34a68c364beb tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.682267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dff6d-4c47-455d-a360-3049cb222bc5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.682925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dff6d-4c47-455d-a360-3049cb222bc5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.683209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dff6d-4c47-455d-a360-3049cb222bc5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.683487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dff6d-4c47-455d-a360-3049cb222bc5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.684204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dff6d-4c47-455d-a360-3049cb222bc5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.686305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dff6d-4c47-455d-a360-3049cb222bc5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.688254 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2280/4501] 10.222.0.76 () {58 vars in 1251 bytes} [Sat Aug 27 04:49:24 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:24.691433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dff6d-4c47-455d-a360-3049cb222bc5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.707930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dff6d-4c47-455d-a360-3049cb222bc5 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.711456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053301e8-f314-4c24-84c8-4ef6d911093b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.712544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053301e8-f314-4c24-84c8-4ef6d911093b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.713009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053301e8-f314-4c24-84c8-4ef6d911093b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.713452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053301e8-f314-4c24-84c8-4ef6d911093b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.714425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053301e8-f314-4c24-84c8-4ef6d911093b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.716509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053301e8-f314-4c24-84c8-4ef6d911093b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.718278 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2281/4502] 10.222.0.76 () {58 vars in 1257 bytes} [Sat Aug 27 04:49:24 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 27 04:49:24.721865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053301e8-f314-4c24-84c8-4ef6d911093b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.729669 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2222/4503] 10.222.0.76 () {58 vars in 1293 bytes} [Sat Aug 27 04:49:24 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/ab27996436cc46718a663d1926f1173e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:24.741817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf858098-5e49-4b4c-a45c-585a25d0fb17 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.759128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053301e8-f314-4c24-84c8-4ef6d911093b tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.773277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695fbe6-39b5-4df4-850f-7e4bfaa2c741 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.773947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695fbe6-39b5-4df4-850f-7e4bfaa2c741 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.774230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695fbe6-39b5-4df4-850f-7e4bfaa2c741 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.774507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695fbe6-39b5-4df4-850f-7e4bfaa2c741 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.775111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695fbe6-39b5-4df4-850f-7e4bfaa2c741 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.776960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf858098-5e49-4b4c-a45c-585a25d0fb17 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.777095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695fbe6-39b5-4df4-850f-7e4bfaa2c741 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.778175 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2282/4504] 10.222.0.76 () {58 vars in 1293 bytes} [Sat Aug 27 04:49:24 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:24.782207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695fbe6-39b5-4df4-850f-7e4bfaa2c741 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.797756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f70ca-c62a-46ba-9f11-c74a8dbd7cf3 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.798514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f70ca-c62a-46ba-9f11-c74a8dbd7cf3 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.798967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f70ca-c62a-46ba-9f11-c74a8dbd7cf3 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.799360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f70ca-c62a-46ba-9f11-c74a8dbd7cf3 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/services/a90cd059790e47cd9719b23df6a30c08` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.800149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f70ca-c62a-46ba-9f11-c74a8dbd7cf3 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a90cd059790e47cd9719b23df6a30c08)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.801926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f70ca-c62a-46ba-9f11-c74a8dbd7cf3 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.805649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695fbe6-39b5-4df4-850f-7e4bfaa2c741 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.813218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c37936-1762-4cc6-8c2e-e9d3b08c6263 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.813218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c37936-1762-4cc6-8c2e-e9d3b08c6263 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.813538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c37936-1762-4cc6-8c2e-e9d3b08c6263 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.813635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c37936-1762-4cc6-8c2e-e9d3b08c6263 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.814454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c37936-1762-4cc6-8c2e-e9d3b08c6263 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.816506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c37936-1762-4cc6-8c2e-e9d3b08c6263 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.817214 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2283/4505] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:24 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 27 04:49:24.822093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c37936-1762-4cc6-8c2e-e9d3b08c6263 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.843932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c37936-1762-4cc6-8c2e-e9d3b08c6263 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.861049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60898519-2239-4f5a-a0cc-ecbedc031911 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.862009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60898519-2239-4f5a-a0cc-ecbedc031911 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.862767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60898519-2239-4f5a-a0cc-ecbedc031911 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.863047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60898519-2239-4f5a-a0cc-ecbedc031911 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.863693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60898519-2239-4f5a-a0cc-ecbedc031911 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.871280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60898519-2239-4f5a-a0cc-ecbedc031911 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.878493 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2284/4506] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:49:24 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:24.881118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60898519-2239-4f5a-a0cc-ecbedc031911 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.906755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60898519-2239-4f5a-a0cc-ecbedc031911 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.912457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c9c05-6d83-4b1a-a070-51b92e2bcb89 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.913297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c9c05-6d83-4b1a-a070-51b92e2bcb89 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.913580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c9c05-6d83-4b1a-a070-51b92e2bcb89 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.913852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c9c05-6d83-4b1a-a070-51b92e2bcb89 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.914585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c9c05-6d83-4b1a-a070-51b92e2bcb89 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.916343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c9c05-6d83-4b1a-a070-51b92e2bcb89 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.922090 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2285/4507] 10.222.0.76 () {58 vars in 1212 bytes} [Sat Aug 27 04:49:24 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:24.923378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c9c05-6d83-4b1a-a070-51b92e2bcb89 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.931994 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2223/4508] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:24 2022] DELETE /identity/v3/services/a90cd059790e47cd9719b23df6a30c08 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:49:24.936994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f70ca-c62a-46ba-9f11-c74a8dbd7cf3 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.938232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c9c05-6d83-4b1a-a070-51b92e2bcb89 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:24.960144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c87be5-6e3b-47ab-b936-6ec96c16b9f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:24.961269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c87be5-6e3b-47ab-b936-6ec96c16b9f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:24.961269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c87be5-6e3b-47ab-b936-6ec96c16b9f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:24.961692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c87be5-6e3b-47ab-b936-6ec96c16b9f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:24.962290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c87be5-6e3b-47ab-b936-6ec96c16b9f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:24.970149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c87be5-6e3b-47ab-b936-6ec96c16b9f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:24.972474 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2286/4509] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:49:24 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:24.973647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c87be5-6e3b-47ab-b936-6ec96c16b9f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:24.998970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c87be5-6e3b-47ab-b936-6ec96c16b9f1 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:25.004194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f70ca-c62a-46ba-9f11-c74a8dbd7cf3 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:25.007112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcda236-913b-42e3-b7e0-ba3097b4e599 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:25.008653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcda236-913b-42e3-b7e0-ba3097b4e599 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.008925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcda236-913b-42e3-b7e0-ba3097b4e599 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.009198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcda236-913b-42e3-b7e0-ba3097b4e599 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.009791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcda236-913b-42e3-b7e0-ba3097b4e599 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:25.013494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcda236-913b-42e3-b7e0-ba3097b4e599 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:25.021146 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2287/4510] 10.222.0.76 () {58 vars in 1215 bytes} [Sat Aug 27 04:49:24 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:25.022254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcda236-913b-42e3-b7e0-ba3097b4e599 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:25.025565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccac845-7b06-4f6d-9c74-bb6c4771d287 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:25.026566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccac845-7b06-4f6d-9c74-bb6c4771d287 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.027511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccac845-7b06-4f6d-9c74-bb6c4771d287 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.027511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccac845-7b06-4f6d-9c74-bb6c4771d287 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/826731c9e4c74810b2039eb4bc291c5a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.027788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccac845-7b06-4f6d-9c74-bb6c4771d287 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=826731c9e4c74810b2039eb4bc291c5a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:25.030414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccac845-7b06-4f6d-9c74-bb6c4771d287 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:25.047340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcda236-913b-42e3-b7e0-ba3097b4e599 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:25.064306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe082704-8a0c-4bfd-8951-46ce609f62f7 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:25.064986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe082704-8a0c-4bfd-8951-46ce609f62f7 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.065264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe082704-8a0c-4bfd-8951-46ce609f62f7 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.065537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe082704-8a0c-4bfd-8951-46ce609f62f7 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.066291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe082704-8a0c-4bfd-8951-46ce609f62f7 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:25.068031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe082704-8a0c-4bfd-8951-46ce609f62f7 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:25.076681 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2288/4511] 10.222.0.76 () {58 vars in 1218 bytes} [Sat Aug 27 04:49:25 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:25.077675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe082704-8a0c-4bfd-8951-46ce609f62f7 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:25.097736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe082704-8a0c-4bfd-8951-46ce609f62f7 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:25.110554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb3e63-7a86-4d60-9e4e-7bedb852ea81 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:25.111471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb3e63-7a86-4d60-9e4e-7bedb852ea81 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.111792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb3e63-7a86-4d60-9e4e-7bedb852ea81 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.112010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb3e63-7a86-4d60-9e4e-7bedb852ea81 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.112674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb3e63-7a86-4d60-9e4e-7bedb852ea81 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:25.115371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb3e63-7a86-4d60-9e4e-7bedb852ea81 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:25.122600 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2289/4512] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:25 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:25.123601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb3e63-7a86-4d60-9e4e-7bedb852ea81 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:25.135146 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2224/4513] 10.222.0.76 () {58 vars in 1293 bytes} [Sat Aug 27 04:49:24 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/826731c9e4c74810b2039eb4bc291c5a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:25.136912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccac845-7b06-4f6d-9c74-bb6c4771d287 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:25.150790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccac845-7b06-4f6d-9c74-bb6c4771d287 tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:25.159566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1387af-d86a-4bba-b169-a606a0eb8ecd tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb0a6e4eb934a6992e40e9004d1cb70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2dbe796c827459a89d34997ea26b72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:25.160656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1387af-d86a-4bba-b169-a606a0eb8ecd tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.170009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1387af-d86a-4bba-b169-a606a0eb8ecd tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.170009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1387af-d86a-4bba-b169-a606a0eb8ecd tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] PATH_INFO: `/v3/services/da310c4056ac4745bc84224735bbd203` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.170009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1387af-d86a-4bba-b169-a606a0eb8ecd tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorizing `identity:delete_service(service_id=da310c4056ac4745bc84224735bbd203)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:25.170009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1387af-d86a-4bba-b169-a606a0eb8ecd tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:25.173949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb3e63-7a86-4d60-9e4e-7bedb852ea81 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:25.186854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4adcf-fbf7-4dfe-940f-4772b099207e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:25.187440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4adcf-fbf7-4dfe-940f-4772b099207e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.187893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4adcf-fbf7-4dfe-940f-4772b099207e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.188191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4adcf-fbf7-4dfe-940f-4772b099207e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.188793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4adcf-fbf7-4dfe-940f-4772b099207e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:25.190402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4adcf-fbf7-4dfe-940f-4772b099207e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:25.205807 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2290/4514] 10.222.0.76 () {58 vars in 1239 bytes} [Sat Aug 27 04:49:25 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:25.206655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4adcf-fbf7-4dfe-940f-4772b099207e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:25.232004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4adcf-fbf7-4dfe-940f-4772b099207e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:25.257794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4334a6e-d339-40b8-a00e-f0bdc3dee300 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:25.259599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4334a6e-d339-40b8-a00e-f0bdc3dee300 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.259896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4334a6e-d339-40b8-a00e-f0bdc3dee300 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.260244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4334a6e-d339-40b8-a00e-f0bdc3dee300 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.260950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4334a6e-d339-40b8-a00e-f0bdc3dee300 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:25.263231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4334a6e-d339-40b8-a00e-f0bdc3dee300 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:25.264925 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2291/4515] 10.222.0.76 () {58 vars in 1260 bytes} [Sat Aug 27 04:49:25 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:25.267000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a690a4-0f76-42ab-af5a-99cf2427ba30 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.267283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a690a4-0f76-42ab-af5a-99cf2427ba30 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.267642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a690a4-0f76-42ab-af5a-99cf2427ba30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.292781 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2225/4516] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:25 2022] DELETE /identity/v3/services/da310c4056ac4745bc84224735bbd203 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:49:25.297228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1387af-d86a-4bba-b169-a606a0eb8ecd tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:25.315605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-63a690a4-0f76-42ab-af5a-99cf2427ba30 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:25.318310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-63a690a4-0f76-42ab-af5a-99cf2427ba30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:25.348552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1387af-d86a-4bba-b169-a606a0eb8ecd tempest-EndPointGroupsTest-1078020683 tempest-EndPointGroupsTest-1078020683-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:25.354876 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2292/4517] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:49:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:25.360480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a690a4-0f76-42ab-af5a-99cf2427ba30 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:25.367290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-63a690a4-0f76-42ab-af5a-99cf2427ba30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:25.381392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577ab5f-8c37-4231-be80-2d1e9cd3c1fa tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:25.385257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577ab5f-8c37-4231-be80-2d1e9cd3c1fa tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.385791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577ab5f-8c37-4231-be80-2d1e9cd3c1fa tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.386228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577ab5f-8c37-4231-be80-2d1e9cd3c1fa tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.387033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577ab5f-8c37-4231-be80-2d1e9cd3c1fa tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:25.389698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577ab5f-8c37-4231-be80-2d1e9cd3c1fa tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:25.391780 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2226/4518] 10.222.0.76 () {58 vars in 1263 bytes} [Sat Aug 27 04:49:25 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:25.393524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577ab5f-8c37-4231-be80-2d1e9cd3c1fa tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:25.424767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a690a4-0f76-42ab-af5a-99cf2427ba30 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:25.446923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577ab5f-8c37-4231-be80-2d1e9cd3c1fa tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:25.455466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413dc7a-c400-42df-bd55-e29bb01ee7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:25.460205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413dc7a-c400-42df-bd55-e29bb01ee7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.460205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413dc7a-c400-42df-bd55-e29bb01ee7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.460205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413dc7a-c400-42df-bd55-e29bb01ee7c9 admin admin] PATH_INFO: `/v3/users/e4cd4f1987b84a00b565e2416ee914f7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.460429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413dc7a-c400-42df-bd55-e29bb01ee7c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4cd4f1987b84a00b565e2416ee914f7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:25.462495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413dc7a-c400-42df-bd55-e29bb01ee7c9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:25.468531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517b26e-faba-40c1-95ea-a9abe4cc1026 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:25.469409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517b26e-faba-40c1-95ea-a9abe4cc1026 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.471360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517b26e-faba-40c1-95ea-a9abe4cc1026 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.472881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517b26e-faba-40c1-95ea-a9abe4cc1026 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.502037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517b26e-faba-40c1-95ea-a9abe4cc1026 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:25.505647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517b26e-faba-40c1-95ea-a9abe4cc1026 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:25.508847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:25.550011 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2227/4519] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:49:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:49:25.551083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517b26e-faba-40c1-95ea-a9abe4cc1026 service swift] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:25.589155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517b26e-faba-40c1-95ea-a9abe4cc1026 service swift] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:25.598461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28375a8-c5e4-4c05-88f3-1080f340b48c tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:25.599335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28375a8-c5e4-4c05-88f3-1080f340b48c tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.599818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28375a8-c5e4-4c05-88f3-1080f340b48c tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.600639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28375a8-c5e4-4c05-88f3-1080f340b48c tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.603623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28375a8-c5e4-4c05-88f3-1080f340b48c tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:25.603623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28375a8-c5e4-4c05-88f3-1080f340b48c tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:25.605473 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2228/4520] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:49:25 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:25.612956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28375a8-c5e4-4c05-88f3-1080f340b48c tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:25.627604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28375a8-c5e4-4c05-88f3-1080f340b48c tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:25.660589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14bc44-04b4-479b-9a6b-81312261b5bf tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:25.661397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14bc44-04b4-479b-9a6b-81312261b5bf tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.661877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14bc44-04b4-479b-9a6b-81312261b5bf tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.662338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14bc44-04b4-479b-9a6b-81312261b5bf tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.663272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14bc44-04b4-479b-9a6b-81312261b5bf tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:25.664993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14bc44-04b4-479b-9a6b-81312261b5bf tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:25.670009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:25.679338 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2229/4521] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:25 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:25.683237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14bc44-04b4-479b-9a6b-81312261b5bf tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:25.714226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14bc44-04b4-479b-9a6b-81312261b5bf tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:25.726202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f413dc7a-c400-42df-bd55-e29bb01ee7c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4cd4f1987b84a00b565e2416ee914f7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:25.727342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f413dc7a-c400-42df-bd55-e29bb01ee7c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4cd4f1987b84a00b565e2416ee914f7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:25.741625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7661ee-cb30-4027-80e7-3a0cebec4224 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:25.743523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7661ee-cb30-4027-80e7-3a0cebec4224 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.743523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7661ee-cb30-4027-80e7-3a0cebec4224 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.743523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7661ee-cb30-4027-80e7-3a0cebec4224 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.743523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7661ee-cb30-4027-80e7-3a0cebec4224 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:25.745139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7661ee-cb30-4027-80e7-3a0cebec4224 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:25.751386 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2230/4522] 10.222.0.76 () {58 vars in 1278 bytes} [Sat Aug 27 04:49:25 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:49:25.753839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7661ee-cb30-4027-80e7-3a0cebec4224 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:25.765710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7661ee-cb30-4027-80e7-3a0cebec4224 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:25.772033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9e305-d363-46f1-809e-0282bfa84e24 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:25.772408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9e305-d363-46f1-809e-0282bfa84e24 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.772720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9e305-d363-46f1-809e-0282bfa84e24 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.773005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9e305-d363-46f1-809e-0282bfa84e24 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/819244c2bc154fdb97f81f2a1a813d51` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.782024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9e305-d363-46f1-809e-0282bfa84e24 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:49:25.788403 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-75d9e305-d363-46f1-809e-0282bfa84e24 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Could not find domain: 819244c2bc154fdb97f81f2a1a813d51.: keystone.exception.DomainNotFound: Could not find domain: 819244c2bc154fdb97f81f2a1a813d51. Aug 27 04:49:25.788403 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:25.788403 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:49:25.788403 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:49:25.788403 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:49:25.788403 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:49:25.788403 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:49:25.788403 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:49:25.788403 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 819244c2bc154fdb97f81f2a1a813d51. Aug 27 04:49:25.788403 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:25.788403 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:49:25.788403 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:25.788403 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:25.788403 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:25.788403 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:25.796392 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:25.796392 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:25.796392 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:25.796392 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:25.796392 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:25.796392 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:25.796392 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:25.796392 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:25.796392 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 27 04:49:25.796392 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 27 04:49:25.796392 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:49:25.796392 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:49:25.796392 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:49:25.796392 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:49:25.796392 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:49:25.796392 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:49:25.797366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:49:25.797366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:49:25.797366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:49:25.797366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:49:25.797366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:49:25.797366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:49:25.797366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:49:25.797366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:49:25.797366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:49:25.797366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:49:25.797366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:49:25.797366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:49:25.797366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:49:25.797366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:49:25.797366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:49:25.797366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:49:25.797366 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 819244c2bc154fdb97f81f2a1a813d51. Aug 27 04:49:25.798364 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:25.798364 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2231/4523] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:49:25 2022] PATCH /identity/v3/domains/819244c2bc154fdb97f81f2a1a813d51 => generated 112 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:49:25.798364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9e305-d363-46f1-809e-0282bfa84e24 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:25.827089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9e305-d363-46f1-809e-0282bfa84e24 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:25.827182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f413dc7a-c400-42df-bd55-e29bb01ee7c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4cd4f1987b84a00b565e2416ee914f7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:25.827182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f413dc7a-c400-42df-bd55-e29bb01ee7c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4cd4f1987b84a00b565e2416ee914f7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:25.827344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a680fd4-db23-42fa-abd2-75f3b85910c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:25.827344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a680fd4-db23-42fa-abd2-75f3b85910c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.827344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a680fd4-db23-42fa-abd2-75f3b85910c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.827565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a680fd4-db23-42fa-abd2-75f3b85910c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/161e308893f2437b8e1f2dcae593a34f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.829800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a680fd4-db23-42fa-abd2-75f3b85910c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:49:25.836307 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-5a680fd4-db23-42fa-abd2-75f3b85910c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Could not find domain: 161e308893f2437b8e1f2dcae593a34f.: keystone.exception.DomainNotFound: Could not find domain: 161e308893f2437b8e1f2dcae593a34f. Aug 27 04:49:25.836307 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:25.836307 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:49:25.836307 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:49:25.836307 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:49:25.836307 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:49:25.836307 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:49:25.836307 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:49:25.836307 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 161e308893f2437b8e1f2dcae593a34f. Aug 27 04:49:25.836307 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:25.836307 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:49:25.836307 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:25.836307 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:25.836307 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:25.836307 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:25.837405 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:25.837405 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:25.837405 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:25.837405 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:25.837405 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:25.837405 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:25.837405 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:25.837405 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:25.837405 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 27 04:49:25.837405 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 27 04:49:25.837405 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:49:25.837405 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:49:25.837405 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:49:25.837405 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:49:25.837405 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:49:25.837405 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:49:25.838452 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:49:25.838452 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:49:25.838452 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:49:25.838452 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:49:25.838452 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:49:25.838452 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:49:25.838452 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:49:25.838452 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:49:25.838452 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:49:25.838452 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:49:25.838452 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:49:25.838452 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:49:25.838452 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:49:25.838452 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:49:25.838452 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:49:25.838452 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:49:25.838452 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 161e308893f2437b8e1f2dcae593a34f. Aug 27 04:49:25.839427 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:25.842174 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2232/4524] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:49:25 2022] PATCH /identity/v3/domains/161e308893f2437b8e1f2dcae593a34f => generated 112 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:49:25.842598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f413dc7a-c400-42df-bd55-e29bb01ee7c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4cd4f1987b84a00b565e2416ee914f7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:25.843131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a680fd4-db23-42fa-abd2-75f3b85910c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:25.845504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5a680fd4-db23-42fa-abd2-75f3b85910c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:25.861877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a680fd4-db23-42fa-abd2-75f3b85910c3 tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:25.865366 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2293/4525] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:25 2022] DELETE /identity/v3/users/e4cd4f1987b84a00b565e2416ee914f7 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:25.871744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46507fa8-41b3-4f8d-a79a-0de98e16da2d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.872420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46507fa8-41b3-4f8d-a79a-0de98e16da2d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.873060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46507fa8-41b3-4f8d-a79a-0de98e16da2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.877866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3756e-1fa4-4970-a55c-7c8f15607d6e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364e8d763e264a4086eeb5193b062528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:25.884609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3756e-1fa4-4970-a55c-7c8f15607d6e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:25.886428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3756e-1fa4-4970-a55c-7c8f15607d6e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:25.891228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3756e-1fa4-4970-a55c-7c8f15607d6e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] PATH_INFO: `/v3/domains/a226e1ab0e394962a30d247bb8de0703` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:25.900438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-46507fa8-41b3-4f8d-a79a-0de98e16da2d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:25.902646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-46507fa8-41b3-4f8d-a79a-0de98e16da2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:25.920871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3756e-1fa4-4970-a55c-7c8f15607d6e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:49:25.933099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-84d3756e-1fa4-4970-a55c-7c8f15607d6e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Could not find domain: a226e1ab0e394962a30d247bb8de0703.: keystone.exception.DomainNotFound: Could not find domain: a226e1ab0e394962a30d247bb8de0703. Aug 27 04:49:25.933099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:25.933099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:49:25.933099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:49:25.933099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:49:25.933099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:49:25.933099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:49:25.933099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:49:25.933099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a226e1ab0e394962a30d247bb8de0703. Aug 27 04:49:25.933099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:25.933099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:49:25.933099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:25.933099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:25.933099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:25.933099 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:25.934443 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:25.934443 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:25.934443 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:25.934443 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:25.934443 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:25.934443 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:25.934443 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:25.934443 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:25.934443 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 27 04:49:25.934443 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 27 04:49:25.934443 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:49:25.934443 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:49:25.934443 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:49:25.934443 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:49:25.934443 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:49:25.934443 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:49:25.935677 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:49:25.935677 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:49:25.935677 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:49:25.935677 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:49:25.935677 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:49:25.935677 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:49:25.935677 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:49:25.935677 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:49:25.935677 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:49:25.935677 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:49:25.935677 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:49:25.935677 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:49:25.935677 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:49:25.935677 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:49:25.935677 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:49:25.935677 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:49:25.935677 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a226e1ab0e394962a30d247bb8de0703. Aug 27 04:49:25.936971 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:25.953693 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2233/4526] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:49:25 2022] PATCH /identity/v3/domains/a226e1ab0e394962a30d247bb8de0703 => generated 112 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:49:25.963399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3756e-1fa4-4970-a55c-7c8f15607d6e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:25.967732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-84d3756e-1fa4-4970-a55c-7c8f15607d6e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:25.995927 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2294/4527] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:26.002757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3756e-1fa4-4970-a55c-7c8f15607d6e tempest-DomainConfigurationTestJSON-231998987 tempest-DomainConfigurationTestJSON-231998987-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:26.008449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3064294-f322-40c0-bfc2-75ec44eeea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:26.010573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3064294-f322-40c0-bfc2-75ec44eeea86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:26.010573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3064294-f322-40c0-bfc2-75ec44eeea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:26.010573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3064294-f322-40c0-bfc2-75ec44eeea86 admin admin] PATH_INFO: `/v3/users/a2baa0b58754432e9ca387dee69a909e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:26.012506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3064294-f322-40c0-bfc2-75ec44eeea86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2baa0b58754432e9ca387dee69a909e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:26.015465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3064294-f322-40c0-bfc2-75ec44eeea86 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:26.370593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46507fa8-41b3-4f8d-a79a-0de98e16da2d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:26.371190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-46507fa8-41b3-4f8d-a79a-0de98e16da2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:26.402298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3064294-f322-40c0-bfc2-75ec44eeea86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2baa0b58754432e9ca387dee69a909e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:26.498278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46507fa8-41b3-4f8d-a79a-0de98e16da2d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:26.506966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0552668-91bb-4ab8-99bd-91d4a7c0abdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:26.511873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0552668-91bb-4ab8-99bd-91d4a7c0abdf service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:26.511873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0552668-91bb-4ab8-99bd-91d4a7c0abdf service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:26.511873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0552668-91bb-4ab8-99bd-91d4a7c0abdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:26.533786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0552668-91bb-4ab8-99bd-91d4a7c0abdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:26.540464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0552668-91bb-4ab8-99bd-91d4a7c0abdf service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:26.567749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3064294-f322-40c0-bfc2-75ec44eeea86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2baa0b58754432e9ca387dee69a909e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:26.575502 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2295/4528] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:26.575658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3064294-f322-40c0-bfc2-75ec44eeea86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2baa0b58754432e9ca387dee69a909e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:26.580564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3064294-f322-40c0-bfc2-75ec44eeea86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2baa0b58754432e9ca387dee69a909e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:26.611292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0552668-91bb-4ab8-99bd-91d4a7c0abdf service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:26.612777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f0552668-91bb-4ab8-99bd-91d4a7c0abdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:26.618142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3064294-f322-40c0-bfc2-75ec44eeea86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2baa0b58754432e9ca387dee69a909e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:26.633449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0552668-91bb-4ab8-99bd-91d4a7c0abdf service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:26.640626 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2234/4529] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:25 2022] DELETE /identity/v3/users/a2baa0b58754432e9ca387dee69a909e => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:49:26.642480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a63c6-b4f8-4a6e-9264-ed8b600c16ac None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:26.642775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a63c6-b4f8-4a6e-9264-ed8b600c16ac None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:26.643054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a63c6-b4f8-4a6e-9264-ed8b600c16ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:26.691422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-642a63c6-b4f8-4a6e-9264-ed8b600c16ac None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:26.692734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-642a63c6-b4f8-4a6e-9264-ed8b600c16ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:26.796028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3379a8-421a-40d7-b761-4c25b1e65995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:26.798033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3379a8-421a-40d7-b761-4c25b1e65995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:26.798411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3379a8-421a-40d7-b761-4c25b1e65995 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:26.799350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3379a8-421a-40d7-b761-4c25b1e65995 admin admin] PATH_INFO: `/v3/projects/d3a5882963a64230a88288ec5f0c5295` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:26.801446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3379a8-421a-40d7-b761-4c25b1e65995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a5882963a64230a88288ec5f0c5295)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:26.809860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3379a8-421a-40d7-b761-4c25b1e65995 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:26.861874 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2235/4530] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:49:26.912673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a63c6-b4f8-4a6e-9264-ed8b600c16ac None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:26.914347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-642a63c6-b4f8-4a6e-9264-ed8b600c16ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:26.988971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a63c6-b4f8-4a6e-9264-ed8b600c16ac None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:26.992848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474248d1-ac78-4749-8f26-9c202ea74b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:26.993481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474248d1-ac78-4749-8f26-9c202ea74b99 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:26.993942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474248d1-ac78-4749-8f26-9c202ea74b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:26.994226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474248d1-ac78-4749-8f26-9c202ea74b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:27.006892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474248d1-ac78-4749-8f26-9c202ea74b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:27.008730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474248d1-ac78-4749-8f26-9c202ea74b99 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:27.022161 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2236/4531] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:49:27.023663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ea6eb-4676-4be8-849e-00fab9b86f23 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:27.024044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ea6eb-4676-4be8-849e-00fab9b86f23 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:27.024353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ea6eb-4676-4be8-849e-00fab9b86f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:27.049242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-fe6ea6eb-4676-4be8-849e-00fab9b86f23 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:27.050655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fe6ea6eb-4676-4be8-849e-00fab9b86f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:27.123389 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2237/4532] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:49:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:27.141696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ea6eb-4676-4be8-849e-00fab9b86f23 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:27.141696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fe6ea6eb-4676-4be8-849e-00fab9b86f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:27.145956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af3379a8-421a-40d7-b761-4c25b1e65995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a5882963a64230a88288ec5f0c5295', 'request_id': 'req-af3379a8-421a-40d7-b761-4c25b1e65995'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:27.162219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af3379a8-421a-40d7-b761-4c25b1e65995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a5882963a64230a88288ec5f0c5295', 'request_id': 'req-af3379a8-421a-40d7-b761-4c25b1e65995'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:27.268918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af3379a8-421a-40d7-b761-4c25b1e65995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a5882963a64230a88288ec5f0c5295', 'request_id': 'req-af3379a8-421a-40d7-b761-4c25b1e65995'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:27.287371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af3379a8-421a-40d7-b761-4c25b1e65995 admin admin] The token cache is being invalidate because project d3a5882963a64230a88288ec5f0c5295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:27.288905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af3379a8-421a-40d7-b761-4c25b1e65995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:27.290090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af3379a8-421a-40d7-b761-4c25b1e65995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:27.299088 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2296/4533] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:26 2022] DELETE /identity/v3/projects/d3a5882963a64230a88288ec5f0c5295 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:27.300110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ea6eb-4676-4be8-849e-00fab9b86f23 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:27.301883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3dd2f4-87e5-40a9-8b3c-776612ecceb2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:27.302763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3dd2f4-87e5-40a9-8b3c-776612ecceb2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:27.304313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3dd2f4-87e5-40a9-8b3c-776612ecceb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:27.326967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3a3dd2f4-87e5-40a9-8b3c-776612ecceb2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:27.328517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3a3dd2f4-87e5-40a9-8b3c-776612ecceb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:27.413868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209df75-ec06-4c77-a212-0ad0721f69c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:27.414691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209df75-ec06-4c77-a212-0ad0721f69c5 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:27.417523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:27.421661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209df75-ec06-4c77-a212-0ad0721f69c5 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:27.423123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209df75-ec06-4c77-a212-0ad0721f69c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:27.427689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9209df75-ec06-4c77-a212-0ad0721f69c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:27.461788 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2297/4534] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:27.536712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02c432-6147-4285-95f4-0093e90a8655 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:27.537290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02c432-6147-4285-95f4-0093e90a8655 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:27.537383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02c432-6147-4285-95f4-0093e90a8655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:27.561425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6c02c432-6147-4285-95f4-0093e90a8655 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:27.562714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6c02c432-6147-4285-95f4-0093e90a8655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:27.563894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209df75-ec06-4c77-a212-0ad0721f69c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:27.565574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209df75-ec06-4c77-a212-0ad0721f69c5 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:27.576799 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2298/4535] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:27.582277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02c432-6147-4285-95f4-0093e90a8655 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:27.585824 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2238/4536] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:49:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 04:49:27.599796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02c432-6147-4285-95f4-0093e90a8655 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:27.607337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d7a31-6b29-4813-8630-2ca422c31280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:27.610988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d7a31-6b29-4813-8630-2ca422c31280 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:27.610988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d7a31-6b29-4813-8630-2ca422c31280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:27.610988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d7a31-6b29-4813-8630-2ca422c31280 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:27.610988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d7a31-6b29-4813-8630-2ca422c31280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:27.610988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d7a31-6b29-4813-8630-2ca422c31280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:27.612318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d7a31-6b29-4813-8630-2ca422c31280 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:27.650449 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2299/4537] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:27.658305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209df75-ec06-4c77-a212-0ad0721f69c5 service swift] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:27.673555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209df75-ec06-4c77-a212-0ad0721f69c5 service swift] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:27.697419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbde50-61c7-4eb0-85d5-024ada5dd6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:27.697419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbde50-61c7-4eb0-85d5-024ada5dd6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:27.697419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbde50-61c7-4eb0-85d5-024ada5dd6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:27.697419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbde50-61c7-4eb0-85d5-024ada5dd6a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:27.697776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbde50-61c7-4eb0-85d5-024ada5dd6a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:27.697776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbde50-61c7-4eb0-85d5-024ada5dd6a8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:27.854959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:27.869951 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2239/4538] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:27 2022] POST /identity/v3/projects => generated 359 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:27.871274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d7a31-6b29-4813-8630-2ca422c31280 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:27.887037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d7a31-6b29-4813-8630-2ca422c31280 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:28.042860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cba1b-15a4-46d3-b199-66373c1429ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:28.043392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cba1b-15a4-46d3-b199-66373c1429ff admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:28.043702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cba1b-15a4-46d3-b199-66373c1429ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:28.043975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cba1b-15a4-46d3-b199-66373c1429ff admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:28.048279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cba1b-15a4-46d3-b199-66373c1429ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:28.053906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cba1b-15a4-46d3-b199-66373c1429ff admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:28.193542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbde50-61c7-4eb0-85d5-024ada5dd6a8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:28.199148 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2300/4539] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:27 2022] POST /identity/v3/users => generated 280 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:28.210837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbde50-61c7-4eb0-85d5-024ada5dd6a8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:28.231274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e43f5c-0777-4ec8-a7f0-3c899e089121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:28.232150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e43f5c-0777-4ec8-a7f0-3c899e089121 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:28.232683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e43f5c-0777-4ec8-a7f0-3c899e089121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:28.232965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e43f5c-0777-4ec8-a7f0-3c899e089121 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:28.233182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6bf67-ffb5-4574-884b-03dea857e4c5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:28.233622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e43f5c-0777-4ec8-a7f0-3c899e089121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:28.233960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6bf67-ffb5-4574-884b-03dea857e4c5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:28.234396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6bf67-ffb5-4574-884b-03dea857e4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:28.235269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e43f5c-0777-4ec8-a7f0-3c899e089121 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:28.276809 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2240/4540] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:28.278061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e43f5c-0777-4ec8-a7f0-3c899e089121 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:28.284546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-81d6bf67-ffb5-4574-884b-03dea857e4c5 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:28.286066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-81d6bf67-ffb5-4574-884b-03dea857e4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:28.304708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e43f5c-0777-4ec8-a7f0-3c899e089121 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:28.319935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8eddb-b45b-4c7d-bb14-441bb3be4a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:28.320597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8eddb-b45b-4c7d-bb14-441bb3be4a32 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:28.320884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8eddb-b45b-4c7d-bb14-441bb3be4a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:28.321160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8eddb-b45b-4c7d-bb14-441bb3be4a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:28.322011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8eddb-b45b-4c7d-bb14-441bb3be4a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:28.323662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8eddb-b45b-4c7d-bb14-441bb3be4a32 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:28.370869 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2241/4541] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:49:28.375669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8eddb-b45b-4c7d-bb14-441bb3be4a32 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:28.394981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8eddb-b45b-4c7d-bb14-441bb3be4a32 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:28.400003 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2301/4542] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:49:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:28.409907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cd47a-ab82-48b7-8a69-823fa8cc9916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:28.410702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cd47a-ab82-48b7-8a69-823fa8cc9916 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:28.411192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cd47a-ab82-48b7-8a69-823fa8cc9916 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:28.412353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cd47a-ab82-48b7-8a69-823fa8cc9916 admin admin] PATH_INFO: `/v3/projects/96d875c684e548afb5e7d0bbff64c531/users/b6ac30ccd84443ba9c3fb9e7f5dd0635/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:28.428999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6bf67-ffb5-4574-884b-03dea857e4c5 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:28.437585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-81d6bf67-ffb5-4574-884b-03dea857e4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:28.438820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cd47a-ab82-48b7-8a69-823fa8cc9916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d875c684e548afb5e7d0bbff64c531, user_id=b6ac30ccd84443ba9c3fb9e7f5dd0635, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:28.442008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cd47a-ab82-48b7-8a69-823fa8cc9916 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:28.524534 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2242/4543] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:28 2022] PUT /identity/v3/projects/96d875c684e548afb5e7d0bbff64c531/users/b6ac30ccd84443ba9c3fb9e7f5dd0635/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:49:28.529211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7c852-7c12-460d-a4be-e068374e926e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:28.529873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7c852-7c12-460d-a4be-e068374e926e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:28.534112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7c852-7c12-460d-a4be-e068374e926e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:28.599833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e4d7c852-7c12-460d-a4be-e068374e926e None None] MFA Rules not processed for user `b6ac30ccd84443ba9c3fb9e7f5dd0635`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:28.601831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e4d7c852-7c12-460d-a4be-e068374e926e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:28.643650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6bf67-ffb5-4574-884b-03dea857e4c5 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:28.697359 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2243/4544] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:49:28.748480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7c852-7c12-460d-a4be-e068374e926e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:28.765926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e760376-e278-4919-99f4-24db8010c1ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:28.765926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e760376-e278-4919-99f4-24db8010c1ca service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:28.765926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e760376-e278-4919-99f4-24db8010c1ca service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:28.768528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e760376-e278-4919-99f4-24db8010c1ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:28.907619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e760376-e278-4919-99f4-24db8010c1ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:28.916991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e760376-e278-4919-99f4-24db8010c1ca service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:28.927495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:28.930434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7c852-7c12-460d-a4be-e068374e926e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:28.951183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404cd49-72bc-4c96-91ba-9f5230dcced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:28.951947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404cd49-72bc-4c96-91ba-9f5230dcced2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:28.952265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404cd49-72bc-4c96-91ba-9f5230dcced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:28.953167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404cd49-72bc-4c96-91ba-9f5230dcced2 admin admin] PATH_INFO: `/v3/users/b6ac30ccd84443ba9c3fb9e7f5dd0635` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:28.953858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404cd49-72bc-4c96-91ba-9f5230dcced2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ac30ccd84443ba9c3fb9e7f5dd0635)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:28.955865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404cd49-72bc-4c96-91ba-9f5230dcced2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:28.966844 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2302/4545] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:49:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:49:29.189880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e760376-e278-4919-99f4-24db8010c1ca service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:29.194068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6e760376-e278-4919-99f4-24db8010c1ca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:29.238209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e760376-e278-4919-99f4-24db8010c1ca service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:29.254896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c132e3-c11b-4219-8b79-ef70029502a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:29.259787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c132e3-c11b-4219-8b79-ef70029502a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:29.260341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c132e3-c11b-4219-8b79-ef70029502a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:29.260789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c132e3-c11b-4219-8b79-ef70029502a6 admin admin] PATH_INFO: `/v3/projects/61e3eba2e9aa46d8a041f0067f171ac0` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:29.269716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c132e3-c11b-4219-8b79-ef70029502a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e3eba2e9aa46d8a041f0067f171ac0)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:29.271796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c132e3-c11b-4219-8b79-ef70029502a6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:29.303814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c404cd49-72bc-4c96-91ba-9f5230dcced2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ac30ccd84443ba9c3fb9e7f5dd0635'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:29.381199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c404cd49-72bc-4c96-91ba-9f5230dcced2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ac30ccd84443ba9c3fb9e7f5dd0635'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:29.386165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c404cd49-72bc-4c96-91ba-9f5230dcced2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ac30ccd84443ba9c3fb9e7f5dd0635'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:29.406716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c404cd49-72bc-4c96-91ba-9f5230dcced2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ac30ccd84443ba9c3fb9e7f5dd0635'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:29.463394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c404cd49-72bc-4c96-91ba-9f5230dcced2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ac30ccd84443ba9c3fb9e7f5dd0635'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:29.490180 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2244/4546] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:28 2022] DELETE /identity/v3/users/b6ac30ccd84443ba9c3fb9e7f5dd0635 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:49:29.493545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404cd49-72bc-4c96-91ba-9f5230dcced2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:29.498187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c404cd49-72bc-4c96-91ba-9f5230dcced2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:29.504987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-69c132e3-c11b-4219-8b79-ef70029502a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e3eba2e9aa46d8a041f0067f171ac0', 'request_id': 'req-69c132e3-c11b-4219-8b79-ef70029502a6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:29.522426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-69c132e3-c11b-4219-8b79-ef70029502a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e3eba2e9aa46d8a041f0067f171ac0', 'request_id': 'req-69c132e3-c11b-4219-8b79-ef70029502a6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:29.609350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-69c132e3-c11b-4219-8b79-ef70029502a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e3eba2e9aa46d8a041f0067f171ac0', 'request_id': 'req-69c132e3-c11b-4219-8b79-ef70029502a6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:29.630944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-69c132e3-c11b-4219-8b79-ef70029502a6 admin admin] The token cache is being invalidate because project 61e3eba2e9aa46d8a041f0067f171ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:29.631248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-69c132e3-c11b-4219-8b79-ef70029502a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:29.634262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-69c132e3-c11b-4219-8b79-ef70029502a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:29.636304 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2303/4547] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:29 2022] DELETE /identity/v3/projects/61e3eba2e9aa46d8a041f0067f171ac0 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:29.638268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd373f7-2050-4bed-b567-43c009d90872 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:29.638822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd373f7-2050-4bed-b567-43c009d90872 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:29.639346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd373f7-2050-4bed-b567-43c009d90872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:29.688487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9cd373f7-2050-4bed-b567-43c009d90872 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:29.698336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404cd49-72bc-4c96-91ba-9f5230dcced2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:29.698896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9cd373f7-2050-4bed-b567-43c009d90872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:29.707057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079ed39-b964-4c45-a4b3-0015fb092d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:29.708776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079ed39-b964-4c45-a4b3-0015fb092d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:29.709130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079ed39-b964-4c45-a4b3-0015fb092d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:29.709490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079ed39-b964-4c45-a4b3-0015fb092d58 admin admin] PATH_INFO: `/v3/projects/6611b3a536d64d248e1b054f67e417b9` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:29.711000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079ed39-b964-4c45-a4b3-0015fb092d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6611b3a536d64d248e1b054f67e417b9)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:29.713098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079ed39-b964-4c45-a4b3-0015fb092d58 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:29.729246 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2304/4548] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:29.738492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd373f7-2050-4bed-b567-43c009d90872 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:29.743025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9cd373f7-2050-4bed-b567-43c009d90872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:29.805287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd373f7-2050-4bed-b567-43c009d90872 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:29.822133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c08e5-b906-4684-a13c-a8507e5594f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:29.826734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c08e5-b906-4684-a13c-a8507e5594f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:29.833649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c08e5-b906-4684-a13c-a8507e5594f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:29.834077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c08e5-b906-4684-a13c-a8507e5594f8 admin admin] PATH_INFO: `/v3/users/364e8d763e264a4086eeb5193b062528` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:29.839729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c08e5-b906-4684-a13c-a8507e5594f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=364e8d763e264a4086eeb5193b062528)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:29.848262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c08e5-b906-4684-a13c-a8507e5594f8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:29.893155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:29.935729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3079ed39-b964-4c45-a4b3-0015fb092d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6611b3a536d64d248e1b054f67e417b9', 'request_id': 'req-3079ed39-b964-4c45-a4b3-0015fb092d58'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:29.943366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3079ed39-b964-4c45-a4b3-0015fb092d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6611b3a536d64d248e1b054f67e417b9', 'request_id': 'req-3079ed39-b964-4c45-a4b3-0015fb092d58'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:29.967554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3079ed39-b964-4c45-a4b3-0015fb092d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6611b3a536d64d248e1b054f67e417b9', 'request_id': 'req-3079ed39-b964-4c45-a4b3-0015fb092d58'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.123351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3079ed39-b964-4c45-a4b3-0015fb092d58 admin admin] The token cache is being invalidate because project 6611b3a536d64d248e1b054f67e417b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:30.123646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3079ed39-b964-4c45-a4b3-0015fb092d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.124553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3079ed39-b964-4c45-a4b3-0015fb092d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.128200 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2245/4549] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:29 2022] DELETE /identity/v3/projects/6611b3a536d64d248e1b054f67e417b9 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:30.129773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079ed39-b964-4c45-a4b3-0015fb092d58 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:30.135480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3079ed39-b964-4c45-a4b3-0015fb092d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:30.152730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a7c08e5-b906-4684-a13c-a8507e5594f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '364e8d763e264a4086eeb5193b062528'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.155072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a7c08e5-b906-4684-a13c-a8507e5594f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '364e8d763e264a4086eeb5193b062528'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.238224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a7c08e5-b906-4684-a13c-a8507e5594f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '364e8d763e264a4086eeb5193b062528'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.238224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a7c08e5-b906-4684-a13c-a8507e5594f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '364e8d763e264a4086eeb5193b062528'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.261327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a7c08e5-b906-4684-a13c-a8507e5594f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '364e8d763e264a4086eeb5193b062528'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.301660 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2305/4550] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:29 2022] DELETE /identity/v3/users/364e8d763e264a4086eeb5193b062528 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:30.303891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c08e5-b906-4684-a13c-a8507e5594f8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:30.305676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5a7c08e5-b906-4684-a13c-a8507e5594f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:30.347694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079ed39-b964-4c45-a4b3-0015fb092d58 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:30.438171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a14103-7f41-43ec-a669-9fe104d9964e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:30.439201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a14103-7f41-43ec-a669-9fe104d9964e service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:30.439756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a14103-7f41-43ec-a669-9fe104d9964e service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:30.440140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a14103-7f41-43ec-a669-9fe104d9964e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:30.443037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-90a14103-7f41-43ec-a669-9fe104d9964e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:30.454652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:30.485459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c08e5-b906-4684-a13c-a8507e5594f8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:30.499945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfe27d-e46b-495d-a849-7a553348b907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:30.500908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfe27d-e46b-495d-a849-7a553348b907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:30.501266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfe27d-e46b-495d-a849-7a553348b907 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:30.501629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfe27d-e46b-495d-a849-7a553348b907 admin admin] PATH_INFO: `/v3/users/1bb0a6e4eb934a6992e40e9004d1cb70` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:30.504869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfe27d-e46b-495d-a849-7a553348b907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb0a6e4eb934a6992e40e9004d1cb70)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:30.508821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfe27d-e46b-495d-a849-7a553348b907 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:30.609729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a14103-7f41-43ec-a669-9fe104d9964e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:30.615704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a14103-7f41-43ec-a669-9fe104d9964e service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:30.631892 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2246/4551] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:30.633826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746a765-0f30-4d7c-b665-47f8389a91f8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:30.640361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:30.640361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746a765-0f30-4d7c-b665-47f8389a91f8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:30.640361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746a765-0f30-4d7c-b665-47f8389a91f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:30.666053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b746a765-0f30-4d7c-b665-47f8389a91f8 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:30.668983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b746a765-0f30-4d7c-b665-47f8389a91f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:30.758077 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2247/4552] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:49:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:30.767848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1cbfe27d-e46b-495d-a849-7a553348b907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb0a6e4eb934a6992e40e9004d1cb70'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.769558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1cbfe27d-e46b-495d-a849-7a553348b907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb0a6e4eb934a6992e40e9004d1cb70'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.774754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746a765-0f30-4d7c-b665-47f8389a91f8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:30.776967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b746a765-0f30-4d7c-b665-47f8389a91f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:30.872484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746a765-0f30-4d7c-b665-47f8389a91f8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:30.883347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18974616-bd4e-4df6-b650-b7fee8f1c638 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:30.884647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18974616-bd4e-4df6-b650-b7fee8f1c638 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:30.884647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18974616-bd4e-4df6-b650-b7fee8f1c638 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:30.884647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18974616-bd4e-4df6-b650-b7fee8f1c638 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:30.895056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18974616-bd4e-4df6-b650-b7fee8f1c638 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:30.896736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18974616-bd4e-4df6-b650-b7fee8f1c638 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:30.903178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1cbfe27d-e46b-495d-a849-7a553348b907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb0a6e4eb934a6992e40e9004d1cb70'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.903844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1cbfe27d-e46b-495d-a849-7a553348b907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb0a6e4eb934a6992e40e9004d1cb70'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.921449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1cbfe27d-e46b-495d-a849-7a553348b907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb0a6e4eb934a6992e40e9004d1cb70'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:30.922367 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2248/4553] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:49:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 04:49:30.971474 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2306/4554] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:30 2022] DELETE /identity/v3/users/1bb0a6e4eb934a6992e40e9004d1cb70 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:31.525206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18974616-bd4e-4df6-b650-b7fee8f1c638 service swift] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:31.536484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-18974616-bd4e-4df6-b650-b7fee8f1c638 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:31.570845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18974616-bd4e-4df6-b650-b7fee8f1c638 service swift] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:31.663211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0e784-8928-48af-a63a-59c5910eac44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:31.669636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0e784-8928-48af-a63a-59c5910eac44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:31.669973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0e784-8928-48af-a63a-59c5910eac44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:31.670651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0e784-8928-48af-a63a-59c5910eac44 admin admin] PATH_INFO: `/v3/users/57e997b636c74fe28f2bcff8e8d2f7c0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:31.679611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0e784-8928-48af-a63a-59c5910eac44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e997b636c74fe28f2bcff8e8d2f7c0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:31.682283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0e784-8928-48af-a63a-59c5910eac44 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:31.773036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387776e8-b999-4f40-b353-dce735c70928 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:31.773604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387776e8-b999-4f40-b353-dce735c70928 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:31.773823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387776e8-b999-4f40-b353-dce735c70928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:31.832304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-387776e8-b999-4f40-b353-dce735c70928 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:31.833597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-387776e8-b999-4f40-b353-dce735c70928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:31.994187 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2307/4555] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:49:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:49:32.003345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ebb0e784-8928-48af-a63a-59c5910eac44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e997b636c74fe28f2bcff8e8d2f7c0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:32.011324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387776e8-b999-4f40-b353-dce735c70928 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:32.013735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-387776e8-b999-4f40-b353-dce735c70928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:32.101741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ebb0e784-8928-48af-a63a-59c5910eac44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e997b636c74fe28f2bcff8e8d2f7c0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:32.101741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ebb0e784-8928-48af-a63a-59c5910eac44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e997b636c74fe28f2bcff8e8d2f7c0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:32.118479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ebb0e784-8928-48af-a63a-59c5910eac44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e997b636c74fe28f2bcff8e8d2f7c0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:32.167035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387776e8-b999-4f40-b353-dce735c70928 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:32.172645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ebb0e784-8928-48af-a63a-59c5910eac44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e997b636c74fe28f2bcff8e8d2f7c0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:32.179232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f0b70-7848-4d62-8556-b0954fd8ece7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:32.180138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f0b70-7848-4d62-8556-b0954fd8ece7 service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:32.180558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f0b70-7848-4d62-8556-b0954fd8ece7 service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:32.180936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f0b70-7848-4d62-8556-b0954fd8ece7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:32.182970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5e2f0b70-7848-4d62-8556-b0954fd8ece7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:32.203354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f0b70-7848-4d62-8556-b0954fd8ece7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:32.204646 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2249/4556] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:31 2022] DELETE /identity/v3/users/57e997b636c74fe28f2bcff8e8d2f7c0 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:32.205584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0e784-8928-48af-a63a-59c5910eac44 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:32.206266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f0b70-7848-4d62-8556-b0954fd8ece7 service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:32.218846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ebb0e784-8928-48af-a63a-59c5910eac44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:32.232835 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2308/4557] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:49:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:49:32.234076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f0b70-7848-4d62-8556-b0954fd8ece7 service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:32.240981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5e2f0b70-7848-4d62-8556-b0954fd8ece7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:32.297514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f0b70-7848-4d62-8556-b0954fd8ece7 service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:32.431613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0e784-8928-48af-a63a-59c5910eac44 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:32.438284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f4e61-77bd-49ae-84ea-e933ff57f43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:32.439520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f4e61-77bd-49ae-84ea-e933ff57f43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:32.439821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f4e61-77bd-49ae-84ea-e933ff57f43d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:32.440103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f4e61-77bd-49ae-84ea-e933ff57f43d admin admin] PATH_INFO: `/v3/projects/bd8201ec768c4a358f1f6d143ee6f4b9` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:32.440410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6a087-c798-487a-9043-27b9f870758e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:32.441326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6a087-c798-487a-9043-27b9f870758e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:32.441447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f4e61-77bd-49ae-84ea-e933ff57f43d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8201ec768c4a358f1f6d143ee6f4b9)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:32.443138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6a087-c798-487a-9043-27b9f870758e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:32.443447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f4e61-77bd-49ae-84ea-e933ff57f43d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:32.443640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6a087-c798-487a-9043-27b9f870758e admin admin] PATH_INFO: `/v3/projects/c2dbe796c827459a89d34997ea26b72f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:32.446569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6a087-c798-487a-9043-27b9f870758e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2dbe796c827459a89d34997ea26b72f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:32.453769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6a087-c798-487a-9043-27b9f870758e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:32.562196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fc1f4e61-77bd-49ae-84ea-e933ff57f43d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'request_id': 'req-fc1f4e61-77bd-49ae-84ea-e933ff57f43d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:32.587720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fc1f4e61-77bd-49ae-84ea-e933ff57f43d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'request_id': 'req-fc1f4e61-77bd-49ae-84ea-e933ff57f43d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:32.595249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fc1f4e61-77bd-49ae-84ea-e933ff57f43d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8201ec768c4a358f1f6d143ee6f4b9', 'request_id': 'req-fc1f4e61-77bd-49ae-84ea-e933ff57f43d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:32.608215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:32.615007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5da6a087-c798-487a-9043-27b9f870758e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2dbe796c827459a89d34997ea26b72f', 'request_id': 'req-5da6a087-c798-487a-9043-27b9f870758e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:32.624289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5da6a087-c798-487a-9043-27b9f870758e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2dbe796c827459a89d34997ea26b72f', 'request_id': 'req-5da6a087-c798-487a-9043-27b9f870758e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:32.667432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fc1f4e61-77bd-49ae-84ea-e933ff57f43d admin admin] The token cache is being invalidate because project bd8201ec768c4a358f1f6d143ee6f4b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:32.667829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fc1f4e61-77bd-49ae-84ea-e933ff57f43d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:32.668810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fc1f4e61-77bd-49ae-84ea-e933ff57f43d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:32.674721 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2250/4558] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:32 2022] DELETE /identity/v3/projects/bd8201ec768c4a358f1f6d143ee6f4b9 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:32.676344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609127d7-7a0d-4a30-ad62-7592a0174bb6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:32.676707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609127d7-7a0d-4a30-ad62-7592a0174bb6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:32.677229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609127d7-7a0d-4a30-ad62-7592a0174bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:32.728407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-609127d7-7a0d-4a30-ad62-7592a0174bb6 None None] MFA Rules not processed for user `e96a441cd02645d88fdd290a1392effa`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:32.730109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-609127d7-7a0d-4a30-ad62-7592a0174bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:32.749616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5da6a087-c798-487a-9043-27b9f870758e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2dbe796c827459a89d34997ea26b72f', 'request_id': 'req-5da6a087-c798-487a-9043-27b9f870758e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:32.775515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5da6a087-c798-487a-9043-27b9f870758e admin admin] The token cache is being invalidate because project c2dbe796c827459a89d34997ea26b72f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:32.776510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5da6a087-c798-487a-9043-27b9f870758e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:32.777205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5da6a087-c798-487a-9043-27b9f870758e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:32.779323 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2309/4559] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:32 2022] DELETE /identity/v3/projects/c2dbe796c827459a89d34997ea26b72f => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:32.781257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6a087-c798-487a-9043-27b9f870758e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:32.783678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5da6a087-c798-487a-9043-27b9f870758e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:32.872461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:32.877827 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2251/4560] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:32.893092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609127d7-7a0d-4a30-ad62-7592a0174bb6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:32.893092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-609127d7-7a0d-4a30-ad62-7592a0174bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:32.945070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6a087-c798-487a-9043-27b9f870758e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:32.951973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f8ae2-d07f-4fc4-8b67-bbf31f996011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:32.953687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f8ae2-d07f-4fc4-8b67-bbf31f996011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:32.953687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f8ae2-d07f-4fc4-8b67-bbf31f996011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:32.953687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f8ae2-d07f-4fc4-8b67-bbf31f996011 admin admin] PATH_INFO: `/v3/projects/96d875c684e548afb5e7d0bbff64c531` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:32.954756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f8ae2-d07f-4fc4-8b67-bbf31f996011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d875c684e548afb5e7d0bbff64c531)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:32.956734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f8ae2-d07f-4fc4-8b67-bbf31f996011 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:33.023401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609127d7-7a0d-4a30-ad62-7592a0174bb6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:33.030548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b57da-74a5-4e9e-9439-41d8abcab551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:33.031228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b57da-74a5-4e9e-9439-41d8abcab551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:33.031571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b57da-74a5-4e9e-9439-41d8abcab551 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:33.031849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b57da-74a5-4e9e-9439-41d8abcab551 admin admin] PATH_INFO: `/v3/projects/e77591a3419946c7b5ca6a26e5f3fc76` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:33.033566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b57da-74a5-4e9e-9439-41d8abcab551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e77591a3419946c7b5ca6a26e5f3fc76)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:33.036024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b57da-74a5-4e9e-9439-41d8abcab551 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:33.235959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c29b57da-74a5-4e9e-9439-41d8abcab551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e77591a3419946c7b5ca6a26e5f3fc76', 'request_id': 'req-c29b57da-74a5-4e9e-9439-41d8abcab551'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:33.242559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-380f8ae2-d07f-4fc4-8b67-bbf31f996011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d875c684e548afb5e7d0bbff64c531', 'request_id': 'req-380f8ae2-d07f-4fc4-8b67-bbf31f996011'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:33.244100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c29b57da-74a5-4e9e-9439-41d8abcab551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e77591a3419946c7b5ca6a26e5f3fc76', 'request_id': 'req-c29b57da-74a5-4e9e-9439-41d8abcab551'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:33.251518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-380f8ae2-d07f-4fc4-8b67-bbf31f996011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d875c684e548afb5e7d0bbff64c531', 'request_id': 'req-380f8ae2-d07f-4fc4-8b67-bbf31f996011'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:33.253703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c29b57da-74a5-4e9e-9439-41d8abcab551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e77591a3419946c7b5ca6a26e5f3fc76', 'request_id': 'req-c29b57da-74a5-4e9e-9439-41d8abcab551'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:33.348789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-380f8ae2-d07f-4fc4-8b67-bbf31f996011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d875c684e548afb5e7d0bbff64c531', 'request_id': 'req-380f8ae2-d07f-4fc4-8b67-bbf31f996011'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:33.369472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-380f8ae2-d07f-4fc4-8b67-bbf31f996011 admin admin] The token cache is being invalidate because project 96d875c684e548afb5e7d0bbff64c531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:33.369787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-380f8ae2-d07f-4fc4-8b67-bbf31f996011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:33.370674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-380f8ae2-d07f-4fc4-8b67-bbf31f996011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:33.375101 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2310/4561] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:32 2022] DELETE /identity/v3/projects/96d875c684e548afb5e7d0bbff64c531 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:33.376301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e198cac-f91a-4154-a04c-9c88764c6a1f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:33.376589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e198cac-f91a-4154-a04c-9c88764c6a1f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:33.376860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e198cac-f91a-4154-a04c-9c88764c6a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:33.411145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2e198cac-f91a-4154-a04c-9c88764c6a1f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:33.413024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2e198cac-f91a-4154-a04c-9c88764c6a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:33.428532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c29b57da-74a5-4e9e-9439-41d8abcab551 admin admin] The token cache is being invalidate because project e77591a3419946c7b5ca6a26e5f3fc76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:33.428914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c29b57da-74a5-4e9e-9439-41d8abcab551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:33.429868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c29b57da-74a5-4e9e-9439-41d8abcab551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:33.442940 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2252/4562] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:32 2022] DELETE /identity/v3/projects/e77591a3419946c7b5ca6a26e5f3fc76 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:33.446233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b57da-74a5-4e9e-9439-41d8abcab551 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:33.450988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c29b57da-74a5-4e9e-9439-41d8abcab551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:33.551790 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2311/4563] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:33.554396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005a3d1-6d44-4905-a112-cb3a62cda571 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:33.554396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005a3d1-6d44-4905-a112-cb3a62cda571 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:33.554725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005a3d1-6d44-4905-a112-cb3a62cda571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:33.577431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f005a3d1-6d44-4905-a112-cb3a62cda571 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:33.578735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f005a3d1-6d44-4905-a112-cb3a62cda571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:33.588900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b57da-74a5-4e9e-9439-41d8abcab551 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:33.594057 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2312/4564] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:33.595850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4910d-48cc-4024-b0ac-6eba90b865b9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:33.596145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4910d-48cc-4024-b0ac-6eba90b865b9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:33.596457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4910d-48cc-4024-b0ac-6eba90b865b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:33.612825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7bbd6-ac27-4c3f-9e77-6354bc86acec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:33.614309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7bbd6-ac27-4c3f-9e77-6354bc86acec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:33.617639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7bbd6-ac27-4c3f-9e77-6354bc86acec admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:33.618195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7bbd6-ac27-4c3f-9e77-6354bc86acec admin admin] PATH_INFO: `/v3/users/f4b1f34841e3438ba0b01ff956bfcb91` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:33.619977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7bbd6-ac27-4c3f-9e77-6354bc86acec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4b1f34841e3438ba0b01ff956bfcb91)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:33.626721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7bbd6-ac27-4c3f-9e77-6354bc86acec admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:33.626879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3fa4910d-48cc-4024-b0ac-6eba90b865b9 None None] MFA Rules not processed for user `e96a441cd02645d88fdd290a1392effa`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:33.630863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3fa4910d-48cc-4024-b0ac-6eba90b865b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:33.733154 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2313/4565] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:33.735399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c884-eab1-4f6f-84bc-86acaee82334 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:33.735693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c884-eab1-4f6f-84bc-86acaee82334 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:33.736018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c884-eab1-4f6f-84bc-86acaee82334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:33.774001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e6d8c884-eab1-4f6f-84bc-86acaee82334 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:33.775244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e6d8c884-eab1-4f6f-84bc-86acaee82334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:33.791375 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2314/4566] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:33.792876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baf210-9ff8-474f-a48a-b0e84def1c02 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:33.793169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baf210-9ff8-474f-a48a-b0e84def1c02 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:33.793735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baf210-9ff8-474f-a48a-b0e84def1c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:33.816996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b8baf210-9ff8-474f-a48a-b0e84def1c02 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:33.818249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b8baf210-9ff8-474f-a48a-b0e84def1c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:33.828810 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2315/4567] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:33.830614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a683095-47bc-45e8-8631-50f83ae76ffb None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:33.830614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a683095-47bc-45e8-8631-50f83ae76ffb None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:33.830816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a683095-47bc-45e8-8631-50f83ae76ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:33.852817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9a683095-47bc-45e8-8631-50f83ae76ffb None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:33.854406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9a683095-47bc-45e8-8631-50f83ae76ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:33.865557 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2316/4568] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:33.868350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c640823-9272-488d-b420-730901621551 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:33.868350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c640823-9272-488d-b420-730901621551 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:33.868350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c640823-9272-488d-b420-730901621551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:33.890173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0c640823-9272-488d-b420-730901621551 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:33.891408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0c640823-9272-488d-b420-730901621551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:33.900228 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2317/4569] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:33.903795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c640823-9272-488d-b420-730901621551 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:33.903795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0c640823-9272-488d-b420-730901621551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:33.980206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ac7bbd6-ac27-4c3f-9e77-6354bc86acec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4b1f34841e3438ba0b01ff956bfcb91'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:34.088800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ac7bbd6-ac27-4c3f-9e77-6354bc86acec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4b1f34841e3438ba0b01ff956bfcb91'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:34.089456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c640823-9272-488d-b420-730901621551 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:34.089563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ac7bbd6-ac27-4c3f-9e77-6354bc86acec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4b1f34841e3438ba0b01ff956bfcb91'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:34.096116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9227096-c1e8-4a3b-a723-904851ba4cd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:34.097609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9227096-c1e8-4a3b-a723-904851ba4cd9 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:34.097971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9227096-c1e8-4a3b-a723-904851ba4cd9 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:34.098296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9227096-c1e8-4a3b-a723-904851ba4cd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:34.100385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a9227096-c1e8-4a3b-a723-904851ba4cd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:34.104489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ac7bbd6-ac27-4c3f-9e77-6354bc86acec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4b1f34841e3438ba0b01ff956bfcb91'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:34.113206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9227096-c1e8-4a3b-a723-904851ba4cd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:34.115274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9227096-c1e8-4a3b-a723-904851ba4cd9 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:34.135161 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2318/4570] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:34.142982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d4b83-a28a-4ba5-99d6-d4629ddaf9b6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:34.142982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d4b83-a28a-4ba5-99d6-d4629ddaf9b6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:34.142982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d4b83-a28a-4ba5-99d6-d4629ddaf9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:34.153184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ac7bbd6-ac27-4c3f-9e77-6354bc86acec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4b1f34841e3438ba0b01ff956bfcb91'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:34.162583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1b0d4b83-a28a-4ba5-99d6-d4629ddaf9b6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:34.163891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1b0d4b83-a28a-4ba5-99d6-d4629ddaf9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:34.174398 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2253/4571] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:33 2022] DELETE /identity/v3/users/f4b1f34841e3438ba0b01ff956bfcb91 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:34.175771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b386075-e687-4ab8-9f4c-eaf0dd8791bd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:34.177383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b386075-e687-4ab8-9f4c-eaf0dd8791bd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:34.177383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b386075-e687-4ab8-9f4c-eaf0dd8791bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:34.180079 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2319/4572] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:34.181310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d4b83-a28a-4ba5-99d6-d4629ddaf9b6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:34.182647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1b0d4b83-a28a-4ba5-99d6-d4629ddaf9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:34.200662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d4b83-a28a-4ba5-99d6-d4629ddaf9b6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:34.231794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3b386075-e687-4ab8-9f4c-eaf0dd8791bd None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:34.233136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3b386075-e687-4ab8-9f4c-eaf0dd8791bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:34.359993 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2254/4573] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:34.359993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b386075-e687-4ab8-9f4c-eaf0dd8791bd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:34.360583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40b2e7-8ca6-492f-bb18-c763936ec401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:34.362188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3b386075-e687-4ab8-9f4c-eaf0dd8791bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:34.362373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40b2e7-8ca6-492f-bb18-c763936ec401 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:34.362712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40b2e7-8ca6-492f-bb18-c763936ec401 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:34.363736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40b2e7-8ca6-492f-bb18-c763936ec401 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:34.367442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40b2e7-8ca6-492f-bb18-c763936ec401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:34.367867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40b2e7-8ca6-492f-bb18-c763936ec401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:34.369624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40b2e7-8ca6-492f-bb18-c763936ec401 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:34.393306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b386075-e687-4ab8-9f4c-eaf0dd8791bd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:34.403663 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2320/4574] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:34.406329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67e1d9-d2b4-4baf-b982-22886917b715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:34.406964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e1d9-d2b4-4baf-b982-22886917b715 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:34.407244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e1d9-d2b4-4baf-b982-22886917b715 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:34.407519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e1d9-d2b4-4baf-b982-22886917b715 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:34.408607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67e1d9-d2b4-4baf-b982-22886917b715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:34.408924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67e1d9-d2b4-4baf-b982-22886917b715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:34.410583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67e1d9-d2b4-4baf-b982-22886917b715 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:34.413213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45bef5-06b5-461c-af87-224b2988cf71 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:34.413500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45bef5-06b5-461c-af87-224b2988cf71 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:34.414403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45bef5-06b5-461c-af87-224b2988cf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:34.459042 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2255/4575] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:34.459042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67e1d9-d2b4-4baf-b982-22886917b715 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:34.497721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8e45bef5-06b5-461c-af87-224b2988cf71 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:34.498564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8e45bef5-06b5-461c-af87-224b2988cf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:34.512506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67e1d9-d2b4-4baf-b982-22886917b715 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:34.522956 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2321/4576] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:34.528902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45bef5-06b5-461c-af87-224b2988cf71 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:34.531570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416052f7-16e6-4f10-90fd-04c233401883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:34.531923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416052f7-16e6-4f10-90fd-04c233401883 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:34.532245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416052f7-16e6-4f10-90fd-04c233401883 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:34.532523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416052f7-16e6-4f10-90fd-04c233401883 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:34.533187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416052f7-16e6-4f10-90fd-04c233401883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:34.533494 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416052f7-16e6-4f10-90fd-04c233401883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:34.535135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416052f7-16e6-4f10-90fd-04c233401883 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:34.560530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45bef5-06b5-461c-af87-224b2988cf71 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:34.577297 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2256/4577] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:34.578165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416052f7-16e6-4f10-90fd-04c233401883 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:34.579831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebcb68-d96c-4ce1-9a34-b0959b99c598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:34.580491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebcb68-d96c-4ce1-9a34-b0959b99c598 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:34.593926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebcb68-d96c-4ce1-9a34-b0959b99c598 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:34.593926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebcb68-d96c-4ce1-9a34-b0959b99c598 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:34.593926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebcb68-d96c-4ce1-9a34-b0959b99c598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:34.593926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebcb68-d96c-4ce1-9a34-b0959b99c598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:34.593926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebcb68-d96c-4ce1-9a34-b0959b99c598 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:34.605454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416052f7-16e6-4f10-90fd-04c233401883 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:34.621977 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2322/4578] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:34.622904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebcb68-d96c-4ce1-9a34-b0959b99c598 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:34.632495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6ce28-6156-4e27-a013-ad2407767673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:34.633122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6ce28-6156-4e27-a013-ad2407767673 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:34.633406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6ce28-6156-4e27-a013-ad2407767673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:34.633948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6ce28-6156-4e27-a013-ad2407767673 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:34.634604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6ce28-6156-4e27-a013-ad2407767673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:34.636702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6ce28-6156-4e27-a013-ad2407767673 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:34.646442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebcb68-d96c-4ce1-9a34-b0959b99c598 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:34.662805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0dc09-ed87-4c77-90f9-9390e9644d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:34.663435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0dc09-ed87-4c77-90f9-9390e9644d18 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:34.663713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0dc09-ed87-4c77-90f9-9390e9644d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:34.663982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0dc09-ed87-4c77-90f9-9390e9644d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:34.665364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0dc09-ed87-4c77-90f9-9390e9644d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:34.670162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0dc09-ed87-4c77-90f9-9390e9644d18 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:34.760280 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2257/4579] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:34 2022] POST /identity/v3/projects => generated 361 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:34.761426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6ce28-6156-4e27-a013-ad2407767673 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:34.765943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-34d6ce28-6156-4e27-a013-ad2407767673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:34.816851 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2323/4580] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:34 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:34.818087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0dc09-ed87-4c77-90f9-9390e9644d18 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:35.001183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6ce28-6156-4e27-a013-ad2407767673 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:35.038358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0dc09-ed87-4c77-90f9-9390e9644d18 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:35.068419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924fb05-0450-4b93-aaa3-7f595182611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:35.071526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924fb05-0450-4b93-aaa3-7f595182611b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:35.072580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924fb05-0450-4b93-aaa3-7f595182611b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:35.073066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924fb05-0450-4b93-aaa3-7f595182611b admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:35.081076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924fb05-0450-4b93-aaa3-7f595182611b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:35.098896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924fb05-0450-4b93-aaa3-7f595182611b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:35.135706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708760d-e18c-4492-98da-8f6b8ed99f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:35.136811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708760d-e18c-4492-98da-8f6b8ed99f7b service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:35.136811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708760d-e18c-4492-98da-8f6b8ed99f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:35.137317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708760d-e18c-4492-98da-8f6b8ed99f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:35.153657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708760d-e18c-4492-98da-8f6b8ed99f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:35.155323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:35.156340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708760d-e18c-4492-98da-8f6b8ed99f7b service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:35.209698 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2324/4581] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:34 2022] POST /identity/v3/projects => generated 365 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:35.209698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924fb05-0450-4b93-aaa3-7f595182611b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:35.217700 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2258/4582] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:35.219912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708760d-e18c-4492-98da-8f6b8ed99f7b service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:35.250952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708760d-e18c-4492-98da-8f6b8ed99f7b service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:35.352397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924fb05-0450-4b93-aaa3-7f595182611b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:35.362735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae034eb-3faa-4737-abc9-ca189edc0b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:35.363361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae034eb-3faa-4737-abc9-ca189edc0b86 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:35.363505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4eeb9-9739-4bf8-8e1f-0f0ab836f2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:35.363721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae034eb-3faa-4737-abc9-ca189edc0b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:35.363982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae034eb-3faa-4737-abc9-ca189edc0b86 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:35.364109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4eeb9-9739-4bf8-8e1f-0f0ab836f2fa admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:35.364353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4eeb9-9739-4bf8-8e1f-0f0ab836f2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:35.364627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4eeb9-9739-4bf8-8e1f-0f0ab836f2fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:35.364855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae034eb-3faa-4737-abc9-ca189edc0b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:35.365273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4eeb9-9739-4bf8-8e1f-0f0ab836f2fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:35.367050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae034eb-3faa-4737-abc9-ca189edc0b86 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:35.367179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4eeb9-9739-4bf8-8e1f-0f0ab836f2fa admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:35.406255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:35.487946 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2259/4583] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:35 2022] POST /identity/v3/users => generated 281 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:35.489132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae034eb-3faa-4737-abc9-ca189edc0b86 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:35.503418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae034eb-3faa-4737-abc9-ca189edc0b86 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:35.509195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c7c72-71d6-4539-98ed-b5ba364da2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:35.510144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c7c72-71d6-4539-98ed-b5ba364da2aa admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:35.510599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c7c72-71d6-4539-98ed-b5ba364da2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:35.510875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c7c72-71d6-4539-98ed-b5ba364da2aa admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:35.511577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c7c72-71d6-4539-98ed-b5ba364da2aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:35.514319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c7c72-71d6-4539-98ed-b5ba364da2aa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:35.518997 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2325/4584] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:35 2022] POST /identity/v3/projects => generated 383 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:35.527613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e09638-8c7b-425f-9e2c-d5a1d48270de None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:35.528435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e09638-8c7b-425f-9e2c-d5a1d48270de None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:35.528891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e09638-8c7b-425f-9e2c-d5a1d48270de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:35.537141 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-a4e09638-8c7b-425f-9e2c-d5a1d48270de None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:49:35.537141 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:35.537141 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:35.537141 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:35.537141 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:35.537141 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:35.537141 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:35.537141 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:35.537141 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:35.537141 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:35.537141 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:35.537141 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:35.537141 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:49:35.541636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:49:35.541636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:49:35.541636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:49:35.541636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:49:35.541636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:49:35.541636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:49:35.541636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:49:35.541636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:49:35.541636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:49:35.541636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:49:35.541636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:49:35.541636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:49:35.541636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:49:35.541636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:49:35.541636 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:35.542638 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2326/4585] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:49:35 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 19 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:49:35.542638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e09638-8c7b-425f-9e2c-d5a1d48270de None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:35.646288 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2260/4586] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:35 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:35.646288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c7c72-71d6-4539-98ed-b5ba364da2aa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:35.667253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c7c72-71d6-4539-98ed-b5ba364da2aa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:35.673182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e09638-8c7b-425f-9e2c-d5a1d48270de None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:35.688657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe6cb1-1998-4f4b-abc9-6c95897b5373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:35.689292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe6cb1-1998-4f4b-abc9-6c95897b5373 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:35.689578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe6cb1-1998-4f4b-abc9-6c95897b5373 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:35.690006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe6cb1-1998-4f4b-abc9-6c95897b5373 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:35.690675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe6cb1-1998-4f4b-abc9-6c95897b5373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:35.693176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe6cb1-1998-4f4b-abc9-6c95897b5373 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:35.697915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92a4fd-8c75-4ec9-a849-75b6d2d3cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:35.698427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92a4fd-8c75-4ec9-a849-75b6d2d3cfe5 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:35.701337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92a4fd-8c75-4ec9-a849-75b6d2d3cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:35.701337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92a4fd-8c75-4ec9-a849-75b6d2d3cfe5 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:35.701337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92a4fd-8c75-4ec9-a849-75b6d2d3cfe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:35.702949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92a4fd-8c75-4ec9-a849-75b6d2d3cfe5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:35.711774 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2261/4587] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:35.713117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe6cb1-1998-4f4b-abc9-6c95897b5373 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:35.724693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe6cb1-1998-4f4b-abc9-6c95897b5373 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:35.731510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f4f25-67ab-49d9-b87f-d1ab602ab870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:35.732840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f4f25-67ab-49d9-b87f-d1ab602ab870 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:35.733417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f4f25-67ab-49d9-b87f-d1ab602ab870 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:35.733906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f4f25-67ab-49d9-b87f-d1ab602ab870 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:35.735251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f4f25-67ab-49d9-b87f-d1ab602ab870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:35.738080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f4f25-67ab-49d9-b87f-d1ab602ab870 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:35.836827 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2327/4588] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:35 2022] POST /identity/v3/users => generated 283 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:35.838349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92a4fd-8c75-4ec9-a849-75b6d2d3cfe5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:35.851843 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2262/4589] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:35 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:35.859597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92a4fd-8c75-4ec9-a849-75b6d2d3cfe5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:35.861448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f4f25-67ab-49d9-b87f-d1ab602ab870 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:35.867577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab654581-9be2-46d5-9f3b-848d72f34636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:35.868471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab654581-9be2-46d5-9f3b-848d72f34636 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:35.869293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab654581-9be2-46d5-9f3b-848d72f34636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:35.869636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab654581-9be2-46d5-9f3b-848d72f34636 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:35.870832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab654581-9be2-46d5-9f3b-848d72f34636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:35.873623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab654581-9be2-46d5-9f3b-848d72f34636 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:35.882096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f4f25-67ab-49d9-b87f-d1ab602ab870 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:35.892618 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2328/4590] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:35.892618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab654581-9be2-46d5-9f3b-848d72f34636 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:35.920705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab654581-9be2-46d5-9f3b-848d72f34636 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:35.932659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870fc9a-c37a-4b60-afe1-1d7ae948b768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:35.935317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870fc9a-c37a-4b60-afe1-1d7ae948b768 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:35.935317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870fc9a-c37a-4b60-afe1-1d7ae948b768 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:35.937022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870fc9a-c37a-4b60-afe1-1d7ae948b768 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:35.937876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870fc9a-c37a-4b60-afe1-1d7ae948b768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:35.939590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c6cf9-2a4e-4be8-b88b-eb5a06fbc6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:35.940783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c6cf9-2a4e-4be8-b88b-eb5a06fbc6fe admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:35.941282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c6cf9-2a4e-4be8-b88b-eb5a06fbc6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:35.941741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c6cf9-2a4e-4be8-b88b-eb5a06fbc6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:35.944081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870fc9a-c37a-4b60-afe1-1d7ae948b768 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:35.945612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c6cf9-2a4e-4be8-b88b-eb5a06fbc6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:35.948097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c6cf9-2a4e-4be8-b88b-eb5a06fbc6fe admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:35.976371 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2329/4591] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:35.977448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870fc9a-c37a-4b60-afe1-1d7ae948b768 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:35.999825 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2263/4592] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:36.005511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c6cf9-2a4e-4be8-b88b-eb5a06fbc6fe admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:36.014828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870fc9a-c37a-4b60-afe1-1d7ae948b768 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:36.019356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c6cf9-2a4e-4be8-b88b-eb5a06fbc6fe admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:36.023582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fa140-d4fb-4cc2-a473-36623018123c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:36.024584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fa140-d4fb-4cc2-a473-36623018123c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:36.035356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fa140-d4fb-4cc2-a473-36623018123c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:36.035356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fa140-d4fb-4cc2-a473-36623018123c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:36.035356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fa140-d4fb-4cc2-a473-36623018123c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:36.035356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fa140-d4fb-4cc2-a473-36623018123c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:36.035807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5c207-a0a6-42f7-9757-e969b6907fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:36.035807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5c207-a0a6-42f7-9757-e969b6907fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:36.035807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5c207-a0a6-42f7-9757-e969b6907fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:36.035807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5c207-a0a6-42f7-9757-e969b6907fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:36.036122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5c207-a0a6-42f7-9757-e969b6907fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:36.036122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5c207-a0a6-42f7-9757-e969b6907fd2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:36.049226 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2330/4593] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:36.050160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fa140-d4fb-4cc2-a473-36623018123c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:36.059915 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2264/4594] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:36.061068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5c207-a0a6-42f7-9757-e969b6907fd2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:36.077296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fa140-d4fb-4cc2-a473-36623018123c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:36.086171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5c207-a0a6-42f7-9757-e969b6907fd2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:36.093809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff3ee3-2fb0-45d6-9bd4-817175768ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:36.094854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff3ee3-2fb0-45d6-9bd4-817175768ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:36.095348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff3ee3-2fb0-45d6-9bd4-817175768ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:36.096849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff3ee3-2fb0-45d6-9bd4-817175768ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:36.098535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff3ee3-2fb0-45d6-9bd4-817175768ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:36.102995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a1824-edbf-404a-9f64-80b6d8ad5131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:36.104448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff3ee3-2fb0-45d6-9bd4-817175768ad7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:36.106874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a1824-edbf-404a-9f64-80b6d8ad5131 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:36.107431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a1824-edbf-404a-9f64-80b6d8ad5131 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:36.107919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a1824-edbf-404a-9f64-80b6d8ad5131 admin admin] PATH_INFO: `/v3/projects/3bedb768e79a4953b5e55a492f7b3469/users/ff6eb8df4ce34a818bdd3b1ac33e5bbf/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:36.134196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a1824-edbf-404a-9f64-80b6d8ad5131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bedb768e79a4953b5e55a492f7b3469, user_id=ff6eb8df4ce34a818bdd3b1ac33e5bbf, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:36.137522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a1824-edbf-404a-9f64-80b6d8ad5131 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:36.139563 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2331/4595] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:36.142729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff3ee3-2fb0-45d6-9bd4-817175768ad7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:36.157514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff3ee3-2fb0-45d6-9bd4-817175768ad7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:36.162944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c152f7-e1af-4adb-bec2-f500abc375f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:36.163567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c152f7-e1af-4adb-bec2-f500abc375f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:36.163845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c152f7-e1af-4adb-bec2-f500abc375f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:36.164557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c152f7-e1af-4adb-bec2-f500abc375f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:36.165348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c152f7-e1af-4adb-bec2-f500abc375f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:36.167034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c152f7-e1af-4adb-bec2-f500abc375f0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:36.180603 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2332/4596] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:36.181561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c152f7-e1af-4adb-bec2-f500abc375f0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:36.212101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c152f7-e1af-4adb-bec2-f500abc375f0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:36.219123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4650e-a76f-41c5-92b6-de67183f1f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:36.219805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4650e-a76f-41c5-92b6-de67183f1f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:36.220089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4650e-a76f-41c5-92b6-de67183f1f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:36.232513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4650e-a76f-41c5-92b6-de67183f1f7a admin admin] PATH_INFO: `/v3/projects/7c77a118277e4872a87c75a7b92ea351/users/c6cc7014dca344ab98c32507cec69b97/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:36.232789 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2265/4597] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:36 2022] PUT /identity/v3/projects/3bedb768e79a4953b5e55a492f7b3469/users/ff6eb8df4ce34a818bdd3b1ac33e5bbf/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:36.232789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a1824-edbf-404a-9f64-80b6d8ad5131 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:36.247898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4650e-a76f-41c5-92b6-de67183f1f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c77a118277e4872a87c75a7b92ea351, user_id=c6cc7014dca344ab98c32507cec69b97, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:36.252133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4650e-a76f-41c5-92b6-de67183f1f7a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:36.338950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a1824-edbf-404a-9f64-80b6d8ad5131 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:36.350824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c63b9d-2032-4b9f-8828-82557bff98e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:36.352357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c63b9d-2032-4b9f-8828-82557bff98e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:36.356392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c63b9d-2032-4b9f-8828-82557bff98e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:36.366348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c63b9d-2032-4b9f-8828-82557bff98e4 admin admin] PATH_INFO: `/v3/projects/2040081d643640e0b9a11e20b9b7b43b/users/f1690d47ed05427998470b485e179295/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:36.381156 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2333/4598] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:36 2022] PUT /identity/v3/projects/7c77a118277e4872a87c75a7b92ea351/users/c6cc7014dca344ab98c32507cec69b97/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:36.384094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4650e-a76f-41c5-92b6-de67183f1f7a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:36.397162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c63b9d-2032-4b9f-8828-82557bff98e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2040081d643640e0b9a11e20b9b7b43b, user_id=f1690d47ed05427998470b485e179295, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:36.399985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c63b9d-2032-4b9f-8828-82557bff98e4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:36.478334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4650e-a76f-41c5-92b6-de67183f1f7a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:36.484001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd43792-90d5-4b08-8511-3151ccdcada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:36.484730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd43792-90d5-4b08-8511-3151ccdcada8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:36.486540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd43792-90d5-4b08-8511-3151ccdcada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:36.486540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd43792-90d5-4b08-8511-3151ccdcada8 admin admin] PATH_INFO: `/v3/projects/62e2973550654530a3aa68b1d3164c7f/users/0da2f983ac0d44b1ad5e116c40a8d8ae/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:36.505505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd43792-90d5-4b08-8511-3151ccdcada8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e2973550654530a3aa68b1d3164c7f, user_id=0da2f983ac0d44b1ad5e116c40a8d8ae, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:36.509320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd43792-90d5-4b08-8511-3151ccdcada8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:36.515657 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2266/4599] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:36 2022] PUT /identity/v3/projects/2040081d643640e0b9a11e20b9b7b43b/users/f1690d47ed05427998470b485e179295/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:36.518765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c63b9d-2032-4b9f-8828-82557bff98e4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:36.527195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-95c63b9d-2032-4b9f-8828-82557bff98e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:36.600638 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2334/4600] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:36 2022] PUT /identity/v3/projects/62e2973550654530a3aa68b1d3164c7f/users/0da2f983ac0d44b1ad5e116c40a8d8ae/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:36.602902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d6fd0-8bba-4e2c-aa8e-841569f69c49 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:36.603234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d6fd0-8bba-4e2c-aa8e-841569f69c49 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:36.603560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d6fd0-8bba-4e2c-aa8e-841569f69c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:36.613819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c63b9d-2032-4b9f-8828-82557bff98e4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:36.654643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-357d6fd0-8bba-4e2c-aa8e-841569f69c49 None None] MFA Rules not processed for user `ff6eb8df4ce34a818bdd3b1ac33e5bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:36.656303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-357d6fd0-8bba-4e2c-aa8e-841569f69c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:36.716227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8ddde-f69a-4dc9-ad9b-cf5acc87aed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:36.717368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8ddde-f69a-4dc9-ad9b-cf5acc87aed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:36.717819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8ddde-f69a-4dc9-ad9b-cf5acc87aed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:36.718258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8ddde-f69a-4dc9-ad9b-cf5acc87aed5 admin admin] PATH_INFO: `/v3/projects/caebb4e0980641faa46639172ed1a090` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:36.719896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8ddde-f69a-4dc9-ad9b-cf5acc87aed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caebb4e0980641faa46639172ed1a090)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:36.722495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8ddde-f69a-4dc9-ad9b-cf5acc87aed5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:36.810336 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2335/4601] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:36.810336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bec35-e45d-489f-b28f-eda7212d3c90 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:36.810336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bec35-e45d-489f-b28f-eda7212d3c90 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:36.810336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bec35-e45d-489f-b28f-eda7212d3c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:36.871145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-203bec35-e45d-489f-b28f-eda7212d3c90 None None] MFA Rules not processed for user `1599979f94f34b579e3cd4ac963de1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:36.871145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-203bec35-e45d-489f-b28f-eda7212d3c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:36.905387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-02a8ddde-f69a-4dc9-ad9b-cf5acc87aed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caebb4e0980641faa46639172ed1a090', 'request_id': 'req-02a8ddde-f69a-4dc9-ad9b-cf5acc87aed5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:36.932589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-02a8ddde-f69a-4dc9-ad9b-cf5acc87aed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caebb4e0980641faa46639172ed1a090', 'request_id': 'req-02a8ddde-f69a-4dc9-ad9b-cf5acc87aed5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:36.942459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-02a8ddde-f69a-4dc9-ad9b-cf5acc87aed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caebb4e0980641faa46639172ed1a090', 'request_id': 'req-02a8ddde-f69a-4dc9-ad9b-cf5acc87aed5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:36.965228 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2336/4602] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:36.967248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115eaa0d-efeb-4d1e-bf3e-01c25ab71844 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:36.967659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115eaa0d-efeb-4d1e-bf3e-01c25ab71844 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:36.968028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115eaa0d-efeb-4d1e-bf3e-01c25ab71844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:37.022023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-115eaa0d-efeb-4d1e-bf3e-01c25ab71844 None None] MFA Rules not processed for user `c6cc7014dca344ab98c32507cec69b97`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:37.023284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-115eaa0d-efeb-4d1e-bf3e-01c25ab71844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:37.041353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-02a8ddde-f69a-4dc9-ad9b-cf5acc87aed5 admin admin] The token cache is being invalidate because project caebb4e0980641faa46639172ed1a090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:37.041575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-02a8ddde-f69a-4dc9-ad9b-cf5acc87aed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:37.042673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-02a8ddde-f69a-4dc9-ad9b-cf5acc87aed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:37.049273 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2267/4603] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:36 2022] DELETE /identity/v3/projects/caebb4e0980641faa46639172ed1a090 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:37.051028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4e81a-3655-4ac1-bb73-795ea3ead82d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:37.052952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4e81a-3655-4ac1-bb73-795ea3ead82d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:37.054533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4e81a-3655-4ac1-bb73-795ea3ead82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:37.095349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:37.126567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:37.134412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-93a4e81a-3655-4ac1-bb73-795ea3ead82d None None] MFA Rules not processed for user `f1690d47ed05427998470b485e179295`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:37.135805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-93a4e81a-3655-4ac1-bb73-795ea3ead82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:37.222567 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2337/4604] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:37.229969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c3832-a2af-4d4e-a6df-d6589bd049e8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:37.230587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c3832-a2af-4d4e-a6df-d6589bd049e8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:37.231809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c3832-a2af-4d4e-a6df-d6589bd049e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:37.285188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-107c3832-a2af-4d4e-a6df-d6589bd049e8 None None] MFA Rules not processed for user `0da2f983ac0d44b1ad5e116c40a8d8ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:37.286633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-107c3832-a2af-4d4e-a6df-d6589bd049e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:37.294433 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2268/4605] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:37.294433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4e81a-3655-4ac1-bb73-795ea3ead82d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:37.297566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-93a4e81a-3655-4ac1-bb73-795ea3ead82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:37.407589 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2338/4606] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:37.407589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c3832-a2af-4d4e-a6df-d6589bd049e8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:37.407589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-107c3832-a2af-4d4e-a6df-d6589bd049e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:37.456214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4e81a-3655-4ac1-bb73-795ea3ead82d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:37.466779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33236785-829f-44de-9742-3b8945b9f5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:37.467413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33236785-829f-44de-9742-3b8945b9f5bf admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:37.467757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33236785-829f-44de-9742-3b8945b9f5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:37.468041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33236785-829f-44de-9742-3b8945b9f5bf admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:37.468733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33236785-829f-44de-9742-3b8945b9f5bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:37.471502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33236785-829f-44de-9742-3b8945b9f5bf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:37.493181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c3832-a2af-4d4e-a6df-d6589bd049e8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:37.498202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f0380-3d8e-4c81-acba-feedffd29e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:37.498824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f0380-3d8e-4c81-acba-feedffd29e9b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:37.499129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f0380-3d8e-4c81-acba-feedffd29e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:37.499432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f0380-3d8e-4c81-acba-feedffd29e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:37.500060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f0380-3d8e-4c81-acba-feedffd29e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:37.502021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f0380-3d8e-4c81-acba-feedffd29e9b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:37.586852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:37.600223 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2269/4607] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:37 2022] POST /identity/v3/projects => generated 367 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:37.604870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8db1-863c-4be8-8b51-07d1a35a0c71 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:37.605417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8db1-863c-4be8-8b51-07d1a35a0c71 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:37.609844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8db1-863c-4be8-8b51-07d1a35a0c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:37.661657 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2339/4608] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:37 2022] POST /identity/v3/projects => generated 383 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:37.661657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f0380-3d8e-4c81-acba-feedffd29e9b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:37.663251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7a1b8db1-863c-4be8-8b51-07d1a35a0c71 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:37.666749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7a1b8db1-863c-4be8-8b51-07d1a35a0c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:37.671875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a65f0380-3d8e-4c81-acba-feedffd29e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:37.765025 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2270/4609] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:37.766331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b8db1-863c-4be8-8b51-07d1a35a0c71 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:37.774683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7a1b8db1-863c-4be8-8b51-07d1a35a0c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:37.796685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f0380-3d8e-4c81-acba-feedffd29e9b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:37.805365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503fc64-92ed-4907-a821-63147b0e789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:37.806139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503fc64-92ed-4907-a821-63147b0e789e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:37.806449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503fc64-92ed-4907-a821-63147b0e789e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:37.806715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503fc64-92ed-4907-a821-63147b0e789e admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:37.807587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503fc64-92ed-4907-a821-63147b0e789e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:37.812275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503fc64-92ed-4907-a821-63147b0e789e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:37.868029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b8db1-863c-4be8-8b51-07d1a35a0c71 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:37.873103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e954d1-d11d-4e3e-8e8f-7c1027490c44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:37.874148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e954d1-d11d-4e3e-8e8f-7c1027490c44 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:37.874641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e954d1-d11d-4e3e-8e8f-7c1027490c44 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:37.875118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e954d1-d11d-4e3e-8e8f-7c1027490c44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:37.942192 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2340/4610] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:37 2022] POST /identity/v3/projects => generated 387 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:37.943225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503fc64-92ed-4907-a821-63147b0e789e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:37.948204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f503fc64-92ed-4907-a821-63147b0e789e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:38.032869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e954d1-d11d-4e3e-8e8f-7c1027490c44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:38.034502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e954d1-d11d-4e3e-8e8f-7c1027490c44 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:38.060328 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2271/4611] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:38.060328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e954d1-d11d-4e3e-8e8f-7c1027490c44 service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:38.081611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:38.083041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e954d1-d11d-4e3e-8e8f-7c1027490c44 service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:38.140217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503fc64-92ed-4907-a821-63147b0e789e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:38.161318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdbc74-3bf9-4fc2-baaf-aa2fa2023729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:38.161967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdbc74-3bf9-4fc2-baaf-aa2fa2023729 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:38.162677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdbc74-3bf9-4fc2-baaf-aa2fa2023729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:38.162677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdbc74-3bf9-4fc2-baaf-aa2fa2023729 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:38.165174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdbc74-3bf9-4fc2-baaf-aa2fa2023729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:38.170582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdbc74-3bf9-4fc2-baaf-aa2fa2023729 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:38.193869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ae205-43a5-4629-939b-ce4e77a5bec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:38.194698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ae205-43a5-4629-939b-ce4e77a5bec8 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:38.195060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ae205-43a5-4629-939b-ce4e77a5bec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:38.196521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ae205-43a5-4629-939b-ce4e77a5bec8 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:38.196897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ae205-43a5-4629-939b-ce4e77a5bec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:38.200546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ae205-43a5-4629-939b-ce4e77a5bec8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:38.299234 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2341/4612] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:37 2022] POST /identity/v3/projects => generated 383 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:38.300098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdbc74-3bf9-4fc2-baaf-aa2fa2023729 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:38.321263 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2272/4613] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:38 2022] POST /identity/v3/users => generated 290 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:38.322677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842609ec-1bb9-48d2-9e9f-7b58402b88a0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:38.323318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842609ec-1bb9-48d2-9e9f-7b58402b88a0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:38.323754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842609ec-1bb9-48d2-9e9f-7b58402b88a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:38.383428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-842609ec-1bb9-48d2-9e9f-7b58402b88a0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:38.385243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-842609ec-1bb9-48d2-9e9f-7b58402b88a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:38.470859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdbc74-3bf9-4fc2-baaf-aa2fa2023729 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:38.476144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efe5b9-3647-4c73-b113-ae3a8142cbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:38.476868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efe5b9-3647-4c73-b113-ae3a8142cbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:38.477217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efe5b9-3647-4c73-b113-ae3a8142cbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:38.477576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efe5b9-3647-4c73-b113-ae3a8142cbf3 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:38.478345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efe5b9-3647-4c73-b113-ae3a8142cbf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:38.480395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efe5b9-3647-4c73-b113-ae3a8142cbf3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:38.533626 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2273/4614] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:38.534729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842609ec-1bb9-48d2-9e9f-7b58402b88a0 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:38.559888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842609ec-1bb9-48d2-9e9f-7b58402b88a0 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:38.574182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ab84d-6925-482c-8379-00237adf9ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:38.575128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ab84d-6925-482c-8379-00237adf9ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:38.575407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ab84d-6925-482c-8379-00237adf9ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:38.576820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ab84d-6925-482c-8379-00237adf9ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:38.577639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ab84d-6925-482c-8379-00237adf9ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:38.580640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ab84d-6925-482c-8379-00237adf9ea9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:38.608638 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2342/4615] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:38 2022] POST /identity/v3/users => generated 298 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:38.608638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efe5b9-3647-4c73-b113-ae3a8142cbf3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:38.630823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efe5b9-3647-4c73-b113-ae3a8142cbf3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:38.649861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba990d6-ed26-4e86-a6d2-0f6972c5c944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:38.650506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba990d6-ed26-4e86-a6d2-0f6972c5c944 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:38.650790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba990d6-ed26-4e86-a6d2-0f6972c5c944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:38.653783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba990d6-ed26-4e86-a6d2-0f6972c5c944 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:38.653783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba990d6-ed26-4e86-a6d2-0f6972c5c944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:38.654074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba990d6-ed26-4e86-a6d2-0f6972c5c944 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:38.677814 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2274/4616] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:38 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:38.678735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ab84d-6925-482c-8379-00237adf9ea9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:38.697472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ab84d-6925-482c-8379-00237adf9ea9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:38.705548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc49d20-2445-4847-a411-73bc563a0ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:38.706386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc49d20-2445-4847-a411-73bc563a0ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:38.706872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc49d20-2445-4847-a411-73bc563a0ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:38.707396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc49d20-2445-4847-a411-73bc563a0ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:38.708242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc49d20-2445-4847-a411-73bc563a0ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:38.710412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc49d20-2445-4847-a411-73bc563a0ac3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:38.731749 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2275/4617] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:38.731749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc49d20-2445-4847-a411-73bc563a0ac3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:38.744756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc49d20-2445-4847-a411-73bc563a0ac3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:38.764139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b6bba-e84d-4625-8bda-7f89ab5f5a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:38.764873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b6bba-e84d-4625-8bda-7f89ab5f5a73 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:38.765161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b6bba-e84d-4625-8bda-7f89ab5f5a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:38.768376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b6bba-e84d-4625-8bda-7f89ab5f5a73 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:38.771180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b6bba-e84d-4625-8bda-7f89ab5f5a73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:38.771586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b6bba-e84d-4625-8bda-7f89ab5f5a73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:38.775746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b6bba-e84d-4625-8bda-7f89ab5f5a73 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:38.790788 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2343/4618] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:38 2022] POST /identity/v3/users => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:38.791821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba990d6-ed26-4e86-a6d2-0f6972c5c944 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:38.813340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba990d6-ed26-4e86-a6d2-0f6972c5c944 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:38.836409 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2276/4619] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:38.836576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf3fc0-d980-4681-be75-af2e4d278f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:38.836576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3fc0-d980-4681-be75-af2e4d278f0c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:38.836576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3fc0-d980-4681-be75-af2e4d278f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:38.836576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3fc0-d980-4681-be75-af2e4d278f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:38.836934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf3fc0-d980-4681-be75-af2e4d278f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:38.840781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b6bba-e84d-4625-8bda-7f89ab5f5a73 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:38.842787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf3fc0-d980-4681-be75-af2e4d278f0c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:38.854462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b6bba-e84d-4625-8bda-7f89ab5f5a73 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:38.883093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535b27b-c5a8-44b5-9a6d-049e5613aafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:38.884005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535b27b-c5a8-44b5-9a6d-049e5613aafa admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:38.887473 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2344/4620] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:38.887625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535b27b-c5a8-44b5-9a6d-049e5613aafa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:38.887886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf3fc0-d980-4681-be75-af2e4d278f0c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:38.888002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535b27b-c5a8-44b5-9a6d-049e5613aafa admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:38.888002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535b27b-c5a8-44b5-9a6d-049e5613aafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:38.890403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535b27b-c5a8-44b5-9a6d-049e5613aafa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:38.914432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf3fc0-d980-4681-be75-af2e4d278f0c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:38.918019 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2277/4621] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:38.919678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535b27b-c5a8-44b5-9a6d-049e5613aafa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:38.936085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535b27b-c5a8-44b5-9a6d-049e5613aafa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:38.941583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236c619-5986-4b38-8af4-746b4b85eb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:38.942321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236c619-5986-4b38-8af4-746b4b85eb1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:38.942882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236c619-5986-4b38-8af4-746b4b85eb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:38.942882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236c619-5986-4b38-8af4-746b4b85eb1b admin admin] PATH_INFO: `/v3/projects/885dbfe1e433422a9cc74cdc68937b2a/users/b0f4a6f1382341789d121621d5eb32b1/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:38.952338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7a8da-3c70-4500-9569-ebeb7073b618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:38.953375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7a8da-3c70-4500-9569-ebeb7073b618 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:38.953375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7a8da-3c70-4500-9569-ebeb7073b618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:38.953590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7a8da-3c70-4500-9569-ebeb7073b618 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:38.954286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7a8da-3c70-4500-9569-ebeb7073b618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:38.956026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7a8da-3c70-4500-9569-ebeb7073b618 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:38.982342 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2278/4622] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:38.982342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7a8da-3c70-4500-9569-ebeb7073b618 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:38.990314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236c619-5986-4b38-8af4-746b4b85eb1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=885dbfe1e433422a9cc74cdc68937b2a, user_id=b0f4a6f1382341789d121621d5eb32b1, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:38.990314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236c619-5986-4b38-8af4-746b4b85eb1b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:38.997710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7a8da-3c70-4500-9569-ebeb7073b618 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:39.003175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2bd22-635b-4024-abcb-837d7f9c5c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:39.003953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2bd22-635b-4024-abcb-837d7f9c5c51 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:39.004236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2bd22-635b-4024-abcb-837d7f9c5c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:39.004589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2bd22-635b-4024-abcb-837d7f9c5c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:39.005592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2bd22-635b-4024-abcb-837d7f9c5c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:39.007669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2bd22-635b-4024-abcb-837d7f9c5c51 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:39.180232 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2279/4623] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:38 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:39.181636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2bd22-635b-4024-abcb-837d7f9c5c51 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:39.195067 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2345/4624] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:38 2022] PUT /identity/v3/projects/885dbfe1e433422a9cc74cdc68937b2a/users/b0f4a6f1382341789d121621d5eb32b1/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:39.197617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236c619-5986-4b38-8af4-746b4b85eb1b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:39.327949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236c619-5986-4b38-8af4-746b4b85eb1b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:39.366975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2bd22-635b-4024-abcb-837d7f9c5c51 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:39.382238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52962fa5-2f56-41dc-b5f8-74bcd9ed293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:39.383050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52962fa5-2f56-41dc-b5f8-74bcd9ed293e admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:39.383392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52962fa5-2f56-41dc-b5f8-74bcd9ed293e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:39.383596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52962fa5-2f56-41dc-b5f8-74bcd9ed293e admin admin] PATH_INFO: `/v3/projects/37933da736ba4506a06cd76f98f5a308/users/266c2afa4bdd4a959047d57f085d589c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:39.419218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52962fa5-2f56-41dc-b5f8-74bcd9ed293e admin admin] RBAC: Authorizing `identity:create_grant(project_id=37933da736ba4506a06cd76f98f5a308, user_id=266c2afa4bdd4a959047d57f085d589c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:39.425130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52962fa5-2f56-41dc-b5f8-74bcd9ed293e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:39.469534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:39.480338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23e134-d6de-4117-b598-b2d4ef5cee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:39.482094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e134-d6de-4117-b598-b2d4ef5cee26 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:39.482441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e134-d6de-4117-b598-b2d4ef5cee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:39.485403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e134-d6de-4117-b598-b2d4ef5cee26 admin admin] PATH_INFO: `/v3/projects/9a294093d8594c93a7af3e7550a145c1/users/3cad6298e4a340588aa9b3fc96a2758c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:39.526586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23e134-d6de-4117-b598-b2d4ef5cee26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a294093d8594c93a7af3e7550a145c1, user_id=3cad6298e4a340588aa9b3fc96a2758c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:39.530555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23e134-d6de-4117-b598-b2d4ef5cee26 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:39.533490 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2280/4625] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:39 2022] PUT /identity/v3/projects/37933da736ba4506a06cd76f98f5a308/users/266c2afa4bdd4a959047d57f085d589c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:39.534199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52962fa5-2f56-41dc-b5f8-74bcd9ed293e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:39.672300 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2346/4626] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:39 2022] PUT /identity/v3/projects/9a294093d8594c93a7af3e7550a145c1/users/3cad6298e4a340588aa9b3fc96a2758c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:39.672300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23e134-d6de-4117-b598-b2d4ef5cee26 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:39.694202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52962fa5-2f56-41dc-b5f8-74bcd9ed293e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:39.801151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23e134-d6de-4117-b598-b2d4ef5cee26 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:39.817599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61dbec-df17-4370-a58e-88dbd9dfdc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:39.818225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61dbec-df17-4370-a58e-88dbd9dfdc0b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:39.818558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61dbec-df17-4370-a58e-88dbd9dfdc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:39.818829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61dbec-df17-4370-a58e-88dbd9dfdc0b admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:39.819522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61dbec-df17-4370-a58e-88dbd9dfdc0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:39.821513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61dbec-df17-4370-a58e-88dbd9dfdc0b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:39.847435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df339a-d97f-47a8-8fcd-815bdf1fd59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:39.848228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df339a-d97f-47a8-8fcd-815bdf1fd59e admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:39.849975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df339a-d97f-47a8-8fcd-815bdf1fd59e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:39.854375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df339a-d97f-47a8-8fcd-815bdf1fd59e admin admin] PATH_INFO: `/v3/projects/e942977be8d249659c6e4d4ceb6f8f24/users/051174fb53da42e18ac0930c0b45ac74/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:39.894053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df339a-d97f-47a8-8fcd-815bdf1fd59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e942977be8d249659c6e4d4ceb6f8f24, user_id=051174fb53da42e18ac0930c0b45ac74, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:39.903734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df339a-d97f-47a8-8fcd-815bdf1fd59e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:39.969581 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2347/4627] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:39 2022] POST /identity/v3/users => generated 293 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:39.973767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61dbec-df17-4370-a58e-88dbd9dfdc0b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:40.006253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61dbec-df17-4370-a58e-88dbd9dfdc0b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:40.023122 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2281/4628] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:39 2022] PUT /identity/v3/projects/e942977be8d249659c6e4d4ceb6f8f24/users/051174fb53da42e18ac0930c0b45ac74/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:40.025678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df339a-d97f-47a8-8fcd-815bdf1fd59e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:40.099321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e358db-e660-425f-a432-679ada4fb9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:40.100364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e358db-e660-425f-a432-679ada4fb9af admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:40.100960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e358db-e660-425f-a432-679ada4fb9af admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:40.101339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e358db-e660-425f-a432-679ada4fb9af admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:40.102133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e358db-e660-425f-a432-679ada4fb9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:40.104706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e358db-e660-425f-a432-679ada4fb9af admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:40.123169 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2348/4629] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:40.123169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e358db-e660-425f-a432-679ada4fb9af admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:40.139681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e358db-e660-425f-a432-679ada4fb9af admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:40.148628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40ba8b-bca1-47c7-88ff-dbe2a10de1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:40.151529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40ba8b-bca1-47c7-88ff-dbe2a10de1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:40.158073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40ba8b-bca1-47c7-88ff-dbe2a10de1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:40.158073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40ba8b-bca1-47c7-88ff-dbe2a10de1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:40.158073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40ba8b-bca1-47c7-88ff-dbe2a10de1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:40.158073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40ba8b-bca1-47c7-88ff-dbe2a10de1f9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:40.169755 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2349/4630] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:40.170862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40ba8b-bca1-47c7-88ff-dbe2a10de1f9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:40.186034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40ba8b-bca1-47c7-88ff-dbe2a10de1f9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:40.192103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3fb15-019b-405d-8e55-ba66c12c36b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:40.192811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df339a-d97f-47a8-8fcd-815bdf1fd59e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:40.193030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3fb15-019b-405d-8e55-ba66c12c36b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:40.193407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3fb15-019b-405d-8e55-ba66c12c36b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:40.193807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3fb15-019b-405d-8e55-ba66c12c36b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:40.194855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3fb15-019b-405d-8e55-ba66c12c36b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:40.196273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3fb15-019b-405d-8e55-ba66c12c36b9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:40.206727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72531b73-9f0f-4b8d-b3db-3c0b9d7b4715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:40.208657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72531b73-9f0f-4b8d-b3db-3c0b9d7b4715 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:40.209171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72531b73-9f0f-4b8d-b3db-3c0b9d7b4715 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:40.221268 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2350/4631] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:40.221268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3fb15-019b-405d-8e55-ba66c12c36b9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:40.221474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72531b73-9f0f-4b8d-b3db-3c0b9d7b4715 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:40.223179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72531b73-9f0f-4b8d-b3db-3c0b9d7b4715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:40.226276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72531b73-9f0f-4b8d-b3db-3c0b9d7b4715 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:40.230157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3fb15-019b-405d-8e55-ba66c12c36b9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:40.236646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db840c-dfc0-465c-b391-ecff4b579b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:40.237038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db840c-dfc0-465c-b391-ecff4b579b8e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:40.237304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db840c-dfc0-465c-b391-ecff4b579b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:40.237577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db840c-dfc0-465c-b391-ecff4b579b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:40.238213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db840c-dfc0-465c-b391-ecff4b579b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:40.240191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db840c-dfc0-465c-b391-ecff4b579b8e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:40.256333 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2282/4632] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:40.257216 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2351/4633] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:40.258133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db840c-dfc0-465c-b391-ecff4b579b8e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:40.258590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72531b73-9f0f-4b8d-b3db-3c0b9d7b4715 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:40.276565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db840c-dfc0-465c-b391-ecff4b579b8e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:40.278619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72531b73-9f0f-4b8d-b3db-3c0b9d7b4715 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:40.283013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f641d-1b23-4a1b-aa28-40e12d913162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:40.284118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f641d-1b23-4a1b-aa28-40e12d913162 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:40.286337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f641d-1b23-4a1b-aa28-40e12d913162 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:40.287138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f641d-1b23-4a1b-aa28-40e12d913162 admin admin] PATH_INFO: `/v3/projects/9a294093d8594c93a7af3e7550a145c1/users/3cad6298e4a340588aa9b3fc96a2758c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:40.287778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d738a2-26de-481c-83ad-a69132aedc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:40.288717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d738a2-26de-481c-83ad-a69132aedc30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:40.289218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f641d-1b23-4a1b-aa28-40e12d913162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a294093d8594c93a7af3e7550a145c1, user_id=3cad6298e4a340588aa9b3fc96a2758c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:40.289447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d738a2-26de-481c-83ad-a69132aedc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:40.290005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d738a2-26de-481c-83ad-a69132aedc30 admin admin] PATH_INFO: `/v3/projects/885dbfe1e433422a9cc74cdc68937b2a/users/b0f4a6f1382341789d121621d5eb32b1/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:40.292688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d738a2-26de-481c-83ad-a69132aedc30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=885dbfe1e433422a9cc74cdc68937b2a, user_id=b0f4a6f1382341789d121621d5eb32b1, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:40.294153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f641d-1b23-4a1b-aa28-40e12d913162 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:40.298056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d738a2-26de-481c-83ad-a69132aedc30 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:40.312968 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2352/4634] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:40 2022] PUT /identity/v3/projects/9a294093d8594c93a7af3e7550a145c1/users/3cad6298e4a340588aa9b3fc96a2758c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:40.314043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f641d-1b23-4a1b-aa28-40e12d913162 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:40.327301 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2283/4635] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:40 2022] PUT /identity/v3/projects/885dbfe1e433422a9cc74cdc68937b2a/users/b0f4a6f1382341789d121621d5eb32b1/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:40.327757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d738a2-26de-481c-83ad-a69132aedc30 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:40.400912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:40.443372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f641d-1b23-4a1b-aa28-40e12d913162 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:40.447720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d738a2-26de-481c-83ad-a69132aedc30 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:40.449225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e120e-3510-44b7-bfab-e11e4d8321d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:40.450119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e120e-3510-44b7-bfab-e11e4d8321d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:40.450501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e120e-3510-44b7-bfab-e11e4d8321d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:40.450879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e120e-3510-44b7-bfab-e11e4d8321d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:40.451748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e120e-3510-44b7-bfab-e11e4d8321d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:40.453701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e120e-3510-44b7-bfab-e11e4d8321d9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:40.455915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21852d-f739-42e4-a0b4-86e50f9888e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:40.456915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21852d-f739-42e4-a0b4-86e50f9888e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:40.457439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21852d-f739-42e4-a0b4-86e50f9888e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:40.457909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21852d-f739-42e4-a0b4-86e50f9888e1 admin admin] PATH_INFO: `/v3/projects/37933da736ba4506a06cd76f98f5a308/users/266c2afa4bdd4a959047d57f085d589c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:40.460325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21852d-f739-42e4-a0b4-86e50f9888e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37933da736ba4506a06cd76f98f5a308, user_id=266c2afa4bdd4a959047d57f085d589c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:40.464442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21852d-f739-42e4-a0b4-86e50f9888e1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:40.475231 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2353/4636] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:40.475231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e120e-3510-44b7-bfab-e11e4d8321d9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:40.480495 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2284/4637] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:40 2022] PUT /identity/v3/projects/37933da736ba4506a06cd76f98f5a308/users/266c2afa4bdd4a959047d57f085d589c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:40.482872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b4db1-7a6a-40e5-b25d-46ea24580016 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:40.483361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b4db1-7a6a-40e5-b25d-46ea24580016 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:40.483860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b4db1-7a6a-40e5-b25d-46ea24580016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:40.486340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e120e-3510-44b7-bfab-e11e4d8321d9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:40.520417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-679b4db1-7a6a-40e5-b25d-46ea24580016 None None] MFA Rules not processed for user `b0f4a6f1382341789d121621d5eb32b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:40.522069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-679b4db1-7a6a-40e5-b25d-46ea24580016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:40.554734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f0c2c-d811-4ef9-95cd-3757bc33f995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:40.555735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f0c2c-d811-4ef9-95cd-3757bc33f995 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:40.556088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f0c2c-d811-4ef9-95cd-3757bc33f995 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:40.556471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f0c2c-d811-4ef9-95cd-3757bc33f995 admin admin] PATH_INFO: `/v3/projects/e942977be8d249659c6e4d4ceb6f8f24/users/051174fb53da42e18ac0930c0b45ac74/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:40.558853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f0c2c-d811-4ef9-95cd-3757bc33f995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e942977be8d249659c6e4d4ceb6f8f24, user_id=051174fb53da42e18ac0930c0b45ac74, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:40.561987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f0c2c-d811-4ef9-95cd-3757bc33f995 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:40.582868 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2354/4638] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:40 2022] PUT /identity/v3/projects/e942977be8d249659c6e4d4ceb6f8f24/users/051174fb53da42e18ac0930c0b45ac74/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:40.584505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc7c9c-100e-4371-b4f7-86d24cf79fe4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:40.586330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc7c9c-100e-4371-b4f7-86d24cf79fe4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:40.586330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc7c9c-100e-4371-b4f7-86d24cf79fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:40.621894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5ddc7c9c-100e-4371-b4f7-86d24cf79fe4 None None] MFA Rules not processed for user `3cad6298e4a340588aa9b3fc96a2758c`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:40.622750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5ddc7c9c-100e-4371-b4f7-86d24cf79fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:40.626201 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2285/4639] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:40.627287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b4db1-7a6a-40e5-b25d-46ea24580016 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:40.640242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b4db1-7a6a-40e5-b25d-46ea24580016 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:40.704513 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2355/4640] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:40.709044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075274b-6537-47e7-9fb6-6ba60765f771 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:40.709401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075274b-6537-47e7-9fb6-6ba60765f771 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:40.709754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075274b-6537-47e7-9fb6-6ba60765f771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:40.747488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3075274b-6537-47e7-9fb6-6ba60765f771 None None] MFA Rules not processed for user `051174fb53da42e18ac0930c0b45ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:40.749210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3075274b-6537-47e7-9fb6-6ba60765f771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:40.752143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc525ec9-13fa-46d0-b40d-8cc364a87478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:40.753416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc525ec9-13fa-46d0-b40d-8cc364a87478 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:40.754292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc525ec9-13fa-46d0-b40d-8cc364a87478 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:40.754835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc525ec9-13fa-46d0-b40d-8cc364a87478 admin admin] PATH_INFO: `/v3/projects/70397b37458b4fdf871fd8042aa9bb02/users/1cb821903fb849ddbe117d45ee3b3e66/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:40.794275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc525ec9-13fa-46d0-b40d-8cc364a87478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70397b37458b4fdf871fd8042aa9bb02, user_id=1cb821903fb849ddbe117d45ee3b3e66, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:40.803506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc525ec9-13fa-46d0-b40d-8cc364a87478 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:40.869775 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2356/4641] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:40.870451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075274b-6537-47e7-9fb6-6ba60765f771 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:40.986375 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2286/4642] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:40 2022] PUT /identity/v3/projects/70397b37458b4fdf871fd8042aa9bb02/users/1cb821903fb849ddbe117d45ee3b3e66/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:40.987497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc525ec9-13fa-46d0-b40d-8cc364a87478 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:41.069886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075274b-6537-47e7-9fb6-6ba60765f771 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:41.156205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc525ec9-13fa-46d0-b40d-8cc364a87478 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:41.161542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae9c1e-e0e2-49ad-ba49-0e8532af0436 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cad6298e4a340588aa9b3fc96a2758c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a294093d8594c93a7af3e7550a145c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:41.162186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae9c1e-e0e2-49ad-ba49-0e8532af0436 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:41.162484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae9c1e-e0e2-49ad-ba49-0e8532af0436 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:41.162748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae9c1e-e0e2-49ad-ba49-0e8532af0436 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:41.163580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae9c1e-e0e2-49ad-ba49-0e8532af0436 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:41.165403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae9c1e-e0e2-49ad-ba49-0e8532af0436 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:41.213556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccb4b6-84c7-4bfa-ac35-f34717e88880 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:41.214321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb4b6-84c7-4bfa-ac35-f34717e88880 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:41.214719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb4b6-84c7-4bfa-ac35-f34717e88880 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:41.215130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb4b6-84c7-4bfa-ac35-f34717e88880 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:41.215933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccb4b6-84c7-4bfa-ac35-f34717e88880 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:41.218491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccb4b6-84c7-4bfa-ac35-f34717e88880 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:41.268369 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2287/4643] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:40 2022] POST /identity/v3/services => generated 289 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:41.268369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae9c1e-e0e2-49ad-ba49-0e8532af0436 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:41.366856 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2357/4644] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:40 2022] POST /identity/v3/projects => generated 360 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:41.368427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126704d-88fb-4772-b774-561038107962 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:41.368719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126704d-88fb-4772-b774-561038107962 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:41.369802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126704d-88fb-4772-b774-561038107962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:41.421223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae9c1e-e0e2-49ad-ba49-0e8532af0436 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:41.449896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4126704d-88fb-4772-b774-561038107962 None None] MFA Rules not processed for user `1cb821903fb849ddbe117d45ee3b3e66`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:41.452540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4126704d-88fb-4772-b774-561038107962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:41.548205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420ce90-7ef9-486e-a0d6-cc1baecd8045 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051174fb53da42e18ac0930c0b45ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e942977be8d249659c6e4d4ceb6f8f24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:41.549904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420ce90-7ef9-486e-a0d6-cc1baecd8045 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:41.549904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420ce90-7ef9-486e-a0d6-cc1baecd8045 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:41.549904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420ce90-7ef9-486e-a0d6-cc1baecd8045 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:41.550269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420ce90-7ef9-486e-a0d6-cc1baecd8045 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:41.551754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420ce90-7ef9-486e-a0d6-cc1baecd8045 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-c420ce90-7ef9-486e-a0d6-cc1baecd8045 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invalid input for field 'name': '' is too short Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: Failed validating 'minLength' in schema['properties']['name']: Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: On instance['name']: Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: Failed validating 'minLength' in schema['properties']['name']: Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: On instance['name']: Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: '' Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise error Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application On instance['name']: Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application '' Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.582371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:49:41.583816 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.583816 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:41.583816 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:41.583816 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:41.583816 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:41.583816 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:41.583816 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:41.583816 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:41.583816 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:41.583816 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:41.583816 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:41.583816 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:41.583816 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 27 04:49:41.583816 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 27 04:49:41.583816 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 27 04:49:41.583816 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 27 04:49:41.583816 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 27 04:49:41.584880 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 27 04:49:41.584880 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 27 04:49:41.584880 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.584880 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 27 04:49:41.584880 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 27 04:49:41.584880 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.584880 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application On instance['name']: Aug 27 04:49:41.584880 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application '' Aug 27 04:49:41.584880 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.584880 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2288/4645] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:49:41 2022] POST /identity/v3/domains => generated 283 bytes in 316 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:49:41.584880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420ce90-7ef9-486e-a0d6-cc1baecd8045 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:41.617666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:41.644100 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2358/4646] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:41 2022] POST /identity/v3/auth/tokens => generated 3396 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:41.645182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126704d-88fb-4772-b774-561038107962 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:41.819545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420ce90-7ef9-486e-a0d6-cc1baecd8045 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:41.832140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597cb22-2f14-475e-8ce7-b100607d68de tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cad6298e4a340588aa9b3fc96a2758c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a294093d8594c93a7af3e7550a145c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:41.832796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597cb22-2f14-475e-8ce7-b100607d68de tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:41.834593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597cb22-2f14-475e-8ce7-b100607d68de tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:41.835094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597cb22-2f14-475e-8ce7-b100607d68de tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:41.837071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597cb22-2f14-475e-8ce7-b100607d68de tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:41.838984 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-b597cb22-2f14-475e-8ce7-b100607d68de tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:41.838984 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:49:41.838984 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:49:41.845489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597cb22-2f14-475e-8ce7-b100607d68de tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:41.857442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126704d-88fb-4772-b774-561038107962 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:41.868816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89c821-acf0-47b4-8014-c5821b917878 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:41.869892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89c821-acf0-47b4-8014-c5821b917878 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:41.870332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89c821-acf0-47b4-8014-c5821b917878 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:41.870903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89c821-acf0-47b4-8014-c5821b917878 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-b597cb22-2f14-475e-8ce7-b100607d68de tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: Failed validating 'type' in schema['properties']['enabled']: Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: {'enum': [True, False, None], 'type': 'boolean'} Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: On instance['enabled']: Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: Failed validating 'type' in schema['properties']['enabled']: Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: {'enum': [True, False, None], 'type': 'boolean'} Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: On instance['enabled']: Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: 'False' Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise error Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application On instance['enabled']: Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application 'False' Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.873205 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:49:41.878410 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.878410 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:41.878410 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:41.878410 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:41.878410 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:41.878410 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:41.878410 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:41.878410 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:41.878410 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:41.878410 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:41.878410 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:41.878410 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:41.878410 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 27 04:49:41.878410 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 27 04:49:41.878410 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 27 04:49:41.878410 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 27 04:49:41.878410 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 27 04:49:41.879703 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 27 04:49:41.879703 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 27 04:49:41.879703 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.879703 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 27 04:49:41.879703 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 27 04:49:41.879703 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.879703 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application On instance['enabled']: Aug 27 04:49:41.879703 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application 'False' Aug 27 04:49:41.879703 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.879703 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2289/4647] 10.222.0.76 () {60 vars in 1156 bytes} [Sat Aug 27 04:49:41 2022] POST /identity/v3/endpoints => generated 283 bytes in 292 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:49:41.879703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597cb22-2f14-475e-8ce7-b100607d68de tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:41.880585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89c821-acf0-47b4-8014-c5821b917878 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:41.887088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89c821-acf0-47b4-8014-c5821b917878 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:41.922024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597cb22-2f14-475e-8ce7-b100607d68de tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:41.950222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de21b0f-914d-476d-a2af-080a2cc00fc2 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051174fb53da42e18ac0930c0b45ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e942977be8d249659c6e4d4ceb6f8f24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:41.951202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de21b0f-914d-476d-a2af-080a2cc00fc2 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:41.952802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de21b0f-914d-476d-a2af-080a2cc00fc2 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:41.954526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de21b0f-914d-476d-a2af-080a2cc00fc2 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:41.955316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de21b0f-914d-476d-a2af-080a2cc00fc2 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:41.969495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de21b0f-914d-476d-a2af-080a2cc00fc2 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-4de21b0f-914d-476d-a2af-080a2cc00fc2 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: Failed validating 'maxLength' in schema['properties']['name']: Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: On instance['name']: Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: Failed validating 'maxLength' in schema['properties']['name']: Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: On instance['name']: Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise error Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 27 04:49:41.979541 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application On instance['name']: Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 27 04:49:41.981836 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 27 04:49:41.983350 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 27 04:49:41.983350 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 27 04:49:41.983350 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 27 04:49:41.983350 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 27 04:49:41.983350 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:49:41.983350 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.983350 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 27 04:49:41.983350 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 27 04:49:41.983350 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.983350 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application On instance['name']: Aug 27 04:49:41.983350 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 04:49:41.983350 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:41.983350 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2290/4648] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:49:41 2022] POST /identity/v3/domains => generated 412 bytes in 106 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:49:41.983350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de21b0f-914d-476d-a2af-080a2cc00fc2 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:42.037072 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2359/4649] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:41 2022] POST /identity/v3/users => generated 416 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:42.037925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89c821-acf0-47b4-8014-c5821b917878 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:42.090740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89c821-acf0-47b4-8014-c5821b917878 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:42.126306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fd414-306e-43c2-a525-526192449a51 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cad6298e4a340588aa9b3fc96a2758c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a294093d8594c93a7af3e7550a145c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:42.128678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fd414-306e-43c2-a525-526192449a51 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:42.129910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fd414-306e-43c2-a525-526192449a51 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:42.130956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fd414-306e-43c2-a525-526192449a51 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:42.134718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fd414-306e-43c2-a525-526192449a51 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:42.141844 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-146fd414-306e-43c2-a525-526192449a51 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:42.141844 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:49:42.141844 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:49:42.145292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fd414-306e-43c2-a525-526192449a51 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:42.167445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de21b0f-914d-476d-a2af-080a2cc00fc2 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-146fd414-306e-43c2-a525-526192449a51 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: Failed validating 'type' in schema['properties']['enabled']: Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: {'enum': [True, False, None], 'type': 'boolean'} Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: On instance['enabled']: Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: Failed validating 'type' in schema['properties']['enabled']: Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: {'enum': [True, False, None], 'type': 'boolean'} Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: On instance['enabled']: Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: 'True' Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise error Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application On instance['enabled']: Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application 'True' Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:42.169136 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:49:42.180812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:42.180812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:42.180812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:42.180812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:42.180812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:42.180812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:42.180812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:42.180812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:42.180812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:42.180812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:42.180812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:42.180812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:42.180812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 27 04:49:42.180812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 27 04:49:42.180812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 27 04:49:42.180812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 27 04:49:42.180812 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 27 04:49:42.182255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 27 04:49:42.182255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 27 04:49:42.182255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:42.182255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 27 04:49:42.182255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 27 04:49:42.182255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:42.182255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application On instance['enabled']: Aug 27 04:49:42.182255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application 'True' Aug 27 04:49:42.182255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:42.182255 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2360/4650] 10.222.0.76 () {60 vars in 1156 bytes} [Sat Aug 27 04:49:42 2022] POST /identity/v3/endpoints => generated 281 bytes in 137 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:49:42.182255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fd414-306e-43c2-a525-526192449a51 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:42.186251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880124d-8d51-4196-a341-286be196568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:42.187095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880124d-8d51-4196-a341-286be196568b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:42.187858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880124d-8d51-4196-a341-286be196568b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:42.188374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880124d-8d51-4196-a341-286be196568b admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:42.189223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880124d-8d51-4196-a341-286be196568b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:42.191405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880124d-8d51-4196-a341-286be196568b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:42.197228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fd414-306e-43c2-a525-526192449a51 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:42.206026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42310f9-841e-4f0e-acff-1421486c1ec8 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051174fb53da42e18ac0930c0b45ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e942977be8d249659c6e4d4ceb6f8f24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:42.206642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42310f9-841e-4f0e-acff-1421486c1ec8 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:42.219116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42310f9-841e-4f0e-acff-1421486c1ec8 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:42.219116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42310f9-841e-4f0e-acff-1421486c1ec8 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:42.219116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42310f9-841e-4f0e-acff-1421486c1ec8 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:42.219116 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-c42310f9-841e-4f0e-acff-1421486c1ec8 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:42.219116 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:49:42.219116 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:49:42.219775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42310f9-841e-4f0e-acff-1421486c1ec8 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:42.351491 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2291/4651] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:41 2022] POST /identity/v3/projects => generated 385 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:42.352488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880124d-8d51-4196-a341-286be196568b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:42.355029 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2361/4652] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:49:42 2022] POST /identity/v3/domains => generated 276 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:42.355930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42310f9-841e-4f0e-acff-1421486c1ec8 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:42.479177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42310f9-841e-4f0e-acff-1421486c1ec8 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:42.479177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5dffb2-754f-4a4f-9f33-6254db8867d1 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cad6298e4a340588aa9b3fc96a2758c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a294093d8594c93a7af3e7550a145c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:42.479177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dffb2-754f-4a4f-9f33-6254db8867d1 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:42.480914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dffb2-754f-4a4f-9f33-6254db8867d1 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:42.481627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dffb2-754f-4a4f-9f33-6254db8867d1 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:42.482479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5dffb2-754f-4a4f-9f33-6254db8867d1 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:42.482623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880124d-8d51-4196-a341-286be196568b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:42.484422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5dffb2-754f-4a4f-9f33-6254db8867d1 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:42.594437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca5835-f2f8-4811-93ac-6fe340f11273 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:42.595013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca5835-f2f8-4811-93ac-6fe340f11273 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:42.595300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca5835-f2f8-4811-93ac-6fe340f11273 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:42.595578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca5835-f2f8-4811-93ac-6fe340f11273 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/users/5511d4e93b3147d2b33ff8d207894642` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:42.614101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca5835-f2f8-4811-93ac-6fe340f11273 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:get_user(user_id=5511d4e93b3147d2b33ff8d207894642)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:42.616598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca5835-f2f8-4811-93ac-6fe340f11273 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:42.624225 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2292/4653] 10.222.0.76 () {58 vars in 1221 bytes} [Sat Aug 27 04:49:42 2022] GET /identity/v3/users/5511d4e93b3147d2b33ff8d207894642 => generated 416 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:42.624225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca5835-f2f8-4811-93ac-6fe340f11273 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:42.642139 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-1c5dffb2-754f-4a4f-9f33-6254db8867d1 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1394392440. To ensure interoperability, identifiers should be a valid uuid. Aug 27 04:49:42.642139 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 27 04:49:42.642139 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:49:42.748677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca5835-f2f8-4811-93ac-6fe340f11273 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:42.772964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207918e1-88ec-4152-beed-612e1a090c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:42.773954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207918e1-88ec-4152-beed-612e1a090c88 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:42.774541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207918e1-88ec-4152-beed-612e1a090c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:42.775022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207918e1-88ec-4152-beed-612e1a090c88 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:42.775867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207918e1-88ec-4152-beed-612e1a090c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:42.779179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207918e1-88ec-4152-beed-612e1a090c88 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:42.782114 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2362/4654] 10.222.0.76 () {60 vars in 1156 bytes} [Sat Aug 27 04:49:42 2022] POST /identity/v3/endpoints => generated 359 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:42.783043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5dffb2-754f-4a4f-9f33-6254db8867d1 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:42.895725 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2293/4655] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:42 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:42.895725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207918e1-88ec-4152-beed-612e1a090c88 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:42.980743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5dffb2-754f-4a4f-9f33-6254db8867d1 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:42.986454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de4552-882a-4463-8a26-f53ff4226fff tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051174fb53da42e18ac0930c0b45ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e942977be8d249659c6e4d4ceb6f8f24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:42.986677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207918e1-88ec-4152-beed-612e1a090c88 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:42.987404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de4552-882a-4463-8a26-f53ff4226fff tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:42.988019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de4552-882a-4463-8a26-f53ff4226fff tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:42.988019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de4552-882a-4463-8a26-f53ff4226fff tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] PATH_INFO: `/v3/domains/54367ecc84384ff69a69df8145c92472` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:43.002110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de4552-882a-4463-8a26-f53ff4226fff tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=54367ecc84384ff69a69df8145c92472)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:43.005024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de4552-882a-4463-8a26-f53ff4226fff tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:43.026863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c12d64-0c84-476b-aa55-c5bb590a963d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:43.028402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c12d64-0c84-476b-aa55-c5bb590a963d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:43.029667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c12d64-0c84-476b-aa55-c5bb590a963d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:43.030116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c12d64-0c84-476b-aa55-c5bb590a963d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/users/5511d4e93b3147d2b33ff8d207894642` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:43.031770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c12d64-0c84-476b-aa55-c5bb590a963d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5511d4e93b3147d2b33ff8d207894642)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:43.034697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c12d64-0c84-476b-aa55-c5bb590a963d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:43.044558 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-27de4552-882a-4463-8a26-f53ff4226fff tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 27 04:49:43.044558 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:43.044558 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:43.044558 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:43.044558 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:43.044558 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:43.044558 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:43.044558 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:43.044558 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:43.044558 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:43.044558 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:43.044558 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:43.044558 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Aug 27 04:49:43.044558 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Aug 27 04:49:43.045835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:49:43.045835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:49:43.045835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Aug 27 04:49:43.045835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Aug 27 04:49:43.045835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Aug 27 04:49:43.045835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 27 04:49:43.045835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 27 04:49:43.045835 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:43.046450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:43.047541 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2363/4656] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:49:42 2022] DELETE /identity/v3/domains/54367ecc84384ff69a69df8145c92472 => generated 120 bytes in 265 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:49:43.048828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de4552-882a-4463-8a26-f53ff4226fff tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:43.075510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de4552-882a-4463-8a26-f53ff4226fff tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:43.087266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89a312-c50c-40a7-81a9-b55b754bc11d tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cad6298e4a340588aa9b3fc96a2758c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a294093d8594c93a7af3e7550a145c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:43.088019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89a312-c50c-40a7-81a9-b55b754bc11d tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:43.088424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89a312-c50c-40a7-81a9-b55b754bc11d tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:43.088794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89a312-c50c-40a7-81a9-b55b754bc11d tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] PATH_INFO: `/v3/regions/tempest-region-1394392440` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:43.090901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89a312-c50c-40a7-81a9-b55b754bc11d tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1394392440)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:43.092087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89a312-c50c-40a7-81a9-b55b754bc11d tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:43.096374 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2364/4657] 10.222.0.76 () {58 vars in 1206 bytes} [Sat Aug 27 04:49:43 2022] GET /identity/v3/regions/tempest-region-1394392440 => generated 180 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:43.097464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89a312-c50c-40a7-81a9-b55b754bc11d tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:43.145078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89a312-c50c-40a7-81a9-b55b754bc11d tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:43.153466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d560d14-655b-49de-8275-0567a2e64e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:43.154200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d560d14-655b-49de-8275-0567a2e64e88 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:43.154497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d560d14-655b-49de-8275-0567a2e64e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:43.154754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d560d14-655b-49de-8275-0567a2e64e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:43.155460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d560d14-655b-49de-8275-0567a2e64e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:43.163148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d560d14-655b-49de-8275-0567a2e64e88 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:43.197913 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2365/4658] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:43.198880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d560d14-655b-49de-8275-0567a2e64e88 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:43.227889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d560d14-655b-49de-8275-0567a2e64e88 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:43.243545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d35ded-bbf5-412f-99c9-7c84508d65d4 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051174fb53da42e18ac0930c0b45ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e942977be8d249659c6e4d4ceb6f8f24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:43.244233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d35ded-bbf5-412f-99c9-7c84508d65d4 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:43.244586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d35ded-bbf5-412f-99c9-7c84508d65d4 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:43.244864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d35ded-bbf5-412f-99c9-7c84508d65d4 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] PATH_INFO: `/v3/domains/54367ecc84384ff69a69df8145c92472` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:43.246724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d35ded-bbf5-412f-99c9-7c84508d65d4 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=54367ecc84384ff69a69df8145c92472)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:43.248417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d35ded-bbf5-412f-99c9-7c84508d65d4 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:43.271753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:43.281436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a8c12d64-0c84-476b-aa55-c5bb590a963d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5511d4e93b3147d2b33ff8d207894642'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:43.305958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-30d35ded-bbf5-412f-99c9-7c84508d65d4 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '54367ecc84384ff69a69df8145c92472'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:43.307133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-30d35ded-bbf5-412f-99c9-7c84508d65d4 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '54367ecc84384ff69a69df8145c92472'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:43.354390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a8c12d64-0c84-476b-aa55-c5bb590a963d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5511d4e93b3147d2b33ff8d207894642'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:43.355448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a8c12d64-0c84-476b-aa55-c5bb590a963d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5511d4e93b3147d2b33ff8d207894642'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:43.374995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a8c12d64-0c84-476b-aa55-c5bb590a963d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5511d4e93b3147d2b33ff8d207894642'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:43.408845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a8c12d64-0c84-476b-aa55-c5bb590a963d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5511d4e93b3147d2b33ff8d207894642'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:43.424775 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2294/4659] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:42 2022] DELETE /identity/v3/users/5511d4e93b3147d2b33ff8d207894642 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:43.425471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c12d64-0c84-476b-aa55-c5bb590a963d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:43.430795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a8c12d64-0c84-476b-aa55-c5bb590a963d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:43.481853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-30d35ded-bbf5-412f-99c9-7c84508d65d4 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '54367ecc84384ff69a69df8145c92472'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:43.482510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-30d35ded-bbf5-412f-99c9-7c84508d65d4 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '54367ecc84384ff69a69df8145c92472'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:43.485090 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2366/4660] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:49:43 2022] PATCH /identity/v3/domains/54367ecc84384ff69a69df8145c92472 => generated 277 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:43.493459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d35ded-bbf5-412f-99c9-7c84508d65d4 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:43.495515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-30d35ded-bbf5-412f-99c9-7c84508d65d4 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:43.588968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c12d64-0c84-476b-aa55-c5bb590a963d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:43.599514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f9a52-ed35-470b-a01f-42d8edfcde0f tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cad6298e4a340588aa9b3fc96a2758c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a294093d8594c93a7af3e7550a145c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:43.600154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f9a52-ed35-470b-a01f-42d8edfcde0f tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:43.600470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f9a52-ed35-470b-a01f-42d8edfcde0f tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:43.603908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f9a52-ed35-470b-a01f-42d8edfcde0f tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] PATH_INFO: `/v3/endpoints/539adebfc9164897ab4e9ff940ce6495` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:43.622166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f9a52-ed35-470b-a01f-42d8edfcde0f tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=539adebfc9164897ab4e9ff940ce6495)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:43.623407 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-c03f9a52-ed35-470b-a01f-42d8edfcde0f tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:43.623407 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:49:43.623407 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:49:43.624519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f9a52-ed35-470b-a01f-42d8edfcde0f tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-c03f9a52-ed35-470b-a01f-42d8edfcde0f tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: Failed validating 'type' in schema['properties']['enabled']: Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: {'enum': [True, False, None], 'type': 'boolean'} Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: On instance['enabled']: Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: Failed validating 'type' in schema['properties']['enabled']: Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: {'enum': [True, False, None], 'type': 'boolean'} Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: On instance['enabled']: Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: 'False' Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise error Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application On instance['enabled']: Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application 'False' Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:43.644751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:49:43.646292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:43.646292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:43.646292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:43.646292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:43.646292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:43.646292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:43.646292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:43.646292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:43.646292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:43.646292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:43.646292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:43.646292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:43.646292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 27 04:49:43.646292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 27 04:49:43.646292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 27 04:49:43.646292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 27 04:49:43.646292 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 27 04:49:43.647753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 27 04:49:43.647753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 27 04:49:43.647753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:43.647753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 27 04:49:43.647753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 27 04:49:43.647753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:43.647753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application On instance['enabled']: Aug 27 04:49:43.647753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application 'False' Aug 27 04:49:43.647753 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:43.650057 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2295/4661] 10.222.0.76 () {60 vars in 1255 bytes} [Sat Aug 27 04:49:43 2022] PATCH /identity/v3/endpoints/539adebfc9164897ab4e9ff940ce6495 => generated 283 bytes in 225 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:49:43.651355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f9a52-ed35-470b-a01f-42d8edfcde0f tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:43.655822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c03f9a52-ed35-470b-a01f-42d8edfcde0f tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:43.664237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d35ded-bbf5-412f-99c9-7c84508d65d4 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:43.800819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4a359-7df7-41a3-97b1-95360b7c7e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:43.801546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a359-7df7-41a3-97b1-95360b7c7e3c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:43.801829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a359-7df7-41a3-97b1-95360b7c7e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:43.802103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a359-7df7-41a3-97b1-95360b7c7e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:43.802752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4a359-7df7-41a3-97b1-95360b7c7e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:43.805071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4a359-7df7-41a3-97b1-95360b7c7e3c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:43.816361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f9a52-ed35-470b-a01f-42d8edfcde0f tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:43.821031 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2367/4662] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:43.821031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4a359-7df7-41a3-97b1-95360b7c7e3c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:43.822339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dad4a359-7df7-41a3-97b1-95360b7c7e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:43.833467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:43.834784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:43.834784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:43.834784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/3ef95347fa014069ac55b0bdfc490bfb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:43.836922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3ef95347fa014069ac55b0bdfc490bfb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:43.841300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:44.011019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef95347fa014069ac55b0bdfc490bfb', 'request_id': 'req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:44.012670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4a359-7df7-41a3-97b1-95360b7c7e3c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:44.018599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef95347fa014069ac55b0bdfc490bfb', 'request_id': 'req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:44.026469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef95347fa014069ac55b0bdfc490bfb', 'request_id': 'req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:44.124045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051174fb53da42e18ac0930c0b45ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e942977be8d249659c6e4d4ceb6f8f24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:44.124744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:44.125029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:44.125301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] PATH_INFO: `/v3/domains/54367ecc84384ff69a69df8145c92472` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:44.148988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=54367ecc84384ff69a69df8145c92472)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:44.150439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:44.161405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] The token cache is being invalidate because project 3ef95347fa014069ac55b0bdfc490bfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:44.162177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:44.163338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:44.167512 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2296/4663] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:43 2022] DELETE /identity/v3/projects/3ef95347fa014069ac55b0bdfc490bfb => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:44.172621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:44.178307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:44.211214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '54367ecc84384ff69a69df8145c92472'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:44.219229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '54367ecc84384ff69a69df8145c92472'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:44.389374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04fb26-d0b2-4e78-a2aa-9b85d61ca983 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:44.424429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54367ecc84384ff69a69df8145c92472', 'request_id': 'req-c388c171-2a02-4450-bdeb-8285489bdce1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:44.450572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54367ecc84384ff69a69df8145c92472', 'request_id': 'req-c388c171-2a02-4450-bdeb-8285489bdce1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:44.544239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54367ecc84384ff69a69df8145c92472', 'request_id': 'req-c388c171-2a02-4450-bdeb-8285489bdce1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:44.548121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2be0f-c2bd-4437-9265-78cc54c0bf67 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cad6298e4a340588aa9b3fc96a2758c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a294093d8594c93a7af3e7550a145c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:44.550116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2be0f-c2bd-4437-9265-78cc54c0bf67 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:44.550593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2be0f-c2bd-4437-9265-78cc54c0bf67 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:44.551015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2be0f-c2bd-4437-9265-78cc54c0bf67 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] PATH_INFO: `/v3/endpoints/539adebfc9164897ab4e9ff940ce6495` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:44.552385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2be0f-c2bd-4437-9265-78cc54c0bf67 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=539adebfc9164897ab4e9ff940ce6495)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:44.553535 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-05c2be0f-c2bd-4437-9265-78cc54c0bf67 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:44.553535 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:49:44.553535 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:49:44.554679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2be0f-c2bd-4437-9265-78cc54c0bf67 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:44.576611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] The token cache is being invalidate because project 54367ecc84384ff69a69df8145c92472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:44.576611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:44.576611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:44.596395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '54367ecc84384ff69a69df8145c92472', 'request_id': 'req-c388c171-2a02-4450-bdeb-8285489bdce1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:44.598021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '54367ecc84384ff69a69df8145c92472', 'request_id': 'req-c388c171-2a02-4450-bdeb-8285489bdce1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:44.598997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '54367ecc84384ff69a69df8145c92472', 'request_id': 'req-c388c171-2a02-4450-bdeb-8285489bdce1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:44.618272 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2368/4664] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:49:43 2022] DELETE /identity/v3/domains/54367ecc84384ff69a69df8145c92472 => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:44.619251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:44.626533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:44.689133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-05c2be0f-c2bd-4437-9265-78cc54c0bf67 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '539adebfc9164897ab4e9ff940ce6495', 'request_id': 'req-05c2be0f-c2bd-4437-9265-78cc54c0bf67'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:44.711591 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2297/4665] 10.222.0.76 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:44 2022] DELETE /identity/v3/endpoints/539adebfc9164897ab4e9ff940ce6495 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:44.713666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2be0f-c2bd-4437-9265-78cc54c0bf67 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:44.719122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-05c2be0f-c2bd-4437-9265-78cc54c0bf67 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:44.768715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388c171-2a02-4450-bdeb-8285489bdce1 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:44.787664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef713262-c6bb-4741-9288-61c2cb8025e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:44.788549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef713262-c6bb-4741-9288-61c2cb8025e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:44.789072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef713262-c6bb-4741-9288-61c2cb8025e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:44.789415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef713262-c6bb-4741-9288-61c2cb8025e0 admin admin] PATH_INFO: `/v3/projects/40517bdc0866455da95a417aeab4ea62/users/6b8fd344f2dd4b17b44d5bd0db4e98ea/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:44.812071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:44.822381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef713262-c6bb-4741-9288-61c2cb8025e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40517bdc0866455da95a417aeab4ea62, user_id=6b8fd344f2dd4b17b44d5bd0db4e98ea, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:44.828025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef713262-c6bb-4741-9288-61c2cb8025e0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:44.863793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2be0f-c2bd-4437-9265-78cc54c0bf67 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:44.872877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86bec8-3f51-495b-892c-416525cc3682 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:44.873640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86bec8-3f51-495b-892c-416525cc3682 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:44.873993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86bec8-3f51-495b-892c-416525cc3682 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:44.874333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86bec8-3f51-495b-892c-416525cc3682 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:44.876229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86bec8-3f51-495b-892c-416525cc3682 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:44.877390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86bec8-3f51-495b-892c-416525cc3682 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:45.006216 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2369/4666] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:44 2022] PUT /identity/v3/projects/40517bdc0866455da95a417aeab4ea62/users/6b8fd344f2dd4b17b44d5bd0db4e98ea/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:45.006459 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2298/4667] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:44 2022] POST /identity/v3/projects => generated 348 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:45.006459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86bec8-3f51-495b-892c-416525cc3682 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:45.006653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef713262-c6bb-4741-9288-61c2cb8025e0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:45.006745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2d86bec8-3f51-495b-892c-416525cc3682 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:45.008903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ef713262-c6bb-4741-9288-61c2cb8025e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:45.119283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef713262-c6bb-4741-9288-61c2cb8025e0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:45.146837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86bec8-3f51-495b-892c-416525cc3682 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:45.160815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e41e0b-dfec-47cb-b109-83e45d7ec352 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051174fb53da42e18ac0930c0b45ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e942977be8d249659c6e4d4ceb6f8f24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:45.161478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e41e0b-dfec-47cb-b109-83e45d7ec352 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:45.161769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e41e0b-dfec-47cb-b109-83e45d7ec352 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:45.162067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e41e0b-dfec-47cb-b109-83e45d7ec352 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] PATH_INFO: `/v3/domains/65ea4d3f7ea6403fa0b19f46b5910618` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:45.183421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e41e0b-dfec-47cb-b109-83e45d7ec352 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:49:45.190969 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-41e41e0b-dfec-47cb-b109-83e45d7ec352 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Could not find domain: 65ea4d3f7ea6403fa0b19f46b5910618.: keystone.exception.DomainNotFound: Could not find domain: 65ea4d3f7ea6403fa0b19f46b5910618. Aug 27 04:49:45.190969 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:45.190969 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:49:45.190969 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:49:45.190969 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:49:45.190969 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:49:45.190969 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:49:45.190969 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:49:45.190969 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 65ea4d3f7ea6403fa0b19f46b5910618. Aug 27 04:49:45.190969 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:45.190969 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:49:45.190969 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:45.190969 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:45.190969 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:45.190969 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:45.192030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:45.192030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:45.192030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:45.192030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:45.192030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:45.192030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:45.192030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:45.192030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:45.192030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Aug 27 04:49:45.192030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Aug 27 04:49:45.192030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:49:45.192030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:49:45.192030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:49:45.192030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:49:45.192030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:49:45.192030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:49:45.193128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:49:45.193128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:49:45.193128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:49:45.193128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:49:45.193128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:49:45.193128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:49:45.193128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:49:45.193128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:49:45.193128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:49:45.193128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:49:45.193128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:49:45.193128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:49:45.193128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:49:45.193128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:49:45.193128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:49:45.193128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:49:45.193128 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 65ea4d3f7ea6403fa0b19f46b5910618. Aug 27 04:49:45.194325 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:45.194325 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2299/4668] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:49:44 2022] DELETE /identity/v3/domains/65ea4d3f7ea6403fa0b19f46b5910618 => generated 112 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:49:45.210207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e41e0b-dfec-47cb-b109-83e45d7ec352 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:45.213571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-41e41e0b-dfec-47cb-b109-83e45d7ec352 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:45.218404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57740d6e-97f0-4838-9c9e-403783383412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:45.221502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57740d6e-97f0-4838-9c9e-403783383412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:45.223492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57740d6e-97f0-4838-9c9e-403783383412 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:45.223979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57740d6e-97f0-4838-9c9e-403783383412 admin admin] PATH_INFO: `/v3/users/e96a441cd02645d88fdd290a1392effa` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:45.225556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57740d6e-97f0-4838-9c9e-403783383412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96a441cd02645d88fdd290a1392effa)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:45.230040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57740d6e-97f0-4838-9c9e-403783383412 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:45.337114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e41e0b-dfec-47cb-b109-83e45d7ec352 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:45.342894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a6eaf-7867-4aff-91bb-c89c5648709a tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cad6298e4a340588aa9b3fc96a2758c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a294093d8594c93a7af3e7550a145c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:45.343649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a6eaf-7867-4aff-91bb-c89c5648709a tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:45.344327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a6eaf-7867-4aff-91bb-c89c5648709a tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:45.344552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a6eaf-7867-4aff-91bb-c89c5648709a tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] PATH_INFO: `/v3/regions/tempest-region-1394392440` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:45.345215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a6eaf-7867-4aff-91bb-c89c5648709a tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1394392440)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:45.350153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a6eaf-7867-4aff-91bb-c89c5648709a tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:45.462923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-57740d6e-97f0-4838-9c9e-403783383412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96a441cd02645d88fdd290a1392effa'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:45.464568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-57740d6e-97f0-4838-9c9e-403783383412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96a441cd02645d88fdd290a1392effa'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:45.477512 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-5c1a6eaf-7867-4aff-91bb-c89c5648709a tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1394392440. To ensure interoperability, identifiers should be a valid uuid. Aug 27 04:49:45.477512 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 27 04:49:45.477512 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:49:45.496867 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2300/4669] 10.222.0.76 () {58 vars in 1209 bytes} [Sat Aug 27 04:49:45 2022] DELETE /identity/v3/regions/tempest-region-1394392440 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:45.501425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a6eaf-7867-4aff-91bb-c89c5648709a tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:45.586805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-57740d6e-97f0-4838-9c9e-403783383412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96a441cd02645d88fdd290a1392effa'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:45.587775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-57740d6e-97f0-4838-9c9e-403783383412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96a441cd02645d88fdd290a1392effa'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:45.610345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-57740d6e-97f0-4838-9c9e-403783383412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96a441cd02645d88fdd290a1392effa'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:45.622642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a6eaf-7867-4aff-91bb-c89c5648709a tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:45.631583 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2370/4670] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:44 2022] DELETE /identity/v3/users/e96a441cd02645d88fdd290a1392effa => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:45.631583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de312f-7cb7-4f95-8f24-9ef8246e3f04 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:45.631583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de312f-7cb7-4f95-8f24-9ef8246e3f04 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:45.631583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de312f-7cb7-4f95-8f24-9ef8246e3f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:45.658137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:45.690612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b2de312f-7cb7-4f95-8f24-9ef8246e3f04 None None] MFA Rules not processed for user `6b8fd344f2dd4b17b44d5bd0db4e98ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:45.691746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b2de312f-7cb7-4f95-8f24-9ef8246e3f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:45.778695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b282d8-5d70-4b99-88df-ca56d0224a01 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:45.780030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b282d8-5d70-4b99-88df-ca56d0224a01 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:45.780533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b282d8-5d70-4b99-88df-ca56d0224a01 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:45.780970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b282d8-5d70-4b99-88df-ca56d0224a01 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:45.791755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b282d8-5d70-4b99-88df-ca56d0224a01 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:45.791755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b282d8-5d70-4b99-88df-ca56d0224a01 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:45.791755 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-f8b282d8-5d70-4b99-88df-ca56d0224a01 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:45.791755 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:49:45.791755 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:49:45.791755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b282d8-5d70-4b99-88df-ca56d0224a01 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:45.821073 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2301/4671] 10.222.0.76 () {58 vars in 1160 bytes} [Sat Aug 27 04:49:45 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:45.822266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b282d8-5d70-4b99-88df-ca56d0224a01 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:45.823973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f8b282d8-5d70-4b99-88df-ca56d0224a01 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:45.862261 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2371/4672] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:45 2022] POST /identity/v3/auth/tokens => generated 3396 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:45.868201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de312f-7cb7-4f95-8f24-9ef8246e3f04 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:45.880994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b2de312f-7cb7-4f95-8f24-9ef8246e3f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:45.937604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b282d8-5d70-4b99-88df-ca56d0224a01 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:45.946903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e02251-db53-4415-bf25-67b7d0b80f4f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051174fb53da42e18ac0930c0b45ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e942977be8d249659c6e4d4ceb6f8f24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:45.947797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e02251-db53-4415-bf25-67b7d0b80f4f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:45.958437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e02251-db53-4415-bf25-67b7d0b80f4f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:45.958437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e02251-db53-4415-bf25-67b7d0b80f4f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:45.958437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e02251-db53-4415-bf25-67b7d0b80f4f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:45.958437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e02251-db53-4415-bf25-67b7d0b80f4f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:46.037444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de312f-7cb7-4f95-8f24-9ef8246e3f04 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:46.051063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a8487-aa1f-4ff3-b997-97cc15494dfc tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cad6298e4a340588aa9b3fc96a2758c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a294093d8594c93a7af3e7550a145c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:46.051063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8487-aa1f-4ff3-b997-97cc15494dfc tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:46.051063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8487-aa1f-4ff3-b997-97cc15494dfc tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:46.051623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8487-aa1f-4ff3-b997-97cc15494dfc tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:46.051623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a8487-aa1f-4ff3-b997-97cc15494dfc tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:46.051623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a8487-aa1f-4ff3-b997-97cc15494dfc tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:46.141156 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2302/4673] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:49:45 2022] POST /identity/v3/domains => generated 253 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:46.142178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e02251-db53-4415-bf25-67b7d0b80f4f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:46.147286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b0e02251-db53-4415-bf25-67b7d0b80f4f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:46.164213 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-eb8a8487-aa1f-4ff3-b997-97cc15494dfc tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1203550804. To ensure interoperability, identifiers should be a valid uuid. Aug 27 04:49:46.164213 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 27 04:49:46.164213 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:49:46.243791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e02251-db53-4415-bf25-67b7d0b80f4f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:46.260939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb581ec5-b74b-4cc3-9d63-bdab175e7ddc tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:46.267834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb581ec5-b74b-4cc3-9d63-bdab175e7ddc tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:46.267834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb581ec5-b74b-4cc3-9d63-bdab175e7ddc tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:46.267834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb581ec5-b74b-4cc3-9d63-bdab175e7ddc tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:46.267834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb581ec5-b74b-4cc3-9d63-bdab175e7ddc tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:46.267834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb581ec5-b74b-4cc3-9d63-bdab175e7ddc tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:46.279675 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2303/4674] 10.222.0.76 () {58 vars in 1128 bytes} [Sat Aug 27 04:49:46 2022] GET /identity/v3/domains => generated 1071 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:46.280460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb581ec5-b74b-4cc3-9d63-bdab175e7ddc tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:46.282899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cb581ec5-b74b-4cc3-9d63-bdab175e7ddc tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:46.352082 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2372/4675] 10.222.0.76 () {60 vars in 1156 bytes} [Sat Aug 27 04:49:45 2022] POST /identity/v3/endpoints => generated 360 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:46.352887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a8487-aa1f-4ff3-b997-97cc15494dfc tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:46.374124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb581ec5-b74b-4cc3-9d63-bdab175e7ddc tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:46.391611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a8487-aa1f-4ff3-b997-97cc15494dfc tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:46.393480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be919a-8e00-489c-9edf-8f5abb07d328 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:46.394089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be919a-8e00-489c-9edf-8f5abb07d328 service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:46.394371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be919a-8e00-489c-9edf-8f5abb07d328 service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:46.394647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be919a-8e00-489c-9edf-8f5abb07d328 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:46.403954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e9be919a-8e00-489c-9edf-8f5abb07d328 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:46.495906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a80ccf-4576-4878-8590-7fe396a46a43 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051174fb53da42e18ac0930c0b45ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e942977be8d249659c6e4d4ceb6f8f24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:46.497572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a80ccf-4576-4878-8590-7fe396a46a43 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:46.497897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a80ccf-4576-4878-8590-7fe396a46a43 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:46.498277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a80ccf-4576-4878-8590-7fe396a46a43 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:46.498610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be919a-8e00-489c-9edf-8f5abb07d328 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:46.499268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a80ccf-4576-4878-8590-7fe396a46a43 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:46.500077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be919a-8e00-489c-9edf-8f5abb07d328 service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:46.501119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a80ccf-4576-4878-8590-7fe396a46a43 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:46.538974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.sql.core [None req-f8a80ccf-4576-4878-8590-7fe396a46a43 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1344840346' for key 'project.ixu_project_name_domain_id'") Aug 27 04:49:46.538974 n-d-852088-5 devstack@keystone.service[82083]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 27 04:49:46.538974 n-d-852088-5 devstack@keystone.service[82083]: [parameters: {'id': '899e89ae242e41fa9c3f2df6305d0c6b', 'name': 'tempest-domain-dup-1344840346', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 27 04:49:46.538974 n-d-852088-5 devstack@keystone.service[82083]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82083) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 04:49:46.539624 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2304/4676] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:46 2022] GET /identity/v3/auth/tokens => generated 3578 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:46.540805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be919a-8e00-489c-9edf-8f5abb07d328 service glance] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:46.542540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e9be919a-8e00-489c-9edf-8f5abb07d328 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:46.571347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-f8a80ccf-4576-4878-8590-7fe396a46a43 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1344840346.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1344840346. Aug 27 04:49:46.571347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:46.571347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:49:46.571347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 04:49:46.571347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:49:46.571347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 04:49:46.571347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:49:46.571347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 04:49:46.571347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:49:46.571347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application conn.query(q) Aug 27 04:49:46.571347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:49:46.571347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:49:46.571347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application result.read() Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1344840346' for key 'project.ixu_project_name_domain_id'") Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 27 04:49:46.572379 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 27 04:49:46.573480 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 04:49:46.573480 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application next(self.gen) Aug 27 04:49:46.573480 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 27 04:49:46.573480 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application yield resource Aug 27 04:49:46.573480 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 04:49:46.573480 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application next(self.gen) Aug 27 04:49:46.573480 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 27 04:49:46.573480 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.session.rollback() Aug 27 04:49:46.573480 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:49:46.573480 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.force_reraise() Aug 27 04:49:46.573480 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:49:46.573480 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise self.value Aug 27 04:49:46.573480 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 27 04:49:46.573480 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 27 04:49:46.573480 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 27 04:49:46.573480 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application session.commit() Aug 27 04:49:46.573480 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 27 04:49:46.575250 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 27 04:49:46.575250 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 27 04:49:46.575250 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._prepare_impl() Aug 27 04:49:46.575250 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 27 04:49:46.575250 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.session.flush() Aug 27 04:49:46.575250 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 04:49:46.575250 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._flush(objects) Aug 27 04:49:46.575250 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 04:49:46.575250 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 27 04:49:46.575250 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 04:49:46.575250 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application compat.raise_( Aug 27 04:49:46.575250 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:49:46.575250 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception Aug 27 04:49:46.575250 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 04:49:46.575250 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application flush_context.execute() Aug 27 04:49:46.575250 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 04:49:46.575250 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rec.execute(self) Aug 27 04:49:46.576337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 04:49:46.576337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 27 04:49:46.576337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 04:49:46.576337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 27 04:49:46.576337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 27 04:49:46.576337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 27 04:49:46.576337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 04:49:46.576337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 04:49:46.576337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 04:49:46.576337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 27 04:49:46.576337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 04:49:46.576337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 27 04:49:46.576337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 04:49:46.576337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 27 04:49:46.576337 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 04:49:46.578770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 04:49:46.578770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:49:46.578770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception Aug 27 04:49:46.578770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:49:46.578770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 04:49:46.578770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:49:46.578770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 04:49:46.578770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:49:46.578770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 04:49:46.578770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:49:46.578770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application conn.query(q) Aug 27 04:49:46.578770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:49:46.578770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:49:46.578770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:49:46.578770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application result.read() Aug 27 04:49:46.578770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:49:46.578770 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 04:49:46.581786 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:49:46.581786 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 04:49:46.581786 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:49:46.581786 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 04:49:46.581786 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:49:46.581786 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 04:49:46.581786 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1344840346' for key 'project.ixu_project_name_domain_id'") Aug 27 04:49:46.581786 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 27 04:49:46.581786 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [parameters: {'id': '899e89ae242e41fa9c3f2df6305d0c6b', 'name': 'tempest-domain-dup-1344840346', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 27 04:49:46.581786 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 04:49:46.581786 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:46.581786 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:49:46.581786 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:46.581786 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:46.584356 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 27 04:49:46.584356 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 27 04:49:46.584356 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 27 04:49:46.584356 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 27 04:49:46.584356 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1344840346. Aug 27 04:49:46.584356 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:46.584356 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:49:46.584356 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:46.584356 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:46.584356 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:46.584356 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:46.584356 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:46.584356 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:46.584356 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:46.584356 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:46.584356 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:46.584356 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:46.587262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:46.587262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:46.587262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Aug 27 04:49:46.587262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Aug 27 04:49:46.587262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:49:46.587262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:49:46.587262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Aug 27 04:49:46.587262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Aug 27 04:49:46.587262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:49:46.587262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:49:46.587262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 27 04:49:46.587262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 27 04:49:46.587262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1344840346. Aug 27 04:49:46.587262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:46.587262 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2373/4677] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:49:46 2022] POST /identity/v3/domains => generated 212 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:49:46.589932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a80ccf-4576-4878-8590-7fe396a46a43 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:46.625445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a80ccf-4576-4878-8590-7fe396a46a43 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:46.633795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018b752-d218-4d06-ab30-a4f5f41e97b3 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:46.634601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018b752-d218-4d06-ab30-a4f5f41e97b3 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:46.635181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018b752-d218-4d06-ab30-a4f5f41e97b3 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:46.635532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018b752-d218-4d06-ab30-a4f5f41e97b3 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/e046614ff1e44345ad9aa5fc8c3e0eb0` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:46.638213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018b752-d218-4d06-ab30-a4f5f41e97b3 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:update_project(project_id=e046614ff1e44345ad9aa5fc8c3e0eb0)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:46.639702 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-4018b752-d218-4d06-ab30-a4f5f41e97b3 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:46.639702 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:49:46.639702 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:49:46.641009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018b752-d218-4d06-ab30-a4f5f41e97b3 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:46.668894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4018b752-d218-4d06-ab30-a4f5f41e97b3 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e046614ff1e44345ad9aa5fc8c3e0eb0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:46.670480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4018b752-d218-4d06-ab30-a4f5f41e97b3 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e046614ff1e44345ad9aa5fc8c3e0eb0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:46.672477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:46.701024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be919a-8e00-489c-9edf-8f5abb07d328 service glance] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:46.777529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a31e74-ce88-40c8-84af-2406fa482d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:46.777529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a31e74-ce88-40c8-84af-2406fa482d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:46.777529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a31e74-ce88-40c8-84af-2406fa482d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:46.777529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a31e74-ce88-40c8-84af-2406fa482d63 admin admin] PATH_INFO: `/v3/projects/b6d126858dec4bb499603c7ca379370b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:46.778042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a31e74-ce88-40c8-84af-2406fa482d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6d126858dec4bb499603c7ca379370b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:46.780975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a31e74-ce88-40c8-84af-2406fa482d63 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:46.813273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4018b752-d218-4d06-ab30-a4f5f41e97b3 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e046614ff1e44345ad9aa5fc8c3e0eb0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:46.813968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4018b752-d218-4d06-ab30-a4f5f41e97b3 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e046614ff1e44345ad9aa5fc8c3e0eb0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:46.823165 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2374/4678] 10.222.0.76 () {60 vars in 1252 bytes} [Sat Aug 27 04:49:46 2022] PATCH /identity/v3/projects/e046614ff1e44345ad9aa5fc8c3e0eb0 => generated 362 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:46.823165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018b752-d218-4d06-ab30-a4f5f41e97b3 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:46.823165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4018b752-d218-4d06-ab30-a4f5f41e97b3 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:47.013526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018b752-d218-4d06-ab30-a4f5f41e97b3 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:47.017808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-14a31e74-ce88-40c8-84af-2406fa482d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6d126858dec4bb499603c7ca379370b', 'request_id': 'req-14a31e74-ce88-40c8-84af-2406fa482d63'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.024916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-14a31e74-ce88-40c8-84af-2406fa482d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6d126858dec4bb499603c7ca379370b', 'request_id': 'req-14a31e74-ce88-40c8-84af-2406fa482d63'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.039291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-14a31e74-ce88-40c8-84af-2406fa482d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6d126858dec4bb499603c7ca379370b', 'request_id': 'req-14a31e74-ce88-40c8-84af-2406fa482d63'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.125443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5318dbe-663c-4b65-b61e-5d27e4ff883d tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cad6298e4a340588aa9b3fc96a2758c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a294093d8594c93a7af3e7550a145c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:47.126490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5318dbe-663c-4b65-b61e-5d27e4ff883d tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:47.126773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5318dbe-663c-4b65-b61e-5d27e4ff883d tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:47.128320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5318dbe-663c-4b65-b61e-5d27e4ff883d tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] PATH_INFO: `/v3/regions/tempest-region-1203550804` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:47.128320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5318dbe-663c-4b65-b61e-5d27e4ff883d tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1203550804)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:47.129208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5318dbe-663c-4b65-b61e-5d27e4ff883d tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:47.132568 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2375/4679] 10.222.0.76 () {58 vars in 1206 bytes} [Sat Aug 27 04:49:46 2022] GET /identity/v3/regions/tempest-region-1203550804 => generated 180 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:47.133479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5318dbe-663c-4b65-b61e-5d27e4ff883d tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:47.137227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d5318dbe-663c-4b65-b61e-5d27e4ff883d tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:47.137826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-14a31e74-ce88-40c8-84af-2406fa482d63 admin admin] The token cache is being invalidate because project b6d126858dec4bb499603c7ca379370b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:47.138221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-14a31e74-ce88-40c8-84af-2406fa482d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.141173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-14a31e74-ce88-40c8-84af-2406fa482d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.147287 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2305/4680] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:46 2022] DELETE /identity/v3/projects/b6d126858dec4bb499603c7ca379370b => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:47.148255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a31e74-ce88-40c8-84af-2406fa482d63 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:47.150940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-14a31e74-ce88-40c8-84af-2406fa482d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:47.306537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a31e74-ce88-40c8-84af-2406fa482d63 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:47.314809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5318dbe-663c-4b65-b61e-5d27e4ff883d tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:47.315063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:47.315989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:47.317334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:47.318224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/e046614ff1e44345ad9aa5fc8c3e0eb0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:47.321392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec58fde-0df8-418e-9071-ca1261fdf524 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051174fb53da42e18ac0930c0b45ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e942977be8d249659c6e4d4ceb6f8f24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:47.322410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec58fde-0df8-418e-9071-ca1261fdf524 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:47.323931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec58fde-0df8-418e-9071-ca1261fdf524 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:47.324571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec58fde-0df8-418e-9071-ca1261fdf524 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] PATH_INFO: `/v3/domains/7cd8789a154c4c1886a54ba6f885bbe4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:47.377682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec58fde-0df8-418e-9071-ca1261fdf524 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7cd8789a154c4c1886a54ba6f885bbe4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:47.383203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec58fde-0df8-418e-9071-ca1261fdf524 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:47.383405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e046614ff1e44345ad9aa5fc8c3e0eb0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:47.385715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:47.423645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e046614ff1e44345ad9aa5fc8c3e0eb0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.434487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e046614ff1e44345ad9aa5fc8c3e0eb0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.440829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aec58fde-0df8-418e-9071-ca1261fdf524 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7cd8789a154c4c1886a54ba6f885bbe4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.442260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aec58fde-0df8-418e-9071-ca1261fdf524 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7cd8789a154c4c1886a54ba6f885bbe4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.550585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aec58fde-0df8-418e-9071-ca1261fdf524 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7cd8789a154c4c1886a54ba6f885bbe4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.551177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aec58fde-0df8-418e-9071-ca1261fdf524 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7cd8789a154c4c1886a54ba6f885bbe4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.560952 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2376/4681] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:49:47 2022] PATCH /identity/v3/domains/7cd8789a154c4c1886a54ba6f885bbe4 => generated 254 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:47.560952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec58fde-0df8-418e-9071-ca1261fdf524 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:47.564191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-aec58fde-0df8-418e-9071-ca1261fdf524 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:47.602517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e046614ff1e44345ad9aa5fc8c3e0eb0', 'request_id': 'req-3b0fff40-1cfe-4787-adf1-00821ff0be72'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.631859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e046614ff1e44345ad9aa5fc8c3e0eb0', 'request_id': 'req-3b0fff40-1cfe-4787-adf1-00821ff0be72'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.648467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e046614ff1e44345ad9aa5fc8c3e0eb0', 'request_id': 'req-3b0fff40-1cfe-4787-adf1-00821ff0be72'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.763183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec58fde-0df8-418e-9071-ca1261fdf524 tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:47.785418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] The token cache is being invalidate because project e046614ff1e44345ad9aa5fc8c3e0eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:47.787036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.789106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.820595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e046614ff1e44345ad9aa5fc8c3e0eb0', 'request_id': 'req-3b0fff40-1cfe-4787-adf1-00821ff0be72'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.830265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e046614ff1e44345ad9aa5fc8c3e0eb0', 'request_id': 'req-3b0fff40-1cfe-4787-adf1-00821ff0be72'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.831526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e046614ff1e44345ad9aa5fc8c3e0eb0', 'request_id': 'req-3b0fff40-1cfe-4787-adf1-00821ff0be72'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:47.855764 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2306/4682] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:47 2022] DELETE /identity/v3/projects/e046614ff1e44345ad9aa5fc8c3e0eb0 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:47.859438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:47.863845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:47.867734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58e77b-003c-47a1-a531-1925da355983 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:47.868487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58e77b-003c-47a1-a531-1925da355983 service glance] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:47.868873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58e77b-003c-47a1-a531-1925da355983 service glance] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:47.869214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58e77b-003c-47a1-a531-1925da355983 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:47.872661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3a58e77b-003c-47a1-a531-1925da355983 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:47.976733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fff40-1cfe-4787-adf1-00821ff0be72 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:47.982236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518eac20-9afc-4d51-ad43-f0b2024cd3e8 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cad6298e4a340588aa9b3fc96a2758c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a294093d8594c93a7af3e7550a145c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:47.982887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518eac20-9afc-4d51-ad43-f0b2024cd3e8 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:47.983310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518eac20-9afc-4d51-ad43-f0b2024cd3e8 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:47.983595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518eac20-9afc-4d51-ad43-f0b2024cd3e8 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] PATH_INFO: `/v3/endpoints/43ecbf80eb804e90b8a6b0cbf3512cfa` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:47.990547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518eac20-9afc-4d51-ad43-f0b2024cd3e8 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=43ecbf80eb804e90b8a6b0cbf3512cfa)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:47.992359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518eac20-9afc-4d51-ad43-f0b2024cd3e8 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-518eac20-9afc-4d51-ad43-f0b2024cd3e8 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: Failed validating 'type' in schema['properties']['enabled']: Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: {'enum': [True, False, None], 'type': 'boolean'} Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: On instance['enabled']: Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: Failed validating 'type' in schema['properties']['enabled']: Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: {'enum': [True, False, None], 'type': 'boolean'} Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: On instance['enabled']: Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: 'True' Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise error Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application On instance['enabled']: Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application 'True' Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:48.000798 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:49:48.003686 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:48.003686 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:48.003686 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:48.003686 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:48.003686 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:48.003686 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:48.003686 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:48.003686 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:48.003686 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:48.003686 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:48.003686 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:48.003686 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:48.003686 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 27 04:49:48.003686 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 27 04:49:48.003686 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 27 04:49:48.003686 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 27 04:49:48.003686 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 27 04:49:48.004907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 27 04:49:48.004907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 27 04:49:48.004907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:48.004907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 27 04:49:48.004907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 27 04:49:48.004907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:48.004907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application On instance['enabled']: Aug 27 04:49:48.004907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application 'True' Aug 27 04:49:48.004907 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:48.004907 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2307/4683] 10.222.0.76 () {60 vars in 1255 bytes} [Sat Aug 27 04:49:47 2022] PATCH /identity/v3/endpoints/43ecbf80eb804e90b8a6b0cbf3512cfa => generated 281 bytes in 148 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:49:48.006585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af871390-da18-4a11-b10b-ccda8cde5434 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:48.006585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af871390-da18-4a11-b10b-ccda8cde5434 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:48.006585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af871390-da18-4a11-b10b-ccda8cde5434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:48.013054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58e77b-003c-47a1-a531-1925da355983 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:48.014657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58e77b-003c-47a1-a531-1925da355983 service glance] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:48.050750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-af871390-da18-4a11-b10b-ccda8cde5434 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:48.052480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-af871390-da18-4a11-b10b-ccda8cde5434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:48.061357 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2377/4684] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:47 2022] GET /identity/v3/auth/tokens => generated 3578 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:48.062264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58e77b-003c-47a1-a531-1925da355983 service glance] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:48.067957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3a58e77b-003c-47a1-a531-1925da355983 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:48.138138 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2308/4685] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:48 2022] POST /identity/v3/auth/tokens => generated 3555 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:48.140747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af871390-da18-4a11-b10b-ccda8cde5434 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:48.146975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-af871390-da18-4a11-b10b-ccda8cde5434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:48.254083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58e77b-003c-47a1-a531-1925da355983 service glance] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:48.268777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331cca0-d7cd-49f3-bc71-5e871163e79f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051174fb53da42e18ac0930c0b45ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e942977be8d249659c6e4d4ceb6f8f24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:48.271886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331cca0-d7cd-49f3-bc71-5e871163e79f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:48.272012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af871390-da18-4a11-b10b-ccda8cde5434 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:48.272103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331cca0-d7cd-49f3-bc71-5e871163e79f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:48.272103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331cca0-d7cd-49f3-bc71-5e871163e79f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] PATH_INFO: `/v3/domains/7cd8789a154c4c1886a54ba6f885bbe4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:48.275357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0e170-611e-44fd-8f9d-633fc64ec053 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:48.276418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0e170-611e-44fd-8f9d-633fc64ec053 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:48.276703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0e170-611e-44fd-8f9d-633fc64ec053 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:48.277367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0e170-611e-44fd-8f9d-633fc64ec053 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:48.278094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0e170-611e-44fd-8f9d-633fc64ec053 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:48.280146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0e170-611e-44fd-8f9d-633fc64ec053 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:48.298650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331cca0-d7cd-49f3-bc71-5e871163e79f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7cd8789a154c4c1886a54ba6f885bbe4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:48.300540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331cca0-d7cd-49f3-bc71-5e871163e79f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:48.321101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:48.345540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2331cca0-d7cd-49f3-bc71-5e871163e79f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7cd8789a154c4c1886a54ba6f885bbe4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:48.351988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2331cca0-d7cd-49f3-bc71-5e871163e79f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7cd8789a154c4c1886a54ba6f885bbe4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:48.398544 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2309/4686] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:48 2022] POST /identity/v3/projects => generated 359 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:48.399855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0e170-611e-44fd-8f9d-633fc64ec053 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:48.503800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2331cca0-d7cd-49f3-bc71-5e871163e79f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd8789a154c4c1886a54ba6f885bbe4', 'request_id': 'req-2331cca0-d7cd-49f3-bc71-5e871163e79f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:48.511850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2331cca0-d7cd-49f3-bc71-5e871163e79f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd8789a154c4c1886a54ba6f885bbe4', 'request_id': 'req-2331cca0-d7cd-49f3-bc71-5e871163e79f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:48.551719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0e170-611e-44fd-8f9d-633fc64ec053 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:48.596894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2331cca0-d7cd-49f3-bc71-5e871163e79f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd8789a154c4c1886a54ba6f885bbe4', 'request_id': 'req-2331cca0-d7cd-49f3-bc71-5e871163e79f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:48.631217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2331cca0-d7cd-49f3-bc71-5e871163e79f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] The token cache is being invalidate because project 7cd8789a154c4c1886a54ba6f885bbe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:48.631532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2331cca0-d7cd-49f3-bc71-5e871163e79f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:48.638894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2331cca0-d7cd-49f3-bc71-5e871163e79f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:48.642523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f0442-e6b8-4e53-958b-991d0847e21c tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cad6298e4a340588aa9b3fc96a2758c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a294093d8594c93a7af3e7550a145c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:48.643355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f0442-e6b8-4e53-958b-991d0847e21c tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:48.643992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f0442-e6b8-4e53-958b-991d0847e21c tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:48.644444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f0442-e6b8-4e53-958b-991d0847e21c tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] PATH_INFO: `/v3/endpoints/43ecbf80eb804e90b8a6b0cbf3512cfa` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:48.654413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f0442-e6b8-4e53-958b-991d0847e21c tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=43ecbf80eb804e90b8a6b0cbf3512cfa)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:48.654413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f0442-e6b8-4e53-958b-991d0847e21c tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:48.671896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2331cca0-d7cd-49f3-bc71-5e871163e79f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7cd8789a154c4c1886a54ba6f885bbe4', 'request_id': 'req-2331cca0-d7cd-49f3-bc71-5e871163e79f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:48.672708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2331cca0-d7cd-49f3-bc71-5e871163e79f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7cd8789a154c4c1886a54ba6f885bbe4', 'request_id': 'req-2331cca0-d7cd-49f3-bc71-5e871163e79f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:48.673340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2331cca0-d7cd-49f3-bc71-5e871163e79f tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7cd8789a154c4c1886a54ba6f885bbe4', 'request_id': 'req-2331cca0-d7cd-49f3-bc71-5e871163e79f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:48.695403 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2378/4687] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:49:48 2022] DELETE /identity/v3/domains/7cd8789a154c4c1886a54ba6f885bbe4 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:48.696987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e1e70-a113-454c-be9d-16f6229e2582 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:48.697281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e1e70-a113-454c-be9d-16f6229e2582 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:48.697560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e1e70-a113-454c-be9d-16f6229e2582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:48.743843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-690f0442-e6b8-4e53-958b-991d0847e21c tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '43ecbf80eb804e90b8a6b0cbf3512cfa', 'request_id': 'req-690f0442-e6b8-4e53-958b-991d0847e21c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:48.748475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f84e1e70-a113-454c-be9d-16f6229e2582 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:48.750842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f84e1e70-a113-454c-be9d-16f6229e2582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:48.760500 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2310/4688] 10.222.0.76 () {58 vars in 1236 bytes} [Sat Aug 27 04:49:48 2022] DELETE /identity/v3/endpoints/43ecbf80eb804e90b8a6b0cbf3512cfa => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:48.761707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f0442-e6b8-4e53-958b-991d0847e21c tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:48.786490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-690f0442-e6b8-4e53-958b-991d0847e21c tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:48.912244 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2379/4689] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:48 2022] POST /identity/v3/auth/tokens => generated 3373 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:48.912244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e1e70-a113-454c-be9d-16f6229e2582 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:48.914594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f84e1e70-a113-454c-be9d-16f6229e2582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:48.931890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f0442-e6b8-4e53-958b-991d0847e21c tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:48.950795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df109970-5bad-41d4-82a7-ae5a02e7c821 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:48.951599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df109970-5bad-41d4-82a7-ae5a02e7c821 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:48.951782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df109970-5bad-41d4-82a7-ae5a02e7c821 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:48.952067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df109970-5bad-41d4-82a7-ae5a02e7c821 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/fcbea38ae3ff426c993af36714536499` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:48.953358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df109970-5bad-41d4-82a7-ae5a02e7c821 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:get_project(project_id=fcbea38ae3ff426c993af36714536499)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:48.956327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df109970-5bad-41d4-82a7-ae5a02e7c821 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:48.979809 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2311/4690] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:49:48 2022] GET /identity/v3/projects/fcbea38ae3ff426c993af36714536499 => generated 359 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:48.980837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df109970-5bad-41d4-82a7-ae5a02e7c821 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:48.990851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-df109970-5bad-41d4-82a7-ae5a02e7c821 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:49.038409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df109970-5bad-41d4-82a7-ae5a02e7c821 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:49.052588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a08360-5f1a-4e37-bda1-153963a353d3 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cad6298e4a340588aa9b3fc96a2758c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a294093d8594c93a7af3e7550a145c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:49.053237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a08360-5f1a-4e37-bda1-153963a353d3 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:49.053563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a08360-5f1a-4e37-bda1-153963a353d3 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:49.053816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a08360-5f1a-4e37-bda1-153963a353d3 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] PATH_INFO: `/v3/regions/tempest-region-1203550804` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:49.055064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a08360-5f1a-4e37-bda1-153963a353d3 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1203550804)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:49.056733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a08360-5f1a-4e37-bda1-153963a353d3 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:49.073934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e1e70-a113-454c-be9d-16f6229e2582 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:49.088938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e4900-89d5-4de8-acc0-08c205f5126e tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051174fb53da42e18ac0930c0b45ac74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e942977be8d249659c6e4d4ceb6f8f24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:49.089432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e4900-89d5-4de8-acc0-08c205f5126e tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:49.090462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e4900-89d5-4de8-acc0-08c205f5126e tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:49.092977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e4900-89d5-4de8-acc0-08c205f5126e tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] PATH_INFO: `/v3/domains/54367ecc84384ff69a69df8145c92472` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:49.104975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e4900-89d5-4de8-acc0-08c205f5126e tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:49:49.127732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-c64e4900-89d5-4de8-acc0-08c205f5126e tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Could not find domain: 54367ecc84384ff69a69df8145c92472.: keystone.exception.DomainNotFound: Could not find domain: 54367ecc84384ff69a69df8145c92472. Aug 27 04:49:49.127732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:49.127732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:49:49.127732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:49:49.127732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:49:49.127732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:49:49.127732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:49:49.127732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:49:49.127732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 54367ecc84384ff69a69df8145c92472. Aug 27 04:49:49.127732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:49.127732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:49:49.127732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:49.127732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:49.127732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:49.127732 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:49.128981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:49.128981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:49.128981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:49.128981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:49.128981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:49.128981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:49.128981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:49.128981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:49.128981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 27 04:49:49.128981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 27 04:49:49.128981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:49:49.128981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:49:49.128981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:49:49.128981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:49:49.128981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:49:49.128981 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:49:49.130212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:49:49.130212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:49:49.130212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:49:49.130212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:49:49.130212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:49:49.130212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:49:49.130212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:49:49.130212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:49:49.130212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:49:49.130212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:49:49.130212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:49:49.130212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:49:49.130212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:49:49.130212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:49:49.130212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:49:49.130212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:49:49.130212 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 54367ecc84384ff69a69df8145c92472. Aug 27 04:49:49.131471 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:49:49.131471 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2380/4691] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:49:48 2022] PATCH /identity/v3/domains/54367ecc84384ff69a69df8145c92472 => generated 112 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:49:49.131471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e4900-89d5-4de8-acc0-08c205f5126e tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:49.140990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e4900-89d5-4de8-acc0-08c205f5126e tempest-DomainsNegativeTestJSON-1933515094 tempest-DomainsNegativeTestJSON-1933515094-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:49.146025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58772904-3b0c-49c9-b09a-9adc41758318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:49.147086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58772904-3b0c-49c9-b09a-9adc41758318 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:49.147339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58772904-3b0c-49c9-b09a-9adc41758318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:49.147683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58772904-3b0c-49c9-b09a-9adc41758318 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:49.148478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58772904-3b0c-49c9-b09a-9adc41758318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:49.148863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58772904-3b0c-49c9-b09a-9adc41758318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:49.152921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58772904-3b0c-49c9-b09a-9adc41758318 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:49.176273 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2381/4692] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:49.176273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58772904-3b0c-49c9-b09a-9adc41758318 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:49.185437 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-a0a08360-5f1a-4e37-bda1-153963a353d3 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1203550804. To ensure interoperability, identifiers should be a valid uuid. Aug 27 04:49:49.185437 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 27 04:49:49.185437 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:49:49.193412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58772904-3b0c-49c9-b09a-9adc41758318 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:49.200126 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2312/4693] 10.222.0.76 () {58 vars in 1209 bytes} [Sat Aug 27 04:49:48 2022] DELETE /identity/v3/regions/tempest-region-1203550804 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:49.202184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a08360-5f1a-4e37-bda1-153963a353d3 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:49.205507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a0a08360-5f1a-4e37-bda1-153963a353d3 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:49.235913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95111e-6d27-467f-b60b-77ca1d643450 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:49.236734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95111e-6d27-467f-b60b-77ca1d643450 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:49.237674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95111e-6d27-467f-b60b-77ca1d643450 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:49.238023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95111e-6d27-467f-b60b-77ca1d643450 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/fcbea38ae3ff426c993af36714536499` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:49.240314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95111e-6d27-467f-b60b-77ca1d643450 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fcbea38ae3ff426c993af36714536499)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:49.256282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95111e-6d27-467f-b60b-77ca1d643450 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:49.270988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a08360-5f1a-4e37-bda1-153963a353d3 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:49.284021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244210a-a0d8-4f16-a959-46ce62c5a0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:49.284734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244210a-a0d8-4f16-a959-46ce62c5a0b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:49.287130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244210a-a0d8-4f16-a959-46ce62c5a0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:49.287130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244210a-a0d8-4f16-a959-46ce62c5a0b4 admin admin] PATH_INFO: `/v3/users/0da2f983ac0d44b1ad5e116c40a8d8ae` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:49.288194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244210a-a0d8-4f16-a959-46ce62c5a0b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0da2f983ac0d44b1ad5e116c40a8d8ae)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:49.290248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244210a-a0d8-4f16-a959-46ce62c5a0b4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:49.434052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6d95111e-6d27-467f-b60b-77ca1d643450 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcbea38ae3ff426c993af36714536499', 'request_id': 'req-6d95111e-6d27-467f-b60b-77ca1d643450'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:49.457912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6d95111e-6d27-467f-b60b-77ca1d643450 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcbea38ae3ff426c993af36714536499', 'request_id': 'req-6d95111e-6d27-467f-b60b-77ca1d643450'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:49.557280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f244210a-a0d8-4f16-a959-46ce62c5a0b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0da2f983ac0d44b1ad5e116c40a8d8ae'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:49.572314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:49.573060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6d95111e-6d27-467f-b60b-77ca1d643450 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcbea38ae3ff426c993af36714536499', 'request_id': 'req-6d95111e-6d27-467f-b60b-77ca1d643450'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:49.593970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6d95111e-6d27-467f-b60b-77ca1d643450 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] The token cache is being invalidate because project fcbea38ae3ff426c993af36714536499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:49.594537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6d95111e-6d27-467f-b60b-77ca1d643450 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:49.595397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6d95111e-6d27-467f-b60b-77ca1d643450 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:49.598139 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2382/4694] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:49 2022] DELETE /identity/v3/projects/fcbea38ae3ff426c993af36714536499 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:49.599147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95111e-6d27-467f-b60b-77ca1d643450 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:49.603463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6d95111e-6d27-467f-b60b-77ca1d643450 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:49.671482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f244210a-a0d8-4f16-a959-46ce62c5a0b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0da2f983ac0d44b1ad5e116c40a8d8ae'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:49.672501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f244210a-a0d8-4f16-a959-46ce62c5a0b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0da2f983ac0d44b1ad5e116c40a8d8ae'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:49.683152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f244210a-a0d8-4f16-a959-46ce62c5a0b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0da2f983ac0d44b1ad5e116c40a8d8ae'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:49.707422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95111e-6d27-467f-b60b-77ca1d643450 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:49.708948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f244210a-a0d8-4f16-a959-46ce62c5a0b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0da2f983ac0d44b1ad5e116c40a8d8ae'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:49.718157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeea58-9230-4af2-9c5a-bd6b926ad6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:49.719007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeea58-9230-4af2-9c5a-bd6b926ad6ab admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:49.719007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeea58-9230-4af2-9c5a-bd6b926ad6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:49.719300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeea58-9230-4af2-9c5a-bd6b926ad6ab admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:49.719925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effeea58-9230-4af2-9c5a-bd6b926ad6ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:49.723406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effeea58-9230-4af2-9c5a-bd6b926ad6ab admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:49.730189 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2313/4695] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:49 2022] DELETE /identity/v3/users/0da2f983ac0d44b1ad5e116c40a8d8ae => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:49.732757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244210a-a0d8-4f16-a959-46ce62c5a0b4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:49.736239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f244210a-a0d8-4f16-a959-46ce62c5a0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:49.821566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244210a-a0d8-4f16-a959-46ce62c5a0b4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:49.827776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52381d66-c608-4967-b593-8c9d57a8e035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:49.828526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52381d66-c608-4967-b593-8c9d57a8e035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:49.836738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52381d66-c608-4967-b593-8c9d57a8e035 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:49.836738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52381d66-c608-4967-b593-8c9d57a8e035 admin admin] PATH_INFO: `/v3/users/1cb821903fb849ddbe117d45ee3b3e66` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:49.836738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52381d66-c608-4967-b593-8c9d57a8e035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cb821903fb849ddbe117d45ee3b3e66)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:49.836738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52381d66-c608-4967-b593-8c9d57a8e035 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:49.939681 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2383/4696] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:49 2022] POST /identity/v3/projects => generated 377 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:49.945728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeea58-9230-4af2-9c5a-bd6b926ad6ab admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:49.949084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-effeea58-9230-4af2-9c5a-bd6b926ad6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:50.061968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeea58-9230-4af2-9c5a-bd6b926ad6ab admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:50.067998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c980b-eaf6-46b0-9603-776c1a686e85 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cad6298e4a340588aa9b3fc96a2758c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a294093d8594c93a7af3e7550a145c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:50.068755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c980b-eaf6-46b0-9603-776c1a686e85 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:50.069036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c980b-eaf6-46b0-9603-776c1a686e85 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:50.069753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c980b-eaf6-46b0-9603-776c1a686e85 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] PATH_INFO: `/v3/services/d7b8ac448a0241e0b35540cdeea0bd28` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:50.070662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c980b-eaf6-46b0-9603-776c1a686e85 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d7b8ac448a0241e0b35540cdeea0bd28)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:50.074315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c980b-eaf6-46b0-9603-776c1a686e85 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:50.099009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-52381d66-c608-4967-b593-8c9d57a8e035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cb821903fb849ddbe117d45ee3b3e66'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:50.188842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-52381d66-c608-4967-b593-8c9d57a8e035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cb821903fb849ddbe117d45ee3b3e66'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:50.190402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-52381d66-c608-4967-b593-8c9d57a8e035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cb821903fb849ddbe117d45ee3b3e66'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:50.202585 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2384/4697] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:49 2022] DELETE /identity/v3/services/d7b8ac448a0241e0b35540cdeea0bd28 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:50.203637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c980b-eaf6-46b0-9603-776c1a686e85 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:50.216358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-52381d66-c608-4967-b593-8c9d57a8e035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cb821903fb849ddbe117d45ee3b3e66'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:50.218819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-744c980b-eaf6-46b0-9603-776c1a686e85 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:50.223376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-52381d66-c608-4967-b593-8c9d57a8e035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cb821903fb849ddbe117d45ee3b3e66'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:50.228600 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2314/4698] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:49 2022] DELETE /identity/v3/users/1cb821903fb849ddbe117d45ee3b3e66 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:50.230871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201a1ac-955a-4f68-ae3b-207627834a92 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:50.231191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201a1ac-955a-4f68-ae3b-207627834a92 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:50.231550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201a1ac-955a-4f68-ae3b-207627834a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:50.268433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1201a1ac-955a-4f68-ae3b-207627834a92 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:50.280066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1201a1ac-955a-4f68-ae3b-207627834a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:50.335792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c980b-eaf6-46b0-9603-776c1a686e85 tempest-EndpointsNegativeTestJSON-1772957579 tempest-EndpointsNegativeTestJSON-1772957579-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:50.442215 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2315/4699] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:50.443295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201a1ac-955a-4f68-ae3b-207627834a92 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:50.444917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1201a1ac-955a-4f68-ae3b-207627834a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:50.464036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201a1ac-955a-4f68-ae3b-207627834a92 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:50.470793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9d50e-a36e-4b4f-a6e3-e031f8dbf525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:50.472524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9d50e-a36e-4b4f-a6e3-e031f8dbf525 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:50.473020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9d50e-a36e-4b4f-a6e3-e031f8dbf525 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:50.473510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9d50e-a36e-4b4f-a6e3-e031f8dbf525 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:50.474511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9d50e-a36e-4b4f-a6e3-e031f8dbf525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:50.477089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9d50e-a36e-4b4f-a6e3-e031f8dbf525 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:50.500715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d5206-c88b-4d02-8e76-33ad59210805 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:50.501432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d5206-c88b-4d02-8e76-33ad59210805 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:50.501713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d5206-c88b-4d02-8e76-33ad59210805 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:50.501988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d5206-c88b-4d02-8e76-33ad59210805 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:50.502630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d5206-c88b-4d02-8e76-33ad59210805 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:50.504546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d5206-c88b-4d02-8e76-33ad59210805 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:50.629967 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2316/4700] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:50 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:50.629967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9d50e-a36e-4b4f-a6e3-e031f8dbf525 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:50.634554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-29c9d50e-a36e-4b4f-a6e3-e031f8dbf525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:50.654639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9d50e-a36e-4b4f-a6e3-e031f8dbf525 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:50.659980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0fb58-1fe4-4864-873d-05b3fa053689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:50.660712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0fb58-1fe4-4864-873d-05b3fa053689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:50.661044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0fb58-1fe4-4864-873d-05b3fa053689 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:50.673874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0fb58-1fe4-4864-873d-05b3fa053689 admin admin] PATH_INFO: `/v3/users/c6cc7014dca344ab98c32507cec69b97` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:50.673874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0fb58-1fe4-4864-873d-05b3fa053689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6cc7014dca344ab98c32507cec69b97)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:50.673874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0fb58-1fe4-4864-873d-05b3fa053689 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:50.674270 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2385/4701] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:50 2022] POST /identity/v3/projects => generated 360 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:50.678056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232c1b7-2a0e-4552-96d1-24c340b6a996 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:50.678343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232c1b7-2a0e-4552-96d1-24c340b6a996 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:50.678615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232c1b7-2a0e-4552-96d1-24c340b6a996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:50.718177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7232c1b7-2a0e-4552-96d1-24c340b6a996 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:50.719749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7232c1b7-2a0e-4552-96d1-24c340b6a996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:50.803563 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2386/4702] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:50.803563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232c1b7-2a0e-4552-96d1-24c340b6a996 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:50.803563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7232c1b7-2a0e-4552-96d1-24c340b6a996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:50.918985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232c1b7-2a0e-4552-96d1-24c340b6a996 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:50.926776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e287be-adb4-47fd-8e5d-d14202d7a8c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:50.927651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e287be-adb4-47fd-8e5d-d14202d7a8c7 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:50.928538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e287be-adb4-47fd-8e5d-d14202d7a8c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:50.929008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e287be-adb4-47fd-8e5d-d14202d7a8c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:50.950502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e287be-adb4-47fd-8e5d-d14202d7a8c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:50.953212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e287be-adb4-47fd-8e5d-d14202d7a8c7 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:50.964080 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2387/4703] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:50.967435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e287be-adb4-47fd-8e5d-d14202d7a8c7 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:50.978382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e287be-adb4-47fd-8e5d-d14202d7a8c7 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:50.983759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a10a5-b250-4546-a261-d007b61441fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:50.988394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a10a5-b250-4546-a261-d007b61441fd admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:50.988394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a10a5-b250-4546-a261-d007b61441fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:50.988394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a10a5-b250-4546-a261-d007b61441fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:50.988394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a10a5-b250-4546-a261-d007b61441fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:50.988394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a10a5-b250-4546-a261-d007b61441fd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:51.003352 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2388/4704] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:51.003352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf3c3-9c27-474e-8561-35fc091ef5e9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:51.003352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf3c3-9c27-474e-8561-35fc091ef5e9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:51.003352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf3c3-9c27-474e-8561-35fc091ef5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:51.035507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-959cf3c3-9c27-474e-8561-35fc091ef5e9 None None] MFA Rules not processed for user `266c2afa4bdd4a959047d57f085d589c`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:51.036799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-959cf3c3-9c27-474e-8561-35fc091ef5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:51.115773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-45b0fb58-1fe4-4864-873d-05b3fa053689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6cc7014dca344ab98c32507cec69b97'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:51.123351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:51.133011 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2389/4705] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:51.133393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cf3c3-9c27-474e-8561-35fc091ef5e9 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:51.134871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-959cf3c3-9c27-474e-8561-35fc091ef5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:51.211785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cf3c3-9c27-474e-8561-35fc091ef5e9 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:51.222281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe71be-6b86-4270-802c-9d49b24e9eed tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:51.223051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe71be-6b86-4270-802c-9d49b24e9eed tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:51.223410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe71be-6b86-4270-802c-9d49b24e9eed tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:51.223707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe71be-6b86-4270-802c-9d49b24e9eed tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/7844d65598f64ee3a88eb8d1e0631f0d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:51.225438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe71be-6b86-4270-802c-9d49b24e9eed tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:get_project(project_id=7844d65598f64ee3a88eb8d1e0631f0d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:51.228006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe71be-6b86-4270-802c-9d49b24e9eed tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:51.231878 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2390/4706] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:49:51 2022] GET /identity/v3/projects/7844d65598f64ee3a88eb8d1e0631f0d => generated 360 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:51.231878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe71be-6b86-4270-802c-9d49b24e9eed tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:51.239939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-45b0fb58-1fe4-4864-873d-05b3fa053689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6cc7014dca344ab98c32507cec69b97'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:51.240656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-45b0fb58-1fe4-4864-873d-05b3fa053689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6cc7014dca344ab98c32507cec69b97'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:51.250465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-45b0fb58-1fe4-4864-873d-05b3fa053689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6cc7014dca344ab98c32507cec69b97'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:51.258670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe71be-6b86-4270-802c-9d49b24e9eed tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:51.269771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241240e8-cc38-4ca5-9c7e-03936f652422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:51.270655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241240e8-cc38-4ca5-9c7e-03936f652422 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:51.272361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241240e8-cc38-4ca5-9c7e-03936f652422 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:51.272710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241240e8-cc38-4ca5-9c7e-03936f652422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:51.280020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-45b0fb58-1fe4-4864-873d-05b3fa053689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6cc7014dca344ab98c32507cec69b97'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:51.294477 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2317/4707] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:50 2022] DELETE /identity/v3/users/c6cc7014dca344ab98c32507cec69b97 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:51.296594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0fb58-1fe4-4864-873d-05b3fa053689 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:51.298101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241240e8-cc38-4ca5-9c7e-03936f652422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:51.299973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-45b0fb58-1fe4-4864-873d-05b3fa053689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:51.301950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241240e8-cc38-4ca5-9c7e-03936f652422 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:51.323601 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2391/4708] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:51.325805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241240e8-cc38-4ca5-9c7e-03936f652422 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:51.332230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-241240e8-cc38-4ca5-9c7e-03936f652422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:51.404994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0fb58-1fe4-4864-873d-05b3fa053689 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:51.410826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d68b27-86f6-45c6-b085-4cc6a8ecece6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:51.411654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d68b27-86f6-45c6-b085-4cc6a8ecece6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:51.412038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d68b27-86f6-45c6-b085-4cc6a8ecece6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:51.412450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d68b27-86f6-45c6-b085-4cc6a8ecece6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:51.413173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d68b27-86f6-45c6-b085-4cc6a8ecece6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:51.415304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d68b27-86f6-45c6-b085-4cc6a8ecece6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:51.429001 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2318/4709] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:49:51.430052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d68b27-86f6-45c6-b085-4cc6a8ecece6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:51.433007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-88d68b27-86f6-45c6-b085-4cc6a8ecece6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:51.495394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241240e8-cc38-4ca5-9c7e-03936f652422 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:51.511108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d68b27-86f6-45c6-b085-4cc6a8ecece6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:51.518387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c97688-daa1-4e69-b15d-5323b46b24ee tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:51.519159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c97688-daa1-4e69-b15d-5323b46b24ee tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:51.519512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c97688-daa1-4e69-b15d-5323b46b24ee tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:51.519842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c97688-daa1-4e69-b15d-5323b46b24ee tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/7844d65598f64ee3a88eb8d1e0631f0d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:51.521145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c97688-daa1-4e69-b15d-5323b46b24ee tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7844d65598f64ee3a88eb8d1e0631f0d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:51.523519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c97688-daa1-4e69-b15d-5323b46b24ee tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:51.594918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95286b5e-8ca5-4299-822d-4b0844679855 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:51.595723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95286b5e-8ca5-4299-822d-4b0844679855 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:51.596230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95286b5e-8ca5-4299-822d-4b0844679855 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:51.596616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95286b5e-8ca5-4299-822d-4b0844679855 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:51.608358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-95286b5e-8ca5-4299-822d-4b0844679855 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:51.680001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-81c97688-daa1-4e69-b15d-5323b46b24ee tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7844d65598f64ee3a88eb8d1e0631f0d', 'request_id': 'req-81c97688-daa1-4e69-b15d-5323b46b24ee'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:51.690789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-81c97688-daa1-4e69-b15d-5323b46b24ee tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7844d65598f64ee3a88eb8d1e0631f0d', 'request_id': 'req-81c97688-daa1-4e69-b15d-5323b46b24ee'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:51.697749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-81c97688-daa1-4e69-b15d-5323b46b24ee tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7844d65598f64ee3a88eb8d1e0631f0d', 'request_id': 'req-81c97688-daa1-4e69-b15d-5323b46b24ee'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:51.709603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95286b5e-8ca5-4299-822d-4b0844679855 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:51.711557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95286b5e-8ca5-4299-822d-4b0844679855 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:51.734217 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2392/4710] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:51.735602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7a4f8-f446-46c6-971a-f9dd810f25f6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:51.735958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7a4f8-f446-46c6-971a-f9dd810f25f6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:51.736343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7a4f8-f446-46c6-971a-f9dd810f25f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:51.760906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-94d7a4f8-f446-46c6-971a-f9dd810f25f6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:51.762927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-94d7a4f8-f446-46c6-971a-f9dd810f25f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:51.823254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-81c97688-daa1-4e69-b15d-5323b46b24ee tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] The token cache is being invalidate because project 7844d65598f64ee3a88eb8d1e0631f0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:51.823542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-81c97688-daa1-4e69-b15d-5323b46b24ee tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:51.824989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-81c97688-daa1-4e69-b15d-5323b46b24ee tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:51.826480 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2319/4711] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:51 2022] DELETE /identity/v3/projects/7844d65598f64ee3a88eb8d1e0631f0d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:51.827357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c97688-daa1-4e69-b15d-5323b46b24ee tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:51.829242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-81c97688-daa1-4e69-b15d-5323b46b24ee tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:51.833742 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2393/4712] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:51.834603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7a4f8-f446-46c6-971a-f9dd810f25f6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:51.841687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-94d7a4f8-f446-46c6-971a-f9dd810f25f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:51.854729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c97688-daa1-4e69-b15d-5323b46b24ee tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:51.862099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11088a31-fcde-4743-8cff-2230d03420fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:51.865186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11088a31-fcde-4743-8cff-2230d03420fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:51.865186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11088a31-fcde-4743-8cff-2230d03420fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:51.865186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11088a31-fcde-4743-8cff-2230d03420fd admin admin] PATH_INFO: `/v3/projects/c95c51d779ca4aadba49b68e6b170e25/users/721664557be941adac164d6fc47f3b7a/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:51.895445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11088a31-fcde-4743-8cff-2230d03420fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95c51d779ca4aadba49b68e6b170e25, user_id=721664557be941adac164d6fc47f3b7a, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:51.898159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11088a31-fcde-4743-8cff-2230d03420fd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:52.037385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7a4f8-f446-46c6-971a-f9dd810f25f6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:52.038820 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2320/4713] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:49:51 2022] PUT /identity/v3/projects/c95c51d779ca4aadba49b68e6b170e25/users/721664557be941adac164d6fc47f3b7a/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:52.039693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11088a31-fcde-4743-8cff-2230d03420fd admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:52.049466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-11088a31-fcde-4743-8cff-2230d03420fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:52.073778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:52.162274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11088a31-fcde-4743-8cff-2230d03420fd admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:52.171952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3e558-a638-4664-a1e2-2deb871e1bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:52.172929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e558-a638-4664-a1e2-2deb871e1bfc service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:52.173299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e558-a638-4664-a1e2-2deb871e1bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:52.173723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e558-a638-4664-a1e2-2deb871e1bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:52.182325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c99c7-d58f-469d-a504-602158a08aca tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:52.183106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c99c7-d58f-469d-a504-602158a08aca tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:52.183754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c99c7-d58f-469d-a504-602158a08aca tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:52.184439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c99c7-d58f-469d-a504-602158a08aca tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:52.185632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c99c7-d58f-469d-a504-602158a08aca tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:52.187652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c99c7-d58f-469d-a504-602158a08aca tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:52.354271 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2394/4714] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:49:51 2022] POST /identity/v3/projects => generated 347 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:52.359900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3e558-a638-4664-a1e2-2deb871e1bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:52.361006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7aa19a-ee15-41a1-b106-5fbc7207f6ad None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:52.361301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7aa19a-ee15-41a1-b106-5fbc7207f6ad None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:52.361573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7aa19a-ee15-41a1-b106-5fbc7207f6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:52.366396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3e558-a638-4664-a1e2-2deb871e1bfc service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:52.391639 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2321/4715] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:52.393000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3e558-a638-4664-a1e2-2deb871e1bfc service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:52.420232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3e558-a638-4664-a1e2-2deb871e1bfc service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:52.436992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bc7aa19a-ee15-41a1-b106-5fbc7207f6ad None None] MFA Rules not processed for user `721664557be941adac164d6fc47f3b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:52.438625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bc7aa19a-ee15-41a1-b106-5fbc7207f6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:52.560029 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2395/4716] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:52.570646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2ad4c-7a41-45ee-aa0a-de0a84921d17 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:52.571182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2ad4c-7a41-45ee-aa0a-de0a84921d17 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:52.571564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2ad4c-7a41-45ee-aa0a-de0a84921d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:52.573056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186cf72-82a8-4d50-99e5-2879a0b5b28d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:52.574539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186cf72-82a8-4d50-99e5-2879a0b5b28d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:52.575424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186cf72-82a8-4d50-99e5-2879a0b5b28d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:52.575891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186cf72-82a8-4d50-99e5-2879a0b5b28d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/8b75c37499d64282976f11b0ff22d9ac` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:52.580744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186cf72-82a8-4d50-99e5-2879a0b5b28d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:get_project(project_id=8b75c37499d64282976f11b0ff22d9ac)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:52.584219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186cf72-82a8-4d50-99e5-2879a0b5b28d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:52.587193 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2322/4717] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:49:52 2022] GET /identity/v3/projects/8b75c37499d64282976f11b0ff22d9ac => generated 347 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:52.593629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186cf72-82a8-4d50-99e5-2879a0b5b28d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:52.616577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186cf72-82a8-4d50-99e5-2879a0b5b28d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:52.619456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-44f2ad4c-7a41-45ee-aa0a-de0a84921d17 None None] MFA Rules not processed for user `721664557be941adac164d6fc47f3b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:52.627556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-44f2ad4c-7a41-45ee-aa0a-de0a84921d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:52.631352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510a625-1670-46fd-a8f9-460712ec5396 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:52.632017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510a625-1670-46fd-a8f9-460712ec5396 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:52.632424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510a625-1670-46fd-a8f9-460712ec5396 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:52.632753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510a625-1670-46fd-a8f9-460712ec5396 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/8b75c37499d64282976f11b0ff22d9ac` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:52.637282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510a625-1670-46fd-a8f9-460712ec5396 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8b75c37499d64282976f11b0ff22d9ac)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:52.639320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510a625-1670-46fd-a8f9-460712ec5396 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:52.652092 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2396/4718] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:52.661053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2ad4c-7a41-45ee-aa0a-de0a84921d17 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:52.662557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-44f2ad4c-7a41-45ee-aa0a-de0a84921d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:52.714149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:52.741096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:52.836774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2ad4c-7a41-45ee-aa0a-de0a84921d17 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:52.849650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a1d23-824c-40d4-b989-50140658d036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:52.850283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a1d23-824c-40d4-b989-50140658d036 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:52.852502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a1d23-824c-40d4-b989-50140658d036 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:52.852782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a1d23-824c-40d4-b989-50140658d036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:52.870271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6510a625-1670-46fd-a8f9-460712ec5396 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b75c37499d64282976f11b0ff22d9ac', 'request_id': 'req-6510a625-1670-46fd-a8f9-460712ec5396'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:52.872117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a1d23-824c-40d4-b989-50140658d036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:52.873959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a1d23-824c-40d4-b989-50140658d036 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:52.885689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6510a625-1670-46fd-a8f9-460712ec5396 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b75c37499d64282976f11b0ff22d9ac', 'request_id': 'req-6510a625-1670-46fd-a8f9-460712ec5396'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:52.899630 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2397/4719] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:52.905107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6510a625-1670-46fd-a8f9-460712ec5396 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b75c37499d64282976f11b0ff22d9ac', 'request_id': 'req-6510a625-1670-46fd-a8f9-460712ec5396'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:53.010227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6510a625-1670-46fd-a8f9-460712ec5396 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] The token cache is being invalidate because project 8b75c37499d64282976f11b0ff22d9ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:53.010575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6510a625-1670-46fd-a8f9-460712ec5396 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:53.013009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6510a625-1670-46fd-a8f9-460712ec5396 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:53.019327 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2323/4720] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:52 2022] DELETE /identity/v3/projects/8b75c37499d64282976f11b0ff22d9ac => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:53.021039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a1d23-824c-40d4-b989-50140658d036 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:53.056692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a1d23-824c-40d4-b989-50140658d036 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:53.092043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510a625-1670-46fd-a8f9-460712ec5396 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:53.097814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6510a625-1670-46fd-a8f9-460712ec5396 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:53.156889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c9f1e-0b50-49b7-83d5-a4775b4110ad tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:53.157630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c9f1e-0b50-49b7-83d5-a4775b4110ad tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:53.157916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c9f1e-0b50-49b7-83d5-a4775b4110ad tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:53.158196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c9f1e-0b50-49b7-83d5-a4775b4110ad tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:53.159298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c9f1e-0b50-49b7-83d5-a4775b4110ad tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:53.160682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c9f1e-0b50-49b7-83d5-a4775b4110ad tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:53.169769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:53.322931 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2398/4721] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:49:53 2022] POST /identity/v3/domains => generated 276 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:53.327334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c9f1e-0b50-49b7-83d5-a4775b4110ad tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:53.330980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-241c9f1e-0b50-49b7-83d5-a4775b4110ad tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:53.388151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510a625-1670-46fd-a8f9-460712ec5396 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:53.445999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c9f1e-0b50-49b7-83d5-a4775b4110ad tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:53.452000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea159a43-3bc0-4680-8f2d-57b201d656e5 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:53.452920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea159a43-3bc0-4680-8f2d-57b201d656e5 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:53.453364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea159a43-3bc0-4680-8f2d-57b201d656e5 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:53.454777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea159a43-3bc0-4680-8f2d-57b201d656e5 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:53.456583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea159a43-3bc0-4680-8f2d-57b201d656e5 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:53.459035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea159a43-3bc0-4680-8f2d-57b201d656e5 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:53.565335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c8b05-1b90-4824-a545-3eb55164d31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:53.566265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c8b05-1b90-4824-a545-3eb55164d31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:53.566875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c8b05-1b90-4824-a545-3eb55164d31d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:53.567323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c8b05-1b90-4824-a545-3eb55164d31d admin admin] PATH_INFO: `/v3/projects/70397b37458b4fdf871fd8042aa9bb02` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:53.570006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c8b05-1b90-4824-a545-3eb55164d31d admin admin] RBAC: Authorizing `identity:delete_project(project_id=70397b37458b4fdf871fd8042aa9bb02)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:53.572478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c8b05-1b90-4824-a545-3eb55164d31d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:53.637748 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2399/4722] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:53 2022] POST /identity/v3/projects => generated 403 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:49:53.644337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea159a43-3bc0-4680-8f2d-57b201d656e5 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:53.651846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ea159a43-3bc0-4680-8f2d-57b201d656e5 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:53.801484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b83c8b05-1b90-4824-a545-3eb55164d31d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70397b37458b4fdf871fd8042aa9bb02', 'request_id': 'req-b83c8b05-1b90-4824-a545-3eb55164d31d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:53.804822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea159a43-3bc0-4680-8f2d-57b201d656e5 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:53.817918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b83c8b05-1b90-4824-a545-3eb55164d31d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70397b37458b4fdf871fd8042aa9bb02', 'request_id': 'req-b83c8b05-1b90-4824-a545-3eb55164d31d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:53.833486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b83c8b05-1b90-4824-a545-3eb55164d31d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70397b37458b4fdf871fd8042aa9bb02', 'request_id': 'req-b83c8b05-1b90-4824-a545-3eb55164d31d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:53.921974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f6912-5fcc-4b9d-afd6-018349aa7ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:53.922761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f6912-5fcc-4b9d-afd6-018349aa7ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:53.923141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f6912-5fcc-4b9d-afd6-018349aa7ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:53.923675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f6912-5fcc-4b9d-afd6-018349aa7ae5 admin admin] PATH_INFO: `/v3/projects/62e2973550654530a3aa68b1d3164c7f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:53.925378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f6912-5fcc-4b9d-afd6-018349aa7ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e2973550654530a3aa68b1d3164c7f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:53.928725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f6912-5fcc-4b9d-afd6-018349aa7ae5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:53.983343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b83c8b05-1b90-4824-a545-3eb55164d31d admin admin] The token cache is being invalidate because project 70397b37458b4fdf871fd8042aa9bb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:53.983895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b83c8b05-1b90-4824-a545-3eb55164d31d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:53.986479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b83c8b05-1b90-4824-a545-3eb55164d31d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:53.991586 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2324/4723] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:53 2022] DELETE /identity/v3/projects/70397b37458b4fdf871fd8042aa9bb02 => generated 0 bytes in 897 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:49:53.992989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c8b05-1b90-4824-a545-3eb55164d31d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:53.997389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b83c8b05-1b90-4824-a545-3eb55164d31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:54.097625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-193f6912-5fcc-4b9d-afd6-018349aa7ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e2973550654530a3aa68b1d3164c7f', 'request_id': 'req-193f6912-5fcc-4b9d-afd6-018349aa7ae5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:54.105891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-193f6912-5fcc-4b9d-afd6-018349aa7ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e2973550654530a3aa68b1d3164c7f', 'request_id': 'req-193f6912-5fcc-4b9d-afd6-018349aa7ae5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:54.160671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c8b05-1b90-4824-a545-3eb55164d31d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:54.189521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-193f6912-5fcc-4b9d-afd6-018349aa7ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e2973550654530a3aa68b1d3164c7f', 'request_id': 'req-193f6912-5fcc-4b9d-afd6-018349aa7ae5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:54.195054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:54.250964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a299ba-1d2a-4070-ba47-f74c7ea8a46d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:54.251613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a299ba-1d2a-4070-ba47-f74c7ea8a46d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:54.251901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a299ba-1d2a-4070-ba47-f74c7ea8a46d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:54.252195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a299ba-1d2a-4070-ba47-f74c7ea8a46d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/dd2281ea36e447ae959ed83c5db4b44e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:54.253414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a299ba-1d2a-4070-ba47-f74c7ea8a46d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:get_project(project_id=dd2281ea36e447ae959ed83c5db4b44e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:54.255746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a299ba-1d2a-4070-ba47-f74c7ea8a46d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:54.261436 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2325/4724] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:49:53 2022] GET /identity/v3/projects/dd2281ea36e447ae959ed83c5db4b44e => generated 403 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:54.261436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a299ba-1d2a-4070-ba47-f74c7ea8a46d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:54.264501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-57a299ba-1d2a-4070-ba47-f74c7ea8a46d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:54.269223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-193f6912-5fcc-4b9d-afd6-018349aa7ae5 admin admin] The token cache is being invalidate because project 62e2973550654530a3aa68b1d3164c7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:54.269872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-193f6912-5fcc-4b9d-afd6-018349aa7ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:54.271311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-193f6912-5fcc-4b9d-afd6-018349aa7ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:54.274388 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2400/4725] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:53 2022] DELETE /identity/v3/projects/62e2973550654530a3aa68b1d3164c7f => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:54.275780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f6912-5fcc-4b9d-afd6-018349aa7ae5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:54.280705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-193f6912-5fcc-4b9d-afd6-018349aa7ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:54.447899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f6912-5fcc-4b9d-afd6-018349aa7ae5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:54.461758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a299ba-1d2a-4070-ba47-f74c7ea8a46d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:54.469779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cf130-b0b0-49ba-a7c5-98911df24b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:54.471162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cf130-b0b0-49ba-a7c5-98911df24b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:54.471858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cf130-b0b0-49ba-a7c5-98911df24b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:54.472053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad236d-40d1-416e-b36d-cb2bee8ca378 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:54.472724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cf130-b0b0-49ba-a7c5-98911df24b1c admin admin] PATH_INFO: `/v3/users/6b8fd344f2dd4b17b44d5bd0db4e98ea` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:54.473479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad236d-40d1-416e-b36d-cb2bee8ca378 service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:54.474115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad236d-40d1-416e-b36d-cb2bee8ca378 service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:54.474656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad236d-40d1-416e-b36d-cb2bee8ca378 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:54.475607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cf130-b0b0-49ba-a7c5-98911df24b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8fd344f2dd4b17b44d5bd0db4e98ea)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:54.477883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c2ad236d-40d1-416e-b36d-cb2bee8ca378 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:54.480432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cf130-b0b0-49ba-a7c5-98911df24b1c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:54.542331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad236d-40d1-416e-b36d-cb2bee8ca378 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:54.547186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad236d-40d1-416e-b36d-cb2bee8ca378 service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:54.572624 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2326/4726] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:49:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:49:54.575243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad236d-40d1-416e-b36d-cb2bee8ca378 service placement] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:54.577787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c2ad236d-40d1-416e-b36d-cb2bee8ca378 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:54.601019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad236d-40d1-416e-b36d-cb2bee8ca378 service placement] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:54.611337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4f89f-1867-4fa0-8171-d83906ffc324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:54.613656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f89f-1867-4fa0-8171-d83906ffc324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:54.614049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f89f-1867-4fa0-8171-d83906ffc324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:54.614548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f89f-1867-4fa0-8171-d83906ffc324 admin admin] PATH_INFO: `/v3/projects/7c77a118277e4872a87c75a7b92ea351` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:54.617547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4f89f-1867-4fa0-8171-d83906ffc324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c77a118277e4872a87c75a7b92ea351)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:54.631426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4f89f-1867-4fa0-8171-d83906ffc324 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:54.711057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:54.763678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-520cf130-b0b0-49ba-a7c5-98911df24b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8fd344f2dd4b17b44d5bd0db4e98ea'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:54.764416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-520cf130-b0b0-49ba-a7c5-98911df24b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8fd344f2dd4b17b44d5bd0db4e98ea'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:54.830806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-81f4f89f-1867-4fa0-8171-d83906ffc324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c77a118277e4872a87c75a7b92ea351', 'request_id': 'req-81f4f89f-1867-4fa0-8171-d83906ffc324'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:54.838582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-81f4f89f-1867-4fa0-8171-d83906ffc324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c77a118277e4872a87c75a7b92ea351', 'request_id': 'req-81f4f89f-1867-4fa0-8171-d83906ffc324'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:54.849165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-81f4f89f-1867-4fa0-8171-d83906ffc324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c77a118277e4872a87c75a7b92ea351', 'request_id': 'req-81f4f89f-1867-4fa0-8171-d83906ffc324'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:54.876987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-520cf130-b0b0-49ba-a7c5-98911df24b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8fd344f2dd4b17b44d5bd0db4e98ea'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:54.879398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-520cf130-b0b0-49ba-a7c5-98911df24b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8fd344f2dd4b17b44d5bd0db4e98ea'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:54.919262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-520cf130-b0b0-49ba-a7c5-98911df24b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8fd344f2dd4b17b44d5bd0db4e98ea'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:54.946680 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2401/4727] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:54 2022] DELETE /identity/v3/users/6b8fd344f2dd4b17b44d5bd0db4e98ea => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:54.950224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cf130-b0b0-49ba-a7c5-98911df24b1c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:54.953160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-520cf130-b0b0-49ba-a7c5-98911df24b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:54.991663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-81f4f89f-1867-4fa0-8171-d83906ffc324 admin admin] The token cache is being invalidate because project 7c77a118277e4872a87c75a7b92ea351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:54.992582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-81f4f89f-1867-4fa0-8171-d83906ffc324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:54.993453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-81f4f89f-1867-4fa0-8171-d83906ffc324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:54.998106 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2327/4728] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:54 2022] DELETE /identity/v3/projects/7c77a118277e4872a87c75a7b92ea351 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:54.999873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4f89f-1867-4fa0-8171-d83906ffc324 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:55.001726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-81f4f89f-1867-4fa0-8171-d83906ffc324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:55.103900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4f89f-1867-4fa0-8171-d83906ffc324 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:55.119160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cf130-b0b0-49ba-a7c5-98911df24b1c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:55.127143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500e3c1-68bf-415c-8fea-f0b7d0030edd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:55.127811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500e3c1-68bf-415c-8fea-f0b7d0030edd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:55.128914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500e3c1-68bf-415c-8fea-f0b7d0030edd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:55.129978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500e3c1-68bf-415c-8fea-f0b7d0030edd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/dd2281ea36e447ae959ed83c5db4b44e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:55.133405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500e3c1-68bf-415c-8fea-f0b7d0030edd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dd2281ea36e447ae959ed83c5db4b44e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:55.141165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500e3c1-68bf-415c-8fea-f0b7d0030edd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:55.250041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c11f7f-63a1-4910-8165-a38257830bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:55.250739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c11f7f-63a1-4910-8165-a38257830bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:55.251075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c11f7f-63a1-4910-8165-a38257830bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:55.251351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c11f7f-63a1-4910-8165-a38257830bc8 admin admin] PATH_INFO: `/v3/users/051174fb53da42e18ac0930c0b45ac74` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:55.253577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c11f7f-63a1-4910-8165-a38257830bc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=051174fb53da42e18ac0930c0b45ac74)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:55.255533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c11f7f-63a1-4910-8165-a38257830bc8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:55.360247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a500e3c1-68bf-415c-8fea-f0b7d0030edd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd2281ea36e447ae959ed83c5db4b44e', 'request_id': 'req-a500e3c1-68bf-415c-8fea-f0b7d0030edd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:55.373063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a500e3c1-68bf-415c-8fea-f0b7d0030edd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd2281ea36e447ae959ed83c5db4b44e', 'request_id': 'req-a500e3c1-68bf-415c-8fea-f0b7d0030edd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:55.472653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a500e3c1-68bf-415c-8fea-f0b7d0030edd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd2281ea36e447ae959ed83c5db4b44e', 'request_id': 'req-a500e3c1-68bf-415c-8fea-f0b7d0030edd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:55.498723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a500e3c1-68bf-415c-8fea-f0b7d0030edd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] The token cache is being invalidate because project dd2281ea36e447ae959ed83c5db4b44e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:55.500147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a500e3c1-68bf-415c-8fea-f0b7d0030edd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:55.501136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a500e3c1-68bf-415c-8fea-f0b7d0030edd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:55.503844 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2402/4729] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:54 2022] DELETE /identity/v3/projects/dd2281ea36e447ae959ed83c5db4b44e => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:55.505324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500e3c1-68bf-415c-8fea-f0b7d0030edd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:55.507859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a500e3c1-68bf-415c-8fea-f0b7d0030edd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:55.560520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-94c11f7f-63a1-4910-8165-a38257830bc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '051174fb53da42e18ac0930c0b45ac74'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:55.680400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500e3c1-68bf-415c-8fea-f0b7d0030edd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:55.687735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea0fd0-58b9-44a3-a602-759b8647d4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:55.689924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea0fd0-58b9-44a3-a602-759b8647d4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:55.690675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea0fd0-58b9-44a3-a602-759b8647d4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:55.691331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea0fd0-58b9-44a3-a602-759b8647d4d2 admin admin] PATH_INFO: `/v3/users/3cad6298e4a340588aa9b3fc96a2758c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:55.693669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea0fd0-58b9-44a3-a602-759b8647d4d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cad6298e4a340588aa9b3fc96a2758c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:55.697454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea0fd0-58b9-44a3-a602-759b8647d4d2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:55.697968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-94c11f7f-63a1-4910-8165-a38257830bc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '051174fb53da42e18ac0930c0b45ac74'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:55.699752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-94c11f7f-63a1-4910-8165-a38257830bc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '051174fb53da42e18ac0930c0b45ac74'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:55.710272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-94c11f7f-63a1-4910-8165-a38257830bc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '051174fb53da42e18ac0930c0b45ac74'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:55.750525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-94c11f7f-63a1-4910-8165-a38257830bc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '051174fb53da42e18ac0930c0b45ac74'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:55.788731 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2328/4730] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:54 2022] DELETE /identity/v3/users/051174fb53da42e18ac0930c0b45ac74 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:55.789804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c11f7f-63a1-4910-8165-a38257830bc8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:55.799769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-94c11f7f-63a1-4910-8165-a38257830bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:55.925024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:55.929576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c11f7f-63a1-4910-8165-a38257830bc8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:55.942135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7f8e7-8543-42b3-9fe4-90c0b546877c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:55.943192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7f8e7-8543-42b3-9fe4-90c0b546877c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:55.943919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7f8e7-8543-42b3-9fe4-90c0b546877c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:55.944762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7f8e7-8543-42b3-9fe4-90c0b546877c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/domains/bf579870b233451f8c03b92397521789` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:55.947339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7f8e7-8543-42b3-9fe4-90c0b546877c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bf579870b233451f8c03b92397521789)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:55.950282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7f8e7-8543-42b3-9fe4-90c0b546877c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:56.015824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a2ea0fd0-58b9-44a3-a602-759b8647d4d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cad6298e4a340588aa9b3fc96a2758c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:56.016769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a2ea0fd0-58b9-44a3-a602-759b8647d4d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cad6298e4a340588aa9b3fc96a2758c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:56.040150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1af7f8e7-8543-42b3-9fe4-90c0b546877c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bf579870b233451f8c03b92397521789'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:56.042032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1af7f8e7-8543-42b3-9fe4-90c0b546877c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bf579870b233451f8c03b92397521789'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:56.155045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a2ea0fd0-58b9-44a3-a602-759b8647d4d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cad6298e4a340588aa9b3fc96a2758c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:56.155659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a2ea0fd0-58b9-44a3-a602-759b8647d4d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cad6298e4a340588aa9b3fc96a2758c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:56.177399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a2ea0fd0-58b9-44a3-a602-759b8647d4d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cad6298e4a340588aa9b3fc96a2758c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:56.202247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1af7f8e7-8543-42b3-9fe4-90c0b546877c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bf579870b233451f8c03b92397521789'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:56.204254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1af7f8e7-8543-42b3-9fe4-90c0b546877c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bf579870b233451f8c03b92397521789'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:56.208804 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2403/4731] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:49:55 2022] DELETE /identity/v3/users/3cad6298e4a340588aa9b3fc96a2758c => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:56.213917 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2329/4732] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:49:55 2022] PATCH /identity/v3/domains/bf579870b233451f8c03b92397521789 => generated 277 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:56.229587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea0fd0-58b9-44a3-a602-759b8647d4d2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:56.239745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a2ea0fd0-58b9-44a3-a602-759b8647d4d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:56.399354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea0fd0-58b9-44a3-a602-759b8647d4d2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:56.417221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:56.418776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:56.419160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:56.422316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/domains/bf579870b233451f8c03b92397521789` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:56.446417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bf579870b233451f8c03b92397521789)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:56.450883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:56.516526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bf579870b233451f8c03b92397521789'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:56.531644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bf579870b233451f8c03b92397521789'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:56.570637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:56.693072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf579870b233451f8c03b92397521789', 'request_id': 'req-97516d5a-cefd-4262-85b7-ca0986c4639c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:56.707746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf579870b233451f8c03b92397521789', 'request_id': 'req-97516d5a-cefd-4262-85b7-ca0986c4639c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:57.005678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf579870b233451f8c03b92397521789', 'request_id': 'req-97516d5a-cefd-4262-85b7-ca0986c4639c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:57.005678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] The token cache is being invalidate because project bf579870b233451f8c03b92397521789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:57.005678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:57.005678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:57.007521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bf579870b233451f8c03b92397521789', 'request_id': 'req-97516d5a-cefd-4262-85b7-ca0986c4639c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:57.007521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bf579870b233451f8c03b92397521789', 'request_id': 'req-97516d5a-cefd-4262-85b7-ca0986c4639c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:57.007521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bf579870b233451f8c03b92397521789', 'request_id': 'req-97516d5a-cefd-4262-85b7-ca0986c4639c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:57.008331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7f8e7-8543-42b3-9fe4-90c0b546877c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:57.008331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1af7f8e7-8543-42b3-9fe4-90c0b546877c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:57.008919 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2404/4733] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:49:56 2022] DELETE /identity/v3/domains/bf579870b233451f8c03b92397521789 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:57.008919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:57.008919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:57.087402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7f8e7-8543-42b3-9fe4-90c0b546877c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:57.184146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97516d5a-cefd-4262-85b7-ca0986c4639c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:57.190422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953ae96-b961-4860-9dbd-c86433d32baa tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:57.191105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953ae96-b961-4860-9dbd-c86433d32baa tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:57.191482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953ae96-b961-4860-9dbd-c86433d32baa tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:57.191853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953ae96-b961-4860-9dbd-c86433d32baa tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:57.192835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953ae96-b961-4860-9dbd-c86433d32baa tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:57.199630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953ae96-b961-4860-9dbd-c86433d32baa tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:57.199787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:57.201418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:57.201716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:57.209475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9 admin admin] PATH_INFO: `/v3/projects/40517bdc0866455da95a417aeab4ea62` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:57.215586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40517bdc0866455da95a417aeab4ea62)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:57.217876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:57.381450 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2405/4734] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:49:56 2022] POST /identity/v3/domains => generated 276 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:49:57.381450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c24c68-6a81-4daf-a1e2-0a839604c703 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:57.381450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c24c68-6a81-4daf-a1e2-0a839604c703 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:57.393064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c24c68-6a81-4daf-a1e2-0a839604c703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:57.407502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:57.445719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40517bdc0866455da95a417aeab4ea62', 'request_id': 'req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:57.452073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a9c24c68-6a81-4daf-a1e2-0a839604c703 None None] MFA Rules not processed for user `1599979f94f34b579e3cd4ac963de1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:57.454601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a9c24c68-6a81-4daf-a1e2-0a839604c703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:57.469322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40517bdc0866455da95a417aeab4ea62', 'request_id': 'req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:57.491620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40517bdc0866455da95a417aeab4ea62', 'request_id': 'req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:57.545040 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2406/4735] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:57.545040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c24c68-6a81-4daf-a1e2-0a839604c703 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:57.545040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a9c24c68-6a81-4daf-a1e2-0a839604c703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:57.601147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9 admin admin] The token cache is being invalidate because project 40517bdc0866455da95a417aeab4ea62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:57.601677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:57.602870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:57.608929 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2330/4736] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:56 2022] DELETE /identity/v3/projects/40517bdc0866455da95a417aeab4ea62 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:57.611033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:57.617000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:57.652910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c24c68-6a81-4daf-a1e2-0a839604c703 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:57.658702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e281cd-fe17-439c-9bf7-a1157844abf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:57.659446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e281cd-fe17-439c-9bf7-a1157844abf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:57.659818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e281cd-fe17-439c-9bf7-a1157844abf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:57.660264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e281cd-fe17-439c-9bf7-a1157844abf0 admin admin] PATH_INFO: `/v3/projects/e942977be8d249659c6e4d4ceb6f8f24` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:57.661780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e281cd-fe17-439c-9bf7-a1157844abf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e942977be8d249659c6e4d4ceb6f8f24)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:57.664390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e281cd-fe17-439c-9bf7-a1157844abf0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:57.719868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7bb2-81e3-4520-bc5f-1a9e19a1a5d9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:57.744852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa06a9-af5d-44d9-98d3-59073046183b tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:57.748202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa06a9-af5d-44d9-98d3-59073046183b tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:57.748960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa06a9-af5d-44d9-98d3-59073046183b tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:57.749461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa06a9-af5d-44d9-98d3-59073046183b tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:57.750416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa06a9-af5d-44d9-98d3-59073046183b tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:57.754488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa06a9-af5d-44d9-98d3-59073046183b tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:57.876831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-21e281cd-fe17-439c-9bf7-a1157844abf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e942977be8d249659c6e4d4ceb6f8f24', 'request_id': 'req-21e281cd-fe17-439c-9bf7-a1157844abf0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:57.891651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-21e281cd-fe17-439c-9bf7-a1157844abf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e942977be8d249659c6e4d4ceb6f8f24', 'request_id': 'req-21e281cd-fe17-439c-9bf7-a1157844abf0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:57.994171 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2331/4737] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:57 2022] POST /identity/v3/projects => generated 408 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:58.018980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c33a6-f20b-4d0e-9fe9-1e331e7d565b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:58.021772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c33a6-f20b-4d0e-9fe9-1e331e7d565b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:58.022261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c33a6-f20b-4d0e-9fe9-1e331e7d565b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:58.023666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-21e281cd-fe17-439c-9bf7-a1157844abf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e942977be8d249659c6e4d4ceb6f8f24', 'request_id': 'req-21e281cd-fe17-439c-9bf7-a1157844abf0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:58.041797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-21e281cd-fe17-439c-9bf7-a1157844abf0 admin admin] The token cache is being invalidate because project e942977be8d249659c6e4d4ceb6f8f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:58.042140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-21e281cd-fe17-439c-9bf7-a1157844abf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:58.043355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-21e281cd-fe17-439c-9bf7-a1157844abf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:58.046897 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2407/4738] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:57 2022] DELETE /identity/v3/projects/e942977be8d249659c6e4d4ceb6f8f24 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:58.047911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e281cd-fe17-439c-9bf7-a1157844abf0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:58.054579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-21e281cd-fe17-439c-9bf7-a1157844abf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:58.073222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e82c33a6-f20b-4d0e-9fe9-1e331e7d565b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:58.075488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e82c33a6-f20b-4d0e-9fe9-1e331e7d565b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:58.196815 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2332/4739] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:58.201593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8df06-2f7c-4e44-a5ab-4d548bee2232 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:58.201939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8df06-2f7c-4e44-a5ab-4d548bee2232 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:58.202291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8df06-2f7c-4e44-a5ab-4d548bee2232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:58.239801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e281cd-fe17-439c-9bf7-a1157844abf0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:58.265379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a3d8df06-2f7c-4e44-a5ab-4d548bee2232 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:58.269662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a3d8df06-2f7c-4e44-a5ab-4d548bee2232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:58.301133 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2333/4740] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:58.304389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c3db0-a43c-4a67-a13d-82b8472f1596 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:58.304975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c3db0-a43c-4a67-a13d-82b8472f1596 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:58.305958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c3db0-a43c-4a67-a13d-82b8472f1596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:58.336816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-598c3db0-a43c-4a67-a13d-82b8472f1596 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:58.338216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-598c3db0-a43c-4a67-a13d-82b8472f1596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:58.349082 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2334/4741] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:58.353967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c3db0-a43c-4a67-a13d-82b8472f1596 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:58.356132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-598c3db0-a43c-4a67-a13d-82b8472f1596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:58.374827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c3db0-a43c-4a67-a13d-82b8472f1596 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:58.380680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a60181-d25b-47a5-89ae-7b4ea10d6f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:58.381855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a60181-d25b-47a5-89ae-7b4ea10d6f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:58.382395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a60181-d25b-47a5-89ae-7b4ea10d6f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:58.382996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a60181-d25b-47a5-89ae-7b4ea10d6f36 admin admin] PATH_INFO: `/v3/projects/9a294093d8594c93a7af3e7550a145c1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:58.384888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a60181-d25b-47a5-89ae-7b4ea10d6f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a294093d8594c93a7af3e7550a145c1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:58.389889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a60181-d25b-47a5-89ae-7b4ea10d6f36 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:58.395041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce43dd-93d2-472a-b6d2-2f34972cb7f5 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:58.396009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce43dd-93d2-472a-b6d2-2f34972cb7f5 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:58.396339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce43dd-93d2-472a-b6d2-2f34972cb7f5 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:58.396633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce43dd-93d2-472a-b6d2-2f34972cb7f5 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:58.397392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce43dd-93d2-472a-b6d2-2f34972cb7f5 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:58.406126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce43dd-93d2-472a-b6d2-2f34972cb7f5 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:58.556083 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2408/4742] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:58 2022] POST /identity/v3/projects => generated 402 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:58.556083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1d320-dd70-43a8-ace5-991c7d2b664b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:58.556083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1d320-dd70-43a8-ace5-991c7d2b664b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:58.556083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1d320-dd70-43a8-ace5-991c7d2b664b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:58.564085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d2a60181-d25b-47a5-89ae-7b4ea10d6f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a294093d8594c93a7af3e7550a145c1', 'request_id': 'req-d2a60181-d25b-47a5-89ae-7b4ea10d6f36'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:58.569594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:58.572391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d2a60181-d25b-47a5-89ae-7b4ea10d6f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a294093d8594c93a7af3e7550a145c1', 'request_id': 'req-d2a60181-d25b-47a5-89ae-7b4ea10d6f36'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:58.584677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d2a60181-d25b-47a5-89ae-7b4ea10d6f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a294093d8594c93a7af3e7550a145c1', 'request_id': 'req-d2a60181-d25b-47a5-89ae-7b4ea10d6f36'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:58.586684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b8c1d320-dd70-43a8-ace5-991c7d2b664b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:58.588114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b8c1d320-dd70-43a8-ace5-991c7d2b664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:58.656770 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2409/4743] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:58.657563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1d320-dd70-43a8-ace5-991c7d2b664b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:58.672062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1d320-dd70-43a8-ace5-991c7d2b664b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:58.684198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec149c-b715-408c-9f23-5bc2a3954286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:58.685358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec149c-b715-408c-9f23-5bc2a3954286 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:58.685358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec149c-b715-408c-9f23-5bc2a3954286 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:58.685681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec149c-b715-408c-9f23-5bc2a3954286 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:58.686490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec149c-b715-408c-9f23-5bc2a3954286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:58.686888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec149c-b715-408c-9f23-5bc2a3954286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:58.689328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec149c-b715-408c-9f23-5bc2a3954286 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:58.702201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d2a60181-d25b-47a5-89ae-7b4ea10d6f36 admin admin] The token cache is being invalidate because project 9a294093d8594c93a7af3e7550a145c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:58.705118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d2a60181-d25b-47a5-89ae-7b4ea10d6f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:58.705118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d2a60181-d25b-47a5-89ae-7b4ea10d6f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:58.705118 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2335/4744] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:58 2022] DELETE /identity/v3/projects/9a294093d8594c93a7af3e7550a145c1 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:58.713464 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2410/4745] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:58.715090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5a9a8-b4da-4b80-9adf-c2da4171f82d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:58.715386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5a9a8-b4da-4b80-9adf-c2da4171f82d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:58.715665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5a9a8-b4da-4b80-9adf-c2da4171f82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:58.716607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec149c-b715-408c-9f23-5bc2a3954286 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:58.720011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-15ec149c-b715-408c-9f23-5bc2a3954286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:58.722977 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-1be5a9a8-b4da-4b80-9adf-c2da4171f82d None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:49:58.722977 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:49:58.722977 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:49:58.722977 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:49:58.722977 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:49:58.722977 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:49:58.722977 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:49:58.722977 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:49:58.722977 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:49:58.722977 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:49:58.722977 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:49:58.722977 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:49:58.722977 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:49:58.723921 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:49:58.723921 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:49:58.723921 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:49:58.723921 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:49:58.723921 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:49:58.723921 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:49:58.723921 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:49:58.723921 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:49:58.723921 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:49:58.723921 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:49:58.723921 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:49:58.723921 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:49:58.723921 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:49:58.723921 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:49:58.723921 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:49:58.724895 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2336/4746] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:49:58 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 19 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:49:58.741675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5a9a8-b4da-4b80-9adf-c2da4171f82d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:58.771334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1be5a9a8-b4da-4b80-9adf-c2da4171f82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:58.795373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5a9a8-b4da-4b80-9adf-c2da4171f82d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:58.820935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c3783-6e98-4829-92d0-9ee87603865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:58.821744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c3783-6e98-4829-92d0-9ee87603865b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:58.822130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c3783-6e98-4829-92d0-9ee87603865b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:58.822508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c3783-6e98-4829-92d0-9ee87603865b admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:58.823277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c3783-6e98-4829-92d0-9ee87603865b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:58.823724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c3783-6e98-4829-92d0-9ee87603865b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:58.831409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c3783-6e98-4829-92d0-9ee87603865b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:58.852369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec149c-b715-408c-9f23-5bc2a3954286 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:58.859476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:58.863126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:58.863126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:58.863126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/c0a32a1f599a4b529dd34ab162d01ba8` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:58.863770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c0a32a1f599a4b529dd34ab162d01ba8)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:58.866224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:58.876671 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2337/4747] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:58.876671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0d9bb-936f-43f8-ae7c-ed505d48447d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:58.876671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0d9bb-936f-43f8-ae7c-ed505d48447d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:58.876671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0d9bb-936f-43f8-ae7c-ed505d48447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:58.926016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d0e0d9bb-936f-43f8-ae7c-ed505d48447d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:58.929669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d0e0d9bb-936f-43f8-ae7c-ed505d48447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:58.953237 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2338/4748] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:58.954667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0d9bb-936f-43f8-ae7c-ed505d48447d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:58.956223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d0e0d9bb-936f-43f8-ae7c-ed505d48447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:58.982000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0d9bb-936f-43f8-ae7c-ed505d48447d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:58.985752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468de96-1895-41fa-8b90-e65377777b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:58.986381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468de96-1895-41fa-8b90-e65377777b1c admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:58.986687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468de96-1895-41fa-8b90-e65377777b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:58.986964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468de96-1895-41fa-8b90-e65377777b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:58.987628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468de96-1895-41fa-8b90-e65377777b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:58.989985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468de96-1895-41fa-8b90-e65377777b1c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:59.036850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a32a1f599a4b529dd34ab162d01ba8', 'request_id': 'req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:59.046107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a32a1f599a4b529dd34ab162d01ba8', 'request_id': 'req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:59.096013 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2339/4749] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:58 2022] POST /identity/v3/projects => generated 399 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:59.098418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e76dd1-24b7-47fb-a6e1-e7c5cc758f81 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:59.099000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e76dd1-24b7-47fb-a6e1-e7c5cc758f81 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:59.101279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e76dd1-24b7-47fb-a6e1-e7c5cc758f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:59.124811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:59.133460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c2e76dd1-24b7-47fb-a6e1-e7c5cc758f81 None None] MFA Rules not processed for user `1599979f94f34b579e3cd4ac963de1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:59.135101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c2e76dd1-24b7-47fb-a6e1-e7c5cc758f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:59.198898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a32a1f599a4b529dd34ab162d01ba8', 'request_id': 'req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:59.222632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] The token cache is being invalidate because project c0a32a1f599a4b529dd34ab162d01ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:49:59.223740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:59.224922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:49:59.226400 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2411/4750] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:58 2022] DELETE /identity/v3/projects/c0a32a1f599a4b529dd34ab162d01ba8 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:49:59.228505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:59.237555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:59.298373 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2340/4751] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:59.304563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a51eb-d82a-443d-b3b5-cc6a1f788f8e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:59.304852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a51eb-d82a-443d-b3b5-cc6a1f788f8e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:59.305140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a51eb-d82a-443d-b3b5-cc6a1f788f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:59.323701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1922e-ca50-4eb1-aeee-45974ffa9ec6 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:59.364654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-980a51eb-d82a-443d-b3b5-cc6a1f788f8e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:49:59.366127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-980a51eb-d82a-443d-b3b5-cc6a1f788f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:59.414937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6016a8f-888a-4bb3-954f-b18b154a5d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:59.416293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6016a8f-888a-4bb3-954f-b18b154a5d81 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:59.416846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6016a8f-888a-4bb3-954f-b18b154a5d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:59.417214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6016a8f-888a-4bb3-954f-b18b154a5d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:59.417999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6016a8f-888a-4bb3-954f-b18b154a5d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:59.422456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6016a8f-888a-4bb3-954f-b18b154a5d81 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:59.499547 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2341/4752] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:49:59.501844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a51eb-d82a-443d-b3b5-cc6a1f788f8e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:59.504466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-980a51eb-d82a-443d-b3b5-cc6a1f788f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:59.522063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a51eb-d82a-443d-b3b5-cc6a1f788f8e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:59.528414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ca1a9-97c5-41f4-85fc-97dd9ee95cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:59.530731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ca1a9-97c5-41f4-85fc-97dd9ee95cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:59.530731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ca1a9-97c5-41f4-85fc-97dd9ee95cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:59.530731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ca1a9-97c5-41f4-85fc-97dd9ee95cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:59.530731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ca1a9-97c5-41f4-85fc-97dd9ee95cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:59.532754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ca1a9-97c5-41f4-85fc-97dd9ee95cb1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:59.679443 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2412/4753] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:49:59 2022] POST /identity/v3/projects => generated 371 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:59.679443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6016a8f-888a-4bb3-954f-b18b154a5d81 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:59.681505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b6016a8f-888a-4bb3-954f-b18b154a5d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:49:59.721932 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2342/4754] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:59 2022] POST /identity/v3/users => generated 300 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:49:59.721932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ca1a9-97c5-41f4-85fc-97dd9ee95cb1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:59.739558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ca1a9-97c5-41f4-85fc-97dd9ee95cb1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:59.770990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6016a8f-888a-4bb3-954f-b18b154a5d81 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:59.782633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b35e0-99d3-452d-ae74-2d746457e5a1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:59.783576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b35e0-99d3-452d-ae74-2d746457e5a1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:59.785344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b35e0-99d3-452d-ae74-2d746457e5a1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:59.788750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b35e0-99d3-452d-ae74-2d746457e5a1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/afc63f84624d4ab8ab4ba1b0ce69f7e7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:59.788750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b35e0-99d3-452d-ae74-2d746457e5a1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:delete_project(project_id=afc63f84624d4ab8ab4ba1b0ce69f7e7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:59.790208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b35e0-99d3-452d-ae74-2d746457e5a1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:59.810700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:49:59.826483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb561a6f-34eb-4aa8-8e7d-9a0f0e6f0800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:59.827222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb561a6f-34eb-4aa8-8e7d-9a0f0e6f0800 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:59.827574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb561a6f-34eb-4aa8-8e7d-9a0f0e6f0800 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:59.827897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb561a6f-34eb-4aa8-8e7d-9a0f0e6f0800 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:59.828659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb561a6f-34eb-4aa8-8e7d-9a0f0e6f0800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:49:59.829033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb561a6f-34eb-4aa8-8e7d-9a0f0e6f0800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:59.830789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb561a6f-34eb-4aa8-8e7d-9a0f0e6f0800 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:49:59.844268 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2343/4755] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:49:59.845360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb561a6f-34eb-4aa8-8e7d-9a0f0e6f0800 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:49:59.856696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb561a6f-34eb-4aa8-8e7d-9a0f0e6f0800 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:49:59.862092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2226f7-4fb8-4786-bfa7-4dee666c2efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:49:59.862713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2226f7-4fb8-4786-bfa7-4dee666c2efc admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:49:59.862996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2226f7-4fb8-4786-bfa7-4dee666c2efc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:49:59.863284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2226f7-4fb8-4786-bfa7-4dee666c2efc admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:49:59.863919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2226f7-4fb8-4786-bfa7-4dee666c2efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:49:59.865923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2226f7-4fb8-4786-bfa7-4dee666c2efc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:00.037916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8e3b35e0-99d3-452d-ae74-2d746457e5a1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afc63f84624d4ab8ab4ba1b0ce69f7e7', 'request_id': 'req-8e3b35e0-99d3-452d-ae74-2d746457e5a1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:00.051223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8e3b35e0-99d3-452d-ae74-2d746457e5a1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afc63f84624d4ab8ab4ba1b0ce69f7e7', 'request_id': 'req-8e3b35e0-99d3-452d-ae74-2d746457e5a1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:00.057831 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2344/4756] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:49:59 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:00.061865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9d8a6-f6b0-4b28-bb8e-52ac755ec509 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:00.062279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9d8a6-f6b0-4b28-bb8e-52ac755ec509 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:00.062704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9d8a6-f6b0-4b28-bb8e-52ac755ec509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:00.076961 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-61b9d8a6-f6b0-4b28-bb8e-52ac755ec509 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:50:00.076961 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:50:00.076961 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:50:00.076961 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:50:00.076961 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:50:00.076961 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:50:00.076961 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:50:00.076961 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:50:00.076961 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:50:00.076961 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:50:00.076961 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:50:00.076961 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:50:00.076961 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:50:00.082399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:50:00.082399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:50:00.082399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:50:00.082399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:50:00.082399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:50:00.082399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:50:00.082399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:50:00.082399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:50:00.082399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:50:00.082399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:50:00.082399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:50:00.082399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:50:00.082399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:50:00.082399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:50:00.082399 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:50:00.087639 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2345/4757] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:50:00 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 20 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:50:00.087639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9d8a6-f6b0-4b28-bb8e-52ac755ec509 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:00.166866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8e3b35e0-99d3-452d-ae74-2d746457e5a1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afc63f84624d4ab8ab4ba1b0ce69f7e7', 'request_id': 'req-8e3b35e0-99d3-452d-ae74-2d746457e5a1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:00.191994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8e3b35e0-99d3-452d-ae74-2d746457e5a1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] The token cache is being invalidate because project afc63f84624d4ab8ab4ba1b0ce69f7e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:00.192537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8e3b35e0-99d3-452d-ae74-2d746457e5a1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:00.193389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8e3b35e0-99d3-452d-ae74-2d746457e5a1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:00.195112 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2413/4758] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:49:59 2022] DELETE /identity/v3/projects/afc63f84624d4ab8ab4ba1b0ce69f7e7 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:00.196589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b35e0-99d3-452d-ae74-2d746457e5a1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:00.198771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8e3b35e0-99d3-452d-ae74-2d746457e5a1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:00.215490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9d8a6-f6b0-4b28-bb8e-52ac755ec509 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:00.219057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1802e74-e59a-4f21-abbe-c13bbf90b177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:00.219742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802e74-e59a-4f21-abbe-c13bbf90b177 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:00.220006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802e74-e59a-4f21-abbe-c13bbf90b177 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:00.220288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802e74-e59a-4f21-abbe-c13bbf90b177 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:00.223479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b35e0-99d3-452d-ae74-2d746457e5a1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:00.223727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1802e74-e59a-4f21-abbe-c13bbf90b177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:00.225192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1802e74-e59a-4f21-abbe-c13bbf90b177 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:00.230971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e860587-436e-4ffe-b626-c64c4c1abdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:00.232131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e860587-436e-4ffe-b626-c64c4c1abdaa admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:00.232804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e860587-436e-4ffe-b626-c64c4c1abdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:00.233599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e860587-436e-4ffe-b626-c64c4c1abdaa admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:00.234304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e860587-436e-4ffe-b626-c64c4c1abdaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:00.236829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e860587-436e-4ffe-b626-c64c4c1abdaa admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:00.239296 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2346/4759] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:00.239984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1802e74-e59a-4f21-abbe-c13bbf90b177 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:00.241772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b1802e74-e59a-4f21-abbe-c13bbf90b177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:00.258231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1802e74-e59a-4f21-abbe-c13bbf90b177 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:00.263987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c8646-6546-4477-ba33-a14736541a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:00.264872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c8646-6546-4477-ba33-a14736541a86 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:00.265156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c8646-6546-4477-ba33-a14736541a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:00.265437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c8646-6546-4477-ba33-a14736541a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:00.266154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c8646-6546-4477-ba33-a14736541a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:00.268400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c8646-6546-4477-ba33-a14736541a86 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:00.284105 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2347/4760] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:00.284105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c8646-6546-4477-ba33-a14736541a86 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:00.284105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-187c8646-6546-4477-ba33-a14736541a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:00.377860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c8646-6546-4477-ba33-a14736541a86 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:00.382629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722f97f-108d-4c71-852b-d6315d5a08d1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:00.383271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722f97f-108d-4c71-852b-d6315d5a08d1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:00.383556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722f97f-108d-4c71-852b-d6315d5a08d1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:00.383839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722f97f-108d-4c71-852b-d6315d5a08d1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/domains/aacd7053ed1e4e008ce0566bf1a998e6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:00.385144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722f97f-108d-4c71-852b-d6315d5a08d1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=aacd7053ed1e4e008ce0566bf1a998e6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:00.386862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722f97f-108d-4c71-852b-d6315d5a08d1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:00.417914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3722f97f-108d-4c71-852b-d6315d5a08d1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'aacd7053ed1e4e008ce0566bf1a998e6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:00.417914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3722f97f-108d-4c71-852b-d6315d5a08d1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'aacd7053ed1e4e008ce0566bf1a998e6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:00.425073 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2414/4761] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:00 2022] POST /identity/v3/projects => generated 369 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:00.427247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e860587-436e-4ffe-b626-c64c4c1abdaa admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:00.429495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1e860587-436e-4ffe-b626-c64c4c1abdaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:00.515758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e860587-436e-4ffe-b626-c64c4c1abdaa admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:00.520585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f2132-ac62-4f81-b173-8518619c08f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:00.521216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f2132-ac62-4f81-b173-8518619c08f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:00.528974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f2132-ac62-4f81-b173-8518619c08f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:00.529327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f2132-ac62-4f81-b173-8518619c08f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:00.530051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f2132-ac62-4f81-b173-8518619c08f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:00.532649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f2132-ac62-4f81-b173-8518619c08f6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:00.548862 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2415/4762] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:00.549922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f2132-ac62-4f81-b173-8518619c08f6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:00.551640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3b7f2132-ac62-4f81-b173-8518619c08f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:00.565071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f2132-ac62-4f81-b173-8518619c08f6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:00.570739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04c51f-013f-4c08-a877-afa2af7db4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:00.571355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04c51f-013f-4c08-a877-afa2af7db4ab admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:00.571687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04c51f-013f-4c08-a877-afa2af7db4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:00.571997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04c51f-013f-4c08-a877-afa2af7db4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:00.572674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04c51f-013f-4c08-a877-afa2af7db4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:00.574383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04c51f-013f-4c08-a877-afa2af7db4ab admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:00.582858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3722f97f-108d-4c71-852b-d6315d5a08d1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'aacd7053ed1e4e008ce0566bf1a998e6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:00.583541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3722f97f-108d-4c71-852b-d6315d5a08d1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'aacd7053ed1e4e008ce0566bf1a998e6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:00.585404 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2416/4763] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:00.586708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04c51f-013f-4c08-a877-afa2af7db4ab admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:00.591268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0b04c51f-013f-4c08-a877-afa2af7db4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:00.595265 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2348/4764] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:50:00 2022] PATCH /identity/v3/domains/aacd7053ed1e4e008ce0566bf1a998e6 => generated 277 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:00.597776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722f97f-108d-4c71-852b-d6315d5a08d1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:00.601718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3722f97f-108d-4c71-852b-d6315d5a08d1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:00.605859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04c51f-013f-4c08-a877-afa2af7db4ab admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:00.611008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf6a34-c3aa-4541-b12f-2bdb3ca2548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:00.611697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf6a34-c3aa-4541-b12f-2bdb3ca2548e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:00.612048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf6a34-c3aa-4541-b12f-2bdb3ca2548e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:00.612547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf6a34-c3aa-4541-b12f-2bdb3ca2548e admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:00.613898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf6a34-c3aa-4541-b12f-2bdb3ca2548e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:00.615977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf6a34-c3aa-4541-b12f-2bdb3ca2548e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:00.738730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722f97f-108d-4c71-852b-d6315d5a08d1 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:00.754179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8d7e4-c8d5-4cfa-979d-99bb5252f043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:00.754179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8d7e4-c8d5-4cfa-979d-99bb5252f043 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:00.754179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8d7e4-c8d5-4cfa-979d-99bb5252f043 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:00.754179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8d7e4-c8d5-4cfa-979d-99bb5252f043 admin admin] PATH_INFO: `/v3/projects/0b549ab7e4c4464faad13315578de2df/users/83483a87309d41c3be2d297fc918c2f2/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:00.760847 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2417/4765] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:00 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:00.762428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf6a34-c3aa-4541-b12f-2bdb3ca2548e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:00.765381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8d7e4-c8d5-4cfa-979d-99bb5252f043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b549ab7e4c4464faad13315578de2df, user_id=83483a87309d41c3be2d297fc918c2f2, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:00.768287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8d7e4-c8d5-4cfa-979d-99bb5252f043 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:00.769956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-82cf6a34-c3aa-4541-b12f-2bdb3ca2548e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:00.786924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf6a34-c3aa-4541-b12f-2bdb3ca2548e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:00.795671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d9647-cbfe-4940-92d7-207598095ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:00.796393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d9647-cbfe-4940-92d7-207598095ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:00.796672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d9647-cbfe-4940-92d7-207598095ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:00.796992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d9647-cbfe-4940-92d7-207598095ddc admin admin] PATH_INFO: `/v3/projects/4154168022a54748b78538e321aea82b/users/09979a7621a24c0fb95bd48716c38048/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:00.819618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d9647-cbfe-4940-92d7-207598095ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4154168022a54748b78538e321aea82b, user_id=09979a7621a24c0fb95bd48716c38048, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:00.822975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d9647-cbfe-4940-92d7-207598095ddc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:00.857466 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2349/4766] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:00 2022] PUT /identity/v3/projects/0b549ab7e4c4464faad13315578de2df/users/83483a87309d41c3be2d297fc918c2f2/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:00.857466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8d7e4-c8d5-4cfa-979d-99bb5252f043 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:00.868838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cbd8d7e4-c8d5-4cfa-979d-99bb5252f043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:00.951633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8d7e4-c8d5-4cfa-979d-99bb5252f043 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:00.958966 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2418/4767] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:00 2022] PUT /identity/v3/projects/4154168022a54748b78538e321aea82b/users/09979a7621a24c0fb95bd48716c38048/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:00.959883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d9647-cbfe-4940-92d7-207598095ddc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:01.031213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:01.031884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:01.032194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:01.032741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/domains/aacd7053ed1e4e008ce0566bf1a998e6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:01.046832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=aacd7053ed1e4e008ce0566bf1a998e6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:01.049005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:01.091432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d9647-cbfe-4940-92d7-207598095ddc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:01.103424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'aacd7053ed1e4e008ce0566bf1a998e6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:01.105331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fc631-c60e-4e77-a9d8-8db927c7ab00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:01.105962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fc631-c60e-4e77-a9d8-8db927c7ab00 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:01.106243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fc631-c60e-4e77-a9d8-8db927c7ab00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:01.106518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fc631-c60e-4e77-a9d8-8db927c7ab00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:01.107319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fc631-c60e-4e77-a9d8-8db927c7ab00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:01.108960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fc631-c60e-4e77-a9d8-8db927c7ab00 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:01.113687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'aacd7053ed1e4e008ce0566bf1a998e6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:01.117525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:01.138578 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2419/4768] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:01.139341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801940f1-ec00-4368-ae63-f0c2747dc962 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:01.139827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801940f1-ec00-4368-ae63-f0c2747dc962 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:01.139966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801940f1-ec00-4368-ae63-f0c2747dc962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:01.171406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:01.199556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-801940f1-ec00-4368-ae63-f0c2747dc962 None None] MFA Rules not processed for user `83483a87309d41c3be2d297fc918c2f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:01.201315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-801940f1-ec00-4368-ae63-f0c2747dc962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:01.277643 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2420/4769] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:01.279129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb14b4e-e0af-4b45-bb01-2d56603189cc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:01.279625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb14b4e-e0af-4b45-bb01-2d56603189cc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:01.279970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb14b4e-e0af-4b45-bb01-2d56603189cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:01.319918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-deb14b4e-e0af-4b45-bb01-2d56603189cc None None] MFA Rules not processed for user `09979a7621a24c0fb95bd48716c38048`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:01.321564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-deb14b4e-e0af-4b45-bb01-2d56603189cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:01.328487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aacd7053ed1e4e008ce0566bf1a998e6', 'request_id': 'req-78c17c83-37b4-4d59-b753-54d8c21c93fb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:01.356284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aacd7053ed1e4e008ce0566bf1a998e6', 'request_id': 'req-78c17c83-37b4-4d59-b753-54d8c21c93fb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:01.364878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aacd7053ed1e4e008ce0566bf1a998e6', 'request_id': 'req-78c17c83-37b4-4d59-b753-54d8c21c93fb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:01.437832 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2421/4770] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:01.437832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb14b4e-e0af-4b45-bb01-2d56603189cc None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:01.508289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] The token cache is being invalidate because project aacd7053ed1e4e008ce0566bf1a998e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:01.508586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:01.511944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:01.539042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'aacd7053ed1e4e008ce0566bf1a998e6', 'request_id': 'req-78c17c83-37b4-4d59-b753-54d8c21c93fb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:01.548667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'aacd7053ed1e4e008ce0566bf1a998e6', 'request_id': 'req-78c17c83-37b4-4d59-b753-54d8c21c93fb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:01.550384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'aacd7053ed1e4e008ce0566bf1a998e6', 'request_id': 'req-78c17c83-37b4-4d59-b753-54d8c21c93fb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:01.554036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb14b4e-e0af-4b45-bb01-2d56603189cc None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:01.571436 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2350/4771] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:50:00 2022] DELETE /identity/v3/domains/aacd7053ed1e4e008ce0566bf1a998e6 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:01.572664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:01.575777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:01.578877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331dfb08-e621-4c18-bde0-eb2205121992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:01.579509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dfb08-e621-4c18-bde0-eb2205121992 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:01.579792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dfb08-e621-4c18-bde0-eb2205121992 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:01.580061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dfb08-e621-4c18-bde0-eb2205121992 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:01.580755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331dfb08-e621-4c18-bde0-eb2205121992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:01.582342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331dfb08-e621-4c18-bde0-eb2205121992 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:01.595693 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2422/4772] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:01.600979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331dfb08-e621-4c18-bde0-eb2205121992 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:01.603262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c17c83-37b4-4d59-b753-54d8c21c93fb tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:01.608563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-331dfb08-e621-4c18-bde0-eb2205121992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:01.612889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6221c57-fb96-4d35-ba82-d0e1f856d995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:01.613867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6221c57-fb96-4d35-ba82-d0e1f856d995 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:01.614468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6221c57-fb96-4d35-ba82-d0e1f856d995 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:01.617241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6221c57-fb96-4d35-ba82-d0e1f856d995 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:01.634566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6221c57-fb96-4d35-ba82-d0e1f856d995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:01.637896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6221c57-fb96-4d35-ba82-d0e1f856d995 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:01.638337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331dfb08-e621-4c18-bde0-eb2205121992 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:01.656549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408ae5e-bfcb-4d42-96ca-c53b32e1b6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:01.657837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408ae5e-bfcb-4d42-96ca-c53b32e1b6ea admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:01.658114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408ae5e-bfcb-4d42-96ca-c53b32e1b6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:01.658383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408ae5e-bfcb-4d42-96ca-c53b32e1b6ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:01.659076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408ae5e-bfcb-4d42-96ca-c53b32e1b6ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:01.661469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408ae5e-bfcb-4d42-96ca-c53b32e1b6ea admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:01.850711 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2423/4773] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:01 2022] POST /identity/v3/projects => generated 371 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:01.850711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408ae5e-bfcb-4d42-96ca-c53b32e1b6ea admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:01.853816 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2351/4774] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:01 2022] POST /identity/v3/projects => generated 399 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:01.857621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6221c57-fb96-4d35-ba82-d0e1f856d995 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:01.858280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e408ae5e-bfcb-4d42-96ca-c53b32e1b6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:01.860375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a6221c57-fb96-4d35-ba82-d0e1f856d995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:01.990352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408ae5e-bfcb-4d42-96ca-c53b32e1b6ea admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:01.998079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6221c57-fb96-4d35-ba82-d0e1f856d995 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:02.005413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a86bd7-ff11-4810-a912-c9131d9fd906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:02.006346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a86bd7-ff11-4810-a912-c9131d9fd906 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:02.006634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a86bd7-ff11-4810-a912-c9131d9fd906 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:02.006915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a86bd7-ff11-4810-a912-c9131d9fd906 admin admin] PATH_INFO: `/v3/projects/fdc86b7f0afd4ff5a178a8ccd599c630/users/9d5c4e307d804d7baf7c16a956f11173/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:02.029153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a86bd7-ff11-4810-a912-c9131d9fd906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc86b7f0afd4ff5a178a8ccd599c630, user_id=9d5c4e307d804d7baf7c16a956f11173, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:02.033699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a86bd7-ff11-4810-a912-c9131d9fd906 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:02.116053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea43fa3-89b5-4c78-80ef-f6a50490d8ed tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:02.119438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea43fa3-89b5-4c78-80ef-f6a50490d8ed tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:02.119813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea43fa3-89b5-4c78-80ef-f6a50490d8ed tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:02.120103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea43fa3-89b5-4c78-80ef-f6a50490d8ed tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:02.120845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea43fa3-89b5-4c78-80ef-f6a50490d8ed tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:02.125087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea43fa3-89b5-4c78-80ef-f6a50490d8ed tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:02.150338 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2352/4775] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:01 2022] PUT /identity/v3/projects/fdc86b7f0afd4ff5a178a8ccd599c630/users/9d5c4e307d804d7baf7c16a956f11173/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:02.163933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a86bd7-ff11-4810-a912-c9131d9fd906 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:02.250772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a86bd7-ff11-4810-a912-c9131d9fd906 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:02.257781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83589f06-a081-4bc7-8535-b8f00e762a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:02.258999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83589f06-a081-4bc7-8535-b8f00e762a60 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:02.258999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83589f06-a081-4bc7-8535-b8f00e762a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:02.259218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83589f06-a081-4bc7-8535-b8f00e762a60 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:02.259794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83589f06-a081-4bc7-8535-b8f00e762a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:02.262035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83589f06-a081-4bc7-8535-b8f00e762a60 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:02.367288 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2424/4776] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:01 2022] POST /identity/v3/projects => generated 377 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:02.368478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea43fa3-89b5-4c78-80ef-f6a50490d8ed tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:02.403918 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2353/4777] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:02 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:02.407166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2eccaa-38bf-4826-b7e2-ca5a550ed35c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:02.407646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2eccaa-38bf-4826-b7e2-ca5a550ed35c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:02.408108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2eccaa-38bf-4826-b7e2-ca5a550ed35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:02.459880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5c2eccaa-38bf-4826-b7e2-ca5a550ed35c None None] MFA Rules not processed for user `9d5c4e307d804d7baf7c16a956f11173`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:02.466034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5c2eccaa-38bf-4826-b7e2-ca5a550ed35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:02.506950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea43fa3-89b5-4c78-80ef-f6a50490d8ed tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:02.519497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b2428-6e31-4c2b-95c6-a97f9b405260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:02.521629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b2428-6e31-4c2b-95c6-a97f9b405260 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:02.522203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b2428-6e31-4c2b-95c6-a97f9b405260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:02.522755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b2428-6e31-4c2b-95c6-a97f9b405260 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:02.528744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b2428-6e31-4c2b-95c6-a97f9b405260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:02.531904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b2428-6e31-4c2b-95c6-a97f9b405260 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:02.600470 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2354/4778] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:02.601537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2eccaa-38bf-4826-b7e2-ca5a550ed35c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:02.681354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:02.682248 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2425/4779] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:02 2022] POST /identity/v3/users => generated 306 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:02.684154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b2428-6e31-4c2b-95c6-a97f9b405260 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:02.706430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b2428-6e31-4c2b-95c6-a97f9b405260 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:02.714835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31874e47-0aab-44b5-92e1-892f0fb3ef6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:02.715489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31874e47-0aab-44b5-92e1-892f0fb3ef6c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:02.715765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31874e47-0aab-44b5-92e1-892f0fb3ef6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:02.716052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31874e47-0aab-44b5-92e1-892f0fb3ef6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:02.716742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31874e47-0aab-44b5-92e1-892f0fb3ef6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:02.719830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31874e47-0aab-44b5-92e1-892f0fb3ef6c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:02.742592 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2426/4780] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:02.743645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31874e47-0aab-44b5-92e1-892f0fb3ef6c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:02.762831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31874e47-0aab-44b5-92e1-892f0fb3ef6c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:02.768900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af1bdb-fab1-4438-9be9-fcdcffa58c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:02.770087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af1bdb-fab1-4438-9be9-fcdcffa58c4a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:02.770430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af1bdb-fab1-4438-9be9-fcdcffa58c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:02.771761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af1bdb-fab1-4438-9be9-fcdcffa58c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:02.772933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af1bdb-fab1-4438-9be9-fcdcffa58c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:02.776010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af1bdb-fab1-4438-9be9-fcdcffa58c4a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:02.780277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2eccaa-38bf-4826-b7e2-ca5a550ed35c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:02.787937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c7a87-117d-4740-99f0-3f8873ab5120 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:02.788898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c7a87-117d-4740-99f0-3f8873ab5120 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:02.789364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c7a87-117d-4740-99f0-3f8873ab5120 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:02.789799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c7a87-117d-4740-99f0-3f8873ab5120 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/e133334dba8a4057bd3ebb686b9cae5e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:02.791930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c7a87-117d-4740-99f0-3f8873ab5120 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:get_project(project_id=e133334dba8a4057bd3ebb686b9cae5e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:02.795017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c7a87-117d-4740-99f0-3f8873ab5120 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:02.798179 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2355/4781] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:50:02 2022] GET /identity/v3/projects/e133334dba8a4057bd3ebb686b9cae5e => generated 377 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:02.799266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c7a87-117d-4740-99f0-3f8873ab5120 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:02.814328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c7a87-117d-4740-99f0-3f8873ab5120 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:02.833270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dc733-6185-4e88-9e4b-a051cf012194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:02.834243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dc733-6185-4e88-9e4b-a051cf012194 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:02.835214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dc733-6185-4e88-9e4b-a051cf012194 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:02.835853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dc733-6185-4e88-9e4b-a051cf012194 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:02.837620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dc733-6185-4e88-9e4b-a051cf012194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:02.840757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dc733-6185-4e88-9e4b-a051cf012194 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:02.856074 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2356/4782] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:02.857217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dc733-6185-4e88-9e4b-a051cf012194 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:02.869756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dc733-6185-4e88-9e4b-a051cf012194 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:02.876598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1b0d6-54b9-4dc0-ba6e-1e678c144121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:02.877569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1b0d6-54b9-4dc0-ba6e-1e678c144121 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:02.878304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1b0d6-54b9-4dc0-ba6e-1e678c144121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:02.878742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1b0d6-54b9-4dc0-ba6e-1e678c144121 admin admin] PATH_INFO: `/v3/projects/725a578a14244fec84d2138e48ede87f/users/6b5ab3e42c814226861773763e63f62d/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:02.905177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1b0d6-54b9-4dc0-ba6e-1e678c144121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=725a578a14244fec84d2138e48ede87f, user_id=6b5ab3e42c814226861773763e63f62d, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:02.908619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1b0d6-54b9-4dc0-ba6e-1e678c144121 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:02.912801 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2427/4783] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:02 2022] POST /identity/v3/projects => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:02.913604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af1bdb-fab1-4438-9be9-fcdcffa58c4a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:02.999958 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2357/4784] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:02 2022] PUT /identity/v3/projects/725a578a14244fec84d2138e48ede87f/users/6b5ab3e42c814226861773763e63f62d/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:03.001405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1b0d6-54b9-4dc0-ba6e-1e678c144121 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:03.070789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af1bdb-fab1-4438-9be9-fcdcffa58c4a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:03.107131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1b0d6-54b9-4dc0-ba6e-1e678c144121 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:03.113170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:03.121425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b398c-bb05-4e80-9158-925cd4325aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:03.134861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b398c-bb05-4e80-9158-925cd4325aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:03.147249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b398c-bb05-4e80-9158-925cd4325aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:03.152217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b398c-bb05-4e80-9158-925cd4325aa5 admin admin] PATH_INFO: `/v3/projects/20ca47dcaedf4a068cad976368103a0e/users/69a851c99e944455b8737fdf75b623bc/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:03.191006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b398c-bb05-4e80-9158-925cd4325aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20ca47dcaedf4a068cad976368103a0e, user_id=69a851c99e944455b8737fdf75b623bc, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:03.193927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b398c-bb05-4e80-9158-925cd4325aa5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:03.219180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6a14c-29c6-4c81-a28f-a64bb2b88a18 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:03.219833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6a14c-29c6-4c81-a28f-a64bb2b88a18 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:03.220119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6a14c-29c6-4c81-a28f-a64bb2b88a18 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:03.220427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6a14c-29c6-4c81-a28f-a64bb2b88a18 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:03.221072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6a14c-29c6-4c81-a28f-a64bb2b88a18 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:03.222918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6a14c-29c6-4c81-a28f-a64bb2b88a18 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:03.248551 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2428/4785] 10.222.0.76 () {58 vars in 1131 bytes} [Sat Aug 27 04:50:02 2022] GET /identity/v3/projects => generated 8016 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:03.249621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6a14c-29c6-4c81-a28f-a64bb2b88a18 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:03.262769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6a14c-29c6-4c81-a28f-a64bb2b88a18 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:03.267647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62c6c7-138c-4b10-9e54-197a607683e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:03.268308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62c6c7-138c-4b10-9e54-197a607683e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:03.268592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62c6c7-138c-4b10-9e54-197a607683e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:03.268868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62c6c7-138c-4b10-9e54-197a607683e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:03.269506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62c6c7-138c-4b10-9e54-197a607683e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:03.272099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62c6c7-138c-4b10-9e54-197a607683e8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:03.351921 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2358/4786] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:03 2022] PUT /identity/v3/projects/20ca47dcaedf4a068cad976368103a0e/users/69a851c99e944455b8737fdf75b623bc/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:03.353021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b398c-bb05-4e80-9158-925cd4325aa5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:03.387143 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2429/4787] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:03 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:03.388245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62c6c7-138c-4b10-9e54-197a607683e8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:03.412581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62c6c7-138c-4b10-9e54-197a607683e8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:03.473264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b398c-bb05-4e80-9158-925cd4325aa5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:03.479242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9f072-96f7-4351-874a-045f14476a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:03.480803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9f072-96f7-4351-874a-045f14476a45 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:03.481353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9f072-96f7-4351-874a-045f14476a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:03.482032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9f072-96f7-4351-874a-045f14476a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:03.482883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9f072-96f7-4351-874a-045f14476a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:03.484725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9f072-96f7-4351-874a-045f14476a45 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:03.501696 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2359/4788] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:03.503128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9f072-96f7-4351-874a-045f14476a45 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:03.514566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8dfa8-869a-4c70-afc2-d80ae622b808 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:03.515405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8dfa8-869a-4c70-afc2-d80ae622b808 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:03.515792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8dfa8-869a-4c70-afc2-d80ae622b808 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:03.516188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8dfa8-869a-4c70-afc2-d80ae622b808 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/e133334dba8a4057bd3ebb686b9cae5e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:03.517570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8dfa8-869a-4c70-afc2-d80ae622b808 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e133334dba8a4057bd3ebb686b9cae5e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:03.520044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8dfa8-869a-4c70-afc2-d80ae622b808 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:03.527230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9f072-96f7-4351-874a-045f14476a45 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:03.535898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55cba7-158c-49d5-838e-fb99ffe00874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:03.536719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55cba7-158c-49d5-838e-fb99ffe00874 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:03.537008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55cba7-158c-49d5-838e-fb99ffe00874 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:03.537286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55cba7-158c-49d5-838e-fb99ffe00874 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:03.537944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55cba7-158c-49d5-838e-fb99ffe00874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:03.539752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55cba7-158c-49d5-838e-fb99ffe00874 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:03.552412 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2360/4789] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:03.553507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55cba7-158c-49d5-838e-fb99ffe00874 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:03.568427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55cba7-158c-49d5-838e-fb99ffe00874 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:03.574745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399299ef-3018-44bd-856b-25911d5aa16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:03.574745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399299ef-3018-44bd-856b-25911d5aa16c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:03.574745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399299ef-3018-44bd-856b-25911d5aa16c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:03.575085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399299ef-3018-44bd-856b-25911d5aa16c admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:03.575544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399299ef-3018-44bd-856b-25911d5aa16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:03.577601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399299ef-3018-44bd-856b-25911d5aa16c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:03.590829 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2361/4790] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:03.591703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399299ef-3018-44bd-856b-25911d5aa16c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:03.603284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399299ef-3018-44bd-856b-25911d5aa16c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:03.614669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397b34e-bbdc-4608-ac82-ec3014d4d0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:03.616656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397b34e-bbdc-4608-ac82-ec3014d4d0fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:03.617403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397b34e-bbdc-4608-ac82-ec3014d4d0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:03.619094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397b34e-bbdc-4608-ac82-ec3014d4d0fa admin admin] PATH_INFO: `/v3/projects/725a578a14244fec84d2138e48ede87f/users/6b5ab3e42c814226861773763e63f62d/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:03.623808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397b34e-bbdc-4608-ac82-ec3014d4d0fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=725a578a14244fec84d2138e48ede87f, user_id=6b5ab3e42c814226861773763e63f62d, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:03.629905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397b34e-bbdc-4608-ac82-ec3014d4d0fa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:03.644201 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2362/4791] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:03 2022] PUT /identity/v3/projects/725a578a14244fec84d2138e48ede87f/users/6b5ab3e42c814226861773763e63f62d/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:03.645715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397b34e-bbdc-4608-ac82-ec3014d4d0fa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:03.685122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-05d8dfa8-869a-4c70-afc2-d80ae622b808 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e133334dba8a4057bd3ebb686b9cae5e', 'request_id': 'req-05d8dfa8-869a-4c70-afc2-d80ae622b808'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:03.708286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-05d8dfa8-869a-4c70-afc2-d80ae622b808 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e133334dba8a4057bd3ebb686b9cae5e', 'request_id': 'req-05d8dfa8-869a-4c70-afc2-d80ae622b808'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:03.767171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397b34e-bbdc-4608-ac82-ec3014d4d0fa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:03.831860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-05d8dfa8-869a-4c70-afc2-d80ae622b808 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e133334dba8a4057bd3ebb686b9cae5e', 'request_id': 'req-05d8dfa8-869a-4c70-afc2-d80ae622b808'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:03.851642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-05d8dfa8-869a-4c70-afc2-d80ae622b808 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] The token cache is being invalidate because project e133334dba8a4057bd3ebb686b9cae5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:03.852016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-05d8dfa8-869a-4c70-afc2-d80ae622b808 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:03.855320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-05d8dfa8-869a-4c70-afc2-d80ae622b808 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:03.857484 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2430/4792] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:03 2022] DELETE /identity/v3/projects/e133334dba8a4057bd3ebb686b9cae5e => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:03.865111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8dfa8-869a-4c70-afc2-d80ae622b808 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:03.865111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-05d8dfa8-869a-4c70-afc2-d80ae622b808 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:03.868056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d1973-7371-473f-a852-b3e5d33cb50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:03.868989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d1973-7371-473f-a852-b3e5d33cb50f admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:03.869429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d1973-7371-473f-a852-b3e5d33cb50f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:03.869814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d1973-7371-473f-a852-b3e5d33cb50f admin admin] PATH_INFO: `/v3/projects/20ca47dcaedf4a068cad976368103a0e/users/69a851c99e944455b8737fdf75b623bc/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:03.872189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d1973-7371-473f-a852-b3e5d33cb50f admin admin] RBAC: Authorizing `identity:create_grant(project_id=20ca47dcaedf4a068cad976368103a0e, user_id=69a851c99e944455b8737fdf75b623bc, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:03.875694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d1973-7371-473f-a852-b3e5d33cb50f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:03.897970 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2363/4793] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:03 2022] PUT /identity/v3/projects/20ca47dcaedf4a068cad976368103a0e/users/69a851c99e944455b8737fdf75b623bc/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:03.897970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3d13-6d18-46f0-ac03-d52318a80719 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:03.897970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3d13-6d18-46f0-ac03-d52318a80719 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:03.897970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3d13-6d18-46f0-ac03-d52318a80719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:03.902804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8dfa8-869a-4c70-afc2-d80ae622b808 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:03.951889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-24bb3d13-6d18-46f0-ac03-d52318a80719 None None] MFA Rules not processed for user `6b5ab3e42c814226861773763e63f62d`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:03.953524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-24bb3d13-6d18-46f0-ac03-d52318a80719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:04.005376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf3c85-2d0a-4e7a-8eab-04a1e5a1f16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:04.006236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3c85-2d0a-4e7a-8eab-04a1e5a1f16a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:04.008336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3c85-2d0a-4e7a-8eab-04a1e5a1f16a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:04.013883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3c85-2d0a-4e7a-8eab-04a1e5a1f16a admin admin] PATH_INFO: `/v3/projects/69d9e47688d94130aafbf3c225513d2f/users/55e3be7cd3654666b5dbcbfc831adb1b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:04.033899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf3c85-2d0a-4e7a-8eab-04a1e5a1f16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d9e47688d94130aafbf3c225513d2f, user_id=55e3be7cd3654666b5dbcbfc831adb1b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:04.036797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf3c85-2d0a-4e7a-8eab-04a1e5a1f16a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:04.053953 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2364/4794] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:04.059082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb3d13-6d18-46f0-ac03-d52318a80719 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:04.059082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-24bb3d13-6d18-46f0-ac03-d52318a80719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:04.136655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb3d13-6d18-46f0-ac03-d52318a80719 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:04.143040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87eeb8-1824-4b76-bc7c-0a3579a8018c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:04.150862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87eeb8-1824-4b76-bc7c-0a3579a8018c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:04.150862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87eeb8-1824-4b76-bc7c-0a3579a8018c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:04.150862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87eeb8-1824-4b76-bc7c-0a3579a8018c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:04.150862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87eeb8-1824-4b76-bc7c-0a3579a8018c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:04.150862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87eeb8-1824-4b76-bc7c-0a3579a8018c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:04.152466 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2431/4795] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:03 2022] PUT /identity/v3/projects/69d9e47688d94130aafbf3c225513d2f/users/55e3be7cd3654666b5dbcbfc831adb1b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:04.153961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d239e-1278-4c9c-919d-c21b2cd665f5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:04.154241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d239e-1278-4c9c-919d-c21b2cd665f5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:04.154509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d239e-1278-4c9c-919d-c21b2cd665f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:04.203091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a51d239e-1278-4c9c-919d-c21b2cd665f5 None None] MFA Rules not processed for user `69a851c99e944455b8737fdf75b623bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:04.203789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a51d239e-1278-4c9c-919d-c21b2cd665f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:04.324136 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2365/4796] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:50:04 2022] POST /identity/v3/projects => generated 346 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:04.328089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87eeb8-1824-4b76-bc7c-0a3579a8018c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:04.334235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:04.355553 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2432/4797] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:04 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:04.363450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d239e-1278-4c9c-919d-c21b2cd665f5 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:04.474715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87eeb8-1824-4b76-bc7c-0a3579a8018c tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:04.496548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95703236-eea1-48b8-9429-3469aacb6f60 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:04.497304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95703236-eea1-48b8-9429-3469aacb6f60 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:04.497589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95703236-eea1-48b8-9429-3469aacb6f60 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:04.497867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95703236-eea1-48b8-9429-3469aacb6f60 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:04.498552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95703236-eea1-48b8-9429-3469aacb6f60 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:04.501476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95703236-eea1-48b8-9429-3469aacb6f60 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:04.530573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d239e-1278-4c9c-919d-c21b2cd665f5 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:04.591490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982f1ca-13ae-4295-b3b2-2c4412570125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:04.592120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982f1ca-13ae-4295-b3b2-2c4412570125 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:04.592485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982f1ca-13ae-4295-b3b2-2c4412570125 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:04.592764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982f1ca-13ae-4295-b3b2-2c4412570125 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:04.593412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982f1ca-13ae-4295-b3b2-2c4412570125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:04.595142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982f1ca-13ae-4295-b3b2-2c4412570125 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:04.609118 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2433/4798] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:04.609955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982f1ca-13ae-4295-b3b2-2c4412570125 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:04.685593 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2366/4799] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:50:04 2022] POST /identity/v3/domains => generated 275 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:04.686749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95703236-eea1-48b8-9429-3469aacb6f60 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:04.689270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-95703236-eea1-48b8-9429-3469aacb6f60 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:04.722194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982f1ca-13ae-4295-b3b2-2c4412570125 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:04.819909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95703236-eea1-48b8-9429-3469aacb6f60 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:04.824523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc4dd1-5796-41f7-beed-bcd967915f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:04.829066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc4dd1-5796-41f7-beed-bcd967915f16 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:04.829066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc4dd1-5796-41f7-beed-bcd967915f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:04.829066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc4dd1-5796-41f7-beed-bcd967915f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:04.829066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7cfc4dd1-5796-41f7-beed-bcd967915f16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:04.873648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d2fc0-77dd-4a6c-a431-a511d8398f1d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:04.873908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d2fc0-77dd-4a6c-a431-a511d8398f1d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:04.874041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d2fc0-77dd-4a6c-a431-a511d8398f1d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:04.874277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d2fc0-77dd-4a6c-a431-a511d8398f1d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/a4a37f329d7643a5934ca048134f6706` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:04.875637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d2fc0-77dd-4a6c-a431-a511d8398f1d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:update_project(project_id=a4a37f329d7643a5934ca048134f6706)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:04.877629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d2fc0-77dd-4a6c-a431-a511d8398f1d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:04.890395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:04.907616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc4dd1-5796-41f7-beed-bcd967915f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:04.909501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc4dd1-5796-41f7-beed-bcd967915f16 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:04.921664 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2367/4800] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:04 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:04.923043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc4dd1-5796-41f7-beed-bcd967915f16 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:05.036027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc4dd1-5796-41f7-beed-bcd967915f16 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:05.041465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee3d13-0dd7-4161-aa5e-df8fe18e0223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:05.043086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee3d13-0dd7-4161-aa5e-df8fe18e0223 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:05.043593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee3d13-0dd7-4161-aa5e-df8fe18e0223 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:05.043978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee3d13-0dd7-4161-aa5e-df8fe18e0223 admin admin] PATH_INFO: `/v3/projects/69d9e47688d94130aafbf3c225513d2f/users/55e3be7cd3654666b5dbcbfc831adb1b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:05.046307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee3d13-0dd7-4161-aa5e-df8fe18e0223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d9e47688d94130aafbf3c225513d2f, user_id=55e3be7cd3654666b5dbcbfc831adb1b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:05.049488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee3d13-0dd7-4161-aa5e-df8fe18e0223 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:05.073477 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2368/4801] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:04 2022] PUT /identity/v3/projects/69d9e47688d94130aafbf3c225513d2f/users/55e3be7cd3654666b5dbcbfc831adb1b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:05.074534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee3d13-0dd7-4161-aa5e-df8fe18e0223 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:05.094374 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2434/4802] 10.222.0.76 () {60 vars in 1252 bytes} [Sat Aug 27 04:50:04 2022] PATCH /identity/v3/projects/a4a37f329d7643a5934ca048134f6706 => generated 361 bytes in 485 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:05.100289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d2fc0-77dd-4a6c-a431-a511d8398f1d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:05.100289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-963d2fc0-77dd-4a6c-a431-a511d8398f1d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:05.143624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d2fc0-77dd-4a6c-a431-a511d8398f1d tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:05.275243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee3d13-0dd7-4161-aa5e-df8fe18e0223 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:05.282368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68122106-bab7-430f-9adb-b7a078e72f2a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:05.283070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68122106-bab7-430f-9adb-b7a078e72f2a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:05.283579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68122106-bab7-430f-9adb-b7a078e72f2a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:05.283865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68122106-bab7-430f-9adb-b7a078e72f2a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:05.284565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68122106-bab7-430f-9adb-b7a078e72f2a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:05.287322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68122106-bab7-430f-9adb-b7a078e72f2a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:05.299974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21762b05-7603-40b1-bca0-cc07a620af81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:05.302716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21762b05-7603-40b1-bca0-cc07a620af81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:05.314674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21762b05-7603-40b1-bca0-cc07a620af81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:05.315327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21762b05-7603-40b1-bca0-cc07a620af81 admin admin] PATH_INFO: `/v3/users/f1690d47ed05427998470b485e179295` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:05.322804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21762b05-7603-40b1-bca0-cc07a620af81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1690d47ed05427998470b485e179295)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:05.340152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21762b05-7603-40b1-bca0-cc07a620af81 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:05.470024 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2369/4803] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:05 2022] POST /identity/v3/projects => generated 401 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:05.471964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1414681-30d8-4433-a760-671aca0c8407 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:05.472184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1414681-30d8-4433-a760-671aca0c8407 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:05.472394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1414681-30d8-4433-a760-671aca0c8407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:05.553306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f1414681-30d8-4433-a760-671aca0c8407 None None] MFA Rules not processed for user `55e3be7cd3654666b5dbcbfc831adb1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:05.555565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f1414681-30d8-4433-a760-671aca0c8407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:05.685641 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2370/4804] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:05.686759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1414681-30d8-4433-a760-671aca0c8407 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:05.764417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-21762b05-7603-40b1-bca0-cc07a620af81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1690d47ed05427998470b485e179295'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:05.765156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-21762b05-7603-40b1-bca0-cc07a620af81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1690d47ed05427998470b485e179295'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:05.806596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1414681-30d8-4433-a760-671aca0c8407 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:05.814491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f7495-05e9-4644-96b6-be82b236fa85 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:05.815585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f7495-05e9-4644-96b6-be82b236fa85 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:05.816058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f7495-05e9-4644-96b6-be82b236fa85 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:05.816785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f7495-05e9-4644-96b6-be82b236fa85 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/a4a37f329d7643a5934ca048134f6706` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:05.836446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f7495-05e9-4644-96b6-be82b236fa85 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:get_project(project_id=a4a37f329d7643a5934ca048134f6706)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:05.838836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f7495-05e9-4644-96b6-be82b236fa85 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:05.844457 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2371/4805] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:50:05 2022] GET /identity/v3/projects/a4a37f329d7643a5934ca048134f6706 => generated 348 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:05.846009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f7495-05e9-4644-96b6-be82b236fa85 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:05.857242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-21762b05-7603-40b1-bca0-cc07a620af81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1690d47ed05427998470b485e179295'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:05.857879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-21762b05-7603-40b1-bca0-cc07a620af81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1690d47ed05427998470b485e179295'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:05.898409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-21762b05-7603-40b1-bca0-cc07a620af81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1690d47ed05427998470b485e179295'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:05.913565 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2435/4806] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:05 2022] DELETE /identity/v3/users/f1690d47ed05427998470b485e179295 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:05.914410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21762b05-7603-40b1-bca0-cc07a620af81 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:05.916157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-21762b05-7603-40b1-bca0-cc07a620af81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:05.988043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f7495-05e9-4644-96b6-be82b236fa85 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:06.040484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21762b05-7603-40b1-bca0-cc07a620af81 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:06.052390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475d1b9-a43f-4b2a-bc56-492491f96d42 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:06.063216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475d1b9-a43f-4b2a-bc56-492491f96d42 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:06.063216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475d1b9-a43f-4b2a-bc56-492491f96d42 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:06.063216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475d1b9-a43f-4b2a-bc56-492491f96d42 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:06.063216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475d1b9-a43f-4b2a-bc56-492491f96d42 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:06.063216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475d1b9-a43f-4b2a-bc56-492491f96d42 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:06.085182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da84d80-b0c2-4482-8e6a-363d9f087af8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:06.085832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da84d80-b0c2-4482-8e6a-363d9f087af8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:06.086191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da84d80-b0c2-4482-8e6a-363d9f087af8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:06.086520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da84d80-b0c2-4482-8e6a-363d9f087af8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/groups` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:06.087341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da84d80-b0c2-4482-8e6a-363d9f087af8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:06.088636 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-9da84d80-b0c2-4482-8e6a-363d9f087af8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:06.088636 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:50:06.088636 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:06.091405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da84d80-b0c2-4482-8e6a-363d9f087af8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:06.223727 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2372/4807] 10.222.0.76 () {60 vars in 1147 bytes} [Sat Aug 27 04:50:05 2022] POST /identity/v3/groups => generated 302 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:06.224258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da84d80-b0c2-4482-8e6a-363d9f087af8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:06.231724 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2436/4808] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:50:05 2022] POST /identity/v3/domains => generated 275 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:06.231724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475d1b9-a43f-4b2a-bc56-492491f96d42 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:06.232547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9da84d80-b0c2-4482-8e6a-363d9f087af8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:06.233747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9475d1b9-a43f-4b2a-bc56-492491f96d42 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:06.397050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da84d80-b0c2-4482-8e6a-363d9f087af8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:06.446941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475d1b9-a43f-4b2a-bc56-492491f96d42 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:06.460725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2888573-589a-439a-afb0-1d5b34f2a974 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:06.461657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2888573-589a-439a-afb0-1d5b34f2a974 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:06.462092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2888573-589a-439a-afb0-1d5b34f2a974 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:06.462557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2888573-589a-439a-afb0-1d5b34f2a974 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/a4a37f329d7643a5934ca048134f6706` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:06.465004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2888573-589a-439a-afb0-1d5b34f2a974 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a4a37f329d7643a5934ca048134f6706)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:06.467188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2888573-589a-439a-afb0-1d5b34f2a974 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:06.507321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd742d36-4286-4daa-81c6-16d4f7784bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:06.508098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd742d36-4286-4daa-81c6-16d4f7784bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:06.508303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd742d36-4286-4daa-81c6-16d4f7784bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:06.508579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd742d36-4286-4daa-81c6-16d4f7784bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:06.517716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dd742d36-4286-4daa-81c6-16d4f7784bb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:06.536808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd742d36-4286-4daa-81c6-16d4f7784bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:06.538481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd742d36-4286-4daa-81c6-16d4f7784bb7 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:06.552251 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2373/4809] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:06.553940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393020-8d17-4181-909d-a8d5cc61d233 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:06.553940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393020-8d17-4181-909d-a8d5cc61d233 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:06.554583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393020-8d17-4181-909d-a8d5cc61d233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:06.590945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1a393020-8d17-4181-909d-a8d5cc61d233 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:06.592670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1a393020-8d17-4181-909d-a8d5cc61d233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:06.636426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2888573-589a-439a-afb0-1d5b34f2a974 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4a37f329d7643a5934ca048134f6706', 'request_id': 'req-c2888573-589a-439a-afb0-1d5b34f2a974'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:06.643354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2888573-589a-439a-afb0-1d5b34f2a974 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4a37f329d7643a5934ca048134f6706', 'request_id': 'req-c2888573-589a-439a-afb0-1d5b34f2a974'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:06.672880 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2374/4810] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:06.673968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393020-8d17-4181-909d-a8d5cc61d233 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:06.677127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1a393020-8d17-4181-909d-a8d5cc61d233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:06.811029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2888573-589a-439a-afb0-1d5b34f2a974 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4a37f329d7643a5934ca048134f6706', 'request_id': 'req-c2888573-589a-439a-afb0-1d5b34f2a974'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:06.824458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393020-8d17-4181-909d-a8d5cc61d233 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:06.828253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2888573-589a-439a-afb0-1d5b34f2a974 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] The token cache is being invalidate because project a4a37f329d7643a5934ca048134f6706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:06.828566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2888573-589a-439a-afb0-1d5b34f2a974 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:06.829394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2888573-589a-439a-afb0-1d5b34f2a974 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:06.832196 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2437/4811] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:06 2022] DELETE /identity/v3/projects/a4a37f329d7643a5934ca048134f6706 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:06.835153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2888573-589a-439a-afb0-1d5b34f2a974 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:06.837216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c2888573-589a-439a-afb0-1d5b34f2a974 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:06.933378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f56e6-a34d-4a38-87ff-d5414cf60f77 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:06.933378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f56e6-a34d-4a38-87ff-d5414cf60f77 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:06.933378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f56e6-a34d-4a38-87ff-d5414cf60f77 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:06.933674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f56e6-a34d-4a38-87ff-d5414cf60f77 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:06.940583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f56e6-a34d-4a38-87ff-d5414cf60f77 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:06.946639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f56e6-a34d-4a38-87ff-d5414cf60f77 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:06.988251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2888573-589a-439a-afb0-1d5b34f2a974 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:06.996759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eed869-b2a9-4071-a865-30529f6b9a9a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:06.999815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eed869-b2a9-4071-a865-30529f6b9a9a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:07.000365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eed869-b2a9-4071-a865-30529f6b9a9a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:07.000873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eed869-b2a9-4071-a865-30529f6b9a9a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:07.002069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eed869-b2a9-4071-a865-30529f6b9a9a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:07.004203 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-e5eed869-b2a9-4071-a865-30529f6b9a9a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:07.004203 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:50:07.004203 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:50:07.005922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eed869-b2a9-4071-a865-30529f6b9a9a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:07.237715 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2375/4812] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:06 2022] POST /identity/v3/users => generated 445 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:07.238782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f56e6-a34d-4a38-87ff-d5414cf60f77 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:07.241073 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2438/4813] 10.222.0.76 () {60 vars in 1147 bytes} [Sat Aug 27 04:50:06 2022] POST /identity/v3/groups => generated 280 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:07.243283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eed869-b2a9-4071-a865-30529f6b9a9a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:07.245692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e5eed869-b2a9-4071-a865-30529f6b9a9a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:07.247091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a21f56e6-a34d-4a38-87ff-d5414cf60f77 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:07.374590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eed869-b2a9-4071-a865-30529f6b9a9a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:07.379991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173697a-09c5-4e98-82ae-62fd027d5ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:07.381201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173697a-09c5-4e98-82ae-62fd027d5ded service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:07.381837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173697a-09c5-4e98-82ae-62fd027d5ded service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:07.383391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:07.383932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173697a-09c5-4e98-82ae-62fd027d5ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:07.386522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2173697a-09c5-4e98-82ae-62fd027d5ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:07.387882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f56e6-a34d-4a38-87ff-d5414cf60f77 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:07.395995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54523a32-588c-4436-b8d5-5114ed54c994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:07.396538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54523a32-588c-4436-b8d5-5114ed54c994 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:07.396826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54523a32-588c-4436-b8d5-5114ed54c994 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:07.397107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54523a32-588c-4436-b8d5-5114ed54c994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:07.399040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-54523a32-588c-4436-b8d5-5114ed54c994 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:07.483052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173697a-09c5-4e98-82ae-62fd027d5ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:07.483277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54523a32-588c-4436-b8d5-5114ed54c994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:07.484899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54523a32-588c-4436-b8d5-5114ed54c994 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:07.485325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173697a-09c5-4e98-82ae-62fd027d5ded service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:07.495347 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2376/4814] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:07 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:07.496209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54523a32-588c-4436-b8d5-5114ed54c994 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:07.497565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-54523a32-588c-4436-b8d5-5114ed54c994 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:07.497773 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2439/4815] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:07.499161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173697a-09c5-4e98-82ae-62fd027d5ded service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:07.500882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2173697a-09c5-4e98-82ae-62fd027d5ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:07.528073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173697a-09c5-4e98-82ae-62fd027d5ded service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:07.533714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abe53f-54a3-4bb5-8840-23f753850b8a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:07.535286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abe53f-54a3-4bb5-8840-23f753850b8a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:07.535573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abe53f-54a3-4bb5-8840-23f753850b8a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:07.536024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abe53f-54a3-4bb5-8840-23f753850b8a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:07.536941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abe53f-54a3-4bb5-8840-23f753850b8a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:07.539017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abe53f-54a3-4bb5-8840-23f753850b8a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:07.628954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54523a32-588c-4436-b8d5-5114ed54c994 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:07.635052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fc51d-db05-4279-a46e-99ad5027e234 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:07.636436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fc51d-db05-4279-a46e-99ad5027e234 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:07.636893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fc51d-db05-4279-a46e-99ad5027e234 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:07.637387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fc51d-db05-4279-a46e-99ad5027e234 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:07.638619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fc51d-db05-4279-a46e-99ad5027e234 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:07.641811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fc51d-db05-4279-a46e-99ad5027e234 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:07.654354 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2440/4816] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:50:07 2022] POST /identity/v3/roles => generated 240 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:07.655932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abe53f-54a3-4bb5-8840-23f753850b8a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:07.669956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abe53f-54a3-4bb5-8840-23f753850b8a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:07.677210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497569a0-c86d-485c-a965-7c82aa5835e5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:07.678151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497569a0-c86d-485c-a965-7c82aa5835e5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:07.678518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497569a0-c86d-485c-a965-7c82aa5835e5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:07.678813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497569a0-c86d-485c-a965-7c82aa5835e5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/243a8d1de4844744811d00a075cc0365` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:07.687390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497569a0-c86d-485c-a965-7c82aa5835e5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:update_group(group_id=243a8d1de4844744811d00a075cc0365)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:07.688589 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-497569a0-c86d-485c-a965-7c82aa5835e5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:07.688589 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:50:07.688589 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:50:07.689797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497569a0-c86d-485c-a965-7c82aa5835e5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:07.792433 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2377/4817] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:07 2022] POST /identity/v3/projects => generated 360 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:07.793999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fc51d-db05-4279-a46e-99ad5027e234 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:07.856862 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2441/4818] 10.222.0.76 () {60 vars in 1247 bytes} [Sat Aug 27 04:50:07 2022] PATCH /identity/v3/groups/243a8d1de4844744811d00a075cc0365 => generated 292 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:07.857800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497569a0-c86d-485c-a965-7c82aa5835e5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:07.876445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497569a0-c86d-485c-a965-7c82aa5835e5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:07.884515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fc51d-db05-4279-a46e-99ad5027e234 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:07.891575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273ace8-bd40-4188-8d85-23d56391059c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:07.893021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ace8-bd40-4188-8d85-23d56391059c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:07.895493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ace8-bd40-4188-8d85-23d56391059c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:07.896457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ace8-bd40-4188-8d85-23d56391059c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/7c000e9a513941f088a09f4365866806/groups/c0233d75842742bf9891904fe46cccc6/roles/21f89316856e420f9529233236d91005/inherited_to_projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:07.906733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273ace8-bd40-4188-8d85-23d56391059c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7c000e9a513941f088a09f4365866806, group_id=c0233d75842742bf9891904fe46cccc6, role_id=21f89316856e420f9529233236d91005)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:07.913025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273ace8-bd40-4188-8d85-23d56391059c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:07.949631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdf849-44f4-4ff7-b63b-9c1d39e9a74b tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:07.950234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdf849-44f4-4ff7-b63b-9c1d39e9a74b tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:07.950519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdf849-44f4-4ff7-b63b-9c1d39e9a74b tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:07.952635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdf849-44f4-4ff7-b63b-9c1d39e9a74b tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/3fdba1e25d8f488c8826325c0b8a1fdb` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:07.953068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdf849-44f4-4ff7-b63b-9c1d39e9a74b tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:update_project(project_id=3fdba1e25d8f488c8826325c0b8a1fdb)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:07.955194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdf849-44f4-4ff7-b63b-9c1d39e9a74b tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:08.096291 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2378/4819] 10.222.0.76 () {60 vars in 1585 bytes} [Sat Aug 27 04:50:07 2022] PUT /identity/v3/OS-INHERIT/projects/7c000e9a513941f088a09f4365866806/groups/c0233d75842742bf9891904fe46cccc6/roles/21f89316856e420f9529233236d91005/inherited_to_projects => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:08.096291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273ace8-bd40-4188-8d85-23d56391059c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:08.149694 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2442/4820] 10.222.0.76 () {60 vars in 1252 bytes} [Sat Aug 27 04:50:07 2022] PATCH /identity/v3/projects/3fdba1e25d8f488c8826325c0b8a1fdb => generated 372 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:08.150844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdf849-44f4-4ff7-b63b-9c1d39e9a74b tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:08.158100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-21fdf849-44f4-4ff7-b63b-9c1d39e9a74b tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:08.207510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273ace8-bd40-4188-8d85-23d56391059c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:08.213917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b68499-a4e5-47af-bc74-dad5662a4868 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:08.215060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b68499-a4e5-47af-bc74-dad5662a4868 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:08.215505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b68499-a4e5-47af-bc74-dad5662a4868 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:08.217169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b68499-a4e5-47af-bc74-dad5662a4868 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/243a8d1de4844744811d00a075cc0365` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:08.225604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b68499-a4e5-47af-bc74-dad5662a4868 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:get_group(group_id=243a8d1de4844744811d00a075cc0365)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:08.236188 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-57b68499-a4e5-47af-bc74-dad5662a4868 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:08.236188 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:50:08.236188 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:08.236188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b68499-a4e5-47af-bc74-dad5662a4868 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:08.236188 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2379/4821] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:08 2022] GET /identity/v3/groups/243a8d1de4844744811d00a075cc0365 => generated 292 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:08.236188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b68499-a4e5-47af-bc74-dad5662a4868 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:08.264149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:08.349828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b68499-a4e5-47af-bc74-dad5662a4868 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:08.352132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdf849-44f4-4ff7-b63b-9c1d39e9a74b tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:08.357599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9c071-92a0-442f-b623-2feda1542c05 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:08.358721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9c071-92a0-442f-b623-2feda1542c05 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:08.359212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9c071-92a0-442f-b623-2feda1542c05 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:08.359708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9c071-92a0-442f-b623-2feda1542c05 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/7c000e9a513941f088a09f4365866806/groups/c0233d75842742bf9891904fe46cccc6/roles/21f89316856e420f9529233236d91005/inherited_to_projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:08.362270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9c071-92a0-442f-b623-2feda1542c05 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:check_grant(project_id=7c000e9a513941f088a09f4365866806, group_id=c0233d75842742bf9891904fe46cccc6, role_id=21f89316856e420f9529233236d91005)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:08.363795 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-8fa9c071-92a0-442f-b623-2feda1542c05 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:08.363795 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:50:08.363795 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:08.366541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9c071-92a0-442f-b623-2feda1542c05 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:08.382888 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2380/4822] 10.222.0.76 () {58 vars in 1567 bytes} [Sat Aug 27 04:50:08 2022] HEAD /identity/v3/OS-INHERIT/projects/7c000e9a513941f088a09f4365866806/groups/c0233d75842742bf9891904fe46cccc6/roles/21f89316856e420f9529233236d91005/inherited_to_projects => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:08.382888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9c071-92a0-442f-b623-2feda1542c05 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:08.471342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:08.490339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cad3e1-1376-4968-9a10-7aacd6caa767 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:08.491026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cad3e1-1376-4968-9a10-7aacd6caa767 service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:08.491314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cad3e1-1376-4968-9a10-7aacd6caa767 service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:08.491809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cad3e1-1376-4968-9a10-7aacd6caa767 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:08.494329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e5cad3e1-1376-4968-9a10-7aacd6caa767 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:08.509038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cad3e1-1376-4968-9a10-7aacd6caa767 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:08.512101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cad3e1-1376-4968-9a10-7aacd6caa767 service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:08.515682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9c071-92a0-442f-b623-2feda1542c05 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:08.524369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c564fe-ce3d-4815-b803-8a846c1790ea tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:08.525172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c564fe-ce3d-4815-b803-8a846c1790ea tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:08.525522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c564fe-ce3d-4815-b803-8a846c1790ea tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:08.525864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c564fe-ce3d-4815-b803-8a846c1790ea tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/3fdba1e25d8f488c8826325c0b8a1fdb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:08.528865 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2443/4823] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:08.530813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cad3e1-1376-4968-9a10-7aacd6caa767 service placement] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:08.532345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e5cad3e1-1376-4968-9a10-7aacd6caa767 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:08.543665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c564fe-ce3d-4815-b803-8a846c1790ea tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:get_project(project_id=3fdba1e25d8f488c8826325c0b8a1fdb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:08.548847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c564fe-ce3d-4815-b803-8a846c1790ea tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:08.548847 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2381/4824] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:50:08 2022] GET /identity/v3/projects/3fdba1e25d8f488c8826325c0b8a1fdb => generated 359 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:08.549731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c564fe-ce3d-4815-b803-8a846c1790ea tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:08.567411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c564fe-ce3d-4815-b803-8a846c1790ea tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:08.577943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631e7c6-c2cf-4520-bb0d-0df57c46b21b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:08.579617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631e7c6-c2cf-4520-bb0d-0df57c46b21b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:08.579990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631e7c6-c2cf-4520-bb0d-0df57c46b21b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:08.580416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631e7c6-c2cf-4520-bb0d-0df57c46b21b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/243a8d1de4844744811d00a075cc0365` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:08.582085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631e7c6-c2cf-4520-bb0d-0df57c46b21b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:update_group(group_id=243a8d1de4844744811d00a075cc0365)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:08.583394 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-7631e7c6-c2cf-4520-bb0d-0df57c46b21b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:08.583394 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:50:08.583394 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:08.585690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631e7c6-c2cf-4520-bb0d-0df57c46b21b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:08.619530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cad3e1-1376-4968-9a10-7aacd6caa767 service placement] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:08.625771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a84b58-4701-4180-bb74-5c8eff5bf172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:08.629181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a84b58-4701-4180-bb74-5c8eff5bf172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:08.629181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a84b58-4701-4180-bb74-5c8eff5bf172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:08.629181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a84b58-4701-4180-bb74-5c8eff5bf172 admin admin] PATH_INFO: `/v3/projects/2040081d643640e0b9a11e20b9b7b43b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:08.629181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a84b58-4701-4180-bb74-5c8eff5bf172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2040081d643640e0b9a11e20b9b7b43b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:08.630371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a84b58-4701-4180-bb74-5c8eff5bf172 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:08.708297 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2382/4825] 10.222.0.76 () {60 vars in 1246 bytes} [Sat Aug 27 04:50:08 2022] PATCH /identity/v3/groups/243a8d1de4844744811d00a075cc0365 => generated 307 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:08.709383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631e7c6-c2cf-4520-bb0d-0df57c46b21b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:08.722311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631e7c6-c2cf-4520-bb0d-0df57c46b21b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:08.727818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f94ec-8cc1-4a32-ab6d-9563fe792da9 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:08.728721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f94ec-8cc1-4a32-ab6d-9563fe792da9 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:08.729111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f94ec-8cc1-4a32-ab6d-9563fe792da9 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:08.731508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f94ec-8cc1-4a32-ab6d-9563fe792da9 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/7c000e9a513941f088a09f4365866806/groups/c0233d75842742bf9891904fe46cccc6/roles/21f89316856e420f9529233236d91005/inherited_to_projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:08.734057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f94ec-8cc1-4a32-ab6d-9563fe792da9 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=7c000e9a513941f088a09f4365866806, group_id=c0233d75842742bf9891904fe46cccc6, role_id=21f89316856e420f9529233236d91005)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:08.735708 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-bd8f94ec-8cc1-4a32-ab6d-9563fe792da9 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:08.735708 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:50:08.735708 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:08.737950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f94ec-8cc1-4a32-ab6d-9563fe792da9 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:08.744070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bd8f94ec-8cc1-4a32-ab6d-9563fe792da9 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invalidating the token cache because role 21f89316856e420f9529233236d91005 was removed from group c0233d75842742bf9891904fe46cccc6 on project 7c000e9a513941f088a09f4365866806. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:08.744399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bd8f94ec-8cc1-4a32-ab6d-9563fe792da9 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:08.748142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bd8f94ec-8cc1-4a32-ab6d-9563fe792da9 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:08.846451 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2383/4826] 10.222.0.76 () {58 vars in 1569 bytes} [Sat Aug 27 04:50:08 2022] DELETE /identity/v3/OS-INHERIT/projects/7c000e9a513941f088a09f4365866806/groups/c0233d75842742bf9891904fe46cccc6/roles/21f89316856e420f9529233236d91005/inherited_to_projects => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:08.847586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f94ec-8cc1-4a32-ab6d-9563fe792da9 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:08.849584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bd8f94ec-8cc1-4a32-ab6d-9563fe792da9 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:08.862934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d9a84b58-4701-4180-bb74-5c8eff5bf172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2040081d643640e0b9a11e20b9b7b43b', 'request_id': 'req-d9a84b58-4701-4180-bb74-5c8eff5bf172'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:08.875076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d9a84b58-4701-4180-bb74-5c8eff5bf172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2040081d643640e0b9a11e20b9b7b43b', 'request_id': 'req-d9a84b58-4701-4180-bb74-5c8eff5bf172'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:08.958150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f94ec-8cc1-4a32-ab6d-9563fe792da9 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:09.011929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d9a84b58-4701-4180-bb74-5c8eff5bf172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2040081d643640e0b9a11e20b9b7b43b', 'request_id': 'req-d9a84b58-4701-4180-bb74-5c8eff5bf172'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:09.029709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d9a84b58-4701-4180-bb74-5c8eff5bf172 admin admin] The token cache is being invalidate because project 2040081d643640e0b9a11e20b9b7b43b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:09.030128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d9a84b58-4701-4180-bb74-5c8eff5bf172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:09.030768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d9a84b58-4701-4180-bb74-5c8eff5bf172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:09.039432 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2444/4827] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:08 2022] DELETE /identity/v3/projects/2040081d643640e0b9a11e20b9b7b43b => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:09.039432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a84b58-4701-4180-bb74-5c8eff5bf172 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:09.043000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d9a84b58-4701-4180-bb74-5c8eff5bf172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:09.054735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883ec84-641f-42fe-9742-303348f5e4bd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:09.055834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883ec84-641f-42fe-9742-303348f5e4bd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:09.056205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883ec84-641f-42fe-9742-303348f5e4bd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:09.056550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883ec84-641f-42fe-9742-303348f5e4bd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/3fdba1e25d8f488c8826325c0b8a1fdb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:09.057957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883ec84-641f-42fe-9742-303348f5e4bd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3fdba1e25d8f488c8826325c0b8a1fdb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:09.060088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883ec84-641f-42fe-9742-303348f5e4bd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:09.141895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a84b58-4701-4180-bb74-5c8eff5bf172 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:09.146764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109236b5-152d-4c1a-9338-b8a0389a0461 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:09.147454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109236b5-152d-4c1a-9338-b8a0389a0461 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:09.147739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109236b5-152d-4c1a-9338-b8a0389a0461 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:09.148020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109236b5-152d-4c1a-9338-b8a0389a0461 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/243a8d1de4844744811d00a075cc0365` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:09.159068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109236b5-152d-4c1a-9338-b8a0389a0461 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:delete_group(group_id=243a8d1de4844744811d00a075cc0365)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:09.164918 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-109236b5-152d-4c1a-9338-b8a0389a0461 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:09.164918 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:50:09.164918 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:50:09.164918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109236b5-152d-4c1a-9338-b8a0389a0461 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:09.174635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0883ec84-641f-42fe-9742-303348f5e4bd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fdba1e25d8f488c8826325c0b8a1fdb', 'request_id': 'req-0883ec84-641f-42fe-9742-303348f5e4bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:09.180637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0883ec84-641f-42fe-9742-303348f5e4bd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fdba1e25d8f488c8826325c0b8a1fdb', 'request_id': 'req-0883ec84-641f-42fe-9742-303348f5e4bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:09.188298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0883ec84-641f-42fe-9742-303348f5e4bd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fdba1e25d8f488c8826325c0b8a1fdb', 'request_id': 'req-0883ec84-641f-42fe-9742-303348f5e4bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:09.289531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0883ec84-641f-42fe-9742-303348f5e4bd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] The token cache is being invalidate because project 3fdba1e25d8f488c8826325c0b8a1fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:09.290487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0883ec84-641f-42fe-9742-303348f5e4bd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:09.299756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0883ec84-641f-42fe-9742-303348f5e4bd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:09.299756 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2384/4828] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:08 2022] DELETE /identity/v3/projects/3fdba1e25d8f488c8826325c0b8a1fdb => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:09.299756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883ec84-641f-42fe-9742-303348f5e4bd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:09.299756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0883ec84-641f-42fe-9742-303348f5e4bd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:09.347436 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2445/4829] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:50:09 2022] DELETE /identity/v3/groups/243a8d1de4844744811d00a075cc0365 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:09.348775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e116f73-86d1-4f62-936f-13eb7ec8dbcf None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:09.349058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e116f73-86d1-4f62-936f-13eb7ec8dbcf None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:09.352278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e116f73-86d1-4f62-936f-13eb7ec8dbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:09.391986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0e116f73-86d1-4f62-936f-13eb7ec8dbcf None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:09.393803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0e116f73-86d1-4f62-936f-13eb7ec8dbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:09.394286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883ec84-641f-42fe-9742-303348f5e4bd tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:09.474060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc5cd1-cd42-40d4-8087-2642a0ece07c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:09.474741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc5cd1-cd42-40d4-8087-2642a0ece07c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:09.475105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc5cd1-cd42-40d4-8087-2642a0ece07c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:09.475441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc5cd1-cd42-40d4-8087-2642a0ece07c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/roles/21f89316856e420f9529233236d91005` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:09.477060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc5cd1-cd42-40d4-8087-2642a0ece07c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:delete_role(role_id=21f89316856e420f9529233236d91005)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:09.479115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc5cd1-cd42-40d4-8087-2642a0ece07c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:09.484789 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2446/4830] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:09.485929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e116f73-86d1-4f62-936f-13eb7ec8dbcf None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:09.490799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0e116f73-86d1-4f62-936f-13eb7ec8dbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:09.561638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e116f73-86d1-4f62-936f-13eb7ec8dbcf None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:09.568479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de112a-5a21-4dd6-9deb-0c27f47deffa tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:09.569099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de112a-5a21-4dd6-9deb-0c27f47deffa tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:09.569416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de112a-5a21-4dd6-9deb-0c27f47deffa tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:09.569697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de112a-5a21-4dd6-9deb-0c27f47deffa tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:09.571018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de112a-5a21-4dd6-9deb-0c27f47deffa tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:09.572224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de112a-5a21-4dd6-9deb-0c27f47deffa tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:09.641625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6cdc5cd1-cd42-40d4-8087-2642a0ece07c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invalidating the token cache because role 21f89316856e420f9529233236d91005 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:09.642035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6cdc5cd1-cd42-40d4-8087-2642a0ece07c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:09.643170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6cdc5cd1-cd42-40d4-8087-2642a0ece07c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:09.645407 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2385/4831] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:09 2022] DELETE /identity/v3/roles/21f89316856e420f9529233236d91005 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:09.646907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc5cd1-cd42-40d4-8087-2642a0ece07c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:09.650558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6cdc5cd1-cd42-40d4-8087-2642a0ece07c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:09.723527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc5cd1-cd42-40d4-8087-2642a0ece07c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:09.728905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc3d8a-7537-42c6-8cb3-e7a54cfc79de tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:09.729535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc3d8a-7537-42c6-8cb3-e7a54cfc79de tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:09.729816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc3d8a-7537-42c6-8cb3-e7a54cfc79de tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:09.730385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc3d8a-7537-42c6-8cb3-e7a54cfc79de tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:09.730739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc3d8a-7537-42c6-8cb3-e7a54cfc79de tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:09.732728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc3d8a-7537-42c6-8cb3-e7a54cfc79de tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:09.750456 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2447/4832] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:09 2022] POST /identity/v3/projects => generated 353 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:09.752470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c2796-c199-49ec-8490-4be2193ce7b3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:09.752965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c2796-c199-49ec-8490-4be2193ce7b3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:09.753245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c2796-c199-49ec-8490-4be2193ce7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:09.778531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c95c2796-c199-49ec-8490-4be2193ce7b3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:09.780142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c95c2796-c199-49ec-8490-4be2193ce7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:09.873371 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2386/4833] 10.222.0.76 () {60 vars in 1147 bytes} [Sat Aug 27 04:50:09 2022] POST /identity/v3/groups => generated 327 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:09.873371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc3d8a-7537-42c6-8cb3-e7a54cfc79de tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:09.874452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-debc3d8a-7537-42c6-8cb3-e7a54cfc79de tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:09.878575 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2448/4834] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:09.883482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c2796-c199-49ec-8490-4be2193ce7b3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:09.885532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c95c2796-c199-49ec-8490-4be2193ce7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:09.996589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc3d8a-7537-42c6-8cb3-e7a54cfc79de tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:10.005343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c2796-c199-49ec-8490-4be2193ce7b3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:10.013181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f3b39-6523-4095-a68f-3a513d374971 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:10.013956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f3b39-6523-4095-a68f-3a513d374971 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:10.014340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f3b39-6523-4095-a68f-3a513d374971 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:10.015638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f3b39-6523-4095-a68f-3a513d374971 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/ad78f02e06e5427bbbde053f76f2d537` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:10.016768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f3b39-6523-4095-a68f-3a513d374971 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:update_project(project_id=ad78f02e06e5427bbbde053f76f2d537)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:10.019906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f3b39-6523-4095-a68f-3a513d374971 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:10.057135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:10.089898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7da32-40e0-4216-82c9-82cf8270b40a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:10.089898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7da32-40e0-4216-82c9-82cf8270b40a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:10.089898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7da32-40e0-4216-82c9-82cf8270b40a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:10.090325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7da32-40e0-4216-82c9-82cf8270b40a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:10.090325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7da32-40e0-4216-82c9-82cf8270b40a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:10.090977 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-45d7da32-40e0-4216-82c9-82cf8270b40a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:10.090977 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:50:10.090977 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:10.092207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7da32-40e0-4216-82c9-82cf8270b40a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:10.203814 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2449/4835] 10.222.0.76 () {60 vars in 1252 bytes} [Sat Aug 27 04:50:09 2022] PATCH /identity/v3/projects/ad78f02e06e5427bbbde053f76f2d537 => generated 367 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:10.205551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f3b39-6523-4095-a68f-3a513d374971 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:10.242374 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2387/4836] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:50:09 2022] POST /identity/v3/roles => generated 240 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:10.242374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7da32-40e0-4216-82c9-82cf8270b40a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:10.254687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7da32-40e0-4216-82c9-82cf8270b40a tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:10.261000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7be381-02fb-4dcd-8996-2fe626fae5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:10.265053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7be381-02fb-4dcd-8996-2fe626fae5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:10.267684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7be381-02fb-4dcd-8996-2fe626fae5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:10.267684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7be381-02fb-4dcd-8996-2fe626fae5b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:10.267933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7be381-02fb-4dcd-8996-2fe626fae5b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:10.269228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7be381-02fb-4dcd-8996-2fe626fae5b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:10.272584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7be381-02fb-4dcd-8996-2fe626fae5b2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:10.296845 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2388/4837] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:10.297734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7be381-02fb-4dcd-8996-2fe626fae5b2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:10.327653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7be381-02fb-4dcd-8996-2fe626fae5b2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:10.337520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de96857-f7ad-4284-8ecd-209d98a07835 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:10.338291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f3b39-6523-4095-a68f-3a513d374971 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:10.339859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de96857-f7ad-4284-8ecd-209d98a07835 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:10.340176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de96857-f7ad-4284-8ecd-209d98a07835 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:10.340478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de96857-f7ad-4284-8ecd-209d98a07835 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/ad78f02e06e5427bbbde053f76f2d537` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:10.350847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9020a08-93e8-4866-93b1-2b1fd092124c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:10.351756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9020a08-93e8-4866-93b1-2b1fd092124c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:10.352961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9020a08-93e8-4866-93b1-2b1fd092124c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:10.353317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9020a08-93e8-4866-93b1-2b1fd092124c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:10.354046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9020a08-93e8-4866-93b1-2b1fd092124c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:10.357066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9020a08-93e8-4866-93b1-2b1fd092124c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:10.359579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de96857-f7ad-4284-8ecd-209d98a07835 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:get_project(project_id=ad78f02e06e5427bbbde053f76f2d537)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:10.361849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de96857-f7ad-4284-8ecd-209d98a07835 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:10.363834 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2389/4838] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:50:10 2022] GET /identity/v3/projects/ad78f02e06e5427bbbde053f76f2d537 => generated 354 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:10.364446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de96857-f7ad-4284-8ecd-209d98a07835 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:10.378266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de96857-f7ad-4284-8ecd-209d98a07835 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:10.383037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b978329-0a15-4d2e-a463-14bbd994f8ee tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:10.383761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b978329-0a15-4d2e-a463-14bbd994f8ee tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:10.384047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b978329-0a15-4d2e-a463-14bbd994f8ee tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:10.384364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b978329-0a15-4d2e-a463-14bbd994f8ee tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/7c000e9a513941f088a09f4365866806/users/86196ef01bd642d19c49f3c54beddc33/roles/67e65a1ecd864c888d091293f7eee1b6/inherited_to_projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:10.403356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b978329-0a15-4d2e-a463-14bbd994f8ee tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7c000e9a513941f088a09f4365866806, user_id=86196ef01bd642d19c49f3c54beddc33, role_id=67e65a1ecd864c888d091293f7eee1b6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:10.408996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b978329-0a15-4d2e-a463-14bbd994f8ee tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:10.455470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:10.463981 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2450/4839] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:10 2022] POST /identity/v3/users => generated 323 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:10.465315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9020a08-93e8-4866-93b1-2b1fd092124c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:10.476496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9020a08-93e8-4866-93b1-2b1fd092124c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:10.481832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85955468-a1b9-4d69-af00-69cd26649d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:10.482061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85955468-a1b9-4d69-af00-69cd26649d97 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:10.482357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85955468-a1b9-4d69-af00-69cd26649d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:10.482629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85955468-a1b9-4d69-af00-69cd26649d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:10.483264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85955468-a1b9-4d69-af00-69cd26649d97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:10.485399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85955468-a1b9-4d69-af00-69cd26649d97 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:10.558545 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2390/4840] 10.222.0.76 () {60 vars in 1582 bytes} [Sat Aug 27 04:50:10 2022] PUT /identity/v3/OS-INHERIT/projects/7c000e9a513941f088a09f4365866806/users/86196ef01bd642d19c49f3c54beddc33/roles/67e65a1ecd864c888d091293f7eee1b6/inherited_to_projects => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:10.559534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b978329-0a15-4d2e-a463-14bbd994f8ee tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:10.629882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b978329-0a15-4d2e-a463-14bbd994f8ee tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:10.631450 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2451/4841] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:10 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:10.639293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85955468-a1b9-4d69-af00-69cd26649d97 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:10.714366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f66e6-29ef-4393-962f-6237b0dbe5ce tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:10.719676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f66e6-29ef-4393-962f-6237b0dbe5ce tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:10.719676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f66e6-29ef-4393-962f-6237b0dbe5ce tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:10.719676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f66e6-29ef-4393-962f-6237b0dbe5ce tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/projects/ad78f02e06e5427bbbde053f76f2d537` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:10.719676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f66e6-29ef-4393-962f-6237b0dbe5ce tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ad78f02e06e5427bbbde053f76f2d537)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:10.721344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f66e6-29ef-4393-962f-6237b0dbe5ce tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:10.731723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85955468-a1b9-4d69-af00-69cd26649d97 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:10.741118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab86d6-a899-4bc0-bfd6-c82a3a71f294 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:10.741628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab86d6-a899-4bc0-bfd6-c82a3a71f294 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:10.741986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab86d6-a899-4bc0-bfd6-c82a3a71f294 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:10.743065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab86d6-a899-4bc0-bfd6-c82a3a71f294 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/c83b01e412054edab08bab7113c9b52c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:10.768251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab86d6-a899-4bc0-bfd6-c82a3a71f294 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=5d09243c3a074b5bb22d8ac45c0f8fa8, user_id=c83b01e412054edab08bab7113c9b52c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:10.769470 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-48ab86d6-a899-4bc0-bfd6-c82a3a71f294 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:10.769470 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:50:10.769470 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:50:10.771420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab86d6-a899-4bc0-bfd6-c82a3a71f294 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:10.927172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-809f66e6-29ef-4393-962f-6237b0dbe5ce tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad78f02e06e5427bbbde053f76f2d537', 'request_id': 'req-809f66e6-29ef-4393-962f-6237b0dbe5ce'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:10.937263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-809f66e6-29ef-4393-962f-6237b0dbe5ce tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad78f02e06e5427bbbde053f76f2d537', 'request_id': 'req-809f66e6-29ef-4393-962f-6237b0dbe5ce'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:10.948616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-809f66e6-29ef-4393-962f-6237b0dbe5ce tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad78f02e06e5427bbbde053f76f2d537', 'request_id': 'req-809f66e6-29ef-4393-962f-6237b0dbe5ce'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:10.967914 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2452/4842] 10.222.0.76 () {60 vars in 1360 bytes} [Sat Aug 27 04:50:10 2022] PUT /identity/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/c83b01e412054edab08bab7113c9b52c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:10.967914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab86d6-a899-4bc0-bfd6-c82a3a71f294 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:11.064557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab86d6-a899-4bc0-bfd6-c82a3a71f294 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:11.071421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d68c2c-fe6c-4bba-bb8b-46b527a63721 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:11.072442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d68c2c-fe6c-4bba-bb8b-46b527a63721 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:11.072832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d68c2c-fe6c-4bba-bb8b-46b527a63721 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:11.073390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d68c2c-fe6c-4bba-bb8b-46b527a63721 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/7c000e9a513941f088a09f4365866806/users/86196ef01bd642d19c49f3c54beddc33/roles/67e65a1ecd864c888d091293f7eee1b6/inherited_to_projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:11.076322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d68c2c-fe6c-4bba-bb8b-46b527a63721 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:check_grant(project_id=7c000e9a513941f088a09f4365866806, user_id=86196ef01bd642d19c49f3c54beddc33, role_id=67e65a1ecd864c888d091293f7eee1b6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:11.078166 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-35d68c2c-fe6c-4bba-bb8b-46b527a63721 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:11.078166 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:50:11.078166 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:50:11.081758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d68c2c-fe6c-4bba-bb8b-46b527a63721 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:11.093933 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2453/4843] 10.222.0.76 () {58 vars in 1564 bytes} [Sat Aug 27 04:50:10 2022] HEAD /identity/v3/OS-INHERIT/projects/7c000e9a513941f088a09f4365866806/users/86196ef01bd642d19c49f3c54beddc33/roles/67e65a1ecd864c888d091293f7eee1b6/inherited_to_projects => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:11.095006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d68c2c-fe6c-4bba-bb8b-46b527a63721 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:11.106511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-809f66e6-29ef-4393-962f-6237b0dbe5ce tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] The token cache is being invalidate because project ad78f02e06e5427bbbde053f76f2d537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:11.107115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-809f66e6-29ef-4393-962f-6237b0dbe5ce tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:11.109479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-809f66e6-29ef-4393-962f-6237b0dbe5ce tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:11.111567 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2391/4844] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:10 2022] DELETE /identity/v3/projects/ad78f02e06e5427bbbde053f76f2d537 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:11.112210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f66e6-29ef-4393-962f-6237b0dbe5ce tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:11.113549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-809f66e6-29ef-4393-962f-6237b0dbe5ce tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:11.232306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d68c2c-fe6c-4bba-bb8b-46b527a63721 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:11.237800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69e02d-4cac-48fa-9d09-14783aa5ded2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:11.239574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69e02d-4cac-48fa-9d09-14783aa5ded2 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:11.239860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69e02d-4cac-48fa-9d09-14783aa5ded2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:11.240201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69e02d-4cac-48fa-9d09-14783aa5ded2 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:11.242240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69e02d-4cac-48fa-9d09-14783aa5ded2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:11.244213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69e02d-4cac-48fa-9d09-14783aa5ded2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:11.250363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f66e6-29ef-4393-962f-6237b0dbe5ce tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:11.327878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93458adc-4445-4063-b8cd-6ad8fbb694b3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:11.328599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93458adc-4445-4063-b8cd-6ad8fbb694b3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:11.328887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93458adc-4445-4063-b8cd-6ad8fbb694b3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:11.329214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93458adc-4445-4063-b8cd-6ad8fbb694b3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:11.329925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93458adc-4445-4063-b8cd-6ad8fbb694b3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:11.332049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93458adc-4445-4063-b8cd-6ad8fbb694b3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:11.372100 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2454/4845] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:11 2022] POST /identity/v3/users => generated 286 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:11.372732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69e02d-4cac-48fa-9d09-14783aa5ded2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:11.378743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8a69e02d-4cac-48fa-9d09-14783aa5ded2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:11.402613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69e02d-4cac-48fa-9d09-14783aa5ded2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:11.415092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70dc7a-8501-4895-8d2f-5c3cd8ed4eea tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:11.415273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70dc7a-8501-4895-8d2f-5c3cd8ed4eea tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:11.415583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70dc7a-8501-4895-8d2f-5c3cd8ed4eea tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:11.415929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70dc7a-8501-4895-8d2f-5c3cd8ed4eea tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/7c000e9a513941f088a09f4365866806/users/86196ef01bd642d19c49f3c54beddc33/roles/67e65a1ecd864c888d091293f7eee1b6/inherited_to_projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:11.420377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70dc7a-8501-4895-8d2f-5c3cd8ed4eea tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=7c000e9a513941f088a09f4365866806, user_id=86196ef01bd642d19c49f3c54beddc33, role_id=67e65a1ecd864c888d091293f7eee1b6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:11.421788 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-6a70dc7a-8501-4895-8d2f-5c3cd8ed4eea tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:11.421788 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:50:11.421788 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:50:11.425166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70dc7a-8501-4895-8d2f-5c3cd8ed4eea tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:11.432575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6a70dc7a-8501-4895-8d2f-5c3cd8ed4eea tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invalidating the token cache because role 67e65a1ecd864c888d091293f7eee1b6 was removed from user 86196ef01bd642d19c49f3c54beddc33 on project 7c000e9a513941f088a09f4365866806. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:11.432948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6a70dc7a-8501-4895-8d2f-5c3cd8ed4eea tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:11.444024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6a70dc7a-8501-4895-8d2f-5c3cd8ed4eea tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:11.453947 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2392/4846] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:11 2022] POST /identity/v3/users => generated 323 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:11.455418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93458adc-4445-4063-b8cd-6ad8fbb694b3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:11.465485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-93458adc-4445-4063-b8cd-6ad8fbb694b3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:11.569304 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2455/4847] 10.222.0.76 () {58 vars in 1566 bytes} [Sat Aug 27 04:50:11 2022] DELETE /identity/v3/OS-INHERIT/projects/7c000e9a513941f088a09f4365866806/users/86196ef01bd642d19c49f3c54beddc33/roles/67e65a1ecd864c888d091293f7eee1b6/inherited_to_projects => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:11.577578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70dc7a-8501-4895-8d2f-5c3cd8ed4eea tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:11.583269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6a70dc7a-8501-4895-8d2f-5c3cd8ed4eea tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:11.617737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93458adc-4445-4063-b8cd-6ad8fbb694b3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:11.717138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70dc7a-8501-4895-8d2f-5c3cd8ed4eea tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:11.722529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14addf4c-6435-434a-b21c-29a01ea7a2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:11.723397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14addf4c-6435-434a-b21c-29a01ea7a2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:11.723775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14addf4c-6435-434a-b21c-29a01ea7a2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:11.724332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14addf4c-6435-434a-b21c-29a01ea7a2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:11.725054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14addf4c-6435-434a-b21c-29a01ea7a2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:11.726805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14addf4c-6435-434a-b21c-29a01ea7a2e0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:11.730519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951cae6-9877-4383-b682-9c6bb102b548 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:11.731192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951cae6-9877-4383-b682-9c6bb102b548 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:11.731632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951cae6-9877-4383-b682-9c6bb102b548 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:11.731916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951cae6-9877-4383-b682-9c6bb102b548 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/domains/aacd7053ed1e4e008ce0566bf1a998e6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:11.739745 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2456/4848] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:11 2022] GET /identity/v3/roles => generated 1651 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:11.740800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14addf4c-6435-434a-b21c-29a01ea7a2e0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:11.742594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-14addf4c-6435-434a-b21c-29a01ea7a2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:11.751418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951cae6-9877-4383-b682-9c6bb102b548 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:50:11.759309 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-4951cae6-9877-4383-b682-9c6bb102b548 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Could not find domain: aacd7053ed1e4e008ce0566bf1a998e6.: keystone.exception.DomainNotFound: Could not find domain: aacd7053ed1e4e008ce0566bf1a998e6. Aug 27 04:50:11.759309 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:50:11.759309 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:50:11.759309 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:50:11.759309 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:50:11.759309 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:50:11.759309 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:50:11.759309 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:50:11.759309 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: aacd7053ed1e4e008ce0566bf1a998e6. Aug 27 04:50:11.759309 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:50:11.759309 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:50:11.759309 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:50:11.759309 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:50:11.759309 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:50:11.759309 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:50:11.759309 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:50:11.760785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:50:11.760785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:50:11.760785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:50:11.760785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:50:11.760785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:50:11.760785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:50:11.760785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:50:11.760785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 27 04:50:11.760785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 27 04:50:11.760785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:50:11.760785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:50:11.760785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:50:11.760785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:50:11.760785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:50:11.760785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:50:11.760785 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:50:11.762055 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:50:11.762055 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:50:11.762055 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:50:11.762055 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:50:11.762055 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:50:11.762055 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:50:11.762055 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:50:11.762055 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:50:11.762055 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:50:11.762055 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:50:11.762055 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:50:11.762055 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:50:11.762055 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:50:11.762055 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:50:11.762055 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:50:11.762055 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: aacd7053ed1e4e008ce0566bf1a998e6. Aug 27 04:50:11.762055 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:50:11.767523 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2393/4849] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:50:11 2022] PATCH /identity/v3/domains/aacd7053ed1e4e008ce0566bf1a998e6 => generated 112 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:50:11.767523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951cae6-9877-4383-b682-9c6bb102b548 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:11.767523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4951cae6-9877-4383-b682-9c6bb102b548 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:11.883856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14addf4c-6435-434a-b21c-29a01ea7a2e0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:11.889210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951cae6-9877-4383-b682-9c6bb102b548 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:11.896416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d060063-a872-4d01-bfc8-bc8c00d63b61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:11.897252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d060063-a872-4d01-bfc8-bc8c00d63b61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:11.897537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d060063-a872-4d01-bfc8-bc8c00d63b61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:11.897812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d060063-a872-4d01-bfc8-bc8c00d63b61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/roles/67e65a1ecd864c888d091293f7eee1b6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:11.898071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ceebb-20eb-4ae2-bf33-2d0bea61e26a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:11.898834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ceebb-20eb-4ae2-bf33-2d0bea61e26a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:11.899225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ceebb-20eb-4ae2-bf33-2d0bea61e26a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:11.899628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ceebb-20eb-4ae2-bf33-2d0bea61e26a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/6c118283d0ba466f8e6d1dded7ff85e1` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:11.900583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d060063-a872-4d01-bfc8-bc8c00d63b61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:delete_role(role_id=67e65a1ecd864c888d091293f7eee1b6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:11.904873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d060063-a872-4d01-bfc8-bc8c00d63b61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:11.931964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ceebb-20eb-4ae2-bf33-2d0bea61e26a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=5d09243c3a074b5bb22d8ac45c0f8fa8, user_id=6c118283d0ba466f8e6d1dded7ff85e1)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:11.934088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ceebb-20eb-4ae2-bf33-2d0bea61e26a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:12.119616 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2457/4850] 10.222.0.76 () {60 vars in 1360 bytes} [Sat Aug 27 04:50:11 2022] PUT /identity/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/6c118283d0ba466f8e6d1dded7ff85e1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:12.123299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ceebb-20eb-4ae2-bf33-2d0bea61e26a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:12.181048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6d060063-a872-4d01-bfc8-bc8c00d63b61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invalidating the token cache because role 67e65a1ecd864c888d091293f7eee1b6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:12.181565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6d060063-a872-4d01-bfc8-bc8c00d63b61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:12.182530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6d060063-a872-4d01-bfc8-bc8c00d63b61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:12.189943 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2394/4851] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:11 2022] DELETE /identity/v3/roles/67e65a1ecd864c888d091293f7eee1b6 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:12.189943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d060063-a872-4d01-bfc8-bc8c00d63b61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:12.190308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ceebb-20eb-4ae2-bf33-2d0bea61e26a tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:12.191446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6d060063-a872-4d01-bfc8-bc8c00d63b61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:12.278535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad944f20-807d-4797-a35b-4d5dbb014ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:12.279367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad944f20-807d-4797-a35b-4d5dbb014ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:12.279648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad944f20-807d-4797-a35b-4d5dbb014ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:12.279919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad944f20-807d-4797-a35b-4d5dbb014ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:12.280593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad944f20-807d-4797-a35b-4d5dbb014ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:12.285292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad944f20-807d-4797-a35b-4d5dbb014ec2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:12.299379 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2458/4852] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:12.304010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad944f20-807d-4797-a35b-4d5dbb014ec2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:12.305819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d060063-a872-4d01-bfc8-bc8c00d63b61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:12.306007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ad944f20-807d-4797-a35b-4d5dbb014ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:12.313534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ebe37-c1f5-44e0-9168-7bc3696f3049 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0f4a6f1382341789d121621d5eb32b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '885dbfe1e433422a9cc74cdc68937b2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:12.314422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ebe37-c1f5-44e0-9168-7bc3696f3049 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:12.314951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ebe37-c1f5-44e0-9168-7bc3696f3049 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:12.315242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ebe37-c1f5-44e0-9168-7bc3696f3049 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] PATH_INFO: `/v3/domains/bf579870b233451f8c03b92397521789` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:12.331171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ebe37-c1f5-44e0-9168-7bc3696f3049 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:50:12.341773 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-138ebe37-c1f5-44e0-9168-7bc3696f3049 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Could not find domain: bf579870b233451f8c03b92397521789.: keystone.exception.DomainNotFound: Could not find domain: bf579870b233451f8c03b92397521789. Aug 27 04:50:12.341773 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:50:12.341773 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:50:12.341773 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:50:12.341773 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:50:12.341773 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:50:12.341773 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:50:12.341773 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:50:12.341773 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bf579870b233451f8c03b92397521789. Aug 27 04:50:12.341773 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:50:12.341773 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:50:12.341773 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:50:12.341773 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:50:12.341773 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:50:12.341773 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:50:12.341773 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:50:12.343151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:50:12.343151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:50:12.343151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:50:12.343151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:50:12.343151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:50:12.343151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:50:12.343151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:50:12.343151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 27 04:50:12.343151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 27 04:50:12.343151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:50:12.343151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:50:12.343151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:50:12.343151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:50:12.343151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:50:12.343151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:50:12.343151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:50:12.344400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:50:12.344400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:50:12.344400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:50:12.344400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:50:12.344400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:50:12.344400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:50:12.344400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:50:12.344400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:50:12.344400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:50:12.344400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:50:12.344400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:50:12.344400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:50:12.344400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:50:12.344400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:50:12.344400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:50:12.344400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: bf579870b233451f8c03b92397521789. Aug 27 04:50:12.344400 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:50:12.345663 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2395/4853] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:50:12 2022] PATCH /identity/v3/domains/bf579870b233451f8c03b92397521789 => generated 112 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:50:12.345663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ebe37-c1f5-44e0-9168-7bc3696f3049 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:12.347448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-138ebe37-c1f5-44e0-9168-7bc3696f3049 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:12.420960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:12.478108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad944f20-807d-4797-a35b-4d5dbb014ec2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:12.485384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010397fd-5207-4f78-a235-2ab4e9833308 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:12.486395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010397fd-5207-4f78-a235-2ab4e9833308 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:12.493063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010397fd-5207-4f78-a235-2ab4e9833308 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:12.493063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010397fd-5207-4f78-a235-2ab4e9833308 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:12.493063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010397fd-5207-4f78-a235-2ab4e9833308 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:12.493374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ebe37-c1f5-44e0-9168-7bc3696f3049 tempest-ProjectsTestJSON-813392900 tempest-ProjectsTestJSON-813392900-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:12.493494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010397fd-5207-4f78-a235-2ab4e9833308 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:12.497449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af0d92-8f2e-49d4-a3d4-54ac028baa66 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:12.498176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af0d92-8f2e-49d4-a3d4-54ac028baa66 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:12.498466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af0d92-8f2e-49d4-a3d4-54ac028baa66 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:12.498738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af0d92-8f2e-49d4-a3d4-54ac028baa66 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:12.499473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af0d92-8f2e-49d4-a3d4-54ac028baa66 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:12.501189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af0d92-8f2e-49d4-a3d4-54ac028baa66 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:12.644557 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2396/4854] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:50:12 2022] POST /identity/v3/roles => generated 239 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:12.645646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af0d92-8f2e-49d4-a3d4-54ac028baa66 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:12.648084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-40af0d92-8f2e-49d4-a3d4-54ac028baa66 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:12.650766 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2459/4855] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:12 2022] POST /identity/v3/users => generated 323 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:12.652430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010397fd-5207-4f78-a235-2ab4e9833308 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:12.655397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-010397fd-5207-4f78-a235-2ab4e9833308 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:12.665281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af0d92-8f2e-49d4-a3d4-54ac028baa66 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:12.694865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3074ea-91f6-4144-834c-9bb1bd8f6275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:12.694865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3074ea-91f6-4144-834c-9bb1bd8f6275 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:12.694865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3074ea-91f6-4144-834c-9bb1bd8f6275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:12.694865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3074ea-91f6-4144-834c-9bb1bd8f6275 admin admin] PATH_INFO: `/v3/projects/f0149f47762a47bcb51db10ffebdde95/users/10ff12e8150f4608b1ffe737a6b5d671/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:12.695804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010397fd-5207-4f78-a235-2ab4e9833308 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:12.695804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942519f-8ffd-4296-96c9-b0000733715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:12.695804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942519f-8ffd-4296-96c9-b0000733715b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:12.696269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942519f-8ffd-4296-96c9-b0000733715b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:12.696269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942519f-8ffd-4296-96c9-b0000733715b admin admin] PATH_INFO: `/v3/users/ff6eb8df4ce34a818bdd3b1ac33e5bbf` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:12.696269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942519f-8ffd-4296-96c9-b0000733715b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6eb8df4ce34a818bdd3b1ac33e5bbf)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:12.696269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942519f-8ffd-4296-96c9-b0000733715b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:12.696865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3074ea-91f6-4144-834c-9bb1bd8f6275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0149f47762a47bcb51db10ffebdde95, user_id=10ff12e8150f4608b1ffe737a6b5d671, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:12.696865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3074ea-91f6-4144-834c-9bb1bd8f6275 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:12.796107 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2397/4856] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:12 2022] PUT /identity/v3/projects/f0149f47762a47bcb51db10ffebdde95/users/10ff12e8150f4608b1ffe737a6b5d671/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:12.797226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3074ea-91f6-4144-834c-9bb1bd8f6275 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:12.914595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3074ea-91f6-4144-834c-9bb1bd8f6275 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:12.921572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab50cf1-4dd3-498c-93f1-677f9e9af07e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:12.922396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab50cf1-4dd3-498c-93f1-677f9e9af07e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:12.922751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab50cf1-4dd3-498c-93f1-677f9e9af07e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:12.923101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab50cf1-4dd3-498c-93f1-677f9e9af07e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/groups/c0233d75842742bf9891904fe46cccc6/roles/bb78d87f28d747028010a2585b2edb78/inherited_to_projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:12.928517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab50cf1-4dd3-498c-93f1-677f9e9af07e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0fdc4c46ff1b41e684af75195d332e66, group_id=c0233d75842742bf9891904fe46cccc6, role_id=bb78d87f28d747028010a2585b2edb78)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:12.931207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab50cf1-4dd3-498c-93f1-677f9e9af07e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:13.040208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:13.043898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a942519f-8ffd-4296-96c9-b0000733715b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6eb8df4ce34a818bdd3b1ac33e5bbf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:13.044793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a942519f-8ffd-4296-96c9-b0000733715b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6eb8df4ce34a818bdd3b1ac33e5bbf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:13.150239 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2398/4857] 10.222.0.76 () {60 vars in 1582 bytes} [Sat Aug 27 04:50:12 2022] PUT /identity/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/groups/c0233d75842742bf9891904fe46cccc6/roles/bb78d87f28d747028010a2585b2edb78/inherited_to_projects => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:13.151058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab50cf1-4dd3-498c-93f1-677f9e9af07e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:13.169556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a942519f-8ffd-4296-96c9-b0000733715b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6eb8df4ce34a818bdd3b1ac33e5bbf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:13.170544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a942519f-8ffd-4296-96c9-b0000733715b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6eb8df4ce34a818bdd3b1ac33e5bbf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:13.195615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a942519f-8ffd-4296-96c9-b0000733715b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6eb8df4ce34a818bdd3b1ac33e5bbf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:13.252282 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2460/4858] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:12 2022] DELETE /identity/v3/users/ff6eb8df4ce34a818bdd3b1ac33e5bbf => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:13.253938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b16183-01f6-4da6-acad-3af1deb7a364 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:13.254323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b16183-01f6-4da6-acad-3af1deb7a364 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:13.255901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b16183-01f6-4da6-acad-3af1deb7a364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:13.306816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f2b16183-01f6-4da6-acad-3af1deb7a364 None None] MFA Rules not processed for user `10ff12e8150f4608b1ffe737a6b5d671`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:13.308981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f2b16183-01f6-4da6-acad-3af1deb7a364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:13.315091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab50cf1-4dd3-498c-93f1-677f9e9af07e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:13.396157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795870f4-0635-46f9-937c-9864250a36ad tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:13.397103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795870f4-0635-46f9-937c-9864250a36ad tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:13.397742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795870f4-0635-46f9-937c-9864250a36ad tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:13.398226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795870f4-0635-46f9-937c-9864250a36ad tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/2a58c8dc16d54c28b8453da28e9b9d4b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:13.417826 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2461/4859] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:13.420074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b16183-01f6-4da6-acad-3af1deb7a364 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:13.432101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f2b16183-01f6-4da6-acad-3af1deb7a364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:13.434955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795870f4-0635-46f9-937c-9864250a36ad tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=5d09243c3a074b5bb22d8ac45c0f8fa8, user_id=2a58c8dc16d54c28b8453da28e9b9d4b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:13.441701 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-795870f4-0635-46f9-937c-9864250a36ad tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:13.441701 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:50:13.441701 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:13.441701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795870f4-0635-46f9-937c-9864250a36ad tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:13.530445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b16183-01f6-4da6-acad-3af1deb7a364 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:13.536097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e99f4-4fc8-453a-8133-f1ab4e31f94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:13.536872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e99f4-4fc8-453a-8133-f1ab4e31f94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:13.537244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e99f4-4fc8-453a-8133-f1ab4e31f94e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:13.537617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e99f4-4fc8-453a-8133-f1ab4e31f94e admin admin] PATH_INFO: `/v3/users/721664557be941adac164d6fc47f3b7a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:13.539308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e99f4-4fc8-453a-8133-f1ab4e31f94e admin admin] RBAC: Authorizing `identity:delete_user(user_id=721664557be941adac164d6fc47f3b7a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:13.541617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e99f4-4fc8-453a-8133-f1ab4e31f94e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:13.563272 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2399/4860] 10.222.0.76 () {60 vars in 1360 bytes} [Sat Aug 27 04:50:13 2022] PUT /identity/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/2a58c8dc16d54c28b8453da28e9b9d4b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:13.564443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795870f4-0635-46f9-937c-9864250a36ad tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:13.568561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-795870f4-0635-46f9-937c-9864250a36ad tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:13.668814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795870f4-0635-46f9-937c-9864250a36ad tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:13.677075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a65dc0-0716-4aea-b454-aafdc3910015 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:13.677846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65dc0-0716-4aea-b454-aafdc3910015 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:13.678313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65dc0-0716-4aea-b454-aafdc3910015 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:13.679249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65dc0-0716-4aea-b454-aafdc3910015 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/groups/c0233d75842742bf9891904fe46cccc6/roles/inherited_to_projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:13.681466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a65dc0-0716-4aea-b454-aafdc3910015 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=0fdc4c46ff1b41e684af75195d332e66, group_id=c0233d75842742bf9891904fe46cccc6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:13.683533 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-24a65dc0-0716-4aea-b454-aafdc3910015 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:13.683533 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:50:13.683533 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:13.686302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a65dc0-0716-4aea-b454-aafdc3910015 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:13.712678 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2400/4861] 10.222.0.76 () {58 vars in 1464 bytes} [Sat Aug 27 04:50:13 2022] GET /identity/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/groups/c0233d75842742bf9891904fe46cccc6/roles/inherited_to_projects => generated 447 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:13.714825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2adc0-427a-4fa8-b35e-4ba5bd74ab75 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:13.715226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2adc0-427a-4fa8-b35e-4ba5bd74ab75 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:13.715597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2adc0-427a-4fa8-b35e-4ba5bd74ab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:13.736881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:13.738177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-12f2adc0-427a-4fa8-b35e-4ba5bd74ab75 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:13.739749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-12f2adc0-427a-4fa8-b35e-4ba5bd74ab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:13.825790 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2401/4862] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:13.826725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2adc0-427a-4fa8-b35e-4ba5bd74ab75 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:13.829006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-12f2adc0-427a-4fa8-b35e-4ba5bd74ab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:13.844649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2adc0-427a-4fa8-b35e-4ba5bd74ab75 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:13.849292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-447e99f4-4fc8-453a-8133-f1ab4e31f94e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '721664557be941adac164d6fc47f3b7a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:13.850232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-447e99f4-4fc8-453a-8133-f1ab4e31f94e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '721664557be941adac164d6fc47f3b7a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:13.851386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54db1ca-da8a-4ef1-a32f-57d132cad62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:13.852292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54db1ca-da8a-4ef1-a32f-57d132cad62c admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:13.852599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54db1ca-da8a-4ef1-a32f-57d132cad62c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:13.852877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54db1ca-da8a-4ef1-a32f-57d132cad62c admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:13.853530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54db1ca-da8a-4ef1-a32f-57d132cad62c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:13.856771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54db1ca-da8a-4ef1-a32f-57d132cad62c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:13.990854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-447e99f4-4fc8-453a-8133-f1ab4e31f94e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '721664557be941adac164d6fc47f3b7a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:13.991645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-447e99f4-4fc8-453a-8133-f1ab4e31f94e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '721664557be941adac164d6fc47f3b7a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:14.007468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-447e99f4-4fc8-453a-8133-f1ab4e31f94e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '721664557be941adac164d6fc47f3b7a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:14.008484 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2402/4863] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:13 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:14.009282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54db1ca-da8a-4ef1-a32f-57d132cad62c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:14.012579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d54db1ca-da8a-4ef1-a32f-57d132cad62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:14.027601 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2462/4864] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:13 2022] DELETE /identity/v3/users/721664557be941adac164d6fc47f3b7a => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:14.028999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e99f4-4fc8-453a-8133-f1ab4e31f94e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:14.030459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-447e99f4-4fc8-453a-8133-f1ab4e31f94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:14.093666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54db1ca-da8a-4ef1-a32f-57d132cad62c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:14.103962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e99f4-4fc8-453a-8133-f1ab4e31f94e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:14.109677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980307d-4c73-47f2-a72d-4f1e3f8637f5 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:14.110448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980307d-4c73-47f2-a72d-4f1e3f8637f5 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:14.110732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980307d-4c73-47f2-a72d-4f1e3f8637f5 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:14.111010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980307d-4c73-47f2-a72d-4f1e3f8637f5 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/groups/c0233d75842742bf9891904fe46cccc6/roles/bb78d87f28d747028010a2585b2edb78/inherited_to_projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:14.113456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980307d-4c73-47f2-a72d-4f1e3f8637f5 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=0fdc4c46ff1b41e684af75195d332e66, group_id=c0233d75842742bf9891904fe46cccc6, role_id=bb78d87f28d747028010a2585b2edb78)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:14.116602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980307d-4c73-47f2-a72d-4f1e3f8637f5 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:14.125228 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2463/4865] 10.222.0.76 () {58 vars in 1564 bytes} [Sat Aug 27 04:50:14 2022] HEAD /identity/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/groups/c0233d75842742bf9891904fe46cccc6/roles/bb78d87f28d747028010a2585b2edb78/inherited_to_projects => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:14.129046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980307d-4c73-47f2-a72d-4f1e3f8637f5 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:14.133399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3980307d-4c73-47f2-a72d-4f1e3f8637f5 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:14.173720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f752d9-62ae-49ca-8c3d-527168c467d5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:14.173720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f752d9-62ae-49ca-8c3d-527168c467d5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:14.174055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f752d9-62ae-49ca-8c3d-527168c467d5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:14.174384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f752d9-62ae-49ca-8c3d-527168c467d5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:14.175760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f752d9-62ae-49ca-8c3d-527168c467d5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=5d09243c3a074b5bb22d8ac45c0f8fa8)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:14.177111 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-04f752d9-62ae-49ca-8c3d-527168c467d5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:14.177111 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:50:14.177111 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:14.179456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f752d9-62ae-49ca-8c3d-527168c467d5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:14.201122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980307d-4c73-47f2-a72d-4f1e3f8637f5 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:14.205145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee08a35-75bf-4274-b1b4-ae4a6416ca30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:14.205846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee08a35-75bf-4274-b1b4-ae4a6416ca30 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:14.206244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee08a35-75bf-4274-b1b4-ae4a6416ca30 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:14.219700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee08a35-75bf-4274-b1b4-ae4a6416ca30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:14.219700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4ee08a35-75bf-4274-b1b4-ae4a6416ca30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:14.219945 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2403/4866] 10.222.0.76 () {58 vars in 1242 bytes} [Sat Aug 27 04:50:14 2022] GET /identity/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users => generated 1085 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:14.219945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f752d9-62ae-49ca-8c3d-527168c467d5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:14.220728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-04f752d9-62ae-49ca-8c3d-527168c467d5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:14.279455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee08a35-75bf-4274-b1b4-ae4a6416ca30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:14.281016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee08a35-75bf-4274-b1b4-ae4a6416ca30 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:14.290481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f752d9-62ae-49ca-8c3d-527168c467d5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:14.291562 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2464/4867] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:14.296291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c0949-2beb-4757-b43e-614de1d2c71a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:14.296291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c0949-2beb-4757-b43e-614de1d2c71a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:14.296291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c0949-2beb-4757-b43e-614de1d2c71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:14.296592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7ceb2-d9eb-4288-958a-d07cb24f9d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:14.296700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7ceb2-d9eb-4288-958a-d07cb24f9d7c admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:14.296964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7ceb2-d9eb-4288-958a-d07cb24f9d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:14.297240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7ceb2-d9eb-4288-958a-d07cb24f9d7c admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:14.297880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7ceb2-d9eb-4288-958a-d07cb24f9d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:14.300709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7ceb2-d9eb-4288-958a-d07cb24f9d7c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:14.327312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6b9c0949-2beb-4757-b43e-614de1d2c71a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:14.329390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6b9c0949-2beb-4757-b43e-614de1d2c71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:14.340154 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2465/4868] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:14.342137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c0949-2beb-4757-b43e-614de1d2c71a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:14.356526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c0949-2beb-4757-b43e-614de1d2c71a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:14.361988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e85c8-b015-439d-b047-3d0805cc2f61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:14.362715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e85c8-b015-439d-b047-3d0805cc2f61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:14.363040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e85c8-b015-439d-b047-3d0805cc2f61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:14.363325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e85c8-b015-439d-b047-3d0805cc2f61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/groups/c0233d75842742bf9891904fe46cccc6/roles/bb78d87f28d747028010a2585b2edb78/inherited_to_projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:14.367462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e85c8-b015-439d-b047-3d0805cc2f61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0fdc4c46ff1b41e684af75195d332e66, group_id=c0233d75842742bf9891904fe46cccc6, role_id=bb78d87f28d747028010a2585b2edb78)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:14.370914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e85c8-b015-439d-b047-3d0805cc2f61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:14.378614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-792e85c8-b015-439d-b047-3d0805cc2f61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invalidating the token cache because role bb78d87f28d747028010a2585b2edb78 was removed from group c0233d75842742bf9891904fe46cccc6 on domain 0fdc4c46ff1b41e684af75195d332e66. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:14.385895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-792e85c8-b015-439d-b047-3d0805cc2f61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:14.385895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-792e85c8-b015-439d-b047-3d0805cc2f61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:14.426163 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2404/4869] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:14 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:14.429711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7ceb2-d9eb-4288-958a-d07cb24f9d7c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:14.429711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c5d7ceb2-d9eb-4288-958a-d07cb24f9d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:14.442623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7ceb2-d9eb-4288-958a-d07cb24f9d7c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:14.447421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e17ed-acf8-4940-9121-2e2c92027913 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:14.448100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e17ed-acf8-4940-9121-2e2c92027913 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:14.448444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e17ed-acf8-4940-9121-2e2c92027913 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:14.448937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e17ed-acf8-4940-9121-2e2c92027913 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/c83b01e412054edab08bab7113c9b52c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:14.450615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e17ed-acf8-4940-9121-2e2c92027913 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=5d09243c3a074b5bb22d8ac45c0f8fa8, user_id=c83b01e412054edab08bab7113c9b52c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:14.451766 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-a66e17ed-acf8-4940-9121-2e2c92027913 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:14.451766 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:50:14.451766 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:14.454313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e17ed-acf8-4940-9121-2e2c92027913 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:14.468789 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2405/4870] 10.222.0.76 () {58 vars in 1342 bytes} [Sat Aug 27 04:50:14 2022] HEAD /identity/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/c83b01e412054edab08bab7113c9b52c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:14.469943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e17ed-acf8-4940-9121-2e2c92027913 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:14.475951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a66e17ed-acf8-4940-9121-2e2c92027913 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:14.486338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e17ed-acf8-4940-9121-2e2c92027913 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:14.490080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370ce3b-50ec-410e-8596-99db78f54c21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:14.490684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370ce3b-50ec-410e-8596-99db78f54c21 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:14.490987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370ce3b-50ec-410e-8596-99db78f54c21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:14.491336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370ce3b-50ec-410e-8596-99db78f54c21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:14.493164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6370ce3b-50ec-410e-8596-99db78f54c21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:14.506282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370ce3b-50ec-410e-8596-99db78f54c21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:14.508207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370ce3b-50ec-410e-8596-99db78f54c21 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:14.520286 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2466/4871] 10.222.0.76 () {58 vars in 1566 bytes} [Sat Aug 27 04:50:14 2022] DELETE /identity/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/groups/c0233d75842742bf9891904fe46cccc6/roles/bb78d87f28d747028010a2585b2edb78/inherited_to_projects => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:14.525567 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2406/4872] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:14.525824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e85c8-b015-439d-b047-3d0805cc2f61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:14.525945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370ce3b-50ec-410e-8596-99db78f54c21 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:14.526048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-792e85c8-b015-439d-b047-3d0805cc2f61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:14.534277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370ce3b-50ec-410e-8596-99db78f54c21 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:14.610996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f146ea-d819-43e3-b0d4-c03748c466b2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:14.614530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f146ea-d819-43e3-b0d4-c03748c466b2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:14.614530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f146ea-d819-43e3-b0d4-c03748c466b2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:14.614530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f146ea-d819-43e3-b0d4-c03748c466b2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/c83b01e412054edab08bab7113c9b52c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:14.615873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f146ea-d819-43e3-b0d4-c03748c466b2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=5d09243c3a074b5bb22d8ac45c0f8fa8, user_id=c83b01e412054edab08bab7113c9b52c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:14.617643 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-c6f146ea-d819-43e3-b0d4-c03748c466b2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:14.617643 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:50:14.617643 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:14.618893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f146ea-d819-43e3-b0d4-c03748c466b2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:14.623607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e85c8-b015-439d-b047-3d0805cc2f61 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:14.629498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f88568-d3a2-4963-9df4-5ba7ba5ae865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:14.630279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f88568-d3a2-4963-9df4-5ba7ba5ae865 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:14.630563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f88568-d3a2-4963-9df4-5ba7ba5ae865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:14.630838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f88568-d3a2-4963-9df4-5ba7ba5ae865 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:14.631487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f88568-d3a2-4963-9df4-5ba7ba5ae865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:14.633272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f88568-d3a2-4963-9df4-5ba7ba5ae865 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:14.655900 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2467/4873] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:14 2022] GET /identity/v3/roles => generated 1650 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:14.657996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f88568-d3a2-4963-9df4-5ba7ba5ae865 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:14.660583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-76f88568-d3a2-4963-9df4-5ba7ba5ae865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:14.660796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:14.747061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f88568-d3a2-4963-9df4-5ba7ba5ae865 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:14.752055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532bd14-0c2f-4854-9db9-3b91d75ad9e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:14.752484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532bd14-0c2f-4854-9db9-3b91d75ad9e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:14.752768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532bd14-0c2f-4854-9db9-3b91d75ad9e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:14.753051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532bd14-0c2f-4854-9db9-3b91d75ad9e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/roles/bb78d87f28d747028010a2585b2edb78` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:14.754511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532bd14-0c2f-4854-9db9-3b91d75ad9e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bb78d87f28d747028010a2585b2edb78)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:14.756289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532bd14-0c2f-4854-9db9-3b91d75ad9e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:14.771030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c6f146ea-d819-43e3-b0d4-c03748c466b2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c83b01e412054edab08bab7113c9b52c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:15.077380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7532bd14-0c2f-4854-9db9-3b91d75ad9e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invalidating the token cache because role bb78d87f28d747028010a2585b2edb78 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:15.077744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7532bd14-0c2f-4854-9db9-3b91d75ad9e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:15.078139 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2407/4874] 10.222.0.76 () {58 vars in 1344 bytes} [Sat Aug 27 04:50:14 2022] DELETE /identity/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/c83b01e412054edab08bab7113c9b52c => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:15.099822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7532bd14-0c2f-4854-9db9-3b91d75ad9e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:15.100070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f146ea-d819-43e3-b0d4-c03748c466b2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:15.100070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c6f146ea-d819-43e3-b0d4-c03748c466b2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:15.100295 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2468/4875] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:14 2022] DELETE /identity/v3/roles/bb78d87f28d747028010a2585b2edb78 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:15.100295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532bd14-0c2f-4854-9db9-3b91d75ad9e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:15.100295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7532bd14-0c2f-4854-9db9-3b91d75ad9e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:15.165908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532bd14-0c2f-4854-9db9-3b91d75ad9e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:15.172342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f146ea-d819-43e3-b0d4-c03748c466b2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:15.173456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3abbe4-06cb-48f3-bd45-49afb04d73c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:15.174623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3abbe4-06cb-48f3-bd45-49afb04d73c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:15.175131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3abbe4-06cb-48f3-bd45-49afb04d73c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:15.175615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3abbe4-06cb-48f3-bd45-49afb04d73c3 admin admin] PATH_INFO: `/v3/users/1599979f94f34b579e3cd4ac963de1d3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:15.177242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3abbe4-06cb-48f3-bd45-49afb04d73c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1599979f94f34b579e3cd4ac963de1d3)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:15.177858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaab92d-9dd0-4ee7-86bf-ef13bbe4c63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:15.183285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaab92d-9dd0-4ee7-86bf-ef13bbe4c63e admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:15.183285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaab92d-9dd0-4ee7-86bf-ef13bbe4c63e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:15.183285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaab92d-9dd0-4ee7-86bf-ef13bbe4c63e admin admin] PATH_INFO: `/v3/projects/9c04c6bdae564cda9d7860f8f7cb4ef6/users/3857e931f44a44dbadcb0d0789817e56/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:15.183571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3abbe4-06cb-48f3-bd45-49afb04d73c3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:15.221874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaab92d-9dd0-4ee7-86bf-ef13bbe4c63e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c04c6bdae564cda9d7860f8f7cb4ef6, user_id=3857e931f44a44dbadcb0d0789817e56, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:15.225203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaab92d-9dd0-4ee7-86bf-ef13bbe4c63e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:15.304046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:15.469101 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2408/4876] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:15 2022] PUT /identity/v3/projects/9c04c6bdae564cda9d7860f8f7cb4ef6/users/3857e931f44a44dbadcb0d0789817e56/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:15.469950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaab92d-9dd0-4ee7-86bf-ef13bbe4c63e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:15.473064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4aaab92d-9dd0-4ee7-86bf-ef13bbe4c63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:15.523676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fa3abbe4-06cb-48f3-bd45-49afb04d73c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1599979f94f34b579e3cd4ac963de1d3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:15.524392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fa3abbe4-06cb-48f3-bd45-49afb04d73c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1599979f94f34b579e3cd4ac963de1d3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:15.542856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaab92d-9dd0-4ee7-86bf-ef13bbe4c63e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:15.547542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929674fa-f23e-48b8-9e56-d402cab70636 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:15.548221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929674fa-f23e-48b8-9e56-d402cab70636 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:15.548509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929674fa-f23e-48b8-9e56-d402cab70636 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:15.548787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929674fa-f23e-48b8-9e56-d402cab70636 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/6c118283d0ba466f8e6d1dded7ff85e1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:15.550459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929674fa-f23e-48b8-9e56-d402cab70636 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=5d09243c3a074b5bb22d8ac45c0f8fa8, user_id=6c118283d0ba466f8e6d1dded7ff85e1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:15.552476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929674fa-f23e-48b8-9e56-d402cab70636 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:15.566023 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2409/4877] 10.222.0.76 () {58 vars in 1342 bytes} [Sat Aug 27 04:50:15 2022] HEAD /identity/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/6c118283d0ba466f8e6d1dded7ff85e1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:15.566806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929674fa-f23e-48b8-9e56-d402cab70636 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:15.568480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-929674fa-f23e-48b8-9e56-d402cab70636 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:15.636121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929674fa-f23e-48b8-9e56-d402cab70636 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:15.644643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10846ecc-fab9-4272-a2aa-728ef09a39ff tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:15.645135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fa3abbe4-06cb-48f3-bd45-49afb04d73c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1599979f94f34b579e3cd4ac963de1d3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:15.645321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10846ecc-fab9-4272-a2aa-728ef09a39ff tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:15.645608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10846ecc-fab9-4272-a2aa-728ef09a39ff tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:15.645941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10846ecc-fab9-4272-a2aa-728ef09a39ff tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:15.647427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10846ecc-fab9-4272-a2aa-728ef09a39ff tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:15.647535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fa3abbe4-06cb-48f3-bd45-49afb04d73c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1599979f94f34b579e3cd4ac963de1d3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:15.648625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10846ecc-fab9-4272-a2aa-728ef09a39ff tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:15.661760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fa3abbe4-06cb-48f3-bd45-49afb04d73c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1599979f94f34b579e3cd4ac963de1d3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:15.675479 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2469/4878] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:15 2022] DELETE /identity/v3/users/1599979f94f34b579e3cd4ac963de1d3 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:15.676327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3abbe4-06cb-48f3-bd45-49afb04d73c3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:15.677640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fa3abbe4-06cb-48f3-bd45-49afb04d73c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:15.747176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3abbe4-06cb-48f3-bd45-49afb04d73c3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:15.752570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:15.753052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:15.753355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:15.753639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52 admin admin] PATH_INFO: `/v3/projects/c95c51d779ca4aadba49b68e6b170e25` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:15.754777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c95c51d779ca4aadba49b68e6b170e25)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:15.756759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:15.832377 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2410/4879] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:50:15 2022] POST /identity/v3/roles => generated 239 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:15.832377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10846ecc-fab9-4272-a2aa-728ef09a39ff tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:15.832377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-10846ecc-fab9-4272-a2aa-728ef09a39ff tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:15.902497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10846ecc-fab9-4272-a2aa-728ef09a39ff tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:15.907316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:15.907993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:15.908293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:15.908570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7 admin admin] PATH_INFO: `/v3/projects/3bedb768e79a4953b5e55a492f7b3469` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:15.909708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bedb768e79a4953b5e55a492f7b3469)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:15.911623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:15.959219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c95c51d779ca4aadba49b68e6b170e25', 'request_id': 'req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:15.968933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c95c51d779ca4aadba49b68e6b170e25', 'request_id': 'req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.114978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c95c51d779ca4aadba49b68e6b170e25', 'request_id': 'req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.133686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52 admin admin] The token cache is being invalidate because project c95c51d779ca4aadba49b68e6b170e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:16.133974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.134804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.137128 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2470/4880] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:15 2022] DELETE /identity/v3/projects/c95c51d779ca4aadba49b68e6b170e25 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:16.137906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:16.139291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:16.143674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bedb768e79a4953b5e55a492f7b3469', 'request_id': 'req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.150797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bedb768e79a4953b5e55a492f7b3469', 'request_id': 'req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.159436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bedb768e79a4953b5e55a492f7b3469', 'request_id': 'req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.233115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b2bdc-8ddd-43d3-ba37-9bef086b3a52 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:16.264325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7 admin admin] The token cache is being invalidate because project 3bedb768e79a4953b5e55a492f7b3469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:16.264830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.265489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.267474 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2411/4881] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:15 2022] DELETE /identity/v3/projects/3bedb768e79a4953b5e55a492f7b3469 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:16.268099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:16.270324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:16.298382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9ddbf-52db-4450-98cb-48d6713ba672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:16.299032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9ddbf-52db-4450-98cb-48d6713ba672 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:16.299369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9ddbf-52db-4450-98cb-48d6713ba672 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:16.299730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9ddbf-52db-4450-98cb-48d6713ba672 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:16.300852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9ddbf-52db-4450-98cb-48d6713ba672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:16.302117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9ddbf-52db-4450-98cb-48d6713ba672 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:16.313809 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2471/4882] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:16 2022] GET /identity/v3/roles => generated 1650 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:16.314836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9ddbf-52db-4450-98cb-48d6713ba672 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:16.318181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a6c9ddbf-52db-4450-98cb-48d6713ba672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:16.341117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557cba6-bc2f-4535-ad33-c84fb9e0e0b7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:16.346478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1db81b-22fe-472f-aace-c8a10929de06 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:16.347477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1db81b-22fe-472f-aace-c8a10929de06 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:16.347570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1db81b-22fe-472f-aace-c8a10929de06 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:16.347857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1db81b-22fe-472f-aace-c8a10929de06 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/6c118283d0ba466f8e6d1dded7ff85e1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:16.349566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1db81b-22fe-472f-aace-c8a10929de06 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=5d09243c3a074b5bb22d8ac45c0f8fa8, user_id=6c118283d0ba466f8e6d1dded7ff85e1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:16.351516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1db81b-22fe-472f-aace-c8a10929de06 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:16.396998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9ddbf-52db-4450-98cb-48d6713ba672 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:16.402567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cbc67-29b6-4785-b84c-ded279da52cf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:16.403236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cbc67-29b6-4785-b84c-ded279da52cf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:16.403514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cbc67-29b6-4785-b84c-ded279da52cf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:16.403785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cbc67-29b6-4785-b84c-ded279da52cf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/users/86196ef01bd642d19c49f3c54beddc33/roles/4ffe4d48540f48a4b71eb3cce4fcd4f4/inherited_to_projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:16.406229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2cbc67-29b6-4785-b84c-ded279da52cf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0fdc4c46ff1b41e684af75195d332e66, user_id=86196ef01bd642d19c49f3c54beddc33, role_id=4ffe4d48540f48a4b71eb3cce4fcd4f4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:16.409713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2cbc67-29b6-4785-b84c-ded279da52cf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:16.473087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9e1db81b-22fe-472f-aace-c8a10929de06 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6c118283d0ba466f8e6d1dded7ff85e1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.545679 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2472/4883] 10.222.0.76 () {60 vars in 1579 bytes} [Sat Aug 27 04:50:16 2022] PUT /identity/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/users/86196ef01bd642d19c49f3c54beddc33/roles/4ffe4d48540f48a4b71eb3cce4fcd4f4/inherited_to_projects => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:16.548915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cbc67-29b6-4785-b84c-ded279da52cf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:16.549183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8d2cbc67-29b6-4785-b84c-ded279da52cf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:16.614149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cbc67-29b6-4785-b84c-ded279da52cf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:16.618873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6b0fd-a17a-481a-913a-44bb17df7adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:16.619509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b0fd-a17a-481a-913a-44bb17df7adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:16.620363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b0fd-a17a-481a-913a-44bb17df7adf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:16.621270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b0fd-a17a-481a-913a-44bb17df7adf admin admin] PATH_INFO: `/v3/projects/f800461258fb485ba56ba8e7a837f5bf` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:16.622455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6b0fd-a17a-481a-913a-44bb17df7adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f800461258fb485ba56ba8e7a837f5bf)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:16.624393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6b0fd-a17a-481a-913a-44bb17df7adf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:16.686887 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2412/4884] 10.222.0.76 () {58 vars in 1344 bytes} [Sat Aug 27 04:50:16 2022] DELETE /identity/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/6c118283d0ba466f8e6d1dded7ff85e1 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:16.692385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf512e-1186-47f9-99ae-9bbdefad475b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:16.692385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf512e-1186-47f9-99ae-9bbdefad475b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:16.692385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf512e-1186-47f9-99ae-9bbdefad475b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:16.711348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3dbf512e-1186-47f9-99ae-9bbdefad475b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:16.712595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3dbf512e-1186-47f9-99ae-9bbdefad475b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:16.785789 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2413/4885] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:16.785789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf512e-1186-47f9-99ae-9bbdefad475b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:16.786105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8c6b0fd-a17a-481a-913a-44bb17df7adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f800461258fb485ba56ba8e7a837f5bf', 'request_id': 'req-b8c6b0fd-a17a-481a-913a-44bb17df7adf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.787328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8c6b0fd-a17a-481a-913a-44bb17df7adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f800461258fb485ba56ba8e7a837f5bf', 'request_id': 'req-b8c6b0fd-a17a-481a-913a-44bb17df7adf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.787582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3dbf512e-1186-47f9-99ae-9bbdefad475b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:16.800767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf512e-1186-47f9-99ae-9bbdefad475b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:16.864529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f456f9d-d966-43b7-9b50-bf47750994bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:16.870533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f456f9d-d966-43b7-9b50-bf47750994bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:16.870533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f456f9d-d966-43b7-9b50-bf47750994bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:16.870533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f456f9d-d966-43b7-9b50-bf47750994bc admin admin] PATH_INFO: `/v3/users/b0f4a6f1382341789d121621d5eb32b1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:16.870533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f456f9d-d966-43b7-9b50-bf47750994bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f4a6f1382341789d121621d5eb32b1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:16.870533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f456f9d-d966-43b7-9b50-bf47750994bc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:16.902347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8c6b0fd-a17a-481a-913a-44bb17df7adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f800461258fb485ba56ba8e7a837f5bf', 'request_id': 'req-b8c6b0fd-a17a-481a-913a-44bb17df7adf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.915494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8c6b0fd-a17a-481a-913a-44bb17df7adf admin admin] The token cache is being invalidate because project f800461258fb485ba56ba8e7a837f5bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:16.915782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8c6b0fd-a17a-481a-913a-44bb17df7adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.916481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b8c6b0fd-a17a-481a-913a-44bb17df7adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:16.918953 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2473/4886] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:16 2022] DELETE /identity/v3/projects/f800461258fb485ba56ba8e7a837f5bf => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:16.919713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6b0fd-a17a-481a-913a-44bb17df7adf admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:16.921020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b8c6b0fd-a17a-481a-913a-44bb17df7adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:16.934619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6b0fd-a17a-481a-913a-44bb17df7adf admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:16.940901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d694aa-8cea-4957-907f-71ee93936eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:16.941594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d694aa-8cea-4957-907f-71ee93936eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:16.941874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d694aa-8cea-4957-907f-71ee93936eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:16.942202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d694aa-8cea-4957-907f-71ee93936eb0 admin admin] PATH_INFO: `/v3/projects/9c04c6bdae564cda9d7860f8f7cb4ef6/users/3857e931f44a44dbadcb0d0789817e56/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:16.944195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d694aa-8cea-4957-907f-71ee93936eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c04c6bdae564cda9d7860f8f7cb4ef6, user_id=3857e931f44a44dbadcb0d0789817e56, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:16.946943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d694aa-8cea-4957-907f-71ee93936eb0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:16.959928 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2474/4887] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:16 2022] PUT /identity/v3/projects/9c04c6bdae564cda9d7860f8f7cb4ef6/users/3857e931f44a44dbadcb0d0789817e56/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:16.960463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d694aa-8cea-4957-907f-71ee93936eb0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:16.970447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a7d694aa-8cea-4957-907f-71ee93936eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:17.040326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d694aa-8cea-4957-907f-71ee93936eb0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:17.045173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348d651-caa7-42a6-807b-aabc635107a7 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:17.045841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348d651-caa7-42a6-807b-aabc635107a7 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:17.046121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348d651-caa7-42a6-807b-aabc635107a7 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:17.046548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348d651-caa7-42a6-807b-aabc635107a7 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/users/86196ef01bd642d19c49f3c54beddc33/roles/inherited_to_projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:17.048277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348d651-caa7-42a6-807b-aabc635107a7 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=0fdc4c46ff1b41e684af75195d332e66, user_id=86196ef01bd642d19c49f3c54beddc33)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:17.049304 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-2348d651-caa7-42a6-807b-aabc635107a7 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:17.049304 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:50:17.049304 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:50:17.051155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348d651-caa7-42a6-807b-aabc635107a7 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:17.064516 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2475/4888] 10.222.0.76 () {58 vars in 1461 bytes} [Sat Aug 27 04:50:16 2022] GET /identity/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/users/86196ef01bd642d19c49f3c54beddc33/roles/inherited_to_projects => generated 446 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:17.065372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348d651-caa7-42a6-807b-aabc635107a7 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:17.067148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2348d651-caa7-42a6-807b-aabc635107a7 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:17.134053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348d651-caa7-42a6-807b-aabc635107a7 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:17.140519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc8682-3356-47c9-9f59-7a0fd83e9f53 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:17.141067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc8682-3356-47c9-9f59-7a0fd83e9f53 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:17.141426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc8682-3356-47c9-9f59-7a0fd83e9f53 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:17.141699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc8682-3356-47c9-9f59-7a0fd83e9f53 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/2a58c8dc16d54c28b8453da28e9b9d4b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:17.143458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc8682-3356-47c9-9f59-7a0fd83e9f53 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=5d09243c3a074b5bb22d8ac45c0f8fa8, user_id=2a58c8dc16d54c28b8453da28e9b9d4b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:17.144534 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-8cfc8682-3356-47c9-9f59-7a0fd83e9f53 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:17.144534 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:50:17.144534 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:50:17.145701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc8682-3356-47c9-9f59-7a0fd83e9f53 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:17.159827 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2476/4889] 10.222.0.76 () {58 vars in 1342 bytes} [Sat Aug 27 04:50:17 2022] HEAD /identity/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/2a58c8dc16d54c28b8453da28e9b9d4b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:17.161148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d702d-1e5b-4170-9e37-43259ec5d77b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:17.161431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d702d-1e5b-4170-9e37-43259ec5d77b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:17.161698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d702d-1e5b-4170-9e37-43259ec5d77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:17.177676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9f456f9d-d966-43b7-9b50-bf47750994bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f4a6f1382341789d121621d5eb32b1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.181319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7d1d702d-1e5b-4170-9e37-43259ec5d77b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:17.183184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7d1d702d-1e5b-4170-9e37-43259ec5d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:17.245766 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2477/4890] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:17.246901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d702d-1e5b-4170-9e37-43259ec5d77b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:17.248397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7d1d702d-1e5b-4170-9e37-43259ec5d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:17.262508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d702d-1e5b-4170-9e37-43259ec5d77b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:17.268113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b1cf6-d867-4d0a-b5c8-fdd2f0ab6c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:17.268948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b1cf6-d867-4d0a-b5c8-fdd2f0ab6c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:17.269169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b1cf6-d867-4d0a-b5c8-fdd2f0ab6c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:17.269456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b1cf6-d867-4d0a-b5c8-fdd2f0ab6c45 admin admin] PATH_INFO: `/v3/users/266c2afa4bdd4a959047d57f085d589c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:17.270615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b1cf6-d867-4d0a-b5c8-fdd2f0ab6c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=266c2afa4bdd4a959047d57f085d589c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:17.272670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b1cf6-d867-4d0a-b5c8-fdd2f0ab6c45 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:17.282309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9f456f9d-d966-43b7-9b50-bf47750994bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f4a6f1382341789d121621d5eb32b1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.282946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9f456f9d-d966-43b7-9b50-bf47750994bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f4a6f1382341789d121621d5eb32b1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.302240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9f456f9d-d966-43b7-9b50-bf47750994bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f4a6f1382341789d121621d5eb32b1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.318414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9f456f9d-d966-43b7-9b50-bf47750994bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f4a6f1382341789d121621d5eb32b1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.325844 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2414/4891] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:16 2022] DELETE /identity/v3/users/b0f4a6f1382341789d121621d5eb32b1 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:17.327742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35561e-2a22-4e96-8b4a-6d69e76abfa1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:17.328295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35561e-2a22-4e96-8b4a-6d69e76abfa1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:17.328837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35561e-2a22-4e96-8b4a-6d69e76abfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:17.362633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0c35561e-2a22-4e96-8b4a-6d69e76abfa1 None None] MFA Rules not processed for user `3857e931f44a44dbadcb0d0789817e56`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:17.363897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0c35561e-2a22-4e96-8b4a-6d69e76abfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:17.446478 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2415/4892] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:17.447345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35561e-2a22-4e96-8b4a-6d69e76abfa1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:17.449085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0c35561e-2a22-4e96-8b4a-6d69e76abfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:17.460948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:17.520401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35561e-2a22-4e96-8b4a-6d69e76abfa1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:17.525169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b52586-8a3b-4604-8e6a-490afcd27e6e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:17.525896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b52586-8a3b-4604-8e6a-490afcd27e6e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:17.526430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b52586-8a3b-4604-8e6a-490afcd27e6e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:17.526777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b52586-8a3b-4604-8e6a-490afcd27e6e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/users/86196ef01bd642d19c49f3c54beddc33/roles/4ffe4d48540f48a4b71eb3cce4fcd4f4/inherited_to_projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:17.529114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b52586-8a3b-4604-8e6a-490afcd27e6e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=0fdc4c46ff1b41e684af75195d332e66, user_id=86196ef01bd642d19c49f3c54beddc33, role_id=4ffe4d48540f48a4b71eb3cce4fcd4f4)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:17.531773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b52586-8a3b-4604-8e6a-490afcd27e6e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:17.538411 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2416/4893] 10.222.0.76 () {58 vars in 1561 bytes} [Sat Aug 27 04:50:17 2022] HEAD /identity/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/users/86196ef01bd642d19c49f3c54beddc33/roles/4ffe4d48540f48a4b71eb3cce4fcd4f4/inherited_to_projects => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:17.539279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b52586-8a3b-4604-8e6a-490afcd27e6e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:17.541152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e9b52586-8a3b-4604-8e6a-490afcd27e6e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:17.573924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cd9b1cf6-d867-4d0a-b5c8-fdd2f0ab6c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '266c2afa4bdd4a959047d57f085d589c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.574970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cd9b1cf6-d867-4d0a-b5c8-fdd2f0ab6c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '266c2afa4bdd4a959047d57f085d589c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.612595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b52586-8a3b-4604-8e6a-490afcd27e6e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:17.619367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b1041-3066-4dc4-a673-0387197f97b8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:17.620446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b1041-3066-4dc4-a673-0387197f97b8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:17.620974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b1041-3066-4dc4-a673-0387197f97b8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:17.621256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b1041-3066-4dc4-a673-0387197f97b8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/2a58c8dc16d54c28b8453da28e9b9d4b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:17.623507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b1041-3066-4dc4-a673-0387197f97b8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=5d09243c3a074b5bb22d8ac45c0f8fa8, user_id=2a58c8dc16d54c28b8453da28e9b9d4b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:17.625670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b1041-3066-4dc4-a673-0387197f97b8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:17.708265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cd9b1cf6-d867-4d0a-b5c8-fdd2f0ab6c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '266c2afa4bdd4a959047d57f085d589c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.708917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cd9b1cf6-d867-4d0a-b5c8-fdd2f0ab6c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '266c2afa4bdd4a959047d57f085d589c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.723693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cd9b1cf6-d867-4d0a-b5c8-fdd2f0ab6c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '266c2afa4bdd4a959047d57f085d589c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.739452 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2478/4894] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:17 2022] DELETE /identity/v3/users/266c2afa4bdd4a959047d57f085d589c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:17.740720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b1cf6-d867-4d0a-b5c8-fdd2f0ab6c45 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:17.743522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cd9b1cf6-d867-4d0a-b5c8-fdd2f0ab6c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:17.756731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b35b1041-3066-4dc4-a673-0387197f97b8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2a58c8dc16d54c28b8453da28e9b9d4b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:17.825404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b1cf6-d867-4d0a-b5c8-fdd2f0ab6c45 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:17.830491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87b9b5-2fea-49dd-bf20-29f9f22a4753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:17.831270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87b9b5-2fea-49dd-bf20-29f9f22a4753 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:17.831644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87b9b5-2fea-49dd-bf20-29f9f22a4753 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:17.831922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87b9b5-2fea-49dd-bf20-29f9f22a4753 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:17.832674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87b9b5-2fea-49dd-bf20-29f9f22a4753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:17.832973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87b9b5-2fea-49dd-bf20-29f9f22a4753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:17.834897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87b9b5-2fea-49dd-bf20-29f9f22a4753 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:17.847904 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2479/4895] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:17.849570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87b9b5-2fea-49dd-bf20-29f9f22a4753 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:17.851312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1d87b9b5-2fea-49dd-bf20-29f9f22a4753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:17.921858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87b9b5-2fea-49dd-bf20-29f9f22a4753 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:17.926752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec1546-56dd-4c51-ac04-b40224a0892c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:17.927475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec1546-56dd-4c51-ac04-b40224a0892c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:17.927874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec1546-56dd-4c51-ac04-b40224a0892c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:17.928171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec1546-56dd-4c51-ac04-b40224a0892c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:17.928843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec1546-56dd-4c51-ac04-b40224a0892c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:17.930488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec1546-56dd-4c51-ac04-b40224a0892c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:17.977572 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2417/4896] 10.222.0.76 () {58 vars in 1344 bytes} [Sat Aug 27 04:50:17 2022] DELETE /identity/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users/2a58c8dc16d54c28b8453da28e9b9d4b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:17.978604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b1041-3066-4dc4-a673-0387197f97b8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:17.981143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b35b1041-3066-4dc4-a673-0387197f97b8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:18.012695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:18.052121 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2480/4897] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:17 2022] POST /identity/v3/services => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:18.053580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec1546-56dd-4c51-ac04-b40224a0892c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:18.074807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b1041-3066-4dc4-a673-0387197f97b8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:18.098007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b2ecb-bb9d-449b-9a8f-de53f37bfc93 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:18.102569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b2ecb-bb9d-449b-9a8f-de53f37bfc93 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:18.102569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b2ecb-bb9d-449b-9a8f-de53f37bfc93 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:18.102569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b2ecb-bb9d-449b-9a8f-de53f37bfc93 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/users/86196ef01bd642d19c49f3c54beddc33/roles/4ffe4d48540f48a4b71eb3cce4fcd4f4/inherited_to_projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:18.103881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b2ecb-bb9d-449b-9a8f-de53f37bfc93 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0fdc4c46ff1b41e684af75195d332e66, user_id=86196ef01bd642d19c49f3c54beddc33, role_id=4ffe4d48540f48a4b71eb3cce4fcd4f4)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:18.108346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b2ecb-bb9d-449b-9a8f-de53f37bfc93 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:18.116346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5c0b2ecb-bb9d-449b-9a8f-de53f37bfc93 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invalidating the token cache because role 4ffe4d48540f48a4b71eb3cce4fcd4f4 was removed from user 86196ef01bd642d19c49f3c54beddc33 on domain 0fdc4c46ff1b41e684af75195d332e66. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:18.116346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5c0b2ecb-bb9d-449b-9a8f-de53f37bfc93 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:18.116798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5c0b2ecb-bb9d-449b-9a8f-de53f37bfc93 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:18.134888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec1546-56dd-4c51-ac04-b40224a0892c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:18.210153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8ab2c-649e-4101-beb6-0ad836c39232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:18.210798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8ab2c-649e-4101-beb6-0ad836c39232 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:18.211073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8ab2c-649e-4101-beb6-0ad836c39232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:18.211346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8ab2c-649e-4101-beb6-0ad836c39232 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:18.211979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8ab2c-649e-4101-beb6-0ad836c39232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:18.214975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8ab2c-649e-4101-beb6-0ad836c39232 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:18.236229 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2418/4898] 10.222.0.76 () {58 vars in 1563 bytes} [Sat Aug 27 04:50:17 2022] DELETE /identity/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/users/86196ef01bd642d19c49f3c54beddc33/roles/4ffe4d48540f48a4b71eb3cce4fcd4f4/inherited_to_projects => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:18.238667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b2ecb-bb9d-449b-9a8f-de53f37bfc93 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:18.240877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5c0b2ecb-bb9d-449b-9a8f-de53f37bfc93 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:18.336949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b2ecb-bb9d-449b-9a8f-de53f37bfc93 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:18.343102 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2481/4899] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:18 2022] POST /identity/v3/projects => generated 381 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:18.343537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8ab2c-649e-4101-beb6-0ad836c39232 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:18.345826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c432a9-3f4d-4e78-b0c3-a71e317f5a1d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:18.346526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c432a9-3f4d-4e78-b0c3-a71e317f5a1d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:18.346816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c432a9-3f4d-4e78-b0c3-a71e317f5a1d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:18.347097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c432a9-3f4d-4e78-b0c3-a71e317f5a1d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:18.347739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1ed8ab2c-649e-4101-beb6-0ad836c39232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:18.348405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c432a9-3f4d-4e78-b0c3-a71e317f5a1d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=5d09243c3a074b5bb22d8ac45c0f8fa8)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:18.350376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c432a9-3f4d-4e78-b0c3-a71e317f5a1d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:18.363748 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2419/4900] 10.222.0.76 () {58 vars in 1242 bytes} [Sat Aug 27 04:50:18 2022] GET /identity/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8/users => generated 145 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:18.363748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c432a9-3f4d-4e78-b0c3-a71e317f5a1d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:18.363748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-03c432a9-3f4d-4e78-b0c3-a71e317f5a1d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:18.428294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8ab2c-649e-4101-beb6-0ad836c39232 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:18.437545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:18.437545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:18.437545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:18.437545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3 admin admin] PATH_INFO: `/v3/projects/885dbfe1e433422a9cc74cdc68937b2a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:18.438301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=885dbfe1e433422a9cc74cdc68937b2a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:18.440364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:18.471790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c432a9-3f4d-4e78-b0c3-a71e317f5a1d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:18.475302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:18.556374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a56d94-d938-4c46-ab19-aee54ecce674 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:18.556374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a56d94-d938-4c46-ab19-aee54ecce674 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:18.556374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a56d94-d938-4c46-ab19-aee54ecce674 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:18.557023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a56d94-d938-4c46-ab19-aee54ecce674 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:18.557023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a56d94-d938-4c46-ab19-aee54ecce674 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:18.557023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a56d94-d938-4c46-ab19-aee54ecce674 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:18.594300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '885dbfe1e433422a9cc74cdc68937b2a', 'request_id': 'req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:18.599865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '885dbfe1e433422a9cc74cdc68937b2a', 'request_id': 'req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:18.673011 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-c5a56d94-d938-4c46-ab19-aee54ecce674 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1063137769. To ensure interoperability, identifiers should be a valid uuid. Aug 27 04:50:18.673011 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 27 04:50:18.673011 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:18.702165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '885dbfe1e433422a9cc74cdc68937b2a', 'request_id': 'req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:18.718592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3 admin admin] The token cache is being invalidate because project 885dbfe1e433422a9cc74cdc68937b2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:18.719034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:18.720598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:18.722190 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2482/4901] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:18 2022] DELETE /identity/v3/projects/885dbfe1e433422a9cc74cdc68937b2a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:18.722645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:18.724151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:18.767013 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2420/4902] 10.222.0.76 () {60 vars in 1156 bytes} [Sat Aug 27 04:50:18 2022] POST /identity/v3/endpoints => generated 360 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:18.775581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a56d94-d938-4c46-ab19-aee54ecce674 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:18.775581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c5a56d94-d938-4c46-ab19-aee54ecce674 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:18.840840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d8b75-c6cb-41d7-9fe5-46f256e375c3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:18.863040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e00f66-f007-41a6-8596-dcad15a4d5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:18.863844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e00f66-f007-41a6-8596-dcad15a4d5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:18.864997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e00f66-f007-41a6-8596-dcad15a4d5be admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:18.865451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e00f66-f007-41a6-8596-dcad15a4d5be admin admin] PATH_INFO: `/v3/projects/37933da736ba4506a06cd76f98f5a308` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:18.867366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e00f66-f007-41a6-8596-dcad15a4d5be admin admin] RBAC: Authorizing `identity:delete_project(project_id=37933da736ba4506a06cd76f98f5a308)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:18.870635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e00f66-f007-41a6-8596-dcad15a4d5be admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:18.874433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a56d94-d938-4c46-ab19-aee54ecce674 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:18.961350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f21448-4533-40e9-a17f-79c7690f5d30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:18.969225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f21448-4533-40e9-a17f-79c7690f5d30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:18.969225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f21448-4533-40e9-a17f-79c7690f5d30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:18.969225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f21448-4533-40e9-a17f-79c7690f5d30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/roles/4ffe4d48540f48a4b71eb3cce4fcd4f4` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:18.969225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f21448-4533-40e9-a17f-79c7690f5d30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4ffe4d48540f48a4b71eb3cce4fcd4f4)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:18.969225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f21448-4533-40e9-a17f-79c7690f5d30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:19.115532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-08e00f66-f007-41a6-8596-dcad15a4d5be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37933da736ba4506a06cd76f98f5a308', 'request_id': 'req-08e00f66-f007-41a6-8596-dcad15a4d5be'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:19.123860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-08e00f66-f007-41a6-8596-dcad15a4d5be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37933da736ba4506a06cd76f98f5a308', 'request_id': 'req-08e00f66-f007-41a6-8596-dcad15a4d5be'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:19.166074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-19f21448-4533-40e9-a17f-79c7690f5d30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invalidating the token cache because role 4ffe4d48540f48a4b71eb3cce4fcd4f4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:19.166377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-19f21448-4533-40e9-a17f-79c7690f5d30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:19.175935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-19f21448-4533-40e9-a17f-79c7690f5d30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:19.175935 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2421/4903] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:18 2022] DELETE /identity/v3/roles/4ffe4d48540f48a4b71eb3cce4fcd4f4 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:19.175935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f21448-4533-40e9-a17f-79c7690f5d30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:19.176340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-19f21448-4533-40e9-a17f-79c7690f5d30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:19.257220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f21448-4533-40e9-a17f-79c7690f5d30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:19.262360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15182fce-ce8f-4833-a353-11ee5421656d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:19.262961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15182fce-ce8f-4833-a353-11ee5421656d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:19.263362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15182fce-ce8f-4833-a353-11ee5421656d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:19.263643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15182fce-ce8f-4833-a353-11ee5421656d admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:19.264320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15182fce-ce8f-4833-a353-11ee5421656d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:19.266231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15182fce-ce8f-4833-a353-11ee5421656d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:19.273966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-08e00f66-f007-41a6-8596-dcad15a4d5be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37933da736ba4506a06cd76f98f5a308', 'request_id': 'req-08e00f66-f007-41a6-8596-dcad15a4d5be'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:19.288523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-08e00f66-f007-41a6-8596-dcad15a4d5be admin admin] The token cache is being invalidate because project 37933da736ba4506a06cd76f98f5a308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:19.288796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-08e00f66-f007-41a6-8596-dcad15a4d5be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:19.289456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-08e00f66-f007-41a6-8596-dcad15a4d5be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:19.291055 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2483/4904] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:18 2022] DELETE /identity/v3/projects/37933da736ba4506a06cd76f98f5a308 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:19.292675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e00f66-f007-41a6-8596-dcad15a4d5be admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:19.294250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-08e00f66-f007-41a6-8596-dcad15a4d5be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:19.367862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e00f66-f007-41a6-8596-dcad15a4d5be admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:19.397651 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2422/4905] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:19 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:19.398992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813984e-ec87-43e0-a18e-df43efcd895d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:19.399500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813984e-ec87-43e0-a18e-df43efcd895d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:19.399854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813984e-ec87-43e0-a18e-df43efcd895d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:19.421217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:19.423672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1813984e-ec87-43e0-a18e-df43efcd895d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:19.425439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1813984e-ec87-43e0-a18e-df43efcd895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:19.430377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51b73a-15c7-45cd-a7d8-4953cc134e95 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:19.443888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51b73a-15c7-45cd-a7d8-4953cc134e95 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:19.443888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51b73a-15c7-45cd-a7d8-4953cc134e95 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:19.443888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51b73a-15c7-45cd-a7d8-4953cc134e95 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/users/2a58c8dc16d54c28b8453da28e9b9d4b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:19.443888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51b73a-15c7-45cd-a7d8-4953cc134e95 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2a58c8dc16d54c28b8453da28e9b9d4b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:19.444317 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2423/4906] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:19 2022] POST /identity/v3/auth/tokens => generated 3554 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:19.444317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813984e-ec87-43e0-a18e-df43efcd895d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:19.444317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1813984e-ec87-43e0-a18e-df43efcd895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:19.444541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51b73a-15c7-45cd-a7d8-4953cc134e95 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:19.523995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813984e-ec87-43e0-a18e-df43efcd895d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:19.529899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3257fe-9af3-4d59-a267-683fe6a4b9b4 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:19.530604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3257fe-9af3-4d59-a267-683fe6a4b9b4 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:19.530894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3257fe-9af3-4d59-a267-683fe6a4b9b4 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:19.531174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3257fe-9af3-4d59-a267-683fe6a4b9b4 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/regions/tempest-region-1063137769` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:19.531898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3257fe-9af3-4d59-a267-683fe6a4b9b4 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1063137769)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:19.533035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3257fe-9af3-4d59-a267-683fe6a4b9b4 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:19.534916 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2424/4907] 10.222.0.76 () {58 vars in 1206 bytes} [Sat Aug 27 04:50:19 2022] GET /identity/v3/regions/tempest-region-1063137769 => generated 180 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:19.535648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3257fe-9af3-4d59-a267-683fe6a4b9b4 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:19.537256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dc3257fe-9af3-4d59-a267-683fe6a4b9b4 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:19.587583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4b51b73a-15c7-45cd-a7d8-4953cc134e95 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a58c8dc16d54c28b8453da28e9b9d4b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:19.588932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4b51b73a-15c7-45cd-a7d8-4953cc134e95 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a58c8dc16d54c28b8453da28e9b9d4b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:19.610503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3257fe-9af3-4d59-a267-683fe6a4b9b4 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:19.615146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f9493-bc50-4091-826a-690d86e09785 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:19.615749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f9493-bc50-4091-826a-690d86e09785 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:19.616032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f9493-bc50-4091-826a-690d86e09785 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:19.616341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f9493-bc50-4091-826a-690d86e09785 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:19.617015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f9493-bc50-4091-826a-690d86e09785 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:19.618769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f9493-bc50-4091-826a-690d86e09785 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:19.705191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4b51b73a-15c7-45cd-a7d8-4953cc134e95 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a58c8dc16d54c28b8453da28e9b9d4b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:19.706116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4b51b73a-15c7-45cd-a7d8-4953cc134e95 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a58c8dc16d54c28b8453da28e9b9d4b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:19.713052 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2425/4908] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:50:19 2022] POST /identity/v3/roles => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:19.721519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fae47a-c145-4c9e-8136-36455a105665 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:19.721519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fae47a-c145-4c9e-8136-36455a105665 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:19.721519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fae47a-c145-4c9e-8136-36455a105665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:19.722393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:19.724957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4b51b73a-15c7-45cd-a7d8-4953cc134e95 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a58c8dc16d54c28b8453da28e9b9d4b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:19.739353 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2484/4909] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:19 2022] DELETE /identity/v3/users/2a58c8dc16d54c28b8453da28e9b9d4b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:19.742570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51b73a-15c7-45cd-a7d8-4953cc134e95 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:19.743594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4b51b73a-15c7-45cd-a7d8-4953cc134e95 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:19.749928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f9fae47a-c145-4c9e-8136-36455a105665 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:19.756154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f9fae47a-c145-4c9e-8136-36455a105665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:19.818036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51b73a-15c7-45cd-a7d8-4953cc134e95 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:19.819527 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2426/4910] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:19 2022] POST /identity/v3/auth/tokens => generated 3554 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:19.819527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fc559-e5c5-4eed-9a16-3ce64bea5256 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:19.819527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fc559-e5c5-4eed-9a16-3ce64bea5256 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:19.819527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fc559-e5c5-4eed-9a16-3ce64bea5256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:19.826313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987c662-538e-4c57-88c5-f9cbb2aa5f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:19.826313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987c662-538e-4c57-88c5-f9cbb2aa5f62 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:19.826313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987c662-538e-4c57-88c5-f9cbb2aa5f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:19.826313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987c662-538e-4c57-88c5-f9cbb2aa5f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:19.826621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987c662-538e-4c57-88c5-f9cbb2aa5f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:19.826980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987c662-538e-4c57-88c5-f9cbb2aa5f62 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:19.842283 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2485/4911] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:19 2022] GET /identity/v3/roles => generated 1651 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:19.842283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987c662-538e-4c57-88c5-f9cbb2aa5f62 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:19.842283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d987c662-538e-4c57-88c5-f9cbb2aa5f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:19.847056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0a0fc559-e5c5-4eed-9a16-3ce64bea5256 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:19.848374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0a0fc559-e5c5-4eed-9a16-3ce64bea5256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:19.857447 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2427/4912] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:19 2022] POST /identity/v3/auth/tokens => generated 3554 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:19.858485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fc559-e5c5-4eed-9a16-3ce64bea5256 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:19.859935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0a0fc559-e5c5-4eed-9a16-3ce64bea5256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:19.927972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fc559-e5c5-4eed-9a16-3ce64bea5256 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:19.929951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987c662-538e-4c57-88c5-f9cbb2aa5f62 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:19.933398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64747539-c081-4f53-b114-ac9667dfde8d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:19.934138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64747539-c081-4f53-b114-ac9667dfde8d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:19.934440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64747539-c081-4f53-b114-ac9667dfde8d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:19.934772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64747539-c081-4f53-b114-ac9667dfde8d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/services` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:19.935361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64747539-c081-4f53-b114-ac9667dfde8d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:19.936342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16410f32-6611-409e-a2ee-b12728890007 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:19.936958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16410f32-6611-409e-a2ee-b12728890007 service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:19.937060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64747539-c081-4f53-b114-ac9667dfde8d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:19.937240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16410f32-6611-409e-a2ee-b12728890007 service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:19.937539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16410f32-6611-409e-a2ee-b12728890007 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:19.939391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-16410f32-6611-409e-a2ee-b12728890007 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:19.952632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16410f32-6611-409e-a2ee-b12728890007 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:19.954310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16410f32-6611-409e-a2ee-b12728890007 service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:19.965547 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2486/4913] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:19 2022] GET /identity/v3/auth/tokens => generated 3623 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:19.966442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16410f32-6611-409e-a2ee-b12728890007 service placement] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:19.967920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-16410f32-6611-409e-a2ee-b12728890007 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:20.027519 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2428/4914] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:19 2022] POST /identity/v3/services => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:20.027519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64747539-c081-4f53-b114-ac9667dfde8d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:20.029016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-64747539-c081-4f53-b114-ac9667dfde8d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:20.050814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16410f32-6611-409e-a2ee-b12728890007 service placement] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:20.056766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64747539-c081-4f53-b114-ac9667dfde8d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:20.064023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fb213-38d1-49fb-a2ba-7543cf2eb500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:20.065068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fb213-38d1-49fb-a2ba-7543cf2eb500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:20.065459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fb213-38d1-49fb-a2ba-7543cf2eb500 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:20.065850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fb213-38d1-49fb-a2ba-7543cf2eb500 admin admin] PATH_INFO: `/v3/users/83483a87309d41c3be2d297fc918c2f2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:20.067098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fb213-38d1-49fb-a2ba-7543cf2eb500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83483a87309d41c3be2d297fc918c2f2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:20.068254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86942b94-5860-4008-8e67-b5a43fbc363d tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:20.068869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86942b94-5860-4008-8e67-b5a43fbc363d tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:20.069190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86942b94-5860-4008-8e67-b5a43fbc363d tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:20.069414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86942b94-5860-4008-8e67-b5a43fbc363d tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:20.069544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fb213-38d1-49fb-a2ba-7543cf2eb500 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:20.070051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86942b94-5860-4008-8e67-b5a43fbc363d tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:20.071949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86942b94-5860-4008-8e67-b5a43fbc363d tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:20.181535 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2487/4915] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:19 2022] POST /identity/v3/projects => generated 409 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:20.181535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86942b94-5860-4008-8e67-b5a43fbc363d tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:20.181535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-86942b94-5860-4008-8e67-b5a43fbc363d tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:20.261902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86942b94-5860-4008-8e67-b5a43fbc363d tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:20.266959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f6f4a-0bc7-45cd-970d-792d6c47fa25 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:20.267730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f6f4a-0bc7-45cd-970d-792d6c47fa25 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:20.268113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f6f4a-0bc7-45cd-970d-792d6c47fa25 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:20.268426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f6f4a-0bc7-45cd-970d-792d6c47fa25 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/users/6c118283d0ba466f8e6d1dded7ff85e1` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:20.269606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f6f4a-0bc7-45cd-970d-792d6c47fa25 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6c118283d0ba466f8e6d1dded7ff85e1)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:20.271523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f6f4a-0bc7-45cd-970d-792d6c47fa25 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:20.328576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-176fb213-38d1-49fb-a2ba-7543cf2eb500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83483a87309d41c3be2d297fc918c2f2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:20.439270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-176fb213-38d1-49fb-a2ba-7543cf2eb500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83483a87309d41c3be2d297fc918c2f2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:20.440063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-176fb213-38d1-49fb-a2ba-7543cf2eb500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83483a87309d41c3be2d297fc918c2f2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:20.443801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bd4f6f4a-0bc7-45cd-970d-792d6c47fa25 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c118283d0ba466f8e6d1dded7ff85e1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:20.444540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bd4f6f4a-0bc7-45cd-970d-792d6c47fa25 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c118283d0ba466f8e6d1dded7ff85e1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:20.450260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-176fb213-38d1-49fb-a2ba-7543cf2eb500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83483a87309d41c3be2d297fc918c2f2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:20.464836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-176fb213-38d1-49fb-a2ba-7543cf2eb500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83483a87309d41c3be2d297fc918c2f2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:20.474425 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2429/4916] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:20 2022] DELETE /identity/v3/users/83483a87309d41c3be2d297fc918c2f2 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:20.474877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f61d1-2674-4caf-aab5-6853241d8325 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:20.479607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f61d1-2674-4caf-aab5-6853241d8325 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:20.479607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f61d1-2674-4caf-aab5-6853241d8325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:20.498741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c64f61d1-2674-4caf-aab5-6853241d8325 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:20.499982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c64f61d1-2674-4caf-aab5-6853241d8325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:20.572213 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2430/4917] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:20 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:20.572213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f61d1-2674-4caf-aab5-6853241d8325 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:20.572213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c64f61d1-2674-4caf-aab5-6853241d8325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:20.585259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f61d1-2674-4caf-aab5-6853241d8325 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:20.587707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bd4f6f4a-0bc7-45cd-970d-792d6c47fa25 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c118283d0ba466f8e6d1dded7ff85e1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:20.590651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bd4f6f4a-0bc7-45cd-970d-792d6c47fa25 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c118283d0ba466f8e6d1dded7ff85e1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:20.592861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c04da1-29e2-40a2-958f-c3ed07eac8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:20.598391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c04da1-29e2-40a2-958f-c3ed07eac8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:20.598391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c04da1-29e2-40a2-958f-c3ed07eac8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:20.598391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c04da1-29e2-40a2-958f-c3ed07eac8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:20.598391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c04da1-29e2-40a2-958f-c3ed07eac8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:20.598827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c04da1-29e2-40a2-958f-c3ed07eac8c1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:20.610774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bd4f6f4a-0bc7-45cd-970d-792d6c47fa25 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c118283d0ba466f8e6d1dded7ff85e1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:20.611019 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2431/4918] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:20 2022] GET /identity/v3/roles => generated 1651 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:20.611857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c04da1-29e2-40a2-958f-c3ed07eac8c1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:20.617729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b1c04da1-29e2-40a2-958f-c3ed07eac8c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:20.637418 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2488/4919] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:20 2022] DELETE /identity/v3/users/6c118283d0ba466f8e6d1dded7ff85e1 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:20.638426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f6f4a-0bc7-45cd-970d-792d6c47fa25 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:20.639894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bd4f6f4a-0bc7-45cd-970d-792d6c47fa25 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:20.640748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c04da1-29e2-40a2-958f-c3ed07eac8c1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:20.709826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934e224-0e94-4ea9-bdaa-4995e75d96f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:20.710547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934e224-0e94-4ea9-bdaa-4995e75d96f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:20.710905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934e224-0e94-4ea9-bdaa-4995e75d96f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:20.711251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934e224-0e94-4ea9-bdaa-4995e75d96f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:20.712525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934e224-0e94-4ea9-bdaa-4995e75d96f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:20.712525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934e224-0e94-4ea9-bdaa-4995e75d96f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:20.716024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934e224-0e94-4ea9-bdaa-4995e75d96f5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:20.727636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f6f4a-0bc7-45cd-970d-792d6c47fa25 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:20.741295 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2432/4920] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:20.741295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934e224-0e94-4ea9-bdaa-4995e75d96f5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:20.741295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8934e224-0e94-4ea9-bdaa-4995e75d96f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:20.743505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83c28b-9349-4578-9e90-646d2bedb119 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:20.744147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83c28b-9349-4578-9e90-646d2bedb119 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:20.744996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83c28b-9349-4578-9e90-646d2bedb119 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:20.745322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83c28b-9349-4578-9e90-646d2bedb119 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:20.748316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83c28b-9349-4578-9e90-646d2bedb119 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:20.750964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83c28b-9349-4578-9e90-646d2bedb119 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:20.820029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934e224-0e94-4ea9-bdaa-4995e75d96f5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:20.826289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12d8a2-2edf-4516-88e7-3dcef05bda7b tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:20.827034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12d8a2-2edf-4516-88e7-3dcef05bda7b tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:20.827322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12d8a2-2edf-4516-88e7-3dcef05bda7b tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:20.827612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12d8a2-2edf-4516-88e7-3dcef05bda7b tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/users/86196ef01bd642d19c49f3c54beddc33/roles/e91bfd2092cd460d8840cc8a3ca97813/inherited_to_projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:20.830043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12d8a2-2edf-4516-88e7-3dcef05bda7b tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0fdc4c46ff1b41e684af75195d332e66, user_id=86196ef01bd642d19c49f3c54beddc33, role_id=e91bfd2092cd460d8840cc8a3ca97813)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:20.832912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12d8a2-2edf-4516-88e7-3dcef05bda7b tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:20.899283 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-7f83c28b-9349-4578-9e90-646d2bedb119 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-962273017. To ensure interoperability, identifiers should be a valid uuid. Aug 27 04:50:20.899283 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 27 04:50:20.899283 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:50:20.939817 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2433/4921] 10.222.0.76 () {60 vars in 1579 bytes} [Sat Aug 27 04:50:20 2022] PUT /identity/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/users/86196ef01bd642d19c49f3c54beddc33/roles/e91bfd2092cd460d8840cc8a3ca97813/inherited_to_projects => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:20.941476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9672dec-2691-4e57-9fec-28a4792fe5c5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:20.941847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9672dec-2691-4e57-9fec-28a4792fe5c5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:20.942352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9672dec-2691-4e57-9fec-28a4792fe5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:20.962531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d9672dec-2691-4e57-9fec-28a4792fe5c5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:20.963693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d9672dec-2691-4e57-9fec-28a4792fe5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:21.034441 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2489/4922] 10.222.0.76 () {60 vars in 1156 bytes} [Sat Aug 27 04:50:20 2022] POST /identity/v3/endpoints => generated 360 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:21.035294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83c28b-9349-4578-9e90-646d2bedb119 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:21.036911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7f83c28b-9349-4578-9e90-646d2bedb119 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:21.038172 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2434/4923] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:20 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:21.039139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9672dec-2691-4e57-9fec-28a4792fe5c5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:21.040518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d9672dec-2691-4e57-9fec-28a4792fe5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:21.052389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9672dec-2691-4e57-9fec-28a4792fe5c5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:21.061842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83c28b-9349-4578-9e90-646d2bedb119 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:21.066644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213f77b-bf2a-4abb-ba05-755032df06d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:21.067243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213f77b-bf2a-4abb-ba05-755032df06d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:21.067522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213f77b-bf2a-4abb-ba05-755032df06d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:21.067789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213f77b-bf2a-4abb-ba05-755032df06d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:21.068057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97408135-4593-4f14-9966-5d83c4649b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:21.068466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213f77b-bf2a-4abb-ba05-755032df06d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:21.068741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97408135-4593-4f14-9966-5d83c4649b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:21.068888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213f77b-bf2a-4abb-ba05-755032df06d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:21.069026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97408135-4593-4f14-9966-5d83c4649b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:21.069280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97408135-4593-4f14-9966-5d83c4649b51 admin admin] PATH_INFO: `/v3/projects/0f5b28f1897849a0b07ee3817838caf1/users/8749d65f584c4fd585a8f7e0415c749f/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:21.070318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213f77b-bf2a-4abb-ba05-755032df06d1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:21.090051 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2490/4924] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:21.090051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213f77b-bf2a-4abb-ba05-755032df06d1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:21.096040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97408135-4593-4f14-9966-5d83c4649b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5b28f1897849a0b07ee3817838caf1, user_id=8749d65f584c4fd585a8f7e0415c749f, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:21.098359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f213f77b-bf2a-4abb-ba05-755032df06d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:21.101005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97408135-4593-4f14-9966-5d83c4649b51 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:21.191438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213f77b-bf2a-4abb-ba05-755032df06d1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:21.196381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430253d5-ec49-4eb0-9ff7-1fdbddd9488b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:21.197026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430253d5-ec49-4eb0-9ff7-1fdbddd9488b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:21.197315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430253d5-ec49-4eb0-9ff7-1fdbddd9488b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:21.197599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430253d5-ec49-4eb0-9ff7-1fdbddd9488b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/users/c83b01e412054edab08bab7113c9b52c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:21.199445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430253d5-ec49-4eb0-9ff7-1fdbddd9488b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c83b01e412054edab08bab7113c9b52c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:21.201452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430253d5-ec49-4eb0-9ff7-1fdbddd9488b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:21.257871 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2435/4925] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:21 2022] PUT /identity/v3/projects/0f5b28f1897849a0b07ee3817838caf1/users/8749d65f584c4fd585a8f7e0415c749f/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:21.258830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97408135-4593-4f14-9966-5d83c4649b51 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:21.331692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97408135-4593-4f14-9966-5d83c4649b51 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:21.336891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4e9da-8539-4cae-b1da-371692670a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:21.337513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4e9da-8539-4cae-b1da-371692670a74 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:21.337797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4e9da-8539-4cae-b1da-371692670a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:21.338082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4e9da-8539-4cae-b1da-371692670a74 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:21.339069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4e9da-8539-4cae-b1da-371692670a74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:21.340986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4e9da-8539-4cae-b1da-371692670a74 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:21.368002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-430253d5-ec49-4eb0-9ff7-1fdbddd9488b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83b01e412054edab08bab7113c9b52c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:21.368745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-430253d5-ec49-4eb0-9ff7-1fdbddd9488b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83b01e412054edab08bab7113c9b52c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:21.466230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-430253d5-ec49-4eb0-9ff7-1fdbddd9488b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83b01e412054edab08bab7113c9b52c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:21.466866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-430253d5-ec49-4eb0-9ff7-1fdbddd9488b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83b01e412054edab08bab7113c9b52c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:21.476916 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2436/4926] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:21 2022] POST /identity/v3/projects => generated 369 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:21.476916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4e9da-8539-4cae-b1da-371692670a74 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:21.476916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e8c4e9da-8539-4cae-b1da-371692670a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:21.483951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-430253d5-ec49-4eb0-9ff7-1fdbddd9488b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83b01e412054edab08bab7113c9b52c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:21.497520 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2491/4927] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:21 2022] DELETE /identity/v3/users/c83b01e412054edab08bab7113c9b52c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:21.498323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430253d5-ec49-4eb0-9ff7-1fdbddd9488b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:21.499687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-430253d5-ec49-4eb0-9ff7-1fdbddd9488b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:21.556774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4e9da-8539-4cae-b1da-371692670a74 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:21.591265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430253d5-ec49-4eb0-9ff7-1fdbddd9488b tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:21.596374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd063e8c-f7bc-49e5-9dae-dcb1b75e85d3 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:21.597108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd063e8c-f7bc-49e5-9dae-dcb1b75e85d3 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:21.597397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd063e8c-f7bc-49e5-9dae-dcb1b75e85d3 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:21.597676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd063e8c-f7bc-49e5-9dae-dcb1b75e85d3 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/regions/tempest-region-962273017` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:21.598295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd063e8c-f7bc-49e5-9dae-dcb1b75e85d3 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-962273017)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:21.599405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd063e8c-f7bc-49e5-9dae-dcb1b75e85d3 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:21.601333 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2492/4928] 10.222.0.76 () {58 vars in 1203 bytes} [Sat Aug 27 04:50:21 2022] GET /identity/v3/regions/tempest-region-962273017 => generated 178 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:21.602107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd063e8c-f7bc-49e5-9dae-dcb1b75e85d3 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:21.603693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bd063e8c-f7bc-49e5-9dae-dcb1b75e85d3 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:21.618884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7f94a-497a-4821-8316-ffefe2fd8e19 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:21.628697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7f94a-497a-4821-8316-ffefe2fd8e19 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:21.628697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7f94a-497a-4821-8316-ffefe2fd8e19 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:21.628697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7f94a-497a-4821-8316-ffefe2fd8e19 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:21.628697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7f94a-497a-4821-8316-ffefe2fd8e19 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Adding query filter params (scope.project.id=7c000e9a513941f088a09f4365866806, user.id=86196ef01bd642d19c49f3c54beddc33) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:21.629100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7f94a-497a-4821-8316-ffefe2fd8e19 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:21.629100 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-33d7f94a-497a-4821-8316-ffefe2fd8e19 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:21.629100 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:50:21.629100 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:21.629100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7f94a-497a-4821-8316-ffefe2fd8e19 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:21.671486 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2437/4929] 10.222.0.76 () {58 vars in 1356 bytes} [Sat Aug 27 04:50:21 2022] GET /identity/v3/role_assignments?scope.project.id=7c000e9a513941f088a09f4365866806&user.id=86196ef01bd642d19c49f3c54beddc33&effective => generated 648 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:21.672365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7f94a-497a-4821-8316-ffefe2fd8e19 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:21.673951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-33d7f94a-497a-4821-8316-ffefe2fd8e19 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:21.677438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd063e8c-f7bc-49e5-9dae-dcb1b75e85d3 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:21.681581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d588c-960f-445e-a760-90ee2111e9e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:21.682372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d588c-960f-445e-a760-90ee2111e9e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:21.682941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d588c-960f-445e-a760-90ee2111e9e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:21.682941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d588c-960f-445e-a760-90ee2111e9e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:21.684633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-083d588c-960f-445e-a760-90ee2111e9e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:21.723505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:21.742815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7f94a-497a-4821-8316-ffefe2fd8e19 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:21.747779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c15059-123f-48c9-8a02-1feadff28542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:21.748356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c15059-123f-48c9-8a02-1feadff28542 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:21.748637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c15059-123f-48c9-8a02-1feadff28542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:21.748911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c15059-123f-48c9-8a02-1feadff28542 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:21.749612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c15059-123f-48c9-8a02-1feadff28542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:21.751560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c15059-123f-48c9-8a02-1feadff28542 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:21.753393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d588c-960f-445e-a760-90ee2111e9e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:21.754876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d588c-960f-445e-a760-90ee2111e9e4 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:21.765420 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2493/4930] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:21 2022] GET /identity/v3/auth/tokens => generated 3868 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:21.772213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3653e-fdb9-441b-9b16-faf52e1e1c9c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:21.772213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3653e-fdb9-441b-9b16-faf52e1e1c9c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:21.772213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3653e-fdb9-441b-9b16-faf52e1e1c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:21.787863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0dd3653e-fdb9-441b-9b16-faf52e1e1c9c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:21.789115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0dd3653e-fdb9-441b-9b16-faf52e1e1c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:21.798439 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2494/4931] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:21 2022] POST /identity/v3/auth/tokens => generated 3868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:21.799222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3653e-fdb9-441b-9b16-faf52e1e1c9c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:21.800506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0dd3653e-fdb9-441b-9b16-faf52e1e1c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:21.813966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3653e-fdb9-441b-9b16-faf52e1e1c9c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:21.823890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71702a97-41e7-4d65-932f-a1c2688b97b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:21.823890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71702a97-41e7-4d65-932f-a1c2688b97b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:21.823890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71702a97-41e7-4d65-932f-a1c2688b97b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:21.823890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71702a97-41e7-4d65-932f-a1c2688b97b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:21.824297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71702a97-41e7-4d65-932f-a1c2688b97b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:21.824297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71702a97-41e7-4d65-932f-a1c2688b97b2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:21.895713 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2438/4932] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:21 2022] POST /identity/v3/projects => generated 399 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:21.896619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c15059-123f-48c9-8a02-1feadff28542 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:21.898285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-30c15059-123f-48c9-8a02-1feadff28542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:21.930255 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2495/4933] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:21 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:21.932305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71702a97-41e7-4d65-932f-a1c2688b97b2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:21.935518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-71702a97-41e7-4d65-932f-a1c2688b97b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:21.955978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71702a97-41e7-4d65-932f-a1c2688b97b2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:21.967884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c15059-123f-48c9-8a02-1feadff28542 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:21.972687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ecfff-72d7-4c1d-819f-e07bc6d258e8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:21.975121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ecfff-72d7-4c1d-819f-e07bc6d258e8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:21.975121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ecfff-72d7-4c1d-819f-e07bc6d258e8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:21.975121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ecfff-72d7-4c1d-819f-e07bc6d258e8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:21.975121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ecfff-72d7-4c1d-819f-e07bc6d258e8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:delete_group(group_id=5d09243c3a074b5bb22d8ac45c0f8fa8)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:21.976140 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-000ecfff-72d7-4c1d-819f-e07bc6d258e8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:21.976140 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:50:21.976140 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:21.977362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ecfff-72d7-4c1d-819f-e07bc6d258e8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:22.015689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16837c42-3d4b-4ba1-a14e-8b541d365f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:22.016372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16837c42-3d4b-4ba1-a14e-8b541d365f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:22.016653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16837c42-3d4b-4ba1-a14e-8b541d365f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:22.016927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16837c42-3d4b-4ba1-a14e-8b541d365f03 admin admin] PATH_INFO: `/v3/users/ecae372a6933460d8acf92b44364d7ec` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:22.018072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16837c42-3d4b-4ba1-a14e-8b541d365f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecae372a6933460d8acf92b44364d7ec)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:22.019988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16837c42-3d4b-4ba1-a14e-8b541d365f03 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:22.116694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:22.131683 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2439/4934] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:50:21 2022] DELETE /identity/v3/groups/5d09243c3a074b5bb22d8ac45c0f8fa8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:22.132538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ecfff-72d7-4c1d-819f-e07bc6d258e8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:22.195114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ecfff-72d7-4c1d-819f-e07bc6d258e8 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:22.200613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c34341-62b3-49ca-8d49-56354c4566b5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:22.201231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c34341-62b3-49ca-8d49-56354c4566b5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:22.201517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c34341-62b3-49ca-8d49-56354c4566b5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:22.201797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c34341-62b3-49ca-8d49-56354c4566b5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:22.202481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c34341-62b3-49ca-8d49-56354c4566b5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:22.204143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c34341-62b3-49ca-8d49-56354c4566b5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:22.242173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-16837c42-3d4b-4ba1-a14e-8b541d365f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecae372a6933460d8acf92b44364d7ec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:22.242828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-16837c42-3d4b-4ba1-a14e-8b541d365f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecae372a6933460d8acf92b44364d7ec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:22.281838 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-17c34341-62b3-49ca-8d49-56354c4566b5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-737734239. To ensure interoperability, identifiers should be a valid uuid. Aug 27 04:50:22.281838 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 27 04:50:22.281838 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:22.325185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-16837c42-3d4b-4ba1-a14e-8b541d365f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecae372a6933460d8acf92b44364d7ec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:22.325804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-16837c42-3d4b-4ba1-a14e-8b541d365f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecae372a6933460d8acf92b44364d7ec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:22.342569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-16837c42-3d4b-4ba1-a14e-8b541d365f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecae372a6933460d8acf92b44364d7ec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:22.355268 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2496/4935] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:21 2022] DELETE /identity/v3/users/ecae372a6933460d8acf92b44364d7ec => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:22.356076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16837c42-3d4b-4ba1-a14e-8b541d365f03 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:22.357405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-16837c42-3d4b-4ba1-a14e-8b541d365f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:22.410849 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2440/4936] 10.222.0.76 () {60 vars in 1156 bytes} [Sat Aug 27 04:50:22 2022] POST /identity/v3/endpoints => generated 359 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:22.411926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c34341-62b3-49ca-8d49-56354c4566b5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:22.415234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-17c34341-62b3-49ca-8d49-56354c4566b5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:22.424519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16837c42-3d4b-4ba1-a14e-8b541d365f03 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:22.440073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490174d9-36ed-4d2e-8ef0-6dad5d49d252 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:22.440708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490174d9-36ed-4d2e-8ef0-6dad5d49d252 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:22.440990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490174d9-36ed-4d2e-8ef0-6dad5d49d252 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:22.441260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490174d9-36ed-4d2e-8ef0-6dad5d49d252 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:22.441980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490174d9-36ed-4d2e-8ef0-6dad5d49d252 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Adding query filter params (scope.project.id=1304dc11626f4326b774930e3aa59ca2, user.id=86196ef01bd642d19c49f3c54beddc33) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:22.442284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490174d9-36ed-4d2e-8ef0-6dad5d49d252 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:22.443279 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-490174d9-36ed-4d2e-8ef0-6dad5d49d252 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:22.443279 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:50:22.443279 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:50:22.444437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490174d9-36ed-4d2e-8ef0-6dad5d49d252 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:22.485586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c34341-62b3-49ca-8d49-56354c4566b5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:22.500415 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2497/4937] 10.222.0.76 () {58 vars in 1356 bytes} [Sat Aug 27 04:50:22 2022] GET /identity/v3/role_assignments?scope.project.id=1304dc11626f4326b774930e3aa59ca2&user.id=86196ef01bd642d19c49f3c54beddc33&effective => generated 648 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:22.501485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490174d9-36ed-4d2e-8ef0-6dad5d49d252 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:22.505274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-490174d9-36ed-4d2e-8ef0-6dad5d49d252 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:22.535778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6208a9-6948-451a-840a-69a7ae4f9e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:22.536324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6208a9-6948-451a-840a-69a7ae4f9e73 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:22.536607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6208a9-6948-451a-840a-69a7ae4f9e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:22.536879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6208a9-6948-451a-840a-69a7ae4f9e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:22.538639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7b6208a9-6948-451a-840a-69a7ae4f9e73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:22.583212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490174d9-36ed-4d2e-8ef0-6dad5d49d252 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:22.585614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:22.588207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853d446-1824-4524-a635-2553c2b200bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:22.589397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853d446-1824-4524-a635-2553c2b200bd admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:22.589684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853d446-1824-4524-a635-2553c2b200bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:22.595567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853d446-1824-4524-a635-2553c2b200bd admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:22.595567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853d446-1824-4524-a635-2553c2b200bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:22.595567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853d446-1824-4524-a635-2553c2b200bd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:22.606989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6208a9-6948-451a-840a-69a7ae4f9e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:22.608473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6208a9-6948-451a-840a-69a7ae4f9e73 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:22.618021 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2441/4938] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:22 2022] GET /identity/v3/auth/tokens => generated 4051 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:22.618809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6208a9-6948-451a-840a-69a7ae4f9e73 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:22.620648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7b6208a9-6948-451a-840a-69a7ae4f9e73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:22.632796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6208a9-6948-451a-840a-69a7ae4f9e73 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:22.638097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4c212-3443-4a5d-bf66-169a578e513a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:22.638700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4c212-3443-4a5d-bf66-169a578e513a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:22.638978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4c212-3443-4a5d-bf66-169a578e513a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:22.639250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4c212-3443-4a5d-bf66-169a578e513a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:22.639912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4c212-3443-4a5d-bf66-169a578e513a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:22.641555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4c212-3443-4a5d-bf66-169a578e513a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:22.656109 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2442/4939] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:22 2022] GET /identity/v3/roles => generated 1651 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:22.656109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4c212-3443-4a5d-bf66-169a578e513a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:22.657420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a5a4c212-3443-4a5d-bf66-169a578e513a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:22.671290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4c212-3443-4a5d-bf66-169a578e513a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:22.676250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91735b02-5883-434b-bd29-e24b76a01691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:22.676936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91735b02-5883-434b-bd29-e24b76a01691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:22.677217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91735b02-5883-434b-bd29-e24b76a01691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:22.677488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91735b02-5883-434b-bd29-e24b76a01691 admin admin] PATH_INFO: `/v3/projects/0b549ab7e4c4464faad13315578de2df` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:22.678661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91735b02-5883-434b-bd29-e24b76a01691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b549ab7e4c4464faad13315578de2df)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:22.680599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91735b02-5883-434b-bd29-e24b76a01691 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:22.705779 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2498/4940] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:22 2022] POST /identity/v3/users => generated 300 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:22.705779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853d446-1824-4524-a635-2553c2b200bd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:22.705779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d853d446-1824-4524-a635-2553c2b200bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:22.782837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853d446-1824-4524-a635-2553c2b200bd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:22.788095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1475f9d-7c56-4b38-8a64-b087c17ffc51 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:22.788728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1475f9d-7c56-4b38-8a64-b087c17ffc51 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:22.789008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1475f9d-7c56-4b38-8a64-b087c17ffc51 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:22.789284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1475f9d-7c56-4b38-8a64-b087c17ffc51 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:22.789949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1475f9d-7c56-4b38-8a64-b087c17ffc51 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:22.792524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1475f9d-7c56-4b38-8a64-b087c17ffc51 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:22.833702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-91735b02-5883-434b-bd29-e24b76a01691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b549ab7e4c4464faad13315578de2df', 'request_id': 'req-91735b02-5883-434b-bd29-e24b76a01691'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:22.839182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-91735b02-5883-434b-bd29-e24b76a01691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b549ab7e4c4464faad13315578de2df', 'request_id': 'req-91735b02-5883-434b-bd29-e24b76a01691'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:22.845888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-91735b02-5883-434b-bd29-e24b76a01691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b549ab7e4c4464faad13315578de2df', 'request_id': 'req-91735b02-5883-434b-bd29-e24b76a01691'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:22.938804 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2499/4941] 10.222.0.76 () {60 vars in 1147 bytes} [Sat Aug 27 04:50:22 2022] POST /identity/v3/groups => generated 327 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:22.940749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d5a90-30b2-4b3f-a62d-b9931756e4df None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:22.941262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d5a90-30b2-4b3f-a62d-b9931756e4df None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:22.941735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d5a90-30b2-4b3f-a62d-b9931756e4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:22.961378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b48d5a90-30b2-4b3f-a62d-b9931756e4df None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:22.962603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b48d5a90-30b2-4b3f-a62d-b9931756e4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:22.987990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-91735b02-5883-434b-bd29-e24b76a01691 admin admin] The token cache is being invalidate because project 0b549ab7e4c4464faad13315578de2df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:22.988424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-91735b02-5883-434b-bd29-e24b76a01691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:23.000620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-91735b02-5883-434b-bd29-e24b76a01691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:23.005701 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2443/4942] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:22 2022] DELETE /identity/v3/projects/0b549ab7e4c4464faad13315578de2df => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:23.006564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91735b02-5883-434b-bd29-e24b76a01691 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:23.007983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-91735b02-5883-434b-bd29-e24b76a01691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:23.053817 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2500/4943] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:22 2022] POST /identity/v3/auth/tokens => generated 4051 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:23.054592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d5a90-30b2-4b3f-a62d-b9931756e4df None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:23.065319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b48d5a90-30b2-4b3f-a62d-b9931756e4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:23.109796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91735b02-5883-434b-bd29-e24b76a01691 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:23.115316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43182d43-4e5a-42cc-a8bb-20748331886e tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:23.115955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43182d43-4e5a-42cc-a8bb-20748331886e tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:23.116266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43182d43-4e5a-42cc-a8bb-20748331886e tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:23.116546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43182d43-4e5a-42cc-a8bb-20748331886e tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/regions/tempest-region-737734239` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:23.117129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43182d43-4e5a-42cc-a8bb-20748331886e tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-737734239)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:23.118278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43182d43-4e5a-42cc-a8bb-20748331886e tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:23.120417 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2444/4944] 10.222.0.76 () {58 vars in 1203 bytes} [Sat Aug 27 04:50:23 2022] GET /identity/v3/regions/tempest-region-737734239 => generated 178 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:23.121204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43182d43-4e5a-42cc-a8bb-20748331886e tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:23.123591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-43182d43-4e5a-42cc-a8bb-20748331886e tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:23.138502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d5a90-30b2-4b3f-a62d-b9931756e4df None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:23.139720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43182d43-4e5a-42cc-a8bb-20748331886e tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:23.143985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a48731-4c9e-4fc6-bedf-d4f162042995 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:23.144705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a48731-4c9e-4fc6-bedf-d4f162042995 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:23.144999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a48731-4c9e-4fc6-bedf-d4f162042995 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:23.145502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a48731-4c9e-4fc6-bedf-d4f162042995 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/users/86196ef01bd642d19c49f3c54beddc33/roles/e91bfd2092cd460d8840cc8a3ca97813/inherited_to_projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:23.148074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b96a6-3e8d-40d2-a1ea-58197a4d03fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:23.148233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a48731-4c9e-4fc6-bedf-d4f162042995 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0fdc4c46ff1b41e684af75195d332e66, user_id=86196ef01bd642d19c49f3c54beddc33, role_id=e91bfd2092cd460d8840cc8a3ca97813)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:23.148837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b96a6-3e8d-40d2-a1ea-58197a4d03fa admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:23.149315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b96a6-3e8d-40d2-a1ea-58197a4d03fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:23.149663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b96a6-3e8d-40d2-a1ea-58197a4d03fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:23.151456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b96a6-3e8d-40d2-a1ea-58197a4d03fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:23.151837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a48731-4c9e-4fc6-bedf-d4f162042995 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:23.153899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b96a6-3e8d-40d2-a1ea-58197a4d03fa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:23.157613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61a48731-4c9e-4fc6-bedf-d4f162042995 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invalidating the token cache because role e91bfd2092cd460d8840cc8a3ca97813 was removed from user 86196ef01bd642d19c49f3c54beddc33 on domain 0fdc4c46ff1b41e684af75195d332e66. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:23.157776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61a48731-4c9e-4fc6-bedf-d4f162042995 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:23.158526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61a48731-4c9e-4fc6-bedf-d4f162042995 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:23.176929 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2445/4945] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:23 2022] GET /identity/v3/roles => generated 1651 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:23.176929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b96a6-3e8d-40d2-a1ea-58197a4d03fa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:23.178255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-849b96a6-3e8d-40d2-a1ea-58197a4d03fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:23.194145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b96a6-3e8d-40d2-a1ea-58197a4d03fa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:23.201687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d2529-4f04-4135-8f55-356e0a013c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:23.202776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d2529-4f04-4135-8f55-356e0a013c96 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:23.203289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d2529-4f04-4135-8f55-356e0a013c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:23.213937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d2529-4f04-4135-8f55-356e0a013c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:23.213937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d2529-4f04-4135-8f55-356e0a013c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:23.213937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d2529-4f04-4135-8f55-356e0a013c96 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:23.222021 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2446/4946] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:23 2022] GET /identity/v3/roles => generated 1651 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:23.222021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d2529-4f04-4135-8f55-356e0a013c96 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:23.223376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-066d2529-4f04-4135-8f55-356e0a013c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:23.296674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d2529-4f04-4135-8f55-356e0a013c96 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:23.301634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db768f-a3af-4b20-a6c8-63a0efd9292d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:23.302261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db768f-a3af-4b20-a6c8-63a0efd9292d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:23.302549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db768f-a3af-4b20-a6c8-63a0efd9292d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:23.302844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db768f-a3af-4b20-a6c8-63a0efd9292d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:23.303492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db768f-a3af-4b20-a6c8-63a0efd9292d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:23.305578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db768f-a3af-4b20-a6c8-63a0efd9292d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:23.330602 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2501/4947] 10.222.0.76 () {58 vars in 1563 bytes} [Sat Aug 27 04:50:23 2022] DELETE /identity/v3/OS-INHERIT/domains/0fdc4c46ff1b41e684af75195d332e66/users/86196ef01bd642d19c49f3c54beddc33/roles/e91bfd2092cd460d8840cc8a3ca97813/inherited_to_projects => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:23.334240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a48731-4c9e-4fc6-bedf-d4f162042995 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:23.334240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-61a48731-4c9e-4fc6-bedf-d4f162042995 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:23.408596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a48731-4c9e-4fc6-bedf-d4f162042995 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:23.413265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2dc08-9596-4944-a95e-1b36c66aac5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:23.413902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2dc08-9596-4944-a95e-1b36c66aac5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:23.414197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2dc08-9596-4944-a95e-1b36c66aac5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:23.414565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2dc08-9596-4944-a95e-1b36c66aac5b admin admin] PATH_INFO: `/v3/users/69a851c99e944455b8737fdf75b623bc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:23.415667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2dc08-9596-4944-a95e-1b36c66aac5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a851c99e944455b8737fdf75b623bc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:23.417960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2dc08-9596-4944-a95e-1b36c66aac5b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:23.426191 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2447/4948] 10.222.0.76 () {60 vars in 1147 bytes} [Sat Aug 27 04:50:23 2022] POST /identity/v3/groups => generated 326 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:23.426191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db768f-a3af-4b20-a6c8-63a0efd9292d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:23.427003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-59db768f-a3af-4b20-a6c8-63a0efd9292d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:23.489191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db768f-a3af-4b20-a6c8-63a0efd9292d tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:23.542648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fa34a-e646-4e91-8759-24614b6b9460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:23.543327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fa34a-e646-4e91-8759-24614b6b9460 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:23.543613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fa34a-e646-4e91-8759-24614b6b9460 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:23.544118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fa34a-e646-4e91-8759-24614b6b9460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:23.546717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-504fa34a-e646-4e91-8759-24614b6b9460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:23.571146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fa34a-e646-4e91-8759-24614b6b9460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:23.573315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fa34a-e646-4e91-8759-24614b6b9460 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:23.586877 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2448/4949] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:23 2022] GET /identity/v3/auth/tokens => generated 4051 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:23.587868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fa34a-e646-4e91-8759-24614b6b9460 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:23.590752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-504fa34a-e646-4e91-8759-24614b6b9460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:23.594201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-baa2dc08-9596-4944-a95e-1b36c66aac5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a851c99e944455b8737fdf75b623bc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:23.594922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-baa2dc08-9596-4944-a95e-1b36c66aac5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a851c99e944455b8737fdf75b623bc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:23.637722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:23.657748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fa34a-e646-4e91-8759-24614b6b9460 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:23.659915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-baa2dc08-9596-4944-a95e-1b36c66aac5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a851c99e944455b8737fdf75b623bc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:23.660859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-baa2dc08-9596-4944-a95e-1b36c66aac5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a851c99e944455b8737fdf75b623bc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:23.663191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a5e74-9ec3-44b5-baf6-2f97a5a22cbd tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:23.663802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a5e74-9ec3-44b5-baf6-2f97a5a22cbd tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:23.664082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a5e74-9ec3-44b5-baf6-2f97a5a22cbd tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:23.664387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a5e74-9ec3-44b5-baf6-2f97a5a22cbd tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:23.670468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a5e74-9ec3-44b5-baf6-2f97a5a22cbd tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:23.670468 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-7b1a5e74-9ec3-44b5-baf6-2f97a5a22cbd tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:23.670468 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:50:23.670468 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:23.670468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a5e74-9ec3-44b5-baf6-2f97a5a22cbd tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:23.676091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-baa2dc08-9596-4944-a95e-1b36c66aac5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a851c99e944455b8737fdf75b623bc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:23.676667 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2449/4950] 10.222.0.76 () {58 vars in 1134 bytes} [Sat Aug 27 04:50:23 2022] GET /identity/v3/endpoints => generated 4393 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:23.676667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a5e74-9ec3-44b5-baf6-2f97a5a22cbd tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:23.676667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7b1a5e74-9ec3-44b5-baf6-2f97a5a22cbd tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:23.690842 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2502/4951] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:23 2022] DELETE /identity/v3/users/69a851c99e944455b8737fdf75b623bc => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:23.694773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2dc08-9596-4944-a95e-1b36c66aac5b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:23.696186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-baa2dc08-9596-4944-a95e-1b36c66aac5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:23.696310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a5e74-9ec3-44b5-baf6-2f97a5a22cbd tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:23.773876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2dc08-9596-4944-a95e-1b36c66aac5b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:23.780110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d854a-2f9f-4f09-b387-7026d912a333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:23.780745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d854a-2f9f-4f09-b387-7026d912a333 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:23.781160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d854a-2f9f-4f09-b387-7026d912a333 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:23.781441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d854a-2f9f-4f09-b387-7026d912a333 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:23.782088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d854a-2f9f-4f09-b387-7026d912a333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:23.783801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d854a-2f9f-4f09-b387-7026d912a333 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:23.798796 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2503/4952] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:23 2022] GET /identity/v3/roles => generated 1651 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:23.798796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d854a-2f9f-4f09-b387-7026d912a333 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:23.799029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a98d854a-2f9f-4f09-b387-7026d912a333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:23.802607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eac2f-c472-4e74-9f9b-10e999be2bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:23.803338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eac2f-c472-4e74-9f9b-10e999be2bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:23.803623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eac2f-c472-4e74-9f9b-10e999be2bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:23.803972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eac2f-c472-4e74-9f9b-10e999be2bb3 admin admin] PATH_INFO: `/v3/projects/4abf602299dd4fa298aed54d64976f7d/users/92053b7c7a4f4317944e018f656fda76/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:23.824401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620eac2f-c472-4e74-9f9b-10e999be2bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4abf602299dd4fa298aed54d64976f7d, user_id=92053b7c7a4f4317944e018f656fda76, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:23.827398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620eac2f-c472-4e74-9f9b-10e999be2bb3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:23.886749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d854a-2f9f-4f09-b387-7026d912a333 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:23.891706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde4098-38fe-4801-ad3e-3af5a054554b tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:23.892491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde4098-38fe-4801-ad3e-3af5a054554b tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:23.892778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde4098-38fe-4801-ad3e-3af5a054554b tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:23.893053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde4098-38fe-4801-ad3e-3af5a054554b tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:23.893871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde4098-38fe-4801-ad3e-3af5a054554b tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Adding query filter params (scope.project.id=7c000e9a513941f088a09f4365866806, user.id=86196ef01bd642d19c49f3c54beddc33) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:23.894180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde4098-38fe-4801-ad3e-3af5a054554b tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:23.896037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde4098-38fe-4801-ad3e-3af5a054554b tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:23.952863 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2504/4953] 10.222.0.76 () {58 vars in 1356 bytes} [Sat Aug 27 04:50:23 2022] GET /identity/v3/role_assignments?scope.project.id=7c000e9a513941f088a09f4365866806&user.id=86196ef01bd642d19c49f3c54beddc33&effective => generated 228 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:23.952863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde4098-38fe-4801-ad3e-3af5a054554b tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:23.952863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8bde4098-38fe-4801-ad3e-3af5a054554b tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:23.969755 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2450/4954] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:23 2022] PUT /identity/v3/projects/4abf602299dd4fa298aed54d64976f7d/users/92053b7c7a4f4317944e018f656fda76/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:23.970663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eac2f-c472-4e74-9f9b-10e999be2bb3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:23.972631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-620eac2f-c472-4e74-9f9b-10e999be2bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:23.991635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:24.030768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde4098-38fe-4801-ad3e-3af5a054554b tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:24.061410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eac2f-c472-4e74-9f9b-10e999be2bb3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:24.068197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa6216-6622-47d2-acc6-cdf3ca02f971 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:24.069154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa6216-6622-47d2-acc6-cdf3ca02f971 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:24.069816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa6216-6622-47d2-acc6-cdf3ca02f971 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:24.070118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa6216-6622-47d2-acc6-cdf3ca02f971 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints/921592dc905049d880a2a9cf435c6afa` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:24.083112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa6216-6622-47d2-acc6-cdf3ca02f971 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=921592dc905049d880a2a9cf435c6afa)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:24.085962 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-2cfa6216-6622-47d2-acc6-cdf3ca02f971 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:24.085962 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:50:24.085962 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:24.086522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa6216-6622-47d2-acc6-cdf3ca02f971 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:24.092243 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2451/4955] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:23 2022] GET /identity/v3/endpoints/921592dc905049d880a2a9cf435c6afa => generated 359 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:24.093736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa6216-6622-47d2-acc6-cdf3ca02f971 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:24.097626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ac368-ee43-456d-ac4a-bba1bcb58fde tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:24.098247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ac368-ee43-456d-ac4a-bba1bcb58fde tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:24.098524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ac368-ee43-456d-ac4a-bba1bcb58fde tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:24.098846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ac368-ee43-456d-ac4a-bba1bcb58fde tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:24.099482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ac368-ee43-456d-ac4a-bba1bcb58fde tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:24.101490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ac368-ee43-456d-ac4a-bba1bcb58fde tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:24.159866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa6216-6622-47d2-acc6-cdf3ca02f971 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:24.165066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419de99-aa66-49fb-ba7b-fae07237d7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:24.165716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419de99-aa66-49fb-ba7b-fae07237d7ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:24.165999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419de99-aa66-49fb-ba7b-fae07237d7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:24.166858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419de99-aa66-49fb-ba7b-fae07237d7ae admin admin] PATH_INFO: `/v3/projects/9d422ed789ea422a82d765d07166bdac/users/1979b5a334de402d82500d4883d44d2f/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:24.182871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419de99-aa66-49fb-ba7b-fae07237d7ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d422ed789ea422a82d765d07166bdac, user_id=1979b5a334de402d82500d4883d44d2f, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:24.185559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419de99-aa66-49fb-ba7b-fae07237d7ae admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:24.204272 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2505/4956] 10.222.0.76 () {60 vars in 1147 bytes} [Sat Aug 27 04:50:23 2022] POST /identity/v3/groups => generated 326 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:24.205508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ac368-ee43-456d-ac4a-bba1bcb58fde tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:24.271883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ac368-ee43-456d-ac4a-bba1bcb58fde tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:24.277057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc2dca-052d-4bf7-a1cd-818622dbece8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:24.277732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc2dca-052d-4bf7-a1cd-818622dbece8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:24.278017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc2dca-052d-4bf7-a1cd-818622dbece8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:24.278290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc2dca-052d-4bf7-a1cd-818622dbece8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:24.279013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc2dca-052d-4bf7-a1cd-818622dbece8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Adding query filter params (scope.project.id=1304dc11626f4326b774930e3aa59ca2, user.id=86196ef01bd642d19c49f3c54beddc33) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:24.279317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc2dca-052d-4bf7-a1cd-818622dbece8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:24.281200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc2dca-052d-4bf7-a1cd-818622dbece8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:24.285067 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2452/4957] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:24 2022] PUT /identity/v3/projects/9d422ed789ea422a82d765d07166bdac/users/1979b5a334de402d82500d4883d44d2f/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:24.289301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9415a5-750b-4055-b8a4-e0b2e6cfbcdc None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:24.289301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9415a5-750b-4055-b8a4-e0b2e6cfbcdc None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:24.289301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9415a5-750b-4055-b8a4-e0b2e6cfbcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:24.325796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bd9415a5-750b-4055-b8a4-e0b2e6cfbcdc None None] MFA Rules not processed for user `92053b7c7a4f4317944e018f656fda76`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:24.327056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bd9415a5-750b-4055-b8a4-e0b2e6cfbcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:24.349319 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2506/4958] 10.222.0.76 () {58 vars in 1356 bytes} [Sat Aug 27 04:50:24 2022] GET /identity/v3/role_assignments?scope.project.id=1304dc11626f4326b774930e3aa59ca2&user.id=86196ef01bd642d19c49f3c54beddc33&effective => generated 228 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:24.350376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc2dca-052d-4bf7-a1cd-818622dbece8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:24.352374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2dfc2dca-052d-4bf7-a1cd-818622dbece8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:24.371785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc2dca-052d-4bf7-a1cd-818622dbece8 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:24.410048 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2453/4959] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:24 2022] POST /identity/v3/auth/tokens => generated 4058 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:24.414647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9415a5-750b-4055-b8a4-e0b2e6cfbcdc None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:24.453120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f30750-5720-4cd0-ac6b-d6a25ab64755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:24.454606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f30750-5720-4cd0-ac6b-d6a25ab64755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:24.454887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f30750-5720-4cd0-ac6b-d6a25ab64755 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:24.455157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f30750-5720-4cd0-ac6b-d6a25ab64755 admin admin] PATH_INFO: `/v3/projects/20ca47dcaedf4a068cad976368103a0e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:24.456408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f30750-5720-4cd0-ac6b-d6a25ab64755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20ca47dcaedf4a068cad976368103a0e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:24.458849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f30750-5720-4cd0-ac6b-d6a25ab64755 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:24.508368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9415a5-750b-4055-b8a4-e0b2e6cfbcdc None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:24.513538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bad7c9-b380-4ec2-a536-cbd209f3d30c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:24.514174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bad7c9-b380-4ec2-a536-cbd209f3d30c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:24.514455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bad7c9-b380-4ec2-a536-cbd209f3d30c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:24.514817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bad7c9-b380-4ec2-a536-cbd209f3d30c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints/921592dc905049d880a2a9cf435c6afa` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:24.515989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bad7c9-b380-4ec2-a536-cbd209f3d30c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=921592dc905049d880a2a9cf435c6afa)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:24.517657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bad7c9-b380-4ec2-a536-cbd209f3d30c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:24.609862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-02f30750-5720-4cd0-ac6b-d6a25ab64755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20ca47dcaedf4a068cad976368103a0e', 'request_id': 'req-02f30750-5720-4cd0-ac6b-d6a25ab64755'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:24.619241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-02f30750-5720-4cd0-ac6b-d6a25ab64755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20ca47dcaedf4a068cad976368103a0e', 'request_id': 'req-02f30750-5720-4cd0-ac6b-d6a25ab64755'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:24.668622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-15bad7c9-b380-4ec2-a536-cbd209f3d30c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '921592dc905049d880a2a9cf435c6afa', 'request_id': 'req-15bad7c9-b380-4ec2-a536-cbd209f3d30c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:24.680446 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2454/4960] 10.222.0.76 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:24 2022] DELETE /identity/v3/endpoints/921592dc905049d880a2a9cf435c6afa => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:24.681295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bad7c9-b380-4ec2-a536-cbd209f3d30c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:24.683381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-15bad7c9-b380-4ec2-a536-cbd209f3d30c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:24.710566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-02f30750-5720-4cd0-ac6b-d6a25ab64755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20ca47dcaedf4a068cad976368103a0e', 'request_id': 'req-02f30750-5720-4cd0-ac6b-d6a25ab64755'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:24.715687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bad7c9-b380-4ec2-a536-cbd209f3d30c tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:24.749690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-02f30750-5720-4cd0-ac6b-d6a25ab64755 admin admin] The token cache is being invalidate because project 20ca47dcaedf4a068cad976368103a0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:24.750072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-02f30750-5720-4cd0-ac6b-d6a25ab64755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:24.752671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-02f30750-5720-4cd0-ac6b-d6a25ab64755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:24.756256 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2507/4961] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:24 2022] DELETE /identity/v3/projects/20ca47dcaedf4a068cad976368103a0e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:24.757748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f30750-5720-4cd0-ac6b-d6a25ab64755 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:24.760773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-02f30750-5720-4cd0-ac6b-d6a25ab64755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:24.827996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309224aa-1083-4583-a6cf-9cd3bc8738dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:24.828877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309224aa-1083-4583-a6cf-9cd3bc8738dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:24.829115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309224aa-1083-4583-a6cf-9cd3bc8738dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:24.829469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309224aa-1083-4583-a6cf-9cd3bc8738dd admin admin] PATH_INFO: `/v3/projects/542025c89be64b2a8c5d33e79058f6e2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:24.830820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309224aa-1083-4583-a6cf-9cd3bc8738dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=542025c89be64b2a8c5d33e79058f6e2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:24.834734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309224aa-1083-4583-a6cf-9cd3bc8738dd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:24.872583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f30750-5720-4cd0-ac6b-d6a25ab64755 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:24.889980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa3e81-f34d-4c07-8496-562aa5ea7ae6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:24.891404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3e81-f34d-4c07-8496-562aa5ea7ae6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:24.891404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3e81-f34d-4c07-8496-562aa5ea7ae6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:24.891404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3e81-f34d-4c07-8496-562aa5ea7ae6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:24.891822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa3e81-f34d-4c07-8496-562aa5ea7ae6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:24.892874 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-c0fa3e81-f34d-4c07-8496-562aa5ea7ae6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:24.892874 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:50:24.892874 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:50:24.894028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa3e81-f34d-4c07-8496-562aa5ea7ae6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:24.902064 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2508/4962] 10.222.0.76 () {58 vars in 1125 bytes} [Sat Aug 27 04:50:24 2022] GET /identity/v3/groups => generated 1781 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:24.903352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f453f2-e503-4da6-b0ef-9a6bca996640 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:24.903635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f453f2-e503-4da6-b0ef-9a6bca996640 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:24.903910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f453f2-e503-4da6-b0ef-9a6bca996640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:24.924352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-30f453f2-e503-4da6-b0ef-9a6bca996640 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:24.925467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-30f453f2-e503-4da6-b0ef-9a6bca996640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:24.937545 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2509/4963] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:24 2022] POST /identity/v3/auth/tokens => generated 3868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:24.937545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f453f2-e503-4da6-b0ef-9a6bca996640 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:24.944873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-30f453f2-e503-4da6-b0ef-9a6bca996640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:25.040846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f453f2-e503-4da6-b0ef-9a6bca996640 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:25.056391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-309224aa-1083-4583-a6cf-9cd3bc8738dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542025c89be64b2a8c5d33e79058f6e2', 'request_id': 'req-309224aa-1083-4583-a6cf-9cd3bc8738dd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:25.064950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-309224aa-1083-4583-a6cf-9cd3bc8738dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542025c89be64b2a8c5d33e79058f6e2', 'request_id': 'req-309224aa-1083-4583-a6cf-9cd3bc8738dd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:25.074644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-309224aa-1083-4583-a6cf-9cd3bc8738dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542025c89be64b2a8c5d33e79058f6e2', 'request_id': 'req-309224aa-1083-4583-a6cf-9cd3bc8738dd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:25.115167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:25.116229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:25.116693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:25.117133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/projects/1304dc11626f4326b774930e3aa59ca2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:25.118353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1304dc11626f4326b774930e3aa59ca2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:25.120659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:25.165122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-309224aa-1083-4583-a6cf-9cd3bc8738dd admin admin] The token cache is being invalidate because project 542025c89be64b2a8c5d33e79058f6e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:25.169583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-309224aa-1083-4583-a6cf-9cd3bc8738dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:25.169583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-309224aa-1083-4583-a6cf-9cd3bc8738dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:25.169583 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2455/4964] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:24 2022] DELETE /identity/v3/projects/542025c89be64b2a8c5d33e79058f6e2 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:25.169583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309224aa-1083-4583-a6cf-9cd3bc8738dd admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:25.170572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-309224aa-1083-4583-a6cf-9cd3bc8738dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:25.265412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309224aa-1083-4583-a6cf-9cd3bc8738dd admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:25.286947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1304dc11626f4326b774930e3aa59ca2', 'request_id': 'req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:25.303517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1304dc11626f4326b774930e3aa59ca2', 'request_id': 'req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:25.357685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d0ddb-3ed2-48f1-8af5-685a4a585de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:25.358824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d0ddb-3ed2-48f1-8af5-685a4a585de6 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:25.359058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d0ddb-3ed2-48f1-8af5-685a4a585de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:25.360703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:25.361298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d0ddb-3ed2-48f1-8af5-685a4a585de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:25.362302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d0ddb-3ed2-48f1-8af5-685a4a585de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:25.379603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d0ddb-3ed2-48f1-8af5-685a4a585de6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:25.399538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1304dc11626f4326b774930e3aa59ca2', 'request_id': 'req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:25.416869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] The token cache is being invalidate because project 1304dc11626f4326b774930e3aa59ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:25.417317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:25.418064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:25.419955 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2510/4965] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:24 2022] DELETE /identity/v3/projects/1304dc11626f4326b774930e3aa59ca2 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:25.423922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:25.425322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:25.502964 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2456/4966] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:25 2022] POST /identity/v3/projects => generated 369 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:25.504963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408261e0-c22d-4e06-9919-a113c2b6cf9e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:25.505257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408261e0-c22d-4e06-9919-a113c2b6cf9e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:25.505761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408261e0-c22d-4e06-9919-a113c2b6cf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:25.531495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-408261e0-c22d-4e06-9919-a113c2b6cf9e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:25.535467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-408261e0-c22d-4e06-9919-a113c2b6cf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:25.567621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:25.587583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6c269-1db1-480f-8ec3-c6ad701feaeb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:25.663557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb943ecf-e17c-4498-aa25-4ea36239e200 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:25.664405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb943ecf-e17c-4498-aa25-4ea36239e200 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:25.664553 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2457/4967] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:25 2022] POST /identity/v3/auth/tokens => generated 3868 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:25.664828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb943ecf-e17c-4498-aa25-4ea36239e200 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:25.665173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb943ecf-e17c-4498-aa25-4ea36239e200 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:25.665949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408261e0-c22d-4e06-9919-a113c2b6cf9e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:25.666093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb943ecf-e17c-4498-aa25-4ea36239e200 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:25.667719 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-cb943ecf-e17c-4498-aa25-4ea36239e200 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:25.667719 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:50:25.667719 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:50:25.668651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb943ecf-e17c-4498-aa25-4ea36239e200 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:25.668776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-408261e0-c22d-4e06-9919-a113c2b6cf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:25.683457 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2511/4968] 10.222.0.76 () {58 vars in 1134 bytes} [Sat Aug 27 04:50:25 2022] GET /identity/v3/endpoints => generated 4047 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:25.684392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb943ecf-e17c-4498-aa25-4ea36239e200 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:25.686370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cb943ecf-e17c-4498-aa25-4ea36239e200 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:25.782818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb943ecf-e17c-4498-aa25-4ea36239e200 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:25.787155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb501729-06a6-450a-b423-4e9fb1573ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:25.787858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb501729-06a6-450a-b423-4e9fb1573ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:25.788250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb501729-06a6-450a-b423-4e9fb1573ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:25.788775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb501729-06a6-450a-b423-4e9fb1573ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:25.790299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408261e0-c22d-4e06-9919-a113c2b6cf9e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:25.790926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-eb501729-06a6-450a-b423-4e9fb1573ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:25.796140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f09bac-f11c-4c83-a80d-600c935c62e0 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:25.797136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f09bac-f11c-4c83-a80d-600c935c62e0 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:25.797386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f09bac-f11c-4c83-a80d-600c935c62e0 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:25.797590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f09bac-f11c-4c83-a80d-600c935c62e0 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/7b960914ab614813bbf6a462cd12b949` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:25.803371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f09bac-f11c-4c83-a80d-600c935c62e0 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7b960914ab614813bbf6a462cd12b949)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:25.805589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f09bac-f11c-4c83-a80d-600c935c62e0 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:25.805951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb501729-06a6-450a-b423-4e9fb1573ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:25.807571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb501729-06a6-450a-b423-4e9fb1573ca0 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:25.821166 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2512/4969] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:25 2022] GET /identity/v3/auth/tokens => generated 3868 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:25.821952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb501729-06a6-450a-b423-4e9fb1573ca0 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:25.824115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-eb501729-06a6-450a-b423-4e9fb1573ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:25.838001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb501729-06a6-450a-b423-4e9fb1573ca0 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:25.844833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598f272-1513-4401-bfd7-99a517d65720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:25.846026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598f272-1513-4401-bfd7-99a517d65720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:25.846026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598f272-1513-4401-bfd7-99a517d65720 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:25.846245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598f272-1513-4401-bfd7-99a517d65720 admin admin] PATH_INFO: `/v3/users/d0800b393bf04b7f89216157897ace6d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:25.847474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598f272-1513-4401-bfd7-99a517d65720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0800b393bf04b7f89216157897ace6d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:25.849759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598f272-1513-4401-bfd7-99a517d65720 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:25.971300 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2458/4970] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:50:25 2022] DELETE /identity/v3/groups/7b960914ab614813bbf6a462cd12b949 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:25.972112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f09bac-f11c-4c83-a80d-600c935c62e0 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:25.975926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-41f09bac-f11c-4c83-a80d-600c935c62e0 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:26.064511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f09bac-f11c-4c83-a80d-600c935c62e0 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:26.076279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41446b6f-392e-4ca6-8060-dc540832c1bb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:26.078181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41446b6f-392e-4ca6-8060-dc540832c1bb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:26.078661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41446b6f-392e-4ca6-8060-dc540832c1bb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:26.079143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41446b6f-392e-4ca6-8060-dc540832c1bb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/roles/e91bfd2092cd460d8840cc8a3ca97813` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:26.082060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41446b6f-392e-4ca6-8060-dc540832c1bb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e91bfd2092cd460d8840cc8a3ca97813)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:26.085022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41446b6f-392e-4ca6-8060-dc540832c1bb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:26.222771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f598f272-1513-4401-bfd7-99a517d65720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0800b393bf04b7f89216157897ace6d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:26.223989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f598f272-1513-4401-bfd7-99a517d65720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0800b393bf04b7f89216157897ace6d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:26.311220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f598f272-1513-4401-bfd7-99a517d65720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0800b393bf04b7f89216157897ace6d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:26.311924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f598f272-1513-4401-bfd7-99a517d65720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0800b393bf04b7f89216157897ace6d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:26.331211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f598f272-1513-4401-bfd7-99a517d65720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0800b393bf04b7f89216157897ace6d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:26.347418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-41446b6f-392e-4ca6-8060-dc540832c1bb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invalidating the token cache because role e91bfd2092cd460d8840cc8a3ca97813 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:26.347722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-41446b6f-392e-4ca6-8060-dc540832c1bb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:26.348439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-41446b6f-392e-4ca6-8060-dc540832c1bb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:26.350338 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2513/4971] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:25 2022] DELETE /identity/v3/users/d0800b393bf04b7f89216157897ace6d => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:26.351470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598f272-1513-4401-bfd7-99a517d65720 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:26.355970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f598f272-1513-4401-bfd7-99a517d65720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:26.361293 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2459/4972] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:25 2022] DELETE /identity/v3/roles/e91bfd2092cd460d8840cc8a3ca97813 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:26.369347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c986b-69dc-4081-bf11-ac6e699ba2bb None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:26.369618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c986b-69dc-4081-bf11-ac6e699ba2bb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:26.369941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c986b-69dc-4081-bf11-ac6e699ba2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:26.405051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d05c986b-69dc-4081-bf11-ac6e699ba2bb None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:26.406663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d05c986b-69dc-4081-bf11-ac6e699ba2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:26.443601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598f272-1513-4401-bfd7-99a517d65720 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:26.505688 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2460/4973] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:26 2022] POST /identity/v3/auth/tokens => generated 3868 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:26.506464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c986b-69dc-4081-bf11-ac6e699ba2bb None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:26.507908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d05c986b-69dc-4081-bf11-ac6e699ba2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:26.540142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b00cf-ed5d-4345-8ae2-f793e44f5c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:26.541787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b00cf-ed5d-4345-8ae2-f793e44f5c51 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:26.542287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b00cf-ed5d-4345-8ae2-f793e44f5c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:26.543962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b00cf-ed5d-4345-8ae2-f793e44f5c51 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:26.544869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b00cf-ed5d-4345-8ae2-f793e44f5c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:26.548014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b00cf-ed5d-4345-8ae2-f793e44f5c51 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:26.577584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:26.602751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c986b-69dc-4081-bf11-ac6e699ba2bb None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:26.608483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd313cc-5e34-46ea-a1ed-3c8f5c1d7497 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:26.609216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd313cc-5e34-46ea-a1ed-3c8f5c1d7497 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:26.609545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd313cc-5e34-46ea-a1ed-3c8f5c1d7497 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:26.609931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd313cc-5e34-46ea-a1ed-3c8f5c1d7497 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints/921592dc905049d880a2a9cf435c6afa` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:26.615844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd313cc-5e34-46ea-a1ed-3c8f5c1d7497 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:50:26.624230 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-3cd313cc-5e34-46ea-a1ed-3c8f5c1d7497 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Could not find endpoint: 921592dc905049d880a2a9cf435c6afa.: keystone.exception.EndpointNotFound: Could not find endpoint: 921592dc905049d880a2a9cf435c6afa. Aug 27 04:50:26.624230 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:50:26.624230 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Aug 27 04:50:26.624230 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Aug 27 04:50:26.624230 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 27 04:50:26.624230 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._iter().one() Aug 27 04:50:26.624230 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 27 04:50:26.624230 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._only_one_row( Aug 27 04:50:26.624230 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 27 04:50:26.624230 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 27 04:50:26.624230 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 27 04:50:26.624230 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:50:26.624230 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:50:26.624230 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:50:26.624230 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:50:26.624230 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Aug 27 04:50:26.625441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Aug 27 04:50:26.625441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Aug 27 04:50:26.625441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Aug 27 04:50:26.625441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Aug 27 04:50:26.625441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 27 04:50:26.625441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 921592dc905049d880a2a9cf435c6afa. Aug 27 04:50:26.625441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:50:26.625441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:50:26.625441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:50:26.625441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:50:26.625441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:50:26.625441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:50:26.625441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:50:26.625441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:50:26.625441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:50:26.625441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:50:26.625441 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:50:26.626530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:50:26.626530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:50:26.626530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:50:26.626530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Aug 27 04:50:26.626530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Aug 27 04:50:26.626530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:50:26.626530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:50:26.626530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:50:26.626530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:50:26.626530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:50:26.626530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:50:26.626530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:50:26.626530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:50:26.626530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:50:26.626530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:50:26.626530 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:50:26.627533 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:50:26.627533 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:50:26.627533 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:50:26.627533 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:50:26.627533 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:50:26.627533 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:50:26.627533 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:50:26.627533 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:50:26.627533 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:50:26.627533 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Aug 27 04:50:26.627533 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 27 04:50:26.627533 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 921592dc905049d880a2a9cf435c6afa. Aug 27 04:50:26.627533 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:50:26.627533 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2461/4974] 10.222.0.76 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:26 2022] DELETE /identity/v3/endpoints/921592dc905049d880a2a9cf435c6afa => generated 114 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:50:26.628539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd313cc-5e34-46ea-a1ed-3c8f5c1d7497 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:26.630018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3cd313cc-5e34-46ea-a1ed-3c8f5c1d7497 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:26.700441 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2514/4975] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:26 2022] POST /identity/v3/users => generated 291 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:26.701392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b00cf-ed5d-4345-8ae2-f793e44f5c51 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:26.703554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-838b00cf-ed5d-4345-8ae2-f793e44f5c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:26.730514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd313cc-5e34-46ea-a1ed-3c8f5c1d7497 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:26.736851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4925a-a734-40f2-8eb0-dd31120a1a46 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:26.737506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4925a-a734-40f2-8eb0-dd31120a1a46 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:26.737787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4925a-a734-40f2-8eb0-dd31120a1a46 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:26.738559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4925a-a734-40f2-8eb0-dd31120a1a46 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/f6d2bc63247946fa88e0cd1625cffd33` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:26.745623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4925a-a734-40f2-8eb0-dd31120a1a46 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f6d2bc63247946fa88e0cd1625cffd33)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:26.748718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4925a-a734-40f2-8eb0-dd31120a1a46 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:26.809436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b00cf-ed5d-4345-8ae2-f793e44f5c51 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:26.817202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4b6a7-2998-4e38-948b-242e05288990 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:26.818813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4b6a7-2998-4e38-948b-242e05288990 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:26.819190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4b6a7-2998-4e38-948b-242e05288990 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:26.819735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4b6a7-2998-4e38-948b-242e05288990 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:26.820766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4b6a7-2998-4e38-948b-242e05288990 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:26.824292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4b6a7-2998-4e38-948b-242e05288990 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:26.976092 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2515/4976] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:50:26 2022] POST /identity/v3/roles => generated 239 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:26.978098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4b6a7-2998-4e38-948b-242e05288990 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:26.997376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4b6a7-2998-4e38-948b-242e05288990 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:26.997492 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2462/4977] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:50:26 2022] DELETE /identity/v3/groups/f6d2bc63247946fa88e0cd1625cffd33 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:26.998222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4925a-a734-40f2-8eb0-dd31120a1a46 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:27.131368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4925a-a734-40f2-8eb0-dd31120a1a46 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:27.142195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d72480-c7a5-42e4-8775-10116fac9477 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:27.143396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d72480-c7a5-42e4-8775-10116fac9477 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:27.143396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d72480-c7a5-42e4-8775-10116fac9477 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:27.143396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d72480-c7a5-42e4-8775-10116fac9477 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/regions/tempest-region-737734239` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:27.144099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d72480-c7a5-42e4-8775-10116fac9477 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-737734239)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:27.146074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d72480-c7a5-42e4-8775-10116fac9477 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:27.168548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef204dd9-c686-48f7-bf8e-e08f989b8dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:27.171232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef204dd9-c686-48f7-bf8e-e08f989b8dba admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:27.172090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef204dd9-c686-48f7-bf8e-e08f989b8dba admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:27.172090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef204dd9-c686-48f7-bf8e-e08f989b8dba admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:27.173062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef204dd9-c686-48f7-bf8e-e08f989b8dba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:27.174209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef204dd9-c686-48f7-bf8e-e08f989b8dba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:27.177794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef204dd9-c686-48f7-bf8e-e08f989b8dba admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:27.195500 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2516/4978] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:27.199503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef204dd9-c686-48f7-bf8e-e08f989b8dba admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:27.215154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ef204dd9-c686-48f7-bf8e-e08f989b8dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:27.237258 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2463/4979] 10.222.0.76 () {58 vars in 1206 bytes} [Sat Aug 27 04:50:26 2022] DELETE /identity/v3/regions/tempest-region-737734239 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:27.238360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d72480-c7a5-42e4-8775-10116fac9477 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:27.242038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef204dd9-c686-48f7-bf8e-e08f989b8dba admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:27.247702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d5d72480-c7a5-42e4-8775-10116fac9477 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:27.265756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0667d-ca5a-478e-93a1-493508230beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:27.271441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0667d-ca5a-478e-93a1-493508230beb admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:27.271441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0667d-ca5a-478e-93a1-493508230beb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:27.271441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0667d-ca5a-478e-93a1-493508230beb admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:27.271441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0667d-ca5a-478e-93a1-493508230beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:27.271441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0667d-ca5a-478e-93a1-493508230beb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:27.282602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d72480-c7a5-42e4-8775-10116fac9477 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:27.292847 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2517/4980] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:27 2022] GET /identity/v3/roles => generated 1650 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:27.294729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0667d-ca5a-478e-93a1-493508230beb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:27.297890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:27.298732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:27.299113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:27.299541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6 admin admin] PATH_INFO: `/v3/projects/3ccc4e90fbad4545aa8f905a7a6fa5fd` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:27.302575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ccc4e90fbad4545aa8f905a7a6fa5fd)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:27.308743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:27.432780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0667d-ca5a-478e-93a1-493508230beb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:27.437907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d6490-9b2b-45c6-a6d8-01b88578eb5c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:27.438604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d6490-9b2b-45c6-a6d8-01b88578eb5c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:27.438959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d6490-9b2b-45c6-a6d8-01b88578eb5c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:27.439303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d6490-9b2b-45c6-a6d8-01b88578eb5c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:27.440019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d6490-9b2b-45c6-a6d8-01b88578eb5c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:27.442083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d6490-9b2b-45c6-a6d8-01b88578eb5c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:27.527052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ccc4e90fbad4545aa8f905a7a6fa5fd', 'request_id': 'req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:27.541940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ccc4e90fbad4545aa8f905a7a6fa5fd', 'request_id': 'req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:27.551560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ccc4e90fbad4545aa8f905a7a6fa5fd', 'request_id': 'req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:27.608685 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2518/4981] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:27 2022] POST /identity/v3/projects => generated 410 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:27.608685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d6490-9b2b-45c6-a6d8-01b88578eb5c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:27.673718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:27.718006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6 admin admin] The token cache is being invalidate because project 3ccc4e90fbad4545aa8f905a7a6fa5fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:27.718337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:27.720789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:27.723526 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2464/4982] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:27 2022] DELETE /identity/v3/projects/3ccc4e90fbad4545aa8f905a7a6fa5fd => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:27.733159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:27.735210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:27.740371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d6490-9b2b-45c6-a6d8-01b88578eb5c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:27.752607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ffe50-3964-450d-b337-aa2721f008f3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:27.755815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ffe50-3964-450d-b337-aa2721f008f3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:27.756566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ffe50-3964-450d-b337-aa2721f008f3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:27.758154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ffe50-3964-450d-b337-aa2721f008f3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/343a4875fdd149aa8c8e5a59126b5478` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:27.768697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ffe50-3964-450d-b337-aa2721f008f3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:delete_group(group_id=343a4875fdd149aa8c8e5a59126b5478)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:27.771526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ffe50-3964-450d-b337-aa2721f008f3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:27.842711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b69bc-99a9-4e55-95d8-82de0b7c24a6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:27.927216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661efc08-afce-40ed-8310-d8dd84c99097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:27.927216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661efc08-afce-40ed-8310-d8dd84c99097 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:27.927216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661efc08-afce-40ed-8310-d8dd84c99097 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:27.927216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661efc08-afce-40ed-8310-d8dd84c99097 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:27.927626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661efc08-afce-40ed-8310-d8dd84c99097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:27.927626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661efc08-afce-40ed-8310-d8dd84c99097 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:28.105821 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2465/4983] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:27 2022] POST /identity/v3/projects => generated 381 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:28.107418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661efc08-afce-40ed-8310-d8dd84c99097 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:28.109333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-661efc08-afce-40ed-8310-d8dd84c99097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:28.124820 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2519/4984] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:50:27 2022] DELETE /identity/v3/groups/343a4875fdd149aa8c8e5a59126b5478 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:28.125774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ffe50-3964-450d-b337-aa2721f008f3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:28.130439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-de9ffe50-3964-450d-b337-aa2721f008f3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:28.139748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:28.238736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ffe50-3964-450d-b337-aa2721f008f3 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:28.248931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d418c63-d090-4119-965a-03c3edcdb15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:28.253283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d418c63-d090-4119-965a-03c3edcdb15d admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:28.253283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d418c63-d090-4119-965a-03c3edcdb15d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:28.253283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d418c63-d090-4119-965a-03c3edcdb15d admin admin] PATH_INFO: `/v3/projects/76e49a8527f9424a98c5871576973cb6/users/756676c5bd2b4fcb981d386f81f53469/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:28.274292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d418c63-d090-4119-965a-03c3edcdb15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e49a8527f9424a98c5871576973cb6, user_id=756676c5bd2b4fcb981d386f81f53469, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:28.281450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d418c63-d090-4119-965a-03c3edcdb15d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:28.301176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661efc08-afce-40ed-8310-d8dd84c99097 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:28.382487 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2520/4985] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:28 2022] PUT /identity/v3/projects/76e49a8527f9424a98c5871576973cb6/users/756676c5bd2b4fcb981d386f81f53469/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:28.383786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d418c63-d090-4119-965a-03c3edcdb15d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:28.387094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3d418c63-d090-4119-965a-03c3edcdb15d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:28.393413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b8516-2b19-47a8-8f7b-ccc0919f5a8a tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:28.394191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b8516-2b19-47a8-8f7b-ccc0919f5a8a tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:28.394617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b8516-2b19-47a8-8f7b-ccc0919f5a8a tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:28.395001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b8516-2b19-47a8-8f7b-ccc0919f5a8a tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:28.395767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b8516-2b19-47a8-8f7b-ccc0919f5a8a tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:28.398166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b8516-2b19-47a8-8f7b-ccc0919f5a8a tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:28.412544 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2466/4986] 10.222.0.76 () {58 vars in 1134 bytes} [Sat Aug 27 04:50:28 2022] GET /identity/v3/endpoints => generated 4047 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:28.416226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ac232-c969-41d2-aeb0-437692b282f4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:28.416226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ac232-c969-41d2-aeb0-437692b282f4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:28.416226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ac232-c969-41d2-aeb0-437692b282f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:28.442392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3d8ac232-c969-41d2-aeb0-437692b282f4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:28.444900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3d8ac232-c969-41d2-aeb0-437692b282f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:28.548694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d418c63-d090-4119-965a-03c3edcdb15d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:28.558171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b49db-84bc-46f9-9599-f539c9280eb3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:28.559603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b49db-84bc-46f9-9599-f539c9280eb3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:28.560249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b49db-84bc-46f9-9599-f539c9280eb3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:28.560939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b49db-84bc-46f9-9599-f539c9280eb3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/7c000e9a513941f088a09f4365866806/users/86196ef01bd642d19c49f3c54beddc33/roles/c4e0d4c3dc39432ebf39c4941091f30f/inherited_to_projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:28.570304 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2467/4987] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:28 2022] POST /identity/v3/auth/tokens => generated 3868 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:28.570304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ac232-c969-41d2-aeb0-437692b282f4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:28.573594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b49db-84bc-46f9-9599-f539c9280eb3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7c000e9a513941f088a09f4365866806, user_id=86196ef01bd642d19c49f3c54beddc33, role_id=c4e0d4c3dc39432ebf39c4941091f30f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:28.575749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ac232-c969-41d2-aeb0-437692b282f4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:28.577101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b49db-84bc-46f9-9599-f539c9280eb3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:28.581560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f6348-5de0-4223-8a92-354a2046c100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:28.584399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f6348-5de0-4223-8a92-354a2046c100 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:28.584399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f6348-5de0-4223-8a92-354a2046c100 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:28.584399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f6348-5de0-4223-8a92-354a2046c100 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:28.584695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f6348-5de0-4223-8a92-354a2046c100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:28.586852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f6348-5de0-4223-8a92-354a2046c100 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:28.730252 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2468/4988] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:28 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:28.731375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f6348-5de0-4223-8a92-354a2046c100 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:28.735855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-634f6348-5de0-4223-8a92-354a2046c100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:28.741201 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2521/4989] 10.222.0.76 () {60 vars in 1582 bytes} [Sat Aug 27 04:50:28 2022] PUT /identity/v3/OS-INHERIT/projects/7c000e9a513941f088a09f4365866806/users/86196ef01bd642d19c49f3c54beddc33/roles/c4e0d4c3dc39432ebf39c4941091f30f/inherited_to_projects => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:28.743140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b49db-84bc-46f9-9599-f539c9280eb3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:28.879930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f6348-5de0-4223-8a92-354a2046c100 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:28.907753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b49db-84bc-46f9-9599-f539c9280eb3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:28.915373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abbfb4-8068-49d8-8152-8654b18d3e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:28.917439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abbfb4-8068-49d8-8152-8654b18d3e6f admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:28.918149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abbfb4-8068-49d8-8152-8654b18d3e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:28.918535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abbfb4-8068-49d8-8152-8654b18d3e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:28.919595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abbfb4-8068-49d8-8152-8654b18d3e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:28.921778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abbfb4-8068-49d8-8152-8654b18d3e6f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:28.945149 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2522/4990] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:28 2022] GET /identity/v3/roles => generated 1650 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:28.947287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abbfb4-8068-49d8-8152-8654b18d3e6f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:28.999184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddfe73-61b4-4ade-a6ef-7a4d302e9810 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:29.002078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddfe73-61b4-4ade-a6ef-7a4d302e9810 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:29.002078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddfe73-61b4-4ade-a6ef-7a4d302e9810 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:29.002078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddfe73-61b4-4ade-a6ef-7a4d302e9810 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:29.002078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddfe73-61b4-4ade-a6ef-7a4d302e9810 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:29.003582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddfe73-61b4-4ade-a6ef-7a4d302e9810 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:29.066444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abbfb4-8068-49d8-8152-8654b18d3e6f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:29.077335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3064ac-aa69-414d-ba12-9628e6ec53fe tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:29.078072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3064ac-aa69-414d-ba12-9628e6ec53fe tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:29.078426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3064ac-aa69-414d-ba12-9628e6ec53fe tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:29.079017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3064ac-aa69-414d-ba12-9628e6ec53fe tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:29.080007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3064ac-aa69-414d-ba12-9628e6ec53fe tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Adding query filter params (service_id=c959e3894b6445709e206c32ea775f73) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:29.083393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3064ac-aa69-414d-ba12-9628e6ec53fe tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:29.085283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3064ac-aa69-414d-ba12-9628e6ec53fe tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:29.098559 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2523/4991] 10.222.0.76 () {58 vars in 1221 bytes} [Sat Aug 27 04:50:28 2022] GET /identity/v3/endpoints?service_id=c959e3894b6445709e206c32ea775f73 => generated 502 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:29.103081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4aea2c-6330-4ff6-8d2a-d5c792ebb079 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:29.103380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4aea2c-6330-4ff6-8d2a-d5c792ebb079 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:29.103728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4aea2c-6330-4ff6-8d2a-d5c792ebb079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:29.133636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9e4aea2c-6330-4ff6-8d2a-d5c792ebb079 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:29.136486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9e4aea2c-6330-4ff6-8d2a-d5c792ebb079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:29.162146 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2524/4992] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:29 2022] POST /identity/v3/auth/tokens => generated 3868 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:29.162146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4aea2c-6330-4ff6-8d2a-d5c792ebb079 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:29.166448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:29.171123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4aea2c-6330-4ff6-8d2a-d5c792ebb079 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:29.179585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da82929-7b12-4f3d-922e-6131f2e03953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:29.180258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da82929-7b12-4f3d-922e-6131f2e03953 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:29.180544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da82929-7b12-4f3d-922e-6131f2e03953 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:29.181353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da82929-7b12-4f3d-922e-6131f2e03953 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:29.183046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da82929-7b12-4f3d-922e-6131f2e03953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:29.188299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da82929-7b12-4f3d-922e-6131f2e03953 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:29.205516 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2469/4993] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:28 2022] POST /identity/v3/users => generated 323 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:29.206975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddfe73-61b4-4ade-a6ef-7a4d302e9810 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:29.216678 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2525/4994] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:29 2022] GET /identity/v3/roles => generated 1650 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:29.220937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da82929-7b12-4f3d-922e-6131f2e03953 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:29.247942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da82929-7b12-4f3d-922e-6131f2e03953 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:29.261594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fc513-cf53-45d3-998a-d605b6c71444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:29.262295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fc513-cf53-45d3-998a-d605b6c71444 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:29.262557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fc513-cf53-45d3-998a-d605b6c71444 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:29.262835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fc513-cf53-45d3-998a-d605b6c71444 admin admin] PATH_INFO: `/v3/projects/76e49a8527f9424a98c5871576973cb6/users/756676c5bd2b4fcb981d386f81f53469/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:29.267276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fc513-cf53-45d3-998a-d605b6c71444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e49a8527f9424a98c5871576973cb6, user_id=756676c5bd2b4fcb981d386f81f53469, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:29.273826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fc513-cf53-45d3-998a-d605b6c71444 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:29.304294 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2526/4995] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:29 2022] PUT /identity/v3/projects/76e49a8527f9424a98c5871576973cb6/users/756676c5bd2b4fcb981d386f81f53469/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:29.304294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fc513-cf53-45d3-998a-d605b6c71444 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:29.325206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddfe73-61b4-4ade-a6ef-7a4d302e9810 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:29.417031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4818607-a54f-4e4c-b30c-705f6f08a14e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:29.417569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4818607-a54f-4e4c-b30c-705f6f08a14e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:29.417709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fc513-cf53-45d3-998a-d605b6c71444 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:29.418457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4818607-a54f-4e4c-b30c-705f6f08a14e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:29.418457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4818607-a54f-4e4c-b30c-705f6f08a14e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:29.418997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4818607-a54f-4e4c-b30c-705f6f08a14e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Adding query filter params (scope.project.id=9d6b2a3c05ba480489cac0e7ed9497e0, user.id=86196ef01bd642d19c49f3c54beddc33) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:29.419312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4818607-a54f-4e4c-b30c-705f6f08a14e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:29.423801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e04cef-a765-4578-b3a3-e6fe117827d7 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:29.424587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e04cef-a765-4578-b3a3-e6fe117827d7 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:29.424969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e04cef-a765-4578-b3a3-e6fe117827d7 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:29.425334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e04cef-a765-4578-b3a3-e6fe117827d7 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:29.425458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4818607-a54f-4e4c-b30c-705f6f08a14e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:29.426194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e04cef-a765-4578-b3a3-e6fe117827d7 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Adding query filter params (service_id=9456767204d448b7b52cd6f1740bc877) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:29.426814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e04cef-a765-4578-b3a3-e6fe117827d7 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:29.430211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e04cef-a765-4578-b3a3-e6fe117827d7 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:29.440329 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2527/4996] 10.222.0.76 () {58 vars in 1221 bytes} [Sat Aug 27 04:50:29 2022] GET /identity/v3/endpoints?service_id=9456767204d448b7b52cd6f1740bc877 => generated 502 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:29.443883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e04cef-a765-4578-b3a3-e6fe117827d7 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:29.469176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:29.522941 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2470/4997] 10.222.0.76 () {58 vars in 1356 bytes} [Sat Aug 27 04:50:29 2022] GET /identity/v3/role_assignments?scope.project.id=9d6b2a3c05ba480489cac0e7ed9497e0&user.id=86196ef01bd642d19c49f3c54beddc33&effective => generated 649 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:29.523883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4818607-a54f-4e4c-b30c-705f6f08a14e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:29.554844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e04cef-a765-4578-b3a3-e6fe117827d7 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:29.562388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f28e39-5f20-4b5e-9786-956602567737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:29.563051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f28e39-5f20-4b5e-9786-956602567737 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:29.563336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f28e39-5f20-4b5e-9786-956602567737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:29.563653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f28e39-5f20-4b5e-9786-956602567737 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:29.564521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f28e39-5f20-4b5e-9786-956602567737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:29.564827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f28e39-5f20-4b5e-9786-956602567737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:29.566782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f28e39-5f20-4b5e-9786-956602567737 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:29.591438 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2528/4998] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:29.592751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f28e39-5f20-4b5e-9786-956602567737 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:29.604373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4818607-a54f-4e4c-b30c-705f6f08a14e tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:29.605893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f28e39-5f20-4b5e-9786-956602567737 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:29.613146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb3e04-08b0-4352-9ab5-7c0d458b9b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:29.613998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb3e04-08b0-4352-9ab5-7c0d458b9b1c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:29.614426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb3e04-08b0-4352-9ab5-7c0d458b9b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:29.614791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb3e04-08b0-4352-9ab5-7c0d458b9b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:29.615465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb3e04-08b0-4352-9ab5-7c0d458b9b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:29.617412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb3e04-08b0-4352-9ab5-7c0d458b9b1c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:29.618045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd9c7d-47ae-4583-b149-34a2c4448ac7 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:29.619357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd9c7d-47ae-4583-b149-34a2c4448ac7 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:29.620662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd9c7d-47ae-4583-b149-34a2c4448ac7 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:29.625610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd9c7d-47ae-4583-b149-34a2c4448ac7 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:29.625610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd9c7d-47ae-4583-b149-34a2c4448ac7 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:29.626018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd9c7d-47ae-4583-b149-34a2c4448ac7 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:29.634686 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2529/4999] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:29 2022] GET /identity/v3/roles => generated 1650 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:29.637053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cbcc9-6b5b-490c-ba18-27638854b76e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:29.637342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cbcc9-6b5b-490c-ba18-27638854b76e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:29.637614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cbcc9-6b5b-490c-ba18-27638854b76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:29.671188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-607cbcc9-6b5b-490c-ba18-27638854b76e None None] MFA Rules not processed for user `756676c5bd2b4fcb981d386f81f53469`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:29.673064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-607cbcc9-6b5b-490c-ba18-27638854b76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:29.750435 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2471/5000] 10.222.0.76 () {60 vars in 1147 bytes} [Sat Aug 27 04:50:29 2022] POST /identity/v3/groups => generated 326 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:29.750435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd9c7d-47ae-4583-b149-34a2c4448ac7 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:29.774548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd9c7d-47ae-4583-b149-34a2c4448ac7 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:29.782528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d745db-1f23-40f3-9532-631fbbf70e98 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:29.783333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d745db-1f23-40f3-9532-631fbbf70e98 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:29.783758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d745db-1f23-40f3-9532-631fbbf70e98 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:29.784141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d745db-1f23-40f3-9532-631fbbf70e98 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:29.786557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d745db-1f23-40f3-9532-631fbbf70e98 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:29.787240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d745db-1f23-40f3-9532-631fbbf70e98 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:29.789030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d745db-1f23-40f3-9532-631fbbf70e98 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:29.806120 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2472/5001] 10.222.0.76 () {58 vars in 1167 bytes} [Sat Aug 27 04:50:29 2022] GET /identity/v3/endpoints?interface=public => generated 3405 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:29.807529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db024760-1965-482e-b058-8be1fa457fd2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:29.808191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db024760-1965-482e-b058-8be1fa457fd2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:29.808191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db024760-1965-482e-b058-8be1fa457fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:29.825546 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2530/5002] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:29 2022] POST /identity/v3/auth/tokens => generated 3942 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:29.828012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cbcc9-6b5b-490c-ba18-27638854b76e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:29.872946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-db024760-1965-482e-b058-8be1fa457fd2 None None] MFA Rules not processed for user `8749d65f584c4fd585a8f7e0415c749f`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:29.877874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cbcc9-6b5b-490c-ba18-27638854b76e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:29.878047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-db024760-1965-482e-b058-8be1fa457fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:29.882603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012a849-b211-4383-8888-369097543b4c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:29.884212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012a849-b211-4383-8888-369097543b4c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:29.890748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012a849-b211-4383-8888-369097543b4c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:29.891643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012a849-b211-4383-8888-369097543b4c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/7c000e9a513941f088a09f4365866806/users/86196ef01bd642d19c49f3c54beddc33/roles/c4e0d4c3dc39432ebf39c4941091f30f/inherited_to_projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:29.906504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012a849-b211-4383-8888-369097543b4c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=7c000e9a513941f088a09f4365866806, user_id=86196ef01bd642d19c49f3c54beddc33, role_id=c4e0d4c3dc39432ebf39c4941091f30f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:29.910302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012a849-b211-4383-8888-369097543b4c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:29.926760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c012a849-b211-4383-8888-369097543b4c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invalidating the token cache because role c4e0d4c3dc39432ebf39c4941091f30f was removed from user 86196ef01bd642d19c49f3c54beddc33 on project 7c000e9a513941f088a09f4365866806. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:29.927153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c012a849-b211-4383-8888-369097543b4c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:29.927981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c012a849-b211-4383-8888-369097543b4c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:29.976503 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2473/5003] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:29 2022] POST /identity/v3/auth/tokens => generated 3887 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:29.985400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db024760-1965-482e-b058-8be1fa457fd2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:29.985400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-db024760-1965-482e-b058-8be1fa457fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:29.997045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db024760-1965-482e-b058-8be1fa457fd2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:30.003541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0bb5d-e3c1-4ee5-a8b5-948dc729f0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:30.004606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0bb5d-e3c1-4ee5-a8b5-948dc729f0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:30.004998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0bb5d-e3c1-4ee5-a8b5-948dc729f0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:30.005370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0bb5d-e3c1-4ee5-a8b5-948dc729f0f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:30.006187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0bb5d-e3c1-4ee5-a8b5-948dc729f0f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:30.008358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0bb5d-e3c1-4ee5-a8b5-948dc729f0f5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:30.061978 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2531/5004] 10.222.0.76 () {58 vars in 1566 bytes} [Sat Aug 27 04:50:29 2022] DELETE /identity/v3/OS-INHERIT/projects/7c000e9a513941f088a09f4365866806/users/86196ef01bd642d19c49f3c54beddc33/roles/c4e0d4c3dc39432ebf39c4941091f30f/inherited_to_projects => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:30.062932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012a849-b211-4383-8888-369097543b4c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:30.064621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c012a849-b211-4383-8888-369097543b4c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:30.145932 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2474/5005] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:29 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:30.146930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0bb5d-e3c1-4ee5-a8b5-948dc729f0f5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:30.149323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a1b0bb5d-e3c1-4ee5-a8b5-948dc729f0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:30.173573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012a849-b211-4383-8888-369097543b4c tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:30.292753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f4a61-d73a-4ac6-8a76-f05ed78681a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:30.294290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f4a61-d73a-4ac6-8a76-f05ed78681a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:30.294750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f4a61-d73a-4ac6-8a76-f05ed78681a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:30.295186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f4a61-d73a-4ac6-8a76-f05ed78681a2 admin admin] PATH_INFO: `/v3/projects/59bd03033f714f7a85eacadc38c4ecc4/users/8cf6f30ab7d14d0f8f3829e05dd565dd/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:30.312831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0bb5d-e3c1-4ee5-a8b5-948dc729f0f5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:30.320515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f4a61-d73a-4ac6-8a76-f05ed78681a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59bd03033f714f7a85eacadc38c4ecc4, user_id=8cf6f30ab7d14d0f8f3829e05dd565dd, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:30.323716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c9729-b57d-47f1-b547-df1f1d8ab80f tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:30.324223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f4a61-d73a-4ac6-8a76-f05ed78681a2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:30.326484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c9729-b57d-47f1-b547-df1f1d8ab80f tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:30.327899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c9729-b57d-47f1-b547-df1f1d8ab80f tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:30.328663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c9729-b57d-47f1-b547-df1f1d8ab80f tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/2cd4ddc144764008bc27a141c445bd78/users/520d48e4895c4aed9831c3fda0d0b0cf` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:30.363229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c9729-b57d-47f1-b547-df1f1d8ab80f tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2cd4ddc144764008bc27a141c445bd78, user_id=520d48e4895c4aed9831c3fda0d0b0cf)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:30.365411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c9729-b57d-47f1-b547-df1f1d8ab80f tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:30.418705 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2532/5006] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:30 2022] PUT /identity/v3/projects/59bd03033f714f7a85eacadc38c4ecc4/users/8cf6f30ab7d14d0f8f3829e05dd565dd/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:30.419851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f4a61-d73a-4ac6-8a76-f05ed78681a2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:30.430254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1d0f4a61-d73a-4ac6-8a76-f05ed78681a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:30.511205 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2475/5007] 10.222.0.76 () {60 vars in 1360 bytes} [Sat Aug 27 04:50:30 2022] PUT /identity/v3/groups/2cd4ddc144764008bc27a141c445bd78/users/520d48e4895c4aed9831c3fda0d0b0cf => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:30.514933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c9729-b57d-47f1-b547-df1f1d8ab80f tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:30.518314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e16c9729-b57d-47f1-b547-df1f1d8ab80f tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:30.538939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f4a61-d73a-4ac6-8a76-f05ed78681a2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:30.629256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959eed9e-62d0-4b56-9a60-f591d9c01e93 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:30.629904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959eed9e-62d0-4b56-9a60-f591d9c01e93 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:30.630187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959eed9e-62d0-4b56-9a60-f591d9c01e93 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:30.630464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959eed9e-62d0-4b56-9a60-f591d9c01e93 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:30.631397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959eed9e-62d0-4b56-9a60-f591d9c01e93 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:30.631957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959eed9e-62d0-4b56-9a60-f591d9c01e93 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:30.637075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959eed9e-62d0-4b56-9a60-f591d9c01e93 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:30.638286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c9729-b57d-47f1-b547-df1f1d8ab80f tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:30.653131 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2533/5008] 10.222.0.76 () {58 vars in 1171 bytes} [Sat Aug 27 04:50:30 2022] GET /identity/v3/endpoints?interface=internal => generated 477 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:30.653131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959eed9e-62d0-4b56-9a60-f591d9c01e93 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:30.653474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd79b96-0506-4500-8f90-002359574450 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:30.653474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd79b96-0506-4500-8f90-002359574450 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:30.653474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd79b96-0506-4500-8f90-002359574450 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:30.658071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd79b96-0506-4500-8f90-002359574450 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:30.658071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd79b96-0506-4500-8f90-002359574450 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:30.658255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-959eed9e-62d0-4b56-9a60-f591d9c01e93 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:30.658366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd79b96-0506-4500-8f90-002359574450 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:30.800701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959eed9e-62d0-4b56-9a60-f591d9c01e93 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:30.810665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542315c-6969-426d-b9cf-7b5e10a7824d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:30.810665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542315c-6969-426d-b9cf-7b5e10a7824d service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:30.811097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542315c-6969-426d-b9cf-7b5e10a7824d service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:30.811326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542315c-6969-426d-b9cf-7b5e10a7824d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:30.815370 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2476/5009] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:50:30 2022] POST /identity/v3/projects => generated 328 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:30.816954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd79b96-0506-4500-8f90-002359574450 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:30.820104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7bd79b96-0506-4500-8f90-002359574450 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:30.868757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:30.955220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd79b96-0506-4500-8f90-002359574450 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:30.955220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219befb-efa9-48fe-8a96-289908c85f30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:30.955220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219befb-efa9-48fe-8a96-289908c85f30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:30.955873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219befb-efa9-48fe-8a96-289908c85f30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:30.956289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219befb-efa9-48fe-8a96-289908c85f30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:30.957171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219befb-efa9-48fe-8a96-289908c85f30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Adding query filter params (scope.project.id=9d6b2a3c05ba480489cac0e7ed9497e0, user.id=86196ef01bd642d19c49f3c54beddc33) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:30.957588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219befb-efa9-48fe-8a96-289908c85f30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:30.960308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219befb-efa9-48fe-8a96-289908c85f30 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:30.978456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542315c-6969-426d-b9cf-7b5e10a7824d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:30.982190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542315c-6969-426d-b9cf-7b5e10a7824d service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:31.002196 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2534/5010] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:30 2022] GET /identity/v3/auth/tokens => generated 3887 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:31.003586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542315c-6969-426d-b9cf-7b5e10a7824d service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:31.109283 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2477/5011] 10.222.0.76 () {58 vars in 1356 bytes} [Sat Aug 27 04:50:30 2022] GET /identity/v3/role_assignments?scope.project.id=9d6b2a3c05ba480489cac0e7ed9497e0&user.id=86196ef01bd642d19c49f3c54beddc33&effective => generated 228 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:31.109283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad036148-1f80-4092-b8cf-4742cff29daf None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:31.109283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad036148-1f80-4092-b8cf-4742cff29daf None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:31.109283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad036148-1f80-4092-b8cf-4742cff29daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:31.163624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ad036148-1f80-4092-b8cf-4742cff29daf None None] MFA Rules not processed for user `8cf6f30ab7d14d0f8f3829e05dd565dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:31.165078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542315c-6969-426d-b9cf-7b5e10a7824d service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:31.165221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ad036148-1f80-4092-b8cf-4742cff29daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:31.334012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:31.339700 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2478/5012] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:31 2022] POST /identity/v3/auth/tokens => generated 3887 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:31.340626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad036148-1f80-4092-b8cf-4742cff29daf None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:31.358622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680e137-f44c-4114-bdfe-11598bc2de39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:31.359592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680e137-f44c-4114-bdfe-11598bc2de39 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:31.360055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680e137-f44c-4114-bdfe-11598bc2de39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:31.360964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680e137-f44c-4114-bdfe-11598bc2de39 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:31.362175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680e137-f44c-4114-bdfe-11598bc2de39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:31.372598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680e137-f44c-4114-bdfe-11598bc2de39 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:31.526110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad036148-1f80-4092-b8cf-4742cff29daf None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:31.534717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c70ee-0089-49c8-9d86-0943d9575f15 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:31.712316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c70ee-0089-49c8-9d86-0943d9575f15 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:31.712316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c70ee-0089-49c8-9d86-0943d9575f15 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:31.712316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c70ee-0089-49c8-9d86-0943d9575f15 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:31.712316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c70ee-0089-49c8-9d86-0943d9575f15 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:31.712316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c70ee-0089-49c8-9d86-0943d9575f15 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:31.714140 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2535/5013] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:31 2022] POST /identity/v3/users => generated 283 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:31.714140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680e137-f44c-4114-bdfe-11598bc2de39 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:31.714140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680e137-f44c-4114-bdfe-11598bc2de39 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:31.714140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb619bd-d7e9-44d1-978a-694d9be78ba5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:31.715000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb619bd-d7e9-44d1-978a-694d9be78ba5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:31.715000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb619bd-d7e9-44d1-978a-694d9be78ba5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:31.715000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb619bd-d7e9-44d1-978a-694d9be78ba5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:31.715000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb619bd-d7e9-44d1-978a-694d9be78ba5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:31.715000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb619bd-d7e9-44d1-978a-694d9be78ba5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:31.786783 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2479/5014] 10.222.0.76 () {60 vars in 1147 bytes} [Sat Aug 27 04:50:31 2022] POST /identity/v3/groups => generated 326 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:31.786783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c70ee-0089-49c8-9d86-0943d9575f15 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:31.871643 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2536/5015] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:31 2022] POST /identity/v3/services => generated 290 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:31.873693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb619bd-d7e9-44d1-978a-694d9be78ba5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:31.942125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c70ee-0089-49c8-9d86-0943d9575f15 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:31.947635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb619bd-d7e9-44d1-978a-694d9be78ba5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:31.948212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee9b46-23c0-4e74-a0f4-a8631eb60843 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:31.948212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee9b46-23c0-4e74-a0f4-a8631eb60843 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:31.948212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee9b46-23c0-4e74-a0f4-a8631eb60843 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:31.948860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee9b46-23c0-4e74-a0f4-a8631eb60843 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:31.948860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee9b46-23c0-4e74-a0f4-a8631eb60843 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:31.948860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee9b46-23c0-4e74-a0f4-a8631eb60843 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:31.949292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:31.950878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:31.951494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:31.953872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/projects/9d6b2a3c05ba480489cac0e7ed9497e0` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:31.955782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9d6b2a3c05ba480489cac0e7ed9497e0)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:31.963322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:32.054664 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2480/5016] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:31 2022] POST /identity/v3/users => generated 413 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:32.055696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee9b46-23c0-4e74-a0f4-a8631eb60843 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:32.059475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8cee9b46-23c0-4e74-a0f4-a8631eb60843 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:32.163478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6b2a3c05ba480489cac0e7ed9497e0', 'request_id': 'req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:32.183422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6b2a3c05ba480489cac0e7ed9497e0', 'request_id': 'req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:32.267935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee9b46-23c0-4e74-a0f4-a8631eb60843 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:32.397006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6b2a3c05ba480489cac0e7ed9497e0', 'request_id': 'req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:32.436467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] The token cache is being invalidate because project 9d6b2a3c05ba480489cac0e7ed9497e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:32.436891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:32.437958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:32.441883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb6dfa-f0ae-40af-85ac-c354ea7f0d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:32.442527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb6dfa-f0ae-40af-85ac-c354ea7f0d98 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:32.442810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb6dfa-f0ae-40af-85ac-c354ea7f0d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:32.443160 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2537/5017] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:31 2022] DELETE /identity/v3/projects/9d6b2a3c05ba480489cac0e7ed9497e0 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:32.444075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:32.446353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb6dfa-f0ae-40af-85ac-c354ea7f0d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:32.449917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:32.455325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8afb6dfa-f0ae-40af-85ac-c354ea7f0d98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:32.630476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb6dfa-f0ae-40af-85ac-c354ea7f0d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:32.633127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb6dfa-f0ae-40af-85ac-c354ea7f0d98 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:32.654485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a40d65-d0e2-4cae-8ef3-50330dd2ecfb tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:32.659209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea5708-7321-4290-8396-25de160bafbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:32.659915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea5708-7321-4290-8396-25de160bafbc admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:32.660301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea5708-7321-4290-8396-25de160bafbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:32.660649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea5708-7321-4290-8396-25de160bafbc admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:32.661369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea5708-7321-4290-8396-25de160bafbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:32.663060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea5708-7321-4290-8396-25de160bafbc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:32.677962 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2481/5018] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:32 2022] GET /identity/v3/auth/tokens => generated 4021 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:32.679038 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2538/5019] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:32 2022] GET /identity/v3/roles => generated 1650 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:32.680073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea5708-7321-4290-8396-25de160bafbc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:32.680601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb6dfa-f0ae-40af-85ac-c354ea7f0d98 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:32.684121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8afb6dfa-f0ae-40af-85ac-c354ea7f0d98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:32.685935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7dea5708-7321-4290-8396-25de160bafbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:32.877865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb6dfa-f0ae-40af-85ac-c354ea7f0d98 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:32.890155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea5708-7321-4290-8396-25de160bafbc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:32.891197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e875e-aa3b-4842-b773-39e8c55efb39 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:32.891879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e875e-aa3b-4842-b773-39e8c55efb39 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:32.892184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e875e-aa3b-4842-b773-39e8c55efb39 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:32.892467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e875e-aa3b-4842-b773-39e8c55efb39 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/20d5187698fe4ce38a70a590b64b731e/users/520d48e4895c4aed9831c3fda0d0b0cf` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:32.898732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f5f73-86a8-4c29-bba7-f20a0badda86 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:32.899691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f5f73-86a8-4c29-bba7-f20a0badda86 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:32.900231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f5f73-86a8-4c29-bba7-f20a0badda86 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:32.900742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f5f73-86a8-4c29-bba7-f20a0badda86 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:32.902522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f5f73-86a8-4c29-bba7-f20a0badda86 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:32.903508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e875e-aa3b-4842-b773-39e8c55efb39 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=20d5187698fe4ce38a70a590b64b731e, user_id=520d48e4895c4aed9831c3fda0d0b0cf)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:32.909214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e875e-aa3b-4842-b773-39e8c55efb39 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:32.910478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f5f73-86a8-4c29-bba7-f20a0badda86 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:33.090383 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-165f5f73-86a8-4c29-bba7-f20a0badda86 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-54202290. To ensure interoperability, identifiers should be a valid uuid. Aug 27 04:50:33.090383 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 27 04:50:33.090383 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:50:33.102542 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2482/5020] 10.222.0.76 () {60 vars in 1360 bytes} [Sat Aug 27 04:50:32 2022] PUT /identity/v3/groups/20d5187698fe4ce38a70a590b64b731e/users/520d48e4895c4aed9831c3fda0d0b0cf => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:33.104513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e875e-aa3b-4842-b773-39e8c55efb39 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:33.106411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f13e875e-aa3b-4842-b773-39e8c55efb39 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:33.252074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e875e-aa3b-4842-b773-39e8c55efb39 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:33.267523 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2539/5021] 10.222.0.76 () {60 vars in 1156 bytes} [Sat Aug 27 04:50:32 2022] POST /identity/v3/endpoints => generated 357 bytes in 585 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:33.267523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f5f73-86a8-4c29-bba7-f20a0badda86 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:33.270904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-165f5f73-86a8-4c29-bba7-f20a0badda86 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:33.301178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be716f5-7a51-4ca3-870d-a6162f12b442 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:33.303162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be716f5-7a51-4ca3-870d-a6162f12b442 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:33.305423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be716f5-7a51-4ca3-870d-a6162f12b442 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:33.322289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be716f5-7a51-4ca3-870d-a6162f12b442 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:33.322289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be716f5-7a51-4ca3-870d-a6162f12b442 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:33.322289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be716f5-7a51-4ca3-870d-a6162f12b442 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:33.402813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f5f73-86a8-4c29-bba7-f20a0badda86 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:33.479431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a5788-2763-4772-80b5-bf72ecd643e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:33.480079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a5788-2763-4772-80b5-bf72ecd643e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:33.480693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a5788-2763-4772-80b5-bf72ecd643e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:33.480976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a5788-2763-4772-80b5-bf72ecd643e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/roles/c4e0d4c3dc39432ebf39c4941091f30f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:33.482589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a5788-2763-4772-80b5-bf72ecd643e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c4e0d4c3dc39432ebf39c4941091f30f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:33.484882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a5788-2763-4772-80b5-bf72ecd643e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:33.534400 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2483/5022] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:50:33 2022] POST /identity/v3/roles => generated 244 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:33.535793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be716f5-7a51-4ca3-870d-a6162f12b442 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:33.632361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3c1a5788-2763-4772-80b5-bf72ecd643e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invalidating the token cache because role c4e0d4c3dc39432ebf39c4941091f30f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:33.632774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3c1a5788-2763-4772-80b5-bf72ecd643e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:33.633590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3c1a5788-2763-4772-80b5-bf72ecd643e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:33.657922 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2540/5023] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:33 2022] DELETE /identity/v3/roles/c4e0d4c3dc39432ebf39c4941091f30f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:33.665217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a5788-2763-4772-80b5-bf72ecd643e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:33.668499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3c1a5788-2763-4772-80b5-bf72ecd643e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:33.731162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be716f5-7a51-4ca3-870d-a6162f12b442 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:33.778733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:33.867304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a5788-2763-4772-80b5-bf72ecd643e3 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:33.879062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d8d56-45b1-4d5b-93b7-0c3c3fdd87ea tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:33.879751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d8d56-45b1-4d5b-93b7-0c3c3fdd87ea tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:33.880034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d8d56-45b1-4d5b-93b7-0c3c3fdd87ea tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:33.882506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d8d56-45b1-4d5b-93b7-0c3c3fdd87ea tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/users/520d48e4895c4aed9831c3fda0d0b0cf/groups` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:33.886451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d8d56-45b1-4d5b-93b7-0c3c3fdd87ea tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=520d48e4895c4aed9831c3fda0d0b0cf)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:33.896589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d8d56-45b1-4d5b-93b7-0c3c3fdd87ea tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:33.913745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb46f23-8db0-44d7-8090-f3833480a177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:33.913745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb46f23-8db0-44d7-8090-f3833480a177 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:33.913745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb46f23-8db0-44d7-8090-f3833480a177 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:33.913745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb46f23-8db0-44d7-8090-f3833480a177 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:33.915036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb46f23-8db0-44d7-8090-f3833480a177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:33.916645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb46f23-8db0-44d7-8090-f3833480a177 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:33.942407 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2484/5024] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:33 2022] GET /identity/v3/roles => generated 1655 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:33.943242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb46f23-8db0-44d7-8090-f3833480a177 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:33.945484 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2541/5025] 10.222.0.76 () {58 vars in 1242 bytes} [Sat Aug 27 04:50:33 2022] GET /identity/v3/users/520d48e4895c4aed9831c3fda0d0b0cf/groups => generated 838 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:33.950407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d8d56-45b1-4d5b-93b7-0c3c3fdd87ea tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:33.950546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5fb46f23-8db0-44d7-8090-f3833480a177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:33.951228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b96d8d56-45b1-4d5b-93b7-0c3c3fdd87ea tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:34.098131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d8d56-45b1-4d5b-93b7-0c3c3fdd87ea tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:34.109687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92caf2-fddc-4497-ac98-0db40203ead3 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:34.111362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92caf2-fddc-4497-ac98-0db40203ead3 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:34.111842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92caf2-fddc-4497-ac98-0db40203ead3 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:34.112761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92caf2-fddc-4497-ac98-0db40203ead3 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:34.113789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92caf2-fddc-4497-ac98-0db40203ead3 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:34.115791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92caf2-fddc-4497-ac98-0db40203ead3 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:34.125536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb46f23-8db0-44d7-8090-f3833480a177 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:34.131771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d895276-990c-450c-83a8-181b76d24b75 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:34.137089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d895276-990c-450c-83a8-181b76d24b75 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:34.137089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d895276-990c-450c-83a8-181b76d24b75 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:34.137089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d895276-990c-450c-83a8-181b76d24b75 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/regions/tempest-region-54202290` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:34.137089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d895276-990c-450c-83a8-181b76d24b75 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-54202290)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:34.137089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d895276-990c-450c-83a8-181b76d24b75 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:34.139136 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2485/5026] 10.222.0.76 () {58 vars in 1200 bytes} [Sat Aug 27 04:50:33 2022] GET /identity/v3/regions/tempest-region-54202290 => generated 176 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:34.139993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d895276-990c-450c-83a8-181b76d24b75 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:34.142154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2d895276-990c-450c-83a8-181b76d24b75 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:34.216334 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2542/5027] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:50:33 2022] POST /identity/v3/roles => generated 246 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:34.219845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92caf2-fddc-4497-ac98-0db40203ead3 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:34.258889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92caf2-fddc-4497-ac98-0db40203ead3 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:34.271047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd475d5-1662-48cf-a7e5-a6747967dbf5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:34.274322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd475d5-1662-48cf-a7e5-a6747967dbf5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:34.274624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd475d5-1662-48cf-a7e5-a6747967dbf5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:34.274889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd475d5-1662-48cf-a7e5-a6747967dbf5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/20d5187698fe4ce38a70a590b64b731e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:34.277618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd475d5-1662-48cf-a7e5-a6747967dbf5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:delete_group(group_id=20d5187698fe4ce38a70a590b64b731e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:34.282441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd475d5-1662-48cf-a7e5-a6747967dbf5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:34.313173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d895276-990c-450c-83a8-181b76d24b75 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:34.326792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce288bb6-db9b-4649-bcf2-9c13d576d817 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:34.327955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce288bb6-db9b-4649-bcf2-9c13d576d817 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:34.328439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce288bb6-db9b-4649-bcf2-9c13d576d817 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:34.328896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce288bb6-db9b-4649-bcf2-9c13d576d817 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/users/86196ef01bd642d19c49f3c54beddc33` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:34.330912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce288bb6-db9b-4649-bcf2-9c13d576d817 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:delete_user(user_id=86196ef01bd642d19c49f3c54beddc33)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:34.333482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce288bb6-db9b-4649-bcf2-9c13d576d817 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:34.343462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:34.422629 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2543/5028] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:50:34 2022] DELETE /identity/v3/groups/20d5187698fe4ce38a70a590b64b731e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:34.427310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd475d5-1662-48cf-a7e5-a6747967dbf5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:34.439033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7dd475d5-1662-48cf-a7e5-a6747967dbf5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:34.551780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ce288bb6-db9b-4649-bcf2-9c13d576d817 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86196ef01bd642d19c49f3c54beddc33'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:34.623017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd475d5-1662-48cf-a7e5-a6747967dbf5 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:34.641192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d23179-bc4a-4d25-a12c-6b73f7c773bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:34.641959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d23179-bc4a-4d25-a12c-6b73f7c773bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:34.642345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d23179-bc4a-4d25-a12c-6b73f7c773bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:34.642725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d23179-bc4a-4d25-a12c-6b73f7c773bc admin admin] PATH_INFO: `/v3/projects/0e8f4d2e736c4d409a47e60a882a8de9/users/62939df053d4493fb541707b376584a4/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:34.654332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ce288bb6-db9b-4649-bcf2-9c13d576d817 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86196ef01bd642d19c49f3c54beddc33'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:34.656189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ce288bb6-db9b-4649-bcf2-9c13d576d817 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86196ef01bd642d19c49f3c54beddc33'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:34.671900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ce288bb6-db9b-4649-bcf2-9c13d576d817 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86196ef01bd642d19c49f3c54beddc33'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:34.685913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d23179-bc4a-4d25-a12c-6b73f7c773bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8f4d2e736c4d409a47e60a882a8de9, user_id=62939df053d4493fb541707b376584a4, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:34.693100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d23179-bc4a-4d25-a12c-6b73f7c773bc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:34.708668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ce288bb6-db9b-4649-bcf2-9c13d576d817 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86196ef01bd642d19c49f3c54beddc33'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:34.720806 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2486/5029] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:34 2022] DELETE /identity/v3/users/86196ef01bd642d19c49f3c54beddc33 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:34.722293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce288bb6-db9b-4649-bcf2-9c13d576d817 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:34.725855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ce288bb6-db9b-4649-bcf2-9c13d576d817 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:34.857952 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2544/5030] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:34 2022] PUT /identity/v3/projects/0e8f4d2e736c4d409a47e60a882a8de9/users/62939df053d4493fb541707b376584a4/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:34.859754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d23179-bc4a-4d25-a12c-6b73f7c773bc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:34.862926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-70d23179-bc4a-4d25-a12c-6b73f7c773bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:34.945623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce288bb6-db9b-4649-bcf2-9c13d576d817 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:35.089614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9762b23-3360-465d-bd52-ff467304b80d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:35.089849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9762b23-3360-465d-bd52-ff467304b80d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:35.090144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9762b23-3360-465d-bd52-ff467304b80d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:35.090421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9762b23-3360-465d-bd52-ff467304b80d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints/d1cc3769430b48f888e6000e12736c09` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:35.103739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9762b23-3360-465d-bd52-ff467304b80d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=d1cc3769430b48f888e6000e12736c09)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:35.106275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9762b23-3360-465d-bd52-ff467304b80d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:35.114070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d23179-bc4a-4d25-a12c-6b73f7c773bc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:35.131241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0425f2-7058-49fb-a63a-85d52a55ec4a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:35.132119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0425f2-7058-49fb-a63a-85d52a55ec4a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:35.132502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0425f2-7058-49fb-a63a-85d52a55ec4a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:35.132611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0425f2-7058-49fb-a63a-85d52a55ec4a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/d20969f5af8f40c290ddc1ea0c5a59a6/users/cf9a1b227dce46bc8f44fe44697dc897/roles/891a83304e5a4177b355df56762ecec7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:35.176134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0425f2-7058-49fb-a63a-85d52a55ec4a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d20969f5af8f40c290ddc1ea0c5a59a6, user_id=cf9a1b227dce46bc8f44fe44697dc897, role_id=891a83304e5a4177b355df56762ecec7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:35.181282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0425f2-7058-49fb-a63a-85d52a55ec4a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:35.277089 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-d9762b23-3360-465d-bd52-ff467304b80d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-697407198. To ensure interoperability, identifiers should be a valid uuid. Aug 27 04:50:35.277089 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 27 04:50:35.277089 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:35.324478 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2545/5031] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:34 2022] PUT /identity/v3/projects/d20969f5af8f40c290ddc1ea0c5a59a6/users/cf9a1b227dce46bc8f44fe44697dc897/roles/891a83304e5a4177b355df56762ecec7 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:35.325751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0425f2-7058-49fb-a63a-85d52a55ec4a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:35.327939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ee0425f2-7058-49fb-a63a-85d52a55ec4a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:35.447133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0425f2-7058-49fb-a63a-85d52a55ec4a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:35.481518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af903ab-c533-449d-9f7b-46eb94f407ca tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:35.484199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af903ab-c533-449d-9f7b-46eb94f407ca tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:35.484584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af903ab-c533-449d-9f7b-46eb94f407ca tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:35.484927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af903ab-c533-449d-9f7b-46eb94f407ca tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/groups/2cd4ddc144764008bc27a141c445bd78` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:35.488679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af903ab-c533-449d-9f7b-46eb94f407ca tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2cd4ddc144764008bc27a141c445bd78)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:35.490917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af903ab-c533-449d-9f7b-46eb94f407ca tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:35.493965 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2487/5032] 10.222.0.76 () {60 vars in 1256 bytes} [Sat Aug 27 04:50:34 2022] PATCH /identity/v3/endpoints/d1cc3769430b48f888e6000e12736c09 => generated 362 bytes in 772 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:35.495472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9762b23-3360-465d-bd52-ff467304b80d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:35.501065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d9762b23-3360-465d-bd52-ff467304b80d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:35.570973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:35.629885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9762b23-3360-465d-bd52-ff467304b80d tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:35.640386 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2546/5033] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:50:35 2022] DELETE /identity/v3/groups/2cd4ddc144764008bc27a141c445bd78 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:35.642273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b141044-2e7e-45bb-b7eb-e7e68be19b8a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:35.642778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b141044-2e7e-45bb-b7eb-e7e68be19b8a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:35.643194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b141044-2e7e-45bb-b7eb-e7e68be19b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:35.714903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456330e-090e-40c5-b31a-de24f553308d tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:35.715633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456330e-090e-40c5-b31a-de24f553308d tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:35.715927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456330e-090e-40c5-b31a-de24f553308d tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:35.716224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456330e-090e-40c5-b31a-de24f553308d tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/groups/c0233d75842742bf9891904fe46cccc6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:35.717765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456330e-090e-40c5-b31a-de24f553308d tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c0233d75842742bf9891904fe46cccc6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:35.721866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8b141044-2e7e-45bb-b7eb-e7e68be19b8a None None] MFA Rules not processed for user `62939df053d4493fb541707b376584a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:35.722443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456330e-090e-40c5-b31a-de24f553308d tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:35.723321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8b141044-2e7e-45bb-b7eb-e7e68be19b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:35.834025 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2547/5034] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:35 2022] POST /identity/v3/auth/tokens => generated 4005 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:35.835566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b141044-2e7e-45bb-b7eb-e7e68be19b8a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:35.877571 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2488/5035] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:50:35 2022] DELETE /identity/v3/groups/c0233d75842742bf9891904fe46cccc6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:35.882444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0e058-1b95-4f78-906b-86baa163fb91 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:35.883060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0e058-1b95-4f78-906b-86baa163fb91 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:35.883405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0e058-1b95-4f78-906b-86baa163fb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:35.957581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-87a0e058-1b95-4f78-906b-86baa163fb91 None None] MFA Rules not processed for user `1979b5a334de402d82500d4883d44d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:35.959735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-87a0e058-1b95-4f78-906b-86baa163fb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:36.023285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b141044-2e7e-45bb-b7eb-e7e68be19b8a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:36.088682 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2489/5036] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:35 2022] POST /identity/v3/auth/tokens => generated 4039 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:36.090794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0e058-1b95-4f78-906b-86baa163fb91 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:36.132815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126219a-7f4c-4c9e-a9ce-c9392da3f30e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:36.133826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126219a-7f4c-4c9e-a9ce-c9392da3f30e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:36.134280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126219a-7f4c-4c9e-a9ce-c9392da3f30e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:36.135365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126219a-7f4c-4c9e-a9ce-c9392da3f30e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/d20969f5af8f40c290ddc1ea0c5a59a6/users/cf9a1b227dce46bc8f44fe44697dc897/roles/0230a1afbb9040edb5d90b634cccc5c6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:36.138645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126219a-7f4c-4c9e-a9ce-c9392da3f30e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d20969f5af8f40c290ddc1ea0c5a59a6, user_id=cf9a1b227dce46bc8f44fe44697dc897, role_id=0230a1afbb9040edb5d90b634cccc5c6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:36.146177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126219a-7f4c-4c9e-a9ce-c9392da3f30e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:36.206014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0e058-1b95-4f78-906b-86baa163fb91 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:36.217533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8508a-1945-40b9-a38c-bd0c728b1fe7 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:36.219075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8508a-1945-40b9-a38c-bd0c728b1fe7 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:36.219598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8508a-1945-40b9-a38c-bd0c728b1fe7 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:36.220048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8508a-1945-40b9-a38c-bd0c728b1fe7 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/regions/tempest-region-697407198` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:36.222346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8508a-1945-40b9-a38c-bd0c728b1fe7 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-697407198)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:36.224942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8508a-1945-40b9-a38c-bd0c728b1fe7 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:36.233968 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2490/5037] 10.222.0.76 () {58 vars in 1203 bytes} [Sat Aug 27 04:50:36 2022] GET /identity/v3/regions/tempest-region-697407198 => generated 178 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:36.245751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8508a-1945-40b9-a38c-bd0c728b1fe7 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:36.318919 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2548/5038] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:35 2022] PUT /identity/v3/projects/d20969f5af8f40c290ddc1ea0c5a59a6/users/cf9a1b227dce46bc8f44fe44697dc897/roles/0230a1afbb9040edb5d90b634cccc5c6 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:36.320262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126219a-7f4c-4c9e-a9ce-c9392da3f30e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:36.322840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3126219a-7f4c-4c9e-a9ce-c9392da3f30e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:36.359288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8508a-1945-40b9-a38c-bd0c728b1fe7 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:36.416769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126219a-7f4c-4c9e-a9ce-c9392da3f30e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:36.425946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5618f84-4a1d-41a0-af92-1a8762cfc36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:36.426626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5618f84-4a1d-41a0-af92-1a8762cfc36c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:36.426909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5618f84-4a1d-41a0-af92-1a8762cfc36c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:36.427184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5618f84-4a1d-41a0-af92-1a8762cfc36c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:36.428258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5618f84-4a1d-41a0-af92-1a8762cfc36c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:36.429852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5618f84-4a1d-41a0-af92-1a8762cfc36c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:36.476914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:36.496614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4f87c-b2f4-405d-8e54-328b8cf0cab2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:36.497791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4f87c-b2f4-405d-8e54-328b8cf0cab2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:36.498463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4f87c-b2f4-405d-8e54-328b8cf0cab2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:36.499520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4f87c-b2f4-405d-8e54-328b8cf0cab2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/users/520d48e4895c4aed9831c3fda0d0b0cf` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:36.501063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4f87c-b2f4-405d-8e54-328b8cf0cab2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:delete_user(user_id=520d48e4895c4aed9831c3fda0d0b0cf)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:36.503341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4f87c-b2f4-405d-8e54-328b8cf0cab2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:36.598324 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2549/5039] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:36 2022] POST /identity/v3/projects => generated 365 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:36.599327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5618f84-4a1d-41a0-af92-1a8762cfc36c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:36.680761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5618f84-4a1d-41a0-af92-1a8762cfc36c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:36.686565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8561f5e-04b8-49a8-a8a7-0f329d424a00 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:36.687225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8561f5e-04b8-49a8-a8a7-0f329d424a00 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:36.687488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8561f5e-04b8-49a8-a8a7-0f329d424a00 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:36.687756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8561f5e-04b8-49a8-a8a7-0f329d424a00 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/projects/7c000e9a513941f088a09f4365866806` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:36.689191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8561f5e-04b8-49a8-a8a7-0f329d424a00 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7c000e9a513941f088a09f4365866806)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:36.691246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8561f5e-04b8-49a8-a8a7-0f329d424a00 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:36.742489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aee4f87c-b2f4-405d-8e54-328b8cf0cab2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520d48e4895c4aed9831c3fda0d0b0cf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:36.907411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aee4f87c-b2f4-405d-8e54-328b8cf0cab2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520d48e4895c4aed9831c3fda0d0b0cf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:36.908589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aee4f87c-b2f4-405d-8e54-328b8cf0cab2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520d48e4895c4aed9831c3fda0d0b0cf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:36.925600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aee4f87c-b2f4-405d-8e54-328b8cf0cab2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520d48e4895c4aed9831c3fda0d0b0cf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:36.948796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8561f5e-04b8-49a8-a8a7-0f329d424a00 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c000e9a513941f088a09f4365866806', 'request_id': 'req-c8561f5e-04b8-49a8-a8a7-0f329d424a00'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:36.952999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aee4f87c-b2f4-405d-8e54-328b8cf0cab2 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520d48e4895c4aed9831c3fda0d0b0cf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:36.958758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8561f5e-04b8-49a8-a8a7-0f329d424a00 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c000e9a513941f088a09f4365866806', 'request_id': 'req-c8561f5e-04b8-49a8-a8a7-0f329d424a00'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:36.970651 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2491/5040] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:36 2022] DELETE /identity/v3/users/520d48e4895c4aed9831c3fda0d0b0cf => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:36.973011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d439-1ed0-454e-ada8-eb8f93cd83f2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:36.973546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d439-1ed0-454e-ada8-eb8f93cd83f2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:36.973978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d439-1ed0-454e-ada8-eb8f93cd83f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:37.003396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-81e7d439-1ed0-454e-ada8-eb8f93cd83f2 None None] MFA Rules not processed for user `1979b5a334de402d82500d4883d44d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:37.005770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-81e7d439-1ed0-454e-ada8-eb8f93cd83f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:37.127427 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2492/5041] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:36 2022] POST /identity/v3/auth/tokens => generated 4039 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:37.129002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7d439-1ed0-454e-ada8-eb8f93cd83f2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:37.130659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-81e7d439-1ed0-454e-ada8-eb8f93cd83f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:37.164667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8561f5e-04b8-49a8-a8a7-0f329d424a00 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c000e9a513941f088a09f4365866806', 'request_id': 'req-c8561f5e-04b8-49a8-a8a7-0f329d424a00'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:37.189932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8561f5e-04b8-49a8-a8a7-0f329d424a00 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] The token cache is being invalidate because project 7c000e9a513941f088a09f4365866806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:37.190458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8561f5e-04b8-49a8-a8a7-0f329d424a00 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:37.191967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8561f5e-04b8-49a8-a8a7-0f329d424a00 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:37.194236 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2550/5042] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:36 2022] DELETE /identity/v3/projects/7c000e9a513941f088a09f4365866806 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:37.203204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8561f5e-04b8-49a8-a8a7-0f329d424a00 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:37.209855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c8561f5e-04b8-49a8-a8a7-0f329d424a00 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:37.218593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7d439-1ed0-454e-ada8-eb8f93cd83f2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:37.230474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bda88-9127-4808-bc29-cb6f60c30f4a tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:37.231146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bda88-9127-4808-bc29-cb6f60c30f4a tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:37.232666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bda88-9127-4808-bc29-cb6f60c30f4a tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:37.233021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bda88-9127-4808-bc29-cb6f60c30f4a tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints/d1cc3769430b48f888e6000e12736c09` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:37.244682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bda88-9127-4808-bc29-cb6f60c30f4a tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=d1cc3769430b48f888e6000e12736c09)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:37.246648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bda88-9127-4808-bc29-cb6f60c30f4a tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:37.332152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c05bda88-9127-4808-bc29-cb6f60c30f4a tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'd1cc3769430b48f888e6000e12736c09', 'request_id': 'req-c05bda88-9127-4808-bc29-cb6f60c30f4a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:37.361627 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2493/5043] 10.222.0.76 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:37 2022] DELETE /identity/v3/endpoints/d1cc3769430b48f888e6000e12736c09 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:37.366338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bda88-9127-4808-bc29-cb6f60c30f4a tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:37.372141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c05bda88-9127-4808-bc29-cb6f60c30f4a tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:37.375124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8561f5e-04b8-49a8-a8a7-0f329d424a00 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:37.486509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:37.490199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02ae85-4baf-4f55-8fa1-d59e43facdfe tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:37.490754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02ae85-4baf-4f55-8fa1-d59e43facdfe tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:37.491036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02ae85-4baf-4f55-8fa1-d59e43facdfe tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:37.491313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02ae85-4baf-4f55-8fa1-d59e43facdfe tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:37.491987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02ae85-4baf-4f55-8fa1-d59e43facdfe tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:37.493064 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-5f02ae85-4baf-4f55-8fa1-d59e43facdfe tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:37.493064 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:50:37.493064 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:50:37.495542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02ae85-4baf-4f55-8fa1-d59e43facdfe tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:37.555278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bda88-9127-4808-bc29-cb6f60c30f4a tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:37.555650 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2551/5044] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:37 2022] GET /identity/v3/users => generated 8884 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:37.557999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02ae85-4baf-4f55-8fa1-d59e43facdfe tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:37.561117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5f02ae85-4baf-4f55-8fa1-d59e43facdfe tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:37.568729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb16528-b3d7-4dbb-9ddc-7c6ad1853f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:37.569547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb16528-b3d7-4dbb-9ddc-7c6ad1853f87 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:37.574871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb16528-b3d7-4dbb-9ddc-7c6ad1853f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:37.574871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb16528-b3d7-4dbb-9ddc-7c6ad1853f87 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:37.574871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb16528-b3d7-4dbb-9ddc-7c6ad1853f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:37.574871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb16528-b3d7-4dbb-9ddc-7c6ad1853f87 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:37.672380 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2494/5045] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:37 2022] POST /identity/v3/users => generated 289 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:37.673297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb16528-b3d7-4dbb-9ddc-7c6ad1853f87 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:37.682141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0cb16528-b3d7-4dbb-9ddc-7c6ad1853f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:37.861424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb16528-b3d7-4dbb-9ddc-7c6ad1853f87 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:37.876791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea470e21-61d3-4ae0-9d5a-dbac14124269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:37.880056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea470e21-61d3-4ae0-9d5a-dbac14124269 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:37.881682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea470e21-61d3-4ae0-9d5a-dbac14124269 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:37.882155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea470e21-61d3-4ae0-9d5a-dbac14124269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:37.895447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:37.902613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ea470e21-61d3-4ae0-9d5a-dbac14124269 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:37.908546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02ae85-4baf-4f55-8fa1-d59e43facdfe tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:37.915488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b93f4-7a84-44d4-86c7-3719b40fcab6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:37.916972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b93f4-7a84-44d4-86c7-3719b40fcab6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:37.917312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b93f4-7a84-44d4-86c7-3719b40fcab6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:37.917594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b93f4-7a84-44d4-86c7-3719b40fcab6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/domains/b704f8842b8e49239b9faf3122f70683` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:37.919114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b93f4-7a84-44d4-86c7-3719b40fcab6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b704f8842b8e49239b9faf3122f70683)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:37.920888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b93f4-7a84-44d4-86c7-3719b40fcab6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:37.948232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea470e21-61d3-4ae0-9d5a-dbac14124269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:37.958403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea470e21-61d3-4ae0-9d5a-dbac14124269 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:37.980774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-680b93f4-7a84-44d4-86c7-3719b40fcab6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b704f8842b8e49239b9faf3122f70683'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:37.982412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-680b93f4-7a84-44d4-86c7-3719b40fcab6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b704f8842b8e49239b9faf3122f70683'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:37.991264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:38.011729 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2495/5046] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:37 2022] GET /identity/v3/auth/tokens => generated 4039 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:38.012711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea470e21-61d3-4ae0-9d5a-dbac14124269 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:38.016093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ea470e21-61d3-4ae0-9d5a-dbac14124269 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:38.091863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-680b93f4-7a84-44d4-86c7-3719b40fcab6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b704f8842b8e49239b9faf3122f70683'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:38.105411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-680b93f4-7a84-44d4-86c7-3719b40fcab6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b704f8842b8e49239b9faf3122f70683'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:38.108662 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2552/5047] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:50:37 2022] PATCH /identity/v3/domains/b704f8842b8e49239b9faf3122f70683 => generated 276 bytes in 552 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:38.121255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b93f4-7a84-44d4-86c7-3719b40fcab6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:38.126956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-680b93f4-7a84-44d4-86c7-3719b40fcab6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:38.200585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea470e21-61d3-4ae0-9d5a-dbac14124269 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:38.285393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b93f4-7a84-44d4-86c7-3719b40fcab6 tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:38.293266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c1cd2-ca43-4df1-84cf-11739409c385 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:38.293938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c1cd2-ca43-4df1-84cf-11739409c385 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:38.294226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c1cd2-ca43-4df1-84cf-11739409c385 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:38.295529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c1cd2-ca43-4df1-84cf-11739409c385 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/regions/tempest-region-697407198` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:38.296254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c1cd2-ca43-4df1-84cf-11739409c385 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-697407198)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:38.298785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c1cd2-ca43-4df1-84cf-11739409c385 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:38.301650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dcecb-aded-49ea-b499-cd3d1bfd7ddf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:38.302666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dcecb-aded-49ea-b499-cd3d1bfd7ddf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:38.303062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dcecb-aded-49ea-b499-cd3d1bfd7ddf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:38.303475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dcecb-aded-49ea-b499-cd3d1bfd7ddf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/domains/0fdc4c46ff1b41e684af75195d332e66` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:38.305941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dcecb-aded-49ea-b499-cd3d1bfd7ddf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0fdc4c46ff1b41e684af75195d332e66)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:38.308810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dcecb-aded-49ea-b499-cd3d1bfd7ddf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:38.336455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ed0dcecb-aded-49ea-b499-cd3d1bfd7ddf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0fdc4c46ff1b41e684af75195d332e66'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:38.340266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ed0dcecb-aded-49ea-b499-cd3d1bfd7ddf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0fdc4c46ff1b41e684af75195d332e66'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:38.393860 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-957c1cd2-ca43-4df1-84cf-11739409c385 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-697407198. To ensure interoperability, identifiers should be a valid uuid. Aug 27 04:50:38.393860 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 27 04:50:38.393860 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:50:38.419300 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2553/5048] 10.222.0.76 () {58 vars in 1206 bytes} [Sat Aug 27 04:50:38 2022] DELETE /identity/v3/regions/tempest-region-697407198 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:38.421731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f7867-d03f-45f1-bc71-d7f1406d2566 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:38.426934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f7867-d03f-45f1-bc71-d7f1406d2566 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:38.427603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f7867-d03f-45f1-bc71-d7f1406d2566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:38.473064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ed0dcecb-aded-49ea-b499-cd3d1bfd7ddf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0fdc4c46ff1b41e684af75195d332e66'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:38.476966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ed0dcecb-aded-49ea-b499-cd3d1bfd7ddf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0fdc4c46ff1b41e684af75195d332e66'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:38.489672 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2496/5049] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:50:38 2022] PATCH /identity/v3/domains/0fdc4c46ff1b41e684af75195d332e66 => generated 276 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:38.490592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dcecb-aded-49ea-b499-cd3d1bfd7ddf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:38.496514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ed0dcecb-aded-49ea-b499-cd3d1bfd7ddf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:38.559434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-863f7867-d03f-45f1-bc71-d7f1406d2566 None None] MFA Rules not processed for user `cf9a1b227dce46bc8f44fe44697dc897`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:38.561209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-863f7867-d03f-45f1-bc71-d7f1406d2566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:38.593519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dcecb-aded-49ea-b499-cd3d1bfd7ddf tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:38.614645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5eeaa5-31e1-4e09-90b6-b38f26de7f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:38.615663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5eeaa5-31e1-4e09-90b6-b38f26de7f5f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:38.616106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5eeaa5-31e1-4e09-90b6-b38f26de7f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:38.616616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5eeaa5-31e1-4e09-90b6-b38f26de7f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:38.617490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5eeaa5-31e1-4e09-90b6-b38f26de7f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:38.619853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5eeaa5-31e1-4e09-90b6-b38f26de7f5f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:38.632472 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2497/5050] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:38 2022] GET /identity/v3/roles => generated 1892 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:38.633696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5eeaa5-31e1-4e09-90b6-b38f26de7f5f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:38.636121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ba5eeaa5-31e1-4e09-90b6-b38f26de7f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:38.699412 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2554/5051] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:38 2022] POST /identity/v3/auth/tokens => generated 4041 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:38.700834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f7867-d03f-45f1-bc71-d7f1406d2566 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:38.702565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-863f7867-d03f-45f1-bc71-d7f1406d2566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:38.760825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5eeaa5-31e1-4e09-90b6-b38f26de7f5f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:38.765856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:38.770676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55e3be7cd3654666b5dbcbfc831adb1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69d9e47688d94130aafbf3c225513d2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:38.772250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:38.773523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:38.774349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] PATH_INFO: `/v3/domains/b704f8842b8e49239b9faf3122f70683` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:38.797266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b704f8842b8e49239b9faf3122f70683)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:38.797266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:38.824403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b704f8842b8e49239b9faf3122f70683'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:38.828212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b704f8842b8e49239b9faf3122f70683'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:38.885959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:38.924999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f7867-d03f-45f1-bc71-d7f1406d2566 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:38.938898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00e145-b84e-4f86-810f-74c4d5c480b9 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:38.942689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00e145-b84e-4f86-810f-74c4d5c480b9 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:38.943101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00e145-b84e-4f86-810f-74c4d5c480b9 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:38.943504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00e145-b84e-4f86-810f-74c4d5c480b9 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/regions/tempest-region-54202290` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:38.944227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00e145-b84e-4f86-810f-74c4d5c480b9 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-54202290)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:38.946725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00e145-b84e-4f86-810f-74c4d5c480b9 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:38.984029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b704f8842b8e49239b9faf3122f70683', 'request_id': 'req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:38.990554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b704f8842b8e49239b9faf3122f70683', 'request_id': 'req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:38.999218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b704f8842b8e49239b9faf3122f70683', 'request_id': 'req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:39.125341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] The token cache is being invalidate because project b704f8842b8e49239b9faf3122f70683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:39.125688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:39.126504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:39.138089 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2555/5052] 10.222.0.76 () {58 vars in 1203 bytes} [Sat Aug 27 04:50:38 2022] DELETE /identity/v3/regions/tempest-region-54202290 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:39.138462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b704f8842b8e49239b9faf3122f70683', 'request_id': 'req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:39.139196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00e145-b84e-4f86-810f-74c4d5c480b9 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:39.140981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6b00e145-b84e-4f86-810f-74c4d5c480b9 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:39.146686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b704f8842b8e49239b9faf3122f70683', 'request_id': 'req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:39.146686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c tempest-GroupsV3TestJSON-405565882 tempest-GroupsV3TestJSON-405565882-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b704f8842b8e49239b9faf3122f70683', 'request_id': 'req-cc064dde-44f3-4824-a28c-b4c2e63e6c6c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:39.179522 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2498/5053] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:50:38 2022] DELETE /identity/v3/domains/b704f8842b8e49239b9faf3122f70683 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:39.182728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b093-6dcb-457b-a181-32d611e80fb9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:39.183610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b093-6dcb-457b-a181-32d611e80fb9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:39.183610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b093-6dcb-457b-a181-32d611e80fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:39.194959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-5116b093-6dcb-457b-a181-32d611e80fb9 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:50:39.194959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:50:39.194959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:50:39.194959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:50:39.194959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:50:39.194959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:50:39.194959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:50:39.194959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:50:39.194959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:50:39.194959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:50:39.194959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:50:39.194959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:50:39.194959 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:50:39.196147 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:50:39.196147 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:50:39.196147 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:50:39.196147 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:50:39.196147 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:50:39.196147 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:50:39.196147 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:50:39.196147 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:50:39.196147 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:50:39.196147 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:50:39.196147 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:50:39.196147 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:50:39.196147 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:50:39.196147 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:50:39.196147 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:50:39.212903 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2499/5054] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:50:39 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 30 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:50:39.212903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116b093-6dcb-457b-a181-32d611e80fb9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:39.225356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5116b093-6dcb-457b-a181-32d611e80fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:39.353937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00e145-b84e-4f86-810f-74c4d5c480b9 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:39.380920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116b093-6dcb-457b-a181-32d611e80fb9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:39.396215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3bc95-a839-4d64-afcc-b9e79b220b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:39.397087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3bc95-a839-4d64-afcc-b9e79b220b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:39.397368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3bc95-a839-4d64-afcc-b9e79b220b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:39.401941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3bc95-a839-4d64-afcc-b9e79b220b03 admin admin] PATH_INFO: `/v3/projects/21f72f96606c438ab6b5619010f4e1cd/users/91812e12f4d5425f88fc06368672422c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:39.427834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3bc95-a839-4d64-afcc-b9e79b220b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f72f96606c438ab6b5619010f4e1cd, user_id=91812e12f4d5425f88fc06368672422c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:39.433053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3bc95-a839-4d64-afcc-b9e79b220b03 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:39.473445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b5ab3e42c814226861773763e63f62d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '725a578a14244fec84d2138e48ede87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:39.474207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:39.474581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:39.475029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] PATH_INFO: `/v3/domains/0fdc4c46ff1b41e684af75195d332e66` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:39.495559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0fdc4c46ff1b41e684af75195d332e66)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:39.501587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:39.536658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0fdc4c46ff1b41e684af75195d332e66'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:39.544363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0fdc4c46ff1b41e684af75195d332e66'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:39.553230 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2500/5055] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:39 2022] PUT /identity/v3/projects/21f72f96606c438ab6b5619010f4e1cd/users/91812e12f4d5425f88fc06368672422c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:39.553230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ed3bc-a5d8-43fb-934e-a20b4be1c342 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:39.553230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ed3bc-a5d8-43fb-934e-a20b4be1c342 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:39.553230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ed3bc-a5d8-43fb-934e-a20b4be1c342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:39.593804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5a0ed3bc-a5d8-43fb-934e-a20b4be1c342 None None] MFA Rules not processed for user `cf9a1b227dce46bc8f44fe44697dc897`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:39.595500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5a0ed3bc-a5d8-43fb-934e-a20b4be1c342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:39.733105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fdc4c46ff1b41e684af75195d332e66', 'request_id': 'req-54c4a361-68a3-491e-af19-cd4c177e7fe1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:39.756918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fdc4c46ff1b41e684af75195d332e66', 'request_id': 'req-54c4a361-68a3-491e-af19-cd4c177e7fe1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:39.816663 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2501/5056] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:39 2022] POST /identity/v3/auth/tokens => generated 4041 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:39.818335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ed3bc-a5d8-43fb-934e-a20b4be1c342 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:39.820098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5a0ed3bc-a5d8-43fb-934e-a20b4be1c342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:39.982471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fdc4c46ff1b41e684af75195d332e66', 'request_id': 'req-54c4a361-68a3-491e-af19-cd4c177e7fe1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:39.984596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ed3bc-a5d8-43fb-934e-a20b4be1c342 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:40.014763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] The token cache is being invalidate because project 0fdc4c46ff1b41e684af75195d332e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:40.018061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:40.018569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:40.049644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0fdc4c46ff1b41e684af75195d332e66', 'request_id': 'req-54c4a361-68a3-491e-af19-cd4c177e7fe1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:40.055017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0fdc4c46ff1b41e684af75195d332e66', 'request_id': 'req-54c4a361-68a3-491e-af19-cd4c177e7fe1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:40.055912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0fdc4c46ff1b41e684af75195d332e66', 'request_id': 'req-54c4a361-68a3-491e-af19-cd4c177e7fe1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:40.071906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b7b51-c69a-43b9-aea9-f898be446cb5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:40.073596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b7b51-c69a-43b9-aea9-f898be446cb5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:40.073596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b7b51-c69a-43b9-aea9-f898be446cb5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:40.073798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b7b51-c69a-43b9-aea9-f898be446cb5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/services/e39dbfe2d4bf4ef6af2f4250a46a6cf5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:40.074259 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2556/5057] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:50:39 2022] DELETE /identity/v3/domains/0fdc4c46ff1b41e684af75195d332e66 => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:40.074405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b7b51-c69a-43b9-aea9-f898be446cb5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e39dbfe2d4bf4ef6af2f4250a46a6cf5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:40.075581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:40.076209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b7b51-c69a-43b9-aea9-f898be446cb5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:40.078077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:40.219582 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2502/5058] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:39 2022] DELETE /identity/v3/services/e39dbfe2d4bf4ef6af2f4250a46a6cf5 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:40.227472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b7b51-c69a-43b9-aea9-f898be446cb5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:40.230140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8e9b7b51-c69a-43b9-aea9-f898be446cb5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:40.231221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4a361-68a3-491e-af19-cd4c177e7fe1 tempest-InheritsV3TestJSON-586159186 tempest-InheritsV3TestJSON-586159186-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:40.272788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dec0b-a363-46fd-8999-a6824a79de93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:40.273782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dec0b-a363-46fd-8999-a6824a79de93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:40.278271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dec0b-a363-46fd-8999-a6824a79de93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:40.278757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dec0b-a363-46fd-8999-a6824a79de93 admin admin] PATH_INFO: `/v3/users/9d5c4e307d804d7baf7c16a956f11173` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:40.280584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dec0b-a363-46fd-8999-a6824a79de93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5c4e307d804d7baf7c16a956f11173)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:40.282822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dec0b-a363-46fd-8999-a6824a79de93 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:40.308014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b7b51-c69a-43b9-aea9-f898be446cb5 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:40.324227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816abce-b0ed-45e5-8186-b9cfcdd1c6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:40.324227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816abce-b0ed-45e5-8186-b9cfcdd1c6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:40.324227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816abce-b0ed-45e5-8186-b9cfcdd1c6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:40.324227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816abce-b0ed-45e5-8186-b9cfcdd1c6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:40.324646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816abce-b0ed-45e5-8186-b9cfcdd1c6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:40.324646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816abce-b0ed-45e5-8186-b9cfcdd1c6b7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:40.351251 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2503/5059] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:40 2022] GET /identity/v3/roles => generated 1892 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:40.351251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816abce-b0ed-45e5-8186-b9cfcdd1c6b7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:40.352445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8816abce-b0ed-45e5-8186-b9cfcdd1c6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:40.486080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816abce-b0ed-45e5-8186-b9cfcdd1c6b7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:40.490974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a7a09-a221-4c72-9ea6-7591eb173665 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf9a1b227dce46bc8f44fe44697dc897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20969f5af8f40c290ddc1ea0c5a59a6', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-484020112', 'tempest-DelegatedRole-2021671154'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:40.491600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a7a09-a221-4c72-9ea6-7591eb173665 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:40.491885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a7a09-a221-4c72-9ea6-7591eb173665 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:40.492250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a7a09-a221-4c72-9ea6-7591eb173665 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:40.492867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a7a09-a221-4c72-9ea6-7591eb173665 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] RBAC: Authorizing `identity:create_trust()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:40.494589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a7a09-a221-4c72-9ea6-7591eb173665 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:40.582346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b51dec0b-a363-46fd-8999-a6824a79de93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5c4e307d804d7baf7c16a956f11173'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:40.583800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b51dec0b-a363-46fd-8999-a6824a79de93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5c4e307d804d7baf7c16a956f11173'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:40.595911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:40.713341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b51dec0b-a363-46fd-8999-a6824a79de93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5c4e307d804d7baf7c16a956f11173'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:40.714229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b51dec0b-a363-46fd-8999-a6824a79de93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5c4e307d804d7baf7c16a956f11173'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:40.725248 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2504/5060] 10.222.0.76 () {60 vars in 1174 bytes} [Sat Aug 27 04:50:40 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:40.726805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a7a09-a221-4c72-9ea6-7591eb173665 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:40.729022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-283a7a09-a221-4c72-9ea6-7591eb173665 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:40.733450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b51dec0b-a363-46fd-8999-a6824a79de93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5c4e307d804d7baf7c16a956f11173'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:40.750878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a7a09-a221-4c72-9ea6-7591eb173665 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:40.754174 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2557/5061] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:40 2022] DELETE /identity/v3/users/9d5c4e307d804d7baf7c16a956f11173 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:40.755424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dec0b-a363-46fd-8999-a6824a79de93 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:40.757496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b51dec0b-a363-46fd-8999-a6824a79de93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:40.846043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d5670-9e84-45a3-8037-872f09f9c202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:40.847401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d5670-9e84-45a3-8037-872f09f9c202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:40.847675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d5670-9e84-45a3-8037-872f09f9c202 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:40.847951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d5670-9e84-45a3-8037-872f09f9c202 admin admin] PATH_INFO: `/v3/users/09979a7621a24c0fb95bd48716c38048` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:40.852565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d5670-9e84-45a3-8037-872f09f9c202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09979a7621a24c0fb95bd48716c38048)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:40.854774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d5670-9e84-45a3-8037-872f09f9c202 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:40.865397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dec0b-a363-46fd-8999-a6824a79de93 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:40.873347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380d7b9-bea0-4684-9946-36b04d64cda0 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:40.874219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380d7b9-bea0-4684-9946-36b04d64cda0 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:40.874506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380d7b9-bea0-4684-9946-36b04d64cda0 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:40.874886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380d7b9-bea0-4684-9946-36b04d64cda0 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints/bab665a308d54faf9cdd7874bf2a6971` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:40.885417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380d7b9-bea0-4684-9946-36b04d64cda0 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=bab665a308d54faf9cdd7874bf2a6971)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:40.886746 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-0380d7b9-bea0-4684-9946-36b04d64cda0 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:40.886746 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:50:40.886746 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:50:40.887931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380d7b9-bea0-4684-9946-36b04d64cda0 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:41.065005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0380d7b9-bea0-4684-9946-36b04d64cda0 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'bab665a308d54faf9cdd7874bf2a6971', 'request_id': 'req-0380d7b9-bea0-4684-9946-36b04d64cda0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:41.066435 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2558/5062] 10.222.0.76 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:40 2022] DELETE /identity/v3/endpoints/bab665a308d54faf9cdd7874bf2a6971 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:41.067456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380d7b9-bea0-4684-9946-36b04d64cda0 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:41.070462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0380d7b9-bea0-4684-9946-36b04d64cda0 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:41.098485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380d7b9-bea0-4684-9946-36b04d64cda0 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:41.103953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfd1cd-b674-462a-abda-5c871a8ba647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:41.104774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfd1cd-b674-462a-abda-5c871a8ba647 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:41.107168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfd1cd-b674-462a-abda-5c871a8ba647 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:41.107168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfd1cd-b674-462a-abda-5c871a8ba647 admin admin] PATH_INFO: `/v3/projects/21f72f96606c438ab6b5619010f4e1cd/users/91812e12f4d5425f88fc06368672422c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:41.107391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfd1cd-b674-462a-abda-5c871a8ba647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f72f96606c438ab6b5619010f4e1cd, user_id=91812e12f4d5425f88fc06368672422c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:41.110110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfd1cd-b674-462a-abda-5c871a8ba647 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:41.125165 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2559/5063] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:41 2022] PUT /identity/v3/projects/21f72f96606c438ab6b5619010f4e1cd/users/91812e12f4d5425f88fc06368672422c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:41.126230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfd1cd-b674-462a-abda-5c871a8ba647 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:41.127850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e6cfd1cd-b674-462a-abda-5c871a8ba647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:41.226729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfd1cd-b674-462a-abda-5c871a8ba647 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:41.233345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbe618-a606-49d3-a971-f73185d0f0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:41.234003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbe618-a606-49d3-a971-f73185d0f0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:41.234281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbe618-a606-49d3-a971-f73185d0f0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:41.234896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbe618-a606-49d3-a971-f73185d0f0ab admin admin] PATH_INFO: `/v3/users/8749d65f584c4fd585a8f7e0415c749f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:41.235924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbe618-a606-49d3-a971-f73185d0f0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=8749d65f584c4fd585a8f7e0415c749f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:41.238866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbe618-a606-49d3-a971-f73185d0f0ab admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:41.249605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-632d5670-9e84-45a3-8037-872f09f9c202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09979a7621a24c0fb95bd48716c38048'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:41.268638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:41.410328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-632d5670-9e84-45a3-8037-872f09f9c202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09979a7621a24c0fb95bd48716c38048'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:41.411419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-632d5670-9e84-45a3-8037-872f09f9c202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09979a7621a24c0fb95bd48716c38048'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:41.422156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-632d5670-9e84-45a3-8037-872f09f9c202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09979a7621a24c0fb95bd48716c38048'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:41.444381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-632d5670-9e84-45a3-8037-872f09f9c202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09979a7621a24c0fb95bd48716c38048'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:41.460130 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2505/5064] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:40 2022] DELETE /identity/v3/users/09979a7621a24c0fb95bd48716c38048 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:41.460947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d5670-9e84-45a3-8037-872f09f9c202 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:41.464804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-632d5670-9e84-45a3-8037-872f09f9c202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:41.572652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-16cbe618-a606-49d3-a971-f73185d0f0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8749d65f584c4fd585a8f7e0415c749f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:41.573617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-16cbe618-a606-49d3-a971-f73185d0f0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8749d65f584c4fd585a8f7e0415c749f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:41.614004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d5670-9e84-45a3-8037-872f09f9c202 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:41.644429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecde97-1cb8-4e12-9020-558e22a538ce tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:41.645181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecde97-1cb8-4e12-9020-558e22a538ce tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:41.645561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecde97-1cb8-4e12-9020-558e22a538ce tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:41.656117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecde97-1cb8-4e12-9020-558e22a538ce tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:41.657037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecde97-1cb8-4e12-9020-558e22a538ce tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:41.659768 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-bfecde97-1cb8-4e12-9020-558e22a538ce tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:50:41.659768 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:50:41.659768 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:50:41.661950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-16cbe618-a606-49d3-a971-f73185d0f0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8749d65f584c4fd585a8f7e0415c749f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:41.662088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecde97-1cb8-4e12-9020-558e22a538ce tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:41.662844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-16cbe618-a606-49d3-a971-f73185d0f0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8749d65f584c4fd585a8f7e0415c749f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:41.684147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-16cbe618-a606-49d3-a971-f73185d0f0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8749d65f584c4fd585a8f7e0415c749f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:41.686980 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2506/5065] 10.222.0.76 () {58 vars in 1155 bytes} [Sat Aug 27 04:50:41 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:41.688488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0009f76-47d0-413f-a76e-a9e635dd4522 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:41.688975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0009f76-47d0-413f-a76e-a9e635dd4522 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:41.689265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0009f76-47d0-413f-a76e-a9e635dd4522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:41.701251 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2560/5066] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:41 2022] DELETE /identity/v3/users/8749d65f584c4fd585a8f7e0415c749f => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:41.702479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbe618-a606-49d3-a971-f73185d0f0ab admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:41.716885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-16cbe618-a606-49d3-a971-f73185d0f0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:41.734375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e0009f76-47d0-413f-a76e-a9e635dd4522 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:41.736785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e0009f76-47d0-413f-a76e-a9e635dd4522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:41.828082 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2507/5067] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:41 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:41.829621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5792d-f9de-4aa7-9db4-63c5d7972bc2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:41.830027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5792d-f9de-4aa7-9db4-63c5d7972bc2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:41.830407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5792d-f9de-4aa7-9db4-63c5d7972bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:41.847310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbe618-a606-49d3-a971-f73185d0f0ab admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:41.853065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346a72f-e2bf-4e83-bde8-2782f1c6b8da tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:41.853731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346a72f-e2bf-4e83-bde8-2782f1c6b8da tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:41.854098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346a72f-e2bf-4e83-bde8-2782f1c6b8da tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:41.854654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346a72f-e2bf-4e83-bde8-2782f1c6b8da tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/regions/tempest-region-962273017` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:41.855588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346a72f-e2bf-4e83-bde8-2782f1c6b8da tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-962273017)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:41.858003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346a72f-e2bf-4e83-bde8-2782f1c6b8da tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:41.866103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-dfa5792d-f9de-4aa7-9db4-63c5d7972bc2 None None] MFA Rules not processed for user `91812e12f4d5425f88fc06368672422c`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:41.868243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dfa5792d-f9de-4aa7-9db4-63c5d7972bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:41.966876 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2508/5068] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:41 2022] POST /identity/v3/auth/tokens => generated 3756 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:41.970620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc26466-65a4-4073-a07f-220e9682d9b1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:41.970620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc26466-65a4-4073-a07f-220e9682d9b1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:41.970812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc26466-65a4-4073-a07f-220e9682d9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:41.991442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bbc26466-65a4-4073-a07f-220e9682d9b1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:41.992709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bbc26466-65a4-4073-a07f-220e9682d9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:42.001225 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2509/5069] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:41 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:42.002192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc26466-65a4-4073-a07f-220e9682d9b1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:42.003441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bbc26466-65a4-4073-a07f-220e9682d9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:42.083492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc26466-65a4-4073-a07f-220e9682d9b1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:42.090203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915588c-5bc1-456d-bb40-8759a60102a4 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf9a1b227dce46bc8f44fe44697dc897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20969f5af8f40c290ddc1ea0c5a59a6', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-484020112', 'tempest-DelegatedRole-2021671154'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:42.090869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915588c-5bc1-456d-bb40-8759a60102a4 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:42.091153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915588c-5bc1-456d-bb40-8759a60102a4 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:42.091431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915588c-5bc1-456d-bb40-8759a60102a4 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] PATH_INFO: `/v3/OS-TRUST/trusts/1a49455a37294b66a1b024d23dfc94e5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:42.100657 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2561/5070] 10.222.0.76 () {58 vars in 1206 bytes} [Sat Aug 27 04:50:41 2022] DELETE /identity/v3/regions/tempest-region-962273017 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:42.100657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346a72f-e2bf-4e83-bde8-2782f1c6b8da tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:42.100657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d346a72f-e2bf-4e83-bde8-2782f1c6b8da tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:42.101405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915588c-5bc1-456d-bb40-8759a60102a4 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] RBAC: Authorizing `identity:delete_trust(trust_id=1a49455a37294b66a1b024d23dfc94e5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:42.102518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915588c-5bc1-456d-bb40-8759a60102a4 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:42.196822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346a72f-e2bf-4e83-bde8-2782f1c6b8da tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:42.204871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65dff4-d99a-4064-b154-244fee116192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:42.205600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65dff4-d99a-4064-b154-244fee116192 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:42.205960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65dff4-d99a-4064-b154-244fee116192 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:42.206320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65dff4-d99a-4064-b154-244fee116192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:42.210064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f915588c-5bc1-456d-bb40-8759a60102a4 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '1a49455a37294b66a1b024d23dfc94e5', 'request_id': 'req-f915588c-5bc1-456d-bb40-8759a60102a4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:42.222195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65dff4-d99a-4064-b154-244fee116192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:42.223961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65dff4-d99a-4064-b154-244fee116192 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:42.254337 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2562/5071] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:42 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:42.256341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65dff4-d99a-4064-b154-244fee116192 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:42.266942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65dff4-d99a-4064-b154-244fee116192 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:42.271512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b6317-6518-4ccb-8c34-3602d7a78c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:42.272257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b6317-6518-4ccb-8c34-3602d7a78c66 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:42.272546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b6317-6518-4ccb-8c34-3602d7a78c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:42.272823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b6317-6518-4ccb-8c34-3602d7a78c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:42.285542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b6317-6518-4ccb-8c34-3602d7a78c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:42.287380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b6317-6518-4ccb-8c34-3602d7a78c66 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:42.314386 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2563/5072] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:42 2022] GET /identity/v3/auth/tokens => generated 3756 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:42.315614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b6317-6518-4ccb-8c34-3602d7a78c66 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:42.328071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b6317-6518-4ccb-8c34-3602d7a78c66 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:42.329307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f915588c-5bc1-456d-bb40-8759a60102a4 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1a49455a37294b66a1b024d23dfc94e5', 'request_id': 'req-f915588c-5bc1-456d-bb40-8759a60102a4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:42.330391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f915588c-5bc1-456d-bb40-8759a60102a4 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1a49455a37294b66a1b024d23dfc94e5', 'request_id': 'req-f915588c-5bc1-456d-bb40-8759a60102a4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:42.333214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dc3ac-b556-4b53-af54-d5918c8b74ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:42.341005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dc3ac-b556-4b53-af54-d5918c8b74ad service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:42.341005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dc3ac-b556-4b53-af54-d5918c8b74ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:42.341005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dc3ac-b556-4b53-af54-d5918c8b74ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:42.341005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fc8dc3ac-b556-4b53-af54-d5918c8b74ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:42.353770 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2510/5073] 10.222.0.76 () {58 vars in 1254 bytes} [Sat Aug 27 04:50:42 2022] DELETE /identity/v3/OS-TRUST/trusts/1a49455a37294b66a1b024d23dfc94e5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:42.355551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915588c-5bc1-456d-bb40-8759a60102a4 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:42.357237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f915588c-5bc1-456d-bb40-8759a60102a4 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:42.368382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:42.378226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915588c-5bc1-456d-bb40-8759a60102a4 tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:42.382229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8dc3ac-b556-4b53-af54-d5918c8b74ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:42.389987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8dc3ac-b556-4b53-af54-d5918c8b74ad service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:42.408981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90ee3e-903f-407a-a470-3602830e3170 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:42.412449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90ee3e-903f-407a-a470-3602830e3170 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:42.414389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90ee3e-903f-407a-a470-3602830e3170 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:42.414828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90ee3e-903f-407a-a470-3602830e3170 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/services/9456767204d448b7b52cd6f1740bc877` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:42.416071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90ee3e-903f-407a-a470-3602830e3170 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:delete_service(service_id=9456767204d448b7b52cd6f1740bc877)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:42.422341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90ee3e-903f-407a-a470-3602830e3170 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:42.427095 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2564/5074] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:42 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:42.427095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dc3ac-b556-4b53-af54-d5918c8b74ad service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:42.428358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fc8dc3ac-b556-4b53-af54-d5918c8b74ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:42.443918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dc3ac-b556-4b53-af54-d5918c8b74ad service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:42.449830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8254c-8f5f-4482-8623-66b5f782442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:42.450632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8254c-8f5f-4482-8623-66b5f782442f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:42.451163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8254c-8f5f-4482-8623-66b5f782442f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:42.452390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8254c-8f5f-4482-8623-66b5f782442f admin admin] PATH_INFO: `/v3/projects/0f5b28f1897849a0b07ee3817838caf1` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:42.453606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8254c-8f5f-4482-8623-66b5f782442f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f5b28f1897849a0b07ee3817838caf1)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:42.455639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8254c-8f5f-4482-8623-66b5f782442f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:42.622629 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2511/5075] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:42 2022] DELETE /identity/v3/services/9456767204d448b7b52cd6f1740bc877 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:42.623476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90ee3e-903f-407a-a470-3602830e3170 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:42.637511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6f90ee3e-903f-407a-a470-3602830e3170 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:42.645156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d8d8254c-8f5f-4482-8623-66b5f782442f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f5b28f1897849a0b07ee3817838caf1', 'request_id': 'req-d8d8254c-8f5f-4482-8623-66b5f782442f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:42.660493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d8d8254c-8f5f-4482-8623-66b5f782442f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f5b28f1897849a0b07ee3817838caf1', 'request_id': 'req-d8d8254c-8f5f-4482-8623-66b5f782442f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:42.676804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90ee3e-903f-407a-a470-3602830e3170 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:42.750887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d8d8254c-8f5f-4482-8623-66b5f782442f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f5b28f1897849a0b07ee3817838caf1', 'request_id': 'req-d8d8254c-8f5f-4482-8623-66b5f782442f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:42.772545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d8d8254c-8f5f-4482-8623-66b5f782442f admin admin] The token cache is being invalidate because project 0f5b28f1897849a0b07ee3817838caf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:42.772997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d8d8254c-8f5f-4482-8623-66b5f782442f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:42.773702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d8d8254c-8f5f-4482-8623-66b5f782442f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:42.783042 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2565/5076] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:42 2022] DELETE /identity/v3/projects/0f5b28f1897849a0b07ee3817838caf1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:42.783042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8254c-8f5f-4482-8623-66b5f782442f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:42.783042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d8d8254c-8f5f-4482-8623-66b5f782442f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:42.804561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afd1c6-8b57-48bc-9bf9-f961b2df94db tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf9a1b227dce46bc8f44fe44697dc897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd20969f5af8f40c290ddc1ea0c5a59a6', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-484020112', 'tempest-DelegatedRole-2021671154'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:42.806589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afd1c6-8b57-48bc-9bf9-f961b2df94db tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:42.807923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afd1c6-8b57-48bc-9bf9-f961b2df94db tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:42.808468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afd1c6-8b57-48bc-9bf9-f961b2df94db tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] PATH_INFO: `/v3/OS-TRUST/trusts/1a49455a37294b66a1b024d23dfc94e5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:42.848506 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-a4afd1c6-8b57-48bc-9bf9-f961b2df94db tempest-TrustsV3TestJSON-507649234 tempest-user-513155029] Could not find trust: 1a49455a37294b66a1b024d23dfc94e5.: keystone.exception.TrustNotFound: Could not find trust: 1a49455a37294b66a1b024d23dfc94e5. Aug 27 04:50:42.848506 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:50:42.848506 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:50:42.848506 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:50:42.848506 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:50:42.848506 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:50:42.848506 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:50:42.848506 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:50:42.848506 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:50:42.848506 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:50:42.848506 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:50:42.848506 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:50:42.848506 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 27 04:50:42.848506 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 27 04:50:42.848506 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 27 04:50:42.849784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 27 04:50:42.849784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 27 04:50:42.849784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 27 04:50:42.849784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 27 04:50:42.849784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 27 04:50:42.849784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:50:42.849784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:50:42.849784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 27 04:50:42.849784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 27 04:50:42.849784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 27 04:50:42.849784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 27 04:50:42.849784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 1a49455a37294b66a1b024d23dfc94e5. Aug 27 04:50:42.849784 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:50:42.855435 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2512/5077] 10.222.0.76 () {58 vars in 1251 bytes} [Sat Aug 27 04:50:42 2022] GET /identity/v3/OS-TRUST/trusts/1a49455a37294b66a1b024d23dfc94e5 => generated 111 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:50:42.858704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f8280-94f4-42d8-af93-a53ccd654b2d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:42.859796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f8280-94f4-42d8-af93-a53ccd654b2d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:42.860444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f8280-94f4-42d8-af93-a53ccd654b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:42.894228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-964f8280-94f4-42d8-af93-a53ccd654b2d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:42.895769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-964f8280-94f4-42d8-af93-a53ccd654b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:42.921076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8254c-8f5f-4482-8623-66b5f782442f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:42.944278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016745a-eeff-4ef0-b9c5-1703f44f8f03 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:42.954771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016745a-eeff-4ef0-b9c5-1703f44f8f03 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:42.954771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016745a-eeff-4ef0-b9c5-1703f44f8f03 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:42.954771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016745a-eeff-4ef0-b9c5-1703f44f8f03 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/endpoints/68558a6df86c455c84991a75b18b017d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:42.954771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016745a-eeff-4ef0-b9c5-1703f44f8f03 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=68558a6df86c455c84991a75b18b017d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:42.954771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016745a-eeff-4ef0-b9c5-1703f44f8f03 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:42.982290 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2513/5078] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:42 2022] POST /identity/v3/auth/tokens => generated 3554 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:42.983731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f8280-94f4-42d8-af93-a53ccd654b2d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:42.986160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-964f8280-94f4-42d8-af93-a53ccd654b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:43.100244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f8280-94f4-42d8-af93-a53ccd654b2d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:43.106704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676bde7-269e-4c4c-9ff2-d8933f5adbfc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:43.108595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676bde7-269e-4c4c-9ff2-d8933f5adbfc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:43.108595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676bde7-269e-4c4c-9ff2-d8933f5adbfc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:43.108595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676bde7-269e-4c4c-9ff2-d8933f5adbfc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles/0230a1afbb9040edb5d90b634cccc5c6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:43.110441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676bde7-269e-4c4c-9ff2-d8933f5adbfc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0230a1afbb9040edb5d90b634cccc5c6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:43.113329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676bde7-269e-4c4c-9ff2-d8933f5adbfc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:43.177633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4016745a-eeff-4ef0-b9c5-1703f44f8f03 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '68558a6df86c455c84991a75b18b017d', 'request_id': 'req-4016745a-eeff-4ef0-b9c5-1703f44f8f03'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:43.207104 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2566/5079] 10.222.0.76 () {58 vars in 1236 bytes} [Sat Aug 27 04:50:42 2022] DELETE /identity/v3/endpoints/68558a6df86c455c84991a75b18b017d => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:43.217016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec90756-a01b-4615-bcd3-15fef17ab261 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:43.217373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec90756-a01b-4615-bcd3-15fef17ab261 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:43.217668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec90756-a01b-4615-bcd3-15fef17ab261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:43.279498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-eec90756-a01b-4615-bcd3-15fef17ab261 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:43.282459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-eec90756-a01b-4615-bcd3-15fef17ab261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:43.323490 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2567/5080] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:43.323490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec90756-a01b-4615-bcd3-15fef17ab261 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:43.341564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3676bde7-269e-4c4c-9ff2-d8933f5adbfc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invalidating the token cache because role 0230a1afbb9040edb5d90b634cccc5c6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:43.341874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3676bde7-269e-4c4c-9ff2-d8933f5adbfc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:43.348498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3676bde7-269e-4c4c-9ff2-d8933f5adbfc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:43.348498 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2514/5081] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:42 2022] DELETE /identity/v3/roles/0230a1afbb9040edb5d90b634cccc5c6 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:43.348498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676bde7-269e-4c4c-9ff2-d8933f5adbfc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:43.350630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3676bde7-269e-4c4c-9ff2-d8933f5adbfc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:43.373309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec90756-a01b-4615-bcd3-15fef17ab261 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:43.461089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b67184-0ae6-40a7-be0d-2c7b6c96be90 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:43.462102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b67184-0ae6-40a7-be0d-2c7b6c96be90 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:43.465039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b67184-0ae6-40a7-be0d-2c7b6c96be90 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:43.465039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b67184-0ae6-40a7-be0d-2c7b6c96be90 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/regions/tempest-region-1063137769` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:43.465418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b67184-0ae6-40a7-be0d-2c7b6c96be90 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1063137769)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:43.468319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b67184-0ae6-40a7-be0d-2c7b6c96be90 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:43.472670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676bde7-269e-4c4c-9ff2-d8933f5adbfc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:43.479710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c2ba5-5451-4409-b6ed-f8500b2be36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:43.480724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c2ba5-5451-4409-b6ed-f8500b2be36a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:43.481108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c2ba5-5451-4409-b6ed-f8500b2be36a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:43.481486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c2ba5-5451-4409-b6ed-f8500b2be36a admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:43.484504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c2ba5-5451-4409-b6ed-f8500b2be36a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:43.484883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c2ba5-5451-4409-b6ed-f8500b2be36a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:43.487045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c2ba5-5451-4409-b6ed-f8500b2be36a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:43.514392 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2515/5082] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:43.515343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c2ba5-5451-4409-b6ed-f8500b2be36a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:43.519549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-299c2ba5-5451-4409-b6ed-f8500b2be36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:43.550793 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-b0b67184-0ae6-40a7-be0d-2c7b6c96be90 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1063137769. To ensure interoperability, identifiers should be a valid uuid. Aug 27 04:50:43.550793 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 27 04:50:43.550793 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:50:43.561707 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2568/5083] 10.222.0.76 () {58 vars in 1209 bytes} [Sat Aug 27 04:50:43 2022] DELETE /identity/v3/regions/tempest-region-1063137769 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:43.565651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b67184-0ae6-40a7-be0d-2c7b6c96be90 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:43.567385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b0b67184-0ae6-40a7-be0d-2c7b6c96be90 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:43.611752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b67184-0ae6-40a7-be0d-2c7b6c96be90 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:43.620521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081c0b1-c1d7-4664-8d80-4049241af228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:43.621182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081c0b1-c1d7-4664-8d80-4049241af228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:43.621459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081c0b1-c1d7-4664-8d80-4049241af228 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:43.625713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081c0b1-c1d7-4664-8d80-4049241af228 admin admin] PATH_INFO: `/v3/projects/fdc86b7f0afd4ff5a178a8ccd599c630` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:43.625713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081c0b1-c1d7-4664-8d80-4049241af228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc86b7f0afd4ff5a178a8ccd599c630)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:43.625713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081c0b1-c1d7-4664-8d80-4049241af228 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:43.656832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:43.674104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c2ba5-5451-4409-b6ed-f8500b2be36a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:43.693516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86b4a0-b2b3-4e41-82ea-11a0bd6ba3d8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:43.697489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86b4a0-b2b3-4e41-82ea-11a0bd6ba3d8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:43.698127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86b4a0-b2b3-4e41-82ea-11a0bd6ba3d8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:43.698485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86b4a0-b2b3-4e41-82ea-11a0bd6ba3d8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles/891a83304e5a4177b355df56762ecec7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:43.701724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86b4a0-b2b3-4e41-82ea-11a0bd6ba3d8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_role(role_id=891a83304e5a4177b355df56762ecec7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:43.708403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86b4a0-b2b3-4e41-82ea-11a0bd6ba3d8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:43.883059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a081c0b1-c1d7-4664-8d80-4049241af228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc86b7f0afd4ff5a178a8ccd599c630', 'request_id': 'req-a081c0b1-c1d7-4664-8d80-4049241af228'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:43.893312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a081c0b1-c1d7-4664-8d80-4049241af228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc86b7f0afd4ff5a178a8ccd599c630', 'request_id': 'req-a081c0b1-c1d7-4664-8d80-4049241af228'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:44.116547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a081c0b1-c1d7-4664-8d80-4049241af228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc86b7f0afd4ff5a178a8ccd599c630', 'request_id': 'req-a081c0b1-c1d7-4664-8d80-4049241af228'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:44.123061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:44.126715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5c86b4a0-b2b3-4e41-82ea-11a0bd6ba3d8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invalidating the token cache because role 891a83304e5a4177b355df56762ecec7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:44.127234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5c86b4a0-b2b3-4e41-82ea-11a0bd6ba3d8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:44.127679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5c86b4a0-b2b3-4e41-82ea-11a0bd6ba3d8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:44.130422 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2516/5084] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:43 2022] DELETE /identity/v3/roles/891a83304e5a4177b355df56762ecec7 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:44.131205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86b4a0-b2b3-4e41-82ea-11a0bd6ba3d8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:44.136907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a081c0b1-c1d7-4664-8d80-4049241af228 admin admin] The token cache is being invalidate because project fdc86b7f0afd4ff5a178a8ccd599c630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:44.136907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a081c0b1-c1d7-4664-8d80-4049241af228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:44.137591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5c86b4a0-b2b3-4e41-82ea-11a0bd6ba3d8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:44.139092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a081c0b1-c1d7-4664-8d80-4049241af228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:44.145310 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2569/5085] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:43 2022] DELETE /identity/v3/projects/fdc86b7f0afd4ff5a178a8ccd599c630 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:44.146970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081c0b1-c1d7-4664-8d80-4049241af228 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:44.154771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a081c0b1-c1d7-4664-8d80-4049241af228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:44.274037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86b4a0-b2b3-4e41-82ea-11a0bd6ba3d8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:44.278386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081c0b1-c1d7-4664-8d80-4049241af228 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:44.281858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadf370-25b1-4583-9e81-749a8141fd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:44.282738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadf370-25b1-4583-9e81-749a8141fd7f admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:44.283020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadf370-25b1-4583-9e81-749a8141fd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:44.283294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadf370-25b1-4583-9e81-749a8141fd7f admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:44.284057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daadf370-25b1-4583-9e81-749a8141fd7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:44.287554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daadf370-25b1-4583-9e81-749a8141fd7f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:44.382938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404a9bb-7278-4402-9d84-ca35a48e3c66 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3857e931f44a44dbadcb0d0789817e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:44.383657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404a9bb-7278-4402-9d84-ca35a48e3c66 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:44.383940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404a9bb-7278-4402-9d84-ca35a48e3c66 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:44.384265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404a9bb-7278-4402-9d84-ca35a48e3c66 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] PATH_INFO: `/v3/services/c959e3894b6445709e206c32ea775f73` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:44.384985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404a9bb-7278-4402-9d84-ca35a48e3c66 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c959e3894b6445709e206c32ea775f73)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:44.387191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404a9bb-7278-4402-9d84-ca35a48e3c66 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:44.402273 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2517/5086] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:44 2022] POST /identity/v3/projects => generated 373 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:44.403707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadf370-25b1-4583-9e81-749a8141fd7f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:44.406376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-daadf370-25b1-4583-9e81-749a8141fd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:44.491186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadf370-25b1-4583-9e81-749a8141fd7f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:44.496223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2365596-04df-4543-9a6c-f41be2bf05fd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:44.496865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2365596-04df-4543-9a6c-f41be2bf05fd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:44.497144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2365596-04df-4543-9a6c-f41be2bf05fd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:44.497419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2365596-04df-4543-9a6c-f41be2bf05fd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users/cf9a1b227dce46bc8f44fe44697dc897` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:44.498557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2365596-04df-4543-9a6c-f41be2bf05fd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cf9a1b227dce46bc8f44fe44697dc897)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:44.500533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2365596-04df-4543-9a6c-f41be2bf05fd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:44.560608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:44.570384 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2570/5087] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:44 2022] DELETE /identity/v3/services/c959e3894b6445709e206c32ea775f73 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:44.577984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404a9bb-7278-4402-9d84-ca35a48e3c66 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:44.583130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b404a9bb-7278-4402-9d84-ca35a48e3c66 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:44.632259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404a9bb-7278-4402-9d84-ca35a48e3c66 tempest-EndPointsTestJSON-808948669 tempest-EndPointsTestJSON-808948669-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:44.661571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d2365596-04df-4543-9a6c-f41be2bf05fd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf9a1b227dce46bc8f44fe44697dc897'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:44.761126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f6726-4a39-48c6-9ffb-132593a1770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:44.761760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6726-4a39-48c6-9ffb-132593a1770b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:44.762132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6726-4a39-48c6-9ffb-132593a1770b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:44.762406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6726-4a39-48c6-9ffb-132593a1770b admin admin] PATH_INFO: `/v3/projects/4154168022a54748b78538e321aea82b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:44.764976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f6726-4a39-48c6-9ffb-132593a1770b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4154168022a54748b78538e321aea82b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:44.767074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f6726-4a39-48c6-9ffb-132593a1770b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:44.807026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d2365596-04df-4543-9a6c-f41be2bf05fd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf9a1b227dce46bc8f44fe44697dc897'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:44.808488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d2365596-04df-4543-9a6c-f41be2bf05fd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf9a1b227dce46bc8f44fe44697dc897'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:44.819828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d2365596-04df-4543-9a6c-f41be2bf05fd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf9a1b227dce46bc8f44fe44697dc897'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:44.836516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d2365596-04df-4543-9a6c-f41be2bf05fd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf9a1b227dce46bc8f44fe44697dc897'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:44.844101 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2518/5088] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:44 2022] DELETE /identity/v3/users/cf9a1b227dce46bc8f44fe44697dc897 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:44.844930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2365596-04df-4543-9a6c-f41be2bf05fd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:44.846531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d2365596-04df-4543-9a6c-f41be2bf05fd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:44.947250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2365596-04df-4543-9a6c-f41be2bf05fd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:44.948218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e49f6726-4a39-48c6-9ffb-132593a1770b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4154168022a54748b78538e321aea82b', 'request_id': 'req-e49f6726-4a39-48c6-9ffb-132593a1770b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:44.954690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e49f6726-4a39-48c6-9ffb-132593a1770b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4154168022a54748b78538e321aea82b', 'request_id': 'req-e49f6726-4a39-48c6-9ffb-132593a1770b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:45.020478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a5f11-f01e-4b31-a0a4-1be279a640fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:45.021257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a5f11-f01e-4b31-a0a4-1be279a640fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:45.021573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a5f11-f01e-4b31-a0a4-1be279a640fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:45.021849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a5f11-f01e-4b31-a0a4-1be279a640fc admin admin] PATH_INFO: `/v3/users/55e3be7cd3654666b5dbcbfc831adb1b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:45.023081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a5f11-f01e-4b31-a0a4-1be279a640fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e3be7cd3654666b5dbcbfc831adb1b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:45.025885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a5f11-f01e-4b31-a0a4-1be279a640fc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:45.140348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e49f6726-4a39-48c6-9ffb-132593a1770b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4154168022a54748b78538e321aea82b', 'request_id': 'req-e49f6726-4a39-48c6-9ffb-132593a1770b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:45.165221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e49f6726-4a39-48c6-9ffb-132593a1770b admin admin] The token cache is being invalidate because project 4154168022a54748b78538e321aea82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:45.165221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e49f6726-4a39-48c6-9ffb-132593a1770b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:45.165221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e49f6726-4a39-48c6-9ffb-132593a1770b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:45.165221 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2571/5089] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:44 2022] DELETE /identity/v3/projects/4154168022a54748b78538e321aea82b => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:45.169811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f6726-4a39-48c6-9ffb-132593a1770b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:45.172888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e49f6726-4a39-48c6-9ffb-132593a1770b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:45.211682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f6726-4a39-48c6-9ffb-132593a1770b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:45.217600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029567dc-0afd-48b8-968c-87aff309169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:45.218334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029567dc-0afd-48b8-968c-87aff309169a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:45.218575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029567dc-0afd-48b8-968c-87aff309169a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:45.218853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029567dc-0afd-48b8-968c-87aff309169a admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:45.219553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029567dc-0afd-48b8-968c-87aff309169a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:45.221976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029567dc-0afd-48b8-968c-87aff309169a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:45.365470 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2572/5090] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:45 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:45.366423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029567dc-0afd-48b8-968c-87aff309169a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:45.372419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-029567dc-0afd-48b8-968c-87aff309169a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:45.402672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9d1a5f11-f01e-4b31-a0a4-1be279a640fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e3be7cd3654666b5dbcbfc831adb1b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:45.408007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029567dc-0afd-48b8-968c-87aff309169a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:45.413001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545096b-2540-48aa-9ca6-97b23599505a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:45.413807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545096b-2540-48aa-9ca6-97b23599505a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:45.414188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545096b-2540-48aa-9ca6-97b23599505a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:45.414565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545096b-2540-48aa-9ca6-97b23599505a admin admin] PATH_INFO: `/v3/users/10ff12e8150f4608b1ffe737a6b5d671` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:45.416081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545096b-2540-48aa-9ca6-97b23599505a admin admin] RBAC: Authorizing `identity:delete_user(user_id=10ff12e8150f4608b1ffe737a6b5d671)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:45.418504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545096b-2540-48aa-9ca6-97b23599505a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:45.522262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9d1a5f11-f01e-4b31-a0a4-1be279a640fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e3be7cd3654666b5dbcbfc831adb1b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:45.522979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9d1a5f11-f01e-4b31-a0a4-1be279a640fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e3be7cd3654666b5dbcbfc831adb1b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:45.552197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9d1a5f11-f01e-4b31-a0a4-1be279a640fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e3be7cd3654666b5dbcbfc831adb1b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:45.579248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9d1a5f11-f01e-4b31-a0a4-1be279a640fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e3be7cd3654666b5dbcbfc831adb1b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:45.592222 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2519/5091] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:44 2022] DELETE /identity/v3/users/55e3be7cd3654666b5dbcbfc831adb1b => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:45.592222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a5f11-f01e-4b31-a0a4-1be279a640fc admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:45.596851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9d1a5f11-f01e-4b31-a0a4-1be279a640fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:45.682707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6545096b-2540-48aa-9ca6-97b23599505a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ff12e8150f4608b1ffe737a6b5d671'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:45.683638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6545096b-2540-48aa-9ca6-97b23599505a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ff12e8150f4608b1ffe737a6b5d671'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:45.764498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a5f11-f01e-4b31-a0a4-1be279a640fc admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:45.770331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91aef9-6358-497a-a3b1-61f5ee91a745 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:45.771071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91aef9-6358-497a-a3b1-61f5ee91a745 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:45.771358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91aef9-6358-497a-a3b1-61f5ee91a745 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:45.771634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91aef9-6358-497a-a3b1-61f5ee91a745 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/d20969f5af8f40c290ddc1ea0c5a59a6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:45.773700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91aef9-6358-497a-a3b1-61f5ee91a745 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d20969f5af8f40c290ddc1ea0c5a59a6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:45.776288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91aef9-6358-497a-a3b1-61f5ee91a745 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:45.796760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6545096b-2540-48aa-9ca6-97b23599505a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ff12e8150f4608b1ffe737a6b5d671'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:45.798897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:45.799998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6545096b-2540-48aa-9ca6-97b23599505a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ff12e8150f4608b1ffe737a6b5d671'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:45.818997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6545096b-2540-48aa-9ca6-97b23599505a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ff12e8150f4608b1ffe737a6b5d671'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:45.837041 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2573/5092] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:45 2022] DELETE /identity/v3/users/10ff12e8150f4608b1ffe737a6b5d671 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:45.838642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545096b-2540-48aa-9ca6-97b23599505a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:45.840705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6545096b-2540-48aa-9ca6-97b23599505a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:45.955864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545096b-2540-48aa-9ca6-97b23599505a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:45.967171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec73479-6fb2-41ab-b058-e270ec021853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:45.968108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec73479-6fb2-41ab-b058-e270ec021853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:45.970966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec73479-6fb2-41ab-b058-e270ec021853 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:45.971253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec73479-6fb2-41ab-b058-e270ec021853 admin admin] PATH_INFO: `/v3/users/6b5ab3e42c814226861773763e63f62d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:45.973721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec73479-6fb2-41ab-b058-e270ec021853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b5ab3e42c814226861773763e63f62d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:45.975896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec73479-6fb2-41ab-b058-e270ec021853 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:46.125312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ca91aef9-6358-497a-a3b1-61f5ee91a745 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd20969f5af8f40c290ddc1ea0c5a59a6', 'request_id': 'req-ca91aef9-6358-497a-a3b1-61f5ee91a745'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:46.136910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ca91aef9-6358-497a-a3b1-61f5ee91a745 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd20969f5af8f40c290ddc1ea0c5a59a6', 'request_id': 'req-ca91aef9-6358-497a-a3b1-61f5ee91a745'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:46.148547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ca91aef9-6358-497a-a3b1-61f5ee91a745 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd20969f5af8f40c290ddc1ea0c5a59a6', 'request_id': 'req-ca91aef9-6358-497a-a3b1-61f5ee91a745'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:46.280515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ca91aef9-6358-497a-a3b1-61f5ee91a745 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] The token cache is being invalidate because project d20969f5af8f40c290ddc1ea0c5a59a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:46.281357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ca91aef9-6358-497a-a3b1-61f5ee91a745 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:46.282740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ca91aef9-6358-497a-a3b1-61f5ee91a745 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:46.285539 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2520/5093] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:45 2022] DELETE /identity/v3/projects/d20969f5af8f40c290ddc1ea0c5a59a6 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:46.286752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91aef9-6358-497a-a3b1-61f5ee91a745 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:46.288451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ca91aef9-6358-497a-a3b1-61f5ee91a745 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:46.316253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6ec73479-6fb2-41ab-b058-e270ec021853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b5ab3e42c814226861773763e63f62d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:46.316253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6ec73479-6fb2-41ab-b058-e270ec021853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b5ab3e42c814226861773763e63f62d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:46.432903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91aef9-6358-497a-a3b1-61f5ee91a745 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:46.439048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b6825-82a3-4de9-90c7-a52d3e0eeaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:46.439795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b6825-82a3-4de9-90c7-a52d3e0eeaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:46.440190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b6825-82a3-4de9-90c7-a52d3e0eeaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:46.440578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b6825-82a3-4de9-90c7-a52d3e0eeaf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:46.441362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b6825-82a3-4de9-90c7-a52d3e0eeaf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:46.443136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b6825-82a3-4de9-90c7-a52d3e0eeaf6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:46.444904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6ec73479-6fb2-41ab-b058-e270ec021853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b5ab3e42c814226861773763e63f62d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:46.445918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6ec73479-6fb2-41ab-b058-e270ec021853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b5ab3e42c814226861773763e63f62d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:46.458424 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2521/5094] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:46.458424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f6dd5-a698-424a-b01b-d438c150b416 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:46.458424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f6dd5-a698-424a-b01b-d438c150b416 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:46.458424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f6dd5-a698-424a-b01b-d438c150b416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:46.473580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6ec73479-6fb2-41ab-b058-e270ec021853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b5ab3e42c814226861773763e63f62d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:46.481960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-101f6dd5-a698-424a-b01b-d438c150b416 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:46.483957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-101f6dd5-a698-424a-b01b-d438c150b416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:46.495400 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2522/5095] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:46.495400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f6dd5-a698-424a-b01b-d438c150b416 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:46.502267 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2574/5096] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:45 2022] DELETE /identity/v3/users/6b5ab3e42c814226861773763e63f62d => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:46.504692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-101f6dd5-a698-424a-b01b-d438c150b416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:46.504851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec73479-6fb2-41ab-b058-e270ec021853 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:46.505554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6ec73479-6fb2-41ab-b058-e270ec021853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:46.639531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec73479-6fb2-41ab-b058-e270ec021853 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:46.648488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae70895-94e4-46df-b57e-5f09bf11b2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:46.650030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae70895-94e4-46df-b57e-5f09bf11b2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:46.650551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae70895-94e4-46df-b57e-5f09bf11b2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:46.651108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae70895-94e4-46df-b57e-5f09bf11b2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:46.652288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae70895-94e4-46df-b57e-5f09bf11b2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:46.656060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae70895-94e4-46df-b57e-5f09bf11b2b6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:46.676815 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2575/5097] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:46.677045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f6dd5-a698-424a-b01b-d438c150b416 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:46.678296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae70895-94e4-46df-b57e-5f09bf11b2b6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:46.681839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9ae70895-94e4-46df-b57e-5f09bf11b2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:46.801348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae70895-94e4-46df-b57e-5f09bf11b2b6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:46.805763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957e4db-d1e9-441c-987e-9cf8063fe9a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:46.807253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957e4db-d1e9-441c-987e-9cf8063fe9a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:46.807253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957e4db-d1e9-441c-987e-9cf8063fe9a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:46.807572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957e4db-d1e9-441c-987e-9cf8063fe9a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:46.808647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd547d3a-0258-42da-b685-deffb4987726 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:46.809315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd547d3a-0258-42da-b685-deffb4987726 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:46.809599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd547d3a-0258-42da-b685-deffb4987726 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:46.809923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd547d3a-0258-42da-b685-deffb4987726 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:46.810550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd547d3a-0258-42da-b685-deffb4987726 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:46.812760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd547d3a-0258-42da-b685-deffb4987726 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:46.818032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957e4db-d1e9-441c-987e-9cf8063fe9a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:46.819865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957e4db-d1e9-441c-987e-9cf8063fe9a3 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:46.833703 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2576/5098] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:46.834464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957e4db-d1e9-441c-987e-9cf8063fe9a3 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:46.835844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e957e4db-d1e9-441c-987e-9cf8063fe9a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:46.851637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957e4db-d1e9-441c-987e-9cf8063fe9a3 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:46.858019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b56fe-cb93-4341-b1df-0b198d94976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:46.858660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b56fe-cb93-4341-b1df-0b198d94976d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:46.858928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b56fe-cb93-4341-b1df-0b198d94976d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:46.859192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b56fe-cb93-4341-b1df-0b198d94976d admin admin] PATH_INFO: `/v3/users/1979b5a334de402d82500d4883d44d2f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:46.860367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b56fe-cb93-4341-b1df-0b198d94976d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1979b5a334de402d82500d4883d44d2f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:46.862885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b56fe-cb93-4341-b1df-0b198d94976d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:46.934795 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2523/5099] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:50:46 2022] POST /identity/v3/projects => generated 329 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:46.936129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd547d3a-0258-42da-b685-deffb4987726 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:47.035751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd547d3a-0258-42da-b685-deffb4987726 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:47.043797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b92d7d-a014-4763-8bfc-b16ff922fdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:47.044856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b92d7d-a014-4763-8bfc-b16ff922fdb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:47.046427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b92d7d-a014-4763-8bfc-b16ff922fdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:47.046601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b92d7d-a014-4763-8bfc-b16ff922fdb2 admin admin] PATH_INFO: `/v3/projects/1f4d7832e8944ccfa33d32d50f28fafe/users/8d1b20251abd45fbb0aa0dbca8209f2e/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:47.077759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b92d7d-a014-4763-8bfc-b16ff922fdb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4d7832e8944ccfa33d32d50f28fafe, user_id=8d1b20251abd45fbb0aa0dbca8209f2e, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:47.085374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b92d7d-a014-4763-8bfc-b16ff922fdb2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:47.235208 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2524/5100] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:46 2022] PUT /identity/v3/projects/1f4d7832e8944ccfa33d32d50f28fafe/users/8d1b20251abd45fbb0aa0dbca8209f2e/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:47.236135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b92d7d-a014-4763-8bfc-b16ff922fdb2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:47.241852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-17b92d7d-a014-4763-8bfc-b16ff922fdb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:47.331812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-912b56fe-cb93-4341-b1df-0b198d94976d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1979b5a334de402d82500d4883d44d2f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:47.333333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-912b56fe-cb93-4341-b1df-0b198d94976d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1979b5a334de402d82500d4883d44d2f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:47.347843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:47.398081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b92d7d-a014-4763-8bfc-b16ff922fdb2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:47.411373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ab1fd-8a2c-4cd5-a3f2-1b4256c8992f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:47.412120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ab1fd-8a2c-4cd5-a3f2-1b4256c8992f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:47.412592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ab1fd-8a2c-4cd5-a3f2-1b4256c8992f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:47.412782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ab1fd-8a2c-4cd5-a3f2-1b4256c8992f admin admin] PATH_INFO: `/v3/projects/69d9e47688d94130aafbf3c225513d2f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:47.414281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ab1fd-8a2c-4cd5-a3f2-1b4256c8992f admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d9e47688d94130aafbf3c225513d2f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:47.417595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ab1fd-8a2c-4cd5-a3f2-1b4256c8992f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:47.422002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-912b56fe-cb93-4341-b1df-0b198d94976d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1979b5a334de402d82500d4883d44d2f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:47.422972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-912b56fe-cb93-4341-b1df-0b198d94976d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1979b5a334de402d82500d4883d44d2f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:47.458244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-912b56fe-cb93-4341-b1df-0b198d94976d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1979b5a334de402d82500d4883d44d2f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:47.482515 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2577/5101] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:46 2022] DELETE /identity/v3/users/1979b5a334de402d82500d4883d44d2f => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:47.483756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b56fe-cb93-4341-b1df-0b198d94976d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:47.486079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-912b56fe-cb93-4341-b1df-0b198d94976d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:47.585397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b74ab1fd-8a2c-4cd5-a3f2-1b4256c8992f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d9e47688d94130aafbf3c225513d2f', 'request_id': 'req-b74ab1fd-8a2c-4cd5-a3f2-1b4256c8992f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:47.600031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b74ab1fd-8a2c-4cd5-a3f2-1b4256c8992f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d9e47688d94130aafbf3c225513d2f', 'request_id': 'req-b74ab1fd-8a2c-4cd5-a3f2-1b4256c8992f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:47.609454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b74ab1fd-8a2c-4cd5-a3f2-1b4256c8992f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d9e47688d94130aafbf3c225513d2f', 'request_id': 'req-b74ab1fd-8a2c-4cd5-a3f2-1b4256c8992f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:47.635123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b56fe-cb93-4341-b1df-0b198d94976d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:47.720844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ed7b7-2d98-4be4-a9ea-aea607b6f190 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:47.721884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ed7b7-2d98-4be4-a9ea-aea607b6f190 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:47.722473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ed7b7-2d98-4be4-a9ea-aea607b6f190 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:47.723043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ed7b7-2d98-4be4-a9ea-aea607b6f190 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:47.724283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ed7b7-2d98-4be4-a9ea-aea607b6f190 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:47.728882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ed7b7-2d98-4be4-a9ea-aea607b6f190 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:47.748061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b74ab1fd-8a2c-4cd5-a3f2-1b4256c8992f admin admin] The token cache is being invalidate because project 69d9e47688d94130aafbf3c225513d2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:47.748400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b74ab1fd-8a2c-4cd5-a3f2-1b4256c8992f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:47.749263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b74ab1fd-8a2c-4cd5-a3f2-1b4256c8992f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:47.752247 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2525/5102] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:47 2022] DELETE /identity/v3/projects/69d9e47688d94130aafbf3c225513d2f => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:47.753004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff5990-3fa2-40c1-a979-539d7d504975 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:47.753004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff5990-3fa2-40c1-a979-539d7d504975 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:47.753004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff5990-3fa2-40c1-a979-539d7d504975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:47.793500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2fff5990-3fa2-40c1-a979-539d7d504975 None None] MFA Rules not processed for user `8d1b20251abd45fbb0aa0dbca8209f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:47.795205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2fff5990-3fa2-40c1-a979-539d7d504975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:47.879951 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2578/5103] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:47 2022] POST /identity/v3/users => generated 413 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:47.881058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ed7b7-2d98-4be4-a9ea-aea607b6f190 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:47.882768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-309ed7b7-2d98-4be4-a9ea-aea607b6f190 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:47.888665 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2526/5104] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:47.889568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff5990-3fa2-40c1-a979-539d7d504975 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:47.896274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2fff5990-3fa2-40c1-a979-539d7d504975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:47.980750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ed7b7-2d98-4be4-a9ea-aea607b6f190 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:47.981947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58061d-4833-48ef-9b82-471fd3e57bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:47.982581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58061d-4833-48ef-9b82-471fd3e57bfe service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:47.982861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58061d-4833-48ef-9b82-471fd3e57bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:47.983140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58061d-4833-48ef-9b82-471fd3e57bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:47.985082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dc58061d-4833-48ef-9b82-471fd3e57bfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:48.013749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff5990-3fa2-40c1-a979-539d7d504975 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:48.019094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e2293-6056-4067-9fad-64b3ddf75705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:48.019774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e2293-6056-4067-9fad-64b3ddf75705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:48.020057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e2293-6056-4067-9fad-64b3ddf75705 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:48.020378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e2293-6056-4067-9fad-64b3ddf75705 admin admin] PATH_INFO: `/v3/projects/725a578a14244fec84d2138e48ede87f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:48.021575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e2293-6056-4067-9fad-64b3ddf75705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=725a578a14244fec84d2138e48ede87f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:48.023553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e2293-6056-4067-9fad-64b3ddf75705 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:48.030878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:48.166837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a68e2293-6056-4067-9fad-64b3ddf75705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '725a578a14244fec84d2138e48ede87f', 'request_id': 'req-a68e2293-6056-4067-9fad-64b3ddf75705'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:48.173026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a68e2293-6056-4067-9fad-64b3ddf75705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '725a578a14244fec84d2138e48ede87f', 'request_id': 'req-a68e2293-6056-4067-9fad-64b3ddf75705'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:48.182587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a68e2293-6056-4067-9fad-64b3ddf75705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '725a578a14244fec84d2138e48ede87f', 'request_id': 'req-a68e2293-6056-4067-9fad-64b3ddf75705'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:48.205269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58061d-4833-48ef-9b82-471fd3e57bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:48.209505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58061d-4833-48ef-9b82-471fd3e57bfe service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:48.229274 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2579/5105] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:48.230845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58061d-4833-48ef-9b82-471fd3e57bfe service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:48.232698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dc58061d-4833-48ef-9b82-471fd3e57bfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:48.254874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58061d-4833-48ef-9b82-471fd3e57bfe service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:48.297518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a68e2293-6056-4067-9fad-64b3ddf75705 admin admin] The token cache is being invalidate because project 725a578a14244fec84d2138e48ede87f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:48.298077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a68e2293-6056-4067-9fad-64b3ddf75705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:48.298771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a68e2293-6056-4067-9fad-64b3ddf75705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:48.304222 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2527/5106] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:47 2022] DELETE /identity/v3/projects/725a578a14244fec84d2138e48ede87f => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:48.305630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617f436-a03e-4e1d-b8b0-5a1469a27354 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:48.306269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617f436-a03e-4e1d-b8b0-5a1469a27354 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:48.306785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617f436-a03e-4e1d-b8b0-5a1469a27354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:48.330399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f617f436-a03e-4e1d-b8b0-5a1469a27354 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:48.335808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f617f436-a03e-4e1d-b8b0-5a1469a27354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:48.383385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29c80f-0c66-4496-8b13-afd6a872e76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:48.384584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29c80f-0c66-4496-8b13-afd6a872e76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:48.385231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29c80f-0c66-4496-8b13-afd6a872e76f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:48.386128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29c80f-0c66-4496-8b13-afd6a872e76f admin admin] PATH_INFO: `/v3/projects/f0149f47762a47bcb51db10ffebdde95` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:48.387966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29c80f-0c66-4496-8b13-afd6a872e76f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0149f47762a47bcb51db10ffebdde95)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:48.391393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29c80f-0c66-4496-8b13-afd6a872e76f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:48.420121 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2528/5107] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:48.421239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617f436-a03e-4e1d-b8b0-5a1469a27354 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:48.422676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f617f436-a03e-4e1d-b8b0-5a1469a27354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:48.438560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617f436-a03e-4e1d-b8b0-5a1469a27354 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:48.447258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186725be-5e65-4642-94a1-740dc933a84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:48.447258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186725be-5e65-4642-94a1-740dc933a84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:48.447533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186725be-5e65-4642-94a1-740dc933a84d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:48.447806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186725be-5e65-4642-94a1-740dc933a84d admin admin] PATH_INFO: `/v3/projects/9d422ed789ea422a82d765d07166bdac` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:48.449019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186725be-5e65-4642-94a1-740dc933a84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d422ed789ea422a82d765d07166bdac)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:48.451667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186725be-5e65-4642-94a1-740dc933a84d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:48.554277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1a29c80f-0c66-4496-8b13-afd6a872e76f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0149f47762a47bcb51db10ffebdde95', 'request_id': 'req-1a29c80f-0c66-4496-8b13-afd6a872e76f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:48.563289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1a29c80f-0c66-4496-8b13-afd6a872e76f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0149f47762a47bcb51db10ffebdde95', 'request_id': 'req-1a29c80f-0c66-4496-8b13-afd6a872e76f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:48.620401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-186725be-5e65-4642-94a1-740dc933a84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d422ed789ea422a82d765d07166bdac', 'request_id': 'req-186725be-5e65-4642-94a1-740dc933a84d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:48.628255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-186725be-5e65-4642-94a1-740dc933a84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d422ed789ea422a82d765d07166bdac', 'request_id': 'req-186725be-5e65-4642-94a1-740dc933a84d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:48.636415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-186725be-5e65-4642-94a1-740dc933a84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d422ed789ea422a82d765d07166bdac', 'request_id': 'req-186725be-5e65-4642-94a1-740dc933a84d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:48.676524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1a29c80f-0c66-4496-8b13-afd6a872e76f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0149f47762a47bcb51db10ffebdde95', 'request_id': 'req-1a29c80f-0c66-4496-8b13-afd6a872e76f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:48.689634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1a29c80f-0c66-4496-8b13-afd6a872e76f admin admin] The token cache is being invalidate because project f0149f47762a47bcb51db10ffebdde95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:48.689929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1a29c80f-0c66-4496-8b13-afd6a872e76f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:48.690717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1a29c80f-0c66-4496-8b13-afd6a872e76f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:48.692243 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2580/5108] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:48 2022] DELETE /identity/v3/projects/f0149f47762a47bcb51db10ffebdde95 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:48.692983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29c80f-0c66-4496-8b13-afd6a872e76f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:48.694305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1a29c80f-0c66-4496-8b13-afd6a872e76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:48.761351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29c80f-0c66-4496-8b13-afd6a872e76f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:48.830593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5291a8-caef-4ad2-b82d-102061c26c94 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:48.832866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5291a8-caef-4ad2-b82d-102061c26c94 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:48.846553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5291a8-caef-4ad2-b82d-102061c26c94 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:48.846553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5291a8-caef-4ad2-b82d-102061c26c94 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:48.846553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5291a8-caef-4ad2-b82d-102061c26c94 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:48.846553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5291a8-caef-4ad2-b82d-102061c26c94 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:48.847199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-186725be-5e65-4642-94a1-740dc933a84d admin admin] The token cache is being invalidate because project 9d422ed789ea422a82d765d07166bdac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:48.847199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-186725be-5e65-4642-94a1-740dc933a84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:48.847199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-186725be-5e65-4642-94a1-740dc933a84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:48.847199 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2529/5109] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:48 2022] DELETE /identity/v3/projects/9d422ed789ea422a82d765d07166bdac => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:48.847199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa715cc4-b538-4f28-adef-7b7a34a69215 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:48.847991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa715cc4-b538-4f28-adef-7b7a34a69215 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:48.847991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa715cc4-b538-4f28-adef-7b7a34a69215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:48.872780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-fa715cc4-b538-4f28-adef-7b7a34a69215 None None] MFA Rules not processed for user `8d1b20251abd45fbb0aa0dbca8209f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:48.874024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fa715cc4-b538-4f28-adef-7b7a34a69215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:48.998436 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2581/5110] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:50:48 2022] POST /identity/v3/roles => generated 244 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:48.998436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8add61b-0bc6-492e-b09d-6d658a557328 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:48.998436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8add61b-0bc6-492e-b09d-6d658a557328 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:48.998436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8add61b-0bc6-492e-b09d-6d658a557328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:49.039117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d8add61b-0bc6-492e-b09d-6d658a557328 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:49.041080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d8add61b-0bc6-492e-b09d-6d658a557328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:49.094991 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2530/5111] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:49.096662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b5cfb-5960-46cf-8848-86e6ff8ebd9c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:49.096982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b5cfb-5960-46cf-8848-86e6ff8ebd9c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:49.097258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b5cfb-5960-46cf-8848-86e6ff8ebd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:49.125715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-560b5cfb-5960-46cf-8848-86e6ff8ebd9c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:49.127167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-560b5cfb-5960-46cf-8848-86e6ff8ebd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:49.170407 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2582/5112] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:49.170407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8add61b-0bc6-492e-b09d-6d658a557328 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:49.172099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d8add61b-0bc6-492e-b09d-6d658a557328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:49.186635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8add61b-0bc6-492e-b09d-6d658a557328 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:49.192584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074e8a2-ad5c-45a3-9d57-bbccc6d99459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:49.197195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074e8a2-ad5c-45a3-9d57-bbccc6d99459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:49.197195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074e8a2-ad5c-45a3-9d57-bbccc6d99459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:49.197195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074e8a2-ad5c-45a3-9d57-bbccc6d99459 admin admin] PATH_INFO: `/v3/users/3857e931f44a44dbadcb0d0789817e56` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:49.197195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074e8a2-ad5c-45a3-9d57-bbccc6d99459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3857e931f44a44dbadcb0d0789817e56)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:49.197927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074e8a2-ad5c-45a3-9d57-bbccc6d99459 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:49.205060 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2531/5113] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:49.206272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79758ab3-8c3b-46c4-babd-94921fc82812 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:49.206999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79758ab3-8c3b-46c4-babd-94921fc82812 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:49.207199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79758ab3-8c3b-46c4-babd-94921fc82812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:49.247037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-79758ab3-8c3b-46c4-babd-94921fc82812 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:49.248432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-79758ab3-8c3b-46c4-babd-94921fc82812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:49.257354 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2532/5114] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:49.258392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79758ab3-8c3b-46c4-babd-94921fc82812 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:49.267071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-79758ab3-8c3b-46c4-babd-94921fc82812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:49.279350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79758ab3-8c3b-46c4-babd-94921fc82812 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:49.283994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c7439-28ff-4478-aec5-996c4fa43dfb tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:49.284706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c7439-28ff-4478-aec5-996c4fa43dfb tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:49.284988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c7439-28ff-4478-aec5-996c4fa43dfb tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:49.285280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c7439-28ff-4478-aec5-996c4fa43dfb tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:49.285931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c7439-28ff-4478-aec5-996c4fa43dfb tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:49.287572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c7439-28ff-4478-aec5-996c4fa43dfb tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:49.377977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:49.383561 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2533/5115] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:50:49 2022] POST /identity/v3/roles => generated 247 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:49.384855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c7439-28ff-4478-aec5-996c4fa43dfb tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:49.386907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e16c7439-28ff-4478-aec5-996c4fa43dfb tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:49.467869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c074e8a2-ad5c-45a3-9d57-bbccc6d99459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3857e931f44a44dbadcb0d0789817e56'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:49.468907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c074e8a2-ad5c-45a3-9d57-bbccc6d99459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3857e931f44a44dbadcb0d0789817e56'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:49.496549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c7439-28ff-4478-aec5-996c4fa43dfb tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:49.502696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a63ad-8e4d-4fc9-aa39-dd1e645cb524 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:49.503935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a63ad-8e4d-4fc9-aa39-dd1e645cb524 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:49.503935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a63ad-8e4d-4fc9-aa39-dd1e645cb524 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:49.504182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a63ad-8e4d-4fc9-aa39-dd1e645cb524 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:49.506025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-389a63ad-8e4d-4fc9-aa39-dd1e645cb524 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:49.517781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a63ad-8e4d-4fc9-aa39-dd1e645cb524 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:49.519391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a63ad-8e4d-4fc9-aa39-dd1e645cb524 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:49.531820 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2534/5116] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:49.533868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55d422-1c49-4059-b9ad-cb95445cd0c5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:49.540422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55d422-1c49-4059-b9ad-cb95445cd0c5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:49.540422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55d422-1c49-4059-b9ad-cb95445cd0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:49.558342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6f55d422-1c49-4059-b9ad-cb95445cd0c5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:49.559758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6f55d422-1c49-4059-b9ad-cb95445cd0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:49.570202 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2535/5117] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:49.571146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55d422-1c49-4059-b9ad-cb95445cd0c5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:49.577829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c074e8a2-ad5c-45a3-9d57-bbccc6d99459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3857e931f44a44dbadcb0d0789817e56'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:49.578732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c074e8a2-ad5c-45a3-9d57-bbccc6d99459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3857e931f44a44dbadcb0d0789817e56'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:49.584060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55d422-1c49-4059-b9ad-cb95445cd0c5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:49.590941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e16069-3269-4e0e-8431-30b2880733b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:49.591819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e16069-3269-4e0e-8431-30b2880733b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:49.592358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e16069-3269-4e0e-8431-30b2880733b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:49.592851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e16069-3269-4e0e-8431-30b2880733b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:49.593419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c074e8a2-ad5c-45a3-9d57-bbccc6d99459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3857e931f44a44dbadcb0d0789817e56'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:49.594016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e16069-3269-4e0e-8431-30b2880733b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:49.594542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e16069-3269-4e0e-8431-30b2880733b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:49.596475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e16069-3269-4e0e-8431-30b2880733b8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:49.618101 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2536/5118] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:49.618101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52ae46-b944-42ce-b656-c4c4a726b5a5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:49.618101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52ae46-b944-42ce-b656-c4c4a726b5a5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:49.618101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52ae46-b944-42ce-b656-c4c4a726b5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:49.630279 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2583/5119] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:49 2022] DELETE /identity/v3/users/3857e931f44a44dbadcb0d0789817e56 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:49.630279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074e8a2-ad5c-45a3-9d57-bbccc6d99459 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:49.637819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c074e8a2-ad5c-45a3-9d57-bbccc6d99459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:49.666994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6e52ae46-b944-42ce-b656-c4c4a726b5a5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:49.668932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6e52ae46-b944-42ce-b656-c4c4a726b5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:49.725878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:49.731059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074e8a2-ad5c-45a3-9d57-bbccc6d99459 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:49.738377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff9635-c486-434c-9b5e-085945c64c1f tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:49.739221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff9635-c486-434c-9b5e-085945c64c1f tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:49.739795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff9635-c486-434c-9b5e-085945c64c1f tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:49.740188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff9635-c486-434c-9b5e-085945c64c1f tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/7657317c3d044a95b12b69be14e78f7d/users/a75b020bacec4483aa99f7096f7d3c02/roles/a9e7e4653e5b4edeb5f802d89eca16e7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:49.769591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff9635-c486-434c-9b5e-085945c64c1f tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7657317c3d044a95b12b69be14e78f7d, user_id=a75b020bacec4483aa99f7096f7d3c02, role_id=a9e7e4653e5b4edeb5f802d89eca16e7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:49.776938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff9635-c486-434c-9b5e-085945c64c1f tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:49.809636 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2537/5120] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:49.810520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52ae46-b944-42ce-b656-c4c4a726b5a5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:49.812016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6e52ae46-b944-42ce-b656-c4c4a726b5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:49.826566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52ae46-b944-42ce-b656-c4c4a726b5a5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:49.831755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7d893-c6c6-422b-baaf-86e013f83b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:49.832533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7d893-c6c6-422b-baaf-86e013f83b76 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:49.832877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7d893-c6c6-422b-baaf-86e013f83b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:49.833370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7d893-c6c6-422b-baaf-86e013f83b76 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:49.834365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7d893-c6c6-422b-baaf-86e013f83b76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:49.834678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7d893-c6c6-422b-baaf-86e013f83b76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:49.836357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7d893-c6c6-422b-baaf-86e013f83b76 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:49.852250 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2538/5121] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:49.852250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7d893-c6c6-422b-baaf-86e013f83b76 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:49.862075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c2c7d893-c6c6-422b-baaf-86e013f83b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:49.879191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7d893-c6c6-422b-baaf-86e013f83b76 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:49.885996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed300c6c-bb11-4908-8e6f-38602d8c3863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:49.886471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed300c6c-bb11-4908-8e6f-38602d8c3863 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:49.886832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed300c6c-bb11-4908-8e6f-38602d8c3863 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:49.887176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed300c6c-bb11-4908-8e6f-38602d8c3863 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:49.887932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed300c6c-bb11-4908-8e6f-38602d8c3863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:49.890116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed300c6c-bb11-4908-8e6f-38602d8c3863 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:49.902092 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2584/5122] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:49 2022] PUT /identity/v3/projects/7657317c3d044a95b12b69be14e78f7d/users/a75b020bacec4483aa99f7096f7d3c02/roles/a9e7e4653e5b4edeb5f802d89eca16e7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:49.903308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff9635-c486-434c-9b5e-085945c64c1f tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:50.068510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff9635-c486-434c-9b5e-085945c64c1f tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:50.075856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdb5f5-ac7b-4e3c-892b-07542a9f057a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:50.076668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdb5f5-ac7b-4e3c-892b-07542a9f057a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:50.077188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdb5f5-ac7b-4e3c-892b-07542a9f057a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:50.077681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdb5f5-ac7b-4e3c-892b-07542a9f057a admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:50.078749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdb5f5-ac7b-4e3c-892b-07542a9f057a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:50.079196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdb5f5-ac7b-4e3c-892b-07542a9f057a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:50.083205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdb5f5-ac7b-4e3c-892b-07542a9f057a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:50.084633 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2539/5123] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:49 2022] POST /identity/v3/projects => generated 383 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:50.085674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed300c6c-bb11-4908-8e6f-38602d8c3863 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:50.131424 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2585/5124] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:50.132647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdb5f5-ac7b-4e3c-892b-07542a9f057a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:50.169495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed300c6c-bb11-4908-8e6f-38602d8c3863 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:50.175850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ab1fc-358a-40d6-8d9a-bdbd442d3653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:50.176864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ab1fc-358a-40d6-8d9a-bdbd442d3653 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:50.177303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ab1fc-358a-40d6-8d9a-bdbd442d3653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:50.177735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ab1fc-358a-40d6-8d9a-bdbd442d3653 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:50.178598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ab1fc-358a-40d6-8d9a-bdbd442d3653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:50.181665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ab1fc-358a-40d6-8d9a-bdbd442d3653 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:50.204734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:50.257225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdb5f5-ac7b-4e3c-892b-07542a9f057a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:50.319667 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2540/5125] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:50 2022] POST /identity/v3/projects => generated 393 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:50.321125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ab1fc-358a-40d6-8d9a-bdbd442d3653 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:50.323222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-239ab1fc-358a-40d6-8d9a-bdbd442d3653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:50.357289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49081993-5567-42be-a9d8-2bf904ac7e4a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:50.358185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49081993-5567-42be-a9d8-2bf904ac7e4a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:50.358565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49081993-5567-42be-a9d8-2bf904ac7e4a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:50.358961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49081993-5567-42be-a9d8-2bf904ac7e4a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/7657317c3d044a95b12b69be14e78f7d/users/a75b020bacec4483aa99f7096f7d3c02/roles/5e416c9c8c684852877434dbf58894f0` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:50.362248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49081993-5567-42be-a9d8-2bf904ac7e4a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7657317c3d044a95b12b69be14e78f7d, user_id=a75b020bacec4483aa99f7096f7d3c02, role_id=5e416c9c8c684852877434dbf58894f0)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:50.366446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49081993-5567-42be-a9d8-2bf904ac7e4a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:50.442672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ab1fc-358a-40d6-8d9a-bdbd442d3653 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:50.450887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1dcd4-8c45-4399-b290-f4de35d6e0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:50.451986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1dcd4-8c45-4399-b290-f4de35d6e0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:50.452525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1dcd4-8c45-4399-b290-f4de35d6e0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:50.453025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1dcd4-8c45-4399-b290-f4de35d6e0d5 admin admin] PATH_INFO: `/v3/users/62939df053d4493fb541707b376584a4` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:50.455150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1dcd4-8c45-4399-b290-f4de35d6e0d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62939df053d4493fb541707b376584a4)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:50.459025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1dcd4-8c45-4399-b290-f4de35d6e0d5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:50.473689 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2586/5126] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:50 2022] PUT /identity/v3/projects/7657317c3d044a95b12b69be14e78f7d/users/a75b020bacec4483aa99f7096f7d3c02/roles/5e416c9c8c684852877434dbf58894f0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:50.479518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018dbf8-2aa8-4526-a4a9-4d4395b9d9e3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:50.479518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018dbf8-2aa8-4526-a4a9-4d4395b9d9e3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:50.479518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018dbf8-2aa8-4526-a4a9-4d4395b9d9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:50.509052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4018dbf8-2aa8-4526-a4a9-4d4395b9d9e3 None None] MFA Rules not processed for user `8d1b20251abd45fbb0aa0dbca8209f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:50.509052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4018dbf8-2aa8-4526-a4a9-4d4395b9d9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:50.567727 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2587/5127] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:50.569139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018dbf8-2aa8-4526-a4a9-4d4395b9d9e3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:50.648784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018dbf8-2aa8-4526-a4a9-4d4395b9d9e3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:50.657584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0e320-7314-4c75-b19b-7ba1bfb459c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:50.658222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0e320-7314-4c75-b19b-7ba1bfb459c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:50.658695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0e320-7314-4c75-b19b-7ba1bfb459c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:50.658794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0e320-7314-4c75-b19b-7ba1bfb459c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:50.659573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0e320-7314-4c75-b19b-7ba1bfb459c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:50.661615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0e320-7314-4c75-b19b-7ba1bfb459c7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:50.667585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c8a1dcd4-8c45-4399-b290-f4de35d6e0d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62939df053d4493fb541707b376584a4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:50.744719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c8a1dcd4-8c45-4399-b290-f4de35d6e0d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62939df053d4493fb541707b376584a4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:50.745478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c8a1dcd4-8c45-4399-b290-f4de35d6e0d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62939df053d4493fb541707b376584a4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:50.755303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c8a1dcd4-8c45-4399-b290-f4de35d6e0d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62939df053d4493fb541707b376584a4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:50.768977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c8a1dcd4-8c45-4399-b290-f4de35d6e0d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62939df053d4493fb541707b376584a4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:50.776691 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2541/5128] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:50 2022] DELETE /identity/v3/users/62939df053d4493fb541707b376584a4 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:50.777598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1dcd4-8c45-4399-b290-f4de35d6e0d5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:50.779115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c8a1dcd4-8c45-4399-b290-f4de35d6e0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:50.784717 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2588/5129] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:50 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:50.784717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0e320-7314-4c75-b19b-7ba1bfb459c7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:50.784717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-71d0e320-7314-4c75-b19b-7ba1bfb459c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:50.796801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0e320-7314-4c75-b19b-7ba1bfb459c7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:50.858761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aee8fb-fdef-42f0-8c29-b0afd47a140b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:50.859324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aee8fb-fdef-42f0-8c29-b0afd47a140b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:50.859607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aee8fb-fdef-42f0-8c29-b0afd47a140b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:50.859884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aee8fb-fdef-42f0-8c29-b0afd47a140b admin admin] PATH_INFO: `/v3/projects/9c04c6bdae564cda9d7860f8f7cb4ef6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:50.860694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1dcd4-8c45-4399-b290-f4de35d6e0d5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:50.861075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aee8fb-fdef-42f0-8c29-b0afd47a140b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c04c6bdae564cda9d7860f8f7cb4ef6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:50.863026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aee8fb-fdef-42f0-8c29-b0afd47a140b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:50.865889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92b44f-ec04-49b4-ba18-5c07b2c54672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:50.866519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92b44f-ec04-49b4-ba18-5c07b2c54672 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:50.866794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92b44f-ec04-49b4-ba18-5c07b2c54672 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:50.867058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92b44f-ec04-49b4-ba18-5c07b2c54672 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:50.867746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92b44f-ec04-49b4-ba18-5c07b2c54672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:50.869869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92b44f-ec04-49b4-ba18-5c07b2c54672 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:51.043566 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2542/5130] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:50 2022] POST /identity/v3/projects => generated 371 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:51.047425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-75aee8fb-fdef-42f0-8c29-b0afd47a140b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'request_id': 'req-75aee8fb-fdef-42f0-8c29-b0afd47a140b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:51.048224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92b44f-ec04-49b4-ba18-5c07b2c54672 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:51.056669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1c92b44f-ec04-49b4-ba18-5c07b2c54672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:51.063017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-75aee8fb-fdef-42f0-8c29-b0afd47a140b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'request_id': 'req-75aee8fb-fdef-42f0-8c29-b0afd47a140b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:51.173390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-75aee8fb-fdef-42f0-8c29-b0afd47a140b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c04c6bdae564cda9d7860f8f7cb4ef6', 'request_id': 'req-75aee8fb-fdef-42f0-8c29-b0afd47a140b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:51.196550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92b44f-ec04-49b4-ba18-5c07b2c54672 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:51.199216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-75aee8fb-fdef-42f0-8c29-b0afd47a140b admin admin] The token cache is being invalidate because project 9c04c6bdae564cda9d7860f8f7cb4ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:51.199521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-75aee8fb-fdef-42f0-8c29-b0afd47a140b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:51.200267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-75aee8fb-fdef-42f0-8c29-b0afd47a140b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:51.207519 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2589/5131] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:50 2022] DELETE /identity/v3/projects/9c04c6bdae564cda9d7860f8f7cb4ef6 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:51.208916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aee8fb-fdef-42f0-8c29-b0afd47a140b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:51.210428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-75aee8fb-fdef-42f0-8c29-b0afd47a140b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:51.217185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd3f8c-87bc-432c-81ea-45345c6c8a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:51.218259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd3f8c-87bc-432c-81ea-45345c6c8a88 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:51.218701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd3f8c-87bc-432c-81ea-45345c6c8a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:51.218983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd3f8c-87bc-432c-81ea-45345c6c8a88 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:51.220672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd3f8c-87bc-432c-81ea-45345c6c8a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:51.232394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd3f8c-87bc-432c-81ea-45345c6c8a88 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:51.304344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aee8fb-fdef-42f0-8c29-b0afd47a140b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:51.374202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d137c-1691-4a4b-b5dd-fb8a178a5eb8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:51.374832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d137c-1691-4a4b-b5dd-fb8a178a5eb8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:51.375269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d137c-1691-4a4b-b5dd-fb8a178a5eb8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:51.375537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d137c-1691-4a4b-b5dd-fb8a178a5eb8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:51.376229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d137c-1691-4a4b-b5dd-fb8a178a5eb8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:51.378314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d137c-1691-4a4b-b5dd-fb8a178a5eb8 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:51.408282 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2590/5132] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:51 2022] GET /identity/v3/users => generated 7202 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:51.410081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41704913-e759-4810-b8bf-033ce192a67a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:51.410081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41704913-e759-4810-b8bf-033ce192a67a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:51.410353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41704913-e759-4810-b8bf-033ce192a67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:51.421750 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2543/5133] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:51 2022] POST /identity/v3/users => generated 297 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:51.422704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd3f8c-87bc-432c-81ea-45345c6c8a88 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:51.427531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-17bd3f8c-87bc-432c-81ea-45345c6c8a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:51.434261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-41704913-e759-4810-b8bf-033ce192a67a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:51.435493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-41704913-e759-4810-b8bf-033ce192a67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:51.441926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd3f8c-87bc-432c-81ea-45345c6c8a88 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:51.444940 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2591/5134] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:51.445662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41704913-e759-4810-b8bf-033ce192a67a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:51.447391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-41704913-e759-4810-b8bf-033ce192a67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:51.447694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52666175-3e2a-4def-9a30-1dc5771bc370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:51.452588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666175-3e2a-4def-9a30-1dc5771bc370 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:51.452939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666175-3e2a-4def-9a30-1dc5771bc370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:51.453229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666175-3e2a-4def-9a30-1dc5771bc370 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:51.454176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52666175-3e2a-4def-9a30-1dc5771bc370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:51.457100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52666175-3e2a-4def-9a30-1dc5771bc370 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:51.471868 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2544/5135] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:51 2022] GET /identity/v3/roles => generated 1893 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:51.473396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed190f2e-5ab8-43a4-8fb1-d55257537edf None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:51.473745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed190f2e-5ab8-43a4-8fb1-d55257537edf None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:51.474079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed190f2e-5ab8-43a4-8fb1-d55257537edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:51.475689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41704913-e759-4810-b8bf-033ce192a67a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:51.482592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab0dba-46b5-478a-9251-50960980f32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:51.483874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab0dba-46b5-478a-9251-50960980f32a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:51.485507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab0dba-46b5-478a-9251-50960980f32a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:51.485802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab0dba-46b5-478a-9251-50960980f32a admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:51.486463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab0dba-46b5-478a-9251-50960980f32a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:51.488854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab0dba-46b5-478a-9251-50960980f32a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:51.497237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ed190f2e-5ab8-43a4-8fb1-d55257537edf None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:51.498481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ed190f2e-5ab8-43a4-8fb1-d55257537edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:51.507207 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2545/5136] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:51.508731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808981d1-afbe-4f17-845d-5675258a9d60 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:51.510011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808981d1-afbe-4f17-845d-5675258a9d60 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:51.510974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808981d1-afbe-4f17-845d-5675258a9d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:51.568430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-808981d1-afbe-4f17-845d-5675258a9d60 None None] MFA Rules not processed for user `a75b020bacec4483aa99f7096f7d3c02`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:51.570503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-808981d1-afbe-4f17-845d-5675258a9d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:51.677673 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2592/5137] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:51 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:51.677673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab0dba-46b5-478a-9251-50960980f32a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:51.678828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f5ab0dba-46b5-478a-9251-50960980f32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:51.697340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab0dba-46b5-478a-9251-50960980f32a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:51.705109 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2546/5138] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:51 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:51.706271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808981d1-afbe-4f17-845d-5675258a9d60 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:51.709324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-808981d1-afbe-4f17-845d-5675258a9d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:51.720771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:51.723119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c4ae0-e7b1-42b0-ba22-8c462fb82520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:51.723886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c4ae0-e7b1-42b0-ba22-8c462fb82520 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:51.724209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c4ae0-e7b1-42b0-ba22-8c462fb82520 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:51.727437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c4ae0-e7b1-42b0-ba22-8c462fb82520 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:51.727437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c4ae0-e7b1-42b0-ba22-8c462fb82520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:51.729250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c4ae0-e7b1-42b0-ba22-8c462fb82520 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:51.756201 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2593/5139] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:51 2022] GET /identity/v3/roles => generated 1893 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:51.756910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c4ae0-e7b1-42b0-ba22-8c462fb82520 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:51.769195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c4ae0-e7b1-42b0-ba22-8c462fb82520 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:51.777323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee65088-cfc1-428c-87bf-caeb82388dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:51.778039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee65088-cfc1-428c-87bf-caeb82388dcf admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:51.778310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee65088-cfc1-428c-87bf-caeb82388dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:51.778743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee65088-cfc1-428c-87bf-caeb82388dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:51.779539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee65088-cfc1-428c-87bf-caeb82388dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:51.781403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee65088-cfc1-428c-87bf-caeb82388dcf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:51.787734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808981d1-afbe-4f17-845d-5675258a9d60 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:51.793134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb991f89-b055-4ead-ae7a-0faa4685f97a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:51.793790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb991f89-b055-4ead-ae7a-0faa4685f97a service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:51.794074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb991f89-b055-4ead-ae7a-0faa4685f97a service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:51.794349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb991f89-b055-4ead-ae7a-0faa4685f97a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:51.795011 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2594/5140] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:51 2022] GET /identity/v3/roles => generated 1893 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:51.796678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce38bf7-a467-4c98-92e7-e4e19b3fb64c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:51.797099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce38bf7-a467-4c98-92e7-e4e19b3fb64c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:51.797392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce38bf7-a467-4c98-92e7-e4e19b3fb64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:51.808883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb991f89-b055-4ead-ae7a-0faa4685f97a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:51.810364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb991f89-b055-4ead-ae7a-0faa4685f97a service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:51.820073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-dce38bf7-a467-4c98-92e7-e4e19b3fb64c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:51.822326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dce38bf7-a467-4c98-92e7-e4e19b3fb64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:51.824304 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2547/5141] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:51.825216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb991f89-b055-4ead-ae7a-0faa4685f97a service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:51.836472 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2595/5142] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:51.838704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7c822-30c9-4354-9875-8fde9cd236a8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:51.839195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7c822-30c9-4354-9875-8fde9cd236a8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:51.839707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7c822-30c9-4354-9875-8fde9cd236a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:51.867210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb991f89-b055-4ead-ae7a-0faa4685f97a service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:51.867210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024090f-9534-4c97-af5e-45135c027a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:51.867210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024090f-9534-4c97-af5e-45135c027a6a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:51.867210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024090f-9534-4c97-af5e-45135c027a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:51.869140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024090f-9534-4c97-af5e-45135c027a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:51.870316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024090f-9534-4c97-af5e-45135c027a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:51.872393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024090f-9534-4c97-af5e-45135c027a6a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:51.880368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1ba7c822-30c9-4354-9875-8fde9cd236a8 None None] MFA Rules not processed for user `a75b020bacec4483aa99f7096f7d3c02`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:51.884512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1ba7c822-30c9-4354-9875-8fde9cd236a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:51.888601 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2548/5143] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:51 2022] GET /identity/v3/roles => generated 1893 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:51.891584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024090f-9534-4c97-af5e-45135c027a6a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:51.909175 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2596/5144] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:51 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:51.910129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7c822-30c9-4354-9875-8fde9cd236a8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:51.935824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7c822-30c9-4354-9875-8fde9cd236a8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:51.949409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024090f-9534-4c97-af5e-45135c027a6a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:51.952753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bd19e-ceda-4195-b2c4-5f3aa800052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:51.953450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bd19e-ceda-4195-b2c4-5f3aa800052e admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:51.953718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bd19e-ceda-4195-b2c4-5f3aa800052e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:51.953994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bd19e-ceda-4195-b2c4-5f3aa800052e admin admin] PATH_INFO: `/v3/projects/f1044294cc6343e48ffa3de8f6cd6c50/users/b0c9bfbd5ba24d30b9d70b8e28ec6b09/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:51.967886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50b6f1-2271-4092-9fc6-ad21237e9aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:51.968854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50b6f1-2271-4092-9fc6-ad21237e9aed admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:51.970434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50b6f1-2271-4092-9fc6-ad21237e9aed admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:51.970754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50b6f1-2271-4092-9fc6-ad21237e9aed admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:51.971606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50b6f1-2271-4092-9fc6-ad21237e9aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:51.974234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50b6f1-2271-4092-9fc6-ad21237e9aed admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:52.003624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bd19e-ceda-4195-b2c4-5f3aa800052e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1044294cc6343e48ffa3de8f6cd6c50, user_id=b0c9bfbd5ba24d30b9d70b8e28ec6b09, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:52.009898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bd19e-ceda-4195-b2c4-5f3aa800052e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:52.010075 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2549/5145] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:51 2022] GET /identity/v3/roles => generated 1893 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:52.011222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50b6f1-2271-4092-9fc6-ad21237e9aed admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:52.031915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50b6f1-2271-4092-9fc6-ad21237e9aed admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:52.046495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416d032-f2a2-4c4a-aa48-b582d2266f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:52.051527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416d032-f2a2-4c4a-aa48-b582d2266f21 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:52.051527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416d032-f2a2-4c4a-aa48-b582d2266f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:52.051527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416d032-f2a2-4c4a-aa48-b582d2266f21 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:52.051527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416d032-f2a2-4c4a-aa48-b582d2266f21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:52.051527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416d032-f2a2-4c4a-aa48-b582d2266f21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:52.051527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416d032-f2a2-4c4a-aa48-b582d2266f21 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:52.080154 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2550/5146] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:52.081216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416d032-f2a2-4c4a-aa48-b582d2266f21 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:52.100223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416d032-f2a2-4c4a-aa48-b582d2266f21 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:52.106575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3b02d-4c50-4809-bbbd-0d7258545621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:52.107296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3b02d-4c50-4809-bbbd-0d7258545621 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:52.107639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3b02d-4c50-4809-bbbd-0d7258545621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:52.107979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3b02d-4c50-4809-bbbd-0d7258545621 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:52.109798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3b02d-4c50-4809-bbbd-0d7258545621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:52.112072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3b02d-4c50-4809-bbbd-0d7258545621 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:52.126665 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2551/5147] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:52 2022] GET /identity/v3/roles => generated 1893 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:52.131838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3b02d-4c50-4809-bbbd-0d7258545621 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:52.142127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3b02d-4c50-4809-bbbd-0d7258545621 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:52.146774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fc798-37a4-47bc-9e48-ab4957ec6606 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75b020bacec4483aa99f7096f7d3c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7657317c3d044a95b12b69be14e78f7d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1457757561', 'tempest-DelegatedRole-1792040891'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:52.147392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fc798-37a4-47bc-9e48-ab4957ec6606 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:52.147668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fc798-37a4-47bc-9e48-ab4957ec6606 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:52.147937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fc798-37a4-47bc-9e48-ab4957ec6606 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:52.148716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fc798-37a4-47bc-9e48-ab4957ec6606 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] RBAC: Authorizing `identity:create_trust()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:52.150408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fc798-37a4-47bc-9e48-ab4957ec6606 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:52.222971 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2597/5148] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:51 2022] PUT /identity/v3/projects/f1044294cc6343e48ffa3de8f6cd6c50/users/b0c9bfbd5ba24d30b9d70b8e28ec6b09/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:52.224139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bd19e-ceda-4195-b2c4-5f3aa800052e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:52.372011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bd19e-ceda-4195-b2c4-5f3aa800052e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:52.378493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ab8a0-5a68-422d-8564-fef6722a7f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:52.379246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ab8a0-5a68-422d-8564-fef6722a7f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:52.379565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ab8a0-5a68-422d-8564-fef6722a7f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:52.379857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ab8a0-5a68-422d-8564-fef6722a7f4c admin admin] PATH_INFO: `/v3/projects/2654d38f2ffc4e7ca353480bd695d219/users/b55b99deebc74d6d933dfcb95c2e99d0/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:52.414065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ab8a0-5a68-422d-8564-fef6722a7f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2654d38f2ffc4e7ca353480bd695d219, user_id=b55b99deebc74d6d933dfcb95c2e99d0, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:52.420363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ab8a0-5a68-422d-8564-fef6722a7f4c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:52.435938 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2552/5149] 10.222.0.76 () {60 vars in 1174 bytes} [Sat Aug 27 04:50:52 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:52.437498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fc798-37a4-47bc-9e48-ab4957ec6606 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:52.472341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fc798-37a4-47bc-9e48-ab4957ec6606 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:52.482412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca05549-5f44-4bca-a871-abd3c3996320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:52.483588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca05549-5f44-4bca-a871-abd3c3996320 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:52.484328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca05549-5f44-4bca-a871-abd3c3996320 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:52.484701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca05549-5f44-4bca-a871-abd3c3996320 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:52.486343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca05549-5f44-4bca-a871-abd3c3996320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:52.490939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca05549-5f44-4bca-a871-abd3c3996320 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:52.548746 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2598/5150] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:52 2022] PUT /identity/v3/projects/2654d38f2ffc4e7ca353480bd695d219/users/b55b99deebc74d6d933dfcb95c2e99d0/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:52.550416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ab8a0-5a68-422d-8564-fef6722a7f4c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:52.639782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:52.657583 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2553/5151] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:52 2022] POST /identity/v3/projects => generated 375 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:52.659843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16fa62-e019-4112-9cd7-23ad3d4ac18e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:52.660350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16fa62-e019-4112-9cd7-23ad3d4ac18e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:52.668844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16fa62-e019-4112-9cd7-23ad3d4ac18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:52.830848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3a16fa62-e019-4112-9cd7-23ad3d4ac18e None None] MFA Rules not processed for user `b0c9bfbd5ba24d30b9d70b8e28ec6b09`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:52.842426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3a16fa62-e019-4112-9cd7-23ad3d4ac18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:52.866220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ab8a0-5a68-422d-8564-fef6722a7f4c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:53.011894 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2554/5152] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:53.013542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16fa62-e019-4112-9cd7-23ad3d4ac18e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:53.029714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13a8c7-1ad8-49f6-a429-1e9590a8a492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:53.030400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13a8c7-1ad8-49f6-a429-1e9590a8a492 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:53.030682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13a8c7-1ad8-49f6-a429-1e9590a8a492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:53.030957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13a8c7-1ad8-49f6-a429-1e9590a8a492 admin admin] PATH_INFO: `/v3/projects/19b52ba67d3a4468a52ed9b1c849e6b3/users/20f49fc0f3084f7e8bc7dbf905482847/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:53.067606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13a8c7-1ad8-49f6-a429-1e9590a8a492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b52ba67d3a4468a52ed9b1c849e6b3, user_id=20f49fc0f3084f7e8bc7dbf905482847, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:53.073551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13a8c7-1ad8-49f6-a429-1e9590a8a492 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:53.129778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16fa62-e019-4112-9cd7-23ad3d4ac18e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:53.136301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d173d1-7123-4f00-b784-cced36cba857 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75b020bacec4483aa99f7096f7d3c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7657317c3d044a95b12b69be14e78f7d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1457757561', 'tempest-DelegatedRole-1792040891'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:53.137726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d173d1-7123-4f00-b784-cced36cba857 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:53.138027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d173d1-7123-4f00-b784-cced36cba857 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:53.138316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d173d1-7123-4f00-b784-cced36cba857 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:53.139034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d173d1-7123-4f00-b784-cced36cba857 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:53.140654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d173d1-7123-4f00-b784-cced36cba857 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:53.150628 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2555/5153] 10.222.0.76 () {58 vars in 1252 bytes} [Sat Aug 27 04:50:53 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=a75b020bacec4483aa99f7096f7d3c02 => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:53.150628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26356e-f331-4e99-affc-1f7ac9c53dc2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:53.150628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26356e-f331-4e99-affc-1f7ac9c53dc2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:53.150628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26356e-f331-4e99-affc-1f7ac9c53dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:53.186522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7b26356e-f331-4e99-affc-1f7ac9c53dc2 None None] MFA Rules not processed for user `b55b99deebc74d6d933dfcb95c2e99d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:53.187761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7b26356e-f331-4e99-affc-1f7ac9c53dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:53.253031 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2599/5154] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:52 2022] PUT /identity/v3/projects/19b52ba67d3a4468a52ed9b1c849e6b3/users/20f49fc0f3084f7e8bc7dbf905482847/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:53.254107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13a8c7-1ad8-49f6-a429-1e9590a8a492 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:53.366608 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2556/5155] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:53.367552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26356e-f331-4e99-affc-1f7ac9c53dc2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:53.370219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7b26356e-f331-4e99-affc-1f7ac9c53dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:53.388544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26356e-f331-4e99-affc-1f7ac9c53dc2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:53.389973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13a8c7-1ad8-49f6-a429-1e9590a8a492 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:53.396464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8b08b-0d76-4a24-84f6-38d7c1262aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:53.397123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8b08b-0d76-4a24-84f6-38d7c1262aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:53.397480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8b08b-0d76-4a24-84f6-38d7c1262aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:53.397756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8b08b-0d76-4a24-84f6-38d7c1262aaa admin admin] PATH_INFO: `/v3/projects/0e8f4d2e736c4d409a47e60a882a8de9` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:53.399954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8b08b-0d76-4a24-84f6-38d7c1262aaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8f4d2e736c4d409a47e60a882a8de9)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:53.401152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8b08b-0d76-4a24-84f6-38d7c1262aaa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:53.402524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f955f1e-0e23-410c-b4f3-73128fc2751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:53.403381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f955f1e-0e23-410c-b4f3-73128fc2751c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:53.403830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f955f1e-0e23-410c-b4f3-73128fc2751c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:53.404316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f955f1e-0e23-410c-b4f3-73128fc2751c admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:53.405563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f955f1e-0e23-410c-b4f3-73128fc2751c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:53.407855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f955f1e-0e23-410c-b4f3-73128fc2751c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:53.527534 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2600/5156] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:53 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:53.531751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f955f1e-0e23-410c-b4f3-73128fc2751c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:53.564829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f955f1e-0e23-410c-b4f3-73128fc2751c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:53.576016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5610-3ff2-4428-9bfc-20f1622e607a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:53.577167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5610-3ff2-4428-9bfc-20f1622e607a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:53.578301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5610-3ff2-4428-9bfc-20f1622e607a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:53.578301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5610-3ff2-4428-9bfc-20f1622e607a admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:53.578970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa5610-3ff2-4428-9bfc-20f1622e607a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:53.582333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa5610-3ff2-4428-9bfc-20f1622e607a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:53.662378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:53.698624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8fd8b08b-0d76-4a24-84f6-38d7c1262aaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8f4d2e736c4d409a47e60a882a8de9', 'request_id': 'req-8fd8b08b-0d76-4a24-84f6-38d7c1262aaa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:53.724846 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2601/5157] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:53 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:53.724846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5610-3ff2-4428-9bfc-20f1622e607a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:53.739067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8fd8b08b-0d76-4a24-84f6-38d7c1262aaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8f4d2e736c4d409a47e60a882a8de9', 'request_id': 'req-8fd8b08b-0d76-4a24-84f6-38d7c1262aaa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:53.759000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8fd8b08b-0d76-4a24-84f6-38d7c1262aaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8f4d2e736c4d409a47e60a882a8de9', 'request_id': 'req-8fd8b08b-0d76-4a24-84f6-38d7c1262aaa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:53.876386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5610-3ff2-4428-9bfc-20f1622e607a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:53.889485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425933bb-cd7d-4c30-8dda-83faa0c4aa14 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75b020bacec4483aa99f7096f7d3c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7657317c3d044a95b12b69be14e78f7d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1457757561', 'tempest-DelegatedRole-1792040891'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:53.890168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425933bb-cd7d-4c30-8dda-83faa0c4aa14 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:53.890506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425933bb-cd7d-4c30-8dda-83faa0c4aa14 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:53.890783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425933bb-cd7d-4c30-8dda-83faa0c4aa14 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] PATH_INFO: `/v3/OS-TRUST/trusts/c996b558ab544f7499f63a7dd6f084c9` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:53.903992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8fd8b08b-0d76-4a24-84f6-38d7c1262aaa admin admin] The token cache is being invalidate because project 0e8f4d2e736c4d409a47e60a882a8de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:53.904507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425933bb-cd7d-4c30-8dda-83faa0c4aa14 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] RBAC: Authorizing `identity:delete_trust(trust_id=c996b558ab544f7499f63a7dd6f084c9)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:53.911506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8fd8b08b-0d76-4a24-84f6-38d7c1262aaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:53.911506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8fd8b08b-0d76-4a24-84f6-38d7c1262aaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:53.912339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425933bb-cd7d-4c30-8dda-83faa0c4aa14 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:53.925626 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2557/5158] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:53 2022] DELETE /identity/v3/projects/0e8f4d2e736c4d409a47e60a882a8de9 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:53.942207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227e955-d669-411c-bec2-3a3365d57ed6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:53.942615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227e955-d669-411c-bec2-3a3365d57ed6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:53.942840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227e955-d669-411c-bec2-3a3365d57ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:54.001505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b227e955-d669-411c-bec2-3a3365d57ed6 None None] MFA Rules not processed for user `20f49fc0f3084f7e8bc7dbf905482847`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:54.002749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b227e955-d669-411c-bec2-3a3365d57ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:54.069042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-425933bb-cd7d-4c30-8dda-83faa0c4aa14 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c996b558ab544f7499f63a7dd6f084c9', 'request_id': 'req-425933bb-cd7d-4c30-8dda-83faa0c4aa14'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:54.072553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-425933bb-cd7d-4c30-8dda-83faa0c4aa14 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'c996b558ab544f7499f63a7dd6f084c9', 'request_id': 'req-425933bb-cd7d-4c30-8dda-83faa0c4aa14'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:54.160220 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2558/5159] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:54.160220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227e955-d669-411c-bec2-3a3365d57ed6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:54.160220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b227e955-d669-411c-bec2-3a3365d57ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:54.234847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227e955-d669-411c-bec2-3a3365d57ed6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:54.239343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc93e7-3a78-4d47-9ac1-73d8cee13f70 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55b99deebc74d6d933dfcb95c2e99d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2654d38f2ffc4e7ca353480bd695d219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:54.239998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc93e7-3a78-4d47-9ac1-73d8cee13f70 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:54.240326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc93e7-3a78-4d47-9ac1-73d8cee13f70 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:54.240609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc93e7-3a78-4d47-9ac1-73d8cee13f70 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:54.241287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc93e7-3a78-4d47-9ac1-73d8cee13f70 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorizing `identity:create_application_credential(user_id=b55b99deebc74d6d933dfcb95c2e99d0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:54.242589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc93e7-3a78-4d47-9ac1-73d8cee13f70 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:54.249168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-425933bb-cd7d-4c30-8dda-83faa0c4aa14 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c996b558ab544f7499f63a7dd6f084c9', 'request_id': 'req-425933bb-cd7d-4c30-8dda-83faa0c4aa14'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:54.260735 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2602/5160] 10.222.0.76 () {58 vars in 1254 bytes} [Sat Aug 27 04:50:53 2022] DELETE /identity/v3/OS-TRUST/trusts/c996b558ab544f7499f63a7dd6f084c9 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:54.266888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425933bb-cd7d-4c30-8dda-83faa0c4aa14 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:54.271338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-425933bb-cd7d-4c30-8dda-83faa0c4aa14 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:54.354350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:54.422387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425933bb-cd7d-4c30-8dda-83faa0c4aa14 tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:54.428341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c22c62-1495-4650-bad5-65bce85f3cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:54.429113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c22c62-1495-4650-bad5-65bce85f3cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:54.430484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c22c62-1495-4650-bad5-65bce85f3cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:54.430484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c22c62-1495-4650-bad5-65bce85f3cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:54.431655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c22c62-1495-4650-bad5-65bce85f3cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:54.433641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c22c62-1495-4650-bad5-65bce85f3cf0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:54.452607 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2603/5161] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:54 2022] GET /identity/v3/roles => generated 1893 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:54.453301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c22c62-1495-4650-bad5-65bce85f3cf0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:54.455062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-35c22c62-1495-4650-bad5-65bce85f3cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:54.470210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c22c62-1495-4650-bad5-65bce85f3cf0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:54.477038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb079d-f46e-41a7-ae25-db5fe7ec276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:54.477258 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2559/5162] 10.222.0.76 () {60 vars in 1314 bytes} [Sat Aug 27 04:50:54 2022] POST /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials => generated 788 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:54.478196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb079d-f46e-41a7-ae25-db5fe7ec276b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:54.478474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb079d-f46e-41a7-ae25-db5fe7ec276b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:54.478836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb079d-f46e-41a7-ae25-db5fe7ec276b admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:54.479186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc93e7-3a78-4d47-9ac1-73d8cee13f70 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:54.479380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb079d-f46e-41a7-ae25-db5fe7ec276b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:54.480979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-87fc93e7-3a78-4d47-9ac1-73d8cee13f70 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:54.481349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb079d-f46e-41a7-ae25-db5fe7ec276b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:54.503939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc93e7-3a78-4d47-9ac1-73d8cee13f70 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:54.511332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3c704-1bd5-44a9-8366-dbdac49aafe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:54.511988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c704-1bd5-44a9-8366-dbdac49aafe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:54.512306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c704-1bd5-44a9-8366-dbdac49aafe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:54.512586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c704-1bd5-44a9-8366-dbdac49aafe1 admin admin] PATH_INFO: `/v3/users/91812e12f4d5425f88fc06368672422c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:54.513765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3c704-1bd5-44a9-8366-dbdac49aafe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91812e12f4d5425f88fc06368672422c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:54.529586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3c704-1bd5-44a9-8366-dbdac49aafe1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:54.591560 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2604/5163] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:54 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:54.592722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb079d-f46e-41a7-ae25-db5fe7ec276b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:54.595333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dadb079d-f46e-41a7-ae25-db5fe7ec276b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:54.721023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb079d-f46e-41a7-ae25-db5fe7ec276b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:54.732464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7c5bd-dec1-4f3d-ad1a-2c3ea69567df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:54.733243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7c5bd-dec1-4f3d-ad1a-2c3ea69567df service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:54.733780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7c5bd-dec1-4f3d-ad1a-2c3ea69567df service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:54.734094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7c5bd-dec1-4f3d-ad1a-2c3ea69567df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:54.745381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7c5bd-dec1-4f3d-ad1a-2c3ea69567df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:54.747041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7c5bd-dec1-4f3d-ad1a-2c3ea69567df service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:54.762222 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2605/5164] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:54.763542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7c5bd-dec1-4f3d-ad1a-2c3ea69567df service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:54.765365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f3c7c5bd-dec1-4f3d-ad1a-2c3ea69567df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:54.784289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7c5bd-dec1-4f3d-ad1a-2c3ea69567df service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:54.789674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e3fc3-daae-4030-8ce7-d717ddc872ca tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75b020bacec4483aa99f7096f7d3c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7657317c3d044a95b12b69be14e78f7d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1457757561', 'tempest-DelegatedRole-1792040891'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:54.791002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e3fc3-daae-4030-8ce7-d717ddc872ca tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:54.791590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e3fc3-daae-4030-8ce7-d717ddc872ca tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:54.791590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e3fc3-daae-4030-8ce7-d717ddc872ca tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] PATH_INFO: `/v3/OS-TRUST/trusts/c996b558ab544f7499f63a7dd6f084c9` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:54.815551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-108e3fc3-daae-4030-8ce7-d717ddc872ca tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] Could not find trust: c996b558ab544f7499f63a7dd6f084c9.: keystone.exception.TrustNotFound: Could not find trust: c996b558ab544f7499f63a7dd6f084c9. Aug 27 04:50:54.815551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:50:54.815551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:50:54.815551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:50:54.815551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:50:54.815551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:50:54.815551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:50:54.815551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:50:54.815551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:50:54.815551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:50:54.815551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:50:54.815551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:50:54.815551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 27 04:50:54.815551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 27 04:50:54.815551 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 27 04:50:54.816913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 27 04:50:54.816913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 27 04:50:54.816913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 27 04:50:54.816913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 27 04:50:54.816913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 27 04:50:54.816913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:50:54.816913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:50:54.816913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 27 04:50:54.816913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 27 04:50:54.816913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 27 04:50:54.816913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 27 04:50:54.816913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: c996b558ab544f7499f63a7dd6f084c9. Aug 27 04:50:54.816913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:50:54.838972 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2606/5165] 10.222.0.76 () {58 vars in 1251 bytes} [Sat Aug 27 04:50:54 2022] GET /identity/v3/OS-TRUST/trusts/c996b558ab544f7499f63a7dd6f084c9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:50:54.841141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e3fc3-daae-4030-8ce7-d717ddc872ca tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:54.850347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bbd3c704-1bd5-44a9-8366-dbdac49aafe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91812e12f4d5425f88fc06368672422c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:54.878565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e3fc3-daae-4030-8ce7-d717ddc872ca tempest-TrustsV3TestJSON-1233014394 tempest-user-192343036] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:54.885210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2bcc7-ddf7-4e44-9f07-ea6e438ebf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:54.886789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2bcc7-ddf7-4e44-9f07-ea6e438ebf0c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:54.887234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2bcc7-ddf7-4e44-9f07-ea6e438ebf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:54.887914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2bcc7-ddf7-4e44-9f07-ea6e438ebf0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:54.888800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2bcc7-ddf7-4e44-9f07-ea6e438ebf0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:54.891109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2bcc7-ddf7-4e44-9f07-ea6e438ebf0c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:54.921566 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2607/5166] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:54 2022] GET /identity/v3/roles => generated 1893 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:54.921566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2bcc7-ddf7-4e44-9f07-ea6e438ebf0c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:54.941968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2bcc7-ddf7-4e44-9f07-ea6e438ebf0c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:54.969855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebae19-9e0b-48ce-9941-949f21bac1bc tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55b99deebc74d6d933dfcb95c2e99d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2654d38f2ffc4e7ca353480bd695d219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:54.970554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebae19-9e0b-48ce-9941-949f21bac1bc tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:54.970846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebae19-9e0b-48ce-9941-949f21bac1bc tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:54.971132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebae19-9e0b-48ce-9941-949f21bac1bc tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials/c85ba8845dcf46718088715014f7b7ce` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:54.984096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebae19-9e0b-48ce-9941-949f21bac1bc tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorizing `identity:get_application_credential(user_id=b55b99deebc74d6d933dfcb95c2e99d0, application_credential_id=c85ba8845dcf46718088715014f7b7ce)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:54.986297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebae19-9e0b-48ce-9941-949f21bac1bc tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:54.989538 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2608/5167] 10.222.0.76 () {58 vars in 1392 bytes} [Sat Aug 27 04:50:54 2022] GET /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials/c85ba8845dcf46718088715014f7b7ce => generated 688 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:54.990400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebae19-9e0b-48ce-9941-949f21bac1bc tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:54.993870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bbd3c704-1bd5-44a9-8366-dbdac49aafe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91812e12f4d5425f88fc06368672422c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:54.994714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bbd3c704-1bd5-44a9-8366-dbdac49aafe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91812e12f4d5425f88fc06368672422c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:55.009968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bbd3c704-1bd5-44a9-8366-dbdac49aafe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91812e12f4d5425f88fc06368672422c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:55.047627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebae19-9e0b-48ce-9941-949f21bac1bc tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:55.050854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bbd3c704-1bd5-44a9-8366-dbdac49aafe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91812e12f4d5425f88fc06368672422c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:55.062126 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2560/5168] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:54 2022] DELETE /identity/v3/users/91812e12f4d5425f88fc06368672422c => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:55.063219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3c704-1bd5-44a9-8366-dbdac49aafe1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:55.070554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bf967-a1d2-41a0-a4a6-db5e10a8e747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:55.071836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bf967-a1d2-41a0-a4a6-db5e10a8e747 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:55.072355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bf967-a1d2-41a0-a4a6-db5e10a8e747 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:55.072822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bf967-a1d2-41a0-a4a6-db5e10a8e747 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:55.073674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bf967-a1d2-41a0-a4a6-db5e10a8e747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:55.075955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bbd3c704-1bd5-44a9-8366-dbdac49aafe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:55.076569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bf967-a1d2-41a0-a4a6-db5e10a8e747 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:55.092668 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2609/5169] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:54 2022] GET /identity/v3/roles => generated 1893 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:55.093844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bf967-a1d2-41a0-a4a6-db5e10a8e747 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:55.097235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-be1bf967-a1d2-41a0-a4a6-db5e10a8e747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:55.118426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bf967-a1d2-41a0-a4a6-db5e10a8e747 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:55.233411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3c704-1bd5-44a9-8366-dbdac49aafe1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:55.240396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc9f21-45ee-4610-a222-95189680f3d7 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:55.240396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc9f21-45ee-4610-a222-95189680f3d7 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:55.240396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc9f21-45ee-4610-a222-95189680f3d7 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:55.247113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc9f21-45ee-4610-a222-95189680f3d7 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles/5e416c9c8c684852877434dbf58894f0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:55.247113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc9f21-45ee-4610-a222-95189680f3d7 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5e416c9c8c684852877434dbf58894f0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:55.249879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc9f21-45ee-4610-a222-95189680f3d7 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:55.272723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79829cdd-38fb-4faa-bf4c-1b43c6e1df4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:55.273538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79829cdd-38fb-4faa-bf4c-1b43c6e1df4f admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:55.273958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79829cdd-38fb-4faa-bf4c-1b43c6e1df4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:55.274349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79829cdd-38fb-4faa-bf4c-1b43c6e1df4f admin admin] PATH_INFO: `/v3/projects/6e57f0e3cfdb4ee29ec2d6e1c3468bb8/users/f677cd9af7cc475dae25c21d3e351a31/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:55.297775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79829cdd-38fb-4faa-bf4c-1b43c6e1df4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e57f0e3cfdb4ee29ec2d6e1c3468bb8, user_id=f677cd9af7cc475dae25c21d3e351a31, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:55.300628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79829cdd-38fb-4faa-bf4c-1b43c6e1df4f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:55.407448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:55.518819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f5fc9f21-45ee-4610-a222-95189680f3d7 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invalidating the token cache because role 5e416c9c8c684852877434dbf58894f0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:55.518819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f5fc9f21-45ee-4610-a222-95189680f3d7 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:55.519618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f5fc9f21-45ee-4610-a222-95189680f3d7 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:55.521864 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2561/5170] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:55 2022] DELETE /identity/v3/roles/5e416c9c8c684852877434dbf58894f0 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:55.527183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7985c-d976-4d4a-98ab-4cd3ee6087d7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:55.527914 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2610/5171] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:55 2022] PUT /identity/v3/projects/6e57f0e3cfdb4ee29ec2d6e1c3468bb8/users/f677cd9af7cc475dae25c21d3e351a31/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:55.528680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79829cdd-38fb-4faa-bf4c-1b43c6e1df4f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:55.530330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-79829cdd-38fb-4faa-bf4c-1b43c6e1df4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:55.538849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7985c-d976-4d4a-98ab-4cd3ee6087d7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:55.540118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7985c-d976-4d4a-98ab-4cd3ee6087d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:55.599591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-02c7985c-d976-4d4a-98ab-4cd3ee6087d7 None None] MFA Rules not processed for user `b55b99deebc74d6d933dfcb95c2e99d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:55.601145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-02c7985c-d976-4d4a-98ab-4cd3ee6087d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:55.654585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79829cdd-38fb-4faa-bf4c-1b43c6e1df4f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:55.734169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509550f-8a01-4974-b2b3-9161a89e2031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:55.745587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509550f-8a01-4974-b2b3-9161a89e2031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:55.745587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509550f-8a01-4974-b2b3-9161a89e2031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:55.745587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509550f-8a01-4974-b2b3-9161a89e2031 admin admin] PATH_INFO: `/v3/users/20f49fc0f3084f7e8bc7dbf905482847` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:55.745587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509550f-8a01-4974-b2b3-9161a89e2031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f49fc0f3084f7e8bc7dbf905482847)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:55.745587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509550f-8a01-4974-b2b3-9161a89e2031 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:55.746063 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2562/5172] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:55 2022] POST /identity/v3/auth/tokens => generated 3426 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 27 04:50:55.746063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7985c-d976-4d4a-98ab-4cd3ee6087d7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:55.746063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-02c7985c-d976-4d4a-98ab-4cd3ee6087d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:55.763856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7985c-d976-4d4a-98ab-4cd3ee6087d7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:55.768577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2601a86-2d5c-4411-b4d3-c076e5af7d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:55.769276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2601a86-2d5c-4411-b4d3-c076e5af7d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:55.769567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2601a86-2d5c-4411-b4d3-c076e5af7d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:55.769840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2601a86-2d5c-4411-b4d3-c076e5af7d91 admin admin] PATH_INFO: `/v3/projects/55cae27d0bfc4f1b8857b8118e7dfeca/users/3ea19476d35a49908037d11d448e0fe4/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:55.796252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2601a86-2d5c-4411-b4d3-c076e5af7d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55cae27d0bfc4f1b8857b8118e7dfeca, user_id=3ea19476d35a49908037d11d448e0fe4, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:55.798947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2601a86-2d5c-4411-b4d3-c076e5af7d91 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:56.006403 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2563/5173] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:55 2022] PUT /identity/v3/projects/55cae27d0bfc4f1b8857b8118e7dfeca/users/3ea19476d35a49908037d11d448e0fe4/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:56.010048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2601a86-2d5c-4411-b4d3-c076e5af7d91 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:56.012426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f2601a86-2d5c-4411-b4d3-c076e5af7d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:56.094205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9509550f-8a01-4974-b2b3-9161a89e2031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f49fc0f3084f7e8bc7dbf905482847'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:56.096347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9509550f-8a01-4974-b2b3-9161a89e2031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f49fc0f3084f7e8bc7dbf905482847'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:56.108592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2601a86-2d5c-4411-b4d3-c076e5af7d91 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:56.113231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50caf6a-b69a-46c2-b9bd-3db202b4bf22 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:56.113952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50caf6a-b69a-46c2-b9bd-3db202b4bf22 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:56.114791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50caf6a-b69a-46c2-b9bd-3db202b4bf22 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:56.115086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50caf6a-b69a-46c2-b9bd-3db202b4bf22 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles/a9e7e4653e5b4edeb5f802d89eca16e7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:56.117784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:56.120985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50caf6a-b69a-46c2-b9bd-3db202b4bf22 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a9e7e4653e5b4edeb5f802d89eca16e7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:56.122778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50caf6a-b69a-46c2-b9bd-3db202b4bf22 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:56.233125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9509550f-8a01-4974-b2b3-9161a89e2031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f49fc0f3084f7e8bc7dbf905482847'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:56.233765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9509550f-8a01-4974-b2b3-9161a89e2031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f49fc0f3084f7e8bc7dbf905482847'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:56.260713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9509550f-8a01-4974-b2b3-9161a89e2031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f49fc0f3084f7e8bc7dbf905482847'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:56.274762 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2611/5174] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:55 2022] DELETE /identity/v3/users/20f49fc0f3084f7e8bc7dbf905482847 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:56.276677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe82a1c-aa5e-42ac-93ea-a646b0b62890 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:56.276973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe82a1c-aa5e-42ac-93ea-a646b0b62890 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:56.277410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe82a1c-aa5e-42ac-93ea-a646b0b62890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:56.313317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5fe82a1c-aa5e-42ac-93ea-a646b0b62890 None None] MFA Rules not processed for user `f677cd9af7cc475dae25c21d3e351a31`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:56.314230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5fe82a1c-aa5e-42ac-93ea-a646b0b62890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:56.396090 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2612/5175] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:56.397059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe82a1c-aa5e-42ac-93ea-a646b0b62890 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:56.398338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5fe82a1c-aa5e-42ac-93ea-a646b0b62890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:56.422217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f50caf6a-b69a-46c2-b9bd-3db202b4bf22 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invalidating the token cache because role a9e7e4653e5b4edeb5f802d89eca16e7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:56.428743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f50caf6a-b69a-46c2-b9bd-3db202b4bf22 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:56.428743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f50caf6a-b69a-46c2-b9bd-3db202b4bf22 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:56.428743 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2564/5176] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:56 2022] DELETE /identity/v3/roles/a9e7e4653e5b4edeb5f802d89eca16e7 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:56.428743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50caf6a-b69a-46c2-b9bd-3db202b4bf22 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:56.428743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f50caf6a-b69a-46c2-b9bd-3db202b4bf22 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:56.480457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe82a1c-aa5e-42ac-93ea-a646b0b62890 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:56.518524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50caf6a-b69a-46c2-b9bd-3db202b4bf22 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:56.524733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:56.525076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:56.525484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:56.525762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a admin admin] PATH_INFO: `/v3/projects/21f72f96606c438ab6b5619010f4e1cd` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:56.527869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f72f96606c438ab6b5619010f4e1cd)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:56.530060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:56.556651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d90727-e293-42cc-9ff9-a45c0b08a3d4 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55b99deebc74d6d933dfcb95c2e99d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2654d38f2ffc4e7ca353480bd695d219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:56.557431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d90727-e293-42cc-9ff9-a45c0b08a3d4 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:56.557787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d90727-e293-42cc-9ff9-a45c0b08a3d4 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:56.558144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d90727-e293-42cc-9ff9-a45c0b08a3d4 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials/c85ba8845dcf46718088715014f7b7ce` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:56.559730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d90727-e293-42cc-9ff9-a45c0b08a3d4 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b55b99deebc74d6d933dfcb95c2e99d0, application_credential_id=c85ba8845dcf46718088715014f7b7ce)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:56.561486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d90727-e293-42cc-9ff9-a45c0b08a3d4 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:56.652968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f72f96606c438ab6b5619010f4e1cd', 'request_id': 'req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:56.658885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f72f96606c438ab6b5619010f4e1cd', 'request_id': 'req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:56.667293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f72f96606c438ab6b5619010f4e1cd', 'request_id': 'req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:56.680191 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2613/5177] 10.222.0.76 () {58 vars in 1395 bytes} [Sat Aug 27 04:50:56 2022] DELETE /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials/c85ba8845dcf46718088715014f7b7ce => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:56.681269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d90727-e293-42cc-9ff9-a45c0b08a3d4 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:56.687620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-32d90727-e293-42cc-9ff9-a45c0b08a3d4 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:56.702525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d90727-e293-42cc-9ff9-a45c0b08a3d4 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:56.765603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c81182-2466-47ce-a463-dfa94866d54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:56.767010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c81182-2466-47ce-a463-dfa94866d54e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:56.767010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c81182-2466-47ce-a463-dfa94866d54e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:56.767010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c81182-2466-47ce-a463-dfa94866d54e admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:56.767364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c81182-2466-47ce-a463-dfa94866d54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:56.769006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c81182-2466-47ce-a463-dfa94866d54e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:56.783603 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2614/5178] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:56.783603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb05414-3b30-471d-b5b2-a14200c3230f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:56.783603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb05414-3b30-471d-b5b2-a14200c3230f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:56.783603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb05414-3b30-471d-b5b2-a14200c3230f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:56.801933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-cbb05414-3b30-471d-b5b2-a14200c3230f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:56.803162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cbb05414-3b30-471d-b5b2-a14200c3230f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:56.812022 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2615/5179] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:56.812888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb05414-3b30-471d-b5b2-a14200c3230f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:56.814376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cbb05414-3b30-471d-b5b2-a14200c3230f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:56.827511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb05414-3b30-471d-b5b2-a14200c3230f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:56.832382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ecadb-765a-475d-9f28-aab9b998e10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:56.832997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ecadb-765a-475d-9f28-aab9b998e10d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:56.833277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ecadb-765a-475d-9f28-aab9b998e10d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:56.833553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ecadb-765a-475d-9f28-aab9b998e10d admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:56.834191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ecadb-765a-475d-9f28-aab9b998e10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:56.836103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ecadb-765a-475d-9f28-aab9b998e10d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:56.847221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a admin admin] The token cache is being invalidate because project 21f72f96606c438ab6b5619010f4e1cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:56.847509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:56.848290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:56.849855 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2565/5180] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:56 2022] DELETE /identity/v3/projects/21f72f96606c438ab6b5619010f4e1cd => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:56.850638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:56.851959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:56.928856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d3a9e-505f-4585-ad54-ad9df0fc272a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:56.933638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745ef9f-3c5b-416d-968b-38bbf0c19577 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:56.934289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745ef9f-3c5b-416d-968b-38bbf0c19577 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:56.934575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745ef9f-3c5b-416d-968b-38bbf0c19577 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:56.934854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745ef9f-3c5b-416d-968b-38bbf0c19577 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users/a75b020bacec4483aa99f7096f7d3c02` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:56.936050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745ef9f-3c5b-416d-968b-38bbf0c19577 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a75b020bacec4483aa99f7096f7d3c02)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:56.938282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745ef9f-3c5b-416d-968b-38bbf0c19577 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:57.023314 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2616/5181] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:56 2022] POST /identity/v3/projects => generated 375 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:57.023314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ecadb-765a-475d-9f28-aab9b998e10d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:57.028784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7c0ecadb-765a-475d-9f28-aab9b998e10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:57.100062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ecadb-765a-475d-9f28-aab9b998e10d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:57.105142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac0232-3bc2-4832-9e80-3af0ddff77fe tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55b99deebc74d6d933dfcb95c2e99d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2654d38f2ffc4e7ca353480bd695d219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:57.105827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac0232-3bc2-4832-9e80-3af0ddff77fe tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:57.106061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac0232-3bc2-4832-9e80-3af0ddff77fe tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:57.106399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac0232-3bc2-4832-9e80-3af0ddff77fe tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:57.107012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac0232-3bc2-4832-9e80-3af0ddff77fe tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorizing `identity:create_application_credential(user_id=b55b99deebc74d6d933dfcb95c2e99d0)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:57.108224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac0232-3bc2-4832-9e80-3af0ddff77fe tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:57.151776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2745ef9f-3c5b-416d-968b-38bbf0c19577 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75b020bacec4483aa99f7096f7d3c02'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:57.255989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2745ef9f-3c5b-416d-968b-38bbf0c19577 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75b020bacec4483aa99f7096f7d3c02'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:57.256657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2745ef9f-3c5b-416d-968b-38bbf0c19577 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75b020bacec4483aa99f7096f7d3c02'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:57.265530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2745ef9f-3c5b-416d-968b-38bbf0c19577 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75b020bacec4483aa99f7096f7d3c02'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:57.280968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2745ef9f-3c5b-416d-968b-38bbf0c19577 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75b020bacec4483aa99f7096f7d3c02'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:57.290035 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2566/5182] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:56 2022] DELETE /identity/v3/users/a75b020bacec4483aa99f7096f7d3c02 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:57.291671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745ef9f-3c5b-416d-968b-38bbf0c19577 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:57.293371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2745ef9f-3c5b-416d-968b-38bbf0c19577 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:57.298755 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2617/5183] 10.222.0.76 () {60 vars in 1315 bytes} [Sat Aug 27 04:50:57 2022] POST /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials => generated 921 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:57.298755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac0232-3bc2-4832-9e80-3af0ddff77fe tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:57.302475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-64ac0232-3bc2-4832-9e80-3af0ddff77fe tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:57.373510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745ef9f-3c5b-416d-968b-38bbf0c19577 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:57.379602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac0232-3bc2-4832-9e80-3af0ddff77fe tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:57.380086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659d64e-08bf-4168-9e77-8228d14103e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:57.384576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659d64e-08bf-4168-9e77-8228d14103e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:57.384576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659d64e-08bf-4168-9e77-8228d14103e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:57.384576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659d64e-08bf-4168-9e77-8228d14103e4 admin admin] PATH_INFO: `/v3/projects/55cae27d0bfc4f1b8857b8118e7dfeca/users/3ea19476d35a49908037d11d448e0fe4/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:57.384576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659d64e-08bf-4168-9e77-8228d14103e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55cae27d0bfc4f1b8857b8118e7dfeca, user_id=3ea19476d35a49908037d11d448e0fe4, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:57.387066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659d64e-08bf-4168-9e77-8228d14103e4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:57.397900 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2567/5184] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:57 2022] PUT /identity/v3/projects/55cae27d0bfc4f1b8857b8118e7dfeca/users/3ea19476d35a49908037d11d448e0fe4/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:57.399195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa82e5-449e-4ef0-9ab1-94faca9c1ae4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:57.399488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa82e5-449e-4ef0-9ab1-94faca9c1ae4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:57.399840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa82e5-449e-4ef0-9ab1-94faca9c1ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:57.432903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4eaa82e5-449e-4ef0-9ab1-94faca9c1ae4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:57.434233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4eaa82e5-449e-4ef0-9ab1-94faca9c1ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:57.445687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330790b-e706-47c6-847c-8df08113f2df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:57.447275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330790b-e706-47c6-847c-8df08113f2df service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:57.447574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330790b-e706-47c6-847c-8df08113f2df service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:57.447829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330790b-e706-47c6-847c-8df08113f2df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:57.450340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2330790b-e706-47c6-847c-8df08113f2df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:57.472283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330790b-e706-47c6-847c-8df08113f2df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:57.474852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330790b-e706-47c6-847c-8df08113f2df service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:57.494593 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2618/5185] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:57.495211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330790b-e706-47c6-847c-8df08113f2df service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:57.498592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2330790b-e706-47c6-847c-8df08113f2df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:57.522663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330790b-e706-47c6-847c-8df08113f2df service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:57.551524 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2568/5186] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:57.553076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa82e5-449e-4ef0-9ab1-94faca9c1ae4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:57.554959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4eaa82e5-449e-4ef0-9ab1-94faca9c1ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:57.575443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa82e5-449e-4ef0-9ab1-94faca9c1ae4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:57.582149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352781a0-de72-4e01-b28f-fa424b38a867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:57.582797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352781a0-de72-4e01-b28f-fa424b38a867 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:57.583124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352781a0-de72-4e01-b28f-fa424b38a867 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:57.583396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352781a0-de72-4e01-b28f-fa424b38a867 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:57.584006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352781a0-de72-4e01-b28f-fa424b38a867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:57.587114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352781a0-de72-4e01-b28f-fa424b38a867 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:57.606832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28956809-4867-4e75-849d-3b757d89f16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:57.607556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28956809-4867-4e75-849d-3b757d89f16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:57.608082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28956809-4867-4e75-849d-3b757d89f16d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:57.608576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28956809-4867-4e75-849d-3b757d89f16d admin admin] PATH_INFO: `/v3/users/8cf6f30ab7d14d0f8f3829e05dd565dd` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:57.610856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28956809-4867-4e75-849d-3b757d89f16d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf6f30ab7d14d0f8f3829e05dd565dd)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:57.614444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28956809-4867-4e75-849d-3b757d89f16d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:57.709469 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2569/5187] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:57 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:57.710576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352781a0-de72-4e01-b28f-fa424b38a867 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:57.713184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-352781a0-de72-4e01-b28f-fa424b38a867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:57.797074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352781a0-de72-4e01-b28f-fa424b38a867 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:57.811854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3c2ac-af60-4e8a-8631-2deb1744b0df tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:57.811854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3c2ac-af60-4e8a-8631-2deb1744b0df tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:57.811854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3c2ac-af60-4e8a-8631-2deb1744b0df tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:57.812144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3c2ac-af60-4e8a-8631-2deb1744b0df tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/7657317c3d044a95b12b69be14e78f7d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:57.813055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3c2ac-af60-4e8a-8631-2deb1744b0df tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7657317c3d044a95b12b69be14e78f7d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:57.815588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3c2ac-af60-4e8a-8631-2deb1744b0df tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:57.857571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-28956809-4867-4e75-849d-3b757d89f16d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf6f30ab7d14d0f8f3829e05dd565dd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:57.858320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-28956809-4867-4e75-849d-3b757d89f16d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf6f30ab7d14d0f8f3829e05dd565dd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:57.988760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-28956809-4867-4e75-849d-3b757d89f16d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf6f30ab7d14d0f8f3829e05dd565dd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:57.989535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-28956809-4867-4e75-849d-3b757d89f16d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf6f30ab7d14d0f8f3829e05dd565dd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:58.005938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-28956809-4867-4e75-849d-3b757d89f16d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf6f30ab7d14d0f8f3829e05dd565dd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:58.021400 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2619/5188] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:50:57 2022] DELETE /identity/v3/users/8cf6f30ab7d14d0f8f3829e05dd565dd => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:58.022559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28956809-4867-4e75-849d-3b757d89f16d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:58.023924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-28956809-4867-4e75-849d-3b757d89f16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:58.101663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28956809-4867-4e75-849d-3b757d89f16d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:58.107232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704721f2-f215-4af6-9dd7-e38dbfb658b2 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55b99deebc74d6d933dfcb95c2e99d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2654d38f2ffc4e7ca353480bd695d219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:58.112381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704721f2-f215-4af6-9dd7-e38dbfb658b2 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:58.112669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704721f2-f215-4af6-9dd7-e38dbfb658b2 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:58.112956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704721f2-f215-4af6-9dd7-e38dbfb658b2 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials/f08c456c24974da1af681f14cdc241e9` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:58.131694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0fe3c2ac-af60-4e8a-8631-2deb1744b0df tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7657317c3d044a95b12b69be14e78f7d', 'request_id': 'req-0fe3c2ac-af60-4e8a-8631-2deb1744b0df'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:58.131852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704721f2-f215-4af6-9dd7-e38dbfb658b2 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b55b99deebc74d6d933dfcb95c2e99d0, application_credential_id=f08c456c24974da1af681f14cdc241e9)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:58.131852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704721f2-f215-4af6-9dd7-e38dbfb658b2 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:58.138679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0fe3c2ac-af60-4e8a-8631-2deb1744b0df tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7657317c3d044a95b12b69be14e78f7d', 'request_id': 'req-0fe3c2ac-af60-4e8a-8631-2deb1744b0df'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:58.148293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0fe3c2ac-af60-4e8a-8631-2deb1744b0df tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7657317c3d044a95b12b69be14e78f7d', 'request_id': 'req-0fe3c2ac-af60-4e8a-8631-2deb1744b0df'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:58.240913 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2620/5189] 10.222.0.76 () {58 vars in 1395 bytes} [Sat Aug 27 04:50:58 2022] DELETE /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials/f08c456c24974da1af681f14cdc241e9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:58.243023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa077149-764b-4490-b30d-4f3a45063767 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:58.244250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa077149-764b-4490-b30d-4f3a45063767 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:58.245257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa077149-764b-4490-b30d-4f3a45063767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:58.281327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-fa077149-764b-4490-b30d-4f3a45063767 None None] MFA Rules not processed for user `3ea19476d35a49908037d11d448e0fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:58.283264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fa077149-764b-4490-b30d-4f3a45063767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:58.326598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0fe3c2ac-af60-4e8a-8631-2deb1744b0df tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] The token cache is being invalidate because project 7657317c3d044a95b12b69be14e78f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:58.328410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0fe3c2ac-af60-4e8a-8631-2deb1744b0df tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:58.328410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0fe3c2ac-af60-4e8a-8631-2deb1744b0df tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:58.335356 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2570/5190] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:57 2022] DELETE /identity/v3/projects/7657317c3d044a95b12b69be14e78f7d => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:58.335356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a9609-c318-4185-9dbb-4d993c1e0616 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:58.335356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a9609-c318-4185-9dbb-4d993c1e0616 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:58.335356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a9609-c318-4185-9dbb-4d993c1e0616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:58.377843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-fd8a9609-c318-4185-9dbb-4d993c1e0616 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:58.377843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fd8a9609-c318-4185-9dbb-4d993c1e0616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:58.396048 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2621/5191] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:58.397834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa077149-764b-4490-b30d-4f3a45063767 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:58.400450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fa077149-764b-4490-b30d-4f3a45063767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:58.463133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:58.463382 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2571/5192] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:58.463382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac907ff2-3309-4df9-a709-f2f36c0b6865 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:58.463382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac907ff2-3309-4df9-a709-f2f36c0b6865 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:58.463382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac907ff2-3309-4df9-a709-f2f36c0b6865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:58.491738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ac907ff2-3309-4df9-a709-f2f36c0b6865 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:58.493830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ac907ff2-3309-4df9-a709-f2f36c0b6865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:58.495299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa077149-764b-4490-b30d-4f3a45063767 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:58.500603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d951b79-f421-4b00-9986-75751eb83a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:58.501227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d951b79-f421-4b00-9986-75751eb83a4e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:58.501509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d951b79-f421-4b00-9986-75751eb83a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:58.510404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d951b79-f421-4b00-9986-75751eb83a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:58.510404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d951b79-f421-4b00-9986-75751eb83a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:58.511218 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2572/5193] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:58.511323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d951b79-f421-4b00-9986-75751eb83a4e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:58.511416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac907ff2-3309-4df9-a709-f2f36c0b6865 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:58.511416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ac907ff2-3309-4df9-a709-f2f36c0b6865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:58.516121 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2622/5194] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:58.517249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d951b79-f421-4b00-9986-75751eb83a4e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:58.519070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9d951b79-f421-4b00-9986-75751eb83a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:58.524247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac907ff2-3309-4df9-a709-f2f36c0b6865 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:58.530855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020bab6-cae6-4c00-8956-7c432ee58289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:58.531024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020bab6-cae6-4c00-8956-7c432ee58289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:58.531291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020bab6-cae6-4c00-8956-7c432ee58289 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:58.531651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020bab6-cae6-4c00-8956-7c432ee58289 admin admin] PATH_INFO: `/v3/projects/19b52ba67d3a4468a52ed9b1c849e6b3` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:58.533576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020bab6-cae6-4c00-8956-7c432ee58289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b52ba67d3a4468a52ed9b1c849e6b3)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:58.534632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d951b79-f421-4b00-9986-75751eb83a4e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:58.535561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020bab6-cae6-4c00-8956-7c432ee58289 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:58.542075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1ef12-9b03-4543-80c6-f1e19b731b0f tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55b99deebc74d6d933dfcb95c2e99d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2654d38f2ffc4e7ca353480bd695d219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:58.542724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1ef12-9b03-4543-80c6-f1e19b731b0f tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:58.543005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1ef12-9b03-4543-80c6-f1e19b731b0f tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:58.543348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1ef12-9b03-4543-80c6-f1e19b731b0f tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:58.544073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1ef12-9b03-4543-80c6-f1e19b731b0f tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorizing `identity:create_application_credential(user_id=b55b99deebc74d6d933dfcb95c2e99d0)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:58.545341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1ef12-9b03-4543-80c6-f1e19b731b0f tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:58.775087 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2623/5195] 10.222.0.76 () {60 vars in 1315 bytes} [Sat Aug 27 04:50:58 2022] POST /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials => generated 813 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:58.777187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1ef12-9b03-4543-80c6-f1e19b731b0f tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:58.780198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3ad1ef12-9b03-4543-80c6-f1e19b731b0f tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:58.782042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6020bab6-cae6-4c00-8956-7c432ee58289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b52ba67d3a4468a52ed9b1c849e6b3', 'request_id': 'req-6020bab6-cae6-4c00-8956-7c432ee58289'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:58.787925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6020bab6-cae6-4c00-8956-7c432ee58289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b52ba67d3a4468a52ed9b1c849e6b3', 'request_id': 'req-6020bab6-cae6-4c00-8956-7c432ee58289'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:58.797054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6020bab6-cae6-4c00-8956-7c432ee58289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b52ba67d3a4468a52ed9b1c849e6b3', 'request_id': 'req-6020bab6-cae6-4c00-8956-7c432ee58289'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:58.861708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1ef12-9b03-4543-80c6-f1e19b731b0f tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:58.921299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531455b-92a5-4b8b-a1ad-9c9754f43065 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:58.921835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531455b-92a5-4b8b-a1ad-9c9754f43065 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:58.922119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531455b-92a5-4b8b-a1ad-9c9754f43065 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:58.922392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531455b-92a5-4b8b-a1ad-9c9754f43065 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:58.923025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531455b-92a5-4b8b-a1ad-9c9754f43065 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:58.925117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531455b-92a5-4b8b-a1ad-9c9754f43065 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:58.967876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6020bab6-cae6-4c00-8956-7c432ee58289 admin admin] The token cache is being invalidate because project 19b52ba67d3a4468a52ed9b1c849e6b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:50:58.968188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6020bab6-cae6-4c00-8956-7c432ee58289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:58.968854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6020bab6-cae6-4c00-8956-7c432ee58289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:50:58.970442 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2573/5196] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:58 2022] DELETE /identity/v3/projects/19b52ba67d3a4468a52ed9b1c849e6b3 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:58.971200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020bab6-cae6-4c00-8956-7c432ee58289 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:58.972660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6020bab6-cae6-4c00-8956-7c432ee58289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:59.038926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020bab6-cae6-4c00-8956-7c432ee58289 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:59.043652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75044643-415d-486a-86b3-cec6dbe9bd28 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea19476d35a49908037d11d448e0fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55cae27d0bfc4f1b8857b8118e7dfeca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:59.044317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75044643-415d-486a-86b3-cec6dbe9bd28 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:59.044603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75044643-415d-486a-86b3-cec6dbe9bd28 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:59.044877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75044643-415d-486a-86b3-cec6dbe9bd28 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:59.045535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75044643-415d-486a-86b3-cec6dbe9bd28 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:59.047396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75044643-415d-486a-86b3-cec6dbe9bd28 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:59.071589 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2624/5197] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:50:58 2022] POST /identity/v3/projects => generated 329 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:59.073900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531455b-92a5-4b8b-a1ad-9c9754f43065 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:59.074331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0531455b-92a5-4b8b-a1ad-9c9754f43065 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:59.140193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531455b-92a5-4b8b-a1ad-9c9754f43065 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:59.145108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62d5f9-9424-4cee-8220-815525a29bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:59.145586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62d5f9-9424-4cee-8220-815525a29bbb admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:59.145871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62d5f9-9424-4cee-8220-815525a29bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:59.146144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62d5f9-9424-4cee-8220-815525a29bbb admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:59.146796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62d5f9-9424-4cee-8220-815525a29bbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:50:59.147096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62d5f9-9424-4cee-8220-815525a29bbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:59.148729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62d5f9-9424-4cee-8220-815525a29bbb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:59.166230 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2625/5198] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:50:59.166230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62d5f9-9424-4cee-8220-815525a29bbb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:59.166230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1c62d5f9-9424-4cee-8220-815525a29bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:59.209790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:50:59.224592 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2574/5199] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:58 2022] POST /identity/v3/projects => generated 358 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:59.224592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75044643-415d-486a-86b3-cec6dbe9bd28 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:59.225405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-75044643-415d-486a-86b3-cec6dbe9bd28 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:59.230212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62d5f9-9424-4cee-8220-815525a29bbb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:59.285396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc53f87-f65e-4342-95f0-ca20ae02639e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:59.286139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc53f87-f65e-4342-95f0-ca20ae02639e service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:59.286440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc53f87-f65e-4342-95f0-ca20ae02639e service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:59.286711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc53f87-f65e-4342-95f0-ca20ae02639e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:59.288535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8bc53f87-f65e-4342-95f0-ca20ae02639e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:59.301511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75044643-415d-486a-86b3-cec6dbe9bd28 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:59.303036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc53f87-f65e-4342-95f0-ca20ae02639e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:59.304525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc53f87-f65e-4342-95f0-ca20ae02639e service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:59.306825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f115869-e655-46f5-8c0a-3aec41bcf533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:59.307497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f115869-e655-46f5-8c0a-3aec41bcf533 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:59.307781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f115869-e655-46f5-8c0a-3aec41bcf533 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:59.308061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f115869-e655-46f5-8c0a-3aec41bcf533 admin admin] PATH_INFO: `/v3/projects/eb09c05d05e94499a231d232c57a523a/users/7439f25dc5e240dd91ec43194b1fe46a/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:59.314936 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2626/5200] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:50:59.315606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc53f87-f65e-4342-95f0-ca20ae02639e service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:59.317029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8bc53f87-f65e-4342-95f0-ca20ae02639e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:59.330933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f115869-e655-46f5-8c0a-3aec41bcf533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb09c05d05e94499a231d232c57a523a, user_id=7439f25dc5e240dd91ec43194b1fe46a, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:59.334153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f115869-e655-46f5-8c0a-3aec41bcf533 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:59.397655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc53f87-f65e-4342-95f0-ca20ae02639e service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:59.403326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5a42a-50c0-4106-905a-643fa3f51fd1 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55b99deebc74d6d933dfcb95c2e99d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2654d38f2ffc4e7ca353480bd695d219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:59.404106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5a42a-50c0-4106-905a-643fa3f51fd1 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:59.404515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5a42a-50c0-4106-905a-643fa3f51fd1 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:59.405045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5a42a-50c0-4106-905a-643fa3f51fd1 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials/c0643136db5346a08615f7181722150b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:59.415521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5a42a-50c0-4106-905a-643fa3f51fd1 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b55b99deebc74d6d933dfcb95c2e99d0, application_credential_id=c0643136db5346a08615f7181722150b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:59.417273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5a42a-50c0-4106-905a-643fa3f51fd1 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:59.468675 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2575/5201] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:50:59 2022] PUT /identity/v3/projects/eb09c05d05e94499a231d232c57a523a/users/7439f25dc5e240dd91ec43194b1fe46a/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:59.468675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5655454-a773-42d1-9a9f-e42e1b297243 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:59.468675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5655454-a773-42d1-9a9f-e42e1b297243 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:59.468675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5655454-a773-42d1-9a9f-e42e1b297243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:59.496640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a5655454-a773-42d1-9a9f-e42e1b297243 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:59.498937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a5655454-a773-42d1-9a9f-e42e1b297243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:59.566147 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2576/5202] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:59.567113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5655454-a773-42d1-9a9f-e42e1b297243 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:59.568505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a5655454-a773-42d1-9a9f-e42e1b297243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:59.629828 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2627/5203] 10.222.0.76 () {58 vars in 1395 bytes} [Sat Aug 27 04:50:59 2022] DELETE /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials/c0643136db5346a08615f7181722150b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:50:59.630716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5a42a-50c0-4106-905a-643fa3f51fd1 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:59.633400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5655454-a773-42d1-9a9f-e42e1b297243 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:59.638765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8f1c1-42aa-48d5-acaf-5fccf36d9049 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:59.639384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f1c1-42aa-48d5-acaf-5fccf36d9049 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:59.639673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f1c1-42aa-48d5-acaf-5fccf36d9049 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:59.640015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f1c1-42aa-48d5-acaf-5fccf36d9049 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:59.640709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8f1c1-42aa-48d5-acaf-5fccf36d9049 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:59.642686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8f1c1-42aa-48d5-acaf-5fccf36d9049 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:59.643563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5a42a-50c0-4106-905a-643fa3f51fd1 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:59.647972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b7645-4c4e-4abc-8564-9dc2661fd921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:59.648615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b7645-4c4e-4abc-8564-9dc2661fd921 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:59.648969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b7645-4c4e-4abc-8564-9dc2661fd921 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:59.649297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b7645-4c4e-4abc-8564-9dc2661fd921 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:59.650087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b7645-4c4e-4abc-8564-9dc2661fd921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:59.652251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b7645-4c4e-4abc-8564-9dc2661fd921 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:59.761942 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2577/5204] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:50:59 2022] POST /identity/v3/users => generated 416 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:59.763019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8f1c1-42aa-48d5-acaf-5fccf36d9049 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:59.764837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bdd8f1c1-42aa-48d5-acaf-5fccf36d9049 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:59.800243 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2628/5205] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:50:59 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:50:59.801215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b7645-4c4e-4abc-8564-9dc2661fd921 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:59.828677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8f1c1-42aa-48d5-acaf-5fccf36d9049 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:59.864502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b7645-4c4e-4abc-8564-9dc2661fd921 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:59.870148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fbe69-c48d-4f9b-8861-5dd9c5150972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:59.870755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fbe69-c48d-4f9b-8861-5dd9c5150972 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:59.871036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fbe69-c48d-4f9b-8861-5dd9c5150972 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:59.871314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fbe69-c48d-4f9b-8861-5dd9c5150972 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:59.871948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fbe69-c48d-4f9b-8861-5dd9c5150972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:59.873582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fbe69-c48d-4f9b-8861-5dd9c5150972 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:59.882582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a99393-01d7-4256-bd78-cd43c20238de tempest-ProjectsNegativeTestJSON-996389272 tempest-ProjectsNegativeTestJSON-996389272-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c9bfbd5ba24d30b9d70b8e28ec6b09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1044294cc6343e48ffa3de8f6cd6c50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:59.884783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a99393-01d7-4256-bd78-cd43c20238de tempest-ProjectsNegativeTestJSON-996389272 tempest-ProjectsNegativeTestJSON-996389272-project] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:59.884783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a99393-01d7-4256-bd78-cd43c20238de tempest-ProjectsNegativeTestJSON-996389272 tempest-ProjectsNegativeTestJSON-996389272-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:59.884998 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2629/5206] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:50:59.885097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a99393-01d7-4256-bd78-cd43c20238de tempest-ProjectsNegativeTestJSON-996389272 tempest-ProjectsNegativeTestJSON-996389272-project] PATH_INFO: `/v3/projects/b5caf923e3e54f07896bac99f47bc5ee` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:59.885625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa42ffd-38cd-46ac-9f16-ae3dfacf1df5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:59.885912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a99393-01d7-4256-bd78-cd43c20238de tempest-ProjectsNegativeTestJSON-996389272 tempest-ProjectsNegativeTestJSON-996389272-project] RBAC: Authorizing `identity:delete_project(project_id=b5caf923e3e54f07896bac99f47bc5ee)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:59.886028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa42ffd-38cd-46ac-9f16-ae3dfacf1df5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:59.886182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa42ffd-38cd-46ac-9f16-ae3dfacf1df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:59.892151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-a3a99393-01d7-4256-bd78-cd43c20238de tempest-ProjectsNegativeTestJSON-996389272 tempest-ProjectsNegativeTestJSON-996389272-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 27 04:50:59.892151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:50:59.892151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:50:59.892151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:50:59.892151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:50:59.892151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:50:59.892151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:50:59.892151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:50:59.892151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:50:59.892151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:50:59.892151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:50:59.892151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:50:59.892151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Aug 27 04:50:59.892151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 27 04:50:59.893377 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 27 04:50:59.893377 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 27 04:50:59.893377 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 27 04:50:59.893377 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 27 04:50:59.893377 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:50:59.893377 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 27 04:50:59.893377 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 27 04:50:59.893377 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:50:59.893946 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2578/5207] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:59 2022] DELETE /identity/v3/projects/b5caf923e3e54f07896bac99f47bc5ee => generated 136 bytes in 131 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:50:59.894297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a99393-01d7-4256-bd78-cd43c20238de tempest-ProjectsNegativeTestJSON-996389272 tempest-ProjectsNegativeTestJSON-996389272-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:59.906491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ffa42ffd-38cd-46ac-9f16-ae3dfacf1df5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:50:59.907778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ffa42ffd-38cd-46ac-9f16-ae3dfacf1df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:59.917208 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2630/5208] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:50:59.918074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa42ffd-38cd-46ac-9f16-ae3dfacf1df5 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:50:59.919304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ffa42ffd-38cd-46ac-9f16-ae3dfacf1df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:50:59.932290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa42ffd-38cd-46ac-9f16-ae3dfacf1df5 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:59.937374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d58a6-c708-4380-a17f-11e57eedf355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:59.938021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d58a6-c708-4380-a17f-11e57eedf355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:59.938342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d58a6-c708-4380-a17f-11e57eedf355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:59.938617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d58a6-c708-4380-a17f-11e57eedf355 admin admin] PATH_INFO: `/v3/projects/59bd03033f714f7a85eacadc38c4ecc4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:59.939760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d58a6-c708-4380-a17f-11e57eedf355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59bd03033f714f7a85eacadc38c4ecc4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:59.941716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d58a6-c708-4380-a17f-11e57eedf355 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:50:59.961446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a99393-01d7-4256-bd78-cd43c20238de tempest-ProjectsNegativeTestJSON-996389272 tempest-ProjectsNegativeTestJSON-996389272-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:50:59.966705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b7daf-75f0-4bb3-a68f-5583bc8bcc99 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55b99deebc74d6d933dfcb95c2e99d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2654d38f2ffc4e7ca353480bd695d219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:50:59.967895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b7daf-75f0-4bb3-a68f-5583bc8bcc99 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:50:59.967895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b7daf-75f0-4bb3-a68f-5583bc8bcc99 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:50:59.968140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b7daf-75f0-4bb3-a68f-5583bc8bcc99 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:50:59.968850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b7daf-75f0-4bb3-a68f-5583bc8bcc99 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorizing `identity:create_application_credential(user_id=b55b99deebc74d6d933dfcb95c2e99d0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:50:59.970103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b7daf-75f0-4bb3-a68f-5583bc8bcc99 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:00.134425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-007d58a6-c708-4380-a17f-11e57eedf355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59bd03033f714f7a85eacadc38c4ecc4', 'request_id': 'req-007d58a6-c708-4380-a17f-11e57eedf355'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:00.140293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-007d58a6-c708-4380-a17f-11e57eedf355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59bd03033f714f7a85eacadc38c4ecc4', 'request_id': 'req-007d58a6-c708-4380-a17f-11e57eedf355'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:00.145101 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2579/5209] 10.222.0.76 () {60 vars in 1314 bytes} [Sat Aug 27 04:50:59 2022] POST /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials => generated 788 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:00.145922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b7daf-75f0-4bb3-a68f-5583bc8bcc99 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:00.210397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b7daf-75f0-4bb3-a68f-5583bc8bcc99 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:00.267956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41c4ea-6a1a-401a-94d7-8a05337f6c04 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:00.268607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41c4ea-6a1a-401a-94d7-8a05337f6c04 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:00.268894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41c4ea-6a1a-401a-94d7-8a05337f6c04 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:00.269175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41c4ea-6a1a-401a-94d7-8a05337f6c04 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:00.269884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41c4ea-6a1a-401a-94d7-8a05337f6c04 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:00.271529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41c4ea-6a1a-401a-94d7-8a05337f6c04 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:00.310777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-007d58a6-c708-4380-a17f-11e57eedf355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59bd03033f714f7a85eacadc38c4ecc4', 'request_id': 'req-007d58a6-c708-4380-a17f-11e57eedf355'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:00.319863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-007d58a6-c708-4380-a17f-11e57eedf355 admin admin] The token cache is being invalidate because project 59bd03033f714f7a85eacadc38c4ecc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:00.320183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-007d58a6-c708-4380-a17f-11e57eedf355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:00.320843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-007d58a6-c708-4380-a17f-11e57eedf355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:00.322356 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2631/5210] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:50:59 2022] DELETE /identity/v3/projects/59bd03033f714f7a85eacadc38c4ecc4 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:00.323223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d58a6-c708-4380-a17f-11e57eedf355 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:00.324853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-007d58a6-c708-4380-a17f-11e57eedf355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:00.392915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d58a6-c708-4380-a17f-11e57eedf355 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:00.397534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e88340-a71b-4c47-a0a5-df870bd88d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:00.398133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e88340-a71b-4c47-a0a5-df870bd88d5e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:00.398405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e88340-a71b-4c47-a0a5-df870bd88d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:00.398670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e88340-a71b-4c47-a0a5-df870bd88d5e admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:00.399323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e88340-a71b-4c47-a0a5-df870bd88d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:00.401270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e88340-a71b-4c47-a0a5-df870bd88d5e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:00.406531 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2580/5211] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:51:00 2022] POST /identity/v3/roles => generated 244 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:00.407245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41c4ea-6a1a-401a-94d7-8a05337f6c04 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:00.408693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7e41c4ea-6a1a-401a-94d7-8a05337f6c04 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:00.423078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41c4ea-6a1a-401a-94d7-8a05337f6c04 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:00.428042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fba6be-9e64-4de8-a6c1-37297f7c3f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:00.428763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fba6be-9e64-4de8-a6c1-37297f7c3f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:00.429044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fba6be-9e64-4de8-a6c1-37297f7c3f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:00.429320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fba6be-9e64-4de8-a6c1-37297f7c3f29 admin admin] PATH_INFO: `/v3/projects/eb09c05d05e94499a231d232c57a523a/users/7439f25dc5e240dd91ec43194b1fe46a/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:00.432445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fba6be-9e64-4de8-a6c1-37297f7c3f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb09c05d05e94499a231d232c57a523a, user_id=7439f25dc5e240dd91ec43194b1fe46a, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:00.436384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fba6be-9e64-4de8-a6c1-37297f7c3f29 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:00.445497 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2581/5212] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:00 2022] PUT /identity/v3/projects/eb09c05d05e94499a231d232c57a523a/users/7439f25dc5e240dd91ec43194b1fe46a/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:00.447113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fba6be-9e64-4de8-a6c1-37297f7c3f29 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:00.448765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f2fba6be-9e64-4de8-a6c1-37297f7c3f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:00.497075 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2632/5213] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:00 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:00.497075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e88340-a71b-4c47-a0a5-df870bd88d5e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:00.497075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-34e88340-a71b-4c47-a0a5-df870bd88d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:00.509063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e88340-a71b-4c47-a0a5-df870bd88d5e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:00.521134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fba6be-9e64-4de8-a6c1-37297f7c3f29 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:00.526843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4f649-fbf1-438c-ba15-f4763ef791a3 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea19476d35a49908037d11d448e0fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55cae27d0bfc4f1b8857b8118e7dfeca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:00.527730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4f649-fbf1-438c-ba15-f4763ef791a3 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:00.528586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4f649-fbf1-438c-ba15-f4763ef791a3 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:00.528586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4f649-fbf1-438c-ba15-f4763ef791a3 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] PATH_INFO: `/v3/projects/b5caf923e3e54f07896bac99f47bc5ee` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:00.529650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4f649-fbf1-438c-ba15-f4763ef791a3 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b5caf923e3e54f07896bac99f47bc5ee)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:00.531634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4f649-fbf1-438c-ba15-f4763ef791a3 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:00.572577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a30ac-4e6f-4d20-8859-5d3f57460df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:00.573108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a30ac-4e6f-4d20-8859-5d3f57460df8 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:00.573385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a30ac-4e6f-4d20-8859-5d3f57460df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:00.573657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a30ac-4e6f-4d20-8859-5d3f57460df8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:00.574300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a30ac-4e6f-4d20-8859-5d3f57460df8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:00.574605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a30ac-4e6f-4d20-8859-5d3f57460df8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:00.576216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a30ac-4e6f-4d20-8859-5d3f57460df8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:00.589322 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2633/5214] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:00.590412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a30ac-4e6f-4d20-8859-5d3f57460df8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:00.592130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-498a30ac-4e6f-4d20-8859-5d3f57460df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:00.650945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:00.655943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a30ac-4e6f-4d20-8859-5d3f57460df8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:00.658386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e1a4f649-fbf1-438c-ba15-f4763ef791a3 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5caf923e3e54f07896bac99f47bc5ee', 'request_id': 'req-e1a4f649-fbf1-438c-ba15-f4763ef791a3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:00.663855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e1a4f649-fbf1-438c-ba15-f4763ef791a3 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5caf923e3e54f07896bac99f47bc5ee', 'request_id': 'req-e1a4f649-fbf1-438c-ba15-f4763ef791a3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:00.671112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e1a4f649-fbf1-438c-ba15-f4763ef791a3 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5caf923e3e54f07896bac99f47bc5ee', 'request_id': 'req-e1a4f649-fbf1-438c-ba15-f4763ef791a3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:00.709094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be8d09-9699-4a8e-b66a-eb162dfa0ac1 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55b99deebc74d6d933dfcb95c2e99d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2654d38f2ffc4e7ca353480bd695d219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:00.709777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be8d09-9699-4a8e-b66a-eb162dfa0ac1 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:00.710065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be8d09-9699-4a8e-b66a-eb162dfa0ac1 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:00.710340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be8d09-9699-4a8e-b66a-eb162dfa0ac1 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:00.710996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be8d09-9699-4a8e-b66a-eb162dfa0ac1 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorizing `identity:create_application_credential(user_id=b55b99deebc74d6d933dfcb95c2e99d0)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:00.712805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be8d09-9699-4a8e-b66a-eb162dfa0ac1 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:00.811662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e1a4f649-fbf1-438c-ba15-f4763ef791a3 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] The token cache is being invalidate because project b5caf923e3e54f07896bac99f47bc5ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:00.812047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e1a4f649-fbf1-438c-ba15-f4763ef791a3 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:00.812989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e1a4f649-fbf1-438c-ba15-f4763ef791a3 tempest-ProjectsNegativeTestJSON-738982775 tempest-ProjectsNegativeTestJSON-738982775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:00.814823 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2582/5215] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:00 2022] DELETE /identity/v3/projects/b5caf923e3e54f07896bac99f47bc5ee => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:00.816262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f105c-3926-4c9f-b848-e335aaeef1dd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:00.816610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f105c-3926-4c9f-b848-e335aaeef1dd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:00.817041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f105c-3926-4c9f-b848-e335aaeef1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:00.838218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ba5f105c-3926-4c9f-b848-e335aaeef1dd None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:00.839344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ba5f105c-3926-4c9f-b848-e335aaeef1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:00.900717 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2583/5216] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:00.901909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f105c-3926-4c9f-b848-e335aaeef1dd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:00.903156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ba5f105c-3926-4c9f-b848-e335aaeef1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:00.967915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f105c-3926-4c9f-b848-e335aaeef1dd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:00.973195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd194a-2d37-4ad0-b939-785f7f7f45d1 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:00.973803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd194a-2d37-4ad0-b939-785f7f7f45d1 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:00.974088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd194a-2d37-4ad0-b939-785f7f7f45d1 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:00.974366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd194a-2d37-4ad0-b939-785f7f7f45d1 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:00.975038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd194a-2d37-4ad0-b939-785f7f7f45d1 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:00.978677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd194a-2d37-4ad0-b939-785f7f7f45d1 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:00.985952 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2634/5217] 10.222.0.76 () {60 vars in 1314 bytes} [Sat Aug 27 04:51:00 2022] POST /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials => generated 788 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:00.988860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0176aee-a632-41f8-a0a3-9c0285f74001 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:00.988860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0176aee-a632-41f8-a0a3-9c0285f74001 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:00.988860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0176aee-a632-41f8-a0a3-9c0285f74001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:01.014087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d0176aee-a632-41f8-a0a3-9c0285f74001 None None] MFA Rules not processed for user `7439f25dc5e240dd91ec43194b1fe46a`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:01.015277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d0176aee-a632-41f8-a0a3-9c0285f74001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:01.054673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:01.084513 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2635/5218] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:01.085429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0176aee-a632-41f8-a0a3-9c0285f74001 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:01.087171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d0176aee-a632-41f8-a0a3-9c0285f74001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:01.099584 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2584/5219] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:51:00 2022] POST /identity/v3/roles => generated 247 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:01.099584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd194a-2d37-4ad0-b939-785f7f7f45d1 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:01.099584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1fbd194a-2d37-4ad0-b939-785f7f7f45d1 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:01.101175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0176aee-a632-41f8-a0a3-9c0285f74001 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:01.106504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d9185-2fda-4cb9-bea5-6292b78bf0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:01.107114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d9185-2fda-4cb9-bea5-6292b78bf0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:01.107393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d9185-2fda-4cb9-bea5-6292b78bf0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:01.107669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d9185-2fda-4cb9-bea5-6292b78bf0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:01.108349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d9185-2fda-4cb9-bea5-6292b78bf0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:01.109984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d9185-2fda-4cb9-bea5-6292b78bf0e1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:01.111286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd194a-2d37-4ad0-b939-785f7f7f45d1 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:01.115927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5e6d2-c52b-4db6-be62-928cca12b638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:01.116582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5e6d2-c52b-4db6-be62-928cca12b638 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:01.116859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5e6d2-c52b-4db6-be62-928cca12b638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:01.117133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5e6d2-c52b-4db6-be62-928cca12b638 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:01.117775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5e6d2-c52b-4db6-be62-928cca12b638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:01.119666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5e6d2-c52b-4db6-be62-928cca12b638 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:01.123908 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2636/5220] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:01 2022] GET /identity/v3/roles => generated 1893 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:01.123908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d9185-2fda-4cb9-bea5-6292b78bf0e1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:01.123908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ca5d9185-2fda-4cb9-bea5-6292b78bf0e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:01.136821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d9185-2fda-4cb9-bea5-6292b78bf0e1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:01.141464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c319ec3-a73a-4af9-9f4a-bafac4568291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:01.142071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c319ec3-a73a-4af9-9f4a-bafac4568291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:01.142348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c319ec3-a73a-4af9-9f4a-bafac4568291 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:01.142620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c319ec3-a73a-4af9-9f4a-bafac4568291 admin admin] PATH_INFO: `/v3/users/b0c9bfbd5ba24d30b9d70b8e28ec6b09` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:01.143774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c319ec3-a73a-4af9-9f4a-bafac4568291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0c9bfbd5ba24d30b9d70b8e28ec6b09)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:01.145667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c319ec3-a73a-4af9-9f4a-bafac4568291 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:01.222787 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2585/5221] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:01 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:01.224067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca06753-0c91-40c7-b4b9-6d891ddb4a79 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:01.224386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca06753-0c91-40c7-b4b9-6d891ddb4a79 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:01.224652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca06753-0c91-40c7-b4b9-6d891ddb4a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:01.244652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-dca06753-0c91-40c7-b4b9-6d891ddb4a79 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:01.249324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dca06753-0c91-40c7-b4b9-6d891ddb4a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:01.311176 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2586/5222] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:01.312037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca06753-0c91-40c7-b4b9-6d891ddb4a79 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:01.313391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dca06753-0c91-40c7-b4b9-6d891ddb4a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:01.371918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5c319ec3-a73a-4af9-9f4a-bafac4568291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0c9bfbd5ba24d30b9d70b8e28ec6b09'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:01.372528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5c319ec3-a73a-4af9-9f4a-bafac4568291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0c9bfbd5ba24d30b9d70b8e28ec6b09'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:01.381231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca06753-0c91-40c7-b4b9-6d891ddb4a79 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:01.386225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0bec8-9968-41d0-b53a-b5a2bcb47b77 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55b99deebc74d6d933dfcb95c2e99d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2654d38f2ffc4e7ca353480bd695d219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:01.386873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0bec8-9968-41d0-b53a-b5a2bcb47b77 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:01.387162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0bec8-9968-41d0-b53a-b5a2bcb47b77 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:01.387441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0bec8-9968-41d0-b53a-b5a2bcb47b77 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:01.388073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0bec8-9968-41d0-b53a-b5a2bcb47b77 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorizing `identity:list_application_credentials(user_id=b55b99deebc74d6d933dfcb95c2e99d0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:01.389756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0bec8-9968-41d0-b53a-b5a2bcb47b77 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:01.402807 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2587/5223] 10.222.0.76 () {58 vars in 1293 bytes} [Sat Aug 27 04:51:01 2022] GET /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials => generated 1500 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:01.408144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0bec8-9968-41d0-b53a-b5a2bcb47b77 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:01.461126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5c319ec3-a73a-4af9-9f4a-bafac4568291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0c9bfbd5ba24d30b9d70b8e28ec6b09'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:01.465200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0bec8-9968-41d0-b53a-b5a2bcb47b77 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:01.467474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5c319ec3-a73a-4af9-9f4a-bafac4568291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0c9bfbd5ba24d30b9d70b8e28ec6b09'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:01.470104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23c05c-7a99-4bf9-adf7-344e16a634e6 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7439f25dc5e240dd91ec43194b1fe46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb09c05d05e94499a231d232c57a523a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:01.470724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23c05c-7a99-4bf9-adf7-344e16a634e6 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:01.471009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23c05c-7a99-4bf9-adf7-344e16a634e6 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:01.471293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23c05c-7a99-4bf9-adf7-344e16a634e6 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:01.472663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23c05c-7a99-4bf9-adf7-344e16a634e6 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:01.473354 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-ed23c05c-7a99-4bf9-adf7-344e16a634e6 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:01.473354 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:01.473354 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:01.473892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23c05c-7a99-4bf9-adf7-344e16a634e6 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:01.481310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5c319ec3-a73a-4af9-9f4a-bafac4568291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0c9bfbd5ba24d30b9d70b8e28ec6b09'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:01.496858 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2637/5224] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:01 2022] DELETE /identity/v3/users/b0c9bfbd5ba24d30b9d70b8e28ec6b09 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:01.496858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c319ec3-a73a-4af9-9f4a-bafac4568291 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:01.496858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5c319ec3-a73a-4af9-9f4a-bafac4568291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:01.565079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c319ec3-a73a-4af9-9f4a-bafac4568291 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:01.569923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefdc8a-9fb7-4aad-a303-cecd511b40fc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:01.570587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefdc8a-9fb7-4aad-a303-cecd511b40fc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:01.571587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefdc8a-9fb7-4aad-a303-cecd511b40fc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:01.571825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefdc8a-9fb7-4aad-a303-cecd511b40fc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/0ad4cc39db7e4da082e154e6c719975e/users/967e3000eb5b4642aa37fb3d2d57eda4/roles/d4a471dad3c643bbba348d4b5fa93510` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:01.587637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefdc8a-9fb7-4aad-a303-cecd511b40fc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0ad4cc39db7e4da082e154e6c719975e, user_id=967e3000eb5b4642aa37fb3d2d57eda4, role_id=d4a471dad3c643bbba348d4b5fa93510)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:01.590346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefdc8a-9fb7-4aad-a303-cecd511b40fc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:01.594480 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2588/5225] 10.222.0.76 () {60 vars in 1185 bytes} [Sat Aug 27 04:51:01 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:01.595463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23c05c-7a99-4bf9-adf7-344e16a634e6 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:01.597106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ed23c05c-7a99-4bf9-adf7-344e16a634e6 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:01.611360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23c05c-7a99-4bf9-adf7-344e16a634e6 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:01.670447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f4546-fcee-4846-bc97-4a9806c92d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:01.671053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f4546-fcee-4846-bc97-4a9806c92d9f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:01.671330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f4546-fcee-4846-bc97-4a9806c92d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:01.671603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f4546-fcee-4846-bc97-4a9806c92d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:01.672274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f4546-fcee-4846-bc97-4a9806c92d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:01.673882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f4546-fcee-4846-bc97-4a9806c92d9f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:01.685411 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2589/5226] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:01 2022] GET /identity/v3/roles => generated 1893 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:01.686213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f4546-fcee-4846-bc97-4a9806c92d9f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:01.687962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4b1f4546-fcee-4846-bc97-4a9806c92d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:01.703874 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2638/5227] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:01 2022] PUT /identity/v3/projects/0ad4cc39db7e4da082e154e6c719975e/users/967e3000eb5b4642aa37fb3d2d57eda4/roles/d4a471dad3c643bbba348d4b5fa93510 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:01.703874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefdc8a-9fb7-4aad-a303-cecd511b40fc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:01.707801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f4546-fcee-4846-bc97-4a9806c92d9f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:01.713321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8cefdc8a-9fb7-4aad-a303-cecd511b40fc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:01.773145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7868a3-3a3f-4928-a091-92c2d6df82ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:01.780251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7868a3-3a3f-4928-a091-92c2d6df82ec admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:01.780251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7868a3-3a3f-4928-a091-92c2d6df82ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:01.780251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7868a3-3a3f-4928-a091-92c2d6df82ec admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:01.780251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7868a3-3a3f-4928-a091-92c2d6df82ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:01.780251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7868a3-3a3f-4928-a091-92c2d6df82ec admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:01.787511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefdc8a-9fb7-4aad-a303-cecd511b40fc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:01.793578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90208e2e-fc78-4d76-8bec-bceddb54b3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:01.794188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90208e2e-fc78-4d76-8bec-bceddb54b3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:01.794468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90208e2e-fc78-4d76-8bec-bceddb54b3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:01.794740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90208e2e-fc78-4d76-8bec-bceddb54b3f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:01.795381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90208e2e-fc78-4d76-8bec-bceddb54b3f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:01.795685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90208e2e-fc78-4d76-8bec-bceddb54b3f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:01.797339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90208e2e-fc78-4d76-8bec-bceddb54b3f0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:01.809936 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2639/5228] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:01.810760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90208e2e-fc78-4d76-8bec-bceddb54b3f0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:01.812444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-90208e2e-fc78-4d76-8bec-bceddb54b3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:01.874462 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2590/5229] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:01 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:01.874922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90208e2e-fc78-4d76-8bec-bceddb54b3f0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:01.875724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99803a5-5dd7-4d41-857e-e195c0d14d5b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:01.876011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99803a5-5dd7-4d41-857e-e195c0d14d5b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:01.876327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99803a5-5dd7-4d41-857e-e195c0d14d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:01.879275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b92cf1-8139-407b-8a93-99ca981e972b tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55b99deebc74d6d933dfcb95c2e99d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2654d38f2ffc4e7ca353480bd695d219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:01.879915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b92cf1-8139-407b-8a93-99ca981e972b tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:01.880220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b92cf1-8139-407b-8a93-99ca981e972b tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:01.880503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b92cf1-8139-407b-8a93-99ca981e972b tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials/6f3d5126bdf64dcb9f2de75c9e211b75` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:01.890605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b92cf1-8139-407b-8a93-99ca981e972b tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b55b99deebc74d6d933dfcb95c2e99d0, application_credential_id=6f3d5126bdf64dcb9f2de75c9e211b75)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:01.892045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b92cf1-8139-407b-8a93-99ca981e972b tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:01.895549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b99803a5-5dd7-4d41-857e-e195c0d14d5b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:01.896904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b99803a5-5dd7-4d41-857e-e195c0d14d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:01.904974 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2591/5230] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:01.905774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99803a5-5dd7-4d41-857e-e195c0d14d5b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:01.906988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b99803a5-5dd7-4d41-857e-e195c0d14d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:01.972612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99803a5-5dd7-4d41-857e-e195c0d14d5b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:01.977981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa1cc5-d59d-45c3-a92d-91b21b1e7ea3 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7439f25dc5e240dd91ec43194b1fe46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb09c05d05e94499a231d232c57a523a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:01.978716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa1cc5-d59d-45c3-a92d-91b21b1e7ea3 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:01.979006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa1cc5-d59d-45c3-a92d-91b21b1e7ea3 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:01.979287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa1cc5-d59d-45c3-a92d-91b21b1e7ea3 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f2bed53b448942b3ab2309d5f585857c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:01.979885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa1cc5-d59d-45c3-a92d-91b21b1e7ea3 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=f2bed53b448942b3ab2309d5f585857c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:01.980953 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-cafa1cc5-d59d-45c3-a92d-91b21b1e7ea3 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:01.980953 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:01.980953 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:01.981864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa1cc5-d59d-45c3-a92d-91b21b1e7ea3 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:01.988012 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2592/5231] 10.222.0.76 () {58 vars in 1263 bytes} [Sat Aug 27 04:51:01 2022] GET /identity/v3/OS-OAUTH1/consumers/f2bed53b448942b3ab2309d5f585857c => generated 221 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:01.988805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa1cc5-d59d-45c3-a92d-91b21b1e7ea3 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:01.999658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa1cc5-d59d-45c3-a92d-91b21b1e7ea3 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:02.006661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bd413-7884-4b25-ba8e-d82815cd8d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:02.006661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bd413-7884-4b25-ba8e-d82815cd8d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:02.006661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bd413-7884-4b25-ba8e-d82815cd8d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:02.006661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bd413-7884-4b25-ba8e-d82815cd8d71 admin admin] PATH_INFO: `/v3/projects/40339c1d2e2842cab5a9a143a40c0d8e/users/909ea3deb6b541d0b09ca961d4015a70/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:02.020028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116bd413-7884-4b25-ba8e-d82815cd8d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40339c1d2e2842cab5a9a143a40c0d8e, user_id=909ea3deb6b541d0b09ca961d4015a70, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:02.022755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116bd413-7884-4b25-ba8e-d82815cd8d71 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:02.030442 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2640/5232] 10.222.0.76 () {58 vars in 1395 bytes} [Sat Aug 27 04:51:01 2022] DELETE /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials/6f3d5126bdf64dcb9f2de75c9e211b75 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:02.031314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b92cf1-8139-407b-8a93-99ca981e972b tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:02.093047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b92cf1-8139-407b-8a93-99ca981e972b tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:02.096171 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2593/5233] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:01 2022] PUT /identity/v3/projects/40339c1d2e2842cab5a9a143a40c0d8e/users/909ea3deb6b541d0b09ca961d4015a70/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:02.097165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bd413-7884-4b25-ba8e-d82815cd8d71 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:02.154031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6b1bc-b6b0-430e-969b-d53662fb7a07 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:02.154605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6b1bc-b6b0-430e-969b-d53662fb7a07 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:02.154886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6b1bc-b6b0-430e-969b-d53662fb7a07 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:02.155159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6b1bc-b6b0-430e-969b-d53662fb7a07 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/0ad4cc39db7e4da082e154e6c719975e/users/967e3000eb5b4642aa37fb3d2d57eda4/roles/e2d466304dd4488ba38e48e5c4daa8bf` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:02.157426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6b1bc-b6b0-430e-969b-d53662fb7a07 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0ad4cc39db7e4da082e154e6c719975e, user_id=967e3000eb5b4642aa37fb3d2d57eda4, role_id=e2d466304dd4488ba38e48e5c4daa8bf)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:02.160040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6b1bc-b6b0-430e-969b-d53662fb7a07 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:02.170478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bd413-7884-4b25-ba8e-d82815cd8d71 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:02.175324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64042fd-8866-4867-a234-d7d431195628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:02.175928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64042fd-8866-4867-a234-d7d431195628 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:02.176241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64042fd-8866-4867-a234-d7d431195628 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:02.176522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64042fd-8866-4867-a234-d7d431195628 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:02.177158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64042fd-8866-4867-a234-d7d431195628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:02.179075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64042fd-8866-4867-a234-d7d431195628 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:02.250867 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2641/5234] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:02 2022] PUT /identity/v3/projects/0ad4cc39db7e4da082e154e6c719975e/users/967e3000eb5b4642aa37fb3d2d57eda4/roles/e2d466304dd4488ba38e48e5c4daa8bf => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:02.251789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6b1bc-b6b0-430e-969b-d53662fb7a07 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:02.274962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:02.282487 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2594/5235] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:02 2022] POST /identity/v3/projects => generated 369 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:02.283084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64042fd-8866-4867-a234-d7d431195628 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:02.284665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c64042fd-8866-4867-a234-d7d431195628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:02.317541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6b1bc-b6b0-430e-969b-d53662fb7a07 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:02.343674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64042fd-8866-4867-a234-d7d431195628 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:02.347590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a040556-49f8-47f2-aeeb-47a2f5cce2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:02.348361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a040556-49f8-47f2-aeeb-47a2f5cce2bc service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:02.348650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a040556-49f8-47f2-aeeb-47a2f5cce2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:02.348931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a040556-49f8-47f2-aeeb-47a2f5cce2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:02.374668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf07965-bbf1-4a58-97d8-d860231dd16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:02.375322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf07965-bbf1-4a58-97d8-d860231dd16b admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:02.375737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf07965-bbf1-4a58-97d8-d860231dd16b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:02.376019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf07965-bbf1-4a58-97d8-d860231dd16b admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:02.376700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf07965-bbf1-4a58-97d8-d860231dd16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:02.378378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf07965-bbf1-4a58-97d8-d860231dd16b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:02.389556 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2642/5236] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:02 2022] GET /identity/v3/roles => generated 1893 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:02.392864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf07965-bbf1-4a58-97d8-d860231dd16b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:02.414523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a040556-49f8-47f2-aeeb-47a2f5cce2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:02.416672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a040556-49f8-47f2-aeeb-47a2f5cce2bc service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:02.426878 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2595/5237] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:02.427470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a040556-49f8-47f2-aeeb-47a2f5cce2bc service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:02.442889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=1,keystone:SELECT=98,keystone:UPDATE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:02.459002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf07965-bbf1-4a58-97d8-d860231dd16b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:02.464811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66b335-0553-431c-9e64-2bfb00150a8d tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7439f25dc5e240dd91ec43194b1fe46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb09c05d05e94499a231d232c57a523a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:02.465462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66b335-0553-431c-9e64-2bfb00150a8d tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:02.465755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66b335-0553-431c-9e64-2bfb00150a8d tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:02.466037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66b335-0553-431c-9e64-2bfb00150a8d tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f2bed53b448942b3ab2309d5f585857c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:02.466633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66b335-0553-431c-9e64-2bfb00150a8d tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=f2bed53b448942b3ab2309d5f585857c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:02.467658 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-ca66b335-0553-431c-9e64-2bfb00150a8d tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:02.467658 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:02.467658 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:02.468743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66b335-0553-431c-9e64-2bfb00150a8d tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:02.469025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ca66b335-0553-431c-9e64-2bfb00150a8d tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invalidating token cache because consumer f2bed53b448942b3ab2309d5f585857c has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:02.469321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ca66b335-0553-431c-9e64-2bfb00150a8d tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:02.470031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ca66b335-0553-431c-9e64-2bfb00150a8d tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:02.493214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a040556-49f8-47f2-aeeb-47a2f5cce2bc service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:02.500271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01dafe-0266-4850-ab16-05c73c41a14c tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55b99deebc74d6d933dfcb95c2e99d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2654d38f2ffc4e7ca353480bd695d219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:02.500929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01dafe-0266-4850-ab16-05c73c41a14c tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:02.501213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01dafe-0266-4850-ab16-05c73c41a14c tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:02.501498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01dafe-0266-4850-ab16-05c73c41a14c tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials/f3e40235e3504eceb5187010f3768b66` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:02.510849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01dafe-0266-4850-ab16-05c73c41a14c tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b55b99deebc74d6d933dfcb95c2e99d0, application_credential_id=f3e40235e3504eceb5187010f3768b66)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:02.512418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01dafe-0266-4850-ab16-05c73c41a14c tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:02.609526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ca66b335-0553-431c-9e64-2bfb00150a8d tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'f2bed53b448942b3ab2309d5f585857c', 'request_id': 'req-ca66b335-0553-431c-9e64-2bfb00150a8d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:02.616629 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2596/5238] 10.222.0.76 () {58 vars in 1395 bytes} [Sat Aug 27 04:51:02 2022] DELETE /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials/f3e40235e3504eceb5187010f3768b66 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:02.618267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4b99b-91a6-4846-825c-6f61bb8b40a4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:02.620932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4b99b-91a6-4846-825c-6f61bb8b40a4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:02.620932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4b99b-91a6-4846-825c-6f61bb8b40a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:02.649859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-56e4b99b-91a6-4846-825c-6f61bb8b40a4 None None] MFA Rules not processed for user `909ea3deb6b541d0b09ca961d4015a70`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:02.651117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-56e4b99b-91a6-4846-825c-6f61bb8b40a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:02.725161 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2597/5240] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:02.725161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4b99b-91a6-4846-825c-6f61bb8b40a4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:02.725992 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2643/5240] 10.222.0.76 () {58 vars in 1266 bytes} [Sat Aug 27 04:51:02 2022] DELETE /identity/v3/OS-OAUTH1/consumers/f2bed53b448942b3ab2309d5f585857c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:02.727902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-56e4b99b-91a6-4846-825c-6f61bb8b40a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:02.728111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66b335-0553-431c-9e64-2bfb00150a8d tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:02.729391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ca66b335-0553-431c-9e64-2bfb00150a8d tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:02.743588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66b335-0553-431c-9e64-2bfb00150a8d tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:02.749023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f070350-9d21-47b7-b759-9c3c2ecda3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:02.749733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f070350-9d21-47b7-b759-9c3c2ecda3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:02.750083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f070350-9d21-47b7-b759-9c3c2ecda3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:02.750432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f070350-9d21-47b7-b759-9c3c2ecda3e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:02.751074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f070350-9d21-47b7-b759-9c3c2ecda3e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:02.753105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f070350-9d21-47b7-b759-9c3c2ecda3e3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:02.813577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4b99b-91a6-4846-825c-6f61bb8b40a4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:02.818368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5702fcf-8c3d-4521-84da-1cdd49911881 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:02.818998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5702fcf-8c3d-4521-84da-1cdd49911881 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:02.819337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5702fcf-8c3d-4521-84da-1cdd49911881 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:02.819611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5702fcf-8c3d-4521-84da-1cdd49911881 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:02.820299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5702fcf-8c3d-4521-84da-1cdd49911881 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:02.821909 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-c5702fcf-8c3d-4521-84da-1cdd49911881 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:02.821909 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:02.821909 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:02.823167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5702fcf-8c3d-4521-84da-1cdd49911881 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:02.864814 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2598/5241] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:02 2022] GET /identity/v3/users => generated 8065 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:02.865558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5702fcf-8c3d-4521-84da-1cdd49911881 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:02.869572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c5702fcf-8c3d-4521-84da-1cdd49911881 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:02.884263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5702fcf-8c3d-4521-84da-1cdd49911881 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:02.889039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2f8f8-22cb-4fb8-b881-781cf6e30c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:02.889635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2f8f8-22cb-4fb8-b881-781cf6e30c40 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:02.889915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2f8f8-22cb-4fb8-b881-781cf6e30c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:02.890186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2f8f8-22cb-4fb8-b881-781cf6e30c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:02.890823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2f8f8-22cb-4fb8-b881-781cf6e30c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:02.892492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2f8f8-22cb-4fb8-b881-781cf6e30c40 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:02.903859 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2599/5242] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:02 2022] GET /identity/v3/roles => generated 1893 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:02.904718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2f8f8-22cb-4fb8-b881-781cf6e30c40 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:02.906288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-67c2f8f8-22cb-4fb8-b881-781cf6e30c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:02.919049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2f8f8-22cb-4fb8-b881-781cf6e30c40 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:02.923324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f3f3b-e96f-4ea5-bede-367e5fa86169 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55b99deebc74d6d933dfcb95c2e99d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2654d38f2ffc4e7ca353480bd695d219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:02.923923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f3f3b-e96f-4ea5-bede-367e5fa86169 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:02.924241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f3f3b-e96f-4ea5-bede-367e5fa86169 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:02.924525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f3f3b-e96f-4ea5-bede-367e5fa86169 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:02.925315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f3f3b-e96f-4ea5-bede-367e5fa86169 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorizing `identity:create_application_credential(user_id=b55b99deebc74d6d933dfcb95c2e99d0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:02.926385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f3f3b-e96f-4ea5-bede-367e5fa86169 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:02.973044 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2644/5243] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:02 2022] POST /identity/v3/users => generated 285 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:02.974049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f070350-9d21-47b7-b759-9c3c2ecda3e3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:02.975774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8f070350-9d21-47b7-b759-9c3c2ecda3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:02.989593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f070350-9d21-47b7-b759-9c3c2ecda3e3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:02.994601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2514e83-5545-49ba-94b6-40aeced13aee tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7439f25dc5e240dd91ec43194b1fe46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb09c05d05e94499a231d232c57a523a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:02.995222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2514e83-5545-49ba-94b6-40aeced13aee tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:02.995504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2514e83-5545-49ba-94b6-40aeced13aee tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:02.995781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2514e83-5545-49ba-94b6-40aeced13aee tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:02.996450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2514e83-5545-49ba-94b6-40aeced13aee tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:02.997485 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-e2514e83-5545-49ba-94b6-40aeced13aee tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:02.997485 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:02.997485 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:02.998368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2514e83-5545-49ba-94b6-40aeced13aee tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:03.127812 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2600/5244] 10.222.0.76 () {60 vars in 1314 bytes} [Sat Aug 27 04:51:02 2022] POST /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials => generated 788 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:03.128752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f3f3b-e96f-4ea5-bede-367e5fa86169 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:03.130319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a48f3f3b-e96f-4ea5-bede-367e5fa86169 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:03.141727 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2645/5245] 10.222.0.76 () {60 vars in 1185 bytes} [Sat Aug 27 04:51:02 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:03.143206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8177f5-7787-4960-beb9-656307a609aa None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:03.143488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8177f5-7787-4960-beb9-656307a609aa None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:03.143758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8177f5-7787-4960-beb9-656307a609aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:03.148619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f3f3b-e96f-4ea5-bede-367e5fa86169 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:03.153940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a4894-62fc-4a53-baa9-3849d4f1a414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:03.154720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a4894-62fc-4a53-baa9-3849d4f1a414 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:03.155089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a4894-62fc-4a53-baa9-3849d4f1a414 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:03.155458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a4894-62fc-4a53-baa9-3849d4f1a414 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:03.156233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a4894-62fc-4a53-baa9-3849d4f1a414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:03.158257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a4894-62fc-4a53-baa9-3849d4f1a414 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:03.186745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3f8177f5-7787-4960-beb9-656307a609aa None None] MFA Rules not processed for user `967e3000eb5b4642aa37fb3d2d57eda4`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:03.187891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3f8177f5-7787-4960-beb9-656307a609aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:03.262315 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2646/5246] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:03 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:03.262315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8177f5-7787-4960-beb9-656307a609aa None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:03.265220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8177f5-7787-4960-beb9-656307a609aa None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:03.269812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fee760-889c-418d-9b15-0e0b21266529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:03.270454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fee760-889c-418d-9b15-0e0b21266529 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:03.270733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fee760-889c-418d-9b15-0e0b21266529 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:03.271005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fee760-889c-418d-9b15-0e0b21266529 admin admin] PATH_INFO: `/v3/projects/7b3645ed00d94f47b69ffbab3ee73850/users/9a05d8e7d917402fae37644094dd2aef/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:03.286583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fee760-889c-418d-9b15-0e0b21266529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3645ed00d94f47b69ffbab3ee73850, user_id=9a05d8e7d917402fae37644094dd2aef, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:03.288881 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2601/5247] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:03 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:03.289332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fee760-889c-418d-9b15-0e0b21266529 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:03.289637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a4894-62fc-4a53-baa9-3849d4f1a414 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:03.353351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a4894-62fc-4a53-baa9-3849d4f1a414 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:03.358113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdca91-41c3-41bf-ab18-965b2225974b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:03.358718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdca91-41c3-41bf-ab18-965b2225974b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:03.359003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdca91-41c3-41bf-ab18-965b2225974b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:03.359280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdca91-41c3-41bf-ab18-965b2225974b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:03.359917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdca91-41c3-41bf-ab18-965b2225974b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:03.361565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdca91-41c3-41bf-ab18-965b2225974b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:03.372698 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2602/5248] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:03 2022] GET /identity/v3/roles => generated 1893 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:03.373492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdca91-41c3-41bf-ab18-965b2225974b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:03.375173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-58fdca91-41c3-41bf-ab18-965b2225974b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:03.381543 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2647/5249] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:03 2022] PUT /identity/v3/projects/7b3645ed00d94f47b69ffbab3ee73850/users/9a05d8e7d917402fae37644094dd2aef/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:03.382546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fee760-889c-418d-9b15-0e0b21266529 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:03.390027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdca91-41c3-41bf-ab18-965b2225974b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:03.451306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fee760-889c-418d-9b15-0e0b21266529 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:03.451703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da87045-9e41-4d54-ab62-523d92133afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:03.452408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da87045-9e41-4d54-ab62-523d92133afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:03.452694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da87045-9e41-4d54-ab62-523d92133afa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:03.453034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da87045-9e41-4d54-ab62-523d92133afa admin admin] PATH_INFO: `/v3/projects/f1044294cc6343e48ffa3de8f6cd6c50` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:03.454104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da87045-9e41-4d54-ab62-523d92133afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1044294cc6343e48ffa3de8f6cd6c50)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:03.455750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31009175-198c-415a-a726-9db2ec9310dc tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55b99deebc74d6d933dfcb95c2e99d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2654d38f2ffc4e7ca353480bd695d219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:03.456064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da87045-9e41-4d54-ab62-523d92133afa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:03.456408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31009175-198c-415a-a726-9db2ec9310dc tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:03.456692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31009175-198c-415a-a726-9db2ec9310dc tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:03.456990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31009175-198c-415a-a726-9db2ec9310dc tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:03.457764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31009175-198c-415a-a726-9db2ec9310dc tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorizing `identity:create_application_credential(user_id=b55b99deebc74d6d933dfcb95c2e99d0)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:03.458895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31009175-198c-415a-a726-9db2ec9310dc tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:03.656519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7da87045-9e41-4d54-ab62-523d92133afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1044294cc6343e48ffa3de8f6cd6c50', 'request_id': 'req-7da87045-9e41-4d54-ab62-523d92133afa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:03.662031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7da87045-9e41-4d54-ab62-523d92133afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1044294cc6343e48ffa3de8f6cd6c50', 'request_id': 'req-7da87045-9e41-4d54-ab62-523d92133afa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:03.668213 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2648/5250] 10.222.0.76 () {60 vars in 1314 bytes} [Sat Aug 27 04:51:03 2022] POST /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials => generated 789 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:03.669049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31009175-198c-415a-a726-9db2ec9310dc tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:03.669638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7da87045-9e41-4d54-ab62-523d92133afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1044294cc6343e48ffa3de8f6cd6c50', 'request_id': 'req-7da87045-9e41-4d54-ab62-523d92133afa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:03.735794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31009175-198c-415a-a726-9db2ec9310dc tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:03.781145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7da87045-9e41-4d54-ab62-523d92133afa admin admin] The token cache is being invalidate because project f1044294cc6343e48ffa3de8f6cd6c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:03.781443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7da87045-9e41-4d54-ab62-523d92133afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:03.782104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7da87045-9e41-4d54-ab62-523d92133afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:03.783728 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2603/5251] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:03 2022] DELETE /identity/v3/projects/f1044294cc6343e48ffa3de8f6cd6c50 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:03.784981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd05b9e-1f15-47b9-86c6-8281d33efeeb None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:03.785269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd05b9e-1f15-47b9-86c6-8281d33efeeb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:03.785568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd05b9e-1f15-47b9-86c6-8281d33efeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:03.792630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2def1db-725c-43f2-ba46-f5d696306d31 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7439f25dc5e240dd91ec43194b1fe46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb09c05d05e94499a231d232c57a523a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:03.793401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2def1db-725c-43f2-ba46-f5d696306d31 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:03.793683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2def1db-725c-43f2-ba46-f5d696306d31 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:03.793952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2def1db-725c-43f2-ba46-f5d696306d31 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/91215c83d55e4b9bbe436192698517e6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:03.794594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2def1db-725c-43f2-ba46-f5d696306d31 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=91215c83d55e4b9bbe436192698517e6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:03.795734 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-a2def1db-725c-43f2-ba46-f5d696306d31 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:03.795734 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:03.795734 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:03.796676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2def1db-725c-43f2-ba46-f5d696306d31 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:03.804364 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2649/5252] 10.222.0.76 () {58 vars in 1263 bytes} [Sat Aug 27 04:51:03 2022] GET /identity/v3/OS-OAUTH1/consumers/91215c83d55e4b9bbe436192698517e6 => generated 220 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:03.804364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2def1db-725c-43f2-ba46-f5d696306d31 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:03.804364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a2def1db-725c-43f2-ba46-f5d696306d31 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:03.807445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bcd05b9e-1f15-47b9-86c6-8281d33efeeb None None] MFA Rules not processed for user `967e3000eb5b4642aa37fb3d2d57eda4`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:03.808869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bcd05b9e-1f15-47b9-86c6-8281d33efeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:03.866972 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2604/5253] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:03 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:03.868755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd05b9e-1f15-47b9-86c6-8281d33efeeb None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:03.870253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bcd05b9e-1f15-47b9-86c6-8281d33efeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:03.872802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2def1db-725c-43f2-ba46-f5d696306d31 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:03.878326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c029b8c-c0ae-4bb5-95df-1319cff909c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:03.879461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c029b8c-c0ae-4bb5-95df-1319cff909c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:03.879461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c029b8c-c0ae-4bb5-95df-1319cff909c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:03.879664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c029b8c-c0ae-4bb5-95df-1319cff909c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:03.880398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c029b8c-c0ae-4bb5-95df-1319cff909c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:03.882311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c029b8c-c0ae-4bb5-95df-1319cff909c0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:03.887011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd05b9e-1f15-47b9-86c6-8281d33efeeb None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:03.893367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f0f3e-6d23-43b5-920b-ff81534f0d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:03.894113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f0f3e-6d23-43b5-920b-ff81534f0d28 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:03.894456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f0f3e-6d23-43b5-920b-ff81534f0d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:03.894787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f0f3e-6d23-43b5-920b-ff81534f0d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:03.896719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f0f3e-6d23-43b5-920b-ff81534f0d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:03.897561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f0f3e-6d23-43b5-920b-ff81534f0d28 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:03.910743 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2605/5254] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:03 2022] GET /identity/v3/roles => generated 1893 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:03.912251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7369a-ed8b-41ed-b408-47026820ce26 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:03.912543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7369a-ed8b-41ed-b408-47026820ce26 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:03.922246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7369a-ed8b-41ed-b408-47026820ce26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:03.932981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2de7369a-ed8b-41ed-b408-47026820ce26 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:03.934199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2de7369a-ed8b-41ed-b408-47026820ce26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:03.943495 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2606/5255] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:03.944318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7369a-ed8b-41ed-b408-47026820ce26 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:03.945643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2de7369a-ed8b-41ed-b408-47026820ce26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:04.006148 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2650/5256] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:03 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:04.006148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c029b8c-c0ae-4bb5-95df-1319cff909c0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:04.010245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1c029b8c-c0ae-4bb5-95df-1319cff909c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:04.021261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c029b8c-c0ae-4bb5-95df-1319cff909c0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:04.028916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6cb5a-16f2-44c7-9079-b3e332fe84e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:04.029563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6cb5a-16f2-44c7-9079-b3e332fe84e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:04.029855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6cb5a-16f2-44c7-9079-b3e332fe84e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:04.030134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6cb5a-16f2-44c7-9079-b3e332fe84e8 admin admin] PATH_INFO: `/v3/users/3ea19476d35a49908037d11d448e0fe4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:04.031496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6cb5a-16f2-44c7-9079-b3e332fe84e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ea19476d35a49908037d11d448e0fe4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:04.032935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7369a-ed8b-41ed-b408-47026820ce26 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:04.033716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6cb5a-16f2-44c7-9079-b3e332fe84e8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:04.037588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb193438-eaef-455e-b5d2-fdf8f8d82ffb tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55b99deebc74d6d933dfcb95c2e99d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2654d38f2ffc4e7ca353480bd695d219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:04.038274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb193438-eaef-455e-b5d2-fdf8f8d82ffb tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:04.038559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb193438-eaef-455e-b5d2-fdf8f8d82ffb tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:04.038845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb193438-eaef-455e-b5d2-fdf8f8d82ffb tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:04.039496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb193438-eaef-455e-b5d2-fdf8f8d82ffb tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Adding query filter params (name=tempest-application_credential-1901119832) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:04.040489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb193438-eaef-455e-b5d2-fdf8f8d82ffb tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorizing `identity:list_application_credentials(user_id=b55b99deebc74d6d933dfcb95c2e99d0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:04.042534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb193438-eaef-455e-b5d2-fdf8f8d82ffb tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:04.053300 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2607/5257] 10.222.0.76 () {58 vars in 1386 bytes} [Sat Aug 27 04:51:03 2022] GET /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials?name=tempest-application_credential-1901119832 => generated 887 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:04.054192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb193438-eaef-455e-b5d2-fdf8f8d82ffb tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:04.059042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cb193438-eaef-455e-b5d2-fdf8f8d82ffb tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:04.074844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb193438-eaef-455e-b5d2-fdf8f8d82ffb tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:04.079642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47568742-9904-4758-873b-e8c131bf0c84 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7439f25dc5e240dd91ec43194b1fe46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb09c05d05e94499a231d232c57a523a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:04.080308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47568742-9904-4758-873b-e8c131bf0c84 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:04.080597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47568742-9904-4758-873b-e8c131bf0c84 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:04.080886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47568742-9904-4758-873b-e8c131bf0c84 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/91215c83d55e4b9bbe436192698517e6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:04.081476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47568742-9904-4758-873b-e8c131bf0c84 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=91215c83d55e4b9bbe436192698517e6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:04.082543 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-47568742-9904-4758-873b-e8c131bf0c84 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:04.082543 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:04.082543 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:04.083441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47568742-9904-4758-873b-e8c131bf0c84 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:04.083731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-47568742-9904-4758-873b-e8c131bf0c84 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invalidating token cache because consumer 91215c83d55e4b9bbe436192698517e6 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:04.084009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-47568742-9904-4758-873b-e8c131bf0c84 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:04.084730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-47568742-9904-4758-873b-e8c131bf0c84 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:04.206402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-47568742-9904-4758-873b-e8c131bf0c84 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '91215c83d55e4b9bbe436192698517e6', 'request_id': 'req-47568742-9904-4758-873b-e8c131bf0c84'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:04.350320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1ac6cb5a-16f2-44c7-9079-b3e332fe84e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ea19476d35a49908037d11d448e0fe4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:04.350899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1ac6cb5a-16f2-44c7-9079-b3e332fe84e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ea19476d35a49908037d11d448e0fe4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:04.455921 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2608/5258] 10.222.0.76 () {58 vars in 1266 bytes} [Sat Aug 27 04:51:04 2022] DELETE /identity/v3/OS-OAUTH1/consumers/91215c83d55e4b9bbe436192698517e6 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:04.456790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47568742-9904-4758-873b-e8c131bf0c84 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:04.458075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-47568742-9904-4758-873b-e8c131bf0c84 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:04.472112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47568742-9904-4758-873b-e8c131bf0c84 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:04.476196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec43ee-6569-4163-8e76-1ffccbef25f1 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '967e3000eb5b4642aa37fb3d2d57eda4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ad4cc39db7e4da082e154e6c719975e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1559163905', 'tempest-NotDelegatedRole-1994180755'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:04.476792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec43ee-6569-4163-8e76-1ffccbef25f1 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:04.477155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec43ee-6569-4163-8e76-1ffccbef25f1 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:04.477940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec43ee-6569-4163-8e76-1ffccbef25f1 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:04.478608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec43ee-6569-4163-8e76-1ffccbef25f1 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: Authorizing `identity:create_trust()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:04.479767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec43ee-6569-4163-8e76-1ffccbef25f1 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:04.544701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1ac6cb5a-16f2-44c7-9079-b3e332fe84e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ea19476d35a49908037d11d448e0fe4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:04.545431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1ac6cb5a-16f2-44c7-9079-b3e332fe84e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ea19476d35a49908037d11d448e0fe4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:04.560622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1ac6cb5a-16f2-44c7-9079-b3e332fe84e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ea19476d35a49908037d11d448e0fe4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:04.574162 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2651/5259] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:04 2022] DELETE /identity/v3/users/3ea19476d35a49908037d11d448e0fe4 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:04.574981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6cb5a-16f2-44c7-9079-b3e332fe84e8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:04.576636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1ac6cb5a-16f2-44c7-9079-b3e332fe84e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:04.630478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:04.650229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6cb5a-16f2-44c7-9079-b3e332fe84e8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:04.657368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e75e1-b0f1-4bae-95fc-a2018854d45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:04.658183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e75e1-b0f1-4bae-95fc-a2018854d45b admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:04.658555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e75e1-b0f1-4bae-95fc-a2018854d45b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:04.658923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e75e1-b0f1-4bae-95fc-a2018854d45b admin admin] PATH_INFO: `/v3/projects/11151118b7d14bb38c65f8f3de18c1f9/users/327fd257218b4985b02fb0367db576de/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:04.678867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e75e1-b0f1-4bae-95fc-a2018854d45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=11151118b7d14bb38c65f8f3de18c1f9, user_id=327fd257218b4985b02fb0367db576de, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:04.682557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e75e1-b0f1-4bae-95fc-a2018854d45b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:04.705211 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2609/5260] 10.222.0.76 () {60 vars in 1174 bytes} [Sat Aug 27 04:51:04 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:04.705211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec43ee-6569-4163-8e76-1ffccbef25f1 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:04.705211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-62ec43ee-6569-4163-8e76-1ffccbef25f1 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:04.756848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec43ee-6569-4163-8e76-1ffccbef25f1 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:04.799187 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2652/5261] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:04 2022] PUT /identity/v3/projects/11151118b7d14bb38c65f8f3de18c1f9/users/327fd257218b4985b02fb0367db576de/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:04.800100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e75e1-b0f1-4bae-95fc-a2018854d45b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:04.801904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d25e75e1-b0f1-4bae-95fc-a2018854d45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:04.817097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c498b-370b-448e-a2b1-0076c9538640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:04.817850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c498b-370b-448e-a2b1-0076c9538640 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:04.818151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c498b-370b-448e-a2b1-0076c9538640 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:04.818406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c498b-370b-448e-a2b1-0076c9538640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:04.820280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-606c498b-370b-448e-a2b1-0076c9538640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:04.833863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c498b-370b-448e-a2b1-0076c9538640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:04.835309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c498b-370b-448e-a2b1-0076c9538640 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:04.847322 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2610/5262] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:04.848348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c498b-370b-448e-a2b1-0076c9538640 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:04.849691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-606c498b-370b-448e-a2b1-0076c9538640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:04.890121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e75e1-b0f1-4bae-95fc-a2018854d45b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:04.895221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b4ea0-3e81-4816-9fe6-de8c6d95ab2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:04.895906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b4ea0-3e81-4816-9fe6-de8c6d95ab2a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:04.896226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b4ea0-3e81-4816-9fe6-de8c6d95ab2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:04.896506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b4ea0-3e81-4816-9fe6-de8c6d95ab2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:04.897142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b4ea0-3e81-4816-9fe6-de8c6d95ab2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:04.898768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b4ea0-3e81-4816-9fe6-de8c6d95ab2a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:04.911533 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2653/5263] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:04 2022] GET /identity/v3/roles => generated 1893 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:04.912679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b4ea0-3e81-4816-9fe6-de8c6d95ab2a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:04.915342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-624b4ea0-3e81-4816-9fe6-de8c6d95ab2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:04.925152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c498b-370b-448e-a2b1-0076c9538640 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:04.995992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cd553-e337-429f-9847-faa78695e0e9 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55b99deebc74d6d933dfcb95c2e99d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2654d38f2ffc4e7ca353480bd695d219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:04.996676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cd553-e337-429f-9847-faa78695e0e9 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:04.996958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cd553-e337-429f-9847-faa78695e0e9 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:04.997231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cd553-e337-429f-9847-faa78695e0e9 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials/17db277f11564cb1b06689739f088962` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:04.997366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b4ea0-3e81-4816-9fe6-de8c6d95ab2a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:05.001915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb464df-9df1-456b-976c-ea8e19d326af tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7439f25dc5e240dd91ec43194b1fe46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb09c05d05e94499a231d232c57a523a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:05.002546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb464df-9df1-456b-976c-ea8e19d326af tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:05.002961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb464df-9df1-456b-976c-ea8e19d326af tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:05.003243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb464df-9df1-456b-976c-ea8e19d326af tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/91215c83d55e4b9bbe436192698517e6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:05.003826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb464df-9df1-456b-976c-ea8e19d326af tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=91215c83d55e4b9bbe436192698517e6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:05.005448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb464df-9df1-456b-976c-ea8e19d326af tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:05.005713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cd553-e337-429f-9847-faa78695e0e9 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b55b99deebc74d6d933dfcb95c2e99d0, application_credential_id=17db277f11564cb1b06689739f088962)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:05.007254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cd553-e337-429f-9847-faa78695e0e9 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:05.021283 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-deb464df-9df1-456b-976c-ea8e19d326af tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 27 04:51:05.021283 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:05.021283 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:05.021283 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:05.021283 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:05.021283 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:05.021283 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:05.021283 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:05.021283 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:05.021283 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:05.021283 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:05.021283 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:05.021283 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Aug 27 04:51:05.021283 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Aug 27 04:51:05.021283 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Aug 27 04:51:05.023931 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Aug 27 04:51:05.023931 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Aug 27 04:51:05.023931 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Aug 27 04:51:05.023931 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Aug 27 04:51:05.023931 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 27 04:51:05.023931 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 27 04:51:05.023931 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 27 04:51:05.023931 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 27 04:51:05.023931 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:51:05.023931 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2654/5264] 10.222.0.76 () {58 vars in 1263 bytes} [Sat Aug 27 04:51:04 2022] GET /identity/v3/OS-OAUTH1/consumers/91215c83d55e4b9bbe436192698517e6 => generated 74 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:51:05.023931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb464df-9df1-456b-976c-ea8e19d326af tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:05.025587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-deb464df-9df1-456b-976c-ea8e19d326af tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:05.090975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb464df-9df1-456b-976c-ea8e19d326af tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:05.095036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870864f2-cf47-4b7c-a2c9-e6863eabbafe tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '967e3000eb5b4642aa37fb3d2d57eda4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ad4cc39db7e4da082e154e6c719975e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1559163905', 'tempest-NotDelegatedRole-1994180755'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:05.095764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870864f2-cf47-4b7c-a2c9-e6863eabbafe tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:05.096006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870864f2-cf47-4b7c-a2c9-e6863eabbafe tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:05.096305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870864f2-cf47-4b7c-a2c9-e6863eabbafe tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] PATH_INFO: `/v3/OS-TRUST/trusts/ce640e025fc54ae88a09d0c59039f730` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:05.103042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870864f2-cf47-4b7c-a2c9-e6863eabbafe tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: Authorizing `identity:get_trust(trust_id=ce640e025fc54ae88a09d0c59039f730)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:05.104697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870864f2-cf47-4b7c-a2c9-e6863eabbafe tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:05.114951 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2655/5265] 10.222.0.76 () {58 vars in 1251 bytes} [Sat Aug 27 04:51:05 2022] GET /identity/v3/OS-TRUST/trusts/ce640e025fc54ae88a09d0c59039f730 => generated 859 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:05.114951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b420-6614-4636-8d1b-8818e8a041a1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:05.114951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b420-6614-4636-8d1b-8818e8a041a1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:05.114951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b420-6614-4636-8d1b-8818e8a041a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:05.141687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9561b420-6614-4636-8d1b-8818e8a041a1 None None] MFA Rules not processed for user `327fd257218b4985b02fb0367db576de`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:05.142824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9561b420-6614-4636-8d1b-8818e8a041a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:05.196330 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2611/5266] 10.222.0.76 () {58 vars in 1395 bytes} [Sat Aug 27 04:51:04 2022] DELETE /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials/17db277f11564cb1b06689739f088962 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:05.197885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cd553-e337-429f-9847-faa78695e0e9 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:05.217635 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2656/5267] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:05.218594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561b420-6614-4636-8d1b-8818e8a041a1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:05.225197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cd553-e337-429f-9847-faa78695e0e9 tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:05.232533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561b420-6614-4636-8d1b-8818e8a041a1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:05.234029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeed611-616d-42d7-8be3-23a3c5bbaa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:05.235135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeed611-616d-42d7-8be3-23a3c5bbaa57 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:05.235693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeed611-616d-42d7-8be3-23a3c5bbaa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:05.236240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeed611-616d-42d7-8be3-23a3c5bbaa57 admin admin] PATH_INFO: `/v3/projects/2360b3d1e3f94b11aca87c33f8ecd790/users/4174797552a64d53b52e3d387f1af40a/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:05.237497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eba609-59c8-46fa-a750-1de9bf7d403a tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7439f25dc5e240dd91ec43194b1fe46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb09c05d05e94499a231d232c57a523a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:05.238148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eba609-59c8-46fa-a750-1de9bf7d403a tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:05.238433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eba609-59c8-46fa-a750-1de9bf7d403a tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:05.238715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eba609-59c8-46fa-a750-1de9bf7d403a tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/91215c83d55e4b9bbe436192698517e6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:05.239419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eba609-59c8-46fa-a750-1de9bf7d403a tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=91215c83d55e4b9bbe436192698517e6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:05.241451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eba609-59c8-46fa-a750-1de9bf7d403a tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:05.241726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94eba609-59c8-46fa-a750-1de9bf7d403a tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invalidating token cache because consumer 91215c83d55e4b9bbe436192698517e6 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:05.242011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94eba609-59c8-46fa-a750-1de9bf7d403a tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:05.244217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-94eba609-59c8-46fa-a750-1de9bf7d403a tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:05.254700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeed611-616d-42d7-8be3-23a3c5bbaa57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2360b3d1e3f94b11aca87c33f8ecd790, user_id=4174797552a64d53b52e3d387f1af40a, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:05.257120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-94eba609-59c8-46fa-a750-1de9bf7d403a tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 27 04:51:05.257120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:05.257120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:05.257120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:05.257120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:05.257120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:05.257120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:05.257120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:05.257120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:05.257120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:05.257120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:05.257120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:05.257120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Aug 27 04:51:05.257120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Aug 27 04:51:05.257120 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:51:05.258455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:51:05.258455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Aug 27 04:51:05.258455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Aug 27 04:51:05.258455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Aug 27 04:51:05.258455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Aug 27 04:51:05.258455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Aug 27 04:51:05.258455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 27 04:51:05.258455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 27 04:51:05.258455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 27 04:51:05.258455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 27 04:51:05.258455 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:51:05.259205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeed611-616d-42d7-8be3-23a3c5bbaa57 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:05.259287 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2657/5268] 10.222.0.76 () {58 vars in 1266 bytes} [Sat Aug 27 04:51:05 2022] DELETE /identity/v3/OS-OAUTH1/consumers/91215c83d55e4b9bbe436192698517e6 => generated 74 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:51:05.259786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eba609-59c8-46fa-a750-1de9bf7d403a tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:05.261206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-94eba609-59c8-46fa-a750-1de9bf7d403a tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:05.275765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eba609-59c8-46fa-a750-1de9bf7d403a tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:05.280436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7ee64-f960-4224-b84d-aba98189fdd5 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '967e3000eb5b4642aa37fb3d2d57eda4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ad4cc39db7e4da082e154e6c719975e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1559163905', 'tempest-NotDelegatedRole-1994180755'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:05.281110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7ee64-f960-4224-b84d-aba98189fdd5 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:05.281393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7ee64-f960-4224-b84d-aba98189fdd5 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:05.281665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7ee64-f960-4224-b84d-aba98189fdd5 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] PATH_INFO: `/v3/OS-TRUST/trusts/ce640e025fc54ae88a09d0c59039f730/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:05.287652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7ee64-f960-4224-b84d-aba98189fdd5 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=ce640e025fc54ae88a09d0c59039f730)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:05.289145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7ee64-f960-4224-b84d-aba98189fdd5 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:05.296806 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2658/5269] 10.222.0.76 () {58 vars in 1269 bytes} [Sat Aug 27 04:51:05 2022] GET /identity/v3/OS-TRUST/trusts/ce640e025fc54ae88a09d0c59039f730/roles => generated 371 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:05.297570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7ee64-f960-4224-b84d-aba98189fdd5 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:05.303436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b5e7ee64-f960-4224-b84d-aba98189fdd5 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:05.314051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7ee64-f960-4224-b84d-aba98189fdd5 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:05.318507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7e125-78c2-44b6-9453-926b2c6ba41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:05.319094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7e125-78c2-44b6-9453-926b2c6ba41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:05.319367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7e125-78c2-44b6-9453-926b2c6ba41a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:05.319632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7e125-78c2-44b6-9453-926b2c6ba41a admin admin] PATH_INFO: `/v3/projects/55cae27d0bfc4f1b8857b8118e7dfeca` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:05.320738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7e125-78c2-44b6-9453-926b2c6ba41a admin admin] RBAC: Authorizing `identity:delete_project(project_id=55cae27d0bfc4f1b8857b8118e7dfeca)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:05.322865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7e125-78c2-44b6-9453-926b2c6ba41a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:05.403335 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2612/5270] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:05 2022] PUT /identity/v3/projects/2360b3d1e3f94b11aca87c33f8ecd790/users/4174797552a64d53b52e3d387f1af40a/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:05.406787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeed611-616d-42d7-8be3-23a3c5bbaa57 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:05.406787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-daeed611-616d-42d7-8be3-23a3c5bbaa57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:05.456135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8ff7e125-78c2-44b6-9453-926b2c6ba41a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55cae27d0bfc4f1b8857b8118e7dfeca', 'request_id': 'req-8ff7e125-78c2-44b6-9453-926b2c6ba41a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:05.462921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8ff7e125-78c2-44b6-9453-926b2c6ba41a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55cae27d0bfc4f1b8857b8118e7dfeca', 'request_id': 'req-8ff7e125-78c2-44b6-9453-926b2c6ba41a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:05.479681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeed611-616d-42d7-8be3-23a3c5bbaa57 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:05.534860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada4798-cdc9-4917-ab42-9a11e66460ef tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55b99deebc74d6d933dfcb95c2e99d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2654d38f2ffc4e7ca353480bd695d219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:05.535678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada4798-cdc9-4917-ab42-9a11e66460ef tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:05.535971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada4798-cdc9-4917-ab42-9a11e66460ef tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:05.536285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada4798-cdc9-4917-ab42-9a11e66460ef tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials/71de9d87cce2448b921fc59c6f7998f3` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:05.546365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada4798-cdc9-4917-ab42-9a11e66460ef tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b55b99deebc74d6d933dfcb95c2e99d0, application_credential_id=71de9d87cce2448b921fc59c6f7998f3)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:05.547891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada4798-cdc9-4917-ab42-9a11e66460ef tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:05.598533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8ff7e125-78c2-44b6-9453-926b2c6ba41a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55cae27d0bfc4f1b8857b8118e7dfeca', 'request_id': 'req-8ff7e125-78c2-44b6-9453-926b2c6ba41a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:05.610761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8ff7e125-78c2-44b6-9453-926b2c6ba41a admin admin] The token cache is being invalidate because project 55cae27d0bfc4f1b8857b8118e7dfeca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:05.613203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8ff7e125-78c2-44b6-9453-926b2c6ba41a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:05.613203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8ff7e125-78c2-44b6-9453-926b2c6ba41a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:05.613521 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2659/5271] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:05 2022] DELETE /identity/v3/projects/55cae27d0bfc4f1b8857b8118e7dfeca => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:05.614317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7e125-78c2-44b6-9453-926b2c6ba41a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:05.615583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8ff7e125-78c2-44b6-9453-926b2c6ba41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:05.674315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7e125-78c2-44b6-9453-926b2c6ba41a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:05.678064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6342c3f-3ed3-4a72-9379-1bc163e8459c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:05.678672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6342c3f-3ed3-4a72-9379-1bc163e8459c service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:05.678953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6342c3f-3ed3-4a72-9379-1bc163e8459c service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:05.679223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6342c3f-3ed3-4a72-9379-1bc163e8459c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:05.681227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d6342c3f-3ed3-4a72-9379-1bc163e8459c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:05.740786 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2613/5272] 10.222.0.76 () {58 vars in 1395 bytes} [Sat Aug 27 04:51:05 2022] DELETE /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0/application_credentials/71de9d87cce2448b921fc59c6f7998f3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:05.742515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada4798-cdc9-4917-ab42-9a11e66460ef tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:05.744298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6342c3f-3ed3-4a72-9379-1bc163e8459c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:05.745979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6342c3f-3ed3-4a72-9379-1bc163e8459c service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:05.746358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4ada4798-cdc9-4917-ab42-9a11e66460ef tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:05.757456 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2660/5273] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:05.760292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6342c3f-3ed3-4a72-9379-1bc163e8459c service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:05.761285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d6342c3f-3ed3-4a72-9379-1bc163e8459c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:05.847165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada4798-cdc9-4917-ab42-9a11e66460ef tempest-ApplicationCredentialsV3Test-1598342013 tempest-ApplicationCredentialsV3Test-1598342013-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:05.848755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6342c3f-3ed3-4a72-9379-1bc163e8459c service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:05.851866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fcf10-1228-476f-aa07-3fbaf7d26998 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7439f25dc5e240dd91ec43194b1fe46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb09c05d05e94499a231d232c57a523a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:05.853004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fcf10-1228-476f-aa07-3fbaf7d26998 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:05.853310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fcf10-1228-476f-aa07-3fbaf7d26998 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:05.853625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fcf10-1228-476f-aa07-3fbaf7d26998 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:05.854226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fcf10-1228-476f-aa07-3fbaf7d26998 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:05.854400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62febdbb-b513-402d-b884-fdcbab6fc543 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '967e3000eb5b4642aa37fb3d2d57eda4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ad4cc39db7e4da082e154e6c719975e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1559163905', 'tempest-NotDelegatedRole-1994180755'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:05.855053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62febdbb-b513-402d-b884-fdcbab6fc543 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:05.855339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62febdbb-b513-402d-b884-fdcbab6fc543 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:05.855618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62febdbb-b513-402d-b884-fdcbab6fc543 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] PATH_INFO: `/v3/OS-TRUST/trusts/ce640e025fc54ae88a09d0c59039f730/roles/d4a471dad3c643bbba348d4b5fa93510` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:05.855863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fcf10-1228-476f-aa07-3fbaf7d26998 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:05.862548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62febdbb-b513-402d-b884-fdcbab6fc543 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ce640e025fc54ae88a09d0c59039f730, role_id=d4a471dad3c643bbba348d4b5fa93510)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:05.864270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62febdbb-b513-402d-b884-fdcbab6fc543 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:05.871162 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2661/5274] 10.222.0.76 () {58 vars in 1368 bytes} [Sat Aug 27 04:51:05 2022] GET /identity/v3/OS-TRUST/trusts/ce640e025fc54ae88a09d0c59039f730/roles/d4a471dad3c643bbba348d4b5fa93510 => generated 244 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:05.871966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62febdbb-b513-402d-b884-fdcbab6fc543 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:05.873803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-62febdbb-b513-402d-b884-fdcbab6fc543 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:05.941816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62febdbb-b513-402d-b884-fdcbab6fc543 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:05.947047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb11bf8-191c-41a2-a658-2350e0c5cf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:05.947689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11bf8-191c-41a2-a658-2350e0c5cf45 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:05.948630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11bf8-191c-41a2-a658-2350e0c5cf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:05.948910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11bf8-191c-41a2-a658-2350e0c5cf45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:05.949551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb11bf8-191c-41a2-a658-2350e0c5cf45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:05.951143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb11bf8-191c-41a2-a658-2350e0c5cf45 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:05.966327 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2662/5275] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:05 2022] GET /identity/v3/roles => generated 1893 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:05.966327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139db2a5-fc67-402e-b384-2277d6419802 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:05.966327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139db2a5-fc67-402e-b384-2277d6419802 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:05.966327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139db2a5-fc67-402e-b384-2277d6419802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:05.987533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-139db2a5-fc67-402e-b384-2277d6419802 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:05.988902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-139db2a5-fc67-402e-b384-2277d6419802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:05.994812 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2614/5276] 10.222.0.76 () {60 vars in 1185 bytes} [Sat Aug 27 04:51:05 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:05.998188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fcf10-1228-476f-aa07-3fbaf7d26998 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:05.999700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e78fcf10-1228-476f-aa07-3fbaf7d26998 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:06.007244 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2663/5277] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:06.009524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139db2a5-fc67-402e-b384-2277d6419802 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:06.019466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fcf10-1228-476f-aa07-3fbaf7d26998 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:06.023539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139db2a5-fc67-402e-b384-2277d6419802 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:06.025147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e05d80-06a9-4af1-be6a-6f46d6c1d0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:06.025804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e05d80-06a9-4af1-be6a-6f46d6c1d0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:06.026081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e05d80-06a9-4af1-be6a-6f46d6c1d0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:06.026350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e05d80-06a9-4af1-be6a-6f46d6c1d0b1 admin admin] PATH_INFO: `/v3/users/b55b99deebc74d6d933dfcb95c2e99d0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:06.027730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e05d80-06a9-4af1-be6a-6f46d6c1d0b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b55b99deebc74d6d933dfcb95c2e99d0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:06.029679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e05d80-06a9-4af1-be6a-6f46d6c1d0b1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:06.031086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec903513-8701-43e8-9595-b57d875c4a2c tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '967e3000eb5b4642aa37fb3d2d57eda4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ad4cc39db7e4da082e154e6c719975e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1559163905', 'tempest-NotDelegatedRole-1994180755'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:06.031971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec903513-8701-43e8-9595-b57d875c4a2c tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] REQUEST_METHOD: `HEAD` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:06.032356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec903513-8701-43e8-9595-b57d875c4a2c tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:06.032643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec903513-8701-43e8-9595-b57d875c4a2c tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] PATH_INFO: `/v3/OS-TRUST/trusts/ce640e025fc54ae88a09d0c59039f730/roles/d4a471dad3c643bbba348d4b5fa93510` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:06.039021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec903513-8701-43e8-9595-b57d875c4a2c tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ce640e025fc54ae88a09d0c59039f730, role_id=d4a471dad3c643bbba348d4b5fa93510)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:06.040934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec903513-8701-43e8-9595-b57d875c4a2c tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:06.051602 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2664/5278] 10.222.0.76 () {58 vars in 1369 bytes} [Sat Aug 27 04:51:06 2022] HEAD /identity/v3/OS-TRUST/trusts/ce640e025fc54ae88a09d0c59039f730/roles/d4a471dad3c643bbba348d4b5fa93510 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 27 04:51:06.051602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec903513-8701-43e8-9595-b57d875c4a2c tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:06.063668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec903513-8701-43e8-9595-b57d875c4a2c tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:06.068205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7fb60-5386-4def-a2ad-95ff684a1294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:06.068858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7fb60-5386-4def-a2ad-95ff684a1294 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:06.069137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7fb60-5386-4def-a2ad-95ff684a1294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:06.069406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7fb60-5386-4def-a2ad-95ff684a1294 admin admin] PATH_INFO: `/v3/projects/2360b3d1e3f94b11aca87c33f8ecd790/users/4174797552a64d53b52e3d387f1af40a/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:06.071882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7fb60-5386-4def-a2ad-95ff684a1294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2360b3d1e3f94b11aca87c33f8ecd790, user_id=4174797552a64d53b52e3d387f1af40a, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:06.074669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7fb60-5386-4def-a2ad-95ff684a1294 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:06.085055 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2665/5279] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:06 2022] PUT /identity/v3/projects/2360b3d1e3f94b11aca87c33f8ecd790/users/4174797552a64d53b52e3d387f1af40a/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:06.085883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7fb60-5386-4def-a2ad-95ff684a1294 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:06.147429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7fb60-5386-4def-a2ad-95ff684a1294 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:06.153972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1d895-e5d3-4d7f-aa3a-e6f6822b5da8 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7439f25dc5e240dd91ec43194b1fe46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb09c05d05e94499a231d232c57a523a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:06.157580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1d895-e5d3-4d7f-aa3a-e6f6822b5da8 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:06.157580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1d895-e5d3-4d7f-aa3a-e6f6822b5da8 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:06.157580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1d895-e5d3-4d7f-aa3a-e6f6822b5da8 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:06.157580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1d895-e5d3-4d7f-aa3a-e6f6822b5da8 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:06.157580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1d895-e5d3-4d7f-aa3a-e6f6822b5da8 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:06.265784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-08e05d80-06a9-4af1-be6a-6f46d6c1d0b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b55b99deebc74d6d933dfcb95c2e99d0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:06.356556 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2666/5280] 10.222.0.76 () {60 vars in 1185 bytes} [Sat Aug 27 04:51:06 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:06.357867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9d61a-5fbc-4b6d-95a6-9ff29174e8a3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:06.358220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9d61a-5fbc-4b6d-95a6-9ff29174e8a3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:06.358499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9d61a-5fbc-4b6d-95a6-9ff29174e8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:06.377541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f5e9d61a-5fbc-4b6d-95a6-9ff29174e8a3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:06.378752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f5e9d61a-5fbc-4b6d-95a6-9ff29174e8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:06.395713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-08e05d80-06a9-4af1-be6a-6f46d6c1d0b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b55b99deebc74d6d933dfcb95c2e99d0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:06.396555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-08e05d80-06a9-4af1-be6a-6f46d6c1d0b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b55b99deebc74d6d933dfcb95c2e99d0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:06.405381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-08e05d80-06a9-4af1-be6a-6f46d6c1d0b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b55b99deebc74d6d933dfcb95c2e99d0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:06.442261 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2667/5281] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:06.443129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9d61a-5fbc-4b6d-95a6-9ff29174e8a3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:06.479969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:06.510537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9d61a-5fbc-4b6d-95a6-9ff29174e8a3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:06.515516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2824643-b6a2-49b4-a27d-a012b9e39c73 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '967e3000eb5b4642aa37fb3d2d57eda4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ad4cc39db7e4da082e154e6c719975e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1559163905', 'tempest-NotDelegatedRole-1994180755'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:06.516379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2824643-b6a2-49b4-a27d-a012b9e39c73 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:06.516653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2824643-b6a2-49b4-a27d-a012b9e39c73 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:06.516994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2824643-b6a2-49b4-a27d-a012b9e39c73 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] PATH_INFO: `/v3/OS-TRUST/trusts/ce640e025fc54ae88a09d0c59039f730/roles/e2d466304dd4488ba38e48e5c4daa8bf` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:06.520940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-08e05d80-06a9-4af1-be6a-6f46d6c1d0b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b55b99deebc74d6d933dfcb95c2e99d0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:06.523932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2824643-b6a2-49b4-a27d-a012b9e39c73 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ce640e025fc54ae88a09d0c59039f730, role_id=e2d466304dd4488ba38e48e5c4daa8bf)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:06.526345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2824643-b6a2-49b4-a27d-a012b9e39c73 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:06.534066 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2615/5282] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:05 2022] DELETE /identity/v3/users/b55b99deebc74d6d933dfcb95c2e99d0 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:06.536389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dbd00-413d-4f5c-86ca-c231241e5f6a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:06.537789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dbd00-413d-4f5c-86ca-c231241e5f6a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:06.538028 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-a2824643-b6a2-49b4-a27d-a012b9e39c73 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Could not find role: e2d466304dd4488ba38e48e5c4daa8bf.: keystone.exception.RoleNotFound: Could not find role: e2d466304dd4488ba38e48e5c4daa8bf. Aug 27 04:51:06.538028 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:06.538028 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:06.538028 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:06.538028 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:06.538028 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:06.538028 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:06.538028 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:06.538028 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:06.538028 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:06.538028 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:06.538028 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:06.538028 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 27 04:51:06.538028 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:51:06.538028 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: e2d466304dd4488ba38e48e5c4daa8bf. Aug 27 04:51:06.539271 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:51:06.540500 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2668/5283] 10.222.0.76 () {58 vars in 1368 bytes} [Sat Aug 27 04:51:06 2022] GET /identity/v3/OS-TRUST/trusts/ce640e025fc54ae88a09d0c59039f730/roles/e2d466304dd4488ba38e48e5c4daa8bf => generated 110 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:51:06.541107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dbd00-413d-4f5c-86ca-c231241e5f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:06.541855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2824643-b6a2-49b4-a27d-a012b9e39c73 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:06.543481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a2824643-b6a2-49b4-a27d-a012b9e39c73 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:06.561154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2824643-b6a2-49b4-a27d-a012b9e39c73 tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:06.593433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-022dbd00-413d-4f5c-86ca-c231241e5f6a None None] MFA Rules not processed for user `4174797552a64d53b52e3d387f1af40a`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:06.594708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-022dbd00-413d-4f5c-86ca-c231241e5f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:06.629540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bc595-b8c0-487c-9068-11078e4fe2b5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7439f25dc5e240dd91ec43194b1fe46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb09c05d05e94499a231d232c57a523a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:06.630286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bc595-b8c0-487c-9068-11078e4fe2b5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:06.630633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bc595-b8c0-487c-9068-11078e4fe2b5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:06.630915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bc595-b8c0-487c-9068-11078e4fe2b5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:06.632212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bc595-b8c0-487c-9068-11078e4fe2b5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:06.633808 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-525bc595-b8c0-487c-9068-11078e4fe2b5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:06.633808 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:06.633808 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:06.634809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bc595-b8c0-487c-9068-11078e4fe2b5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:06.641230 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2669/5284] 10.222.0.76 () {58 vars in 1164 bytes} [Sat Aug 27 04:51:06 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 537 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:06.641995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bc595-b8c0-487c-9068-11078e4fe2b5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:06.643760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-525bc595-b8c0-487c-9068-11078e4fe2b5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:06.686079 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2616/5285] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:06.688365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad482d1-60fb-4940-a2a3-e5f7323c378a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:06.688887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad482d1-60fb-4940-a2a3-e5f7323c378a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:06.689192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad482d1-60fb-4940-a2a3-e5f7323c378a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:06.714480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4ad482d1-60fb-4940-a2a3-e5f7323c378a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:06.715723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4ad482d1-60fb-4940-a2a3-e5f7323c378a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:06.738151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bc595-b8c0-487c-9068-11078e4fe2b5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:06.744098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66486e4b-03af-4b04-b75d-3711a510967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:06.744808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66486e4b-03af-4b04-b75d-3711a510967d admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:06.745094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66486e4b-03af-4b04-b75d-3711a510967d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:06.745373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66486e4b-03af-4b04-b75d-3711a510967d admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:06.746038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66486e4b-03af-4b04-b75d-3711a510967d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:06.746346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66486e4b-03af-4b04-b75d-3711a510967d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:06.748039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66486e4b-03af-4b04-b75d-3711a510967d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:06.762635 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2670/5286] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:06.763518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66486e4b-03af-4b04-b75d-3711a510967d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:06.765540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-66486e4b-03af-4b04-b75d-3711a510967d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:06.817640 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2617/5287] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:06.818795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad482d1-60fb-4940-a2a3-e5f7323c378a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:06.832281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad482d1-60fb-4940-a2a3-e5f7323c378a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:06.839071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11d917-a40f-412e-8cd6-c847d1784433 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7439f25dc5e240dd91ec43194b1fe46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb09c05d05e94499a231d232c57a523a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:06.839736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11d917-a40f-412e-8cd6-c847d1784433 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:06.840039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11d917-a40f-412e-8cd6-c847d1784433 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:06.840380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11d917-a40f-412e-8cd6-c847d1784433 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/fb906ac086c441a4803fd64c1139afaa` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:06.841305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11d917-a40f-412e-8cd6-c847d1784433 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=fb906ac086c441a4803fd64c1139afaa)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:06.842631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11d917-a40f-412e-8cd6-c847d1784433 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:06.842863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b11d917-a40f-412e-8cd6-c847d1784433 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invalidating token cache because consumer fb906ac086c441a4803fd64c1139afaa has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:06.843134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b11d917-a40f-412e-8cd6-c847d1784433 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:06.843868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b11d917-a40f-412e-8cd6-c847d1784433 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:06.859668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66486e4b-03af-4b04-b75d-3711a510967d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:06.865728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347ce79-96b5-4b0f-8d5d-dccc3229f34f tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '967e3000eb5b4642aa37fb3d2d57eda4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ad4cc39db7e4da082e154e6c719975e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1559163905', 'tempest-NotDelegatedRole-1994180755'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:06.868197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347ce79-96b5-4b0f-8d5d-dccc3229f34f tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] REQUEST_METHOD: `HEAD` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:06.868197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347ce79-96b5-4b0f-8d5d-dccc3229f34f tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:06.868197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347ce79-96b5-4b0f-8d5d-dccc3229f34f tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] PATH_INFO: `/v3/OS-TRUST/trusts/ce640e025fc54ae88a09d0c59039f730/roles/e2d466304dd4488ba38e48e5c4daa8bf` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:06.874735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347ce79-96b5-4b0f-8d5d-dccc3229f34f tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ce640e025fc54ae88a09d0c59039f730, role_id=e2d466304dd4488ba38e48e5c4daa8bf)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:06.876485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347ce79-96b5-4b0f-8d5d-dccc3229f34f tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:06.889533 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-5347ce79-96b5-4b0f-8d5d-dccc3229f34f tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Could not find role: e2d466304dd4488ba38e48e5c4daa8bf.: keystone.exception.RoleNotFound: Could not find role: e2d466304dd4488ba38e48e5c4daa8bf. Aug 27 04:51:06.889533 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:06.889533 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:06.889533 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:06.889533 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:06.889533 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:06.889533 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:06.889533 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:06.889533 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:06.889533 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:06.889533 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:06.889533 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:06.889533 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 27 04:51:06.889533 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:51:06.889533 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: e2d466304dd4488ba38e48e5c4daa8bf. Aug 27 04:51:06.890879 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:51:06.892463 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2671/5288] 10.222.0.76 () {58 vars in 1369 bytes} [Sat Aug 27 04:51:06 2022] HEAD /identity/v3/OS-TRUST/trusts/ce640e025fc54ae88a09d0c59039f730/roles/e2d466304dd4488ba38e48e5c4daa8bf => generated 0 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 27 04:51:06.896392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347ce79-96b5-4b0f-8d5d-dccc3229f34f tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:06.898373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5347ce79-96b5-4b0f-8d5d-dccc3229f34f tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:06.944617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3b11d917-a40f-412e-8cd6-c847d1784433 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'fb906ac086c441a4803fd64c1139afaa', 'request_id': 'req-3b11d917-a40f-412e-8cd6-c847d1784433'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:07.006778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347ce79-96b5-4b0f-8d5d-dccc3229f34f tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:07.013686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cf957-a57a-4225-8196-096db04dac90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:07.013686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cf957-a57a-4225-8196-096db04dac90 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:07.013686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cf957-a57a-4225-8196-096db04dac90 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:07.013686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cf957-a57a-4225-8196-096db04dac90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:07.014786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-331cf957-a57a-4225-8196-096db04dac90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:07.028866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cf957-a57a-4225-8196-096db04dac90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:07.030345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cf957-a57a-4225-8196-096db04dac90 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:07.042121 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2672/5289] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:07.045286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cf957-a57a-4225-8196-096db04dac90 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:07.047108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-331cf957-a57a-4225-8196-096db04dac90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:07.063930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cf957-a57a-4225-8196-096db04dac90 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:07.069358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c690b47-e9ba-4f1c-8577-a337fe9de1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:07.070092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c690b47-e9ba-4f1c-8577-a337fe9de1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:07.070475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c690b47-e9ba-4f1c-8577-a337fe9de1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:07.072156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c690b47-e9ba-4f1c-8577-a337fe9de1c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:07.072969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c690b47-e9ba-4f1c-8577-a337fe9de1c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:07.075038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c690b47-e9ba-4f1c-8577-a337fe9de1c3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:07.088011 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2618/5290] 10.222.0.76 () {58 vars in 1266 bytes} [Sat Aug 27 04:51:06 2022] DELETE /identity/v3/OS-OAUTH1/consumers/fb906ac086c441a4803fd64c1139afaa => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:07.088011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11d917-a40f-412e-8cd6-c847d1784433 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:07.109997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11d917-a40f-412e-8cd6-c847d1784433 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:07.114055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:07.126968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407dd2f-2ea3-4cf2-a074-667c77567b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:07.128092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407dd2f-2ea3-4cf2-a074-667c77567b9e service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:07.129225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407dd2f-2ea3-4cf2-a074-667c77567b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:07.129795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407dd2f-2ea3-4cf2-a074-667c77567b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:07.134607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b407dd2f-2ea3-4cf2-a074-667c77567b9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:07.149503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407dd2f-2ea3-4cf2-a074-667c77567b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:07.151376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407dd2f-2ea3-4cf2-a074-667c77567b9e service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:07.166144 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2619/5291] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:07.167514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407dd2f-2ea3-4cf2-a074-667c77567b9e service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:07.169938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b407dd2f-2ea3-4cf2-a074-667c77567b9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:07.189045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407dd2f-2ea3-4cf2-a074-667c77567b9e service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:07.195465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a1bcb-ca34-4bd9-8990-4f7b7c3c314b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '967e3000eb5b4642aa37fb3d2d57eda4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ad4cc39db7e4da082e154e6c719975e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1559163905', 'tempest-NotDelegatedRole-1994180755'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:07.197538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a1bcb-ca34-4bd9-8990-4f7b7c3c314b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:07.197538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a1bcb-ca34-4bd9-8990-4f7b7c3c314b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:07.197881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a1bcb-ca34-4bd9-8990-4f7b7c3c314b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] PATH_INFO: `/v3/OS-TRUST/trusts/ce640e025fc54ae88a09d0c59039f730` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:07.206519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a1bcb-ca34-4bd9-8990-4f7b7c3c314b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: Authorizing `identity:delete_trust(trust_id=ce640e025fc54ae88a09d0c59039f730)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:07.208113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a1bcb-ca34-4bd9-8990-4f7b7c3c314b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:07.269538 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2673/5292] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:07 2022] POST /identity/v3/projects => generated 367 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:07.269538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c690b47-e9ba-4f1c-8577-a337fe9de1c3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:07.272270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1c690b47-e9ba-4f1c-8577-a337fe9de1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:07.344011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-352a1bcb-ca34-4bd9-8990-4f7b7c3c314b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'ce640e025fc54ae88a09d0c59039f730', 'request_id': 'req-352a1bcb-ca34-4bd9-8990-4f7b7c3c314b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:07.390377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c690b47-e9ba-4f1c-8577-a337fe9de1c3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:07.397014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a64d5-2c14-4709-93fd-eb07e2315a1f tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7439f25dc5e240dd91ec43194b1fe46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb09c05d05e94499a231d232c57a523a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:07.397662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a64d5-2c14-4709-93fd-eb07e2315a1f tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:07.397937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a64d5-2c14-4709-93fd-eb07e2315a1f tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:07.398210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a64d5-2c14-4709-93fd-eb07e2315a1f tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b966136a0353465086b1be2662e6090f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:07.399046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a64d5-2c14-4709-93fd-eb07e2315a1f tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=b966136a0353465086b1be2662e6090f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:07.400614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a64d5-2c14-4709-93fd-eb07e2315a1f tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:07.400890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3e6a64d5-2c14-4709-93fd-eb07e2315a1f tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invalidating token cache because consumer b966136a0353465086b1be2662e6090f has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:07.401165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3e6a64d5-2c14-4709-93fd-eb07e2315a1f tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:07.402125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3e6a64d5-2c14-4709-93fd-eb07e2315a1f tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:07.443436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-352a1bcb-ca34-4bd9-8990-4f7b7c3c314b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ce640e025fc54ae88a09d0c59039f730', 'request_id': 'req-352a1bcb-ca34-4bd9-8990-4f7b7c3c314b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:07.444240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-352a1bcb-ca34-4bd9-8990-4f7b7c3c314b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ce640e025fc54ae88a09d0c59039f730', 'request_id': 'req-352a1bcb-ca34-4bd9-8990-4f7b7c3c314b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:07.456152 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2620/5293] 10.222.0.76 () {58 vars in 1254 bytes} [Sat Aug 27 04:51:07 2022] DELETE /identity/v3/OS-TRUST/trusts/ce640e025fc54ae88a09d0c59039f730 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:07.457402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a1bcb-ca34-4bd9-8990-4f7b7c3c314b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:07.459017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-352a1bcb-ca34-4bd9-8990-4f7b7c3c314b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:07.477504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a1bcb-ca34-4bd9-8990-4f7b7c3c314b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:07.518554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3e6a64d5-2c14-4709-93fd-eb07e2315a1f tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'b966136a0353465086b1be2662e6090f', 'request_id': 'req-3e6a64d5-2c14-4709-93fd-eb07e2315a1f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:07.547260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407623c-f9bf-4da2-b128-0072d071ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:07.547879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407623c-f9bf-4da2-b128-0072d071ef00 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:07.549818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407623c-f9bf-4da2-b128-0072d071ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:07.549818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407623c-f9bf-4da2-b128-0072d071ef00 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:07.549818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407623c-f9bf-4da2-b128-0072d071ef00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:07.551110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407623c-f9bf-4da2-b128-0072d071ef00 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:07.676677 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2674/5294] 10.222.0.76 () {58 vars in 1266 bytes} [Sat Aug 27 04:51:07 2022] DELETE /identity/v3/OS-OAUTH1/consumers/b966136a0353465086b1be2662e6090f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:07.683366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a64d5-2c14-4709-93fd-eb07e2315a1f tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:07.686086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3e6a64d5-2c14-4709-93fd-eb07e2315a1f tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:07.713801 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2621/5295] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:07 2022] POST /identity/v3/users => generated 284 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:07.715323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407623c-f9bf-4da2-b128-0072d071ef00 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:07.717661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1407623c-f9bf-4da2-b128-0072d071ef00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:07.735865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407623c-f9bf-4da2-b128-0072d071ef00 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:07.743534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86465c0-3ddb-4e25-b4c7-ad202cc398c4 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7439f25dc5e240dd91ec43194b1fe46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb09c05d05e94499a231d232c57a523a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:07.744144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86465c0-3ddb-4e25-b4c7-ad202cc398c4 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:07.744518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86465c0-3ddb-4e25-b4c7-ad202cc398c4 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:07.748324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86465c0-3ddb-4e25-b4c7-ad202cc398c4 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:07.748324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86465c0-3ddb-4e25-b4c7-ad202cc398c4 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:07.748324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86465c0-3ddb-4e25-b4c7-ad202cc398c4 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:07.827445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a64d5-2c14-4709-93fd-eb07e2315a1f tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:07.835394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2e8c7-50dd-4254-8286-b0777453014b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '967e3000eb5b4642aa37fb3d2d57eda4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ad4cc39db7e4da082e154e6c719975e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1559163905', 'tempest-NotDelegatedRole-1994180755'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:07.836468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2e8c7-50dd-4254-8286-b0777453014b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:07.844617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2e8c7-50dd-4254-8286-b0777453014b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:07.844901 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2622/5296] 10.222.0.76 () {60 vars in 1185 bytes} [Sat Aug 27 04:51:07 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:07.844901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86465c0-3ddb-4e25-b4c7-ad202cc398c4 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:07.845088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2e8c7-50dd-4254-8286-b0777453014b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] PATH_INFO: `/v3/OS-TRUST/trusts/ce640e025fc54ae88a09d0c59039f730` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:07.861176 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-a5c2e8c7-50dd-4254-8286-b0777453014b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Could not find trust: ce640e025fc54ae88a09d0c59039f730.: keystone.exception.TrustNotFound: Could not find trust: ce640e025fc54ae88a09d0c59039f730. Aug 27 04:51:07.861176 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:07.861176 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:07.861176 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:07.861176 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:07.861176 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:07.861176 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:07.861176 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:07.861176 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:07.861176 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:07.861176 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:07.861176 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:07.861176 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 27 04:51:07.861176 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 27 04:51:07.861176 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 27 04:51:07.863009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 27 04:51:07.863009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 27 04:51:07.863009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 27 04:51:07.863009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 27 04:51:07.863009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 27 04:51:07.863009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:51:07.863009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:51:07.863009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 27 04:51:07.863009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 27 04:51:07.863009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 27 04:51:07.863009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 27 04:51:07.863009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: ce640e025fc54ae88a09d0c59039f730. Aug 27 04:51:07.863009 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:51:07.867205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86465c0-3ddb-4e25-b4c7-ad202cc398c4 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:07.868586 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2675/5297] 10.222.0.76 () {58 vars in 1251 bytes} [Sat Aug 27 04:51:07 2022] GET /identity/v3/OS-TRUST/trusts/ce640e025fc54ae88a09d0c59039f730 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:51:07.875082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2e8c7-50dd-4254-8286-b0777453014b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:07.882362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18c145-9e07-4de7-b4a7-5e7aaff4087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:07.884557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18c145-9e07-4de7-b4a7-5e7aaff4087f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:07.885274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18c145-9e07-4de7-b4a7-5e7aaff4087f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:07.885766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18c145-9e07-4de7-b4a7-5e7aaff4087f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:07.887460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18c145-9e07-4de7-b4a7-5e7aaff4087f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:07.889816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18c145-9e07-4de7-b4a7-5e7aaff4087f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:07.920540 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2623/5298] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:07 2022] GET /identity/v3/roles => generated 1893 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:07.921674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18c145-9e07-4de7-b4a7-5e7aaff4087f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:07.924377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ec18c145-9e07-4de7-b4a7-5e7aaff4087f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:07.941598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2e8c7-50dd-4254-8286-b0777453014b tempest-TrustsV3TestJSON-1194623555 tempest-user-2137831610] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:07.989049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991d54e-a592-42d1-85fa-1c928930f6d8 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7439f25dc5e240dd91ec43194b1fe46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb09c05d05e94499a231d232c57a523a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:07.990473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991d54e-a592-42d1-85fa-1c928930f6d8 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:07.992363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991d54e-a592-42d1-85fa-1c928930f6d8 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:07.993783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991d54e-a592-42d1-85fa-1c928930f6d8 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/bec4623c5e6048c0b2afd1e8b630a07a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:07.994736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991d54e-a592-42d1-85fa-1c928930f6d8 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=bec4623c5e6048c0b2afd1e8b630a07a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:07.998774 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-8991d54e-a592-42d1-85fa-1c928930f6d8 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:07.998774 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:07.998774 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:08.001408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991d54e-a592-42d1-85fa-1c928930f6d8 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:08.042166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:08.111799 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2676/5299] 10.222.0.76 () {60 vars in 1285 bytes} [Sat Aug 27 04:51:07 2022] PATCH /identity/v3/OS-OAUTH1/consumers/bec4623c5e6048c0b2afd1e8b630a07a => generated 221 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:08.112861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991d54e-a592-42d1-85fa-1c928930f6d8 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:08.116614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18c145-9e07-4de7-b4a7-5e7aaff4087f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:08.117619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8991d54e-a592-42d1-85fa-1c928930f6d8 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:08.131344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1c664-f3de-488f-9331-06e5bb3d3b8e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:08.132059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1c664-f3de-488f-9331-06e5bb3d3b8e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:08.132372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1c664-f3de-488f-9331-06e5bb3d3b8e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:08.132651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1c664-f3de-488f-9331-06e5bb3d3b8e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles/e2d466304dd4488ba38e48e5c4daa8bf` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:08.135821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1c664-f3de-488f-9331-06e5bb3d3b8e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e2d466304dd4488ba38e48e5c4daa8bf)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:08.166871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1c664-f3de-488f-9331-06e5bb3d3b8e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:08.182648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991d54e-a592-42d1-85fa-1c928930f6d8 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:08.193046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c8d72-d467-422f-9597-95c24c39a252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:08.199612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c8d72-d467-422f-9597-95c24c39a252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:08.199612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c8d72-d467-422f-9597-95c24c39a252 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:08.199612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c8d72-d467-422f-9597-95c24c39a252 admin admin] PATH_INFO: `/v3/projects/2654d38f2ffc4e7ca353480bd695d219` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:08.199612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c8d72-d467-422f-9597-95c24c39a252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2654d38f2ffc4e7ca353480bd695d219)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:08.199612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c8d72-d467-422f-9597-95c24c39a252 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:08.406348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ba4c8d72-d467-422f-9597-95c24c39a252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2654d38f2ffc4e7ca353480bd695d219', 'request_id': 'req-ba4c8d72-d467-422f-9597-95c24c39a252'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:08.412836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ba4c8d72-d467-422f-9597-95c24c39a252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2654d38f2ffc4e7ca353480bd695d219', 'request_id': 'req-ba4c8d72-d467-422f-9597-95c24c39a252'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:08.500272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ec1c664-f3de-488f-9331-06e5bb3d3b8e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invalidating the token cache because role e2d466304dd4488ba38e48e5c4daa8bf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:08.500621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ec1c664-f3de-488f-9331-06e5bb3d3b8e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:08.501339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ec1c664-f3de-488f-9331-06e5bb3d3b8e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:08.504324 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2624/5300] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:07 2022] DELETE /identity/v3/roles/e2d466304dd4488ba38e48e5c4daa8bf => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:08.504324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1c664-f3de-488f-9331-06e5bb3d3b8e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:08.505747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9ec1c664-f3de-488f-9331-06e5bb3d3b8e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:08.521283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ba4c8d72-d467-422f-9597-95c24c39a252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2654d38f2ffc4e7ca353480bd695d219', 'request_id': 'req-ba4c8d72-d467-422f-9597-95c24c39a252'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:08.536207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ba4c8d72-d467-422f-9597-95c24c39a252 admin admin] The token cache is being invalidate because project 2654d38f2ffc4e7ca353480bd695d219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:08.541850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ba4c8d72-d467-422f-9597-95c24c39a252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:08.541850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ba4c8d72-d467-422f-9597-95c24c39a252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:08.541850 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2677/5301] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:08 2022] DELETE /identity/v3/projects/2654d38f2ffc4e7ca353480bd695d219 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:08.541850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c8d72-d467-422f-9597-95c24c39a252 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:08.546300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ba4c8d72-d467-422f-9597-95c24c39a252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:08.575044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1c664-f3de-488f-9331-06e5bb3d3b8e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:08.580952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd22aa9-2914-455d-a293-228efe74e20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:08.581578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd22aa9-2914-455d-a293-228efe74e20b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:08.581935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd22aa9-2914-455d-a293-228efe74e20b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:08.582400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd22aa9-2914-455d-a293-228efe74e20b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:08.583039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd22aa9-2914-455d-a293-228efe74e20b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:08.584802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd22aa9-2914-455d-a293-228efe74e20b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:08.599308 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2625/5302] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:08 2022] GET /identity/v3/roles => generated 1655 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:08.599308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd22aa9-2914-455d-a293-228efe74e20b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:08.601069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3fd22aa9-2914-455d-a293-228efe74e20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:08.623233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c8d72-d467-422f-9597-95c24c39a252 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:08.697288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80024ca6-436c-49ea-929a-29eb7fc7697e tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7439f25dc5e240dd91ec43194b1fe46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb09c05d05e94499a231d232c57a523a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:08.698066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80024ca6-436c-49ea-929a-29eb7fc7697e tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:08.698252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80024ca6-436c-49ea-929a-29eb7fc7697e tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:08.698600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80024ca6-436c-49ea-929a-29eb7fc7697e tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/bec4623c5e6048c0b2afd1e8b630a07a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:08.699254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80024ca6-436c-49ea-929a-29eb7fc7697e tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=bec4623c5e6048c0b2afd1e8b630a07a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:08.702981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80024ca6-436c-49ea-929a-29eb7fc7697e tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:08.717217 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2678/5303] 10.222.0.76 () {58 vars in 1263 bytes} [Sat Aug 27 04:51:08 2022] GET /identity/v3/OS-OAUTH1/consumers/bec4623c5e6048c0b2afd1e8b630a07a => generated 221 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:08.717217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d38108-d31b-4017-9a6d-2a30a88659ee None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:08.717654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d38108-d31b-4017-9a6d-2a30a88659ee None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:08.718296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d38108-d31b-4017-9a6d-2a30a88659ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:08.719272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd22aa9-2914-455d-a293-228efe74e20b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:08.736931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:08.760735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-60d38108-d31b-4017-9a6d-2a30a88659ee None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:08.763105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-60d38108-d31b-4017-9a6d-2a30a88659ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:08.771622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d43e4-d96e-4628-b860-c3e09b85ee80 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:08.775096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d43e4-d96e-4628-b860-c3e09b85ee80 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:08.775233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d43e4-d96e-4628-b860-c3e09b85ee80 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:08.777066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d43e4-d96e-4628-b860-c3e09b85ee80 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles/d4a471dad3c643bbba348d4b5fa93510` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:08.778425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d43e4-d96e-4628-b860-c3e09b85ee80 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d4a471dad3c643bbba348d4b5fa93510)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:08.779072 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2679/5304] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:08.786570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d38108-d31b-4017-9a6d-2a30a88659ee None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:08.790413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d43e4-d96e-4628-b860-c3e09b85ee80 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:08.806252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-60d38108-d31b-4017-9a6d-2a30a88659ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:08.835557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d38108-d31b-4017-9a6d-2a30a88659ee None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:08.845762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3235f-a875-4012-a2b8-4477596e8430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:08.846864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3235f-a875-4012-a2b8-4477596e8430 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:08.847324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3235f-a875-4012-a2b8-4477596e8430 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:08.847805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3235f-a875-4012-a2b8-4477596e8430 admin admin] PATH_INFO: `/v3/projects/fb170528d4004209b6ebd987000bc753/users/e3e1f702553c403db6265e08b426e0f8/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:08.878793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3235f-a875-4012-a2b8-4477596e8430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb170528d4004209b6ebd987000bc753, user_id=e3e1f702553c403db6265e08b426e0f8, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:08.882125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3235f-a875-4012-a2b8-4477596e8430 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:09.032232 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2680/5305] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:08 2022] PUT /identity/v3/projects/fb170528d4004209b6ebd987000bc753/users/e3e1f702553c403db6265e08b426e0f8/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:09.032232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3235f-a875-4012-a2b8-4477596e8430 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:09.052141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5e8d43e4-d96e-4628-b860-c3e09b85ee80 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invalidating the token cache because role d4a471dad3c643bbba348d4b5fa93510 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:09.052447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5e8d43e4-d96e-4628-b860-c3e09b85ee80 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:09.060679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5e8d43e4-d96e-4628-b860-c3e09b85ee80 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:09.062780 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2626/5306] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:08 2022] DELETE /identity/v3/roles/d4a471dad3c643bbba348d4b5fa93510 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:09.067146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ffd64-c54a-49a6-91b3-1abca41a65bf None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:09.067436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ffd64-c54a-49a6-91b3-1abca41a65bf None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:09.067720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ffd64-c54a-49a6-91b3-1abca41a65bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:09.112580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e68ffd64-c54a-49a6-91b3-1abca41a65bf None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:09.114078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e68ffd64-c54a-49a6-91b3-1abca41a65bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:09.147548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3235f-a875-4012-a2b8-4477596e8430 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:09.287190 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2627/5307] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:09.289039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf7f5b-74d4-4da1-b481-118e59208aa9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:09.289540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf7f5b-74d4-4da1-b481-118e59208aa9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:09.290275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf7f5b-74d4-4da1-b481-118e59208aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:09.328813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad94e78-b0a3-4258-b8ec-d64e80f585e5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7439f25dc5e240dd91ec43194b1fe46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb09c05d05e94499a231d232c57a523a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:09.331779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad94e78-b0a3-4258-b8ec-d64e80f585e5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:09.332177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad94e78-b0a3-4258-b8ec-d64e80f585e5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:09.332557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad94e78-b0a3-4258-b8ec-d64e80f585e5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/bec4623c5e6048c0b2afd1e8b630a07a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:09.333370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad94e78-b0a3-4258-b8ec-d64e80f585e5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=bec4623c5e6048c0b2afd1e8b630a07a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:09.339195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-36bf7f5b-74d4-4da1-b481-118e59208aa9 None None] MFA Rules not processed for user `e3e1f702553c403db6265e08b426e0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:09.339691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad94e78-b0a3-4258-b8ec-d64e80f585e5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:09.343209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bad94e78-b0a3-4258-b8ec-d64e80f585e5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invalidating token cache because consumer bec4623c5e6048c0b2afd1e8b630a07a has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:09.343209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bad94e78-b0a3-4258-b8ec-d64e80f585e5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:09.343455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-36bf7f5b-74d4-4da1-b481-118e59208aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:09.343752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bad94e78-b0a3-4258-b8ec-d64e80f585e5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:09.452191 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2628/5308] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:09.453884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf7f5b-74d4-4da1-b481-118e59208aa9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:09.455857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-36bf7f5b-74d4-4da1-b481-118e59208aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:09.470687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bad94e78-b0a3-4258-b8ec-d64e80f585e5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'bec4623c5e6048c0b2afd1e8b630a07a', 'request_id': 'req-bad94e78-b0a3-4258-b8ec-d64e80f585e5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:09.549759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf7f5b-74d4-4da1-b481-118e59208aa9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:09.557042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea160e95-79dd-4655-a959-3e1a0ac8fa9a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:09.559007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea160e95-79dd-4655-a959-3e1a0ac8fa9a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:09.559007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea160e95-79dd-4655-a959-3e1a0ac8fa9a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:09.559007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea160e95-79dd-4655-a959-3e1a0ac8fa9a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users/967e3000eb5b4642aa37fb3d2d57eda4` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:09.559943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea160e95-79dd-4655-a959-3e1a0ac8fa9a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_user(user_id=967e3000eb5b4642aa37fb3d2d57eda4)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:09.562654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea160e95-79dd-4655-a959-3e1a0ac8fa9a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:09.647594 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2681/5309] 10.222.0.76 () {58 vars in 1266 bytes} [Sat Aug 27 04:51:09 2022] DELETE /identity/v3/OS-OAUTH1/consumers/bec4623c5e6048c0b2afd1e8b630a07a => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:09.647594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad94e78-b0a3-4258-b8ec-d64e80f585e5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:09.647594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bad94e78-b0a3-4258-b8ec-d64e80f585e5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:09.682570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad94e78-b0a3-4258-b8ec-d64e80f585e5 tempest-OAUTHConsumersV3Test-958105098 tempest-OAUTHConsumersV3Test-958105098-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:09.696758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b53721-72cf-42a8-9362-10f8f95f3c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:09.697568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b53721-72cf-42a8-9362-10f8f95f3c8e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:09.697916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b53721-72cf-42a8-9362-10f8f95f3c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:09.698257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b53721-72cf-42a8-9362-10f8f95f3c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:09.699040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b53721-72cf-42a8-9362-10f8f95f3c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:09.700388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b53721-72cf-42a8-9362-10f8f95f3c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:09.705647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b53721-72cf-42a8-9362-10f8f95f3c8e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:09.736340 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2682/5310] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:09.737637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b53721-72cf-42a8-9362-10f8f95f3c8e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:09.739778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c9b53721-72cf-42a8-9362-10f8f95f3c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:09.751546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea160e95-79dd-4655-a959-3e1a0ac8fa9a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967e3000eb5b4642aa37fb3d2d57eda4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:09.758336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b53721-72cf-42a8-9362-10f8f95f3c8e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:09.769360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21ae88-45a2-4c51-95bb-05c1464d58dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:09.769986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21ae88-45a2-4c51-95bb-05c1464d58dc admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:09.770263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21ae88-45a2-4c51-95bb-05c1464d58dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:09.770535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21ae88-45a2-4c51-95bb-05c1464d58dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:09.773387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21ae88-45a2-4c51-95bb-05c1464d58dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:09.777961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21ae88-45a2-4c51-95bb-05c1464d58dc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:09.906218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea160e95-79dd-4655-a959-3e1a0ac8fa9a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967e3000eb5b4642aa37fb3d2d57eda4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:09.909337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea160e95-79dd-4655-a959-3e1a0ac8fa9a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967e3000eb5b4642aa37fb3d2d57eda4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:09.918596 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2683/5311] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:09 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:09.918596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21ae88-45a2-4c51-95bb-05c1464d58dc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:09.920497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5e21ae88-45a2-4c51-95bb-05c1464d58dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:09.934911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea160e95-79dd-4655-a959-3e1a0ac8fa9a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967e3000eb5b4642aa37fb3d2d57eda4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:09.972649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea160e95-79dd-4655-a959-3e1a0ac8fa9a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967e3000eb5b4642aa37fb3d2d57eda4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:09.981311 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2629/5312] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:09 2022] DELETE /identity/v3/users/967e3000eb5b4642aa37fb3d2d57eda4 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:09.985194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea160e95-79dd-4655-a959-3e1a0ac8fa9a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:09.993139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ea160e95-79dd-4655-a959-3e1a0ac8fa9a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:10.036467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21ae88-45a2-4c51-95bb-05c1464d58dc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:10.176985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea160e95-79dd-4655-a959-3e1a0ac8fa9a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:10.198317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5faedb5-7ea2-40bf-949f-9df6ea318c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:10.203359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faedb5-7ea2-40bf-949f-9df6ea318c0e admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:10.203665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faedb5-7ea2-40bf-949f-9df6ea318c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:10.203944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faedb5-7ea2-40bf-949f-9df6ea318c0e admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:10.204651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5faedb5-7ea2-40bf-949f-9df6ea318c0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:10.215810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5faedb5-7ea2-40bf-949f-9df6ea318c0e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:10.229847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da91e6-4579-4c07-bc3c-18c4b73fd307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:10.230514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da91e6-4579-4c07-bc3c-18c4b73fd307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:10.231311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da91e6-4579-4c07-bc3c-18c4b73fd307 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:10.231868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da91e6-4579-4c07-bc3c-18c4b73fd307 admin admin] PATH_INFO: `/v3/users/f677cd9af7cc475dae25c21d3e351a31` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:10.237279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da91e6-4579-4c07-bc3c-18c4b73fd307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f677cd9af7cc475dae25c21d3e351a31)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:10.240140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da91e6-4579-4c07-bc3c-18c4b73fd307 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:10.370958 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2630/5313] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:09 2022] POST /identity/v3/projects => generated 375 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:10.371900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5faedb5-7ea2-40bf-949f-9df6ea318c0e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:10.374428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a5faedb5-7ea2-40bf-949f-9df6ea318c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:10.447147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:10.452327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5faedb5-7ea2-40bf-949f-9df6ea318c0e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:10.457685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4426c-54d5-4515-a90e-f4029f3c57c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:10.458300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4426c-54d5-4515-a90e-f4029f3c57c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:10.458590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4426c-54d5-4515-a90e-f4029f3c57c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:10.458897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4426c-54d5-4515-a90e-f4029f3c57c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:10.459679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4426c-54d5-4515-a90e-f4029f3c57c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:10.463028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4426c-54d5-4515-a90e-f4029f3c57c8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:10.482965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-09da91e6-4579-4c07-bc3c-18c4b73fd307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f677cd9af7cc475dae25c21d3e351a31'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:10.483953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-09da91e6-4579-4c07-bc3c-18c4b73fd307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f677cd9af7cc475dae25c21d3e351a31'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:10.594199 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2631/5314] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:10 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:10.598417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4426c-54d5-4515-a90e-f4029f3c57c8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:10.600111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2ff4426c-54d5-4515-a90e-f4029f3c57c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:10.615859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-09da91e6-4579-4c07-bc3c-18c4b73fd307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f677cd9af7cc475dae25c21d3e351a31'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:10.616881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-09da91e6-4579-4c07-bc3c-18c4b73fd307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f677cd9af7cc475dae25c21d3e351a31'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:10.632044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-09da91e6-4579-4c07-bc3c-18c4b73fd307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f677cd9af7cc475dae25c21d3e351a31'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:10.649957 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2684/5315] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:09 2022] DELETE /identity/v3/users/f677cd9af7cc475dae25c21d3e351a31 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:10.649957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da91e6-4579-4c07-bc3c-18c4b73fd307 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:10.649957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-09da91e6-4579-4c07-bc3c-18c4b73fd307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:10.674565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4426c-54d5-4515-a90e-f4029f3c57c8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:10.720969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:10.750667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da91e6-4579-4c07-bc3c-18c4b73fd307 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:10.756414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19013181-eefb-4f00-b3cc-f6ea000074ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:10.757447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013181-eefb-4f00-b3cc-f6ea000074ff admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:10.758830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013181-eefb-4f00-b3cc-f6ea000074ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:10.759155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013181-eefb-4f00-b3cc-f6ea000074ff admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:10.760295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19013181-eefb-4f00-b3cc-f6ea000074ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:10.763941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19013181-eefb-4f00-b3cc-f6ea000074ff admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:10.765049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648def79-3e75-4470-8d5b-218a94378ac9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:10.766349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648def79-3e75-4470-8d5b-218a94378ac9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:10.766828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648def79-3e75-4470-8d5b-218a94378ac9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:10.767306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648def79-3e75-4470-8d5b-218a94378ac9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/0ad4cc39db7e4da082e154e6c719975e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:10.768865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648def79-3e75-4470-8d5b-218a94378ac9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ad4cc39db7e4da082e154e6c719975e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:10.771145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648def79-3e75-4470-8d5b-218a94378ac9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:10.894542 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2685/5316] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:10 2022] POST /identity/v3/users => generated 288 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:10.895476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19013181-eefb-4f00-b3cc-f6ea000074ff admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:10.897494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-19013181-eefb-4f00-b3cc-f6ea000074ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:10.912973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19013181-eefb-4f00-b3cc-f6ea000074ff admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:10.919796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6af62-53af-4129-b345-4953937f81c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:10.920612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6af62-53af-4129-b345-4953937f81c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:10.921039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6af62-53af-4129-b345-4953937f81c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:10.921696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6af62-53af-4129-b345-4953937f81c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:10.922321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6af62-53af-4129-b345-4953937f81c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:10.924059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6af62-53af-4129-b345-4953937f81c8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:10.961943 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2686/5317] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:10.974543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4613c2-4aaf-4ce9-b481-dbf2ba282c35 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:10.974772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4613c2-4aaf-4ce9-b481-dbf2ba282c35 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:10.975056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4613c2-4aaf-4ce9-b481-dbf2ba282c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:10.999756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2e4613c2-4aaf-4ce9-b481-dbf2ba282c35 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:11.001112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2e4613c2-4aaf-4ce9-b481-dbf2ba282c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:11.108356 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2687/5318] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:11.109544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4613c2-4aaf-4ce9-b481-dbf2ba282c35 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:11.115958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-648def79-3e75-4470-8d5b-218a94378ac9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad4cc39db7e4da082e154e6c719975e', 'request_id': 'req-648def79-3e75-4470-8d5b-218a94378ac9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:11.126094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-648def79-3e75-4470-8d5b-218a94378ac9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad4cc39db7e4da082e154e6c719975e', 'request_id': 'req-648def79-3e75-4470-8d5b-218a94378ac9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:11.136837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4613c2-4aaf-4ce9-b481-dbf2ba282c35 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:11.139114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-648def79-3e75-4470-8d5b-218a94378ac9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad4cc39db7e4da082e154e6c719975e', 'request_id': 'req-648def79-3e75-4470-8d5b-218a94378ac9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:11.142060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dea21-0e18-4fa6-9488-50a23e52d4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:11.142738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dea21-0e18-4fa6-9488-50a23e52d4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:11.143062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dea21-0e18-4fa6-9488-50a23e52d4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:11.143340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dea21-0e18-4fa6-9488-50a23e52d4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:11.144187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009dea21-0e18-4fa6-9488-50a23e52d4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:11.146054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009dea21-0e18-4fa6-9488-50a23e52d4a0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:11.160384 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2688/5319] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:11.161811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dea21-0e18-4fa6-9488-50a23e52d4a0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:11.178543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dea21-0e18-4fa6-9488-50a23e52d4a0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:11.185576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff36aaa-1c1e-4336-90f0-72a24099efca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:11.186612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff36aaa-1c1e-4336-90f0-72a24099efca admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:11.186993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff36aaa-1c1e-4336-90f0-72a24099efca admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:11.187376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff36aaa-1c1e-4336-90f0-72a24099efca admin admin] PATH_INFO: `/v3/projects/aed67d259f504207bf495dfb65945c15/users/d2081af0a76d4b49aa1af0992e6a08dc/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:11.208964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff36aaa-1c1e-4336-90f0-72a24099efca admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed67d259f504207bf495dfb65945c15, user_id=d2081af0a76d4b49aa1af0992e6a08dc, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:11.213370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff36aaa-1c1e-4336-90f0-72a24099efca admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:11.272528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-648def79-3e75-4470-8d5b-218a94378ac9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] The token cache is being invalidate because project 0ad4cc39db7e4da082e154e6c719975e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:11.273022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-648def79-3e75-4470-8d5b-218a94378ac9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:11.278026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-648def79-3e75-4470-8d5b-218a94378ac9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:11.281282 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2632/5320] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:10 2022] DELETE /identity/v3/projects/0ad4cc39db7e4da082e154e6c719975e => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:11.286655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648def79-3e75-4470-8d5b-218a94378ac9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:11.293881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-648def79-3e75-4470-8d5b-218a94378ac9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:11.303045 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2689/5321] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:11 2022] PUT /identity/v3/projects/aed67d259f504207bf495dfb65945c15/users/d2081af0a76d4b49aa1af0992e6a08dc/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:11.303045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff36aaa-1c1e-4336-90f0-72a24099efca admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:11.303045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6ff36aaa-1c1e-4336-90f0-72a24099efca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:11.404609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648def79-3e75-4470-8d5b-218a94378ac9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:11.406278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff36aaa-1c1e-4336-90f0-72a24099efca admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:11.412798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee601d-6f1b-4788-86f0-25ea0e3aa169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:11.416065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee601d-6f1b-4788-86f0-25ea0e3aa169 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:11.418013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee601d-6f1b-4788-86f0-25ea0e3aa169 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:11.418491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee601d-6f1b-4788-86f0-25ea0e3aa169 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:11.419549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee601d-6f1b-4788-86f0-25ea0e3aa169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:11.422361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee601d-6f1b-4788-86f0-25ea0e3aa169 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:11.446584 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2690/5322] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:11.454656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee601d-6f1b-4788-86f0-25ea0e3aa169 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:11.454656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0dee601d-6f1b-4788-86f0-25ea0e3aa169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:11.504402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfe56a-d998-4ff0-82b1-43214e1fe94d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:11.506572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfe56a-d998-4ff0-82b1-43214e1fe94d service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:11.506932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfe56a-d998-4ff0-82b1-43214e1fe94d service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:11.507288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfe56a-d998-4ff0-82b1-43214e1fe94d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:11.513320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c7dfe56a-d998-4ff0-82b1-43214e1fe94d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:11.541947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfe56a-d998-4ff0-82b1-43214e1fe94d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:11.544579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfe56a-d998-4ff0-82b1-43214e1fe94d service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:11.549197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee601d-6f1b-4788-86f0-25ea0e3aa169 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:11.561907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6043c0e-96a0-469c-88ee-00fe8e0f1811 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:11.566091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6043c0e-96a0-469c-88ee-00fe8e0f1811 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:11.566091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6043c0e-96a0-469c-88ee-00fe8e0f1811 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:11.566091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6043c0e-96a0-469c-88ee-00fe8e0f1811 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:11.566091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6043c0e-96a0-469c-88ee-00fe8e0f1811 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:11.570171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6043c0e-96a0-469c-88ee-00fe8e0f1811 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:11.572964 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2633/5323] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:11.574038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfe56a-d998-4ff0-82b1-43214e1fe94d service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:11.577725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c7dfe56a-d998-4ff0-82b1-43214e1fe94d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:11.603948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfe56a-d998-4ff0-82b1-43214e1fe94d service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:11.613235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf080db-5cb7-4396-864b-580b7035f8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:11.614165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf080db-5cb7-4396-864b-580b7035f8fb admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:11.614603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf080db-5cb7-4396-864b-580b7035f8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:11.615133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf080db-5cb7-4396-864b-580b7035f8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:11.615931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf080db-5cb7-4396-864b-580b7035f8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:11.618324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf080db-5cb7-4396-864b-580b7035f8fb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:11.631191 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2634/5324] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:11.632750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf080db-5cb7-4396-864b-580b7035f8fb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:11.646912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf080db-5cb7-4396-864b-580b7035f8fb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:11.655178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dd47a-3b5b-4cea-a706-3260f42861af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:11.655873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dd47a-3b5b-4cea-a706-3260f42861af admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:11.656151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dd47a-3b5b-4cea-a706-3260f42861af admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:11.656471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dd47a-3b5b-4cea-a706-3260f42861af admin admin] PATH_INFO: `/v3/projects/dc976c7c588e42f089299ed5a3c124fe/users/74aad0d2b42845cf8617d6094c709db4/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:11.677579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dd47a-3b5b-4cea-a706-3260f42861af admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc976c7c588e42f089299ed5a3c124fe, user_id=74aad0d2b42845cf8617d6094c709db4, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:11.683147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dd47a-3b5b-4cea-a706-3260f42861af admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:11.725033 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2691/5325] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:51:11 2022] POST /identity/v3/projects => generated 328 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:11.730022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6043c0e-96a0-469c-88ee-00fe8e0f1811 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:11.828488 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2635/5326] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:11 2022] PUT /identity/v3/projects/dc976c7c588e42f089299ed5a3c124fe/users/74aad0d2b42845cf8617d6094c709db4/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:11.829533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dd47a-3b5b-4cea-a706-3260f42861af admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:11.850133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6043c0e-96a0-469c-88ee-00fe8e0f1811 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:11.979665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d7db8-84a7-4874-aca8-a626a0a913b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:11.980695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d7db8-84a7-4874-aca8-a626a0a913b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:11.981667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d7db8-84a7-4874-aca8-a626a0a913b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:11.982144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d7db8-84a7-4874-aca8-a626a0a913b5 admin admin] PATH_INFO: `/v3/projects/aed67d259f504207bf495dfb65945c15/users/d2081af0a76d4b49aa1af0992e6a08dc/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:11.985538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d7db8-84a7-4874-aca8-a626a0a913b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed67d259f504207bf495dfb65945c15, user_id=d2081af0a76d4b49aa1af0992e6a08dc, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:11.988772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dd47a-3b5b-4cea-a706-3260f42861af admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:11.989139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d7db8-84a7-4874-aca8-a626a0a913b5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:12.001329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73ac2f-e62f-4335-bbcc-efb266b1258a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:12.011658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73ac2f-e62f-4335-bbcc-efb266b1258a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:12.011658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73ac2f-e62f-4335-bbcc-efb266b1258a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:12.011658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73ac2f-e62f-4335-bbcc-efb266b1258a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:12.011658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73ac2f-e62f-4335-bbcc-efb266b1258a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:12.012267 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2692/5327] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:11 2022] PUT /identity/v3/projects/aed67d259f504207bf495dfb65945c15/users/d2081af0a76d4b49aa1af0992e6a08dc/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:12.012267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecbaca-880c-4eb3-8f71-b4865e299550 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:12.012267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecbaca-880c-4eb3-8f71-b4865e299550 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:12.012267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecbaca-880c-4eb3-8f71-b4865e299550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:12.014862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73ac2f-e62f-4335-bbcc-efb266b1258a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:12.049915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-96ecbaca-880c-4eb3-8f71-b4865e299550 None None] MFA Rules not processed for user `74aad0d2b42845cf8617d6094c709db4`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:12.053754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-96ecbaca-880c-4eb3-8f71-b4865e299550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:12.146001 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2693/5328] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:12.147671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896d3cd-9008-4256-a983-ae4923a9b350 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:12.147968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896d3cd-9008-4256-a983-ae4923a9b350 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:12.148271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896d3cd-9008-4256-a983-ae4923a9b350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:12.174335 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2636/5329] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:11 2022] POST /identity/v3/users => generated 416 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:12.174335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73ac2f-e62f-4335-bbcc-efb266b1258a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:12.206673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3896d3cd-9008-4256-a983-ae4923a9b350 None None] MFA Rules not processed for user `d2081af0a76d4b49aa1af0992e6a08dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:12.208992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3896d3cd-9008-4256-a983-ae4923a9b350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:12.294699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73ac2f-e62f-4335-bbcc-efb266b1258a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:12.307777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56ec84-4493-4ea9-80c5-ea48d0a1bb1e tempest-IdentityCatalogTest-1620402122 tempest-IdentityCatalogTest-1620402122-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74aad0d2b42845cf8617d6094c709db4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc976c7c588e42f089299ed5a3c124fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:12.308592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56ec84-4493-4ea9-80c5-ea48d0a1bb1e tempest-IdentityCatalogTest-1620402122 tempest-IdentityCatalogTest-1620402122-project] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:12.308982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56ec84-4493-4ea9-80c5-ea48d0a1bb1e tempest-IdentityCatalogTest-1620402122 tempest-IdentityCatalogTest-1620402122-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:12.309365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56ec84-4493-4ea9-80c5-ea48d0a1bb1e tempest-IdentityCatalogTest-1620402122 tempest-IdentityCatalogTest-1620402122-project] PATH_INFO: `/v3/auth/catalog` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:12.310063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56ec84-4493-4ea9-80c5-ea48d0a1bb1e tempest-IdentityCatalogTest-1620402122 tempest-IdentityCatalogTest-1620402122-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:12.311384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56ec84-4493-4ea9-80c5-ea48d0a1bb1e tempest-IdentityCatalogTest-1620402122 tempest-IdentityCatalogTest-1620402122-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:12.318262 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2637/5330] 10.222.0.76 () {58 vars in 1143 bytes} [Sat Aug 27 04:51:12 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:12.318809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56ec84-4493-4ea9-80c5-ea48d0a1bb1e tempest-IdentityCatalogTest-1620402122 tempest-IdentityCatalogTest-1620402122-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:12.423912 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2694/5331] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:12.428656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896d3cd-9008-4256-a983-ae4923a9b350 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:12.450691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56ec84-4493-4ea9-80c5-ea48d0a1bb1e tempest-IdentityCatalogTest-1620402122 tempest-IdentityCatalogTest-1620402122-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:12.453247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:12.457811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05949691-10ad-4c17-8f18-4116ba457ba5 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:12.458523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05949691-10ad-4c17-8f18-4116ba457ba5 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:12.459844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05949691-10ad-4c17-8f18-4116ba457ba5 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:12.460616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05949691-10ad-4c17-8f18-4116ba457ba5 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:12.461565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05949691-10ad-4c17-8f18-4116ba457ba5 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:12.463293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05949691-10ad-4c17-8f18-4116ba457ba5 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:12.541757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896d3cd-9008-4256-a983-ae4923a9b350 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:12.549319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbcc8c-3ad2-4f8f-a72d-2f8211a55c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:12.550264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbcc8c-3ad2-4f8f-a72d-2f8211a55c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:12.557146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbcc8c-3ad2-4f8f-a72d-2f8211a55c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:12.557146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbcc8c-3ad2-4f8f-a72d-2f8211a55c63 admin admin] PATH_INFO: `/v3/users/74aad0d2b42845cf8617d6094c709db4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:12.557146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cbcc8c-3ad2-4f8f-a72d-2f8211a55c63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74aad0d2b42845cf8617d6094c709db4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:12.557612 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2638/5332] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:51:12 2022] POST /identity/v3/roles => generated 244 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:12.557612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05949691-10ad-4c17-8f18-4116ba457ba5 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:12.557814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cbcc8c-3ad2-4f8f-a72d-2f8211a55c63 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:12.582446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05949691-10ad-4c17-8f18-4116ba457ba5 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:12.604005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe1e8c-2104-4dfd-91e2-e21d1f04a3e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:12.604972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe1e8c-2104-4dfd-91e2-e21d1f04a3e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:12.605121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe1e8c-2104-4dfd-91e2-e21d1f04a3e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:12.605479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe1e8c-2104-4dfd-91e2-e21d1f04a3e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:12.606230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe1e8c-2104-4dfd-91e2-e21d1f04a3e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:12.608215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe1e8c-2104-4dfd-91e2-e21d1f04a3e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:12.746326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:12.755446 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2639/5333] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:51:12 2022] POST /identity/v3/roles => generated 235 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:12.755446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe1e8c-2104-4dfd-91e2-e21d1f04a3e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:12.769866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe1e8c-2104-4dfd-91e2-e21d1f04a3e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:12.777881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d6b93-a1b8-4653-a6cd-56b08faab3bf tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:12.778628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6b93-a1b8-4653-a6cd-56b08faab3bf tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:12.779147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6b93-a1b8-4653-a6cd-56b08faab3bf tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:12.779535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6b93-a1b8-4653-a6cd-56b08faab3bf tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:12.780465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d6b93-a1b8-4653-a6cd-56b08faab3bf tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:12.782843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d6b93-a1b8-4653-a6cd-56b08faab3bf tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:12.861813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-45cbcc8c-3ad2-4f8f-a72d-2f8211a55c63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74aad0d2b42845cf8617d6094c709db4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:12.862425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-45cbcc8c-3ad2-4f8f-a72d-2f8211a55c63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74aad0d2b42845cf8617d6094c709db4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:12.880037 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2640/5334] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:51:12 2022] POST /identity/v3/roles => generated 247 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:12.884071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d6b93-a1b8-4653-a6cd-56b08faab3bf tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:12.885819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-805d6b93-a1b8-4653-a6cd-56b08faab3bf tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:12.907497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d6b93-a1b8-4653-a6cd-56b08faab3bf tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:12.913812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff595476-fd7f-44cb-b47b-765c11ef9e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:12.915418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff595476-fd7f-44cb-b47b-765c11ef9e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:12.915684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff595476-fd7f-44cb-b47b-765c11ef9e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:12.916430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff595476-fd7f-44cb-b47b-765c11ef9e14 admin admin] PATH_INFO: `/v3/users/909ea3deb6b541d0b09ca961d4015a70` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:12.933687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff595476-fd7f-44cb-b47b-765c11ef9e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=909ea3deb6b541d0b09ca961d4015a70)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:12.933687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff595476-fd7f-44cb-b47b-765c11ef9e14 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:12.996450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-45cbcc8c-3ad2-4f8f-a72d-2f8211a55c63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74aad0d2b42845cf8617d6094c709db4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:12.997090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-45cbcc8c-3ad2-4f8f-a72d-2f8211a55c63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74aad0d2b42845cf8617d6094c709db4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:13.012862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-45cbcc8c-3ad2-4f8f-a72d-2f8211a55c63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74aad0d2b42845cf8617d6094c709db4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:13.028474 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2695/5335] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:12 2022] DELETE /identity/v3/users/74aad0d2b42845cf8617d6094c709db4 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:13.032994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbcc8c-3ad2-4f8f-a72d-2f8211a55c63 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:13.034522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-45cbcc8c-3ad2-4f8f-a72d-2f8211a55c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:13.162869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbcc8c-3ad2-4f8f-a72d-2f8211a55c63 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:13.172504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad051655-d034-489f-8716-beee1c2fa47e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:13.177718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad051655-d034-489f-8716-beee1c2fa47e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:13.177718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad051655-d034-489f-8716-beee1c2fa47e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:13.177718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad051655-d034-489f-8716-beee1c2fa47e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:13.177718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad051655-d034-489f-8716-beee1c2fa47e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:13.177718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad051655-d034-489f-8716-beee1c2fa47e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:13.186723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ff595476-fd7f-44cb-b47b-765c11ef9e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '909ea3deb6b541d0b09ca961d4015a70'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:13.317283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ff595476-fd7f-44cb-b47b-765c11ef9e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '909ea3deb6b541d0b09ca961d4015a70'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:13.318926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ff595476-fd7f-44cb-b47b-765c11ef9e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '909ea3deb6b541d0b09ca961d4015a70'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:13.333172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ff595476-fd7f-44cb-b47b-765c11ef9e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '909ea3deb6b541d0b09ca961d4015a70'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:13.334523 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2696/5336] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:51:13 2022] POST /identity/v3/roles => generated 235 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:13.335700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad051655-d034-489f-8716-beee1c2fa47e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:13.340111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ad051655-d034-489f-8716-beee1c2fa47e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:13.369679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ff595476-fd7f-44cb-b47b-765c11ef9e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '909ea3deb6b541d0b09ca961d4015a70'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:13.387832 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2641/5337] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:12 2022] DELETE /identity/v3/users/909ea3deb6b541d0b09ca961d4015a70 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:13.389394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff595476-fd7f-44cb-b47b-765c11ef9e14 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:13.393489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ff595476-fd7f-44cb-b47b-765c11ef9e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:13.473457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad051655-d034-489f-8716-beee1c2fa47e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:13.530415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff595476-fd7f-44cb-b47b-765c11ef9e14 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:13.536766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885614f6-b507-474a-9e57-fe9e7f87315f tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:13.537378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885614f6-b507-474a-9e57-fe9e7f87315f tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:13.537665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885614f6-b507-474a-9e57-fe9e7f87315f tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:13.537945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885614f6-b507-474a-9e57-fe9e7f87315f tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/a89f9b094a4d474a96a46bf9f5202d01/users/26c31ee8e6a14db48ee6ec7ed31541c2/roles/3c54f94637d5480a9bd49383966d7e9d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:13.557961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885614f6-b507-474a-9e57-fe9e7f87315f tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a89f9b094a4d474a96a46bf9f5202d01, user_id=26c31ee8e6a14db48ee6ec7ed31541c2, role_id=3c54f94637d5480a9bd49383966d7e9d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:13.561143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885614f6-b507-474a-9e57-fe9e7f87315f tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:13.569957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab826fbf-c61a-442b-b287-a75fe16ea774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:13.571591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab826fbf-c61a-442b-b287-a75fe16ea774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:13.571939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab826fbf-c61a-442b-b287-a75fe16ea774 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:13.572258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab826fbf-c61a-442b-b287-a75fe16ea774 admin admin] PATH_INFO: `/v3/projects/6e57f0e3cfdb4ee29ec2d6e1c3468bb8` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:13.573553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab826fbf-c61a-442b-b287-a75fe16ea774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e57f0e3cfdb4ee29ec2d6e1c3468bb8)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:13.577460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab826fbf-c61a-442b-b287-a75fe16ea774 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:13.647585 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2642/5338] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:13 2022] PUT /identity/v3/projects/a89f9b094a4d474a96a46bf9f5202d01/users/26c31ee8e6a14db48ee6ec7ed31541c2/roles/3c54f94637d5480a9bd49383966d7e9d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:13.650334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a1392-9c06-4587-88b9-a8f7e5177fed None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:13.650691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a1392-9c06-4587-88b9-a8f7e5177fed None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:13.652334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a1392-9c06-4587-88b9-a8f7e5177fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:13.686100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1d3a1392-9c06-4587-88b9-a8f7e5177fed None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:13.687969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1d3a1392-9c06-4587-88b9-a8f7e5177fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:13.693750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ab826fbf-c61a-442b-b287-a75fe16ea774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e57f0e3cfdb4ee29ec2d6e1c3468bb8', 'request_id': 'req-ab826fbf-c61a-442b-b287-a75fe16ea774'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:13.701103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ab826fbf-c61a-442b-b287-a75fe16ea774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e57f0e3cfdb4ee29ec2d6e1c3468bb8', 'request_id': 'req-ab826fbf-c61a-442b-b287-a75fe16ea774'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:13.778803 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2643/5339] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:13.778803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a1392-9c06-4587-88b9-a8f7e5177fed None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:13.782938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1d3a1392-9c06-4587-88b9-a8f7e5177fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:13.801017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ab826fbf-c61a-442b-b287-a75fe16ea774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e57f0e3cfdb4ee29ec2d6e1c3468bb8', 'request_id': 'req-ab826fbf-c61a-442b-b287-a75fe16ea774'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:13.815853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ab826fbf-c61a-442b-b287-a75fe16ea774 admin admin] The token cache is being invalidate because project 6e57f0e3cfdb4ee29ec2d6e1c3468bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:13.816482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ab826fbf-c61a-442b-b287-a75fe16ea774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:13.817359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ab826fbf-c61a-442b-b287-a75fe16ea774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:13.819393 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2697/5340] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:13 2022] DELETE /identity/v3/projects/6e57f0e3cfdb4ee29ec2d6e1c3468bb8 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:13.821800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d032ec-bc16-4e68-8677-b12f3d468318 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:13.822078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d032ec-bc16-4e68-8677-b12f3d468318 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:13.822355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d032ec-bc16-4e68-8677-b12f3d468318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:13.846084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e4d032ec-bc16-4e68-8677-b12f3d468318 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:13.847308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e4d032ec-bc16-4e68-8677-b12f3d468318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:13.857257 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2698/5341] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:13.857833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a1392-9c06-4587-88b9-a8f7e5177fed None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:13.858449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec89b7-f45e-493c-b32c-88bef11d8363 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:13.858804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec89b7-f45e-493c-b32c-88bef11d8363 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:13.859153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec89b7-f45e-493c-b32c-88bef11d8363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:13.871674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ffaf3-183f-42f5-9d9e-3710cd772bfa tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:13.872416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ffaf3-183f-42f5-9d9e-3710cd772bfa tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:13.872710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ffaf3-183f-42f5-9d9e-3710cd772bfa tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:13.872990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ffaf3-183f-42f5-9d9e-3710cd772bfa tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:13.873673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ffaf3-183f-42f5-9d9e-3710cd772bfa tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:13.876472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ffaf3-183f-42f5-9d9e-3710cd772bfa tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:13.893002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-42ec89b7-f45e-493c-b32c-88bef11d8363 None None] MFA Rules not processed for user `9a05d8e7d917402fae37644094dd2aef`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:13.894231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-42ec89b7-f45e-493c-b32c-88bef11d8363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:13.987985 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2644/5342] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:51:13 2022] POST /identity/v3/roles => generated 235 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:13.991442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ffaf3-183f-42f5-9d9e-3710cd772bfa tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:13.993547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6e6ffaf3-183f-42f5-9d9e-3710cd772bfa tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:14.040571 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2699/5343] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:14.041700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec89b7-f45e-493c-b32c-88bef11d8363 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:14.043825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-42ec89b7-f45e-493c-b32c-88bef11d8363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:14.125865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ffaf3-183f-42f5-9d9e-3710cd772bfa tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:14.136205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec89b7-f45e-493c-b32c-88bef11d8363 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:14.137620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b0695-c917-42b1-96ad-1b355584b9cd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:14.138627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b0695-c917-42b1-96ad-1b355584b9cd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:14.139075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b0695-c917-42b1-96ad-1b355584b9cd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:14.139448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b0695-c917-42b1-96ad-1b355584b9cd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/a89f9b094a4d474a96a46bf9f5202d01/users/26c31ee8e6a14db48ee6ec7ed31541c2/roles/9d3c050df500490b962bbd47b5e1e7b1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:14.142732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900bbb8-211d-4b90-8506-4a6c3ecd3a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:14.143885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900bbb8-211d-4b90-8506-4a6c3ecd3a57 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:14.144248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900bbb8-211d-4b90-8506-4a6c3ecd3a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:14.144530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900bbb8-211d-4b90-8506-4a6c3ecd3a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:14.146688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b0695-c917-42b1-96ad-1b355584b9cd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a89f9b094a4d474a96a46bf9f5202d01, user_id=26c31ee8e6a14db48ee6ec7ed31541c2, role_id=9d3c050df500490b962bbd47b5e1e7b1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:14.146828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b900bbb8-211d-4b90-8506-4a6c3ecd3a57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:14.150461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b0695-c917-42b1-96ad-1b355584b9cd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:14.176200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900bbb8-211d-4b90-8506-4a6c3ecd3a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:14.204965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900bbb8-211d-4b90-8506-4a6c3ecd3a57 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:14.223787 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2700/5344] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:14.225129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900bbb8-211d-4b90-8506-4a6c3ecd3a57 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:14.226532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b900bbb8-211d-4b90-8506-4a6c3ecd3a57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:14.258009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900bbb8-211d-4b90-8506-4a6c3ecd3a57 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:14.271236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5baec-f9f8-4f21-bfdc-2126f01f4b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:14.271893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5baec-f9f8-4f21-bfdc-2126f01f4b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:14.272221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5baec-f9f8-4f21-bfdc-2126f01f4b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:14.273013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5baec-f9f8-4f21-bfdc-2126f01f4b23 admin admin] PATH_INFO: `/v3/users/7439f25dc5e240dd91ec43194b1fe46a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:14.274360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5baec-f9f8-4f21-bfdc-2126f01f4b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7439f25dc5e240dd91ec43194b1fe46a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:14.276960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5baec-f9f8-4f21-bfdc-2126f01f4b23 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:14.315835 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2645/5345] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:13 2022] PUT /identity/v3/projects/a89f9b094a4d474a96a46bf9f5202d01/users/26c31ee8e6a14db48ee6ec7ed31541c2/roles/9d3c050df500490b962bbd47b5e1e7b1 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:14.315835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b0695-c917-42b1-96ad-1b355584b9cd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:14.449745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b0695-c917-42b1-96ad-1b355584b9cd tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:14.453898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79457106-f016-49a4-affe-3c415f2d12cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:14.454714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79457106-f016-49a4-affe-3c415f2d12cd service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:14.455006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79457106-f016-49a4-affe-3c415f2d12cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:14.460758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79457106-f016-49a4-affe-3c415f2d12cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:14.538915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79457106-f016-49a4-affe-3c415f2d12cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:14.541381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79457106-f016-49a4-affe-3c415f2d12cd service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:14.554796 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2646/5346] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:14.556658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79457106-f016-49a4-affe-3c415f2d12cd service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:14.558340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-79457106-f016-49a4-affe-3c415f2d12cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:14.593414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-95f5baec-f9f8-4f21-bfdc-2126f01f4b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7439f25dc5e240dd91ec43194b1fe46a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:14.594184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-95f5baec-f9f8-4f21-bfdc-2126f01f4b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7439f25dc5e240dd91ec43194b1fe46a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:14.675086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79457106-f016-49a4-affe-3c415f2d12cd service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:14.675086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07742d-1351-4773-9d7a-6ce1038a2d4f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:14.675086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07742d-1351-4773-9d7a-6ce1038a2d4f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:14.675835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07742d-1351-4773-9d7a-6ce1038a2d4f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:14.675835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07742d-1351-4773-9d7a-6ce1038a2d4f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:14.675835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07742d-1351-4773-9d7a-6ce1038a2d4f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:14.675835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07742d-1351-4773-9d7a-6ce1038a2d4f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:14.727526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-95f5baec-f9f8-4f21-bfdc-2126f01f4b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7439f25dc5e240dd91ec43194b1fe46a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:14.728888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-95f5baec-f9f8-4f21-bfdc-2126f01f4b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7439f25dc5e240dd91ec43194b1fe46a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:14.783012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-95f5baec-f9f8-4f21-bfdc-2126f01f4b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7439f25dc5e240dd91ec43194b1fe46a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:14.783012 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2701/5347] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:14 2022] DELETE /identity/v3/users/7439f25dc5e240dd91ec43194b1fe46a => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:14.783012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5baec-f9f8-4f21-bfdc-2126f01f4b23 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:14.783012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-95f5baec-f9f8-4f21-bfdc-2126f01f4b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:14.826965 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2647/5348] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:51:14 2022] POST /identity/v3/domains => generated 276 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:14.828589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07742d-1351-4773-9d7a-6ce1038a2d4f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:14.831898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dd07742d-1351-4773-9d7a-6ce1038a2d4f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:14.927551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5baec-f9f8-4f21-bfdc-2126f01f4b23 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:14.996053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07742d-1351-4773-9d7a-6ce1038a2d4f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:15.005862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:15.007392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa1ac0-2d0d-4c95-b551-1da108d1092e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:15.010614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa1ac0-2d0d-4c95-b551-1da108d1092e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:15.011193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa1ac0-2d0d-4c95-b551-1da108d1092e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:15.011694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa1ac0-2d0d-4c95-b551-1da108d1092e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:15.012662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa1ac0-2d0d-4c95-b551-1da108d1092e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:15.016029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa1ac0-2d0d-4c95-b551-1da108d1092e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:15.056863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd65ac-4d4a-4cc7-8f35-43027ada09e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:15.058199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd65ac-4d4a-4cc7-8f35-43027ada09e7 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:15.058531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd65ac-4d4a-4cc7-8f35-43027ada09e7 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:15.059436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd65ac-4d4a-4cc7-8f35-43027ada09e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:15.062709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3efd65ac-4d4a-4cc7-8f35-43027ada09e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:15.082356 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2648/5349] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:14 2022] GET /identity/v3/users => generated 7763 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:15.083375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa1ac0-2d0d-4c95-b551-1da108d1092e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:15.089568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d6aa1ac0-2d0d-4c95-b551-1da108d1092e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:15.204998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd65ac-4d4a-4cc7-8f35-43027ada09e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:15.206746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd65ac-4d4a-4cc7-8f35-43027ada09e7 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:15.217603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:15.240248 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2702/5350] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:15.241341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4ffd-e4a1-47d8-b8d7-013a8f905813 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:15.241648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4ffd-e4a1-47d8-b8d7-013a8f905813 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:15.241908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4ffd-e4a1-47d8-b8d7-013a8f905813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:15.301038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa1ac0-2d0d-4c95-b551-1da108d1092e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:15.310825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecc440-e3cd-4bb7-83a4-2337115a81cc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:15.312963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecc440-e3cd-4bb7-83a4-2337115a81cc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:15.313267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecc440-e3cd-4bb7-83a4-2337115a81cc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:15.313549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecc440-e3cd-4bb7-83a4-2337115a81cc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:15.316063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecc440-e3cd-4bb7-83a4-2337115a81cc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:15.322085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-25bd4ffd-e4a1-47d8-b8d7-013a8f905813 None None] MFA Rules not processed for user `26c31ee8e6a14db48ee6ec7ed31541c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:15.322390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecc440-e3cd-4bb7-83a4-2337115a81cc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:15.323427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-25bd4ffd-e4a1-47d8-b8d7-013a8f905813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:15.490703 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2649/5351] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:15 2022] POST /identity/v3/projects => generated 401 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:15.498541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecc440-e3cd-4bb7-83a4-2337115a81cc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:15.559578 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2703/5352] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:15 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:15.569129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6d462-e349-4f10-a2e3-0cb3ebbb6645 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:15.569530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6d462-e349-4f10-a2e3-0cb3ebbb6645 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:15.569914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6d462-e349-4f10-a2e3-0cb3ebbb6645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:15.614191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-80a6d462-e349-4f10-a2e3-0cb3ebbb6645 None None] MFA Rules not processed for user `26c31ee8e6a14db48ee6ec7ed31541c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:15.615667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-80a6d462-e349-4f10-a2e3-0cb3ebbb6645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:15.710613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecc440-e3cd-4bb7-83a4-2337115a81cc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:15.720058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab76313-ec5a-4539-961a-999cfe8ee938 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:15.721097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab76313-ec5a-4539-961a-999cfe8ee938 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:15.721565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab76313-ec5a-4539-961a-999cfe8ee938 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:15.722033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab76313-ec5a-4539-961a-999cfe8ee938 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/groups` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:15.722876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab76313-ec5a-4539-961a-999cfe8ee938 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:15.725523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab76313-ec5a-4539-961a-999cfe8ee938 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:15.794166 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2704/5353] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:15 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:15.795484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6d462-e349-4f10-a2e3-0cb3ebbb6645 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:15.805515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6d462-e349-4f10-a2e3-0cb3ebbb6645 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:15.817352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325cbe5-0261-4987-be9e-05b4408ccb70 tempest-TrustsV3TestJSON-576642520 tempest-user-1365833834] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26c31ee8e6a14db48ee6ec7ed31541c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89f9b094a4d474a96a46bf9f5202d01', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1762480849', 'tempest-NotDelegatedRole-1695846999'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:15.818268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325cbe5-0261-4987-be9e-05b4408ccb70 tempest-TrustsV3TestJSON-576642520 tempest-user-1365833834] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:15.818751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325cbe5-0261-4987-be9e-05b4408ccb70 tempest-TrustsV3TestJSON-576642520 tempest-user-1365833834] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:15.819172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325cbe5-0261-4987-be9e-05b4408ccb70 tempest-TrustsV3TestJSON-576642520 tempest-user-1365833834] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:15.819992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325cbe5-0261-4987-be9e-05b4408ccb70 tempest-TrustsV3TestJSON-576642520 tempest-user-1365833834] RBAC: Authorizing `identity:create_trust()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:15.830526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325cbe5-0261-4987-be9e-05b4408ccb70 tempest-TrustsV3TestJSON-576642520 tempest-user-1365833834] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:15.863863 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2650/5354] 10.222.0.76 () {60 vars in 1147 bytes} [Sat Aug 27 04:51:15 2022] POST /identity/v3/groups => generated 300 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:51:15.865015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab76313-ec5a-4539-961a-999cfe8ee938 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:15.882909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab76313-ec5a-4539-961a-999cfe8ee938 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:15.899709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf255e-98c4-40d5-a1e4-8bf0fb7a5aca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:15.901037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf255e-98c4-40d5-a1e4-8bf0fb7a5aca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:15.901758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf255e-98c4-40d5-a1e4-8bf0fb7a5aca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:15.902210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf255e-98c4-40d5-a1e4-8bf0fb7a5aca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:15.904737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf255e-98c4-40d5-a1e4-8bf0fb7a5aca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:15.906616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf255e-98c4-40d5-a1e4-8bf0fb7a5aca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:15.975055 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-6325cbe5-0261-4987-be9e-05b4408ccb70 tempest-TrustsV3TestJSON-576642520 tempest-user-1365833834] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:51:15.975055 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:15.975055 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Aug 27 04:51:15.975055 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Aug 27 04:51:15.975055 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Aug 27 04:51:15.975055 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Aug 27 04:51:15.975055 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Aug 27 04:51:15.975055 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:51:15.975055 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:51:15.975055 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:51:15.975055 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:15.975055 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Aug 27 04:51:15.975055 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Aug 27 04:51:15.975055 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise ValueError(str(e)) Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Aug 27 04:51:15.976664 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Aug 27 04:51:15.978385 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Aug 27 04:51:15.978385 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Aug 27 04:51:15.978385 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Aug 27 04:51:15.978385 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Aug 27 04:51:15.978385 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:51:15.978385 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:51:15.978385 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2705/5355] 10.222.0.76 () {60 vars in 1174 bytes} [Sat Aug 27 04:51:15 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 183 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:51:15.982023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325cbe5-0261-4987-be9e-05b4408ccb70 tempest-TrustsV3TestJSON-576642520 tempest-user-1365833834] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:16.017596 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2651/5356] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:51:15 2022] POST /identity/v3/roles => generated 235 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:51:16.021962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf255e-98c4-40d5-a1e4-8bf0fb7a5aca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:16.025230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-91bf255e-98c4-40d5-a1e4-8bf0fb7a5aca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:16.108123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325cbe5-0261-4987-be9e-05b4408ccb70 tempest-TrustsV3TestJSON-576642520 tempest-user-1365833834] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:16.118410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72147b9d-9b08-4f26-a28c-d8094e62c053 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:16.119603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72147b9d-9b08-4f26-a28c-d8094e62c053 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:16.120066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72147b9d-9b08-4f26-a28c-d8094e62c053 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:16.121157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72147b9d-9b08-4f26-a28c-d8094e62c053 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles/9d3c050df500490b962bbd47b5e1e7b1` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:16.123969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72147b9d-9b08-4f26-a28c-d8094e62c053 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9d3c050df500490b962bbd47b5e1e7b1)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:16.126779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72147b9d-9b08-4f26-a28c-d8094e62c053 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:16.182741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf255e-98c4-40d5-a1e4-8bf0fb7a5aca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:16.188060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8359d03-1cfa-4236-9670-efcf23bb770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:16.188850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8359d03-1cfa-4236-9670-efcf23bb770b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:16.189257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8359d03-1cfa-4236-9670-efcf23bb770b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:16.189547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8359d03-1cfa-4236-9670-efcf23bb770b admin admin] PATH_INFO: `/v3/projects/eb09c05d05e94499a231d232c57a523a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:16.190793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8359d03-1cfa-4236-9670-efcf23bb770b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb09c05d05e94499a231d232c57a523a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:16.192851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8359d03-1cfa-4236-9670-efcf23bb770b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:16.373488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8359d03-1cfa-4236-9670-efcf23bb770b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb09c05d05e94499a231d232c57a523a', 'request_id': 'req-e8359d03-1cfa-4236-9670-efcf23bb770b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:16.380865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8359d03-1cfa-4236-9670-efcf23bb770b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb09c05d05e94499a231d232c57a523a', 'request_id': 'req-e8359d03-1cfa-4236-9670-efcf23bb770b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:16.388982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8359d03-1cfa-4236-9670-efcf23bb770b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb09c05d05e94499a231d232c57a523a', 'request_id': 'req-e8359d03-1cfa-4236-9670-efcf23bb770b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:16.411635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-72147b9d-9b08-4f26-a28c-d8094e62c053 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invalidating the token cache because role 9d3c050df500490b962bbd47b5e1e7b1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:16.411635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-72147b9d-9b08-4f26-a28c-d8094e62c053 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:16.411635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-72147b9d-9b08-4f26-a28c-d8094e62c053 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:16.418269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:16.419463 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2706/5357] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:15 2022] DELETE /identity/v3/roles/9d3c050df500490b962bbd47b5e1e7b1 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:51:16.420353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72147b9d-9b08-4f26-a28c-d8094e62c053 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:16.422417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-72147b9d-9b08-4f26-a28c-d8094e62c053 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:16.464248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8359d03-1cfa-4236-9670-efcf23bb770b admin admin] The token cache is being invalidate because project eb09c05d05e94499a231d232c57a523a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:16.468414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8359d03-1cfa-4236-9670-efcf23bb770b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:16.468414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e8359d03-1cfa-4236-9670-efcf23bb770b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:16.468414 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2652/5358] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:16 2022] DELETE /identity/v3/projects/eb09c05d05e94499a231d232c57a523a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:16.468414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8359d03-1cfa-4236-9670-efcf23bb770b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:16.477922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e8359d03-1cfa-4236-9670-efcf23bb770b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:16.540524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72147b9d-9b08-4f26-a28c-d8094e62c053 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:16.548739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fca6c-e416-47ad-9f1a-bf703da1304b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:16.549591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fca6c-e416-47ad-9f1a-bf703da1304b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:16.560264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fca6c-e416-47ad-9f1a-bf703da1304b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:16.560264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fca6c-e416-47ad-9f1a-bf703da1304b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:16.560264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fca6c-e416-47ad-9f1a-bf703da1304b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:16.560264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fca6c-e416-47ad-9f1a-bf703da1304b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:16.598650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8359d03-1cfa-4236-9670-efcf23bb770b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:16.656724 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2707/5359] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:16 2022] POST /identity/v3/users => generated 442 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:16.658783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fca6c-e416-47ad-9f1a-bf703da1304b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:16.663966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-691fca6c-e416-47ad-9f1a-bf703da1304b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:16.738892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbfdc0-e7ca-42b6-9e75-83f013dfe08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:16.739631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbfdc0-e7ca-42b6-9e75-83f013dfe08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:16.739993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbfdc0-e7ca-42b6-9e75-83f013dfe08e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:16.740492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbfdc0-e7ca-42b6-9e75-83f013dfe08e admin admin] PATH_INFO: `/v3/projects/40339c1d2e2842cab5a9a143a40c0d8e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:16.742140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbfdc0-e7ca-42b6-9e75-83f013dfe08e admin admin] RBAC: Authorizing `identity:delete_project(project_id=40339c1d2e2842cab5a9a143a40c0d8e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:16.744021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbfdc0-e7ca-42b6-9e75-83f013dfe08e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:16.798358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fca6c-e416-47ad-9f1a-bf703da1304b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:16.804314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68590014-c036-43fd-af7f-e5fd462a686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:16.805025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68590014-c036-43fd-af7f-e5fd462a686c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:16.805318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68590014-c036-43fd-af7f-e5fd462a686c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:16.805672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68590014-c036-43fd-af7f-e5fd462a686c admin admin] PATH_INFO: `/v3/projects/dc976c7c588e42f089299ed5a3c124fe` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:16.806860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68590014-c036-43fd-af7f-e5fd462a686c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc976c7c588e42f089299ed5a3c124fe)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:16.809753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68590014-c036-43fd-af7f-e5fd462a686c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:16.963447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:16.995990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-68590014-c036-43fd-af7f-e5fd462a686c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc976c7c588e42f089299ed5a3c124fe', 'request_id': 'req-68590014-c036-43fd-af7f-e5fd462a686c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:16.998987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ffbbfdc0-e7ca-42b6-9e75-83f013dfe08e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40339c1d2e2842cab5a9a143a40c0d8e', 'request_id': 'req-ffbbfdc0-e7ca-42b6-9e75-83f013dfe08e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:17.001876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-68590014-c036-43fd-af7f-e5fd462a686c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc976c7c588e42f089299ed5a3c124fe', 'request_id': 'req-68590014-c036-43fd-af7f-e5fd462a686c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:17.011389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ffbbfdc0-e7ca-42b6-9e75-83f013dfe08e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40339c1d2e2842cab5a9a143a40c0d8e', 'request_id': 'req-ffbbfdc0-e7ca-42b6-9e75-83f013dfe08e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:17.018741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ffbbfdc0-e7ca-42b6-9e75-83f013dfe08e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40339c1d2e2842cab5a9a143a40c0d8e', 'request_id': 'req-ffbbfdc0-e7ca-42b6-9e75-83f013dfe08e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:17.095456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-68590014-c036-43fd-af7f-e5fd462a686c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc976c7c588e42f089299ed5a3c124fe', 'request_id': 'req-68590014-c036-43fd-af7f-e5fd462a686c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:17.108191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-68590014-c036-43fd-af7f-e5fd462a686c admin admin] The token cache is being invalidate because project dc976c7c588e42f089299ed5a3c124fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:17.108491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-68590014-c036-43fd-af7f-e5fd462a686c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:17.109163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-68590014-c036-43fd-af7f-e5fd462a686c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:17.111174 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2708/5360] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:16 2022] DELETE /identity/v3/projects/dc976c7c588e42f089299ed5a3c124fe => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:17.115369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68590014-c036-43fd-af7f-e5fd462a686c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:17.116583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-68590014-c036-43fd-af7f-e5fd462a686c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:17.125168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:17.158818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ffbbfdc0-e7ca-42b6-9e75-83f013dfe08e admin admin] The token cache is being invalidate because project 40339c1d2e2842cab5a9a143a40c0d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:17.159157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ffbbfdc0-e7ca-42b6-9e75-83f013dfe08e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:17.160828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ffbbfdc0-e7ca-42b6-9e75-83f013dfe08e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:17.162463 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2653/5361] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:16 2022] DELETE /identity/v3/projects/40339c1d2e2842cab5a9a143a40c0d8e => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:17.173097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467606c-1655-415f-909b-ff3ed3173819 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:17.173097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467606c-1655-415f-909b-ff3ed3173819 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:17.173097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467606c-1655-415f-909b-ff3ed3173819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:17.203531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68590014-c036-43fd-af7f-e5fd462a686c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:17.220647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a467606c-1655-415f-909b-ff3ed3173819 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:17.221891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a467606c-1655-415f-909b-ff3ed3173819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:17.287334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1acbd7-ba52-418a-8ffc-e46f170eefaa tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:17.288686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1acbd7-ba52-418a-8ffc-e46f170eefaa tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:17.289070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1acbd7-ba52-418a-8ffc-e46f170eefaa tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:17.289409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1acbd7-ba52-418a-8ffc-e46f170eefaa tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles/3c54f94637d5480a9bd49383966d7e9d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:17.291794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1acbd7-ba52-418a-8ffc-e46f170eefaa tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3c54f94637d5480a9bd49383966d7e9d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:17.293973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1acbd7-ba52-418a-8ffc-e46f170eefaa tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:17.324131 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2654/5362] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:17.324131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467606c-1655-415f-909b-ff3ed3173819 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:17.325914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a467606c-1655-415f-909b-ff3ed3173819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:17.440938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467606c-1655-415f-909b-ff3ed3173819 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:17.447059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00371d4-844f-4d30-81ac-29a303443746 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:17.447850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00371d4-844f-4d30-81ac-29a303443746 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:17.448059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00371d4-844f-4d30-81ac-29a303443746 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:17.448797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00371d4-844f-4d30-81ac-29a303443746 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:17.449359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00371d4-844f-4d30-81ac-29a303443746 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:17.450450 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-c00371d4-844f-4d30-81ac-29a303443746 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:17.450450 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:17.450450 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:17.451439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00371d4-844f-4d30-81ac-29a303443746 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:17.505158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7d1acbd7-ba52-418a-8ffc-e46f170eefaa tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invalidating the token cache because role 3c54f94637d5480a9bd49383966d7e9d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:17.505468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7d1acbd7-ba52-418a-8ffc-e46f170eefaa tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:17.506646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7d1acbd7-ba52-418a-8ffc-e46f170eefaa tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:17.513306 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2709/5363] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:17 2022] DELETE /identity/v3/roles/3c54f94637d5480a9bd49383966d7e9d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:17.513306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2a197-53ec-4467-a649-794a7665da77 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:17.513306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2a197-53ec-4467-a649-794a7665da77 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:17.513306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2a197-53ec-4467-a649-794a7665da77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:17.545192 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2655/5364] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:51:17 2022] POST /identity/v3/roles => generated 270 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:17.545192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bf99f-d232-41f9-845e-d6ddc445bdd4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:17.545192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bf99f-d232-41f9-845e-d6ddc445bdd4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:17.545192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bf99f-d232-41f9-845e-d6ddc445bdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:17.578150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c6c2a197-53ec-4467-a649-794a7665da77 None None] MFA Rules not processed for user `9a05d8e7d917402fae37644094dd2aef`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:17.581760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c6c2a197-53ec-4467-a649-794a7665da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:17.604909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9e6bf99f-d232-41f9-845e-d6ddc445bdd4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:17.606146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9e6bf99f-d232-41f9-845e-d6ddc445bdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:17.677580 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2710/5365] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:17.678813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2a197-53ec-4467-a649-794a7665da77 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:17.681040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c6c2a197-53ec-4467-a649-794a7665da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:17.687409 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2656/5366] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:17.693672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:17.694161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10363495-8b71-4371-8027-25c7133cdf72 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:17.694161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10363495-8b71-4371-8027-25c7133cdf72 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:17.694161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10363495-8b71-4371-8027-25c7133cdf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:17.710465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2a197-53ec-4467-a649-794a7665da77 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:17.722896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-10363495-8b71-4371-8027-25c7133cdf72 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:17.723035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2244bbd-ee7b-4876-b1e8-3d6e1780a1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:17.723035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2244bbd-ee7b-4876-b1e8-3d6e1780a1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:17.723241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-10363495-8b71-4371-8027-25c7133cdf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:17.723353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2244bbd-ee7b-4876-b1e8-3d6e1780a1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:17.723353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2244bbd-ee7b-4876-b1e8-3d6e1780a1a2 admin admin] PATH_INFO: `/v3/users/4174797552a64d53b52e3d387f1af40a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:17.723353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2244bbd-ee7b-4876-b1e8-3d6e1780a1a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4174797552a64d53b52e3d387f1af40a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:17.723782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2244bbd-ee7b-4876-b1e8-3d6e1780a1a2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:17.760352 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2657/5367] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:17.761221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10363495-8b71-4371-8027-25c7133cdf72 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:17.762707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-10363495-8b71-4371-8027-25c7133cdf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:17.850708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10363495-8b71-4371-8027-25c7133cdf72 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:17.860292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a234daa-dc43-4f2d-b6a6-4a996d1bd98b tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:17.860962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a234daa-dc43-4f2d-b6a6-4a996d1bd98b tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:17.861989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a234daa-dc43-4f2d-b6a6-4a996d1bd98b tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:17.862278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a234daa-dc43-4f2d-b6a6-4a996d1bd98b tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users/26c31ee8e6a14db48ee6ec7ed31541c2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:17.864337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a234daa-dc43-4f2d-b6a6-4a996d1bd98b tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_user(user_id=26c31ee8e6a14db48ee6ec7ed31541c2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:17.868932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a234daa-dc43-4f2d-b6a6-4a996d1bd98b tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:18.029171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4a234daa-dc43-4f2d-b6a6-4a996d1bd98b tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26c31ee8e6a14db48ee6ec7ed31541c2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:18.030048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e2244bbd-ee7b-4876-b1e8-3d6e1780a1a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4174797552a64d53b52e3d387f1af40a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:18.032469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e2244bbd-ee7b-4876-b1e8-3d6e1780a1a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4174797552a64d53b52e3d387f1af40a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:18.130427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4a234daa-dc43-4f2d-b6a6-4a996d1bd98b tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26c31ee8e6a14db48ee6ec7ed31541c2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:18.132877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4a234daa-dc43-4f2d-b6a6-4a996d1bd98b tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26c31ee8e6a14db48ee6ec7ed31541c2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:18.147907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4a234daa-dc43-4f2d-b6a6-4a996d1bd98b tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26c31ee8e6a14db48ee6ec7ed31541c2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:18.170486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4a234daa-dc43-4f2d-b6a6-4a996d1bd98b tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26c31ee8e6a14db48ee6ec7ed31541c2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:18.178102 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2658/5368] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:17 2022] DELETE /identity/v3/users/26c31ee8e6a14db48ee6ec7ed31541c2 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:18.178908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a234daa-dc43-4f2d-b6a6-4a996d1bd98b tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:18.181478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4a234daa-dc43-4f2d-b6a6-4a996d1bd98b tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:18.218396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e2244bbd-ee7b-4876-b1e8-3d6e1780a1a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4174797552a64d53b52e3d387f1af40a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:18.219115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e2244bbd-ee7b-4876-b1e8-3d6e1780a1a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4174797552a64d53b52e3d387f1af40a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:18.241669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e2244bbd-ee7b-4876-b1e8-3d6e1780a1a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4174797552a64d53b52e3d387f1af40a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:18.269471 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2711/5369] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:17 2022] DELETE /identity/v3/users/4174797552a64d53b52e3d387f1af40a => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:18.284484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150c041-a355-466a-a59e-76e8cab84894 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:18.284799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:18.284918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150c041-a355-466a-a59e-76e8cab84894 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:18.285117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150c041-a355-466a-a59e-76e8cab84894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:18.290056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a234daa-dc43-4f2d-b6a6-4a996d1bd98b tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:18.306671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9150c041-a355-466a-a59e-76e8cab84894 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:18.307904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9150c041-a355-466a-a59e-76e8cab84894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:18.410725 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2712/5370] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:18.411738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150c041-a355-466a-a59e-76e8cab84894 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:18.417916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9150c041-a355-466a-a59e-76e8cab84894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:18.426321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c615def-eb9a-4377-bf70-2cb7a3f4e9b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:18.427171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c615def-eb9a-4377-bf70-2cb7a3f4e9b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:18.427486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c615def-eb9a-4377-bf70-2cb7a3f4e9b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:18.427739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c615def-eb9a-4377-bf70-2cb7a3f4e9b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/projects/818237f556a4495eb0a73c1763a11490/users/0a48539c987b4f988709d51f673cda2d/roles/990d677663c64d4697449c4d726d1d01` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:18.432139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150c041-a355-466a-a59e-76e8cab84894 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:18.438995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a4e3f-c87e-46ce-aeb8-88ea4bdd8d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:18.444884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a4e3f-c87e-46ce-aeb8-88ea4bdd8d36 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:18.444884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a4e3f-c87e-46ce-aeb8-88ea4bdd8d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:18.444884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a4e3f-c87e-46ce-aeb8-88ea4bdd8d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:18.444884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a4e3f-c87e-46ce-aeb8-88ea4bdd8d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:18.444884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a4e3f-c87e-46ce-aeb8-88ea4bdd8d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:18.444884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a4e3f-c87e-46ce-aeb8-88ea4bdd8d36 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:18.459985 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2713/5371] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:18.462123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99674c-15f1-4e26-8231-efd15e582f06 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:18.462410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c615def-eb9a-4377-bf70-2cb7a3f4e9b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_grant(project_id=818237f556a4495eb0a73c1763a11490, user_id=0a48539c987b4f988709d51f673cda2d, role_id=990d677663c64d4697449c4d726d1d01)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:18.462545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99674c-15f1-4e26-8231-efd15e582f06 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:18.462729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99674c-15f1-4e26-8231-efd15e582f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:18.470246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-9e99674c-15f1-4e26-8231-efd15e582f06 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:51:18.470246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:18.470246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:18.470246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:18.470246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:18.470246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:18.470246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:18.470246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:18.470246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:18.470246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:18.470246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:18.470246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:18.470246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:51:18.471209 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:51:18.471209 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:51:18.471209 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:51:18.471209 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:51:18.471209 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:51:18.471209 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:51:18.471209 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:51:18.471209 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:51:18.471209 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:51:18.471209 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:51:18.471209 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:51:18.471209 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:51:18.471209 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:51:18.471209 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:51:18.471209 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:51:18.472227 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2714/5372] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:51:18 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:51:18.472324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c615def-eb9a-4377-bf70-2cb7a3f4e9b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:18.472412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99674c-15f1-4e26-8231-efd15e582f06 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:18.477100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9e99674c-15f1-4e26-8231-efd15e582f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:18.573000 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2659/5373] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:18 2022] PUT /identity/v3/projects/818237f556a4495eb0a73c1763a11490/users/0a48539c987b4f988709d51f673cda2d/roles/990d677663c64d4697449c4d726d1d01 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:18.573000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c615def-eb9a-4377-bf70-2cb7a3f4e9b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:18.579073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99674c-15f1-4e26-8231-efd15e582f06 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:18.664913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23694ef6-2db0-44d8-8b07-69b42061cd98 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:18.665420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23694ef6-2db0-44d8-8b07-69b42061cd98 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:18.665825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23694ef6-2db0-44d8-8b07-69b42061cd98 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:18.666247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23694ef6-2db0-44d8-8b07-69b42061cd98 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/a89f9b094a4d474a96a46bf9f5202d01` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:18.667592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23694ef6-2db0-44d8-8b07-69b42061cd98 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a89f9b094a4d474a96a46bf9f5202d01)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:18.671162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23694ef6-2db0-44d8-8b07-69b42061cd98 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:18.685135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c615def-eb9a-4377-bf70-2cb7a3f4e9b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:18.690632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f8b6c-0cf0-4b0e-b6f4-fd81ee4f159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:18.691250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f8b6c-0cf0-4b0e-b6f4-fd81ee4f159b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:18.691534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f8b6c-0cf0-4b0e-b6f4-fd81ee4f159b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:18.691807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f8b6c-0cf0-4b0e-b6f4-fd81ee4f159b admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:18.692661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f8b6c-0cf0-4b0e-b6f4-fd81ee4f159b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:18.692970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f8b6c-0cf0-4b0e-b6f4-fd81ee4f159b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:18.696446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f8b6c-0cf0-4b0e-b6f4-fd81ee4f159b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:18.711459 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2660/5374] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:18.712474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f8b6c-0cf0-4b0e-b6f4-fd81ee4f159b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:18.735168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f8b6c-0cf0-4b0e-b6f4-fd81ee4f159b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:18.742911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adc2cb-75a5-4e88-af8a-8db15c5e3b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:18.743568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adc2cb-75a5-4e88-af8a-8db15c5e3b68 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:18.746102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adc2cb-75a5-4e88-af8a-8db15c5e3b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:18.746102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adc2cb-75a5-4e88-af8a-8db15c5e3b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:18.746102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19adc2cb-75a5-4e88-af8a-8db15c5e3b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:18.748349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19adc2cb-75a5-4e88-af8a-8db15c5e3b68 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:18.876000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-23694ef6-2db0-44d8-8b07-69b42061cd98 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a89f9b094a4d474a96a46bf9f5202d01', 'request_id': 'req-23694ef6-2db0-44d8-8b07-69b42061cd98'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:18.881995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-23694ef6-2db0-44d8-8b07-69b42061cd98 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a89f9b094a4d474a96a46bf9f5202d01', 'request_id': 'req-23694ef6-2db0-44d8-8b07-69b42061cd98'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:18.903806 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2661/5375] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:18 2022] POST /identity/v3/projects => generated 369 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:18.903806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adc2cb-75a5-4e88-af8a-8db15c5e3b68 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:18.905534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-19adc2cb-75a5-4e88-af8a-8db15c5e3b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:18.978064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adc2cb-75a5-4e88-af8a-8db15c5e3b68 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:18.983479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48418496-9b43-4472-ba3e-357ff9ec6d1a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:18.984234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48418496-9b43-4472-ba3e-357ff9ec6d1a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:18.987644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48418496-9b43-4472-ba3e-357ff9ec6d1a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:18.987644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48418496-9b43-4472-ba3e-357ff9ec6d1a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:18.987644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48418496-9b43-4472-ba3e-357ff9ec6d1a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Adding query filter params (scope.project.id=818237f556a4495eb0a73c1763a11490, user.id=0a48539c987b4f988709d51f673cda2d) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:18.987644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48418496-9b43-4472-ba3e-357ff9ec6d1a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:18.988276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48418496-9b43-4472-ba3e-357ff9ec6d1a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:19.009596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:19.011996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-23694ef6-2db0-44d8-8b07-69b42061cd98 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a89f9b094a4d474a96a46bf9f5202d01', 'request_id': 'req-23694ef6-2db0-44d8-8b07-69b42061cd98'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:19.037344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-23694ef6-2db0-44d8-8b07-69b42061cd98 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] The token cache is being invalidate because project a89f9b094a4d474a96a46bf9f5202d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:19.038002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-23694ef6-2db0-44d8-8b07-69b42061cd98 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:19.038459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-23694ef6-2db0-44d8-8b07-69b42061cd98 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:19.045875 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2715/5376] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:18 2022] DELETE /identity/v3/projects/a89f9b094a4d474a96a46bf9f5202d01 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:19.047616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23694ef6-2db0-44d8-8b07-69b42061cd98 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:19.049652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-23694ef6-2db0-44d8-8b07-69b42061cd98 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:19.096764 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2662/5377] 10.222.0.76 () {58 vars in 1356 bytes} [Sat Aug 27 04:51:18 2022] GET /identity/v3/role_assignments?scope.project.id=818237f556a4495eb0a73c1763a11490&user.id=0a48539c987b4f988709d51f673cda2d&effective => generated 228 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:19.098326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48418496-9b43-4472-ba3e-357ff9ec6d1a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:19.101133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-48418496-9b43-4472-ba3e-357ff9ec6d1a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:19.139160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23694ef6-2db0-44d8-8b07-69b42061cd98 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:19.243776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145a70c-661e-41bf-a504-249c1a78e61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:19.244482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145a70c-661e-41bf-a504-249c1a78e61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:19.252611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145a70c-661e-41bf-a504-249c1a78e61b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:19.255563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145a70c-661e-41bf-a504-249c1a78e61b admin admin] PATH_INFO: `/v3/projects/2360b3d1e3f94b11aca87c33f8ecd790` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:19.255563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145a70c-661e-41bf-a504-249c1a78e61b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2360b3d1e3f94b11aca87c33f8ecd790)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:19.256070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48418496-9b43-4472-ba3e-357ff9ec6d1a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:19.256827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145a70c-661e-41bf-a504-249c1a78e61b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:19.269111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6fa5a-49d4-4514-8640-db63a0c81cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:19.269738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6fa5a-49d4-4514-8640-db63a0c81cfa admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:19.270068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6fa5a-49d4-4514-8640-db63a0c81cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:19.270346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6fa5a-49d4-4514-8640-db63a0c81cfa admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:19.271040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6fa5a-49d4-4514-8640-db63a0c81cfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:19.273063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6fa5a-49d4-4514-8640-db63a0c81cfa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:19.422354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c145a70c-661e-41bf-a504-249c1a78e61b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2360b3d1e3f94b11aca87c33f8ecd790', 'request_id': 'req-c145a70c-661e-41bf-a504-249c1a78e61b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:19.431580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c145a70c-661e-41bf-a504-249c1a78e61b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2360b3d1e3f94b11aca87c33f8ecd790', 'request_id': 'req-c145a70c-661e-41bf-a504-249c1a78e61b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:19.479512 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2663/5378] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:19 2022] POST /identity/v3/projects => generated 393 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:19.480322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6fa5a-49d4-4514-8640-db63a0c81cfa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:19.483071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-00c6fa5a-49d4-4514-8640-db63a0c81cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:19.515370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c145a70c-661e-41bf-a504-249c1a78e61b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2360b3d1e3f94b11aca87c33f8ecd790', 'request_id': 'req-c145a70c-661e-41bf-a504-249c1a78e61b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:19.535620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c145a70c-661e-41bf-a504-249c1a78e61b admin admin] The token cache is being invalidate because project 2360b3d1e3f94b11aca87c33f8ecd790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:19.535620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c145a70c-661e-41bf-a504-249c1a78e61b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:19.535620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c145a70c-661e-41bf-a504-249c1a78e61b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:19.535620 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2716/5379] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:19 2022] DELETE /identity/v3/projects/2360b3d1e3f94b11aca87c33f8ecd790 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:19.535620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145a70c-661e-41bf-a504-249c1a78e61b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:19.539361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c145a70c-661e-41bf-a504-249c1a78e61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:19.607655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6fa5a-49d4-4514-8640-db63a0c81cfa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:19.614362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ac132-f033-4d72-8a89-ec241c15784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:19.615044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ac132-f033-4d72-8a89-ec241c15784a admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:19.615333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ac132-f033-4d72-8a89-ec241c15784a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:19.615783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ac132-f033-4d72-8a89-ec241c15784a admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:19.616615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ac132-f033-4d72-8a89-ec241c15784a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:19.620305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ac132-f033-4d72-8a89-ec241c15784a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:19.712364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145a70c-661e-41bf-a504-249c1a78e61b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:19.726800 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2664/5380] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:19 2022] POST /identity/v3/users => generated 285 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:19.733785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ac132-f033-4d72-8a89-ec241c15784a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:19.736392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:19.739055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-432ac132-f033-4d72-8a89-ec241c15784a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:19.794316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6ccc0-decf-454f-9cfd-932f432450ed tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:19.795592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6ccc0-decf-454f-9cfd-932f432450ed tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:19.796305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6ccc0-decf-454f-9cfd-932f432450ed tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:19.798135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6ccc0-decf-454f-9cfd-932f432450ed tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:19.800445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6ccc0-decf-454f-9cfd-932f432450ed tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:19.805201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6ccc0-decf-454f-9cfd-932f432450ed tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:19.863085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ac132-f033-4d72-8a89-ec241c15784a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:19.871621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3e66f-ee5b-45bc-89c5-7a271b1fc16b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:19.872792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3e66f-ee5b-45bc-89c5-7a271b1fc16b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:19.872792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3e66f-ee5b-45bc-89c5-7a271b1fc16b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:19.873220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3e66f-ee5b-45bc-89c5-7a271b1fc16b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/projects/818237f556a4495eb0a73c1763a11490/users/0a48539c987b4f988709d51f673cda2d/roles/990d677663c64d4697449c4d726d1d01` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:19.875544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3e66f-ee5b-45bc-89c5-7a271b1fc16b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=818237f556a4495eb0a73c1763a11490, user_id=0a48539c987b4f988709d51f673cda2d, role_id=990d677663c64d4697449c4d726d1d01)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:19.879019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3e66f-ee5b-45bc-89c5-7a271b1fc16b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:19.887167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f4d3e66f-ee5b-45bc-89c5-7a271b1fc16b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invalidating the token cache because role 990d677663c64d4697449c4d726d1d01 was removed from user 0a48539c987b4f988709d51f673cda2d on project 818237f556a4495eb0a73c1763a11490. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:19.887167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f4d3e66f-ee5b-45bc-89c5-7a271b1fc16b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:19.887671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f4d3e66f-ee5b-45bc-89c5-7a271b1fc16b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:19.975069 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2717/5381] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:51:19 2022] POST /identity/v3/projects => generated 328 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:19.975069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6ccc0-decf-454f-9cfd-932f432450ed tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:19.975069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-06f6ccc0-decf-454f-9cfd-932f432450ed tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:20.011895 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2665/5382] 10.222.0.76 () {58 vars in 1467 bytes} [Sat Aug 27 04:51:19 2022] DELETE /identity/v3/projects/818237f556a4495eb0a73c1763a11490/users/0a48539c987b4f988709d51f673cda2d/roles/990d677663c64d4697449c4d726d1d01 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:20.018075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aee56a-448a-4c9f-971f-9554f2df6c3b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:20.018075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aee56a-448a-4c9f-971f-9554f2df6c3b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:20.018075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aee56a-448a-4c9f-971f-9554f2df6c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:20.045953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-07aee56a-448a-4c9f-971f-9554f2df6c3b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:20.047365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-07aee56a-448a-4c9f-971f-9554f2df6c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:20.098575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6ccc0-decf-454f-9cfd-932f432450ed tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:20.132674 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2666/5383] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:20.132674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aee56a-448a-4c9f-971f-9554f2df6c3b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:20.132674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-07aee56a-448a-4c9f-971f-9554f2df6c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:20.140871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aee56a-448a-4c9f-971f-9554f2df6c3b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:20.145969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c442c5b-7db7-4655-98be-0ac10565dfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:20.146541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c442c5b-7db7-4655-98be-0ac10565dfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:20.146826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c442c5b-7db7-4655-98be-0ac10565dfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:20.147170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c442c5b-7db7-4655-98be-0ac10565dfb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:20.147949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c442c5b-7db7-4655-98be-0ac10565dfb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:20.149870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c442c5b-7db7-4655-98be-0ac10565dfb0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:20.166489 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2667/5384] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:20 2022] GET /identity/v3/roles => generated 2324 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:20.166489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c442c5b-7db7-4655-98be-0ac10565dfb0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:20.167460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829c4e2-f9f8-45e3-ab28-65928a51b2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:20.168028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9c442c5b-7db7-4655-98be-0ac10565dfb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:20.168328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829c4e2-f9f8-45e3-ab28-65928a51b2da admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:20.168711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829c4e2-f9f8-45e3-ab28-65928a51b2da admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:20.169082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829c4e2-f9f8-45e3-ab28-65928a51b2da admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:20.169818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829c4e2-f9f8-45e3-ab28-65928a51b2da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:20.171926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829c4e2-f9f8-45e3-ab28-65928a51b2da admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:20.256553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c442c5b-7db7-4655-98be-0ac10565dfb0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:20.266708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74de30-97e3-4efd-92e9-b44911fea3e6 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:20.267520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74de30-97e3-4efd-92e9-b44911fea3e6 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:20.267908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74de30-97e3-4efd-92e9-b44911fea3e6 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:20.268486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74de30-97e3-4efd-92e9-b44911fea3e6 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:20.269252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74de30-97e3-4efd-92e9-b44911fea3e6 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:20.271420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74de30-97e3-4efd-92e9-b44911fea3e6 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:20.279550 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2718/5385] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:19 2022] POST /identity/v3/users => generated 303 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:20.281131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829c4e2-f9f8-45e3-ab28-65928a51b2da admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:20.287935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8829c4e2-f9f8-45e3-ab28-65928a51b2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:20.366641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829c4e2-f9f8-45e3-ab28-65928a51b2da admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:20.372337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c8fba-ea34-4045-bd7e-3ebee1217c37 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:20.372995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c8fba-ea34-4045-bd7e-3ebee1217c37 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:20.373272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c8fba-ea34-4045-bd7e-3ebee1217c37 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:20.373546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c8fba-ea34-4045-bd7e-3ebee1217c37 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/990d677663c64d4697449c4d726d1d01` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:20.376412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c8fba-ea34-4045-bd7e-3ebee1217c37 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=990d677663c64d4697449c4d726d1d01)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:20.377444 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-b41c8fba-ea34-4045-bd7e-3ebee1217c37 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:20.377444 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:20.377444 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:20.378368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c8fba-ea34-4045-bd7e-3ebee1217c37 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:20.382513 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2668/5386] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:20 2022] POST /identity/v3/users => generated 410 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:20.384313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b7180-c098-4930-b31a-88298d98b81d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:20.384766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b7180-c098-4930-b31a-88298d98b81d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:20.385287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b7180-c098-4930-b31a-88298d98b81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:20.408516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2b0b7180-c098-4930-b31a-88298d98b81d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:20.409742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2b0b7180-c098-4930-b31a-88298d98b81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:20.420201 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2669/5387] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:20.423797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b7180-c098-4930-b31a-88298d98b81d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:20.431270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b7180-c098-4930-b31a-88298d98b81d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:20.436437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604676c-4ba2-405e-b4f2-cbfdabda8d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:20.437120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604676c-4ba2-405e-b4f2-cbfdabda8d1d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:20.437541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604676c-4ba2-405e-b4f2-cbfdabda8d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:20.437881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604676c-4ba2-405e-b4f2-cbfdabda8d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:20.438652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604676c-4ba2-405e-b4f2-cbfdabda8d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:20.440331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604676c-4ba2-405e-b4f2-cbfdabda8d1d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:20.452745 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2670/5388] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:20 2022] GET /identity/v3/roles => generated 2324 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:20.453682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604676c-4ba2-405e-b4f2-cbfdabda8d1d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:20.465998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604676c-4ba2-405e-b4f2-cbfdabda8d1d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:20.471585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fbbfc-4705-49ae-88ec-3d04e49fafe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:20.472363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fbbfc-4705-49ae-88ec-3d04e49fafe6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:20.472671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fbbfc-4705-49ae-88ec-3d04e49fafe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:20.472916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fbbfc-4705-49ae-88ec-3d04e49fafe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:20.473552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fbbfc-4705-49ae-88ec-3d04e49fafe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:20.475235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fbbfc-4705-49ae-88ec-3d04e49fafe6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:20.488879 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2671/5389] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:20 2022] GET /identity/v3/roles => generated 2324 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:20.489855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fbbfc-4705-49ae-88ec-3d04e49fafe6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:20.506885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fbbfc-4705-49ae-88ec-3d04e49fafe6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:20.513552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456217dc-a7c7-4984-8351-65e77f388b93 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:20.514167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456217dc-a7c7-4984-8351-65e77f388b93 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:20.514456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456217dc-a7c7-4984-8351-65e77f388b93 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:20.514785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456217dc-a7c7-4984-8351-65e77f388b93 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:20.515558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456217dc-a7c7-4984-8351-65e77f388b93 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:20.517189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456217dc-a7c7-4984-8351-65e77f388b93 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:20.552705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b41c8fba-ea34-4045-bd7e-3ebee1217c37 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invalidating the token cache because role 990d677663c64d4697449c4d726d1d01 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:20.553295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b41c8fba-ea34-4045-bd7e-3ebee1217c37 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:20.554594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b41c8fba-ea34-4045-bd7e-3ebee1217c37 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:20.562842 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2719/5390] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:20 2022] DELETE /identity/v3/roles/990d677663c64d4697449c4d726d1d01 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:20.563907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c8fba-ea34-4045-bd7e-3ebee1217c37 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:20.569759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b41c8fba-ea34-4045-bd7e-3ebee1217c37 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:20.637358 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2672/5391] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:51:20 2022] POST /identity/v3/roles => generated 243 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:20.637358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456217dc-a7c7-4984-8351-65e77f388b93 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:20.637358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-456217dc-a7c7-4984-8351-65e77f388b93 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:20.652123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456217dc-a7c7-4984-8351-65e77f388b93 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:20.657139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4655db9-bd0c-43f9-bd22-9c2fd5ac3927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:20.657820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4655db9-bd0c-43f9-bd22-9c2fd5ac3927 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:20.658100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4655db9-bd0c-43f9-bd22-9c2fd5ac3927 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:20.658373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4655db9-bd0c-43f9-bd22-9c2fd5ac3927 admin admin] PATH_INFO: `/v3/projects/1a37fc9cd3c148b58ace5a410df2a8bb/users/5ae78681345c4110b11489524f0c03da/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:20.663854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c8fba-ea34-4045-bd7e-3ebee1217c37 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:20.670611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cebc2d-d5a9-4ab1-9908-6b18f1e54d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:20.671033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cebc2d-d5a9-4ab1-9908-6b18f1e54d54 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:20.671393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cebc2d-d5a9-4ab1-9908-6b18f1e54d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:20.671574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cebc2d-d5a9-4ab1-9908-6b18f1e54d54 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:20.672268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cebc2d-d5a9-4ab1-9908-6b18f1e54d54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:20.672577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cebc2d-d5a9-4ab1-9908-6b18f1e54d54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:20.674515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cebc2d-d5a9-4ab1-9908-6b18f1e54d54 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:20.691088 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2720/5392] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:20.692124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cebc2d-d5a9-4ab1-9908-6b18f1e54d54 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:20.695692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4655db9-bd0c-43f9-bd22-9c2fd5ac3927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a37fc9cd3c148b58ace5a410df2a8bb, user_id=5ae78681345c4110b11489524f0c03da, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:20.696219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-94cebc2d-d5a9-4ab1-9908-6b18f1e54d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:20.699147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4655db9-bd0c-43f9-bd22-9c2fd5ac3927 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:20.712115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cebc2d-d5a9-4ab1-9908-6b18f1e54d54 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:20.717147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23754422-a4b0-4152-80e2-04d0a0df2101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:20.717819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23754422-a4b0-4152-80e2-04d0a0df2101 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:20.718102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23754422-a4b0-4152-80e2-04d0a0df2101 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:20.718379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23754422-a4b0-4152-80e2-04d0a0df2101 admin admin] PATH_INFO: `/v3/projects/39f97f4919f44ceb81381c2bbb3a67a5/users/eaf64b46c3424d13afd5ddca475dacda/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:20.743133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23754422-a4b0-4152-80e2-04d0a0df2101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f97f4919f44ceb81381c2bbb3a67a5, user_id=eaf64b46c3424d13afd5ddca475dacda, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:20.743133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23754422-a4b0-4152-80e2-04d0a0df2101 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:20.743360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:20.834670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:20.850583 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2673/5393] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:20 2022] PUT /identity/v3/projects/1a37fc9cd3c148b58ace5a410df2a8bb/users/5ae78681345c4110b11489524f0c03da/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:20.850583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4655db9-bd0c-43f9-bd22-9c2fd5ac3927 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:20.850583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e4655db9-bd0c-43f9-bd22-9c2fd5ac3927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:20.852434 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2721/5394] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:20 2022] PUT /identity/v3/projects/39f97f4919f44ceb81381c2bbb3a67a5/users/eaf64b46c3424d13afd5ddca475dacda/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:20.853572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23754422-a4b0-4152-80e2-04d0a0df2101 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:20.859180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-23754422-a4b0-4152-80e2-04d0a0df2101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:20.932938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4655db9-bd0c-43f9-bd22-9c2fd5ac3927 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:20.938391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23754422-a4b0-4152-80e2-04d0a0df2101 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:20.949101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503845c-bbdc-4848-b82b-7d3e82e2a621 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:20.952894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503845c-bbdc-4848-b82b-7d3e82e2a621 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:20.952894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503845c-bbdc-4848-b82b-7d3e82e2a621 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:20.952894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503845c-bbdc-4848-b82b-7d3e82e2a621 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:20.952894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503845c-bbdc-4848-b82b-7d3e82e2a621 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:20.953299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503845c-bbdc-4848-b82b-7d3e82e2a621 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:21.004753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89feef08-901a-4352-a2a8-c53b578bf994 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:21.005434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89feef08-901a-4352-a2a8-c53b578bf994 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:21.005718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89feef08-901a-4352-a2a8-c53b578bf994 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:21.005997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89feef08-901a-4352-a2a8-c53b578bf994 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/projects/818237f556a4495eb0a73c1763a11490/users/0a48539c987b4f988709d51f673cda2d/roles/172fc58542b84a4b95bcc5b4b36789e7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:21.010029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89feef08-901a-4352-a2a8-c53b578bf994 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_grant(project_id=818237f556a4495eb0a73c1763a11490, user_id=0a48539c987b4f988709d51f673cda2d, role_id=172fc58542b84a4b95bcc5b4b36789e7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:21.012739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89feef08-901a-4352-a2a8-c53b578bf994 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:21.090301 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2722/5395] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:51:20 2022] POST /identity/v3/roles => generated 247 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:21.091708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503845c-bbdc-4848-b82b-7d3e82e2a621 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:21.115582 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2674/5396] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:20 2022] PUT /identity/v3/projects/818237f556a4495eb0a73c1763a11490/users/0a48539c987b4f988709d51f673cda2d/roles/172fc58542b84a4b95bcc5b4b36789e7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:21.117722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2aebd-33bf-45e9-8e61-3cf400684946 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:21.118793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2aebd-33bf-45e9-8e61-3cf400684946 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:21.119175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2aebd-33bf-45e9-8e61-3cf400684946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:21.154909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-10c2aebd-33bf-45e9-8e61-3cf400684946 None None] MFA Rules not processed for user `5ae78681345c4110b11489524f0c03da`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:21.156267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-10c2aebd-33bf-45e9-8e61-3cf400684946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:21.224691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503845c-bbdc-4848-b82b-7d3e82e2a621 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:21.257118 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2675/5397] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:21.258690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2aebd-33bf-45e9-8e61-3cf400684946 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:21.363049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8eb1d-da7b-4d98-9a31-539a5287daae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:21.363689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8eb1d-da7b-4d98-9a31-539a5287daae admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:21.365882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8eb1d-da7b-4d98-9a31-539a5287daae admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:21.365882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8eb1d-da7b-4d98-9a31-539a5287daae admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:21.365882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8eb1d-da7b-4d98-9a31-539a5287daae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:21.366897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8eb1d-da7b-4d98-9a31-539a5287daae admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:21.432217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2aebd-33bf-45e9-8e61-3cf400684946 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:21.444472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ce0a7-3a12-476e-85fc-7eb9e464cf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:21.445906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ce0a7-3a12-476e-85fc-7eb9e464cf8d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:21.446238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ce0a7-3a12-476e-85fc-7eb9e464cf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:21.446628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ce0a7-3a12-476e-85fc-7eb9e464cf8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:21.447397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ce0a7-3a12-476e-85fc-7eb9e464cf8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:21.449844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ce0a7-3a12-476e-85fc-7eb9e464cf8d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:21.486338 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2676/5398] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:21 2022] GET /identity/v3/roles => generated 2796 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:21.486338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ce0a7-3a12-476e-85fc-7eb9e464cf8d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:21.588477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ce0a7-3a12-476e-85fc-7eb9e464cf8d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:21.590625 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2723/5399] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:21 2022] POST /identity/v3/projects => generated 389 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:21.593773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8eb1d-da7b-4d98-9a31-539a5287daae admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:21.682072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9ea9e-991e-4326-8b97-bddb0e1e2440 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:21.682935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ea9e-991e-4326-8b97-bddb0e1e2440 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:21.683485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ea9e-991e-4326-8b97-bddb0e1e2440 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:21.683877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ea9e-991e-4326-8b97-bddb0e1e2440 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/eada0ae9984c4f2c9fa211d09bcdedd4/users/2da90fa43a9b4f61979b7b266b92b25a/roles/1f05e766e49d4c79af3229d7de10137a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:21.729399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9ea9e-991e-4326-8b97-bddb0e1e2440 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_grant(project_id=eada0ae9984c4f2c9fa211d09bcdedd4, user_id=2da90fa43a9b4f61979b7b266b92b25a, role_id=1f05e766e49d4c79af3229d7de10137a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:21.739180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9ea9e-991e-4326-8b97-bddb0e1e2440 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:21.747218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8eb1d-da7b-4d98-9a31-539a5287daae admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:21.753851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3034b3-9ae4-44c0-8209-899d069cfd4e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:21.754542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3034b3-9ae4-44c0-8209-899d069cfd4e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:21.754822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3034b3-9ae4-44c0-8209-899d069cfd4e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:21.755094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3034b3-9ae4-44c0-8209-899d069cfd4e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:21.756856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3034b3-9ae4-44c0-8209-899d069cfd4e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=79d566fca0ac4c2b9a147a70bf0e7278)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:21.758453 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-3f3034b3-9ae4-44c0-8209-899d069cfd4e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:21.758453 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:21.758453 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:21.759445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3034b3-9ae4-44c0-8209-899d069cfd4e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:21.846360 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2677/5400] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:21 2022] PUT /identity/v3/projects/eada0ae9984c4f2c9fa211d09bcdedd4/users/2da90fa43a9b4f61979b7b266b92b25a/roles/1f05e766e49d4c79af3229d7de10137a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:21.846360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9ea9e-991e-4326-8b97-bddb0e1e2440 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:21.913214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9ea9e-991e-4326-8b97-bddb0e1e2440 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:21.918445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed8f1b-e708-4259-91ac-b80ed67300f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:21.919083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed8f1b-e708-4259-91ac-b80ed67300f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:21.919364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed8f1b-e708-4259-91ac-b80ed67300f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:21.919639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed8f1b-e708-4259-91ac-b80ed67300f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:21.920318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed8f1b-e708-4259-91ac-b80ed67300f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:21.922848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed8f1b-e708-4259-91ac-b80ed67300f9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:21.937219 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2724/5401] 10.222.0.76 () {60 vars in 1363 bytes} [Sat Aug 27 04:51:21 2022] PUT /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278 => generated 521 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:21.937219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3034b3-9ae4-44c0-8209-899d069cfd4e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:22.015614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3034b3-9ae4-44c0-8209-899d069cfd4e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:22.043980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c587a-c993-458b-892d-5f0c31761fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:22.044713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c587a-c993-458b-892d-5f0c31761fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:22.045002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c587a-c993-458b-892d-5f0c31761fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:22.045269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c587a-c993-458b-892d-5f0c31761fc6 admin admin] PATH_INFO: `/v3/projects/39f97f4919f44ceb81381c2bbb3a67a5/users/eaf64b46c3424d13afd5ddca475dacda/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:22.047333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c587a-c993-458b-892d-5f0c31761fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f97f4919f44ceb81381c2bbb3a67a5, user_id=eaf64b46c3424d13afd5ddca475dacda, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:22.050037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c587a-c993-458b-892d-5f0c31761fc6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:22.074869 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2725/5402] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:21 2022] PUT /identity/v3/projects/39f97f4919f44ceb81381c2bbb3a67a5/users/eaf64b46c3424d13afd5ddca475dacda/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:22.074869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c587a-c993-458b-892d-5f0c31761fc6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:22.090128 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2678/5403] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:21 2022] POST /identity/v3/projects => generated 369 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:22.091544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed8f1b-e708-4259-91ac-b80ed67300f9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:22.223082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c587a-c993-458b-892d-5f0c31761fc6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:22.270026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed8f1b-e708-4259-91ac-b80ed67300f9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:22.286032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1972f-a788-4c71-98fa-594b79bcb727 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:22.286303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1972f-a788-4c71-98fa-594b79bcb727 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:22.286558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1972f-a788-4c71-98fa-594b79bcb727 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:22.286857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1972f-a788-4c71-98fa-594b79bcb727 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/eada0ae9984c4f2c9fa211d09bcdedd4/users/2da90fa43a9b4f61979b7b266b92b25a/roles/a4501e6d56924930b9e4658735af7434` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:22.292227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1972f-a788-4c71-98fa-594b79bcb727 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_grant(project_id=eada0ae9984c4f2c9fa211d09bcdedd4, user_id=2da90fa43a9b4f61979b7b266b92b25a, role_id=a4501e6d56924930b9e4658735af7434)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:22.296002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1972f-a788-4c71-98fa-594b79bcb727 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:22.336565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a50b04-8665-4b96-bed5-a787f38ea861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:22.337551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50b04-8665-4b96-bed5-a787f38ea861 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:22.337993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50b04-8665-4b96-bed5-a787f38ea861 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:22.338280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50b04-8665-4b96-bed5-a787f38ea861 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:22.339247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a50b04-8665-4b96-bed5-a787f38ea861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:22.341584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a50b04-8665-4b96-bed5-a787f38ea861 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:22.437717 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2679/5404] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:22 2022] PUT /identity/v3/projects/eada0ae9984c4f2c9fa211d09bcdedd4/users/2da90fa43a9b4f61979b7b266b92b25a/roles/a4501e6d56924930b9e4658735af7434 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:22.437717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1972f-a788-4c71-98fa-594b79bcb727 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:22.471324 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2726/5405] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:22 2022] POST /identity/v3/users => generated 295 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:22.474334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84261c33-0dc4-46a6-95f4-2a544315d4a3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:22.474334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84261c33-0dc4-46a6-95f4-2a544315d4a3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:22.474334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84261c33-0dc4-46a6-95f4-2a544315d4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:22.522057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-84261c33-0dc4-46a6-95f4-2a544315d4a3 None None] MFA Rules not processed for user `eaf64b46c3424d13afd5ddca475dacda`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:22.524581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-84261c33-0dc4-46a6-95f4-2a544315d4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:22.566386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1972f-a788-4c71-98fa-594b79bcb727 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:22.594555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209101c2-7b28-41a9-ace9-296f9c9f8e0c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:22.594555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209101c2-7b28-41a9-ace9-296f9c9f8e0c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:22.594555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209101c2-7b28-41a9-ace9-296f9c9f8e0c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:22.600018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209101c2-7b28-41a9-ace9-296f9c9f8e0c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:22.600018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209101c2-7b28-41a9-ace9-296f9c9f8e0c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Adding query filter params (scope.project.id=818237f556a4495eb0a73c1763a11490, user.id=0a48539c987b4f988709d51f673cda2d) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:22.600018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209101c2-7b28-41a9-ace9-296f9c9f8e0c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:22.600018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209101c2-7b28-41a9-ace9-296f9c9f8e0c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:22.644770 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2727/5406] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:22 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:22.645985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84261c33-0dc4-46a6-95f4-2a544315d4a3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:22.676538 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2680/5407] 10.222.0.76 () {58 vars in 1356 bytes} [Sat Aug 27 04:51:22 2022] GET /identity/v3/role_assignments?scope.project.id=818237f556a4495eb0a73c1763a11490&user.id=0a48539c987b4f988709d51f673cda2d&effective => generated 1061 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:22.677402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209101c2-7b28-41a9-ace9-296f9c9f8e0c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:22.748321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84261c33-0dc4-46a6-95f4-2a544315d4a3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:22.754991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573319b2-8e2f-4e89-b208-ed890c3bbb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:22.756026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573319b2-8e2f-4e89-b208-ed890c3bbb62 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:22.756802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573319b2-8e2f-4e89-b208-ed890c3bbb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:22.757281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573319b2-8e2f-4e89-b208-ed890c3bbb62 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:22.758692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573319b2-8e2f-4e89-b208-ed890c3bbb62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:22.761021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573319b2-8e2f-4e89-b208-ed890c3bbb62 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:22.795589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209101c2-7b28-41a9-ace9-296f9c9f8e0c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:22.801273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79238b41-66bf-4e37-9c30-98466bd3d297 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:22.802215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79238b41-66bf-4e37-9c30-98466bd3d297 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:22.803010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79238b41-66bf-4e37-9c30-98466bd3d297 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:22.803010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79238b41-66bf-4e37-9c30-98466bd3d297 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:22.803441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79238b41-66bf-4e37-9c30-98466bd3d297 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:22.806505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79238b41-66bf-4e37-9c30-98466bd3d297 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:22.859398 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2681/5408] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:22 2022] GET /identity/v3/users => generated 8756 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:22.860662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79238b41-66bf-4e37-9c30-98466bd3d297 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:22.890399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79238b41-66bf-4e37-9c30-98466bd3d297 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:22.895956 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2728/5409] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:22 2022] POST /identity/v3/users => generated 291 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:22.898614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573319b2-8e2f-4e89-b208-ed890c3bbb62 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:22.902458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d02f7e-f6cd-4884-85a3-233668d86ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:22.903477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d02f7e-f6cd-4884-85a3-233668d86ceb admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:22.903933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d02f7e-f6cd-4884-85a3-233668d86ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:22.905706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d02f7e-f6cd-4884-85a3-233668d86ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:22.906999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d02f7e-f6cd-4884-85a3-233668d86ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:22.908679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d02f7e-f6cd-4884-85a3-233668d86ceb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:22.915050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573319b2-8e2f-4e89-b208-ed890c3bbb62 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:22.921867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62322e-58ac-4b9c-8ccb-e408a02a8113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:22.928631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62322e-58ac-4b9c-8ccb-e408a02a8113 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:22.928631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62322e-58ac-4b9c-8ccb-e408a02a8113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:22.928631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62322e-58ac-4b9c-8ccb-e408a02a8113 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:22.928631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62322e-58ac-4b9c-8ccb-e408a02a8113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:22.928631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62322e-58ac-4b9c-8ccb-e408a02a8113 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:22.929139 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2682/5410] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:22 2022] GET /identity/v3/roles => generated 2796 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:22.929139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d02f7e-f6cd-4884-85a3-233668d86ceb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:22.945775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d02f7e-f6cd-4884-85a3-233668d86ceb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:22.950958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041f208-ad79-41dd-80b5-8a10d1ed1a58 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:22.951619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041f208-ad79-41dd-80b5-8a10d1ed1a58 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:22.951910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041f208-ad79-41dd-80b5-8a10d1ed1a58 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:22.952210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041f208-ad79-41dd-80b5-8a10d1ed1a58 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:22.954085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041f208-ad79-41dd-80b5-8a10d1ed1a58 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=79d566fca0ac4c2b9a147a70bf0e7278)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:22.955124 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-b041f208-ad79-41dd-80b5-8a10d1ed1a58 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:22.955124 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:22.955124 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:22.956008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041f208-ad79-41dd-80b5-8a10d1ed1a58 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:23.085659 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2729/5411] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:22 2022] POST /identity/v3/projects => generated 397 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:23.085659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdf437-5a30-4464-9db1-c339942c37ea None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.085659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdf437-5a30-4464-9db1-c339942c37ea None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.085659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdf437-5a30-4464-9db1-c339942c37ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.102477 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2683/5412] 10.222.0.76 () {58 vars in 1347 bytes} [Sat Aug 27 04:51:22 2022] DELETE /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:23.103669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041f208-ad79-41dd-80b5-8a10d1ed1a58 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:23.191869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-95cdf437-5a30-4464-9db1-c339942c37ea None None] MFA Rules not processed for user `2da90fa43a9b4f61979b7b266b92b25a`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:23.192803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-95cdf437-5a30-4464-9db1-c339942c37ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:23.251426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041f208-ad79-41dd-80b5-8a10d1ed1a58 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:23.262875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975f0f5-1dc4-42df-8e49-22241f71ebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:23.263611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975f0f5-1dc4-42df-8e49-22241f71ebf2 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.263956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975f0f5-1dc4-42df-8e49-22241f71ebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.264321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975f0f5-1dc4-42df-8e49-22241f71ebf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.265694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975f0f5-1dc4-42df-8e49-22241f71ebf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:23.272127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975f0f5-1dc4-42df-8e49-22241f71ebf2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:23.278630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:23.300233 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2684/5413] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:23 2022] GET /identity/v3/roles => generated 2796 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:23.305229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:23.308613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975f0f5-1dc4-42df-8e49-22241f71ebf2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:23.330214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975f0f5-1dc4-42df-8e49-22241f71ebf2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:23.335440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7571a-fb01-4e77-a46d-98caa39870b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:23.336275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7571a-fb01-4e77-a46d-98caa39870b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.336565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7571a-fb01-4e77-a46d-98caa39870b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.336840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7571a-fb01-4e77-a46d-98caa39870b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.337749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7571a-fb01-4e77-a46d-98caa39870b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:23.339496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7571a-fb01-4e77-a46d-98caa39870b7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:23.348921 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2730/5414] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:23 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:23.353851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdf437-5a30-4464-9db1-c339942c37ea None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:23.355821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-95cdf437-5a30-4464-9db1-c339942c37ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:23.358148 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2685/5415] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:23 2022] GET /identity/v3/roles => generated 2796 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:23.360260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7571a-fb01-4e77-a46d-98caa39870b7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:23.372579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7571a-fb01-4e77-a46d-98caa39870b7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:23.378799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0314c4c-2f40-433d-aed7-297ed1ed76e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:23.379515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0314c4c-2f40-433d-aed7-297ed1ed76e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.379872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0314c4c-2f40-433d-aed7-297ed1ed76e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.380682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0314c4c-2f40-433d-aed7-297ed1ed76e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.381161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0314c4c-2f40-433d-aed7-297ed1ed76e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:23.383368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0314c4c-2f40-433d-aed7-297ed1ed76e7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:23.456129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdf437-5a30-4464-9db1-c339942c37ea None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:23.461822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be9bf9-7263-49b0-b144-76c557a8408e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:23.462435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be9bf9-7263-49b0-b144-76c557a8408e service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.462783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be9bf9-7263-49b0-b144-76c557a8408e service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.463064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be9bf9-7263-49b0-b144-76c557a8408e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.464839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-35be9bf9-7263-49b0-b144-76c557a8408e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:23.480300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be9bf9-7263-49b0-b144-76c557a8408e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:23.483599 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2686/5416] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:23 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:23.483599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0314c4c-2f40-433d-aed7-297ed1ed76e7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:23.485357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be9bf9-7263-49b0-b144-76c557a8408e service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:23.500147 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2731/5417] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:23.501380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be9bf9-7263-49b0-b144-76c557a8408e service placement] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:23.513889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be9bf9-7263-49b0-b144-76c557a8408e service placement] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:23.522424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c22b88-fa2e-4c96-b474-4ff6be6d2a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:23.523385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22b88-fa2e-4c96-b474-4ff6be6d2a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.524155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22b88-fa2e-4c96-b474-4ff6be6d2a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.524656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22b88-fa2e-4c96-b474-4ff6be6d2a44 admin admin] PATH_INFO: `/v3/projects/a7074ae1c8ab4920b6cb59b20bae36ce/users/01d9aa87e19741058bff0c29c368e724/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.558291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c22b88-fa2e-4c96-b474-4ff6be6d2a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7074ae1c8ab4920b6cb59b20bae36ce, user_id=01d9aa87e19741058bff0c29c368e724, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:23.568976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c22b88-fa2e-4c96-b474-4ff6be6d2a44 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:23.604805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0314c4c-2f40-433d-aed7-297ed1ed76e7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:23.612005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a27f7-07f0-4bfa-bf6c-b95d18a57ffd tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:23.612806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a27f7-07f0-4bfa-bf6c-b95d18a57ffd tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.613162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a27f7-07f0-4bfa-bf6c-b95d18a57ffd tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.613782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a27f7-07f0-4bfa-bf6c-b95d18a57ffd tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.614680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a27f7-07f0-4bfa-bf6c-b95d18a57ffd tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Adding query filter params (scope.project.id=818237f556a4495eb0a73c1763a11490, user.id=0a48539c987b4f988709d51f673cda2d) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:23.615062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a27f7-07f0-4bfa-bf6c-b95d18a57ffd tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:23.618335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a27f7-07f0-4bfa-bf6c-b95d18a57ffd tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:23.697802 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2687/5418] 10.222.0.76 () {58 vars in 1356 bytes} [Sat Aug 27 04:51:23 2022] GET /identity/v3/role_assignments?scope.project.id=818237f556a4495eb0a73c1763a11490&user.id=0a48539c987b4f988709d51f673cda2d&effective => generated 577 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:23.697802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776393a-a36b-4e36-a394-adae96188e0b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.697802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776393a-a36b-4e36-a394-adae96188e0b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.697802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776393a-a36b-4e36-a394-adae96188e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.698323 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2732/5419] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:23 2022] PUT /identity/v3/projects/a7074ae1c8ab4920b6cb59b20bae36ce/users/01d9aa87e19741058bff0c29c368e724/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:23.698928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c22b88-fa2e-4c96-b474-4ff6be6d2a44 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:23.737361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5776393a-a36b-4e36-a394-adae96188e0b None None] MFA Rules not processed for user `2da90fa43a9b4f61979b7b266b92b25a`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:23.738584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5776393a-a36b-4e36-a394-adae96188e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:23.796864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c22b88-fa2e-4c96-b474-4ff6be6d2a44 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:23.802752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8a4c5-245a-4a04-bb80-c768d138aadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:23.810376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8a4c5-245a-4a04-bb80-c768d138aadc admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.810376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8a4c5-245a-4a04-bb80-c768d138aadc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.810376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8a4c5-245a-4a04-bb80-c768d138aadc admin admin] PATH_INFO: `/v3/projects/d3b2b69d4366472280ac8ef285f6a628/users/8edcb8ae97c14a6bb4f130ed5f2ded86/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.812069 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2688/5420] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:23 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:23.813168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776393a-a36b-4e36-a394-adae96188e0b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:23.823847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8a4c5-245a-4a04-bb80-c768d138aadc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b2b69d4366472280ac8ef285f6a628, user_id=8edcb8ae97c14a6bb4f130ed5f2ded86, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:23.826299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776393a-a36b-4e36-a394-adae96188e0b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:23.826697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8a4c5-245a-4a04-bb80-c768d138aadc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:23.831874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9061d9b-d652-44c5-91eb-7c1ebebf2fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:23.856586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9061d9b-d652-44c5-91eb-7c1ebebf2fef admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.856586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9061d9b-d652-44c5-91eb-7c1ebebf2fef admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.856586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9061d9b-d652-44c5-91eb-7c1ebebf2fef admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.856586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9061d9b-d652-44c5-91eb-7c1ebebf2fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:23.856586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9061d9b-d652-44c5-91eb-7c1ebebf2fef admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:23.856586 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2689/5421] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:23 2022] GET /identity/v3/roles => generated 2796 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:23.857773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9061d9b-d652-44c5-91eb-7c1ebebf2fef admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:23.934646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9061d9b-d652-44c5-91eb-7c1ebebf2fef admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:23.945527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64295ff-b0f8-451d-a316-72a3a8f65cc2 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:23.946274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64295ff-b0f8-451d-a316-72a3a8f65cc2 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:23.946700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64295ff-b0f8-451d-a316-72a3a8f65cc2 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:23.946994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64295ff-b0f8-451d-a316-72a3a8f65cc2 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:23.948709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64295ff-b0f8-451d-a316-72a3a8f65cc2 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=79d566fca0ac4c2b9a147a70bf0e7278)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:23.950384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64295ff-b0f8-451d-a316-72a3a8f65cc2 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:23.959349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-d64295ff-b0f8-451d-a316-72a3a8f65cc2 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] 172fc58542b84a4b95bcc5b4b36789e7 does not imply 79d566fca0ac4c2b9a147a70bf0e7278.: keystone.exception.ImpliedRoleNotFound: 172fc58542b84a4b95bcc5b4b36789e7 does not imply 79d566fca0ac4c2b9a147a70bf0e7278. Aug 27 04:51:23.959349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:23.959349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 27 04:51:23.959349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = query.one() Aug 27 04:51:23.959349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 27 04:51:23.959349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._iter().one() Aug 27 04:51:23.959349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 27 04:51:23.959349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._only_one_row( Aug 27 04:51:23.959349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 27 04:51:23.959349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 27 04:51:23.959349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 27 04:51:23.959349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:51:23.959349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:51:23.959349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:51:23.959349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:23.959349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:23.960645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:23.960645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:23.960645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:23.960645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:23.960645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:23.960645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:23.960645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:23.960645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:23.960645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:23.960645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 27 04:51:23.960645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 27 04:51:23.960645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:51:23.960645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:51:23.960645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 27 04:51:23.960645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 27 04:51:23.960645 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 27 04:51:23.961887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 27 04:51:23.961887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 27 04:51:23.961887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 27 04:51:23.961887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 172fc58542b84a4b95bcc5b4b36789e7 does not imply 79d566fca0ac4c2b9a147a70bf0e7278. Aug 27 04:51:23.961887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:51:23.964089 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2690/5422] 10.222.0.76 () {58 vars in 1347 bytes} [Sat Aug 27 04:51:23 2022] DELETE /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278 => generated 137 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:51:23.965044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64295ff-b0f8-451d-a316-72a3a8f65cc2 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:23.993179 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2733/5423] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:23 2022] PUT /identity/v3/projects/d3b2b69d4366472280ac8ef285f6a628/users/8edcb8ae97c14a6bb4f130ed5f2ded86/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:23.993707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8a4c5-245a-4a04-bb80-c768d138aadc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:24.005026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64295ff-b0f8-451d-a316-72a3a8f65cc2 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:24.085438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ba14d-c712-494f-b9b3-d9a79fa1e744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:24.086944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ba14d-c712-494f-b9b3-d9a79fa1e744 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.087368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ba14d-c712-494f-b9b3-d9a79fa1e744 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.087715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ba14d-c712-494f-b9b3-d9a79fa1e744 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.087861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8a4c5-245a-4a04-bb80-c768d138aadc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:24.088777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ba14d-c712-494f-b9b3-d9a79fa1e744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:24.094053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ba14d-c712-494f-b9b3-d9a79fa1e744 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:24.094244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969f4db-9eb3-45f9-b5d1-c729e7d5fae2 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da90fa43a9b4f61979b7b266b92b25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eada0ae9984c4f2c9fa211d09bcdedd4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-886169838', 'tempest-NotDelegatedRole-1369879218'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:24.094678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969f4db-9eb3-45f9-b5d1-c729e7d5fae2 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.094954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969f4db-9eb3-45f9-b5d1-c729e7d5fae2 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.095230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969f4db-9eb3-45f9-b5d1-c729e7d5fae2 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.096094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969f4db-9eb3-45f9-b5d1-c729e7d5fae2 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: Authorizing `identity:create_trust()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:24.097306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969f4db-9eb3-45f9-b5d1-c729e7d5fae2 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:24.109812 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2691/5424] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:23 2022] GET /identity/v3/roles => generated 2796 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:24.110943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ba14d-c712-494f-b9b3-d9a79fa1e744 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:24.124869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ba14d-c712-494f-b9b3-d9a79fa1e744 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:24.130096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89320bc-7169-4b83-8a07-cc9404a58205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:24.134949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89320bc-7169-4b83-8a07-cc9404a58205 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.134949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89320bc-7169-4b83-8a07-cc9404a58205 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.134949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89320bc-7169-4b83-8a07-cc9404a58205 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.134949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89320bc-7169-4b83-8a07-cc9404a58205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:24.134949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89320bc-7169-4b83-8a07-cc9404a58205 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:24.146927 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2692/5425] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:24 2022] GET /identity/v3/roles => generated 2796 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:24.147753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89320bc-7169-4b83-8a07-cc9404a58205 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:24.215640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89320bc-7169-4b83-8a07-cc9404a58205 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:24.220790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cbc43-d834-4de8-9696-2dc3e3e5df52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:24.226976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cbc43-d834-4de8-9696-2dc3e3e5df52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.226976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cbc43-d834-4de8-9696-2dc3e3e5df52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.226976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cbc43-d834-4de8-9696-2dc3e3e5df52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/projects/818237f556a4495eb0a73c1763a11490/users/0a48539c987b4f988709d51f673cda2d/roles/172fc58542b84a4b95bcc5b4b36789e7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.226976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cbc43-d834-4de8-9696-2dc3e3e5df52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=818237f556a4495eb0a73c1763a11490, user_id=0a48539c987b4f988709d51f673cda2d, role_id=172fc58542b84a4b95bcc5b4b36789e7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:24.227806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cbc43-d834-4de8-9696-2dc3e3e5df52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:24.233472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d10cbc43-d834-4de8-9696-2dc3e3e5df52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invalidating the token cache because role 172fc58542b84a4b95bcc5b4b36789e7 was removed from user 0a48539c987b4f988709d51f673cda2d on project 818237f556a4495eb0a73c1763a11490. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:24.233772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d10cbc43-d834-4de8-9696-2dc3e3e5df52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:24.234498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d10cbc43-d834-4de8-9696-2dc3e3e5df52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:24.298726 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2734/5426] 10.222.0.76 () {60 vars in 1174 bytes} [Sat Aug 27 04:51:23 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:24.299979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2d05e-db7c-42b8-b5eb-17e447ae6c07 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.300287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2d05e-db7c-42b8-b5eb-17e447ae6c07 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.300561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2d05e-db7c-42b8-b5eb-17e447ae6c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.330037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-dff2d05e-db7c-42b8-b5eb-17e447ae6c07 None None] MFA Rules not processed for user `8edcb8ae97c14a6bb4f130ed5f2ded86`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:24.331246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dff2d05e-db7c-42b8-b5eb-17e447ae6c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:24.373467 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2693/5427] 10.222.0.76 () {58 vars in 1467 bytes} [Sat Aug 27 04:51:24 2022] DELETE /identity/v3/projects/818237f556a4495eb0a73c1763a11490/users/0a48539c987b4f988709d51f673cda2d/roles/172fc58542b84a4b95bcc5b4b36789e7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:24.374719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cbc43-d834-4de8-9696-2dc3e3e5df52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:24.376075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d10cbc43-d834-4de8-9696-2dc3e3e5df52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:24.399691 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2735/5428] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:24.400311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2d05e-db7c-42b8-b5eb-17e447ae6c07 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:24.401848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dff2d05e-db7c-42b8-b5eb-17e447ae6c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:24.418153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2d05e-db7c-42b8-b5eb-17e447ae6c07 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:24.465409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cbc43-d834-4de8-9696-2dc3e3e5df52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:24.470453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d48b4-dc8d-403b-8e64-5bc5b0fde847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:24.471161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d48b4-dc8d-403b-8e64-5bc5b0fde847 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.471547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d48b4-dc8d-403b-8e64-5bc5b0fde847 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.471922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d48b4-dc8d-403b-8e64-5bc5b0fde847 admin admin] PATH_INFO: `/v3/projects/a7074ae1c8ab4920b6cb59b20bae36ce/users/01d9aa87e19741058bff0c29c368e724/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.474032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d48b4-dc8d-403b-8e64-5bc5b0fde847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7074ae1c8ab4920b6cb59b20bae36ce, user_id=01d9aa87e19741058bff0c29c368e724, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:24.477466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d48b4-dc8d-403b-8e64-5bc5b0fde847 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:24.484973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e025e3a-1a12-4d6f-b875-5a076c855b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:24.485887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e025e3a-1a12-4d6f-b875-5a076c855b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.486229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e025e3a-1a12-4d6f-b875-5a076c855b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.486468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e025e3a-1a12-4d6f-b875-5a076c855b26 admin admin] PATH_INFO: `/v3/projects/e9d908cf094d454891d2e52617f620e3/users/4d6163303e634aceb43295f887755e15/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.489450 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2694/5429] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:24 2022] PUT /identity/v3/projects/a7074ae1c8ab4920b6cb59b20bae36ce/users/01d9aa87e19741058bff0c29c368e724/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:24.499037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d48b4-dc8d-403b-8e64-5bc5b0fde847 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:24.499037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-310d48b4-dc8d-403b-8e64-5bc5b0fde847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:24.503162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e025e3a-1a12-4d6f-b875-5a076c855b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d908cf094d454891d2e52617f620e3, user_id=4d6163303e634aceb43295f887755e15, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:24.513629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e025e3a-1a12-4d6f-b875-5a076c855b26 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:24.573120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d48b4-dc8d-403b-8e64-5bc5b0fde847 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:24.578459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf16c5d-9467-4c74-8bc6-0f3b6dbd0f3d tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da90fa43a9b4f61979b7b266b92b25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eada0ae9984c4f2c9fa211d09bcdedd4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-886169838', 'tempest-NotDelegatedRole-1369879218'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:24.579141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf16c5d-9467-4c74-8bc6-0f3b6dbd0f3d tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.579419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf16c5d-9467-4c74-8bc6-0f3b6dbd0f3d tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.579697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf16c5d-9467-4c74-8bc6-0f3b6dbd0f3d tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] PATH_INFO: `/v3/OS-TRUST/trusts/24d0c8c8504041f28794ba9073b53bde` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.596049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf16c5d-9467-4c74-8bc6-0f3b6dbd0f3d tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: Authorizing `identity:get_trust(trust_id=24d0c8c8504041f28794ba9073b53bde)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:24.597673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf16c5d-9467-4c74-8bc6-0f3b6dbd0f3d tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:24.602330 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2736/5430] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:24 2022] PUT /identity/v3/projects/e9d908cf094d454891d2e52617f620e3/users/4d6163303e634aceb43295f887755e15/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:24.603836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e025e3a-1a12-4d6f-b875-5a076c855b26 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:24.606359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2e025e3a-1a12-4d6f-b875-5a076c855b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:24.610762 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2695/5431] 10.222.0.76 () {58 vars in 1251 bytes} [Sat Aug 27 04:51:24 2022] GET /identity/v3/OS-TRUST/trusts/24d0c8c8504041f28794ba9073b53bde => generated 833 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:24.610762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf16c5d-9467-4c74-8bc6-0f3b6dbd0f3d tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:24.610762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dcf16c5d-9467-4c74-8bc6-0f3b6dbd0f3d tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:24.681525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf16c5d-9467-4c74-8bc6-0f3b6dbd0f3d tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:24.691822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e025e3a-1a12-4d6f-b875-5a076c855b26 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:24.698302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1609433-f8c7-404a-b116-f4dc5cf30e65 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:24.699079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1609433-f8c7-404a-b116-f4dc5cf30e65 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.699441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1609433-f8c7-404a-b116-f4dc5cf30e65 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.699790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1609433-f8c7-404a-b116-f4dc5cf30e65 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.700578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1609433-f8c7-404a-b116-f4dc5cf30e65 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:24.702118 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-e1609433-f8c7-404a-b116-f4dc5cf30e65 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:24.702118 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:24.702118 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:24.702512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1609433-f8c7-404a-b116-f4dc5cf30e65 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:24.740367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ed702-e5ac-44f9-b02c-63cc3310a1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:24.740887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ed702-e5ac-44f9-b02c-63cc3310a1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.741161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ed702-e5ac-44f9-b02c-63cc3310a1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.741442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ed702-e5ac-44f9-b02c-63cc3310a1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.806250 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2737/5432] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:24 2022] POST /identity/v3/roles => generated 272 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:24.808760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01e2c1-a5a4-436b-9d58-c35639283c36 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.810168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01e2c1-a5a4-436b-9d58-c35639283c36 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.810168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01e2c1-a5a4-436b-9d58-c35639283c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.813941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ed702-e5ac-44f9-b02c-63cc3310a1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:24.815630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ed702-e5ac-44f9-b02c-63cc3310a1c2 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:24.827791 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2696/5433] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:24.829083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f4abe-98dc-4bd6-b5e5-f50583f920db None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.830493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f4abe-98dc-4bd6-b5e5-f50583f920db None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.830756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f4abe-98dc-4bd6-b5e5-f50583f920db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.841131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ad01e2c1-a5a4-436b-9d58-c35639283c36 None None] MFA Rules not processed for user `9a05d8e7d917402fae37644094dd2aef`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:24.843748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ad01e2c1-a5a4-436b-9d58-c35639283c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:24.864790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-130f4abe-98dc-4bd6-b5e5-f50583f920db None None] MFA Rules not processed for user `01d9aa87e19741058bff0c29c368e724`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:24.866072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-130f4abe-98dc-4bd6-b5e5-f50583f920db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:24.944269 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2738/5434] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:24.948233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd440721-0259-440b-9b55-74d9cb3fb743 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:24.948530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd440721-0259-440b-9b55-74d9cb3fb743 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:24.948808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd440721-0259-440b-9b55-74d9cb3fb743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:24.985557 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2697/5435] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:24.995597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f4abe-98dc-4bd6-b5e5-f50583f920db None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:25.011518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-dd440721-0259-440b-9b55-74d9cb3fb743 None None] MFA Rules not processed for user `4d6163303e634aceb43295f887755e15`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:25.013891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dd440721-0259-440b-9b55-74d9cb3fb743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:25.029048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:25.082895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f4abe-98dc-4bd6-b5e5-f50583f920db None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:25.092455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa5382-a6d6-4697-aee8-c5b9ccb521df tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da90fa43a9b4f61979b7b266b92b25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eada0ae9984c4f2c9fa211d09bcdedd4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-886169838', 'tempest-NotDelegatedRole-1369879218'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:25.094970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa5382-a6d6-4697-aee8-c5b9ccb521df tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:25.095534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa5382-a6d6-4697-aee8-c5b9ccb521df tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:25.096037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa5382-a6d6-4697-aee8-c5b9ccb521df tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] PATH_INFO: `/v3/OS-TRUST/trusts/24d0c8c8504041f28794ba9073b53bde/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:25.109066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa5382-a6d6-4697-aee8-c5b9ccb521df tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=24d0c8c8504041f28794ba9073b53bde)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:25.125180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa5382-a6d6-4697-aee8-c5b9ccb521df tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:25.137194 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2739/5436] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:25.138306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd440721-0259-440b-9b55-74d9cb3fb743 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:25.150134 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2698/5437] 10.222.0.76 () {58 vars in 1269 bytes} [Sat Aug 27 04:51:24 2022] GET /identity/v3/OS-TRUST/trusts/24d0c8c8504041f28794ba9073b53bde/roles => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:25.151507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa5382-a6d6-4697-aee8-c5b9ccb521df tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:25.165482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-18fa5382-a6d6-4697-aee8-c5b9ccb521df tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:25.165617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd440721-0259-440b-9b55-74d9cb3fb743 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:25.171578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0c60b-99ad-4284-b51e-5358c990962c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:25.172483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0c60b-99ad-4284-b51e-5358c990962c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:25.173097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0c60b-99ad-4284-b51e-5358c990962c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:25.173538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0c60b-99ad-4284-b51e-5358c990962c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:25.174411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0c60b-99ad-4284-b51e-5358c990962c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Adding query filter params (domain_id=3c5b393f88604e94a0608ded33678f83) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:25.175022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0c60b-99ad-4284-b51e-5358c990962c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:25.176857 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-5cc0c60b-99ad-4284-b51e-5358c990962c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:25.176857 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:25.176857 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:25.178427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0c60b-99ad-4284-b51e-5358c990962c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:25.192143 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2740/5438] 10.222.0.76 () {58 vars in 1207 bytes} [Sat Aug 27 04:51:25 2022] GET /identity/v3/roles?domain_id=3c5b393f88604e94a0608ded33678f83 => generated 409 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:25.193418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0c60b-99ad-4284-b51e-5358c990962c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:25.207849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0c60b-99ad-4284-b51e-5358c990962c tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:25.213371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd1b3b-e3c6-4c4b-bdbe-a4219522d6d6 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d9aa87e19741058bff0c29c368e724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7074ae1c8ab4920b6cb59b20bae36ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:25.214032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd1b3b-e3c6-4c4b-bdbe-a4219522d6d6 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:25.214315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd1b3b-e3c6-4c4b-bdbe-a4219522d6d6 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:25.222438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd1b3b-e3c6-4c4b-bdbe-a4219522d6d6 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] PATH_INFO: `/v3/policies` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:25.222438 n-d-852088-5 devstack@keystone.service[82083]: WARNING oslo_log.versionutils [None req-e0fd1b3b-e3c6-4c4b-bdbe-a4219522d6d6 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 27 04:51:25.222438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd1b3b-e3c6-4c4b-bdbe-a4219522d6d6 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:25.222438 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-e0fd1b3b-e3c6-4c4b-bdbe-a4219522d6d6 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:25.222438 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:25.222438 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:25.223399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd1b3b-e3c6-4c4b-bdbe-a4219522d6d6 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:25.258196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa5382-a6d6-4697-aee8-c5b9ccb521df tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:25.261875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:25.263350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c67d3-d612-4142-bea7-721256a7d03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:25.268708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c67d3-d612-4142-bea7-721256a7d03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:25.268708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c67d3-d612-4142-bea7-721256a7d03b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:25.268708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c67d3-d612-4142-bea7-721256a7d03b admin admin] PATH_INFO: `/v3/users/8edcb8ae97c14a6bb4f130ed5f2ded86` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:25.268708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c67d3-d612-4142-bea7-721256a7d03b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8edcb8ae97c14a6bb4f130ed5f2ded86)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:25.268708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c67d3-d612-4142-bea7-721256a7d03b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:25.387706 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2741/5439] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:51:25 2022] POST /identity/v3/policies => generated 229 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:25.387706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd1b3b-e3c6-4c4b-bdbe-a4219522d6d6 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:25.398776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd1b3b-e3c6-4c4b-bdbe-a4219522d6d6 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:25.403284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057289ea-d2b4-4b34-aa64-4942457ceba0 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da90fa43a9b4f61979b7b266b92b25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eada0ae9984c4f2c9fa211d09bcdedd4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-886169838', 'tempest-NotDelegatedRole-1369879218'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:25.403980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057289ea-d2b4-4b34-aa64-4942457ceba0 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:25.404297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057289ea-d2b4-4b34-aa64-4942457ceba0 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:25.404577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057289ea-d2b4-4b34-aa64-4942457ceba0 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] PATH_INFO: `/v3/OS-TRUST/trusts/24d0c8c8504041f28794ba9073b53bde/roles/1f05e766e49d4c79af3229d7de10137a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:25.410463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057289ea-d2b4-4b34-aa64-4942457ceba0 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: Authorizing `identity:get_role_for_trust(trust_id=24d0c8c8504041f28794ba9073b53bde, role_id=1f05e766e49d4c79af3229d7de10137a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:25.411895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057289ea-d2b4-4b34-aa64-4942457ceba0 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:25.424081 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2742/5440] 10.222.0.76 () {58 vars in 1368 bytes} [Sat Aug 27 04:51:25 2022] GET /identity/v3/OS-TRUST/trusts/24d0c8c8504041f28794ba9073b53bde/roles/1f05e766e49d4c79af3229d7de10137a => generated 243 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:25.424081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057289ea-d2b4-4b34-aa64-4942457ceba0 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:25.424081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-057289ea-d2b4-4b34-aa64-4942457ceba0 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:25.495308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057289ea-d2b4-4b34-aa64-4942457ceba0 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:25.499116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaff24-59ea-4636-bbca-3b9b325a27eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:25.499722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaff24-59ea-4636-bbca-3b9b325a27eb service glance] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:25.500002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaff24-59ea-4636-bbca-3b9b325a27eb service glance] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:25.500317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaff24-59ea-4636-bbca-3b9b325a27eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:25.502134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8fcaff24-59ea-4636-bbca-3b9b325a27eb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:25.567991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaff24-59ea-4636-bbca-3b9b325a27eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:25.569449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaff24-59ea-4636-bbca-3b9b325a27eb service glance] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:25.578945 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2743/5441] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:25 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:25.579722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaff24-59ea-4636-bbca-3b9b325a27eb service glance] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:25.589360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaff24-59ea-4636-bbca-3b9b325a27eb service glance] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:25.594083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23179cf8-70b4-4eb8-94b8-1b21aa93fc8e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:25.596120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23179cf8-70b4-4eb8-94b8-1b21aa93fc8e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:25.596120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23179cf8-70b4-4eb8-94b8-1b21aa93fc8e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:25.596120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23179cf8-70b4-4eb8-94b8-1b21aa93fc8e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/c2aae4a8d5e348d4b697f7b1c9b45261` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:25.596490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23179cf8-70b4-4eb8-94b8-1b21aa93fc8e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=c2aae4a8d5e348d4b697f7b1c9b45261)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:25.597938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23179cf8-70b4-4eb8-94b8-1b21aa93fc8e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:25.609809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d42c67d3-d612-4142-bea7-721256a7d03b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8edcb8ae97c14a6bb4f130ed5f2ded86'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:25.723862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d42c67d3-d612-4142-bea7-721256a7d03b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8edcb8ae97c14a6bb4f130ed5f2ded86'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:25.724561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d42c67d3-d612-4142-bea7-721256a7d03b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8edcb8ae97c14a6bb4f130ed5f2ded86'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:25.733321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d42c67d3-d612-4142-bea7-721256a7d03b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8edcb8ae97c14a6bb4f130ed5f2ded86'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:25.745443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d42c67d3-d612-4142-bea7-721256a7d03b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8edcb8ae97c14a6bb4f130ed5f2ded86'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:25.751415 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2699/5442] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:25 2022] DELETE /identity/v3/users/8edcb8ae97c14a6bb4f130ed5f2ded86 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:25.752686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8ccb3-9c7a-4ef4-99f9-e0da9e6db922 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:25.753022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8ccb3-9c7a-4ef4-99f9-e0da9e6db922 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:25.753298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8ccb3-9c7a-4ef4-99f9-e0da9e6db922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:25.759823 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-21d8ccb3-9c7a-4ef4-99f9-e0da9e6db922 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:51:25.759823 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:25.759823 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:25.759823 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:25.759823 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:25.759823 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:25.759823 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:25.759823 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:25.759823 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:25.759823 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:25.759823 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:25.759823 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:25.759823 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:51:25.760934 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:51:25.760934 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:51:25.760934 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:51:25.760934 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:51:25.760934 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:51:25.760934 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:51:25.760934 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:51:25.760934 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:51:25.760934 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:51:25.760934 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:51:25.760934 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:51:25.760934 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:51:25.760934 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:51:25.760934 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:51:25.760934 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:51:25.762052 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2700/5443] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:51:25 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 9 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:51:25.762052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8ccb3-9c7a-4ef4-99f9-e0da9e6db922 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:25.763212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-21d8ccb3-9c7a-4ef4-99f9-e0da9e6db922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:25.796282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-23179cf8-70b4-4eb8-94b8-1b21aa93fc8e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invalidating the token cache because role c2aae4a8d5e348d4b697f7b1c9b45261 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:25.796784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-23179cf8-70b4-4eb8-94b8-1b21aa93fc8e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:25.797924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-23179cf8-70b4-4eb8-94b8-1b21aa93fc8e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:25.803837 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2744/5444] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:25 2022] DELETE /identity/v3/roles/c2aae4a8d5e348d4b697f7b1c9b45261 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:25.804750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23179cf8-70b4-4eb8-94b8-1b21aa93fc8e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:25.806879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-23179cf8-70b4-4eb8-94b8-1b21aa93fc8e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:25.854821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8ccb3-9c7a-4ef4-99f9-e0da9e6db922 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:25.878875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23179cf8-70b4-4eb8-94b8-1b21aa93fc8e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:25.883477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ce433-5ec8-46cf-94cf-45f9b9e7c40f tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da90fa43a9b4f61979b7b266b92b25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eada0ae9984c4f2c9fa211d09bcdedd4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-886169838', 'tempest-NotDelegatedRole-1369879218'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:25.884122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ce433-5ec8-46cf-94cf-45f9b9e7c40f tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] REQUEST_METHOD: `HEAD` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:25.884429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ce433-5ec8-46cf-94cf-45f9b9e7c40f tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:25.884702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ce433-5ec8-46cf-94cf-45f9b9e7c40f tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] PATH_INFO: `/v3/OS-TRUST/trusts/24d0c8c8504041f28794ba9073b53bde/roles/1f05e766e49d4c79af3229d7de10137a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:25.890527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ce433-5ec8-46cf-94cf-45f9b9e7c40f tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: Authorizing `identity:get_role_for_trust(trust_id=24d0c8c8504041f28794ba9073b53bde, role_id=1f05e766e49d4c79af3229d7de10137a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:25.892017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ce433-5ec8-46cf-94cf-45f9b9e7c40f tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:25.899360 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2745/5445] 10.222.0.76 () {58 vars in 1369 bytes} [Sat Aug 27 04:51:25 2022] HEAD /identity/v3/OS-TRUST/trusts/24d0c8c8504041f28794ba9073b53bde/roles/1f05e766e49d4c79af3229d7de10137a => generated 0 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 27 04:51:25.900851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05688d9-506a-48bc-9c14-2a66200a3fad None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:25.901137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05688d9-506a-48bc-9c14-2a66200a3fad None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:25.901461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05688d9-506a-48bc-9c14-2a66200a3fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:25.918224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf33b0b-c029-43a7-b0e9-450951c0824d tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d9aa87e19741058bff0c29c368e724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7074ae1c8ab4920b6cb59b20bae36ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:25.918892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf33b0b-c029-43a7-b0e9-450951c0824d tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:25.919159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf33b0b-c029-43a7-b0e9-450951c0824d tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:25.919427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf33b0b-c029-43a7-b0e9-450951c0824d tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] PATH_INFO: `/v3/policies/df57450e3bb647b186afad5555345135` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:25.920415 n-d-852088-5 devstack@keystone.service[82082]: WARNING oslo_log.versionutils [None req-7cf33b0b-c029-43a7-b0e9-450951c0824d tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 27 04:51:25.920950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf33b0b-c029-43a7-b0e9-450951c0824d tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=df57450e3bb647b186afad5555345135)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:25.922248 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-7cf33b0b-c029-43a7-b0e9-450951c0824d tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:25.922248 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:25.922248 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:25.922543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b05688d9-506a-48bc-9c14-2a66200a3fad None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:25.923133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf33b0b-c029-43a7-b0e9-450951c0824d tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:25.923639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b05688d9-506a-48bc-9c14-2a66200a3fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:25.983905 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2746/5446] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:25.984783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05688d9-506a-48bc-9c14-2a66200a3fad None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:25.987019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b05688d9-506a-48bc-9c14-2a66200a3fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:26.058774 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2701/5447] 10.222.0.76 () {60 vars in 1252 bytes} [Sat Aug 27 04:51:25 2022] PATCH /identity/v3/policies/df57450e3bb647b186afad5555345135 => generated 237 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:26.059718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf33b0b-c029-43a7-b0e9-450951c0824d tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:26.063418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05688d9-506a-48bc-9c14-2a66200a3fad None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:26.072421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdd353-8dbf-49b4-a269-a7f90a525680 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:26.073207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdd353-8dbf-49b4-a269-a7f90a525680 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:26.073744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdd353-8dbf-49b4-a269-a7f90a525680 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:26.074091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdd353-8dbf-49b4-a269-a7f90a525680 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:26.075475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdd353-8dbf-49b4-a269-a7f90a525680 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Adding query filter params (domain_id=3c5b393f88604e94a0608ded33678f83) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:26.075881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdd353-8dbf-49b4-a269-a7f90a525680 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:26.079455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdd353-8dbf-49b4-a269-a7f90a525680 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:26.086826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf33b0b-c029-43a7-b0e9-450951c0824d tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:26.091007 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2747/5448] 10.222.0.76 () {58 vars in 1207 bytes} [Sat Aug 27 04:51:25 2022] GET /identity/v3/roles?domain_id=3c5b393f88604e94a0608ded33678f83 => generated 148 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:26.092005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdd353-8dbf-49b4-a269-a7f90a525680 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:26.094816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bcfdd353-8dbf-49b4-a269-a7f90a525680 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:26.095157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d2db8-011e-41aa-8c93-93520711f426 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da90fa43a9b4f61979b7b266b92b25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eada0ae9984c4f2c9fa211d09bcdedd4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-886169838', 'tempest-NotDelegatedRole-1369879218'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:26.095863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d2db8-011e-41aa-8c93-93520711f426 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:26.096120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d2db8-011e-41aa-8c93-93520711f426 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:26.096439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d2db8-011e-41aa-8c93-93520711f426 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] PATH_INFO: `/v3/OS-TRUST/trusts/24d0c8c8504041f28794ba9073b53bde/roles/a4501e6d56924930b9e4658735af7434` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:26.105989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d2db8-011e-41aa-8c93-93520711f426 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: Authorizing `identity:get_role_for_trust(trust_id=24d0c8c8504041f28794ba9073b53bde, role_id=a4501e6d56924930b9e4658735af7434)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:26.107625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d2db8-011e-41aa-8c93-93520711f426 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:26.120771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-451d2db8-011e-41aa-8c93-93520711f426 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Could not find role: a4501e6d56924930b9e4658735af7434.: keystone.exception.RoleNotFound: Could not find role: a4501e6d56924930b9e4658735af7434. Aug 27 04:51:26.120771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:26.120771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:26.120771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:26.120771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:26.120771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:26.120771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:26.120771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:26.120771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:26.120771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:26.120771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:26.120771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:26.120771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 27 04:51:26.120771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:51:26.120771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: a4501e6d56924930b9e4658735af7434. Aug 27 04:51:26.122019 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:51:26.122491 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2702/5449] 10.222.0.76 () {58 vars in 1368 bytes} [Sat Aug 27 04:51:26 2022] GET /identity/v3/OS-TRUST/trusts/24d0c8c8504041f28794ba9073b53bde/roles/a4501e6d56924930b9e4658735af7434 => generated 110 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:51:26.123099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d2db8-011e-41aa-8c93-93520711f426 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:26.127926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-451d2db8-011e-41aa-8c93-93520711f426 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:26.144887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d2db8-011e-41aa-8c93-93520711f426 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:26.150678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df0718-8db7-463a-aad4-71059f483f03 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d9aa87e19741058bff0c29c368e724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7074ae1c8ab4920b6cb59b20bae36ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:26.151313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df0718-8db7-463a-aad4-71059f483f03 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:26.152205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df0718-8db7-463a-aad4-71059f483f03 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:26.152205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df0718-8db7-463a-aad4-71059f483f03 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] PATH_INFO: `/v3/policies/df57450e3bb647b186afad5555345135` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:26.152955 n-d-852088-5 devstack@keystone.service[82082]: WARNING oslo_log.versionutils [None req-56df0718-8db7-463a-aad4-71059f483f03 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 27 04:51:26.153514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df0718-8db7-463a-aad4-71059f483f03 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=df57450e3bb647b186afad5555345135)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:26.154753 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-56df0718-8db7-463a-aad4-71059f483f03 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:26.154753 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:26.154753 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:26.155785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df0718-8db7-463a-aad4-71059f483f03 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:26.164654 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2703/5450] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:51:26 2022] GET /identity/v3/policies/df57450e3bb647b186afad5555345135 => generated 237 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:26.165798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df0718-8db7-463a-aad4-71059f483f03 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:26.178321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df0718-8db7-463a-aad4-71059f483f03 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:26.184962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1e557-02c5-43f9-8be5-25a974a23413 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:26.187165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1e557-02c5-43f9-8be5-25a974a23413 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:26.187165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1e557-02c5-43f9-8be5-25a974a23413 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:26.187165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1e557-02c5-43f9-8be5-25a974a23413 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/c2aae4a8d5e348d4b697f7b1c9b45261` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:26.188109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdd353-8dbf-49b4-a269-a7f90a525680 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:26.192380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6ba09-6ab2-4764-b359-424dfd3b3a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:26.193001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6ba09-6ab2-4764-b359-424dfd3b3a88 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:26.193286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6ba09-6ab2-4764-b359-424dfd3b3a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:26.193568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6ba09-6ab2-4764-b359-424dfd3b3a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:26.198720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1e557-02c5-43f9-8be5-25a974a23413 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:51:26.203612 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-79e1e557-02c5-43f9-8be5-25a974a23413 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Could not find role: c2aae4a8d5e348d4b697f7b1c9b45261.: keystone.exception.RoleNotFound: Could not find role: c2aae4a8d5e348d4b697f7b1c9b45261. Aug 27 04:51:26.203612 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:26.203612 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:26.203612 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:26.203612 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:26.203612 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:26.203612 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:26.203612 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:26.203612 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:26.203612 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:26.203612 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:26.203612 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:26.203612 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Aug 27 04:51:26.203612 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Aug 27 04:51:26.204983 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:51:26.204983 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:51:26.204983 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:51:26.204983 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:51:26.204983 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:51:26.204983 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:51:26.204983 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:51:26.204983 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:51:26.204983 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:51:26.204983 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:51:26.204983 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:51:26.204983 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:51:26.204983 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:51:26.204983 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:51:26.204983 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:51:26.204983 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:51:26.206507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:51:26.206507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:51:26.206507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:51:26.206507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:51:26.206507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 04:51:26.206507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 04:51:26.206507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 04:51:26.206507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 04:51:26.206507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 04:51:26.206507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:51:26.206507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: c2aae4a8d5e348d4b697f7b1c9b45261. Aug 27 04:51:26.206507 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:51:26.209123 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2704/5451] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:26 2022] DELETE /identity/v3/roles/c2aae4a8d5e348d4b697f7b1c9b45261 => generated 110 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:51:26.209248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6ba09-6ab2-4764-b359-424dfd3b3a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:26.209818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1e557-02c5-43f9-8be5-25a974a23413 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:26.212919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6ba09-6ab2-4764-b359-424dfd3b3a88 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:26.225822 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2748/5452] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:26.226717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6ba09-6ab2-4764-b359-424dfd3b3a88 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:26.233445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1e557-02c5-43f9-8be5-25a974a23413 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:26.237522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6ba09-6ab2-4764-b359-424dfd3b3a88 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:26.242946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b91571-35d3-4120-8a69-354711efb435 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da90fa43a9b4f61979b7b266b92b25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eada0ae9984c4f2c9fa211d09bcdedd4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-886169838', 'tempest-NotDelegatedRole-1369879218'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:26.243519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a73803-b66a-4059-96b7-982adc47ed69 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d9aa87e19741058bff0c29c368e724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7074ae1c8ab4920b6cb59b20bae36ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:26.243755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b91571-35d3-4120-8a69-354711efb435 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] REQUEST_METHOD: `HEAD` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:26.244040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b91571-35d3-4120-8a69-354711efb435 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:26.244724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73803-b66a-4059-96b7-982adc47ed69 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:26.244960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b91571-35d3-4120-8a69-354711efb435 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] PATH_INFO: `/v3/OS-TRUST/trusts/24d0c8c8504041f28794ba9073b53bde/roles/a4501e6d56924930b9e4658735af7434` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:26.245322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73803-b66a-4059-96b7-982adc47ed69 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:26.245796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73803-b66a-4059-96b7-982adc47ed69 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] PATH_INFO: `/v3/policies/df57450e3bb647b186afad5555345135` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:26.246935 n-d-852088-5 devstack@keystone.service[82083]: WARNING oslo_log.versionutils [None req-38a73803-b66a-4059-96b7-982adc47ed69 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 27 04:51:26.247652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a73803-b66a-4059-96b7-982adc47ed69 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=df57450e3bb647b186afad5555345135)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:26.249353 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-38a73803-b66a-4059-96b7-982adc47ed69 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:26.249353 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:26.249353 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:26.250602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a73803-b66a-4059-96b7-982adc47ed69 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:26.254501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b91571-35d3-4120-8a69-354711efb435 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: Authorizing `identity:get_role_for_trust(trust_id=24d0c8c8504041f28794ba9073b53bde, role_id=a4501e6d56924930b9e4658735af7434)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:26.258292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b91571-35d3-4120-8a69-354711efb435 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:26.282775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-a1b91571-35d3-4120-8a69-354711efb435 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Could not find role: a4501e6d56924930b9e4658735af7434.: keystone.exception.RoleNotFound: Could not find role: a4501e6d56924930b9e4658735af7434. Aug 27 04:51:26.282775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:26.282775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:26.282775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:26.282775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:26.282775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:26.282775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:26.282775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:26.282775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:26.282775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:26.282775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:26.282775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:26.282775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 27 04:51:26.282775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:51:26.282775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: a4501e6d56924930b9e4658735af7434. Aug 27 04:51:26.283996 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:51:26.286316 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2705/5453] 10.222.0.76 () {58 vars in 1369 bytes} [Sat Aug 27 04:51:26 2022] HEAD /identity/v3/OS-TRUST/trusts/24d0c8c8504041f28794ba9073b53bde/roles/a4501e6d56924930b9e4658735af7434 => generated 0 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 27 04:51:26.287565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b91571-35d3-4120-8a69-354711efb435 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:26.307941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b91571-35d3-4120-8a69-354711efb435 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:26.312870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a206f9c-fa1c-4a74-981b-d3eb39babae2 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:26.314459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a206f9c-fa1c-4a74-981b-d3eb39babae2 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:26.316667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a206f9c-fa1c-4a74-981b-d3eb39babae2 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:26.317141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a206f9c-fa1c-4a74-981b-d3eb39babae2 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/domains/3c5b393f88604e94a0608ded33678f83/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:26.329921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a206f9c-fa1c-4a74-981b-d3eb39babae2 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3c5b393f88604e94a0608ded33678f83, group_id=216c77dd281c4b3b8e973dadcea3e611, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:26.336507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a206f9c-fa1c-4a74-981b-d3eb39babae2 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:26.342919 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2749/5454] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:26 2022] DELETE /identity/v3/policies/df57450e3bb647b186afad5555345135 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:26.342919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a73803-b66a-4059-96b7-982adc47ed69 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:26.360663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a73803-b66a-4059-96b7-982adc47ed69 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:26.369160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfcefa-3d0e-4f56-b9b7-d10c5ad1dfca tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da90fa43a9b4f61979b7b266b92b25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eada0ae9984c4f2c9fa211d09bcdedd4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-886169838', 'tempest-NotDelegatedRole-1369879218'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:26.369825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfcefa-3d0e-4f56-b9b7-d10c5ad1dfca tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:26.370104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfcefa-3d0e-4f56-b9b7-d10c5ad1dfca tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:26.372780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfcefa-3d0e-4f56-b9b7-d10c5ad1dfca tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] PATH_INFO: `/v3/OS-TRUST/trusts/24d0c8c8504041f28794ba9073b53bde` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:26.380279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfcefa-3d0e-4f56-b9b7-d10c5ad1dfca tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: Authorizing `identity:delete_trust(trust_id=24d0c8c8504041f28794ba9073b53bde)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:26.382026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfcefa-3d0e-4f56-b9b7-d10c5ad1dfca tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:26.456022 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2706/5455] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:26 2022] PUT /identity/v3/domains/3c5b393f88604e94a0608ded33678f83/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:26.458305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a206f9c-fa1c-4a74-981b-d3eb39babae2 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:26.481216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c4cfcefa-3d0e-4f56-b9b7-d10c5ad1dfca tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '24d0c8c8504041f28794ba9073b53bde', 'request_id': 'req-c4cfcefa-3d0e-4f56-b9b7-d10c5ad1dfca'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:26.484327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c4cfcefa-3d0e-4f56-b9b7-d10c5ad1dfca tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '24d0c8c8504041f28794ba9073b53bde', 'request_id': 'req-c4cfcefa-3d0e-4f56-b9b7-d10c5ad1dfca'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:26.562519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a206f9c-fa1c-4a74-981b-d3eb39babae2 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:26.571906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6719ba-9a75-47f1-b5d1-0f675560d9f4 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d9aa87e19741058bff0c29c368e724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7074ae1c8ab4920b6cb59b20bae36ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:26.571906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6719ba-9a75-47f1-b5d1-0f675560d9f4 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:26.571906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6719ba-9a75-47f1-b5d1-0f675560d9f4 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:26.572349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6719ba-9a75-47f1-b5d1-0f675560d9f4 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] PATH_INFO: `/v3/policies` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:26.572349 n-d-852088-5 devstack@keystone.service[82082]: WARNING oslo_log.versionutils [None req-2f6719ba-9a75-47f1-b5d1-0f675560d9f4 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 27 04:51:26.572349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6719ba-9a75-47f1-b5d1-0f675560d9f4 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:26.572622 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-2f6719ba-9a75-47f1-b5d1-0f675560d9f4 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:26.572622 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:26.572622 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:26.573717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6719ba-9a75-47f1-b5d1-0f675560d9f4 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:26.634732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c4cfcefa-3d0e-4f56-b9b7-d10c5ad1dfca tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '24d0c8c8504041f28794ba9073b53bde', 'request_id': 'req-c4cfcefa-3d0e-4f56-b9b7-d10c5ad1dfca'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:26.644703 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2750/5456] 10.222.0.76 () {58 vars in 1254 bytes} [Sat Aug 27 04:51:26 2022] DELETE /identity/v3/OS-TRUST/trusts/24d0c8c8504041f28794ba9073b53bde => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:26.645326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfcefa-3d0e-4f56-b9b7-d10c5ad1dfca tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:26.647072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c4cfcefa-3d0e-4f56-b9b7-d10c5ad1dfca tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:26.669336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfcefa-3d0e-4f56-b9b7-d10c5ad1dfca tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:26.707395 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2707/5457] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:51:26 2022] POST /identity/v3/policies => generated 230 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:26.713568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6719ba-9a75-47f1-b5d1-0f675560d9f4 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:26.721588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2f6719ba-9a75-47f1-b5d1-0f675560d9f4 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:26.815967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc6a4c-8fbd-4191-81aa-ab9b6aeb9bf0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:26.816804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc6a4c-8fbd-4191-81aa-ab9b6aeb9bf0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:26.817237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc6a4c-8fbd-4191-81aa-ab9b6aeb9bf0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:26.817625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc6a4c-8fbd-4191-81aa-ab9b6aeb9bf0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/domains/3c5b393f88604e94a0608ded33678f83/groups/216c77dd281c4b3b8e973dadcea3e611/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:26.819725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc6a4c-8fbd-4191-81aa-ab9b6aeb9bf0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=3c5b393f88604e94a0608ded33678f83, group_id=216c77dd281c4b3b8e973dadcea3e611)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:26.823914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc6a4c-8fbd-4191-81aa-ab9b6aeb9bf0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:26.830070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6719ba-9a75-47f1-b5d1-0f675560d9f4 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:26.835056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406899b5-00c3-4afc-a39f-5a1dff8044d6 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da90fa43a9b4f61979b7b266b92b25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eada0ae9984c4f2c9fa211d09bcdedd4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-886169838', 'tempest-NotDelegatedRole-1369879218'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:26.836533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406899b5-00c3-4afc-a39f-5a1dff8044d6 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:26.837219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406899b5-00c3-4afc-a39f-5a1dff8044d6 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:26.837821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406899b5-00c3-4afc-a39f-5a1dff8044d6 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] PATH_INFO: `/v3/OS-TRUST/trusts/24d0c8c8504041f28794ba9073b53bde` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:26.849074 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-406899b5-00c3-4afc-a39f-5a1dff8044d6 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Could not find trust: 24d0c8c8504041f28794ba9073b53bde.: keystone.exception.TrustNotFound: Could not find trust: 24d0c8c8504041f28794ba9073b53bde. Aug 27 04:51:26.849074 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:26.849074 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:26.849074 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:26.849074 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:26.849074 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:26.849074 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:26.849074 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:26.849074 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:26.849074 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:26.849074 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:26.849074 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:26.849074 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 27 04:51:26.849074 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 27 04:51:26.849074 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 27 04:51:26.850218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 27 04:51:26.850218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 27 04:51:26.850218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 27 04:51:26.850218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 27 04:51:26.850218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 27 04:51:26.850218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:51:26.850218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:51:26.850218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 27 04:51:26.850218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 27 04:51:26.850218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 27 04:51:26.850218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 27 04:51:26.850218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 24d0c8c8504041f28794ba9073b53bde. Aug 27 04:51:26.850218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:51:26.852442 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2751/5458] 10.222.0.76 () {58 vars in 1365 bytes} [Sat Aug 27 04:51:26 2022] GET /identity/v3/domains/3c5b393f88604e94a0608ded33678f83/groups/216c77dd281c4b3b8e973dadcea3e611/roles => generated 410 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:26.856648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc6a4c-8fbd-4191-81aa-ab9b6aeb9bf0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:26.856648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7bfc6a4c-8fbd-4191-81aa-ab9b6aeb9bf0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:26.857651 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2708/5459] 10.222.0.76 () {58 vars in 1251 bytes} [Sat Aug 27 04:51:26 2022] GET /identity/v3/OS-TRUST/trusts/24d0c8c8504041f28794ba9073b53bde => generated 111 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:51:26.858940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406899b5-00c3-4afc-a39f-5a1dff8044d6 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:26.874370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc6a4c-8fbd-4191-81aa-ab9b6aeb9bf0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:26.877224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406899b5-00c3-4afc-a39f-5a1dff8044d6 tempest-TrustsV3TestJSON-866209459 tempest-user-42716209] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:26.880450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228cbbb-1ca5-42a4-a193-2131611ce293 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d9aa87e19741058bff0c29c368e724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7074ae1c8ab4920b6cb59b20bae36ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:26.881269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228cbbb-1ca5-42a4-a193-2131611ce293 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:26.881682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228cbbb-1ca5-42a4-a193-2131611ce293 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:26.882039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228cbbb-1ca5-42a4-a193-2131611ce293 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] PATH_INFO: `/v3/policies` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:26.884187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228cbbb-1ca5-42a4-a193-2131611ce293 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:26.885228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28062a-fdb3-4ed7-9ed3-0400457adb82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:26.886123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28062a-fdb3-4ed7-9ed3-0400457adb82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:26.886624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28062a-fdb3-4ed7-9ed3-0400457adb82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:26.886853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228cbbb-1ca5-42a4-a193-2131611ce293 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:26.887298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28062a-fdb3-4ed7-9ed3-0400457adb82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/domains/3c5b393f88604e94a0608ded33678f83/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:26.890070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28062a-fdb3-4ed7-9ed3-0400457adb82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=3c5b393f88604e94a0608ded33678f83, group_id=216c77dd281c4b3b8e973dadcea3e611, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:26.893575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28062a-fdb3-4ed7-9ed3-0400457adb82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:26.904441 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2709/5460] 10.222.0.76 () {58 vars in 1465 bytes} [Sat Aug 27 04:51:26 2022] HEAD /identity/v3/domains/3c5b393f88604e94a0608ded33678f83/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:26.904441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28062a-fdb3-4ed7-9ed3-0400457adb82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:26.911601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5f28062a-fdb3-4ed7-9ed3-0400457adb82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:26.986352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28062a-fdb3-4ed7-9ed3-0400457adb82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:26.991284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528b7e2-fa4e-494e-800d-cc878ebeb2e9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:26.992022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528b7e2-fa4e-494e-800d-cc878ebeb2e9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:26.992389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528b7e2-fa4e-494e-800d-cc878ebeb2e9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:26.992751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528b7e2-fa4e-494e-800d-cc878ebeb2e9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles/a4501e6d56924930b9e4658735af7434` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:26.994214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528b7e2-fa4e-494e-800d-cc878ebeb2e9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a4501e6d56924930b9e4658735af7434)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:26.995844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528b7e2-fa4e-494e-800d-cc878ebeb2e9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:27.061646 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2752/5461] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:51:26 2022] POST /identity/v3/policies => generated 229 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:27.062798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228cbbb-1ca5-42a4-a193-2131611ce293 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:27.084314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228cbbb-1ca5-42a4-a193-2131611ce293 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:27.090968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f9e61-27f3-4556-be3e-a0a17c22c1d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:27.091742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f9e61-27f3-4556-be3e-a0a17c22c1d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:27.092036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f9e61-27f3-4556-be3e-a0a17c22c1d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:27.092376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f9e61-27f3-4556-be3e-a0a17c22c1d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/domains/3c5b393f88604e94a0608ded33678f83/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:27.096154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f9e61-27f3-4556-be3e-a0a17c22c1d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3c5b393f88604e94a0608ded33678f83, group_id=216c77dd281c4b3b8e973dadcea3e611, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:27.108889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f9e61-27f3-4556-be3e-a0a17c22c1d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:27.120475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3a0f9e61-27f3-4556-be3e-a0a17c22c1d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invalidating the token cache because role 959d409c289a4ad1b4ceeea047bb8036 was removed from group 216c77dd281c4b3b8e973dadcea3e611 on domain 3c5b393f88604e94a0608ded33678f83. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:27.120475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3a0f9e61-27f3-4556-be3e-a0a17c22c1d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:27.120475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3a0f9e61-27f3-4556-be3e-a0a17c22c1d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:27.268019 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2753/5462] 10.222.0.76 () {58 vars in 1467 bytes} [Sat Aug 27 04:51:27 2022] DELETE /identity/v3/domains/3c5b393f88604e94a0608ded33678f83/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:27.271180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f9e61-27f3-4556-be3e-a0a17c22c1d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:27.283005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3a0f9e61-27f3-4556-be3e-a0a17c22c1d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:27.296377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2528b7e2-fa4e-494e-800d-cc878ebeb2e9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invalidating the token cache because role a4501e6d56924930b9e4658735af7434 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:27.297053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2528b7e2-fa4e-494e-800d-cc878ebeb2e9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:27.301902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2528b7e2-fa4e-494e-800d-cc878ebeb2e9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:27.314474 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2710/5463] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:26 2022] DELETE /identity/v3/roles/a4501e6d56924930b9e4658735af7434 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:27.316432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528b7e2-fa4e-494e-800d-cc878ebeb2e9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:27.322335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2528b7e2-fa4e-494e-800d-cc878ebeb2e9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:27.462999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f9e61-27f3-4556-be3e-a0a17c22c1d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:27.517004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528b7e2-fa4e-494e-800d-cc878ebeb2e9 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:27.522128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e33926-5c83-4e08-85ee-4142daa5c2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:27.523933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e33926-5c83-4e08-85ee-4142daa5c2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:27.524586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e33926-5c83-4e08-85ee-4142daa5c2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:27.524880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e33926-5c83-4e08-85ee-4142daa5c2d7 admin admin] PATH_INFO: `/v3/projects/d3b2b69d4366472280ac8ef285f6a628` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:27.526246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e33926-5c83-4e08-85ee-4142daa5c2d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b2b69d4366472280ac8ef285f6a628)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:27.528557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e33926-5c83-4e08-85ee-4142daa5c2d7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:27.594503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4dc18-1f2c-48bb-be5c-400971fd4e58 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d9aa87e19741058bff0c29c368e724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7074ae1c8ab4920b6cb59b20bae36ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:27.595510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4dc18-1f2c-48bb-be5c-400971fd4e58 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:27.595811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4dc18-1f2c-48bb-be5c-400971fd4e58 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:27.596252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4dc18-1f2c-48bb-be5c-400971fd4e58 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] PATH_INFO: `/v3/policies` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:27.597652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4dc18-1f2c-48bb-be5c-400971fd4e58 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:27.607888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4dc18-1f2c-48bb-be5c-400971fd4e58 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:27.736845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-76e33926-5c83-4e08-85ee-4142daa5c2d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b2b69d4366472280ac8ef285f6a628', 'request_id': 'req-76e33926-5c83-4e08-85ee-4142daa5c2d7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:27.743719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-76e33926-5c83-4e08-85ee-4142daa5c2d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b2b69d4366472280ac8ef285f6a628', 'request_id': 'req-76e33926-5c83-4e08-85ee-4142daa5c2d7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:27.750979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-76e33926-5c83-4e08-85ee-4142daa5c2d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b2b69d4366472280ac8ef285f6a628', 'request_id': 'req-76e33926-5c83-4e08-85ee-4142daa5c2d7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:27.791111 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2754/5464] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:51:27 2022] POST /identity/v3/policies => generated 230 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:27.792236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4dc18-1f2c-48bb-be5c-400971fd4e58 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:27.794232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-99c4dc18-1f2c-48bb-be5c-400971fd4e58 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:27.809471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4dc18-1f2c-48bb-be5c-400971fd4e58 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:27.851145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-76e33926-5c83-4e08-85ee-4142daa5c2d7 admin admin] The token cache is being invalidate because project d3b2b69d4366472280ac8ef285f6a628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:27.851422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-76e33926-5c83-4e08-85ee-4142daa5c2d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:27.852198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-76e33926-5c83-4e08-85ee-4142daa5c2d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:27.857633 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2711/5465] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:27 2022] DELETE /identity/v3/projects/d3b2b69d4366472280ac8ef285f6a628 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:27.857633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e33926-5c83-4e08-85ee-4142daa5c2d7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:27.857633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-76e33926-5c83-4e08-85ee-4142daa5c2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:27.873796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8a025-3c9c-40c3-bd36-a8831ecd5cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:27.874350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8a025-3c9c-40c3-bd36-a8831ecd5cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:27.874625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8a025-3c9c-40c3-bd36-a8831ecd5cca admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:27.874894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8a025-3c9c-40c3-bd36-a8831ecd5cca admin admin] PATH_INFO: `/v3/users/eaf64b46c3424d13afd5ddca475dacda` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:27.876012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8a025-3c9c-40c3-bd36-a8831ecd5cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf64b46c3424d13afd5ddca475dacda)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:27.878012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8a025-3c9c-40c3-bd36-a8831ecd5cca admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:27.910385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:27.927562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e33926-5c83-4e08-85ee-4142daa5c2d7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:27.933742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d57b5-9a51-4b51-831d-c8c2682f4d86 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:27.934433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d57b5-9a51-4b51-831d-c8c2682f4d86 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:27.934718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d57b5-9a51-4b51-831d-c8c2682f4d86 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:27.934997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d57b5-9a51-4b51-831d-c8c2682f4d86 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/projects/818237f556a4495eb0a73c1763a11490/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:27.942158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d57b5-9a51-4b51-831d-c8c2682f4d86 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_grant(project_id=818237f556a4495eb0a73c1763a11490, group_id=216c77dd281c4b3b8e973dadcea3e611, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:27.945682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d57b5-9a51-4b51-831d-c8c2682f4d86 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:28.166111 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2712/5466] 10.222.0.76 () {60 vars in 1486 bytes} [Sat Aug 27 04:51:27 2022] PUT /identity/v3/projects/818237f556a4495eb0a73c1763a11490/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:28.167135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d57b5-9a51-4b51-831d-c8c2682f4d86 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:28.168905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b21d57b5-9a51-4b51-831d-c8c2682f4d86 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:28.225191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:28.243989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d57b5-9a51-4b51-831d-c8c2682f4d86 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:28.248852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af830d0-d020-43eb-a2b4-ae5c3ff5e116 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:28.249647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af830d0-d020-43eb-a2b4-ae5c3ff5e116 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:28.249932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af830d0-d020-43eb-a2b4-ae5c3ff5e116 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:28.250207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af830d0-d020-43eb-a2b4-ae5c3ff5e116 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles/1f05e766e49d4c79af3229d7de10137a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:28.251634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af830d0-d020-43eb-a2b4-ae5c3ff5e116 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1f05e766e49d4c79af3229d7de10137a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:28.253291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af830d0-d020-43eb-a2b4-ae5c3ff5e116 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:28.269418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-19c8a025-3c9c-40c3-bd36-a8831ecd5cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf64b46c3424d13afd5ddca475dacda'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:28.280050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-19c8a025-3c9c-40c3-bd36-a8831ecd5cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf64b46c3424d13afd5ddca475dacda'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:28.440943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-19c8a025-3c9c-40c3-bd36-a8831ecd5cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf64b46c3424d13afd5ddca475dacda'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:28.441605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-19c8a025-3c9c-40c3-bd36-a8831ecd5cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf64b46c3424d13afd5ddca475dacda'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:28.466434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-19c8a025-3c9c-40c3-bd36-a8831ecd5cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf64b46c3424d13afd5ddca475dacda'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:28.493187 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2755/5467] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:27 2022] DELETE /identity/v3/users/eaf64b46c3424d13afd5ddca475dacda => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:28.493187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8a025-3c9c-40c3-bd36-a8831ecd5cca admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:28.493187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-19c8a025-3c9c-40c3-bd36-a8831ecd5cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:28.573714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0af830d0-d020-43eb-a2b4-ae5c3ff5e116 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invalidating the token cache because role 1f05e766e49d4c79af3229d7de10137a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:28.574017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0af830d0-d020-43eb-a2b4-ae5c3ff5e116 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:28.574786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0af830d0-d020-43eb-a2b4-ae5c3ff5e116 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:28.577097 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2713/5468] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:28 2022] DELETE /identity/v3/roles/1f05e766e49d4c79af3229d7de10137a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:28.578668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0d535-53d2-4fa8-ad20-0e23b15eece3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:28.578954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0d535-53d2-4fa8-ad20-0e23b15eece3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:28.579225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0d535-53d2-4fa8-ad20-0e23b15eece3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:28.605309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8a025-3c9c-40c3-bd36-a8831ecd5cca admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:28.612457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0ae0d535-53d2-4fa8-ad20-0e23b15eece3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:28.614075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0ae0d535-53d2-4fa8-ad20-0e23b15eece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:28.688875 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2714/5469] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:28.696413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0d535-53d2-4fa8-ad20-0e23b15eece3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:28.696413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0ae0d535-53d2-4fa8-ad20-0e23b15eece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:28.708731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65af37-71a2-43e9-9f12-166cbefb167c tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d9aa87e19741058bff0c29c368e724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7074ae1c8ab4920b6cb59b20bae36ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:28.709491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65af37-71a2-43e9-9f12-166cbefb167c tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:28.709774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65af37-71a2-43e9-9f12-166cbefb167c tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:28.710043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65af37-71a2-43e9-9f12-166cbefb167c tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] PATH_INFO: `/v3/policies` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:28.711845 n-d-852088-5 devstack@keystone.service[82083]: WARNING oslo_log.versionutils [None req-4d65af37-71a2-43e9-9f12-166cbefb167c tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 27 04:51:28.712440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65af37-71a2-43e9-9f12-166cbefb167c tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:28.715237 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-4d65af37-71a2-43e9-9f12-166cbefb167c tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:28.715237 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:28.715237 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:28.718246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65af37-71a2-43e9-9f12-166cbefb167c tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:28.744319 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2756/5470] 10.222.0.76 () {58 vars in 1131 bytes} [Sat Aug 27 04:51:28 2022] GET /identity/v3/policies => generated 765 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:28.745952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b275b5-fb04-4418-bade-95e7750de85a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:28.746235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b275b5-fb04-4418-bade-95e7750de85a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:28.746508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b275b5-fb04-4418-bade-95e7750de85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:28.777348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-15b275b5-fb04-4418-bade-95e7750de85a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:28.778914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-15b275b5-fb04-4418-bade-95e7750de85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:28.789805 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2757/5471] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:28.790852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b275b5-fb04-4418-bade-95e7750de85a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:28.792316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-15b275b5-fb04-4418-bade-95e7750de85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:28.808636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0d535-53d2-4fa8-ad20-0e23b15eece3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:28.814722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271fd38-0b5b-4b71-ae4e-6377a6f47a34 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:28.815444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271fd38-0b5b-4b71-ae4e-6377a6f47a34 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:28.815759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271fd38-0b5b-4b71-ae4e-6377a6f47a34 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:28.816106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271fd38-0b5b-4b71-ae4e-6377a6f47a34 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/projects/818237f556a4495eb0a73c1763a11490/groups/216c77dd281c4b3b8e973dadcea3e611/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:28.818175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271fd38-0b5b-4b71-ae4e-6377a6f47a34 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:list_grants(project_id=818237f556a4495eb0a73c1763a11490, group_id=216c77dd281c4b3b8e973dadcea3e611)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:28.820859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271fd38-0b5b-4b71-ae4e-6377a6f47a34 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:28.836234 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2715/5472] 10.222.0.76 () {58 vars in 1368 bytes} [Sat Aug 27 04:51:28 2022] GET /identity/v3/projects/818237f556a4495eb0a73c1763a11490/groups/216c77dd281c4b3b8e973dadcea3e611/roles => generated 411 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:28.839765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe14555-5791-4745-8e14-47f32c3fcb8a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:28.839765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe14555-5791-4745-8e14-47f32c3fcb8a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:28.840047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe14555-5791-4745-8e14-47f32c3fcb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:28.881657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b275b5-fb04-4418-bade-95e7750de85a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:28.898340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36029f81-ff4b-4eeb-8250-53fbac26a2dc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:28.898340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36029f81-ff4b-4eeb-8250-53fbac26a2dc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:28.898340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36029f81-ff4b-4eeb-8250-53fbac26a2dc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:28.898783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36029f81-ff4b-4eeb-8250-53fbac26a2dc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users/2da90fa43a9b4f61979b7b266b92b25a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:28.898885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-dbe14555-5791-4745-8e14-47f32c3fcb8a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:28.898972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36029f81-ff4b-4eeb-8250-53fbac26a2dc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2da90fa43a9b4f61979b7b266b92b25a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:28.899075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dbe14555-5791-4745-8e14-47f32c3fcb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:28.899185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36029f81-ff4b-4eeb-8250-53fbac26a2dc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:28.906952 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2716/5473] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:28.906952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe14555-5791-4745-8e14-47f32c3fcb8a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:28.906952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dbe14555-5791-4745-8e14-47f32c3fcb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:28.936580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe14555-5791-4745-8e14-47f32c3fcb8a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:28.938254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ed3c8-7636-42e3-9011-6724f7646152 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d9aa87e19741058bff0c29c368e724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7074ae1c8ab4920b6cb59b20bae36ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:28.939088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ed3c8-7636-42e3-9011-6724f7646152 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:28.939553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ed3c8-7636-42e3-9011-6724f7646152 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:28.939995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ed3c8-7636-42e3-9011-6724f7646152 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] PATH_INFO: `/v3/policies/9e552146a89e4ec4a63e97a66f580fee` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:28.944534 n-d-852088-5 devstack@keystone.service[82082]: WARNING oslo_log.versionutils [None req-549ed3c8-7636-42e3-9011-6724f7646152 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 27 04:51:28.945195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ed3c8-7636-42e3-9011-6724f7646152 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=9e552146a89e4ec4a63e97a66f580fee)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:28.946457 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-549ed3c8-7636-42e3-9011-6724f7646152 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:28.946457 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:28.946457 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:28.947341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ed3c8-7636-42e3-9011-6724f7646152 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:29.105593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-36029f81-ff4b-4eeb-8250-53fbac26a2dc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2da90fa43a9b4f61979b7b266b92b25a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:29.133204 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2717/5474] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:28 2022] DELETE /identity/v3/policies/9e552146a89e4ec4a63e97a66f580fee => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:29.133890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-36029f81-ff4b-4eeb-8250-53fbac26a2dc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2da90fa43a9b4f61979b7b266b92b25a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:29.134112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ed3c8-7636-42e3-9011-6724f7646152 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:29.134112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-549ed3c8-7636-42e3-9011-6724f7646152 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:29.213828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ed3c8-7636-42e3-9011-6724f7646152 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:29.218403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295124c-7a6d-43e8-9384-cfac898a05df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:29.219086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295124c-7a6d-43e8-9384-cfac898a05df service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:29.219470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295124c-7a6d-43e8-9384-cfac898a05df service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:29.219806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295124c-7a6d-43e8-9384-cfac898a05df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:29.236362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-36029f81-ff4b-4eeb-8250-53fbac26a2dc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2da90fa43a9b4f61979b7b266b92b25a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:29.236925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-36029f81-ff4b-4eeb-8250-53fbac26a2dc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2da90fa43a9b4f61979b7b266b92b25a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:29.237773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295124c-7a6d-43e8-9384-cfac898a05df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:29.245794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295124c-7a6d-43e8-9384-cfac898a05df service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:29.253670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-36029f81-ff4b-4eeb-8250-53fbac26a2dc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2da90fa43a9b4f61979b7b266b92b25a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:29.256708 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2718/5475] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:29.257868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295124c-7a6d-43e8-9384-cfac898a05df service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:29.270733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295124c-7a6d-43e8-9384-cfac898a05df service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:29.272311 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2758/5476] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:28 2022] DELETE /identity/v3/users/2da90fa43a9b4f61979b7b266b92b25a => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:29.276046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36029f81-ff4b-4eeb-8250-53fbac26a2dc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:29.281221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-36029f81-ff4b-4eeb-8250-53fbac26a2dc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:29.342514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b0374-2f00-4721-b95c-087a73528569 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:29.343233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b0374-2f00-4721-b95c-087a73528569 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:29.343980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b0374-2f00-4721-b95c-087a73528569 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:29.344323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b0374-2f00-4721-b95c-087a73528569 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/groups/216c77dd281c4b3b8e973dadcea3e611/users/0a48539c987b4f988709d51f673cda2d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:29.346369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b0374-2f00-4721-b95c-087a73528569 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=216c77dd281c4b3b8e973dadcea3e611, user_id=0a48539c987b4f988709d51f673cda2d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:29.348631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b0374-2f00-4721-b95c-087a73528569 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:29.386824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36029f81-ff4b-4eeb-8250-53fbac26a2dc tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:29.392965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe70c29-06e3-4f00-bf6b-fd17c3996bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:29.394282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70c29-06e3-4f00-bf6b-fd17c3996bbe admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:29.394687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70c29-06e3-4f00-bf6b-fd17c3996bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:29.395063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70c29-06e3-4f00-bf6b-fd17c3996bbe admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:29.395883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe70c29-06e3-4f00-bf6b-fd17c3996bbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:29.396620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe70c29-06e3-4f00-bf6b-fd17c3996bbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:29.398678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe70c29-06e3-4f00-bf6b-fd17c3996bbe admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:29.416209 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2759/5477] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:29.416209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe70c29-06e3-4f00-bf6b-fd17c3996bbe admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:29.418259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ebe70c29-06e3-4f00-bf6b-fd17c3996bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:29.494720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe70c29-06e3-4f00-bf6b-fd17c3996bbe admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:29.500725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beceef-e4e1-4989-8620-d3f74463964e tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d9aa87e19741058bff0c29c368e724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7074ae1c8ab4920b6cb59b20bae36ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:29.501502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beceef-e4e1-4989-8620-d3f74463964e tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:29.501782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beceef-e4e1-4989-8620-d3f74463964e tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:29.502238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beceef-e4e1-4989-8620-d3f74463964e tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] PATH_INFO: `/v3/policies/2c17cad846ee4ca09688f9c3f39b8c68` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:29.503767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0beceef-e4e1-4989-8620-d3f74463964e tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=2c17cad846ee4ca09688f9c3f39b8c68)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:29.506318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0beceef-e4e1-4989-8620-d3f74463964e tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:29.586137 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2719/5478] 10.222.0.76 () {60 vars in 1360 bytes} [Sat Aug 27 04:51:29 2022] PUT /identity/v3/groups/216c77dd281c4b3b8e973dadcea3e611/users/0a48539c987b4f988709d51f673cda2d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:29.586960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b0374-2f00-4721-b95c-087a73528569 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:29.589601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0e8b0374-2f00-4721-b95c-087a73528569 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:29.663282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b0374-2f00-4721-b95c-087a73528569 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:29.669443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb0cfd-4cd7-428e-bea5-235c272418e0 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:29.670241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb0cfd-4cd7-428e-bea5-235c272418e0 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:29.670670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb0cfd-4cd7-428e-bea5-235c272418e0 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:29.671047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb0cfd-4cd7-428e-bea5-235c272418e0 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/eada0ae9984c4f2c9fa211d09bcdedd4` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:29.672321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb0cfd-4cd7-428e-bea5-235c272418e0 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eada0ae9984c4f2c9fa211d09bcdedd4)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:29.674320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb0cfd-4cd7-428e-bea5-235c272418e0 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:29.748401 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2760/5479] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:29 2022] DELETE /identity/v3/policies/2c17cad846ee4ca09688f9c3f39b8c68 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:29.749531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beceef-e4e1-4989-8620-d3f74463964e tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:29.764921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beceef-e4e1-4989-8620-d3f74463964e tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:29.855487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7418ea-2a76-4269-938f-07eb5db5e249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:29.856128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7418ea-2a76-4269-938f-07eb5db5e249 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:29.856457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7418ea-2a76-4269-938f-07eb5db5e249 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:29.856739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7418ea-2a76-4269-938f-07eb5db5e249 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:29.857382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7418ea-2a76-4269-938f-07eb5db5e249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:29.859875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7418ea-2a76-4269-938f-07eb5db5e249 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:29.956824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dcfb0cfd-4cd7-428e-bea5-235c272418e0 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eada0ae9984c4f2c9fa211d09bcdedd4', 'request_id': 'req-dcfb0cfd-4cd7-428e-bea5-235c272418e0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:29.966954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dcfb0cfd-4cd7-428e-bea5-235c272418e0 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eada0ae9984c4f2c9fa211d09bcdedd4', 'request_id': 'req-dcfb0cfd-4cd7-428e-bea5-235c272418e0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:29.982721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dcfb0cfd-4cd7-428e-bea5-235c272418e0 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eada0ae9984c4f2c9fa211d09bcdedd4', 'request_id': 'req-dcfb0cfd-4cd7-428e-bea5-235c272418e0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:30.044187 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2761/5480] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:29 2022] POST /identity/v3/projects => generated 373 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:30.044187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bb285-16e1-4020-93d9-e88e7b2c4c15 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:30.044187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bb285-16e1-4020-93d9-e88e7b2c4c15 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:30.044187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bb285-16e1-4020-93d9-e88e7b2c4c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:30.092548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e88bb285-16e1-4020-93d9-e88e7b2c4c15 None None] MFA Rules not processed for user `0a48539c987b4f988709d51f673cda2d`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:30.094085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e88bb285-16e1-4020-93d9-e88e7b2c4c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:30.115403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dcfb0cfd-4cd7-428e-bea5-235c272418e0 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] The token cache is being invalidate because project eada0ae9984c4f2c9fa211d09bcdedd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:30.115703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dcfb0cfd-4cd7-428e-bea5-235c272418e0 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:30.117193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dcfb0cfd-4cd7-428e-bea5-235c272418e0 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:30.119066 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2720/5481] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:29 2022] DELETE /identity/v3/projects/eada0ae9984c4f2c9fa211d09bcdedd4 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:30.124886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb0cfd-4cd7-428e-bea5-235c272418e0 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:30.126674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dcfb0cfd-4cd7-428e-bea5-235c272418e0 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:30.210764 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2762/5482] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:30.210764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bb285-16e1-4020-93d9-e88e7b2c4c15 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:30.210764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e88bb285-16e1-4020-93d9-e88e7b2c4c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:30.211267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb0cfd-4cd7-428e-bea5-235c272418e0 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:30.296462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd9c22-71d9-465b-9507-0644f567a044 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d9aa87e19741058bff0c29c368e724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7074ae1c8ab4920b6cb59b20bae36ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:30.298099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd9c22-71d9-465b-9507-0644f567a044 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:30.298099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd9c22-71d9-465b-9507-0644f567a044 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:30.302841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd9c22-71d9-465b-9507-0644f567a044 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] PATH_INFO: `/v3/policies/7e8a5de757294c9aa744a7d41722657d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:30.304737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd9c22-71d9-465b-9507-0644f567a044 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=7e8a5de757294c9aa744a7d41722657d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:30.307983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd9c22-71d9-465b-9507-0644f567a044 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:30.312996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bb285-16e1-4020-93d9-e88e7b2c4c15 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:30.318554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099400f-82e0-4399-8e32-818b62974be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:30.319262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099400f-82e0-4399-8e32-818b62974be7 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:30.319669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099400f-82e0-4399-8e32-818b62974be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:30.321323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099400f-82e0-4399-8e32-818b62974be7 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:30.321457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099400f-82e0-4399-8e32-818b62974be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:30.323590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099400f-82e0-4399-8e32-818b62974be7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:30.410022 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2721/5483] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:30 2022] DELETE /identity/v3/policies/7e8a5de757294c9aa744a7d41722657d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:30.411149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd9c22-71d9-465b-9507-0644f567a044 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:30.413132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-03dd9c22-71d9-465b-9507-0644f567a044 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:30.428418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd9c22-71d9-465b-9507-0644f567a044 tempest-PoliciesTestJSON-1352176551 tempest-PoliciesTestJSON-1352176551-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:30.433827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f2ff3-db17-4c13-9964-17d816ded8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:30.434486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f2ff3-db17-4c13-9964-17d816ded8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:30.434768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f2ff3-db17-4c13-9964-17d816ded8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:30.435041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f2ff3-db17-4c13-9964-17d816ded8ae admin admin] PATH_INFO: `/v3/projects/39f97f4919f44ceb81381c2bbb3a67a5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:30.436209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f2ff3-db17-4c13-9964-17d816ded8ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f97f4919f44ceb81381c2bbb3a67a5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:30.438166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f2ff3-db17-4c13-9964-17d816ded8ae admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:30.448281 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2763/5484] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:30 2022] POST /identity/v3/users => generated 287 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:30.449329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099400f-82e0-4399-8e32-818b62974be7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:30.450954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a099400f-82e0-4399-8e32-818b62974be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:30.522532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=13,keystone:SELECT=83,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:30.526354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099400f-82e0-4399-8e32-818b62974be7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:30.531522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4a5ca-0211-4918-9e0a-a206de375184 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:30.532615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4a5ca-0211-4918-9e0a-a206de375184 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:30.532615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4a5ca-0211-4918-9e0a-a206de375184 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:30.533030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4a5ca-0211-4918-9e0a-a206de375184 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:30.533823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4a5ca-0211-4918-9e0a-a206de375184 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:30.536686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4a5ca-0211-4918-9e0a-a206de375184 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:30.595872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5f3f2ff3-db17-4c13-9964-17d816ded8ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f97f4919f44ceb81381c2bbb3a67a5', 'request_id': 'req-5f3f2ff3-db17-4c13-9964-17d816ded8ae'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:30.601725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5f3f2ff3-db17-4c13-9964-17d816ded8ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f97f4919f44ceb81381c2bbb3a67a5', 'request_id': 'req-5f3f2ff3-db17-4c13-9964-17d816ded8ae'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:30.608075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5f3f2ff3-db17-4c13-9964-17d816ded8ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f97f4919f44ceb81381c2bbb3a67a5', 'request_id': 'req-5f3f2ff3-db17-4c13-9964-17d816ded8ae'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:30.722170 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2764/5485] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:51:30 2022] POST /identity/v3/projects => generated 328 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:30.723179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4a5ca-0211-4918-9e0a-a206de375184 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:30.725410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-08a4a5ca-0211-4918-9e0a-a206de375184 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:30.762440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:30.770474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5f3f2ff3-db17-4c13-9964-17d816ded8ae admin admin] The token cache is being invalidate because project 39f97f4919f44ceb81381c2bbb3a67a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:30.770758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5f3f2ff3-db17-4c13-9964-17d816ded8ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:30.771945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5f3f2ff3-db17-4c13-9964-17d816ded8ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:30.777276 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2722/5486] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:30 2022] DELETE /identity/v3/projects/39f97f4919f44ceb81381c2bbb3a67a5 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:30.777276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f2ff3-db17-4c13-9964-17d816ded8ae admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:30.777276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5f3f2ff3-db17-4c13-9964-17d816ded8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:30.800843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4a5ca-0211-4918-9e0a-a206de375184 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:30.810159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36484f-f506-451f-bfa0-13f002420c6e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:30.810846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36484f-f506-451f-bfa0-13f002420c6e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:30.811125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36484f-f506-451f-bfa0-13f002420c6e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:30.811396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36484f-f506-451f-bfa0-13f002420c6e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/projects/818237f556a4495eb0a73c1763a11490/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:30.813759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36484f-f506-451f-bfa0-13f002420c6e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:check_grant(project_id=818237f556a4495eb0a73c1763a11490, group_id=216c77dd281c4b3b8e973dadcea3e611, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:30.816511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36484f-f506-451f-bfa0-13f002420c6e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:30.822842 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2765/5487] 10.222.0.76 () {58 vars in 1468 bytes} [Sat Aug 27 04:51:30 2022] HEAD /identity/v3/projects/818237f556a4495eb0a73c1763a11490/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:30.823673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36484f-f506-451f-bfa0-13f002420c6e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:30.825376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6f36484f-f506-451f-bfa0-13f002420c6e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:30.854263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f2ff3-db17-4c13-9964-17d816ded8ae admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:30.898432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36484f-f506-451f-bfa0-13f002420c6e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:30.921982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea8c87-aa87-4a40-a659-65d8f730ff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:30.921982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea8c87-aa87-4a40-a659-65d8f730ff1d admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:30.921982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea8c87-aa87-4a40-a659-65d8f730ff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:30.921982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea8c87-aa87-4a40-a659-65d8f730ff1d admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:30.922609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea8c87-aa87-4a40-a659-65d8f730ff1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:30.925193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea8c87-aa87-4a40-a659-65d8f730ff1d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:30.926078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e43c7b-1c19-4f80-8c0f-abe9fd7c04a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:30.926736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e43c7b-1c19-4f80-8c0f-abe9fd7c04a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:30.927018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e43c7b-1c19-4f80-8c0f-abe9fd7c04a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:30.927294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e43c7b-1c19-4f80-8c0f-abe9fd7c04a8 admin admin] PATH_INFO: `/v3/users/5ae78681345c4110b11489524f0c03da` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:30.928579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e43c7b-1c19-4f80-8c0f-abe9fd7c04a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae78681345c4110b11489524f0c03da)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:30.931172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e43c7b-1c19-4f80-8c0f-abe9fd7c04a8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:30.943795 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2766/5488] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:30 2022] GET /identity/v3/roles => generated 2324 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:30.943795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea8c87-aa87-4a40-a659-65d8f730ff1d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:30.945851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e9ea8c87-aa87-4a40-a659-65d8f730ff1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:31.032450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea8c87-aa87-4a40-a659-65d8f730ff1d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:31.044347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c585a-b6d5-4834-b8f7-6b4aee5a0019 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:31.045251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c585a-b6d5-4834-b8f7-6b4aee5a0019 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:31.045607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c585a-b6d5-4834-b8f7-6b4aee5a0019 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:31.045955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c585a-b6d5-4834-b8f7-6b4aee5a0019 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:31.046902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c585a-b6d5-4834-b8f7-6b4aee5a0019 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:31.049178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c585a-b6d5-4834-b8f7-6b4aee5a0019 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:31.235705 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2767/5489] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:30 2022] POST /identity/v3/users => generated 413 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:31.236901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c585a-b6d5-4834-b8f7-6b4aee5a0019 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:31.238852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e67c585a-b6d5-4834-b8f7-6b4aee5a0019 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:31.244217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-30e43c7b-1c19-4f80-8c0f-abe9fd7c04a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae78681345c4110b11489524f0c03da'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:31.258781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c585a-b6d5-4834-b8f7-6b4aee5a0019 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:31.264734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec6f83-295e-4a4b-bdd5-2a303aa70942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:31.268621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec6f83-295e-4a4b-bdd5-2a303aa70942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:31.268621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec6f83-295e-4a4b-bdd5-2a303aa70942 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:31.268621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec6f83-295e-4a4b-bdd5-2a303aa70942 admin admin] PATH_INFO: `/v3/users/4d6163303e634aceb43295f887755e15` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:31.268621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec6f83-295e-4a4b-bdd5-2a303aa70942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6163303e634aceb43295f887755e15)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:31.270995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec6f83-295e-4a4b-bdd5-2a303aa70942 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:31.359643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-30e43c7b-1c19-4f80-8c0f-abe9fd7c04a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae78681345c4110b11489524f0c03da'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:31.361210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-30e43c7b-1c19-4f80-8c0f-abe9fd7c04a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae78681345c4110b11489524f0c03da'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:31.370740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-30e43c7b-1c19-4f80-8c0f-abe9fd7c04a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae78681345c4110b11489524f0c03da'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:31.384968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-30e43c7b-1c19-4f80-8c0f-abe9fd7c04a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae78681345c4110b11489524f0c03da'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:31.394207 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2723/5490] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:30 2022] DELETE /identity/v3/users/5ae78681345c4110b11489524f0c03da => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:31.394207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e43c7b-1c19-4f80-8c0f-abe9fd7c04a8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:31.394207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-30e43c7b-1c19-4f80-8c0f-abe9fd7c04a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:31.468879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e43c7b-1c19-4f80-8c0f-abe9fd7c04a8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:31.473895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e09671-456a-4dde-a26f-319177686ead tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:31.478306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e09671-456a-4dde-a26f-319177686ead tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:31.478306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e09671-456a-4dde-a26f-319177686ead tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:31.478306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e09671-456a-4dde-a26f-319177686ead tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/projects/818237f556a4495eb0a73c1763a11490/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:31.479545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e09671-456a-4dde-a26f-319177686ead tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=818237f556a4495eb0a73c1763a11490, group_id=216c77dd281c4b3b8e973dadcea3e611, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:31.482591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e09671-456a-4dde-a26f-319177686ead tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:31.489368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-09e09671-456a-4dde-a26f-319177686ead tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invalidating the token cache because role 959d409c289a4ad1b4ceeea047bb8036 was removed from group 216c77dd281c4b3b8e973dadcea3e611 on project 818237f556a4495eb0a73c1763a11490. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:31.489663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-09e09671-456a-4dde-a26f-319177686ead tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:31.490406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-09e09671-456a-4dde-a26f-319177686ead tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:31.583591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aaec6f83-295e-4a4b-bdd5-2a303aa70942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6163303e634aceb43295f887755e15'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:31.584444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aaec6f83-295e-4a4b-bdd5-2a303aa70942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6163303e634aceb43295f887755e15'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:31.616214 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2724/5491] 10.222.0.76 () {58 vars in 1470 bytes} [Sat Aug 27 04:51:31 2022] DELETE /identity/v3/projects/818237f556a4495eb0a73c1763a11490/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:31.616214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e09671-456a-4dde-a26f-319177686ead tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:31.616214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-09e09671-456a-4dde-a26f-319177686ead tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:31.720724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aaec6f83-295e-4a4b-bdd5-2a303aa70942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6163303e634aceb43295f887755e15'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:31.721510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aaec6f83-295e-4a4b-bdd5-2a303aa70942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6163303e634aceb43295f887755e15'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:31.743435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e09671-456a-4dde-a26f-319177686ead tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:31.743580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aaec6f83-295e-4a4b-bdd5-2a303aa70942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6163303e634aceb43295f887755e15'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:31.751271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264837e-af5a-4a8c-b2f6-e564d612a10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:31.752126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264837e-af5a-4a8c-b2f6-e564d612a10c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:31.752788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264837e-af5a-4a8c-b2f6-e564d612a10c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:31.753254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264837e-af5a-4a8c-b2f6-e564d612a10c admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:31.754074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264837e-af5a-4a8c-b2f6-e564d612a10c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:31.757095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264837e-af5a-4a8c-b2f6-e564d612a10c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:31.773540 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2768/5492] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:31 2022] DELETE /identity/v3/users/4d6163303e634aceb43295f887755e15 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:31.775425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec6f83-295e-4a4b-bdd5-2a303aa70942 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:31.778174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-aaec6f83-295e-4a4b-bdd5-2a303aa70942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:31.795746 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2725/5493] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:31 2022] GET /identity/v3/roles => generated 2324 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:31.804616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f0824-0c9d-427a-bc03-4bc608983ed3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:31.804923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f0824-0c9d-427a-bc03-4bc608983ed3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:31.805167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f0824-0c9d-427a-bc03-4bc608983ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:31.842844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c29f0824-0c9d-427a-bc03-4bc608983ed3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:31.844713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c29f0824-0c9d-427a-bc03-4bc608983ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:31.873452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec6f83-295e-4a4b-bdd5-2a303aa70942 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:31.879722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3998a27-5c16-475f-b2be-7ce83031d9ac tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:31.884401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3998a27-5c16-475f-b2be-7ce83031d9ac tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:31.884401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3998a27-5c16-475f-b2be-7ce83031d9ac tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:31.884401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3998a27-5c16-475f-b2be-7ce83031d9ac tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:31.884401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3998a27-5c16-475f-b2be-7ce83031d9ac tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:31.884401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3998a27-5c16-475f-b2be-7ce83031d9ac tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:31.919809 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2726/5494] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:31.923714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f0824-0c9d-427a-bc03-4bc608983ed3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:31.923714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c29f0824-0c9d-427a-bc03-4bc608983ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:31.994293 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2769/5495] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:51:31 2022] POST /identity/v3/roles => generated 243 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:31.995127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3998a27-5c16-475f-b2be-7ce83031d9ac tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:32.000544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e3998a27-5c16-475f-b2be-7ce83031d9ac tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:32.019863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3998a27-5c16-475f-b2be-7ce83031d9ac tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:32.027001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fe1af-cd0d-4ba4-b8d8-6fd000d95791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:32.027891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fe1af-cd0d-4ba4-b8d8-6fd000d95791 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:32.028342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fe1af-cd0d-4ba4-b8d8-6fd000d95791 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:32.028618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fe1af-cd0d-4ba4-b8d8-6fd000d95791 admin admin] PATH_INFO: `/v3/projects/6ce726174f1e4e6987c3110c9e2e762f/users/3b896f18403b49d99fcb0171b5e501ef/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:32.047705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f0824-0c9d-427a-bc03-4bc608983ed3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:32.053004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73beee-00d0-4804-98b2-865aff3f98d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:32.055993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73beee-00d0-4804-98b2-865aff3f98d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:32.055993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73beee-00d0-4804-98b2-865aff3f98d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:32.056276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fe1af-cd0d-4ba4-b8d8-6fd000d95791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce726174f1e4e6987c3110c9e2e762f, user_id=3b896f18403b49d99fcb0171b5e501ef, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:32.056402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73beee-00d0-4804-98b2-865aff3f98d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/groups/216c77dd281c4b3b8e973dadcea3e611/users/0a48539c987b4f988709d51f673cda2d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:32.057254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73beee-00d0-4804-98b2-865aff3f98d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=216c77dd281c4b3b8e973dadcea3e611, user_id=0a48539c987b4f988709d51f673cda2d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:32.058285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fe1af-cd0d-4ba4-b8d8-6fd000d95791 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:32.059564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73beee-00d0-4804-98b2-865aff3f98d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:32.190955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc73beee-00d0-4804-98b2-865aff3f98d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0a48539c987b4f988709d51f673cda2d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:32.200415 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2770/5496] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:31 2022] PUT /identity/v3/projects/6ce726174f1e4e6987c3110c9e2e762f/users/3b896f18403b49d99fcb0171b5e501ef/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:32.202266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fe1af-cd0d-4ba4-b8d8-6fd000d95791 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:32.205555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6b9fe1af-cd0d-4ba4-b8d8-6fd000d95791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:32.324080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fe1af-cd0d-4ba4-b8d8-6fd000d95791 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:32.324416 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2727/5497] 10.222.0.76 () {58 vars in 1344 bytes} [Sat Aug 27 04:51:31 2022] DELETE /identity/v3/groups/216c77dd281c4b3b8e973dadcea3e611/users/0a48539c987b4f988709d51f673cda2d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:32.325246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73beee-00d0-4804-98b2-865aff3f98d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:32.420286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73beee-00d0-4804-98b2-865aff3f98d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:32.425305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f602d57-14ce-498e-84b4-ebf121aea290 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:32.426015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f602d57-14ce-498e-84b4-ebf121aea290 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:32.426308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f602d57-14ce-498e-84b4-ebf121aea290 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:32.427217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f602d57-14ce-498e-84b4-ebf121aea290 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:32.428445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f602d57-14ce-498e-84b4-ebf121aea290 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:32.430474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f602d57-14ce-498e-84b4-ebf121aea290 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:32.474663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de93565-8a05-4cb2-9361-8672ec3c141e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:32.475296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de93565-8a05-4cb2-9361-8672ec3c141e service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:32.475629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de93565-8a05-4cb2-9361-8672ec3c141e service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:32.476564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de93565-8a05-4cb2-9361-8672ec3c141e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:32.567819 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2728/5498] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:51:32 2022] POST /identity/v3/roles => generated 247 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:32.570303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9deb8-49b0-4134-875c-46a5c908dc66 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:32.570715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9deb8-49b0-4134-875c-46a5c908dc66 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:32.571304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9deb8-49b0-4134-875c-46a5c908dc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:32.607975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-92b9deb8-49b0-4134-875c-46a5c908dc66 None None] MFA Rules not processed for user `3b896f18403b49d99fcb0171b5e501ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:32.608791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de93565-8a05-4cb2-9361-8672ec3c141e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:32.610069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-92b9deb8-49b0-4134-875c-46a5c908dc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:32.610867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de93565-8a05-4cb2-9361-8672ec3c141e service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:32.625238 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2771/5499] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:32.627232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de93565-8a05-4cb2-9361-8672ec3c141e service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:32.724556 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2729/5500] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:32.725352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9deb8-49b0-4134-875c-46a5c908dc66 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:32.743641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9deb8-49b0-4134-875c-46a5c908dc66 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:32.750545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada052eb-1e5f-4a3a-933f-0450a03ed20a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:32.751236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada052eb-1e5f-4a3a-933f-0450a03ed20a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:32.751588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada052eb-1e5f-4a3a-933f-0450a03ed20a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:32.752008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada052eb-1e5f-4a3a-933f-0450a03ed20a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/e2b595b4e073485fa78857d395fb7b58/users/85d364c69a314f518bcbb08c940ed2ae/roles/d8ee21c66afd46a1a943c713bc4bcf66` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:32.783049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de93565-8a05-4cb2-9361-8672ec3c141e service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:32.785369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada052eb-1e5f-4a3a-933f-0450a03ed20a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e2b595b4e073485fa78857d395fb7b58, user_id=85d364c69a314f518bcbb08c940ed2ae, role_id=d8ee21c66afd46a1a943c713bc4bcf66)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:32.789365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada052eb-1e5f-4a3a-933f-0450a03ed20a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:32.794565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052f973-28bd-4354-836f-087ad24f59e1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:32.794881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052f973-28bd-4354-836f-087ad24f59e1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:32.795167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052f973-28bd-4354-836f-087ad24f59e1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:32.795445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052f973-28bd-4354-836f-087ad24f59e1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/system/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:32.797208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052f973-28bd-4354-836f-087ad24f59e1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=216c77dd281c4b3b8e973dadcea3e611, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:32.798257 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-4052f973-28bd-4354-836f-087ad24f59e1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:32.798257 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:32.798257 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:32.799147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052f973-28bd-4354-836f-087ad24f59e1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:32.908787 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2730/5501] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:32 2022] PUT /identity/v3/projects/e2b595b4e073485fa78857d395fb7b58/users/85d364c69a314f518bcbb08c940ed2ae/roles/d8ee21c66afd46a1a943c713bc4bcf66 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:32.910022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada052eb-1e5f-4a3a-933f-0450a03ed20a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:32.915934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ada052eb-1e5f-4a3a-933f-0450a03ed20a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:32.946503 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2772/5502] 10.222.0.76 () {60 vars in 1381 bytes} [Sat Aug 27 04:51:32 2022] PUT /identity/v3/system/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:32.949010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052f973-28bd-4354-836f-087ad24f59e1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:32.952615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:32.952834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4052f973-28bd-4354-836f-087ad24f59e1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:32.971064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052f973-28bd-4354-836f-087ad24f59e1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:33.033677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ff6c4-5510-4781-a929-c005ce480a39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:33.034971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ff6c4-5510-4781-a929-c005ce480a39 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:33.034971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ff6c4-5510-4781-a929-c005ce480a39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:33.034971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ff6c4-5510-4781-a929-c005ce480a39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:33.041313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada052eb-1e5f-4a3a-933f-0450a03ed20a tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:33.046806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c150343-1165-425b-96dc-c6d072ca7385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:33.047915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c150343-1165-425b-96dc-c6d072ca7385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:33.048413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c150343-1165-425b-96dc-c6d072ca7385 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:33.048849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c150343-1165-425b-96dc-c6d072ca7385 admin admin] PATH_INFO: `/v3/projects/e9d908cf094d454891d2e52617f620e3` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:33.050386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c150343-1165-425b-96dc-c6d072ca7385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d908cf094d454891d2e52617f620e3)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:33.053006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c150343-1165-425b-96dc-c6d072ca7385 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:33.113276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ff6c4-5510-4781-a929-c005ce480a39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:33.114882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ff6c4-5510-4781-a929-c005ce480a39 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:33.126384 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2773/5503] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:33.126969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ff6c4-5510-4781-a929-c005ce480a39 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:33.219589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6c150343-1165-425b-96dc-c6d072ca7385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d908cf094d454891d2e52617f620e3', 'request_id': 'req-6c150343-1165-425b-96dc-c6d072ca7385'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:33.240481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6c150343-1165-425b-96dc-c6d072ca7385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d908cf094d454891d2e52617f620e3', 'request_id': 'req-6c150343-1165-425b-96dc-c6d072ca7385'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:33.250466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6c150343-1165-425b-96dc-c6d072ca7385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d908cf094d454891d2e52617f620e3', 'request_id': 'req-6c150343-1165-425b-96dc-c6d072ca7385'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:33.270294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ff6c4-5510-4781-a929-c005ce480a39 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:33.305952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:33.353056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8c7ee-31f3-495d-83a3-812b3c7e6ea4 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:33.353790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8c7ee-31f3-495d-83a3-812b3c7e6ea4 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:33.354104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8c7ee-31f3-495d-83a3-812b3c7e6ea4 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:33.355207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8c7ee-31f3-495d-83a3-812b3c7e6ea4 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/e2b595b4e073485fa78857d395fb7b58/users/85d364c69a314f518bcbb08c940ed2ae/roles/16d14b1d363b4f12b9b5b782b3f4aeb9` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:33.357004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8c7ee-31f3-495d-83a3-812b3c7e6ea4 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e2b595b4e073485fa78857d395fb7b58, user_id=85d364c69a314f518bcbb08c940ed2ae, role_id=16d14b1d363b4f12b9b5b782b3f4aeb9)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:33.359722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8c7ee-31f3-495d-83a3-812b3c7e6ea4 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:33.389824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6c150343-1165-425b-96dc-c6d072ca7385 admin admin] The token cache is being invalidate because project e9d908cf094d454891d2e52617f620e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:33.390314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6c150343-1165-425b-96dc-c6d072ca7385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:33.390905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6c150343-1165-425b-96dc-c6d072ca7385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:33.392760 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2731/5504] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:32 2022] DELETE /identity/v3/projects/e9d908cf094d454891d2e52617f620e3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:33.393456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c150343-1165-425b-96dc-c6d072ca7385 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:33.394930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6c150343-1165-425b-96dc-c6d072ca7385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:33.481165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c150343-1165-425b-96dc-c6d072ca7385 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:33.487108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4526d20-6132-47a0-8787-5c1cfa484ac3 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:33.487828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4526d20-6132-47a0-8787-5c1cfa484ac3 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:33.488362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4526d20-6132-47a0-8787-5c1cfa484ac3 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:33.488716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4526d20-6132-47a0-8787-5c1cfa484ac3 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/system/groups/216c77dd281c4b3b8e973dadcea3e611/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:33.490513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4526d20-6132-47a0-8787-5c1cfa484ac3 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=216c77dd281c4b3b8e973dadcea3e611)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:33.491779 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-e4526d20-6132-47a0-8787-5c1cfa484ac3 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:33.491779 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:33.491779 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:33.493041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4526d20-6132-47a0-8787-5c1cfa484ac3 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:33.509004 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2732/5505] 10.222.0.76 () {58 vars in 1263 bytes} [Sat Aug 27 04:51:33 2022] GET /identity/v3/system/groups/216c77dd281c4b3b8e973dadcea3e611/roles => generated 376 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:33.509004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81deecd-0cdd-4ab5-ad77-53864e27e004 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:33.520821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81deecd-0cdd-4ab5-ad77-53864e27e004 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:33.520821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81deecd-0cdd-4ab5-ad77-53864e27e004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:33.521020 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2774/5506] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:33 2022] PUT /identity/v3/projects/e2b595b4e073485fa78857d395fb7b58/users/85d364c69a314f518bcbb08c940ed2ae/roles/16d14b1d363b4f12b9b5b782b3f4aeb9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:33.521248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8c7ee-31f3-495d-83a3-812b3c7e6ea4 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:33.537150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b81deecd-0cdd-4ab5-ad77-53864e27e004 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:33.539029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b81deecd-0cdd-4ab5-ad77-53864e27e004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:33.597784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8c7ee-31f3-495d-83a3-812b3c7e6ea4 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:33.614652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eeed17-5468-4c4e-8edc-b8cb42222d52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:33.615395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eeed17-5468-4c4e-8edc-b8cb42222d52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:33.615683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eeed17-5468-4c4e-8edc-b8cb42222d52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:33.615960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eeed17-5468-4c4e-8edc-b8cb42222d52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/system/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:33.618270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eeed17-5468-4c4e-8edc-b8cb42222d52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=216c77dd281c4b3b8e973dadcea3e611, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:33.628283 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-02eeed17-5468-4c4e-8edc-b8cb42222d52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:33.628283 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:33.628283 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:33.628283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eeed17-5468-4c4e-8edc-b8cb42222d52 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:33.636505 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2733/5507] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:33.637448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81deecd-0cdd-4ab5-ad77-53864e27e004 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:33.645031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b81deecd-0cdd-4ab5-ad77-53864e27e004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:33.649127 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2775/5508] 10.222.0.76 () {58 vars in 1363 bytes} [Sat Aug 27 04:51:33 2022] HEAD /identity/v3/system/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:33.651546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a0667-f184-4a1f-bb36-b5af9165c1ee None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:33.652342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a0667-f184-4a1f-bb36-b5af9165c1ee None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:33.652723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a0667-f184-4a1f-bb36-b5af9165c1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:33.705496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e21a0667-f184-4a1f-bb36-b5af9165c1ee None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:33.706893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e21a0667-f184-4a1f-bb36-b5af9165c1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:33.719975 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2776/5509] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:33.720998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a0667-f184-4a1f-bb36-b5af9165c1ee None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:33.735064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a0667-f184-4a1f-bb36-b5af9165c1ee None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:33.741777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d11c0c-4a7a-4a85-a20f-8e8820fcbc55 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:33.742636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d11c0c-4a7a-4a85-a20f-8e8820fcbc55 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:33.743204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d11c0c-4a7a-4a85-a20f-8e8820fcbc55 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:33.743499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d11c0c-4a7a-4a85-a20f-8e8820fcbc55 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/system/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:33.748140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d11c0c-4a7a-4a85-a20f-8e8820fcbc55 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=216c77dd281c4b3b8e973dadcea3e611, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:33.749325 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-87d11c0c-4a7a-4a85-a20f-8e8820fcbc55 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:33.749325 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:33.749325 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:33.750488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d11c0c-4a7a-4a85-a20f-8e8820fcbc55 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:33.765856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81deecd-0cdd-4ab5-ad77-53864e27e004 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:33.777650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69002b2-ffb3-494c-b7bf-3e3ddfc8da59 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:33.778919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69002b2-ffb3-494c-b7bf-3e3ddfc8da59 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:33.779597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69002b2-ffb3-494c-b7bf-3e3ddfc8da59 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:33.780215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69002b2-ffb3-494c-b7bf-3e3ddfc8da59 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:33.781610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69002b2-ffb3-494c-b7bf-3e3ddfc8da59 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:33.785183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69002b2-ffb3-494c-b7bf-3e3ddfc8da59 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:33.820188 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2734/5510] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:33 2022] GET /identity/v3/users => generated 8463 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:33.820953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69002b2-ffb3-494c-b7bf-3e3ddfc8da59 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:33.834996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69002b2-ffb3-494c-b7bf-3e3ddfc8da59 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:33.841687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531ede0-6373-4747-9ac3-da232933a941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:33.842308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531ede0-6373-4747-9ac3-da232933a941 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:33.842590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531ede0-6373-4747-9ac3-da232933a941 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:33.842865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531ede0-6373-4747-9ac3-da232933a941 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:33.843633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531ede0-6373-4747-9ac3-da232933a941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:33.843827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531ede0-6373-4747-9ac3-da232933a941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:33.845723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531ede0-6373-4747-9ac3-da232933a941 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:33.864600 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2735/5511] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:33.867181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f462f9-e4c9-498a-b174-bc58f202f6ee None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:33.867601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f462f9-e4c9-498a-b174-bc58f202f6ee None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:33.868076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f462f9-e4c9-498a-b174-bc58f202f6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:33.881305 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2777/5512] 10.222.0.76 () {58 vars in 1365 bytes} [Sat Aug 27 04:51:33 2022] DELETE /identity/v3/system/groups/216c77dd281c4b3b8e973dadcea3e611/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:33.883607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d11c0c-4a7a-4a85-a20f-8e8820fcbc55 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:33.907377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d11c0c-4a7a-4a85-a20f-8e8820fcbc55 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:33.915365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431c989-42b9-4594-a1a3-16a2d6124781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:33.915996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431c989-42b9-4594-a1a3-16a2d6124781 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:33.916320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431c989-42b9-4594-a1a3-16a2d6124781 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:33.916608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431c989-42b9-4594-a1a3-16a2d6124781 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:33.917229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431c989-42b9-4594-a1a3-16a2d6124781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:33.919276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431c989-42b9-4594-a1a3-16a2d6124781 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:33.934969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b8f462f9-e4c9-498a-b174-bc58f202f6ee None None] MFA Rules not processed for user `85d364c69a314f518bcbb08c940ed2ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:33.937891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b8f462f9-e4c9-498a-b174-bc58f202f6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:34.029019 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2778/5513] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:33 2022] POST /identity/v3/projects => generated 363 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:34.029019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431c989-42b9-4594-a1a3-16a2d6124781 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:34.044989 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2736/5514] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:33 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:34.046096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f462f9-e4c9-498a-b174-bc58f202f6ee None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:34.047605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b8f462f9-e4c9-498a-b174-bc58f202f6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:34.071056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f462f9-e4c9-498a-b174-bc58f202f6ee None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:34.141031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431c989-42b9-4594-a1a3-16a2d6124781 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:34.146028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f732e3-8aef-48a4-bd1e-f3800c62f56b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:34.147129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f732e3-8aef-48a4-bd1e-f3800c62f56b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:34.148569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f732e3-8aef-48a4-bd1e-f3800c62f56b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:34.148952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f732e3-8aef-48a4-bd1e-f3800c62f56b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/domains/3c5b393f88604e94a0608ded33678f83/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:34.151908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f732e3-8aef-48a4-bd1e-f3800c62f56b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3c5b393f88604e94a0608ded33678f83, user_id=0a48539c987b4f988709d51f673cda2d, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:34.160357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f732e3-8aef-48a4-bd1e-f3800c62f56b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:34.169369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cde00b-cceb-4cfb-99ac-d5dcaa232e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:34.170293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cde00b-cceb-4cfb-99ac-d5dcaa232e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:34.170571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cde00b-cceb-4cfb-99ac-d5dcaa232e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:34.170843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cde00b-cceb-4cfb-99ac-d5dcaa232e6f admin admin] PATH_INFO: `/v3/projects/1a37fc9cd3c148b58ace5a410df2a8bb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:34.172058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cde00b-cceb-4cfb-99ac-d5dcaa232e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a37fc9cd3c148b58ace5a410df2a8bb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:34.174080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cde00b-cceb-4cfb-99ac-d5dcaa232e6f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:34.257990 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2779/5515] 10.222.0.76 () {60 vars in 1480 bytes} [Sat Aug 27 04:51:34 2022] PUT /identity/v3/domains/3c5b393f88604e94a0608ded33678f83/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:34.257990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f732e3-8aef-48a4-bd1e-f3800c62f56b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:34.327881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f732e3-8aef-48a4-bd1e-f3800c62f56b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:34.337206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a6cde00b-cceb-4cfb-99ac-d5dcaa232e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a37fc9cd3c148b58ace5a410df2a8bb', 'request_id': 'req-a6cde00b-cceb-4cfb-99ac-d5dcaa232e6f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:34.343439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a6cde00b-cceb-4cfb-99ac-d5dcaa232e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a37fc9cd3c148b58ace5a410df2a8bb', 'request_id': 'req-a6cde00b-cceb-4cfb-99ac-d5dcaa232e6f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:34.350041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a6cde00b-cceb-4cfb-99ac-d5dcaa232e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a37fc9cd3c148b58ace5a410df2a8bb', 'request_id': 'req-a6cde00b-cceb-4cfb-99ac-d5dcaa232e6f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:34.417232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54010865-347c-4283-bd98-72848394c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:34.417476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54010865-347c-4283-bd98-72848394c0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:34.422840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54010865-347c-4283-bd98-72848394c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:34.422840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54010865-347c-4283-bd98-72848394c0c1 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:34.422840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54010865-347c-4283-bd98-72848394c0c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:34.422840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54010865-347c-4283-bd98-72848394c0c1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:34.482703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a6cde00b-cceb-4cfb-99ac-d5dcaa232e6f admin admin] The token cache is being invalidate because project 1a37fc9cd3c148b58ace5a410df2a8bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:34.484192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a6cde00b-cceb-4cfb-99ac-d5dcaa232e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:34.485988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a6cde00b-cceb-4cfb-99ac-d5dcaa232e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:34.487443 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2737/5516] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:34 2022] DELETE /identity/v3/projects/1a37fc9cd3c148b58ace5a410df2a8bb => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:34.489151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed5589-7016-4b00-bccd-98939bb687d6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:34.489576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed5589-7016-4b00-bccd-98939bb687d6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:34.490634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed5589-7016-4b00-bccd-98939bb687d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:34.521669 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2780/5517] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:34 2022] POST /identity/v3/users => generated 282 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:34.523903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54010865-347c-4283-bd98-72848394c0c1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:34.526985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-54010865-347c-4283-bd98-72848394c0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:34.534611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6eed5589-7016-4b00-bccd-98939bb687d6 None None] MFA Rules not processed for user `85d364c69a314f518bcbb08c940ed2ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:34.540924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6eed5589-7016-4b00-bccd-98939bb687d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:34.664569 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2738/5518] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:34 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:34.664569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed5589-7016-4b00-bccd-98939bb687d6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:34.664569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6eed5589-7016-4b00-bccd-98939bb687d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:34.683240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54010865-347c-4283-bd98-72848394c0c1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:34.691229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40face0-ae59-4114-9170-00d35cceaed9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:34.692498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40face0-ae59-4114-9170-00d35cceaed9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:34.692498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40face0-ae59-4114-9170-00d35cceaed9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:34.692733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40face0-ae59-4114-9170-00d35cceaed9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/domains/3c5b393f88604e94a0608ded33678f83/users/0a48539c987b4f988709d51f673cda2d/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:34.693336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed5589-7016-4b00-bccd-98939bb687d6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:34.696079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40face0-ae59-4114-9170-00d35cceaed9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=3c5b393f88604e94a0608ded33678f83, user_id=0a48539c987b4f988709d51f673cda2d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:34.700866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40face0-ae59-4114-9170-00d35cceaed9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:34.706711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7366be-714f-4b30-ae16-865a8d06cccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:34.707366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7366be-714f-4b30-ae16-865a8d06cccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:34.707689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7366be-714f-4b30-ae16-865a8d06cccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:34.707923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7366be-714f-4b30-ae16-865a8d06cccb admin admin] PATH_INFO: `/v3/users/01d9aa87e19741058bff0c29c368e724` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:34.709111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7366be-714f-4b30-ae16-865a8d06cccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=01d9aa87e19741058bff0c29c368e724)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:34.712223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7366be-714f-4b30-ae16-865a8d06cccb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:34.732698 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2781/5519] 10.222.0.76 () {58 vars in 1362 bytes} [Sat Aug 27 04:51:34 2022] GET /identity/v3/domains/3c5b393f88604e94a0608ded33678f83/users/0a48539c987b4f988709d51f673cda2d/roles => generated 409 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:34.733627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40face0-ae59-4114-9170-00d35cceaed9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:34.735524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a40face0-ae59-4114-9170-00d35cceaed9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:34.751037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40face0-ae59-4114-9170-00d35cceaed9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:34.758949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c436cd7-6f0a-41bb-90b5-1392968963a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:34.759591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436cd7-6f0a-41bb-90b5-1392968963a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:34.759871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436cd7-6f0a-41bb-90b5-1392968963a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:34.760143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436cd7-6f0a-41bb-90b5-1392968963a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:34.760824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c436cd7-6f0a-41bb-90b5-1392968963a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:34.762555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c436cd7-6f0a-41bb-90b5-1392968963a7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:34.784020 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2782/5520] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:34 2022] GET /identity/v3/roles => generated 2796 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:34.785134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c436cd7-6f0a-41bb-90b5-1392968963a7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:34.804867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c436cd7-6f0a-41bb-90b5-1392968963a7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:34.825080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e8c43-7750-4e9a-89cb-cf522fc637b3 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85d364c69a314f518bcbb08c940ed2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b595b4e073485fa78857d395fb7b58', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781932943', 'tempest-DelegatedRole-413867460'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:34.825080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e8c43-7750-4e9a-89cb-cf522fc637b3 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:34.825080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e8c43-7750-4e9a-89cb-cf522fc637b3 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:34.825536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e8c43-7750-4e9a-89cb-cf522fc637b3 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:34.825536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e8c43-7750-4e9a-89cb-cf522fc637b3 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: Authorizing `identity:create_trust()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:34.826456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e8c43-7750-4e9a-89cb-cf522fc637b3 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:35.141513 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2783/5521] 10.222.0.76 () {60 vars in 1174 bytes} [Sat Aug 27 04:51:34 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:35.143085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e8c43-7750-4e9a-89cb-cf522fc637b3 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:35.148844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc7366be-714f-4b30-ae16-865a8d06cccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01d9aa87e19741058bff0c29c368e724'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:35.158538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e8c43-7750-4e9a-89cb-cf522fc637b3 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:35.167383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8b911-9e47-437f-93ac-3ea479520763 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:35.167383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8b911-9e47-437f-93ac-3ea479520763 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:35.167383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8b911-9e47-437f-93ac-3ea479520763 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:35.167707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8b911-9e47-437f-93ac-3ea479520763 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/domains/3c5b393f88604e94a0608ded33678f83/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:35.169806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8b911-9e47-437f-93ac-3ea479520763 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=3c5b393f88604e94a0608ded33678f83, user_id=0a48539c987b4f988709d51f673cda2d, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:35.172497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8b911-9e47-437f-93ac-3ea479520763 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:35.183590 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2784/5522] 10.222.0.76 () {58 vars in 1462 bytes} [Sat Aug 27 04:51:35 2022] HEAD /identity/v3/domains/3c5b393f88604e94a0608ded33678f83/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:35.183590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8b911-9e47-437f-93ac-3ea479520763 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:35.198119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8b911-9e47-437f-93ac-3ea479520763 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:35.204146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00a6bc-bc86-40e8-a23f-d0039438df21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:35.208982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00a6bc-bc86-40e8-a23f-d0039438df21 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:35.208982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00a6bc-bc86-40e8-a23f-d0039438df21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:35.208982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00a6bc-bc86-40e8-a23f-d0039438df21 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:35.208982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00a6bc-bc86-40e8-a23f-d0039438df21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:35.208982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00a6bc-bc86-40e8-a23f-d0039438df21 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:35.228837 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2785/5523] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:35 2022] GET /identity/v3/roles => generated 2796 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:35.232260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00a6bc-bc86-40e8-a23f-d0039438df21 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:35.249691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00a6bc-bc86-40e8-a23f-d0039438df21 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:35.252345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc7366be-714f-4b30-ae16-865a8d06cccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01d9aa87e19741058bff0c29c368e724'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:35.254080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc7366be-714f-4b30-ae16-865a8d06cccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01d9aa87e19741058bff0c29c368e724'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:35.263456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc7366be-714f-4b30-ae16-865a8d06cccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01d9aa87e19741058bff0c29c368e724'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:35.268365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bb5e6-ccdc-4359-a35d-8553c5ca7f1d tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85d364c69a314f518bcbb08c940ed2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b595b4e073485fa78857d395fb7b58', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781932943', 'tempest-DelegatedRole-413867460'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:35.269915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bb5e6-ccdc-4359-a35d-8553c5ca7f1d tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:35.270395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bb5e6-ccdc-4359-a35d-8553c5ca7f1d tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:35.272234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bb5e6-ccdc-4359-a35d-8553c5ca7f1d tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] PATH_INFO: `/v3/OS-TRUST/trusts/58ea9d98ac68484b85011b8821643884` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:35.292515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bb5e6-ccdc-4359-a35d-8553c5ca7f1d tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: Authorizing `identity:get_trust(trust_id=58ea9d98ac68484b85011b8821643884)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:35.293364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cc7366be-714f-4b30-ae16-865a8d06cccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01d9aa87e19741058bff0c29c368e724'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:35.297267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bb5e6-ccdc-4359-a35d-8553c5ca7f1d tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:35.314614 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2786/5525] 10.222.0.76 () {58 vars in 1251 bytes} [Sat Aug 27 04:51:35 2022] GET /identity/v3/OS-TRUST/trusts/58ea9d98ac68484b85011b8821643884 => generated 834 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:35.314614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bb5e6-ccdc-4359-a35d-8553c5ca7f1d tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:35.314858 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2739/5525] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:34 2022] DELETE /identity/v3/users/01d9aa87e19741058bff0c29c368e724 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:35.314858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7366be-714f-4b30-ae16-865a8d06cccb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:35.318261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3c3bb5e6-ccdc-4359-a35d-8553c5ca7f1d tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:35.321519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cc7366be-714f-4b30-ae16-865a8d06cccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:35.335771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:35.341030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bb5e6-ccdc-4359-a35d-8553c5ca7f1d tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:35.439718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:35.447124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7366be-714f-4b30-ae16-865a8d06cccb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:35.453665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6521e35-a4db-47ca-8fad-5f55b82f3b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:35.454343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6521e35-a4db-47ca-8fad-5f55b82f3b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:35.454627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6521e35-a4db-47ca-8fad-5f55b82f3b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:35.454903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6521e35-a4db-47ca-8fad-5f55b82f3b3c admin admin] PATH_INFO: `/v3/projects/38aa11ca93314ca19452cc1da639b047/users/62e2379d8bb04dd0ac269cf52527f51a/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:35.460604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496800c-6c98-47ac-b186-d1db36b2966f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:35.461757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496800c-6c98-47ac-b186-d1db36b2966f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:35.462221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496800c-6c98-47ac-b186-d1db36b2966f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:35.462677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496800c-6c98-47ac-b186-d1db36b2966f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/domains/3c5b393f88604e94a0608ded33678f83/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:35.465405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496800c-6c98-47ac-b186-d1db36b2966f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3c5b393f88604e94a0608ded33678f83, user_id=0a48539c987b4f988709d51f673cda2d, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:35.469170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496800c-6c98-47ac-b186-d1db36b2966f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:35.478484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6521e35-a4db-47ca-8fad-5f55b82f3b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38aa11ca93314ca19452cc1da639b047, user_id=62e2379d8bb04dd0ac269cf52527f51a, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:35.482107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6521e35-a4db-47ca-8fad-5f55b82f3b3c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:35.488828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1496800c-6c98-47ac-b186-d1db36b2966f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invalidating the token cache because role 959d409c289a4ad1b4ceeea047bb8036 was removed from user 0a48539c987b4f988709d51f673cda2d on domain 3c5b393f88604e94a0608ded33678f83. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:35.489132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1496800c-6c98-47ac-b186-d1db36b2966f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:35.489893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1496800c-6c98-47ac-b186-d1db36b2966f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:35.600144 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2740/5526] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:35 2022] PUT /identity/v3/projects/38aa11ca93314ca19452cc1da639b047/users/62e2379d8bb04dd0ac269cf52527f51a/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:35.602111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6521e35-a4db-47ca-8fad-5f55b82f3b3c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:35.611942 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2787/5527] 10.222.0.76 () {58 vars in 1464 bytes} [Sat Aug 27 04:51:35 2022] DELETE /identity/v3/domains/3c5b393f88604e94a0608ded33678f83/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:35.613553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734373f-569b-4072-a9b4-8543324a0772 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:35.613905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734373f-569b-4072-a9b4-8543324a0772 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:35.614240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734373f-569b-4072-a9b4-8543324a0772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:35.618536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f6521e35-a4db-47ca-8fad-5f55b82f3b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:35.661030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c734373f-569b-4072-a9b4-8543324a0772 None None] MFA Rules not processed for user `62e2379d8bb04dd0ac269cf52527f51a`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:35.664282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c734373f-569b-4072-a9b4-8543324a0772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:35.733121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6521e35-a4db-47ca-8fad-5f55b82f3b3c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:35.756297 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2788/5528] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:35.756297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734373f-569b-4072-a9b4-8543324a0772 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:35.762781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c734373f-569b-4072-a9b4-8543324a0772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:35.809083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b388d-ff01-4864-910a-2d90a51dcddb tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85d364c69a314f518bcbb08c940ed2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b595b4e073485fa78857d395fb7b58', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781932943', 'tempest-DelegatedRole-413867460'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:35.809745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b388d-ff01-4864-910a-2d90a51dcddb tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:35.810022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b388d-ff01-4864-910a-2d90a51dcddb tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:35.810976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b388d-ff01-4864-910a-2d90a51dcddb tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] PATH_INFO: `/v3/OS-TRUST/trusts/58ea9d98ac68484b85011b8821643884/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:35.822502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b388d-ff01-4864-910a-2d90a51dcddb tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=58ea9d98ac68484b85011b8821643884)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:35.823384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b388d-ff01-4864-910a-2d90a51dcddb tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:35.842655 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2741/5529] 10.222.0.76 () {58 vars in 1269 bytes} [Sat Aug 27 04:51:35 2022] GET /identity/v3/OS-TRUST/trusts/58ea9d98ac68484b85011b8821643884/roles => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:35.842655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b388d-ff01-4864-910a-2d90a51dcddb tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:35.844947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9c6b388d-ff01-4864-910a-2d90a51dcddb tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:35.868765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734373f-569b-4072-a9b4-8543324a0772 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:35.875115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22c2a6-4e26-4a5d-9b30-ed52a56cd8c5 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:35.876929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22c2a6-4e26-4a5d-9b30-ed52a56cd8c5 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:35.877223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22c2a6-4e26-4a5d-9b30-ed52a56cd8c5 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:35.877507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22c2a6-4e26-4a5d-9b30-ed52a56cd8c5 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/projects/818237f556a4495eb0a73c1763a11490/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:35.880245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22c2a6-4e26-4a5d-9b30-ed52a56cd8c5 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_grant(project_id=818237f556a4495eb0a73c1763a11490, user_id=0a48539c987b4f988709d51f673cda2d, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:35.885834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22c2a6-4e26-4a5d-9b30-ed52a56cd8c5 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:35.940653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b388d-ff01-4864-910a-2d90a51dcddb tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:35.946055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc93a50-e29f-4092-87b5-d20a21ec68bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:35.946772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc93a50-e29f-4092-87b5-d20a21ec68bc service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:35.947174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc93a50-e29f-4092-87b5-d20a21ec68bc service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:35.947566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc93a50-e29f-4092-87b5-d20a21ec68bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:35.959247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc93a50-e29f-4092-87b5-d20a21ec68bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:35.961674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc93a50-e29f-4092-87b5-d20a21ec68bc service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:35.971489 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2742/5530] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:35.972571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc93a50-e29f-4092-87b5-d20a21ec68bc service glance] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:35.984615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc93a50-e29f-4092-87b5-d20a21ec68bc service glance] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:35.989273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c6220-6e71-463d-9cf5-618a3071d4aa tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85d364c69a314f518bcbb08c940ed2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b595b4e073485fa78857d395fb7b58', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781932943', 'tempest-DelegatedRole-413867460'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:35.990700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c6220-6e71-463d-9cf5-618a3071d4aa tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:35.990700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c6220-6e71-463d-9cf5-618a3071d4aa tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:35.990962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c6220-6e71-463d-9cf5-618a3071d4aa tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] PATH_INFO: `/v3/OS-TRUST/trusts/58ea9d98ac68484b85011b8821643884/roles/d8ee21c66afd46a1a943c713bc4bcf66` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:35.999681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c6220-6e71-463d-9cf5-618a3071d4aa tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: Authorizing `identity:get_role_for_trust(trust_id=58ea9d98ac68484b85011b8821643884, role_id=d8ee21c66afd46a1a943c713bc4bcf66)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:36.001868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c6220-6e71-463d-9cf5-618a3071d4aa tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:36.016361 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2743/5531] 10.222.0.76 () {58 vars in 1368 bytes} [Sat Aug 27 04:51:35 2022] GET /identity/v3/OS-TRUST/trusts/58ea9d98ac68484b85011b8821643884/roles/d8ee21c66afd46a1a943c713bc4bcf66 => generated 243 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:36.017965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c6220-6e71-463d-9cf5-618a3071d4aa tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:36.020707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-789c6220-6e71-463d-9cf5-618a3071d4aa tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:36.038616 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2789/5532] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:35 2022] PUT /identity/v3/projects/818237f556a4495eb0a73c1763a11490/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:36.040148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22c2a6-4e26-4a5d-9b30-ed52a56cd8c5 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:36.042572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6c22c2a6-4e26-4a5d-9b30-ed52a56cd8c5 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:36.159886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22c2a6-4e26-4a5d-9b30-ed52a56cd8c5 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:36.163905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c6220-6e71-463d-9cf5-618a3071d4aa tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:36.171546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b267929-867e-4c54-a3e0-c2d103231f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:36.172229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b267929-867e-4c54-a3e0-c2d103231f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:36.172514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b267929-867e-4c54-a3e0-c2d103231f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:36.172790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b267929-867e-4c54-a3e0-c2d103231f83 admin admin] PATH_INFO: `/v3/projects/a7074ae1c8ab4920b6cb59b20bae36ce` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:36.176461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b267929-867e-4c54-a3e0-c2d103231f83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7074ae1c8ab4920b6cb59b20bae36ce)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:36.180459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b267929-867e-4c54-a3e0-c2d103231f83 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:36.188943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b2b9e-4699-4cc5-9659-7f9e8c5afc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:36.191419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b2b9e-4699-4cc5-9659-7f9e8c5afc14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:36.194416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b2b9e-4699-4cc5-9659-7f9e8c5afc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:36.195446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b2b9e-4699-4cc5-9659-7f9e8c5afc14 admin admin] PATH_INFO: `/v3/users/9a05d8e7d917402fae37644094dd2aef` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:36.199496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b2b9e-4699-4cc5-9659-7f9e8c5afc14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a05d8e7d917402fae37644094dd2aef)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:36.201878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b2b9e-4699-4cc5-9659-7f9e8c5afc14 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:36.466861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c7b2b9e-4699-4cc5-9659-7f9e8c5afc14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a05d8e7d917402fae37644094dd2aef'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:36.468501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6b267929-867e-4c54-a3e0-c2d103231f83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7074ae1c8ab4920b6cb59b20bae36ce', 'request_id': 'req-6b267929-867e-4c54-a3e0-c2d103231f83'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:36.474899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6b267929-867e-4c54-a3e0-c2d103231f83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7074ae1c8ab4920b6cb59b20bae36ce', 'request_id': 'req-6b267929-867e-4c54-a3e0-c2d103231f83'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:36.552465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c7b2b9e-4699-4cc5-9659-7f9e8c5afc14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a05d8e7d917402fae37644094dd2aef'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:36.553130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c7b2b9e-4699-4cc5-9659-7f9e8c5afc14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a05d8e7d917402fae37644094dd2aef'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:36.570931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c7b2b9e-4699-4cc5-9659-7f9e8c5afc14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a05d8e7d917402fae37644094dd2aef'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:36.597973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c7b2b9e-4699-4cc5-9659-7f9e8c5afc14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a05d8e7d917402fae37644094dd2aef'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:36.598545 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2744/5533] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:36 2022] DELETE /identity/v3/users/9a05d8e7d917402fae37644094dd2aef => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:36.599562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b2b9e-4699-4cc5-9659-7f9e8c5afc14 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:36.603269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2c7b2b9e-4699-4cc5-9659-7f9e8c5afc14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:36.653640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6b267929-867e-4c54-a3e0-c2d103231f83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7074ae1c8ab4920b6cb59b20bae36ce', 'request_id': 'req-6b267929-867e-4c54-a3e0-c2d103231f83'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:36.676285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6b267929-867e-4c54-a3e0-c2d103231f83 admin admin] The token cache is being invalidate because project a7074ae1c8ab4920b6cb59b20bae36ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:36.676582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6b267929-867e-4c54-a3e0-c2d103231f83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:36.679669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6b267929-867e-4c54-a3e0-c2d103231f83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:36.686920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b2b9e-4699-4cc5-9659-7f9e8c5afc14 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:36.690281 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2790/5534] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:36 2022] DELETE /identity/v3/projects/a7074ae1c8ab4920b6cb59b20bae36ce => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:36.691175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b267929-867e-4c54-a3e0-c2d103231f83 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:36.692708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6b267929-867e-4c54-a3e0-c2d103231f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:36.693604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cb3e4-629d-448f-b18d-105d944d11dc tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85d364c69a314f518bcbb08c940ed2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b595b4e073485fa78857d395fb7b58', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781932943', 'tempest-DelegatedRole-413867460'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:36.696596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb3e4-629d-448f-b18d-105d944d11dc tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] REQUEST_METHOD: `HEAD` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:36.696596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb3e4-629d-448f-b18d-105d944d11dc tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:36.696596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb3e4-629d-448f-b18d-105d944d11dc tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] PATH_INFO: `/v3/OS-TRUST/trusts/58ea9d98ac68484b85011b8821643884/roles/d8ee21c66afd46a1a943c713bc4bcf66` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:36.704490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cb3e4-629d-448f-b18d-105d944d11dc tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: Authorizing `identity:get_role_for_trust(trust_id=58ea9d98ac68484b85011b8821643884, role_id=d8ee21c66afd46a1a943c713bc4bcf66)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:36.706105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cb3e4-629d-448f-b18d-105d944d11dc tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:36.717402 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2745/5535] 10.222.0.76 () {58 vars in 1369 bytes} [Sat Aug 27 04:51:36 2022] HEAD /identity/v3/OS-TRUST/trusts/58ea9d98ac68484b85011b8821643884/roles/d8ee21c66afd46a1a943c713bc4bcf66 => generated 0 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 27 04:51:36.718208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff54bf-9042-4d74-bf1a-99b454fdd3d0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:36.718821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff54bf-9042-4d74-bf1a-99b454fdd3d0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:36.719168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff54bf-9042-4d74-bf1a-99b454fdd3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:36.761162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d0ff54bf-9042-4d74-bf1a-99b454fdd3d0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:36.763418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d0ff54bf-9042-4d74-bf1a-99b454fdd3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:36.851649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b267929-867e-4c54-a3e0-c2d103231f83 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:36.861414 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2746/5536] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:36.863060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff54bf-9042-4d74-bf1a-99b454fdd3d0 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:36.864893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d0ff54bf-9042-4d74-bf1a-99b454fdd3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:36.892037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff54bf-9042-4d74-bf1a-99b454fdd3d0 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:36.905754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01aaff-5e6f-4384-8dca-8476d1f914f7 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85d364c69a314f518bcbb08c940ed2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b595b4e073485fa78857d395fb7b58', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781932943', 'tempest-DelegatedRole-413867460'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:36.907086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01aaff-5e6f-4384-8dca-8476d1f914f7 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:36.907508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01aaff-5e6f-4384-8dca-8476d1f914f7 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:36.907889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01aaff-5e6f-4384-8dca-8476d1f914f7 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] PATH_INFO: `/v3/OS-TRUST/trusts/58ea9d98ac68484b85011b8821643884/roles/16d14b1d363b4f12b9b5b782b3f4aeb9` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:36.911529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:36.923896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01aaff-5e6f-4384-8dca-8476d1f914f7 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: Authorizing `identity:get_role_for_trust(trust_id=58ea9d98ac68484b85011b8821643884, role_id=16d14b1d363b4f12b9b5b782b3f4aeb9)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:36.927380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01aaff-5e6f-4384-8dca-8476d1f914f7 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:36.948778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-3c01aaff-5e6f-4384-8dca-8476d1f914f7 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Could not find role: 16d14b1d363b4f12b9b5b782b3f4aeb9.: keystone.exception.RoleNotFound: Could not find role: 16d14b1d363b4f12b9b5b782b3f4aeb9. Aug 27 04:51:36.948778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:36.948778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:36.948778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:36.948778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:36.948778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:36.948778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:36.948778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:36.948778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:36.948778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:36.948778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:36.948778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:36.948778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 27 04:51:36.948778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:51:36.948778 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 16d14b1d363b4f12b9b5b782b3f4aeb9. Aug 27 04:51:36.950200 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:51:36.955304 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2747/5537] 10.222.0.76 () {58 vars in 1368 bytes} [Sat Aug 27 04:51:36 2022] GET /identity/v3/OS-TRUST/trusts/58ea9d98ac68484b85011b8821643884/roles/16d14b1d363b4f12b9b5b782b3f4aeb9 => generated 110 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:51:36.955304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23ad6b-fb01-4ac4-88d0-b572a1a7d5ba None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:36.955304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23ad6b-fb01-4ac4-88d0-b572a1a7d5ba None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:36.956091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23ad6b-fb01-4ac4-88d0-b572a1a7d5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:36.978745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf82f8c-3b65-4c5e-ba55-845bb061ad06 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:36.979508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf82f8c-3b65-4c5e-ba55-845bb061ad06 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:36.982305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf82f8c-3b65-4c5e-ba55-845bb061ad06 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:36.982815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf82f8c-3b65-4c5e-ba55-845bb061ad06 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/projects/818237f556a4495eb0a73c1763a11490/users/0a48539c987b4f988709d51f673cda2d/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:36.988615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf82f8c-3b65-4c5e-ba55-845bb061ad06 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:list_grants(project_id=818237f556a4495eb0a73c1763a11490, user_id=0a48539c987b4f988709d51f673cda2d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:36.993943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf82f8c-3b65-4c5e-ba55-845bb061ad06 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:37.020848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2c23ad6b-fb01-4ac4-88d0-b572a1a7d5ba None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:37.021786 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2791/5538] 10.222.0.76 () {58 vars in 1365 bytes} [Sat Aug 27 04:51:36 2022] GET /identity/v3/projects/818237f556a4495eb0a73c1763a11490/users/0a48539c987b4f988709d51f673cda2d/roles => generated 410 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:37.022637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2c23ad6b-fb01-4ac4-88d0-b572a1a7d5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:37.023788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf82f8c-3b65-4c5e-ba55-845bb061ad06 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:37.030448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fbf82f8c-3b65-4c5e-ba55-845bb061ad06 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:37.034748 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2748/5539] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:37.039807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23ad6b-fb01-4ac4-88d0-b572a1a7d5ba None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:37.047663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23ad6b-fb01-4ac4-88d0-b572a1a7d5ba None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:37.056317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf82f8c-3b65-4c5e-ba55-845bb061ad06 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:37.058593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5cfc4-1bac-46a6-b767-2e0cbb6603b5 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85d364c69a314f518bcbb08c940ed2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b595b4e073485fa78857d395fb7b58', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781932943', 'tempest-DelegatedRole-413867460'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:37.059682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5cfc4-1bac-46a6-b767-2e0cbb6603b5 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] REQUEST_METHOD: `HEAD` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:37.060206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5cfc4-1bac-46a6-b767-2e0cbb6603b5 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:37.060654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5cfc4-1bac-46a6-b767-2e0cbb6603b5 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] PATH_INFO: `/v3/OS-TRUST/trusts/58ea9d98ac68484b85011b8821643884/roles/16d14b1d363b4f12b9b5b782b3f4aeb9` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:37.062327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1662ef-26fb-43b6-8a2e-7a92df94d169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:37.063526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1662ef-26fb-43b6-8a2e-7a92df94d169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:37.063810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1662ef-26fb-43b6-8a2e-7a92df94d169 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:37.064628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1662ef-26fb-43b6-8a2e-7a92df94d169 admin admin] PATH_INFO: `/v3/users/62e2379d8bb04dd0ac269cf52527f51a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:37.068124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1662ef-26fb-43b6-8a2e-7a92df94d169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e2379d8bb04dd0ac269cf52527f51a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:37.071080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1662ef-26fb-43b6-8a2e-7a92df94d169 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:37.079772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5cfc4-1bac-46a6-b767-2e0cbb6603b5 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: Authorizing `identity:get_role_for_trust(trust_id=58ea9d98ac68484b85011b8821643884, role_id=16d14b1d363b4f12b9b5b782b3f4aeb9)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:37.082947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5cfc4-1bac-46a6-b767-2e0cbb6603b5 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:37.109698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-72f5cfc4-1bac-46a6-b767-2e0cbb6603b5 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Could not find role: 16d14b1d363b4f12b9b5b782b3f4aeb9.: keystone.exception.RoleNotFound: Could not find role: 16d14b1d363b4f12b9b5b782b3f4aeb9. Aug 27 04:51:37.109698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:37.109698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:37.109698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:37.109698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:37.109698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:37.109698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:37.109698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:37.109698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:37.109698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:37.109698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:37.109698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:37.109698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 27 04:51:37.109698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 04:51:37.109698 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 16d14b1d363b4f12b9b5b782b3f4aeb9. Aug 27 04:51:37.111152 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:51:37.114299 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2749/5540] 10.222.0.76 () {58 vars in 1369 bytes} [Sat Aug 27 04:51:37 2022] HEAD /identity/v3/OS-TRUST/trusts/58ea9d98ac68484b85011b8821643884/roles/16d14b1d363b4f12b9b5b782b3f4aeb9 => generated 0 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 27 04:51:37.115244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5cfc4-1bac-46a6-b767-2e0cbb6603b5 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:37.136862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5cfc4-1bac-46a6-b767-2e0cbb6603b5 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:37.147084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3b4aa-3535-4e85-bd35-1460150de3ec tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:37.148565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3b4aa-3535-4e85-bd35-1460150de3ec tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:37.148951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3b4aa-3535-4e85-bd35-1460150de3ec tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:37.149118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3b4aa-3535-4e85-bd35-1460150de3ec tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/projects/818237f556a4495eb0a73c1763a11490/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:37.160941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3b4aa-3535-4e85-bd35-1460150de3ec tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:check_grant(project_id=818237f556a4495eb0a73c1763a11490, user_id=0a48539c987b4f988709d51f673cda2d, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:37.180411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3b4aa-3535-4e85-bd35-1460150de3ec tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:37.187799 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2750/5541] 10.222.0.76 () {58 vars in 1465 bytes} [Sat Aug 27 04:51:37 2022] HEAD /identity/v3/projects/818237f556a4495eb0a73c1763a11490/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:37.187799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3b4aa-3535-4e85-bd35-1460150de3ec tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:37.214591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3b4aa-3535-4e85-bd35-1460150de3ec tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:37.222901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bfa4b-05be-46bf-855b-b48bab1b7c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:37.224040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bfa4b-05be-46bf-855b-b48bab1b7c58 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:37.224199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bfa4b-05be-46bf-855b-b48bab1b7c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:37.224530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bfa4b-05be-46bf-855b-b48bab1b7c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:37.225456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bfa4b-05be-46bf-855b-b48bab1b7c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:37.226654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bfa4b-05be-46bf-855b-b48bab1b7c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:37.229089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bfa4b-05be-46bf-855b-b48bab1b7c58 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:37.245972 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2751/5542] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:37.246957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bfa4b-05be-46bf-855b-b48bab1b7c58 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:37.258365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-096bfa4b-05be-46bf-855b-b48bab1b7c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:37.277618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bfa4b-05be-46bf-855b-b48bab1b7c58 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:37.284228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4f797-ed78-4e56-a926-4bdad2d80f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:37.286843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4f797-ed78-4e56-a926-4bdad2d80f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:37.287515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4f797-ed78-4e56-a926-4bdad2d80f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:37.287515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4f797-ed78-4e56-a926-4bdad2d80f0a admin admin] PATH_INFO: `/v3/projects/7b3645ed00d94f47b69ffbab3ee73850` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:37.289226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4f797-ed78-4e56-a926-4bdad2d80f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3645ed00d94f47b69ffbab3ee73850)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:37.291286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4f797-ed78-4e56-a926-4bdad2d80f0a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:37.332021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d1662ef-26fb-43b6-8a2e-7a92df94d169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e2379d8bb04dd0ac269cf52527f51a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:37.333448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d1662ef-26fb-43b6-8a2e-7a92df94d169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e2379d8bb04dd0ac269cf52527f51a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:37.440981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d1662ef-26fb-43b6-8a2e-7a92df94d169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e2379d8bb04dd0ac269cf52527f51a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:37.442035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d1662ef-26fb-43b6-8a2e-7a92df94d169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e2379d8bb04dd0ac269cf52527f51a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:37.487220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d1662ef-26fb-43b6-8a2e-7a92df94d169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e2379d8bb04dd0ac269cf52527f51a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:37.493202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-56a4f797-ed78-4e56-a926-4bdad2d80f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3645ed00d94f47b69ffbab3ee73850', 'request_id': 'req-56a4f797-ed78-4e56-a926-4bdad2d80f0a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:37.513517 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2792/5543] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:37 2022] DELETE /identity/v3/users/62e2379d8bb04dd0ac269cf52527f51a => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:37.513517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1662ef-26fb-43b6-8a2e-7a92df94d169 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:37.516312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5d1662ef-26fb-43b6-8a2e-7a92df94d169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:37.517729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-56a4f797-ed78-4e56-a926-4bdad2d80f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3645ed00d94f47b69ffbab3ee73850', 'request_id': 'req-56a4f797-ed78-4e56-a926-4bdad2d80f0a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:37.529147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-56a4f797-ed78-4e56-a926-4bdad2d80f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3645ed00d94f47b69ffbab3ee73850', 'request_id': 'req-56a4f797-ed78-4e56-a926-4bdad2d80f0a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:37.617748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1662ef-26fb-43b6-8a2e-7a92df94d169 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:37.622544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d923bdb-bec6-42d8-a395-a72f884cdf12 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85d364c69a314f518bcbb08c940ed2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b595b4e073485fa78857d395fb7b58', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781932943', 'tempest-DelegatedRole-413867460'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:37.623295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d923bdb-bec6-42d8-a395-a72f884cdf12 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:37.623646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d923bdb-bec6-42d8-a395-a72f884cdf12 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:37.624047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d923bdb-bec6-42d8-a395-a72f884cdf12 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] PATH_INFO: `/v3/OS-TRUST/trusts/58ea9d98ac68484b85011b8821643884` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:37.630716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d923bdb-bec6-42d8-a395-a72f884cdf12 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: Authorizing `identity:delete_trust(trust_id=58ea9d98ac68484b85011b8821643884)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:37.632407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d923bdb-bec6-42d8-a395-a72f884cdf12 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:37.652931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-56a4f797-ed78-4e56-a926-4bdad2d80f0a admin admin] The token cache is being invalidate because project 7b3645ed00d94f47b69ffbab3ee73850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:37.652931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-56a4f797-ed78-4e56-a926-4bdad2d80f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:37.652931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-56a4f797-ed78-4e56-a926-4bdad2d80f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:37.658491 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2752/5544] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:37 2022] DELETE /identity/v3/projects/7b3645ed00d94f47b69ffbab3ee73850 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:37.658491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4f797-ed78-4e56-a926-4bdad2d80f0a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:37.664044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-56a4f797-ed78-4e56-a926-4bdad2d80f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:37.760532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4f797-ed78-4e56-a926-4bdad2d80f0a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:37.808580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8d923bdb-bec6-42d8-a395-a72f884cdf12 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '58ea9d98ac68484b85011b8821643884', 'request_id': 'req-8d923bdb-bec6-42d8-a395-a72f884cdf12'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:37.809817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8d923bdb-bec6-42d8-a395-a72f884cdf12 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '58ea9d98ac68484b85011b8821643884', 'request_id': 'req-8d923bdb-bec6-42d8-a395-a72f884cdf12'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:37.838019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb15a5-3aa1-4871-9009-e3dc0dae6a59 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:37.838688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb15a5-3aa1-4871-9009-e3dc0dae6a59 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:37.838976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb15a5-3aa1-4871-9009-e3dc0dae6a59 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:37.839257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb15a5-3aa1-4871-9009-e3dc0dae6a59 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/projects/818237f556a4495eb0a73c1763a11490/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:37.841507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb15a5-3aa1-4871-9009-e3dc0dae6a59 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=818237f556a4495eb0a73c1763a11490, user_id=0a48539c987b4f988709d51f673cda2d, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:37.844623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb15a5-3aa1-4871-9009-e3dc0dae6a59 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:37.851296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8acb15a5-3aa1-4871-9009-e3dc0dae6a59 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invalidating the token cache because role 959d409c289a4ad1b4ceeea047bb8036 was removed from user 0a48539c987b4f988709d51f673cda2d on project 818237f556a4495eb0a73c1763a11490. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:37.851871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8acb15a5-3aa1-4871-9009-e3dc0dae6a59 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:37.852366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8acb15a5-3aa1-4871-9009-e3dc0dae6a59 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:37.980869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8d923bdb-bec6-42d8-a395-a72f884cdf12 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '58ea9d98ac68484b85011b8821643884', 'request_id': 'req-8d923bdb-bec6-42d8-a395-a72f884cdf12'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:37.986594 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2793/5545] 10.222.0.76 () {58 vars in 1254 bytes} [Sat Aug 27 04:51:37 2022] DELETE /identity/v3/OS-TRUST/trusts/58ea9d98ac68484b85011b8821643884 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:37.987315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d923bdb-bec6-42d8-a395-a72f884cdf12 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:37.988691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8d923bdb-bec6-42d8-a395-a72f884cdf12 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:37.992809 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2753/5546] 10.222.0.76 () {58 vars in 1467 bytes} [Sat Aug 27 04:51:37 2022] DELETE /identity/v3/projects/818237f556a4495eb0a73c1763a11490/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:37.995000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2bf14-52b1-4e74-98d3-ac9becf84197 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:37.995444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2bf14-52b1-4e74-98d3-ac9becf84197 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:37.995885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2bf14-52b1-4e74-98d3-ac9becf84197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:38.064713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0bc2bf14-52b1-4e74-98d3-ac9becf84197 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:38.065952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0bc2bf14-52b1-4e74-98d3-ac9becf84197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:38.140770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d923bdb-bec6-42d8-a395-a72f884cdf12 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:38.192542 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2754/5547] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:38.195137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de443f-ae7d-4241-89e2-d48f3e82a818 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:38.195427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de443f-ae7d-4241-89e2-d48f3e82a818 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:38.195702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de443f-ae7d-4241-89e2-d48f3e82a818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:38.214697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:38.237115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-28de443f-ae7d-4241-89e2-d48f3e82a818 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:38.240962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-28de443f-ae7d-4241-89e2-d48f3e82a818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:38.268804 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2755/5548] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:38.270962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de443f-ae7d-4241-89e2-d48f3e82a818 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:38.277512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-28de443f-ae7d-4241-89e2-d48f3e82a818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:38.303767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434219c-9d17-4e24-92db-be9291c4392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:38.306621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434219c-9d17-4e24-92db-be9291c4392c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:38.307127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434219c-9d17-4e24-92db-be9291c4392c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:38.307591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434219c-9d17-4e24-92db-be9291c4392c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:38.308472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434219c-9d17-4e24-92db-be9291c4392c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:38.328541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434219c-9d17-4e24-92db-be9291c4392c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:38.479357 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2794/5549] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:37 2022] POST /identity/v3/projects => generated 387 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:38.479357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434219c-9d17-4e24-92db-be9291c4392c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:38.483738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2434219c-9d17-4e24-92db-be9291c4392c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:38.533910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de443f-ae7d-4241-89e2-d48f3e82a818 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:38.645897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53439c60-9358-4670-9af9-cc3009979a82 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85d364c69a314f518bcbb08c940ed2ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2b595b4e073485fa78857d395fb7b58', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1781932943', 'tempest-DelegatedRole-413867460'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:38.646567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53439c60-9358-4670-9af9-cc3009979a82 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:38.648046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53439c60-9358-4670-9af9-cc3009979a82 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:38.648361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53439c60-9358-4670-9af9-cc3009979a82 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] PATH_INFO: `/v3/OS-TRUST/trusts/58ea9d98ac68484b85011b8821643884` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:38.676437 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-53439c60-9358-4670-9af9-cc3009979a82 tempest-TrustsV3TestJSON-973123875 tempest-user-364232818] Could not find trust: 58ea9d98ac68484b85011b8821643884.: keystone.exception.TrustNotFound: Could not find trust: 58ea9d98ac68484b85011b8821643884. Aug 27 04:51:38.676437 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:38.676437 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:38.676437 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:38.676437 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:38.676437 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:38.676437 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:38.676437 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:38.676437 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:38.676437 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:38.676437 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:38.676437 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:38.676437 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 27 04:51:38.676437 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 27 04:51:38.676437 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 27 04:51:38.678162 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 27 04:51:38.678162 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 27 04:51:38.678162 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 27 04:51:38.678162 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 27 04:51:38.678162 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 27 04:51:38.678162 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:51:38.678162 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:51:38.678162 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 27 04:51:38.678162 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 27 04:51:38.678162 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 27 04:51:38.678162 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 27 04:51:38.678162 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 58ea9d98ac68484b85011b8821643884. Aug 27 04:51:38.678162 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:51:38.679676 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2756/5550] 10.222.0.76 () {58 vars in 1251 bytes} [Sat Aug 27 04:51:38 2022] GET /identity/v3/OS-TRUST/trusts/58ea9d98ac68484b85011b8821643884 => generated 111 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:51:38.683675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98a6ba-8f09-4566-a44b-cc8880e74ad1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:38.684244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98a6ba-8f09-4566-a44b-cc8880e74ad1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:38.684692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98a6ba-8f09-4566-a44b-cc8880e74ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:38.714926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434219c-9d17-4e24-92db-be9291c4392c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:38.724000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d16c20-c7a3-4390-b55a-75a67e29a4e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:38.724898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d16c20-c7a3-4390-b55a-75a67e29a4e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:38.725282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d16c20-c7a3-4390-b55a-75a67e29a4e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:38.726324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d16c20-c7a3-4390-b55a-75a67e29a4e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/system/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:38.730033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d16c20-c7a3-4390-b55a-75a67e29a4e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0a48539c987b4f988709d51f673cda2d, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:38.731310 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-45d16c20-c7a3-4390-b55a-75a67e29a4e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:38.731310 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:38.731310 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:38.733150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d16c20-c7a3-4390-b55a-75a67e29a4e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:38.747526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1a98a6ba-8f09-4566-a44b-cc8880e74ad1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:38.762026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1a98a6ba-8f09-4566-a44b-cc8880e74ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:38.839524 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2795/5551] 10.222.0.76 () {60 vars in 1378 bytes} [Sat Aug 27 04:51:38 2022] PUT /identity/v3/system/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:38.840984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d16c20-c7a3-4390-b55a-75a67e29a4e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:38.851898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-45d16c20-c7a3-4390-b55a-75a67e29a4e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:38.888218 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2757/5552] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:38.889230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98a6ba-8f09-4566-a44b-cc8880e74ad1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:38.902915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1a98a6ba-8f09-4566-a44b-cc8880e74ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:38.920313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98a6ba-8f09-4566-a44b-cc8880e74ad1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:38.925643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09788e05-9e3d-4c8a-bb02-7ece1b626a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:38.926259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09788e05-9e3d-4c8a-bb02-7ece1b626a3e admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:38.926539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09788e05-9e3d-4c8a-bb02-7ece1b626a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:38.926813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09788e05-9e3d-4c8a-bb02-7ece1b626a3e admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:38.927667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09788e05-9e3d-4c8a-bb02-7ece1b626a3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:38.931080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09788e05-9e3d-4c8a-bb02-7ece1b626a3e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:39.015814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d16c20-c7a3-4390-b55a-75a67e29a4e0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:39.019659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec5e66-3e0d-4f6f-8d1e-89c87af66be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:39.021192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec5e66-3e0d-4f6f-8d1e-89c87af66be5 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:39.021613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec5e66-3e0d-4f6f-8d1e-89c87af66be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:39.021787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec5e66-3e0d-4f6f-8d1e-89c87af66be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:39.040217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec5e66-3e0d-4f6f-8d1e-89c87af66be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:39.043417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec5e66-3e0d-4f6f-8d1e-89c87af66be5 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:39.076384 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2796/5553] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:39.077377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec5e66-3e0d-4f6f-8d1e-89c87af66be5 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:39.080145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-09ec5e66-3e0d-4f6f-8d1e-89c87af66be5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:39.106144 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2758/5554] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:38 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:39.107661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09788e05-9e3d-4c8a-bb02-7ece1b626a3e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:39.151106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09788e05-9e3d-4c8a-bb02-7ece1b626a3e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:39.167718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886aac1-06e7-408e-b0af-c3ce66dff423 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:39.169451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886aac1-06e7-408e-b0af-c3ce66dff423 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:39.169744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886aac1-06e7-408e-b0af-c3ce66dff423 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:39.170029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886aac1-06e7-408e-b0af-c3ce66dff423 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/system/users/0a48539c987b4f988709d51f673cda2d/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:39.180586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886aac1-06e7-408e-b0af-c3ce66dff423 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=0a48539c987b4f988709d51f673cda2d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:39.182072 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-5886aac1-06e7-408e-b0af-c3ce66dff423 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:39.182072 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:39.182072 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:39.189081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886aac1-06e7-408e-b0af-c3ce66dff423 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:39.204419 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2759/5555] 10.222.0.76 () {58 vars in 1260 bytes} [Sat Aug 27 04:51:39 2022] GET /identity/v3/system/users/0a48539c987b4f988709d51f673cda2d/roles => generated 375 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:39.205336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886aac1-06e7-408e-b0af-c3ce66dff423 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:39.222128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886aac1-06e7-408e-b0af-c3ce66dff423 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:39.229702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe970b-2c7e-4214-93a0-d28acaa8272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:39.230872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe970b-2c7e-4214-93a0-d28acaa8272f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:39.230872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe970b-2c7e-4214-93a0-d28acaa8272f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:39.231119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe970b-2c7e-4214-93a0-d28acaa8272f admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:39.231610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe970b-2c7e-4214-93a0-d28acaa8272f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:39.231908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe970b-2c7e-4214-93a0-d28acaa8272f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:39.233692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe970b-2c7e-4214-93a0-d28acaa8272f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:39.278566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec5e66-3e0d-4f6f-8d1e-89c87af66be5 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:39.282510 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2760/5556] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:39.284679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe970b-2c7e-4214-93a0-d28acaa8272f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:39.299777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4eea3-d98e-4730-8e6c-11393949e546 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:39.300749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4eea3-d98e-4730-8e6c-11393949e546 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:39.303819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4eea3-d98e-4730-8e6c-11393949e546 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:39.304542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4eea3-d98e-4730-8e6c-11393949e546 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles/16d14b1d363b4f12b9b5b782b3f4aeb9` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:39.307469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4eea3-d98e-4730-8e6c-11393949e546 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_role(role_id=16d14b1d363b4f12b9b5b782b3f4aeb9)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:39.321918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4eea3-d98e-4730-8e6c-11393949e546 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:39.330763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe970b-2c7e-4214-93a0-d28acaa8272f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:39.349558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233dc37-4c69-4d37-8d7b-b13d3da3de68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:39.350194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233dc37-4c69-4d37-8d7b-b13d3da3de68 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:39.353316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233dc37-4c69-4d37-8d7b-b13d3da3de68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:39.353316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233dc37-4c69-4d37-8d7b-b13d3da3de68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:39.353316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233dc37-4c69-4d37-8d7b-b13d3da3de68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:39.353870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233dc37-4c69-4d37-8d7b-b13d3da3de68 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:39.384337 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2761/5557] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:39 2022] GET /identity/v3/roles => generated 2796 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:39.389123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233dc37-4c69-4d37-8d7b-b13d3da3de68 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:39.403099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233dc37-4c69-4d37-8d7b-b13d3da3de68 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:39.427626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6e368-20e2-430b-80a5-db17f4b3a1ff tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:39.428863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6e368-20e2-430b-80a5-db17f4b3a1ff tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:39.431280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6e368-20e2-430b-80a5-db17f4b3a1ff tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:39.432935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6e368-20e2-430b-80a5-db17f4b3a1ff tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/system/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:39.435938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6e368-20e2-430b-80a5-db17f4b3a1ff tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=0a48539c987b4f988709d51f673cda2d, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:39.437527 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-59b6e368-20e2-430b-80a5-db17f4b3a1ff tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:39.437527 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:39.437527 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:39.438826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6e368-20e2-430b-80a5-db17f4b3a1ff tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:39.450209 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2762/5558] 10.222.0.76 () {58 vars in 1360 bytes} [Sat Aug 27 04:51:39 2022] HEAD /identity/v3/system/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:39.451464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6e368-20e2-430b-80a5-db17f4b3a1ff tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:39.470108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6e368-20e2-430b-80a5-db17f4b3a1ff tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:39.480623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e6705-0d60-4cf7-89b9-a2a44850b66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:39.480623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e6705-0d60-4cf7-89b9-a2a44850b66c admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:39.480623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e6705-0d60-4cf7-89b9-a2a44850b66c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:39.480623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e6705-0d60-4cf7-89b9-a2a44850b66c admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:39.481007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e6705-0d60-4cf7-89b9-a2a44850b66c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:39.481954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e6705-0d60-4cf7-89b9-a2a44850b66c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:39.542056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-49f4eea3-d98e-4730-8e6c-11393949e546 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invalidating the token cache because role 16d14b1d363b4f12b9b5b782b3f4aeb9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:39.542642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-49f4eea3-d98e-4730-8e6c-11393949e546 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:39.543297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-49f4eea3-d98e-4730-8e6c-11393949e546 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:39.545796 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2797/5559] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:39 2022] DELETE /identity/v3/roles/16d14b1d363b4f12b9b5b782b3f4aeb9 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:39.546797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4eea3-d98e-4730-8e6c-11393949e546 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:39.548751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-49f4eea3-d98e-4730-8e6c-11393949e546 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:39.620283 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2763/5560] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:39 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:39.621271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e6705-0d60-4cf7-89b9-a2a44850b66c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:39.628822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-128e6705-0d60-4cf7-89b9-a2a44850b66c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:39.632626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4eea3-d98e-4730-8e6c-11393949e546 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:39.663037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:39.723372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73270e75-0a2e-46dc-b51b-d85df5a3e552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:39.724013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73270e75-0a2e-46dc-b51b-d85df5a3e552 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:39.724338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73270e75-0a2e-46dc-b51b-d85df5a3e552 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:39.724614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73270e75-0a2e-46dc-b51b-d85df5a3e552 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:39.725265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73270e75-0a2e-46dc-b51b-d85df5a3e552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:39.733372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73270e75-0a2e-46dc-b51b-d85df5a3e552 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:39.763823 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2798/5561] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:39 2022] GET /identity/v3/roles => generated 2558 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:39.764408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73270e75-0a2e-46dc-b51b-d85df5a3e552 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:39.769184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-73270e75-0a2e-46dc-b51b-d85df5a3e552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:39.816435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e6705-0d60-4cf7-89b9-a2a44850b66c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:39.849550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af78aa7-7fc9-461f-a7fc-c882945a173e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:39.850253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af78aa7-7fc9-461f-a7fc-c882945a173e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:39.851098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af78aa7-7fc9-461f-a7fc-c882945a173e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:39.851387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af78aa7-7fc9-461f-a7fc-c882945a173e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/system/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:39.857093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:39.858032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af78aa7-7fc9-461f-a7fc-c882945a173e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=0a48539c987b4f988709d51f673cda2d, role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:39.859340 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-4af78aa7-7fc9-461f-a7fc-c882945a173e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:39.859340 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:39.859340 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:39.861888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af78aa7-7fc9-461f-a7fc-c882945a173e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:39.867562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73270e75-0a2e-46dc-b51b-d85df5a3e552 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:39.875875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1556e-5c97-409d-b74d-8dfa78110c84 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:39.876941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1556e-5c97-409d-b74d-8dfa78110c84 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:39.877841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1556e-5c97-409d-b74d-8dfa78110c84 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:39.877841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1556e-5c97-409d-b74d-8dfa78110c84 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/roles/d8ee21c66afd46a1a943c713bc4bcf66` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:39.880025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1556e-5c97-409d-b74d-8dfa78110c84 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d8ee21c66afd46a1a943c713bc4bcf66)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:39.882492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1556e-5c97-409d-b74d-8dfa78110c84 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:39.998842 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2764/5562] 10.222.0.76 () {58 vars in 1362 bytes} [Sat Aug 27 04:51:39 2022] DELETE /identity/v3/system/users/0a48539c987b4f988709d51f673cda2d/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:39.998842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af78aa7-7fc9-461f-a7fc-c882945a173e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:40.000980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4af78aa7-7fc9-461f-a7fc-c882945a173e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:40.017089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af78aa7-7fc9-461f-a7fc-c882945a173e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:40.022223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad6c56-5cae-4e87-99aa-9c77b789f8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:40.024404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad6c56-5cae-4e87-99aa-9c77b789f8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:40.024812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad6c56-5cae-4e87-99aa-9c77b789f8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:40.025191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad6c56-5cae-4e87-99aa-9c77b789f8a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:40.025928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad6c56-5cae-4e87-99aa-9c77b789f8a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:40.028353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad6c56-5cae-4e87-99aa-9c77b789f8a8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:40.149964 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2765/5563] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:39 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:40.150802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad6c56-5cae-4e87-99aa-9c77b789f8a8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:40.174054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad6c56-5cae-4e87-99aa-9c77b789f8a8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:40.181536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3ebb5-c86e-4358-8367-8cb62e01be01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:40.182672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3ebb5-c86e-4358-8367-8cb62e01be01 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:40.183139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3ebb5-c86e-4358-8367-8cb62e01be01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:40.183574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3ebb5-c86e-4358-8367-8cb62e01be01 admin admin] PATH_INFO: `/v3/projects/acbc50ff913042aebfb7cdcc8b11820f/users/d7e7e6cf73254b1cb3cef66630008ff5/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:40.200871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3ebb5-c86e-4358-8367-8cb62e01be01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbc50ff913042aebfb7cdcc8b11820f, user_id=d7e7e6cf73254b1cb3cef66630008ff5, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:40.204787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3ebb5-c86e-4358-8367-8cb62e01be01 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:40.228664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e7f1556e-5c97-409d-b74d-8dfa78110c84 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invalidating the token cache because role d8ee21c66afd46a1a943c713bc4bcf66 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:40.236911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e7f1556e-5c97-409d-b74d-8dfa78110c84 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:40.236911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e7f1556e-5c97-409d-b74d-8dfa78110c84 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:40.242926 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2799/5564] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:39 2022] DELETE /identity/v3/roles/d8ee21c66afd46a1a943c713bc4bcf66 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:40.244268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1556e-5c97-409d-b74d-8dfa78110c84 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:40.247833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e7f1556e-5c97-409d-b74d-8dfa78110c84 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:40.313492 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2766/5565] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:40 2022] PUT /identity/v3/projects/acbc50ff913042aebfb7cdcc8b11820f/users/d7e7e6cf73254b1cb3cef66630008ff5/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:40.315436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3ebb5-c86e-4358-8367-8cb62e01be01 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:40.318112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d4a3ebb5-c86e-4358-8367-8cb62e01be01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:40.416719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1556e-5c97-409d-b74d-8dfa78110c84 tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:40.463506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3ebb5-c86e-4358-8367-8cb62e01be01 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:40.480186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1f284-8ac4-4987-9dc1-ac227cff0443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:40.480955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1f284-8ac4-4987-9dc1-ac227cff0443 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:40.481155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1f284-8ac4-4987-9dc1-ac227cff0443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:40.481432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1f284-8ac4-4987-9dc1-ac227cff0443 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:40.482091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1f284-8ac4-4987-9dc1-ac227cff0443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:40.483708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1f284-8ac4-4987-9dc1-ac227cff0443 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:40.499259 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2767/5566] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:40 2022] GET /identity/v3/roles => generated 2324 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:40.499506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0997b8d-9680-4e37-8fe3-6f2ab43df00e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:40.499624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1f284-8ac4-4987-9dc1-ac227cff0443 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:40.499724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0997b8d-9680-4e37-8fe3-6f2ab43df00e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:40.499724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0997b8d-9680-4e37-8fe3-6f2ab43df00e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:40.499724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0997b8d-9680-4e37-8fe3-6f2ab43df00e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:40.499958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-eab1f284-8ac4-4987-9dc1-ac227cff0443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:40.500053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0997b8d-9680-4e37-8fe3-6f2ab43df00e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:40.502416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0997b8d-9680-4e37-8fe3-6f2ab43df00e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:40.513809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1f284-8ac4-4987-9dc1-ac227cff0443 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:40.524080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae223d2-cdca-466e-aa21-81e8837a76a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:40.524080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae223d2-cdca-466e-aa21-81e8837a76a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:40.524080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae223d2-cdca-466e-aa21-81e8837a76a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:40.524080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae223d2-cdca-466e-aa21-81e8837a76a3 admin admin] PATH_INFO: `/v3/projects/38aa11ca93314ca19452cc1da639b047` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:40.524507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae223d2-cdca-466e-aa21-81e8837a76a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38aa11ca93314ca19452cc1da639b047)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:40.524595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae223d2-cdca-466e-aa21-81e8837a76a3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:40.662651 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2800/5567] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:51:40 2022] POST /identity/v3/roles => generated 270 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:40.664004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0997b8d-9680-4e37-8fe3-6f2ab43df00e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:40.667281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c0997b8d-9680-4e37-8fe3-6f2ab43df00e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:40.689381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0ae223d2-cdca-466e-aa21-81e8837a76a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38aa11ca93314ca19452cc1da639b047', 'request_id': 'req-0ae223d2-cdca-466e-aa21-81e8837a76a3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:40.703333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0ae223d2-cdca-466e-aa21-81e8837a76a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38aa11ca93314ca19452cc1da639b047', 'request_id': 'req-0ae223d2-cdca-466e-aa21-81e8837a76a3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:40.726579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0ae223d2-cdca-466e-aa21-81e8837a76a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38aa11ca93314ca19452cc1da639b047', 'request_id': 'req-0ae223d2-cdca-466e-aa21-81e8837a76a3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:40.768945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0997b8d-9680-4e37-8fe3-6f2ab43df00e tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:40.856858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0ae223d2-cdca-466e-aa21-81e8837a76a3 admin admin] The token cache is being invalidate because project 38aa11ca93314ca19452cc1da639b047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:40.856858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0ae223d2-cdca-466e-aa21-81e8837a76a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:40.857481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997625cf-b5e8-4c4e-a38b-23d4ec28279e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:40.857481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997625cf-b5e8-4c4e-a38b-23d4ec28279e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:40.857703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0ae223d2-cdca-466e-aa21-81e8837a76a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:40.857807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997625cf-b5e8-4c4e-a38b-23d4ec28279e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:40.857807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997625cf-b5e8-4c4e-a38b-23d4ec28279e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/users/85d364c69a314f518bcbb08c940ed2ae` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:40.857807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997625cf-b5e8-4c4e-a38b-23d4ec28279e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_user(user_id=85d364c69a314f518bcbb08c940ed2ae)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:40.858022 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2768/5568] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:40 2022] DELETE /identity/v3/projects/38aa11ca93314ca19452cc1da639b047 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:40.858101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997625cf-b5e8-4c4e-a38b-23d4ec28279e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:40.858191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956d3e1-ec3e-495f-90ed-e0750169501c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:40.858191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956d3e1-ec3e-495f-90ed-e0750169501c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:40.858191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956d3e1-ec3e-495f-90ed-e0750169501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:40.925944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2956d3e1-ec3e-495f-90ed-e0750169501c None None] MFA Rules not processed for user `d7e7e6cf73254b1cb3cef66630008ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:40.927459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2956d3e1-ec3e-495f-90ed-e0750169501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:41.023480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-997625cf-b5e8-4c4e-a38b-23d4ec28279e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d364c69a314f518bcbb08c940ed2ae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:41.025466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-997625cf-b5e8-4c4e-a38b-23d4ec28279e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d364c69a314f518bcbb08c940ed2ae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:41.070099 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2769/5569] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:41.071401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956d3e1-ec3e-495f-90ed-e0750169501c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:41.072825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2956d3e1-ec3e-495f-90ed-e0750169501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:41.138059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-997625cf-b5e8-4c4e-a38b-23d4ec28279e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d364c69a314f518bcbb08c940ed2ae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:41.138783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-997625cf-b5e8-4c4e-a38b-23d4ec28279e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d364c69a314f518bcbb08c940ed2ae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:41.159989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-997625cf-b5e8-4c4e-a38b-23d4ec28279e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d364c69a314f518bcbb08c940ed2ae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:41.162119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956d3e1-ec3e-495f-90ed-e0750169501c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:41.173613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e24c7f-1f2b-4211-b2e2-ca9c68fefda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:41.174256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e24c7f-1f2b-4211-b2e2-ca9c68fefda1 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:41.174540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e24c7f-1f2b-4211-b2e2-ca9c68fefda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:41.174857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e24c7f-1f2b-4211-b2e2-ca9c68fefda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:41.175644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e24c7f-1f2b-4211-b2e2-ca9c68fefda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:41.178142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e24c7f-1f2b-4211-b2e2-ca9c68fefda1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:41.186865 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2801/5570] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:40 2022] DELETE /identity/v3/users/85d364c69a314f518bcbb08c940ed2ae => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:41.187874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997625cf-b5e8-4c4e-a38b-23d4ec28279e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:41.189765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-997625cf-b5e8-4c4e-a38b-23d4ec28279e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:41.196284 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2770/5571] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:41 2022] GET /identity/v3/roles => generated 2324 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:41.199988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62119c0b-f75e-4c9a-88cb-ac32f248bae6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:41.199988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62119c0b-f75e-4c9a-88cb-ac32f248bae6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:41.199988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62119c0b-f75e-4c9a-88cb-ac32f248bae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:41.231554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-62119c0b-f75e-4c9a-88cb-ac32f248bae6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:41.233651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-62119c0b-f75e-4c9a-88cb-ac32f248bae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:41.312825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997625cf-b5e8-4c4e-a38b-23d4ec28279e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:41.318773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08906f6-33eb-4f47-b856-f630b6420647 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:41.319435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08906f6-33eb-4f47-b856-f630b6420647 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:41.319718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08906f6-33eb-4f47-b856-f630b6420647 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:41.319998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08906f6-33eb-4f47-b856-f630b6420647 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:41.322064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08906f6-33eb-4f47-b856-f630b6420647 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:41.327484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08906f6-33eb-4f47-b856-f630b6420647 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:41.348395 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2771/5572] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:41.350004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62119c0b-f75e-4c9a-88cb-ac32f248bae6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:41.352963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-62119c0b-f75e-4c9a-88cb-ac32f248bae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:41.367569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62119c0b-f75e-4c9a-88cb-ac32f248bae6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:41.374691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d70877-cd52-4c3f-845d-7429cb031ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:41.375181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d70877-cd52-4c3f-845d-7429cb031ceb admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:41.375464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d70877-cd52-4c3f-845d-7429cb031ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:41.375741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d70877-cd52-4c3f-845d-7429cb031ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:41.376460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d70877-cd52-4c3f-845d-7429cb031ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:41.378441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d70877-cd52-4c3f-845d-7429cb031ceb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:41.437715 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2802/5573] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:51:41 2022] POST /identity/v3/roles => generated 270 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:41.438534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08906f6-33eb-4f47-b856-f630b6420647 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:41.443328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d08906f6-33eb-4f47-b856-f630b6420647 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:41.533158 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2772/5574] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:41 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:41.534325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d70877-cd52-4c3f-845d-7429cb031ceb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:41.540044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d2d70877-cd52-4c3f-845d-7429cb031ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:41.592796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08906f6-33eb-4f47-b856-f630b6420647 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:41.672686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:41.697965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '756676c5bd2b4fcb981d386f81f53469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76e49a8527f9424a98c5871576973cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:41.698744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:41.700265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:41.700627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] PATH_INFO: `/v3/projects/e2b595b4e073485fa78857d395fb7b58` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:41.702066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e2b595b4e073485fa78857d395fb7b58)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:41.709535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d70877-cd52-4c3f-845d-7429cb031ceb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:41.712107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:41.727305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dbb3f-eed2-48bf-b72b-9398b34eaac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:41.728139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dbb3f-eed2-48bf-b72b-9398b34eaac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:41.728527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dbb3f-eed2-48bf-b72b-9398b34eaac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:41.728876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dbb3f-eed2-48bf-b72b-9398b34eaac0 admin admin] PATH_INFO: `/v3/projects/0e490bef1fb4425cb00bc508165626fd/users/2dbd274a4c0243ecb81e238288d3893e/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:41.752094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874dbb3f-eed2-48bf-b72b-9398b34eaac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e490bef1fb4425cb00bc508165626fd, user_id=2dbd274a4c0243ecb81e238288d3893e, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:41.755268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874dbb3f-eed2-48bf-b72b-9398b34eaac0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:41.806598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:41.838930 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2773/5575] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:41 2022] PUT /identity/v3/projects/0e490bef1fb4425cb00bc508165626fd/users/2dbd274a4c0243ecb81e238288d3893e/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:41.838930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346002cd-a90f-47c7-9c18-047465b2be51 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:41.838930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346002cd-a90f-47c7-9c18-047465b2be51 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:41.838930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346002cd-a90f-47c7-9c18-047465b2be51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:41.889804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-346002cd-a90f-47c7-9c18-047465b2be51 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:41.891061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-346002cd-a90f-47c7-9c18-047465b2be51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:42.010339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b595b4e073485fa78857d395fb7b58', 'request_id': 'req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:42.020038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b595b4e073485fa78857d395fb7b58', 'request_id': 'req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:42.044430 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2774/5576] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:42.045291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346002cd-a90f-47c7-9c18-047465b2be51 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:42.184735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b595b4e073485fa78857d395fb7b58', 'request_id': 'req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:42.215174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] The token cache is being invalidate because project e2b595b4e073485fa78857d395fb7b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:42.216462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:42.218831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:42.222574 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2803/5577] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:41 2022] DELETE /identity/v3/projects/e2b595b4e073485fa78857d395fb7b58 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:42.228313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:42.230054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346002cd-a90f-47c7-9c18-047465b2be51 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:42.231564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:42.236875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07786f7-c8c6-4a7f-bb3e-5377426afe82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:42.237558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07786f7-c8c6-4a7f-bb3e-5377426afe82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:42.237921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07786f7-c8c6-4a7f-bb3e-5377426afe82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:42.238211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07786f7-c8c6-4a7f-bb3e-5377426afe82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/c44465b759ba4ab4a29dfd59846d61a1/implies/7e20555c73544a17af4886643a43800a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:42.243470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07786f7-c8c6-4a7f-bb3e-5377426afe82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c44465b759ba4ab4a29dfd59846d61a1, implied_role_id=7e20555c73544a17af4886643a43800a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:42.244576 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-c07786f7-c8c6-4a7f-bb3e-5377426afe82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:42.244576 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:42.244576 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:42.245482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07786f7-c8c6-4a7f-bb3e-5377426afe82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:42.268123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594ff26-1e2f-43eb-b3b6-f8138bf9836e tempest-TrustsV3TestJSON-1976621983 tempest-TrustsV3TestJSON-1976621983-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:42.280075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beea5d0-9d06-46b7-a18b-28492bc6f940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:42.280767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea5d0-9d06-46b7-a18b-28492bc6f940 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:42.281043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea5d0-9d06-46b7-a18b-28492bc6f940 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:42.281440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea5d0-9d06-46b7-a18b-28492bc6f940 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:42.281949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beea5d0-9d06-46b7-a18b-28492bc6f940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:42.288363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beea5d0-9d06-46b7-a18b-28492bc6f940 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:42.343940 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2775/5578] 10.222.0.76 () {60 vars in 1363 bytes} [Sat Aug 27 04:51:42 2022] PUT /identity/v3/roles/c44465b759ba4ab4a29dfd59846d61a1/implies/7e20555c73544a17af4886643a43800a => generated 531 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:42.345785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab971ccd-1e1b-4043-bc6b-e20b8c066b3b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:42.346068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab971ccd-1e1b-4043-bc6b-e20b8c066b3b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:42.346339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab971ccd-1e1b-4043-bc6b-e20b8c066b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:42.368043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ab971ccd-1e1b-4043-bc6b-e20b8c066b3b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:42.368331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ab971ccd-1e1b-4043-bc6b-e20b8c066b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:42.427261 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2804/5579] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:42 2022] POST /identity/v3/users => generated 299 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:42.431255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beea5d0-9d06-46b7-a18b-28492bc6f940 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:42.433985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6beea5d0-9d06-46b7-a18b-28492bc6f940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:42.437898 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2776/5580] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:42.439334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab971ccd-1e1b-4043-bc6b-e20b8c066b3b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:42.445214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ab971ccd-1e1b-4043-bc6b-e20b8c066b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:42.462536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beea5d0-9d06-46b7-a18b-28492bc6f940 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:42.464597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab971ccd-1e1b-4043-bc6b-e20b8c066b3b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:42.472092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed52286-ca24-4394-b9ee-1f7d34622213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:42.472328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8e29b-bc08-4371-9183-74ba2e0cac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:42.473330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed52286-ca24-4394-b9ee-1f7d34622213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:42.473330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed52286-ca24-4394-b9ee-1f7d34622213 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:42.473620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed52286-ca24-4394-b9ee-1f7d34622213 admin admin] PATH_INFO: `/v3/users/92053b7c7a4f4317944e018f656fda76` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:42.475149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed52286-ca24-4394-b9ee-1f7d34622213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92053b7c7a4f4317944e018f656fda76)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:42.475535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8e29b-bc08-4371-9183-74ba2e0cac90 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:42.477974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8e29b-bc08-4371-9183-74ba2e0cac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:42.478628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8e29b-bc08-4371-9183-74ba2e0cac90 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:42.479858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8e29b-bc08-4371-9183-74ba2e0cac90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:42.480257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed52286-ca24-4394-b9ee-1f7d34622213 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:42.481309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8e29b-bc08-4371-9183-74ba2e0cac90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:42.483502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8e29b-bc08-4371-9183-74ba2e0cac90 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:42.502722 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2805/5581] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:42.504922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8e29b-bc08-4371-9183-74ba2e0cac90 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:42.513232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c6c8e29b-bc08-4371-9183-74ba2e0cac90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:42.630919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8e29b-bc08-4371-9183-74ba2e0cac90 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:42.643979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb5119-8c8c-4002-b3e1-c5986a4d30a5 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:42.644912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb5119-8c8c-4002-b3e1-c5986a4d30a5 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:42.645457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb5119-8c8c-4002-b3e1-c5986a4d30a5 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:42.645981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb5119-8c8c-4002-b3e1-c5986a4d30a5 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:42.648037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb5119-8c8c-4002-b3e1-c5986a4d30a5 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:42.649815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb5119-8c8c-4002-b3e1-c5986a4d30a5 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:42.818385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8ed52286-ca24-4394-b9ee-1f7d34622213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92053b7c7a4f4317944e018f656fda76'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:42.844745 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2806/5582] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:51:42 2022] POST /identity/v3/domains => generated 276 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:42.844745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb5119-8c8c-4002-b3e1-c5986a4d30a5 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:42.943579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8ed52286-ca24-4394-b9ee-1f7d34622213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92053b7c7a4f4317944e018f656fda76'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:42.945525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8ed52286-ca24-4394-b9ee-1f7d34622213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92053b7c7a4f4317944e018f656fda76'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:42.954500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8ed52286-ca24-4394-b9ee-1f7d34622213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92053b7c7a4f4317944e018f656fda76'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:42.957168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb5119-8c8c-4002-b3e1-c5986a4d30a5 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:42.967895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d22d6-1143-4b78-97c7-855bc0128d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:42.970804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d22d6-1143-4b78-97c7-855bc0128d33 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:42.970804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d22d6-1143-4b78-97c7-855bc0128d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:42.970804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d22d6-1143-4b78-97c7-855bc0128d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:42.971510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d22d6-1143-4b78-97c7-855bc0128d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:42.974116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d22d6-1143-4b78-97c7-855bc0128d33 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:42.978880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8ed52286-ca24-4394-b9ee-1f7d34622213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92053b7c7a4f4317944e018f656fda76'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:42.982609 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2777/5583] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:42 2022] DELETE /identity/v3/users/92053b7c7a4f4317944e018f656fda76 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:42.986241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed52286-ca24-4394-b9ee-1f7d34622213 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:42.986241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8ed52286-ca24-4394-b9ee-1f7d34622213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:42.993322 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2807/5584] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:42 2022] GET /identity/v3/roles => generated 2324 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:42.994144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d22d6-1143-4b78-97c7-855bc0128d33 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:42.997219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b13d22d6-1143-4b78-97c7-855bc0128d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:43.016244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d22d6-1143-4b78-97c7-855bc0128d33 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:43.073206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed52286-ca24-4394-b9ee-1f7d34622213 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:43.084144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df62e1-2dc1-4b56-90c0-fbe0302abb6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:43.085114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df62e1-2dc1-4b56-90c0-fbe0302abb6e service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:43.085419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df62e1-2dc1-4b56-90c0-fbe0302abb6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:43.085740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df62e1-2dc1-4b56-90c0-fbe0302abb6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:43.088029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d5ae2-4e53-4d11-a918-ee02b0795b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:43.088300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d5df62e1-2dc1-4b56-90c0-fbe0302abb6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:43.089163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d5ae2-4e53-4d11-a918-ee02b0795b1f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:43.089163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d5ae2-4e53-4d11-a918-ee02b0795b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:43.089367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d5ae2-4e53-4d11-a918-ee02b0795b1f admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:43.089878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d5ae2-4e53-4d11-a918-ee02b0795b1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:43.091822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d5ae2-4e53-4d11-a918-ee02b0795b1f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:43.104034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df62e1-2dc1-4b56-90c0-fbe0302abb6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:43.120111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df62e1-2dc1-4b56-90c0-fbe0302abb6e service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:43.120111 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2778/5585] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:43.120111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df62e1-2dc1-4b56-90c0-fbe0302abb6e service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:43.120111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d5df62e1-2dc1-4b56-90c0-fbe0302abb6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:43.218372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df62e1-2dc1-4b56-90c0-fbe0302abb6e service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:43.227593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687949c4-ba6f-4a45-a5cf-6f6fbc40712d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:43.228610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687949c4-ba6f-4a45-a5cf-6f6fbc40712d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:43.229074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687949c4-ba6f-4a45-a5cf-6f6fbc40712d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:43.229631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687949c4-ba6f-4a45-a5cf-6f6fbc40712d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:43.230496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687949c4-ba6f-4a45-a5cf-6f6fbc40712d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:43.233327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687949c4-ba6f-4a45-a5cf-6f6fbc40712d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:43.270549 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2808/5586] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:42 2022] POST /identity/v3/projects => generated 361 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:43.274505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbe3fe-063b-4cdb-ab6e-f3ad3c441d92 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:43.274797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbe3fe-063b-4cdb-ab6e-f3ad3c441d92 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:43.275086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbe3fe-063b-4cdb-ab6e-f3ad3c441d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:43.313764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-79dbe3fe-063b-4cdb-ab6e-f3ad3c441d92 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:43.313764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-79dbe3fe-063b-4cdb-ab6e-f3ad3c441d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:43.385012 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2779/5587] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:51:43 2022] POST /identity/v3/roles => generated 270 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:43.385012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687949c4-ba6f-4a45-a5cf-6f6fbc40712d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:43.396648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-687949c4-ba6f-4a45-a5cf-6f6fbc40712d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:43.407264 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2809/5588] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:43.409395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbe3fe-063b-4cdb-ab6e-f3ad3c441d92 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:43.435983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687949c4-ba6f-4a45-a5cf-6f6fbc40712d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:43.456355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d545054-ee3d-4242-821b-2e36136349ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:43.461084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545054-ee3d-4242-821b-2e36136349ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:43.461965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545054-ee3d-4242-821b-2e36136349ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:43.463043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545054-ee3d-4242-821b-2e36136349ec admin admin] PATH_INFO: `/v3/projects/ce1c1a8538674c29ace05af57b818d15/users/0b30e52024c4456993685169431316bd/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:43.513364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbe3fe-063b-4cdb-ab6e-f3ad3c441d92 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:43.516054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d545054-ee3d-4242-821b-2e36136349ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c1a8538674c29ace05af57b818d15, user_id=0b30e52024c4456993685169431316bd, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:43.528805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d545054-ee3d-4242-821b-2e36136349ec admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:43.532087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d25fd-cefc-407e-beb0-01d99ac939f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:43.532767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d25fd-cefc-407e-beb0-01d99ac939f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:43.535599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d25fd-cefc-407e-beb0-01d99ac939f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:43.540514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d25fd-cefc-407e-beb0-01d99ac939f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:43.544345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d25fd-cefc-407e-beb0-01d99ac939f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:43.555430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d25fd-cefc-407e-beb0-01d99ac939f9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:43.659383 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2780/5589] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:43 2022] PUT /identity/v3/projects/ce1c1a8538674c29ace05af57b818d15/users/0b30e52024c4456993685169431316bd/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:43.663985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d545054-ee3d-4242-821b-2e36136349ec admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:43.713057 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2810/5590] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:43 2022] POST /identity/v3/users => generated 281 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:43.714705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d25fd-cefc-407e-beb0-01d99ac939f9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:43.726241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-913d25fd-cefc-407e-beb0-01d99ac939f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:43.908506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d545054-ee3d-4242-821b-2e36136349ec admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:43.948090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9cd24-6d79-497f-b6c9-f387140c732b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:43.949102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9cd24-6d79-497f-b6c9-f387140c732b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:43.949457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9cd24-6d79-497f-b6c9-f387140c732b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:43.949745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9cd24-6d79-497f-b6c9-f387140c732b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/c44465b759ba4ab4a29dfd59846d61a1/implies/a8e33b61027c4f5bb8d9c5927546bfbe` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:43.966797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9cd24-6d79-497f-b6c9-f387140c732b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c44465b759ba4ab4a29dfd59846d61a1, implied_role_id=a8e33b61027c4f5bb8d9c5927546bfbe)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:43.968571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9cd24-6d79-497f-b6c9-f387140c732b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:43.980442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d25fd-cefc-407e-beb0-01d99ac939f9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:44.027317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:44.126127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27554b-278a-4e21-8883-ee0a8e296102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:44.126127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27554b-278a-4e21-8883-ee0a8e296102 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:44.126127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27554b-278a-4e21-8883-ee0a8e296102 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:44.126127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27554b-278a-4e21-8883-ee0a8e296102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:44.197713 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2781/5591] 10.222.0.76 () {60 vars in 1363 bytes} [Sat Aug 27 04:51:43 2022] PUT /identity/v3/roles/c44465b759ba4ab4a29dfd59846d61a1/implies/a8e33b61027c4f5bb8d9c5927546bfbe => generated 531 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:44.197713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9cd24-6d79-497f-b6c9-f387140c732b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:44.295168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27554b-278a-4e21-8883-ee0a8e296102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:44.297325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27554b-278a-4e21-8883-ee0a8e296102 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:44.312931 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2811/5592] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:44.313813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27554b-278a-4e21-8883-ee0a8e296102 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:44.325725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27554b-278a-4e21-8883-ee0a8e296102 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:44.377778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9cd24-6d79-497f-b6c9-f387140c732b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:44.390102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d22713-e8bb-4753-b5d3-3ed29630b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:44.391171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d22713-e8bb-4753-b5d3-3ed29630b245 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:44.392999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d22713-e8bb-4753-b5d3-3ed29630b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:44.393680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d22713-e8bb-4753-b5d3-3ed29630b245 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:44.395779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d22713-e8bb-4753-b5d3-3ed29630b245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:44.400967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d22713-e8bb-4753-b5d3-3ed29630b245 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:44.403767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea27efa-36d6-4be0-b95a-2e5898acba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:44.404840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea27efa-36d6-4be0-b95a-2e5898acba5c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:44.405122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea27efa-36d6-4be0-b95a-2e5898acba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:44.408640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea27efa-36d6-4be0-b95a-2e5898acba5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:44.409378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea27efa-36d6-4be0-b95a-2e5898acba5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:44.411409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea27efa-36d6-4be0-b95a-2e5898acba5c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:44.432187 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2812/5593] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:44 2022] GET /identity/v3/roles => generated 2324 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:44.433144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea27efa-36d6-4be0-b95a-2e5898acba5c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:44.445774 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2782/5594] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:44 2022] GET /identity/v3/roles => generated 2324 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:44.446789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d22713-e8bb-4753-b5d3-3ed29630b245 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:44.474461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d22713-e8bb-4753-b5d3-3ed29630b245 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:44.496737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805959a6-aa05-4ea6-830d-29e55141c69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:44.497932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805959a6-aa05-4ea6-830d-29e55141c69b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:44.498415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805959a6-aa05-4ea6-830d-29e55141c69b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:44.498856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805959a6-aa05-4ea6-830d-29e55141c69b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:44.500035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805959a6-aa05-4ea6-830d-29e55141c69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:44.501909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805959a6-aa05-4ea6-830d-29e55141c69b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:44.555189 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2783/5595] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:44 2022] GET /identity/v3/roles => generated 2324 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:44.555189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805959a6-aa05-4ea6-830d-29e55141c69b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:44.576205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805959a6-aa05-4ea6-830d-29e55141c69b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:44.577958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea27efa-36d6-4be0-b95a-2e5898acba5c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:44.597348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc71a02-aabe-4d76-a53f-40fb22d2a7cc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:44.598038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc71a02-aabe-4d76-a53f-40fb22d2a7cc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:44.598321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc71a02-aabe-4d76-a53f-40fb22d2a7cc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:44.598692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881d3d4-1010-4c4e-ac88-ec491d050923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:44.599549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881d3d4-1010-4c4e-ac88-ec491d050923 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:44.599999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881d3d4-1010-4c4e-ac88-ec491d050923 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:44.601043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc71a02-aabe-4d76-a53f-40fb22d2a7cc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/c44465b759ba4ab4a29dfd59846d61a1/implies/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:44.602094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881d3d4-1010-4c4e-ac88-ec491d050923 admin admin] PATH_INFO: `/v3/projects/ce1c1a8538674c29ace05af57b818d15/users/0b30e52024c4456993685169431316bd/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:44.605406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc71a02-aabe-4d76-a53f-40fb22d2a7cc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c44465b759ba4ab4a29dfd59846d61a1, implied_role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:44.606339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881d3d4-1010-4c4e-ac88-ec491d050923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c1a8538674c29ace05af57b818d15, user_id=0b30e52024c4456993685169431316bd, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:44.610223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc71a02-aabe-4d76-a53f-40fb22d2a7cc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:44.611670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881d3d4-1010-4c4e-ac88-ec491d050923 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:44.651154 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2784/5596] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:44 2022] PUT /identity/v3/projects/ce1c1a8538674c29ace05af57b818d15/users/0b30e52024c4456993685169431316bd/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:44.652695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881d3d4-1010-4c4e-ac88-ec491d050923 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:44.713284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:44.748409 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2813/5597] 10.222.0.76 () {60 vars in 1363 bytes} [Sat Aug 27 04:51:44 2022] PUT /identity/v3/roles/c44465b759ba4ab4a29dfd59846d61a1/implies/959d409c289a4ad1b4ceeea047bb8036 => generated 526 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:44.752056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c745f-174f-47f4-9d74-493811e64c0e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:44.752673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c745f-174f-47f4-9d74-493811e64c0e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:44.754516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c745f-174f-47f4-9d74-493811e64c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:44.841139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4e6c745f-174f-47f4-9d74-493811e64c0e None None] MFA Rules not processed for user `0b30e52024c4456993685169431316bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:44.845613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4e6c745f-174f-47f4-9d74-493811e64c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:44.878118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881d3d4-1010-4c4e-ac88-ec491d050923 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:45.027225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34feed59-94f7-4921-961f-9fbec4b98121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:45.027924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feed59-94f7-4921-961f-9fbec4b98121 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:45.028238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feed59-94f7-4921-961f-9fbec4b98121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:45.028523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feed59-94f7-4921-961f-9fbec4b98121 admin admin] PATH_INFO: `/v3/projects/88383306a1174445a1e8eb1cddd47ea7/users/893056291dbb46deb755bcdf9ae77f75/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:45.040925 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2814/5598] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:45.042474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c745f-174f-47f4-9d74-493811e64c0e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:45.071442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34feed59-94f7-4921-961f-9fbec4b98121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88383306a1174445a1e8eb1cddd47ea7, user_id=893056291dbb46deb755bcdf9ae77f75, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:45.074879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34feed59-94f7-4921-961f-9fbec4b98121 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:45.181297 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2785/5599] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:44 2022] PUT /identity/v3/projects/88383306a1174445a1e8eb1cddd47ea7/users/893056291dbb46deb755bcdf9ae77f75/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:45.182270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34feed59-94f7-4921-961f-9fbec4b98121 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:45.204216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c745f-174f-47f4-9d74-493811e64c0e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:45.319018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52372ff-34e8-4e83-aacb-6d258aa0e4b7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:45.319944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52372ff-34e8-4e83-aacb-6d258aa0e4b7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:45.320257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52372ff-34e8-4e83-aacb-6d258aa0e4b7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:45.321260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52372ff-34e8-4e83-aacb-6d258aa0e4b7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/959d409c289a4ad1b4ceeea047bb8036/implies/c44465b759ba4ab4a29dfd59846d61a1` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:45.323285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52372ff-34e8-4e83-aacb-6d258aa0e4b7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=959d409c289a4ad1b4ceeea047bb8036, implied_role_id=c44465b759ba4ab4a29dfd59846d61a1)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:45.325285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52372ff-34e8-4e83-aacb-6d258aa0e4b7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:45.360911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-a52372ff-34e8-4e83-aacb-6d258aa0e4b7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] c44465b759ba4ab4a29dfd59846d61a1 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: c44465b759ba4ab4a29dfd59846d61a1 cannot be an implied roles. Aug 27 04:51:45.360911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:45.360911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:45.360911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:45.360911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:45.360911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:45.360911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:45.360911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:45.360911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:45.360911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:45.360911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:45.360911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:45.360911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Aug 27 04:51:45.360911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Aug 27 04:51:45.362291 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:51:45.362291 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:51:45.362291 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Aug 27 04:51:45.362291 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Aug 27 04:51:45.362291 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: c44465b759ba4ab4a29dfd59846d61a1 cannot be an implied roles. Aug 27 04:51:45.362291 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:51:45.364189 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2815/5600] 10.222.0.76 () {60 vars in 1363 bytes} [Sat Aug 27 04:51:45 2022] PUT /identity/v3/roles/959d409c289a4ad1b4ceeea047bb8036/implies/c44465b759ba4ab4a29dfd59846d61a1 => generated 116 bytes in 323 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:51:45.365572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba96057-f9dc-4b49-aee1-18a2f1b2a6bc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:45.366015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba96057-f9dc-4b49-aee1-18a2f1b2a6bc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:45.366399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba96057-f9dc-4b49-aee1-18a2f1b2a6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:45.376696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34feed59-94f7-4921-961f-9fbec4b98121 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:45.389147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f7b23-0633-43f4-925d-fd2ea0924d5a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30e52024c4456993685169431316bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c1a8538674c29ace05af57b818d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:45.389615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f7b23-0633-43f4-925d-fd2ea0924d5a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:45.389904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f7b23-0633-43f4-925d-fd2ea0924d5a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:45.390186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f7b23-0633-43f4-925d-fd2ea0924d5a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:45.390996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f7b23-0633-43f4-925d-fd2ea0924d5a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:45.392963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f7b23-0633-43f4-925d-fd2ea0924d5a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:45.425363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3ba96057-f9dc-4b49-aee1-18a2f1b2a6bc None None] MFA Rules not processed for user `893056291dbb46deb755bcdf9ae77f75`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:45.428816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3ba96057-f9dc-4b49-aee1-18a2f1b2a6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:45.585668 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2786/5601] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:45 2022] POST /identity/v3/projects => generated 359 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:45.585668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f7b23-0633-43f4-925d-fd2ea0924d5a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:45.593152 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2816/5602] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:45.595003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba96057-f9dc-4b49-aee1-18a2f1b2a6bc None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:45.623549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba96057-f9dc-4b49-aee1-18a2f1b2a6bc None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:45.729413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f7b23-0633-43f4-925d-fd2ea0924d5a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:45.736023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0edb7-85de-484e-97bb-acf9108c7589 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:45.736834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0edb7-85de-484e-97bb-acf9108c7589 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:45.737189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0edb7-85de-484e-97bb-acf9108c7589 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:45.737539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0edb7-85de-484e-97bb-acf9108c7589 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/c44465b759ba4ab4a29dfd59846d61a1/implies/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:45.739828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0edb7-85de-484e-97bb-acf9108c7589 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c44465b759ba4ab4a29dfd59846d61a1, implied_role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:45.742267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0edb7-85de-484e-97bb-acf9108c7589 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:45.745514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ff17a-f71c-4365-af43-ae634aff2d35 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30e52024c4456993685169431316bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c1a8538674c29ace05af57b818d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:45.749881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ff17a-f71c-4365-af43-ae634aff2d35 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:45.750877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ff17a-f71c-4365-af43-ae634aff2d35 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:45.751661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ff17a-f71c-4365-af43-ae634aff2d35 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] PATH_INFO: `/v3/projects/524738e2d8fa4a98a60facefdc8c9254/tags/tempest-tag-1233818970` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:45.754738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ff17a-f71c-4365-af43-ae634aff2d35 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=524738e2d8fa4a98a60facefdc8c9254, value=tempest-tag-1233818970)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:45.760335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ff17a-f71c-4365-af43-ae634aff2d35 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:45.834021 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2787/5603] 10.222.0.76 () {58 vars in 1347 bytes} [Sat Aug 27 04:51:45 2022] DELETE /identity/v3/roles/c44465b759ba4ab4a29dfd59846d61a1/implies/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:45.836393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0edb7-85de-484e-97bb-acf9108c7589 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:45.972812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0edb7-85de-484e-97bb-acf9108c7589 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:45.978435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08094f6d-a366-4845-a64d-ad302595e82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:45.979282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08094f6d-a366-4845-a64d-ad302595e82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:45.980188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08094f6d-a366-4845-a64d-ad302595e82b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:45.980188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08094f6d-a366-4845-a64d-ad302595e82b admin admin] PATH_INFO: `/v3/users/893056291dbb46deb755bcdf9ae77f75` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:45.981514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08094f6d-a366-4845-a64d-ad302595e82b admin admin] RBAC: Authorizing `identity:delete_user(user_id=893056291dbb46deb755bcdf9ae77f75)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:45.983701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08094f6d-a366-4845-a64d-ad302595e82b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:45.996820 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-150ff17a-f71c-4365-af43-ae634aff2d35 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1233818970. To ensure interoperability, identifiers should be a valid uuid. Aug 27 04:51:45.996820 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 27 04:51:45.996820 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:46.011506 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2817/5604] 10.222.0.76 () {60 vars in 1333 bytes} [Sat Aug 27 04:51:45 2022] PUT /identity/v3/projects/524738e2d8fa4a98a60facefdc8c9254/tags/tempest-tag-1233818970 => generated 0 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Aug 27 04:51:46.012992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ff17a-f71c-4365-af43-ae634aff2d35 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:46.051989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ff17a-f71c-4365-af43-ae634aff2d35 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:46.179033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:46.188778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f010a3f-0992-4a03-b824-d2983e3a0a54 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:46.191285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f010a3f-0992-4a03-b824-d2983e3a0a54 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:46.191706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f010a3f-0992-4a03-b824-d2983e3a0a54 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:46.192310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f010a3f-0992-4a03-b824-d2983e3a0a54 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/c44465b759ba4ab4a29dfd59846d61a1/implies/a8e33b61027c4f5bb8d9c5927546bfbe` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:46.194738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f010a3f-0992-4a03-b824-d2983e3a0a54 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c44465b759ba4ab4a29dfd59846d61a1, implied_role_id=a8e33b61027c4f5bb8d9c5927546bfbe)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:46.199850 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-1f010a3f-0992-4a03-b824-d2983e3a0a54 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:46.199850 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:46.199850 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:46.199850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f010a3f-0992-4a03-b824-d2983e3a0a54 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:46.280181 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2818/5605] 10.222.0.76 () {58 vars in 1347 bytes} [Sat Aug 27 04:51:46 2022] DELETE /identity/v3/roles/c44465b759ba4ab4a29dfd59846d61a1/implies/a8e33b61027c4f5bb8d9c5927546bfbe => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:46.281127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f010a3f-0992-4a03-b824-d2983e3a0a54 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:46.324835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-08094f6d-a366-4845-a64d-ad302595e82b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893056291dbb46deb755bcdf9ae77f75'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:46.433099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f010a3f-0992-4a03-b824-d2983e3a0a54 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:46.434327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-08094f6d-a366-4845-a64d-ad302595e82b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893056291dbb46deb755bcdf9ae77f75'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:46.435209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-08094f6d-a366-4845-a64d-ad302595e82b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893056291dbb46deb755bcdf9ae77f75'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:46.444528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-08094f6d-a366-4845-a64d-ad302595e82b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893056291dbb46deb755bcdf9ae77f75'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:46.445325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63bd39-15d1-4e20-8da4-35cf7f057583 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30e52024c4456993685169431316bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c1a8538674c29ace05af57b818d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:46.445998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63bd39-15d1-4e20-8da4-35cf7f057583 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:46.446289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63bd39-15d1-4e20-8da4-35cf7f057583 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:46.447374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63bd39-15d1-4e20-8da4-35cf7f057583 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] PATH_INFO: `/v3/projects/524738e2d8fa4a98a60facefdc8c9254/tags/tempest-tag-1233818970` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:46.475874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-08094f6d-a366-4845-a64d-ad302595e82b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893056291dbb46deb755bcdf9ae77f75'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:46.476014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63bd39-15d1-4e20-8da4-35cf7f057583 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=524738e2d8fa4a98a60facefdc8c9254, value=tempest-tag-1233818970)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:46.479561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63bd39-15d1-4e20-8da4-35cf7f057583 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:46.494781 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2788/5606] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:45 2022] DELETE /identity/v3/users/893056291dbb46deb755bcdf9ae77f75 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:46.495818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08094f6d-a366-4845-a64d-ad302595e82b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:46.499257 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2819/5607] 10.222.0.76 () {58 vars in 1314 bytes} [Sat Aug 27 04:51:46 2022] GET /identity/v3/projects/524738e2d8fa4a98a60facefdc8c9254/tags/tempest-tag-1233818970 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:46.499257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63bd39-15d1-4e20-8da4-35cf7f057583 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:46.500658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dd63bd39-15d1-4e20-8da4-35cf7f057583 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:46.501692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-08094f6d-a366-4845-a64d-ad302595e82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:46.622173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08094f6d-a366-4845-a64d-ad302595e82b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:46.637581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae076f89-2c00-41db-a6b7-adc62f5485cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:46.638619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076f89-2c00-41db-a6b7-adc62f5485cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:46.639082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076f89-2c00-41db-a6b7-adc62f5485cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:46.639500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076f89-2c00-41db-a6b7-adc62f5485cf admin admin] PATH_INFO: `/v3/projects/4abf602299dd4fa298aed54d64976f7d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:46.640867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae076f89-2c00-41db-a6b7-adc62f5485cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4abf602299dd4fa298aed54d64976f7d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:46.657225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae076f89-2c00-41db-a6b7-adc62f5485cf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:46.670989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63bd39-15d1-4e20-8da4-35cf7f057583 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:46.785285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedb899-39f3-4c27-be13-fa531325410a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:46.786303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedb899-39f3-4c27-be13-fa531325410a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:46.786852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedb899-39f3-4c27-be13-fa531325410a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:46.787611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedb899-39f3-4c27-be13-fa531325410a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/a8e33b61027c4f5bb8d9c5927546bfbe` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:46.789822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedb899-39f3-4c27-be13-fa531325410a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=a8e33b61027c4f5bb8d9c5927546bfbe)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:46.793697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedb899-39f3-4c27-be13-fa531325410a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:46.815122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:46.889993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ae076f89-2c00-41db-a6b7-adc62f5485cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4abf602299dd4fa298aed54d64976f7d', 'request_id': 'req-ae076f89-2c00-41db-a6b7-adc62f5485cf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:46.902844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ae076f89-2c00-41db-a6b7-adc62f5485cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4abf602299dd4fa298aed54d64976f7d', 'request_id': 'req-ae076f89-2c00-41db-a6b7-adc62f5485cf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:46.925013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ae076f89-2c00-41db-a6b7-adc62f5485cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4abf602299dd4fa298aed54d64976f7d', 'request_id': 'req-ae076f89-2c00-41db-a6b7-adc62f5485cf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:46.981212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9cedb899-39f3-4c27-be13-fa531325410a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invalidating the token cache because role a8e33b61027c4f5bb8d9c5927546bfbe has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:46.982385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9cedb899-39f3-4c27-be13-fa531325410a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:46.984848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9cedb899-39f3-4c27-be13-fa531325410a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:46.991036 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2820/5608] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:46 2022] DELETE /identity/v3/roles/a8e33b61027c4f5bb8d9c5927546bfbe => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:46.991036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60832ece-1735-4ea7-9060-a60b2a32cccb None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:46.991036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60832ece-1735-4ea7-9060-a60b2a32cccb None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:46.991036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60832ece-1735-4ea7-9060-a60b2a32cccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:47.019402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-60832ece-1735-4ea7-9060-a60b2a32cccb None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:47.020803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-60832ece-1735-4ea7-9060-a60b2a32cccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:47.066375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ae076f89-2c00-41db-a6b7-adc62f5485cf admin admin] The token cache is being invalidate because project 4abf602299dd4fa298aed54d64976f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:47.066721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ae076f89-2c00-41db-a6b7-adc62f5485cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:47.067650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ae076f89-2c00-41db-a6b7-adc62f5485cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:47.073223 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2789/5609] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:46 2022] DELETE /identity/v3/projects/4abf602299dd4fa298aed54d64976f7d => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:47.073223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae076f89-2c00-41db-a6b7-adc62f5485cf admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:47.076745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ae076f89-2c00-41db-a6b7-adc62f5485cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:47.117428 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2821/5610] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:47.118722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60832ece-1735-4ea7-9060-a60b2a32cccb None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:47.120495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-60832ece-1735-4ea7-9060-a60b2a32cccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:47.191672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae076f89-2c00-41db-a6b7-adc62f5485cf admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:47.227784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60832ece-1735-4ea7-9060-a60b2a32cccb None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:47.234867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe6ad8-cdd0-4eec-9d6b-e76e1addf4bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:47.235782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6ad8-cdd0-4eec-9d6b-e76e1addf4bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:47.236203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6ad8-cdd0-4eec-9d6b-e76e1addf4bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:47.236660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6ad8-cdd0-4eec-9d6b-e76e1addf4bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/domains/5bb40926ffa84146bb5a61230113b37e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:47.253529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe6ad8-cdd0-4eec-9d6b-e76e1addf4bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5bb40926ffa84146bb5a61230113b37e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:47.255538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe6ad8-cdd0-4eec-9d6b-e76e1addf4bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:47.314124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7ebe6ad8-cdd0-4eec-9d6b-e76e1addf4bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5bb40926ffa84146bb5a61230113b37e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:47.315588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7ebe6ad8-cdd0-4eec-9d6b-e76e1addf4bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5bb40926ffa84146bb5a61230113b37e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:47.338294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8a019-33f9-4ace-bfe0-27779b30769e tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30e52024c4456993685169431316bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c1a8538674c29ace05af57b818d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:47.338955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8a019-33f9-4ace-bfe0-27779b30769e tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:47.339249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8a019-33f9-4ace-bfe0-27779b30769e tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:47.339535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8a019-33f9-4ace-bfe0-27779b30769e tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] PATH_INFO: `/v3/projects/524738e2d8fa4a98a60facefdc8c9254/tags` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:47.341036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8a019-33f9-4ace-bfe0-27779b30769e tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=524738e2d8fa4a98a60facefdc8c9254)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:47.344023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8a019-33f9-4ace-bfe0-27779b30769e tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:47.465672 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2790/5611] 10.222.0.76 () {60 vars in 1265 bytes} [Sat Aug 27 04:51:47 2022] PUT /identity/v3/projects/524738e2d8fa4a98a60facefdc8c9254/tags => generated 140 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:47.466906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8a019-33f9-4ace-bfe0-27779b30769e tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:47.469463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-40f8a019-33f9-4ace-bfe0-27779b30769e tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:47.474967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7ebe6ad8-cdd0-4eec-9d6b-e76e1addf4bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5bb40926ffa84146bb5a61230113b37e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:47.476927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7ebe6ad8-cdd0-4eec-9d6b-e76e1addf4bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5bb40926ffa84146bb5a61230113b37e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:47.481610 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2822/5612] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:51:47 2022] PATCH /identity/v3/domains/5bb40926ffa84146bb5a61230113b37e => generated 277 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:47.483708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe6ad8-cdd0-4eec-9d6b-e76e1addf4bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:47.486285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7ebe6ad8-cdd0-4eec-9d6b-e76e1addf4bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:47.515437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8a019-33f9-4ace-bfe0-27779b30769e tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:47.581766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe6ad8-cdd0-4eec-9d6b-e76e1addf4bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:47.586354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2407aa-39bd-4301-abd9-51a72f0096c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:47.587106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2407aa-39bd-4301-abd9-51a72f0096c8 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:47.587485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2407aa-39bd-4301-abd9-51a72f0096c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:47.587828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2407aa-39bd-4301-abd9-51a72f0096c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:47.590324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0c2407aa-39bd-4301-abd9-51a72f0096c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:47.618827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1c22b-9f1a-420b-a4c3-8ffb64c27580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:47.618827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c22b-9f1a-420b-a4c3-8ffb64c27580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:47.618827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c22b-9f1a-420b-a4c3-8ffb64c27580 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:47.618827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c22b-9f1a-420b-a4c3-8ffb64c27580 admin admin] PATH_INFO: `/v3/users/756676c5bd2b4fcb981d386f81f53469` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:47.619549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1c22b-9f1a-420b-a4c3-8ffb64c27580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=756676c5bd2b4fcb981d386f81f53469)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:47.620501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1c22b-9f1a-420b-a4c3-8ffb64c27580 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:47.739755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2407aa-39bd-4301-abd9-51a72f0096c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:47.740450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2407aa-39bd-4301-abd9-51a72f0096c8 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:47.757144 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2823/5613] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:47.759718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2407aa-39bd-4301-abd9-51a72f0096c8 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:47.762136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0c2407aa-39bd-4301-abd9-51a72f0096c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:47.881547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2407aa-39bd-4301-abd9-51a72f0096c8 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:47.886031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e4b1c22b-9f1a-420b-a4c3-8ffb64c27580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756676c5bd2b4fcb981d386f81f53469'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:47.889523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dba18b-9b72-4bf3-bee9-77dc7f7f2113 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30e52024c4456993685169431316bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c1a8538674c29ace05af57b818d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:47.891224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dba18b-9b72-4bf3-bee9-77dc7f7f2113 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:47.891844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dba18b-9b72-4bf3-bee9-77dc7f7f2113 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:47.892423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dba18b-9b72-4bf3-bee9-77dc7f7f2113 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] PATH_INFO: `/v3/projects/524738e2d8fa4a98a60facefdc8c9254/tags` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:47.920021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dba18b-9b72-4bf3-bee9-77dc7f7f2113 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=524738e2d8fa4a98a60facefdc8c9254)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:47.924197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dba18b-9b72-4bf3-bee9-77dc7f7f2113 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:47.952350 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2824/5614] 10.222.0.76 () {58 vars in 1245 bytes} [Sat Aug 27 04:51:47 2022] GET /identity/v3/projects/524738e2d8fa4a98a60facefdc8c9254/tags => generated 140 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:47.954758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dba18b-9b72-4bf3-bee9-77dc7f7f2113 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:47.956417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-41dba18b-9b72-4bf3-bee9-77dc7f7f2113 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:48.000030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e4b1c22b-9f1a-420b-a4c3-8ffb64c27580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756676c5bd2b4fcb981d386f81f53469'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.000030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e4b1c22b-9f1a-420b-a4c3-8ffb64c27580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756676c5bd2b4fcb981d386f81f53469'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.001165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e4b1c22b-9f1a-420b-a4c3-8ffb64c27580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756676c5bd2b4fcb981d386f81f53469'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.022970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e4b1c22b-9f1a-420b-a4c3-8ffb64c27580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756676c5bd2b4fcb981d386f81f53469'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.034182 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2791/5615] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:47 2022] DELETE /identity/v3/users/756676c5bd2b4fcb981d386f81f53469 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:48.035564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1c22b-9f1a-420b-a4c3-8ffb64c27580 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:48.040244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e4b1c22b-9f1a-420b-a4c3-8ffb64c27580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:48.116602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dba18b-9b72-4bf3-bee9-77dc7f7f2113 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:48.180755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1c22b-9f1a-420b-a4c3-8ffb64c27580 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:48.189436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ea9d0-ae6b-4ca7-ac3b-d8d5380e7122 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30e52024c4456993685169431316bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c1a8538674c29ace05af57b818d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:48.190569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ea9d0-ae6b-4ca7-ac3b-d8d5380e7122 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:48.191168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ea9d0-ae6b-4ca7-ac3b-d8d5380e7122 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:48.191621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ea9d0-ae6b-4ca7-ac3b-d8d5380e7122 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] PATH_INFO: `/v3/projects/524738e2d8fa4a98a60facefdc8c9254/tags/tempest-tag-690912861` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:48.193989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ea9d0-ae6b-4ca7-ac3b-d8d5380e7122 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=524738e2d8fa4a98a60facefdc8c9254, value=tempest-tag-690912861)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:48.199746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ea9d0-ae6b-4ca7-ac3b-d8d5380e7122 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:48.248836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:48.249490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:48.253272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:48.253607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/domains/5bb40926ffa84146bb5a61230113b37e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:48.268483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5bb40926ffa84146bb5a61230113b37e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:48.270329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:48.307049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5bb40926ffa84146bb5a61230113b37e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.311200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5bb40926ffa84146bb5a61230113b37e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.329128 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-c04ea9d0-ae6b-4ca7-ac3b-d8d5380e7122 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-690912861. To ensure interoperability, identifiers should be a valid uuid. Aug 27 04:51:48.329128 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 27 04:51:48.329128 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:48.338351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:48.346072 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2792/5616] 10.222.0.76 () {58 vars in 1314 bytes} [Sat Aug 27 04:51:48 2022] DELETE /identity/v3/projects/524738e2d8fa4a98a60facefdc8c9254/tags/tempest-tag-690912861 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:48.349652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ea9d0-ae6b-4ca7-ac3b-d8d5380e7122 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:48.354212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c04ea9d0-ae6b-4ca7-ac3b-d8d5380e7122 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:48.460970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ea9d0-ae6b-4ca7-ac3b-d8d5380e7122 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:48.470374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb88ba-16d4-4d58-88db-abeb508087d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:48.471301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb88ba-16d4-4d58-88db-abeb508087d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:48.472061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb88ba-16d4-4d58-88db-abeb508087d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:48.472236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb88ba-16d4-4d58-88db-abeb508087d9 admin admin] PATH_INFO: `/v3/users/8d1b20251abd45fbb0aa0dbca8209f2e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:48.473755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb88ba-16d4-4d58-88db-abeb508087d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1b20251abd45fbb0aa0dbca8209f2e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:48.477586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb88ba-16d4-4d58-88db-abeb508087d9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:48.576788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bb40926ffa84146bb5a61230113b37e', 'request_id': 'req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.595529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bb40926ffa84146bb5a61230113b37e', 'request_id': 'req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.721074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bb40926ffa84146bb5a61230113b37e', 'request_id': 'req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.744774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] The token cache is being invalidate because project 5bb40926ffa84146bb5a61230113b37e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:48.759077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:48.778611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.795245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.830805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-62fb88ba-16d4-4d58-88db-abeb508087d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1b20251abd45fbb0aa0dbca8209f2e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.841474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5bb40926ffa84146bb5a61230113b37e', 'request_id': 'req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.842208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5bb40926ffa84146bb5a61230113b37e', 'request_id': 'req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.842845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5bb40926ffa84146bb5a61230113b37e', 'request_id': 'req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.856088 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2825/5617] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:51:47 2022] DELETE /identity/v3/domains/5bb40926ffa84146bb5a61230113b37e => generated 0 bytes in 903 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:48.857624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:48.859070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:48.923474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-62fb88ba-16d4-4d58-88db-abeb508087d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1b20251abd45fbb0aa0dbca8209f2e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.924396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-62fb88ba-16d4-4d58-88db-abeb508087d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1b20251abd45fbb0aa0dbca8209f2e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.938150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:48.955834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-62fb88ba-16d4-4d58-88db-abeb508087d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1b20251abd45fbb0aa0dbca8209f2e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:48.989441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-62fb88ba-16d4-4d58-88db-abeb508087d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1b20251abd45fbb0aa0dbca8209f2e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:49.001498 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2793/5618] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:48 2022] DELETE /identity/v3/users/8d1b20251abd45fbb0aa0dbca8209f2e => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:49.003023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb88ba-16d4-4d58-88db-abeb508087d9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:49.007639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-62fb88ba-16d4-4d58-88db-abeb508087d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:49.055792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869b9e2-f28e-428e-ba3c-6d65b7e1ab82 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:49.185541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb88ba-16d4-4d58-88db-abeb508087d9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:49.191505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46aa74d-fc04-416b-823e-b9c1a69e498b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:49.192499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46aa74d-fc04-416b-823e-b9c1a69e498b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:49.192879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46aa74d-fc04-416b-823e-b9c1a69e498b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:49.193218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46aa74d-fc04-416b-823e-b9c1a69e498b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/c44465b759ba4ab4a29dfd59846d61a1/implies/7e20555c73544a17af4886643a43800a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:49.195278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46aa74d-fc04-416b-823e-b9c1a69e498b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c44465b759ba4ab4a29dfd59846d61a1, implied_role_id=7e20555c73544a17af4886643a43800a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:49.197183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46aa74d-fc04-416b-823e-b9c1a69e498b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:49.199252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a9210-f086-4282-9352-d3e5f7a55f4a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30e52024c4456993685169431316bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c1a8538674c29ace05af57b818d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:49.200962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9210-f086-4282-9352-d3e5f7a55f4a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:49.201252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9210-f086-4282-9352-d3e5f7a55f4a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:49.201688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9210-f086-4282-9352-d3e5f7a55f4a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] PATH_INFO: `/v3/projects/524738e2d8fa4a98a60facefdc8c9254/tags/tempest-tag-690912861` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:49.217727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a9210-f086-4282-9352-d3e5f7a55f4a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=524738e2d8fa4a98a60facefdc8c9254, value=tempest-tag-690912861)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:49.219835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a9210-f086-4282-9352-d3e5f7a55f4a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:49.237406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-474a9210-f086-4282-9352-d3e5f7a55f4a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Could not find project tag: tempest-tag-690912861.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-690912861. Aug 27 04:51:49.237406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:49.237406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:49.237406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:49.237406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:49.237406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:49.237406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:49.237406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:49.237406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:49.237406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:49.237406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:49.237406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:49.237406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Aug 27 04:51:49.237406 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Aug 27 04:51:49.239499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:51:49.239499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:51:49.239499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Aug 27 04:51:49.239499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Aug 27 04:51:49.239499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-690912861. Aug 27 04:51:49.239499 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:51:49.239499 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2826/5619] 10.222.0.76 () {58 vars in 1311 bytes} [Sat Aug 27 04:51:48 2022] GET /identity/v3/projects/524738e2d8fa4a98a60facefdc8c9254/tags/tempest-tag-690912861 => generated 106 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:51:49.243990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a5e0-293b-4c72-b801-fedcd8f7923a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:49.244313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a5e0-293b-4c72-b801-fedcd8f7923a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:49.249128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a5e0-293b-4c72-b801-fedcd8f7923a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:49.270311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-92e4a5e0-293b-4c72-b801-fedcd8f7923a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:49.272037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-92e4a5e0-293b-4c72-b801-fedcd8f7923a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:49.318349 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2794/5620] 10.222.0.76 () {58 vars in 1347 bytes} [Sat Aug 27 04:51:49 2022] DELETE /identity/v3/roles/c44465b759ba4ab4a29dfd59846d61a1/implies/7e20555c73544a17af4886643a43800a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:49.318349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46aa74d-fc04-416b-823e-b9c1a69e498b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:49.320677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d46aa74d-fc04-416b-823e-b9c1a69e498b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:49.375349 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2827/5621] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:49.376292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4a5e0-293b-4c72-b801-fedcd8f7923a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:49.377785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-92e4a5e0-293b-4c72-b801-fedcd8f7923a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:49.400872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4a5e0-293b-4c72-b801-fedcd8f7923a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:49.429648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46aa74d-fc04-416b-823e-b9c1a69e498b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:49.472458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04f0e7-df14-456a-9e2b-8eb0c5c8acfd tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30e52024c4456993685169431316bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c1a8538674c29ace05af57b818d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:49.473315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04f0e7-df14-456a-9e2b-8eb0c5c8acfd tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:49.476208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04f0e7-df14-456a-9e2b-8eb0c5c8acfd tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:49.476611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04f0e7-df14-456a-9e2b-8eb0c5c8acfd tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] PATH_INFO: `/v3/projects/524738e2d8fa4a98a60facefdc8c9254/tags` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:49.478801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04f0e7-df14-456a-9e2b-8eb0c5c8acfd tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=524738e2d8fa4a98a60facefdc8c9254)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:49.489730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04f0e7-df14-456a-9e2b-8eb0c5c8acfd tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:49.527741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c761d7-0445-4742-b16c-7886439e43e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:49.530428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c761d7-0445-4742-b16c-7886439e43e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:49.530428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c761d7-0445-4742-b16c-7886439e43e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:49.530428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c761d7-0445-4742-b16c-7886439e43e9 admin admin] PATH_INFO: `/v3/projects/76e49a8527f9424a98c5871576973cb6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:49.530428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c761d7-0445-4742-b16c-7886439e43e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e49a8527f9424a98c5871576973cb6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:49.533055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c761d7-0445-4742-b16c-7886439e43e9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:49.744706 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2795/5622] 10.222.0.76 () {58 vars in 1248 bytes} [Sat Aug 27 04:51:49 2022] DELETE /identity/v3/projects/524738e2d8fa4a98a60facefdc8c9254/tags => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:49.748418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04f0e7-df14-456a-9e2b-8eb0c5c8acfd tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:49.804129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8c761d7-0445-4742-b16c-7886439e43e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e49a8527f9424a98c5871576973cb6', 'request_id': 'req-c8c761d7-0445-4742-b16c-7886439e43e9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:49.820536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8c761d7-0445-4742-b16c-7886439e43e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e49a8527f9424a98c5871576973cb6', 'request_id': 'req-c8c761d7-0445-4742-b16c-7886439e43e9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:49.841466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04f0e7-df14-456a-9e2b-8eb0c5c8acfd tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:49.933890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340b996-c25f-45ee-8b46-976c7ed41876 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:49.942518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340b996-c25f-45ee-8b46-976c7ed41876 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:49.942518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340b996-c25f-45ee-8b46-976c7ed41876 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:49.942518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340b996-c25f-45ee-8b46-976c7ed41876 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/7e20555c73544a17af4886643a43800a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:49.942518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340b996-c25f-45ee-8b46-976c7ed41876 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=7e20555c73544a17af4886643a43800a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:49.942918 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-7340b996-c25f-45ee-8b46-976c7ed41876 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:49.942918 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:49.942918 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:49.942918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340b996-c25f-45ee-8b46-976c7ed41876 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:49.983108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8c761d7-0445-4742-b16c-7886439e43e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e49a8527f9424a98c5871576973cb6', 'request_id': 'req-c8c761d7-0445-4742-b16c-7886439e43e9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:50.001390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8c761d7-0445-4742-b16c-7886439e43e9 admin admin] The token cache is being invalidate because project 76e49a8527f9424a98c5871576973cb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:50.001677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8c761d7-0445-4742-b16c-7886439e43e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:50.002425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8c761d7-0445-4742-b16c-7886439e43e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:50.005385 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2828/5623] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:49 2022] DELETE /identity/v3/projects/76e49a8527f9424a98c5871576973cb6 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:50.006740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c761d7-0445-4742-b16c-7886439e43e9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:50.009026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c8c761d7-0445-4742-b16c-7886439e43e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:50.107505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c761d7-0445-4742-b16c-7886439e43e9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:50.114090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ab52c-1af9-4061-8821-dceb35eb206d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:50.114883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ab52c-1af9-4061-8821-dceb35eb206d service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:50.115278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ab52c-1af9-4061-8821-dceb35eb206d service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:50.115643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ab52c-1af9-4061-8821-dceb35eb206d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:50.118613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7b8ab52c-1af9-4061-8821-dceb35eb206d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:50.165471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7340b996-c25f-45ee-8b46-976c7ed41876 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invalidating the token cache because role 7e20555c73544a17af4886643a43800a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:50.165797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7340b996-c25f-45ee-8b46-976c7ed41876 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:50.166736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7340b996-c25f-45ee-8b46-976c7ed41876 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:50.171205 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2796/5624] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:49 2022] DELETE /identity/v3/roles/7e20555c73544a17af4886643a43800a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:50.172247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340b996-c25f-45ee-8b46-976c7ed41876 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:50.177720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7340b996-c25f-45ee-8b46-976c7ed41876 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:50.224780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ab52c-1af9-4061-8821-dceb35eb206d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:50.226887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ab52c-1af9-4061-8821-dceb35eb206d service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:50.246499 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2829/5625] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:50.247486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ab52c-1af9-4061-8821-dceb35eb206d service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:50.248981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7b8ab52c-1af9-4061-8821-dceb35eb206d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:50.277041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340b996-c25f-45ee-8b46-976c7ed41876 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:50.282268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57415576-efcc-492d-a917-a0f8b7286439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:50.282917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57415576-efcc-492d-a917-a0f8b7286439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:50.283198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57415576-efcc-492d-a917-a0f8b7286439 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:50.283650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57415576-efcc-492d-a917-a0f8b7286439 admin admin] PATH_INFO: `/v3/projects/88383306a1174445a1e8eb1cddd47ea7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:50.285230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57415576-efcc-492d-a917-a0f8b7286439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88383306a1174445a1e8eb1cddd47ea7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:50.288664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57415576-efcc-492d-a917-a0f8b7286439 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:50.342711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ab52c-1af9-4061-8821-dceb35eb206d service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:50.423725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e5b03-41f9-4529-8fbd-4256bb02cb5a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30e52024c4456993685169431316bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c1a8538674c29ace05af57b818d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:50.424963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e5b03-41f9-4529-8fbd-4256bb02cb5a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:50.425484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e5b03-41f9-4529-8fbd-4256bb02cb5a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:50.426206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e5b03-41f9-4529-8fbd-4256bb02cb5a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] PATH_INFO: `/v3/projects/524738e2d8fa4a98a60facefdc8c9254/tags` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:50.456234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e5b03-41f9-4529-8fbd-4256bb02cb5a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=524738e2d8fa4a98a60facefdc8c9254)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:50.460234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e5b03-41f9-4529-8fbd-4256bb02cb5a tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:50.509789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-57415576-efcc-492d-a917-a0f8b7286439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88383306a1174445a1e8eb1cddd47ea7', 'request_id': 'req-57415576-efcc-492d-a917-a0f8b7286439'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:50.512047 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2830/5626] 10.222.0.76 () {58 vars in 1245 bytes} [Sat Aug 27 04:51:50 2022] GET /identity/v3/projects/524738e2d8fa4a98a60facefdc8c9254/tags => generated 66 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 27 04:51:50.513548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed5ae9-39e8-4fed-a39e-87262f2289d4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:50.513836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed5ae9-39e8-4fed-a39e-87262f2289d4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:50.514117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed5ae9-39e8-4fed-a39e-87262f2289d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:50.517626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-57415576-efcc-492d-a917-a0f8b7286439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88383306a1174445a1e8eb1cddd47ea7', 'request_id': 'req-57415576-efcc-492d-a917-a0f8b7286439'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:50.527448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-57415576-efcc-492d-a917-a0f8b7286439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88383306a1174445a1e8eb1cddd47ea7', 'request_id': 'req-57415576-efcc-492d-a917-a0f8b7286439'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:50.555383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b5ed5ae9-39e8-4fed-a39e-87262f2289d4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:50.556705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b5ed5ae9-39e8-4fed-a39e-87262f2289d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:50.647552 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2831/5627] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:50.647552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed5ae9-39e8-4fed-a39e-87262f2289d4 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:50.648479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b5ed5ae9-39e8-4fed-a39e-87262f2289d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:50.688707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-57415576-efcc-492d-a917-a0f8b7286439 admin admin] The token cache is being invalidate because project 88383306a1174445a1e8eb1cddd47ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:50.689035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-57415576-efcc-492d-a917-a0f8b7286439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:50.690902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-57415576-efcc-492d-a917-a0f8b7286439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:50.696880 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2797/5628] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:50 2022] DELETE /identity/v3/projects/88383306a1174445a1e8eb1cddd47ea7 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:50.697856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57415576-efcc-492d-a917-a0f8b7286439 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:50.699392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-57415576-efcc-492d-a917-a0f8b7286439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:50.748416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed5ae9-39e8-4fed-a39e-87262f2289d4 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:50.764648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e97310-b690-4972-a8be-a647400e1e80 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:50.765417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e97310-b690-4972-a8be-a647400e1e80 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:50.768198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e97310-b690-4972-a8be-a647400e1e80 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:50.768506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e97310-b690-4972-a8be-a647400e1e80 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/c44465b759ba4ab4a29dfd59846d61a1` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:50.770873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e97310-b690-4972-a8be-a647400e1e80 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=c44465b759ba4ab4a29dfd59846d61a1)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:50.776589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e97310-b690-4972-a8be-a647400e1e80 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:50.789669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57415576-efcc-492d-a917-a0f8b7286439 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:50.795887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48dc45-6343-4f23-a574-45326b946e10 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30e52024c4456993685169431316bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c1a8538674c29ace05af57b818d15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:50.796927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48dc45-6343-4f23-a574-45326b946e10 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:50.797580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48dc45-6343-4f23-a574-45326b946e10 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:50.798375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48dc45-6343-4f23-a574-45326b946e10 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] PATH_INFO: `/v3/projects/524738e2d8fa4a98a60facefdc8c9254` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:50.799839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48dc45-6343-4f23-a574-45326b946e10 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorizing `identity:delete_project(project_id=524738e2d8fa4a98a60facefdc8c9254)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:50.802274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48dc45-6343-4f23-a574-45326b946e10 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:50.973882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-85e97310-b690-4972-a8be-a647400e1e80 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invalidating the token cache because role c44465b759ba4ab4a29dfd59846d61a1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:50.975475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-85e97310-b690-4972-a8be-a647400e1e80 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:50.976869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-85e97310-b690-4972-a8be-a647400e1e80 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:50.984355 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2832/5629] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:50 2022] DELETE /identity/v3/roles/c44465b759ba4ab4a29dfd59846d61a1 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:50.986421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e7a78-6f23-4050-9de3-478d0a0428e8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:50.988606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e7a78-6f23-4050-9de3-478d0a0428e8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:50.994215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e7a78-6f23-4050-9de3-478d0a0428e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:51.015680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-af48dc45-6343-4f23-a574-45326b946e10 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '524738e2d8fa4a98a60facefdc8c9254', 'request_id': 'req-af48dc45-6343-4f23-a574-45326b946e10'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:51.030813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-af48dc45-6343-4f23-a574-45326b946e10 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '524738e2d8fa4a98a60facefdc8c9254', 'request_id': 'req-af48dc45-6343-4f23-a574-45326b946e10'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:51.039696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-912e7a78-6f23-4050-9de3-478d0a0428e8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:51.041000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-912e7a78-6f23-4050-9de3-478d0a0428e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:51.046369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-af48dc45-6343-4f23-a574-45326b946e10 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '524738e2d8fa4a98a60facefdc8c9254', 'request_id': 'req-af48dc45-6343-4f23-a574-45326b946e10'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:51.164983 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2833/5630] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:51.164983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f58fcf-1751-499a-be46-c125ef772ea0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:51.165318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f58fcf-1751-499a-be46-c125ef772ea0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:51.165583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f58fcf-1751-499a-be46-c125ef772ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:51.183543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-af48dc45-6343-4f23-a574-45326b946e10 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] The token cache is being invalidate because project 524738e2d8fa4a98a60facefdc8c9254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:51.184209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-af48dc45-6343-4f23-a574-45326b946e10 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:51.185743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-af48dc45-6343-4f23-a574-45326b946e10 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:51.189088 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2798/5631] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:50 2022] DELETE /identity/v3/projects/524738e2d8fa4a98a60facefdc8c9254 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:51.190925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-61f58fcf-1751-499a-be46-c125ef772ea0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:51.192734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-61f58fcf-1751-499a-be46-c125ef772ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:51.195241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48dc45-6343-4f23-a574-45326b946e10 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:51.202097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-af48dc45-6343-4f23-a574-45326b946e10 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:51.217495 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2834/5632] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:51.218627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f58fcf-1751-499a-be46-c125ef772ea0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:51.220258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-61f58fcf-1751-499a-be46-c125ef772ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:51.241616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f58fcf-1751-499a-be46-c125ef772ea0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:51.256300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677edfbf-8e62-4c68-ae9b-bc8eb6c43900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:51.259411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677edfbf-8e62-4c68-ae9b-bc8eb6c43900 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:51.261130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677edfbf-8e62-4c68-ae9b-bc8eb6c43900 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:51.261689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677edfbf-8e62-4c68-ae9b-bc8eb6c43900 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:51.262480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677edfbf-8e62-4c68-ae9b-bc8eb6c43900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:51.263486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677edfbf-8e62-4c68-ae9b-bc8eb6c43900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:51.267211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677edfbf-8e62-4c68-ae9b-bc8eb6c43900 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:51.299279 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2835/5633] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:51.300525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677edfbf-8e62-4c68-ae9b-bc8eb6c43900 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:51.306030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-677edfbf-8e62-4c68-ae9b-bc8eb6c43900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:51.333347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677edfbf-8e62-4c68-ae9b-bc8eb6c43900 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:51.341204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d61fe-85d6-44c0-99e6-459ac3d88395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:51.343051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d61fe-85d6-44c0-99e6-459ac3d88395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:51.344520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d61fe-85d6-44c0-99e6-459ac3d88395 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:51.344990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d61fe-85d6-44c0-99e6-459ac3d88395 admin admin] PATH_INFO: `/v3/users/d7e7e6cf73254b1cb3cef66630008ff5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:51.347123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d61fe-85d6-44c0-99e6-459ac3d88395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e7e6cf73254b1cb3cef66630008ff5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:51.349815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d61fe-85d6-44c0-99e6-459ac3d88395 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:51.371691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48dc45-6343-4f23-a574-45326b946e10 tempest-IdentityV3ProjectTagsTest-601474625 tempest-IdentityV3ProjectTagsTest-601474625-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:51.493668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81e680-d8a3-4284-b607-192fcde2d342 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:51.494785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81e680-d8a3-4284-b607-192fcde2d342 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:51.495251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81e680-d8a3-4284-b607-192fcde2d342 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:51.495661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81e680-d8a3-4284-b607-192fcde2d342 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:51.498025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81e680-d8a3-4284-b607-192fcde2d342 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=79d566fca0ac4c2b9a147a70bf0e7278)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:51.501446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81e680-d8a3-4284-b607-192fcde2d342 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:51.614252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:51.630119 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2799/5634] 10.222.0.76 () {60 vars in 1363 bytes} [Sat Aug 27 04:51:51 2022] PUT /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278 => generated 521 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:51.630119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c37c50-2cd0-4805-850e-23cdd7ddc8ce None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:51.630119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c37c50-2cd0-4805-850e-23cdd7ddc8ce None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:51.630119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c37c50-2cd0-4805-850e-23cdd7ddc8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:51.642195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e95d61fe-85d6-44c0-99e6-459ac3d88395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e7e6cf73254b1cb3cef66630008ff5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:51.644457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e95d61fe-85d6-44c0-99e6-459ac3d88395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e7e6cf73254b1cb3cef66630008ff5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:51.667569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-45c37c50-2cd0-4805-850e-23cdd7ddc8ce None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:51.668954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-45c37c50-2cd0-4805-850e-23cdd7ddc8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:51.769257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e95d61fe-85d6-44c0-99e6-459ac3d88395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e7e6cf73254b1cb3cef66630008ff5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:51.770054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e95d61fe-85d6-44c0-99e6-459ac3d88395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e7e6cf73254b1cb3cef66630008ff5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:51.796842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e95d61fe-85d6-44c0-99e6-459ac3d88395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e7e6cf73254b1cb3cef66630008ff5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:51.804344 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2800/5635] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:51.811039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c37c50-2cd0-4805-850e-23cdd7ddc8ce None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:51.816406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-45c37c50-2cd0-4805-850e-23cdd7ddc8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:51.840772 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2836/5636] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:51 2022] DELETE /identity/v3/users/d7e7e6cf73254b1cb3cef66630008ff5 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:51.841836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d61fe-85d6-44c0-99e6-459ac3d88395 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:51.844603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e95d61fe-85d6-44c0-99e6-459ac3d88395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:51.850593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c37c50-2cd0-4805-850e-23cdd7ddc8ce None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:51.992300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9e13b-9466-4980-902a-1068039d32b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:51.992974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9e13b-9466-4980-902a-1068039d32b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:51.993240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9e13b-9466-4980-902a-1068039d32b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:51.995828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9e13b-9466-4980-902a-1068039d32b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:51.996553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9e13b-9466-4980-902a-1068039d32b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:51.998892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9e13b-9466-4980-902a-1068039d32b7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:52.016073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d61fe-85d6-44c0-99e6-459ac3d88395 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:52.036955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecbcfd-021f-4e35-bbe8-3cc787084fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:52.038599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecbcfd-021f-4e35-bbe8-3cc787084fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:52.038897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecbcfd-021f-4e35-bbe8-3cc787084fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:52.039186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecbcfd-021f-4e35-bbe8-3cc787084fc9 admin admin] PATH_INFO: `/v3/projects/1f4d7832e8944ccfa33d32d50f28fafe` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:52.040595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ecbcfd-021f-4e35-bbe8-3cc787084fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4d7832e8944ccfa33d32d50f28fafe)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:52.042789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ecbcfd-021f-4e35-bbe8-3cc787084fc9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:52.261844 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2801/5637] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:51 2022] POST /identity/v3/projects => generated 377 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:52.263408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9e13b-9466-4980-902a-1068039d32b7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:52.270127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0ff9e13b-9466-4980-902a-1068039d32b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:52.370878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c1ecbcfd-021f-4e35-bbe8-3cc787084fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4d7832e8944ccfa33d32d50f28fafe', 'request_id': 'req-c1ecbcfd-021f-4e35-bbe8-3cc787084fc9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:52.388970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c1ecbcfd-021f-4e35-bbe8-3cc787084fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4d7832e8944ccfa33d32d50f28fafe', 'request_id': 'req-c1ecbcfd-021f-4e35-bbe8-3cc787084fc9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:52.390796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9e13b-9466-4980-902a-1068039d32b7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:52.528012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c747fa-9cb4-44cc-a065-9bb429bedd00 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:52.529032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c747fa-9cb4-44cc-a065-9bb429bedd00 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:52.529558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c747fa-9cb4-44cc-a065-9bb429bedd00 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:52.531717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c747fa-9cb4-44cc-a065-9bb429bedd00 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:52.534190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c747fa-9cb4-44cc-a065-9bb429bedd00 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=79d566fca0ac4c2b9a147a70bf0e7278)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:52.535568 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-47c747fa-9cb4-44cc-a065-9bb429bedd00 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:52.535568 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:52.535568 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:52.536121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c1ecbcfd-021f-4e35-bbe8-3cc787084fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4d7832e8944ccfa33d32d50f28fafe', 'request_id': 'req-c1ecbcfd-021f-4e35-bbe8-3cc787084fc9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:52.536903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c747fa-9cb4-44cc-a065-9bb429bedd00 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:52.538890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c747fa-9cb4-44cc-a065-9bb429bedd00 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=79d566fca0ac4c2b9a147a70bf0e7278)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:52.540201 n-d-852088-5 devstack@keystone.service[82082]: WARNING py.warnings [None req-47c747fa-9cb4-44cc-a065-9bb429bedd00 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:52.540201 n-d-852088-5 devstack@keystone.service[82082]: warnings.warn(msg) Aug 27 04:51:52.540201 n-d-852088-5 devstack@keystone.service[82082]: Aug 27 04:51:52.543813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c747fa-9cb4-44cc-a065-9bb429bedd00 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:52.560838 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2802/5638] 10.222.0.76 () {58 vars in 1345 bytes} [Sat Aug 27 04:51:52 2022] HEAD /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:52.563513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c747fa-9cb4-44cc-a065-9bb429bedd00 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:52.565499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c1ecbcfd-021f-4e35-bbe8-3cc787084fc9 admin admin] The token cache is being invalidate because project 1f4d7832e8944ccfa33d32d50f28fafe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:52.572444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c1ecbcfd-021f-4e35-bbe8-3cc787084fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:52.574610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c1ecbcfd-021f-4e35-bbe8-3cc787084fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:52.581967 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2837/5639] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:51 2022] DELETE /identity/v3/projects/1f4d7832e8944ccfa33d32d50f28fafe => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:52.581967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea14f9-6bfa-467d-9b08-b53984369da0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:52.581967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea14f9-6bfa-467d-9b08-b53984369da0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:52.581967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea14f9-6bfa-467d-9b08-b53984369da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:52.666435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-09ea14f9-6bfa-467d-9b08-b53984369da0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:52.668082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-09ea14f9-6bfa-467d-9b08-b53984369da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:52.699221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c747fa-9cb4-44cc-a065-9bb429bedd00 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:52.711044 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2838/5640] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:52.712034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea14f9-6bfa-467d-9b08-b53984369da0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:52.713620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-09ea14f9-6bfa-467d-9b08-b53984369da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:52.725999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba986b-96ef-40fc-9edb-94e91aacf691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:52.726629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba986b-96ef-40fc-9edb-94e91aacf691 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:52.726915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba986b-96ef-40fc-9edb-94e91aacf691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:52.730433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba986b-96ef-40fc-9edb-94e91aacf691 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:52.730433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba986b-96ef-40fc-9edb-94e91aacf691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:52.730433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba986b-96ef-40fc-9edb-94e91aacf691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:52.730976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea14f9-6bfa-467d-9b08-b53984369da0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:52.731098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba986b-96ef-40fc-9edb-94e91aacf691 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:52.735526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce9638-b1c5-4b76-bfe0-6633458f9def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:52.736418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9638-b1c5-4b76-bfe0-6633458f9def admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:52.736826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9638-b1c5-4b76-bfe0-6633458f9def admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:52.737992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9638-b1c5-4b76-bfe0-6633458f9def admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:52.737992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce9638-b1c5-4b76-bfe0-6633458f9def admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:52.740067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce9638-b1c5-4b76-bfe0-6633458f9def admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:52.762416 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2803/5641] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:52.762416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba986b-96ef-40fc-9edb-94e91aacf691 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:52.762714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3dba986b-96ef-40fc-9edb-94e91aacf691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:52.779891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba986b-96ef-40fc-9edb-94e91aacf691 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:52.785125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147a5c5-565b-4a6d-bfb8-6ec32f7484ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:52.785863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147a5c5-565b-4a6d-bfb8-6ec32f7484ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:52.786211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147a5c5-565b-4a6d-bfb8-6ec32f7484ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:52.786612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147a5c5-565b-4a6d-bfb8-6ec32f7484ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:52.793975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147a5c5-565b-4a6d-bfb8-6ec32f7484ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=79d566fca0ac4c2b9a147a70bf0e7278)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:52.798950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147a5c5-565b-4a6d-bfb8-6ec32f7484ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:52.807183 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2804/5642] 10.222.0.76 () {58 vars in 1344 bytes} [Sat Aug 27 04:51:52 2022] GET /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278 => generated 521 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:52.808644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c28afa-1abe-4c0c-8a9d-8bd6b748c0c0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:52.808938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c28afa-1abe-4c0c-8a9d-8bd6b748c0c0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:52.809221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c28afa-1abe-4c0c-8a9d-8bd6b748c0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:52.835737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-16c28afa-1abe-4c0c-8a9d-8bd6b748c0c0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:52.839482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-16c28afa-1abe-4c0c-8a9d-8bd6b748c0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:52.847273 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2805/5643] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:52.848745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c28afa-1abe-4c0c-8a9d-8bd6b748c0c0 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:52.851746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-16c28afa-1abe-4c0c-8a9d-8bd6b748c0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:52.928329 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2839/5644] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:52 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:52.929693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce9638-b1c5-4b76-bfe0-6633458f9def admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:52.933447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-09ce9638-b1c5-4b76-bfe0-6633458f9def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:52.959971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c28afa-1abe-4c0c-8a9d-8bd6b748c0c0 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:52.961968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce9638-b1c5-4b76-bfe0-6633458f9def admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:52.972970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70399b4d-948a-41a5-adf9-f1b6eb53aae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:52.973951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70399b4d-948a-41a5-adf9-f1b6eb53aae1 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:52.976051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70399b4d-948a-41a5-adf9-f1b6eb53aae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:52.976752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70399b4d-948a-41a5-adf9-f1b6eb53aae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:52.984454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fbfb8-ae28-4c15-a41f-a9cff3d43de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:52.984454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fbfb8-ae28-4c15-a41f-a9cff3d43de7 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:52.984454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fbfb8-ae28-4c15-a41f-a9cff3d43de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:52.984454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fbfb8-ae28-4c15-a41f-a9cff3d43de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:52.985300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fbfb8-ae28-4c15-a41f-a9cff3d43de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:52.992796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fbfb8-ae28-4c15-a41f-a9cff3d43de7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:53.015171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70399b4d-948a-41a5-adf9-f1b6eb53aae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:53.018205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70399b4d-948a-41a5-adf9-f1b6eb53aae1 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:53.059531 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2806/5645] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:53.060716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70399b4d-948a-41a5-adf9-f1b6eb53aae1 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:53.091366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70399b4d-948a-41a5-adf9-f1b6eb53aae1 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:53.106861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec3c11-a7bb-4ca5-9355-2907fd98a637 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:53.107408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3c11-a7bb-4ca5-9355-2907fd98a637 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:53.107408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3c11-a7bb-4ca5-9355-2907fd98a637 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:53.107592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3c11-a7bb-4ca5-9355-2907fd98a637 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:53.112890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec3c11-a7bb-4ca5-9355-2907fd98a637 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=79d566fca0ac4c2b9a147a70bf0e7278)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:53.116139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec3c11-a7bb-4ca5-9355-2907fd98a637 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:53.213656 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2840/5646] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:52 2022] POST /identity/v3/projects => generated 375 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:53.215663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939eb39e-91bf-4715-8f04-246a26bf6206 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:53.215959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939eb39e-91bf-4715-8f04-246a26bf6206 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:53.216264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939eb39e-91bf-4715-8f04-246a26bf6206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:53.267135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-939eb39e-91bf-4715-8f04-246a26bf6206 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:53.268426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-939eb39e-91bf-4715-8f04-246a26bf6206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:53.310147 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2807/5647] 10.222.0.76 () {58 vars in 1347 bytes} [Sat Aug 27 04:51:53 2022] DELETE /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:53.314261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec3c11-a7bb-4ca5-9355-2907fd98a637 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:53.316577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:53.373248 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2841/5648] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:53.374230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939eb39e-91bf-4715-8f04-246a26bf6206 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:53.384645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939eb39e-91bf-4715-8f04-246a26bf6206 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:53.427579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec3c11-a7bb-4ca5-9355-2907fd98a637 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:53.427579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38cd50-cadb-4b97-a5b7-8d0ffd986af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:53.427579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38cd50-cadb-4b97-a5b7-8d0ffd986af7 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:53.427869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38cd50-cadb-4b97-a5b7-8d0ffd986af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:53.427869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38cd50-cadb-4b97-a5b7-8d0ffd986af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:53.427869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38cd50-cadb-4b97-a5b7-8d0ffd986af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:53.427869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38cd50-cadb-4b97-a5b7-8d0ffd986af7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:53.450773 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2808/5649] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:53 2022] GET /identity/v3/roles => generated 2324 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:53.450773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38cd50-cadb-4b97-a5b7-8d0ffd986af7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:53.468926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcde38-7010-4aa5-81d6-bcad2f56891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:53.470050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcde38-7010-4aa5-81d6-bcad2f56891e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:53.470505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcde38-7010-4aa5-81d6-bcad2f56891e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:53.471013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcde38-7010-4aa5-81d6-bcad2f56891e admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:53.471975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fcde38-7010-4aa5-81d6-bcad2f56891e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:53.474971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fcde38-7010-4aa5-81d6-bcad2f56891e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:53.570051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38cd50-cadb-4b97-a5b7-8d0ffd986af7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:53.582799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb1c86-d999-4c73-ab28-7d4dd2029dfb tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:53.583481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb1c86-d999-4c73-ab28-7d4dd2029dfb tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:53.583769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb1c86-d999-4c73-ab28-7d4dd2029dfb tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:53.584052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb1c86-d999-4c73-ab28-7d4dd2029dfb tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:53.585903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb1c86-d999-4c73-ab28-7d4dd2029dfb tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=79d566fca0ac4c2b9a147a70bf0e7278)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:53.587846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb1c86-d999-4c73-ab28-7d4dd2029dfb tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:53.599212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-c2cb1c86-d999-4c73-ab28-7d4dd2029dfb tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] 172fc58542b84a4b95bcc5b4b36789e7 does not imply 79d566fca0ac4c2b9a147a70bf0e7278.: keystone.exception.ImpliedRoleNotFound: 172fc58542b84a4b95bcc5b4b36789e7 does not imply 79d566fca0ac4c2b9a147a70bf0e7278. Aug 27 04:51:53.599212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:53.599212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 27 04:51:53.599212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = query.one() Aug 27 04:51:53.599212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 27 04:51:53.599212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._iter().one() Aug 27 04:51:53.599212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 27 04:51:53.599212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._only_one_row( Aug 27 04:51:53.599212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 27 04:51:53.599212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 27 04:51:53.599212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 27 04:51:53.599212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:51:53.599212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:51:53.599212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:51:53.599212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:53.599212 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:53.600978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:53.600978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:53.600978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:53.600978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:53.600978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:53.600978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:53.600978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:53.600978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:53.600978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:53.600978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Aug 27 04:51:53.600978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Aug 27 04:51:53.600978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Aug 27 04:51:53.600978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Aug 27 04:51:53.600978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Aug 27 04:51:53.600978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 27 04:51:53.600978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 27 04:51:53.602023 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 27 04:51:53.602023 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 172fc58542b84a4b95bcc5b4b36789e7 does not imply 79d566fca0ac4c2b9a147a70bf0e7278. Aug 27 04:51:53.602023 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:51:53.602023 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2809/5650] 10.222.0.76 () {58 vars in 1344 bytes} [Sat Aug 27 04:51:53 2022] GET /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278 => generated 137 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:51:53.602023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb1c86-d999-4c73-ab28-7d4dd2029dfb tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:53.617395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb1c86-d999-4c73-ab28-7d4dd2029dfb tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:53.620655 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2842/5651] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:53 2022] POST /identity/v3/users => generated 288 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:53.624319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcde38-7010-4aa5-81d6-bcad2f56891e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:53.629091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131fd8b-558a-40bf-94fd-d32c71177669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:53.631031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131fd8b-558a-40bf-94fd-d32c71177669 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:53.632060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131fd8b-558a-40bf-94fd-d32c71177669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:53.632790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131fd8b-558a-40bf-94fd-d32c71177669 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:53.637877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131fd8b-558a-40bf-94fd-d32c71177669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:53.638911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131fd8b-558a-40bf-94fd-d32c71177669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:53.647595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcde38-7010-4aa5-81d6-bcad2f56891e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:53.654898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131fd8b-558a-40bf-94fd-d32c71177669 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:53.663846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd243451-3003-40a7-bc1b-3249f3202978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:53.664586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd243451-3003-40a7-bc1b-3249f3202978 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:53.664885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd243451-3003-40a7-bc1b-3249f3202978 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:53.665132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd243451-3003-40a7-bc1b-3249f3202978 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:53.665822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd243451-3003-40a7-bc1b-3249f3202978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:53.667482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd243451-3003-40a7-bc1b-3249f3202978 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:53.683374 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2810/5652] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:53.684270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131fd8b-558a-40bf-94fd-d32c71177669 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:53.701589 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2843/5653] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:53 2022] GET /identity/v3/roles => generated 2324 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:53.701589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd243451-3003-40a7-bc1b-3249f3202978 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:53.716585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131fd8b-558a-40bf-94fd-d32c71177669 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:53.719998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd243451-3003-40a7-bc1b-3249f3202978 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:53.726785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4631730-6c54-45fa-8c80-fb7b78fda54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:53.727420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4631730-6c54-45fa-8c80-fb7b78fda54c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:53.727700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4631730-6c54-45fa-8c80-fb7b78fda54c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:53.727972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4631730-6c54-45fa-8c80-fb7b78fda54c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:53.728662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4631730-6c54-45fa-8c80-fb7b78fda54c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:53.742309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4631730-6c54-45fa-8c80-fb7b78fda54c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:53.742525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc339a-cb84-4b4f-a403-10683e723a8d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:53.742525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc339a-cb84-4b4f-a403-10683e723a8d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:53.742525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc339a-cb84-4b4f-a403-10683e723a8d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:53.742849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc339a-cb84-4b4f-a403-10683e723a8d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:53.742849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc339a-cb84-4b4f-a403-10683e723a8d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=79d566fca0ac4c2b9a147a70bf0e7278)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:53.743293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc339a-cb84-4b4f-a403-10683e723a8d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:53.756639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-74fc339a-cb84-4b4f-a403-10683e723a8d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] 172fc58542b84a4b95bcc5b4b36789e7 does not imply 79d566fca0ac4c2b9a147a70bf0e7278.: keystone.exception.ImpliedRoleNotFound: 172fc58542b84a4b95bcc5b4b36789e7 does not imply 79d566fca0ac4c2b9a147a70bf0e7278. Aug 27 04:51:53.756639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:53.756639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 27 04:51:53.756639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = query.one() Aug 27 04:51:53.756639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 27 04:51:53.756639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._iter().one() Aug 27 04:51:53.756639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 27 04:51:53.756639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._only_one_row( Aug 27 04:51:53.756639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 27 04:51:53.756639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 27 04:51:53.756639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 27 04:51:53.756639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:51:53.756639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:51:53.756639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:51:53.756639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:53.756639 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:53.758655 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:53.758655 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:53.758655 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:53.758655 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:53.758655 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:53.758655 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:53.758655 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:53.758655 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:53.758655 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:53.758655 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 27 04:51:53.758655 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 27 04:51:53.758655 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:51:53.758655 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:51:53.758655 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 27 04:51:53.758655 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 27 04:51:53.758655 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 27 04:51:53.759730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 27 04:51:53.759730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 27 04:51:53.759730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 27 04:51:53.759730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 172fc58542b84a4b95bcc5b4b36789e7 does not imply 79d566fca0ac4c2b9a147a70bf0e7278. Aug 27 04:51:53.759730 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:51:53.767587 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2811/5654] 10.222.0.76 () {58 vars in 1347 bytes} [Sat Aug 27 04:51:53 2022] DELETE /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278 => generated 137 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:51:53.770955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc339a-cb84-4b4f-a403-10683e723a8d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:53.782342 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2844/5655] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:53 2022] GET /identity/v3/roles => generated 2324 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:53.791133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4631730-6c54-45fa-8c80-fb7b78fda54c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:53.796616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc339a-cb84-4b4f-a403-10683e723a8d tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:53.802130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339144f-933c-4b6b-89bc-91e37bcb4c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:53.804030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339144f-933c-4b6b-89bc-91e37bcb4c0b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:53.804336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339144f-933c-4b6b-89bc-91e37bcb4c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:53.804638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339144f-933c-4b6b-89bc-91e37bcb4c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:53.805371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339144f-933c-4b6b-89bc-91e37bcb4c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:53.807323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339144f-933c-4b6b-89bc-91e37bcb4c0b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:53.831927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4631730-6c54-45fa-8c80-fb7b78fda54c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:53.837759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5547152-de25-46bd-bba7-2c0953b18108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:53.838669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5547152-de25-46bd-bba7-2c0953b18108 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:53.838955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5547152-de25-46bd-bba7-2c0953b18108 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:53.839230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5547152-de25-46bd-bba7-2c0953b18108 admin admin] PATH_INFO: `/v3/projects/bf0ea305715d4476bbd6177698d73eb8/users/5fbb0f9721764e2faf3587d7836232ec/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:53.860331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5547152-de25-46bd-bba7-2c0953b18108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0ea305715d4476bbd6177698d73eb8, user_id=5fbb0f9721764e2faf3587d7836232ec, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:53.863588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:53.875399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5547152-de25-46bd-bba7-2c0953b18108 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:53.948857 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2812/5656] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:53 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:53.955663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339144f-933c-4b6b-89bc-91e37bcb4c0b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:53.966868 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2845/5657] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:53 2022] PUT /identity/v3/projects/bf0ea305715d4476bbd6177698d73eb8/users/5fbb0f9721764e2faf3587d7836232ec/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:53.967737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5547152-de25-46bd-bba7-2c0953b18108 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:54.122213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5547152-de25-46bd-bba7-2c0953b18108 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:54.130413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8b6f4-0d0b-47dc-8457-610f40913fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:54.131366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8b6f4-0d0b-47dc-8457-610f40913fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:54.131583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339144f-933c-4b6b-89bc-91e37bcb4c0b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:54.133189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8b6f4-0d0b-47dc-8457-610f40913fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:54.133648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8b6f4-0d0b-47dc-8457-610f40913fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:54.135433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8b6f4-0d0b-47dc-8457-610f40913fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:54.141382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8b6f4-0d0b-47dc-8457-610f40913fe4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:54.177648 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2846/5658] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:53 2022] GET /identity/v3/roles => generated 2324 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:54.198995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8b6f4-0d0b-47dc-8457-610f40913fe4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:54.246304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8b6f4-0d0b-47dc-8457-610f40913fe4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:54.265496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fe94e-eea7-440d-88ae-6136483279c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:54.266067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fe94e-eea7-440d-88ae-6136483279c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:54.266352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fe94e-eea7-440d-88ae-6136483279c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:54.266633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fe94e-eea7-440d-88ae-6136483279c6 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:54.267280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fe94e-eea7-440d-88ae-6136483279c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:54.275144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fe94e-eea7-440d-88ae-6136483279c6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:54.324330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b7748-7e58-4dc3-b225-ec8822e54980 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:54.325287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b7748-7e58-4dc3-b225-ec8822e54980 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:54.325841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b7748-7e58-4dc3-b225-ec8822e54980 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:54.326282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b7748-7e58-4dc3-b225-ec8822e54980 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:54.328493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b7748-7e58-4dc3-b225-ec8822e54980 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=79d566fca0ac4c2b9a147a70bf0e7278)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:54.330720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b7748-7e58-4dc3-b225-ec8822e54980 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:54.461016 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2847/5659] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:54 2022] POST /identity/v3/users => generated 292 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:54.462507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243fe86-3fea-4b3b-a605-6679ac049a1d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:54.466206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243fe86-3fea-4b3b-a605-6679ac049a1d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:54.466561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243fe86-3fea-4b3b-a605-6679ac049a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:54.490208 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2813/5660] 10.222.0.76 () {60 vars in 1363 bytes} [Sat Aug 27 04:51:53 2022] PUT /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278 => generated 521 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:54.491363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b7748-7e58-4dc3-b225-ec8822e54980 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:54.535195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f243fe86-3fea-4b3b-a605-6679ac049a1d None None] MFA Rules not processed for user `5fbb0f9721764e2faf3587d7836232ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:54.536742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f243fe86-3fea-4b3b-a605-6679ac049a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:54.653815 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2848/5661] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:54.659034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243fe86-3fea-4b3b-a605-6679ac049a1d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:54.708630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b7748-7e58-4dc3-b225-ec8822e54980 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:54.715766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25eedf-758b-4af8-b308-eb965257c1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:54.716605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25eedf-758b-4af8-b308-eb965257c1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:54.717077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25eedf-758b-4af8-b308-eb965257c1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:54.717698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25eedf-758b-4af8-b308-eb965257c1a6 admin admin] PATH_INFO: `/v3/projects/a80a362bf3c04509aed3cd354eb02360/users/fbbffcb4fa614cd3b80354d714673b82/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:54.762441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25eedf-758b-4af8-b308-eb965257c1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80a362bf3c04509aed3cd354eb02360, user_id=fbbffcb4fa614cd3b80354d714673b82, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:54.775767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25eedf-758b-4af8-b308-eb965257c1a6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:54.805036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243fe86-3fea-4b3b-a605-6679ac049a1d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:54.813660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ceb558-44a5-4ae7-8b5c-1a4532999bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:54.815424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ceb558-44a5-4ae7-8b5c-1a4532999bdf admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:54.816240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ceb558-44a5-4ae7-8b5c-1a4532999bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:54.817329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ceb558-44a5-4ae7-8b5c-1a4532999bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:54.819561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ceb558-44a5-4ae7-8b5c-1a4532999bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:54.822987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ceb558-44a5-4ae7-8b5c-1a4532999bdf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:54.842886 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2849/5662] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:54 2022] GET /identity/v3/roles => generated 2324 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:54.844080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ceb558-44a5-4ae7-8b5c-1a4532999bdf admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:54.897591 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2814/5663] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:54 2022] PUT /identity/v3/projects/a80a362bf3c04509aed3cd354eb02360/users/fbbffcb4fa614cd3b80354d714673b82/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:54.898852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25eedf-758b-4af8-b308-eb965257c1a6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:54.965869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ceb558-44a5-4ae7-8b5c-1a4532999bdf admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:55.020053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25eedf-758b-4af8-b308-eb965257c1a6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:55.027968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa7df9-b346-45ad-807c-1b68b4455a5d tempest-DefaultDomainTestJSON-710560122 tempest-DefaultDomainTestJSON-710560122-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fbb0f9721764e2faf3587d7836232ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf0ea305715d4476bbd6177698d73eb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:55.028816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa7df9-b346-45ad-807c-1b68b4455a5d tempest-DefaultDomainTestJSON-710560122 tempest-DefaultDomainTestJSON-710560122-project] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:55.029646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa7df9-b346-45ad-807c-1b68b4455a5d tempest-DefaultDomainTestJSON-710560122 tempest-DefaultDomainTestJSON-710560122-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:55.029943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa7df9-b346-45ad-807c-1b68b4455a5d tempest-DefaultDomainTestJSON-710560122 tempest-DefaultDomainTestJSON-710560122-project] PATH_INFO: `/v3/domains/default` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:55.034163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa7df9-b346-45ad-807c-1b68b4455a5d tempest-DefaultDomainTestJSON-710560122 tempest-DefaultDomainTestJSON-710560122-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:55.035903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa7df9-b346-45ad-807c-1b68b4455a5d tempest-DefaultDomainTestJSON-710560122 tempest-DefaultDomainTestJSON-710560122-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:55.045744 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2815/5664] 10.222.0.76 () {58 vars in 1152 bytes} [Sat Aug 27 04:51:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:55.046701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c6ce0-a7f2-42df-8888-70cfcb65d15a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:55.047296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa7df9-b346-45ad-807c-1b68b4455a5d tempest-DefaultDomainTestJSON-710560122 tempest-DefaultDomainTestJSON-710560122-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:55.047873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c6ce0-a7f2-42df-8888-70cfcb65d15a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:55.049346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-56aa7df9-b346-45ad-807c-1b68b4455a5d tempest-DefaultDomainTestJSON-710560122 tempest-DefaultDomainTestJSON-710560122-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:55.049854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c6ce0-a7f2-42df-8888-70cfcb65d15a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:55.050124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c6ce0-a7f2-42df-8888-70cfcb65d15a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/98e065d0a72643c3967449fd360f10c0` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:55.062102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c6ce0-a7f2-42df-8888-70cfcb65d15a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=98e065d0a72643c3967449fd360f10c0)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:55.063839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c6ce0-a7f2-42df-8888-70cfcb65d15a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:55.155293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa7df9-b346-45ad-807c-1b68b4455a5d tempest-DefaultDomainTestJSON-710560122 tempest-DefaultDomainTestJSON-710560122-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:55.161684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53dbc8-b98b-445b-9050-aaa966a1347c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:55.163408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53dbc8-b98b-445b-9050-aaa966a1347c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:55.163871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53dbc8-b98b-445b-9050-aaa966a1347c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:55.164289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53dbc8-b98b-445b-9050-aaa966a1347c admin admin] PATH_INFO: `/v3/projects/acbc50ff913042aebfb7cdcc8b11820f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:55.165879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53dbc8-b98b-445b-9050-aaa966a1347c admin admin] RBAC: Authorizing `identity:delete_project(project_id=acbc50ff913042aebfb7cdcc8b11820f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:55.170032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53dbc8-b98b-445b-9050-aaa966a1347c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:55.211034 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2850/5665] 10.222.0.76 () {60 vars in 1363 bytes} [Sat Aug 27 04:51:54 2022] PUT /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/98e065d0a72643c3967449fd360f10c0 => generated 521 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:55.212193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c6ce0-a7f2-42df-8888-70cfcb65d15a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:55.298701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c6ce0-a7f2-42df-8888-70cfcb65d15a tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:55.306688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef20df-70bb-4c64-b936-f643206dcd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:55.307345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef20df-70bb-4c64-b936-f643206dcd4f admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:55.307631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef20df-70bb-4c64-b936-f643206dcd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:55.307906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef20df-70bb-4c64-b936-f643206dcd4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:55.308717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef20df-70bb-4c64-b936-f643206dcd4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:55.310558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef20df-70bb-4c64-b936-f643206dcd4f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:55.335427 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2851/5666] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:55 2022] GET /identity/v3/roles => generated 2324 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:55.337392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03916300-ae26-43d2-a2e1-7ac82d1a31d1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:55.337796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03916300-ae26-43d2-a2e1-7ac82d1a31d1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:55.338500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03916300-ae26-43d2-a2e1-7ac82d1a31d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:55.380508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e53dbc8-b98b-445b-9050-aaa966a1347c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acbc50ff913042aebfb7cdcc8b11820f', 'request_id': 'req-4e53dbc8-b98b-445b-9050-aaa966a1347c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:55.387125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e53dbc8-b98b-445b-9050-aaa966a1347c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acbc50ff913042aebfb7cdcc8b11820f', 'request_id': 'req-4e53dbc8-b98b-445b-9050-aaa966a1347c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:55.394009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e53dbc8-b98b-445b-9050-aaa966a1347c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acbc50ff913042aebfb7cdcc8b11820f', 'request_id': 'req-4e53dbc8-b98b-445b-9050-aaa966a1347c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:55.399203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-03916300-ae26-43d2-a2e1-7ac82d1a31d1 None None] MFA Rules not processed for user `fbbffcb4fa614cd3b80354d714673b82`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:55.403607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-03916300-ae26-43d2-a2e1-7ac82d1a31d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:55.502208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e53dbc8-b98b-445b-9050-aaa966a1347c admin admin] The token cache is being invalidate because project acbc50ff913042aebfb7cdcc8b11820f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:55.502566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e53dbc8-b98b-445b-9050-aaa966a1347c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:55.503934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4e53dbc8-b98b-445b-9050-aaa966a1347c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:55.505768 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2816/5667] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:55 2022] DELETE /identity/v3/projects/acbc50ff913042aebfb7cdcc8b11820f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:55.507931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53dbc8-b98b-445b-9050-aaa966a1347c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:55.512989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4e53dbc8-b98b-445b-9050-aaa966a1347c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:55.527970 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2852/5668] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:55.529449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe666cc-8907-4cbd-b775-92419b0a28c7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:55.529836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe666cc-8907-4cbd-b775-92419b0a28c7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:55.531230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe666cc-8907-4cbd-b775-92419b0a28c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:55.566838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9fe666cc-8907-4cbd-b775-92419b0a28c7 None None] MFA Rules not processed for user `2dbd274a4c0243ecb81e238288d3893e`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:55.568254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9fe666cc-8907-4cbd-b775-92419b0a28c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:55.630823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53dbc8-b98b-445b-9050-aaa966a1347c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:55.638912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c26ffc-ecd9-4e94-953a-732eb5370f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:55.639778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c26ffc-ecd9-4e94-953a-732eb5370f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:55.640246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c26ffc-ecd9-4e94-953a-732eb5370f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:55.640703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c26ffc-ecd9-4e94-953a-732eb5370f97 admin admin] PATH_INFO: `/v3/users/5fbb0f9721764e2faf3587d7836232ec` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:55.642054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c26ffc-ecd9-4e94-953a-732eb5370f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fbb0f9721764e2faf3587d7836232ec)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:55.644208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c26ffc-ecd9-4e94-953a-732eb5370f97 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:55.690370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:55.691240 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2853/5669] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:55.692281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe666cc-8907-4cbd-b775-92419b0a28c7 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:55.695607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9fe666cc-8907-4cbd-b775-92419b0a28c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:55.800903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe666cc-8907-4cbd-b775-92419b0a28c7 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:55.807115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e917cc8-4118-4b98-b1e6-86828ea0ba11 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:55.809534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e917cc8-4118-4b98-b1e6-86828ea0ba11 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:55.809668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e917cc8-4118-4b98-b1e6-86828ea0ba11 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:55.811256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e917cc8-4118-4b98-b1e6-86828ea0ba11 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/98e065d0a72643c3967449fd360f10c0/implies/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:55.814701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e917cc8-4118-4b98-b1e6-86828ea0ba11 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=98e065d0a72643c3967449fd360f10c0, implied_role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:55.819070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e917cc8-4118-4b98-b1e6-86828ea0ba11 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:56.034347 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2854/5670] 10.222.0.76 () {60 vars in 1363 bytes} [Sat Aug 27 04:51:55 2022] PUT /identity/v3/roles/98e065d0a72643c3967449fd360f10c0/implies/959d409c289a4ad1b4ceeea047bb8036 => generated 521 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:56.035664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e917cc8-4118-4b98-b1e6-86828ea0ba11 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:56.040700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2e917cc8-4118-4b98-b1e6-86828ea0ba11 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:56.042778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-79c26ffc-ecd9-4e94-953a-732eb5370f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fbb0f9721764e2faf3587d7836232ec'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:56.134928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-79c26ffc-ecd9-4e94-953a-732eb5370f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fbb0f9721764e2faf3587d7836232ec'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:56.136836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-79c26ffc-ecd9-4e94-953a-732eb5370f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fbb0f9721764e2faf3587d7836232ec'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:56.170464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-79c26ffc-ecd9-4e94-953a-732eb5370f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fbb0f9721764e2faf3587d7836232ec'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:56.196988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e917cc8-4118-4b98-b1e6-86828ea0ba11 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:56.216026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a3091-e3e5-4168-96d9-b594c1a73ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:56.216026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a3091-e3e5-4168-96d9-b594c1a73ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:56.216026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a3091-e3e5-4168-96d9-b594c1a73ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:56.216026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a3091-e3e5-4168-96d9-b594c1a73ddc admin admin] PATH_INFO: `/v3/projects/74bc85d80bc74ecdb98a7df6b8af1ebd/users/5f36f07947784bcdbdb6051d6dca1659/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:56.216476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-79c26ffc-ecd9-4e94-953a-732eb5370f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fbb0f9721764e2faf3587d7836232ec'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:56.243916 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2817/5671] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:55 2022] DELETE /identity/v3/users/5fbb0f9721764e2faf3587d7836232ec => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:56.244989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c26ffc-ecd9-4e94-953a-732eb5370f97 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:56.246467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-79c26ffc-ecd9-4e94-953a-732eb5370f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:56.249060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a3091-e3e5-4168-96d9-b594c1a73ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=74bc85d80bc74ecdb98a7df6b8af1ebd, user_id=5f36f07947784bcdbdb6051d6dca1659, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:56.251803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a3091-e3e5-4168-96d9-b594c1a73ddc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:56.359377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c26ffc-ecd9-4e94-953a-732eb5370f97 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:56.368585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982fb4c-7928-4a71-8270-539fbf1f312f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:56.369551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982fb4c-7928-4a71-8270-539fbf1f312f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:56.369990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982fb4c-7928-4a71-8270-539fbf1f312f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:56.370411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982fb4c-7928-4a71-8270-539fbf1f312f admin admin] PATH_INFO: `/v3/users/0b30e52024c4456993685169431316bd` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:56.371775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982fb4c-7928-4a71-8270-539fbf1f312f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b30e52024c4456993685169431316bd)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:56.373954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982fb4c-7928-4a71-8270-539fbf1f312f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:56.377881 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2855/5672] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:56 2022] PUT /identity/v3/projects/74bc85d80bc74ecdb98a7df6b8af1ebd/users/5f36f07947784bcdbdb6051d6dca1659/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:56.378732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a3091-e3e5-4168-96d9-b594c1a73ddc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:56.384940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3f5a3091-e3e5-4168-96d9-b594c1a73ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:56.450752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:56.493789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a3091-e3e5-4168-96d9-b594c1a73ddc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:56.505323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff03d6-10c9-4032-a210-5bce870ac9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:56.505987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff03d6-10c9-4032-a210-5bce870ac9de admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:56.506830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff03d6-10c9-4032-a210-5bce870ac9de admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:56.507122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff03d6-10c9-4032-a210-5bce870ac9de admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:56.507945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff03d6-10c9-4032-a210-5bce870ac9de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:56.510164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff03d6-10c9-4032-a210-5bce870ac9de admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:56.665761 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2856/5673] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:51:56 2022] POST /identity/v3/projects => generated 375 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:56.667848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecdddb-9330-4d8f-8aad-10e3ddd4198e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:56.668144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecdddb-9330-4d8f-8aad-10e3ddd4198e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:56.668456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecdddb-9330-4d8f-8aad-10e3ddd4198e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:56.707528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a982fb4c-7928-4a71-8270-539fbf1f312f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b30e52024c4456993685169431316bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:56.737737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-adecdddb-9330-4d8f-8aad-10e3ddd4198e None None] MFA Rules not processed for user `2dbd274a4c0243ecb81e238288d3893e`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:56.741184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-adecdddb-9330-4d8f-8aad-10e3ddd4198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:56.822478 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2857/5674] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:56.823514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecdddb-9330-4d8f-8aad-10e3ddd4198e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:56.824926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-adecdddb-9330-4d8f-8aad-10e3ddd4198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:56.859230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a982fb4c-7928-4a71-8270-539fbf1f312f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b30e52024c4456993685169431316bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:56.859525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a982fb4c-7928-4a71-8270-539fbf1f312f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b30e52024c4456993685169431316bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:56.884602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a982fb4c-7928-4a71-8270-539fbf1f312f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b30e52024c4456993685169431316bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:56.915881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a982fb4c-7928-4a71-8270-539fbf1f312f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b30e52024c4456993685169431316bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:56.940702 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2818/5675] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:51:56 2022] DELETE /identity/v3/users/0b30e52024c4456993685169431316bd => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:56.942398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9ce4c-8215-49a8-934c-4e51afdf59a2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:56.945648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9ce4c-8215-49a8-934c-4e51afdf59a2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:56.945995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9ce4c-8215-49a8-934c-4e51afdf59a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:56.968248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecdddb-9330-4d8f-8aad-10e3ddd4198e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:57.006758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-64b9ce4c-8215-49a8-934c-4e51afdf59a2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:57.011787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-64b9ce4c-8215-49a8-934c-4e51afdf59a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:57.044300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36d3f1-d301-4cad-a391-5a5479f48ae8 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:57.045074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36d3f1-d301-4cad-a391-5a5479f48ae8 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:57.045509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36d3f1-d301-4cad-a391-5a5479f48ae8 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:57.045798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36d3f1-d301-4cad-a391-5a5479f48ae8 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:57.046442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36d3f1-d301-4cad-a391-5a5479f48ae8 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:57.047576 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-3c36d3f1-d301-4cad-a391-5a5479f48ae8 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:57.047576 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:57.047576 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:57.048502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36d3f1-d301-4cad-a391-5a5479f48ae8 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:57.072681 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2858/5676] 10.222.0.76 () {58 vars in 1152 bytes} [Sat Aug 27 04:51:56 2022] GET /identity/v3/role_inferences => generated 1608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:57.074257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505a8a4-3dd0-4bfc-a9b1-c19f6d75b741 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:57.074652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505a8a4-3dd0-4bfc-a9b1-c19f6d75b741 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:57.074965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505a8a4-3dd0-4bfc-a9b1-c19f6d75b741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:57.100985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0505a8a4-3dd0-4bfc-a9b1-c19f6d75b741 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:57.102372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0505a8a4-3dd0-4bfc-a9b1-c19f6d75b741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:57.173215 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2819/5677] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:57.174243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9ce4c-8215-49a8-934c-4e51afdf59a2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:57.175793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-64b9ce4c-8215-49a8-934c-4e51afdf59a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:57.199613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9ce4c-8215-49a8-934c-4e51afdf59a2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:57.204452 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2859/5678] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:57.204805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cc719-92c3-4c4d-be55-f89274dfa9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:57.205288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505a8a4-3dd0-4bfc-a9b1-c19f6d75b741 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:57.205487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cc719-92c3-4c4d-be55-f89274dfa9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:57.205831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cc719-92c3-4c4d-be55-f89274dfa9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:57.206049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cc719-92c3-4c4d-be55-f89274dfa9d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:57.206745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3cc719-92c3-4c4d-be55-f89274dfa9d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:57.206872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0505a8a4-3dd0-4bfc-a9b1-c19f6d75b741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:57.210903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3cc719-92c3-4c4d-be55-f89274dfa9d5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:57.300073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505a8a4-3dd0-4bfc-a9b1-c19f6d75b741 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:57.310389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ecfbd-cda1-4bed-9430-e46a47ae3a5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:57.311336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ecfbd-cda1-4bed-9430-e46a47ae3a5f service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:57.311772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ecfbd-cda1-4bed-9430-e46a47ae3a5f service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:57.312341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ecfbd-cda1-4bed-9430-e46a47ae3a5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:57.315070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3a4ecfbd-cda1-4bed-9430-e46a47ae3a5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:57.390550 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2820/5679] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:51:57 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:57.395880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cc719-92c3-4c4d-be55-f89274dfa9d5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:57.402058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9c3cc719-92c3-4c4d-be55-f89274dfa9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:57.425479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cc719-92c3-4c4d-be55-f89274dfa9d5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:57.425663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ecfbd-cda1-4bed-9430-e46a47ae3a5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:57.426731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ecfbd-cda1-4bed-9430-e46a47ae3a5f service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:57.433092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8c72f-2397-4b74-930e-de29d876a1bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:57.435141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8c72f-2397-4b74-930e-de29d876a1bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:57.435602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8c72f-2397-4b74-930e-de29d876a1bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:57.436881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8c72f-2397-4b74-930e-de29d876a1bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/98e065d0a72643c3967449fd360f10c0/implies/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:57.438871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8c72f-2397-4b74-930e-de29d876a1bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=98e065d0a72643c3967449fd360f10c0, implied_role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:57.441387 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2860/5680] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:57.442726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8c72f-2397-4b74-930e-de29d876a1bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:57.451469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ecfbd-cda1-4bed-9430-e46a47ae3a5f service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:57.454407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3a4ecfbd-cda1-4bed-9430-e46a47ae3a5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:57.530375 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2821/5681] 10.222.0.76 () {58 vars in 1347 bytes} [Sat Aug 27 04:51:57 2022] DELETE /identity/v3/roles/98e065d0a72643c3967449fd360f10c0/implies/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:57.531482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8c72f-2397-4b74-930e-de29d876a1bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:57.558092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ecfbd-cda1-4bed-9430-e46a47ae3a5f service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:57.635804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8c72f-2397-4b74-930e-de29d876a1bc tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:57.642051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a2a15-1a3a-445f-ac3c-42e5269933cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:57.643406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a2a15-1a3a-445f-ac3c-42e5269933cf service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:57.643696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a2a15-1a3a-445f-ac3c-42e5269933cf service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:57.643970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a2a15-1a3a-445f-ac3c-42e5269933cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:57.702100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7924973-7ea9-492a-bae1-dea1cb8e258e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:57.702790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7924973-7ea9-492a-bae1-dea1cb8e258e service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:57.703005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7924973-7ea9-492a-bae1-dea1cb8e258e service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:57.703281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7924973-7ea9-492a-bae1-dea1cb8e258e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:57.737613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a2a15-1a3a-445f-ac3c-42e5269933cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:57.739085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a2a15-1a3a-445f-ac3c-42e5269933cf service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:57.752640 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2822/5682] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:57.753736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a2a15-1a3a-445f-ac3c-42e5269933cf service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:57.765789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a2a15-1a3a-445f-ac3c-42e5269933cf service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:57.774744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826f077-1b7d-44b2-ba82-78bc9909d9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:57.775664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826f077-1b7d-44b2-ba82-78bc9909d9ff admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:57.776103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826f077-1b7d-44b2-ba82-78bc9909d9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:57.776565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826f077-1b7d-44b2-ba82-78bc9909d9ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:57.777744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826f077-1b7d-44b2-ba82-78bc9909d9ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:57.779747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826f077-1b7d-44b2-ba82-78bc9909d9ff admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:57.808318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7924973-7ea9-492a-bae1-dea1cb8e258e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:57.808318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7924973-7ea9-492a-bae1-dea1cb8e258e service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:57.823543 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2823/5683] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:57 2022] GET /identity/v3/roles => generated 2324 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:57.824276 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2861/5684] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:57.826511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826f077-1b7d-44b2-ba82-78bc9909d9ff admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:57.828257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7924973-7ea9-492a-bae1-dea1cb8e258e service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:57.842978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7924973-7ea9-492a-bae1-dea1cb8e258e service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:57.847920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc414037-3945-4842-b528-c177e2288a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:57.848846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc414037-3945-4842-b528-c177e2288a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:57.850635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc414037-3945-4842-b528-c177e2288a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:57.850635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc414037-3945-4842-b528-c177e2288a4a admin admin] PATH_INFO: `/v3/projects/d8a834f5e55b4544b5bbc3ab8609fe7f/users/d56ae280c89648eb99a4adcbd3231fc3/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:57.871212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc414037-3945-4842-b528-c177e2288a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a834f5e55b4544b5bbc3ab8609fe7f, user_id=d56ae280c89648eb99a4adcbd3231fc3, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:57.873471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc414037-3945-4842-b528-c177e2288a4a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:57.954750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826f077-1b7d-44b2-ba82-78bc9909d9ff admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:57.969730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0b28c-c9f8-4a0e-a969-f8ab0b1764ff tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:57.970405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0b28c-c9f8-4a0e-a969-f8ab0b1764ff tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:57.970690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0b28c-c9f8-4a0e-a969-f8ab0b1764ff tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:57.970962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0b28c-c9f8-4a0e-a969-f8ab0b1764ff tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/98e065d0a72643c3967449fd360f10c0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:57.973028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0b28c-c9f8-4a0e-a969-f8ab0b1764ff tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=98e065d0a72643c3967449fd360f10c0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:57.974705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0b28c-c9f8-4a0e-a969-f8ab0b1764ff tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:57.978877 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2862/5685] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:57 2022] PUT /identity/v3/projects/d8a834f5e55b4544b5bbc3ab8609fe7f/users/d56ae280c89648eb99a4adcbd3231fc3/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:51:57.983382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc414037-3945-4842-b528-c177e2288a4a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:58.076061 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2824/5686] 10.222.0.76 () {58 vars in 1347 bytes} [Sat Aug 27 04:51:57 2022] DELETE /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/98e065d0a72643c3967449fd360f10c0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:58.081233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0b28c-c9f8-4a0e-a969-f8ab0b1764ff tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:58.089495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc414037-3945-4842-b528-c177e2288a4a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:58.224427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0b28c-c9f8-4a0e-a969-f8ab0b1764ff tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:58.244471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f173c30-4c98-4e2d-8410-29e030eaf2a0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:58.252035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f173c30-4c98-4e2d-8410-29e030eaf2a0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:58.252035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f173c30-4c98-4e2d-8410-29e030eaf2a0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:58.252035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f173c30-4c98-4e2d-8410-29e030eaf2a0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:58.252035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f173c30-4c98-4e2d-8410-29e030eaf2a0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=79d566fca0ac4c2b9a147a70bf0e7278)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:58.252497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f173c30-4c98-4e2d-8410-29e030eaf2a0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:58.295477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c983a52-a7fb-491c-a8dc-99eeaee53400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:58.311122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c983a52-a7fb-491c-a8dc-99eeaee53400 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:58.313735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c983a52-a7fb-491c-a8dc-99eeaee53400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:58.315133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:58.316531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c983a52-a7fb-491c-a8dc-99eeaee53400 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:58.318022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c983a52-a7fb-491c-a8dc-99eeaee53400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:58.322067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c983a52-a7fb-491c-a8dc-99eeaee53400 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:58.347675 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2825/5687] 10.222.0.76 () {58 vars in 1347 bytes} [Sat Aug 27 04:51:58 2022] DELETE /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:51:58.347675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f173c30-4c98-4e2d-8410-29e030eaf2a0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:58.361526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4f173c30-4c98-4e2d-8410-29e030eaf2a0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:58.362084 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2863/5688] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:57 2022] GET /identity/v3/roles => generated 2324 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:51:58.362084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c983a52-a7fb-491c-a8dc-99eeaee53400 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:58.400566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c983a52-a7fb-491c-a8dc-99eeaee53400 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:58.488856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f173c30-4c98-4e2d-8410-29e030eaf2a0 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:58.494465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1288d-323c-475e-98e0-a8517ecd26a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:58.495217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1288d-323c-475e-98e0-a8517ecd26a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:58.495564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1288d-323c-475e-98e0-a8517ecd26a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:58.495920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1288d-323c-475e-98e0-a8517ecd26a0 admin admin] PATH_INFO: `/v3/projects/ce1c1a8538674c29ace05af57b818d15` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:58.506787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1288d-323c-475e-98e0-a8517ecd26a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1c1a8538674c29ace05af57b818d15)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:58.510166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1288d-323c-475e-98e0-a8517ecd26a0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:58.548023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3949c-89c7-49b1-898e-134cc68b7f27 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:58.548969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3949c-89c7-49b1-898e-134cc68b7f27 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:58.549480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3949c-89c7-49b1-898e-134cc68b7f27 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:58.549914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3949c-89c7-49b1-898e-134cc68b7f27 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:58.550844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3949c-89c7-49b1-898e-134cc68b7f27 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:58.553814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3949c-89c7-49b1-898e-134cc68b7f27 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:58.575553 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2864/5689] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:58 2022] GET /identity/v3/roles => generated 2324 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:51:58.576936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3949c-89c7-49b1-898e-134cc68b7f27 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:58.620568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3949c-89c7-49b1-898e-134cc68b7f27 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:58.635996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37c60-1297-4ec8-8f22-889d2b0c0e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:58.636883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37c60-1297-4ec8-8f22-889d2b0c0e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:58.637008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37c60-1297-4ec8-8f22-889d2b0c0e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:58.637267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37c60-1297-4ec8-8f22-889d2b0c0e83 admin admin] PATH_INFO: `/v3/projects/d8a834f5e55b4544b5bbc3ab8609fe7f/users/d56ae280c89648eb99a4adcbd3231fc3/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:58.641693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b37c60-1297-4ec8-8f22-889d2b0c0e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a834f5e55b4544b5bbc3ab8609fe7f, user_id=d56ae280c89648eb99a4adcbd3231fc3, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:58.653288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b37c60-1297-4ec8-8f22-889d2b0c0e83 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:58.676799 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2865/5690] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:51:58 2022] PUT /identity/v3/projects/d8a834f5e55b4544b5bbc3ab8609fe7f/users/d56ae280c89648eb99a4adcbd3231fc3/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:58.676799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37c60-1297-4ec8-8f22-889d2b0c0e83 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:58.704589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5eb1288d-323c-475e-98e0-a8517ecd26a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1c1a8538674c29ace05af57b818d15', 'request_id': 'req-5eb1288d-323c-475e-98e0-a8517ecd26a0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:58.713115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5eb1288d-323c-475e-98e0-a8517ecd26a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1c1a8538674c29ace05af57b818d15', 'request_id': 'req-5eb1288d-323c-475e-98e0-a8517ecd26a0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:58.720277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5eb1288d-323c-475e-98e0-a8517ecd26a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1c1a8538674c29ace05af57b818d15', 'request_id': 'req-5eb1288d-323c-475e-98e0-a8517ecd26a0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:58.790823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37c60-1297-4ec8-8f22-889d2b0c0e83 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:58.819553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5eb1288d-323c-475e-98e0-a8517ecd26a0 admin admin] The token cache is being invalidate because project ce1c1a8538674c29ace05af57b818d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:51:58.820420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5eb1288d-323c-475e-98e0-a8517ecd26a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:58.821299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5eb1288d-323c-475e-98e0-a8517ecd26a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:51:58.823988 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2826/5691] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:51:58 2022] DELETE /identity/v3/projects/ce1c1a8538674c29ace05af57b818d15 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:51:58.828679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff96ea0-1068-4ea8-b6c9-9dd6d3e97672 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:58.829232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff96ea0-1068-4ea8-b6c9-9dd6d3e97672 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:58.830695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff96ea0-1068-4ea8-b6c9-9dd6d3e97672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:58.932004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5ff96ea0-1068-4ea8-b6c9-9dd6d3e97672 None None] MFA Rules not processed for user `d56ae280c89648eb99a4adcbd3231fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:58.934956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5ff96ea0-1068-4ea8-b6c9-9dd6d3e97672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:58.994029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a356ff4-5966-4a1c-852c-390abe7cbaac tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:58.995240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a356ff4-5966-4a1c-852c-390abe7cbaac tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:58.997998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a356ff4-5966-4a1c-852c-390abe7cbaac tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:58.998637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a356ff4-5966-4a1c-852c-390abe7cbaac tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:59.001195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a356ff4-5966-4a1c-852c-390abe7cbaac tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:59.006329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a356ff4-5966-4a1c-852c-390abe7cbaac tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:59.045738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:59.075615 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2827/5692] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:59.077064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3af8a-b1c8-45a8-8dc9-233e9a33c74c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:59.077413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3af8a-b1c8-45a8-8dc9-233e9a33c74c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:59.077743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3af8a-b1c8-45a8-8dc9-233e9a33c74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:59.114299 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2866/5693] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:51:58 2022] POST /identity/v3/roles => generated 234 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:51:59.119117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ca597-061e-4f9d-84b6-aceb4d53fe9e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:59.119888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ca597-061e-4f9d-84b6-aceb4d53fe9e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:59.120356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ca597-061e-4f9d-84b6-aceb4d53fe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:59.132334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f4e3af8a-b1c8-45a8-8dc9-233e9a33c74c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:59.134216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f4e3af8a-b1c8-45a8-8dc9-233e9a33c74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:59.140197 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-7b9ca597-061e-4f9d-84b6-aceb4d53fe9e None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:51:59.140197 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:51:59.140197 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:51:59.140197 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:51:59.140197 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:51:59.140197 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:51:59.140197 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:51:59.140197 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:51:59.140197 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:51:59.140197 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:51:59.140197 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:51:59.140197 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:51:59.140197 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:51:59.145332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:51:59.145332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:51:59.145332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:51:59.145332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:51:59.145332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:51:59.145332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:51:59.145332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:51:59.145332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:51:59.145332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:51:59.145332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:51:59.145332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:51:59.145332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:51:59.145332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:51:59.145332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:51:59.145332 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:51:59.175897 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2867/5694] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:51:59 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 38 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:51:59.175897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ca597-061e-4f9d-84b6-aceb4d53fe9e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:59.175897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7b9ca597-061e-4f9d-84b6-aceb4d53fe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:59.222574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ca597-061e-4f9d-84b6-aceb4d53fe9e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:59.236523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e68f72-d26b-460b-8e61-53616100d086 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:59.237177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e68f72-d26b-460b-8e61-53616100d086 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:59.237463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e68f72-d26b-460b-8e61-53616100d086 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:59.237734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e68f72-d26b-460b-8e61-53616100d086 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/b123a699217541a5a80b996fa2056b84` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:59.239770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e68f72-d26b-460b-8e61-53616100d086 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:update_role(role_id=b123a699217541a5a80b996fa2056b84)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:59.242937 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-14e68f72-d26b-460b-8e61-53616100d086 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:59.242937 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:51:59.242937 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:51:59.243848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e68f72-d26b-460b-8e61-53616100d086 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:59.318125 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2828/5695] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:59.321577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3af8a-b1c8-45a8-8dc9-233e9a33c74c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:59.323453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f4e3af8a-b1c8-45a8-8dc9-233e9a33c74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:59.404201 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2868/5696] 10.222.0.76 () {60 vars in 1243 bytes} [Sat Aug 27 04:51:59 2022] PATCH /identity/v3/roles/b123a699217541a5a80b996fa2056b84 => generated 237 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:59.405007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589883ba-d695-4484-89d6-c8b15b09d825 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:59.405307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589883ba-d695-4484-89d6-c8b15b09d825 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:59.407696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589883ba-d695-4484-89d6-c8b15b09d825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:59.498078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3af8a-b1c8-45a8-8dc9-233e9a33c74c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:59.504882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-589883ba-d695-4484-89d6-c8b15b09d825 None None] MFA Rules not processed for user `2dbd274a4c0243ecb81e238288d3893e`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:59.512607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b25c8-0c9f-4409-8a8c-46a0d1a4b15e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:59.517703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-589883ba-d695-4484-89d6-c8b15b09d825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:59.520383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b25c8-0c9f-4409-8a8c-46a0d1a4b15e service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:59.522584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b25c8-0c9f-4409-8a8c-46a0d1a4b15e service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:59.525901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b25c8-0c9f-4409-8a8c-46a0d1a4b15e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:59.544657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b25c8-0c9f-4409-8a8c-46a0d1a4b15e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:59.573561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b25c8-0c9f-4409-8a8c-46a0d1a4b15e service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:59.597299 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2829/5697] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:51:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:51:59.600282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54d877-f873-41a7-845f-9b1e7c0f1adc None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:59.601071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54d877-f873-41a7-845f-9b1e7c0f1adc None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:59.602459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54d877-f873-41a7-845f-9b1e7c0f1adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:59.710609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6d54d877-f873-41a7-845f-9b1e7c0f1adc None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:51:59.712625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6d54d877-f873-41a7-845f-9b1e7c0f1adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:51:59.716892 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2869/5698] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:59.718603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589883ba-d695-4484-89d6-c8b15b09d825 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:59.759459 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2830/5699] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:51:59.763447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54d877-f873-41a7-845f-9b1e7c0f1adc None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:59.778611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589883ba-d695-4484-89d6-c8b15b09d825 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:59.819526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aff55e-6daf-4b6b-a48a-6827b1044daf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:59.821271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aff55e-6daf-4b6b-a48a-6827b1044daf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:59.821271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aff55e-6daf-4b6b-a48a-6827b1044daf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:59.821271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aff55e-6daf-4b6b-a48a-6827b1044daf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/b123a699217541a5a80b996fa2056b84` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:59.824719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54d877-f873-41a7-845f-9b1e7c0f1adc None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:59.862342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aff55e-6daf-4b6b-a48a-6827b1044daf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:get_role(role_id=b123a699217541a5a80b996fa2056b84)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:59.866407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09c495-31a1-4aac-b7df-94288a9199df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:59.870799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aff55e-6daf-4b6b-a48a-6827b1044daf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:59.873893 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2870/5700] 10.222.0.76 () {58 vars in 1221 bytes} [Sat Aug 27 04:51:59 2022] GET /identity/v3/roles/b123a699217541a5a80b996fa2056b84 => generated 237 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:51:59.875851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09c495-31a1-4aac-b7df-94288a9199df admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:59.877878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aff55e-6daf-4b6b-a48a-6827b1044daf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:51:59.887753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09c495-31a1-4aac-b7df-94288a9199df admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:59.891703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09c495-31a1-4aac-b7df-94288a9199df admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:59.894836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09c495-31a1-4aac-b7df-94288a9199df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:51:59.897865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09c495-31a1-4aac-b7df-94288a9199df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:59.905536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09c495-31a1-4aac-b7df-94288a9199df admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:51:59.908589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aff55e-6daf-4b6b-a48a-6827b1044daf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:51:59.952406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:51:59.962742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462fe86-d92b-483c-8957-35e9c7cc1bdf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:51:59.962742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462fe86-d92b-483c-8957-35e9c7cc1bdf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:51:59.962742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462fe86-d92b-483c-8957-35e9c7cc1bdf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:51:59.963065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462fe86-d92b-483c-8957-35e9c7cc1bdf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:51:59.977021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462fe86-d92b-483c-8957-35e9c7cc1bdf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:51:59.978876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462fe86-d92b-483c-8957-35e9c7cc1bdf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:00.005275 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2831/5701] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:00.009679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09c495-31a1-4aac-b7df-94288a9199df admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:00.025728 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2871/5702] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:51:59 2022] GET /identity/v3/roles => generated 2552 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:00.026974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462fe86-d92b-483c-8957-35e9c7cc1bdf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:00.064865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09c495-31a1-4aac-b7df-94288a9199df admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:00.092669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667bd0e-acf5-4ebf-a214-d5b7f22cea7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:00.093325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667bd0e-acf5-4ebf-a214-d5b7f22cea7e admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:00.093611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667bd0e-acf5-4ebf-a214-d5b7f22cea7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:00.093897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667bd0e-acf5-4ebf-a214-d5b7f22cea7e admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:00.094545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667bd0e-acf5-4ebf-a214-d5b7f22cea7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:00.098920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462fe86-d92b-483c-8957-35e9c7cc1bdf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:00.100630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667bd0e-acf5-4ebf-a214-d5b7f22cea7e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:00.119942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d938af-e339-49d3-999d-f374c4c5fdf7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:00.122059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d938af-e339-49d3-999d-f374c4c5fdf7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:00.123678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d938af-e339-49d3-999d-f374c4c5fdf7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:00.123973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d938af-e339-49d3-999d-f374c4c5fdf7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/b123a699217541a5a80b996fa2056b84` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:00.132288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d938af-e339-49d3-999d-f374c4c5fdf7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b123a699217541a5a80b996fa2056b84)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:00.142364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d938af-e339-49d3-999d-f374c4c5fdf7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:00.327489 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2832/5703] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:00 2022] POST /identity/v3/projects => generated 373 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:52:00.333275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667bd0e-acf5-4ebf-a214-d5b7f22cea7e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:00.343807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-53d938af-e339-49d3-999d-f374c4c5fdf7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invalidating the token cache because role b123a699217541a5a80b996fa2056b84 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:00.344476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-53d938af-e339-49d3-999d-f374c4c5fdf7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:00.346297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-53d938af-e339-49d3-999d-f374c4c5fdf7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:00.351835 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2872/5704] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:00 2022] DELETE /identity/v3/roles/b123a699217541a5a80b996fa2056b84 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:00.357364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d938af-e339-49d3-999d-f374c4c5fdf7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:00.360150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-53d938af-e339-49d3-999d-f374c4c5fdf7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:00.514597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d938af-e339-49d3-999d-f374c4c5fdf7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:00.519491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667bd0e-acf5-4ebf-a214-d5b7f22cea7e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:00.528348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97d8d8-9054-421f-a516-ea19c3e72a97 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:00.529725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97d8d8-9054-421f-a516-ea19c3e72a97 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:00.530304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97d8d8-9054-421f-a516-ea19c3e72a97 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:00.530940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97d8d8-9054-421f-a516-ea19c3e72a97 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:00.537713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97d8d8-9054-421f-a516-ea19c3e72a97 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=79d566fca0ac4c2b9a147a70bf0e7278)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:00.540042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97d8d8-9054-421f-a516-ea19c3e72a97 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:00.639724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d1d24-407f-4447-bf40-86aeabd88fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:00.640519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d1d24-407f-4447-bf40-86aeabd88fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:00.641016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d1d24-407f-4447-bf40-86aeabd88fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:00.641525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d1d24-407f-4447-bf40-86aeabd88fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:00.642338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d1d24-407f-4447-bf40-86aeabd88fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:00.644743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d1d24-407f-4447-bf40-86aeabd88fa2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:00.757738 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2873/5705] 10.222.0.76 () {60 vars in 1363 bytes} [Sat Aug 27 04:52:00 2022] PUT /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278 => generated 521 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:52:00.759627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97d8d8-9054-421f-a516-ea19c3e72a97 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:00.764665 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2833/5706] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:00 2022] POST /identity/v3/users => generated 287 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:00.766138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d1d24-407f-4447-bf40-86aeabd88fa2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:00.769085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-425d1d24-407f-4447-bf40-86aeabd88fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:00.790008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d1d24-407f-4447-bf40-86aeabd88fa2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:00.885112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97d8d8-9054-421f-a516-ea19c3e72a97 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:00.897125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bb8f9-fd76-4903-841e-e381d046f669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:00.897684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bb8f9-fd76-4903-841e-e381d046f669 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:00.898273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bb8f9-fd76-4903-841e-e381d046f669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:00.899196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bb8f9-fd76-4903-841e-e381d046f669 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:00.899955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bb8f9-fd76-4903-841e-e381d046f669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:00.903565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bb8f9-fd76-4903-841e-e381d046f669 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:00.904969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d52934-839b-4f4b-8296-f23e5a32a991 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:00.905817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d52934-839b-4f4b-8296-f23e5a32a991 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:00.906127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d52934-839b-4f4b-8296-f23e5a32a991 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:00.906401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d52934-839b-4f4b-8296-f23e5a32a991 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/98e065d0a72643c3967449fd360f10c0` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:00.908415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d52934-839b-4f4b-8296-f23e5a32a991 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=98e065d0a72643c3967449fd360f10c0)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:00.910456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d52934-839b-4f4b-8296-f23e5a32a991 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:00.923378 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2834/5707] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:00 2022] GET /identity/v3/roles => generated 2324 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:00.925521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f322bca-2759-4b57-9b60-d12670909342 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:00.925859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f322bca-2759-4b57-9b60-d12670909342 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:00.926143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f322bca-2759-4b57-9b60-d12670909342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:00.933752 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-8f322bca-2759-4b57-9b60-d12670909342 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:52:00.933752 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:00.933752 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:52:00.933752 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:52:00.933752 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:52:00.933752 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:52:00.933752 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:52:00.933752 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:52:00.933752 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:52:00.933752 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:52:00.933752 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:52:00.933752 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:52:00.933752 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:52:00.935120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:52:00.935120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:52:00.935120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:52:00.935120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:52:00.935120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:52:00.935120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:52:00.935120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:52:00.935120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:52:00.935120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:52:00.935120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:52:00.935120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:52:00.935120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:52:00.935120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:52:00.935120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:52:00.935120 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:52:00.959826 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2835/5708] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:52:00 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 36 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:52:00.961622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f322bca-2759-4b57-9b60-d12670909342 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:00.995733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f322bca-2759-4b57-9b60-d12670909342 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:01.003834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31e60d-695d-4e5e-b5d6-ce2ebf63c603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:01.005793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31e60d-695d-4e5e-b5d6-ce2ebf63c603 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:01.006366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31e60d-695d-4e5e-b5d6-ce2ebf63c603 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:01.008207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:01.009487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31e60d-695d-4e5e-b5d6-ce2ebf63c603 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:01.010200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31e60d-695d-4e5e-b5d6-ce2ebf63c603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:01.014054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31e60d-695d-4e5e-b5d6-ce2ebf63c603 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:01.045462 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2836/5709] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:00 2022] GET /identity/v3/roles => generated 2324 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:01.046847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cadd58-ba62-4c8c-96c9-429fdccec4a8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:01.047181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cadd58-ba62-4c8c-96c9-429fdccec4a8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:01.047409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cadd58-ba62-4c8c-96c9-429fdccec4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:01.053638 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2874/5710] 10.222.0.76 () {60 vars in 1363 bytes} [Sat Aug 27 04:52:00 2022] PUT /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/98e065d0a72643c3967449fd360f10c0 => generated 521 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:52:01.055614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d52934-839b-4f4b-8296-f23e5a32a991 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:01.079590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-25cadd58-ba62-4c8c-96c9-429fdccec4a8 None None] MFA Rules not processed for user `2dbd274a4c0243ecb81e238288d3893e`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:01.080902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-25cadd58-ba62-4c8c-96c9-429fdccec4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:01.136974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d52934-839b-4f4b-8296-f23e5a32a991 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:01.141983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322fe80-5609-4701-9c34-283eacb89e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:01.142420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322fe80-5609-4701-9c34-283eacb89e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:01.142739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322fe80-5609-4701-9c34-283eacb89e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:01.143012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322fe80-5609-4701-9c34-283eacb89e9e admin admin] PATH_INFO: `/v3/projects/6f90fffa5a4140f5a4637da116ebc138/users/d33dc48033074d60a1c1fb1adf91417d/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:01.153176 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2837/5711] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:01.154298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cadd58-ba62-4c8c-96c9-429fdccec4a8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:01.176458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322fe80-5609-4701-9c34-283eacb89e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f90fffa5a4140f5a4637da116ebc138, user_id=d33dc48033074d60a1c1fb1adf91417d, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:01.183187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322fe80-5609-4701-9c34-283eacb89e9e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:01.268360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cadd58-ba62-4c8c-96c9-429fdccec4a8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:01.274349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dff741-5d33-446e-8010-598f961ddbb4 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:01.275710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dff741-5d33-446e-8010-598f961ddbb4 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:01.275710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dff741-5d33-446e-8010-598f961ddbb4 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:01.275920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dff741-5d33-446e-8010-598f961ddbb4 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/98e065d0a72643c3967449fd360f10c0/implies/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:01.279058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dff741-5d33-446e-8010-598f961ddbb4 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=98e065d0a72643c3967449fd360f10c0, implied_role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:01.286096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dff741-5d33-446e-8010-598f961ddbb4 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:01.315076 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2875/5712] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:01 2022] PUT /identity/v3/projects/6f90fffa5a4140f5a4637da116ebc138/users/d33dc48033074d60a1c1fb1adf91417d/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:01.326835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff81d5-702f-40fd-9d98-2cfaf3da652c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:01.327143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff81d5-702f-40fd-9d98-2cfaf3da652c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:01.327440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff81d5-702f-40fd-9d98-2cfaf3da652c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:01.374050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8bff81d5-702f-40fd-9d98-2cfaf3da652c None None] MFA Rules not processed for user `d33dc48033074d60a1c1fb1adf91417d`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:01.375375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8bff81d5-702f-40fd-9d98-2cfaf3da652c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:01.446499 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2838/5713] 10.222.0.76 () {60 vars in 1363 bytes} [Sat Aug 27 04:52:01 2022] PUT /identity/v3/roles/98e065d0a72643c3967449fd360f10c0/implies/959d409c289a4ad1b4ceeea047bb8036 => generated 521 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:01.446499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dff741-5d33-446e-8010-598f961ddbb4 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:01.446499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f7dff741-5d33-446e-8010-598f961ddbb4 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:01.516431 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2876/5714] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:52:01.517920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff81d5-702f-40fd-9d98-2cfaf3da652c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:01.616907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dff741-5d33-446e-8010-598f961ddbb4 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:01.623116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:01.623886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:01.624190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:01.624516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb admin admin] PATH_INFO: `/v3/projects/bf0ea305715d4476bbd6177698d73eb8` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:01.626669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0ea305715d4476bbd6177698d73eb8)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:01.632965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:01.635693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff81d5-702f-40fd-9d98-2cfaf3da652c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:01.715472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50ee68-80ec-45d6-9d1e-e1b6e78234b7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:01.716796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50ee68-80ec-45d6-9d1e-e1b6e78234b7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:01.717372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50ee68-80ec-45d6-9d1e-e1b6e78234b7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:01.717885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50ee68-80ec-45d6-9d1e-e1b6e78234b7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/98e065d0a72643c3967449fd360f10c0/implies` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:01.719544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50ee68-80ec-45d6-9d1e-e1b6e78234b7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=98e065d0a72643c3967449fd360f10c0)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:01.721159 n-d-852088-5 devstack@keystone.service[82083]: WARNING py.warnings [None req-3d50ee68-80ec-45d6-9d1e-e1b6e78234b7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:52:01.721159 n-d-852088-5 devstack@keystone.service[82083]: warnings.warn(msg) Aug 27 04:52:01.721159 n-d-852088-5 devstack@keystone.service[82083]: Aug 27 04:52:01.723243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50ee68-80ec-45d6-9d1e-e1b6e78234b7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:01.742214 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2877/5715] 10.222.0.76 () {58 vars in 1245 bytes} [Sat Aug 27 04:52:01 2022] GET /identity/v3/roles/98e065d0a72643c3967449fd360f10c0/implies => generated 490 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:01.742214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50ee68-80ec-45d6-9d1e-e1b6e78234b7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:01.821230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50ee68-80ec-45d6-9d1e-e1b6e78234b7 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:01.826912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2ed9f-0f11-419d-bbd2-b6fef68930a2 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd33dc48033074d60a1c1fb1adf91417d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f90fffa5a4140f5a4637da116ebc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:01.836506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ed9f-0f11-419d-bbd2-b6fef68930a2 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:01.836506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ed9f-0f11-419d-bbd2-b6fef68930a2 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:01.836506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ed9f-0f11-419d-bbd2-b6fef68930a2 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] PATH_INFO: `/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:01.836506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2ed9f-0f11-419d-bbd2-b6fef68930a2 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=d33dc48033074d60a1c1fb1adf91417d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:01.836506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2ed9f-0f11-419d-bbd2-b6fef68930a2 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:01.866482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0ea305715d4476bbd6177698d73eb8', 'request_id': 'req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:01.873858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0ea305715d4476bbd6177698d73eb8', 'request_id': 'req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:01.882971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0ea305715d4476bbd6177698d73eb8', 'request_id': 'req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:01.961828 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2878/5716] 10.222.0.76 () {60 vars in 1299 bytes} [Sat Aug 27 04:52:01 2022] POST /identity/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2 => generated 367 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:01.963198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c0d76-a7d6-42b2-82fa-99708fa3cee2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:01.963479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c0d76-a7d6-42b2-82fa-99708fa3cee2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:01.963825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c0d76-a7d6-42b2-82fa-99708fa3cee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:01.986746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-869c0d76-a7d6-42b2-82fa-99708fa3cee2 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:52:01.986746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:01.986746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:52:01.986746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:52:01.986746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:52:01.986746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:52:01.986746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:52:01.986746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:52:01.986746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:52:01.986746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:52:01.986746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:52:01.986746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:52:01.986746 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:52:01.987914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:52:01.987914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:52:01.987914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:52:01.987914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:52:01.987914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:52:01.987914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:52:01.987914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:52:01.987914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:52:01.987914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:52:01.987914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:52:01.987914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:52:01.987914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:52:01.987914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:52:01.987914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:52:01.987914 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:01.989322 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2879/5717] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:52:01 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 27 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:52:01.991972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c0d76-a7d6-42b2-82fa-99708fa3cee2 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:02.025422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb admin admin] The token cache is being invalidate because project bf0ea305715d4476bbd6177698d73eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:02.025422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:02.026228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:02.035416 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2839/5718] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:01 2022] DELETE /identity/v3/projects/bf0ea305715d4476bbd6177698d73eb8 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:02.039858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:02.043863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:02.192773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c0d76-a7d6-42b2-82fa-99708fa3cee2 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:02.201766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd95e7-f02a-4174-afce-12b0af42b109 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:02.205719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd95e7-f02a-4174-afce-12b0af42b109 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:02.205719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd95e7-f02a-4174-afce-12b0af42b109 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:02.205719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd95e7-f02a-4174-afce-12b0af42b109 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:02.205719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd95e7-f02a-4174-afce-12b0af42b109 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:02.207122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd95e7-f02a-4174-afce-12b0af42b109 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:02.209323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f547d-7145-4ba3-a953-c0b4f0a6a7fb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:02.220720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a22b7-1b37-4752-ad4b-20d944337874 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd33dc48033074d60a1c1fb1adf91417d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f90fffa5a4140f5a4637da116ebc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:02.221942 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2880/5719] 10.222.0.76 () {58 vars in 1245 bytes} [Sat Aug 27 04:52:01 2022] GET /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies => generated 661 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:02.223112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f403dd-9c25-4393-ae06-e93dc9ba5346 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:02.223337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a22b7-1b37-4752-ad4b-20d944337874 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:02.223585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f403dd-9c25-4393-ae06-e93dc9ba5346 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:02.224027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f403dd-9c25-4393-ae06-e93dc9ba5346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:02.226555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a22b7-1b37-4752-ad4b-20d944337874 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:02.226851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a22b7-1b37-4752-ad4b-20d944337874 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] PATH_INFO: `/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2/e51117431c9b40259c5f1e0edfac8fe6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:02.230719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a22b7-1b37-4752-ad4b-20d944337874 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=d33dc48033074d60a1c1fb1adf91417d, credential_id=e51117431c9b40259c5f1e0edfac8fe6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:02.236737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a22b7-1b37-4752-ad4b-20d944337874 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:02.255667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-86f403dd-9c25-4393-ae06-e93dc9ba5346 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:02.259028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-86f403dd-9c25-4393-ae06-e93dc9ba5346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:02.349285 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2840/5720] 10.222.0.76 () {58 vars in 1380 bytes} [Sat Aug 27 04:52:02 2022] DELETE /identity/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2/e51117431c9b40259c5f1e0edfac8fe6 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:02.354706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a22b7-1b37-4752-ad4b-20d944337874 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:02.354706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e53a22b7-1b37-4752-ad4b-20d944337874 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:02.371509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a22b7-1b37-4752-ad4b-20d944337874 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:02.376421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839b349-8b17-4219-9750-fa194aa12283 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:02.377288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839b349-8b17-4219-9750-fa194aa12283 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:02.377579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839b349-8b17-4219-9750-fa194aa12283 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:02.377859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839b349-8b17-4219-9750-fa194aa12283 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/98e065d0a72643c3967449fd360f10c0/implies/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:02.379715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839b349-8b17-4219-9750-fa194aa12283 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=98e065d0a72643c3967449fd360f10c0, implied_role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:02.381416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839b349-8b17-4219-9750-fa194aa12283 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:02.386725 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2881/5721] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:02.406158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f403dd-9c25-4393-ae06-e93dc9ba5346 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:02.406158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f403dd-9c25-4393-ae06-e93dc9ba5346 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:02.418983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fe366-eb36-435b-85cd-6f3cc865cd65 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd33dc48033074d60a1c1fb1adf91417d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f90fffa5a4140f5a4637da116ebc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:02.419664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fe366-eb36-435b-85cd-6f3cc865cd65 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:02.420460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fe366-eb36-435b-85cd-6f3cc865cd65 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:02.420748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fe366-eb36-435b-85cd-6f3cc865cd65 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] PATH_INFO: `/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:02.421525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fe366-eb36-435b-85cd-6f3cc865cd65 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=d33dc48033074d60a1c1fb1adf91417d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:02.423226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fe366-eb36-435b-85cd-6f3cc865cd65 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:02.523570 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2841/5722] 10.222.0.76 () {58 vars in 1347 bytes} [Sat Aug 27 04:52:02 2022] DELETE /identity/v3/roles/98e065d0a72643c3967449fd360f10c0/implies/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:02.523570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0758dc-d1c2-4aac-ba6f-afaa6ef2d345 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:02.523570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0758dc-d1c2-4aac-ba6f-afaa6ef2d345 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:02.523570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0758dc-d1c2-4aac-ba6f-afaa6ef2d345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:02.547018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-db0758dc-d1c2-4aac-ba6f-afaa6ef2d345 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:02.548343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-db0758dc-d1c2-4aac-ba6f-afaa6ef2d345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:02.614538 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2882/5723] 10.222.0.76 () {60 vars in 1299 bytes} [Sat Aug 27 04:52:02 2022] POST /identity/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2 => generated 367 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:02.615507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fe366-eb36-435b-85cd-6f3cc865cd65 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:02.640003 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2842/5724] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:02.640326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0758dc-d1c2-4aac-ba6f-afaa6ef2d345 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:02.668936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fe366-eb36-435b-85cd-6f3cc865cd65 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:02.742881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0758dc-d1c2-4aac-ba6f-afaa6ef2d345 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:02.758558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0445d3-30c3-4602-98b3-db96ace29ff3 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd33dc48033074d60a1c1fb1adf91417d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f90fffa5a4140f5a4637da116ebc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:02.760653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0445d3-30c3-4602-98b3-db96ace29ff3 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:02.760955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0445d3-30c3-4602-98b3-db96ace29ff3 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:02.761237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0445d3-30c3-4602-98b3-db96ace29ff3 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] PATH_INFO: `/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2/e9f4eaeaabc044e0abe0d55c7e8fb37f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:02.768154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0445d3-30c3-4602-98b3-db96ace29ff3 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=d33dc48033074d60a1c1fb1adf91417d, credential_id=e9f4eaeaabc044e0abe0d55c7e8fb37f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:02.772602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0445d3-30c3-4602-98b3-db96ace29ff3 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:02.775027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e5ba8-4c2b-4c3e-a33b-6d1b2fe3441b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:02.775707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e5ba8-4c2b-4c3e-a33b-6d1b2fe3441b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:02.775994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e5ba8-4c2b-4c3e-a33b-6d1b2fe3441b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:02.776300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e5ba8-4c2b-4c3e-a33b-6d1b2fe3441b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/98e065d0a72643c3967449fd360f10c0` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:02.778869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e5ba8-4c2b-4c3e-a33b-6d1b2fe3441b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=98e065d0a72643c3967449fd360f10c0)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:02.780552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e5ba8-4c2b-4c3e-a33b-6d1b2fe3441b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:02.886843 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2883/5725] 10.222.0.76 () {58 vars in 1347 bytes} [Sat Aug 27 04:52:02 2022] DELETE /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/98e065d0a72643c3967449fd360f10c0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:02.888145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e5ba8-4c2b-4c3e-a33b-6d1b2fe3441b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:02.903942 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2843/5726] 10.222.0.76 () {58 vars in 1380 bytes} [Sat Aug 27 04:52:02 2022] DELETE /identity/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2/e9f4eaeaabc044e0abe0d55c7e8fb37f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:02.904843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0445d3-30c3-4602-98b3-db96ace29ff3 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:02.920211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:02.951158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0445d3-30c3-4602-98b3-db96ace29ff3 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:03.002493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:03.029468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e5ba8-4c2b-4c3e-a33b-6d1b2fe3441b tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:03.041390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d46f5-1938-48fa-9e22-ab4214612d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:03.045629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d46f5-1938-48fa-9e22-ab4214612d8d admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:03.045629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d46f5-1938-48fa-9e22-ab4214612d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:03.045629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d46f5-1938-48fa-9e22-ab4214612d8d admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:03.045629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d46f5-1938-48fa-9e22-ab4214612d8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:03.045629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d46f5-1938-48fa-9e22-ab4214612d8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:03.046172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d46f5-1938-48fa-9e22-ab4214612d8d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:03.059257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eed1f-1b1d-49cf-8746-f575c3a90766 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:03.060416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eed1f-1b1d-49cf-8746-f575c3a90766 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:03.060921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eed1f-1b1d-49cf-8746-f575c3a90766 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:03.061588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eed1f-1b1d-49cf-8746-f575c3a90766 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:03.064546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140eed1f-1b1d-49cf-8746-f575c3a90766 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=172fc58542b84a4b95bcc5b4b36789e7, implied_role_id=79d566fca0ac4c2b9a147a70bf0e7278)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:03.067758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140eed1f-1b1d-49cf-8746-f575c3a90766 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:03.077094 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2884/5727] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:03.083195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d46f5-1938-48fa-9e22-ab4214612d8d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:03.161450 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2844/5728] 10.222.0.76 () {58 vars in 1347 bytes} [Sat Aug 27 04:52:02 2022] DELETE /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7/implies/79d566fca0ac4c2b9a147a70bf0e7278 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:03.163308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eed1f-1b1d-49cf-8746-f575c3a90766 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:03.184097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d46f5-1938-48fa-9e22-ab4214612d8d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:03.295798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fce45-e7ea-47c3-873c-49155bf17416 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd33dc48033074d60a1c1fb1adf91417d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f90fffa5a4140f5a4637da116ebc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:03.295798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fce45-e7ea-47c3-873c-49155bf17416 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:03.295798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fce45-e7ea-47c3-873c-49155bf17416 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:03.296469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fce45-e7ea-47c3-873c-49155bf17416 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] PATH_INFO: `/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2/e9f4eaeaabc044e0abe0d55c7e8fb37f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:03.308769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eed1f-1b1d-49cf-8746-f575c3a90766 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:03.324803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f805226-cefa-4bf5-b51c-1d19747d31e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:03.325441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f805226-cefa-4bf5-b51c-1d19747d31e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:03.325724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f805226-cefa-4bf5-b51c-1d19747d31e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:03.325999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f805226-cefa-4bf5-b51c-1d19747d31e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:03.326657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f805226-cefa-4bf5-b51c-1d19747d31e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:03.328867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f805226-cefa-4bf5-b51c-1d19747d31e5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:03.333661 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-de1fce45-e7ea-47c3-873c-49155bf17416 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Could not find credential: dd1a667caede5eb3cadcb85d646bb53cb298d6e1e1cb0032f2f9eaee6707fa02.: keystone.exception.CredentialNotFound: Could not find credential: dd1a667caede5eb3cadcb85d646bb53cb298d6e1e1cb0032f2f9eaee6707fa02. Aug 27 04:52:03.333661 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:03.333661 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:52:03.333661 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:52:03.333661 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:52:03.333661 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:52:03.333661 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:52:03.333661 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:52:03.333661 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:52:03.333661 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:52:03.333661 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:52:03.333661 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:52:03.333661 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Aug 27 04:52:03.333661 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 27 04:52:03.334909 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 27 04:52:03.334909 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 27 04:52:03.334909 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Aug 27 04:52:03.334909 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Aug 27 04:52:03.334909 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:03.334909 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:03.334909 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Aug 27 04:52:03.334909 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Aug 27 04:52:03.334909 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:52:03.334909 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:52:03.334909 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:52:03.334909 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:52:03.334909 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:52:03.334909 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:52:03.334909 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:52:03.334909 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:52:03.336433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:52:03.336433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:52:03.336433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:52:03.336433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:52:03.336433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:52:03.336433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:52:03.336433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Aug 27 04:52:03.336433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Aug 27 04:52:03.336433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Aug 27 04:52:03.336433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Aug 27 04:52:03.336433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Aug 27 04:52:03.336433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Aug 27 04:52:03.336433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: dd1a667caede5eb3cadcb85d646bb53cb298d6e1e1cb0032f2f9eaee6707fa02. Aug 27 04:52:03.336433 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:03.340532 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2885/5729] 10.222.0.76 () {58 vars in 1377 bytes} [Sat Aug 27 04:52:03 2022] GET /identity/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2/e9f4eaeaabc044e0abe0d55c7e8fb37f => generated 148 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:52:03.341500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fce45-e7ea-47c3-873c-49155bf17416 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:03.467922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fce45-e7ea-47c3-873c-49155bf17416 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:03.468055 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2845/5730] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:03 2022] POST /identity/v3/projects => generated 381 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:03.468055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f805226-cefa-4bf5-b51c-1d19747d31e5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:03.475716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21f7bf-5a93-4d46-8d09-8e89b0934513 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:03.477289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21f7bf-5a93-4d46-8d09-8e89b0934513 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:03.477577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21f7bf-5a93-4d46-8d09-8e89b0934513 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:03.478330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21f7bf-5a93-4d46-8d09-8e89b0934513 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/domains/5bb40926ffa84146bb5a61230113b37e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:03.501933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21f7bf-5a93-4d46-8d09-8e89b0934513 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:52:03.515326 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-3e21f7bf-5a93-4d46-8d09-8e89b0934513 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Could not find domain: 5bb40926ffa84146bb5a61230113b37e.: keystone.exception.DomainNotFound: Could not find domain: 5bb40926ffa84146bb5a61230113b37e. Aug 27 04:52:03.515326 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:03.515326 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:52:03.515326 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:52:03.515326 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:52:03.515326 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:52:03.515326 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:52:03.515326 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:52:03.515326 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5bb40926ffa84146bb5a61230113b37e. Aug 27 04:52:03.515326 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:03.515326 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:52:03.515326 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:03.515326 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:03.515326 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:52:03.515326 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:52:03.515326 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:52:03.516701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:52:03.516701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:52:03.516701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:52:03.516701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:52:03.516701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:52:03.516701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:52:03.516701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:52:03.516701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 27 04:52:03.516701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 27 04:52:03.516701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:52:03.516701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:52:03.516701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:52:03.516701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:52:03.516701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:03.516701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:03.516701 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:52:03.517846 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:52:03.517846 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:52:03.517846 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:52:03.517846 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:52:03.517846 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:52:03.517846 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:52:03.517846 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:52:03.517846 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:52:03.517846 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:52:03.517846 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:52:03.517846 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:52:03.517846 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:52:03.517846 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:52:03.517846 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:52:03.517846 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:52:03.517846 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 5bb40926ffa84146bb5a61230113b37e. Aug 27 04:52:03.517846 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:03.521691 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2886/5731] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:52:03 2022] PATCH /identity/v3/domains/5bb40926ffa84146bb5a61230113b37e => generated 112 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:52:03.524567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21f7bf-5a93-4d46-8d09-8e89b0934513 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:03.555123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21f7bf-5a93-4d46-8d09-8e89b0934513 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:03.625194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f805226-cefa-4bf5-b51c-1d19747d31e5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:03.638635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10444cc1-8c0b-4833-ba57-c146981b1f50 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd33dc48033074d60a1c1fb1adf91417d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f90fffa5a4140f5a4637da116ebc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:03.639737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10444cc1-8c0b-4833-ba57-c146981b1f50 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:03.640259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10444cc1-8c0b-4833-ba57-c146981b1f50 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:03.641627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10444cc1-8c0b-4833-ba57-c146981b1f50 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] PATH_INFO: `/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:03.645034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10444cc1-8c0b-4833-ba57-c146981b1f50 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=d33dc48033074d60a1c1fb1adf91417d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:03.646954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10444cc1-8c0b-4833-ba57-c146981b1f50 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:03.691667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3869712-b948-4593-ba1b-ccbb418079a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:03.692343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3869712-b948-4593-ba1b-ccbb418079a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:03.692621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3869712-b948-4593-ba1b-ccbb418079a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:03.697787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3869712-b948-4593-ba1b-ccbb418079a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:03.698551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3869712-b948-4593-ba1b-ccbb418079a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:03.701716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3869712-b948-4593-ba1b-ccbb418079a6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:03.767476 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2846/5732] 10.222.0.76 () {60 vars in 1299 bytes} [Sat Aug 27 04:52:03 2022] POST /identity/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2 => generated 367 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:03.767476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10444cc1-8c0b-4833-ba57-c146981b1f50 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:03.864262 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2887/5733] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:03 2022] POST /identity/v3/users => generated 291 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:03.864262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3869712-b948-4593-ba1b-ccbb418079a6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:03.886858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3869712-b948-4593-ba1b-ccbb418079a6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:03.897084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7a62e-e8ba-4343-9d44-c3f23be09ac1 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd33dc48033074d60a1c1fb1adf91417d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f90fffa5a4140f5a4637da116ebc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:03.897932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7a62e-e8ba-4343-9d44-c3f23be09ac1 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:03.898352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7a62e-e8ba-4343-9d44-c3f23be09ac1 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:03.898518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7a62e-e8ba-4343-9d44-c3f23be09ac1 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] PATH_INFO: `/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:03.899218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7a62e-e8ba-4343-9d44-c3f23be09ac1 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=d33dc48033074d60a1c1fb1adf91417d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:03.902907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7a62e-e8ba-4343-9d44-c3f23be09ac1 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:03.906869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10444cc1-8c0b-4833-ba57-c146981b1f50 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:03.919697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8f7e6-e6cb-43c2-b8dc-c220365c6c29 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:03.924223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8f7e6-e6cb-43c2-b8dc-c220365c6c29 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:03.924223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8f7e6-e6cb-43c2-b8dc-c220365c6c29 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:03.924223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8f7e6-e6cb-43c2-b8dc-c220365c6c29 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/users/0a48539c987b4f988709d51f673cda2d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:03.924223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8f7e6-e6cb-43c2-b8dc-c220365c6c29 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0a48539c987b4f988709d51f673cda2d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:03.935289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8f7e6-e6cb-43c2-b8dc-c220365c6c29 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:04.087034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:04.095743 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2888/5734] 10.222.0.76 () {60 vars in 1299 bytes} [Sat Aug 27 04:52:03 2022] POST /identity/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2 => generated 367 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:04.095743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7a62e-e8ba-4343-9d44-c3f23be09ac1 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:04.124183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7a62e-e8ba-4343-9d44-c3f23be09ac1 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:04.134889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d978ba-299a-4c0e-852c-89cec95c9e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:04.136008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d978ba-299a-4c0e-852c-89cec95c9e99 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:04.136485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d978ba-299a-4c0e-852c-89cec95c9e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:04.137018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d978ba-299a-4c0e-852c-89cec95c9e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:04.138027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d978ba-299a-4c0e-852c-89cec95c9e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:04.140904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d978ba-299a-4c0e-852c-89cec95c9e99 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:04.171653 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2889/5735] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:04 2022] GET /identity/v3/roles => generated 2324 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:04.172699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d978ba-299a-4c0e-852c-89cec95c9e99 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:04.186316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d978ba-299a-4c0e-852c-89cec95c9e99 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:04.190676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de738ca-7628-4649-a343-3b78ff45e259 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd33dc48033074d60a1c1fb1adf91417d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f90fffa5a4140f5a4637da116ebc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:04.191316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de738ca-7628-4649-a343-3b78ff45e259 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:04.191595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de738ca-7628-4649-a343-3b78ff45e259 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:04.192182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de738ca-7628-4649-a343-3b78ff45e259 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] PATH_INFO: `/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:04.210496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de738ca-7628-4649-a343-3b78ff45e259 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=d33dc48033074d60a1c1fb1adf91417d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:04.216069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de738ca-7628-4649-a343-3b78ff45e259 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:04.238660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f4d8f7e6-e6cb-43c2-b8dc-c220365c6c29 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a48539c987b4f988709d51f673cda2d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:04.260551 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2890/5736] 10.222.0.76 () {58 vars in 1278 bytes} [Sat Aug 27 04:52:04 2022] GET /identity/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2 => generated 865 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:04.261919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de738ca-7628-4649-a343-3b78ff45e259 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:04.278074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de738ca-7628-4649-a343-3b78ff45e259 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:04.284692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d92bd-7779-4060-97c0-646365f59213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:04.285489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d92bd-7779-4060-97c0-646365f59213 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:04.285823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d92bd-7779-4060-97c0-646365f59213 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:04.286097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d92bd-7779-4060-97c0-646365f59213 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:04.287981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d92bd-7779-4060-97c0-646365f59213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:04.290895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d92bd-7779-4060-97c0-646365f59213 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:04.313225 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2891/5737] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:04 2022] GET /identity/v3/roles => generated 2324 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:04.315680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d92bd-7779-4060-97c0-646365f59213 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:04.340300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d92bd-7779-4060-97c0-646365f59213 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:04.345995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ea41b-0de3-41a9-8415-31daca5aa018 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd33dc48033074d60a1c1fb1adf91417d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f90fffa5a4140f5a4637da116ebc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:04.346928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ea41b-0de3-41a9-8415-31daca5aa018 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:04.347400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ea41b-0de3-41a9-8415-31daca5aa018 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:04.347931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ea41b-0de3-41a9-8415-31daca5aa018 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] PATH_INFO: `/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2/a87437a9db834c98b824b4f79a868ea6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:04.351977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f4d8f7e6-e6cb-43c2-b8dc-c220365c6c29 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a48539c987b4f988709d51f673cda2d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:04.352675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f4d8f7e6-e6cb-43c2-b8dc-c220365c6c29 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a48539c987b4f988709d51f673cda2d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:04.360614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ea41b-0de3-41a9-8415-31daca5aa018 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=d33dc48033074d60a1c1fb1adf91417d, credential_id=a87437a9db834c98b824b4f79a868ea6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:04.362146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ea41b-0de3-41a9-8415-31daca5aa018 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:04.362751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f4d8f7e6-e6cb-43c2-b8dc-c220365c6c29 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a48539c987b4f988709d51f673cda2d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:04.380873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f4d8f7e6-e6cb-43c2-b8dc-c220365c6c29 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a48539c987b4f988709d51f673cda2d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:04.392033 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2847/5738] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:03 2022] DELETE /identity/v3/users/0a48539c987b4f988709d51f673cda2d => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:04.392924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8f7e6-e6cb-43c2-b8dc-c220365c6c29 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:04.395707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f4d8f7e6-e6cb-43c2-b8dc-c220365c6c29 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:04.500853 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2892/5739] 10.222.0.76 () {58 vars in 1380 bytes} [Sat Aug 27 04:52:04 2022] DELETE /identity/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2/a87437a9db834c98b824b4f79a868ea6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:04.504280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ea41b-0de3-41a9-8415-31daca5aa018 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:04.505959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-487ea41b-0de3-41a9-8415-31daca5aa018 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:04.516436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8f7e6-e6cb-43c2-b8dc-c220365c6c29 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:04.524821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2de775-acf8-4965-91df-18186986b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:04.526196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2de775-acf8-4965-91df-18186986b342 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:04.533091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2de775-acf8-4965-91df-18186986b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:04.533091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2de775-acf8-4965-91df-18186986b342 admin admin] PATH_INFO: `/v3/projects/d204f6345a0e4876a7359b14b48f8ca1/users/4ec2ade268514a35b76961bc94831459/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:04.533325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ea41b-0de3-41a9-8415-31daca5aa018 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:04.562858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2de775-acf8-4965-91df-18186986b342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d204f6345a0e4876a7359b14b48f8ca1, user_id=4ec2ade268514a35b76961bc94831459, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:04.573219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2de775-acf8-4965-91df-18186986b342 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:04.652402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca547c-de3b-489e-8b35-949b785927d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:04.653118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca547c-de3b-489e-8b35-949b785927d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:04.653651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca547c-de3b-489e-8b35-949b785927d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:04.653938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca547c-de3b-489e-8b35-949b785927d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/959d409c289a4ad1b4ceeea047bb8036` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:04.655625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca547c-de3b-489e-8b35-949b785927d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_role(role_id=959d409c289a4ad1b4ceeea047bb8036)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:04.660090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca547c-de3b-489e-8b35-949b785927d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:04.765298 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2848/5740] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:04 2022] PUT /identity/v3/projects/d204f6345a0e4876a7359b14b48f8ca1/users/4ec2ade268514a35b76961bc94831459/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:04.766837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2de775-acf8-4965-91df-18186986b342 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:04.805916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7c2de775-acf8-4965-91df-18186986b342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:04.976784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2de775-acf8-4965-91df-18186986b342 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:04.985182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4dca547c-de3b-489e-8b35-949b785927d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invalidating the token cache because role 959d409c289a4ad1b4ceeea047bb8036 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:04.985474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4385c7-e72d-4f7f-84bc-03c3dd93b7ba tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd33dc48033074d60a1c1fb1adf91417d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f90fffa5a4140f5a4637da116ebc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:04.986495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4dca547c-de3b-489e-8b35-949b785927d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:04.986720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4385c7-e72d-4f7f-84bc-03c3dd93b7ba tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:04.986971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4385c7-e72d-4f7f-84bc-03c3dd93b7ba tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:04.987693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4385c7-e72d-4f7f-84bc-03c3dd93b7ba tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] PATH_INFO: `/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2/e88f0651b12a4b4891dd1d2363f2abd2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:04.990336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4385c7-e72d-4f7f-84bc-03c3dd93b7ba tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=d33dc48033074d60a1c1fb1adf91417d, credential_id=e88f0651b12a4b4891dd1d2363f2abd2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:04.990530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4dca547c-de3b-489e-8b35-949b785927d9 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:04.991898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4385c7-e72d-4f7f-84bc-03c3dd93b7ba tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:04.995763 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2893/5741] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:04 2022] DELETE /identity/v3/roles/959d409c289a4ad1b4ceeea047bb8036 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:04.998326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a34686-78b8-488f-82b8-5ffa986552f6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:04.998980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a34686-78b8-488f-82b8-5ffa986552f6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:05.001173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a34686-78b8-488f-82b8-5ffa986552f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:05.045524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-29a34686-78b8-488f-82b8-5ffa986552f6 None None] MFA Rules not processed for user `4ec2ade268514a35b76961bc94831459`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:05.047734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-29a34686-78b8-488f-82b8-5ffa986552f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:05.095290 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2849/5742] 10.222.0.76 () {58 vars in 1380 bytes} [Sat Aug 27 04:52:04 2022] DELETE /identity/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2/e88f0651b12a4b4891dd1d2363f2abd2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:05.101969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4385c7-e72d-4f7f-84bc-03c3dd93b7ba tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:05.103727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2e4385c7-e72d-4f7f-84bc-03c3dd93b7ba tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:05.120550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:05.210523 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2894/5743] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:05.210523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a34686-78b8-488f-82b8-5ffa986552f6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:05.210523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-29a34686-78b8-488f-82b8-5ffa986552f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:05.291931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a34686-78b8-488f-82b8-5ffa986552f6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:05.297156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408b72d-2109-499f-a76f-3edfa34680cf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:05.297808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408b72d-2109-499f-a76f-3edfa34680cf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:05.298094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408b72d-2109-499f-a76f-3edfa34680cf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:05.298382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408b72d-2109-499f-a76f-3edfa34680cf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/groups/216c77dd281c4b3b8e973dadcea3e611` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:05.300196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408b72d-2109-499f-a76f-3edfa34680cf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_group(group_id=216c77dd281c4b3b8e973dadcea3e611)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:05.302534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408b72d-2109-499f-a76f-3edfa34680cf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:05.345420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4385c7-e72d-4f7f-84bc-03c3dd93b7ba tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:05.452697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b9c49-3b9f-42de-8fb1-ef0375c15710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:05.453633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b9c49-3b9f-42de-8fb1-ef0375c15710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:05.454903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b9c49-3b9f-42de-8fb1-ef0375c15710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:05.455051 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2895/5744] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:52:05 2022] DELETE /identity/v3/groups/216c77dd281c4b3b8e973dadcea3e611 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:05.455496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408b72d-2109-499f-a76f-3edfa34680cf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:05.457328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d408b72d-2109-499f-a76f-3edfa34680cf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:05.458254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b9c49-3b9f-42de-8fb1-ef0375c15710 admin admin] PATH_INFO: `/v3/users/fbbffcb4fa614cd3b80354d714673b82` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:05.461132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:05.463082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b9c49-3b9f-42de-8fb1-ef0375c15710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbbffcb4fa614cd3b80354d714673b82)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:05.469906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b9c49-3b9f-42de-8fb1-ef0375c15710 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:05.534692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408b72d-2109-499f-a76f-3edfa34680cf tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:05.547597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66866989-5962-475a-a73e-9ff070bcc476 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd33dc48033074d60a1c1fb1adf91417d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f90fffa5a4140f5a4637da116ebc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:05.548939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66866989-5962-475a-a73e-9ff070bcc476 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:05.549101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66866989-5962-475a-a73e-9ff070bcc476 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:05.549334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66866989-5962-475a-a73e-9ff070bcc476 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] PATH_INFO: `/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:05.551135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66866989-5962-475a-a73e-9ff070bcc476 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=d33dc48033074d60a1c1fb1adf91417d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:05.554880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66866989-5962-475a-a73e-9ff070bcc476 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:05.692341 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2896/5745] 10.222.0.76 () {60 vars in 1299 bytes} [Sat Aug 27 04:52:05 2022] POST /identity/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2 => generated 367 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:05.693730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66866989-5962-475a-a73e-9ff070bcc476 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:05.697242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-66866989-5962-475a-a73e-9ff070bcc476 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:05.704781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-969b9c49-3b9f-42de-8fb1-ef0375c15710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbbffcb4fa614cd3b80354d714673b82'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:05.822858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-969b9c49-3b9f-42de-8fb1-ef0375c15710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbbffcb4fa614cd3b80354d714673b82'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:05.823535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-969b9c49-3b9f-42de-8fb1-ef0375c15710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbbffcb4fa614cd3b80354d714673b82'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:05.835733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-969b9c49-3b9f-42de-8fb1-ef0375c15710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbbffcb4fa614cd3b80354d714673b82'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:05.862153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-969b9c49-3b9f-42de-8fb1-ef0375c15710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbbffcb4fa614cd3b80354d714673b82'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:05.870183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66866989-5962-475a-a73e-9ff070bcc476 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:05.881044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdbe59-817c-495c-a096-a0239c3e2527 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:05.881891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdbe59-817c-495c-a096-a0239c3e2527 service glance] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:05.882242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdbe59-817c-495c-a096-a0239c3e2527 service glance] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:05.882585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdbe59-817c-495c-a096-a0239c3e2527 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:05.885703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-59cdbe59-817c-495c-a096-a0239c3e2527 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:05.893396 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2850/5746] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:05 2022] DELETE /identity/v3/users/fbbffcb4fa614cd3b80354d714673b82 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:05.894433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b9c49-3b9f-42de-8fb1-ef0375c15710 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:05.896204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-969b9c49-3b9f-42de-8fb1-ef0375c15710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:06.047921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b9c49-3b9f-42de-8fb1-ef0375c15710 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:06.050172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cdbe59-817c-495c-a096-a0239c3e2527 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:06.053740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cdbe59-817c-495c-a096-a0239c3e2527 service glance] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:06.070171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7792052-5c97-4961-bd9f-23b55ae088b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:06.070171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7792052-5c97-4961-bd9f-23b55ae088b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:06.070171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7792052-5c97-4961-bd9f-23b55ae088b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:06.070616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7792052-5c97-4961-bd9f-23b55ae088b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/projects/818237f556a4495eb0a73c1763a11490` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:06.075306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7792052-5c97-4961-bd9f-23b55ae088b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_project(project_id=818237f556a4495eb0a73c1763a11490)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:06.081389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7792052-5c97-4961-bd9f-23b55ae088b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:06.104941 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2897/5747] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:06.111673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdbe59-817c-495c-a096-a0239c3e2527 service glance] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:06.117113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-59cdbe59-817c-495c-a096-a0239c3e2527 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:06.152628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdbe59-817c-495c-a096-a0239c3e2527 service glance] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:06.240675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3c6e8-f0ee-4407-83c6-8b5f5805e901 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd33dc48033074d60a1c1fb1adf91417d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f90fffa5a4140f5a4637da116ebc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:06.241735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c6e8-f0ee-4407-83c6-8b5f5805e901 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:06.242261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c6e8-f0ee-4407-83c6-8b5f5805e901 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:06.242821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c6e8-f0ee-4407-83c6-8b5f5805e901 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] PATH_INFO: `/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2/b8c309f010ff409f90f7954a23b47274` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:06.245160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3c6e8-f0ee-4407-83c6-8b5f5805e901 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=d33dc48033074d60a1c1fb1adf91417d, credential_id=b8c309f010ff409f90f7954a23b47274)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:06.246935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3c6e8-f0ee-4407-83c6-8b5f5805e901 tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:06.251413 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2898/5748] 10.222.0.76 () {58 vars in 1377 bytes} [Sat Aug 27 04:52:06 2022] GET /identity/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2/b8c309f010ff409f90f7954a23b47274 => generated 367 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:06.253348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac180-d437-4645-b834-d7ca585102c6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:06.254079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac180-d437-4645-b834-d7ca585102c6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:06.254585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac180-d437-4645-b834-d7ca585102c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:06.281850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1bcac180-d437-4645-b834-d7ca585102c6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:06.283761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1bcac180-d437-4645-b834-d7ca585102c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:06.326104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b7792052-5c97-4961-bd9f-23b55ae088b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818237f556a4495eb0a73c1763a11490', 'request_id': 'req-b7792052-5c97-4961-bd9f-23b55ae088b1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:06.359001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b7792052-5c97-4961-bd9f-23b55ae088b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818237f556a4495eb0a73c1763a11490', 'request_id': 'req-b7792052-5c97-4961-bd9f-23b55ae088b1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:06.384865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b7792052-5c97-4961-bd9f-23b55ae088b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818237f556a4495eb0a73c1763a11490', 'request_id': 'req-b7792052-5c97-4961-bd9f-23b55ae088b1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:06.430683 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2899/5749] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:06.431657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcac180-d437-4645-b834-d7ca585102c6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:06.444471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcac180-d437-4645-b834-d7ca585102c6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:06.468652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b7792052-5c97-4961-bd9f-23b55ae088b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] The token cache is being invalidate because project 818237f556a4495eb0a73c1763a11490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:06.468999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b7792052-5c97-4961-bd9f-23b55ae088b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:06.470404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b7792052-5c97-4961-bd9f-23b55ae088b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:06.477896 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2851/5750] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:05 2022] DELETE /identity/v3/projects/818237f556a4495eb0a73c1763a11490 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:06.479007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7792052-5c97-4961-bd9f-23b55ae088b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:06.484548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b7792052-5c97-4961-bd9f-23b55ae088b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:06.517330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf28efb-a7d2-462a-8c71-925a6b46402c tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd33dc48033074d60a1c1fb1adf91417d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f90fffa5a4140f5a4637da116ebc138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:06.518355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf28efb-a7d2-462a-8c71-925a6b46402c tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:06.519753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf28efb-a7d2-462a-8c71-925a6b46402c tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:06.520121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf28efb-a7d2-462a-8c71-925a6b46402c tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] PATH_INFO: `/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2/b8c309f010ff409f90f7954a23b47274` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:06.524191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf28efb-a7d2-462a-8c71-925a6b46402c tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=d33dc48033074d60a1c1fb1adf91417d, credential_id=b8c309f010ff409f90f7954a23b47274)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:06.526427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf28efb-a7d2-462a-8c71-925a6b46402c tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:06.657919 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2900/5751] 10.222.0.76 () {58 vars in 1380 bytes} [Sat Aug 27 04:52:06 2022] DELETE /identity/v3/users/d33dc48033074d60a1c1fb1adf91417d/credentials/OS-EC2/b8c309f010ff409f90f7954a23b47274 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:06.658877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf28efb-a7d2-462a-8c71-925a6b46402c tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:06.666159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-aaf28efb-a7d2-462a-8c71-925a6b46402c tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:06.692787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7792052-5c97-4961-bd9f-23b55ae088b1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:06.712340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5956592-a2bc-4ad2-8508-ddac18524435 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:06.713007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5956592-a2bc-4ad2-8508-ddac18524435 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:06.713291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5956592-a2bc-4ad2-8508-ddac18524435 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:06.713574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5956592-a2bc-4ad2-8508-ddac18524435 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/domains/3c5b393f88604e94a0608ded33678f83` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:06.716677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5956592-a2bc-4ad2-8508-ddac18524435 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3c5b393f88604e94a0608ded33678f83)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:06.717950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5956592-a2bc-4ad2-8508-ddac18524435 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:06.762003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:06.774873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e5956592-a2bc-4ad2-8508-ddac18524435 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3c5b393f88604e94a0608ded33678f83'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:06.777651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e5956592-a2bc-4ad2-8508-ddac18524435 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3c5b393f88604e94a0608ded33678f83'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:06.822270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf28efb-a7d2-462a-8c71-925a6b46402c tempest-EC2CredentialsTest-1588174749 tempest-EC2CredentialsTest-1588174749-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:06.900430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa65928-05e3-42aa-9a82-672da9cda082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:06.901116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa65928-05e3-42aa-9a82-672da9cda082 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:06.901394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa65928-05e3-42aa-9a82-672da9cda082 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:06.901665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa65928-05e3-42aa-9a82-672da9cda082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:06.903862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-aaa65928-05e3-42aa-9a82-672da9cda082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:06.918023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e5956592-a2bc-4ad2-8508-ddac18524435 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3c5b393f88604e94a0608ded33678f83'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:06.920563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e5956592-a2bc-4ad2-8508-ddac18524435 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3c5b393f88604e94a0608ded33678f83'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:06.925988 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2852/5752] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:52:06 2022] PATCH /identity/v3/domains/3c5b393f88604e94a0608ded33678f83 => generated 277 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:06.927104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5956592-a2bc-4ad2-8508-ddac18524435 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:06.929710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e5956592-a2bc-4ad2-8508-ddac18524435 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:07.050719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa65928-05e3-42aa-9a82-672da9cda082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:07.053516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa65928-05e3-42aa-9a82-672da9cda082 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:07.074881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5956592-a2bc-4ad2-8508-ddac18524435 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:07.077848 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2901/5753] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:07.078760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa65928-05e3-42aa-9a82-672da9cda082 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:07.081120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c33b4-95c9-46b4-8b77-1abf105e3fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:07.082176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c33b4-95c9-46b4-8b77-1abf105e3fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:07.082685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c33b4-95c9-46b4-8b77-1abf105e3fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:07.083057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-aaa65928-05e3-42aa-9a82-672da9cda082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:07.084762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c33b4-95c9-46b4-8b77-1abf105e3fcc admin admin] PATH_INFO: `/v3/users/d33dc48033074d60a1c1fb1adf91417d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:07.086552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c33b4-95c9-46b4-8b77-1abf105e3fcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33dc48033074d60a1c1fb1adf91417d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:07.089015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c33b4-95c9-46b4-8b77-1abf105e3fcc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:07.113933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa65928-05e3-42aa-9a82-672da9cda082 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:07.118931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:07.124436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0289e-8960-40d4-9380-a75c7ffff178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:07.125637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0289e-8960-40d4-9380-a75c7ffff178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:07.126214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0289e-8960-40d4-9380-a75c7ffff178 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:07.126764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0289e-8960-40d4-9380-a75c7ffff178 admin admin] PATH_INFO: `/v3/users/3b896f18403b49d99fcb0171b5e501ef` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:07.128732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0289e-8960-40d4-9380-a75c7ffff178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b896f18403b49d99fcb0171b5e501ef)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:07.132009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0289e-8960-40d4-9380-a75c7ffff178 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:07.326469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9e9c33b4-95c9-46b4-8b77-1abf105e3fcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33dc48033074d60a1c1fb1adf91417d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.403298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-50e0289e-8960-40d4-9380-a75c7ffff178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b896f18403b49d99fcb0171b5e501ef'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.404614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-50e0289e-8960-40d4-9380-a75c7ffff178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b896f18403b49d99fcb0171b5e501ef'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.412679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9e9c33b4-95c9-46b4-8b77-1abf105e3fcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33dc48033074d60a1c1fb1adf91417d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.415464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9e9c33b4-95c9-46b4-8b77-1abf105e3fcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33dc48033074d60a1c1fb1adf91417d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.431614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9e9c33b4-95c9-46b4-8b77-1abf105e3fcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33dc48033074d60a1c1fb1adf91417d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.444466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9e9c33b4-95c9-46b4-8b77-1abf105e3fcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33dc48033074d60a1c1fb1adf91417d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.450775 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2853/5754] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:06 2022] DELETE /identity/v3/users/d33dc48033074d60a1c1fb1adf91417d => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:07.451514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c33b4-95c9-46b4-8b77-1abf105e3fcc admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:07.452992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9e9c33b4-95c9-46b4-8b77-1abf105e3fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:07.518860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c33b4-95c9-46b4-8b77-1abf105e3fcc admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:07.524505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d6ebd-21a2-4eba-a24a-0603b6ed1752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:07.525152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d6ebd-21a2-4eba-a24a-0603b6ed1752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:07.528411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d6ebd-21a2-4eba-a24a-0603b6ed1752 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:07.528816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d6ebd-21a2-4eba-a24a-0603b6ed1752 admin admin] PATH_INFO: `/v3/users/4ec2ade268514a35b76961bc94831459` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:07.530380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d6ebd-21a2-4eba-a24a-0603b6ed1752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec2ade268514a35b76961bc94831459)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:07.532603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d6ebd-21a2-4eba-a24a-0603b6ed1752 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:07.546008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-50e0289e-8960-40d4-9380-a75c7ffff178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b896f18403b49d99fcb0171b5e501ef'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.546682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-50e0289e-8960-40d4-9380-a75c7ffff178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b896f18403b49d99fcb0171b5e501ef'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.561559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-50e0289e-8960-40d4-9380-a75c7ffff178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b896f18403b49d99fcb0171b5e501ef'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.574729 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2902/5755] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:07 2022] DELETE /identity/v3/users/3b896f18403b49d99fcb0171b5e501ef => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:07.578454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0289e-8960-40d4-9380-a75c7ffff178 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:07.579872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-50e0289e-8960-40d4-9380-a75c7ffff178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:07.683370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0289e-8960-40d4-9380-a75c7ffff178 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:07.693883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8030e-7134-478b-814c-14eca73ecf7f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:07.694318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8030e-7134-478b-814c-14eca73ecf7f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:07.694787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8030e-7134-478b-814c-14eca73ecf7f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:07.695234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8030e-7134-478b-814c-14eca73ecf7f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/domains/3c5b393f88604e94a0608ded33678f83` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:07.708725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8030e-7134-478b-814c-14eca73ecf7f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3c5b393f88604e94a0608ded33678f83)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:07.711052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8030e-7134-478b-814c-14eca73ecf7f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:07.749417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0ae8030e-7134-478b-814c-14eca73ecf7f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3c5b393f88604e94a0608ded33678f83'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.754443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0ae8030e-7134-478b-814c-14eca73ecf7f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3c5b393f88604e94a0608ded33678f83'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.772700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-252d6ebd-21a2-4eba-a24a-0603b6ed1752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec2ade268514a35b76961bc94831459'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.912655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-252d6ebd-21a2-4eba-a24a-0603b6ed1752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec2ade268514a35b76961bc94831459'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.912655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-252d6ebd-21a2-4eba-a24a-0603b6ed1752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec2ade268514a35b76961bc94831459'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.921194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-252d6ebd-21a2-4eba-a24a-0603b6ed1752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec2ade268514a35b76961bc94831459'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.947545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-252d6ebd-21a2-4eba-a24a-0603b6ed1752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec2ade268514a35b76961bc94831459'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.947979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0ae8030e-7134-478b-814c-14eca73ecf7f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5b393f88604e94a0608ded33678f83', 'request_id': 'req-0ae8030e-7134-478b-814c-14eca73ecf7f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.957017 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2854/5756] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:07 2022] DELETE /identity/v3/users/4ec2ade268514a35b76961bc94831459 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:07.961054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ad992-9a0a-443c-b864-881e7e037f17 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:07.961970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ad992-9a0a-443c-b864-881e7e037f17 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:07.962440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ad992-9a0a-443c-b864-881e7e037f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:07.973439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0ae8030e-7134-478b-814c-14eca73ecf7f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5b393f88604e94a0608ded33678f83', 'request_id': 'req-0ae8030e-7134-478b-814c-14eca73ecf7f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:07.994159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9a2ad992-9a0a-443c-b864-881e7e037f17 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:07.995469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9a2ad992-9a0a-443c-b864-881e7e037f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:08.054934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0ae8030e-7134-478b-814c-14eca73ecf7f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5b393f88604e94a0608ded33678f83', 'request_id': 'req-0ae8030e-7134-478b-814c-14eca73ecf7f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:08.072156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0ae8030e-7134-478b-814c-14eca73ecf7f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] The token cache is being invalidate because project 3c5b393f88604e94a0608ded33678f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:08.072460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0ae8030e-7134-478b-814c-14eca73ecf7f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:08.073413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0ae8030e-7134-478b-814c-14eca73ecf7f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:08.073556 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2855/5757] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:08.074885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789ecc4-44b0-44e1-9e30-e9d272cfcb65 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:08.075639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789ecc4-44b0-44e1-9e30-e9d272cfcb65 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:08.075931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789ecc4-44b0-44e1-9e30-e9d272cfcb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:08.090181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0ae8030e-7134-478b-814c-14eca73ecf7f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3c5b393f88604e94a0608ded33678f83', 'request_id': 'req-0ae8030e-7134-478b-814c-14eca73ecf7f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:08.094134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0ae8030e-7134-478b-814c-14eca73ecf7f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3c5b393f88604e94a0608ded33678f83', 'request_id': 'req-0ae8030e-7134-478b-814c-14eca73ecf7f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:08.094805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0ae8030e-7134-478b-814c-14eca73ecf7f tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3c5b393f88604e94a0608ded33678f83', 'request_id': 'req-0ae8030e-7134-478b-814c-14eca73ecf7f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:08.096429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f789ecc4-44b0-44e1-9e30-e9d272cfcb65 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:08.097871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f789ecc4-44b0-44e1-9e30-e9d272cfcb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:08.106897 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2903/5758] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:52:07 2022] DELETE /identity/v3/domains/3c5b393f88604e94a0608ded33678f83 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:08.111257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980cc5-1e59-438a-86a6-4c68bbd89f6d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:08.112874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980cc5-1e59-438a-86a6-4c68bbd89f6d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:08.115454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980cc5-1e59-438a-86a6-4c68bbd89f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:08.118608 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2856/5759] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:08.119860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789ecc4-44b0-44e1-9e30-e9d272cfcb65 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:08.121470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f789ecc4-44b0-44e1-9e30-e9d272cfcb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:08.149388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789ecc4-44b0-44e1-9e30-e9d272cfcb65 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:08.160018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-29980cc5-1e59-438a-86a6-4c68bbd89f6d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:08.160595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d042e-17a4-407b-b6f3-55b63a595055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:08.161323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d042e-17a4-407b-b6f3-55b63a595055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:08.161612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d042e-17a4-407b-b6f3-55b63a595055 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:08.162430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d042e-17a4-407b-b6f3-55b63a595055 admin admin] PATH_INFO: `/v3/projects/a80a362bf3c04509aed3cd354eb02360` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:08.164259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-29980cc5-1e59-438a-86a6-4c68bbd89f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:08.166488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d042e-17a4-407b-b6f3-55b63a595055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a80a362bf3c04509aed3cd354eb02360)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:08.168479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d042e-17a4-407b-b6f3-55b63a595055 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:08.182560 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2904/5760] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:08.186605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29980cc5-1e59-438a-86a6-4c68bbd89f6d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:08.187976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-29980cc5-1e59-438a-86a6-4c68bbd89f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:08.294528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29980cc5-1e59-438a-86a6-4c68bbd89f6d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:08.304287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53d381-d8f2-48f1-b5da-758ad3c30db1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:08.305116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d381-d8f2-48f1-b5da-758ad3c30db1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:08.305498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d381-d8f2-48f1-b5da-758ad3c30db1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:08.306910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d381-d8f2-48f1-b5da-758ad3c30db1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/98e065d0a72643c3967449fd360f10c0` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:08.309374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53d381-d8f2-48f1-b5da-758ad3c30db1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_role(role_id=98e065d0a72643c3967449fd360f10c0)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:08.311789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53d381-d8f2-48f1-b5da-758ad3c30db1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:08.336821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-767d042e-17a4-407b-b6f3-55b63a595055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a80a362bf3c04509aed3cd354eb02360', 'request_id': 'req-767d042e-17a4-407b-b6f3-55b63a595055'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:08.342197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:08.366537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-767d042e-17a4-407b-b6f3-55b63a595055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a80a362bf3c04509aed3cd354eb02360', 'request_id': 'req-767d042e-17a4-407b-b6f3-55b63a595055'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:08.381016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-767d042e-17a4-407b-b6f3-55b63a595055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a80a362bf3c04509aed3cd354eb02360', 'request_id': 'req-767d042e-17a4-407b-b6f3-55b63a595055'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:08.497682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4c53d381-d8f2-48f1-b5da-758ad3c30db1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invalidating the token cache because role 98e065d0a72643c3967449fd360f10c0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:08.498355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4c53d381-d8f2-48f1-b5da-758ad3c30db1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:08.498889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4c53d381-d8f2-48f1-b5da-758ad3c30db1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:08.503878 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2905/5761] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:08 2022] DELETE /identity/v3/roles/98e065d0a72643c3967449fd360f10c0 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:08.504123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-767d042e-17a4-407b-b6f3-55b63a595055 admin admin] The token cache is being invalidate because project a80a362bf3c04509aed3cd354eb02360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:08.504341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-767d042e-17a4-407b-b6f3-55b63a595055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:08.505289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53d381-d8f2-48f1-b5da-758ad3c30db1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:08.505467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-767d042e-17a4-407b-b6f3-55b63a595055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:08.507568 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2857/5762] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:08 2022] DELETE /identity/v3/projects/a80a362bf3c04509aed3cd354eb02360 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:08.511621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4c53d381-d8f2-48f1-b5da-758ad3c30db1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:08.512778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d042e-17a4-407b-b6f3-55b63a595055 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:08.514313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-767d042e-17a4-407b-b6f3-55b63a595055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:08.613927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:08.632246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d042e-17a4-407b-b6f3-55b63a595055 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:08.650375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fe2fa-dd48-4fae-a174-f82409f8e9ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:08.651600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fe2fa-dd48-4fae-a174-f82409f8e9ad service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:08.652210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fe2fa-dd48-4fae-a174-f82409f8e9ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:08.652346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53d381-d8f2-48f1-b5da-758ad3c30db1 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:08.652977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fe2fa-dd48-4fae-a174-f82409f8e9ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:08.657587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d961713-3f4d-4115-9b9b-33ff190fa99b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:08.658312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d961713-3f4d-4115-9b9b-33ff190fa99b service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:08.658690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d961713-3f4d-4115-9b9b-33ff190fa99b service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:08.659056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d961713-3f4d-4115-9b9b-33ff190fa99b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:08.661039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4d961713-3f4d-4115-9b9b-33ff190fa99b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:08.662575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-642fe2fa-dd48-4fae-a174-f82409f8e9ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:08.668841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:08.765916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d961713-3f4d-4115-9b9b-33ff190fa99b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:08.768613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d961713-3f4d-4115-9b9b-33ff190fa99b service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:08.785096 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2906/5763] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:08.786393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d961713-3f4d-4115-9b9b-33ff190fa99b service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:08.788772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4d961713-3f4d-4115-9b9b-33ff190fa99b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:08.791810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fe2fa-dd48-4fae-a174-f82409f8e9ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:08.796552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fe2fa-dd48-4fae-a174-f82409f8e9ad service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:08.827021 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2858/5764] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:08.829084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fe2fa-dd48-4fae-a174-f82409f8e9ad service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:08.832604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-642fe2fa-dd48-4fae-a174-f82409f8e9ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:08.864753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fe2fa-dd48-4fae-a174-f82409f8e9ad service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:08.881162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb27a7a-81b8-437e-9706-cd254de9bf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:08.881162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb27a7a-81b8-437e-9706-cd254de9bf1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:08.881162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb27a7a-81b8-437e-9706-cd254de9bf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:08.881162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb27a7a-81b8-437e-9706-cd254de9bf1a admin admin] PATH_INFO: `/v3/users/d56ae280c89648eb99a4adcbd3231fc3` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:08.882027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb27a7a-81b8-437e-9706-cd254de9bf1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d56ae280c89648eb99a4adcbd3231fc3)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:08.886116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb27a7a-81b8-437e-9706-cd254de9bf1a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:08.913170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d961713-3f4d-4115-9b9b-33ff190fa99b service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:08.919484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b55d7-902e-43fe-93eb-917f773dc4ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:08.950646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b55d7-902e-43fe-93eb-917f773dc4ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:08.951262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b55d7-902e-43fe-93eb-917f773dc4ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:08.951713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b55d7-902e-43fe-93eb-917f773dc4ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/79d566fca0ac4c2b9a147a70bf0e7278` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:08.953983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b55d7-902e-43fe-93eb-917f773dc4ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_role(role_id=79d566fca0ac4c2b9a147a70bf0e7278)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:08.956071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b55d7-902e-43fe-93eb-917f773dc4ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:09.130055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-469b55d7-902e-43fe-93eb-917f773dc4ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invalidating the token cache because role 79d566fca0ac4c2b9a147a70bf0e7278 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:09.130558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-469b55d7-902e-43fe-93eb-917f773dc4ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:09.131232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-469b55d7-902e-43fe-93eb-917f773dc4ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:09.136129 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2907/5765] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:08 2022] DELETE /identity/v3/roles/79d566fca0ac4c2b9a147a70bf0e7278 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:09.137081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b55d7-902e-43fe-93eb-917f773dc4ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:09.139134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-469b55d7-902e-43fe-93eb-917f773dc4ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:09.206619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7cb27a7a-81b8-437e-9706-cd254de9bf1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd56ae280c89648eb99a4adcbd3231fc3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:09.274379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b55d7-902e-43fe-93eb-917f773dc4ca tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:09.285205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d01d5-e3a0-4b40-8fb5-7935992fae8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:09.285758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d01d5-e3a0-4b40-8fb5-7935992fae8b service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:09.286048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d01d5-e3a0-4b40-8fb5-7935992fae8b service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:09.286325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d01d5-e3a0-4b40-8fb5-7935992fae8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:09.290184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5d6d01d5-e3a0-4b40-8fb5-7935992fae8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:09.311771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7cb27a7a-81b8-437e-9706-cd254de9bf1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd56ae280c89648eb99a4adcbd3231fc3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:09.312487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7cb27a7a-81b8-437e-9706-cd254de9bf1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd56ae280c89648eb99a4adcbd3231fc3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:09.321444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7cb27a7a-81b8-437e-9706-cd254de9bf1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd56ae280c89648eb99a4adcbd3231fc3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:09.352287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7cb27a7a-81b8-437e-9706-cd254de9bf1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd56ae280c89648eb99a4adcbd3231fc3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:09.363054 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2859/5766] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:08 2022] DELETE /identity/v3/users/d56ae280c89648eb99a4adcbd3231fc3 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:09.363719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb27a7a-81b8-437e-9706-cd254de9bf1a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:09.368750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7cb27a7a-81b8-437e-9706-cd254de9bf1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:09.394095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d01d5-e3a0-4b40-8fb5-7935992fae8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:09.395476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d01d5-e3a0-4b40-8fb5-7935992fae8b service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:09.418705 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2908/5767] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:09.419659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d01d5-e3a0-4b40-8fb5-7935992fae8b service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:09.421056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5d6d01d5-e3a0-4b40-8fb5-7935992fae8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:09.454647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d01d5-e3a0-4b40-8fb5-7935992fae8b service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:09.485539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:09.539286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb27a7a-81b8-437e-9706-cd254de9bf1a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:09.546119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24fe759-1a34-4827-a43d-0702fe8d0100 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2081af0a76d4b49aa1af0992e6a08dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aed67d259f504207bf495dfb65945c15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:09.546791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fe759-1a34-4827-a43d-0702fe8d0100 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:09.547074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fe759-1a34-4827-a43d-0702fe8d0100 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:09.547353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fe759-1a34-4827-a43d-0702fe8d0100 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] PATH_INFO: `/v3/roles/172fc58542b84a4b95bcc5b4b36789e7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:09.557523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24fe759-1a34-4827-a43d-0702fe8d0100 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorizing `identity:delete_role(role_id=172fc58542b84a4b95bcc5b4b36789e7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:09.560497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24fe759-1a34-4827-a43d-0702fe8d0100 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:09.568660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cee7b7-b432-4561-9a29-2a7455f5490f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:09.570063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cee7b7-b432-4561-9a29-2a7455f5490f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:09.570599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cee7b7-b432-4561-9a29-2a7455f5490f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:09.571126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cee7b7-b432-4561-9a29-2a7455f5490f admin admin] PATH_INFO: `/v3/projects/6ce726174f1e4e6987c3110c9e2e762f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:09.573216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cee7b7-b432-4561-9a29-2a7455f5490f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce726174f1e4e6987c3110c9e2e762f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:09.578060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cee7b7-b432-4561-9a29-2a7455f5490f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:09.672576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:09.712234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a24fe759-1a34-4827-a43d-0702fe8d0100 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invalidating the token cache because role 172fc58542b84a4b95bcc5b4b36789e7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:09.717291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a24fe759-1a34-4827-a43d-0702fe8d0100 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:09.720767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a24fe759-1a34-4827-a43d-0702fe8d0100 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:09.734349 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2860/5768] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:09 2022] DELETE /identity/v3/roles/172fc58542b84a4b95bcc5b4b36789e7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:09.735914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24fe759-1a34-4827-a43d-0702fe8d0100 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:09.737755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a24fe759-1a34-4827-a43d-0702fe8d0100 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:09.763993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a6cee7b7-b432-4561-9a29-2a7455f5490f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce726174f1e4e6987c3110c9e2e762f', 'request_id': 'req-a6cee7b7-b432-4561-9a29-2a7455f5490f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:09.776370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a6cee7b7-b432-4561-9a29-2a7455f5490f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce726174f1e4e6987c3110c9e2e762f', 'request_id': 'req-a6cee7b7-b432-4561-9a29-2a7455f5490f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:09.862615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a6cee7b7-b432-4561-9a29-2a7455f5490f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce726174f1e4e6987c3110c9e2e762f', 'request_id': 'req-a6cee7b7-b432-4561-9a29-2a7455f5490f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:09.884737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a6cee7b7-b432-4561-9a29-2a7455f5490f admin admin] The token cache is being invalidate because project 6ce726174f1e4e6987c3110c9e2e762f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:09.885192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a6cee7b7-b432-4561-9a29-2a7455f5490f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:09.885788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a6cee7b7-b432-4561-9a29-2a7455f5490f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:09.892511 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2909/5769] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:09 2022] DELETE /identity/v3/projects/6ce726174f1e4e6987c3110c9e2e762f => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:09.894292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a2684-05d3-4c51-83eb-e0753754fb3b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:09.894691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a2684-05d3-4c51-83eb-e0753754fb3b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:09.895141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a2684-05d3-4c51-83eb-e0753754fb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:09.902964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24fe759-1a34-4827-a43d-0702fe8d0100 tempest-RolesV3TestJSON-1317993665 tempest-RolesV3TestJSON-1317993665-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:09.917929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707af0c-336c-405d-8cef-65aae7180c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:09.919507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707af0c-336c-405d-8cef-65aae7180c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:09.922326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707af0c-336c-405d-8cef-65aae7180c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:09.924321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707af0c-336c-405d-8cef-65aae7180c69 admin admin] PATH_INFO: `/v3/users/e3e1f702553c403db6265e08b426e0f8` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:09.926350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707af0c-336c-405d-8cef-65aae7180c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3e1f702553c403db6265e08b426e0f8)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:09.935756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707af0c-336c-405d-8cef-65aae7180c69 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:09.963398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-741a2684-05d3-4c51-83eb-e0753754fb3b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:09.965856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-741a2684-05d3-4c51-83eb-e0753754fb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:09.986168 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2910/5770] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:52:09.988617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986fb52-db9c-409b-827e-466e7ef6769f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:09.989104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986fb52-db9c-409b-827e-466e7ef6769f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:09.990897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986fb52-db9c-409b-827e-466e7ef6769f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:10.013997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c986fb52-db9c-409b-827e-466e7ef6769f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:10.016994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c986fb52-db9c-409b-827e-466e7ef6769f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:10.036101 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2911/5771] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:10.039857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986fb52-db9c-409b-827e-466e7ef6769f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:10.051550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986fb52-db9c-409b-827e-466e7ef6769f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:10.060325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cc179-1b0f-4569-94ba-db6d70a4c12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:10.062403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cc179-1b0f-4569-94ba-db6d70a4c12a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:10.062991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cc179-1b0f-4569-94ba-db6d70a4c12a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:10.063435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cc179-1b0f-4569-94ba-db6d70a4c12a admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:10.064354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cc179-1b0f-4569-94ba-db6d70a4c12a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:10.064921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cc179-1b0f-4569-94ba-db6d70a4c12a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:10.067008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cc179-1b0f-4569-94ba-db6d70a4c12a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:10.092579 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2912/5772] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:10.094723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cc179-1b0f-4569-94ba-db6d70a4c12a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:10.106861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cc179-1b0f-4569-94ba-db6d70a4c12a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:10.110276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f707af0c-336c-405d-8cef-65aae7180c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3e1f702553c403db6265e08b426e0f8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:10.119481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e9e95-33cb-4b80-8b64-f01ef9c37e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:10.119481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e9e95-33cb-4b80-8b64-f01ef9c37e7b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:10.119481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e9e95-33cb-4b80-8b64-f01ef9c37e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:10.119481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e9e95-33cb-4b80-8b64-f01ef9c37e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:10.120140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e9e95-33cb-4b80-8b64-f01ef9c37e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:10.120140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e9e95-33cb-4b80-8b64-f01ef9c37e7b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:10.251853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f707af0c-336c-405d-8cef-65aae7180c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3e1f702553c403db6265e08b426e0f8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:10.253460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f707af0c-336c-405d-8cef-65aae7180c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3e1f702553c403db6265e08b426e0f8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:10.267527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f707af0c-336c-405d-8cef-65aae7180c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3e1f702553c403db6265e08b426e0f8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:10.269200 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2913/5773] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:10 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:10.270190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e9e95-33cb-4b80-8b64-f01ef9c37e7b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:10.288523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f707af0c-336c-405d-8cef-65aae7180c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3e1f702553c403db6265e08b426e0f8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:10.308522 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2861/5774] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:09 2022] DELETE /identity/v3/users/e3e1f702553c403db6265e08b426e0f8 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:10.310372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d3b63-9290-4fbc-9a55-0959ecea5a72 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:10.310665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d3b63-9290-4fbc-9a55-0959ecea5a72 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:10.310939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d3b63-9290-4fbc-9a55-0959ecea5a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:10.348472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0a1d3b63-9290-4fbc-9a55-0959ecea5a72 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:10.350708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0a1d3b63-9290-4fbc-9a55-0959ecea5a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:10.404223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e9e95-33cb-4b80-8b64-f01ef9c37e7b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:10.475197 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2862/5775] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:10.477122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d3b63-9290-4fbc-9a55-0959ecea5a72 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:10.478564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0a1d3b63-9290-4fbc-9a55-0959ecea5a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:10.497222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d3b63-9290-4fbc-9a55-0959ecea5a72 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:10.504853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfc0c0-a056-4109-a9df-9203bcc7a929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:10.506572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfc0c0-a056-4109-a9df-9203bcc7a929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:10.507048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfc0c0-a056-4109-a9df-9203bcc7a929 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:10.507338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfc0c0-a056-4109-a9df-9203bcc7a929 admin admin] PATH_INFO: `/v3/projects/6f90fffa5a4140f5a4637da116ebc138` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:10.509125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfc0c0-a056-4109-a9df-9203bcc7a929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f90fffa5a4140f5a4637da116ebc138)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:10.511161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfc0c0-a056-4109-a9df-9203bcc7a929 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:10.515492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:10.545544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b815b3-c115-4f80-90d1-dc9acba3920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:10.548572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b815b3-c115-4f80-90d1-dc9acba3920d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:10.548771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b815b3-c115-4f80-90d1-dc9acba3920d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:10.549158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b815b3-c115-4f80-90d1-dc9acba3920d admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:10.550741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b815b3-c115-4f80-90d1-dc9acba3920d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:10.556292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b815b3-c115-4f80-90d1-dc9acba3920d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:10.673406 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2914/5776] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:10 2022] POST /identity/v3/users => generated 284 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:10.675726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b815b3-c115-4f80-90d1-dc9acba3920d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:10.678493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-05b815b3-c115-4f80-90d1-dc9acba3920d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:10.685018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b1cfc0c0-a056-4109-a9df-9203bcc7a929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f90fffa5a4140f5a4637da116ebc138', 'request_id': 'req-b1cfc0c0-a056-4109-a9df-9203bcc7a929'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:10.701438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b1cfc0c0-a056-4109-a9df-9203bcc7a929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f90fffa5a4140f5a4637da116ebc138', 'request_id': 'req-b1cfc0c0-a056-4109-a9df-9203bcc7a929'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:10.719962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b1cfc0c0-a056-4109-a9df-9203bcc7a929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f90fffa5a4140f5a4637da116ebc138', 'request_id': 'req-b1cfc0c0-a056-4109-a9df-9203bcc7a929'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:10.827666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b1cfc0c0-a056-4109-a9df-9203bcc7a929 admin admin] The token cache is being invalidate because project 6f90fffa5a4140f5a4637da116ebc138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:10.827970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b1cfc0c0-a056-4109-a9df-9203bcc7a929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:10.829232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b1cfc0c0-a056-4109-a9df-9203bcc7a929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:10.832780 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2863/5777] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:10 2022] DELETE /identity/v3/projects/6f90fffa5a4140f5a4637da116ebc138 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:10.834262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfc0c0-a056-4109-a9df-9203bcc7a929 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:10.838078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b1cfc0c0-a056-4109-a9df-9203bcc7a929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:10.844093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b815b3-c115-4f80-90d1-dc9acba3920d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:10.909027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:10.933247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cca7e-5d21-4d23-bdce-d84cf8804ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:10.934385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cca7e-5d21-4d23-bdce-d84cf8804ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:10.934680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cca7e-5d21-4d23-bdce-d84cf8804ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:10.936145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cca7e-5d21-4d23-bdce-d84cf8804ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:10.943649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-935cca7e-5d21-4d23-bdce-d84cf8804ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:10.988978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfc0c0-a056-4109-a9df-9203bcc7a929 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:10.999490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867aa9e-dcb2-4bf3-bb16-dd3b21ac814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:11.002163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867aa9e-dcb2-4bf3-bb16-dd3b21ac814b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:11.002869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867aa9e-dcb2-4bf3-bb16-dd3b21ac814b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:11.004373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867aa9e-dcb2-4bf3-bb16-dd3b21ac814b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:11.005869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867aa9e-dcb2-4bf3-bb16-dd3b21ac814b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:11.011014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867aa9e-dcb2-4bf3-bb16-dd3b21ac814b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:11.043630 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2864/5778] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:11.045064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5062047-8b3e-40f7-9925-20707a20b835 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:11.045360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5062047-8b3e-40f7-9925-20707a20b835 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:11.045644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5062047-8b3e-40f7-9925-20707a20b835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:11.089947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e5062047-8b3e-40f7-9925-20707a20b835 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:11.092039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e5062047-8b3e-40f7-9925-20707a20b835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:11.108284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935cca7e-5d21-4d23-bdce-d84cf8804ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:11.108284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935cca7e-5d21-4d23-bdce-d84cf8804ee8 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:11.122923 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2865/5779] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:11.122923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5062047-8b3e-40f7-9925-20707a20b835 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:11.137509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5062047-8b3e-40f7-9925-20707a20b835 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:11.144860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc2307-e726-4280-8c23-085c5db945aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:11.146611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc2307-e726-4280-8c23-085c5db945aa admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:11.148247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc2307-e726-4280-8c23-085c5db945aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:11.148557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc2307-e726-4280-8c23-085c5db945aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:11.149304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc2307-e726-4280-8c23-085c5db945aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:11.150961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc2307-e726-4280-8c23-085c5db945aa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:11.153895 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2915/5780] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:11.154820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cca7e-5d21-4d23-bdce-d84cf8804ee8 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:11.159602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-935cca7e-5d21-4d23-bdce-d84cf8804ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:11.180704 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2866/5781] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:11.181779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc2307-e726-4280-8c23-085c5db945aa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:11.190115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cca7e-5d21-4d23-bdce-d84cf8804ee8 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:11.190416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bcdc2307-e726-4280-8c23-085c5db945aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:11.217106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3e520-292a-44ab-acff-f823ede765bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:11.217781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3e520-292a-44ab-acff-f823ede765bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:11.218066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3e520-292a-44ab-acff-f823ede765bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:11.218342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3e520-292a-44ab-acff-f823ede765bf admin admin] PATH_INFO: `/v3/projects/d204f6345a0e4876a7359b14b48f8ca1` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:11.224245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3e520-292a-44ab-acff-f823ede765bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d204f6345a0e4876a7359b14b48f8ca1)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:11.224245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3e520-292a-44ab-acff-f823ede765bf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:11.241030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc2307-e726-4280-8c23-085c5db945aa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:11.253883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42424788-ae44-4322-8297-e176ce134819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:11.254603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42424788-ae44-4322-8297-e176ce134819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:11.258007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42424788-ae44-4322-8297-e176ce134819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:11.258007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42424788-ae44-4322-8297-e176ce134819 admin admin] PATH_INFO: `/v3/projects/d8a834f5e55b4544b5bbc3ab8609fe7f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:11.258712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42424788-ae44-4322-8297-e176ce134819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a834f5e55b4544b5bbc3ab8609fe7f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:11.263555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42424788-ae44-4322-8297-e176ce134819 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:11.365675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-58a3e520-292a-44ab-acff-f823ede765bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd204f6345a0e4876a7359b14b48f8ca1', 'request_id': 'req-58a3e520-292a-44ab-acff-f823ede765bf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:11.375260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-58a3e520-292a-44ab-acff-f823ede765bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd204f6345a0e4876a7359b14b48f8ca1', 'request_id': 'req-58a3e520-292a-44ab-acff-f823ede765bf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:11.407915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-42424788-ae44-4322-8297-e176ce134819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a834f5e55b4544b5bbc3ab8609fe7f', 'request_id': 'req-42424788-ae44-4322-8297-e176ce134819'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:11.413034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-42424788-ae44-4322-8297-e176ce134819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a834f5e55b4544b5bbc3ab8609fe7f', 'request_id': 'req-42424788-ae44-4322-8297-e176ce134819'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:11.422574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-42424788-ae44-4322-8297-e176ce134819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a834f5e55b4544b5bbc3ab8609fe7f', 'request_id': 'req-42424788-ae44-4322-8297-e176ce134819'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:11.537912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-58a3e520-292a-44ab-acff-f823ede765bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd204f6345a0e4876a7359b14b48f8ca1', 'request_id': 'req-58a3e520-292a-44ab-acff-f823ede765bf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:11.556361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-58a3e520-292a-44ab-acff-f823ede765bf admin admin] The token cache is being invalidate because project d204f6345a0e4876a7359b14b48f8ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:11.556862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-58a3e520-292a-44ab-acff-f823ede765bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:11.557610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-58a3e520-292a-44ab-acff-f823ede765bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:11.559543 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2916/5782] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:11 2022] DELETE /identity/v3/projects/d204f6345a0e4876a7359b14b48f8ca1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:11.561267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0fe5c-d44e-4da6-ae75-c5b2605c2cc2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:11.561981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0fe5c-d44e-4da6-ae75-c5b2605c2cc2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:11.562332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0fe5c-d44e-4da6-ae75-c5b2605c2cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:11.601040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-31a0fe5c-d44e-4da6-ae75-c5b2605c2cc2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:11.603736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-42424788-ae44-4322-8297-e176ce134819 admin admin] The token cache is being invalidate because project d8a834f5e55b4544b5bbc3ab8609fe7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:11.603874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-31a0fe5c-d44e-4da6-ae75-c5b2605c2cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:11.607894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-42424788-ae44-4322-8297-e176ce134819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:11.610422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-42424788-ae44-4322-8297-e176ce134819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:11.616341 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2867/5783] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:11 2022] DELETE /identity/v3/projects/d8a834f5e55b4544b5bbc3ab8609fe7f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:11.619877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42424788-ae44-4322-8297-e176ce134819 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:11.622930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-42424788-ae44-4322-8297-e176ce134819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:11.745008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42424788-ae44-4322-8297-e176ce134819 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:11.758893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e60df2-86d6-43cf-8554-ba91b8ac31c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:11.759586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e60df2-86d6-43cf-8554-ba91b8ac31c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:11.759877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e60df2-86d6-43cf-8554-ba91b8ac31c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:11.760156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e60df2-86d6-43cf-8554-ba91b8ac31c7 admin admin] PATH_INFO: `/v3/projects/7f4eb79f7b6d431db33148f31fb43258/users/449a9b776f64465a916a96aa26510caf/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:11.765950 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2917/5784] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:11.769973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0fe5c-d44e-4da6-ae75-c5b2605c2cc2 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:11.773518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-31a0fe5c-d44e-4da6-ae75-c5b2605c2cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:11.798925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0fe5c-d44e-4da6-ae75-c5b2605c2cc2 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:11.801819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e60df2-86d6-43cf-8554-ba91b8ac31c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4eb79f7b6d431db33148f31fb43258, user_id=449a9b776f64465a916a96aa26510caf, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:11.808913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e60df2-86d6-43cf-8554-ba91b8ac31c7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:11.818920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e43ef-a036-4777-b98b-0e5b8e925249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:11.819871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e43ef-a036-4777-b98b-0e5b8e925249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:11.821155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e43ef-a036-4777-b98b-0e5b8e925249 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:11.821469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e43ef-a036-4777-b98b-0e5b8e925249 admin admin] PATH_INFO: `/v3/users/2dbd274a4c0243ecb81e238288d3893e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:11.825244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e43ef-a036-4777-b98b-0e5b8e925249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dbd274a4c0243ecb81e238288d3893e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:11.825386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e43ef-a036-4777-b98b-0e5b8e925249 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:11.953057 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2868/5785] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:11 2022] PUT /identity/v3/projects/7f4eb79f7b6d431db33148f31fb43258/users/449a9b776f64465a916a96aa26510caf/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:11.954656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d286-4514-434b-90ee-009560856113 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:11.955117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d286-4514-434b-90ee-009560856113 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:11.955900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d286-4514-434b-90ee-009560856113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:11.979734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7c93d286-4514-434b-90ee-009560856113 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:11.981394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7c93d286-4514-434b-90ee-009560856113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:12.060329 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2869/5786] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:12.062226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ae009-986d-4a1b-ba82-e13789ebafe5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:12.062829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ae009-986d-4a1b-ba82-e13789ebafe5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:12.063154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ae009-986d-4a1b-ba82-e13789ebafe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:12.092884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c43ae009-986d-4a1b-ba82-e13789ebafe5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:12.094386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c43ae009-986d-4a1b-ba82-e13789ebafe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:12.104958 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2870/5787] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:12.113702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ae009-986d-4a1b-ba82-e13789ebafe5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:12.125886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ae009-986d-4a1b-ba82-e13789ebafe5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:12.131017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825634f0-8f7f-49e4-9458-7f5a19d87722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:12.131911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825634f0-8f7f-49e4-9458-7f5a19d87722 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:12.132419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825634f0-8f7f-49e4-9458-7f5a19d87722 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:12.132878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825634f0-8f7f-49e4-9458-7f5a19d87722 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:12.133917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825634f0-8f7f-49e4-9458-7f5a19d87722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:12.134587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825634f0-8f7f-49e4-9458-7f5a19d87722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:12.136484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825634f0-8f7f-49e4-9458-7f5a19d87722 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:12.152096 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2871/5788] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:12.160084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784aede-11db-4c44-8281-eaac6aaf686d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:12.160084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784aede-11db-4c44-8281-eaac6aaf686d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:12.160084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784aede-11db-4c44-8281-eaac6aaf686d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:12.184732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af8e43ef-a036-4777-b98b-0e5b8e925249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dbd274a4c0243ecb81e238288d3893e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:12.185681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af8e43ef-a036-4777-b98b-0e5b8e925249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dbd274a4c0243ecb81e238288d3893e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:12.190530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0784aede-11db-4c44-8281-eaac6aaf686d None None] MFA Rules not processed for user `449a9b776f64465a916a96aa26510caf`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:12.191959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0784aede-11db-4c44-8281-eaac6aaf686d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:12.296752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af8e43ef-a036-4777-b98b-0e5b8e925249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dbd274a4c0243ecb81e238288d3893e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:12.298391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af8e43ef-a036-4777-b98b-0e5b8e925249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dbd274a4c0243ecb81e238288d3893e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:12.307438 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2872/5789] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:12.310700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b2127-46f6-45e7-a2b3-81497ec349c4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:12.311729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b2127-46f6-45e7-a2b3-81497ec349c4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:12.312303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b2127-46f6-45e7-a2b3-81497ec349c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:12.322243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af8e43ef-a036-4777-b98b-0e5b8e925249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dbd274a4c0243ecb81e238288d3893e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:12.337020 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2918/5790] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:11 2022] DELETE /identity/v3/users/2dbd274a4c0243ecb81e238288d3893e => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:12.337833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e43ef-a036-4777-b98b-0e5b8e925249 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:12.339384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-af8e43ef-a036-4777-b98b-0e5b8e925249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:12.339651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d22b2127-46f6-45e7-a2b3-81497ec349c4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:12.341111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d22b2127-46f6-45e7-a2b3-81497ec349c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:12.409802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:12.454439 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2873/5791] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:12.456666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a1d74-c371-4c08-9b57-67a97a911d6a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:12.457063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a1d74-c371-4c08-9b57-67a97a911d6a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:12.457441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a1d74-c371-4c08-9b57-67a97a911d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:12.464913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e43ef-a036-4777-b98b-0e5b8e925249 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:12.472789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee9bba-6529-40a6-aad6-9461881784d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:12.473738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee9bba-6529-40a6-aad6-9461881784d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:12.475479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee9bba-6529-40a6-aad6-9461881784d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:12.476004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee9bba-6529-40a6-aad6-9461881784d2 admin admin] PATH_INFO: `/v3/projects/fb170528d4004209b6ebd987000bc753` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:12.478725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee9bba-6529-40a6-aad6-9461881784d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb170528d4004209b6ebd987000bc753)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:12.480905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee9bba-6529-40a6-aad6-9461881784d2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:12.494612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-cc6a1d74-c371-4c08-9b57-67a97a911d6a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:12.496927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cc6a1d74-c371-4c08-9b57-67a97a911d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:12.515353 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2874/5792] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:12.516636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a1d74-c371-4c08-9b57-67a97a911d6a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:12.519478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cc6a1d74-c371-4c08-9b57-67a97a911d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:12.533080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a1d74-c371-4c08-9b57-67a97a911d6a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:12.539198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b91dc-af90-4879-93a3-7437c34ddf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:12.539955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b91dc-af90-4879-93a3-7437c34ddf6e admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:12.540280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b91dc-af90-4879-93a3-7437c34ddf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:12.540555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b91dc-af90-4879-93a3-7437c34ddf6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:12.541205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b91dc-af90-4879-93a3-7437c34ddf6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:12.543128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b91dc-af90-4879-93a3-7437c34ddf6e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:12.599940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-62ee9bba-6529-40a6-aad6-9461881784d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb170528d4004209b6ebd987000bc753', 'request_id': 'req-62ee9bba-6529-40a6-aad6-9461881784d2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:12.611025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-62ee9bba-6529-40a6-aad6-9461881784d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb170528d4004209b6ebd987000bc753', 'request_id': 'req-62ee9bba-6529-40a6-aad6-9461881784d2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:12.674224 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2875/5793] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:12 2022] POST /identity/v3/projects => generated 359 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:12.677469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b91dc-af90-4879-93a3-7437c34ddf6e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:12.681987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8d9b91dc-af90-4879-93a3-7437c34ddf6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:12.690011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:12.690812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-62ee9bba-6529-40a6-aad6-9461881784d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb170528d4004209b6ebd987000bc753', 'request_id': 'req-62ee9bba-6529-40a6-aad6-9461881784d2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:12.712022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-62ee9bba-6529-40a6-aad6-9461881784d2 admin admin] The token cache is being invalidate because project fb170528d4004209b6ebd987000bc753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:12.712859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-62ee9bba-6529-40a6-aad6-9461881784d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:12.713646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-62ee9bba-6529-40a6-aad6-9461881784d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:12.717192 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2919/5794] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:12 2022] DELETE /identity/v3/projects/fb170528d4004209b6ebd987000bc753 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:12.718457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee9bba-6529-40a6-aad6-9461881784d2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:12.720095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-62ee9bba-6529-40a6-aad6-9461881784d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:12.785488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b91dc-af90-4879-93a3-7437c34ddf6e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:12.792412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3942d2-6789-428c-b4e7-d6fa76f96391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:12.793046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3942d2-6789-428c-b4e7-d6fa76f96391 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:12.793380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3942d2-6789-428c-b4e7-d6fa76f96391 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:12.794923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3942d2-6789-428c-b4e7-d6fa76f96391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:12.796405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ba3942d2-6789-428c-b4e7-d6fa76f96391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:12.801849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee9bba-6529-40a6-aad6-9461881784d2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:12.879707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf74b9-78da-4834-88c3-f41c721e7219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:12.881894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf74b9-78da-4834-88c3-f41c721e7219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:12.882387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf74b9-78da-4834-88c3-f41c721e7219 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:12.882736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf74b9-78da-4834-88c3-f41c721e7219 admin admin] PATH_INFO: `/v3/users/327fd257218b4985b02fb0367db576de` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:12.884013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf74b9-78da-4834-88c3-f41c721e7219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=327fd257218b4985b02fb0367db576de)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:12.890515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf74b9-78da-4834-88c3-f41c721e7219 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:12.890905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3942d2-6789-428c-b4e7-d6fa76f96391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:12.891502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3942d2-6789-428c-b4e7-d6fa76f96391 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:12.903567 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2876/5795] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:12.920280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3942d2-6789-428c-b4e7-d6fa76f96391 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:12.920280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ba3942d2-6789-428c-b4e7-d6fa76f96391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:12.947221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3942d2-6789-428c-b4e7-d6fa76f96391 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:12.951010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6f4da-bf1f-4617-a471-5abf1a22ee8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:12.951654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6f4da-bf1f-4617-a471-5abf1a22ee8a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:12.951935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6f4da-bf1f-4617-a471-5abf1a22ee8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:12.952259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6f4da-bf1f-4617-a471-5abf1a22ee8a admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:12.952938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6f4da-bf1f-4617-a471-5abf1a22ee8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:12.953265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6f4da-bf1f-4617-a471-5abf1a22ee8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:12.955234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6f4da-bf1f-4617-a471-5abf1a22ee8a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:12.972779 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2877/5796] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:12.973689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6f4da-bf1f-4617-a471-5abf1a22ee8a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:12.976340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3eb6f4da-bf1f-4617-a471-5abf1a22ee8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:12.989471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6f4da-bf1f-4617-a471-5abf1a22ee8a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:12.996691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fe149-a3c6-4081-b78a-eb43dc8458e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:12.996843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fe149-a3c6-4081-b78a-eb43dc8458e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:12.997154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fe149-a3c6-4081-b78a-eb43dc8458e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:12.997536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fe149-a3c6-4081-b78a-eb43dc8458e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:12.998448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fe149-a3c6-4081-b78a-eb43dc8458e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:12.998769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fe149-a3c6-4081-b78a-eb43dc8458e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:13.000825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fe149-a3c6-4081-b78a-eb43dc8458e4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:13.021308 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2878/5797] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:13.021308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fe149-a3c6-4081-b78a-eb43dc8458e4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:13.021308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3c2fe149-a3c6-4081-b78a-eb43dc8458e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:13.037441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fe149-a3c6-4081-b78a-eb43dc8458e4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:13.045226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:13.045872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:13.046153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:13.046426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad admin admin] PATH_INFO: `/v3/projects/0e490bef1fb4425cb00bc508165626fd` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:13.047578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e490bef1fb4425cb00bc508165626fd)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:13.049690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:13.072794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0eaf74b9-78da-4834-88c3-f41c721e7219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327fd257218b4985b02fb0367db576de'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:13.074109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0eaf74b9-78da-4834-88c3-f41c721e7219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327fd257218b4985b02fb0367db576de'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:13.199514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0eaf74b9-78da-4834-88c3-f41c721e7219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327fd257218b4985b02fb0367db576de'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:13.200116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0eaf74b9-78da-4834-88c3-f41c721e7219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327fd257218b4985b02fb0367db576de'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:13.217859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0eaf74b9-78da-4834-88c3-f41c721e7219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327fd257218b4985b02fb0367db576de'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:13.234306 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2920/5798] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:12 2022] DELETE /identity/v3/users/327fd257218b4985b02fb0367db576de => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:13.235811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf74b9-78da-4834-88c3-f41c721e7219 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:13.238589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0eaf74b9-78da-4834-88c3-f41c721e7219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:13.245021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e490bef1fb4425cb00bc508165626fd', 'request_id': 'req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:13.258307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e490bef1fb4425cb00bc508165626fd', 'request_id': 'req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:13.270244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e490bef1fb4425cb00bc508165626fd', 'request_id': 'req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:13.323645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf74b9-78da-4834-88c3-f41c721e7219 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:13.328658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16754089-6349-467b-b172-cad806155404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:13.329280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16754089-6349-467b-b172-cad806155404 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:13.329578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16754089-6349-467b-b172-cad806155404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:13.329830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16754089-6349-467b-b172-cad806155404 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:13.330463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16754089-6349-467b-b172-cad806155404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:13.332427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16754089-6349-467b-b172-cad806155404 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:13.346713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad admin admin] The token cache is being invalidate because project 0e490bef1fb4425cb00bc508165626fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:13.348504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:13.348504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:13.352389 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2879/5799] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:13 2022] DELETE /identity/v3/projects/0e490bef1fb4425cb00bc508165626fd => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:13.352389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:13.353004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:13.424404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3636dd0-ca2f-47fb-91c6-cddd50c79fad admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:13.432432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62646f-587e-4b95-98b4-892f0b0908d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:13.433328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62646f-587e-4b95-98b4-892f0b0908d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:13.433678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62646f-587e-4b95-98b4-892f0b0908d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:13.437252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62646f-587e-4b95-98b4-892f0b0908d9 admin admin] PATH_INFO: `/v3/users/d2081af0a76d4b49aa1af0992e6a08dc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:13.437252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62646f-587e-4b95-98b4-892f0b0908d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2081af0a76d4b49aa1af0992e6a08dc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:13.438086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62646f-587e-4b95-98b4-892f0b0908d9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:13.450826 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2921/5800] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:13 2022] POST /identity/v3/users => generated 280 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:13.452224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651a0d4-e0f1-404b-b42c-3c24c57dcb84 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:13.452624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651a0d4-e0f1-404b-b42c-3c24c57dcb84 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:13.453039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651a0d4-e0f1-404b-b42c-3c24c57dcb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:13.489310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e651a0d4-e0f1-404b-b42c-3c24c57dcb84 None None] MFA Rules not processed for user `5f36f07947784bcdbdb6051d6dca1659`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:13.508409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e651a0d4-e0f1-404b-b42c-3c24c57dcb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:13.557344 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2922/5801] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:13.558323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651a0d4-e0f1-404b-b42c-3c24c57dcb84 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:13.560680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e651a0d4-e0f1-404b-b42c-3c24c57dcb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:13.575690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651a0d4-e0f1-404b-b42c-3c24c57dcb84 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:13.580479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22295fbd-be9b-494f-b8e1-3fa661c46197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:13.581094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22295fbd-be9b-494f-b8e1-3fa661c46197 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:13.581375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22295fbd-be9b-494f-b8e1-3fa661c46197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:13.581646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22295fbd-be9b-494f-b8e1-3fa661c46197 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:13.582316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22295fbd-be9b-494f-b8e1-3fa661c46197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:13.584686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22295fbd-be9b-494f-b8e1-3fa661c46197 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:13.711890 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2923/5802] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:13 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:13.712572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22295fbd-be9b-494f-b8e1-3fa661c46197 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:13.716452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-22295fbd-be9b-494f-b8e1-3fa661c46197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:13.728330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ac62646f-587e-4b95-98b4-892f0b0908d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2081af0a76d4b49aa1af0992e6a08dc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:13.743945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:13.809661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ac62646f-587e-4b95-98b4-892f0b0908d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2081af0a76d4b49aa1af0992e6a08dc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:13.811446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ac62646f-587e-4b95-98b4-892f0b0908d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2081af0a76d4b49aa1af0992e6a08dc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:13.818681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22295fbd-be9b-494f-b8e1-3fa661c46197 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:13.827689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ac62646f-587e-4b95-98b4-892f0b0908d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2081af0a76d4b49aa1af0992e6a08dc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:13.830492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaab3e8-dc33-487e-bc5f-b9492ff78cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:13.831222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaab3e8-dc33-487e-bc5f-b9492ff78cea admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:13.836070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaab3e8-dc33-487e-bc5f-b9492ff78cea admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:13.836070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaab3e8-dc33-487e-bc5f-b9492ff78cea admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:13.836070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaab3e8-dc33-487e-bc5f-b9492ff78cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:13.836070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaab3e8-dc33-487e-bc5f-b9492ff78cea admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:13.843763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ac62646f-587e-4b95-98b4-892f0b0908d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2081af0a76d4b49aa1af0992e6a08dc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:13.852681 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2880/5803] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:13 2022] DELETE /identity/v3/users/d2081af0a76d4b49aa1af0992e6a08dc => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:13.853766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe8669-9b51-4c21-acff-3da0a2f8e446 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:13.860537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe8669-9b51-4c21-acff-3da0a2f8e446 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:13.860832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe8669-9b51-4c21-acff-3da0a2f8e446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:13.897325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-fdfe8669-9b51-4c21-acff-3da0a2f8e446 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:13.898644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fdfe8669-9b51-4c21-acff-3da0a2f8e446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:13.945504 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2924/5804] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:13 2022] POST /identity/v3/projects => generated 369 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:13.946937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0164ad-5b3a-4d27-a0e6-f96e8680ffb3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:13.947230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0164ad-5b3a-4d27-a0e6-f96e8680ffb3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:13.947509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0164ad-5b3a-4d27-a0e6-f96e8680ffb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:13.983593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6f0164ad-5b3a-4d27-a0e6-f96e8680ffb3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:13.986028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6f0164ad-5b3a-4d27-a0e6-f96e8680ffb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:14.000783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:14.001118 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2881/5805] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:14.003338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe8669-9b51-4c21-acff-3da0a2f8e446 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:14.005700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fdfe8669-9b51-4c21-acff-3da0a2f8e446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:14.023056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe8669-9b51-4c21-acff-3da0a2f8e446 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:14.095632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311deb53-fda1-4eaf-ab28-4a9ddcb4df09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:14.096418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311deb53-fda1-4eaf-ab28-4a9ddcb4df09 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:14.096932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311deb53-fda1-4eaf-ab28-4a9ddcb4df09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:14.097395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311deb53-fda1-4eaf-ab28-4a9ddcb4df09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:14.097783 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2925/5806] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:14.098614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311deb53-fda1-4eaf-ab28-4a9ddcb4df09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:14.100774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c7db0-0097-4072-a44c-43f3b36f35bc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:14.101062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c7db0-0097-4072-a44c-43f3b36f35bc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:14.101494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c7db0-0097-4072-a44c-43f3b36f35bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:14.101957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311deb53-fda1-4eaf-ab28-4a9ddcb4df09 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:14.113068 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2882/5807] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:14.114387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311deb53-fda1-4eaf-ab28-4a9ddcb4df09 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:14.118065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-311deb53-fda1-4eaf-ab28-4a9ddcb4df09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:14.123734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1c7c7db0-0097-4072-a44c-43f3b36f35bc None None] MFA Rules not processed for user `5f36f07947784bcdbdb6051d6dca1659`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:14.125622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1c7c7db0-0097-4072-a44c-43f3b36f35bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:14.131861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311deb53-fda1-4eaf-ab28-4a9ddcb4df09 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:14.137950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237730db-ec1b-4508-a3f0-b514f28f23ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:14.138568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237730db-ec1b-4508-a3f0-b514f28f23ff admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:14.138851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237730db-ec1b-4508-a3f0-b514f28f23ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:14.139125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237730db-ec1b-4508-a3f0-b514f28f23ff admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:14.139767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237730db-ec1b-4508-a3f0-b514f28f23ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:14.141758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237730db-ec1b-4508-a3f0-b514f28f23ff admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:14.204363 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2926/5808] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:14.204905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c7db0-0097-4072-a44c-43f3b36f35bc None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:14.206177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1c7c7db0-0097-4072-a44c-43f3b36f35bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:14.222117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c7db0-0097-4072-a44c-43f3b36f35bc None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:14.227373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c31777-1774-4d83-93af-8b9879218434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:14.227991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c31777-1774-4d83-93af-8b9879218434 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:14.228304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c31777-1774-4d83-93af-8b9879218434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:14.228578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c31777-1774-4d83-93af-8b9879218434 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:14.229210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c31777-1774-4d83-93af-8b9879218434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:14.231253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c31777-1774-4d83-93af-8b9879218434 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:14.290972 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2883/5809] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:14 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:14.290972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237730db-ec1b-4508-a3f0-b514f28f23ff admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:14.290972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-237730db-ec1b-4508-a3f0-b514f28f23ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:14.370417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237730db-ec1b-4508-a3f0-b514f28f23ff admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:14.372980 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2927/5810] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:14 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:14.375043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8ce56-b21c-4586-a6ba-69175c893691 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:14.375299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8ce56-b21c-4586-a6ba-69175c893691 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:14.376121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8ce56-b21c-4586-a6ba-69175c893691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:14.378210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d2191-9d23-400f-84c6-cfbbd12bf04f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:14.378964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d2191-9d23-400f-84c6-cfbbd12bf04f service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:14.379311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d2191-9d23-400f-84c6-cfbbd12bf04f service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:14.379651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d2191-9d23-400f-84c6-cfbbd12bf04f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:14.392087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d2191-9d23-400f-84c6-cfbbd12bf04f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:14.394314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d2191-9d23-400f-84c6-cfbbd12bf04f service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:14.403319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-50f8ce56-b21c-4586-a6ba-69175c893691 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:14.404681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-50f8ce56-b21c-4586-a6ba-69175c893691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:14.407203 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2884/5811] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:14.408262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d2191-9d23-400f-84c6-cfbbd12bf04f service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:14.414552 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2928/5812] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:14.415587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8ce56-b21c-4586-a6ba-69175c893691 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:14.417148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-50f8ce56-b21c-4586-a6ba-69175c893691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:14.420592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d2191-9d23-400f-84c6-cfbbd12bf04f service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:14.429202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360760d0-eedc-4340-b79f-a8734bb8ae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:14.430059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360760d0-eedc-4340-b79f-a8734bb8ae9a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:14.430430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360760d0-eedc-4340-b79f-a8734bb8ae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:14.430859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360760d0-eedc-4340-b79f-a8734bb8ae9a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:14.431584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360760d0-eedc-4340-b79f-a8734bb8ae9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:14.433548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360760d0-eedc-4340-b79f-a8734bb8ae9a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:14.447024 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2885/5813] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:14.448013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360760d0-eedc-4340-b79f-a8734bb8ae9a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:14.458850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360760d0-eedc-4340-b79f-a8734bb8ae9a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:14.469977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff62a9f-404d-48b3-a960-40e1c9e34b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:14.470679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff62a9f-404d-48b3-a960-40e1c9e34b4d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:14.470958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff62a9f-404d-48b3-a960-40e1c9e34b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:14.471230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff62a9f-404d-48b3-a960-40e1c9e34b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:14.471882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff62a9f-404d-48b3-a960-40e1c9e34b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:14.473522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff62a9f-404d-48b3-a960-40e1c9e34b4d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:14.491321 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2886/5814] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:14.491321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff62a9f-404d-48b3-a960-40e1c9e34b4d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:14.502005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff62a9f-404d-48b3-a960-40e1c9e34b4d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:14.515513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952e7ca-bb8f-491a-bdcd-584134eb271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:14.516447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952e7ca-bb8f-491a-bdcd-584134eb271f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:14.516798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952e7ca-bb8f-491a-bdcd-584134eb271f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:14.517074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952e7ca-bb8f-491a-bdcd-584134eb271f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:14.517730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952e7ca-bb8f-491a-bdcd-584134eb271f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:14.519891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952e7ca-bb8f-491a-bdcd-584134eb271f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:14.533004 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2887/5815] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:14.534151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952e7ca-bb8f-491a-bdcd-584134eb271f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:14.551100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952e7ca-bb8f-491a-bdcd-584134eb271f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:14.553658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8ce56-b21c-4586-a6ba-69175c893691 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:14.559228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36394ce1-0fcb-4b31-883a-662085e9c771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:14.560052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36394ce1-0fcb-4b31-883a-662085e9c771 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:14.560635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36394ce1-0fcb-4b31-883a-662085e9c771 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:14.560793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36394ce1-0fcb-4b31-883a-662085e9c771 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:14.561437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e0fd5-4495-41d3-b548-a1b50744139b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:14.561588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36394ce1-0fcb-4b31-883a-662085e9c771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:14.562171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e0fd5-4495-41d3-b548-a1b50744139b service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:14.562317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36394ce1-0fcb-4b31-883a-662085e9c771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:14.562571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e0fd5-4495-41d3-b548-a1b50744139b service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:14.562953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e0fd5-4495-41d3-b548-a1b50744139b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:14.564580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36394ce1-0fcb-4b31-883a-662085e9c771 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:14.565080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ff4e0fd5-4495-41d3-b548-a1b50744139b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:14.577928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e0fd5-4495-41d3-b548-a1b50744139b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:14.579640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e0fd5-4495-41d3-b548-a1b50744139b service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:14.588874 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2888/5816] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:14.588874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36394ce1-0fcb-4b31-883a-662085e9c771 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:14.591364 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2929/5817] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:14.599117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e0fd5-4495-41d3-b548-a1b50744139b service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:14.599912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-36394ce1-0fcb-4b31-883a-662085e9c771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:14.603999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e0fd5-4495-41d3-b548-a1b50744139b service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:14.608993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323996b8-deba-45ce-9c60-b66d75e2a464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:14.609945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323996b8-deba-45ce-9c60-b66d75e2a464 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:14.610323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323996b8-deba-45ce-9c60-b66d75e2a464 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:14.610774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323996b8-deba-45ce-9c60-b66d75e2a464 admin admin] PATH_INFO: `/v3/projects/8f09db728c6f44b88ef295e39d22b612/users/67ff5492e3714b6aa286354a74922b06/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:14.627305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36394ce1-0fcb-4b31-883a-662085e9c771 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:14.629593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323996b8-deba-45ce-9c60-b66d75e2a464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f09db728c6f44b88ef295e39d22b612, user_id=67ff5492e3714b6aa286354a74922b06, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:14.633579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323996b8-deba-45ce-9c60-b66d75e2a464 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:14.642628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1baf7-30dc-4187-b932-6f93dc42ec9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:14.644010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1baf7-30dc-4187-b932-6f93dc42ec9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:14.644263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1baf7-30dc-4187-b932-6f93dc42ec9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:14.644577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1baf7-30dc-4187-b932-6f93dc42ec9b admin admin] PATH_INFO: `/v3/projects/aed67d259f504207bf495dfb65945c15` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:14.646037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1baf7-30dc-4187-b932-6f93dc42ec9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed67d259f504207bf495dfb65945c15)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:14.648531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1baf7-30dc-4187-b932-6f93dc42ec9b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:14.725082 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2930/5818] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:14 2022] PUT /identity/v3/projects/8f09db728c6f44b88ef295e39d22b612/users/67ff5492e3714b6aa286354a74922b06/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:14.726077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323996b8-deba-45ce-9c60-b66d75e2a464 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:14.812811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323996b8-deba-45ce-9c60-b66d75e2a464 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:14.814643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6db1baf7-30dc-4187-b932-6f93dc42ec9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed67d259f504207bf495dfb65945c15', 'request_id': 'req-6db1baf7-30dc-4187-b932-6f93dc42ec9b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:14.828015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6db1baf7-30dc-4187-b932-6f93dc42ec9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed67d259f504207bf495dfb65945c15', 'request_id': 'req-6db1baf7-30dc-4187-b932-6f93dc42ec9b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:14.843847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6db1baf7-30dc-4187-b932-6f93dc42ec9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed67d259f504207bf495dfb65945c15', 'request_id': 'req-6db1baf7-30dc-4187-b932-6f93dc42ec9b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:14.909068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fd2fd-50be-4329-af0c-ba3e28aae878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:14.910003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fd2fd-50be-4329-af0c-ba3e28aae878 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:14.910295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fd2fd-50be-4329-af0c-ba3e28aae878 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:14.910600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fd2fd-50be-4329-af0c-ba3e28aae878 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:14.911249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fd2fd-50be-4329-af0c-ba3e28aae878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:14.913874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fd2fd-50be-4329-af0c-ba3e28aae878 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:14.924844 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2931/5819] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:14.925708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fd2fd-50be-4329-af0c-ba3e28aae878 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:14.937971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fd2fd-50be-4329-af0c-ba3e28aae878 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:14.945346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81bcd1-cad3-4440-b49a-094711dbaf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:14.945966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81bcd1-cad3-4440-b49a-094711dbaf89 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:14.946247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81bcd1-cad3-4440-b49a-094711dbaf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:14.946720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81bcd1-cad3-4440-b49a-094711dbaf89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:14.947380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81bcd1-cad3-4440-b49a-094711dbaf89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:14.949044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81bcd1-cad3-4440-b49a-094711dbaf89 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:14.953947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6db1baf7-30dc-4187-b932-6f93dc42ec9b admin admin] The token cache is being invalidate because project aed67d259f504207bf495dfb65945c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:14.954358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6db1baf7-30dc-4187-b932-6f93dc42ec9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:14.955034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6db1baf7-30dc-4187-b932-6f93dc42ec9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:14.956596 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2889/5820] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:14 2022] DELETE /identity/v3/projects/aed67d259f504207bf495dfb65945c15 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:14.967328 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2932/5821] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:14.967328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81bcd1-cad3-4440-b49a-094711dbaf89 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:14.968749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ef81bcd1-cad3-4440-b49a-094711dbaf89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:14.969288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c03b31-c598-411c-8568-8b6060b05944 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:14.969581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c03b31-c598-411c-8568-8b6060b05944 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:14.969859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c03b31-c598-411c-8568-8b6060b05944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:14.991483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81bcd1-cad3-4440-b49a-094711dbaf89 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:14.999272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605b161-dff2-4ea1-b491-029889763d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:15.000390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605b161-dff2-4ea1-b491-029889763d28 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:15.000775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605b161-dff2-4ea1-b491-029889763d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:15.001259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605b161-dff2-4ea1-b491-029889763d28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:15.002087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605b161-dff2-4ea1-b491-029889763d28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:15.004200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605b161-dff2-4ea1-b491-029889763d28 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:15.010056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-24c03b31-c598-411c-8568-8b6060b05944 None None] MFA Rules not processed for user `67ff5492e3714b6aa286354a74922b06`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:15.011583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-24c03b31-c598-411c-8568-8b6060b05944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:15.109523 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2890/5822] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:15.110385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c03b31-c598-411c-8568-8b6060b05944 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:15.111654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-24c03b31-c598-411c-8568-8b6060b05944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:15.130280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c03b31-c598-411c-8568-8b6060b05944 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:15.138169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcf888-497c-4896-95ef-1630981576eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:15.139691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf888-497c-4896-95ef-1630981576eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:15.140184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf888-497c-4896-95ef-1630981576eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:15.140616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf888-497c-4896-95ef-1630981576eb admin admin] PATH_INFO: `/v3/projects/11151118b7d14bb38c65f8f3de18c1f9` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:15.142542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcf888-497c-4896-95ef-1630981576eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=11151118b7d14bb38c65f8f3de18c1f9)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:15.145299 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2933/5823] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:14 2022] POST /identity/v3/projects => generated 393 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:15.145493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcf888-497c-4896-95ef-1630981576eb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:15.146837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605b161-dff2-4ea1-b491-029889763d28 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:15.150721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8605b161-dff2-4ea1-b491-029889763d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:15.224893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605b161-dff2-4ea1-b491-029889763d28 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:15.231291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8de5c3-61fb-48f1-bdd8-a18f8ee7aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:15.231974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8de5c3-61fb-48f1-bdd8-a18f8ee7aadf admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:15.232296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8de5c3-61fb-48f1-bdd8-a18f8ee7aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:15.236523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8de5c3-61fb-48f1-bdd8-a18f8ee7aadf admin admin] PATH_INFO: `/v3/projects/f0f1eb4384394fc18f1626f3e12e04e3/users/4f0f2cda90f64e00a465ddf272986497/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:15.248485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8de5c3-61fb-48f1-bdd8-a18f8ee7aadf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f1eb4384394fc18f1626f3e12e04e3, user_id=4f0f2cda90f64e00a465ddf272986497, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:15.251156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8de5c3-61fb-48f1-bdd8-a18f8ee7aadf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:15.344556 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2934/5824] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:15 2022] PUT /identity/v3/projects/f0f1eb4384394fc18f1626f3e12e04e3/users/4f0f2cda90f64e00a465ddf272986497/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:15.346189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812f047-0a16-4dac-98e9-3d08732a856c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:15.346565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812f047-0a16-4dac-98e9-3d08732a856c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:15.346801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812f047-0a16-4dac-98e9-3d08732a856c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:15.355364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-e812f047-0a16-4dac-98e9-3d08732a856c None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:52:15.355364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:15.355364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:52:15.355364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:52:15.355364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:52:15.355364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:52:15.355364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:52:15.355364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:52:15.355364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:52:15.355364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:52:15.355364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:52:15.355364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:52:15.355364 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:52:15.356642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:52:15.356642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:52:15.356642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:52:15.356642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:52:15.356642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:52:15.356642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:52:15.356642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:52:15.356642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:52:15.356642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:52:15.356642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:52:15.356642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:52:15.356642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:52:15.356642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:52:15.356642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:52:15.356642 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:15.357942 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2935/5825] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:52:15 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:52:15.357942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c6e2f-e3d7-4813-aad3-a937fc8af099 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:15.358131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c6e2f-e3d7-4813-aad3-a937fc8af099 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:15.358402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c6e2f-e3d7-4813-aad3-a937fc8af099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:15.381046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b2dcf888-497c-4896-95ef-1630981576eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11151118b7d14bb38c65f8f3de18c1f9', 'request_id': 'req-b2dcf888-497c-4896-95ef-1630981576eb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:15.381046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b2dcf888-497c-4896-95ef-1630981576eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11151118b7d14bb38c65f8f3de18c1f9', 'request_id': 'req-b2dcf888-497c-4896-95ef-1630981576eb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:15.390128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b2dcf888-497c-4896-95ef-1630981576eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11151118b7d14bb38c65f8f3de18c1f9', 'request_id': 'req-b2dcf888-497c-4896-95ef-1630981576eb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:15.401285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2e5c6e2f-e3d7-4813-aad3-a937fc8af099 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:15.402836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2e5c6e2f-e3d7-4813-aad3-a937fc8af099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:15.488399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b2dcf888-497c-4896-95ef-1630981576eb admin admin] The token cache is being invalidate because project 11151118b7d14bb38c65f8f3de18c1f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:15.488836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b2dcf888-497c-4896-95ef-1630981576eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:15.489671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b2dcf888-497c-4896-95ef-1630981576eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:15.491783 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2891/5826] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:15 2022] DELETE /identity/v3/projects/11151118b7d14bb38c65f8f3de18c1f9 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:15.493782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcf888-497c-4896-95ef-1630981576eb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:15.501498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b2dcf888-497c-4896-95ef-1630981576eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:15.502553 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2936/5827] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:15.504680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22309998-8f8d-4c10-a049-237fdb783856 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:15.509552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22309998-8f8d-4c10-a049-237fdb783856 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:15.509552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22309998-8f8d-4c10-a049-237fdb783856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:15.522903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcf888-497c-4896-95ef-1630981576eb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:15.528551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba6aee-9d3c-48d7-a425-aa330eeb2be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:15.529343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba6aee-9d3c-48d7-a425-aa330eeb2be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:15.529725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba6aee-9d3c-48d7-a425-aa330eeb2be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:15.530095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba6aee-9d3c-48d7-a425-aa330eeb2be8 admin admin] PATH_INFO: `/v3/projects/68fc37dba0b24a998c0be16ec438e76d/users/eace64b8e2ba4f36a1938ba7c70ce317/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:15.535100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-22309998-8f8d-4c10-a049-237fdb783856 None None] MFA Rules not processed for user `67ff5492e3714b6aa286354a74922b06`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:15.538253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-22309998-8f8d-4c10-a049-237fdb783856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:15.542103 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2937/5828] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:15 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:15.543099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22309998-8f8d-4c10-a049-237fdb783856 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:15.545382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-22309998-8f8d-4c10-a049-237fdb783856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:15.554663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba6aee-9d3c-48d7-a425-aa330eeb2be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fc37dba0b24a998c0be16ec438e76d, user_id=eace64b8e2ba4f36a1938ba7c70ce317, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:15.558594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba6aee-9d3c-48d7-a425-aa330eeb2be8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:15.570420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22309998-8f8d-4c10-a049-237fdb783856 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:15.575662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939410d-0def-4157-a9ca-a5cf50dad6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:15.576436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939410d-0def-4157-a9ca-a5cf50dad6bf admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:15.576783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939410d-0def-4157-a9ca-a5cf50dad6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:15.577122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939410d-0def-4157-a9ca-a5cf50dad6bf admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:15.577852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939410d-0def-4157-a9ca-a5cf50dad6bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:15.580006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939410d-0def-4157-a9ca-a5cf50dad6bf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:15.672790 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2892/5829] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:15 2022] PUT /identity/v3/projects/68fc37dba0b24a998c0be16ec438e76d/users/eace64b8e2ba4f36a1938ba7c70ce317/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:15.674475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f331147-a1bb-4cc7-9e6b-fb50836976b0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:15.674927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f331147-a1bb-4cc7-9e6b-fb50836976b0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:15.675393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f331147-a1bb-4cc7-9e6b-fb50836976b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:15.713413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3f331147-a1bb-4cc7-9e6b-fb50836976b0 None None] MFA Rules not processed for user `4f0f2cda90f64e00a465ddf272986497`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:15.715192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3f331147-a1bb-4cc7-9e6b-fb50836976b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:15.716212 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2938/5830] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:15 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:15.717958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a9730-7491-415b-910b-2913c9d3c7ef None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:15.718495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a9730-7491-415b-910b-2913c9d3c7ef None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:15.719012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a9730-7491-415b-910b-2913c9d3c7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:15.737725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:15.761081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-931a9730-7491-415b-910b-2913c9d3c7ef None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:15.763056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-931a9730-7491-415b-910b-2913c9d3c7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:15.854970 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2893/5831] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:15.856568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971db54-515a-4356-9aae-3cc2ec6ce6f6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:15.856854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971db54-515a-4356-9aae-3cc2ec6ce6f6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:15.860859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971db54-515a-4356-9aae-3cc2ec6ce6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:15.875891 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2939/5832] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:15.877513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4ce3a-63f8-4f41-9f7e-97b05c981ed5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:15.878128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4ce3a-63f8-4f41-9f7e-97b05c981ed5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:15.878817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4ce3a-63f8-4f41-9f7e-97b05c981ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:15.905353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8bf4ce3a-63f8-4f41-9f7e-97b05c981ed5 None None] MFA Rules not processed for user `67ff5492e3714b6aa286354a74922b06`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:15.913035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8bf4ce3a-63f8-4f41-9f7e-97b05c981ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:15.918108 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2940/5833] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:15 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:15.918894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c971db54-515a-4356-9aae-3cc2ec6ce6f6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:15.920181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c971db54-515a-4356-9aae-3cc2ec6ce6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:15.920376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd28448-7dae-4ed5-b2ad-d1ee9cf28330 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:15.920808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd28448-7dae-4ed5-b2ad-d1ee9cf28330 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:15.921259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd28448-7dae-4ed5-b2ad-d1ee9cf28330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:15.947485 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2894/5834] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:15.948782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971db54-515a-4356-9aae-3cc2ec6ce6f6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:15.967596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971db54-515a-4356-9aae-3cc2ec6ce6f6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:15.981970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9fd28448-7dae-4ed5-b2ad-d1ee9cf28330 None None] MFA Rules not processed for user `eace64b8e2ba4f36a1938ba7c70ce317`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:15.983668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9fd28448-7dae-4ed5-b2ad-d1ee9cf28330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:15.983955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f6bbd-7949-4105-9dee-8d069712c364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:15.984793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f6bbd-7949-4105-9dee-8d069712c364 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:15.985441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f6bbd-7949-4105-9dee-8d069712c364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:15.986014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f6bbd-7949-4105-9dee-8d069712c364 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:15.986862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f6bbd-7949-4105-9dee-8d069712c364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:15.988699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f6bbd-7949-4105-9dee-8d069712c364 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:15.992846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:16.018982 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2895/5835] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:16.028394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f6bbd-7949-4105-9dee-8d069712c364 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:16.032119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cb0f6bbd-7949-4105-9dee-8d069712c364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:16.114268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f6bbd-7949-4105-9dee-8d069712c364 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:16.120237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ee65b-87c8-4fcf-8ff0-4f6a0b8cbdba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:16.122185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee65b-87c8-4fcf-8ff0-4f6a0b8cbdba service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:16.122728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee65b-87c8-4fcf-8ff0-4f6a0b8cbdba service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:16.123374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee65b-87c8-4fcf-8ff0-4f6a0b8cbdba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:16.134389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ee65b-87c8-4fcf-8ff0-4f6a0b8cbdba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:16.136187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ee65b-87c8-4fcf-8ff0-4f6a0b8cbdba service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:16.150115 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2896/5836] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:16.152885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa46d4-cd89-4065-ae2d-ffa7f5bb3f28 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:16.153359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa46d4-cd89-4065-ae2d-ffa7f5bb3f28 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:16.153873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa46d4-cd89-4065-ae2d-ffa7f5bb3f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:16.178461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-19aa46d4-cd89-4065-ae2d-ffa7f5bb3f28 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:16.180134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-19aa46d4-cd89-4065-ae2d-ffa7f5bb3f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:16.191535 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2897/5837] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:16.196354 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2941/5838] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:16.196354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd28448-7dae-4ed5-b2ad-d1ee9cf28330 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:16.197217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa46d4-cd89-4065-ae2d-ffa7f5bb3f28 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:16.199106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-19aa46d4-cd89-4065-ae2d-ffa7f5bb3f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:16.223189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd28448-7dae-4ed5-b2ad-d1ee9cf28330 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:16.242407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b7312-beec-4266-89f4-86faadff296e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:16.245751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b7312-beec-4266-89f4-86faadff296e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:16.245751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b7312-beec-4266-89f4-86faadff296e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:16.245751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b7312-beec-4266-89f4-86faadff296e admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:16.246147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b7312-beec-4266-89f4-86faadff296e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:16.246147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b7312-beec-4266-89f4-86faadff296e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:16.253408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b7312-beec-4266-89f4-86faadff296e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:16.284035 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2942/5839] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:16.285150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b7312-beec-4266-89f4-86faadff296e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:16.297464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b7312-beec-4266-89f4-86faadff296e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:16.307187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e47c5c-bfaf-47db-a429-e6effcee6424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:16.307944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa46d4-cd89-4065-ae2d-ffa7f5bb3f28 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:16.308506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e47c5c-bfaf-47db-a429-e6effcee6424 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:16.308931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e47c5c-bfaf-47db-a429-e6effcee6424 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:16.309502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e47c5c-bfaf-47db-a429-e6effcee6424 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:16.310248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e47c5c-bfaf-47db-a429-e6effcee6424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:16.312079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e47c5c-bfaf-47db-a429-e6effcee6424 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:16.312263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c8d6d-ea45-4eb1-98da-7bed112403bf tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ff5492e3714b6aa286354a74922b06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f09db728c6f44b88ef295e39d22b612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:16.312870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c8d6d-ea45-4eb1-98da-7bed112403bf tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] REQUEST_METHOD: `HEAD` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:16.313217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c8d6d-ea45-4eb1-98da-7bed112403bf tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:16.313564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c8d6d-ea45-4eb1-98da-7bed112403bf tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:16.321485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c8d6d-ea45-4eb1-98da-7bed112403bf tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] RBAC: Authorizing `identity:check_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:16.323422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c8d6d-ea45-4eb1-98da-7bed112403bf tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:16.334135 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2898/5840] 10.222.0.76 () {56 vars in 1264 bytes} [Sat Aug 27 04:52:16 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Aug 27 04:52:16.335317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c8d6d-ea45-4eb1-98da-7bed112403bf tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:16.342567 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2943/5841] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:16.348748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e47c5c-bfaf-47db-a429-e6effcee6424 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:16.354780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c8d6d-ea45-4eb1-98da-7bed112403bf tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:16.363821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e47c5c-bfaf-47db-a429-e6effcee6424 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:16.364722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a2cab-2062-412e-8673-e3cf8de4cc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:16.365451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a2cab-2062-412e-8673-e3cf8de4cc9e admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:16.365964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a2cab-2062-412e-8673-e3cf8de4cc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:16.366337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a2cab-2062-412e-8673-e3cf8de4cc9e admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:16.369906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a2cab-2062-412e-8673-e3cf8de4cc9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:16.370252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a2cab-2062-412e-8673-e3cf8de4cc9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:16.372885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a2cab-2062-412e-8673-e3cf8de4cc9e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:16.383577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c54d0b-5fb5-464c-9a8e-689456565c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:16.384651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c54d0b-5fb5-464c-9a8e-689456565c1f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:16.385226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c54d0b-5fb5-464c-9a8e-689456565c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:16.385716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c54d0b-5fb5-464c-9a8e-689456565c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:16.386878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c54d0b-5fb5-464c-9a8e-689456565c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:16.389504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c54d0b-5fb5-464c-9a8e-689456565c1f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:16.412253 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2899/5842] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:16.414717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a2cab-2062-412e-8673-e3cf8de4cc9e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:16.429809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a2cab-2062-412e-8673-e3cf8de4cc9e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:16.438798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb066bc-cee1-406d-86dd-d259456edc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:16.439907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb066bc-cee1-406d-86dd-d259456edc78 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:16.440474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb066bc-cee1-406d-86dd-d259456edc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:16.440763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb066bc-cee1-406d-86dd-d259456edc78 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:16.441558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb066bc-cee1-406d-86dd-d259456edc78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:16.445040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb066bc-cee1-406d-86dd-d259456edc78 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:16.493164 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2944/5843] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:16 2022] POST /identity/v3/projects => generated 367 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:16.494072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c54d0b-5fb5-464c-9a8e-689456565c1f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:16.564724 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2900/5844] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:16 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:16.565819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb066bc-cee1-406d-86dd-d259456edc78 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:16.579977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c54d0b-5fb5-464c-9a8e-689456565c1f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:16.666520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459de8f-7f99-49cd-b1b7-eecdc4d12a73 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ff5492e3714b6aa286354a74922b06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f09db728c6f44b88ef295e39d22b612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:16.667325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459de8f-7f99-49cd-b1b7-eecdc4d12a73 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:16.667613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459de8f-7f99-49cd-b1b7-eecdc4d12a73 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:16.667959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459de8f-7f99-49cd-b1b7-eecdc4d12a73 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:16.676806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459de8f-7f99-49cd-b1b7-eecdc4d12a73 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:16.679406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459de8f-7f99-49cd-b1b7-eecdc4d12a73 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:16.687538 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2945/5845] 10.222.0.76 () {56 vars in 1263 bytes} [Sat Aug 27 04:52:16 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:16.688582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459de8f-7f99-49cd-b1b7-eecdc4d12a73 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:16.702365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459de8f-7f99-49cd-b1b7-eecdc4d12a73 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:16.704660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb066bc-cee1-406d-86dd-d259456edc78 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:16.709584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d2c1b-719a-4eae-9319-62575c480010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:16.710271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d2c1b-719a-4eae-9319-62575c480010 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:16.710931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d2c1b-719a-4eae-9319-62575c480010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:16.711268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d2c1b-719a-4eae-9319-62575c480010 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:16.712320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d2c1b-719a-4eae-9319-62575c480010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:16.714279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d2c1b-719a-4eae-9319-62575c480010 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:16.719083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b48b7-5f84-4eae-b682-605478721429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:16.719953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b48b7-5f84-4eae-b682-605478721429 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:16.722610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b48b7-5f84-4eae-b682-605478721429 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:16.722610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b48b7-5f84-4eae-b682-605478721429 admin admin] PATH_INFO: `/v3/projects/7451645b0f414ff1bffd9cc096577139/users/acc9882e74924037af21b3da3c5bf1fb/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:16.758222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b48b7-5f84-4eae-b682-605478721429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7451645b0f414ff1bffd9cc096577139, user_id=acc9882e74924037af21b3da3c5bf1fb, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:16.762721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b48b7-5f84-4eae-b682-605478721429 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:16.818856 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2946/5846] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:16 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:16.819606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d2c1b-719a-4eae-9319-62575c480010 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:16.848025 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2901/5847] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:16 2022] PUT /identity/v3/projects/7451645b0f414ff1bffd9cc096577139/users/acc9882e74924037af21b3da3c5bf1fb/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:16.852275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b48b7-5f84-4eae-b682-605478721429 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:16.920607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d2c1b-719a-4eae-9319-62575c480010 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:16.979495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b48b7-5f84-4eae-b682-605478721429 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:16.996122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986a623-b5d4-4d90-83c9-689cd0f26f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:16.997063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986a623-b5d4-4d90-83c9-689cd0f26f8c admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:16.997516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986a623-b5d4-4d90-83c9-689cd0f26f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:16.997966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986a623-b5d4-4d90-83c9-689cd0f26f8c admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:16.998933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986a623-b5d4-4d90-83c9-689cd0f26f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:17.001058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986a623-b5d4-4d90-83c9-689cd0f26f8c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:17.037386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b4b6b-a506-47cf-89c5-b2212a70c329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:17.037946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b4b6b-a506-47cf-89c5-b2212a70c329 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:17.038309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b4b6b-a506-47cf-89c5-b2212a70c329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:17.038758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b4b6b-a506-47cf-89c5-b2212a70c329 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:17.039577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b4b6b-a506-47cf-89c5-b2212a70c329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:17.041582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b4b6b-a506-47cf-89c5-b2212a70c329 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:17.108373 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2902/5848] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:16 2022] POST /identity/v3/users => generated 285 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:17.109726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986a623-b5d4-4d90-83c9-689cd0f26f8c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:17.135437 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2947/5849] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:16 2022] POST /identity/v3/users => generated 290 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:17.136843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b4b6b-a506-47cf-89c5-b2212a70c329 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:17.163710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b4b6b-a506-47cf-89c5-b2212a70c329 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:17.175608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f32a9d-559c-4720-903a-96c3c2a7e578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:17.183232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f32a9d-559c-4720-903a-96c3c2a7e578 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:17.183232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f32a9d-559c-4720-903a-96c3c2a7e578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:17.183232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f32a9d-559c-4720-903a-96c3c2a7e578 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:17.183232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f32a9d-559c-4720-903a-96c3c2a7e578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:17.183920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f32a9d-559c-4720-903a-96c3c2a7e578 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:17.225903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986a623-b5d4-4d90-83c9-689cd0f26f8c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:17.232258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:17.233179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60836693-bbf1-466f-8bb6-5b337e566e7f tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ff5492e3714b6aa286354a74922b06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f09db728c6f44b88ef295e39d22b612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:17.233858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60836693-bbf1-466f-8bb6-5b337e566e7f tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:17.234138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60836693-bbf1-466f-8bb6-5b337e566e7f tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:17.234413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60836693-bbf1-466f-8bb6-5b337e566e7f tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:17.242258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60836693-bbf1-466f-8bb6-5b337e566e7f tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:17.243801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60836693-bbf1-466f-8bb6-5b337e566e7f tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:17.298348 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2948/5850] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:17 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:17.298348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2505ba9-a30f-410e-883a-6a93e67dbb86 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:17.298348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2505ba9-a30f-410e-883a-6a93e67dbb86 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:17.298348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2505ba9-a30f-410e-883a-6a93e67dbb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:17.321076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c2505ba9-a30f-410e-883a-6a93e67dbb86 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:17.323091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c2505ba9-a30f-410e-883a-6a93e67dbb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:17.324089 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2903/5851] 10.222.0.76 () {56 vars in 1266 bytes} [Sat Aug 27 04:52:17 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:17.325963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60836693-bbf1-466f-8bb6-5b337e566e7f tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:17.332575 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2949/5852] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:17.333468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2505ba9-a30f-410e-883a-6a93e67dbb86 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:17.340554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60836693-bbf1-466f-8bb6-5b337e566e7f tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:17.346704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2505ba9-a30f-410e-883a-6a93e67dbb86 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:17.348305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc360b2-3575-4a65-ba40-7033b0f4eda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:17.350089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc360b2-3575-4a65-ba40-7033b0f4eda6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:17.354752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc360b2-3575-4a65-ba40-7033b0f4eda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:17.354752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc360b2-3575-4a65-ba40-7033b0f4eda6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:17.354752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc360b2-3575-4a65-ba40-7033b0f4eda6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:17.355242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763c2f5-9e2e-4fb5-aafd-881059db5074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:17.355242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763c2f5-9e2e-4fb5-aafd-881059db5074 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:17.355242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763c2f5-9e2e-4fb5-aafd-881059db5074 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:17.355538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc360b2-3575-4a65-ba40-7033b0f4eda6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:17.355638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763c2f5-9e2e-4fb5-aafd-881059db5074 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:17.355638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763c2f5-9e2e-4fb5-aafd-881059db5074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:17.356960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763c2f5-9e2e-4fb5-aafd-881059db5074 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:17.374389 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2904/5853] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:17.375155 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2950/5854] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:17.376104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc360b2-3575-4a65-ba40-7033b0f4eda6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:17.376301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763c2f5-9e2e-4fb5-aafd-881059db5074 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:17.388825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763c2f5-9e2e-4fb5-aafd-881059db5074 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:17.390492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc360b2-3575-4a65-ba40-7033b0f4eda6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:17.394031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804ff25-99b5-4f4d-87f1-fc8a3499ac8b tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ff5492e3714b6aa286354a74922b06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f09db728c6f44b88ef295e39d22b612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:17.394787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804ff25-99b5-4f4d-87f1-fc8a3499ac8b tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] REQUEST_METHOD: `HEAD` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:17.396235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804ff25-99b5-4f4d-87f1-fc8a3499ac8b tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:17.396639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804ff25-99b5-4f4d-87f1-fc8a3499ac8b tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:17.399115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7804ff25-99b5-4f4d-87f1-fc8a3499ac8b tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:17.402101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025eb20c-cb1e-43a9-83ea-b8415e08ba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:17.402833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025eb20c-cb1e-43a9-83ea-b8415e08ba85 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:17.403214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025eb20c-cb1e-43a9-83ea-b8415e08ba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:17.403602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025eb20c-cb1e-43a9-83ea-b8415e08ba85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:17.404470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025eb20c-cb1e-43a9-83ea-b8415e08ba85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:17.409567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025eb20c-cb1e-43a9-83ea-b8415e08ba85 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:17.433947 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-7804ff25-99b5-4f4d-87f1-fc8a3499ac8b tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 27 04:52:17.433947 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:17.433947 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:52:17.433947 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:52:17.433947 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:52:17.433947 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:52:17.433947 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:52:17.433947 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:52:17.433947 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:52:17.433947 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:52:17.433947 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:52:17.433947 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:52:17.433947 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Aug 27 04:52:17.433947 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Aug 27 04:52:17.433947 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 27 04:52:17.435089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 27 04:52:17.435089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 27 04:52:17.435089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 27 04:52:17.435089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:17.435089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:17.435089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 27 04:52:17.435089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 27 04:52:17.435089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 27 04:52:17.435089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 27 04:52:17.435089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:17.435089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:17.435089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 27 04:52:17.435089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 27 04:52:17.435089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:17.435089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:17.435089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 27 04:52:17.435089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 27 04:52:17.436349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:17.436349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:17.436349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 27 04:52:17.436349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 27 04:52:17.436349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 27 04:52:17.436349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:17.441066 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2905/5855] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:17.441066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025eb20c-cb1e-43a9-83ea-b8415e08ba85 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:17.452187 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2951/5856] 10.222.0.76 () {56 vars in 1264 bytes} [Sat Aug 27 04:52:17 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Aug 27 04:52:17.452187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804ff25-99b5-4f4d-87f1-fc8a3499ac8b tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:17.459154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804ff25-99b5-4f4d-87f1-fc8a3499ac8b tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:17.465652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025eb20c-cb1e-43a9-83ea-b8415e08ba85 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:17.468356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515f7d0-1695-49f3-949d-6559c9672458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:17.470186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515f7d0-1695-49f3-949d-6559c9672458 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:17.471093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515f7d0-1695-49f3-949d-6559c9672458 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:17.471926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515f7d0-1695-49f3-949d-6559c9672458 admin admin] PATH_INFO: `/v3/projects/c013321b51d948d9b93393c29a6452c3/users/30f1beff70e043b8bfc3983291ff1e79/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:17.476390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385004-ada3-4198-a5f9-2e16d3121720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:17.477685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385004-ada3-4198-a5f9-2e16d3121720 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:17.478892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385004-ada3-4198-a5f9-2e16d3121720 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:17.478892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385004-ada3-4198-a5f9-2e16d3121720 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:17.480517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e385004-ada3-4198-a5f9-2e16d3121720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:17.483377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e385004-ada3-4198-a5f9-2e16d3121720 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:17.495965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515f7d0-1695-49f3-949d-6559c9672458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c013321b51d948d9b93393c29a6452c3, user_id=30f1beff70e043b8bfc3983291ff1e79, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:17.500770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515f7d0-1695-49f3-949d-6559c9672458 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:17.504536 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2906/5857] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:17.506455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385004-ada3-4198-a5f9-2e16d3121720 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:17.585604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385004-ada3-4198-a5f9-2e16d3121720 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:17.590095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af63b2-df99-494d-ab7f-082376a69f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:17.590703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af63b2-df99-494d-ab7f-082376a69f17 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:17.590983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af63b2-df99-494d-ab7f-082376a69f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:17.591878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af63b2-df99-494d-ab7f-082376a69f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:17.602384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af63b2-df99-494d-ab7f-082376a69f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:17.603837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af63b2-df99-494d-ab7f-082376a69f17 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:17.616099 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2907/5858] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:17.617048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af63b2-df99-494d-ab7f-082376a69f17 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:17.629386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af63b2-df99-494d-ab7f-082376a69f17 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:17.651306 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2952/5859] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:17 2022] PUT /identity/v3/projects/c013321b51d948d9b93393c29a6452c3/users/30f1beff70e043b8bfc3983291ff1e79/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:17.652499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:17.661156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2dfd3-7bcf-48c2-a03b-61935abbe551 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:17.662818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2dfd3-7bcf-48c2-a03b-61935abbe551 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:17.662818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2dfd3-7bcf-48c2-a03b-61935abbe551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:17.706489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7d381-62c4-4e5c-bd9f-6d92563c23d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:17.707390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7d381-62c4-4e5c-bd9f-6d92563c23d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:17.707745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7d381-62c4-4e5c-bd9f-6d92563c23d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:17.708088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7d381-62c4-4e5c-bd9f-6d92563c23d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:17.708849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7d381-62c4-4e5c-bd9f-6d92563c23d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:17.712087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7d381-62c4-4e5c-bd9f-6d92563c23d5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:17.712876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-32c2dfd3-7bcf-48c2-a03b-61935abbe551 None None] MFA Rules not processed for user `67ff5492e3714b6aa286354a74922b06`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:17.714162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-32c2dfd3-7bcf-48c2-a03b-61935abbe551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:17.724331 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2953/5860] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:17 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:17.730836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2dfd3-7bcf-48c2-a03b-61935abbe551 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:17.730973 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2908/5861] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:17.730973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7d381-62c4-4e5c-bd9f-6d92563c23d5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:17.746109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7d381-62c4-4e5c-bd9f-6d92563c23d5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:17.748326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2dfd3-7bcf-48c2-a03b-61935abbe551 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:17.753745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2691b-7c74-4839-896c-7983fcfe54c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:17.754984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2691b-7c74-4839-896c-7983fcfe54c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:17.755300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2691b-7c74-4839-896c-7983fcfe54c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:17.756228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2691b-7c74-4839-896c-7983fcfe54c3 admin admin] PATH_INFO: `/v3/projects/e33f1e5540984e409e0091e6ae1dd080/users/fb5afdde47ba4b85beff39a0d23d8f25/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:17.762860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a6c84-b075-4704-8b65-7aadeaac5257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:17.764443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a6c84-b075-4704-8b65-7aadeaac5257 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:17.765227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a6c84-b075-4704-8b65-7aadeaac5257 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:17.765866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a6c84-b075-4704-8b65-7aadeaac5257 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:17.767094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a6c84-b075-4704-8b65-7aadeaac5257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:17.769000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a6c84-b075-4704-8b65-7aadeaac5257 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:17.779928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2691b-7c74-4839-896c-7983fcfe54c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33f1e5540984e409e0091e6ae1dd080, user_id=fb5afdde47ba4b85beff39a0d23d8f25, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:17.783781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2691b-7c74-4839-896c-7983fcfe54c3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:17.797658 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2909/5862] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:17.797658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a6c84-b075-4704-8b65-7aadeaac5257 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:17.858764 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2954/5863] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:17 2022] PUT /identity/v3/projects/e33f1e5540984e409e0091e6ae1dd080/users/fb5afdde47ba4b85beff39a0d23d8f25/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:17.860043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2691b-7c74-4839-896c-7983fcfe54c3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:17.896130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a6c84-b075-4704-8b65-7aadeaac5257 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:17.926636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2691b-7c74-4839-896c-7983fcfe54c3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:17.942721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6f167-3e8b-4294-b5ff-bcd60d454056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:17.945405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6f167-3e8b-4294-b5ff-bcd60d454056 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:17.945573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6f167-3e8b-4294-b5ff-bcd60d454056 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:17.947298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6f167-3e8b-4294-b5ff-bcd60d454056 admin admin] PATH_INFO: `/v3/projects/7404cab787d9443cbae839218717bbbd/users/918033297acd4cee941cad78b6e950f5/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:17.976088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6f167-3e8b-4294-b5ff-bcd60d454056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7404cab787d9443cbae839218717bbbd, user_id=918033297acd4cee941cad78b6e950f5, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:17.978873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6f167-3e8b-4294-b5ff-bcd60d454056 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:17.983736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912117c-9e40-4b2e-9368-87d9da21db33 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ff5492e3714b6aa286354a74922b06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f09db728c6f44b88ef295e39d22b612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:17.984624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912117c-9e40-4b2e-9368-87d9da21db33 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:17.984745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912117c-9e40-4b2e-9368-87d9da21db33 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:17.984939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912117c-9e40-4b2e-9368-87d9da21db33 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:17.992761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912117c-9e40-4b2e-9368-87d9da21db33 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:17.994642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912117c-9e40-4b2e-9368-87d9da21db33 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:18.004233 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2910/5864] 10.222.0.76 () {56 vars in 1263 bytes} [Sat Aug 27 04:52:17 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 04:52:18.004233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912117c-9e40-4b2e-9368-87d9da21db33 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:18.014470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912117c-9e40-4b2e-9368-87d9da21db33 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:18.019335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c81a65-a691-4f57-bbaa-07af1b66ba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:18.020057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c81a65-a691-4f57-bbaa-07af1b66ba88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:18.027858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c81a65-a691-4f57-bbaa-07af1b66ba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:18.027858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c81a65-a691-4f57-bbaa-07af1b66ba88 admin admin] PATH_INFO: `/v3/projects/c013321b51d948d9b93393c29a6452c3/users/30f1beff70e043b8bfc3983291ff1e79/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:18.027858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c81a65-a691-4f57-bbaa-07af1b66ba88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c013321b51d948d9b93393c29a6452c3, user_id=30f1beff70e043b8bfc3983291ff1e79, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:18.027858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c81a65-a691-4f57-bbaa-07af1b66ba88 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:18.038133 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2911/5865] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:18 2022] PUT /identity/v3/projects/c013321b51d948d9b93393c29a6452c3/users/30f1beff70e043b8bfc3983291ff1e79/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:18.039508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f207b-241b-45d2-9625-f250ac0d8390 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:18.039873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f207b-241b-45d2-9625-f250ac0d8390 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:18.040244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f207b-241b-45d2-9625-f250ac0d8390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:18.079374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f51f207b-241b-45d2-9625-f250ac0d8390 None None] MFA Rules not processed for user `fb5afdde47ba4b85beff39a0d23d8f25`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:18.080417 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2955/5866] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:17 2022] PUT /identity/v3/projects/7404cab787d9443cbae839218717bbbd/users/918033297acd4cee941cad78b6e950f5/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:18.081156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f51f207b-241b-45d2-9625-f250ac0d8390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:18.090514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6f167-3e8b-4294-b5ff-bcd60d454056 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:18.181041 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2912/5867] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:18.183249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c7b12-26dc-4f9e-ba63-0f74f4fd80a8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:18.183668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c7b12-26dc-4f9e-ba63-0f74f4fd80a8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:18.184377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c7b12-26dc-4f9e-ba63-0f74f4fd80a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:18.196574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6f167-3e8b-4294-b5ff-bcd60d454056 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:18.201659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfde25-1f67-465a-825e-65932db82f41 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ff5492e3714b6aa286354a74922b06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f09db728c6f44b88ef295e39d22b612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:18.202638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfde25-1f67-465a-825e-65932db82f41 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:18.203117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfde25-1f67-465a-825e-65932db82f41 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:18.203563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfde25-1f67-465a-825e-65932db82f41 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:18.212554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfde25-1f67-465a-825e-65932db82f41 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:18.214532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfde25-1f67-465a-825e-65932db82f41 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:18.239353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-493c7b12-26dc-4f9e-ba63-0f74f4fd80a8 None None] MFA Rules not processed for user `30f1beff70e043b8bfc3983291ff1e79`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:18.242761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-493c7b12-26dc-4f9e-ba63-0f74f4fd80a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:18.326026 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2956/5868] 10.222.0.76 () {56 vars in 1266 bytes} [Sat Aug 27 04:52:18 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:18.327989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92457815-c8fc-4a46-91af-ceba25ddf317 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:18.328369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92457815-c8fc-4a46-91af-ceba25ddf317 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:18.328843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92457815-c8fc-4a46-91af-ceba25ddf317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:18.368816 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2913/5869] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:18.373388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c7b12-26dc-4f9e-ba63-0f74f4fd80a8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:18.394492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-92457815-c8fc-4a46-91af-ceba25ddf317 None None] MFA Rules not processed for user `918033297acd4cee941cad78b6e950f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:18.398773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-92457815-c8fc-4a46-91af-ceba25ddf317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:18.446479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:18.498293 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2957/5870] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:18.498293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92457815-c8fc-4a46-91af-ceba25ddf317 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:18.509787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c7b12-26dc-4f9e-ba63-0f74f4fd80a8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:18.515972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92457815-c8fc-4a46-91af-ceba25ddf317 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:18.520352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7b94e-12ce-4b76-bb28-6ae9e661d594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:18.524485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e3dba-c106-4cb5-957b-e0ef4c8434d3 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ff5492e3714b6aa286354a74922b06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f09db728c6f44b88ef295e39d22b612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:18.525358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e3dba-c106-4cb5-957b-e0ef4c8434d3 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:18.525595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7b94e-12ce-4b76-bb28-6ae9e661d594 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:18.525717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e3dba-c106-4cb5-957b-e0ef4c8434d3 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:18.526013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e3dba-c106-4cb5-957b-e0ef4c8434d3 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:18.526708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7b94e-12ce-4b76-bb28-6ae9e661d594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:18.528132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7b94e-12ce-4b76-bb28-6ae9e661d594 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:18.528375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b29e3dba-c106-4cb5-957b-e0ef4c8434d3 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:18.536292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7b94e-12ce-4b76-bb28-6ae9e661d594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:18.536292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7b94e-12ce-4b76-bb28-6ae9e661d594 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:18.559393 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-b29e3dba-c106-4cb5-957b-e0ef4c8434d3 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 27 04:52:18.559393 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:18.559393 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:52:18.559393 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:52:18.559393 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:52:18.559393 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:52:18.559393 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:52:18.559393 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:52:18.559393 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:52:18.559393 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:52:18.559393 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:52:18.559393 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:52:18.559393 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Aug 27 04:52:18.559393 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Aug 27 04:52:18.559393 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 27 04:52:18.560567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 27 04:52:18.560567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 27 04:52:18.560567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 27 04:52:18.560567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:18.560567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:18.560567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 27 04:52:18.560567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 27 04:52:18.560567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 27 04:52:18.560567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 27 04:52:18.560567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:18.560567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:18.560567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 27 04:52:18.560567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 27 04:52:18.560567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:18.560567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:18.560567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 27 04:52:18.560567 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 27 04:52:18.567443 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:18.567443 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:18.567443 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 27 04:52:18.567443 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 27 04:52:18.567443 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 27 04:52:18.567443 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:18.567443 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2958/5871] 10.222.0.76 () {56 vars in 1263 bytes} [Sat Aug 27 04:52:18 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:52:18.567443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e3dba-c106-4cb5-957b-e0ef4c8434d3 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:18.568628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b29e3dba-c106-4cb5-957b-e0ef4c8434d3 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:18.643688 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2914/5872] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:18 2022] POST /identity/v3/projects => generated 367 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:18.644609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7b94e-12ce-4b76-bb28-6ae9e661d594 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:18.652204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-84e7b94e-12ce-4b76-bb28-6ae9e661d594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:18.695611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e3dba-c106-4cb5-957b-e0ef4c8434d3 tempest-TokensV3Test-318038178 tempest-TokensV3Test-318038178-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:18.776570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7b94e-12ce-4b76-bb28-6ae9e661d594 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:18.784986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864a2a2-9a1f-4fa8-aaab-e084d7b18c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:18.787456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864a2a2-9a1f-4fa8-aaab-e084d7b18c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:18.788257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864a2a2-9a1f-4fa8-aaab-e084d7b18c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:18.788631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864a2a2-9a1f-4fa8-aaab-e084d7b18c0d admin admin] PATH_INFO: `/v3/users/67ff5492e3714b6aa286354a74922b06` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:18.792708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864a2a2-9a1f-4fa8-aaab-e084d7b18c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ff5492e3714b6aa286354a74922b06)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:18.795563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864a2a2-9a1f-4fa8-aaab-e084d7b18c0d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:18.807417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b6fb7-d35a-411a-a664-e629fb90123d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:18.808278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b6fb7-d35a-411a-a664-e629fb90123d service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:18.808722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b6fb7-d35a-411a-a664-e629fb90123d service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:18.809155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b6fb7-d35a-411a-a664-e629fb90123d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:18.902726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b6fb7-d35a-411a-a664-e629fb90123d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:18.905519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b6fb7-d35a-411a-a664-e629fb90123d service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:18.920328 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2959/5873] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:18.922113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b6fb7-d35a-411a-a664-e629fb90123d service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:18.947793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b6fb7-d35a-411a-a664-e629fb90123d service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:18.955005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a6478-7e57-4983-bcda-dd96f1655430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:18.956016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a6478-7e57-4983-bcda-dd96f1655430 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:18.959718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a6478-7e57-4983-bcda-dd96f1655430 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:18.959718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a6478-7e57-4983-bcda-dd96f1655430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:19.056797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a6478-7e57-4983-bcda-dd96f1655430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:19.059136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a6478-7e57-4983-bcda-dd96f1655430 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:19.072449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2864a2a2-9a1f-4fa8-aaab-e084d7b18c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ff5492e3714b6aa286354a74922b06'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:19.072996 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2960/5874] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:19.073853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a6478-7e57-4983-bcda-dd96f1655430 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:19.087392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a6478-7e57-4983-bcda-dd96f1655430 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:19.096152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e9d73-b3f4-49fe-a8b6-361b5554e0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:19.096922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e9d73-b3f4-49fe-a8b6-361b5554e0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:19.097299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e9d73-b3f4-49fe-a8b6-361b5554e0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:19.097672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e9d73-b3f4-49fe-a8b6-361b5554e0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:19.098485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e9d73-b3f4-49fe-a8b6-361b5554e0a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:19.102027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e9d73-b3f4-49fe-a8b6-361b5554e0a1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:19.182967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2864a2a2-9a1f-4fa8-aaab-e084d7b18c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ff5492e3714b6aa286354a74922b06'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:19.183932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2864a2a2-9a1f-4fa8-aaab-e084d7b18c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ff5492e3714b6aa286354a74922b06'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:19.195415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2864a2a2-9a1f-4fa8-aaab-e084d7b18c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ff5492e3714b6aa286354a74922b06'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:19.221905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2864a2a2-9a1f-4fa8-aaab-e084d7b18c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ff5492e3714b6aa286354a74922b06'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:19.223188 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2961/5875] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:19 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:19.229453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e9d73-b3f4-49fe-a8b6-361b5554e0a1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:19.230136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-760e9d73-b3f4-49fe-a8b6-361b5554e0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:19.243319 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2915/5876] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:18 2022] DELETE /identity/v3/users/67ff5492e3714b6aa286354a74922b06 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:19.244361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e9d73-b3f4-49fe-a8b6-361b5554e0a1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:19.252294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216710af-b5ea-4db9-a8f7-4cc29b626d70 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:19.252963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216710af-b5ea-4db9-a8f7-4cc29b626d70 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:19.253406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216710af-b5ea-4db9-a8f7-4cc29b626d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:19.285909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-216710af-b5ea-4db9-a8f7-4cc29b626d70 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:19.287165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-216710af-b5ea-4db9-a8f7-4cc29b626d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:19.351463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b5d38-42c0-49e2-8348-3fd270bb5fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:19.352098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b5d38-42c0-49e2-8348-3fd270bb5fdf admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:19.352406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b5d38-42c0-49e2-8348-3fd270bb5fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:19.352684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b5d38-42c0-49e2-8348-3fd270bb5fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:19.353339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b5d38-42c0-49e2-8348-3fd270bb5fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:19.354951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b5d38-42c0-49e2-8348-3fd270bb5fdf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:19.364984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:19.368937 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2916/5877] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:19.372605 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2962/5878] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:19.373480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216710af-b5ea-4db9-a8f7-4cc29b626d70 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:19.389121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216710af-b5ea-4db9-a8f7-4cc29b626d70 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:19.394339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295603b5-677a-45df-b055-e694d28d39cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:19.395146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295603b5-677a-45df-b055-e694d28d39cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:19.395497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295603b5-677a-45df-b055-e694d28d39cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:19.396578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295603b5-677a-45df-b055-e694d28d39cd admin admin] PATH_INFO: `/v3/projects/54efbd5b01ec4261b01f8085dd41adda/users/29061152a40742f58eae6f0acd7fb422/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:19.408406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b5d38-42c0-49e2-8348-3fd270bb5fdf admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:19.410510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-767b5d38-42c0-49e2-8348-3fd270bb5fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:19.416937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295603b5-677a-45df-b055-e694d28d39cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=54efbd5b01ec4261b01f8085dd41adda, user_id=29061152a40742f58eae6f0acd7fb422, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:19.419987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295603b5-677a-45df-b055-e694d28d39cd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:19.503537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b5d38-42c0-49e2-8348-3fd270bb5fdf admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:19.508907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6c545-b148-4b14-bb5c-ec667ee907d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:19.509625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6c545-b148-4b14-bb5c-ec667ee907d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:19.509910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6c545-b148-4b14-bb5c-ec667ee907d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:19.510315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6c545-b148-4b14-bb5c-ec667ee907d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:19.523725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6c545-b148-4b14-bb5c-ec667ee907d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:19.525337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6c545-b148-4b14-bb5c-ec667ee907d2 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:19.543772 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2917/5879] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:19 2022] PUT /identity/v3/projects/54efbd5b01ec4261b01f8085dd41adda/users/29061152a40742f58eae6f0acd7fb422/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:19.546265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295603b5-677a-45df-b055-e694d28d39cd admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:19.551245 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2963/5880] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:19.745584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295603b5-677a-45df-b055-e694d28d39cd admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:19.761652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255d3e3-8aec-4693-9e12-c38d6f93f3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:19.762149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255d3e3-8aec-4693-9e12-c38d6f93f3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:19.762433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255d3e3-8aec-4693-9e12-c38d6f93f3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:19.762643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255d3e3-8aec-4693-9e12-c38d6f93f3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:19.763454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255d3e3-8aec-4693-9e12-c38d6f93f3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:19.765720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255d3e3-8aec-4693-9e12-c38d6f93f3c1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:19.788032 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2918/5881] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:19.788263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6c545-b148-4b14-bb5c-ec667ee907d2 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:19.801229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6c545-b148-4b14-bb5c-ec667ee907d2 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:19.808625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bb502-0591-403a-8cb3-f4025bfb53c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:19.809514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bb502-0591-403a-8cb3-f4025bfb53c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:19.810662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bb502-0591-403a-8cb3-f4025bfb53c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:19.811055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bb502-0591-403a-8cb3-f4025bfb53c6 admin admin] PATH_INFO: `/v3/projects/54efbd5b01ec4261b01f8085dd41adda/users/29061152a40742f58eae6f0acd7fb422/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:19.813553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bb502-0591-403a-8cb3-f4025bfb53c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54efbd5b01ec4261b01f8085dd41adda, user_id=29061152a40742f58eae6f0acd7fb422, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:19.816659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bb502-0591-403a-8cb3-f4025bfb53c6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:19.845029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee3bfb-3df0-40ee-beff-222f27b25bb6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:19.845394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee3bfb-3df0-40ee-beff-222f27b25bb6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:19.846035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee3bfb-3df0-40ee-beff-222f27b25bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:19.848254 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2964/5882] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:19 2022] PUT /identity/v3/projects/54efbd5b01ec4261b01f8085dd41adda/users/29061152a40742f58eae6f0acd7fb422/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:19.885635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-aaee3bfb-3df0-40ee-beff-222f27b25bb6 None None] MFA Rules not processed for user `29061152a40742f58eae6f0acd7fb422`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:19.886865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aaee3bfb-3df0-40ee-beff-222f27b25bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:20.026649 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2919/5883] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:20.029253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bb502-0591-403a-8cb3-f4025bfb53c6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:20.209659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:20.222990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bb502-0591-403a-8cb3-f4025bfb53c6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:20.254763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a7069-8a3f-405a-bf99-8bf78718b9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:20.255983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a7069-8a3f-405a-bf99-8bf78718b9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:20.256282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a7069-8a3f-405a-bf99-8bf78718b9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:20.256562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a7069-8a3f-405a-bf99-8bf78718b9a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:20.257216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a7069-8a3f-405a-bf99-8bf78718b9a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:20.259179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a7069-8a3f-405a-bf99-8bf78718b9a9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:20.397703 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2965/5884] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:20 2022] POST /identity/v3/projects => generated 367 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:20.401384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee3bfb-3df0-40ee-beff-222f27b25bb6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:20.433709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee3bfb-3df0-40ee-beff-222f27b25bb6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:20.573642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec900e01-85d4-4ffd-aa60-69d498922aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:20.573642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec900e01-85d4-4ffd-aa60-69d498922aef admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:20.573642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec900e01-85d4-4ffd-aa60-69d498922aef admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:20.573642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec900e01-85d4-4ffd-aa60-69d498922aef admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:20.574586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec900e01-85d4-4ffd-aa60-69d498922aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:20.574586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec900e01-85d4-4ffd-aa60-69d498922aef admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:20.679446 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2920/5885] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:20 2022] POST /identity/v3/users => generated 284 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:20.683117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a7069-8a3f-405a-bf99-8bf78718b9a9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:20.695369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a7069-8a3f-405a-bf99-8bf78718b9a9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:20.718698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fc054-2172-4686-a52c-c61d8cafd854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:20.718698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fc054-2172-4686-a52c-c61d8cafd854 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:20.718698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fc054-2172-4686-a52c-c61d8cafd854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:20.718698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fc054-2172-4686-a52c-c61d8cafd854 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:20.719123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fc054-2172-4686-a52c-c61d8cafd854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:20.719123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fc054-2172-4686-a52c-c61d8cafd854 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:20.720553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec900e01-85d4-4ffd-aa60-69d498922aef admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:20.728248 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2966/5886] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:20.734784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec900e01-85d4-4ffd-aa60-69d498922aef admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:20.741709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fb409-ff27-4049-8c13-8570dc8b7894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:20.742694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fb409-ff27-4049-8c13-8570dc8b7894 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:20.743147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fb409-ff27-4049-8c13-8570dc8b7894 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:20.745672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fb409-ff27-4049-8c13-8570dc8b7894 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:20.745861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fb409-ff27-4049-8c13-8570dc8b7894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:20.747674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fb409-ff27-4049-8c13-8570dc8b7894 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:20.765292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fc054-2172-4686-a52c-c61d8cafd854 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:20.765999 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2921/5887] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:20.781136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fc054-2172-4686-a52c-c61d8cafd854 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:20.788643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359d279-182c-46eb-8cde-daf343b41f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:20.789616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359d279-182c-46eb-8cde-daf343b41f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:20.790250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359d279-182c-46eb-8cde-daf343b41f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:20.790853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359d279-182c-46eb-8cde-daf343b41f4d admin admin] PATH_INFO: `/v3/projects/47999f37f7a0473384cfa64fdfa0bfe7/users/109ba43ad7b24d83aa375673d0a08816/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:20.811577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359d279-182c-46eb-8cde-daf343b41f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=47999f37f7a0473384cfa64fdfa0bfe7, user_id=109ba43ad7b24d83aa375673d0a08816, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:20.816919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359d279-182c-46eb-8cde-daf343b41f4d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:20.918521 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2967/5888] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:20 2022] PUT /identity/v3/projects/47999f37f7a0473384cfa64fdfa0bfe7/users/109ba43ad7b24d83aa375673d0a08816/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:20.922776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773990e4-3c5d-471c-ae98-4f3556c56f8a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:20.923350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773990e4-3c5d-471c-ae98-4f3556c56f8a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:20.923849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773990e4-3c5d-471c-ae98-4f3556c56f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:20.971260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-773990e4-3c5d-471c-ae98-4f3556c56f8a None None] MFA Rules not processed for user `109ba43ad7b24d83aa375673d0a08816`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:20.972916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-773990e4-3c5d-471c-ae98-4f3556c56f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:21.137092 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2922/5889] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:52:21.141728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359d279-182c-46eb-8cde-daf343b41f4d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:21.207453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773990e4-3c5d-471c-ae98-4f3556c56f8a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:21.209910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-773990e4-3c5d-471c-ae98-4f3556c56f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:21.283609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359d279-182c-46eb-8cde-daf343b41f4d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:21.311353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c80b81-6595-42cd-b7b2-7796e303497a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:21.312346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c80b81-6595-42cd-b7b2-7796e303497a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:21.312691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c80b81-6595-42cd-b7b2-7796e303497a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:21.313070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c80b81-6595-42cd-b7b2-7796e303497a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:21.314179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c80b81-6595-42cd-b7b2-7796e303497a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:21.319879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c80b81-6595-42cd-b7b2-7796e303497a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:21.359969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:21.378546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773990e4-3c5d-471c-ae98-4f3556c56f8a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:21.392962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd80cdf-8c4f-4d4e-b3a6-cd71db9236b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:21.392962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd80cdf-8c4f-4d4e-b3a6-cd71db9236b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:21.392962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd80cdf-8c4f-4d4e-b3a6-cd71db9236b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:21.393259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd80cdf-8c4f-4d4e-b3a6-cd71db9236b5 admin admin] PATH_INFO: `/v3/projects/8f09db728c6f44b88ef295e39d22b612` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:21.396991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd80cdf-8c4f-4d4e-b3a6-cd71db9236b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f09db728c6f44b88ef295e39d22b612)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:21.398964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd80cdf-8c4f-4d4e-b3a6-cd71db9236b5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:21.437301 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2968/5890] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:52:21 2022] POST /identity/v3/domains => generated 274 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:21.438824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c80b81-6595-42cd-b7b2-7796e303497a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:21.564648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-abd80cdf-8c4f-4d4e-b3a6-cd71db9236b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f09db728c6f44b88ef295e39d22b612', 'request_id': 'req-abd80cdf-8c4f-4d4e-b3a6-cd71db9236b5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:21.582255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-abd80cdf-8c4f-4d4e-b3a6-cd71db9236b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f09db728c6f44b88ef295e39d22b612', 'request_id': 'req-abd80cdf-8c4f-4d4e-b3a6-cd71db9236b5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:21.587362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:21.598695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-abd80cdf-8c4f-4d4e-b3a6-cd71db9236b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f09db728c6f44b88ef295e39d22b612', 'request_id': 'req-abd80cdf-8c4f-4d4e-b3a6-cd71db9236b5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:21.627109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c80b81-6595-42cd-b7b2-7796e303497a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:21.689124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-abd80cdf-8c4f-4d4e-b3a6-cd71db9236b5 admin admin] The token cache is being invalidate because project 8f09db728c6f44b88ef295e39d22b612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:21.689556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-abd80cdf-8c4f-4d4e-b3a6-cd71db9236b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:21.691923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-abd80cdf-8c4f-4d4e-b3a6-cd71db9236b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:21.698284 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2923/5891] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:21 2022] DELETE /identity/v3/projects/8f09db728c6f44b88ef295e39d22b612 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:52:21.699913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f1942-5550-4e3e-9218-cf4ba887b186 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:21.701881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f1942-5550-4e3e-9218-cf4ba887b186 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:21.702194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f1942-5550-4e3e-9218-cf4ba887b186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:21.750936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e16f1942-5550-4e3e-9218-cf4ba887b186 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:21.753083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e16f1942-5550-4e3e-9218-cf4ba887b186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:21.758738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de0d6b-b6cf-4771-8371-a78be64a9e12 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:21.760832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de0d6b-b6cf-4771-8371-a78be64a9e12 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:21.761396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de0d6b-b6cf-4771-8371-a78be64a9e12 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:21.762203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de0d6b-b6cf-4771-8371-a78be64a9e12 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:21.763347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de0d6b-b6cf-4771-8371-a78be64a9e12 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:21.765585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de0d6b-b6cf-4771-8371-a78be64a9e12 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:21.856787 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2969/5892] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:52:21 2022] POST /identity/v3/roles => generated 240 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:21.858035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de0d6b-b6cf-4771-8371-a78be64a9e12 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:21.862095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-08de0d6b-b6cf-4771-8371-a78be64a9e12 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:21.894812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de0d6b-b6cf-4771-8371-a78be64a9e12 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:21.903802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f12c0-843c-4091-aad2-0530fd25726f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:21.904896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f12c0-843c-4091-aad2-0530fd25726f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:21.905430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f12c0-843c-4091-aad2-0530fd25726f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:21.905928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f12c0-843c-4091-aad2-0530fd25726f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/4a6dc22c0a6b4291b4aa4c6274196a48/users/109ba43ad7b24d83aa375673d0a08816/roles/ad4ce09d0463494092430a3ffe9bef15` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:21.929402 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2924/5893] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:21.934088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6bddb-f0b1-4c25-95c7-cbdbbff4b4e2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:21.941184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6bddb-f0b1-4c25-95c7-cbdbbff4b4e2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:21.941184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6bddb-f0b1-4c25-95c7-cbdbbff4b4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:21.956748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f12c0-843c-4091-aad2-0530fd25726f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=4a6dc22c0a6b4291b4aa4c6274196a48, user_id=109ba43ad7b24d83aa375673d0a08816, role_id=ad4ce09d0463494092430a3ffe9bef15)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:21.961604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f12c0-843c-4091-aad2-0530fd25726f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:21.992392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-55d6bddb-f0b1-4c25-95c7-cbdbbff4b4e2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:21.994020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-55d6bddb-f0b1-4c25-95c7-cbdbbff4b4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:22.016533 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2925/5894] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:52:22.020690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6bddb-f0b1-4c25-95c7-cbdbbff4b4e2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:22.041608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6bddb-f0b1-4c25-95c7-cbdbbff4b4e2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:22.055922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e48c4-be78-4856-ab6b-d5b8b64b9ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:22.057754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e48c4-be78-4856-ab6b-d5b8b64b9ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:22.058262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e48c4-be78-4856-ab6b-d5b8b64b9ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:22.058798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e48c4-be78-4856-ab6b-d5b8b64b9ad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:22.059715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e48c4-be78-4856-ab6b-d5b8b64b9ad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:22.060958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e48c4-be78-4856-ab6b-d5b8b64b9ad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:22.064595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e48c4-be78-4856-ab6b-d5b8b64b9ad3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:22.093020 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2926/5895] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:52:22.095109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e48c4-be78-4856-ab6b-d5b8b64b9ad3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:22.107566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e48c4-be78-4856-ab6b-d5b8b64b9ad3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:22.112834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea5f0a-e951-42a0-b795-950a0f6d9b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:22.113577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea5f0a-e951-42a0-b795-950a0f6d9b92 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:22.113923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea5f0a-e951-42a0-b795-950a0f6d9b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:22.115454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea5f0a-e951-42a0-b795-950a0f6d9b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:22.116230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea5f0a-e951-42a0-b795-950a0f6d9b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:22.118375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea5f0a-e951-42a0-b795-950a0f6d9b92 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:22.139225 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2970/5896] 10.222.0.76 () {60 vars in 1480 bytes} [Sat Aug 27 04:52:21 2022] PUT /identity/v3/domains/4a6dc22c0a6b4291b4aa4c6274196a48/users/109ba43ad7b24d83aa375673d0a08816/roles/ad4ce09d0463494092430a3ffe9bef15 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:22.140191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f12c0-843c-4091-aad2-0530fd25726f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:22.261461 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2927/5897] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:22 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:22.262908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea5f0a-e951-42a0-b795-950a0f6d9b92 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:22.308365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:22.317728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f12c0-843c-4091-aad2-0530fd25726f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:22.371501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:22.467869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea5f0a-e951-42a0-b795-950a0f6d9b92 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:22.479000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2eb8a-c236-4528-9e70-6603624737fe tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:22.480008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2eb8a-c236-4528-9e70-6603624737fe tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:22.482552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2eb8a-c236-4528-9e70-6603624737fe tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:22.482987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524d340-5681-4432-bdcc-dfa296223bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:22.483334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2eb8a-c236-4528-9e70-6603624737fe tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:22.483604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524d340-5681-4432-bdcc-dfa296223bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:22.483882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524d340-5681-4432-bdcc-dfa296223bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:22.484153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524d340-5681-4432-bdcc-dfa296223bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:22.484871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524d340-5681-4432-bdcc-dfa296223bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:22.485368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2eb8a-c236-4528-9e70-6603624737fe tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:22.488018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524d340-5681-4432-bdcc-dfa296223bd6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:22.490702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2eb8a-c236-4528-9e70-6603624737fe tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:22.605126 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2971/5898] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:52:22 2022] POST /identity/v3/domains => generated 277 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:22.606235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2eb8a-c236-4528-9e70-6603624737fe tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:22.617615 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2928/5899] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:22 2022] POST /identity/v3/users => generated 287 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:22.619169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524d340-5681-4432-bdcc-dfa296223bd6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:22.644453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524d340-5681-4432-bdcc-dfa296223bd6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:22.747026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2eb8a-c236-4528-9e70-6603624737fe tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:22.759995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efdf57-aab7-45ae-9950-0c609cf6a459 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:22.761227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efdf57-aab7-45ae-9950-0c609cf6a459 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:22.761400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efdf57-aab7-45ae-9950-0c609cf6a459 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:22.761579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efdf57-aab7-45ae-9950-0c609cf6a459 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:22.762264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efdf57-aab7-45ae-9950-0c609cf6a459 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:22.764329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efdf57-aab7-45ae-9950-0c609cf6a459 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:22.799287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eea020-0eb4-4c0b-b6fe-52aaef80f4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:22.799923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eea020-0eb4-4c0b-b6fe-52aaef80f4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:22.800396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eea020-0eb4-4c0b-b6fe-52aaef80f4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:22.800668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eea020-0eb4-4c0b-b6fe-52aaef80f4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:22.801322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eea020-0eb4-4c0b-b6fe-52aaef80f4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:22.805531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eea020-0eb4-4c0b-b6fe-52aaef80f4f4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:22.841341 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2929/5900] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:22 2022] GET /identity/v3/roles => generated 1651 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:52:22.842385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eea020-0eb4-4c0b-b6fe-52aaef80f4f4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:22.867195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eea020-0eb4-4c0b-b6fe-52aaef80f4f4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:22.882756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ea7cd-1462-4b95-9091-c1c034d28893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:22.883601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ea7cd-1462-4b95-9091-c1c034d28893 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:22.883601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ea7cd-1462-4b95-9091-c1c034d28893 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:22.883899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ea7cd-1462-4b95-9091-c1c034d28893 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:22.884381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ea7cd-1462-4b95-9091-c1c034d28893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:22.888230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ea7cd-1462-4b95-9091-c1c034d28893 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:22.914586 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2972/5901] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:52:22 2022] POST /identity/v3/roles => generated 240 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:52:22.915556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efdf57-aab7-45ae-9950-0c609cf6a459 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:22.924384 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2930/5902] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:22 2022] GET /identity/v3/roles => generated 1651 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:22.929093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ea7cd-1462-4b95-9091-c1c034d28893 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:22.938984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efdf57-aab7-45ae-9950-0c609cf6a459 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:22.948355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68980d-03d6-45e9-9e55-6dcc0edcb4bd tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:22.948996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68980d-03d6-45e9-9e55-6dcc0edcb4bd tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:22.949271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68980d-03d6-45e9-9e55-6dcc0edcb4bd tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:22.949547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68980d-03d6-45e9-9e55-6dcc0edcb4bd tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/groups` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:22.949999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ea7cd-1462-4b95-9091-c1c034d28893 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:22.950182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68980d-03d6-45e9-9e55-6dcc0edcb4bd tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:22.955376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68980d-03d6-45e9-9e55-6dcc0edcb4bd tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:22.969382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b2c80-7d4b-4959-ab6b-d44e4eccb0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:22.969938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b2c80-7d4b-4959-ab6b-d44e4eccb0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:22.970249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b2c80-7d4b-4959-ab6b-d44e4eccb0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:22.970524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b2c80-7d4b-4959-ab6b-d44e4eccb0b4 admin admin] PATH_INFO: `/v3/projects/68be995ca5614f189b5052f4462e8b09/users/cd780010f84d405a96bd5d9a2efd9285/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:23.022922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b2c80-7d4b-4959-ab6b-d44e4eccb0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68be995ca5614f189b5052f4462e8b09, user_id=cd780010f84d405a96bd5d9a2efd9285, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:23.030883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b2c80-7d4b-4959-ab6b-d44e4eccb0b4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:23.073655 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2973/5903] 10.222.0.76 () {60 vars in 1147 bytes} [Sat Aug 27 04:52:22 2022] POST /identity/v3/groups => generated 326 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:23.075172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68980d-03d6-45e9-9e55-6dcc0edcb4bd tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:23.100142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68980d-03d6-45e9-9e55-6dcc0edcb4bd tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:23.105199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139d102-4f46-4300-b87d-f38b93e335ed tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:23.105975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d102-4f46-4300-b87d-f38b93e335ed tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:23.106420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d102-4f46-4300-b87d-f38b93e335ed tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:23.106793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d102-4f46-4300-b87d-f38b93e335ed tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/groups/3b3e71afe96142c3b0106705bc3f17c1/users/109ba43ad7b24d83aa375673d0a08816` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:23.121127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139d102-4f46-4300-b87d-f38b93e335ed tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=3b3e71afe96142c3b0106705bc3f17c1, user_id=109ba43ad7b24d83aa375673d0a08816)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:23.123170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139d102-4f46-4300-b87d-f38b93e335ed tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:23.161604 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2931/5904] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:22 2022] PUT /identity/v3/projects/68be995ca5614f189b5052f4462e8b09/users/cd780010f84d405a96bd5d9a2efd9285/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:23.179712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c41d9-aed3-434d-8ed2-252b755db456 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:23.180365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c41d9-aed3-434d-8ed2-252b755db456 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:23.180365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c41d9-aed3-434d-8ed2-252b755db456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:23.240881 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2974/5905] 10.222.0.76 () {60 vars in 1360 bytes} [Sat Aug 27 04:52:23 2022] PUT /identity/v3/groups/3b3e71afe96142c3b0106705bc3f17c1/users/109ba43ad7b24d83aa375673d0a08816 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:23.243629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139d102-4f46-4300-b87d-f38b93e335ed tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:23.262011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f81c41d9-aed3-434d-8ed2-252b755db456 None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:23.263541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f81c41d9-aed3-434d-8ed2-252b755db456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:23.449266 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2932/5906] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:23.450721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c41d9-aed3-434d-8ed2-252b755db456 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:23.457247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139d102-4f46-4300-b87d-f38b93e335ed tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:23.465617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b68f86-62af-4f50-8d0c-09fa8ab24f43 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:23.466369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b68f86-62af-4f50-8d0c-09fa8ab24f43 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:23.466660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b68f86-62af-4f50-8d0c-09fa8ab24f43 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:23.471192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b68f86-62af-4f50-8d0c-09fa8ab24f43 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/68f44c39b4b948829a9b10b82f4506fb/groups/3b3e71afe96142c3b0106705bc3f17c1/roles/21ef2ec07b1a4eab96d2559917729ee7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:23.476000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b68f86-62af-4f50-8d0c-09fa8ab24f43 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=68f44c39b4b948829a9b10b82f4506fb, group_id=3b3e71afe96142c3b0106705bc3f17c1, role_id=21ef2ec07b1a4eab96d2559917729ee7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:23.486062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b68f86-62af-4f50-8d0c-09fa8ab24f43 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:23.500898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c41d9-aed3-434d-8ed2-252b755db456 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:23.547655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066cc7f-0047-4c93-bd3f-0647d88509ad tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd780010f84d405a96bd5d9a2efd9285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68be995ca5614f189b5052f4462e8b09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:23.552258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066cc7f-0047-4c93-bd3f-0647d88509ad tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:23.552258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066cc7f-0047-4c93-bd3f-0647d88509ad tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:23.552258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066cc7f-0047-4c93-bd3f-0647d88509ad tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] PATH_INFO: `/v3/users/cd780010f84d405a96bd5d9a2efd9285/password` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:23.583169 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2975/5907] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:23 2022] PUT /identity/v3/domains/68f44c39b4b948829a9b10b82f4506fb/groups/3b3e71afe96142c3b0106705bc3f17c1/roles/21ef2ec07b1a4eab96d2559917729ee7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:23.590581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b68f86-62af-4f50-8d0c-09fa8ab24f43 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:23.715505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0066cc7f-0047-4c93-bd3f-0647d88509ad tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cd780010f84d405a96bd5d9a2efd9285'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:23.777661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b68f86-62af-4f50-8d0c-09fa8ab24f43 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:23.802892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f760e87-c83c-4b54-95ac-6f0da98eff14 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:23.803970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f760e87-c83c-4b54-95ac-6f0da98eff14 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:23.804579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f760e87-c83c-4b54-95ac-6f0da98eff14 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:23.804910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f760e87-c83c-4b54-95ac-6f0da98eff14 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:23.805605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f760e87-c83c-4b54-95ac-6f0da98eff14 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:23.807221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f760e87-c83c-4b54-95ac-6f0da98eff14 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:23.810275 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2933/5908] 10.222.0.76 () {60 vars in 1269 bytes} [Sat Aug 27 04:52:23 2022] POST /identity/v3/users/cd780010f84d405a96bd5d9a2efd9285/password => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:23.895228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066cc7f-0047-4c93-bd3f-0647d88509ad tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:23.897651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0066cc7f-0047-4c93-bd3f-0647d88509ad tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:23.958888 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2976/5909] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:52:23 2022] POST /identity/v3/domains => generated 276 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:23.964604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f760e87-c83c-4b54-95ac-6f0da98eff14 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:24.037504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:24.058958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:24.076751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066cc7f-0047-4c93-bd3f-0647d88509ad tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:24.135224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f760e87-c83c-4b54-95ac-6f0da98eff14 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:24.145341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30f365-d9ec-4e44-99d9-4a3708757933 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:24.146029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30f365-d9ec-4e44-99d9-4a3708757933 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:24.146314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30f365-d9ec-4e44-99d9-4a3708757933 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:24.146801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30f365-d9ec-4e44-99d9-4a3708757933 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:24.147389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30f365-d9ec-4e44-99d9-4a3708757933 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:24.152154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30f365-d9ec-4e44-99d9-4a3708757933 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:24.200816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d5079-6744-4107-ae79-90503ac24974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:24.201843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d5079-6744-4107-ae79-90503ac24974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:24.202342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d5079-6744-4107-ae79-90503ac24974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:24.202795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d5079-6744-4107-ae79-90503ac24974 admin admin] PATH_INFO: `/v3/users/5f36f07947784bcdbdb6051d6dca1659` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:24.204479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d5079-6744-4107-ae79-90503ac24974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f36f07947784bcdbdb6051d6dca1659)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:24.207452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d5079-6744-4107-ae79-90503ac24974 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:24.249914 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2977/5910] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:52:23 2022] POST /identity/v3/roles => generated 240 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:24.260679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30f365-d9ec-4e44-99d9-4a3708757933 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:24.288562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30f365-d9ec-4e44-99d9-4a3708757933 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:24.295454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572ab3d-ae9e-4ab7-bc23-a5bd6ea1bf43 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:24.299987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572ab3d-ae9e-4ab7-bc23-a5bd6ea1bf43 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:24.299987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572ab3d-ae9e-4ab7-bc23-a5bd6ea1bf43 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:24.299987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572ab3d-ae9e-4ab7-bc23-a5bd6ea1bf43 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/1e8d1efcfbc145fdb9c606927c89f560/users/109ba43ad7b24d83aa375673d0a08816/roles/c52e9a2553944b78bc03a025b24df8eb` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:24.312787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572ab3d-ae9e-4ab7-bc23-a5bd6ea1bf43 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=1e8d1efcfbc145fdb9c606927c89f560, user_id=109ba43ad7b24d83aa375673d0a08816, role_id=c52e9a2553944b78bc03a025b24df8eb)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:24.316469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572ab3d-ae9e-4ab7-bc23-a5bd6ea1bf43 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:24.452318 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2978/5911] 10.222.0.76 () {60 vars in 1480 bytes} [Sat Aug 27 04:52:24 2022] PUT /identity/v3/domains/1e8d1efcfbc145fdb9c606927c89f560/users/109ba43ad7b24d83aa375673d0a08816/roles/c52e9a2553944b78bc03a025b24df8eb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:24.455712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572ab3d-ae9e-4ab7-bc23-a5bd6ea1bf43 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:24.564078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ae7d5079-6744-4107-ae79-90503ac24974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f36f07947784bcdbdb6051d6dca1659'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:24.577141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572ab3d-ae9e-4ab7-bc23-a5bd6ea1bf43 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:24.586222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651136bf-d7b4-4751-932a-427a39584414 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:24.587016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651136bf-d7b4-4751-932a-427a39584414 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:24.590278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651136bf-d7b4-4751-932a-427a39584414 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:24.590278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651136bf-d7b4-4751-932a-427a39584414 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:24.590278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651136bf-d7b4-4751-932a-427a39584414 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:24.590637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651136bf-d7b4-4751-932a-427a39584414 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:24.678561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ae7d5079-6744-4107-ae79-90503ac24974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f36f07947784bcdbdb6051d6dca1659'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:24.679504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ae7d5079-6744-4107-ae79-90503ac24974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f36f07947784bcdbdb6051d6dca1659'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:24.695420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ae7d5079-6744-4107-ae79-90503ac24974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f36f07947784bcdbdb6051d6dca1659'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:24.711279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ae7d5079-6744-4107-ae79-90503ac24974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f36f07947784bcdbdb6051d6dca1659'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:24.724352 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2934/5912] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:23 2022] DELETE /identity/v3/users/5f36f07947784bcdbdb6051d6dca1659 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:52:24.732004 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2979/5913] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:52:24 2022] POST /identity/v3/domains => generated 277 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:52:24.736332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d5079-6744-4107-ae79-90503ac24974 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:24.738198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ae7d5079-6744-4107-ae79-90503ac24974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:24.816095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812f303-5e1d-44cd-936a-e1303094f756 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:24.816485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812f303-5e1d-44cd-936a-e1303094f756 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:24.816759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812f303-5e1d-44cd-936a-e1303094f756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:24.843555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d5079-6744-4107-ae79-90503ac24974 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:24.852283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d812f303-5e1d-44cd-936a-e1303094f756 None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:24.854487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d812f303-5e1d-44cd-936a-e1303094f756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:24.866586 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2980/5914] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:24 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:52:24.872147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812f303-5e1d-44cd-936a-e1303094f756 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:24.872147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d812f303-5e1d-44cd-936a-e1303094f756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:24.931735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf025f89-7c5a-43f9-bbad-2b81360bdc53 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:24.932998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf025f89-7c5a-43f9-bbad-2b81360bdc53 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:24.933291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf025f89-7c5a-43f9-bbad-2b81360bdc53 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:24.933683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf025f89-7c5a-43f9-bbad-2b81360bdc53 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:24.934370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf025f89-7c5a-43f9-bbad-2b81360bdc53 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:24.936683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf025f89-7c5a-43f9-bbad-2b81360bdc53 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:24.969944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812f303-5e1d-44cd-936a-e1303094f756 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:24.975575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196346fd-4b8c-47bf-9cc9-b01503a41f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:24.977641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196346fd-4b8c-47bf-9cc9-b01503a41f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:24.977641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196346fd-4b8c-47bf-9cc9-b01503a41f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:24.977641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196346fd-4b8c-47bf-9cc9-b01503a41f02 admin admin] PATH_INFO: `/v3/users/eace64b8e2ba4f36a1938ba7c70ce317` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:24.978073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196346fd-4b8c-47bf-9cc9-b01503a41f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eace64b8e2ba4f36a1938ba7c70ce317)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:24.979943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196346fd-4b8c-47bf-9cc9-b01503a41f02 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:25.043488 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2935/5915] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:52:24 2022] POST /identity/v3/roles => generated 240 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:52:25.045151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ef20d-9e05-4d31-a7fb-c495fcb66654 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:25.045579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ef20d-9e05-4d31-a7fb-c495fcb66654 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:25.045940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ef20d-9e05-4d31-a7fb-c495fcb66654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:25.074803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-cc8ef20d-9e05-4d31-a7fb-c495fcb66654 None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:25.076396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cc8ef20d-9e05-4d31-a7fb-c495fcb66654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:25.165712 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2936/5916] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:25.165712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ef20d-9e05-4d31-a7fb-c495fcb66654 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:25.180719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ef20d-9e05-4d31-a7fb-c495fcb66654 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:25.188731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca01d21-b2af-4e15-95c0-903fca367368 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:25.189907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca01d21-b2af-4e15-95c0-903fca367368 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:25.189907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca01d21-b2af-4e15-95c0-903fca367368 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:25.190168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca01d21-b2af-4e15-95c0-903fca367368 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/groups` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:25.190792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca01d21-b2af-4e15-95c0-903fca367368 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:25.195129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca01d21-b2af-4e15-95c0-903fca367368 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:25.223259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:25.289774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-196346fd-4b8c-47bf-9cc9-b01503a41f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eace64b8e2ba4f36a1938ba7c70ce317'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:25.290667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-196346fd-4b8c-47bf-9cc9-b01503a41f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eace64b8e2ba4f36a1938ba7c70ce317'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:25.365719 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2937/5917] 10.222.0.76 () {60 vars in 1147 bytes} [Sat Aug 27 04:52:25 2022] POST /identity/v3/groups => generated 326 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:25.365953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca01d21-b2af-4e15-95c0-903fca367368 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:25.387126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca01d21-b2af-4e15-95c0-903fca367368 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:25.392924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a463c3-0ede-4d3c-bd37-be6e5accdd45 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd780010f84d405a96bd5d9a2efd9285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68be995ca5614f189b5052f4462e8b09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:25.393648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a463c3-0ede-4d3c-bd37-be6e5accdd45 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:25.393940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a463c3-0ede-4d3c-bd37-be6e5accdd45 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:25.396413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a463c3-0ede-4d3c-bd37-be6e5accdd45 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] PATH_INFO: `/v3/users/cd780010f84d405a96bd5d9a2efd9285/password` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:25.402204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-196346fd-4b8c-47bf-9cc9-b01503a41f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eace64b8e2ba4f36a1938ba7c70ce317'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:25.404257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-196346fd-4b8c-47bf-9cc9-b01503a41f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eace64b8e2ba4f36a1938ba7c70ce317'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:25.442046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-196346fd-4b8c-47bf-9cc9-b01503a41f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eace64b8e2ba4f36a1938ba7c70ce317'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:25.468003 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2981/5918] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:24 2022] DELETE /identity/v3/users/eace64b8e2ba4f36a1938ba7c70ce317 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:25.469040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196346fd-4b8c-47bf-9cc9-b01503a41f02 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:25.470602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-196346fd-4b8c-47bf-9cc9-b01503a41f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:25.472684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-78a463c3-0ede-4d3c-bd37-be6e5accdd45 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 27 04:52:25.472684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:25.472684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:52:25.472684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:52:25.472684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:52:25.472684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:52:25.472684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:52:25.472684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:52:25.472684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:52:25.472684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:52:25.472684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:52:25.472684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:52:25.472684 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:52:25.473904 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:52:25.473904 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 27 04:52:25.473904 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 27 04:52:25.473904 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:25.473904 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:25.473904 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:52:25.473904 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:52:25.473904 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 27 04:52:25.473904 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 27 04:52:25.473904 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 27 04:52:25.473904 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 27 04:52:25.473904 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 27 04:52:25.473904 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 27 04:52:25.473904 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 27 04:52:25.473904 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:52:25.485332 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2938/5919] 10.222.0.76 () {60 vars in 1269 bytes} [Sat Aug 27 04:52:25 2022] POST /identity/v3/users/cd780010f84d405a96bd5d9a2efd9285/password => generated 188 bytes in 120 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:52:25.486770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a463c3-0ede-4d3c-bd37-be6e5accdd45 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:25.488732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-78a463c3-0ede-4d3c-bd37-be6e5accdd45 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:25.510273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a463c3-0ede-4d3c-bd37-be6e5accdd45 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:25.590814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196346fd-4b8c-47bf-9cc9-b01503a41f02 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:25.602906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0690183-df7f-4c03-83d2-3307aad00797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:25.604549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0690183-df7f-4c03-83d2-3307aad00797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:25.604900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0690183-df7f-4c03-83d2-3307aad00797 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:25.605607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0690183-df7f-4c03-83d2-3307aad00797 admin admin] PATH_INFO: `/v3/projects/74bc85d80bc74ecdb98a7df6b8af1ebd` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:25.606932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0690183-df7f-4c03-83d2-3307aad00797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74bc85d80bc74ecdb98a7df6b8af1ebd)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:25.611105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0690183-df7f-4c03-83d2-3307aad00797 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:25.633235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532b69a-36fe-4853-9997-79677b9f5d67 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:25.634003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532b69a-36fe-4853-9997-79677b9f5d67 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:25.634393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532b69a-36fe-4853-9997-79677b9f5d67 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:25.634717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532b69a-36fe-4853-9997-79677b9f5d67 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/groups/54a2edc03c5045279398c95c306e8600/users/109ba43ad7b24d83aa375673d0a08816` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:25.641399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532b69a-36fe-4853-9997-79677b9f5d67 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=54a2edc03c5045279398c95c306e8600, user_id=109ba43ad7b24d83aa375673d0a08816)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:25.643675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532b69a-36fe-4853-9997-79677b9f5d67 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:25.769514 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2939/5920] 10.222.0.76 () {60 vars in 1360 bytes} [Sat Aug 27 04:52:25 2022] PUT /identity/v3/groups/54a2edc03c5045279398c95c306e8600/users/109ba43ad7b24d83aa375673d0a08816 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:25.769514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee030ae4-716c-4642-a137-b126083d447b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:25.769514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee030ae4-716c-4642-a137-b126083d447b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:25.769514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee030ae4-716c-4642-a137-b126083d447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:25.817009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d0690183-df7f-4c03-83d2-3307aad00797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74bc85d80bc74ecdb98a7df6b8af1ebd', 'request_id': 'req-d0690183-df7f-4c03-83d2-3307aad00797'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:25.818577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ee030ae4-716c-4642-a137-b126083d447b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:25.819923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ee030ae4-716c-4642-a137-b126083d447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:25.834965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d0690183-df7f-4c03-83d2-3307aad00797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74bc85d80bc74ecdb98a7df6b8af1ebd', 'request_id': 'req-d0690183-df7f-4c03-83d2-3307aad00797'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:25.890966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:25.947983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d0690183-df7f-4c03-83d2-3307aad00797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74bc85d80bc74ecdb98a7df6b8af1ebd', 'request_id': 'req-d0690183-df7f-4c03-83d2-3307aad00797'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:25.974300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d0690183-df7f-4c03-83d2-3307aad00797 admin admin] The token cache is being invalidate because project 74bc85d80bc74ecdb98a7df6b8af1ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:25.975808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d0690183-df7f-4c03-83d2-3307aad00797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:25.984625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d0690183-df7f-4c03-83d2-3307aad00797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:25.989721 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2982/5921] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:25 2022] DELETE /identity/v3/projects/74bc85d80bc74ecdb98a7df6b8af1ebd => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:25.991428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0690183-df7f-4c03-83d2-3307aad00797 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:25.998954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d0690183-df7f-4c03-83d2-3307aad00797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:26.009669 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2940/5922] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:26.018805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee030ae4-716c-4642-a137-b126083d447b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:26.023314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ee030ae4-716c-4642-a137-b126083d447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:26.171803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee030ae4-716c-4642-a137-b126083d447b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:26.177945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa687051-8f86-4e4f-8aef-a04a8f6b0b54 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:26.183822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa687051-8f86-4e4f-8aef-a04a8f6b0b54 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:26.183822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa687051-8f86-4e4f-8aef-a04a8f6b0b54 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:26.183822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa687051-8f86-4e4f-8aef-a04a8f6b0b54 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/68b4e6cbfebe4df69e0b855f024462be/groups/54a2edc03c5045279398c95c306e8600/roles/02e6c16c9c3f417ca592222ec720391b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:26.183822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa687051-8f86-4e4f-8aef-a04a8f6b0b54 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=68b4e6cbfebe4df69e0b855f024462be, group_id=54a2edc03c5045279398c95c306e8600, role_id=02e6c16c9c3f417ca592222ec720391b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:26.185467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa687051-8f86-4e4f-8aef-a04a8f6b0b54 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:26.208507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0690183-df7f-4c03-83d2-3307aad00797 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:26.213272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0150f-3f82-4648-85c0-6824c7212b06 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd780010f84d405a96bd5d9a2efd9285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68be995ca5614f189b5052f4462e8b09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:26.213965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0150f-3f82-4648-85c0-6824c7212b06 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:26.214429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0150f-3f82-4648-85c0-6824c7212b06 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:26.214710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0150f-3f82-4648-85c0-6824c7212b06 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] PATH_INFO: `/v3/users/cd780010f84d405a96bd5d9a2efd9285/password` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:26.270077 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2941/5923] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:26 2022] PUT /identity/v3/domains/68b4e6cbfebe4df69e0b855f024462be/groups/54a2edc03c5045279398c95c306e8600/roles/02e6c16c9c3f417ca592222ec720391b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:26.272386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfab9e-f32e-4592-8b15-f2842792733e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:26.272952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfab9e-f32e-4592-8b15-f2842792733e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:26.273437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfab9e-f32e-4592-8b15-f2842792733e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:26.289064 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-21b0150f-3f82-4648-85c0-6824c7212b06 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 27 04:52:26.289064 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:26.289064 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:52:26.289064 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:52:26.289064 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:52:26.289064 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:52:26.289064 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:52:26.289064 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:52:26.289064 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:52:26.289064 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:52:26.289064 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:52:26.289064 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:52:26.289064 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:52:26.294105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:52:26.294105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 27 04:52:26.294105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 27 04:52:26.294105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:26.294105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:26.294105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:52:26.294105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:52:26.294105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 27 04:52:26.294105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 27 04:52:26.294105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 27 04:52:26.294105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 27 04:52:26.294105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 27 04:52:26.294105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 27 04:52:26.294105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 27 04:52:26.294105 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:26.295203 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2983/5924] 10.222.0.76 () {60 vars in 1269 bytes} [Sat Aug 27 04:52:25 2022] POST /identity/v3/users/cd780010f84d405a96bd5d9a2efd9285/password => generated 188 bytes in 301 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:52:26.295203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0150f-3f82-4648-85c0-6824c7212b06 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:26.299754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-21b0150f-3f82-4648-85c0-6824c7212b06 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:26.318236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5ecfab9e-f32e-4592-8b15-f2842792733e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:26.319874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5ecfab9e-f32e-4592-8b15-f2842792733e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:26.447951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0150f-3f82-4648-85c0-6824c7212b06 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:26.454881 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2942/5925] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:26.456342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfab9e-f32e-4592-8b15-f2842792733e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:26.460196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5ecfab9e-f32e-4592-8b15-f2842792733e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:26.485441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:26.592796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944f8fa-541c-41c6-90cc-dc6244c7572e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:26.592796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944f8fa-541c-41c6-90cc-dc6244c7572e service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:26.592796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944f8fa-541c-41c6-90cc-dc6244c7572e service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:26.592796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944f8fa-541c-41c6-90cc-dc6244c7572e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:26.613907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944f8fa-541c-41c6-90cc-dc6244c7572e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:26.615378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944f8fa-541c-41c6-90cc-dc6244c7572e service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:26.635292 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2984/5926] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:26.636153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944f8fa-541c-41c6-90cc-dc6244c7572e service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:26.707735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfab9e-f32e-4592-8b15-f2842792733e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:26.714087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b007ad3-8f8a-4d1b-a217-1ecdabbced55 tempest-TokensV3TestJSON-640524726 tempest-TokensV3TestJSON-640524726-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '109ba43ad7b24d83aa375673d0a08816', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47999f37f7a0473384cfa64fdfa0bfe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:26.715000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b007ad3-8f8a-4d1b-a217-1ecdabbced55 tempest-TokensV3TestJSON-640524726 tempest-TokensV3TestJSON-640524726-project] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:26.715492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b007ad3-8f8a-4d1b-a217-1ecdabbced55 tempest-TokensV3TestJSON-640524726 tempest-TokensV3TestJSON-640524726-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:26.716002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b007ad3-8f8a-4d1b-a217-1ecdabbced55 tempest-TokensV3TestJSON-640524726 tempest-TokensV3TestJSON-640524726-project] PATH_INFO: `/v3/auth/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:26.716943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b007ad3-8f8a-4d1b-a217-1ecdabbced55 tempest-TokensV3TestJSON-640524726 tempest-TokensV3TestJSON-640524726-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:26.723234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b007ad3-8f8a-4d1b-a217-1ecdabbced55 tempest-TokensV3TestJSON-640524726 tempest-TokensV3TestJSON-640524726-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:26.738307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944f8fa-541c-41c6-90cc-dc6244c7572e service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:26.743512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d3abe-b732-47b1-8434-667eaa41410c tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd780010f84d405a96bd5d9a2efd9285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68be995ca5614f189b5052f4462e8b09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:26.744363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d3abe-b732-47b1-8434-667eaa41410c tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:26.744722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d3abe-b732-47b1-8434-667eaa41410c tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:26.745089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d3abe-b732-47b1-8434-667eaa41410c tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] PATH_INFO: `/v3/users/cd780010f84d405a96bd5d9a2efd9285/password` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:26.846704 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2943/5927] 10.222.0.76 () {58 vars in 1143 bytes} [Sat Aug 27 04:52:26 2022] GET /identity/v3/auth/domains => generated 1172 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:26.851120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be773bf-9824-4990-9286-adef6d8c11d6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:26.851120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be773bf-9824-4990-9286-adef6d8c11d6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:26.862630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be773bf-9824-4990-9286-adef6d8c11d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:26.905870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-234d3abe-b732-47b1-8434-667eaa41410c tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cd780010f84d405a96bd5d9a2efd9285'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:26.906118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6be773bf-9824-4990-9286-adef6d8c11d6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:26.907261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6be773bf-9824-4990-9286-adef6d8c11d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:26.922463 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2944/5928] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:26.922463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be773bf-9824-4990-9286-adef6d8c11d6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:26.996277 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2985/5929] 10.222.0.76 () {60 vars in 1269 bytes} [Sat Aug 27 04:52:26 2022] POST /identity/v3/users/cd780010f84d405a96bd5d9a2efd9285/password => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:26.996277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d3abe-b732-47b1-8434-667eaa41410c tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:26.999391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be773bf-9824-4990-9286-adef6d8c11d6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:27.004964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e6d57-50c2-4323-8d0a-c42e7c17a470 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:27.005670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e6d57-50c2-4323-8d0a-c42e7c17a470 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:27.005962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e6d57-50c2-4323-8d0a-c42e7c17a470 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:27.006301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e6d57-50c2-4323-8d0a-c42e7c17a470 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/68b4e6cbfebe4df69e0b855f024462be/groups/54a2edc03c5045279398c95c306e8600/roles/02e6c16c9c3f417ca592222ec720391b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:27.009695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e6d57-50c2-4323-8d0a-c42e7c17a470 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=68b4e6cbfebe4df69e0b855f024462be, group_id=54a2edc03c5045279398c95c306e8600, role_id=02e6c16c9c3f417ca592222ec720391b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:27.012474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e6d57-50c2-4323-8d0a-c42e7c17a470 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:27.019470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-170e6d57-50c2-4323-8d0a-c42e7c17a470 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invalidating the token cache because role 02e6c16c9c3f417ca592222ec720391b was removed from group 54a2edc03c5045279398c95c306e8600 on domain 68b4e6cbfebe4df69e0b855f024462be. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:27.019827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-170e6d57-50c2-4323-8d0a-c42e7c17a470 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:27.020575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-170e6d57-50c2-4323-8d0a-c42e7c17a470 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:27.024263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d3abe-b732-47b1-8434-667eaa41410c tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:27.037868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f63e50-2987-4174-8a0c-60c3d3e6fd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:27.038505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f63e50-2987-4174-8a0c-60c3d3e6fd7b admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:27.038789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f63e50-2987-4174-8a0c-60c3d3e6fd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:27.039064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f63e50-2987-4174-8a0c-60c3d3e6fd7b admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:27.039726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f63e50-2987-4174-8a0c-60c3d3e6fd7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:27.040033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f63e50-2987-4174-8a0c-60c3d3e6fd7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:27.047595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f63e50-2987-4174-8a0c-60c3d3e6fd7b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:27.093671 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2986/5930] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:27.094997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f63e50-2987-4174-8a0c-60c3d3e6fd7b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:27.097195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b4f63e50-2987-4174-8a0c-60c3d3e6fd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:27.119971 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2945/5931] 10.222.0.76 () {58 vars in 1467 bytes} [Sat Aug 27 04:52:26 2022] DELETE /identity/v3/domains/68b4e6cbfebe4df69e0b855f024462be/groups/54a2edc03c5045279398c95c306e8600/roles/02e6c16c9c3f417ca592222ec720391b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:27.120367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f63e50-2987-4174-8a0c-60c3d3e6fd7b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:27.121089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e6d57-50c2-4323-8d0a-c42e7c17a470 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:27.122509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-170e6d57-50c2-4323-8d0a-c42e7c17a470 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:27.194900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:27.219122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c553c2-fb4e-4de7-8ea4-472b196a454f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:27.224523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c553c2-fb4e-4de7-8ea4-472b196a454f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:27.226995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c553c2-fb4e-4de7-8ea4-472b196a454f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:27.231530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c553c2-fb4e-4de7-8ea4-472b196a454f admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:27.235975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c553c2-fb4e-4de7-8ea4-472b196a454f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:27.257145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c553c2-fb4e-4de7-8ea4-472b196a454f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:27.283643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e6d57-50c2-4323-8d0a-c42e7c17a470 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:27.297813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c9d96-8b2d-45ad-9ef4-9c64746f01b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:27.298551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c9d96-8b2d-45ad-9ef4-9c64746f01b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:27.298839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c9d96-8b2d-45ad-9ef4-9c64746f01b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:27.299123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c9d96-8b2d-45ad-9ef4-9c64746f01b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/groups/54a2edc03c5045279398c95c306e8600/users/109ba43ad7b24d83aa375673d0a08816` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:27.301264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c9d96-8b2d-45ad-9ef4-9c64746f01b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=54a2edc03c5045279398c95c306e8600, user_id=109ba43ad7b24d83aa375673d0a08816)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:27.307470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c9d96-8b2d-45ad-9ef4-9c64746f01b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:27.438759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-897c9d96-8b2d-45ad-9ef4-9c64746f01b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '109ba43ad7b24d83aa375673d0a08816'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:27.448961 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2987/5932] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:27 2022] POST /identity/v3/projects => generated 405 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:27.449886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c553c2-fb4e-4de7-8ea4-472b196a454f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:27.455511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-22c553c2-fb4e-4de7-8ea4-472b196a454f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:27.543225 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2946/5933] 10.222.0.76 () {58 vars in 1344 bytes} [Sat Aug 27 04:52:27 2022] DELETE /identity/v3/groups/54a2edc03c5045279398c95c306e8600/users/109ba43ad7b24d83aa375673d0a08816 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:27.547341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c9d96-8b2d-45ad-9ef4-9c64746f01b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:27.563260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c553c2-fb4e-4de7-8ea4-472b196a454f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:27.651006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc464f-be97-4a05-86ad-aaca2788866d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:27.651669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc464f-be97-4a05-86ad-aaca2788866d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:27.652260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc464f-be97-4a05-86ad-aaca2788866d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:27.652689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc464f-be97-4a05-86ad-aaca2788866d admin admin] PATH_INFO: `/v3/projects/68fc37dba0b24a998c0be16ec438e76d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:27.655235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc464f-be97-4a05-86ad-aaca2788866d admin admin] RBAC: Authorizing `identity:delete_project(project_id=68fc37dba0b24a998c0be16ec438e76d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:27.658503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc464f-be97-4a05-86ad-aaca2788866d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:27.679890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c9d96-8b2d-45ad-9ef4-9c64746f01b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:27.701686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566722e-a200-493d-98f1-f8caae07ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:27.709251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566722e-a200-493d-98f1-f8caae07ae7a admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:27.709842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566722e-a200-493d-98f1-f8caae07ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:27.710451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566722e-a200-493d-98f1-f8caae07ae7a admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:27.711752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566722e-a200-493d-98f1-f8caae07ae7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:27.716693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566722e-a200-493d-98f1-f8caae07ae7a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:27.825791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d9fc464f-be97-4a05-86ad-aaca2788866d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68fc37dba0b24a998c0be16ec438e76d', 'request_id': 'req-d9fc464f-be97-4a05-86ad-aaca2788866d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:27.855189 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2947/5934] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:27 2022] POST /identity/v3/users => generated 303 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:27.855189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566722e-a200-493d-98f1-f8caae07ae7a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:27.887330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d9fc464f-be97-4a05-86ad-aaca2788866d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68fc37dba0b24a998c0be16ec438e76d', 'request_id': 'req-d9fc464f-be97-4a05-86ad-aaca2788866d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:27.999809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d9fc464f-be97-4a05-86ad-aaca2788866d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68fc37dba0b24a998c0be16ec438e76d', 'request_id': 'req-d9fc464f-be97-4a05-86ad-aaca2788866d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:28.018808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d9fc464f-be97-4a05-86ad-aaca2788866d admin admin] The token cache is being invalidate because project 68fc37dba0b24a998c0be16ec438e76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:28.020962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d9fc464f-be97-4a05-86ad-aaca2788866d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:28.024966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d9fc464f-be97-4a05-86ad-aaca2788866d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:28.027658 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2988/5935] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:27 2022] DELETE /identity/v3/projects/68fc37dba0b24a998c0be16ec438e76d => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:28.030799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc464f-be97-4a05-86ad-aaca2788866d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:28.034015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d9fc464f-be97-4a05-86ad-aaca2788866d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:28.062548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566722e-a200-493d-98f1-f8caae07ae7a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:28.185900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0879b19-b0b7-4c12-b2aa-a0f582278654 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:28.186565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0879b19-b0b7-4c12-b2aa-a0f582278654 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:28.186942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0879b19-b0b7-4c12-b2aa-a0f582278654 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:28.187226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0879b19-b0b7-4c12-b2aa-a0f582278654 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/groups/54a2edc03c5045279398c95c306e8600` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:28.191040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0879b19-b0b7-4c12-b2aa-a0f582278654 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:delete_group(group_id=54a2edc03c5045279398c95c306e8600)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:28.196266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0879b19-b0b7-4c12-b2aa-a0f582278654 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:28.211600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc464f-be97-4a05-86ad-aaca2788866d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:28.226833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec0841-f799-44fb-8359-aa406cf1c784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:28.229520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec0841-f799-44fb-8359-aa406cf1c784 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:28.229834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec0841-f799-44fb-8359-aa406cf1c784 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:28.230116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec0841-f799-44fb-8359-aa406cf1c784 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:28.237080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec0841-f799-44fb-8359-aa406cf1c784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:28.241126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec0841-f799-44fb-8359-aa406cf1c784 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:28.261950 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2989/5936] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:28 2022] GET /identity/v3/roles => generated 2344 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:28.264053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c8ce6-9442-489b-9cd9-dba5d57dc47c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:28.265162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c8ce6-9442-489b-9cd9-dba5d57dc47c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:28.265613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c8ce6-9442-489b-9cd9-dba5d57dc47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:28.303877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-de2c8ce6-9442-489b-9cd9-dba5d57dc47c None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:28.305533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-de2c8ce6-9442-489b-9cd9-dba5d57dc47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:28.310967 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2990/5937] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:28 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:28.312090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c8ce6-9442-489b-9cd9-dba5d57dc47c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:28.313640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-de2c8ce6-9442-489b-9cd9-dba5d57dc47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:28.333657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c8ce6-9442-489b-9cd9-dba5d57dc47c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:28.345162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5483e-b079-4236-9295-aa931780bece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:28.346097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5483e-b079-4236-9295-aa931780bece admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:28.346578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5483e-b079-4236-9295-aa931780bece admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:28.347198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5483e-b079-4236-9295-aa931780bece admin admin] PATH_INFO: `/v3/users/30f1beff70e043b8bfc3983291ff1e79` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:28.351662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5483e-b079-4236-9295-aa931780bece admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f1beff70e043b8bfc3983291ff1e79)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:28.354368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5483e-b079-4236-9295-aa931780bece admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:28.383926 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2948/5938] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:52:27 2022] DELETE /identity/v3/groups/54a2edc03c5045279398c95c306e8600 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:28.384908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0879b19-b0b7-4c12-b2aa-a0f582278654 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:28.501809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0879b19-b0b7-4c12-b2aa-a0f582278654 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:28.514440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f0ad5-93b7-46e0-a45b-24cebf4fb096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:28.515191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0ad5-93b7-46e0-a45b-24cebf4fb096 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:28.516394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0ad5-93b7-46e0-a45b-24cebf4fb096 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:28.516812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0ad5-93b7-46e0-a45b-24cebf4fb096 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:28.520335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:28.529678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f0ad5-93b7-46e0-a45b-24cebf4fb096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:28.535256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f0ad5-93b7-46e0-a45b-24cebf4fb096 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:28.557100 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2949/5939] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:28 2022] GET /identity/v3/roles => generated 2344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:28.557858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a70afe-bb05-4dbb-90df-eb08adab712e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:28.558153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a70afe-bb05-4dbb-90df-eb08adab712e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:28.558501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a70afe-bb05-4dbb-90df-eb08adab712e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:28.603453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-71a70afe-bb05-4dbb-90df-eb08adab712e None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:28.603453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-71a70afe-bb05-4dbb-90df-eb08adab712e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:28.645671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5ec5483e-b079-4236-9295-aa931780bece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f1beff70e043b8bfc3983291ff1e79'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:28.646998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5ec5483e-b079-4236-9295-aa931780bece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f1beff70e043b8bfc3983291ff1e79'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:28.717646 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2950/5940] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:28.718577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a70afe-bb05-4dbb-90df-eb08adab712e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:28.722707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-71a70afe-bb05-4dbb-90df-eb08adab712e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:28.731076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5ec5483e-b079-4236-9295-aa931780bece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f1beff70e043b8bfc3983291ff1e79'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:28.731792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5ec5483e-b079-4236-9295-aa931780bece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f1beff70e043b8bfc3983291ff1e79'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:28.771014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5ec5483e-b079-4236-9295-aa931780bece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f1beff70e043b8bfc3983291ff1e79'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:28.825646 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2991/5941] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:28 2022] DELETE /identity/v3/users/30f1beff70e043b8bfc3983291ff1e79 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:28.826591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5483e-b079-4236-9295-aa931780bece admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:28.827980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5ec5483e-b079-4236-9295-aa931780bece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:28.845492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a70afe-bb05-4dbb-90df-eb08adab712e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:28.950257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49a376-340f-4b99-900d-ed895631ccea tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:28.950257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49a376-340f-4b99-900d-ed895631ccea tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:28.950257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49a376-340f-4b99-900d-ed895631ccea tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:28.951015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49a376-340f-4b99-900d-ed895631ccea tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/roles/02e6c16c9c3f417ca592222ec720391b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:28.958114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49a376-340f-4b99-900d-ed895631ccea tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:delete_role(role_id=02e6c16c9c3f417ca592222ec720391b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:28.967362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49a376-340f-4b99-900d-ed895631ccea tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:29.010004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5483e-b079-4236-9295-aa931780bece admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:29.045646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:29.054824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f078e-cbfd-4bc5-bc2a-f0324164d655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:29.055518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f078e-cbfd-4bc5-bc2a-f0324164d655 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:29.055799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f078e-cbfd-4bc5-bc2a-f0324164d655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:29.056074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f078e-cbfd-4bc5-bc2a-f0324164d655 admin admin] PATH_INFO: `/v3/projects/f8cf9c5207684ce3a0f8820eee81f737/users/581232a8dc7e41bc93bd4f9b184db2bf/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:29.088776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f078e-cbfd-4bc5-bc2a-f0324164d655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8cf9c5207684ce3a0f8820eee81f737, user_id=581232a8dc7e41bc93bd4f9b184db2bf, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:29.094067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f078e-cbfd-4bc5-bc2a-f0324164d655 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:29.177017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-de49a376-340f-4b99-900d-ed895631ccea tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invalidating the token cache because role 02e6c16c9c3f417ca592222ec720391b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:29.177383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-de49a376-340f-4b99-900d-ed895631ccea tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:29.181087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-de49a376-340f-4b99-900d-ed895631ccea tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:29.190743 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2951/5942] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:28 2022] DELETE /identity/v3/roles/02e6c16c9c3f417ca592222ec720391b => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:29.191619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49a376-340f-4b99-900d-ed895631ccea tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:29.195288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-de49a376-340f-4b99-900d-ed895631ccea tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:29.218195 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2992/5943] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:28 2022] PUT /identity/v3/projects/f8cf9c5207684ce3a0f8820eee81f737/users/581232a8dc7e41bc93bd4f9b184db2bf/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:29.220968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f078e-cbfd-4bc5-bc2a-f0324164d655 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:29.225797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-390f078e-cbfd-4bc5-bc2a-f0324164d655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:29.369909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49a376-340f-4b99-900d-ed895631ccea tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:29.400948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f078e-cbfd-4bc5-bc2a-f0324164d655 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:29.406775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82de651-56ba-49a7-88c7-fcb777d6ffe5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:29.408443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82de651-56ba-49a7-88c7-fcb777d6ffe5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:29.409139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82de651-56ba-49a7-88c7-fcb777d6ffe5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:29.412118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82de651-56ba-49a7-88c7-fcb777d6ffe5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/68b4e6cbfebe4df69e0b855f024462be` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:29.412118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82de651-56ba-49a7-88c7-fcb777d6ffe5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=68b4e6cbfebe4df69e0b855f024462be)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:29.414657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82de651-56ba-49a7-88c7-fcb777d6ffe5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:29.449473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c82de651-56ba-49a7-88c7-fcb777d6ffe5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '68b4e6cbfebe4df69e0b855f024462be'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:29.451009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c82de651-56ba-49a7-88c7-fcb777d6ffe5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '68b4e6cbfebe4df69e0b855f024462be'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:29.504305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571a567-8289-4557-a460-87cbe5c4e578 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd780010f84d405a96bd5d9a2efd9285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68be995ca5614f189b5052f4462e8b09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:29.506792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571a567-8289-4557-a460-87cbe5c4e578 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:29.507338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571a567-8289-4557-a460-87cbe5c4e578 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:29.507919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571a567-8289-4557-a460-87cbe5c4e578 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] PATH_INFO: `/v3/users/cd780010f84d405a96bd5d9a2efd9285/password` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:29.562403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c82de651-56ba-49a7-88c7-fcb777d6ffe5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '68b4e6cbfebe4df69e0b855f024462be'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:29.564991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c82de651-56ba-49a7-88c7-fcb777d6ffe5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '68b4e6cbfebe4df69e0b855f024462be'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:29.572799 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2993/5944] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:52:29 2022] PATCH /identity/v3/domains/68b4e6cbfebe4df69e0b855f024462be => generated 278 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:29.575851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560627bb-675b-4189-98ff-c32ed5bac52a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:29.577420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560627bb-675b-4189-98ff-c32ed5bac52a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:29.577968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560627bb-675b-4189-98ff-c32ed5bac52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:29.612035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-560627bb-675b-4189-98ff-c32ed5bac52a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:29.616666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-560627bb-675b-4189-98ff-c32ed5bac52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:29.711270 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2994/5945] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:29.712427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560627bb-675b-4189-98ff-c32ed5bac52a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:29.714201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-560627bb-675b-4189-98ff-c32ed5bac52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:29.738892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a571a567-8289-4557-a460-87cbe5c4e578 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cd780010f84d405a96bd5d9a2efd9285'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:29.822915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:29.852452 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2952/5946] 10.222.0.76 () {60 vars in 1269 bytes} [Sat Aug 27 04:52:29 2022] POST /identity/v3/users/cd780010f84d405a96bd5d9a2efd9285/password => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:29.853947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571a567-8289-4557-a460-87cbe5c4e578 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:29.858202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a571a567-8289-4557-a460-87cbe5c4e578 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:29.919326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560627bb-675b-4189-98ff-c32ed5bac52a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:29.926274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:29.927606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:29.927981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:29.928391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/68b4e6cbfebe4df69e0b855f024462be` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:29.963076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=68b4e6cbfebe4df69e0b855f024462be)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:29.963076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:29.967129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571a567-8289-4557-a460-87cbe5c4e578 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:30.030052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '68b4e6cbfebe4df69e0b855f024462be'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:30.036847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '68b4e6cbfebe4df69e0b855f024462be'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:30.099065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb77f3-f3ac-4175-b555-a235a95d154f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:30.099729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb77f3-f3ac-4175-b555-a235a95d154f service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:30.100020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb77f3-f3ac-4175-b555-a235a95d154f service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:30.100328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb77f3-f3ac-4175-b555-a235a95d154f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:30.128868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb77f3-f3ac-4175-b555-a235a95d154f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:30.133835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb77f3-f3ac-4175-b555-a235a95d154f service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:30.168653 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2953/5947] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:30.230894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b4e6cbfebe4df69e0b855f024462be', 'request_id': 'req-52922023-9f58-4dc1-988b-b2ee13b77919'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:30.251048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b4e6cbfebe4df69e0b855f024462be', 'request_id': 'req-52922023-9f58-4dc1-988b-b2ee13b77919'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:30.313309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb77f3-f3ac-4175-b555-a235a95d154f service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:30.314802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-53cb77f3-f3ac-4175-b555-a235a95d154f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:30.335238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb77f3-f3ac-4175-b555-a235a95d154f service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:30.368735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b4e6cbfebe4df69e0b855f024462be', 'request_id': 'req-52922023-9f58-4dc1-988b-b2ee13b77919'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:30.389506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] The token cache is being invalidate because project 68b4e6cbfebe4df69e0b855f024462be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:30.390551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:30.392330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:30.415087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '68b4e6cbfebe4df69e0b855f024462be', 'request_id': 'req-52922023-9f58-4dc1-988b-b2ee13b77919'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:30.416602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '68b4e6cbfebe4df69e0b855f024462be', 'request_id': 'req-52922023-9f58-4dc1-988b-b2ee13b77919'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:30.417518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '68b4e6cbfebe4df69e0b855f024462be', 'request_id': 'req-52922023-9f58-4dc1-988b-b2ee13b77919'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:30.443559 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2995/5948] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:52:29 2022] DELETE /identity/v3/domains/68b4e6cbfebe4df69e0b855f024462be => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:30.445239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:30.447549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:30.474355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c63793-39fe-419d-8b9b-c97746b30c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:30.475204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c63793-39fe-419d-8b9b-c97746b30c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:30.475488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c63793-39fe-419d-8b9b-c97746b30c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:30.475761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c63793-39fe-419d-8b9b-c97746b30c91 admin admin] PATH_INFO: `/v3/projects/c013321b51d948d9b93393c29a6452c3` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:30.477145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c63793-39fe-419d-8b9b-c97746b30c91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c013321b51d948d9b93393c29a6452c3)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:30.479194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c63793-39fe-419d-8b9b-c97746b30c91 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:30.623036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52922023-9f58-4dc1-988b-b2ee13b77919 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:30.632191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:30.641255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-36c63793-39fe-419d-8b9b-c97746b30c91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c013321b51d948d9b93393c29a6452c3', 'request_id': 'req-36c63793-39fe-419d-8b9b-c97746b30c91'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:30.663157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-36c63793-39fe-419d-8b9b-c97746b30c91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c013321b51d948d9b93393c29a6452c3', 'request_id': 'req-36c63793-39fe-419d-8b9b-c97746b30c91'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:30.686451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-36c63793-39fe-419d-8b9b-c97746b30c91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c013321b51d948d9b93393c29a6452c3', 'request_id': 'req-36c63793-39fe-419d-8b9b-c97746b30c91'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:30.758931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60c711-c84d-466b-a9a2-3569d4b8a50c tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:30.759618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60c711-c84d-466b-a9a2-3569d4b8a50c tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:30.759902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60c711-c84d-466b-a9a2-3569d4b8a50c tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:30.760240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60c711-c84d-466b-a9a2-3569d4b8a50c tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/1e8d1efcfbc145fdb9c606927c89f560/users/109ba43ad7b24d83aa375673d0a08816/roles/c52e9a2553944b78bc03a025b24df8eb` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:30.765458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60c711-c84d-466b-a9a2-3569d4b8a50c tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=1e8d1efcfbc145fdb9c606927c89f560, user_id=109ba43ad7b24d83aa375673d0a08816, role_id=c52e9a2553944b78bc03a025b24df8eb)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:30.772669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60c711-c84d-466b-a9a2-3569d4b8a50c tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:30.783140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8a60c711-c84d-466b-a9a2-3569d4b8a50c tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invalidating the token cache because role c52e9a2553944b78bc03a025b24df8eb was removed from user 109ba43ad7b24d83aa375673d0a08816 on domain 1e8d1efcfbc145fdb9c606927c89f560. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:30.783445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8a60c711-c84d-466b-a9a2-3569d4b8a50c tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:30.784316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8a60c711-c84d-466b-a9a2-3569d4b8a50c tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:30.845172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-36c63793-39fe-419d-8b9b-c97746b30c91 admin admin] The token cache is being invalidate because project c013321b51d948d9b93393c29a6452c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:30.845496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-36c63793-39fe-419d-8b9b-c97746b30c91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:30.850165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-36c63793-39fe-419d-8b9b-c97746b30c91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:30.851849 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2954/5949] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:30 2022] DELETE /identity/v3/projects/c013321b51d948d9b93393c29a6452c3 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:30.857717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e8a8f-6812-4e16-b91d-3d75d3fd7943 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:30.857999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e8a8f-6812-4e16-b91d-3d75d3fd7943 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:30.858268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e8a8f-6812-4e16-b91d-3d75d3fd7943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:30.897968 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2996/5950] 10.222.0.76 () {58 vars in 1464 bytes} [Sat Aug 27 04:52:30 2022] DELETE /identity/v3/domains/1e8d1efcfbc145fdb9c606927c89f560/users/109ba43ad7b24d83aa375673d0a08816/roles/c52e9a2553944b78bc03a025b24df8eb => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:30.901755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6291b5b-6d0d-4fe8-8c84-2bb6fd60badb None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:30.902419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6291b5b-6d0d-4fe8-8c84-2bb6fd60badb None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:30.902801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6291b5b-6d0d-4fe8-8c84-2bb6fd60badb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:30.906210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1e6e8a8f-6812-4e16-b91d-3d75d3fd7943 None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:30.907561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1e6e8a8f-6812-4e16-b91d-3d75d3fd7943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:30.918327 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2955/5951] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:30 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:30.923156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e8a8f-6812-4e16-b91d-3d75d3fd7943 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:30.927557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1e6e8a8f-6812-4e16-b91d-3d75d3fd7943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:30.938344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a6291b5b-6d0d-4fe8-8c84-2bb6fd60badb None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:30.940212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a6291b5b-6d0d-4fe8-8c84-2bb6fd60badb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:31.066062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e8a8f-6812-4e16-b91d-3d75d3fd7943 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:31.072994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ca779-5a49-4f4b-ba34-9d36d245ccb8 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:31.073663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ca779-5a49-4f4b-ba34-9d36d245ccb8 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:31.073947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ca779-5a49-4f4b-ba34-9d36d245ccb8 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:31.074227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ca779-5a49-4f4b-ba34-9d36d245ccb8 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/roles/c52e9a2553944b78bc03a025b24df8eb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:31.075799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ca779-5a49-4f4b-ba34-9d36d245ccb8 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c52e9a2553944b78bc03a025b24df8eb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:31.077525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ca779-5a49-4f4b-ba34-9d36d245ccb8 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:31.144670 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2997/5952] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:31.148732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05dc9f-d617-417d-98a5-30294f2e58e1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:31.148732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05dc9f-d617-417d-98a5-30294f2e58e1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:31.150860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05dc9f-d617-417d-98a5-30294f2e58e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:31.199216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0b05dc9f-d617-417d-98a5-30294f2e58e1 None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:31.201382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0b05dc9f-d617-417d-98a5-30294f2e58e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:31.211131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b84ca779-5a49-4f4b-ba34-9d36d245ccb8 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invalidating the token cache because role c52e9a2553944b78bc03a025b24df8eb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:31.213301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b84ca779-5a49-4f4b-ba34-9d36d245ccb8 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:31.213937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b84ca779-5a49-4f4b-ba34-9d36d245ccb8 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:31.216351 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2956/5953] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:30 2022] DELETE /identity/v3/roles/c52e9a2553944b78bc03a025b24df8eb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:31.217679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81100a1-6f3b-46f0-b54c-6d9b5e661d01 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:31.218047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81100a1-6f3b-46f0-b54c-6d9b5e661d01 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:31.218229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81100a1-6f3b-46f0-b54c-6d9b5e661d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:31.237387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:31.278682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e81100a1-6f3b-46f0-b54c-6d9b5e661d01 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:31.279932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e81100a1-6f3b-46f0-b54c-6d9b5e661d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:31.352684 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2998/5954] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:31.352684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05dc9f-d617-417d-98a5-30294f2e58e1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:31.355510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0b05dc9f-d617-417d-98a5-30294f2e58e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:31.391193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05dc9f-d617-417d-98a5-30294f2e58e1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:31.417793 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2957/5955] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:31.418768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81100a1-6f3b-46f0-b54c-6d9b5e661d01 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:31.525497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3dbbe-811f-42cb-b3fd-9b130491cb79 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:31.526126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3dbbe-811f-42cb-b3fd-9b130491cb79 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:31.526409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3dbbe-811f-42cb-b3fd-9b130491cb79 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:31.526688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3dbbe-811f-42cb-b3fd-9b130491cb79 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/1e8d1efcfbc145fdb9c606927c89f560` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:31.530868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3dbbe-811f-42cb-b3fd-9b130491cb79 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1e8d1efcfbc145fdb9c606927c89f560)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:31.534152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3dbbe-811f-42cb-b3fd-9b130491cb79 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:31.567401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-10d3dbbe-811f-42cb-b3fd-9b130491cb79 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1e8d1efcfbc145fdb9c606927c89f560'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:31.567891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-10d3dbbe-811f-42cb-b3fd-9b130491cb79 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1e8d1efcfbc145fdb9c606927c89f560'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:31.573126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81100a1-6f3b-46f0-b54c-6d9b5e661d01 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:31.634652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7174d71-af27-4d97-96fa-b407e7574a20 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd780010f84d405a96bd5d9a2efd9285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68be995ca5614f189b5052f4462e8b09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:31.636720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7174d71-af27-4d97-96fa-b407e7574a20 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:31.637017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7174d71-af27-4d97-96fa-b407e7574a20 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:31.637300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7174d71-af27-4d97-96fa-b407e7574a20 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] PATH_INFO: `/v3/users/cd780010f84d405a96bd5d9a2efd9285/password` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:31.717399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-10d3dbbe-811f-42cb-b3fd-9b130491cb79 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1e8d1efcfbc145fdb9c606927c89f560'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:31.718145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-10d3dbbe-811f-42cb-b3fd-9b130491cb79 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1e8d1efcfbc145fdb9c606927c89f560'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:31.726514 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 2999/5956] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:52:31 2022] PATCH /identity/v3/domains/1e8d1efcfbc145fdb9c606927c89f560 => generated 277 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:31.726514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3dbbe-811f-42cb-b3fd-9b130491cb79 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:31.729313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-10d3dbbe-811f-42cb-b3fd-9b130491cb79 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:31.769944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b7174d71-af27-4d97-96fa-b407e7574a20 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cd780010f84d405a96bd5d9a2efd9285'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:31.855724 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2958/5957] 10.222.0.76 () {60 vars in 1269 bytes} [Sat Aug 27 04:52:31 2022] POST /identity/v3/users/cd780010f84d405a96bd5d9a2efd9285/password => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:31.857054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7174d71-af27-4d97-96fa-b407e7574a20 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:31.859187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b7174d71-af27-4d97-96fa-b407e7574a20 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:31.978622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3dbbe-811f-42cb-b3fd-9b130491cb79 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:31.992443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f9e7a-2a0d-4a67-8273-676c9afb15df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:31.993095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f9e7a-2a0d-4a67-8273-676c9afb15df admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:31.993452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f9e7a-2a0d-4a67-8273-676c9afb15df admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:31.993741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f9e7a-2a0d-4a67-8273-676c9afb15df admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:31.995435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f9e7a-2a0d-4a67-8273-676c9afb15df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:32.000974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f9e7a-2a0d-4a67-8273-676c9afb15df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:32.003514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7174d71-af27-4d97-96fa-b407e7574a20 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:32.006012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f9e7a-2a0d-4a67-8273-676c9afb15df admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:32.011211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:32.012785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:32.013351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:32.013857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/1e8d1efcfbc145fdb9c606927c89f560` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:32.021251 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3000/5958] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:32.043721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f9e7a-2a0d-4a67-8273-676c9afb15df admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:32.043961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1e8d1efcfbc145fdb9c606927c89f560)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:32.043961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:32.046604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f9e7a-2a0d-4a67-8273-676c9afb15df admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:32.052777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b055e0c-c37b-4e7f-963a-727bcad34189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:32.053596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b055e0c-c37b-4e7f-963a-727bcad34189 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:32.053970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b055e0c-c37b-4e7f-963a-727bcad34189 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:32.054352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b055e0c-c37b-4e7f-963a-727bcad34189 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:32.055101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b055e0c-c37b-4e7f-963a-727bcad34189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:32.057847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b055e0c-c37b-4e7f-963a-727bcad34189 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:32.068724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1e8d1efcfbc145fdb9c606927c89f560'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:32.075374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1e8d1efcfbc145fdb9c606927c89f560'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:32.188237 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3001/5959] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:32 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:32.191608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b055e0c-c37b-4e7f-963a-727bcad34189 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:32.200021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e8d1efcfbc145fdb9c606927c89f560', 'request_id': 'req-7c7d99aa-8acf-4965-86cc-4339d4ca4666'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:32.206336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e8d1efcfbc145fdb9c606927c89f560', 'request_id': 'req-7c7d99aa-8acf-4965-86cc-4339d4ca4666'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:32.231203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e8d1efcfbc145fdb9c606927c89f560', 'request_id': 'req-7c7d99aa-8acf-4965-86cc-4339d4ca4666'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:32.298596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b055e0c-c37b-4e7f-963a-727bcad34189 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:32.306971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adb5fe-123b-41d6-9765-1cfdac3f137e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:32.310614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adb5fe-123b-41d6-9765-1cfdac3f137e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:32.310614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adb5fe-123b-41d6-9765-1cfdac3f137e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:32.310614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adb5fe-123b-41d6-9765-1cfdac3f137e admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:32.310614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adb5fe-123b-41d6-9765-1cfdac3f137e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:32.312016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adb5fe-123b-41d6-9765-1cfdac3f137e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:32.313360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] The token cache is being invalidate because project 1e8d1efcfbc145fdb9c606927c89f560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:32.314067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:32.316108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:32.327824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1e8d1efcfbc145fdb9c606927c89f560', 'request_id': 'req-7c7d99aa-8acf-4965-86cc-4339d4ca4666'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:32.331597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1e8d1efcfbc145fdb9c606927c89f560', 'request_id': 'req-7c7d99aa-8acf-4965-86cc-4339d4ca4666'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:32.333624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1e8d1efcfbc145fdb9c606927c89f560', 'request_id': 'req-7c7d99aa-8acf-4965-86cc-4339d4ca4666'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:32.346051 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2959/5960] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:52:31 2022] DELETE /identity/v3/domains/1e8d1efcfbc145fdb9c606927c89f560 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:32.347634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:32.350097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:32.449569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d99aa-8acf-4965-86cc-4339d4ca4666 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:32.480919 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3002/5961] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:32 2022] POST /identity/v3/users => generated 287 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:32.482813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adb5fe-123b-41d6-9765-1cfdac3f137e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:32.487391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d7adb5fe-123b-41d6-9765-1cfdac3f137e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:32.517588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adb5fe-123b-41d6-9765-1cfdac3f137e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:32.526203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:32.535167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab271ca-e414-4053-a5ba-0bc3b75223a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:32.535853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab271ca-e414-4053-a5ba-0bc3b75223a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:32.537998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab271ca-e414-4053-a5ba-0bc3b75223a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:32.538246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab271ca-e414-4053-a5ba-0bc3b75223a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:32.539024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab271ca-e414-4053-a5ba-0bc3b75223a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:32.542346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab271ca-e414-4053-a5ba-0bc3b75223a4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:32.569485 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3003/5962] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:32 2022] GET /identity/v3/roles => generated 1882 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:32.573642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab271ca-e414-4053-a5ba-0bc3b75223a4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:32.587854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6181c-5115-4d56-8be0-34d7f433f0b0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:32.590794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6181c-5115-4d56-8be0-34d7f433f0b0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:32.591196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6181c-5115-4d56-8be0-34d7f433f0b0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:32.591584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6181c-5115-4d56-8be0-34d7f433f0b0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/68f44c39b4b948829a9b10b82f4506fb/groups/3b3e71afe96142c3b0106705bc3f17c1/roles/21ef2ec07b1a4eab96d2559917729ee7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:32.599302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6181c-5115-4d56-8be0-34d7f433f0b0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=68f44c39b4b948829a9b10b82f4506fb, group_id=3b3e71afe96142c3b0106705bc3f17c1, role_id=21ef2ec07b1a4eab96d2559917729ee7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:32.606798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6181c-5115-4d56-8be0-34d7f433f0b0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:32.610169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab271ca-e414-4053-a5ba-0bc3b75223a4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:32.621787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7e02b-b2d4-42d7-9d26-0def636de714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:32.622687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7e02b-b2d4-42d7-9d26-0def636de714 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:32.623166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7e02b-b2d4-42d7-9d26-0def636de714 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:32.623619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7e02b-b2d4-42d7-9d26-0def636de714 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:32.623758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-05b6181c-5115-4d56-8be0-34d7f433f0b0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invalidating the token cache because role 21ef2ec07b1a4eab96d2559917729ee7 was removed from group 3b3e71afe96142c3b0106705bc3f17c1 on domain 68f44c39b4b948829a9b10b82f4506fb. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:32.624145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-05b6181c-5115-4d56-8be0-34d7f433f0b0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:32.624796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7e02b-b2d4-42d7-9d26-0def636de714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:32.627023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7e02b-b2d4-42d7-9d26-0def636de714 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:32.627479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-05b6181c-5115-4d56-8be0-34d7f433f0b0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:32.656056 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3004/5963] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:32 2022] GET /identity/v3/roles => generated 1882 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:32.657261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7e02b-b2d4-42d7-9d26-0def636de714 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:32.659531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8fa7e02b-b2d4-42d7-9d26-0def636de714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:32.680778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7e02b-b2d4-42d7-9d26-0def636de714 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:32.687897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360eab8c-adf2-4bdc-89cf-df0cd376bbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:32.696333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360eab8c-adf2-4bdc-89cf-df0cd376bbf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:32.696333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360eab8c-adf2-4bdc-89cf-df0cd376bbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:32.696333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360eab8c-adf2-4bdc-89cf-df0cd376bbf3 admin admin] PATH_INFO: `/v3/projects/027f2bde14a649d1b5ba3c56c43e18de/users/9c7b499281b747f8b3e98df2a33baf16/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:32.711884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360eab8c-adf2-4bdc-89cf-df0cd376bbf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=027f2bde14a649d1b5ba3c56c43e18de, user_id=9c7b499281b747f8b3e98df2a33baf16, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:32.715305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360eab8c-adf2-4bdc-89cf-df0cd376bbf3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:32.725273 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2960/5964] 10.222.0.76 () {58 vars in 1467 bytes} [Sat Aug 27 04:52:32 2022] DELETE /identity/v3/domains/68f44c39b4b948829a9b10b82f4506fb/groups/3b3e71afe96142c3b0106705bc3f17c1/roles/21ef2ec07b1a4eab96d2559917729ee7 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:32.727761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6181c-5115-4d56-8be0-34d7f433f0b0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:32.729431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-05b6181c-5115-4d56-8be0-34d7f433f0b0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:32.860438 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3005/5965] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:32 2022] PUT /identity/v3/projects/027f2bde14a649d1b5ba3c56c43e18de/users/9c7b499281b747f8b3e98df2a33baf16/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:32.868551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e72b1-e358-4152-a587-6ac82902fef5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:32.868551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e72b1-e358-4152-a587-6ac82902fef5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:32.868551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e72b1-e358-4152-a587-6ac82902fef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:32.871788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6181c-5115-4d56-8be0-34d7f433f0b0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:32.956652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-987e72b1-e358-4152-a587-6ac82902fef5 None None] MFA Rules not processed for user `9c7b499281b747f8b3e98df2a33baf16`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:32.969661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-987e72b1-e358-4152-a587-6ac82902fef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:32.996704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88bafd-c8f5-41a2-b426-2c027181bfa5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:32.997375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88bafd-c8f5-41a2-b426-2c027181bfa5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:32.997920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88bafd-c8f5-41a2-b426-2c027181bfa5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:32.998213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88bafd-c8f5-41a2-b426-2c027181bfa5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/groups/3b3e71afe96142c3b0106705bc3f17c1/users/109ba43ad7b24d83aa375673d0a08816` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:33.000718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88bafd-c8f5-41a2-b426-2c027181bfa5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=3b3e71afe96142c3b0106705bc3f17c1, user_id=109ba43ad7b24d83aa375673d0a08816)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:33.002381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88bafd-c8f5-41a2-b426-2c027181bfa5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:33.095892 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3006/5966] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:33.095892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48272331-2b42-42b5-a19f-82c4027fe31c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:33.095892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48272331-2b42-42b5-a19f-82c4027fe31c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:33.095892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48272331-2b42-42b5-a19f-82c4027fe31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:33.101862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c88bafd-c8f5-41a2-b426-2c027181bfa5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '109ba43ad7b24d83aa375673d0a08816'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:33.124477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-48272331-2b42-42b5-a19f-82c4027fe31c None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:33.125808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-48272331-2b42-42b5-a19f-82c4027fe31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:33.131341 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3007/5967] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:33 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:33.132807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ec5d9-5bfe-4971-994d-5a6b8264fe64 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:33.133169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ec5d9-5bfe-4971-994d-5a6b8264fe64 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:33.133439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ec5d9-5bfe-4971-994d-5a6b8264fe64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:33.201520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-801ec5d9-5bfe-4971-994d-5a6b8264fe64 None None] MFA Rules not processed for user `acc9882e74924037af21b3da3c5bf1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:33.204477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-801ec5d9-5bfe-4971-994d-5a6b8264fe64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:33.228547 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2961/5968] 10.222.0.76 () {58 vars in 1344 bytes} [Sat Aug 27 04:52:32 2022] DELETE /identity/v3/groups/3b3e71afe96142c3b0106705bc3f17c1/users/109ba43ad7b24d83aa375673d0a08816 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:52:33.228935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88bafd-c8f5-41a2-b426-2c027181bfa5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:33.390390 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3008/5969] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:33.392356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047112b-23fa-43fa-ab47-4fa7f8cb1690 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:33.393233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047112b-23fa-43fa-ab47-4fa7f8cb1690 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:33.393705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047112b-23fa-43fa-ab47-4fa7f8cb1690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:33.406152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:33.430530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6047112b-23fa-43fa-ab47-4fa7f8cb1690 None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:33.434001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6047112b-23fa-43fa-ab47-4fa7f8cb1690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:33.439313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88bafd-c8f5-41a2-b426-2c027181bfa5 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:33.445022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f482e70-d2f5-4c64-8b17-98dc3efc7e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:33.445768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f482e70-d2f5-4c64-8b17-98dc3efc7e3a admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:33.446125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f482e70-d2f5-4c64-8b17-98dc3efc7e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:33.446703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f482e70-d2f5-4c64-8b17-98dc3efc7e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:33.447509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f482e70-d2f5-4c64-8b17-98dc3efc7e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:33.450219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f482e70-d2f5-4c64-8b17-98dc3efc7e3a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:33.541757 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2962/5970] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:33 2022] POST /identity/v3/projects => generated 371 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:33.542626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f482e70-d2f5-4c64-8b17-98dc3efc7e3a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:33.552959 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3009/5971] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:33.557558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbeac6-e129-4e51-a158-ec35bd3e22f1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:33.560475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbeac6-e129-4e51-a158-ec35bd3e22f1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:33.560914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbeac6-e129-4e51-a158-ec35bd3e22f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:33.604133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a2dbeac6-e129-4e51-a158-ec35bd3e22f1 None None] MFA Rules not processed for user `acc9882e74924037af21b3da3c5bf1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:33.605445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a2dbeac6-e129-4e51-a158-ec35bd3e22f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:33.682646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f482e70-d2f5-4c64-8b17-98dc3efc7e3a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:33.697220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed34b3-2f40-4428-b8f6-7065a6a87edb tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:33.701374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed34b3-2f40-4428-b8f6-7065a6a87edb tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:33.701374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed34b3-2f40-4428-b8f6-7065a6a87edb tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:33.701374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed34b3-2f40-4428-b8f6-7065a6a87edb tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/groups/3b3e71afe96142c3b0106705bc3f17c1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:33.701374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed34b3-2f40-4428-b8f6-7065a6a87edb tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:delete_group(group_id=3b3e71afe96142c3b0106705bc3f17c1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:33.703626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed34b3-2f40-4428-b8f6-7065a6a87edb tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:33.729535 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3010/5972] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:33.730674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbeac6-e129-4e51-a158-ec35bd3e22f1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:33.862265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbeac6-e129-4e51-a158-ec35bd3e22f1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:33.868174 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2963/5973] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:52:33 2022] DELETE /identity/v3/groups/3b3e71afe96142c3b0106705bc3f17c1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:33.871700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed34b3-2f40-4428-b8f6-7065a6a87edb tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:33.997809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eef6b-26c5-440e-a865-251e5962e435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:33.999946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eef6b-26c5-440e-a865-251e5962e435 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:34.001131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eef6b-26c5-440e-a865-251e5962e435 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:34.001914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eef6b-26c5-440e-a865-251e5962e435 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:34.010219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121eef6b-26c5-440e-a865-251e5962e435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:34.024132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121eef6b-26c5-440e-a865-251e5962e435 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:34.027244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed34b3-2f40-4428-b8f6-7065a6a87edb tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:34.048818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ff258-09fc-4a6c-b9c7-fd419d296af2 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd780010f84d405a96bd5d9a2efd9285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68be995ca5614f189b5052f4462e8b09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:34.049815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ff258-09fc-4a6c-b9c7-fd419d296af2 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:34.049815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ff258-09fc-4a6c-b9c7-fd419d296af2 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:34.050070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ff258-09fc-4a6c-b9c7-fd419d296af2 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] PATH_INFO: `/v3/users/cd780010f84d405a96bd5d9a2efd9285/password` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:34.107923 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3011/5974] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:33 2022] POST /identity/v3/users => generated 292 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:34.107923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eef6b-26c5-440e-a865-251e5962e435 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:34.109825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-121eef6b-26c5-440e-a865-251e5962e435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:34.180295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-962ff258-09fc-4a6c-b9c7-fd419d296af2 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cd780010f84d405a96bd5d9a2efd9285'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:34.254982 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2964/5975] 10.222.0.76 () {60 vars in 1269 bytes} [Sat Aug 27 04:52:33 2022] POST /identity/v3/users/cd780010f84d405a96bd5d9a2efd9285/password => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:34.256716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ff258-09fc-4a6c-b9c7-fd419d296af2 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:34.284930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eef6b-26c5-440e-a865-251e5962e435 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:34.290286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:34.298191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026b14-fea5-4479-ba9d-122211fa8175 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:34.302915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026b14-fea5-4479-ba9d-122211fa8175 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:34.302915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026b14-fea5-4479-ba9d-122211fa8175 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:34.302915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026b14-fea5-4479-ba9d-122211fa8175 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:34.387167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ff258-09fc-4a6c-b9c7-fd419d296af2 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:34.392304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0c034-d71a-45a4-910c-5f610e542532 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:34.394870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0c034-d71a-45a4-910c-5f610e542532 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:34.394870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0c034-d71a-45a4-910c-5f610e542532 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:34.394870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0c034-d71a-45a4-910c-5f610e542532 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/roles/21ef2ec07b1a4eab96d2559917729ee7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:34.396438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0c034-d71a-45a4-910c-5f610e542532 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:delete_role(role_id=21ef2ec07b1a4eab96d2559917729ee7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:34.402784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0c034-d71a-45a4-910c-5f610e542532 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:34.413714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4026b14-fea5-4479-ba9d-122211fa8175 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:34.416330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4026b14-fea5-4479-ba9d-122211fa8175 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:34.430787 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3012/5976] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:34 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:34.445473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026b14-fea5-4479-ba9d-122211fa8175 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:34.471453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026b14-fea5-4479-ba9d-122211fa8175 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:34.484376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963dc0f-6729-4e74-a545-226456081782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:34.484376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963dc0f-6729-4e74-a545-226456081782 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:34.484376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963dc0f-6729-4e74-a545-226456081782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:34.496569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963dc0f-6729-4e74-a545-226456081782 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:34.501529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963dc0f-6729-4e74-a545-226456081782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:34.503181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963dc0f-6729-4e74-a545-226456081782 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:34.528964 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3013/5977] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:34 2022] GET /identity/v3/roles => generated 1882 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:34.533455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963dc0f-6729-4e74-a545-226456081782 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:34.549852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963dc0f-6729-4e74-a545-226456081782 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:34.557898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668033a3-aa5c-4fa2-9d48-61b2b4af8f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:34.558980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668033a3-aa5c-4fa2-9d48-61b2b4af8f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:34.559963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668033a3-aa5c-4fa2-9d48-61b2b4af8f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:34.560498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668033a3-aa5c-4fa2-9d48-61b2b4af8f96 admin admin] PATH_INFO: `/v3/projects/938edb15849c46d08a5be2ac829a2887/users/938cdce8858747ffb57d49db9defc4a0/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:34.577409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-16b0c034-d71a-45a4-910c-5f610e542532 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invalidating the token cache because role 21ef2ec07b1a4eab96d2559917729ee7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:34.577978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-16b0c034-d71a-45a4-910c-5f610e542532 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:34.578780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-16b0c034-d71a-45a4-910c-5f610e542532 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:34.585879 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2965/5978] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:34 2022] DELETE /identity/v3/roles/21ef2ec07b1a4eab96d2559917729ee7 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:34.586220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0c034-d71a-45a4-910c-5f610e542532 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:34.589050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-16b0c034-d71a-45a4-910c-5f610e542532 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:34.594583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668033a3-aa5c-4fa2-9d48-61b2b4af8f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938edb15849c46d08a5be2ac829a2887, user_id=938cdce8858747ffb57d49db9defc4a0, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:34.601251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668033a3-aa5c-4fa2-9d48-61b2b4af8f96 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:34.670067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0c034-d71a-45a4-910c-5f610e542532 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:34.675291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01637e49-28c5-4086-aeb3-01285b618089 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:34.676044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01637e49-28c5-4086-aeb3-01285b618089 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:34.676489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01637e49-28c5-4086-aeb3-01285b618089 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:34.676881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01637e49-28c5-4086-aeb3-01285b618089 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/68f44c39b4b948829a9b10b82f4506fb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:34.678321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01637e49-28c5-4086-aeb3-01285b618089 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=68f44c39b4b948829a9b10b82f4506fb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:34.680050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01637e49-28c5-4086-aeb3-01285b618089 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:34.695338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:34.701488 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3014/5979] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:34 2022] PUT /identity/v3/projects/938edb15849c46d08a5be2ac829a2887/users/938cdce8858747ffb57d49db9defc4a0/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:52:34.703758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-01637e49-28c5-4086-aeb3-01285b618089 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '68f44c39b4b948829a9b10b82f4506fb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:34.704706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-01637e49-28c5-4086-aeb3-01285b618089 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '68f44c39b4b948829a9b10b82f4506fb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:34.708750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668033a3-aa5c-4fa2-9d48-61b2b4af8f96 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:34.719797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-668033a3-aa5c-4fa2-9d48-61b2b4af8f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:34.789206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-01637e49-28c5-4086-aeb3-01285b618089 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '68f44c39b4b948829a9b10b82f4506fb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:34.790747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-01637e49-28c5-4086-aeb3-01285b618089 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '68f44c39b4b948829a9b10b82f4506fb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:34.797368 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2966/5980] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:52:34 2022] PATCH /identity/v3/domains/68f44c39b4b948829a9b10b82f4506fb => generated 278 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:52:34.806362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01637e49-28c5-4086-aeb3-01285b618089 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:34.807043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-01637e49-28c5-4086-aeb3-01285b618089 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:34.880451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668033a3-aa5c-4fa2-9d48-61b2b4af8f96 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:34.903999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01637e49-28c5-4086-aeb3-01285b618089 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:34.929654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31002f8-d91f-4da0-a3c6-ae22655c8022 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:34.935286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31002f8-d91f-4da0-a3c6-ae22655c8022 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:34.935286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31002f8-d91f-4da0-a3c6-ae22655c8022 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:34.935286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31002f8-d91f-4da0-a3c6-ae22655c8022 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/68f44c39b4b948829a9b10b82f4506fb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:34.962675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31002f8-d91f-4da0-a3c6-ae22655c8022 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=68f44c39b4b948829a9b10b82f4506fb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:34.976399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31002f8-d91f-4da0-a3c6-ae22655c8022 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:34.996570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c274c-b3db-4ca4-bd9e-9c8a07b15a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:34.997299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c274c-b3db-4ca4-bd9e-9c8a07b15a8c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:34.997755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c274c-b3db-4ca4-bd9e-9c8a07b15a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:34.998106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c274c-b3db-4ca4-bd9e-9c8a07b15a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:34.998860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c274c-b3db-4ca4-bd9e-9c8a07b15a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:35.000839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c274c-b3db-4ca4-bd9e-9c8a07b15a8c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:35.025268 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3015/5981] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:34 2022] GET /identity/v3/roles => generated 1651 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:52:35.029707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d31002f8-d91f-4da0-a3c6-ae22655c8022 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '68f44c39b4b948829a9b10b82f4506fb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:35.031195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c274c-b3db-4ca4-bd9e-9c8a07b15a8c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:35.037441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b09c274c-b3db-4ca4-bd9e-9c8a07b15a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:35.037686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d31002f8-d91f-4da0-a3c6-ae22655c8022 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '68f44c39b4b948829a9b10b82f4506fb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:35.069162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c274c-b3db-4ca4-bd9e-9c8a07b15a8c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:35.078267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e44c1-2b8d-46a4-a6c4-916f24f1b50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:35.079331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e44c1-2b8d-46a4-a6c4-916f24f1b50f admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:35.080100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e44c1-2b8d-46a4-a6c4-916f24f1b50f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:35.080601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e44c1-2b8d-46a4-a6c4-916f24f1b50f admin admin] PATH_INFO: `/v3/projects/938edb15849c46d08a5be2ac829a2887/users/938cdce8858747ffb57d49db9defc4a0/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:35.084064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e44c1-2b8d-46a4-a6c4-916f24f1b50f admin admin] RBAC: Authorizing `identity:create_grant(project_id=938edb15849c46d08a5be2ac829a2887, user_id=938cdce8858747ffb57d49db9defc4a0, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:35.088664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e44c1-2b8d-46a4-a6c4-916f24f1b50f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:35.111985 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3016/5982] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:35 2022] PUT /identity/v3/projects/938edb15849c46d08a5be2ac829a2887/users/938cdce8858747ffb57d49db9defc4a0/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:35.125185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37834d-709b-4a0e-a89e-65cbf23b21e4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:35.125494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37834d-709b-4a0e-a89e-65cbf23b21e4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:35.125779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37834d-709b-4a0e-a89e-65cbf23b21e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:35.193390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9a37834d-709b-4a0e-a89e-65cbf23b21e4 None None] MFA Rules not processed for user `938cdce8858747ffb57d49db9defc4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:35.195012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9a37834d-709b-4a0e-a89e-65cbf23b21e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:35.215057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d31002f8-d91f-4da0-a3c6-ae22655c8022 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f44c39b4b948829a9b10b82f4506fb', 'request_id': 'req-d31002f8-d91f-4da0-a3c6-ae22655c8022'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:35.236879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d31002f8-d91f-4da0-a3c6-ae22655c8022 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f44c39b4b948829a9b10b82f4506fb', 'request_id': 'req-d31002f8-d91f-4da0-a3c6-ae22655c8022'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:35.250467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d31002f8-d91f-4da0-a3c6-ae22655c8022 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f44c39b4b948829a9b10b82f4506fb', 'request_id': 'req-d31002f8-d91f-4da0-a3c6-ae22655c8022'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:35.327811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d31002f8-d91f-4da0-a3c6-ae22655c8022 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] The token cache is being invalidate because project 68f44c39b4b948829a9b10b82f4506fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:35.328942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d31002f8-d91f-4da0-a3c6-ae22655c8022 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:35.329618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d31002f8-d91f-4da0-a3c6-ae22655c8022 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:35.335562 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3017/5983] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:35.335562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bcba6-8611-47de-bc33-ef6af3d5656f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:35.335562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bcba6-8611-47de-bc33-ef6af3d5656f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:35.341516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bcba6-8611-47de-bc33-ef6af3d5656f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:35.347174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d31002f8-d91f-4da0-a3c6-ae22655c8022 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '68f44c39b4b948829a9b10b82f4506fb', 'request_id': 'req-d31002f8-d91f-4da0-a3c6-ae22655c8022'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:35.351229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:35.355073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d31002f8-d91f-4da0-a3c6-ae22655c8022 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '68f44c39b4b948829a9b10b82f4506fb', 'request_id': 'req-d31002f8-d91f-4da0-a3c6-ae22655c8022'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:35.358442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d31002f8-d91f-4da0-a3c6-ae22655c8022 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '68f44c39b4b948829a9b10b82f4506fb', 'request_id': 'req-d31002f8-d91f-4da0-a3c6-ae22655c8022'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:35.379220 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2967/5984] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:52:34 2022] DELETE /identity/v3/domains/68f44c39b4b948829a9b10b82f4506fb => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:52:35.382066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5153b49-49da-4915-946e-4ed585e5b83e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:35.382354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5153b49-49da-4915-946e-4ed585e5b83e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:35.382633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5153b49-49da-4915-946e-4ed585e5b83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:35.387597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-db4bcba6-8611-47de-bc33-ef6af3d5656f None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:35.389105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-db4bcba6-8611-47de-bc33-ef6af3d5656f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:35.395579 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3018/5985] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:35 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:35.396673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bcba6-8611-47de-bc33-ef6af3d5656f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:35.398049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-db4bcba6-8611-47de-bc33-ef6af3d5656f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:35.399383 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-f5153b49-49da-4915-946e-4ed585e5b83e None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:52:35.399383 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:35.399383 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:52:35.399383 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:52:35.399383 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:52:35.399383 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:52:35.399383 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:52:35.399383 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:52:35.399383 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:52:35.399383 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:52:35.399383 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:52:35.399383 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:52:35.399383 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:52:35.400609 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:52:35.400609 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:52:35.400609 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:52:35.400609 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:52:35.400609 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:52:35.400609 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:52:35.400609 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:52:35.400609 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:52:35.400609 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:52:35.400609 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:52:35.400609 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:52:35.400609 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:52:35.400609 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:52:35.400609 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:52:35.400609 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:52:35.401853 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2968/5986] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:52:35 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 22 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:52:35.421228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5153b49-49da-4915-946e-4ed585e5b83e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:35.421228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f5153b49-49da-4915-946e-4ed585e5b83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:35.441259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bcba6-8611-47de-bc33-ef6af3d5656f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:35.447333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a7e31-d36a-44b2-8a46-021a2f0f8fd4 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938cdce8858747ffb57d49db9defc4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '938edb15849c46d08a5be2ac829a2887', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:35.449248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a7e31-d36a-44b2-8a46-021a2f0f8fd4 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:35.450409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a7e31-d36a-44b2-8a46-021a2f0f8fd4 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:35.451109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a7e31-d36a-44b2-8a46-021a2f0f8fd4 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:35.452282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a7e31-d36a-44b2-8a46-021a2f0f8fd4 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:35.453743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a7e31-d36a-44b2-8a46-021a2f0f8fd4 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:35.456732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a7e31-d36a-44b2-8a46-021a2f0f8fd4 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:35.482648 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3019/5987] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:35.487685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a7e31-d36a-44b2-8a46-021a2f0f8fd4 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:35.511742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a7e31-d36a-44b2-8a46-021a2f0f8fd4 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:35.518643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee17024-8e42-4498-972b-5149c4af3e23 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938cdce8858747ffb57d49db9defc4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '938edb15849c46d08a5be2ac829a2887', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:35.519460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee17024-8e42-4498-972b-5149c4af3e23 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:35.524258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee17024-8e42-4498-972b-5149c4af3e23 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:35.524258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee17024-8e42-4498-972b-5149c4af3e23 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:35.524258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee17024-8e42-4498-972b-5149c4af3e23 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:35.524258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee17024-8e42-4498-972b-5149c4af3e23 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:35.612655 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3020/5988] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:35 2022] POST /identity/v3/projects => generated 348 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:52:35.620356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee17024-8e42-4498-972b-5149c4af3e23 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:35.629271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5153b49-49da-4915-946e-4ed585e5b83e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:35.774809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee17024-8e42-4498-972b-5149c4af3e23 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:35.777846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cec1d3-64f2-41a0-a0fe-70d967a94549 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938cdce8858747ffb57d49db9defc4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '938edb15849c46d08a5be2ac829a2887', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:35.778596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cec1d3-64f2-41a0-a0fe-70d967a94549 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:35.779065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cec1d3-64f2-41a0-a0fe-70d967a94549 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:35.779449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cec1d3-64f2-41a0-a0fe-70d967a94549 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:35.780321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cec1d3-64f2-41a0-a0fe-70d967a94549 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:35.780744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cec1d3-64f2-41a0-a0fe-70d967a94549 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:35.785358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cec1d3-64f2-41a0-a0fe-70d967a94549 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:35.808775 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3021/5989] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:52:35.849753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cec1d3-64f2-41a0-a0fe-70d967a94549 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:35.852454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-70cec1d3-64f2-41a0-a0fe-70d967a94549 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:35.883577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1c10b-4192-472c-844e-00fddf493e3a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:35.891143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1c10b-4192-472c-844e-00fddf493e3a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:35.892306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1c10b-4192-472c-844e-00fddf493e3a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:35.893237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1c10b-4192-472c-844e-00fddf493e3a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/4a6dc22c0a6b4291b4aa4c6274196a48/users/109ba43ad7b24d83aa375673d0a08816/roles/ad4ce09d0463494092430a3ffe9bef15` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:35.905767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1c10b-4192-472c-844e-00fddf493e3a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=4a6dc22c0a6b4291b4aa4c6274196a48, user_id=109ba43ad7b24d83aa375673d0a08816, role_id=ad4ce09d0463494092430a3ffe9bef15)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:35.920927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1c10b-4192-472c-844e-00fddf493e3a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:35.939418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9fb1c10b-4192-472c-844e-00fddf493e3a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invalidating the token cache because role ad4ce09d0463494092430a3ffe9bef15 was removed from user 109ba43ad7b24d83aa375673d0a08816 on domain 4a6dc22c0a6b4291b4aa4c6274196a48. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:35.940342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9fb1c10b-4192-472c-844e-00fddf493e3a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:35.958232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9fb1c10b-4192-472c-844e-00fddf493e3a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:36.034044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cec1d3-64f2-41a0-a0fe-70d967a94549 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:36.034044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8484a-c478-4f89-bb12-433ba6d6ec90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:36.034044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8484a-c478-4f89-bb12-433ba6d6ec90 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:36.034754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8484a-c478-4f89-bb12-433ba6d6ec90 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:36.036321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8484a-c478-4f89-bb12-433ba6d6ec90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:36.039448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7bc8484a-c478-4f89-bb12-433ba6d6ec90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:36.065575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8484a-c478-4f89-bb12-433ba6d6ec90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:36.068607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8484a-c478-4f89-bb12-433ba6d6ec90 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:36.075490 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2969/5990] 10.222.0.76 () {58 vars in 1464 bytes} [Sat Aug 27 04:52:35 2022] DELETE /identity/v3/domains/4a6dc22c0a6b4291b4aa4c6274196a48/users/109ba43ad7b24d83aa375673d0a08816/roles/ad4ce09d0463494092430a3ffe9bef15 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:36.078603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1c10b-4192-472c-844e-00fddf493e3a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:36.081702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9fb1c10b-4192-472c-844e-00fddf493e3a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:36.091141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:36.101590 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3022/5991] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:52:36.293007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1c10b-4192-472c-844e-00fddf493e3a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:36.305674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc48c4-9d95-4384-ae31-c2f3e262e4b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:36.307112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc48c4-9d95-4384-ae31-c2f3e262e4b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:36.307621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc48c4-9d95-4384-ae31-c2f3e262e4b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:36.308129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc48c4-9d95-4384-ae31-c2f3e262e4b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/roles/ad4ce09d0463494092430a3ffe9bef15` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:36.312006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc48c4-9d95-4384-ae31-c2f3e262e4b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ad4ce09d0463494092430a3ffe9bef15)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:36.317304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc48c4-9d95-4384-ae31-c2f3e262e4b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:36.411918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aaf74-1cd7-476a-8d3a-2fe11eb3573e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:36.412803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aaf74-1cd7-476a-8d3a-2fe11eb3573e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:36.413196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aaf74-1cd7-476a-8d3a-2fe11eb3573e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:36.468632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7f1aaf74-1cd7-476a-8d3a-2fe11eb3573e None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:36.472652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7f1aaf74-1cd7-476a-8d3a-2fe11eb3573e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:36.556237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a9fc48c4-9d95-4384-ae31-c2f3e262e4b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invalidating the token cache because role ad4ce09d0463494092430a3ffe9bef15 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:36.556737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a9fc48c4-9d95-4384-ae31-c2f3e262e4b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:36.558030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a9fc48c4-9d95-4384-ae31-c2f3e262e4b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:36.561576 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2970/5992] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:36 2022] DELETE /identity/v3/roles/ad4ce09d0463494092430a3ffe9bef15 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:36.568057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc48c4-9d95-4384-ae31-c2f3e262e4b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:36.571148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a9fc48c4-9d95-4384-ae31-c2f3e262e4b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:36.580498 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3023/5993] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:36.592303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd0588-6acd-4e83-a56a-a524c55457b1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:36.592663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd0588-6acd-4e83-a56a-a524c55457b1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:36.593862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd0588-6acd-4e83-a56a-a524c55457b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:36.651166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-05fd0588-6acd-4e83-a56a-a524c55457b1 None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:36.656490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-05fd0588-6acd-4e83-a56a-a524c55457b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:36.663351 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3024/5994] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:36 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:36.667791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbab5ed-d7de-4a8f-b15a-87b7c04ebeb8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:36.668200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbab5ed-d7de-4a8f-b15a-87b7c04ebeb8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:36.668579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbab5ed-d7de-4a8f-b15a-87b7c04ebeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:36.743092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:36.770434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc48c4-9d95-4384-ae31-c2f3e262e4b1 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:36.778615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539c589-c412-4ae6-849a-6377a6ea643e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:36.780023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539c589-c412-4ae6-849a-6377a6ea643e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:36.780619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539c589-c412-4ae6-849a-6377a6ea643e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:36.782204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539c589-c412-4ae6-849a-6377a6ea643e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/4a6dc22c0a6b4291b4aa4c6274196a48` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:36.784187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539c589-c412-4ae6-849a-6377a6ea643e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4a6dc22c0a6b4291b4aa4c6274196a48)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:36.806304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539c589-c412-4ae6-849a-6377a6ea643e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:36.836381 n-d-852088-5 devstack@keystone.service[82083]: WARNING keystone.server.flask.application [None req-0fbab5ed-d7de-4a8f-b15a-87b7c04ebeb8 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.76: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 27 04:52:36.836381 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3025/5995] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:36 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 168 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 27 04:52:36.846531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca264e-cd55-4c16-b042-223a4fd808aa None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:36.847257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca264e-cd55-4c16-b042-223a4fd808aa None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:36.851194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca264e-cd55-4c16-b042-223a4fd808aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:36.872920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d539c589-c412-4ae6-849a-6377a6ea643e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4a6dc22c0a6b4291b4aa4c6274196a48'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:36.873801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d539c589-c412-4ae6-849a-6377a6ea643e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4a6dc22c0a6b4291b4aa4c6274196a48'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:37.017067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d539c589-c412-4ae6-849a-6377a6ea643e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4a6dc22c0a6b4291b4aa4c6274196a48'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:37.017689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d539c589-c412-4ae6-849a-6377a6ea643e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4a6dc22c0a6b4291b4aa4c6274196a48'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:37.024145 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2971/5996] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:52:36 2022] PATCH /identity/v3/domains/4a6dc22c0a6b4291b4aa4c6274196a48 => generated 275 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:37.025648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539c589-c412-4ae6-849a-6377a6ea643e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:37.027602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d539c589-c412-4ae6-849a-6377a6ea643e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:37.043233 n-d-852088-5 devstack@keystone.service[82083]: WARNING keystone.server.flask.application [None req-17ca264e-cd55-4c16-b042-223a4fd808aa None None] Authorization failed. The request you have made requires authentication. from 10.222.0.76: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 27 04:52:37.055157 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3026/5997] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:36 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 198 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 27 04:52:37.057063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aecf3-2a77-42bc-bb3b-430380e668eb None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:37.060108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aecf3-2a77-42bc-bb3b-430380e668eb None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:37.060425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aecf3-2a77-42bc-bb3b-430380e668eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:37.104430 n-d-852088-5 devstack@keystone.service[82083]: WARNING keystone.server.flask.application [None req-807aecf3-2a77-42bc-bb3b-430380e668eb None None] Authorization failed. The request you have made requires authentication. from 10.222.0.76: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 27 04:52:37.107641 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3027/5998] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:37 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 52 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 27 04:52:37.167269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539c589-c412-4ae6-849a-6377a6ea643e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:37.181634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:37.182582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:37.183007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:37.184284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/4a6dc22c0a6b4291b4aa4c6274196a48` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:37.208040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4a6dc22c0a6b4291b4aa4c6274196a48)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:37.210406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:37.247852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4a6dc22c0a6b4291b4aa4c6274196a48'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:37.252724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4a6dc22c0a6b4291b4aa4c6274196a48'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:37.291788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:37.470645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a6dc22c0a6b4291b4aa4c6274196a48', 'request_id': 'req-ebeda9eb-1c94-47c0-8140-6ececaa7c776'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:37.498625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a6dc22c0a6b4291b4aa4c6274196a48', 'request_id': 'req-ebeda9eb-1c94-47c0-8140-6ececaa7c776'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:37.508259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807aecf3-2a77-42bc-bb3b-430380e668eb None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:37.510789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-807aecf3-2a77-42bc-bb3b-430380e668eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:37.521918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a6dc22c0a6b4291b4aa4c6274196a48', 'request_id': 'req-ebeda9eb-1c94-47c0-8140-6ececaa7c776'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:37.619917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] The token cache is being invalidate because project 4a6dc22c0a6b4291b4aa4c6274196a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:37.620536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:37.621798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:37.639938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4a6dc22c0a6b4291b4aa4c6274196a48', 'request_id': 'req-ebeda9eb-1c94-47c0-8140-6ececaa7c776'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:37.646435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4a6dc22c0a6b4291b4aa4c6274196a48', 'request_id': 'req-ebeda9eb-1c94-47c0-8140-6ececaa7c776'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:37.654206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4a6dc22c0a6b4291b4aa4c6274196a48', 'request_id': 'req-ebeda9eb-1c94-47c0-8140-6ececaa7c776'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:37.674673 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2972/5999] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:52:37 2022] DELETE /identity/v3/domains/4a6dc22c0a6b4291b4aa4c6274196a48 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:37.684821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:37.688623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:37.692942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807aecf3-2a77-42bc-bb3b-430380e668eb None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:37.710192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d43c7-ccfa-4e49-8e3c-19be6dda5ef3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:37.710871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d43c7-ccfa-4e49-8e3c-19be6dda5ef3 service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:37.711149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d43c7-ccfa-4e49-8e3c-19be6dda5ef3 service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:37.711422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d43c7-ccfa-4e49-8e3c-19be6dda5ef3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:37.714910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-195d43c7-ccfa-4e49-8e3c-19be6dda5ef3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:37.751070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d43c7-ccfa-4e49-8e3c-19be6dda5ef3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:37.752914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d43c7-ccfa-4e49-8e3c-19be6dda5ef3 service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:37.775986 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3028/6000] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:52:37.859808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:37.890086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeda9eb-1c94-47c0-8140-6ececaa7c776 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:37.906177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91350aa-612b-4130-8c1a-9417b0de4625 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:37.908590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91350aa-612b-4130-8c1a-9417b0de4625 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:37.911504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91350aa-612b-4130-8c1a-9417b0de4625 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:37.911504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91350aa-612b-4130-8c1a-9417b0de4625 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:37.911504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91350aa-612b-4130-8c1a-9417b0de4625 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:37.920883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91350aa-612b-4130-8c1a-9417b0de4625 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:37.969790 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2973/6001] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:37.973863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d43c7-ccfa-4e49-8e3c-19be6dda5ef3 service placement] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:37.993590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d43c7-ccfa-4e49-8e3c-19be6dda5ef3 service placement] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:38.009388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e860030-f2c3-4389-872b-23141222c869 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:38.010120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e860030-f2c3-4389-872b-23141222c869 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:38.010403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e860030-f2c3-4389-872b-23141222c869 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:38.010677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e860030-f2c3-4389-872b-23141222c869 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/projects/e33f1e5540984e409e0091e6ae1dd080/users/29061152a40742f58eae6f0acd7fb422/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:38.013732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e860030-f2c3-4389-872b-23141222c869 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e33f1e5540984e409e0091e6ae1dd080, user_id=29061152a40742f58eae6f0acd7fb422, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:38.017066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e860030-f2c3-4389-872b-23141222c869 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:38.130081 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3029/6002] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:37 2022] PUT /identity/v3/projects/e33f1e5540984e409e0091e6ae1dd080/users/29061152a40742f58eae6f0acd7fb422/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:38.131692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91350aa-612b-4130-8c1a-9417b0de4625 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:38.141581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:38.152487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91350aa-612b-4130-8c1a-9417b0de4625 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:38.264473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bad046-dcf5-4901-8a44-8ffc8af0d7f7 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:38.264883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bad046-dcf5-4901-8a44-8ffc8af0d7f7 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:38.265135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bad046-dcf5-4901-8a44-8ffc8af0d7f7 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:38.265414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bad046-dcf5-4901-8a44-8ffc8af0d7f7 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:38.265995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bad046-dcf5-4901-8a44-8ffc8af0d7f7 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:38.267147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bad046-dcf5-4901-8a44-8ffc8af0d7f7 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:38.353870 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2974/6003] 10.222.0.76 () {58 vars in 1146 bytes} [Sat Aug 27 04:52:38 2022] GET /identity/v3/auth/projects => generated 826 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:52:38.358394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e860030-f2c3-4389-872b-23141222c869 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:38.371498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e860030-f2c3-4389-872b-23141222c869 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:38.378472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44fc06-6451-457c-ba99-30343471e481 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:38.379979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44fc06-6451-457c-ba99-30343471e481 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:38.380419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44fc06-6451-457c-ba99-30343471e481 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:38.380883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44fc06-6451-457c-ba99-30343471e481 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/projects/e33f1e5540984e409e0091e6ae1dd080/users/29061152a40742f58eae6f0acd7fb422/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:38.382995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44fc06-6451-457c-ba99-30343471e481 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=e33f1e5540984e409e0091e6ae1dd080, user_id=29061152a40742f58eae6f0acd7fb422, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:38.386765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44fc06-6451-457c-ba99-30343471e481 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:38.399681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ac44fc06-6451-457c-ba99-30343471e481 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invalidating the token cache because role 0957af53dfcc4cfc8cf7947a65ecfabc was removed from user 29061152a40742f58eae6f0acd7fb422 on project e33f1e5540984e409e0091e6ae1dd080. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:38.400137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ac44fc06-6451-457c-ba99-30343471e481 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:38.401161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ac44fc06-6451-457c-ba99-30343471e481 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:38.510626 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3030/6004] 10.222.0.76 () {58 vars in 1467 bytes} [Sat Aug 27 04:52:38 2022] DELETE /identity/v3/projects/e33f1e5540984e409e0091e6ae1dd080/users/29061152a40742f58eae6f0acd7fb422/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:38.515855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bad046-dcf5-4901-8a44-8ffc8af0d7f7 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:38.518117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-34bad046-dcf5-4901-8a44-8ffc8af0d7f7 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:38.546175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bad046-dcf5-4901-8a44-8ffc8af0d7f7 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:38.720191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d304b-78ae-4c49-b1db-853ce2e75c50 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:38.720191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d304b-78ae-4c49-b1db-853ce2e75c50 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:38.720191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d304b-78ae-4c49-b1db-853ce2e75c50 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:38.720722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d304b-78ae-4c49-b1db-853ce2e75c50 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:38.721162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d304b-78ae-4c49-b1db-853ce2e75c50 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:38.728541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d304b-78ae-4c49-b1db-853ce2e75c50 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:38.873437 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2975/6005] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:38 2022] POST /identity/v3/users => generated 323 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:38.874693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44fc06-6451-457c-ba99-30343471e481 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:38.905698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44fc06-6451-457c-ba99-30343471e481 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:38.916054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec8b65-09ab-4955-8040-d0217c3df847 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:38.916941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec8b65-09ab-4955-8040-d0217c3df847 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:38.917293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec8b65-09ab-4955-8040-d0217c3df847 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:38.917762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec8b65-09ab-4955-8040-d0217c3df847 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:38.918480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec8b65-09ab-4955-8040-d0217c3df847 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:38.920979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec8b65-09ab-4955-8040-d0217c3df847 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:39.039241 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3031/6006] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:38 2022] POST /identity/v3/projects => generated 363 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:39.041966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d304b-78ae-4c49-b1db-853ce2e75c50 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:39.073185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d304b-78ae-4c49-b1db-853ce2e75c50 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:39.148405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:39.195855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:39.266451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753677c8-184e-4a2a-97ca-6688fffedb90 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:39.267083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753677c8-184e-4a2a-97ca-6688fffedb90 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:39.267366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753677c8-184e-4a2a-97ca-6688fffedb90 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:39.267645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753677c8-184e-4a2a-97ca-6688fffedb90 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:39.268319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753677c8-184e-4a2a-97ca-6688fffedb90 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:39.271039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753677c8-184e-4a2a-97ca-6688fffedb90 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:39.409906 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2976/6007] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:39 2022] POST /identity/v3/projects => generated 363 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:39.414922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec8b65-09ab-4955-8040-d0217c3df847 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:39.449746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec8b65-09ab-4955-8040-d0217c3df847 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:39.637727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918be33-125d-469b-9d34-bbf1f3f6a802 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:39.638487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918be33-125d-469b-9d34-bbf1f3f6a802 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:39.638836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918be33-125d-469b-9d34-bbf1f3f6a802 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:39.641011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918be33-125d-469b-9d34-bbf1f3f6a802 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:39.641532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918be33-125d-469b-9d34-bbf1f3f6a802 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:39.647202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918be33-125d-469b-9d34-bbf1f3f6a802 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:39.759273 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3032/6008] 10.222.0.76 () {60 vars in 1143 bytes} [Sat Aug 27 04:52:39 2022] POST /identity/v3/roles => generated 240 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:39.763446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753677c8-184e-4a2a-97ca-6688fffedb90 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:39.781173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753677c8-184e-4a2a-97ca-6688fffedb90 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:39.795899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab9e31-2e9e-47ea-bd2b-56029466bebb tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:39.796629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab9e31-2e9e-47ea-bd2b-56029466bebb tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:39.802728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab9e31-2e9e-47ea-bd2b-56029466bebb tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:39.802728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab9e31-2e9e-47ea-bd2b-56029466bebb tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/projects/4123b8aece9542c1bc553b3068b17a87/users/e4d516b51ce740d79e5284d8f4c51a9b/roles/e9254f6b0604461c8c7231d816745429` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:39.832053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab9e31-2e9e-47ea-bd2b-56029466bebb tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4123b8aece9542c1bc553b3068b17a87, user_id=e4d516b51ce740d79e5284d8f4c51a9b, role_id=e9254f6b0604461c8c7231d816745429)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:39.840709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab9e31-2e9e-47ea-bd2b-56029466bebb tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:39.962538 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2977/6009] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:39 2022] PUT /identity/v3/projects/4123b8aece9542c1bc553b3068b17a87/users/e4d516b51ce740d79e5284d8f4c51a9b/roles/e9254f6b0604461c8c7231d816745429 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:39.970619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918be33-125d-469b-9d34-bbf1f3f6a802 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:39.984892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918be33-125d-469b-9d34-bbf1f3f6a802 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:40.152692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce7640-3034-4bf6-a6a6-cbb94881adc0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:40.153846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce7640-3034-4bf6-a6a6-cbb94881adc0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:40.154378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce7640-3034-4bf6-a6a6-cbb94881adc0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:40.154871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce7640-3034-4bf6-a6a6-cbb94881adc0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/projects/3e27a33835cf40bfbb5c987abd63109c/users/e4d516b51ce740d79e5284d8f4c51a9b/roles/e9254f6b0604461c8c7231d816745429` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:40.157492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce7640-3034-4bf6-a6a6-cbb94881adc0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3e27a33835cf40bfbb5c987abd63109c, user_id=e4d516b51ce740d79e5284d8f4c51a9b, role_id=e9254f6b0604461c8c7231d816745429)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:40.163139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce7640-3034-4bf6-a6a6-cbb94881adc0 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:40.273722 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3033/6010] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:39 2022] PUT /identity/v3/projects/3e27a33835cf40bfbb5c987abd63109c/users/e4d516b51ce740d79e5284d8f4c51a9b/roles/e9254f6b0604461c8c7231d816745429 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:40.279384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a09d1-d2c0-47cb-9e2c-91f88feb3204 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:40.279768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a09d1-d2c0-47cb-9e2c-91f88feb3204 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:40.281663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a09d1-d2c0-47cb-9e2c-91f88feb3204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:40.354723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b63a09d1-d2c0-47cb-9e2c-91f88feb3204 None None] MFA Rules not processed for user `e4d516b51ce740d79e5284d8f4c51a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:40.356497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b63a09d1-d2c0-47cb-9e2c-91f88feb3204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:40.373822 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2978/6011] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:40 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:40.375168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354c2bf-c831-40fd-9ea9-6112b4dc3aba None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:40.375688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354c2bf-c831-40fd-9ea9-6112b4dc3aba None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:40.375826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354c2bf-c831-40fd-9ea9-6112b4dc3aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:40.397392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f354c2bf-c831-40fd-9ea9-6112b4dc3aba None None] MFA Rules not processed for user `e4d516b51ce740d79e5284d8f4c51a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:40.398963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f354c2bf-c831-40fd-9ea9-6112b4dc3aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:40.416618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:40.507985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:40.576515 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3034/6012] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:40 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Aug 27 04:52:40.581361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a09d1-d2c0-47cb-9e2c-91f88feb3204 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:40.725047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a09d1-d2c0-47cb-9e2c-91f88feb3204 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:40.736756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9e16f-e0a3-4421-818b-53d64e726527 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:40.737399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9e16f-e0a3-4421-818b-53d64e726527 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:40.737687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9e16f-e0a3-4421-818b-53d64e726527 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:40.738009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9e16f-e0a3-4421-818b-53d64e726527 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:40.757081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9e16f-e0a3-4421-818b-53d64e726527 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:40.759715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9e16f-e0a3-4421-818b-53d64e726527 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:40.899325 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2979/6013] 10.222.0.76 () {56 vars in 1308 bytes} [Sat Aug 27 04:52:40 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:40.904876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e3bfe-d8a6-479a-88c0-f4c36a770ae3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:40.905361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e3bfe-d8a6-479a-88c0-f4c36a770ae3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:40.905453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e3bfe-d8a6-479a-88c0-f4c36a770ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:40.936469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b64e3bfe-d8a6-479a-88c0-f4c36a770ae3 None None] MFA Rules not processed for user `e4d516b51ce740d79e5284d8f4c51a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:40.936469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b64e3bfe-d8a6-479a-88c0-f4c36a770ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:41.089306 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3035/6014] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:40 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 27 04:52:41.093558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9e16f-e0a3-4421-818b-53d64e726527 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:41.104781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9e16f-e0a3-4421-818b-53d64e726527 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:41.126901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb379c6c-83e1-4311-a954-85408bdc96d6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:41.127562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb379c6c-83e1-4311-a954-85408bdc96d6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:41.127846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb379c6c-83e1-4311-a954-85408bdc96d6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:41.128125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb379c6c-83e1-4311-a954-85408bdc96d6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/roles/e9254f6b0604461c8c7231d816745429` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:41.130153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb379c6c-83e1-4311-a954-85408bdc96d6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e9254f6b0604461c8c7231d816745429)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:41.131838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb379c6c-83e1-4311-a954-85408bdc96d6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:41.379099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-eb379c6c-83e1-4311-a954-85408bdc96d6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invalidating the token cache because role e9254f6b0604461c8c7231d816745429 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:41.379889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-eb379c6c-83e1-4311-a954-85408bdc96d6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:41.380654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-eb379c6c-83e1-4311-a954-85408bdc96d6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:41.388615 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2980/6015] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:41 2022] DELETE /identity/v3/roles/e9254f6b0604461c8c7231d816745429 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:41.389454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e3bfe-d8a6-479a-88c0-f4c36a770ae3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:41.403197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e3bfe-d8a6-479a-88c0-f4c36a770ae3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:41.494150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f95853-197d-4c48-9f54-3ce95bc07064 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:41.499296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f95853-197d-4c48-9f54-3ce95bc07064 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:41.499896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f95853-197d-4c48-9f54-3ce95bc07064 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:41.500566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f95853-197d-4c48-9f54-3ce95bc07064 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/projects/3e27a33835cf40bfbb5c987abd63109c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:41.504251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f95853-197d-4c48-9f54-3ce95bc07064 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3e27a33835cf40bfbb5c987abd63109c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:41.512448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f95853-197d-4c48-9f54-3ce95bc07064 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:41.622036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:41.681330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-69f95853-197d-4c48-9f54-3ce95bc07064 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e27a33835cf40bfbb5c987abd63109c', 'request_id': 'req-69f95853-197d-4c48-9f54-3ce95bc07064'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:41.697182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-69f95853-197d-4c48-9f54-3ce95bc07064 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e27a33835cf40bfbb5c987abd63109c', 'request_id': 'req-69f95853-197d-4c48-9f54-3ce95bc07064'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:41.804135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-69f95853-197d-4c48-9f54-3ce95bc07064 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e27a33835cf40bfbb5c987abd63109c', 'request_id': 'req-69f95853-197d-4c48-9f54-3ce95bc07064'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:41.835899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-69f95853-197d-4c48-9f54-3ce95bc07064 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] The token cache is being invalidate because project 3e27a33835cf40bfbb5c987abd63109c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:41.837726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-69f95853-197d-4c48-9f54-3ce95bc07064 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:41.838881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-69f95853-197d-4c48-9f54-3ce95bc07064 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:41.845469 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3036/6016] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:41 2022] DELETE /identity/v3/projects/3e27a33835cf40bfbb5c987abd63109c => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:52:41.845757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb379c6c-83e1-4311-a954-85408bdc96d6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:41.847257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-eb379c6c-83e1-4311-a954-85408bdc96d6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:41.871008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb379c6c-83e1-4311-a954-85408bdc96d6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:42.030289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53710cd7-0c5c-4c91-919b-02b621259ea3 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:42.030990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53710cd7-0c5c-4c91-919b-02b621259ea3 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:42.031210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53710cd7-0c5c-4c91-919b-02b621259ea3 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:42.031687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53710cd7-0c5c-4c91-919b-02b621259ea3 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/projects/3e27a33835cf40bfbb5c987abd63109c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:42.045185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53710cd7-0c5c-4c91-919b-02b621259ea3 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3e27a33835cf40bfbb5c987abd63109c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:42.051701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53710cd7-0c5c-4c91-919b-02b621259ea3 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:42.064786 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-53710cd7-0c5c-4c91-919b-02b621259ea3 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Could not find project: 3e27a33835cf40bfbb5c987abd63109c.: keystone.exception.ProjectNotFound: Could not find project: 3e27a33835cf40bfbb5c987abd63109c. Aug 27 04:52:42.064786 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:42.064786 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:52:42.064786 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:52:42.064786 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:52:42.064786 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:52:42.064786 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:52:42.064786 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:52:42.064786 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:52:42.064786 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:52:42.064786 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:52:42.064786 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:52:42.064786 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 27 04:52:42.064786 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 27 04:52:42.066016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:42.066016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:42.066016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 27 04:52:42.066016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 27 04:52:42.066016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:52:42.066016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:52:42.066016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:52:42.066016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:52:42.066016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3e27a33835cf40bfbb5c987abd63109c. Aug 27 04:52:42.066016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:52:42.069442 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2981/6017] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:41 2022] DELETE /identity/v3/projects/3e27a33835cf40bfbb5c987abd63109c => generated 113 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:52:42.073343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f95853-197d-4c48-9f54-3ce95bc07064 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:42.074827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-69f95853-197d-4c48-9f54-3ce95bc07064 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:42.096185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f95853-197d-4c48-9f54-3ce95bc07064 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:42.107524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbaa547-5912-4b75-bd6c-85db90fe947e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:42.115031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaa547-5912-4b75-bd6c-85db90fe947e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:42.115031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaa547-5912-4b75-bd6c-85db90fe947e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:42.115031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaa547-5912-4b75-bd6c-85db90fe947e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/projects/4123b8aece9542c1bc553b3068b17a87` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:42.115031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbaa547-5912-4b75-bd6c-85db90fe947e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4123b8aece9542c1bc553b3068b17a87)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:42.115031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbaa547-5912-4b75-bd6c-85db90fe947e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:42.159676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:42.299083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4dbaa547-5912-4b75-bd6c-85db90fe947e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4123b8aece9542c1bc553b3068b17a87', 'request_id': 'req-4dbaa547-5912-4b75-bd6c-85db90fe947e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:42.302436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53710cd7-0c5c-4c91-919b-02b621259ea3 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:42.304268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-53710cd7-0c5c-4c91-919b-02b621259ea3 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:42.322509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4dbaa547-5912-4b75-bd6c-85db90fe947e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4123b8aece9542c1bc553b3068b17a87', 'request_id': 'req-4dbaa547-5912-4b75-bd6c-85db90fe947e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:42.408389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4dbaa547-5912-4b75-bd6c-85db90fe947e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4123b8aece9542c1bc553b3068b17a87', 'request_id': 'req-4dbaa547-5912-4b75-bd6c-85db90fe947e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:42.429216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4dbaa547-5912-4b75-bd6c-85db90fe947e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] The token cache is being invalidate because project 4123b8aece9542c1bc553b3068b17a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:42.430218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4dbaa547-5912-4b75-bd6c-85db90fe947e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:42.436709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4dbaa547-5912-4b75-bd6c-85db90fe947e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:42.439126 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3037/6018] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:42 2022] DELETE /identity/v3/projects/4123b8aece9542c1bc553b3068b17a87 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:42.442350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53710cd7-0c5c-4c91-919b-02b621259ea3 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:42.444133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbaa547-5912-4b75-bd6c-85db90fe947e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:42.445966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4dbaa547-5912-4b75-bd6c-85db90fe947e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:42.582506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938cdce8858747ffb57d49db9defc4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '938edb15849c46d08a5be2ac829a2887', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:42.583340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:42.583695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:42.584276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] PATH_INFO: `/v3/projects/b84135ac44cc4192a49b5e3b8f9236c3` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:42.586434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b84135ac44cc4192a49b5e3b8f9236c3)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:42.592457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:42.600636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbaa547-5912-4b75-bd6c-85db90fe947e tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:42.623390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0bd09-6b3e-47cb-9cc0-280eefb5293f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:42.631428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0bd09-6b3e-47cb-9cc0-280eefb5293f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:42.631428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0bd09-6b3e-47cb-9cc0-280eefb5293f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:42.631428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0bd09-6b3e-47cb-9cc0-280eefb5293f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/users/e4d516b51ce740d79e5284d8f4c51a9b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:42.631428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0bd09-6b3e-47cb-9cc0-280eefb5293f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e4d516b51ce740d79e5284d8f4c51a9b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:42.632407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0bd09-6b3e-47cb-9cc0-280eefb5293f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:42.778973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84135ac44cc4192a49b5e3b8f9236c3', 'request_id': 'req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:42.787237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84135ac44cc4192a49b5e3b8f9236c3', 'request_id': 'req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:42.802510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84135ac44cc4192a49b5e3b8f9236c3', 'request_id': 'req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:42.835668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61c0bd09-6b3e-47cb-9cc0-280eefb5293f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d516b51ce740d79e5284d8f4c51a9b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:42.843531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61c0bd09-6b3e-47cb-9cc0-280eefb5293f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d516b51ce740d79e5284d8f4c51a9b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:43.046208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] The token cache is being invalidate because project b84135ac44cc4192a49b5e3b8f9236c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:43.049777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:43.049777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:43.051336 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2982/6019] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:42 2022] DELETE /identity/v3/projects/b84135ac44cc4192a49b5e3b8f9236c3 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:43.056677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:43.058771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:43.181964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61c0bd09-6b3e-47cb-9cc0-280eefb5293f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d516b51ce740d79e5284d8f4c51a9b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:43.186513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61c0bd09-6b3e-47cb-9cc0-280eefb5293f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d516b51ce740d79e5284d8f4c51a9b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:43.212428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61c0bd09-6b3e-47cb-9cc0-280eefb5293f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d516b51ce740d79e5284d8f4c51a9b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:43.259905 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3038/6020] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:42 2022] DELETE /identity/v3/users/e4d516b51ce740d79e5284d8f4c51a9b => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:52:43.265584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0bd09-6b3e-47cb-9cc0-280eefb5293f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:43.267079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea3d8a-786b-4179-b3da-0b8fa4aa2bc7 tempest-QuotasNegativeTest-853301104 tempest-QuotasNegativeTest-853301104-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:43.267664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-61c0bd09-6b3e-47cb-9cc0-280eefb5293f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:43.364981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5588daa-7bcc-4838-801c-962f6fded3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:43.365641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5588daa-7bcc-4838-801c-962f6fded3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:43.365925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5588daa-7bcc-4838-801c-962f6fded3da admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:43.366202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5588daa-7bcc-4838-801c-962f6fded3da admin admin] PATH_INFO: `/v3/users/9c7b499281b747f8b3e98df2a33baf16` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:43.371965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5588daa-7bcc-4838-801c-962f6fded3da admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c7b499281b747f8b3e98df2a33baf16)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:43.374086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5588daa-7bcc-4838-801c-962f6fded3da admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:43.432644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0bd09-6b3e-47cb-9cc0-280eefb5293f tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:43.443561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab04dc1-8e60-40cb-973d-88f386b678f6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:43.448513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab04dc1-8e60-40cb-973d-88f386b678f6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:43.448829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab04dc1-8e60-40cb-973d-88f386b678f6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:43.449315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab04dc1-8e60-40cb-973d-88f386b678f6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/68b4e6cbfebe4df69e0b855f024462be` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:43.471886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab04dc1-8e60-40cb-973d-88f386b678f6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:52:43.480280 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-aab04dc1-8e60-40cb-973d-88f386b678f6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Could not find domain: 68b4e6cbfebe4df69e0b855f024462be.: keystone.exception.DomainNotFound: Could not find domain: 68b4e6cbfebe4df69e0b855f024462be. Aug 27 04:52:43.480280 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:43.480280 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:52:43.480280 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:52:43.480280 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:52:43.480280 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:52:43.480280 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:52:43.480280 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:52:43.480280 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 68b4e6cbfebe4df69e0b855f024462be. Aug 27 04:52:43.480280 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:43.480280 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:52:43.480280 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:43.480280 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:43.480280 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:52:43.480280 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:52:43.480280 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:52:43.482458 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:52:43.482458 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:52:43.482458 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:52:43.482458 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:52:43.482458 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:52:43.482458 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:52:43.482458 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:52:43.482458 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 27 04:52:43.482458 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 27 04:52:43.482458 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:52:43.482458 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:52:43.482458 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:52:43.482458 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:52:43.482458 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:43.482458 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:43.482458 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:52:43.483605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:52:43.483605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:52:43.483605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:52:43.483605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:52:43.483605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:52:43.483605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:52:43.483605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:52:43.483605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:52:43.483605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:52:43.483605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:52:43.483605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:52:43.483605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:52:43.483605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:52:43.483605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:52:43.483605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:52:43.483605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 68b4e6cbfebe4df69e0b855f024462be. Aug 27 04:52:43.483605 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:43.493985 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3039/6021] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:52:43 2022] PATCH /identity/v3/domains/68b4e6cbfebe4df69e0b855f024462be => generated 112 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 27 04:52:43.495180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab04dc1-8e60-40cb-973d-88f386b678f6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:43.508432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab04dc1-8e60-40cb-973d-88f386b678f6 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:43.513669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c52fc-b1b8-4560-b300-d17ce93f9e9a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:43.514573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c52fc-b1b8-4560-b300-d17ce93f9e9a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:43.515299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c52fc-b1b8-4560-b300-d17ce93f9e9a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:43.515801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c52fc-b1b8-4560-b300-d17ce93f9e9a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/1e8d1efcfbc145fdb9c606927c89f560` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:43.528680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c52fc-b1b8-4560-b300-d17ce93f9e9a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:52:43.537142 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-6c3c52fc-b1b8-4560-b300-d17ce93f9e9a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Could not find domain: 1e8d1efcfbc145fdb9c606927c89f560.: keystone.exception.DomainNotFound: Could not find domain: 1e8d1efcfbc145fdb9c606927c89f560. Aug 27 04:52:43.537142 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:43.537142 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:52:43.537142 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:52:43.537142 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:52:43.537142 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:52:43.537142 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:52:43.537142 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:52:43.537142 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1e8d1efcfbc145fdb9c606927c89f560. Aug 27 04:52:43.537142 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:43.537142 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:52:43.537142 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:43.537142 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:43.537142 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:52:43.537142 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:52:43.537142 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:52:43.538347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:52:43.538347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:52:43.538347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:52:43.538347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:52:43.538347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:52:43.538347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:52:43.538347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:52:43.538347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 27 04:52:43.538347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 27 04:52:43.538347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:52:43.538347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:52:43.538347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:52:43.538347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:52:43.538347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:43.538347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:43.538347 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:52:43.539429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:52:43.539429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:52:43.539429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:52:43.539429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:52:43.539429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:52:43.539429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:52:43.539429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:52:43.539429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:52:43.539429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:52:43.539429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:52:43.539429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:52:43.539429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:52:43.539429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:52:43.539429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:52:43.539429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:52:43.539429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1e8d1efcfbc145fdb9c606927c89f560. Aug 27 04:52:43.539429 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:43.544917 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3040/6022] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:52:43 2022] PATCH /identity/v3/domains/1e8d1efcfbc145fdb9c606927c89f560 => generated 112 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:52:43.548659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c52fc-b1b8-4560-b300-d17ce93f9e9a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:43.575578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c52fc-b1b8-4560-b300-d17ce93f9e9a tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:43.589054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd594ae-596e-490d-bbf6-18d60c1c7624 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:43.590026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd594ae-596e-490d-bbf6-18d60c1c7624 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:43.590534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd594ae-596e-490d-bbf6-18d60c1c7624 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:43.591075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd594ae-596e-490d-bbf6-18d60c1c7624 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/68f44c39b4b948829a9b10b82f4506fb` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:43.609523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd594ae-596e-490d-bbf6-18d60c1c7624 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:52:43.624512 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-fdd594ae-596e-490d-bbf6-18d60c1c7624 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Could not find domain: 68f44c39b4b948829a9b10b82f4506fb.: keystone.exception.DomainNotFound: Could not find domain: 68f44c39b4b948829a9b10b82f4506fb. Aug 27 04:52:43.624512 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:43.624512 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:52:43.624512 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:52:43.624512 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:52:43.624512 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:52:43.624512 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:52:43.624512 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:52:43.624512 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 68f44c39b4b948829a9b10b82f4506fb. Aug 27 04:52:43.624512 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:43.624512 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:52:43.624512 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:43.624512 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:43.624512 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:52:43.624512 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:52:43.624512 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:52:43.625790 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:52:43.625790 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:52:43.625790 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:52:43.625790 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:52:43.625790 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:52:43.625790 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:52:43.625790 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:52:43.625790 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 27 04:52:43.625790 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 27 04:52:43.625790 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:52:43.625790 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:52:43.625790 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:52:43.625790 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:52:43.625790 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:43.625790 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:43.625790 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:52:43.626897 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:52:43.626897 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:52:43.626897 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:52:43.626897 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:52:43.626897 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:52:43.626897 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:52:43.626897 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:52:43.626897 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:52:43.626897 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:52:43.626897 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:52:43.626897 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:52:43.626897 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:52:43.626897 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:52:43.626897 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:52:43.626897 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:52:43.626897 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 68f44c39b4b948829a9b10b82f4506fb. Aug 27 04:52:43.626897 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:43.640104 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3041/6023] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:52:43 2022] PATCH /identity/v3/domains/68f44c39b4b948829a9b10b82f4506fb => generated 112 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:52:43.651883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd594ae-596e-490d-bbf6-18d60c1c7624 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:43.665918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b5588daa-7bcc-4838-801c-962f6fded3da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c7b499281b747f8b3e98df2a33baf16'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:43.682086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd594ae-596e-490d-bbf6-18d60c1c7624 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:43.688061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70a5d3-6dc7-4d39-b2de-7e0d32f98ec9 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29061152a40742f58eae6f0acd7fb422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54efbd5b01ec4261b01f8085dd41adda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:43.688754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70a5d3-6dc7-4d39-b2de-7e0d32f98ec9 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:43.689705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70a5d3-6dc7-4d39-b2de-7e0d32f98ec9 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:43.689992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70a5d3-6dc7-4d39-b2de-7e0d32f98ec9 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] PATH_INFO: `/v3/domains/4a6dc22c0a6b4291b4aa4c6274196a48` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:43.702484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:43.702679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70a5d3-6dc7-4d39-b2de-7e0d32f98ec9 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:52:43.717502 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-9f70a5d3-6dc7-4d39-b2de-7e0d32f98ec9 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Could not find domain: 4a6dc22c0a6b4291b4aa4c6274196a48.: keystone.exception.DomainNotFound: Could not find domain: 4a6dc22c0a6b4291b4aa4c6274196a48. Aug 27 04:52:43.717502 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:43.717502 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:52:43.717502 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:52:43.717502 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:52:43.717502 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:52:43.717502 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:52:43.717502 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:52:43.717502 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4a6dc22c0a6b4291b4aa4c6274196a48. Aug 27 04:52:43.717502 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:43.717502 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:52:43.717502 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:43.717502 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:43.717502 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:52:43.717502 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:52:43.717502 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:52:43.718941 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:52:43.718941 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:52:43.718941 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:52:43.718941 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:52:43.718941 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:52:43.718941 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:52:43.718941 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:52:43.718941 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 27 04:52:43.718941 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 27 04:52:43.718941 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:52:43.718941 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:52:43.718941 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:52:43.718941 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:52:43.718941 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:43.718941 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:43.718941 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:52:43.720263 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:52:43.720263 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:52:43.720263 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:52:43.720263 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:52:43.720263 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:52:43.720263 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:52:43.720263 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:52:43.720263 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:52:43.720263 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:52:43.720263 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:52:43.720263 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:52:43.720263 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:52:43.720263 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:52:43.720263 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:52:43.720263 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:52:43.720263 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4a6dc22c0a6b4291b4aa4c6274196a48. Aug 27 04:52:43.720263 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:52:43.726034 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3042/6024] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:52:43 2022] PATCH /identity/v3/domains/4a6dc22c0a6b4291b4aa4c6274196a48 => generated 112 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:52:43.727995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70a5d3-6dc7-4d39-b2de-7e0d32f98ec9 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:43.731323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9f70a5d3-6dc7-4d39-b2de-7e0d32f98ec9 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:43.754616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70a5d3-6dc7-4d39-b2de-7e0d32f98ec9 tempest-TokensV3TestJSON-779494199 tempest-TokensV3TestJSON-779494199-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:43.760933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9769e-7be9-41a6-b249-ec24a124840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:43.761581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9769e-7be9-41a6-b249-ec24a124840a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:43.761863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9769e-7be9-41a6-b249-ec24a124840a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:43.762139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9769e-7be9-41a6-b249-ec24a124840a admin admin] PATH_INFO: `/v3/users/fb5afdde47ba4b85beff39a0d23d8f25` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:43.765608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9769e-7be9-41a6-b249-ec24a124840a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5afdde47ba4b85beff39a0d23d8f25)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:43.770140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9769e-7be9-41a6-b249-ec24a124840a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:43.777648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b5588daa-7bcc-4838-801c-962f6fded3da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c7b499281b747f8b3e98df2a33baf16'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:43.778717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b5588daa-7bcc-4838-801c-962f6fded3da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c7b499281b747f8b3e98df2a33baf16'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:43.796541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b5588daa-7bcc-4838-801c-962f6fded3da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c7b499281b747f8b3e98df2a33baf16'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:43.797293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:43.840059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b5588daa-7bcc-4838-801c-962f6fded3da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c7b499281b747f8b3e98df2a33baf16'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:43.858615 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2983/6025] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:43 2022] DELETE /identity/v3/users/9c7b499281b747f8b3e98df2a33baf16 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:52:43.876021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d33193-6a16-4cc1-9e72-91913730a910 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:43.878532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d33193-6a16-4cc1-9e72-91913730a910 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:43.878825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d33193-6a16-4cc1-9e72-91913730a910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:43.921178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-64d33193-6a16-4cc1-9e72-91913730a910 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:43.922432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-64d33193-6a16-4cc1-9e72-91913730a910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:44.083501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9cc9769e-7be9-41a6-b249-ec24a124840a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5afdde47ba4b85beff39a0d23d8f25'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:44.085489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9cc9769e-7be9-41a6-b249-ec24a124840a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5afdde47ba4b85beff39a0d23d8f25'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:44.102998 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2984/6026] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:44.148827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d33193-6a16-4cc1-9e72-91913730a910 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:44.150604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-64d33193-6a16-4cc1-9e72-91913730a910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:44.164546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9cc9769e-7be9-41a6-b249-ec24a124840a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5afdde47ba4b85beff39a0d23d8f25'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:44.165282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9cc9769e-7be9-41a6-b249-ec24a124840a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5afdde47ba4b85beff39a0d23d8f25'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:44.181501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9cc9769e-7be9-41a6-b249-ec24a124840a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5afdde47ba4b85beff39a0d23d8f25'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:44.222024 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3043/6027] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:43 2022] DELETE /identity/v3/users/fb5afdde47ba4b85beff39a0d23d8f25 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:44.223890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ab60b-4503-4f4b-9537-f5d31b92253f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:44.251589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ab60b-4503-4f4b-9537-f5d31b92253f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:44.251589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ab60b-4503-4f4b-9537-f5d31b92253f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:44.298353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-882ab60b-4503-4f4b-9537-f5d31b92253f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:44.299921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-882ab60b-4503-4f4b-9537-f5d31b92253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:44.315018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d33193-6a16-4cc1-9e72-91913730a910 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:44.409539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b34c9-471e-414d-b1a8-3bc796ea490e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:44.411803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b34c9-471e-414d-b1a8-3bc796ea490e service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:44.412463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b34c9-471e-414d-b1a8-3bc796ea490e service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:44.417236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b34c9-471e-414d-b1a8-3bc796ea490e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:44.417236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fc1b34c9-471e-414d-b1a8-3bc796ea490e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:44.423997 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3044/6028] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:44.439504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b34c9-471e-414d-b1a8-3bc796ea490e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:44.443352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b34c9-471e-414d-b1a8-3bc796ea490e service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:44.477100 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2985/6029] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:44.575436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ab60b-4503-4f4b-9537-f5d31b92253f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:44.577134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-882ab60b-4503-4f4b-9537-f5d31b92253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:44.611411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ab60b-4503-4f4b-9537-f5d31b92253f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:44.622688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00e88e-abfe-4563-82b0-ca1b3b1aeb1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:44.624749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00e88e-abfe-4563-82b0-ca1b3b1aeb1b service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:44.626547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00e88e-abfe-4563-82b0-ca1b3b1aeb1b service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:44.628362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00e88e-abfe-4563-82b0-ca1b3b1aeb1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:44.654327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00e88e-abfe-4563-82b0-ca1b3b1aeb1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:44.656073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00e88e-abfe-4563-82b0-ca1b3b1aeb1b service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:44.683841 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3045/6030] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:44.765697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:45.528857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:45.810921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:46.157179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b34c9-471e-414d-b1a8-3bc796ea490e service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:46.159241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fc1b34c9-471e-414d-b1a8-3bc796ea490e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:46.185888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b34c9-471e-414d-b1a8-3bc796ea490e service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:46.199644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fce51-370a-48c7-9af9-0c63970e5554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:46.200406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fce51-370a-48c7-9af9-0c63970e5554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:46.200682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fce51-370a-48c7-9af9-0c63970e5554 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:46.200957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fce51-370a-48c7-9af9-0c63970e5554 admin admin] PATH_INFO: `/v3/users/449a9b776f64465a916a96aa26510caf` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:46.204142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3fce51-370a-48c7-9af9-0c63970e5554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=449a9b776f64465a916a96aa26510caf)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:46.206212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3fce51-370a-48c7-9af9-0c63970e5554 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:46.296326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00e88e-abfe-4563-82b0-ca1b3b1aeb1b service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:46.299333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cb00e88e-abfe-4563-82b0-ca1b3b1aeb1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:46.320789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00e88e-abfe-4563-82b0-ca1b3b1aeb1b service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:46.327507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:46.328831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:46.332902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:46.333426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3 admin admin] PATH_INFO: `/v3/projects/027f2bde14a649d1b5ba3c56c43e18de` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:46.334940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=027f2bde14a649d1b5ba3c56c43e18de)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:46.338046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:46.478924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7a3fce51-370a-48c7-9af9-0c63970e5554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '449a9b776f64465a916a96aa26510caf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:46.500470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027f2bde14a649d1b5ba3c56c43e18de', 'request_id': 'req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:46.507874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027f2bde14a649d1b5ba3c56c43e18de', 'request_id': 'req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:46.562952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7a3fce51-370a-48c7-9af9-0c63970e5554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '449a9b776f64465a916a96aa26510caf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:46.563688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7a3fce51-370a-48c7-9af9-0c63970e5554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '449a9b776f64465a916a96aa26510caf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:46.572818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7a3fce51-370a-48c7-9af9-0c63970e5554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '449a9b776f64465a916a96aa26510caf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:46.587140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7a3fce51-370a-48c7-9af9-0c63970e5554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '449a9b776f64465a916a96aa26510caf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:46.593914 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2986/6031] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:46 2022] DELETE /identity/v3/users/449a9b776f64465a916a96aa26510caf => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:46.595610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fce51-370a-48c7-9af9-0c63970e5554 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:46.597448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7a3fce51-370a-48c7-9af9-0c63970e5554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:46.681493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fce51-370a-48c7-9af9-0c63970e5554 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:46.687264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a9332-63c7-43d7-a6d9-7acb63c01e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:46.688222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a9332-63c7-43d7-a6d9-7acb63c01e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:46.688688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a9332-63c7-43d7-a6d9-7acb63c01e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:46.688944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a9332-63c7-43d7-a6d9-7acb63c01e0e admin admin] PATH_INFO: `/v3/projects/e33f1e5540984e409e0091e6ae1dd080` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:46.692145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a9332-63c7-43d7-a6d9-7acb63c01e0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33f1e5540984e409e0091e6ae1dd080)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:46.694514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027f2bde14a649d1b5ba3c56c43e18de', 'request_id': 'req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:46.703412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a9332-63c7-43d7-a6d9-7acb63c01e0e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:46.717693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3 admin admin] The token cache is being invalidate because project 027f2bde14a649d1b5ba3c56c43e18de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:46.721016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:46.722057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:46.725702 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3046/6032] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:46 2022] DELETE /identity/v3/projects/027f2bde14a649d1b5ba3c56c43e18de => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:52:46.730037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:46.736048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:46.859395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4f57d-81da-4a6d-b081-d681fe77b7f3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:46.863003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b250a9-7777-40ea-ae4a-1ea866c12ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:46.864454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b250a9-7777-40ea-ae4a-1ea866c12ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:46.865057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b250a9-7777-40ea-ae4a-1ea866c12ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:46.869516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b250a9-7777-40ea-ae4a-1ea866c12ea2 admin admin] PATH_INFO: `/v3/users/acc9882e74924037af21b3da3c5bf1fb` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:46.873779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b250a9-7777-40ea-ae4a-1ea866c12ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acc9882e74924037af21b3da3c5bf1fb)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:46.892579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b250a9-7777-40ea-ae4a-1ea866c12ea2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:46.963926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-291a9332-63c7-43d7-a6d9-7acb63c01e0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33f1e5540984e409e0091e6ae1dd080', 'request_id': 'req-291a9332-63c7-43d7-a6d9-7acb63c01e0e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:46.990669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-291a9332-63c7-43d7-a6d9-7acb63c01e0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33f1e5540984e409e0091e6ae1dd080', 'request_id': 'req-291a9332-63c7-43d7-a6d9-7acb63c01e0e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:47.006219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-291a9332-63c7-43d7-a6d9-7acb63c01e0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33f1e5540984e409e0091e6ae1dd080', 'request_id': 'req-291a9332-63c7-43d7-a6d9-7acb63c01e0e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:47.009786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:47.119179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-291a9332-63c7-43d7-a6d9-7acb63c01e0e admin admin] The token cache is being invalidate because project e33f1e5540984e409e0091e6ae1dd080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:47.119420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-291a9332-63c7-43d7-a6d9-7acb63c01e0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:47.120433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-291a9332-63c7-43d7-a6d9-7acb63c01e0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:47.125365 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2987/6033] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:46 2022] DELETE /identity/v3/projects/e33f1e5540984e409e0091e6ae1dd080 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:47.133358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fde833-526a-4576-a76a-5255eb31ba21 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:47.134179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fde833-526a-4576-a76a-5255eb31ba21 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:47.134883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fde833-526a-4576-a76a-5255eb31ba21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:47.173606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-25fde833-526a-4576-a76a-5255eb31ba21 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:47.175221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-25fde833-526a-4576-a76a-5255eb31ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:47.274729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-86b250a9-7777-40ea-ae4a-1ea866c12ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acc9882e74924037af21b3da3c5bf1fb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:47.274729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-86b250a9-7777-40ea-ae4a-1ea866c12ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acc9882e74924037af21b3da3c5bf1fb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:47.299701 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2988/6034] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:47.302213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fde833-526a-4576-a76a-5255eb31ba21 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:47.304905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-25fde833-526a-4576-a76a-5255eb31ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:47.322958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fde833-526a-4576-a76a-5255eb31ba21 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:47.331568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22df781-6bef-4430-b7d7-8a91f204494a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:47.332311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22df781-6bef-4430-b7d7-8a91f204494a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:47.332618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22df781-6bef-4430-b7d7-8a91f204494a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:47.332894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22df781-6bef-4430-b7d7-8a91f204494a admin admin] PATH_INFO: `/v3/users/938cdce8858747ffb57d49db9defc4a0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:47.337377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22df781-6bef-4430-b7d7-8a91f204494a admin admin] RBAC: Authorizing `identity:delete_user(user_id=938cdce8858747ffb57d49db9defc4a0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:47.340499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22df781-6bef-4430-b7d7-8a91f204494a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:47.382682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-86b250a9-7777-40ea-ae4a-1ea866c12ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acc9882e74924037af21b3da3c5bf1fb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:47.383328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-86b250a9-7777-40ea-ae4a-1ea866c12ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acc9882e74924037af21b3da3c5bf1fb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:47.405967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-86b250a9-7777-40ea-ae4a-1ea866c12ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acc9882e74924037af21b3da3c5bf1fb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:47.417145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:47.436472 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3047/6035] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:46 2022] DELETE /identity/v3/users/acc9882e74924037af21b3da3c5bf1fb => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:47.437662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b250a9-7777-40ea-ae4a-1ea866c12ea2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:47.439915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-86b250a9-7777-40ea-ae4a-1ea866c12ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:47.590497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d22df781-6bef-4430-b7d7-8a91f204494a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '938cdce8858747ffb57d49db9defc4a0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:47.600912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b250a9-7777-40ea-ae4a-1ea866c12ea2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:47.607799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15005804-e709-49e6-83da-13c47a3f3da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:47.608754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15005804-e709-49e6-83da-13c47a3f3da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:47.609134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15005804-e709-49e6-83da-13c47a3f3da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:47.609477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15005804-e709-49e6-83da-13c47a3f3da4 admin admin] PATH_INFO: `/v3/users/29061152a40742f58eae6f0acd7fb422` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:47.610708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15005804-e709-49e6-83da-13c47a3f3da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29061152a40742f58eae6f0acd7fb422)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:47.612903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15005804-e709-49e6-83da-13c47a3f3da4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:47.673684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d22df781-6bef-4430-b7d7-8a91f204494a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '938cdce8858747ffb57d49db9defc4a0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:47.674508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d22df781-6bef-4430-b7d7-8a91f204494a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '938cdce8858747ffb57d49db9defc4a0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:47.685776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d22df781-6bef-4430-b7d7-8a91f204494a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '938cdce8858747ffb57d49db9defc4a0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:47.703897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d22df781-6bef-4430-b7d7-8a91f204494a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '938cdce8858747ffb57d49db9defc4a0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:47.712919 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2989/6036] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:47 2022] DELETE /identity/v3/users/938cdce8858747ffb57d49db9defc4a0 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:47.714309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22df781-6bef-4430-b7d7-8a91f204494a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:47.717819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d22df781-6bef-4430-b7d7-8a91f204494a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:47.841831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22df781-6bef-4430-b7d7-8a91f204494a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:47.849929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b743e-f85b-4a4e-a2d3-44c912551624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:47.852887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b743e-f85b-4a4e-a2d3-44c912551624 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:47.853360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b743e-f85b-4a4e-a2d3-44c912551624 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:47.854165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b743e-f85b-4a4e-a2d3-44c912551624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:47.857930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f88b743e-f85b-4a4e-a2d3-44c912551624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:47.931388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-15005804-e709-49e6-83da-13c47a3f3da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29061152a40742f58eae6f0acd7fb422'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:47.932582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-15005804-e709-49e6-83da-13c47a3f3da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29061152a40742f58eae6f0acd7fb422'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:48.055995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-15005804-e709-49e6-83da-13c47a3f3da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29061152a40742f58eae6f0acd7fb422'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:48.056684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-15005804-e709-49e6-83da-13c47a3f3da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29061152a40742f58eae6f0acd7fb422'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:48.070065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b743e-f85b-4a4e-a2d3-44c912551624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:48.075186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b743e-f85b-4a4e-a2d3-44c912551624 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:48.081742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-15005804-e709-49e6-83da-13c47a3f3da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29061152a40742f58eae6f0acd7fb422'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:48.120142 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2990/6037] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:48.121746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18e005-65b9-41a8-a798-c9f7e03ec86e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:48.123226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18e005-65b9-41a8-a798-c9f7e03ec86e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:48.123226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18e005-65b9-41a8-a798-c9f7e03ec86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:48.137360 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3048/6038] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:47 2022] DELETE /identity/v3/users/29061152a40742f58eae6f0acd7fb422 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:48.141356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15005804-e709-49e6-83da-13c47a3f3da4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:48.148385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-15005804-e709-49e6-83da-13c47a3f3da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:48.162291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ef18e005-65b9-41a8-a798-c9f7e03ec86e None None] MFA Rules not processed for user `581232a8dc7e41bc93bd4f9b184db2bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:48.163742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ef18e005-65b9-41a8-a798-c9f7e03ec86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:48.237466 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2991/6039] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:48 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:48.239678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5250ed-7cea-47d3-be77-55327c87acbb None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:48.239966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5250ed-7cea-47d3-be77-55327c87acbb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:48.240294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5250ed-7cea-47d3-be77-55327c87acbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:48.315656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15005804-e709-49e6-83da-13c47a3f3da4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:48.324078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208046e-677b-4159-bbbd-96c8816445c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:48.326241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208046e-677b-4159-bbbd-96c8816445c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:48.326675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208046e-677b-4159-bbbd-96c8816445c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:48.327550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208046e-677b-4159-bbbd-96c8816445c1 admin admin] PATH_INFO: `/v3/projects/7451645b0f414ff1bffd9cc096577139` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:48.329076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208046e-677b-4159-bbbd-96c8816445c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7451645b0f414ff1bffd9cc096577139)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:48.332042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208046e-677b-4159-bbbd-96c8816445c1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:48.478919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bc5250ed-7cea-47d3-be77-55327c87acbb None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:48.484323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bc5250ed-7cea-47d3-be77-55327c87acbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:48.493673 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2992/6040] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:48 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:48.495791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5250ed-7cea-47d3-be77-55327c87acbb None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:48.501024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bc5250ed-7cea-47d3-be77-55327c87acbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:48.545313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5250ed-7cea-47d3-be77-55327c87acbb None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:48.553559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea717eb-80d7-4c63-bc6a-813e930dc402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:48.554313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea717eb-80d7-4c63-bc6a-813e930dc402 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:48.554589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea717eb-80d7-4c63-bc6a-813e930dc402 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:48.554861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea717eb-80d7-4c63-bc6a-813e930dc402 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:48.555505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea717eb-80d7-4c63-bc6a-813e930dc402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:48.557768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea717eb-80d7-4c63-bc6a-813e930dc402 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:48.601037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1208046e-677b-4159-bbbd-96c8816445c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7451645b0f414ff1bffd9cc096577139', 'request_id': 'req-1208046e-677b-4159-bbbd-96c8816445c1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:48.606858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1208046e-677b-4159-bbbd-96c8816445c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7451645b0f414ff1bffd9cc096577139', 'request_id': 'req-1208046e-677b-4159-bbbd-96c8816445c1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:48.709566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1208046e-677b-4159-bbbd-96c8816445c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7451645b0f414ff1bffd9cc096577139', 'request_id': 'req-1208046e-677b-4159-bbbd-96c8816445c1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:48.727897 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2993/6041] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:48 2022] POST /identity/v3/projects => generated 405 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:48.734068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea717eb-80d7-4c63-bc6a-813e930dc402 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:48.739064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9ea717eb-80d7-4c63-bc6a-813e930dc402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:48.743790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1208046e-677b-4159-bbbd-96c8816445c1 admin admin] The token cache is being invalidate because project 7451645b0f414ff1bffd9cc096577139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:48.744083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1208046e-677b-4159-bbbd-96c8816445c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:48.750169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1208046e-677b-4159-bbbd-96c8816445c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:48.763438 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3049/6042] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:48 2022] DELETE /identity/v3/projects/7451645b0f414ff1bffd9cc096577139 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:48.763438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208046e-677b-4159-bbbd-96c8816445c1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:48.764631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1208046e-677b-4159-bbbd-96c8816445c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:48.802887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:48.914167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea717eb-80d7-4c63-bc6a-813e930dc402 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:48.919256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d443ca-96db-4e89-a394-1276fa0c613d tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd780010f84d405a96bd5d9a2efd9285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68be995ca5614f189b5052f4462e8b09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:48.920126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d443ca-96db-4e89-a394-1276fa0c613d tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:48.920516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d443ca-96db-4e89-a394-1276fa0c613d tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:48.920874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d443ca-96db-4e89-a394-1276fa0c613d tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] PATH_INFO: `/v3/users/cd780010f84d405a96bd5d9a2efd9285/password` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:48.947253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208046e-677b-4159-bbbd-96c8816445c1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:49.040719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f9166-4b51-42cc-8588-938c71f41e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:49.041818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f9166-4b51-42cc-8588-938c71f41e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:49.042374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f9166-4b51-42cc-8588-938c71f41e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:49.042875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f9166-4b51-42cc-8588-938c71f41e27 admin admin] PATH_INFO: `/v3/projects/938edb15849c46d08a5be2ac829a2887` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:49.045728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f9166-4b51-42cc-8588-938c71f41e27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=938edb15849c46d08a5be2ac829a2887)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:49.048013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f9166-4b51-42cc-8588-938c71f41e27 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:49.181138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d4d443ca-96db-4e89-a394-1276fa0c613d tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cd780010f84d405a96bd5d9a2efd9285'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:49.212263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:49.232356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-362f9166-4b51-42cc-8588-938c71f41e27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938edb15849c46d08a5be2ac829a2887', 'request_id': 'req-362f9166-4b51-42cc-8588-938c71f41e27'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:49.238768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-362f9166-4b51-42cc-8588-938c71f41e27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938edb15849c46d08a5be2ac829a2887', 'request_id': 'req-362f9166-4b51-42cc-8588-938c71f41e27'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:49.319706 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2994/6043] 10.222.0.76 () {60 vars in 1269 bytes} [Sat Aug 27 04:52:48 2022] POST /identity/v3/users/cd780010f84d405a96bd5d9a2efd9285/password => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:49.320644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d443ca-96db-4e89-a394-1276fa0c613d tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:49.322513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d4d443ca-96db-4e89-a394-1276fa0c613d tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:49.345838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d443ca-96db-4e89-a394-1276fa0c613d tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:49.427953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5d3fa-7cb7-4880-b2a1-65c73871afea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:49.428965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5d3fa-7cb7-4880-b2a1-65c73871afea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:49.429455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5d3fa-7cb7-4880-b2a1-65c73871afea admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:49.430038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5d3fa-7cb7-4880-b2a1-65c73871afea admin admin] PATH_INFO: `/v3/projects/7f4eb79f7b6d431db33148f31fb43258` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:49.431510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5d3fa-7cb7-4880-b2a1-65c73871afea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4eb79f7b6d431db33148f31fb43258)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:49.433704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5d3fa-7cb7-4880-b2a1-65c73871afea admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:49.448790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-362f9166-4b51-42cc-8588-938c71f41e27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938edb15849c46d08a5be2ac829a2887', 'request_id': 'req-362f9166-4b51-42cc-8588-938c71f41e27'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:49.465362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-362f9166-4b51-42cc-8588-938c71f41e27 admin admin] The token cache is being invalidate because project 938edb15849c46d08a5be2ac829a2887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:49.466177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-362f9166-4b51-42cc-8588-938c71f41e27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:49.467102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-362f9166-4b51-42cc-8588-938c71f41e27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:49.469212 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3050/6044] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:48 2022] DELETE /identity/v3/projects/938edb15849c46d08a5be2ac829a2887 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:49.474362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f9166-4b51-42cc-8588-938c71f41e27 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:49.476566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-362f9166-4b51-42cc-8588-938c71f41e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:49.495342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f9166-4b51-42cc-8588-938c71f41e27 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:49.505135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2849e4d-3b60-4f99-a447-6a6efa8dd1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:49.505746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2849e4d-3b60-4f99-a447-6a6efa8dd1cd admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:49.506129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2849e4d-3b60-4f99-a447-6a6efa8dd1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:49.506511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2849e4d-3b60-4f99-a447-6a6efa8dd1cd admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:49.507383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2849e4d-3b60-4f99-a447-6a6efa8dd1cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:49.509547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2849e4d-3b60-4f99-a447-6a6efa8dd1cd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:49.663375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3ec5d3fa-7cb7-4880-b2a1-65c73871afea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4eb79f7b6d431db33148f31fb43258', 'request_id': 'req-3ec5d3fa-7cb7-4880-b2a1-65c73871afea'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:49.672345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3ec5d3fa-7cb7-4880-b2a1-65c73871afea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4eb79f7b6d431db33148f31fb43258', 'request_id': 'req-3ec5d3fa-7cb7-4880-b2a1-65c73871afea'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:49.682647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3ec5d3fa-7cb7-4880-b2a1-65c73871afea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4eb79f7b6d431db33148f31fb43258', 'request_id': 'req-3ec5d3fa-7cb7-4880-b2a1-65c73871afea'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:49.694913 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3051/6045] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:49 2022] POST /identity/v3/users => generated 303 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:49.702386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b99f8-52a6-441f-93f7-50ce1366c78d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:49.702386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b99f8-52a6-441f-93f7-50ce1366c78d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:49.702386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b99f8-52a6-441f-93f7-50ce1366c78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:49.720779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-cd3b99f8-52a6-441f-93f7-50ce1366c78d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:49.722009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cd3b99f8-52a6-441f-93f7-50ce1366c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:49.834886 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3052/6046] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:49.835912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b99f8-52a6-441f-93f7-50ce1366c78d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:49.841432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cd3b99f8-52a6-441f-93f7-50ce1366c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:49.855678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b99f8-52a6-441f-93f7-50ce1366c78d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:49.861338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf0fbf-06e6-4f16-a6a9-70dbbc9e434e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:49.862094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf0fbf-06e6-4f16-a6a9-70dbbc9e434e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:49.862382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf0fbf-06e6-4f16-a6a9-70dbbc9e434e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:49.863642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf0fbf-06e6-4f16-a6a9-70dbbc9e434e admin admin] PATH_INFO: `/v3/projects/54efbd5b01ec4261b01f8085dd41adda` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:49.865009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf0fbf-06e6-4f16-a6a9-70dbbc9e434e admin admin] RBAC: Authorizing `identity:delete_project(project_id=54efbd5b01ec4261b01f8085dd41adda)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:49.867789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf0fbf-06e6-4f16-a6a9-70dbbc9e434e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:49.873787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3ec5d3fa-7cb7-4880-b2a1-65c73871afea admin admin] The token cache is being invalidate because project 7f4eb79f7b6d431db33148f31fb43258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:49.874210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3ec5d3fa-7cb7-4880-b2a1-65c73871afea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:49.875164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3ec5d3fa-7cb7-4880-b2a1-65c73871afea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:49.877104 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2995/6047] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:49 2022] DELETE /identity/v3/projects/7f4eb79f7b6d431db33148f31fb43258 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:49.878518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a704bbc-fbd5-43da-bb05-45020652dbbb None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:49.881194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a704bbc-fbd5-43da-bb05-45020652dbbb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:49.881596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a704bbc-fbd5-43da-bb05-45020652dbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:49.932283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1a704bbc-fbd5-43da-bb05-45020652dbbb None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:49.933663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1a704bbc-fbd5-43da-bb05-45020652dbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:49.957961 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2996/6048] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:49.957961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a704bbc-fbd5-43da-bb05-45020652dbbb None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:49.963651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1a704bbc-fbd5-43da-bb05-45020652dbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:49.990290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a704bbc-fbd5-43da-bb05-45020652dbbb None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:50.001427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ed6fd-f436-4ddc-893d-01bbcdb628c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:50.002152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ed6fd-f436-4ddc-893d-01bbcdb628c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:50.002500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ed6fd-f436-4ddc-893d-01bbcdb628c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:50.002955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ed6fd-f436-4ddc-893d-01bbcdb628c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:50.008806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ed6fd-f436-4ddc-893d-01bbcdb628c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:50.008806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ed6fd-f436-4ddc-893d-01bbcdb628c6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:50.019206 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2997/6049] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:50.024086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f96b8-4abd-405b-a9b0-f25460cbdcb5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:50.024467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f96b8-4abd-405b-a9b0-f25460cbdcb5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:50.024805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f96b8-4abd-405b-a9b0-f25460cbdcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:50.051189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-960f96b8-4abd-405b-a9b0-f25460cbdcb5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:50.055205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-960f96b8-4abd-405b-a9b0-f25460cbdcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:50.092278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e8bf0fbf-06e6-4f16-a6a9-70dbbc9e434e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54efbd5b01ec4261b01f8085dd41adda', 'request_id': 'req-e8bf0fbf-06e6-4f16-a6a9-70dbbc9e434e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:50.122833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e8bf0fbf-06e6-4f16-a6a9-70dbbc9e434e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54efbd5b01ec4261b01f8085dd41adda', 'request_id': 'req-e8bf0fbf-06e6-4f16-a6a9-70dbbc9e434e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:50.146812 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2998/6050] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:50.152347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a291113-a829-4b2b-be87-6792abeaefad None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:50.152638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a291113-a829-4b2b-be87-6792abeaefad None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:50.152915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a291113-a829-4b2b-be87-6792abeaefad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:50.175215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7a291113-a829-4b2b-be87-6792abeaefad None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:50.177630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7a291113-a829-4b2b-be87-6792abeaefad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:50.186375 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 2999/6051] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:50.188469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb43a80-f72f-4fcd-aacc-bed60a65f3bd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:50.188903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb43a80-f72f-4fcd-aacc-bed60a65f3bd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:50.189322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb43a80-f72f-4fcd-aacc-bed60a65f3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:50.217210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ccb43a80-f72f-4fcd-aacc-bed60a65f3bd None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:50.219343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ccb43a80-f72f-4fcd-aacc-bed60a65f3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:50.229254 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3000/6052] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:50.230428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb43a80-f72f-4fcd-aacc-bed60a65f3bd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:50.247423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e8bf0fbf-06e6-4f16-a6a9-70dbbc9e434e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54efbd5b01ec4261b01f8085dd41adda', 'request_id': 'req-e8bf0fbf-06e6-4f16-a6a9-70dbbc9e434e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:50.254396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb43a80-f72f-4fcd-aacc-bed60a65f3bd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:50.260129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8bb13-d457-4398-a4b5-a26774f66765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:50.260970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8bb13-d457-4398-a4b5-a26774f66765 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:50.261457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8bb13-d457-4398-a4b5-a26774f66765 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:50.261726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8bb13-d457-4398-a4b5-a26774f66765 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:50.262534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8bb13-d457-4398-a4b5-a26774f66765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:50.264398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8bb13-d457-4398-a4b5-a26774f66765 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:50.270124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e8bf0fbf-06e6-4f16-a6a9-70dbbc9e434e admin admin] The token cache is being invalidate because project 54efbd5b01ec4261b01f8085dd41adda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:50.272783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e8bf0fbf-06e6-4f16-a6a9-70dbbc9e434e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:50.277637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e8bf0fbf-06e6-4f16-a6a9-70dbbc9e434e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:50.282326 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3001/6053] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:50.283307 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3053/6054] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:49 2022] DELETE /identity/v3/projects/54efbd5b01ec4261b01f8085dd41adda => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:50.283725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8bb13-d457-4398-a4b5-a26774f66765 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:50.285819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56bce5-35c1-40a7-882b-f09d31230f6e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:50.286111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56bce5-35c1-40a7-882b-f09d31230f6e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:50.288082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56bce5-35c1-40a7-882b-f09d31230f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:50.288508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-20a8bb13-d457-4398-a4b5-a26774f66765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:50.303630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8bb13-d457-4398-a4b5-a26774f66765 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:50.308997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56112b47-13c1-418d-b747-d6caee52874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:50.314229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56112b47-13c1-418d-b747-d6caee52874b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:50.314229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56112b47-13c1-418d-b747-d6caee52874b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:50.314229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56112b47-13c1-418d-b747-d6caee52874b admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:50.314229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56112b47-13c1-418d-b747-d6caee52874b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:50.314229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56112b47-13c1-418d-b747-d6caee52874b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:50.315022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56112b47-13c1-418d-b747-d6caee52874b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:50.329350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2e56bce5-35c1-40a7-882b-f09d31230f6e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:50.330614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2e56bce5-35c1-40a7-882b-f09d31230f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:50.334592 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3002/6055] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:50.335920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56112b47-13c1-418d-b747-d6caee52874b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:50.338049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-56112b47-13c1-418d-b747-d6caee52874b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:50.342268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:50.350027 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3054/6056] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:50.353044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56bce5-35c1-40a7-882b-f09d31230f6e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:50.355496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2e56bce5-35c1-40a7-882b-f09d31230f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:50.357235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56112b47-13c1-418d-b747-d6caee52874b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:50.362485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bbefc-2c8b-486c-a33e-1d9459d3191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:50.363842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bbefc-2c8b-486c-a33e-1d9459d3191d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:50.364189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bbefc-2c8b-486c-a33e-1d9459d3191d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:50.364655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bbefc-2c8b-486c-a33e-1d9459d3191d admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:50.365497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7bbefc-2c8b-486c-a33e-1d9459d3191d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:50.365869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7bbefc-2c8b-486c-a33e-1d9459d3191d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:50.367586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7bbefc-2c8b-486c-a33e-1d9459d3191d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:50.380912 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3003/6057] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:50.381519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56bce5-35c1-40a7-882b-f09d31230f6e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:50.381955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bbefc-2c8b-486c-a33e-1d9459d3191d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:50.386097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1d7bbefc-2c8b-486c-a33e-1d9459d3191d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:50.387425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2766d-b18c-4398-85f5-a45be0150f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:50.388410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2766d-b18c-4398-85f5-a45be0150f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:50.388921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2766d-b18c-4398-85f5-a45be0150f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:50.389414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2766d-b18c-4398-85f5-a45be0150f36 admin admin] PATH_INFO: `/v3/projects/756f39b82b0745a3bc33a85f632348fa/users/e525d35a47544404b70b7f87052c51b4/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:50.408669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bbefc-2c8b-486c-a33e-1d9459d3191d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:50.414199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3b7df-9ebf-41c8-a057-126611ab8712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:50.414966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3b7df-9ebf-41c8-a057-126611ab8712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:50.415322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3b7df-9ebf-41c8-a057-126611ab8712 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:50.416258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3b7df-9ebf-41c8-a057-126611ab8712 admin admin] PATH_INFO: `/v3/users/109ba43ad7b24d83aa375673d0a08816` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:50.416921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3b7df-9ebf-41c8-a057-126611ab8712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=109ba43ad7b24d83aa375673d0a08816)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:50.418955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3b7df-9ebf-41c8-a057-126611ab8712 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:50.429789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2766d-b18c-4398-85f5-a45be0150f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756f39b82b0745a3bc33a85f632348fa, user_id=e525d35a47544404b70b7f87052c51b4, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:50.435585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2766d-b18c-4398-85f5-a45be0150f36 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:50.531497 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3055/6058] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:50 2022] PUT /identity/v3/projects/756f39b82b0745a3bc33a85f632348fa/users/e525d35a47544404b70b7f87052c51b4/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:50.533382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5648a-e7a4-4cf5-8da9-890783636bfa None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:50.533926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5648a-e7a4-4cf5-8da9-890783636bfa None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:50.540703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5648a-e7a4-4cf5-8da9-890783636bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:50.564325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b4f5648a-e7a4-4cf5-8da9-890783636bfa None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:50.565681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b4f5648a-e7a4-4cf5-8da9-890783636bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:50.569436 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3056/6059] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:50 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:50.570633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5648a-e7a4-4cf5-8da9-890783636bfa None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:50.636534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-38f3b7df-9ebf-41c8-a057-126611ab8712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109ba43ad7b24d83aa375673d0a08816'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:50.649629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5648a-e7a4-4cf5-8da9-890783636bfa None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:50.655880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f735b-80bd-4bff-87fa-cc4f168c5232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:50.656816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f735b-80bd-4bff-87fa-cc4f168c5232 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:50.657295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f735b-80bd-4bff-87fa-cc4f168c5232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:50.657734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f735b-80bd-4bff-87fa-cc4f168c5232 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:50.658559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f735b-80bd-4bff-87fa-cc4f168c5232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:50.661411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f735b-80bd-4bff-87fa-cc4f168c5232 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:50.730706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-38f3b7df-9ebf-41c8-a057-126611ab8712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109ba43ad7b24d83aa375673d0a08816'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:50.731749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-38f3b7df-9ebf-41c8-a057-126611ab8712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109ba43ad7b24d83aa375673d0a08816'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:50.744343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-38f3b7df-9ebf-41c8-a057-126611ab8712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109ba43ad7b24d83aa375673d0a08816'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:50.771924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-38f3b7df-9ebf-41c8-a057-126611ab8712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109ba43ad7b24d83aa375673d0a08816'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:50.782265 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3004/6060] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:50 2022] DELETE /identity/v3/users/109ba43ad7b24d83aa375673d0a08816 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:50.782265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3b7df-9ebf-41c8-a057-126611ab8712 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:50.782265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-38f3b7df-9ebf-41c8-a057-126611ab8712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:50.822904 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3057/6061] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:50 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:50.828388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f735b-80bd-4bff-87fa-cc4f168c5232 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:50.828388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ed7f735b-80bd-4bff-87fa-cc4f168c5232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:50.919381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f735b-80bd-4bff-87fa-cc4f168c5232 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:50.932105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36b1ce-c0ee-4ebc-9e47-0907cfeaa395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:50.932981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36b1ce-c0ee-4ebc-9e47-0907cfeaa395 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:50.940368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3b7df-9ebf-41c8-a057-126611ab8712 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:50.940559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36b1ce-c0ee-4ebc-9e47-0907cfeaa395 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:50.940559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36b1ce-c0ee-4ebc-9e47-0907cfeaa395 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:50.940559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36b1ce-c0ee-4ebc-9e47-0907cfeaa395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:50.940559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36b1ce-c0ee-4ebc-9e47-0907cfeaa395 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:50.958880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14259081-794c-4afc-b066-b3008dea470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:50.963323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14259081-794c-4afc-b066-b3008dea470a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:50.963323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14259081-794c-4afc-b066-b3008dea470a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:50.963323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14259081-794c-4afc-b066-b3008dea470a admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:50.963323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14259081-794c-4afc-b066-b3008dea470a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:50.963323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14259081-794c-4afc-b066-b3008dea470a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:50.968834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14259081-794c-4afc-b066-b3008dea470a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:50.988430 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3005/6062] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:50.988430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af783a6-8cf4-4d6e-bbba-35d7e91f3e4a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:50.988430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af783a6-8cf4-4d6e-bbba-35d7e91f3e4a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:50.988430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af783a6-8cf4-4d6e-bbba-35d7e91f3e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:50.992677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2af783a6-8cf4-4d6e-bbba-35d7e91f3e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:51.027439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:51.078127 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3058/6063] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:50 2022] POST /identity/v3/projects => generated 393 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:51.080149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36b1ce-c0ee-4ebc-9e47-0907cfeaa395 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:51.084762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ad36b1ce-c0ee-4ebc-9e47-0907cfeaa395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:51.112751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-2af783a6-8cf4-4d6e-bbba-35d7e91f3e4a None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 27 04:52:51.112751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:52:51.112751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:52:51.112751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:52:51.112751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:52:51.112751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:52:51.112751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:52:51.112751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:52:51.112751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:52:51.112751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:52:51.112751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:52:51.112751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:52:51.112751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:52:51.112751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:52:51.112751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:52:51.112751 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:52:51.115578 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Aug 27 04:52:51.115578 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Aug 27 04:52:51.115578 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Aug 27 04:52:51.115578 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Aug 27 04:52:51.115578 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Aug 27 04:52:51.115578 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Aug 27 04:52:51.115578 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Aug 27 04:52:51.115578 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Aug 27 04:52:51.115578 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:51.115578 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:51.115578 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 27 04:52:51.115578 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 27 04:52:51.115578 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 27 04:52:51.115578 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 27 04:52:51.115578 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:51.115578 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:51.117060 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 27 04:52:51.117060 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 27 04:52:51.117060 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:51.117060 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:51.117060 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 27 04:52:51.117060 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 27 04:52:51.117060 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:52:51.117060 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:52:51.117060 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 27 04:52:51.117060 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 27 04:52:51.117060 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 27 04:52:51.117060 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:52:51.119837 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3006/6064] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:50 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 134 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:52:51.120799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af783a6-8cf4-4d6e-bbba-35d7e91f3e4a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:51.141465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af783a6-8cf4-4d6e-bbba-35d7e91f3e4a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:51.247453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36b1ce-c0ee-4ebc-9e47-0907cfeaa395 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:51.252108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777586d-382a-4c4e-b6df-a00205925880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:51.252754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777586d-382a-4c4e-b6df-a00205925880 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:51.253036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777586d-382a-4c4e-b6df-a00205925880 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:51.253312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777586d-382a-4c4e-b6df-a00205925880 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:51.254575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777586d-382a-4c4e-b6df-a00205925880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:51.256626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777586d-382a-4c4e-b6df-a00205925880 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:51.261399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5e06a-d539-40ef-91c3-57563060b903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:51.262427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e06a-d539-40ef-91c3-57563060b903 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:51.262690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e06a-d539-40ef-91c3-57563060b903 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:51.263065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e06a-d539-40ef-91c3-57563060b903 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:51.263856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5e06a-d539-40ef-91c3-57563060b903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:51.266583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5e06a-d539-40ef-91c3-57563060b903 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:51.407469 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3059/6065] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:51 2022] POST /identity/v3/users => generated 293 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:51.411533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5e06a-d539-40ef-91c3-57563060b903 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:51.414617 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3007/6066] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:51 2022] POST /identity/v3/projects => generated 377 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:51.417334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcc1d1-64a0-42c2-b3e8-3dccecdfcad9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:51.420904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcc1d1-64a0-42c2-b3e8-3dccecdfcad9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:51.421801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcc1d1-64a0-42c2-b3e8-3dccecdfcad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:51.435541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5e06a-d539-40ef-91c3-57563060b903 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:51.580760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a1ec4-4d05-40bb-a7e2-44a1b4f991a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:51.580760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a1ec4-4d05-40bb-a7e2-44a1b4f991a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:51.580760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a1ec4-4d05-40bb-a7e2-44a1b4f991a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:51.580760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a1ec4-4d05-40bb-a7e2-44a1b4f991a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:51.581190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a1ec4-4d05-40bb-a7e2-44a1b4f991a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:51.581190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a1ec4-4d05-40bb-a7e2-44a1b4f991a6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:51.734754 n-d-852088-5 devstack@keystone.service[82082]: WARNING keystone.server.flask.application [None req-91dcc1d1-64a0-42c2-b3e8-3dccecdfcad9 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.76: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 27 04:52:51.740238 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3008/6067] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:51 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 324 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 27 04:52:51.741317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcc1d1-64a0-42c2-b3e8-3dccecdfcad9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:51.759027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcc1d1-64a0-42c2-b3e8-3dccecdfcad9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:51.780605 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3060/6068] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:51 2022] POST /identity/v3/users => generated 297 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:51.786298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a1ec4-4d05-40bb-a7e2-44a1b4f991a6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:51.789801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6fcee-6cf5-48ab-b88f-bf5b63af9eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:51.790743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6fcee-6cf5-48ab-b88f-bf5b63af9eba admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:51.791426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6fcee-6cf5-48ab-b88f-bf5b63af9eba admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:51.791815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6fcee-6cf5-48ab-b88f-bf5b63af9eba admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:51.798654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6fcee-6cf5-48ab-b88f-bf5b63af9eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:51.800151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a1ec4-4d05-40bb-a7e2-44a1b4f991a6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:51.802387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6fcee-6cf5-48ab-b88f-bf5b63af9eba admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:51.810420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a659629-5171-48bb-b549-fb3d74d34a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:51.812362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a659629-5171-48bb-b549-fb3d74d34a8c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:51.812905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a659629-5171-48bb-b549-fb3d74d34a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:51.813350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a659629-5171-48bb-b549-fb3d74d34a8c admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:51.814736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a659629-5171-48bb-b549-fb3d74d34a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:51.817572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a659629-5171-48bb-b549-fb3d74d34a8c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:51.825233 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3009/6069] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:51.830902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7584c-b715-446c-8d6a-efb1fced764d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:51.831316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7584c-b715-446c-8d6a-efb1fced764d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:51.833059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7584c-b715-446c-8d6a-efb1fced764d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:51.961904 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3061/6070] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:51 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:51.961904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a659629-5171-48bb-b549-fb3d74d34a8c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:51.977384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a659629-5171-48bb-b549-fb3d74d34a8c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:51.989022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c5c7584c-b715-446c-8d6a-efb1fced764d None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:51.989022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c5c7584c-b715-446c-8d6a-efb1fced764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:51.994544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc13fc2-1fff-4557-80c7-44444b0f20f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:51.995193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc13fc2-1fff-4557-80c7-44444b0f20f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:51.995470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc13fc2-1fff-4557-80c7-44444b0f20f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:51.995746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc13fc2-1fff-4557-80c7-44444b0f20f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:51.996439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc13fc2-1fff-4557-80c7-44444b0f20f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:51.998436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc13fc2-1fff-4557-80c7-44444b0f20f1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:52.024983 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3062/6071] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:52.026198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc13fc2-1fff-4557-80c7-44444b0f20f1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:52.039133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc13fc2-1fff-4557-80c7-44444b0f20f1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:52.045577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdf479-1633-4352-837e-b420e3c3c720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:52.046499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdf479-1633-4352-837e-b420e3c3c720 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:52.046945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdf479-1633-4352-837e-b420e3c3c720 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:52.047392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdf479-1633-4352-837e-b420e3c3c720 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:52.048233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdf479-1633-4352-837e-b420e3c3c720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:52.055651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdf479-1633-4352-837e-b420e3c3c720 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:52.074865 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3063/6072] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:52.080815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdf479-1633-4352-837e-b420e3c3c720 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:52.083342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-51bdf479-1633-4352-837e-b420e3c3c720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:52.110505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdf479-1633-4352-837e-b420e3c3c720 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:52.122627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81828cb7-3448-482e-a290-92a5c815702d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:52.123516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81828cb7-3448-482e-a290-92a5c815702d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:52.123968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81828cb7-3448-482e-a290-92a5c815702d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:52.124454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81828cb7-3448-482e-a290-92a5c815702d admin admin] PATH_INFO: `/v3/projects/47999f37f7a0473384cfa64fdfa0bfe7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:52.130995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81828cb7-3448-482e-a290-92a5c815702d admin admin] RBAC: Authorizing `identity:delete_project(project_id=47999f37f7a0473384cfa64fdfa0bfe7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:52.133177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81828cb7-3448-482e-a290-92a5c815702d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:52.153240 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3010/6073] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:52.156667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7584c-b715-446c-8d6a-efb1fced764d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:52.182461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7584c-b715-446c-8d6a-efb1fced764d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:52.193544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece7c1c-0cc5-4d5b-8e6a-76553ca67a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:52.194576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7c1c-0cc5-4d5b-8e6a-76553ca67a6a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:52.199221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7c1c-0cc5-4d5b-8e6a-76553ca67a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:52.199221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7c1c-0cc5-4d5b-8e6a-76553ca67a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:52.199221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece7c1c-0cc5-4d5b-8e6a-76553ca67a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:52.199221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece7c1c-0cc5-4d5b-8e6a-76553ca67a6a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:52.216431 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3011/6074] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:52.218512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece7c1c-0cc5-4d5b-8e6a-76553ca67a6a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:52.237229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece7c1c-0cc5-4d5b-8e6a-76553ca67a6a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:52.242658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b9cf1-0234-4ccc-a731-9b64e0e9d9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:52.246179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b9cf1-0234-4ccc-a731-9b64e0e9d9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:52.246179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b9cf1-0234-4ccc-a731-9b64e0e9d9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:52.246179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b9cf1-0234-4ccc-a731-9b64e0e9d9d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:52.246179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b9cf1-0234-4ccc-a731-9b64e0e9d9d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:52.248370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b9cf1-0234-4ccc-a731-9b64e0e9d9d8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:52.266571 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3012/6075] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:52.267529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b9cf1-0234-4ccc-a731-9b64e0e9d9d8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:52.307637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b9cf1-0234-4ccc-a731-9b64e0e9d9d8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:52.324863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648f2b5-64a1-44d1-be1a-1f05caedfd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:52.328426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648f2b5-64a1-44d1-be1a-1f05caedfd60 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:52.329211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648f2b5-64a1-44d1-be1a-1f05caedfd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:52.330450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648f2b5-64a1-44d1-be1a-1f05caedfd60 admin admin] PATH_INFO: `/v3/projects/648e7927634f419f8e754f76bd8a0952/users/b62acf375a104203a66043c136fb1f99/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:52.358909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-81828cb7-3448-482e-a290-92a5c815702d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47999f37f7a0473384cfa64fdfa0bfe7', 'request_id': 'req-81828cb7-3448-482e-a290-92a5c815702d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:52.376938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-81828cb7-3448-482e-a290-92a5c815702d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47999f37f7a0473384cfa64fdfa0bfe7', 'request_id': 'req-81828cb7-3448-482e-a290-92a5c815702d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:52.387959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648f2b5-64a1-44d1-be1a-1f05caedfd60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=648e7927634f419f8e754f76bd8a0952, user_id=b62acf375a104203a66043c136fb1f99, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:52.401489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648f2b5-64a1-44d1-be1a-1f05caedfd60 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:52.479919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:52.480606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-81828cb7-3448-482e-a290-92a5c815702d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47999f37f7a0473384cfa64fdfa0bfe7', 'request_id': 'req-81828cb7-3448-482e-a290-92a5c815702d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:52.500820 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3013/6076] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:52 2022] PUT /identity/v3/projects/648e7927634f419f8e754f76bd8a0952/users/b62acf375a104203a66043c136fb1f99/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:52.501898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648f2b5-64a1-44d1-be1a-1f05caedfd60 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:52.502697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-81828cb7-3448-482e-a290-92a5c815702d admin admin] The token cache is being invalidate because project 47999f37f7a0473384cfa64fdfa0bfe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:52.502993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-81828cb7-3448-482e-a290-92a5c815702d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:52.504239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-81828cb7-3448-482e-a290-92a5c815702d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:52.507563 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3064/6077] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:52 2022] DELETE /identity/v3/projects/47999f37f7a0473384cfa64fdfa0bfe7 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:52.511419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81828cb7-3448-482e-a290-92a5c815702d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:52.511419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-81828cb7-3448-482e-a290-92a5c815702d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:52.613142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81828cb7-3448-482e-a290-92a5c815702d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:52.630181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648f2b5-64a1-44d1-be1a-1f05caedfd60 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:52.635824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bfd7b-f1e4-4cef-9884-6e87b90bd728 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd780010f84d405a96bd5d9a2efd9285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68be995ca5614f189b5052f4462e8b09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:52.636112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bfd7b-f1e4-4cef-9884-6e87b90bd728 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:52.637816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bfd7b-f1e4-4cef-9884-6e87b90bd728 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:52.638313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bfd7b-f1e4-4cef-9884-6e87b90bd728 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] PATH_INFO: `/v3/users/cd780010f84d405a96bd5d9a2efd9285/password` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:52.704664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c4afe-6367-47f4-b9b8-7627976914f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:52.705699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4afe-6367-47f4-b9b8-7627976914f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:52.706154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4afe-6367-47f4-b9b8-7627976914f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:52.706600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4afe-6367-47f4-b9b8-7627976914f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:52.708107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c4afe-6367-47f4-b9b8-7627976914f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:52.710267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c4afe-6367-47f4-b9b8-7627976914f6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:52.725847 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3065/6078] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:52.729370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c4afe-6367-47f4-b9b8-7627976914f6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:52.729825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-990c4afe-6367-47f4-b9b8-7627976914f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:52.751422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c4afe-6367-47f4-b9b8-7627976914f6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:52.760234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051d860-f308-472a-a310-853d9d06f813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:52.760234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051d860-f308-472a-a310-853d9d06f813 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:52.760234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051d860-f308-472a-a310-853d9d06f813 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:52.760234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051d860-f308-472a-a310-853d9d06f813 admin admin] PATH_INFO: `/v3/projects/3b41a15d18c840f198f5860fd595d4ca/users/29c36a19050147e6a97e28fb6d0d0fc5/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:52.802991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051d860-f308-472a-a310-853d9d06f813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b41a15d18c840f198f5860fd595d4ca, user_id=29c36a19050147e6a97e28fb6d0d0fc5, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:52.804464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cb2bfd7b-f1e4-4cef-9884-6e87b90bd728 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cd780010f84d405a96bd5d9a2efd9285'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:52.805750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051d860-f308-472a-a310-853d9d06f813 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:52.943085 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3014/6079] 10.222.0.76 () {60 vars in 1269 bytes} [Sat Aug 27 04:52:52 2022] POST /identity/v3/users/cd780010f84d405a96bd5d9a2efd9285/password => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:52.943211 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3066/6080] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:52 2022] PUT /identity/v3/projects/3b41a15d18c840f198f5860fd595d4ca/users/29c36a19050147e6a97e28fb6d0d0fc5/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:52.944866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ed894-2709-49f9-9522-14dfaf4cd5f6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:52.945150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ed894-2709-49f9-9522-14dfaf4cd5f6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:52.945425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ed894-2709-49f9-9522-14dfaf4cd5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:52.948351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589463a-5524-4526-8ad5-f980143dd002 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:52.948894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589463a-5524-4526-8ad5-f980143dd002 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:52.949383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589463a-5524-4526-8ad5-f980143dd002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:52.959056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:52.997871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6589463a-5524-4526-8ad5-f980143dd002 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:52.999595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ed5ed894-2709-49f9-9522-14dfaf4cd5f6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:53.000851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ed5ed894-2709-49f9-9522-14dfaf4cd5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:53.007021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6589463a-5524-4526-8ad5-f980143dd002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:53.140648 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3067/6081] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:53.141468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ed894-2709-49f9-9522-14dfaf4cd5f6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:53.173172 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3015/6082] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:53.173407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ed894-2709-49f9-9522-14dfaf4cd5f6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:53.173523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c4901-979f-46ce-9206-841493d84d80 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:53.173523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c4901-979f-46ce-9206-841493d84d80 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:53.173523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c4901-979f-46ce-9206-841493d84d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:53.192034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c1343-e7e7-4b4e-9acb-694e99fac4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:53.193031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c1343-e7e7-4b4e-9acb-694e99fac4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:53.193594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c1343-e7e7-4b4e-9acb-694e99fac4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:53.194035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c1343-e7e7-4b4e-9acb-694e99fac4eb admin admin] PATH_INFO: `/v3/projects/2984e48850ef455b8419393487177f02/users/61eed3ae50f8415da60fb673111695e2/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:53.234212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c1343-e7e7-4b4e-9acb-694e99fac4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2984e48850ef455b8419393487177f02, user_id=61eed3ae50f8415da60fb673111695e2, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:53.238933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c1343-e7e7-4b4e-9acb-694e99fac4eb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:53.240824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-426c4901-979f-46ce-9206-841493d84d80 None None] MFA Rules not processed for user `29c36a19050147e6a97e28fb6d0d0fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:53.242057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-426c4901-979f-46ce-9206-841493d84d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:53.314901 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3068/6083] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:53 2022] PUT /identity/v3/projects/2984e48850ef455b8419393487177f02/users/61eed3ae50f8415da60fb673111695e2/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:53.318305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f3b12-16e5-47ed-b2ef-42026e7100a9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:53.318672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f3b12-16e5-47ed-b2ef-42026e7100a9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:53.319021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f3b12-16e5-47ed-b2ef-42026e7100a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:53.387257 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3016/6084] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:53.388314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2c5f3b12-16e5-47ed-b2ef-42026e7100a9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:53.389850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdedc8-ec38-49a8-8d1e-c5d094681d04 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:53.390358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdedc8-ec38-49a8-8d1e-c5d094681d04 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:53.390805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdedc8-ec38-49a8-8d1e-c5d094681d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:53.399624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2c5f3b12-16e5-47ed-b2ef-42026e7100a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:53.430423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-93bdedc8-ec38-49a8-8d1e-c5d094681d04 None None] MFA Rules not processed for user `61eed3ae50f8415da60fb673111695e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:53.431959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-93bdedc8-ec38-49a8-8d1e-c5d094681d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:53.551096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:53.560953 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3069/6085] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:53.562156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f3b12-16e5-47ed-b2ef-42026e7100a9 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:53.587467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f3b12-16e5-47ed-b2ef-42026e7100a9 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:53.596992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440dfd5b-20bf-4aaf-8ca4-8c6b3b56dfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:53.598885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dfd5b-20bf-4aaf-8ca4-8c6b3b56dfc7 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:53.599398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dfd5b-20bf-4aaf-8ca4-8c6b3b56dfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:53.599861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440dfd5b-20bf-4aaf-8ca4-8c6b3b56dfc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:53.600728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440dfd5b-20bf-4aaf-8ca4-8c6b3b56dfc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:53.603512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440dfd5b-20bf-4aaf-8ca4-8c6b3b56dfc7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:53.606946 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3017/6086] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:53.607923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdedc8-ec38-49a8-8d1e-c5d094681d04 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:53.632999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdedc8-ec38-49a8-8d1e-c5d094681d04 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:53.651561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e519c-4ec4-4e4e-83c6-bd8f5511011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:53.652545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e519c-4ec4-4e4e-83c6-bd8f5511011d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:53.652827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e519c-4ec4-4e4e-83c6-bd8f5511011d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:53.653205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e519c-4ec4-4e4e-83c6-bd8f5511011d admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:53.655251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e519c-4ec4-4e4e-83c6-bd8f5511011d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:53.655579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e519c-4ec4-4e4e-83c6-bd8f5511011d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:53.661399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e519c-4ec4-4e4e-83c6-bd8f5511011d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:53.697560 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3018/6087] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:53.697747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e519c-4ec4-4e4e-83c6-bd8f5511011d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:53.724808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e519c-4ec4-4e4e-83c6-bd8f5511011d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:53.731721 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3070/6088] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:53 2022] POST /identity/v3/projects => generated 393 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:53.740462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440dfd5b-20bf-4aaf-8ca4-8c6b3b56dfc7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:53.748143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f0aef-5283-4410-b9d5-81ed01a7b8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:53.748769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f0aef-5283-4410-b9d5-81ed01a7b8fe admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:53.754104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f0aef-5283-4410-b9d5-81ed01a7b8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:53.755748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f0aef-5283-4410-b9d5-81ed01a7b8fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:53.757236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f0aef-5283-4410-b9d5-81ed01a7b8fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:53.763156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f0aef-5283-4410-b9d5-81ed01a7b8fe admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:53.869481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440dfd5b-20bf-4aaf-8ca4-8c6b3b56dfc7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:53.883664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbc402-f401-47f0-a861-ec08f7557c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:53.884495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbc402-f401-47f0-a861-ec08f7557c87 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:53.884780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbc402-f401-47f0-a861-ec08f7557c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:53.885057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbc402-f401-47f0-a861-ec08f7557c87 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:53.885699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbc402-f401-47f0-a861-ec08f7557c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:53.887857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbc402-f401-47f0-a861-ec08f7557c87 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:53.979614 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3019/6089] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:53 2022] POST /identity/v3/projects => generated 373 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:53.981931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f0aef-5283-4410-b9d5-81ed01a7b8fe admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:53.987383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-687f0aef-5283-4410-b9d5-81ed01a7b8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:54.064085 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3071/6090] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:53 2022] POST /identity/v3/users => generated 303 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:54.064085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbc402-f401-47f0-a861-ec08f7557c87 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:54.068437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e0dbc402-f401-47f0-a861-ec08f7557c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:54.135898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f0aef-5283-4410-b9d5-81ed01a7b8fe admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:54.141599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223fd04-df2c-4583-b133-0b9c087e137b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:54.142276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223fd04-df2c-4583-b133-0b9c087e137b service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:54.142570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223fd04-df2c-4583-b133-0b9c087e137b service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:54.142901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223fd04-df2c-4583-b133-0b9c087e137b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:54.214134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbc402-f401-47f0-a861-ec08f7557c87 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:54.219418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0ef53-1afc-480f-930b-6e6414a96e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:54.219871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0ef53-1afc-480f-930b-6e6414a96e82 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:54.220184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0ef53-1afc-480f-930b-6e6414a96e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:54.220489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0ef53-1afc-480f-930b-6e6414a96e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:54.222147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223fd04-df2c-4583-b133-0b9c087e137b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:54.224023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223fd04-df2c-4583-b133-0b9c087e137b service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:54.236384 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3020/6091] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:54.238994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf559ae-624d-461d-b1c1-16fab1f87824 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:54.239991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf559ae-624d-461d-b1c1-16fab1f87824 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:54.240610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf559ae-624d-461d-b1c1-16fab1f87824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:54.274757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-fbf559ae-624d-461d-b1c1-16fab1f87824 None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:54.278198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fbf559ae-624d-461d-b1c1-16fab1f87824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:54.282276 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3021/6092] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:54 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:54.283378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf559ae-624d-461d-b1c1-16fab1f87824 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:54.296621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:54.335514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0ef53-1afc-480f-930b-6e6414a96e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:54.337891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0ef53-1afc-480f-930b-6e6414a96e82 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:54.350023 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3072/6093] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:54.350960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0ef53-1afc-480f-930b-6e6414a96e82 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:54.376815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0ef53-1afc-480f-930b-6e6414a96e82 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:54.405418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92830a1-a21f-43f5-9185-22fd3af8ed2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:54.406049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92830a1-a21f-43f5-9185-22fd3af8ed2f admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:54.406333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92830a1-a21f-43f5-9185-22fd3af8ed2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:54.406615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92830a1-a21f-43f5-9185-22fd3af8ed2f admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:54.408039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92830a1-a21f-43f5-9185-22fd3af8ed2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:54.410640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92830a1-a21f-43f5-9185-22fd3af8ed2f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:54.413012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf559ae-624d-461d-b1c1-16fab1f87824 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:54.421981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29760406-0239-4202-81ba-c008966a7565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:54.424219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29760406-0239-4202-81ba-c008966a7565 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:54.424681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29760406-0239-4202-81ba-c008966a7565 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:54.425161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29760406-0239-4202-81ba-c008966a7565 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:54.427012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29760406-0239-4202-81ba-c008966a7565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:54.434538 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3073/6094] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:54.434538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92830a1-a21f-43f5-9185-22fd3af8ed2f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:54.438380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29760406-0239-4202-81ba-c008966a7565 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:54.449501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92830a1-a21f-43f5-9185-22fd3af8ed2f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:54.465014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893812a6-a086-417b-aeea-bfc019369271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:54.465996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893812a6-a086-417b-aeea-bfc019369271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:54.466654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893812a6-a086-417b-aeea-bfc019369271 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:54.467123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893812a6-a086-417b-aeea-bfc019369271 admin admin] PATH_INFO: `/v3/users/61eed3ae50f8415da60fb673111695e2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:54.470752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893812a6-a086-417b-aeea-bfc019369271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61eed3ae50f8415da60fb673111695e2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:54.474701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893812a6-a086-417b-aeea-bfc019369271 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:54.629382 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3022/6095] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:54 2022] POST /identity/v3/users => generated 287 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:54.629737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31690d1a-9bb9-4a60-bac1-1fd1e958ff61 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:54.630133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31690d1a-9bb9-4a60-bac1-1fd1e958ff61 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:54.630520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31690d1a-9bb9-4a60-bac1-1fd1e958ff61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:54.652470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-31690d1a-9bb9-4a60-bac1-1fd1e958ff61 None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:54.654345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-31690d1a-9bb9-4a60-bac1-1fd1e958ff61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:54.720219 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3023/6096] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:54.728125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31690d1a-9bb9-4a60-bac1-1fd1e958ff61 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:54.753448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31690d1a-9bb9-4a60-bac1-1fd1e958ff61 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:54.771208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-893812a6-a086-417b-aeea-bfc019369271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61eed3ae50f8415da60fb673111695e2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:54.772185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-893812a6-a086-417b-aeea-bfc019369271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61eed3ae50f8415da60fb673111695e2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:54.775769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dcdae-a326-4db2-9fa1-54c916978408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:54.776974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dcdae-a326-4db2-9fa1-54c916978408 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:54.782654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dcdae-a326-4db2-9fa1-54c916978408 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:54.782654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dcdae-a326-4db2-9fa1-54c916978408 admin admin] PATH_INFO: `/v3/projects/f18b96c1ef634f909543790f0c455cf7/users/f42c4fed10de4f15a9ebed331162df06/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:54.826505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172dcdae-a326-4db2-9fa1-54c916978408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18b96c1ef634f909543790f0c455cf7, user_id=f42c4fed10de4f15a9ebed331162df06, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:54.829263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172dcdae-a326-4db2-9fa1-54c916978408 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:54.878957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-893812a6-a086-417b-aeea-bfc019369271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61eed3ae50f8415da60fb673111695e2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:54.879792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-893812a6-a086-417b-aeea-bfc019369271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61eed3ae50f8415da60fb673111695e2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:54.897093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-893812a6-a086-417b-aeea-bfc019369271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61eed3ae50f8415da60fb673111695e2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:54.913938 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3074/6097] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:54 2022] DELETE /identity/v3/users/61eed3ae50f8415da60fb673111695e2 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:54.914915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893812a6-a086-417b-aeea-bfc019369271 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:54.916557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-893812a6-a086-417b-aeea-bfc019369271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:55.012013 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3024/6098] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:54 2022] PUT /identity/v3/projects/f18b96c1ef634f909543790f0c455cf7/users/f42c4fed10de4f15a9ebed331162df06/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:55.013322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dcdae-a326-4db2-9fa1-54c916978408 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:55.022110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-172dcdae-a326-4db2-9fa1-54c916978408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:55.030706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893812a6-a086-417b-aeea-bfc019369271 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:55.168550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dcdae-a326-4db2-9fa1-54c916978408 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:55.184143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c9064-3299-4a28-8895-44e142ce855f tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd780010f84d405a96bd5d9a2efd9285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68be995ca5614f189b5052f4462e8b09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:55.187044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c9064-3299-4a28-8895-44e142ce855f tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:55.187044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c9064-3299-4a28-8895-44e142ce855f tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:55.188039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baca98-ed06-4b97-88d2-fd332a1f5968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:55.188482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c9064-3299-4a28-8895-44e142ce855f tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] PATH_INFO: `/v3/users/cd780010f84d405a96bd5d9a2efd9285/password` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:55.190456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baca98-ed06-4b97-88d2-fd332a1f5968 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:55.194713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baca98-ed06-4b97-88d2-fd332a1f5968 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:55.195206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baca98-ed06-4b97-88d2-fd332a1f5968 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:55.196017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1baca98-ed06-4b97-88d2-fd332a1f5968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:55.198312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1baca98-ed06-4b97-88d2-fd332a1f5968 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:55.233176 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3075/6099] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:55.236426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f8029-9b94-4b3c-ab07-5e45e7fa63a1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:55.237384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f8029-9b94-4b3c-ab07-5e45e7fa63a1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:55.237802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f8029-9b94-4b3c-ab07-5e45e7fa63a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:55.274566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b37f8029-9b94-4b3c-ab07-5e45e7fa63a1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:55.276255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b37f8029-9b94-4b3c-ab07-5e45e7fa63a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:55.296806 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3076/6100] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:55.297902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f8029-9b94-4b3c-ab07-5e45e7fa63a1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:55.300608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b37f8029-9b94-4b3c-ab07-5e45e7fa63a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:55.328037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f8029-9b94-4b3c-ab07-5e45e7fa63a1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:55.339331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f1dce-3e8c-412e-9df9-24c71b9983b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:55.352680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f1dce-3e8c-412e-9df9-24c71b9983b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:55.352965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f1dce-3e8c-412e-9df9-24c71b9983b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:55.353244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f1dce-3e8c-412e-9df9-24c71b9983b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:55.353943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f1dce-3e8c-412e-9df9-24c71b9983b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:55.359916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f1dce-3e8c-412e-9df9-24c71b9983b7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:55.387802 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3077/6101] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:55.387802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f1dce-3e8c-412e-9df9-24c71b9983b7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:55.387802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f1dce-3e8c-412e-9df9-24c71b9983b7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:55.394956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef5c7e-4596-4d3c-b808-2a11882701c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:55.396250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef5c7e-4596-4d3c-b808-2a11882701c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:55.396702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef5c7e-4596-4d3c-b808-2a11882701c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:55.396973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef5c7e-4596-4d3c-b808-2a11882701c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:55.397625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef5c7e-4596-4d3c-b808-2a11882701c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:55.399296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef5c7e-4596-4d3c-b808-2a11882701c1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:55.420595 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3078/6102] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:55.421656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef5c7e-4596-4d3c-b808-2a11882701c1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:55.426395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-54ef5c7e-4596-4d3c-b808-2a11882701c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:55.473246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4b2c9064-3299-4a28-8895-44e142ce855f tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cd780010f84d405a96bd5d9a2efd9285'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:55.543529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef5c7e-4596-4d3c-b808-2a11882701c1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:55.549549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e256395-30a9-417e-ba9d-2112fa36b9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:55.550344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e256395-30a9-417e-ba9d-2112fa36b9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:55.551186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e256395-30a9-417e-ba9d-2112fa36b9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:55.551930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e256395-30a9-417e-ba9d-2112fa36b9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:55.567588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e256395-30a9-417e-ba9d-2112fa36b9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:55.569159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e256395-30a9-417e-ba9d-2112fa36b9b4 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:55.580057 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3025/6103] 10.222.0.76 () {60 vars in 1269 bytes} [Sat Aug 27 04:52:55 2022] POST /identity/v3/users/cd780010f84d405a96bd5d9a2efd9285/password => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:55.582747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c9064-3299-4a28-8895-44e142ce855f tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:55.599390 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3079/6104] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:55.600397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e256395-30a9-417e-ba9d-2112fa36b9b4 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:55.607794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c9064-3299-4a28-8895-44e142ce855f tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:55.617204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:55.626578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32232f8-17e7-416b-aa3c-8ef9c05a6b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:55.627266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32232f8-17e7-416b-aa3c-8ef9c05a6b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:55.627545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32232f8-17e7-416b-aa3c-8ef9c05a6b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:55.627816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32232f8-17e7-416b-aa3c-8ef9c05a6b6c admin admin] PATH_INFO: `/v3/projects/f18b96c1ef634f909543790f0c455cf7/users/f42c4fed10de4f15a9ebed331162df06/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:55.631237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e256395-30a9-417e-ba9d-2112fa36b9b4 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:55.640039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32232f8-17e7-416b-aa3c-8ef9c05a6b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18b96c1ef634f909543790f0c455cf7, user_id=f42c4fed10de4f15a9ebed331162df06, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:55.643197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32232f8-17e7-416b-aa3c-8ef9c05a6b6c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:55.650371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cefb18-83a9-4074-8f1d-cdb4fca321d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:55.651355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cefb18-83a9-4074-8f1d-cdb4fca321d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:55.652503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cefb18-83a9-4074-8f1d-cdb4fca321d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:55.656554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cefb18-83a9-4074-8f1d-cdb4fca321d3 admin admin] PATH_INFO: `/v3/projects/7e86c1b3452c4299a8b93b30e13da5cb/users/bad3844831a14056a6c11886c1a8a975/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:55.679961 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3026/6105] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:55 2022] PUT /identity/v3/projects/f18b96c1ef634f909543790f0c455cf7/users/f42c4fed10de4f15a9ebed331162df06/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:55.691212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cefb18-83a9-4074-8f1d-cdb4fca321d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e86c1b3452c4299a8b93b30e13da5cb, user_id=bad3844831a14056a6c11886c1a8a975, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:55.694128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02526e-b7bd-4d90-86f6-4fee0f8b69a2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:55.694487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02526e-b7bd-4d90-86f6-4fee0f8b69a2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:55.694817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02526e-b7bd-4d90-86f6-4fee0f8b69a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:55.702029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cefb18-83a9-4074-8f1d-cdb4fca321d3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:55.744765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bd02526e-b7bd-4d90-86f6-4fee0f8b69a2 None None] MFA Rules not processed for user `f42c4fed10de4f15a9ebed331162df06`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:55.746710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bd02526e-b7bd-4d90-86f6-4fee0f8b69a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:55.810567 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3080/6106] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:55 2022] PUT /identity/v3/projects/7e86c1b3452c4299a8b93b30e13da5cb/users/bad3844831a14056a6c11886c1a8a975/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:55.812310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325e8f8-9210-437a-bead-c38edbafca47 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:55.812599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325e8f8-9210-437a-bead-c38edbafca47 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:55.812875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325e8f8-9210-437a-bead-c38edbafca47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:55.872567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9325e8f8-9210-437a-bead-c38edbafca47 None None] MFA Rules not processed for user `bad3844831a14056a6c11886c1a8a975`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:55.873881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9325e8f8-9210-437a-bead-c38edbafca47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:55.882197 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3027/6107] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:55 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:52:55.896781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02526e-b7bd-4d90-86f6-4fee0f8b69a2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:55.899387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bd02526e-b7bd-4d90-86f6-4fee0f8b69a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:55.971651 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3081/6108] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:55.993724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325e8f8-9210-437a-bead-c38edbafca47 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:55.997088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9325e8f8-9210-437a-bead-c38edbafca47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:56.008916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02526e-b7bd-4d90-86f6-4fee0f8b69a2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:56.119744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:56.128937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa76b6-1356-4b98-8a78-39da9acd390b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:56.129761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa76b6-1356-4b98-8a78-39da9acd390b service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:56.130163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa76b6-1356-4b98-8a78-39da9acd390b service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:56.130714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa76b6-1356-4b98-8a78-39da9acd390b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:56.136242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325e8f8-9210-437a-bead-c38edbafca47 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:56.144399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d492874-5a64-4d68-a5fa-72cb084ad512 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:56.146365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d492874-5a64-4d68-a5fa-72cb084ad512 service glance] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:56.147369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d492874-5a64-4d68-a5fa-72cb084ad512 service glance] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:56.149216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d492874-5a64-4d68-a5fa-72cb084ad512 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:56.169846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d492874-5a64-4d68-a5fa-72cb084ad512 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:56.172867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d492874-5a64-4d68-a5fa-72cb084ad512 service glance] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:56.199139 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3082/6109] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:52:56.242617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa76b6-1356-4b98-8a78-39da9acd390b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:56.245377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa76b6-1356-4b98-8a78-39da9acd390b service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:56.259718 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3028/6110] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:55 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:52:56.587047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abdf61-ed31-4dc4-b130-c62099b2425f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:56.588087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abdf61-ed31-4dc4-b130-c62099b2425f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:56.588475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abdf61-ed31-4dc4-b130-c62099b2425f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:56.634026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b5abdf61-ed31-4dc4-b130-c62099b2425f None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:56.635479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b5abdf61-ed31-4dc4-b130-c62099b2425f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:56.640298 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3083/6111] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:56 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 04:52:56.645637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68e07c-98c5-49ac-822c-5e1c39a36504 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:56.645637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68e07c-98c5-49ac-822c-5e1c39a36504 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:56.645637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68e07c-98c5-49ac-822c-5e1c39a36504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:56.678838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0c68e07c-98c5-49ac-822c-5e1c39a36504 None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:56.680146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0c68e07c-98c5-49ac-822c-5e1c39a36504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:56.822852 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3029/6112] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:56.830383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abdf61-ed31-4dc4-b130-c62099b2425f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:56.847769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abdf61-ed31-4dc4-b130-c62099b2425f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:56.854301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb69551-99ea-4c76-8263-37548d35fa22 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd780010f84d405a96bd5d9a2efd9285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68be995ca5614f189b5052f4462e8b09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:56.863082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb69551-99ea-4c76-8263-37548d35fa22 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:56.863967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb69551-99ea-4c76-8263-37548d35fa22 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:56.864220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb69551-99ea-4c76-8263-37548d35fa22 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] PATH_INFO: `/v3/users/cd780010f84d405a96bd5d9a2efd9285/password` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:57.023680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1cb69551-99ea-4c76-8263-37548d35fa22 tempest-IdentityV3UsersTest-860561475 tempest-IdentityV3UsersTest-860561475-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cd780010f84d405a96bd5d9a2efd9285'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:57.136862 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3084/6113] 10.222.0.76 () {60 vars in 1269 bytes} [Sat Aug 27 04:52:56 2022] POST /identity/v3/users/cd780010f84d405a96bd5d9a2efd9285/password => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:57.609502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68e07c-98c5-49ac-822c-5e1c39a36504 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:57.611902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0c68e07c-98c5-49ac-822c-5e1c39a36504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:57.732728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68e07c-98c5-49ac-822c-5e1c39a36504 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:57.750204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba959a-cdad-459e-8845-a996d15b360e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:57.751407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba959a-cdad-459e-8845-a996d15b360e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:57.751856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba959a-cdad-459e-8845-a996d15b360e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:57.752339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba959a-cdad-459e-8845-a996d15b360e admin admin] PATH_INFO: `/v3/projects/2984e48850ef455b8419393487177f02` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:57.754500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba959a-cdad-459e-8845-a996d15b360e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2984e48850ef455b8419393487177f02)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:57.760907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba959a-cdad-459e-8845-a996d15b360e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:58.018319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c0ba959a-cdad-459e-8845-a996d15b360e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2984e48850ef455b8419393487177f02', 'request_id': 'req-c0ba959a-cdad-459e-8845-a996d15b360e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:58.028284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c0ba959a-cdad-459e-8845-a996d15b360e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2984e48850ef455b8419393487177f02', 'request_id': 'req-c0ba959a-cdad-459e-8845-a996d15b360e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:58.037442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c0ba959a-cdad-459e-8845-a996d15b360e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2984e48850ef455b8419393487177f02', 'request_id': 'req-c0ba959a-cdad-459e-8845-a996d15b360e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:58.125884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:58.142522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87402a89-f640-4783-a96e-2a008d903c5c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:58.143084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87402a89-f640-4783-a96e-2a008d903c5c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:58.143084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87402a89-f640-4783-a96e-2a008d903c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:58.168861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-87402a89-f640-4783-a96e-2a008d903c5c None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:58.170686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-87402a89-f640-4783-a96e-2a008d903c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:58.181042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c0ba959a-cdad-459e-8845-a996d15b360e admin admin] The token cache is being invalidate because project 2984e48850ef455b8419393487177f02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:52:58.184405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c0ba959a-cdad-459e-8845-a996d15b360e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:58.184405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c0ba959a-cdad-459e-8845-a996d15b360e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:58.186298 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3030/6114] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:52:57 2022] DELETE /identity/v3/projects/2984e48850ef455b8419393487177f02 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:58.191314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9c017-6c8f-45ce-8970-b2252a39b8f3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:58.192069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9c017-6c8f-45ce-8970-b2252a39b8f3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:58.194049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9c017-6c8f-45ce-8970-b2252a39b8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:58.196017 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3085/6115] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:58 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 04:52:58.224589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a5c9c017-6c8f-45ce-8970-b2252a39b8f3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:58.225482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a5c9c017-6c8f-45ce-8970-b2252a39b8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:58.345090 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3031/6116] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:58.354382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1e781-9d61-4def-b843-ab6639b3aa7c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:58.355734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1e781-9d61-4def-b843-ab6639b3aa7c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:58.356229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1e781-9d61-4def-b843-ab6639b3aa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:58.381539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b1a1e781-9d61-4def-b843-ab6639b3aa7c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:58.383252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b1a1e781-9d61-4def-b843-ab6639b3aa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:58.394239 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3086/6117] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:52:58.401340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9c017-6c8f-45ce-8970-b2252a39b8f3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:58.419971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9c017-6c8f-45ce-8970-b2252a39b8f3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:58.427871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e17639-2c44-4510-a2a1-9cfdab1d86d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:58.428599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e17639-2c44-4510-a2a1-9cfdab1d86d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:58.428923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e17639-2c44-4510-a2a1-9cfdab1d86d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:58.429340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e17639-2c44-4510-a2a1-9cfdab1d86d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:58.430208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e17639-2c44-4510-a2a1-9cfdab1d86d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:52:58.430522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e17639-2c44-4510-a2a1-9cfdab1d86d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:58.432276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e17639-2c44-4510-a2a1-9cfdab1d86d5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:58.456712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1e781-9d61-4def-b843-ab6639b3aa7c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:58.467176 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3032/6118] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:52:58.468553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1e781-9d61-4def-b843-ab6639b3aa7c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:58.475177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1d779-4680-4550-ad4d-531c43c27f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:58.476645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1d779-4680-4550-ad4d-531c43c27f45 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:58.477096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1d779-4680-4550-ad4d-531c43c27f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:58.477700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1d779-4680-4550-ad4d-531c43c27f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:58.478901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1d779-4680-4550-ad4d-531c43c27f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:58.481674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1d779-4680-4550-ad4d-531c43c27f45 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:58.487295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:58.647709 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3087/6119] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:58 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:58.648936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e17639-2c44-4510-a2a1-9cfdab1d86d5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:58.663576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e17639-2c44-4510-a2a1-9cfdab1d86d5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:58.671603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1d779-4680-4550-ad4d-531c43c27f45 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:58.673369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-50e1d779-4680-4550-ad4d-531c43c27f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:58.747672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ab053-c813-4a21-8ebc-b48a0487d5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:58.748259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ab053-c813-4a21-8ebc-b48a0487d5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:58.748624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ab053-c813-4a21-8ebc-b48a0487d5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:58.748994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ab053-c813-4a21-8ebc-b48a0487d5b1 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:58.749880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ab053-c813-4a21-8ebc-b48a0487d5b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:58.751933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ab053-c813-4a21-8ebc-b48a0487d5b1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:58.795941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1d779-4680-4550-ad4d-531c43c27f45 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:58.802946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705c50e-9b3c-4075-965f-19ac710d4d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:58.803756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705c50e-9b3c-4075-965f-19ac710d4d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:58.804729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705c50e-9b3c-4075-965f-19ac710d4d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:58.805032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705c50e-9b3c-4075-965f-19ac710d4d35 admin admin] PATH_INFO: `/v3/users/bad3844831a14056a6c11886c1a8a975` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:58.806753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705c50e-9b3c-4075-965f-19ac710d4d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad3844831a14056a6c11886c1a8a975)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:58.811091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705c50e-9b3c-4075-965f-19ac710d4d35 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:58.890061 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3033/6120] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:52:58 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:58.896207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ab053-c813-4a21-8ebc-b48a0487d5b1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:58.922049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ab053-c813-4a21-8ebc-b48a0487d5b1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:58.929925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab4e1f-e6fd-4c69-b6ee-bf168e8b4f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:58.931938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab4e1f-e6fd-4c69-b6ee-bf168e8b4f98 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:58.938782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab4e1f-e6fd-4c69-b6ee-bf168e8b4f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:58.938782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab4e1f-e6fd-4c69-b6ee-bf168e8b4f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:58.938782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab4e1f-e6fd-4c69-b6ee-bf168e8b4f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:58.938782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab4e1f-e6fd-4c69-b6ee-bf168e8b4f98 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:58.973128 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3034/6121] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:58.977857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab4e1f-e6fd-4c69-b6ee-bf168e8b4f98 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:59.005210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab4e1f-e6fd-4c69-b6ee-bf168e8b4f98 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:59.016579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d262e58-6dbb-4a40-a422-1f7e21aa2e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:59.017542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d262e58-6dbb-4a40-a422-1f7e21aa2e5b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:59.017887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d262e58-6dbb-4a40-a422-1f7e21aa2e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:59.018232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d262e58-6dbb-4a40-a422-1f7e21aa2e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:59.019448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d262e58-6dbb-4a40-a422-1f7e21aa2e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:59.025932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d262e58-6dbb-4a40-a422-1f7e21aa2e5b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:59.053063 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3035/6122] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:52:59.056374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d262e58-6dbb-4a40-a422-1f7e21aa2e5b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:59.071816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d262e58-6dbb-4a40-a422-1f7e21aa2e5b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:59.086518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c623d1-2a88-4cb9-85be-ace798398353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:59.087325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c623d1-2a88-4cb9-85be-ace798398353 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:59.088358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c623d1-2a88-4cb9-85be-ace798398353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:59.088734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c623d1-2a88-4cb9-85be-ace798398353 admin admin] PATH_INFO: `/v3/projects/73d41ab0b8774f56900878dcca74a777/users/47e693ab3a174307b5d80315a8fb73c7/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:59.135402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c623d1-2a88-4cb9-85be-ace798398353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d41ab0b8774f56900878dcca74a777, user_id=47e693ab3a174307b5d80315a8fb73c7, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:59.141158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c623d1-2a88-4cb9-85be-ace798398353 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:59.163609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c705c50e-9b3c-4075-965f-19ac710d4d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad3844831a14056a6c11886c1a8a975'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:59.166559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c705c50e-9b3c-4075-965f-19ac710d4d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad3844831a14056a6c11886c1a8a975'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:59.273171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c705c50e-9b3c-4075-965f-19ac710d4d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad3844831a14056a6c11886c1a8a975'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:59.274136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c705c50e-9b3c-4075-965f-19ac710d4d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad3844831a14056a6c11886c1a8a975'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:59.282645 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3036/6123] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:52:59 2022] PUT /identity/v3/projects/73d41ab0b8774f56900878dcca74a777/users/47e693ab3a174307b5d80315a8fb73c7/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:59.285260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d186f93-6003-4a37-b583-912b204b0471 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:59.285729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d186f93-6003-4a37-b583-912b204b0471 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:59.286014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d186f93-6003-4a37-b583-912b204b0471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:59.298068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c705c50e-9b3c-4075-965f-19ac710d4d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad3844831a14056a6c11886c1a8a975'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:52:59.325693 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3088/6124] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:58 2022] DELETE /identity/v3/users/bad3844831a14056a6c11886c1a8a975 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:52:59.327025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111a502-5560-4e88-93ba-ab747707e503 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:59.327314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111a502-5560-4e88-93ba-ab747707e503 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:59.327596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111a502-5560-4e88-93ba-ab747707e503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:59.355186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9d186f93-6003-4a37-b583-912b204b0471 None None] MFA Rules not processed for user `cd780010f84d405a96bd5d9a2efd9285`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:59.357324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9d186f93-6003-4a37-b583-912b204b0471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:59.400606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8111a502-5560-4e88-93ba-ab747707e503 None None] MFA Rules not processed for user `47e693ab3a174307b5d80315a8fb73c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:59.401876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8111a502-5560-4e88-93ba-ab747707e503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:59.516320 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3037/6125] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:59.518089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb400a-fcbb-44aa-bfe3-becdfae1df51 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:59.518285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb400a-fcbb-44aa-bfe3-becdfae1df51 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:59.519619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb400a-fcbb-44aa-bfe3-becdfae1df51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:59.530802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:52:59.553256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-45bb400a-fcbb-44aa-bfe3-becdfae1df51 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:52:59.555452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-45bb400a-fcbb-44aa-bfe3-becdfae1df51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:59.572761 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3089/6126] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:59.573943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111a502-5560-4e88-93ba-ab747707e503 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:59.575322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8111a502-5560-4e88-93ba-ab747707e503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:59.664027 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3038/6127] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:52:59.665321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb400a-fcbb-44aa-bfe3-becdfae1df51 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:59.676953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-45bb400a-fcbb-44aa-bfe3-becdfae1df51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:52:59.703781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb400a-fcbb-44aa-bfe3-becdfae1df51 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:59.721606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ee6e8-0c67-4de5-a166-fb89d843b758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:59.722955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ee6e8-0c67-4de5-a166-fb89d843b758 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:59.723458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ee6e8-0c67-4de5-a166-fb89d843b758 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:59.724104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ee6e8-0c67-4de5-a166-fb89d843b758 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:59.726220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ee6e8-0c67-4de5-a166-fb89d843b758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:59.728990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ee6e8-0c67-4de5-a166-fb89d843b758 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:59.777716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111a502-5560-4e88-93ba-ab747707e503 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:52:59.791330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08226ef1-896b-434e-9b48-3430eb328d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:52:59.793485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226ef1-896b-434e-9b48-3430eb328d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:52:59.793624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226ef1-896b-434e-9b48-3430eb328d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:52:59.793891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226ef1-896b-434e-9b48-3430eb328d06 admin admin] PATH_INFO: `/v3/users/cd780010f84d405a96bd5d9a2efd9285` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:52:59.795351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08226ef1-896b-434e-9b48-3430eb328d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd780010f84d405a96bd5d9a2efd9285)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:52:59.798217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08226ef1-896b-434e-9b48-3430eb328d06 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:52:59.944029 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3039/6128] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:52:59 2022] POST /identity/v3/projects => generated 377 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:52:59.947503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ee6e8-0c67-4de5-a166-fb89d843b758 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:52:59.953772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c23ee6e8-0c67-4de5-a166-fb89d843b758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:00.129630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-08226ef1-896b-434e-9b48-3430eb328d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd780010f84d405a96bd5d9a2efd9285'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:00.133494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-08226ef1-896b-434e-9b48-3430eb328d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd780010f84d405a96bd5d9a2efd9285'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:00.140994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ee6e8-0c67-4de5-a166-fb89d843b758 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:00.149832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6028226-726f-4132-95bf-5982129c1317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:00.155268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6028226-726f-4132-95bf-5982129c1317 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:00.155268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6028226-726f-4132-95bf-5982129c1317 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:00.155268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6028226-726f-4132-95bf-5982129c1317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:00.303028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-08226ef1-896b-434e-9b48-3430eb328d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd780010f84d405a96bd5d9a2efd9285'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:00.304613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-08226ef1-896b-434e-9b48-3430eb328d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd780010f84d405a96bd5d9a2efd9285'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:00.330709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-08226ef1-896b-434e-9b48-3430eb328d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd780010f84d405a96bd5d9a2efd9285'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:00.367662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6028226-726f-4132-95bf-5982129c1317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:00.368316 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3090/6129] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:52:59 2022] DELETE /identity/v3/users/cd780010f84d405a96bd5d9a2efd9285 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:00.370285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6028226-726f-4132-95bf-5982129c1317 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:00.370899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08226ef1-896b-434e-9b48-3430eb328d06 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:00.377479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-08226ef1-896b-434e-9b48-3430eb328d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:00.409810 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3040/6130] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:00.411669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92a33c-2adb-4837-8a18-322f9c895d2c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:00.411965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92a33c-2adb-4837-8a18-322f9c895d2c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:00.416649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92a33c-2adb-4837-8a18-322f9c895d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:00.498006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5a92a33c-2adb-4837-8a18-322f9c895d2c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:00.499461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5a92a33c-2adb-4837-8a18-322f9c895d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:00.592878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08226ef1-896b-434e-9b48-3430eb328d06 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:00.620940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c38c45-bcd7-468b-8c74-81876d44a84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:00.621995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38c45-bcd7-468b-8c74-81876d44a84a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:00.622556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38c45-bcd7-468b-8c74-81876d44a84a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:00.625919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38c45-bcd7-468b-8c74-81876d44a84a admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:00.629754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c38c45-bcd7-468b-8c74-81876d44a84a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:00.641942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c38c45-bcd7-468b-8c74-81876d44a84a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:00.742741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:00.744387 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3041/6131] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:00.774782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92a33c-2adb-4837-8a18-322f9c895d2c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:00.777844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5a92a33c-2adb-4837-8a18-322f9c895d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:00.839462 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3091/6132] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:00 2022] POST /identity/v3/users => generated 289 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:00.845539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c38c45-bcd7-468b-8c74-81876d44a84a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:00.867221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c38c45-bcd7-468b-8c74-81876d44a84a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:00.904298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ff908-413a-4706-944e-5871a997942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:00.905119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ff908-413a-4706-944e-5871a997942a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:00.905518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ff908-413a-4706-944e-5871a997942a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:00.908974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ff908-413a-4706-944e-5871a997942a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:00.911929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ff908-413a-4706-944e-5871a997942a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:00.916770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ff908-413a-4706-944e-5871a997942a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:00.954048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:00.968148 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3092/6133] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:00.970183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92a33c-2adb-4837-8a18-322f9c895d2c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:00.972662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ff908-413a-4706-944e-5871a997942a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:00.986097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181051dd-f373-4571-9b0b-b822b3160e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:00.986758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181051dd-f373-4571-9b0b-b822b3160e67 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:00.987040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181051dd-f373-4571-9b0b-b822b3160e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:00.987314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181051dd-f373-4571-9b0b-b822b3160e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:00.994941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ff908-413a-4706-944e-5871a997942a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:01.009533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc97e6-7d17-41a0-aa34-38dedf5e5691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:01.010050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181051dd-f373-4571-9b0b-b822b3160e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:01.011742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc97e6-7d17-41a0-aa34-38dedf5e5691 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:01.012402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc97e6-7d17-41a0-aa34-38dedf5e5691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:01.013356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181051dd-f373-4571-9b0b-b822b3160e67 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:01.013805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc97e6-7d17-41a0-aa34-38dedf5e5691 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:01.014486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc97e6-7d17-41a0-aa34-38dedf5e5691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:01.017569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc97e6-7d17-41a0-aa34-38dedf5e5691 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:01.050893 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3042/6134] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:01.057886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181051dd-f373-4571-9b0b-b822b3160e67 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:01.076054 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3093/6135] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:01.076264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181051dd-f373-4571-9b0b-b822b3160e67 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:01.076264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e9dea-ec31-4b0c-a758-d70a2fa20111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:01.077172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e9dea-ec31-4b0c-a758-d70a2fa20111 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:01.077635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e9dea-ec31-4b0c-a758-d70a2fa20111 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:01.078071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e9dea-ec31-4b0c-a758-d70a2fa20111 admin admin] PATH_INFO: `/v3/projects/4dcc9e99087a4963a0e95f36f43149ed/users/1ab6204921764766a064cd63d11316dc/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:01.096409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e9dea-ec31-4b0c-a758-d70a2fa20111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dcc9e99087a4963a0e95f36f43149ed, user_id=1ab6204921764766a064cd63d11316dc, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:01.101029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e9dea-ec31-4b0c-a758-d70a2fa20111 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:01.216564 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3043/6136] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:01 2022] PUT /identity/v3/projects/4dcc9e99087a4963a0e95f36f43149ed/users/1ab6204921764766a064cd63d11316dc/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:01.229120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb013d1-440d-4e99-ac38-7d1e0cc5e28d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:01.229956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb013d1-440d-4e99-ac38-7d1e0cc5e28d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:01.230485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb013d1-440d-4e99-ac38-7d1e0cc5e28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:01.272876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ecb013d1-440d-4e99-ac38-7d1e0cc5e28d None None] MFA Rules not processed for user `1ab6204921764766a064cd63d11316dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:01.275134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ecb013d1-440d-4e99-ac38-7d1e0cc5e28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:01.420937 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3094/6137] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:01.426097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e9dea-ec31-4b0c-a758-d70a2fa20111 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:01.604858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e9dea-ec31-4b0c-a758-d70a2fa20111 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:01.611175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc02caa-44c9-4914-9274-475d665be342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:01.611954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc02caa-44c9-4914-9274-475d665be342 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:01.612271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc02caa-44c9-4914-9274-475d665be342 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:01.613161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc02caa-44c9-4914-9274-475d665be342 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:01.613767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc02caa-44c9-4914-9274-475d665be342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:01.617006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc02caa-44c9-4914-9274-475d665be342 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:01.837193 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3044/6138] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:01 2022] POST /identity/v3/projects => generated 379 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:01.838629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb013d1-440d-4e99-ac38-7d1e0cc5e28d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:01.852774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb013d1-440d-4e99-ac38-7d1e0cc5e28d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:02.001135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974ef24-85a3-47b7-af42-08c2a0da11bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:02.001424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974ef24-85a3-47b7-af42-08c2a0da11bf admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:02.001657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974ef24-85a3-47b7-af42-08c2a0da11bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:02.001903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974ef24-85a3-47b7-af42-08c2a0da11bf admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:02.002548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974ef24-85a3-47b7-af42-08c2a0da11bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:02.005232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974ef24-85a3-47b7-af42-08c2a0da11bf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:02.038751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:02.116088 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3095/6139] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:01 2022] POST /identity/v3/users => generated 296 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:02.117278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc02caa-44c9-4914-9274-475d665be342 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:02.128662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc02caa-44c9-4914-9274-475d665be342 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:02.135393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84210b3-9c77-40d3-ba8e-3774ab1ec6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:02.136072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84210b3-9c77-40d3-ba8e-3774ab1ec6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:02.136488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84210b3-9c77-40d3-ba8e-3774ab1ec6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:02.136696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84210b3-9c77-40d3-ba8e-3774ab1ec6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:02.137594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84210b3-9c77-40d3-ba8e-3774ab1ec6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:02.139040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84210b3-9c77-40d3-ba8e-3774ab1ec6b8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:02.156820 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3045/6140] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:02.157100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974ef24-85a3-47b7-af42-08c2a0da11bf admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:02.191636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974ef24-85a3-47b7-af42-08c2a0da11bf admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:02.197295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a50102-2249-4ea0-84ea-b2ba6249959e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:02.198364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a50102-2249-4ea0-84ea-b2ba6249959e admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:02.198816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a50102-2249-4ea0-84ea-b2ba6249959e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:02.200865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a50102-2249-4ea0-84ea-b2ba6249959e admin admin] PATH_INFO: `/v3/projects/f1c327f146704d888352779929747fe7/users/cc21a3a93d144fdf9056b637e990bf49/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:02.233660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a50102-2249-4ea0-84ea-b2ba6249959e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c327f146704d888352779929747fe7, user_id=cc21a3a93d144fdf9056b637e990bf49, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:02.237257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a50102-2249-4ea0-84ea-b2ba6249959e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:02.370838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84210b3-9c77-40d3-ba8e-3774ab1ec6b8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:02.371734 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3096/6141] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:02 2022] PUT /identity/v3/projects/f1c327f146704d888352779929747fe7/users/cc21a3a93d144fdf9056b637e990bf49/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:53:02.393920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84210b3-9c77-40d3-ba8e-3774ab1ec6b8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:02.527482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697af385-70f0-4104-9138-7a2f0d1e6155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:02.532084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697af385-70f0-4104-9138-7a2f0d1e6155 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:02.533041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697af385-70f0-4104-9138-7a2f0d1e6155 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:02.533496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697af385-70f0-4104-9138-7a2f0d1e6155 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:02.534472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697af385-70f0-4104-9138-7a2f0d1e6155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:02.536912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697af385-70f0-4104-9138-7a2f0d1e6155 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:02.573078 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3046/6142] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:02.573235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a50102-2249-4ea0-84ea-b2ba6249959e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:02.584639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a50102-2249-4ea0-84ea-b2ba6249959e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:02.592154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed00039-45f4-46e8-ac20-f7b73177add7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:02.596636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed00039-45f4-46e8-ac20-f7b73177add7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:02.598523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed00039-45f4-46e8-ac20-f7b73177add7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:02.598993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed00039-45f4-46e8-ac20-f7b73177add7 admin admin] PATH_INFO: `/v3/projects/f1c327f146704d888352779929747fe7/users/cc21a3a93d144fdf9056b637e990bf49/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:02.601659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed00039-45f4-46e8-ac20-f7b73177add7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c327f146704d888352779929747fe7, user_id=cc21a3a93d144fdf9056b637e990bf49, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:02.606602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed00039-45f4-46e8-ac20-f7b73177add7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:02.645209 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3097/6143] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:02 2022] PUT /identity/v3/projects/f1c327f146704d888352779929747fe7/users/cc21a3a93d144fdf9056b637e990bf49/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:53:02.753495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca031f-9b24-4026-8436-ba135b10eb90 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:02.754706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca031f-9b24-4026-8436-ba135b10eb90 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:02.754706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca031f-9b24-4026-8436-ba135b10eb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:02.764857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed00039-45f4-46e8-ac20-f7b73177add7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:02.765275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7ed00039-45f4-46e8-ac20-f7b73177add7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:02.851719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ceca031f-9b24-4026-8436-ba135b10eb90 None None] MFA Rules not processed for user `cc21a3a93d144fdf9056b637e990bf49`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:02.853148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ceca031f-9b24-4026-8436-ba135b10eb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:02.911786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed00039-45f4-46e8-ac20-f7b73177add7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:02.925636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:02.926309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:02.926594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:02.926871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d admin admin] PATH_INFO: `/v3/projects/68be995ca5614f189b5052f4462e8b09` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:02.930208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d admin admin] RBAC: Authorizing `identity:delete_project(project_id=68be995ca5614f189b5052f4462e8b09)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:02.932035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:03.031451 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3047/6144] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:03.032363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca031f-9b24-4026-8436-ba135b10eb90 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:03.044601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ceca031f-9b24-4026-8436-ba135b10eb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:03.070366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca031f-9b24-4026-8436-ba135b10eb90 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:03.081148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabac8cb-1188-48db-9f0a-b64a8a58c2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:03.083404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabac8cb-1188-48db-9f0a-b64a8a58c2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:03.083907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabac8cb-1188-48db-9f0a-b64a8a58c2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:03.084422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabac8cb-1188-48db-9f0a-b64a8a58c2fa admin admin] PATH_INFO: `/v3/projects/7e86c1b3452c4299a8b93b30e13da5cb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:03.089023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabac8cb-1188-48db-9f0a-b64a8a58c2fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e86c1b3452c4299a8b93b30e13da5cb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:03.091754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabac8cb-1188-48db-9f0a-b64a8a58c2fa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:03.127251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68be995ca5614f189b5052f4462e8b09', 'request_id': 'req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:03.146241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68be995ca5614f189b5052f4462e8b09', 'request_id': 'req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:03.250843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68be995ca5614f189b5052f4462e8b09', 'request_id': 'req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:03.265018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d admin admin] The token cache is being invalidate because project 68be995ca5614f189b5052f4462e8b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:03.265716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:03.295694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:03.303825 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3098/6145] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:02 2022] DELETE /identity/v3/projects/68be995ca5614f189b5052f4462e8b09 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:53:03.306680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:03.310086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:03.335156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dabac8cb-1188-48db-9f0a-b64a8a58c2fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e86c1b3452c4299a8b93b30e13da5cb', 'request_id': 'req-dabac8cb-1188-48db-9f0a-b64a8a58c2fa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:03.356002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dabac8cb-1188-48db-9f0a-b64a8a58c2fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e86c1b3452c4299a8b93b30e13da5cb', 'request_id': 'req-dabac8cb-1188-48db-9f0a-b64a8a58c2fa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:03.397763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dabac8cb-1188-48db-9f0a-b64a8a58c2fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e86c1b3452c4299a8b93b30e13da5cb', 'request_id': 'req-dabac8cb-1188-48db-9f0a-b64a8a58c2fa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:03.434762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:03.474569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6183a-cc96-40e3-a1a9-12e7b2dc471d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:03.582491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dabac8cb-1188-48db-9f0a-b64a8a58c2fa admin admin] The token cache is being invalidate because project 7e86c1b3452c4299a8b93b30e13da5cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:03.583071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dabac8cb-1188-48db-9f0a-b64a8a58c2fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:03.584359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dabac8cb-1188-48db-9f0a-b64a8a58c2fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:03.587298 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3048/6146] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:03 2022] DELETE /identity/v3/projects/7e86c1b3452c4299a8b93b30e13da5cb => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:03.589387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ee77-5e61-4ae5-b5e7-881951b3f6a3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:03.591386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ee77-5e61-4ae5-b5e7-881951b3f6a3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:03.592321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ee77-5e61-4ae5-b5e7-881951b3f6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:03.600140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b98e8-bfca-4dc7-b890-31ab401b2413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:03.601500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b98e8-bfca-4dc7-b890-31ab401b2413 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:03.601500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b98e8-bfca-4dc7-b890-31ab401b2413 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:03.604965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b98e8-bfca-4dc7-b890-31ab401b2413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:03.610121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fa4b98e8-bfca-4dc7-b890-31ab401b2413 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:03.636888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7634ee77-5e61-4ae5-b5e7-881951b3f6a3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:03.638184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7634ee77-5e61-4ae5-b5e7-881951b3f6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:03.668392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:03.725990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b98e8-bfca-4dc7-b890-31ab401b2413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:03.728369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b98e8-bfca-4dc7-b890-31ab401b2413 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:03.744912 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3099/6147] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:03.748060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5ef06-648a-4a3a-b4f7-e0f34d915907 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:03.748490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5ef06-648a-4a3a-b4f7-e0f34d915907 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:03.749392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5ef06-648a-4a3a-b4f7-e0f34d915907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:03.769993 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3049/6148] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:03.771542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feb43b-c9f0-41a6-85a1-ad9b33260d39 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:03.772018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feb43b-c9f0-41a6-85a1-ad9b33260d39 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:03.774950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feb43b-c9f0-41a6-85a1-ad9b33260d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:03.783086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-edd5ef06-648a-4a3a-b4f7-e0f34d915907 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:03.783086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-edd5ef06-648a-4a3a-b4f7-e0f34d915907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:03.801745 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3100/6149] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:03.803940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849b5bf-a50c-476e-b549-9ed0f188ba95 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:03.804757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849b5bf-a50c-476e-b549-9ed0f188ba95 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:03.805131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849b5bf-a50c-476e-b549-9ed0f188ba95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:03.818819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c7feb43b-c9f0-41a6-85a1-ad9b33260d39 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:03.828916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c7feb43b-c9f0-41a6-85a1-ad9b33260d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:03.834634 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3050/6150] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:03.835905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feb43b-c9f0-41a6-85a1-ad9b33260d39 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:03.847809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feb43b-c9f0-41a6-85a1-ad9b33260d39 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:03.848949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5849b5bf-a50c-476e-b549-9ed0f188ba95 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:03.853830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5849b5bf-a50c-476e-b549-9ed0f188ba95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:03.853997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbc144-b255-4564-8d35-ebf714157a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:03.854807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbc144-b255-4564-8d35-ebf714157a80 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:03.855408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbc144-b255-4564-8d35-ebf714157a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:03.855866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbc144-b255-4564-8d35-ebf714157a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:03.857023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbc144-b255-4564-8d35-ebf714157a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:53:03.857565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbc144-b255-4564-8d35-ebf714157a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:03.859925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbc144-b255-4564-8d35-ebf714157a80 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:03.869975 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3101/6151] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:53:03.872120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849b5bf-a50c-476e-b549-9ed0f188ba95 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:03.886431 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3051/6152] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:53:03.890199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849b5bf-a50c-476e-b549-9ed0f188ba95 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:03.891333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbc144-b255-4564-8d35-ebf714157a80 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:03.906409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084871b3-dddc-4636-b2a2-d2b5d34267c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:03.907198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084871b3-dddc-4636-b2a2-d2b5d34267c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:03.907483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084871b3-dddc-4636-b2a2-d2b5d34267c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:03.907745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084871b3-dddc-4636-b2a2-d2b5d34267c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:03.924736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084871b3-dddc-4636-b2a2-d2b5d34267c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:53:03.925748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084871b3-dddc-4636-b2a2-d2b5d34267c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:03.927481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084871b3-dddc-4636-b2a2-d2b5d34267c6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:03.931372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbc144-b255-4564-8d35-ebf714157a80 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:03.944101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea26625-bba5-4e70-b5e4-fade117eceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:03.944784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea26625-bba5-4e70-b5e4-fade117eceab admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:03.945060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea26625-bba5-4e70-b5e4-fade117eceab admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:03.945337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea26625-bba5-4e70-b5e4-fade117eceab admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:03.945981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea26625-bba5-4e70-b5e4-fade117eceab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:03.947916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea26625-bba5-4e70-b5e4-fade117eceab admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:03.961259 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3102/6153] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:53:03.963080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084871b3-dddc-4636-b2a2-d2b5d34267c6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:03.969661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-084871b3-dddc-4636-b2a2-d2b5d34267c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:03.996943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084871b3-dddc-4636-b2a2-d2b5d34267c6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:04.008731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cb992-8736-4126-89f0-597dd1d1a897 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:04.009384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cb992-8736-4126-89f0-597dd1d1a897 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:04.009661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cb992-8736-4126-89f0-597dd1d1a897 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:04.009948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cb992-8736-4126-89f0-597dd1d1a897 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:04.013582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d20cb992-8736-4126-89f0-597dd1d1a897 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:04.084636 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3052/6154] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:03 2022] POST /identity/v3/projects => generated 399 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:04.085793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea26625-bba5-4e70-b5e4-fade117eceab admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:04.135187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cb992-8736-4126-89f0-597dd1d1a897 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:04.139172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cb992-8736-4126-89f0-597dd1d1a897 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:04.163308 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3103/6155] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:04.176987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cb992-8736-4126-89f0-597dd1d1a897 service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:04.205788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cb992-8736-4126-89f0-597dd1d1a897 service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:04.260441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea26625-bba5-4e70-b5e4-fade117eceab admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:04.266969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36673135-05d1-4ff7-a79e-dd0e18b221c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:04.267850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36673135-05d1-4ff7-a79e-dd0e18b221c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:04.268469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36673135-05d1-4ff7-a79e-dd0e18b221c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:04.269149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36673135-05d1-4ff7-a79e-dd0e18b221c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:04.270060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36673135-05d1-4ff7-a79e-dd0e18b221c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:04.272289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36673135-05d1-4ff7-a79e-dd0e18b221c5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:04.356806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307697e-f7ab-4912-96ea-1b306befeb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:04.357931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307697e-f7ab-4912-96ea-1b306befeb8a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:04.358378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307697e-f7ab-4912-96ea-1b306befeb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:04.361469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307697e-f7ab-4912-96ea-1b306befeb8a admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:04.367581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307697e-f7ab-4912-96ea-1b306befeb8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:04.371450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307697e-f7ab-4912-96ea-1b306befeb8a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:04.432548 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3053/6156] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:04 2022] POST /identity/v3/projects => generated 385 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:04.440855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36673135-05d1-4ff7-a79e-dd0e18b221c5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:04.479846 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3104/6157] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:04 2022] POST /identity/v3/users => generated 306 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:04.484941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307697e-f7ab-4912-96ea-1b306befeb8a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:04.509005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307697e-f7ab-4912-96ea-1b306befeb8a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:04.592735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36673135-05d1-4ff7-a79e-dd0e18b221c5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:04.601232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3dd1c-84ea-418f-9473-2aad7a50fb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:04.602050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3dd1c-84ea-418f-9473-2aad7a50fb63 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:04.602432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3dd1c-84ea-418f-9473-2aad7a50fb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:04.603009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3dd1c-84ea-418f-9473-2aad7a50fb63 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:04.605412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3dd1c-84ea-418f-9473-2aad7a50fb63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:04.607891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3dd1c-84ea-418f-9473-2aad7a50fb63 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:04.656784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:04.697927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136c315-3ba1-464a-8a38-a94e900afa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:04.698560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136c315-3ba1-464a-8a38-a94e900afa4a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:04.698837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136c315-3ba1-464a-8a38-a94e900afa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:04.699102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136c315-3ba1-464a-8a38-a94e900afa4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:04.701022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136c315-3ba1-464a-8a38-a94e900afa4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:04.702379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136c315-3ba1-464a-8a38-a94e900afa4a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:04.732662 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3105/6158] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:04.737015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136c315-3ba1-464a-8a38-a94e900afa4a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:04.761560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136c315-3ba1-464a-8a38-a94e900afa4a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:04.774778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016755cb-cfa4-4e78-9929-84101ed27a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:04.775988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016755cb-cfa4-4e78-9929-84101ed27a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:04.776485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016755cb-cfa4-4e78-9929-84101ed27a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:04.776924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016755cb-cfa4-4e78-9929-84101ed27a4a admin admin] PATH_INFO: `/v3/projects/a58a9546b04e469088f687658b6d5ba0/users/a8300bd4c67a4039a3cdc33a5fffcd4c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:04.787504 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3054/6159] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:04 2022] POST /identity/v3/users => generated 293 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:04.792150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3dd1c-84ea-418f-9473-2aad7a50fb63 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:04.820844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3dd1c-84ea-418f-9473-2aad7a50fb63 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:04.830625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e7d03-a505-4f39-b2a9-6bb3656f8382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:04.831865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e7d03-a505-4f39-b2a9-6bb3656f8382 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:04.832505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e7d03-a505-4f39-b2a9-6bb3656f8382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:04.833080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e7d03-a505-4f39-b2a9-6bb3656f8382 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:04.833938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e7d03-a505-4f39-b2a9-6bb3656f8382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:04.835771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e7d03-a505-4f39-b2a9-6bb3656f8382 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:04.840134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016755cb-cfa4-4e78-9929-84101ed27a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58a9546b04e469088f687658b6d5ba0, user_id=a8300bd4c67a4039a3cdc33a5fffcd4c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:04.850070 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3055/6160] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:04.854473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016755cb-cfa4-4e78-9929-84101ed27a4a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:04.854831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e7d03-a505-4f39-b2a9-6bb3656f8382 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:04.881574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e7d03-a505-4f39-b2a9-6bb3656f8382 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:04.895908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b37eae-6da8-481a-a566-27bf2c659262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:04.896597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b37eae-6da8-481a-a566-27bf2c659262 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:04.896878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b37eae-6da8-481a-a566-27bf2c659262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:04.899584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b37eae-6da8-481a-a566-27bf2c659262 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:04.900305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b37eae-6da8-481a-a566-27bf2c659262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:04.905367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b37eae-6da8-481a-a566-27bf2c659262 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:04.922767 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3056/6161] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:04.927370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b37eae-6da8-481a-a566-27bf2c659262 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:04.947878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b37eae-6da8-481a-a566-27bf2c659262 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:04.966291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc0c6f-ec9f-43a1-b7ac-c7cec5e1d3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:04.969333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc0c6f-ec9f-43a1-b7ac-c7cec5e1d3db admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:04.969629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc0c6f-ec9f-43a1-b7ac-c7cec5e1d3db admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:04.969909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc0c6f-ec9f-43a1-b7ac-c7cec5e1d3db admin admin] PATH_INFO: `/v3/projects/9a675622ae36405791117896fa14f7fe/users/e751f2bca5574d7fb1a3cfd19ec10c01/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:04.991980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc0c6f-ec9f-43a1-b7ac-c7cec5e1d3db admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a675622ae36405791117896fa14f7fe, user_id=e751f2bca5574d7fb1a3cfd19ec10c01, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:04.998381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc0c6f-ec9f-43a1-b7ac-c7cec5e1d3db admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:05.054473 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3106/6162] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:04 2022] PUT /identity/v3/projects/a58a9546b04e469088f687658b6d5ba0/users/a8300bd4c67a4039a3cdc33a5fffcd4c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:05.055453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016755cb-cfa4-4e78-9929-84101ed27a4a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:05.107314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:05.187384 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3057/6163] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:04 2022] PUT /identity/v3/projects/9a675622ae36405791117896fa14f7fe/users/e751f2bca5574d7fb1a3cfd19ec10c01/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:05.189848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2f2e4-eb28-44bf-83e4-907024939a5e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:05.190325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2f2e4-eb28-44bf-83e4-907024939a5e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:05.190992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2f2e4-eb28-44bf-83e4-907024939a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:05.231653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016755cb-cfa4-4e78-9929-84101ed27a4a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:05.266848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3de2f2e4-eb28-44bf-83e4-907024939a5e None None] MFA Rules not processed for user `e751f2bca5574d7fb1a3cfd19ec10c01`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:05.269573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3de2f2e4-eb28-44bf-83e4-907024939a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:05.403757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7ca65-15d9-4c06-95c4-fba470fdad99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:05.404760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7ca65-15d9-4c06-95c4-fba470fdad99 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:05.405216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7ca65-15d9-4c06-95c4-fba470fdad99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:05.405666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7ca65-15d9-4c06-95c4-fba470fdad99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:05.406492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7ca65-15d9-4c06-95c4-fba470fdad99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:05.408753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7ca65-15d9-4c06-95c4-fba470fdad99 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:05.416715 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3058/6164] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:05.422705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2f2e4-eb28-44bf-83e4-907024939a5e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:05.428967 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3107/6165] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:05.430538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7ca65-15d9-4c06-95c4-fba470fdad99 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:05.449723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2f2e4-eb28-44bf-83e4-907024939a5e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:05.457711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7ca65-15d9-4c06-95c4-fba470fdad99 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:05.544657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9833e4-0a4b-4935-b970-1643a489138b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:05.544657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9833e4-0a4b-4935-b970-1643a489138b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:05.544657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9833e4-0a4b-4935-b970-1643a489138b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:05.544657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9833e4-0a4b-4935-b970-1643a489138b admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:05.547289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9833e4-0a4b-4935-b970-1643a489138b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:05.547289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9833e4-0a4b-4935-b970-1643a489138b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:05.548047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696952f-4e46-4fb6-a25f-94cee86db159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:05.548047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696952f-4e46-4fb6-a25f-94cee86db159 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:05.548047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696952f-4e46-4fb6-a25f-94cee86db159 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:05.548047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696952f-4e46-4fb6-a25f-94cee86db159 admin admin] PATH_INFO: `/v3/projects/a58a9546b04e469088f687658b6d5ba0/users/a8300bd4c67a4039a3cdc33a5fffcd4c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:05.549072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696952f-4e46-4fb6-a25f-94cee86db159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58a9546b04e469088f687658b6d5ba0, user_id=a8300bd4c67a4039a3cdc33a5fffcd4c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:05.549072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696952f-4e46-4fb6-a25f-94cee86db159 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:05.549072 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3108/6166] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:05 2022] PUT /identity/v3/projects/a58a9546b04e469088f687658b6d5ba0/users/a8300bd4c67a4039a3cdc33a5fffcd4c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:53:05.556239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510b5d-dc90-460e-b0c9-cc0cb6caad00 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:05.556535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510b5d-dc90-460e-b0c9-cc0cb6caad00 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:05.556808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510b5d-dc90-460e-b0c9-cc0cb6caad00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:05.651317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c1510b5d-dc90-460e-b0c9-cc0cb6caad00 None None] MFA Rules not processed for user `a8300bd4c67a4039a3cdc33a5fffcd4c`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:05.653863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c1510b5d-dc90-460e-b0c9-cc0cb6caad00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:05.709206 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3059/6167] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:05 2022] POST /identity/v3/projects => generated 385 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:05.710857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9833e4-0a4b-4935-b970-1643a489138b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:05.935884 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3109/6168] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:05 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:05.952652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1510b5d-dc90-460e-b0c9-cc0cb6caad00 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:05.988746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:06.102849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9833e4-0a4b-4935-b970-1643a489138b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:06.131326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068c22b-05a2-4884-abec-99ed8ece5f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:06.133623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068c22b-05a2-4884-abec-99ed8ece5f68 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:06.135989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068c22b-05a2-4884-abec-99ed8ece5f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:06.137766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068c22b-05a2-4884-abec-99ed8ece5f68 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:06.138825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068c22b-05a2-4884-abec-99ed8ece5f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:06.154156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068c22b-05a2-4884-abec-99ed8ece5f68 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:06.222012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1510b5d-dc90-460e-b0c9-cc0cb6caad00 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:06.230293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189d703-be45-48b7-92dd-64c7eec3de30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:06.231217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189d703-be45-48b7-92dd-64c7eec3de30 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:06.231648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189d703-be45-48b7-92dd-64c7eec3de30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:06.232092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189d703-be45-48b7-92dd-64c7eec3de30 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:06.232873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189d703-be45-48b7-92dd-64c7eec3de30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:06.235003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189d703-be45-48b7-92dd-64c7eec3de30 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:06.368768 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3060/6169] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:05 2022] POST /identity/v3/users => generated 299 bytes in 659 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:06.372474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068c22b-05a2-4884-abec-99ed8ece5f68 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:06.403545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068c22b-05a2-4884-abec-99ed8ece5f68 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:06.410727 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3110/6170] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:05 2022] POST /identity/v3/projects => generated 397 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:06.411270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c74dca-5704-486f-b64a-5cdb97603574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:06.412026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c74dca-5704-486f-b64a-5cdb97603574 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:06.412455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c74dca-5704-486f-b64a-5cdb97603574 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:06.412957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c74dca-5704-486f-b64a-5cdb97603574 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:06.413960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c74dca-5704-486f-b64a-5cdb97603574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:06.415201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189d703-be45-48b7-92dd-64c7eec3de30 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:06.415853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c74dca-5704-486f-b64a-5cdb97603574 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:06.436701 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3061/6171] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:53:06.446364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c74dca-5704-486f-b64a-5cdb97603574 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:06.495598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c74dca-5704-486f-b64a-5cdb97603574 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:06.576293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189d703-be45-48b7-92dd-64c7eec3de30 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:06.601032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c1cfa-08b9-4705-88a5-8169b49148c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:06.601673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c1cfa-08b9-4705-88a5-8169b49148c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:06.601956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c1cfa-08b9-4705-88a5-8169b49148c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:06.602231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c1cfa-08b9-4705-88a5-8169b49148c5 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:06.602917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c1cfa-08b9-4705-88a5-8169b49148c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:06.604892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c1cfa-08b9-4705-88a5-8169b49148c5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:06.658011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b6ca4-8cd2-42ba-ae48-47082bc7794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:06.659835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b6ca4-8cd2-42ba-ae48-47082bc7794f admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:06.659978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b6ca4-8cd2-42ba-ae48-47082bc7794f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:06.660272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b6ca4-8cd2-42ba-ae48-47082bc7794f admin admin] PATH_INFO: `/v3/projects/d86a3aa454114d5086ba036d737d9572/users/2cff882ed4564c4cb34e207578003907/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:06.698705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b6ca4-8cd2-42ba-ae48-47082bc7794f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d86a3aa454114d5086ba036d737d9572, user_id=2cff882ed4564c4cb34e207578003907, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:06.703827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b6ca4-8cd2-42ba-ae48-47082bc7794f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:06.777498 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3111/6172] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:06 2022] POST /identity/v3/users => generated 299 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:06.781482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c1cfa-08b9-4705-88a5-8169b49148c5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:06.813259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c1cfa-08b9-4705-88a5-8169b49148c5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:06.814689 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3062/6173] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:06 2022] PUT /identity/v3/projects/d86a3aa454114d5086ba036d737d9572/users/2cff882ed4564c4cb34e207578003907/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:06.830683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b6ca4-8cd2-42ba-ae48-47082bc7794f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:07.005906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913254f-a360-4945-8e07-f445e9101c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:07.067081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913254f-a360-4945-8e07-f445e9101c83 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:07.067081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913254f-a360-4945-8e07-f445e9101c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:07.067081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913254f-a360-4945-8e07-f445e9101c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:07.067081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913254f-a360-4945-8e07-f445e9101c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:07.067081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913254f-a360-4945-8e07-f445e9101c83 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:07.067081 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3112/6174] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:53:07.068103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913254f-a360-4945-8e07-f445e9101c83 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:07.068103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913254f-a360-4945-8e07-f445e9101c83 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:07.069252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b6ca4-8cd2-42ba-ae48-47082bc7794f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:07.070527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276d586-5635-4899-89c4-f81bae7768c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:07.071701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276d586-5635-4899-89c4-f81bae7768c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:07.072244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276d586-5635-4899-89c4-f81bae7768c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:07.072821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276d586-5635-4899-89c4-f81bae7768c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:07.073790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276d586-5635-4899-89c4-f81bae7768c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:07.075690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276d586-5635-4899-89c4-f81bae7768c7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:07.080827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37f63e-2133-4e45-848e-ada87a86394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:07.081673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37f63e-2133-4e45-848e-ada87a86394f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:07.081953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37f63e-2133-4e45-848e-ada87a86394f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:07.082228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37f63e-2133-4e45-848e-ada87a86394f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:07.083023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37f63e-2133-4e45-848e-ada87a86394f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:07.091081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37f63e-2133-4e45-848e-ada87a86394f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:07.093903 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3113/6175] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:07.098572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276d586-5635-4899-89c4-f81bae7768c7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:07.125111 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3063/6176] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:07.129013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276d586-5635-4899-89c4-f81bae7768c7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:07.131228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37f63e-2133-4e45-848e-ada87a86394f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:07.159279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70408c3f-c183-48ee-886d-93d99b92afd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:07.165631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408c3f-c183-48ee-886d-93d99b92afd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:07.166507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408c3f-c183-48ee-886d-93d99b92afd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:07.169064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408c3f-c183-48ee-886d-93d99b92afd0 admin admin] PATH_INFO: `/v3/projects/3aa8fbf1aae4401184b543cf428fc33d/users/6dcfe5d20f2c4f758d2b4adc190883e2/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:07.176312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37f63e-2133-4e45-848e-ada87a86394f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:07.194731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24dfed-6966-4dc6-9112-65337429c804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:07.200263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24dfed-6966-4dc6-9112-65337429c804 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:07.200601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24dfed-6966-4dc6-9112-65337429c804 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:07.204192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24dfed-6966-4dc6-9112-65337429c804 admin admin] PATH_INFO: `/v3/projects/d86a3aa454114d5086ba036d737d9572/users/2cff882ed4564c4cb34e207578003907/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:07.210485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24dfed-6966-4dc6-9112-65337429c804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d86a3aa454114d5086ba036d737d9572, user_id=2cff882ed4564c4cb34e207578003907, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:07.217701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24dfed-6966-4dc6-9112-65337429c804 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:07.227498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70408c3f-c183-48ee-886d-93d99b92afd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa8fbf1aae4401184b543cf428fc33d, user_id=6dcfe5d20f2c4f758d2b4adc190883e2, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:07.237137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70408c3f-c183-48ee-886d-93d99b92afd0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:07.249119 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3064/6177] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:07 2022] PUT /identity/v3/projects/d86a3aa454114d5086ba036d737d9572/users/2cff882ed4564c4cb34e207578003907/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:07.263175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b33ad-c81f-46cf-9a13-da3869a2b991 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:07.263620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b33ad-c81f-46cf-9a13-da3869a2b991 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:07.263995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b33ad-c81f-46cf-9a13-da3869a2b991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:07.325799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-920b33ad-c81f-46cf-9a13-da3869a2b991 None None] MFA Rules not processed for user `2cff882ed4564c4cb34e207578003907`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:07.330195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-920b33ad-c81f-46cf-9a13-da3869a2b991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:07.426275 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3114/6178] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:07 2022] PUT /identity/v3/projects/3aa8fbf1aae4401184b543cf428fc33d/users/6dcfe5d20f2c4f758d2b4adc190883e2/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:07.439226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece87538-33df-4387-929d-96bf653ad971 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:07.439794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece87538-33df-4387-929d-96bf653ad971 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:07.440270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece87538-33df-4387-929d-96bf653ad971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:07.518043 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3065/6179] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:53:07.580611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ece87538-33df-4387-929d-96bf653ad971 None None] MFA Rules not processed for user `6dcfe5d20f2c4f758d2b4adc190883e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:07.582136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ece87538-33df-4387-929d-96bf653ad971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:07.728887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:07.769700 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3115/6180] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:53:07.783703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b33ad-c81f-46cf-9a13-da3869a2b991 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:07.785714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-920b33ad-c81f-46cf-9a13-da3869a2b991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:07.964092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b33ad-c81f-46cf-9a13-da3869a2b991 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:07.993633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece87538-33df-4387-929d-96bf653ad971 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:07.995047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ece87538-33df-4387-929d-96bf653ad971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:08.110730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d830544-e683-4cee-96e9-3a8679f058ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:08.111958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d830544-e683-4cee-96e9-3a8679f058ee service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:08.113147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d830544-e683-4cee-96e9-3a8679f058ee service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:08.113638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d830544-e683-4cee-96e9-3a8679f058ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:08.172686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece87538-33df-4387-929d-96bf653ad971 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:08.190784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77151248-a70c-4a52-a155-d1280552ab1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:08.191510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77151248-a70c-4a52-a155-d1280552ab1e service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:08.191787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77151248-a70c-4a52-a155-d1280552ab1e service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:08.192054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77151248-a70c-4a52-a155-d1280552ab1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:08.213365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d830544-e683-4cee-96e9-3a8679f058ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:08.219261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d830544-e683-4cee-96e9-3a8679f058ee service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:08.250100 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3066/6181] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:07 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:08.250979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d830544-e683-4cee-96e9-3a8679f058ee service glance] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:08.252398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3d830544-e683-4cee-96e9-3a8679f058ee service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:08.388134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77151248-a70c-4a52-a155-d1280552ab1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:08.396566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77151248-a70c-4a52-a155-d1280552ab1e service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:08.434536 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3116/6182] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:08.442314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0bdea-d154-4245-bc79-5458d5f69006 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:08.443486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0bdea-d154-4245-bc79-5458d5f69006 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:08.444557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0bdea-d154-4245-bc79-5458d5f69006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:08.467187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d830544-e683-4cee-96e9-3a8679f058ee service glance] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:08.480924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55388bc3-f521-46fb-a7db-48cde7ba1574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:08.481699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55388bc3-f521-46fb-a7db-48cde7ba1574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:08.482223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55388bc3-f521-46fb-a7db-48cde7ba1574 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:08.489282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55388bc3-f521-46fb-a7db-48cde7ba1574 admin admin] PATH_INFO: `/v3/users/29c36a19050147e6a97e28fb6d0d0fc5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:08.507311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55388bc3-f521-46fb-a7db-48cde7ba1574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29c36a19050147e6a97e28fb6d0d0fc5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:08.513433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55388bc3-f521-46fb-a7db-48cde7ba1574 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:08.549210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-35e0bdea-d154-4245-bc79-5458d5f69006 None None] MFA Rules not processed for user `b62acf375a104203a66043c136fb1f99`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:08.557310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-35e0bdea-d154-4245-bc79-5458d5f69006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:08.707428 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3117/6183] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:08.726038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0bdea-d154-4245-bc79-5458d5f69006 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:08.727639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-35e0bdea-d154-4245-bc79-5458d5f69006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:08.858317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0bdea-d154-4245-bc79-5458d5f69006 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:08.869915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449728a4-447b-453c-b2be-50a009797ec1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:08.872455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449728a4-447b-453c-b2be-50a009797ec1 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:08.872966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449728a4-447b-453c-b2be-50a009797ec1 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:08.873928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449728a4-447b-453c-b2be-50a009797ec1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:08.905384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:08.914617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449728a4-447b-453c-b2be-50a009797ec1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:08.916991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-55388bc3-f521-46fb-a7db-48cde7ba1574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29c36a19050147e6a97e28fb6d0d0fc5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:08.921215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449728a4-447b-453c-b2be-50a009797ec1 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:08.953449 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3118/6184] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:53:09.098825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-55388bc3-f521-46fb-a7db-48cde7ba1574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29c36a19050147e6a97e28fb6d0d0fc5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:09.098825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-55388bc3-f521-46fb-a7db-48cde7ba1574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29c36a19050147e6a97e28fb6d0d0fc5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:09.109683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-55388bc3-f521-46fb-a7db-48cde7ba1574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29c36a19050147e6a97e28fb6d0d0fc5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:09.167905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-55388bc3-f521-46fb-a7db-48cde7ba1574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29c36a19050147e6a97e28fb6d0d0fc5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:09.189621 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3067/6185] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:08 2022] DELETE /identity/v3/users/29c36a19050147e6a97e28fb6d0d0fc5 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:09.192628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4bca9-bba1-409f-b8c8-f13f9e211436 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:09.192628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4bca9-bba1-409f-b8c8-f13f9e211436 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:09.196682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4bca9-bba1-409f-b8c8-f13f9e211436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:09.230596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-39b4bca9-bba1-409f-b8c8-f13f9e211436 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:09.233668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-39b4bca9-bba1-409f-b8c8-f13f9e211436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:09.276758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:09.375717 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3119/6186] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:09.461114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55388bc3-f521-46fb-a7db-48cde7ba1574 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:09.464432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-55388bc3-f521-46fb-a7db-48cde7ba1574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:09.577605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55388bc3-f521-46fb-a7db-48cde7ba1574 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:09.583554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd7bbc-ffc4-432e-ad1f-fe6e45a7f499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:09.584382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd7bbc-ffc4-432e-ad1f-fe6e45a7f499 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:09.584740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd7bbc-ffc4-432e-ad1f-fe6e45a7f499 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:09.585181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd7bbc-ffc4-432e-ad1f-fe6e45a7f499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:09.613715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd7bbc-ffc4-432e-ad1f-fe6e45a7f499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:09.615955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd7bbc-ffc4-432e-ad1f-fe6e45a7f499 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:09.657332 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3068/6187] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:09.811770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4bca9-bba1-409f-b8c8-f13f9e211436 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:09.811770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-39b4bca9-bba1-409f-b8c8-f13f9e211436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:09.825496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4bca9-bba1-409f-b8c8-f13f9e211436 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:09.851666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8a790-dd23-4811-880f-eb8bb35774f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:09.851666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8a790-dd23-4811-880f-eb8bb35774f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:09.851666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8a790-dd23-4811-880f-eb8bb35774f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:09.851666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8a790-dd23-4811-880f-eb8bb35774f0 admin admin] PATH_INFO: `/v3/users/a8300bd4c67a4039a3cdc33a5fffcd4c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:09.852090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8a790-dd23-4811-880f-eb8bb35774f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8300bd4c67a4039a3cdc33a5fffcd4c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:09.853706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8a790-dd23-4811-880f-eb8bb35774f0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:09.854051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254b49-e11a-46d7-9bbc-9682075b27c9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:09.854345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254b49-e11a-46d7-9bbc-9682075b27c9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:09.854763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254b49-e11a-46d7-9bbc-9682075b27c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:09.898656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c5254b49-e11a-46d7-9bbc-9682075b27c9 None None] MFA Rules not processed for user `e525d35a47544404b70b7f87052c51b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:09.899955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c5254b49-e11a-46d7-9bbc-9682075b27c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:10.103824 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3069/6188] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:09 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:10.110888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244baaef-07ea-4cc5-bf80-802c04473b3e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:10.110888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244baaef-07ea-4cc5-bf80-802c04473b3e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:10.111201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244baaef-07ea-4cc5-bf80-802c04473b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:10.153456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-244baaef-07ea-4cc5-bf80-802c04473b3e None None] MFA Rules not processed for user `581232a8dc7e41bc93bd4f9b184db2bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:10.159073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-244baaef-07ea-4cc5-bf80-802c04473b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:10.208506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7cb8a790-dd23-4811-880f-eb8bb35774f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8300bd4c67a4039a3cdc33a5fffcd4c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:10.210104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7cb8a790-dd23-4811-880f-eb8bb35774f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8300bd4c67a4039a3cdc33a5fffcd4c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:10.298193 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3070/6189] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:10 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:53:10.313049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244baaef-07ea-4cc5-bf80-802c04473b3e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:10.314505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-244baaef-07ea-4cc5-bf80-802c04473b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:10.329746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7cb8a790-dd23-4811-880f-eb8bb35774f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8300bd4c67a4039a3cdc33a5fffcd4c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:10.330580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7cb8a790-dd23-4811-880f-eb8bb35774f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8300bd4c67a4039a3cdc33a5fffcd4c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:10.352772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7cb8a790-dd23-4811-880f-eb8bb35774f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8300bd4c67a4039a3cdc33a5fffcd4c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:10.384650 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3120/6190] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:09 2022] DELETE /identity/v3/users/a8300bd4c67a4039a3cdc33a5fffcd4c => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:10.388849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93edd6-878d-4cef-ade9-1cb8c4d8f752 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:10.389422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93edd6-878d-4cef-ade9-1cb8c4d8f752 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:10.389912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93edd6-878d-4cef-ade9-1cb8c4d8f752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:10.443212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0e93edd6-878d-4cef-ade9-1cb8c4d8f752 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:10.446739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0e93edd6-878d-4cef-ade9-1cb8c4d8f752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:10.483369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244baaef-07ea-4cc5-bf80-802c04473b3e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:10.537729 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3121/6191] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:10.638031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e62260-fd73-4ce9-b1f5-3abce82addbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:10.639854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e62260-fd73-4ce9-b1f5-3abce82addbe service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:10.643042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e62260-fd73-4ce9-b1f5-3abce82addbe service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:10.643353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e62260-fd73-4ce9-b1f5-3abce82addbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:10.650257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-36e62260-fd73-4ce9-b1f5-3abce82addbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:10.687313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93edd6-878d-4cef-ade9-1cb8c4d8f752 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:10.690436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0e93edd6-878d-4cef-ade9-1cb8c4d8f752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:10.788249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e62260-fd73-4ce9-b1f5-3abce82addbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:10.790786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e62260-fd73-4ce9-b1f5-3abce82addbe service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:10.826062 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3071/6192] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:10 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:10.841899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e62260-fd73-4ce9-b1f5-3abce82addbe service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:10.866578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-36e62260-fd73-4ce9-b1f5-3abce82addbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:10.886271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93edd6-878d-4cef-ade9-1cb8c4d8f752 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:10.907303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd626d-b187-4106-9f7e-dd58af44f4bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:10.915886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd626d-b187-4106-9f7e-dd58af44f4bf service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:10.916316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd626d-b187-4106-9f7e-dd58af44f4bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:10.918442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd626d-b187-4106-9f7e-dd58af44f4bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:10.927151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e62260-fd73-4ce9-b1f5-3abce82addbe service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:10.945794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7eec22-6450-463a-8b1d-1fa5a88b4cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:10.946537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eec22-6450-463a-8b1d-1fa5a88b4cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:10.946894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eec22-6450-463a-8b1d-1fa5a88b4cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:10.947244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eec22-6450-463a-8b1d-1fa5a88b4cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:10.949424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cf7eec22-6450-463a-8b1d-1fa5a88b4cd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:10.973318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd626d-b187-4106-9f7e-dd58af44f4bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:10.979469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd626d-b187-4106-9f7e-dd58af44f4bf service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:11.016079 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3122/6193] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:53:11.018249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd626d-b187-4106-9f7e-dd58af44f4bf service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:11.021980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-96dd626d-b187-4106-9f7e-dd58af44f4bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:11.058393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd626d-b187-4106-9f7e-dd58af44f4bf service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:11.067600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f9eae-635f-460e-ac99-5685dfcb1107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:11.068729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f9eae-635f-460e-ac99-5685dfcb1107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:11.069279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f9eae-635f-460e-ac99-5685dfcb1107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:11.069785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f9eae-635f-460e-ac99-5685dfcb1107 admin admin] PATH_INFO: `/v3/projects/3b41a15d18c840f198f5860fd595d4ca` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:11.071595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f9eae-635f-460e-ac99-5685dfcb1107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b41a15d18c840f198f5860fd595d4ca)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:11.075304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f9eae-635f-460e-ac99-5685dfcb1107 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:11.122212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7eec22-6450-463a-8b1d-1fa5a88b4cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:11.128349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7eec22-6450-463a-8b1d-1fa5a88b4cd4 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:11.146968 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3072/6194] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:11.246454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-678f9eae-635f-460e-ac99-5685dfcb1107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b41a15d18c840f198f5860fd595d4ca', 'request_id': 'req-678f9eae-635f-460e-ac99-5685dfcb1107'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:11.270295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-678f9eae-635f-460e-ac99-5685dfcb1107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b41a15d18c840f198f5860fd595d4ca', 'request_id': 'req-678f9eae-635f-460e-ac99-5685dfcb1107'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:11.393935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-678f9eae-635f-460e-ac99-5685dfcb1107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b41a15d18c840f198f5860fd595d4ca', 'request_id': 'req-678f9eae-635f-460e-ac99-5685dfcb1107'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:11.420501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-678f9eae-635f-460e-ac99-5685dfcb1107 admin admin] The token cache is being invalidate because project 3b41a15d18c840f198f5860fd595d4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:11.420798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-678f9eae-635f-460e-ac99-5685dfcb1107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:11.422019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-678f9eae-635f-460e-ac99-5685dfcb1107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:11.431727 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3123/6195] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:11 2022] DELETE /identity/v3/projects/3b41a15d18c840f198f5860fd595d4ca => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:11.433869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7eec22-6450-463a-8b1d-1fa5a88b4cd4 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:11.460687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7eec22-6450-463a-8b1d-1fa5a88b4cd4 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:11.484508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:11.633516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16632a2-2b34-4255-8fa7-53ae6efdc76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:11.634860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16632a2-2b34-4255-8fa7-53ae6efdc76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:11.636133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16632a2-2b34-4255-8fa7-53ae6efdc76a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:11.636133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16632a2-2b34-4255-8fa7-53ae6efdc76a admin admin] PATH_INFO: `/v3/users/f42c4fed10de4f15a9ebed331162df06` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:11.637369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16632a2-2b34-4255-8fa7-53ae6efdc76a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f42c4fed10de4f15a9ebed331162df06)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:11.639543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16632a2-2b34-4255-8fa7-53ae6efdc76a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:12.005748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f16632a2-2b34-4255-8fa7-53ae6efdc76a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f42c4fed10de4f15a9ebed331162df06'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:12.029290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536f298-4ba8-4168-be4a-8f355b9d3148 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:12.029925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536f298-4ba8-4168-be4a-8f355b9d3148 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:12.030862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536f298-4ba8-4168-be4a-8f355b9d3148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:12.039275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-f536f298-4ba8-4168-be4a-8f355b9d3148 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:53:12.039275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:53:12.039275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:53:12.039275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:53:12.039275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:53:12.039275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:53:12.039275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:53:12.039275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:53:12.039275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:53:12.039275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:53:12.039275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:53:12.039275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:53:12.039275 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:53:12.044473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:53:12.044473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:53:12.044473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:53:12.044473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:53:12.044473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:53:12.044473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:53:12.044473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:53:12.044473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:53:12.044473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:53:12.044473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:53:12.044473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:53:12.044473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:53:12.044473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:53:12.044473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:53:12.044473 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:53:12.045800 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3124/6196] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:53:12 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 13 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:53:12.170282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f16632a2-2b34-4255-8fa7-53ae6efdc76a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f42c4fed10de4f15a9ebed331162df06'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:12.170962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f16632a2-2b34-4255-8fa7-53ae6efdc76a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f42c4fed10de4f15a9ebed331162df06'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:12.180482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f16632a2-2b34-4255-8fa7-53ae6efdc76a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f42c4fed10de4f15a9ebed331162df06'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:12.204196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f16632a2-2b34-4255-8fa7-53ae6efdc76a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f42c4fed10de4f15a9ebed331162df06'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:12.214325 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3073/6197] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:11 2022] DELETE /identity/v3/users/f42c4fed10de4f15a9ebed331162df06 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:13.218940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536f298-4ba8-4168-be4a-8f355b9d3148 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:13.220942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f536f298-4ba8-4168-be4a-8f355b9d3148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:13.402453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:13.424290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536f298-4ba8-4168-be4a-8f355b9d3148 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:13.446534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:13.446534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:13.446534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:13.446534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376 admin admin] PATH_INFO: `/v3/projects/a58a9546b04e469088f687658b6d5ba0` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:13.447027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58a9546b04e469088f687658b6d5ba0)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:13.448811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:13.687108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58a9546b04e469088f687658b6d5ba0', 'request_id': 'req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:13.716153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58a9546b04e469088f687658b6d5ba0', 'request_id': 'req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:13.842315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16632a2-2b34-4255-8fa7-53ae6efdc76a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:13.843934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f16632a2-2b34-4255-8fa7-53ae6efdc76a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:13.871316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16632a2-2b34-4255-8fa7-53ae6efdc76a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:13.889560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58a9546b04e469088f687658b6d5ba0', 'request_id': 'req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:13.911451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376 admin admin] The token cache is being invalidate because project a58a9546b04e469088f687658b6d5ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:13.911743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:13.917981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:13.921313 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3125/6198] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:13 2022] DELETE /identity/v3/projects/a58a9546b04e469088f687658b6d5ba0 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:13.927316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:13.932476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:14.040541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeab9bb-f0a7-4a35-b98f-cf1445693442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:14.041502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeab9bb-f0a7-4a35-b98f-cf1445693442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:14.041995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeab9bb-f0a7-4a35-b98f-cf1445693442 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:14.042537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeab9bb-f0a7-4a35-b98f-cf1445693442 admin admin] PATH_INFO: `/v3/projects/f18b96c1ef634f909543790f0c455cf7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:14.047135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeab9bb-f0a7-4a35-b98f-cf1445693442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f18b96c1ef634f909543790f0c455cf7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:14.049398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeab9bb-f0a7-4a35-b98f-cf1445693442 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:14.135970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b23f0e-8ec4-4ab9-a303-d8e311f27376 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:14.148945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a1de0-da3b-46b9-b2cc-7d8cbeef5b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:14.150339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a1de0-da3b-46b9-b2cc-7d8cbeef5b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:14.151061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a1de0-da3b-46b9-b2cc-7d8cbeef5b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:14.151586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a1de0-da3b-46b9-b2cc-7d8cbeef5b2a admin admin] PATH_INFO: `/v3/users/6dcfe5d20f2c4f758d2b4adc190883e2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:14.156066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a1de0-da3b-46b9-b2cc-7d8cbeef5b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dcfe5d20f2c4f758d2b4adc190883e2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:14.160616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a1de0-da3b-46b9-b2cc-7d8cbeef5b2a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:14.265584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ddeab9bb-f0a7-4a35-b98f-cf1445693442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f18b96c1ef634f909543790f0c455cf7', 'request_id': 'req-ddeab9bb-f0a7-4a35-b98f-cf1445693442'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:14.273806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:14.275312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ddeab9bb-f0a7-4a35-b98f-cf1445693442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f18b96c1ef634f909543790f0c455cf7', 'request_id': 'req-ddeab9bb-f0a7-4a35-b98f-cf1445693442'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:14.286471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ddeab9bb-f0a7-4a35-b98f-cf1445693442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f18b96c1ef634f909543790f0c455cf7', 'request_id': 'req-ddeab9bb-f0a7-4a35-b98f-cf1445693442'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:14.389304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ddeab9bb-f0a7-4a35-b98f-cf1445693442 admin admin] The token cache is being invalidate because project f18b96c1ef634f909543790f0c455cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:14.389612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ddeab9bb-f0a7-4a35-b98f-cf1445693442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:14.390355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ddeab9bb-f0a7-4a35-b98f-cf1445693442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:14.392771 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3074/6199] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:13 2022] DELETE /identity/v3/projects/f18b96c1ef634f909543790f0c455cf7 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:14.397548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8fda7-4819-4449-b2e2-9d0822db22ea None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:14.397842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8fda7-4819-4449-b2e2-9d0822db22ea None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:14.398125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8fda7-4819-4449-b2e2-9d0822db22ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:14.429274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7b8a1de0-da3b-46b9-b2cc-7d8cbeef5b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dcfe5d20f2c4f758d2b4adc190883e2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:14.430233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7b8a1de0-da3b-46b9-b2cc-7d8cbeef5b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dcfe5d20f2c4f758d2b4adc190883e2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:14.474952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8ba8fda7-4819-4449-b2e2-9d0822db22ea None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:14.477998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8ba8fda7-4819-4449-b2e2-9d0822db22ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:14.518979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7b8a1de0-da3b-46b9-b2cc-7d8cbeef5b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dcfe5d20f2c4f758d2b4adc190883e2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:14.519798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7b8a1de0-da3b-46b9-b2cc-7d8cbeef5b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dcfe5d20f2c4f758d2b4adc190883e2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:14.550557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7b8a1de0-da3b-46b9-b2cc-7d8cbeef5b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dcfe5d20f2c4f758d2b4adc190883e2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:14.581961 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3126/6200] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:13 2022] DELETE /identity/v3/users/6dcfe5d20f2c4f758d2b4adc190883e2 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:14.632826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:14.636191 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3075/6201] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:14.643036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e7025-a864-4098-949e-2097c77de098 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:14.643844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e7025-a864-4098-949e-2097c77de098 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:14.644381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e7025-a864-4098-949e-2097c77de098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:14.708190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c38e7025-a864-4098-949e-2097c77de098 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:14.711523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c38e7025-a864-4098-949e-2097c77de098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:14.869833 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3127/6202] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:14.874489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8fda7-4819-4449-b2e2-9d0822db22ea None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:14.896675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8fda7-4819-4449-b2e2-9d0822db22ea None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:14.911187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81c5df-5ed5-4e1b-8977-17b0187ddfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:14.912146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81c5df-5ed5-4e1b-8977-17b0187ddfab admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:14.913529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81c5df-5ed5-4e1b-8977-17b0187ddfab admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:14.914596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81c5df-5ed5-4e1b-8977-17b0187ddfab admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:14.917944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81c5df-5ed5-4e1b-8977-17b0187ddfab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:53:14.918533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81c5df-5ed5-4e1b-8977-17b0187ddfab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:14.922228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81c5df-5ed5-4e1b-8977-17b0187ddfab admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:14.969994 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3076/6203] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:53:14.975239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e7025-a864-4098-949e-2097c77de098 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:14.986500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e7025-a864-4098-949e-2097c77de098 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:14.992092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51470d-1536-4973-9079-41cec6b9ec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:14.992787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51470d-1536-4973-9079-41cec6b9ec11 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:14.993067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51470d-1536-4973-9079-41cec6b9ec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:14.993346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51470d-1536-4973-9079-41cec6b9ec11 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:14.993995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51470d-1536-4973-9079-41cec6b9ec11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:14.995947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51470d-1536-4973-9079-41cec6b9ec11 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:15.160658 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3128/6204] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:14 2022] POST /identity/v3/projects => generated 357 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:15.164911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81c5df-5ed5-4e1b-8977-17b0187ddfab admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:15.182837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81c5df-5ed5-4e1b-8977-17b0187ddfab admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:15.271639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266db39f-d26c-4554-b9e3-80bc42f63520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:15.272692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266db39f-d26c-4554-b9e3-80bc42f63520 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:15.273183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266db39f-d26c-4554-b9e3-80bc42f63520 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:15.274423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266db39f-d26c-4554-b9e3-80bc42f63520 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:15.275327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266db39f-d26c-4554-b9e3-80bc42f63520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:15.278181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266db39f-d26c-4554-b9e3-80bc42f63520 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:15.371047 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3077/6205] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:15 2022] POST /identity/v3/users => generated 279 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:15.374923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51470d-1536-4973-9079-41cec6b9ec11 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:15.391269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51470d-1536-4973-9079-41cec6b9ec11 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:15.404091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dda69-f930-4d15-94ac-6078caf04395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:15.404826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dda69-f930-4d15-94ac-6078caf04395 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:15.405114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dda69-f930-4d15-94ac-6078caf04395 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:15.405451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dda69-f930-4d15-94ac-6078caf04395 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:15.406024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928dda69-f930-4d15-94ac-6078caf04395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:15.408689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928dda69-f930-4d15-94ac-6078caf04395 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:15.438565 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3129/6206] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:15.445496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266db39f-d26c-4554-b9e3-80bc42f63520 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:15.461307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266db39f-d26c-4554-b9e3-80bc42f63520 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:15.469524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0923de-e2d3-4b4b-b7e3-6b2aeff88c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:15.470149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0923de-e2d3-4b4b-b7e3-6b2aeff88c82 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:15.470433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0923de-e2d3-4b4b-b7e3-6b2aeff88c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:15.470709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0923de-e2d3-4b4b-b7e3-6b2aeff88c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:15.471489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0923de-e2d3-4b4b-b7e3-6b2aeff88c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:15.479951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0923de-e2d3-4b4b-b7e3-6b2aeff88c82 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:15.508915 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3078/6207] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:15.512737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dda69-f930-4d15-94ac-6078caf04395 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:15.529818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dda69-f930-4d15-94ac-6078caf04395 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:15.543470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622f40f-0cd1-412c-871d-70668623a053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:15.543470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622f40f-0cd1-412c-871d-70668623a053 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:15.543470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622f40f-0cd1-412c-871d-70668623a053 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:15.543470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622f40f-0cd1-412c-871d-70668623a053 admin admin] PATH_INFO: `/v3/projects/8294e34ae47f4d6bbb8fc590d6939221/users/a8b6504d5be24d67b2f600d054a0eb0c/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:15.574433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622f40f-0cd1-412c-871d-70668623a053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8294e34ae47f4d6bbb8fc590d6939221, user_id=a8b6504d5be24d67b2f600d054a0eb0c, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:15.577137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622f40f-0cd1-412c-871d-70668623a053 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:15.710516 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3130/6208] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:15 2022] PUT /identity/v3/projects/8294e34ae47f4d6bbb8fc590d6939221/users/a8b6504d5be24d67b2f600d054a0eb0c/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:15.725540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c4a15-0c2f-4e38-97a1-81e5654efbca None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:15.728135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c4a15-0c2f-4e38-97a1-81e5654efbca None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:15.730683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c4a15-0c2f-4e38-97a1-81e5654efbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:15.792266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8a9c4a15-0c2f-4e38-97a1-81e5654efbca None None] MFA Rules not processed for user `a8b6504d5be24d67b2f600d054a0eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:15.793736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8a9c4a15-0c2f-4e38-97a1-81e5654efbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:15.963555 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3079/6209] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:15.993391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622f40f-0cd1-412c-871d-70668623a053 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:15.995266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0622f40f-0cd1-412c-871d-70668623a053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:16.032033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c4a15-0c2f-4e38-97a1-81e5654efbca None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:16.035961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8a9c4a15-0c2f-4e38-97a1-81e5654efbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:16.163497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622f40f-0cd1-412c-871d-70668623a053 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:16.177702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff4449-6e13-4212-a44b-79ef5d8c8630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:16.178531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff4449-6e13-4212-a44b-79ef5d8c8630 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:16.178927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff4449-6e13-4212-a44b-79ef5d8c8630 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:16.179318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff4449-6e13-4212-a44b-79ef5d8c8630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:16.197417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff4449-6e13-4212-a44b-79ef5d8c8630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:16.199009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff4449-6e13-4212-a44b-79ef5d8c8630 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:16.226949 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3131/6210] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:16.237682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c4a15-0c2f-4e38-97a1-81e5654efbca None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:16.250104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d6297-c823-4bd4-b1b2-b75c22708402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:16.252346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d6297-c823-4bd4-b1b2-b75c22708402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:16.252930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d6297-c823-4bd4-b1b2-b75c22708402 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:16.253356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d6297-c823-4bd4-b1b2-b75c22708402 admin admin] PATH_INFO: `/v3/users/47e693ab3a174307b5d80315a8fb73c7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:16.256443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d6297-c823-4bd4-b1b2-b75c22708402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e693ab3a174307b5d80315a8fb73c7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:16.263376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d6297-c823-4bd4-b1b2-b75c22708402 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:16.434802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bf628-56af-48c7-8b8f-1fb31ae1a238 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:16.435552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bf628-56af-48c7-8b8f-1fb31ae1a238 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:16.436034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bf628-56af-48c7-8b8f-1fb31ae1a238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:16.474761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-848bf628-56af-48c7-8b8f-1fb31ae1a238 None None] MFA Rules not processed for user `b62acf375a104203a66043c136fb1f99`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:16.476006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-848bf628-56af-48c7-8b8f-1fb31ae1a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:16.583805 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3132/6211] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:53:16.585227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bf628-56af-48c7-8b8f-1fb31ae1a238 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:16.587312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-848bf628-56af-48c7-8b8f-1fb31ae1a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:16.592761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:16.609258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bf628-56af-48c7-8b8f-1fb31ae1a238 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:16.615491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89261561-198b-43c1-ab1e-beff700547e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:16.616313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89261561-198b-43c1-ab1e-beff700547e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:16.616702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89261561-198b-43c1-ab1e-beff700547e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:16.617267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89261561-198b-43c1-ab1e-beff700547e6 admin admin] PATH_INFO: `/v3/projects/3aa8fbf1aae4401184b543cf428fc33d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:16.618760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89261561-198b-43c1-ab1e-beff700547e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa8fbf1aae4401184b543cf428fc33d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:16.621737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89261561-198b-43c1-ab1e-beff700547e6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:16.661377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-867d6297-c823-4bd4-b1b2-b75c22708402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e693ab3a174307b5d80315a8fb73c7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:16.754045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:16.781839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-867d6297-c823-4bd4-b1b2-b75c22708402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e693ab3a174307b5d80315a8fb73c7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:16.784906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-867d6297-c823-4bd4-b1b2-b75c22708402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e693ab3a174307b5d80315a8fb73c7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:16.801116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-867d6297-c823-4bd4-b1b2-b75c22708402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e693ab3a174307b5d80315a8fb73c7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:16.825717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-89261561-198b-43c1-ab1e-beff700547e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa8fbf1aae4401184b543cf428fc33d', 'request_id': 'req-89261561-198b-43c1-ab1e-beff700547e6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:16.827185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-867d6297-c823-4bd4-b1b2-b75c22708402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e693ab3a174307b5d80315a8fb73c7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:16.837732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-89261561-198b-43c1-ab1e-beff700547e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa8fbf1aae4401184b543cf428fc33d', 'request_id': 'req-89261561-198b-43c1-ab1e-beff700547e6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:16.841021 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3080/6212] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:16 2022] DELETE /identity/v3/users/47e693ab3a174307b5d80315a8fb73c7 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:53:16.843996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8db18-1389-4f7c-b5d7-99d7aa4a553c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:16.844312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8db18-1389-4f7c-b5d7-99d7aa4a553c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:16.845756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8db18-1389-4f7c-b5d7-99d7aa4a553c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:16.873094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-efe8db18-1389-4f7c-b5d7-99d7aa4a553c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:16.874657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-efe8db18-1389-4f7c-b5d7-99d7aa4a553c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:16.937751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-89261561-198b-43c1-ab1e-beff700547e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa8fbf1aae4401184b543cf428fc33d', 'request_id': 'req-89261561-198b-43c1-ab1e-beff700547e6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:16.963886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-89261561-198b-43c1-ab1e-beff700547e6 admin admin] The token cache is being invalidate because project 3aa8fbf1aae4401184b543cf428fc33d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:16.964206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-89261561-198b-43c1-ab1e-beff700547e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:16.965429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-89261561-198b-43c1-ab1e-beff700547e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:16.969768 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3133/6213] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:16 2022] DELETE /identity/v3/projects/3aa8fbf1aae4401184b543cf428fc33d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:16.976143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110afb4b-f045-468d-9cfe-f232148f5ea5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:16.976685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110afb4b-f045-468d-9cfe-f232148f5ea5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:16.982621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110afb4b-f045-468d-9cfe-f232148f5ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:16.985386 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3081/6214] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:17.026193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-110afb4b-f045-468d-9cfe-f232148f5ea5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:17.027636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-110afb4b-f045-468d-9cfe-f232148f5ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:17.050178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8db18-1389-4f7c-b5d7-99d7aa4a553c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:17.052025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-efe8db18-1389-4f7c-b5d7-99d7aa4a553c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:17.055570 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3134/6215] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:53:17.064345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14902d4e-7c41-4dfc-b935-20ccc47aedd0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:17.064559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14902d4e-7c41-4dfc-b935-20ccc47aedd0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:17.064777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14902d4e-7c41-4dfc-b935-20ccc47aedd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:17.115206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-14902d4e-7c41-4dfc-b935-20ccc47aedd0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:17.116675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-14902d4e-7c41-4dfc-b935-20ccc47aedd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:17.134925 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3135/6216] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:17.138807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14902d4e-7c41-4dfc-b935-20ccc47aedd0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:17.159151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14902d4e-7c41-4dfc-b935-20ccc47aedd0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:17.172292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0baba0-ea74-4526-8f53-2a1319677104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:17.172930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0baba0-ea74-4526-8f53-2a1319677104 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:17.173205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0baba0-ea74-4526-8f53-2a1319677104 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:17.173478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0baba0-ea74-4526-8f53-2a1319677104 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:17.174189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0baba0-ea74-4526-8f53-2a1319677104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:53:17.174655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0baba0-ea74-4526-8f53-2a1319677104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:17.179768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0baba0-ea74-4526-8f53-2a1319677104 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:17.207824 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3136/6217] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:53:17.213319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0baba0-ea74-4526-8f53-2a1319677104 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:17.235396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0baba0-ea74-4526-8f53-2a1319677104 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:17.248300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bca52e-02aa-43d9-b9ed-037eaf67a9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:17.248936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bca52e-02aa-43d9-b9ed-037eaf67a9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:17.249217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bca52e-02aa-43d9-b9ed-037eaf67a9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:17.249488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bca52e-02aa-43d9-b9ed-037eaf67a9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:17.250136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bca52e-02aa-43d9-b9ed-037eaf67a9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:17.252944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bca52e-02aa-43d9-b9ed-037eaf67a9b5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:17.273328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8db18-1389-4f7c-b5d7-99d7aa4a553c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:17.284857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd34d5-6455-4e3e-a8a7-a35862977c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:17.285881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd34d5-6455-4e3e-a8a7-a35862977c6c service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:17.286356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd34d5-6455-4e3e-a8a7-a35862977c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:17.289517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd34d5-6455-4e3e-a8a7-a35862977c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:17.320914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd34d5-6455-4e3e-a8a7-a35862977c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:17.326032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd34d5-6455-4e3e-a8a7-a35862977c6c service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:17.342422 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3082/6218] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:53:17.451100 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3137/6219] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:17 2022] POST /identity/v3/projects => generated 377 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:53:17.456482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd34d5-6455-4e3e-a8a7-a35862977c6c service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:17.472773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd34d5-6455-4e3e-a8a7-a35862977c6c service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:17.645640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1184d9-f009-4282-8583-4d2e9e030cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:17.648140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1184d9-f009-4282-8583-4d2e9e030cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:17.648561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1184d9-f009-4282-8583-4d2e9e030cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:17.648853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1184d9-f009-4282-8583-4d2e9e030cc3 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:17.649546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1184d9-f009-4282-8583-4d2e9e030cc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:17.655244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1184d9-f009-4282-8583-4d2e9e030cc3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:17.840432 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3083/6220] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:17 2022] POST /identity/v3/users => generated 289 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:17.845845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bca52e-02aa-43d9-b9ed-037eaf67a9b5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:17.858858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bca52e-02aa-43d9-b9ed-037eaf67a9b5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:17.865189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a9c95-8d74-4a37-8604-bd2a58fd6bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:17.866133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a9c95-8d74-4a37-8604-bd2a58fd6bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:17.866412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a9c95-8d74-4a37-8604-bd2a58fd6bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:17.866860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a9c95-8d74-4a37-8604-bd2a58fd6bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:17.867510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a9c95-8d74-4a37-8604-bd2a58fd6bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:17.869364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a9c95-8d74-4a37-8604-bd2a58fd6bf5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:17.884101 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3138/6221] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:17.887864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1184d9-f009-4282-8583-4d2e9e030cc3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:17.904797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1184d9-f009-4282-8583-4d2e9e030cc3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:17.910676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b6b63-7c0d-4e11-bbc2-211f012ffda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:17.911674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b6b63-7c0d-4e11-bbc2-211f012ffda9 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:17.912123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b6b63-7c0d-4e11-bbc2-211f012ffda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:17.912648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b6b63-7c0d-4e11-bbc2-211f012ffda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:17.913479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b6b63-7c0d-4e11-bbc2-211f012ffda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:17.915557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b6b63-7c0d-4e11-bbc2-211f012ffda9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:17.929545 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3084/6222] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:53:17.943903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a9c95-8d74-4a37-8604-bd2a58fd6bf5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:17.956509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a9c95-8d74-4a37-8604-bd2a58fd6bf5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:17.974833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33851e-b5aa-4990-840a-52186d8675e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:17.975508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33851e-b5aa-4990-840a-52186d8675e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:17.975794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33851e-b5aa-4990-840a-52186d8675e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:17.976841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33851e-b5aa-4990-840a-52186d8675e1 admin admin] PATH_INFO: `/v3/projects/ffb868baf22b4f59bbffdd6581d07c1d/users/56f97a3ec5df4d2786b6bd85f5e48ab8/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:18.000627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33851e-b5aa-4990-840a-52186d8675e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffb868baf22b4f59bbffdd6581d07c1d, user_id=56f97a3ec5df4d2786b6bd85f5e48ab8, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:18.007782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33851e-b5aa-4990-840a-52186d8675e1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:18.199284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ec512-e363-4bd3-98f9-91e9db1293b9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:18.199571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ec512-e363-4bd3-98f9-91e9db1293b9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:18.199848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ec512-e363-4bd3-98f9-91e9db1293b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:18.207456 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3139/6223] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:17 2022] PUT /identity/v3/projects/ffb868baf22b4f59bbffdd6581d07c1d/users/56f97a3ec5df4d2786b6bd85f5e48ab8/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:18.265043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-146ec512-e363-4bd3-98f9-91e9db1293b9 None None] MFA Rules not processed for user `56f97a3ec5df4d2786b6bd85f5e48ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:18.266749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-146ec512-e363-4bd3-98f9-91e9db1293b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:18.358217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18ee42-82d1-41c9-bd14-1f9890f15bbb None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:18.359365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18ee42-82d1-41c9-bd14-1f9890f15bbb None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:18.359815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18ee42-82d1-41c9-bd14-1f9890f15bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:18.370932 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-5f18ee42-82d1-41c9-bd14-1f9890f15bbb None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:53:18.370932 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:53:18.370932 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:53:18.370932 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:53:18.370932 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:53:18.370932 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:53:18.370932 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:53:18.370932 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:53:18.370932 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:53:18.370932 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:53:18.370932 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:53:18.370932 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:53:18.370932 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:53:18.373284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:53:18.373284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:53:18.373284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:53:18.373284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:53:18.373284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:53:18.373284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:53:18.373284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:53:18.373284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:53:18.373284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:53:18.373284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:53:18.373284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:53:18.373284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:53:18.373284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:53:18.373284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:53:18.373284 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:53:18.375342 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3140/6224] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:53:18 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 18 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 04:53:18.415330 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3085/6225] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:18.420434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18ee42-82d1-41c9-bd14-1f9890f15bbb None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:18.748068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18ee42-82d1-41c9-bd14-1f9890f15bbb None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:18.755299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04381c-e0ac-4d1d-ba95-94527c47cf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:18.756153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04381c-e0ac-4d1d-ba95-94527c47cf82 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:18.756686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04381c-e0ac-4d1d-ba95-94527c47cf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:18.757340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04381c-e0ac-4d1d-ba95-94527c47cf82 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:18.758282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04381c-e0ac-4d1d-ba95-94527c47cf82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:18.760990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04381c-e0ac-4d1d-ba95-94527c47cf82 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:18.970542 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3141/6226] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:18 2022] POST /identity/v3/projects => generated 377 bytes in 550 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:18.975338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ec512-e363-4bd3-98f9-91e9db1293b9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:18.990737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ec512-e363-4bd3-98f9-91e9db1293b9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:19.154080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3857d-fec8-432a-9231-7d1e5da3fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:19.158318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3857d-fec8-432a-9231-7d1e5da3fc55 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:19.160101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3857d-fec8-432a-9231-7d1e5da3fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:19.161049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3857d-fec8-432a-9231-7d1e5da3fc55 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:19.161958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3857d-fec8-432a-9231-7d1e5da3fc55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:19.166929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3857d-fec8-432a-9231-7d1e5da3fc55 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:19.249996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:19.331805 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3086/6227] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:18 2022] POST /identity/v3/users => generated 289 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:19.333131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04381c-e0ac-4d1d-ba95-94527c47cf82 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:19.354760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:19.369672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04381c-e0ac-4d1d-ba95-94527c47cf82 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:19.389653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f50523-7b91-4805-b445-61fe6d4b543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:19.391866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50523-7b91-4805-b445-61fe6d4b543f admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:19.392458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50523-7b91-4805-b445-61fe6d4b543f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:19.393740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50523-7b91-4805-b445-61fe6d4b543f admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:19.395310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f50523-7b91-4805-b445-61fe6d4b543f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:19.398322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f50523-7b91-4805-b445-61fe6d4b543f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:19.418517 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3142/6228] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:53:19.422258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3857d-fec8-432a-9231-7d1e5da3fc55 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:19.435233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3857d-fec8-432a-9231-7d1e5da3fc55 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:19.442883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f04638-20e1-4fb8-8c6f-7051b73905c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:19.443855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f04638-20e1-4fb8-8c6f-7051b73905c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:19.444445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f04638-20e1-4fb8-8c6f-7051b73905c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:19.445027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f04638-20e1-4fb8-8c6f-7051b73905c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:19.446059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f04638-20e1-4fb8-8c6f-7051b73905c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:19.448324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f04638-20e1-4fb8-8c6f-7051b73905c6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:19.468593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f50523-7b91-4805-b445-61fe6d4b543f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:19.478519 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3087/6229] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:19.484550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f04638-20e1-4fb8-8c6f-7051b73905c6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:19.484972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f50523-7b91-4805-b445-61fe6d4b543f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:19.486323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d8f04638-20e1-4fb8-8c6f-7051b73905c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:19.501103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af228ab-b321-49f1-9f3a-f26931d0ebce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:19.504245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af228ab-b321-49f1-9f3a-f26931d0ebce admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:19.505154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af228ab-b321-49f1-9f3a-f26931d0ebce admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:19.505595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af228ab-b321-49f1-9f3a-f26931d0ebce admin admin] PATH_INFO: `/v3/projects/423fd32e10f74b73a7b0444d997e6bf1/users/bf69fd1331f74540b72ea01e729b40b1/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:19.512825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f04638-20e1-4fb8-8c6f-7051b73905c6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:19.524928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca4daf-6d91-4b1a-805f-c7101f309a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:19.525615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca4daf-6d91-4b1a-805f-c7101f309a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:19.525869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca4daf-6d91-4b1a-805f-c7101f309a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:19.526145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca4daf-6d91-4b1a-805f-c7101f309a2e admin admin] PATH_INFO: `/v3/projects/73d41ab0b8774f56900878dcca74a777` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:19.527591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca4daf-6d91-4b1a-805f-c7101f309a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d41ab0b8774f56900878dcca74a777)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:19.529584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca4daf-6d91-4b1a-805f-c7101f309a2e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:19.545585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af228ab-b321-49f1-9f3a-f26931d0ebce admin admin] RBAC: Authorizing `identity:create_grant(project_id=423fd32e10f74b73a7b0444d997e6bf1, user_id=bf69fd1331f74540b72ea01e729b40b1, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:19.550524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af228ab-b321-49f1-9f3a-f26931d0ebce admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:19.665473 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3143/6230] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:19 2022] PUT /identity/v3/projects/423fd32e10f74b73a7b0444d997e6bf1/users/bf69fd1331f74540b72ea01e729b40b1/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:53:19.678933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b25c9-9c52-4e5e-bc8d-cf4e353e3a50 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:19.680322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b25c9-9c52-4e5e-bc8d-cf4e353e3a50 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:19.680758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b25c9-9c52-4e5e-bc8d-cf4e353e3a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:19.735398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8bca4daf-6d91-4b1a-805f-c7101f309a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d41ab0b8774f56900878dcca74a777', 'request_id': 'req-8bca4daf-6d91-4b1a-805f-c7101f309a2e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:19.759144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-300b25c9-9c52-4e5e-bc8d-cf4e353e3a50 None None] MFA Rules not processed for user `bf69fd1331f74540b72ea01e729b40b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:19.761030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8bca4daf-6d91-4b1a-805f-c7101f309a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d41ab0b8774f56900878dcca74a777', 'request_id': 'req-8bca4daf-6d91-4b1a-805f-c7101f309a2e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:19.762045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-300b25c9-9c52-4e5e-bc8d-cf4e353e3a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:19.785089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8bca4daf-6d91-4b1a-805f-c7101f309a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d41ab0b8774f56900878dcca74a777', 'request_id': 'req-8bca4daf-6d91-4b1a-805f-c7101f309a2e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:19.885486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8bca4daf-6d91-4b1a-805f-c7101f309a2e admin admin] The token cache is being invalidate because project 73d41ab0b8774f56900878dcca74a777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:19.885804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8bca4daf-6d91-4b1a-805f-c7101f309a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:19.886885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8bca4daf-6d91-4b1a-805f-c7101f309a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:19.889218 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3088/6231] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:19 2022] DELETE /identity/v3/projects/73d41ab0b8774f56900878dcca74a777 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:19.897058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca4daf-6d91-4b1a-805f-c7101f309a2e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:19.905882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8bca4daf-6d91-4b1a-805f-c7101f309a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:19.910214 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3144/6232] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:53:19.927283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b25c9-9c52-4e5e-bc8d-cf4e353e3a50 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:19.933880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-300b25c9-9c52-4e5e-bc8d-cf4e353e3a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:20.035937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b25c9-9c52-4e5e-bc8d-cf4e353e3a50 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:20.039782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02165fb-ea4c-4b29-9c8e-d02a9ee3fc4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:20.040869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02165fb-ea4c-4b29-9c8e-d02a9ee3fc4f service glance] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:20.041435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02165fb-ea4c-4b29-9c8e-d02a9ee3fc4f service glance] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:20.041712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02165fb-ea4c-4b29-9c8e-d02a9ee3fc4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:20.043963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f02165fb-ea4c-4b29-9c8e-d02a9ee3fc4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:20.085787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca4daf-6d91-4b1a-805f-c7101f309a2e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:20.101714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e99dd-108e-473b-be9a-dbead90af28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:20.102644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e99dd-108e-473b-be9a-dbead90af28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:20.103112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e99dd-108e-473b-be9a-dbead90af28d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:20.103580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e99dd-108e-473b-be9a-dbead90af28d admin admin] PATH_INFO: `/v3/users/1ab6204921764766a064cd63d11316dc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:20.106886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e99dd-108e-473b-be9a-dbead90af28d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab6204921764766a064cd63d11316dc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:20.111281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e99dd-108e-473b-be9a-dbead90af28d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:20.160203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02165fb-ea4c-4b29-9c8e-d02a9ee3fc4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:20.161855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02165fb-ea4c-4b29-9c8e-d02a9ee3fc4f service glance] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:20.201299 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3145/6233] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:53:20.495126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e92e99dd-108e-473b-be9a-dbead90af28d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab6204921764766a064cd63d11316dc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:20.615673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e92e99dd-108e-473b-be9a-dbead90af28d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab6204921764766a064cd63d11316dc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:20.617252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:20.618092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e92e99dd-108e-473b-be9a-dbead90af28d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab6204921764766a064cd63d11316dc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:20.629496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e92e99dd-108e-473b-be9a-dbead90af28d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab6204921764766a064cd63d11316dc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:20.647296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e92e99dd-108e-473b-be9a-dbead90af28d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab6204921764766a064cd63d11316dc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:20.659939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6947854-f8e0-4d41-b2b0-f468440e7ac8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:20.660251 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3089/6234] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:19 2022] DELETE /identity/v3/users/1ab6204921764766a064cd63d11316dc => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:20.660622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6947854-f8e0-4d41-b2b0-f468440e7ac8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:20.660622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6947854-f8e0-4d41-b2b0-f468440e7ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:20.697520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e6947854-f8e0-4d41-b2b0-f468440e7ac8 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:20.699616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e6947854-f8e0-4d41-b2b0-f468440e7ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:20.822172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:20.835158 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3146/6235] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:53:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:53:21.036666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e99dd-108e-473b-be9a-dbead90af28d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:21.038051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e92e99dd-108e-473b-be9a-dbead90af28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:21.198877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e99dd-108e-473b-be9a-dbead90af28d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:21.208701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c02699-50f7-46d4-a1ed-698c59a7fb56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:21.209730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c02699-50f7-46d4-a1ed-698c59a7fb56 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:21.210515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c02699-50f7-46d4-a1ed-698c59a7fb56 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:21.211027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c02699-50f7-46d4-a1ed-698c59a7fb56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:21.221072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c02699-50f7-46d4-a1ed-698c59a7fb56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:21.223886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c02699-50f7-46d4-a1ed-698c59a7fb56 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:21.235336 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3090/6236] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:53:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:21.926335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6947854-f8e0-4d41-b2b0-f468440e7ac8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:21.928073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e6947854-f8e0-4d41-b2b0-f468440e7ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:22.011933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6947854-f8e0-4d41-b2b0-f468440e7ac8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:22.016950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13b61f-90bf-400d-91e2-c3b264c65fd9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:22.018025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13b61f-90bf-400d-91e2-c3b264c65fd9 service glance] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:22.019406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13b61f-90bf-400d-91e2-c3b264c65fd9 service glance] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:22.019938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13b61f-90bf-400d-91e2-c3b264c65fd9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:22.022107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5b13b61f-90bf-400d-91e2-c3b264c65fd9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:22.095879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13b61f-90bf-400d-91e2-c3b264c65fd9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:22.098623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13b61f-90bf-400d-91e2-c3b264c65fd9 service glance] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:22.120319 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3147/6237] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:22.135123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c02699-50f7-46d4-a1ed-698c59a7fb56 service swift] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:22.136589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a0c02699-50f7-46d4-a1ed-698c59a7fb56 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:22.210712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9c4f8-a6bc-4a2a-a491-dbe84abe0444 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:22.211305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9c4f8-a6bc-4a2a-a491-dbe84abe0444 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:22.211815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9c4f8-a6bc-4a2a-a491-dbe84abe0444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:22.233724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b0a9c4f8-a6bc-4a2a-a491-dbe84abe0444 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:22.235441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b0a9c4f8-a6bc-4a2a-a491-dbe84abe0444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:22.245604 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3148/6238] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:53:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:53:22.249439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c02699-50f7-46d4-a1ed-698c59a7fb56 service swift] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:22.257984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f70449-da56-49e0-abc8-d23c3133a230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:22.258652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f70449-da56-49e0-abc8-d23c3133a230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:22.259032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f70449-da56-49e0-abc8-d23c3133a230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:22.259367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f70449-da56-49e0-abc8-d23c3133a230 admin admin] PATH_INFO: `/v3/users/918033297acd4cee941cad78b6e950f5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:22.261290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f70449-da56-49e0-abc8-d23c3133a230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=918033297acd4cee941cad78b6e950f5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:22.261479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9c4f8-a6bc-4a2a-a491-dbe84abe0444 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:22.265004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f70449-da56-49e0-abc8-d23c3133a230 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:22.280250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9c4f8-a6bc-4a2a-a491-dbe84abe0444 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:22.285686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ec2a0-4837-4f34-a25d-44e5583ea32a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:22.286309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ec2a0-4837-4f34-a25d-44e5583ea32a service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:22.286615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ec2a0-4837-4f34-a25d-44e5583ea32a service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:22.286881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ec2a0-4837-4f34-a25d-44e5583ea32a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:22.300250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ec2a0-4837-4f34-a25d-44e5583ea32a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:22.301925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ec2a0-4837-4f34-a25d-44e5583ea32a service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:22.314431 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3149/6239] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:53:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:22.534956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ec2a0-4837-4f34-a25d-44e5583ea32a service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:22.537531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-323ec2a0-4837-4f34-a25d-44e5583ea32a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:22.600355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ec2a0-4837-4f34-a25d-44e5583ea32a service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:22.606297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfed605-efdc-4356-848e-63553b1ba799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:22.607331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfed605-efdc-4356-848e-63553b1ba799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:22.608141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfed605-efdc-4356-848e-63553b1ba799 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:22.608878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfed605-efdc-4356-848e-63553b1ba799 admin admin] PATH_INFO: `/v3/projects/4dcc9e99087a4963a0e95f36f43149ed` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:22.610598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfed605-efdc-4356-848e-63553b1ba799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dcc9e99087a4963a0e95f36f43149ed)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:22.613538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfed605-efdc-4356-848e-63553b1ba799 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:22.659932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-24f70449-da56-49e0-abc8-d23c3133a230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918033297acd4cee941cad78b6e950f5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:22.781536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-24f70449-da56-49e0-abc8-d23c3133a230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918033297acd4cee941cad78b6e950f5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:22.785700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-24f70449-da56-49e0-abc8-d23c3133a230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918033297acd4cee941cad78b6e950f5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:22.807245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-24f70449-da56-49e0-abc8-d23c3133a230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918033297acd4cee941cad78b6e950f5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:22.807692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7cfed605-efdc-4356-848e-63553b1ba799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dcc9e99087a4963a0e95f36f43149ed', 'request_id': 'req-7cfed605-efdc-4356-848e-63553b1ba799'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:22.817871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7cfed605-efdc-4356-848e-63553b1ba799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dcc9e99087a4963a0e95f36f43149ed', 'request_id': 'req-7cfed605-efdc-4356-848e-63553b1ba799'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:22.834746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-24f70449-da56-49e0-abc8-d23c3133a230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918033297acd4cee941cad78b6e950f5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:22.853099 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3091/6240] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:22 2022] DELETE /identity/v3/users/918033297acd4cee941cad78b6e950f5 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:22.854575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab361bac-aa70-4b74-83d0-1b7f7cddf57c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:22.854923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab361bac-aa70-4b74-83d0-1b7f7cddf57c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:22.855216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab361bac-aa70-4b74-83d0-1b7f7cddf57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:22.882512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ab361bac-aa70-4b74-83d0-1b7f7cddf57c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:22.884140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ab361bac-aa70-4b74-83d0-1b7f7cddf57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:22.986307 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3092/6241] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:22.998223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab361bac-aa70-4b74-83d0-1b7f7cddf57c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:23.000458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ab361bac-aa70-4b74-83d0-1b7f7cddf57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:23.032997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7cfed605-efdc-4356-848e-63553b1ba799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dcc9e99087a4963a0e95f36f43149ed', 'request_id': 'req-7cfed605-efdc-4356-848e-63553b1ba799'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:23.060867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7cfed605-efdc-4356-848e-63553b1ba799 admin admin] The token cache is being invalidate because project 4dcc9e99087a4963a0e95f36f43149ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:23.061242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7cfed605-efdc-4356-848e-63553b1ba799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:23.062075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7cfed605-efdc-4356-848e-63553b1ba799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:23.067045 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3150/6242] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:22 2022] DELETE /identity/v3/projects/4dcc9e99087a4963a0e95f36f43149ed => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:53:23.068009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfed605-efdc-4356-848e-63553b1ba799 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:23.074512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7cfed605-efdc-4356-848e-63553b1ba799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:23.166350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab361bac-aa70-4b74-83d0-1b7f7cddf57c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:23.180410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cb21d-e342-4b59-a2d2-e09f9ed9526e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:23.185932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cb21d-e342-4b59-a2d2-e09f9ed9526e service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:23.185932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cb21d-e342-4b59-a2d2-e09f9ed9526e service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:23.185932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cb21d-e342-4b59-a2d2-e09f9ed9526e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:23.195290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6e3cb21d-e342-4b59-a2d2-e09f9ed9526e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:23.217151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cb21d-e342-4b59-a2d2-e09f9ed9526e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:23.219918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cb21d-e342-4b59-a2d2-e09f9ed9526e service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:23.238439 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3093/6243] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:23.239683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cb21d-e342-4b59-a2d2-e09f9ed9526e service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:23.241505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6e3cb21d-e342-4b59-a2d2-e09f9ed9526e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:23.259756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cb21d-e342-4b59-a2d2-e09f9ed9526e service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:23.262860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfed605-efdc-4356-848e-63553b1ba799 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:23.274582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044168ff-a9e9-41ae-9f22-e78048a1620f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:23.275726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044168ff-a9e9-41ae-9f22-e78048a1620f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:23.276227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044168ff-a9e9-41ae-9f22-e78048a1620f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:23.278072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044168ff-a9e9-41ae-9f22-e78048a1620f admin admin] PATH_INFO: `/v3/users/cc21a3a93d144fdf9056b637e990bf49` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:23.281338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38505ffb-cea6-4337-8195-224a04db8841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:23.281502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044168ff-a9e9-41ae-9f22-e78048a1620f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc21a3a93d144fdf9056b637e990bf49)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:23.284716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38505ffb-cea6-4337-8195-224a04db8841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:23.285242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38505ffb-cea6-4337-8195-224a04db8841 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:23.285535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38505ffb-cea6-4337-8195-224a04db8841 admin admin] PATH_INFO: `/v3/users/56f97a3ec5df4d2786b6bd85f5e48ab8` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:23.287687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38505ffb-cea6-4337-8195-224a04db8841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f97a3ec5df4d2786b6bd85f5e48ab8)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:23.287927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044168ff-a9e9-41ae-9f22-e78048a1620f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:23.289787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38505ffb-cea6-4337-8195-224a04db8841 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:23.298268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:23.430061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:23.636146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-38505ffb-cea6-4337-8195-224a04db8841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f97a3ec5df4d2786b6bd85f5e48ab8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:23.639304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-38505ffb-cea6-4337-8195-224a04db8841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f97a3ec5df4d2786b6bd85f5e48ab8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:23.654994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-044168ff-a9e9-41ae-9f22-e78048a1620f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc21a3a93d144fdf9056b637e990bf49'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:23.798729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-38505ffb-cea6-4337-8195-224a04db8841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f97a3ec5df4d2786b6bd85f5e48ab8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:23.800015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-38505ffb-cea6-4337-8195-224a04db8841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f97a3ec5df4d2786b6bd85f5e48ab8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:23.819640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-38505ffb-cea6-4337-8195-224a04db8841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f97a3ec5df4d2786b6bd85f5e48ab8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:23.832805 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3151/6244] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:23 2022] DELETE /identity/v3/users/56f97a3ec5df4d2786b6bd85f5e48ab8 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:23.837055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b709af-90b2-4e0a-b5fd-4e956f1523fa None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:23.837345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b709af-90b2-4e0a-b5fd-4e956f1523fa None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:23.837626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b709af-90b2-4e0a-b5fd-4e956f1523fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:23.891990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a8b709af-90b2-4e0a-b5fd-4e956f1523fa None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:23.894635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a8b709af-90b2-4e0a-b5fd-4e956f1523fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:23.939386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-044168ff-a9e9-41ae-9f22-e78048a1620f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc21a3a93d144fdf9056b637e990bf49'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:23.940476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-044168ff-a9e9-41ae-9f22-e78048a1620f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc21a3a93d144fdf9056b637e990bf49'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:23.952091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-044168ff-a9e9-41ae-9f22-e78048a1620f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc21a3a93d144fdf9056b637e990bf49'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:23.983527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-044168ff-a9e9-41ae-9f22-e78048a1620f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc21a3a93d144fdf9056b637e990bf49'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:23.995627 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3094/6245] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:23 2022] DELETE /identity/v3/users/cc21a3a93d144fdf9056b637e990bf49 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:24.048399 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3152/6246] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:24.075905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044168ff-a9e9-41ae-9f22-e78048a1620f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:24.083798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-044168ff-a9e9-41ae-9f22-e78048a1620f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:24.245811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044168ff-a9e9-41ae-9f22-e78048a1620f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:24.261408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf3a7f-1a17-4d2c-bdfd-5ee504344a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:24.262385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf3a7f-1a17-4d2c-bdfd-5ee504344a89 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:24.262729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf3a7f-1a17-4d2c-bdfd-5ee504344a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:24.263153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf3a7f-1a17-4d2c-bdfd-5ee504344a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:24.360343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b709af-90b2-4e0a-b5fd-4e956f1523fa None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:24.361825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a8b709af-90b2-4e0a-b5fd-4e956f1523fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:24.389102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b709af-90b2-4e0a-b5fd-4e956f1523fa None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:24.418693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf3a7f-1a17-4d2c-bdfd-5ee504344a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:24.420338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf3a7f-1a17-4d2c-bdfd-5ee504344a89 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:24.432688 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3095/6247] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:24.549791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e40759-4fa4-4c1a-85a2-1b3c8c7309d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:24.550484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e40759-4fa4-4c1a-85a2-1b3c8c7309d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:24.550766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e40759-4fa4-4c1a-85a2-1b3c8c7309d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:24.551041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e40759-4fa4-4c1a-85a2-1b3c8c7309d7 admin admin] PATH_INFO: `/v3/projects/7404cab787d9443cbae839218717bbbd` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:24.552510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e40759-4fa4-4c1a-85a2-1b3c8c7309d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7404cab787d9443cbae839218717bbbd)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:24.558626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e40759-4fa4-4c1a-85a2-1b3c8c7309d7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:24.775020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-00e40759-4fa4-4c1a-85a2-1b3c8c7309d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7404cab787d9443cbae839218717bbbd', 'request_id': 'req-00e40759-4fa4-4c1a-85a2-1b3c8c7309d7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:24.781895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-00e40759-4fa4-4c1a-85a2-1b3c8c7309d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7404cab787d9443cbae839218717bbbd', 'request_id': 'req-00e40759-4fa4-4c1a-85a2-1b3c8c7309d7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:24.882539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-00e40759-4fa4-4c1a-85a2-1b3c8c7309d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7404cab787d9443cbae839218717bbbd', 'request_id': 'req-00e40759-4fa4-4c1a-85a2-1b3c8c7309d7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:24.900125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-00e40759-4fa4-4c1a-85a2-1b3c8c7309d7 admin admin] The token cache is being invalidate because project 7404cab787d9443cbae839218717bbbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:24.900798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-00e40759-4fa4-4c1a-85a2-1b3c8c7309d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:24.901897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-00e40759-4fa4-4c1a-85a2-1b3c8c7309d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:24.911349 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3153/6248] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:24 2022] DELETE /identity/v3/projects/7404cab787d9443cbae839218717bbbd => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:53:24.919156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320db6a-a2e9-4bda-8f5e-90759abfaac5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:24.919156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320db6a-a2e9-4bda-8f5e-90759abfaac5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:24.919156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320db6a-a2e9-4bda-8f5e-90759abfaac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:24.949432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9320db6a-a2e9-4bda-8f5e-90759abfaac5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:24.950819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9320db6a-a2e9-4bda-8f5e-90759abfaac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:25.067698 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3096/6249] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:25.076740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cfc4d-4714-4146-bf08-46e15e96a6d7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:25.078828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cfc4d-4714-4146-bf08-46e15e96a6d7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:25.079187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cfc4d-4714-4146-bf08-46e15e96a6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:25.146385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-111cfc4d-4714-4146-bf08-46e15e96a6d7 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:25.150151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-111cfc4d-4714-4146-bf08-46e15e96a6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:25.173020 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3154/6250] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:25.178072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320db6a-a2e9-4bda-8f5e-90759abfaac5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:25.189305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320db6a-a2e9-4bda-8f5e-90759abfaac5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:25.207558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9530b0c-467b-48b2-b043-9c0776c16bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:25.208556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9530b0c-467b-48b2-b043-9c0776c16bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:25.209134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9530b0c-467b-48b2-b043-9c0776c16bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:25.209568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9530b0c-467b-48b2-b043-9c0776c16bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:25.210411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9530b0c-467b-48b2-b043-9c0776c16bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:53:25.210888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9530b0c-467b-48b2-b043-9c0776c16bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:25.212751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9530b0c-467b-48b2-b043-9c0776c16bf5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:25.226856 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3097/6251] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:53:25.230851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cfc4d-4714-4146-bf08-46e15e96a6d7 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:25.242154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cfc4d-4714-4146-bf08-46e15e96a6d7 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:25.268660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf593684-f534-434e-a424-2fa9d6dc3499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:25.268660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf593684-f534-434e-a424-2fa9d6dc3499 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:25.268660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf593684-f534-434e-a424-2fa9d6dc3499 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:25.268660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf593684-f534-434e-a424-2fa9d6dc3499 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:25.269308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf593684-f534-434e-a424-2fa9d6dc3499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:25.270585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf593684-f534-434e-a424-2fa9d6dc3499 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:25.455631 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3155/6252] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:25 2022] POST /identity/v3/projects => generated 375 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:25.456709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9530b0c-467b-48b2-b043-9c0776c16bf5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:25.472555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9530b0c-467b-48b2-b043-9c0776c16bf5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:25.575316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bac27-e671-4f45-a16a-c1a9fd025663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:25.576340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bac27-e671-4f45-a16a-c1a9fd025663 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:25.576712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bac27-e671-4f45-a16a-c1a9fd025663 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:25.577238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bac27-e671-4f45-a16a-c1a9fd025663 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:25.578130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bac27-e671-4f45-a16a-c1a9fd025663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:25.581615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bac27-e671-4f45-a16a-c1a9fd025663 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:25.697366 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3098/6253] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:25 2022] POST /identity/v3/users => generated 288 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:53:25.699241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf593684-f534-434e-a424-2fa9d6dc3499 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:25.724712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf593684-f534-434e-a424-2fa9d6dc3499 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:25.735446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4c4a3-e257-4509-bca7-66dd9509b77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:25.736787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c4a3-e257-4509-bca7-66dd9509b77c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:25.737366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c4a3-e257-4509-bca7-66dd9509b77c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:25.737873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c4a3-e257-4509-bca7-66dd9509b77c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:25.739804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4c4a3-e257-4509-bca7-66dd9509b77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:25.742065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4c4a3-e257-4509-bca7-66dd9509b77c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:25.760507 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3156/6254] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:25.761941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bac27-e671-4f45-a16a-c1a9fd025663 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:25.782420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bac27-e671-4f45-a16a-c1a9fd025663 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:25.791762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f8e50-ace0-4787-b1c1-47b5548595fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:25.792686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f8e50-ace0-4787-b1c1-47b5548595fa admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:25.793074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f8e50-ace0-4787-b1c1-47b5548595fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:25.793454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f8e50-ace0-4787-b1c1-47b5548595fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:25.794264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f8e50-ace0-4787-b1c1-47b5548595fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:25.796039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f8e50-ace0-4787-b1c1-47b5548595fa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:25.805140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:25.818559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4c4a3-e257-4509-bca7-66dd9509b77c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:25.821122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a9e4c4a3-e257-4509-bca7-66dd9509b77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:25.836238 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3099/6255] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:25.837740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f8e50-ace0-4787-b1c1-47b5548595fa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:25.851218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4c4a3-e257-4509-bca7-66dd9509b77c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:25.864887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2bb3b-2c0b-4f83-b052-ddff4ba2e579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:25.865958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f8e50-ace0-4787-b1c1-47b5548595fa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:25.866754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2bb3b-2c0b-4f83-b052-ddff4ba2e579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:25.868668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2bb3b-2c0b-4f83-b052-ddff4ba2e579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:25.869642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2bb3b-2c0b-4f83-b052-ddff4ba2e579 admin admin] PATH_INFO: `/v3/projects/f1c327f146704d888352779929747fe7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:25.872034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2bb3b-2c0b-4f83-b052-ddff4ba2e579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c327f146704d888352779929747fe7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:25.878089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2bb3b-2c0b-4f83-b052-ddff4ba2e579 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:25.881701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15200d0-ff6a-4a97-940e-61d1309e4e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:25.883687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15200d0-ff6a-4a97-940e-61d1309e4e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:25.884569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15200d0-ff6a-4a97-940e-61d1309e4e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:25.885747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15200d0-ff6a-4a97-940e-61d1309e4e7d admin admin] PATH_INFO: `/v3/projects/208beca2a666410c8b645838eff45ad9/users/46652f090c1242dfb3ba532d61c46319/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:25.901649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=80,keystone:DELETE=15,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:25.923569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15200d0-ff6a-4a97-940e-61d1309e4e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=208beca2a666410c8b645838eff45ad9, user_id=46652f090c1242dfb3ba532d61c46319, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:25.931330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15200d0-ff6a-4a97-940e-61d1309e4e7d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:26.101419 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3100/6256] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:25 2022] PUT /identity/v3/projects/208beca2a666410c8b645838eff45ad9/users/46652f090c1242dfb3ba532d61c46319/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:26.102201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19f13-a610-4afa-a654-b1793a068b12 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:26.102685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19f13-a610-4afa-a654-b1793a068b12 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:26.103142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19f13-a610-4afa-a654-b1793a068b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:26.146300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-82a2bb3b-2c0b-4f83-b052-ddff4ba2e579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c327f146704d888352779929747fe7', 'request_id': 'req-82a2bb3b-2c0b-4f83-b052-ddff4ba2e579'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:26.163256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-82a2bb3b-2c0b-4f83-b052-ddff4ba2e579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c327f146704d888352779929747fe7', 'request_id': 'req-82a2bb3b-2c0b-4f83-b052-ddff4ba2e579'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:26.218957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4cd19f13-a610-4afa-a654-b1793a068b12 None None] MFA Rules not processed for user `46652f090c1242dfb3ba532d61c46319`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:26.229593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4cd19f13-a610-4afa-a654-b1793a068b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:26.282330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-82a2bb3b-2c0b-4f83-b052-ddff4ba2e579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c327f146704d888352779929747fe7', 'request_id': 'req-82a2bb3b-2c0b-4f83-b052-ddff4ba2e579'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:26.325015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-82a2bb3b-2c0b-4f83-b052-ddff4ba2e579 admin admin] The token cache is being invalidate because project f1c327f146704d888352779929747fe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:26.325977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-82a2bb3b-2c0b-4f83-b052-ddff4ba2e579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:26.328629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-82a2bb3b-2c0b-4f83-b052-ddff4ba2e579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:26.331312 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3157/6257] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:25 2022] DELETE /identity/v3/projects/f1c327f146704d888352779929747fe7 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:26.337914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719665c-4e1e-4a90-8cc5-f72511977675 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:26.338554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719665c-4e1e-4a90-8cc5-f72511977675 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:26.339049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719665c-4e1e-4a90-8cc5-f72511977675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:26.339544 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3101/6258] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:26.395644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7719665c-4e1e-4a90-8cc5-f72511977675 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:26.401579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7719665c-4e1e-4a90-8cc5-f72511977675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:26.424555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd19f13-a610-4afa-a654-b1793a068b12 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:26.426583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4cd19f13-a610-4afa-a654-b1793a068b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:26.562618 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3158/6259] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:26.571896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929e4c5-8e59-4152-a8d4-8277028493b7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:26.572199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929e4c5-8e59-4152-a8d4-8277028493b7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:26.572484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929e4c5-8e59-4152-a8d4-8277028493b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:26.610227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd19f13-a610-4afa-a654-b1793a068b12 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:26.617636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4929e4c5-8e59-4152-a8d4-8277028493b7 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:26.618974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4929e4c5-8e59-4152-a8d4-8277028493b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:26.628461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e1dfc-7e7b-4627-82cc-d6226f33c4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:26.633483 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3159/6260] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:53:26.633879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e1dfc-7e7b-4627-82cc-d6226f33c4fa service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:26.634175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e1dfc-7e7b-4627-82cc-d6226f33c4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:26.634456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e1dfc-7e7b-4627-82cc-d6226f33c4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:26.638645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929e4c5-8e59-4152-a8d4-8277028493b7 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:26.643905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f34e1dfc-7e7b-4627-82cc-d6226f33c4fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:26.651837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929e4c5-8e59-4152-a8d4-8277028493b7 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:26.658423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c50f21-b2c1-4753-9e99-5abf1980e134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:26.659216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c50f21-b2c1-4753-9e99-5abf1980e134 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:26.659531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c50f21-b2c1-4753-9e99-5abf1980e134 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:26.659808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c50f21-b2c1-4753-9e99-5abf1980e134 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:26.660520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c50f21-b2c1-4753-9e99-5abf1980e134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:53:26.660991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c50f21-b2c1-4753-9e99-5abf1980e134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:26.662734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c50f21-b2c1-4753-9e99-5abf1980e134 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:26.681613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e1dfc-7e7b-4627-82cc-d6226f33c4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:26.683261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e1dfc-7e7b-4627-82cc-d6226f33c4fa service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:26.695273 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3160/6261] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:53:26.698881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c50f21-b2c1-4753-9e99-5abf1980e134 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:26.714402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c50f21-b2c1-4753-9e99-5abf1980e134 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:26.720895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780dfc8-853f-4b27-8c2e-e37a28e10f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:26.721518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780dfc8-853f-4b27-8c2e-e37a28e10f71 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:26.721795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780dfc8-853f-4b27-8c2e-e37a28e10f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:26.722065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780dfc8-853f-4b27-8c2e-e37a28e10f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:26.722703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780dfc8-853f-4b27-8c2e-e37a28e10f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:26.724847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780dfc8-853f-4b27-8c2e-e37a28e10f71 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:26.727956 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3102/6262] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:26.921008 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3161/6263] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:26 2022] POST /identity/v3/projects => generated 363 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:26.922554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e1dfc-7e7b-4627-82cc-d6226f33c4fa service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:26.939291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e1dfc-7e7b-4627-82cc-d6226f33c4fa service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:26.994435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780dfc8-853f-4b27-8c2e-e37a28e10f71 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:26.997440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5780dfc8-853f-4b27-8c2e-e37a28e10f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:27.092845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f749d-9f5e-43b7-896d-148c340059b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:27.093474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f749d-9f5e-43b7-896d-148c340059b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:27.093753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f749d-9f5e-43b7-896d-148c340059b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:27.094029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f749d-9f5e-43b7-896d-148c340059b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:27.094753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f749d-9f5e-43b7-896d-148c340059b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:27.101207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f749d-9f5e-43b7-896d-148c340059b6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:27.132091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780dfc8-853f-4b27-8c2e-e37a28e10f71 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:27.139184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05dca9-a63a-492c-b8fd-c0b7ec009936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:27.141698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05dca9-a63a-492c-b8fd-c0b7ec009936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:27.141698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05dca9-a63a-492c-b8fd-c0b7ec009936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:27.142310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05dca9-a63a-492c-b8fd-c0b7ec009936 admin admin] PATH_INFO: `/v3/projects/ffb868baf22b4f59bbffdd6581d07c1d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:27.146780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05dca9-a63a-492c-b8fd-c0b7ec009936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffb868baf22b4f59bbffdd6581d07c1d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:27.149840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05dca9-a63a-492c-b8fd-c0b7ec009936 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:27.210480 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3103/6264] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:26 2022] POST /identity/v3/users => generated 282 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:53:27.214916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f749d-9f5e-43b7-896d-148c340059b6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:27.238617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f749d-9f5e-43b7-896d-148c340059b6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:27.252024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d823f-80da-4083-9776-2bcd9d91dd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:27.253776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d823f-80da-4083-9776-2bcd9d91dd53 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:27.254063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d823f-80da-4083-9776-2bcd9d91dd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:27.254396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d823f-80da-4083-9776-2bcd9d91dd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:27.256519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d823f-80da-4083-9776-2bcd9d91dd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:27.262445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d823f-80da-4083-9776-2bcd9d91dd53 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:27.288020 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3104/6265] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:53:27.293263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d823f-80da-4083-9776-2bcd9d91dd53 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:27.320742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d823f-80da-4083-9776-2bcd9d91dd53 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:27.334920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cc05dca9-a63a-492c-b8fd-c0b7ec009936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffb868baf22b4f59bbffdd6581d07c1d', 'request_id': 'req-cc05dca9-a63a-492c-b8fd-c0b7ec009936'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:27.342273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cc05dca9-a63a-492c-b8fd-c0b7ec009936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffb868baf22b4f59bbffdd6581d07c1d', 'request_id': 'req-cc05dca9-a63a-492c-b8fd-c0b7ec009936'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:27.484001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b2d3e-2c98-43a2-a52e-003c98daeef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:27.487916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b2d3e-2c98-43a2-a52e-003c98daeef0 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:27.488247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b2d3e-2c98-43a2-a52e-003c98daeef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:27.488575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b2d3e-2c98-43a2-a52e-003c98daeef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:27.489268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b2d3e-2c98-43a2-a52e-003c98daeef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:27.495602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cc05dca9-a63a-492c-b8fd-c0b7ec009936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffb868baf22b4f59bbffdd6581d07c1d', 'request_id': 'req-cc05dca9-a63a-492c-b8fd-c0b7ec009936'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:27.495750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b2d3e-2c98-43a2-a52e-003c98daeef0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:27.520297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cc05dca9-a63a-492c-b8fd-c0b7ec009936 admin admin] The token cache is being invalidate because project ffb868baf22b4f59bbffdd6581d07c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:27.521000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cc05dca9-a63a-492c-b8fd-c0b7ec009936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:27.523162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cc05dca9-a63a-492c-b8fd-c0b7ec009936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:27.524267 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3105/6266] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:27.528327 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3162/6267] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:26 2022] DELETE /identity/v3/projects/ffb868baf22b4f59bbffdd6581d07c1d => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:27.530384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b2d3e-2c98-43a2-a52e-003c98daeef0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:27.531863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05dca9-a63a-492c-b8fd-c0b7ec009936 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:27.534403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cc05dca9-a63a-492c-b8fd-c0b7ec009936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:27.535711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-678b2d3e-2c98-43a2-a52e-003c98daeef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:27.575789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b2d3e-2c98-43a2-a52e-003c98daeef0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:27.586853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05dca9-a63a-492c-b8fd-c0b7ec009936 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:27.606653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea00aa1-b382-48c9-af9f-86864b2c1b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:27.614835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea00aa1-b382-48c9-af9f-86864b2c1b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:27.614835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea00aa1-b382-48c9-af9f-86864b2c1b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:27.614835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea00aa1-b382-48c9-af9f-86864b2c1b5b admin admin] PATH_INFO: `/v3/users/bf69fd1331f74540b72ea01e729b40b1` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:27.616061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea00aa1-b382-48c9-af9f-86864b2c1b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf69fd1331f74540b72ea01e729b40b1)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:27.616580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8eccdd-9939-4e90-97e8-d474711c10a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:27.621116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8eccdd-9939-4e90-97e8-d474711c10a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:27.621385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea00aa1-b382-48c9-af9f-86864b2c1b5b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:27.621511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8eccdd-9939-4e90-97e8-d474711c10a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:27.621698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8eccdd-9939-4e90-97e8-d474711c10a0 admin admin] PATH_INFO: `/v3/projects/f57a78d75da94621b5aecc2f5614902d/users/275bfd7792fe43ed9bb76c2018b239d6/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:27.677038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8eccdd-9939-4e90-97e8-d474711c10a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f57a78d75da94621b5aecc2f5614902d, user_id=275bfd7792fe43ed9bb76c2018b239d6, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:27.682413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8eccdd-9939-4e90-97e8-d474711c10a0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:27.821086 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3106/6268] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:27 2022] PUT /identity/v3/projects/f57a78d75da94621b5aecc2f5614902d/users/275bfd7792fe43ed9bb76c2018b239d6/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:27.832576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14997b93-c0b1-4c07-9a3d-8445b447eba8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:27.832865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14997b93-c0b1-4c07-9a3d-8445b447eba8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:27.833143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14997b93-c0b1-4c07-9a3d-8445b447eba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:27.906033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-14997b93-c0b1-4c07-9a3d-8445b447eba8 None None] MFA Rules not processed for user `275bfd7792fe43ed9bb76c2018b239d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:27.907379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-14997b93-c0b1-4c07-9a3d-8445b447eba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:28.006175 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3107/6269] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:28.010708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14997b93-c0b1-4c07-9a3d-8445b447eba8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:28.119184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14997b93-c0b1-4c07-9a3d-8445b447eba8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:28.129858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b4ea6-4585-4938-a942-cd224e9e2c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:28.130719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b4ea6-4585-4938-a942-cd224e9e2c6d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:28.131216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b4ea6-4585-4938-a942-cd224e9e2c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:28.131905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b4ea6-4585-4938-a942-cd224e9e2c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:28.132259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b4ea6-4585-4938-a942-cd224e9e2c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:28.134206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b4ea6-4585-4938-a942-cd224e9e2c6d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:28.267174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7ea00aa1-b382-48c9-af9f-86864b2c1b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf69fd1331f74540b72ea01e729b40b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:28.269110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7ea00aa1-b382-48c9-af9f-86864b2c1b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf69fd1331f74540b72ea01e729b40b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:28.335094 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3108/6270] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:28 2022] POST /identity/v3/projects => generated 367 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:28.336670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98646fd6-35b2-4e5a-82ce-3071bd95e808 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:28.337102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98646fd6-35b2-4e5a-82ce-3071bd95e808 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:28.337404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98646fd6-35b2-4e5a-82ce-3071bd95e808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:28.380571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-98646fd6-35b2-4e5a-82ce-3071bd95e808 None None] MFA Rules not processed for user `b62acf375a104203a66043c136fb1f99`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:28.384660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-98646fd6-35b2-4e5a-82ce-3071bd95e808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:28.412903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7ea00aa1-b382-48c9-af9f-86864b2c1b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf69fd1331f74540b72ea01e729b40b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:28.413875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7ea00aa1-b382-48c9-af9f-86864b2c1b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf69fd1331f74540b72ea01e729b40b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:28.439343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7ea00aa1-b382-48c9-af9f-86864b2c1b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf69fd1331f74540b72ea01e729b40b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:28.475915 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3163/6271] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:27 2022] DELETE /identity/v3/users/bf69fd1331f74540b72ea01e729b40b1 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:28.479587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea00aa1-b382-48c9-af9f-86864b2c1b5b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:28.483678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7ea00aa1-b382-48c9-af9f-86864b2c1b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:28.519368 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3109/6272] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:28.619561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea00aa1-b382-48c9-af9f-86864b2c1b5b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:28.631825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3da32-7b00-4f93-8911-870fae612fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:28.632907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3da32-7b00-4f93-8911-870fae612fdb admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:28.633414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3da32-7b00-4f93-8911-870fae612fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:28.634084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3da32-7b00-4f93-8911-870fae612fdb admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:28.634977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3da32-7b00-4f93-8911-870fae612fdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:28.641160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3da32-7b00-4f93-8911-870fae612fdb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:28.785120 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3164/6273] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:28 2022] POST /identity/v3/users => generated 290 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:28.788844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98646fd6-35b2-4e5a-82ce-3071bd95e808 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:28.895627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98646fd6-35b2-4e5a-82ce-3071bd95e808 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:28.904199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bba5a-0fcc-4b31-9895-610e9032a827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:28.905102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bba5a-0fcc-4b31-9895-610e9032a827 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:28.905806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bba5a-0fcc-4b31-9895-610e9032a827 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:28.907329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bba5a-0fcc-4b31-9895-610e9032a827 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:28.909356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bba5a-0fcc-4b31-9895-610e9032a827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:28.923286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bba5a-0fcc-4b31-9895-610e9032a827 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:28.941101 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3110/6274] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:28.944952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3da32-7b00-4f93-8911-870fae612fdb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:28.961463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3da32-7b00-4f93-8911-870fae612fdb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:28.968569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394358e-37ce-446f-a5d7-ce554292db5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:28.969559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394358e-37ce-446f-a5d7-ce554292db5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:28.970070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394358e-37ce-446f-a5d7-ce554292db5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:28.970921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394358e-37ce-446f-a5d7-ce554292db5f admin admin] PATH_INFO: `/v3/projects/5dac99877c64454494fa3eed9d76330d/users/4493964b859c45aab076db09bf269362/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:28.997675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394358e-37ce-446f-a5d7-ce554292db5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dac99877c64454494fa3eed9d76330d, user_id=4493964b859c45aab076db09bf269362, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:29.000919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394358e-37ce-446f-a5d7-ce554292db5f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:29.175028 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3165/6275] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:28 2022] PUT /identity/v3/projects/5dac99877c64454494fa3eed9d76330d/users/4493964b859c45aab076db09bf269362/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:29.178357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bba5a-0fcc-4b31-9895-610e9032a827 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:29.203293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bba5a-0fcc-4b31-9895-610e9032a827 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:29.449353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb319b8-0c93-4265-b6ba-171e72853757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:29.452352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb319b8-0c93-4265-b6ba-171e72853757 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:29.452352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb319b8-0c93-4265-b6ba-171e72853757 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:29.452352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb319b8-0c93-4265-b6ba-171e72853757 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:29.452352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb319b8-0c93-4265-b6ba-171e72853757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:29.453069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb319b8-0c93-4265-b6ba-171e72853757 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:29.477543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394358e-37ce-446f-a5d7-ce554292db5f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:29.479541 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3111/6276] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:29.494666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394358e-37ce-446f-a5d7-ce554292db5f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:29.516809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97699adc-cc0c-43c8-978b-eb2a0fc34268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:29.518519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97699adc-cc0c-43c8-978b-eb2a0fc34268 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:29.519739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97699adc-cc0c-43c8-978b-eb2a0fc34268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:29.520323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97699adc-cc0c-43c8-978b-eb2a0fc34268 admin admin] PATH_INFO: `/v3/projects/5dac99877c64454494fa3eed9d76330d/users/4493964b859c45aab076db09bf269362/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:29.541302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97699adc-cc0c-43c8-978b-eb2a0fc34268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dac99877c64454494fa3eed9d76330d, user_id=4493964b859c45aab076db09bf269362, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:29.544123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97699adc-cc0c-43c8-978b-eb2a0fc34268 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:29.599195 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3166/6277] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:29 2022] PUT /identity/v3/projects/5dac99877c64454494fa3eed9d76330d/users/4493964b859c45aab076db09bf269362/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:29.609935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9783ad-f8da-49a4-a731-1ca692107736 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:29.610429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9783ad-f8da-49a4-a731-1ca692107736 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:29.610859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9783ad-f8da-49a4-a731-1ca692107736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:29.669939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2a9783ad-f8da-49a4-a731-1ca692107736 None None] MFA Rules not processed for user `4493964b859c45aab076db09bf269362`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:29.671565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2a9783ad-f8da-49a4-a731-1ca692107736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:29.765977 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3112/6278] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:29.783748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97699adc-cc0c-43c8-978b-eb2a0fc34268 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:29.786267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-97699adc-cc0c-43c8-978b-eb2a0fc34268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:29.803116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:29.901553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97699adc-cc0c-43c8-978b-eb2a0fc34268 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:29.917056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1782159-0272-457b-8cd0-a8f200bd864c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:29.918026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1782159-0272-457b-8cd0-a8f200bd864c service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:29.919621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1782159-0272-457b-8cd0-a8f200bd864c service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:29.920081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1782159-0272-457b-8cd0-a8f200bd864c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:29.949618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1782159-0272-457b-8cd0-a8f200bd864c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:29.951247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1782159-0272-457b-8cd0-a8f200bd864c service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:29.980747 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3167/6279] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:30.001189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bf1a9-c776-4344-81de-ac1051b06299 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:30.001471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bf1a9-c776-4344-81de-ac1051b06299 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:30.001748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bf1a9-c776-4344-81de-ac1051b06299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:30.012664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-215bf1a9-c776-4344-81de-ac1051b06299 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:53:30.012664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:53:30.012664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:53:30.012664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:53:30.012664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:53:30.012664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:53:30.012664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:53:30.012664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:53:30.012664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:53:30.012664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:53:30.012664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:53:30.012664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:53:30.012664 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:53:30.013929 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:53:30.013929 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:53:30.013929 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:53:30.013929 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:53:30.013929 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:53:30.013929 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:53:30.013929 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:53:30.013929 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:53:30.013929 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:53:30.013929 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:53:30.013929 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:53:30.013929 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:53:30.013929 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:53:30.013929 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:53:30.013929 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:53:30.015579 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3113/6280] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:53:29 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 15 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:53:30.072950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:30.395009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1782159-0272-457b-8cd0-a8f200bd864c service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:30.419483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1782159-0272-457b-8cd0-a8f200bd864c service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:30.429112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb7282-78d9-40a8-ac88-c76ad26841e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:30.431502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb7282-78d9-40a8-ac88-c76ad26841e5 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:30.432014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb7282-78d9-40a8-ac88-c76ad26841e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:30.432608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb7282-78d9-40a8-ac88-c76ad26841e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:30.435938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9cdb7282-78d9-40a8-ac88-c76ad26841e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:30.566729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb7282-78d9-40a8-ac88-c76ad26841e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:30.568495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb7282-78d9-40a8-ac88-c76ad26841e5 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:30.583706 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3168/6281] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:30.661394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bf1a9-c776-4344-81de-ac1051b06299 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:30.666306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-215bf1a9-c776-4344-81de-ac1051b06299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:30.762923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bf1a9-c776-4344-81de-ac1051b06299 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:30.770995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd54cd-cce0-4f87-9dc5-f0817263043a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:30.782550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd54cd-cce0-4f87-9dc5-f0817263043a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:30.782550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd54cd-cce0-4f87-9dc5-f0817263043a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:30.782550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd54cd-cce0-4f87-9dc5-f0817263043a admin admin] PATH_INFO: `/v3/projects/423fd32e10f74b73a7b0444d997e6bf1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:30.782550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd54cd-cce0-4f87-9dc5-f0817263043a admin admin] RBAC: Authorizing `identity:delete_project(project_id=423fd32e10f74b73a7b0444d997e6bf1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:30.782550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd54cd-cce0-4f87-9dc5-f0817263043a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:30.964816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-42cd54cd-cce0-4f87-9dc5-f0817263043a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '423fd32e10f74b73a7b0444d997e6bf1', 'request_id': 'req-42cd54cd-cce0-4f87-9dc5-f0817263043a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:30.985095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-42cd54cd-cce0-4f87-9dc5-f0817263043a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '423fd32e10f74b73a7b0444d997e6bf1', 'request_id': 'req-42cd54cd-cce0-4f87-9dc5-f0817263043a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:30.994025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-42cd54cd-cce0-4f87-9dc5-f0817263043a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '423fd32e10f74b73a7b0444d997e6bf1', 'request_id': 'req-42cd54cd-cce0-4f87-9dc5-f0817263043a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:31.158956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-42cd54cd-cce0-4f87-9dc5-f0817263043a admin admin] The token cache is being invalidate because project 423fd32e10f74b73a7b0444d997e6bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:31.161147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-42cd54cd-cce0-4f87-9dc5-f0817263043a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:31.162714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-42cd54cd-cce0-4f87-9dc5-f0817263043a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:31.167433 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3114/6282] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:30 2022] DELETE /identity/v3/projects/423fd32e10f74b73a7b0444d997e6bf1 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:31.175530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9f1d5-4b0f-41a4-a47e-347473ae49f3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:31.178896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9f1d5-4b0f-41a4-a47e-347473ae49f3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:31.179424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9f1d5-4b0f-41a4-a47e-347473ae49f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:31.235134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-afb9f1d5-4b0f-41a4-a47e-347473ae49f3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:31.240138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-afb9f1d5-4b0f-41a4-a47e-347473ae49f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:31.348449 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3169/6283] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:31.362837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f5a4e-78aa-4e42-81cb-56430971eb78 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:31.362837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f5a4e-78aa-4e42-81cb-56430971eb78 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:31.362837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f5a4e-78aa-4e42-81cb-56430971eb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:31.387440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-862f5a4e-78aa-4e42-81cb-56430971eb78 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:31.389632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-862f5a4e-78aa-4e42-81cb-56430971eb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:31.401379 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3115/6284] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:31.405824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9f1d5-4b0f-41a4-a47e-347473ae49f3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:31.420082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9f1d5-4b0f-41a4-a47e-347473ae49f3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:31.428230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c60df9-7949-49dc-977e-7481edcdbb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:31.430453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c60df9-7949-49dc-977e-7481edcdbb2a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:31.431058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c60df9-7949-49dc-977e-7481edcdbb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:31.431567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c60df9-7949-49dc-977e-7481edcdbb2a admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:31.432813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c60df9-7949-49dc-977e-7481edcdbb2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:53:31.437336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c60df9-7949-49dc-977e-7481edcdbb2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:31.437336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c60df9-7949-49dc-977e-7481edcdbb2a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:31.454086 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3170/6285] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:53:31.458719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f5a4e-78aa-4e42-81cb-56430971eb78 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:31.491011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f5a4e-78aa-4e42-81cb-56430971eb78 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:31.505691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b75442-7851-4e1c-a7f8-6e9a1d83d995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:31.506528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b75442-7851-4e1c-a7f8-6e9a1d83d995 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:31.506780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b75442-7851-4e1c-a7f8-6e9a1d83d995 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:31.506931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b75442-7851-4e1c-a7f8-6e9a1d83d995 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:31.507565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b75442-7851-4e1c-a7f8-6e9a1d83d995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:31.515878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b75442-7851-4e1c-a7f8-6e9a1d83d995 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:31.686185 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3116/6286] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:31 2022] POST /identity/v3/projects => generated 373 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:53:31.690639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c60df9-7949-49dc-977e-7481edcdbb2a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:31.711007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c60df9-7949-49dc-977e-7481edcdbb2a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:31.857019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13530e81-d01f-43b0-9010-f11fb74f80aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:31.859813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13530e81-d01f-43b0-9010-f11fb74f80aa admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:31.860271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13530e81-d01f-43b0-9010-f11fb74f80aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:31.860917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13530e81-d01f-43b0-9010-f11fb74f80aa admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:31.862050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13530e81-d01f-43b0-9010-f11fb74f80aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:31.865180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13530e81-d01f-43b0-9010-f11fb74f80aa admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:32.010991 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3171/6287] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:31 2022] POST /identity/v3/users => generated 287 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:32.015347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b75442-7851-4e1c-a7f8-6e9a1d83d995 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:32.031165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b75442-7851-4e1c-a7f8-6e9a1d83d995 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:32.042397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4397cb-7dda-444e-9bec-50a214dd7df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:32.043153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4397cb-7dda-444e-9bec-50a214dd7df2 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:32.043622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4397cb-7dda-444e-9bec-50a214dd7df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:32.045085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4397cb-7dda-444e-9bec-50a214dd7df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:32.045876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4397cb-7dda-444e-9bec-50a214dd7df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:32.050339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4397cb-7dda-444e-9bec-50a214dd7df2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:32.077890 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3117/6288] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:32.079299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13530e81-d01f-43b0-9010-f11fb74f80aa admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:32.094966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13530e81-d01f-43b0-9010-f11fb74f80aa admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:32.109125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7178b-a2b1-4929-a23c-8531bbc2159c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:32.119532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7178b-a2b1-4929-a23c-8531bbc2159c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:32.119532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7178b-a2b1-4929-a23c-8531bbc2159c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:32.119532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7178b-a2b1-4929-a23c-8531bbc2159c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:32.119532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7178b-a2b1-4929-a23c-8531bbc2159c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:32.119532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7178b-a2b1-4929-a23c-8531bbc2159c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:32.147790 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3172/6289] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:32.153869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4397cb-7dda-444e-9bec-50a214dd7df2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:32.165861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4397cb-7dda-444e-9bec-50a214dd7df2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:32.172419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a3ece-58c1-49b4-a8fe-8d269baf3da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:32.173368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a3ece-58c1-49b4-a8fe-8d269baf3da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:32.174465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a3ece-58c1-49b4-a8fe-8d269baf3da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:32.175061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a3ece-58c1-49b4-a8fe-8d269baf3da9 admin admin] PATH_INFO: `/v3/projects/71287c23978b448cb68dd2d6feaf7f9d/users/cf2d599761924f7f8bfb7b5b4f8300f6/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:32.202940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a3ece-58c1-49b4-a8fe-8d269baf3da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71287c23978b448cb68dd2d6feaf7f9d, user_id=cf2d599761924f7f8bfb7b5b4f8300f6, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:32.209970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a3ece-58c1-49b4-a8fe-8d269baf3da9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:32.461184 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3118/6290] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:32 2022] PUT /identity/v3/projects/71287c23978b448cb68dd2d6feaf7f9d/users/cf2d599761924f7f8bfb7b5b4f8300f6/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:32.462886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b56ac-05ba-489f-acdc-ee8c9425c9db None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:32.463205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b56ac-05ba-489f-acdc-ee8c9425c9db None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:32.463489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b56ac-05ba-489f-acdc-ee8c9425c9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:32.567220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b92b56ac-05ba-489f-acdc-ee8c9425c9db None None] MFA Rules not processed for user `cf2d599761924f7f8bfb7b5b4f8300f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:32.573653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b92b56ac-05ba-489f-acdc-ee8c9425c9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:32.779736 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3173/6291] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:32.804571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a3ece-58c1-49b4-a8fe-8d269baf3da9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:32.806401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f77a3ece-58c1-49b4-a8fe-8d269baf3da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:32.971733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a3ece-58c1-49b4-a8fe-8d269baf3da9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:32.983146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa58ac3-ef66-4150-b90e-2e0f36217b0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:32.983789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa58ac3-ef66-4150-b90e-2e0f36217b0b service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:32.984073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa58ac3-ef66-4150-b90e-2e0f36217b0b service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:32.984385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa58ac3-ef66-4150-b90e-2e0f36217b0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:33.001406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa58ac3-ef66-4150-b90e-2e0f36217b0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:33.003963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa58ac3-ef66-4150-b90e-2e0f36217b0b service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:33.024525 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3119/6292] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:33.913906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9094ac-9ec0-4d32-9154-6f147300b1da None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:33.914435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9094ac-9ec0-4d32-9154-6f147300b1da None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:33.914435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9094ac-9ec0-4d32-9154-6f147300b1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:33.951231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-dc9094ac-9ec0-4d32-9154-6f147300b1da None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:33.954492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dc9094ac-9ec0-4d32-9154-6f147300b1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:33.964089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:34.073070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:34.108852 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3174/6293] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:53:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:34.129875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa58ac3-ef66-4150-b90e-2e0f36217b0b service glance] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:34.133438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ffa58ac3-ef66-4150-b90e-2e0f36217b0b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:34.282200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa58ac3-ef66-4150-b90e-2e0f36217b0b service glance] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:34.289866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d67e9b-cb91-4f30-94fa-d880474e7997 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:34.292093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d67e9b-cb91-4f30-94fa-d880474e7997 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:34.293351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d67e9b-cb91-4f30-94fa-d880474e7997 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:34.307076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d67e9b-cb91-4f30-94fa-d880474e7997 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:34.307076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d67e9b-cb91-4f30-94fa-d880474e7997 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:34.307076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d67e9b-cb91-4f30-94fa-d880474e7997 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:34.317819 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3120/6294] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:53:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:35.646810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c542d00-bf92-4ddc-8e53-0b2ca0975239 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:35.647410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c542d00-bf92-4ddc-8e53-0b2ca0975239 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:35.647410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c542d00-bf92-4ddc-8e53-0b2ca0975239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:35.690006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7c542d00-bf92-4ddc-8e53-0b2ca0975239 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:35.691246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7c542d00-bf92-4ddc-8e53-0b2ca0975239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:35.706838 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3175/6295] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:53:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:53:35.726756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d67e9b-cb91-4f30-94fa-d880474e7997 service swift] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:35.749021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d67e9b-cb91-4f30-94fa-d880474e7997 service swift] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:35.769953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e25b7-78e7-42a8-bb40-9f10ce3e65c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:35.769953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e25b7-78e7-42a8-bb40-9f10ce3e65c0 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:35.769953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e25b7-78e7-42a8-bb40-9f10ce3e65c0 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:35.769953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e25b7-78e7-42a8-bb40-9f10ce3e65c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:35.791010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e25b7-78e7-42a8-bb40-9f10ce3e65c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:35.793274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e25b7-78e7-42a8-bb40-9f10ce3e65c0 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:35.808367 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3121/6296] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:53:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:36.448466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c542d00-bf92-4ddc-8e53-0b2ca0975239 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:36.449900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7c542d00-bf92-4ddc-8e53-0b2ca0975239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:36.563902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c542d00-bf92-4ddc-8e53-0b2ca0975239 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:36.569015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4d0c4-1734-4655-bb65-022a4bac58f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:36.569686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4d0c4-1734-4655-bb65-022a4bac58f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:36.569971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4d0c4-1734-4655-bb65-022a4bac58f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:36.570275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4d0c4-1734-4655-bb65-022a4bac58f0 admin admin] PATH_INFO: `/v3/users/581232a8dc7e41bc93bd4f9b184db2bf` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:36.572176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4d0c4-1734-4655-bb65-022a4bac58f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=581232a8dc7e41bc93bd4f9b184db2bf)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:36.574150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4d0c4-1734-4655-bb65-022a4bac58f0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:36.872729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-06a4d0c4-1734-4655-bb65-022a4bac58f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581232a8dc7e41bc93bd4f9b184db2bf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:36.874387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-06a4d0c4-1734-4655-bb65-022a4bac58f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581232a8dc7e41bc93bd4f9b184db2bf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:37.023612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-06a4d0c4-1734-4655-bb65-022a4bac58f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581232a8dc7e41bc93bd4f9b184db2bf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:37.023612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-06a4d0c4-1734-4655-bb65-022a4bac58f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581232a8dc7e41bc93bd4f9b184db2bf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:37.045301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-06a4d0c4-1734-4655-bb65-022a4bac58f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581232a8dc7e41bc93bd4f9b184db2bf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:37.062170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5d34-1bd3-4803-94a4-7ef23a87c158 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:37.062707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5d34-1bd3-4803-94a4-7ef23a87c158 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:37.062707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5d34-1bd3-4803-94a4-7ef23a87c158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:37.075215 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3176/6297] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:36 2022] DELETE /identity/v3/users/581232a8dc7e41bc93bd4f9b184db2bf => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:37.089809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-936d5d34-1bd3-4803-94a4-7ef23a87c158 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:37.091324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-936d5d34-1bd3-4803-94a4-7ef23a87c158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:37.285913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:37.302179 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3122/6298] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:53:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:53:37.315447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4d0c4-1734-4655-bb65-022a4bac58f0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:37.317144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-06a4d0c4-1734-4655-bb65-022a4bac58f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:37.501535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4d0c4-1734-4655-bb65-022a4bac58f0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:37.526845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633c87b-dc99-4428-a08b-77dfec975b0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:37.528132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633c87b-dc99-4428-a08b-77dfec975b0c service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:37.528632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633c87b-dc99-4428-a08b-77dfec975b0c service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:37.529086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633c87b-dc99-4428-a08b-77dfec975b0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:37.540427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633c87b-dc99-4428-a08b-77dfec975b0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:37.544368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633c87b-dc99-4428-a08b-77dfec975b0c service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:37.601564 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3177/6299] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:53:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:38.387363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:38.979636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f9636-bad8-4ae8-a75d-c28ed5d06b99 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:38.979998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f9636-bad8-4ae8-a75d-c28ed5d06b99 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:38.980327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f9636-bad8-4ae8-a75d-c28ed5d06b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:39.023810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-948f9636-bad8-4ae8-a75d-c28ed5d06b99 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:39.025553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-948f9636-bad8-4ae8-a75d-c28ed5d06b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:39.037211 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3123/6300] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:53:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:39.066980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633c87b-dc99-4428-a08b-77dfec975b0c service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:39.080978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633c87b-dc99-4428-a08b-77dfec975b0c service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:39.094923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900476fb-8a12-4bb2-9413-cf9984f6cf04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:39.095898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900476fb-8a12-4bb2-9413-cf9984f6cf04 service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:39.096547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900476fb-8a12-4bb2-9413-cf9984f6cf04 service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:39.097207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900476fb-8a12-4bb2-9413-cf9984f6cf04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:39.115566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900476fb-8a12-4bb2-9413-cf9984f6cf04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:39.117963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900476fb-8a12-4bb2-9413-cf9984f6cf04 service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:39.129692 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3178/6301] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:53:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 04:53:39.186601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f9636-bad8-4ae8-a75d-c28ed5d06b99 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:39.188122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-948f9636-bad8-4ae8-a75d-c28ed5d06b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:39.226271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900476fb-8a12-4bb2-9413-cf9984f6cf04 service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:39.227986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-900476fb-8a12-4bb2-9413-cf9984f6cf04 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:39.334413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f9636-bad8-4ae8-a75d-c28ed5d06b99 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:39.344435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608decb-77c0-42d7-ada8-2a970bac6225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:39.345092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608decb-77c0-42d7-ada8-2a970bac6225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:39.346283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608decb-77c0-42d7-ada8-2a970bac6225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:39.346764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608decb-77c0-42d7-ada8-2a970bac6225 admin admin] PATH_INFO: `/v3/projects/f8cf9c5207684ce3a0f8820eee81f737` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:39.348143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608decb-77c0-42d7-ada8-2a970bac6225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8cf9c5207684ce3a0f8820eee81f737)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:39.350375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608decb-77c0-42d7-ada8-2a970bac6225 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:39.357132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900476fb-8a12-4bb2-9413-cf9984f6cf04 service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:39.364112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a29db0-b775-4658-bbfd-eb7aff105fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:39.364798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a29db0-b775-4658-bbfd-eb7aff105fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:39.365075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a29db0-b775-4658-bbfd-eb7aff105fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:39.365358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a29db0-b775-4658-bbfd-eb7aff105fe6 admin admin] PATH_INFO: `/v3/users/e751f2bca5574d7fb1a3cfd19ec10c01` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:39.366809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a29db0-b775-4658-bbfd-eb7aff105fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e751f2bca5574d7fb1a3cfd19ec10c01)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:39.371943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a29db0-b775-4658-bbfd-eb7aff105fe6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:39.564459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:39.694645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6608decb-77c0-42d7-ada8-2a970bac6225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8cf9c5207684ce3a0f8820eee81f737', 'request_id': 'req-6608decb-77c0-42d7-ada8-2a970bac6225'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:39.698314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61a29db0-b775-4658-bbfd-eb7aff105fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e751f2bca5574d7fb1a3cfd19ec10c01'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:39.699793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61a29db0-b775-4658-bbfd-eb7aff105fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e751f2bca5574d7fb1a3cfd19ec10c01'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:39.712992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6608decb-77c0-42d7-ada8-2a970bac6225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8cf9c5207684ce3a0f8820eee81f737', 'request_id': 'req-6608decb-77c0-42d7-ada8-2a970bac6225'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:39.720994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6608decb-77c0-42d7-ada8-2a970bac6225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8cf9c5207684ce3a0f8820eee81f737', 'request_id': 'req-6608decb-77c0-42d7-ada8-2a970bac6225'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:39.832326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61a29db0-b775-4658-bbfd-eb7aff105fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e751f2bca5574d7fb1a3cfd19ec10c01'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:39.833352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61a29db0-b775-4658-bbfd-eb7aff105fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e751f2bca5574d7fb1a3cfd19ec10c01'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:39.847989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61a29db0-b775-4658-bbfd-eb7aff105fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e751f2bca5574d7fb1a3cfd19ec10c01'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:39.861334 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3179/6302] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:39 2022] DELETE /identity/v3/users/e751f2bca5574d7fb1a3cfd19ec10c01 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:53:39.863121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a1430-0044-431c-aaff-00b3cb4b9afb None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:39.863351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a1430-0044-431c-aaff-00b3cb4b9afb None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:39.863925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a1430-0044-431c-aaff-00b3cb4b9afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:39.883293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-082a1430-0044-431c-aaff-00b3cb4b9afb None None] MFA Rules not processed for user `b62acf375a104203a66043c136fb1f99`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:39.884644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-082a1430-0044-431c-aaff-00b3cb4b9afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:39.950320 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3180/6303] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:39.951664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b51e7-b285-440b-b99b-0452c8c58998 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:39.951950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b51e7-b285-440b-b99b-0452c8c58998 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:39.952405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b51e7-b285-440b-b99b-0452c8c58998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:39.990461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4c9b51e7-b285-440b-b99b-0452c8c58998 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:39.991824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4c9b51e7-b285-440b-b99b-0452c8c58998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:40.032040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6608decb-77c0-42d7-ada8-2a970bac6225 admin admin] The token cache is being invalidate because project f8cf9c5207684ce3a0f8820eee81f737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:40.032375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6608decb-77c0-42d7-ada8-2a970bac6225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:40.035504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6608decb-77c0-42d7-ada8-2a970bac6225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:40.039805 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3124/6304] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:39 2022] DELETE /identity/v3/projects/f8cf9c5207684ce3a0f8820eee81f737 => generated 0 bytes in 853 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:40.040457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608decb-77c0-42d7-ada8-2a970bac6225 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:40.043860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6608decb-77c0-42d7-ada8-2a970bac6225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:40.106941 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3181/6305] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:40.112145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b51e7-b285-440b-b99b-0452c8c58998 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:40.112145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4c9b51e7-b285-440b-b99b-0452c8c58998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:40.124710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b51e7-b285-440b-b99b-0452c8c58998 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:40.131623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddbdce-9cb6-4138-92d7-e0634c006c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:40.132754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddbdce-9cb6-4138-92d7-e0634c006c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:40.133444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddbdce-9cb6-4138-92d7-e0634c006c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:40.133899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddbdce-9cb6-4138-92d7-e0634c006c98 admin admin] PATH_INFO: `/v3/users/e525d35a47544404b70b7f87052c51b4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:40.135836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ddbdce-9cb6-4138-92d7-e0634c006c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e525d35a47544404b70b7f87052c51b4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:40.138351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ddbdce-9cb6-4138-92d7-e0634c006c98 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:40.350617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608decb-77c0-42d7-ada8-2a970bac6225 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:40.421840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b210a8-70b4-40f5-b14f-8f60fdde3fb1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:40.422468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b210a8-70b4-40f5-b14f-8f60fdde3fb1 service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:40.422748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b210a8-70b4-40f5-b14f-8f60fdde3fb1 service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:40.425172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b210a8-70b4-40f5-b14f-8f60fdde3fb1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:40.427464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-38b210a8-70b4-40f5-b14f-8f60fdde3fb1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:40.506780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-11ddbdce-9cb6-4138-92d7-e0634c006c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e525d35a47544404b70b7f87052c51b4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:40.510409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-11ddbdce-9cb6-4138-92d7-e0634c006c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e525d35a47544404b70b7f87052c51b4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:40.562809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b210a8-70b4-40f5-b14f-8f60fdde3fb1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:40.565442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b210a8-70b4-40f5-b14f-8f60fdde3fb1 service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:40.583768 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3125/6306] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:40.585276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b210a8-70b4-40f5-b14f-8f60fdde3fb1 service glance] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:40.587014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-38b210a8-70b4-40f5-b14f-8f60fdde3fb1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:40.604647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:40.638084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-11ddbdce-9cb6-4138-92d7-e0634c006c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e525d35a47544404b70b7f87052c51b4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:40.638930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-11ddbdce-9cb6-4138-92d7-e0634c006c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e525d35a47544404b70b7f87052c51b4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:40.663525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-11ddbdce-9cb6-4138-92d7-e0634c006c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e525d35a47544404b70b7f87052c51b4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:40.697721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b210a8-70b4-40f5-b14f-8f60fdde3fb1 service glance] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:40.711680 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3182/6307] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:40 2022] DELETE /identity/v3/users/e525d35a47544404b70b7f87052c51b4 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:40.711680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804c251-62ef-4e04-954c-aac49f4ba2b8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:40.711680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804c251-62ef-4e04-954c-aac49f4ba2b8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:40.711680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804c251-62ef-4e04-954c-aac49f4ba2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:40.743654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7804c251-62ef-4e04-954c-aac49f4ba2b8 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:40.745548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7804c251-62ef-4e04-954c-aac49f4ba2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:40.803205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c6b1e-3509-428b-82e7-98f44fd918a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:40.803845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c6b1e-3509-428b-82e7-98f44fd918a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:40.804128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c6b1e-3509-428b-82e7-98f44fd918a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:40.804439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c6b1e-3509-428b-82e7-98f44fd918a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:40.808415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-820c6b1e-3509-428b-82e7-98f44fd918a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:40.892606 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3183/6308] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:53:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:40.906452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804c251-62ef-4e04-954c-aac49f4ba2b8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:40.909970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7804c251-62ef-4e04-954c-aac49f4ba2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:40.933630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c6b1e-3509-428b-82e7-98f44fd918a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:40.935095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c6b1e-3509-428b-82e7-98f44fd918a9 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:40.950369 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3126/6309] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:41.036562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804c251-62ef-4e04-954c-aac49f4ba2b8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:41.043340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57987a-9dbf-4cfe-9a52-7098d06629c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:41.044180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57987a-9dbf-4cfe-9a52-7098d06629c6 service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:41.044453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57987a-9dbf-4cfe-9a52-7098d06629c6 service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:41.044733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57987a-9dbf-4cfe-9a52-7098d06629c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:41.055773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57987a-9dbf-4cfe-9a52-7098d06629c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:41.059233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57987a-9dbf-4cfe-9a52-7098d06629c6 service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:41.083995 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3184/6310] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:53:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:41.277528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d91ddb-4362-4e49-b6b0-d14ee3e5f1dc None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:41.278113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d91ddb-4362-4e49-b6b0-d14ee3e5f1dc None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:41.278451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d91ddb-4362-4e49-b6b0-d14ee3e5f1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:41.299528 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-a6d91ddb-4362-4e49-b6b0-d14ee3e5f1dc None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:53:41.299528 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:53:41.299528 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:53:41.299528 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:53:41.299528 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:53:41.299528 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:53:41.299528 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:53:41.299528 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:53:41.299528 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:53:41.299528 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:53:41.299528 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:53:41.299528 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:53:41.299528 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 04:53:41.302956 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 04:53:41.302956 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 04:53:41.302956 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 04:53:41.302956 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 04:53:41.302956 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 04:53:41.302956 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 04:53:41.302956 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 04:53:41.302956 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 04:53:41.302956 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 04:53:41.302956 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 04:53:41.302956 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 04:53:41.302956 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 04:53:41.302956 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 04:53:41.302956 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 04:53:41.302956 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:53:41.304193 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3127/6311] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:53:41 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 26 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 04:53:41.425353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57987a-9dbf-4cfe-9a52-7098d06629c6 service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:41.429062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1c57987a-9dbf-4cfe-9a52-7098d06629c6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:41.449122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57987a-9dbf-4cfe-9a52-7098d06629c6 service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:41.454628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f3718-169c-4da0-9de9-879baf4570ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:41.456343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f3718-169c-4da0-9de9-879baf4570ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:41.456830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f3718-169c-4da0-9de9-879baf4570ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:41.457651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f3718-169c-4da0-9de9-879baf4570ff admin admin] PATH_INFO: `/v3/projects/756f39b82b0745a3bc33a85f632348fa` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:41.459198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f3718-169c-4da0-9de9-879baf4570ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=756f39b82b0745a3bc33a85f632348fa)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:41.462020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f3718-169c-4da0-9de9-879baf4570ff admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:41.708016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b04f3718-169c-4da0-9de9-879baf4570ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '756f39b82b0745a3bc33a85f632348fa', 'request_id': 'req-b04f3718-169c-4da0-9de9-879baf4570ff'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:41.739566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b04f3718-169c-4da0-9de9-879baf4570ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '756f39b82b0745a3bc33a85f632348fa', 'request_id': 'req-b04f3718-169c-4da0-9de9-879baf4570ff'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:41.853369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b04f3718-169c-4da0-9de9-879baf4570ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '756f39b82b0745a3bc33a85f632348fa', 'request_id': 'req-b04f3718-169c-4da0-9de9-879baf4570ff'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:41.896303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b04f3718-169c-4da0-9de9-879baf4570ff admin admin] The token cache is being invalidate because project 756f39b82b0745a3bc33a85f632348fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:41.897854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b04f3718-169c-4da0-9de9-879baf4570ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:41.899512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b04f3718-169c-4da0-9de9-879baf4570ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:41.910521 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3185/6312] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:41 2022] DELETE /identity/v3/projects/756f39b82b0745a3bc33a85f632348fa => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:41.913028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d5bcb-115a-4780-91f7-d9b02c1f8a7e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:41.913889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d5bcb-115a-4780-91f7-d9b02c1f8a7e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:41.914321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d5bcb-115a-4780-91f7-d9b02c1f8a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:41.982574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-584d5bcb-115a-4780-91f7-d9b02c1f8a7e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:41.984085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-584d5bcb-115a-4780-91f7-d9b02c1f8a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:42.035756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f3718-169c-4da0-9de9-879baf4570ff admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:42.038854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b04f3718-169c-4da0-9de9-879baf4570ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:42.151367 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3128/6313] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:42.160011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcd4c0-06a0-4cbb-95b3-95ec4a014032 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:42.160407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcd4c0-06a0-4cbb-95b3-95ec4a014032 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:42.160748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcd4c0-06a0-4cbb-95b3-95ec4a014032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:42.166876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f3718-169c-4da0-9de9-879baf4570ff admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:42.186955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d8fca-895b-45f9-815b-2c70a1f3c15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:42.188776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d8fca-895b-45f9-815b-2c70a1f3c15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:42.189200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d8fca-895b-45f9-815b-2c70a1f3c15e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:42.189655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d8fca-895b-45f9-815b-2c70a1f3c15e admin admin] PATH_INFO: `/v3/projects/9a675622ae36405791117896fa14f7fe` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:42.195758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d8fca-895b-45f9-815b-2c70a1f3c15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a675622ae36405791117896fa14f7fe)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:42.195758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d8fca-895b-45f9-815b-2c70a1f3c15e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:42.216862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-cafcd4c0-06a0-4cbb-95b3-95ec4a014032 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:42.218324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cafcd4c0-06a0-4cbb-95b3-95ec4a014032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:42.240616 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3129/6314] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:53:42.242282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcd4c0-06a0-4cbb-95b3-95ec4a014032 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:42.255650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcd4c0-06a0-4cbb-95b3-95ec4a014032 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:42.262340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505985ee-d95b-4555-8544-51362c8ab42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:42.264610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505985ee-d95b-4555-8544-51362c8ab42b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:42.264610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505985ee-d95b-4555-8544-51362c8ab42b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:42.264610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505985ee-d95b-4555-8544-51362c8ab42b admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:42.271117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505985ee-d95b-4555-8544-51362c8ab42b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:53:42.271527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505985ee-d95b-4555-8544-51362c8ab42b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:42.278187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505985ee-d95b-4555-8544-51362c8ab42b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:42.310532 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3130/6315] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:53:42.316700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505985ee-d95b-4555-8544-51362c8ab42b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:42.330661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505985ee-d95b-4555-8544-51362c8ab42b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:42.338487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541f3a6-0316-49a9-a8c1-782f9ae35e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:42.339586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541f3a6-0316-49a9-a8c1-782f9ae35e33 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:42.340033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541f3a6-0316-49a9-a8c1-782f9ae35e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:42.340698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541f3a6-0316-49a9-a8c1-782f9ae35e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:42.341697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541f3a6-0316-49a9-a8c1-782f9ae35e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:42.344205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541f3a6-0316-49a9-a8c1-782f9ae35e33 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:42.399144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-143d8fca-895b-45f9-815b-2c70a1f3c15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a675622ae36405791117896fa14f7fe', 'request_id': 'req-143d8fca-895b-45f9-815b-2c70a1f3c15e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:42.410120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-143d8fca-895b-45f9-815b-2c70a1f3c15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a675622ae36405791117896fa14f7fe', 'request_id': 'req-143d8fca-895b-45f9-815b-2c70a1f3c15e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:42.482188 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3131/6316] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:42 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:42.483630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fddef-96d8-4801-81ec-c0ef6fb83407 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:42.483990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fddef-96d8-4801-81ec-c0ef6fb83407 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:42.485096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fddef-96d8-4801-81ec-c0ef6fb83407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:42.494703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-143d8fca-895b-45f9-815b-2c70a1f3c15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a675622ae36405791117896fa14f7fe', 'request_id': 'req-143d8fca-895b-45f9-815b-2c70a1f3c15e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:42.511522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-143d8fca-895b-45f9-815b-2c70a1f3c15e admin admin] The token cache is being invalidate because project 9a675622ae36405791117896fa14f7fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:42.513130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8c1fddef-96d8-4801-81ec-c0ef6fb83407 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:42.513785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-143d8fca-895b-45f9-815b-2c70a1f3c15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:42.514860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8c1fddef-96d8-4801-81ec-c0ef6fb83407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:42.515259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-143d8fca-895b-45f9-815b-2c70a1f3c15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:42.521582 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3186/6317] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:42 2022] DELETE /identity/v3/projects/9a675622ae36405791117896fa14f7fe => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:42.523165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d8fca-895b-45f9-815b-2c70a1f3c15e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:42.529141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-143d8fca-895b-45f9-815b-2c70a1f3c15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:42.632993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d8fca-895b-45f9-815b-2c70a1f3c15e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:42.644815 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3132/6318] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 04:53:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:42.645880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fddef-96d8-4801-81ec-c0ef6fb83407 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:42.650150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8c1fddef-96d8-4801-81ec-c0ef6fb83407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:42.776948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696be1a3-1bf5-4279-a423-172c06cf2eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:42.779077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696be1a3-1bf5-4279-a423-172c06cf2eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:42.789900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696be1a3-1bf5-4279-a423-172c06cf2eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:42.789900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696be1a3-1bf5-4279-a423-172c06cf2eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:42.789900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696be1a3-1bf5-4279-a423-172c06cf2eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:42.789900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696be1a3-1bf5-4279-a423-172c06cf2eb4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:42.810198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fddef-96d8-4801-81ec-c0ef6fb83407 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:42.820292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50030e3-73a9-4c54-b1b8-aaee666020ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:42.821349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50030e3-73a9-4c54-b1b8-aaee666020ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:42.824290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50030e3-73a9-4c54-b1b8-aaee666020ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:42.824290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50030e3-73a9-4c54-b1b8-aaee666020ac admin admin] PATH_INFO: `/v3/users/2cff882ed4564c4cb34e207578003907` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:42.825228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50030e3-73a9-4c54-b1b8-aaee666020ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cff882ed4564c4cb34e207578003907)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:42.828444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50030e3-73a9-4c54-b1b8-aaee666020ac admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:42.925322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:42.979942 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3187/6319] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:42 2022] POST /identity/v3/users => generated 288 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:42.979942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696be1a3-1bf5-4279-a423-172c06cf2eb4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:42.983095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-696be1a3-1bf5-4279-a423-172c06cf2eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:42.992866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:43.078856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f50030e3-73a9-4c54-b1b8-aaee666020ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cff882ed4564c4cb34e207578003907'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:43.178149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f50030e3-73a9-4c54-b1b8-aaee666020ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cff882ed4564c4cb34e207578003907'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:43.178904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f50030e3-73a9-4c54-b1b8-aaee666020ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cff882ed4564c4cb34e207578003907'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:43.188790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f50030e3-73a9-4c54-b1b8-aaee666020ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cff882ed4564c4cb34e207578003907'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:43.232975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f50030e3-73a9-4c54-b1b8-aaee666020ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cff882ed4564c4cb34e207578003907'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:43.243848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696be1a3-1bf5-4279-a423-172c06cf2eb4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:43.250119 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3133/6320] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:42 2022] DELETE /identity/v3/users/2cff882ed4564c4cb34e207578003907 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:43.256322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50030e3-73a9-4c54-b1b8-aaee666020ac admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:43.260186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f50030e3-73a9-4c54-b1b8-aaee666020ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:43.266928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfed54f-bd7d-47bc-b306-b069522ccbd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:43.269307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfed54f-bd7d-47bc-b306-b069522ccbd2 service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:43.269597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfed54f-bd7d-47bc-b306-b069522ccbd2 service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:43.269877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfed54f-bd7d-47bc-b306-b069522ccbd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:43.279293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6bfed54f-bd7d-47bc-b306-b069522ccbd2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:43.318395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfed54f-bd7d-47bc-b306-b069522ccbd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:43.327636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfed54f-bd7d-47bc-b306-b069522ccbd2 service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:43.359117 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3188/6321] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:53:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:43.402480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50030e3-73a9-4c54-b1b8-aaee666020ac admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:43.409322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42f0d0-01d6-4cf5-a531-d46b7b941ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:43.412600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42f0d0-01d6-4cf5-a531-d46b7b941ebe admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:43.413167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42f0d0-01d6-4cf5-a531-d46b7b941ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:43.413701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42f0d0-01d6-4cf5-a531-d46b7b941ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:43.414609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42f0d0-01d6-4cf5-a531-d46b7b941ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:43.417067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42f0d0-01d6-4cf5-a531-d46b7b941ebe admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:43.430050 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3134/6322] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:43.445327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfed54f-bd7d-47bc-b306-b069522ccbd2 service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:43.466966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfed54f-bd7d-47bc-b306-b069522ccbd2 service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:43.474801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5976183-0590-43e3-a993-0af71423fea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:43.475790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5976183-0590-43e3-a993-0af71423fea9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:43.482593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5976183-0590-43e3-a993-0af71423fea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:43.482593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5976183-0590-43e3-a993-0af71423fea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:43.482593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5976183-0590-43e3-a993-0af71423fea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:43.482593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5976183-0590-43e3-a993-0af71423fea9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:43.506159 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3189/6323] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:43.508350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42f0d0-01d6-4cf5-a531-d46b7b941ebe admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:43.524282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42f0d0-01d6-4cf5-a531-d46b7b941ebe admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:43.535562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366514fb-b312-4a36-9893-5cbc455b217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:43.536392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366514fb-b312-4a36-9893-5cbc455b217b admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:43.536775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366514fb-b312-4a36-9893-5cbc455b217b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:43.537235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366514fb-b312-4a36-9893-5cbc455b217b admin admin] PATH_INFO: `/v3/projects/a307682bfefc416d83311652bcb2def6/users/103575cc5e4a4f2c8fb5f1442f1ee9ec/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:43.591877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366514fb-b312-4a36-9893-5cbc455b217b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a307682bfefc416d83311652bcb2def6, user_id=103575cc5e4a4f2c8fb5f1442f1ee9ec, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:43.599791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366514fb-b312-4a36-9893-5cbc455b217b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:43.735456 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3135/6324] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:43 2022] PUT /identity/v3/projects/a307682bfefc416d83311652bcb2def6/users/103575cc5e4a4f2c8fb5f1442f1ee9ec/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:43.749264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d63806-ae12-4cf6-90a9-53a7a56d1852 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:43.749974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d63806-ae12-4cf6-90a9-53a7a56d1852 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:43.750249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d63806-ae12-4cf6-90a9-53a7a56d1852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:43.805662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-21d63806-ae12-4cf6-90a9-53a7a56d1852 None None] MFA Rules not processed for user `103575cc5e4a4f2c8fb5f1442f1ee9ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:43.806978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-21d63806-ae12-4cf6-90a9-53a7a56d1852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:43.934244 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3190/6325] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:43.938903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366514fb-b312-4a36-9893-5cbc455b217b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:44.028941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366514fb-b312-4a36-9893-5cbc455b217b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:44.036648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a9b01-784d-417b-91b1-bc690c45df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:44.037500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a9b01-784d-417b-91b1-bc690c45df78 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:44.037952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a9b01-784d-417b-91b1-bc690c45df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:44.038329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a9b01-784d-417b-91b1-bc690c45df78 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:44.039545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a9b01-784d-417b-91b1-bc690c45df78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:44.042043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a9b01-784d-417b-91b1-bc690c45df78 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:44.247614 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3136/6326] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:43 2022] POST /identity/v3/projects => generated 375 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:44.248338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d63806-ae12-4cf6-90a9-53a7a56d1852 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:44.274619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d63806-ae12-4cf6-90a9-53a7a56d1852 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:44.351462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b00e50-fe43-47ff-ab5d-b47768b7ac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:44.369572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b00e50-fe43-47ff-ab5d-b47768b7ac8d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:44.369572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b00e50-fe43-47ff-ab5d-b47768b7ac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:44.369572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b00e50-fe43-47ff-ab5d-b47768b7ac8d admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:44.369572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b00e50-fe43-47ff-ab5d-b47768b7ac8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:44.369572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b00e50-fe43-47ff-ab5d-b47768b7ac8d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:44.495758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a9b01-784d-417b-91b1-bc690c45df78 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:44.500634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-954a9b01-784d-417b-91b1-bc690c45df78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:44.508229 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3191/6327] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:44 2022] POST /identity/v3/users => generated 294 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:44.512104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b00e50-fe43-47ff-ab5d-b47768b7ac8d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:44.530604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a9b01-784d-417b-91b1-bc690c45df78 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:44.533329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b00e50-fe43-47ff-ab5d-b47768b7ac8d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:44.542638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f2043-27f7-4875-aeac-0b75998876e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:44.543597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f2043-27f7-4875-aeac-0b75998876e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:44.543818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f2043-27f7-4875-aeac-0b75998876e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:44.544435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f2043-27f7-4875-aeac-0b75998876e6 admin admin] PATH_INFO: `/v3/projects/d86a3aa454114d5086ba036d737d9572` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:44.545036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f216be-ff94-41d2-bd85-3141ef77a0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:44.545789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f216be-ff94-41d2-bd85-3141ef77a0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:44.546086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f216be-ff94-41d2-bd85-3141ef77a0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:44.546324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f2043-27f7-4875-aeac-0b75998876e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d86a3aa454114d5086ba036d737d9572)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:44.546467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f216be-ff94-41d2-bd85-3141ef77a0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:44.547125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f216be-ff94-41d2-bd85-3141ef77a0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:44.550024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f216be-ff94-41d2-bd85-3141ef77a0c1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:44.550537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f2043-27f7-4875-aeac-0b75998876e6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:44.562590 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3192/6328] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:44.569336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f216be-ff94-41d2-bd85-3141ef77a0c1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:44.610168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f216be-ff94-41d2-bd85-3141ef77a0c1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:44.616810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986273d-5a29-4a26-8b9b-0c389f39bf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:44.618593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986273d-5a29-4a26-8b9b-0c389f39bf25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:44.619064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986273d-5a29-4a26-8b9b-0c389f39bf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:44.619434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986273d-5a29-4a26-8b9b-0c389f39bf25 admin admin] PATH_INFO: `/v3/projects/c1dee3b9e552418e915c2b5154567bd5/users/0c437ea28505426aaf3e85352215b11b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:44.643010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986273d-5a29-4a26-8b9b-0c389f39bf25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1dee3b9e552418e915c2b5154567bd5, user_id=0c437ea28505426aaf3e85352215b11b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:44.645169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986273d-5a29-4a26-8b9b-0c389f39bf25 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:44.820092 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3193/6329] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:44 2022] PUT /identity/v3/projects/c1dee3b9e552418e915c2b5154567bd5/users/0c437ea28505426aaf3e85352215b11b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:44.824029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986273d-5a29-4a26-8b9b-0c389f39bf25 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:44.843349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b07f2043-27f7-4875-aeac-0b75998876e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd86a3aa454114d5086ba036d737d9572', 'request_id': 'req-b07f2043-27f7-4875-aeac-0b75998876e6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:44.871372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b07f2043-27f7-4875-aeac-0b75998876e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd86a3aa454114d5086ba036d737d9572', 'request_id': 'req-b07f2043-27f7-4875-aeac-0b75998876e6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:44.891387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b07f2043-27f7-4875-aeac-0b75998876e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd86a3aa454114d5086ba036d737d9572', 'request_id': 'req-b07f2043-27f7-4875-aeac-0b75998876e6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:45.007258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986273d-5a29-4a26-8b9b-0c389f39bf25 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:45.025476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b07f2043-27f7-4875-aeac-0b75998876e6 admin admin] The token cache is being invalidate because project d86a3aa454114d5086ba036d737d9572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:45.026065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b07f2043-27f7-4875-aeac-0b75998876e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:45.027483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b07f2043-27f7-4875-aeac-0b75998876e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:45.030386 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3137/6330] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:44 2022] DELETE /identity/v3/projects/d86a3aa454114d5086ba036d737d9572 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:45.037423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b44d8-5e27-4cfc-855a-d71b28a10c0c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:45.038083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b44d8-5e27-4cfc-855a-d71b28a10c0c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:45.038592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b44d8-5e27-4cfc-855a-d71b28a10c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:45.100612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0a9b44d8-5e27-4cfc-855a-d71b28a10c0c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:45.103053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0a9b44d8-5e27-4cfc-855a-d71b28a10c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:45.213174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caca86-69c6-4ebd-80d0-595cee26f4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:45.214302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caca86-69c6-4ebd-80d0-595cee26f4bc admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:45.215935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caca86-69c6-4ebd-80d0-595cee26f4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:45.216517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caca86-69c6-4ebd-80d0-595cee26f4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:45.217603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0caca86-69c6-4ebd-80d0-595cee26f4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:45.224619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0caca86-69c6-4ebd-80d0-595cee26f4bc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:45.264731 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3194/6331] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:53:45.266003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caca86-69c6-4ebd-80d0-595cee26f4bc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:45.276188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f0caca86-69c6-4ebd-80d0-595cee26f4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:45.311722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caca86-69c6-4ebd-80d0-595cee26f4bc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:45.318323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b748c-977c-491f-9d56-7f09c58b473e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:45.319435 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3138/6332] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:45.320068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b44d8-5e27-4cfc-855a-d71b28a10c0c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:45.321045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b748c-977c-491f-9d56-7f09c58b473e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:45.321742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0a9b44d8-5e27-4cfc-855a-d71b28a10c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:45.322063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b748c-977c-491f-9d56-7f09c58b473e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:45.322567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b748c-977c-491f-9d56-7f09c58b473e admin admin] PATH_INFO: `/v3/users/275bfd7792fe43ed9bb76c2018b239d6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:45.324003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b748c-977c-491f-9d56-7f09c58b473e admin admin] RBAC: Authorizing `identity:delete_user(user_id=275bfd7792fe43ed9bb76c2018b239d6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:45.332854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b748c-977c-491f-9d56-7f09c58b473e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:45.364393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b44d8-5e27-4cfc-855a-d71b28a10c0c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:45.382450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892b2d6-f149-4103-b92b-859fee292ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:45.383537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892b2d6-f149-4103-b92b-859fee292ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:45.383999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892b2d6-f149-4103-b92b-859fee292ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:45.385085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892b2d6-f149-4103-b92b-859fee292ba9 admin admin] PATH_INFO: `/v3/projects/c1dee3b9e552418e915c2b5154567bd5/users/0c437ea28505426aaf3e85352215b11b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:45.389734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892b2d6-f149-4103-b92b-859fee292ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1dee3b9e552418e915c2b5154567bd5, user_id=0c437ea28505426aaf3e85352215b11b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:45.396587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892b2d6-f149-4103-b92b-859fee292ba9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:45.428028 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3139/6333] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:45 2022] PUT /identity/v3/projects/c1dee3b9e552418e915c2b5154567bd5/users/0c437ea28505426aaf3e85352215b11b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:45.429908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7930d3-a3c3-4402-87f2-e394be34b201 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:45.430673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7930d3-a3c3-4402-87f2-e394be34b201 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:45.431181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7930d3-a3c3-4402-87f2-e394be34b201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:45.475222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9b7930d3-a3c3-4402-87f2-e394be34b201 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:45.476621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9b7930d3-a3c3-4402-87f2-e394be34b201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:45.581386 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3140/6334] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:45.582982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2883a6-c1ea-47f1-8ea3-1f4d9574f777 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:45.587806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2883a6-c1ea-47f1-8ea3-1f4d9574f777 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:45.588452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2883a6-c1ea-47f1-8ea3-1f4d9574f777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:45.590761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-db8b748c-977c-491f-9d56-7f09c58b473e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275bfd7792fe43ed9bb76c2018b239d6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:45.593134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-db8b748c-977c-491f-9d56-7f09c58b473e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275bfd7792fe43ed9bb76c2018b239d6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:45.623923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0a2883a6-c1ea-47f1-8ea3-1f4d9574f777 None None] MFA Rules not processed for user `0c437ea28505426aaf3e85352215b11b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:45.627097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0a2883a6-c1ea-47f1-8ea3-1f4d9574f777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:45.718221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-db8b748c-977c-491f-9d56-7f09c58b473e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275bfd7792fe43ed9bb76c2018b239d6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:45.719149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-db8b748c-977c-491f-9d56-7f09c58b473e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275bfd7792fe43ed9bb76c2018b239d6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:45.740570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-db8b748c-977c-491f-9d56-7f09c58b473e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275bfd7792fe43ed9bb76c2018b239d6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:45.761070 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3195/6335] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:45 2022] DELETE /identity/v3/users/275bfd7792fe43ed9bb76c2018b239d6 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:45.765902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b748c-977c-491f-9d56-7f09c58b473e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:45.770572 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3141/6336] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:45.770572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4b2ae-9fa6-4dfe-ad52-558ec4579e99 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:45.770572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4b2ae-9fa6-4dfe-ad52-558ec4579e99 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:45.770572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4b2ae-9fa6-4dfe-ad52-558ec4579e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:45.776205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-db8b748c-977c-491f-9d56-7f09c58b473e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:45.792570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-62c4b2ae-9fa6-4dfe-ad52-558ec4579e99 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:45.793980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-62c4b2ae-9fa6-4dfe-ad52-558ec4579e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:45.844523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:45.875943 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3142/6337] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:53:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:45.879157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f683e2-5730-4c34-9acf-b54bfac8b8ac None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:45.879358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f683e2-5730-4c34-9acf-b54bfac8b8ac None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:45.879601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f683e2-5730-4c34-9acf-b54bfac8b8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:45.902895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-68f683e2-5730-4c34-9acf-b54bfac8b8ac None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:45.904143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-68f683e2-5730-4c34-9acf-b54bfac8b8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:45.920402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b748c-977c-491f-9d56-7f09c58b473e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:45.920781 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3143/6338] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:45.921657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f683e2-5730-4c34-9acf-b54bfac8b8ac None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:45.927172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e367f03-fdb1-4600-b210-3ab3ca15adfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:45.928024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e367f03-fdb1-4600-b210-3ab3ca15adfb admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:45.928346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e367f03-fdb1-4600-b210-3ab3ca15adfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:45.928620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e367f03-fdb1-4600-b210-3ab3ca15adfb admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:45.929284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e367f03-fdb1-4600-b210-3ab3ca15adfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:53:45.929591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e367f03-fdb1-4600-b210-3ab3ca15adfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:45.931272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e367f03-fdb1-4600-b210-3ab3ca15adfb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:45.939438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:45.952239 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3196/6339] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:53:45.953122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e367f03-fdb1-4600-b210-3ab3ca15adfb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:45.954982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8e367f03-fdb1-4600-b210-3ab3ca15adfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:46.050257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f683e2-5730-4c34-9acf-b54bfac8b8ac None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:46.057179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dfea6-f259-4508-a678-ef13c94b4f93 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c437ea28505426aaf3e85352215b11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1dee3b9e552418e915c2b5154567bd5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:46.058135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dfea6-f259-4508-a678-ef13c94b4f93 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:46.058507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dfea6-f259-4508-a678-ef13c94b4f93 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:46.059682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dfea6-f259-4508-a678-ef13c94b4f93 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:46.060485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dfea6-f259-4508-a678-ef13c94b4f93 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:46.063144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dfea6-f259-4508-a678-ef13c94b4f93 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:46.093720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e367f03-fdb1-4600-b210-3ab3ca15adfb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:46.100060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9616b-e46c-4767-87cc-1cc5b30d4d3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:46.100945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9616b-e46c-4767-87cc-1cc5b30d4d3b service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:46.101401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9616b-e46c-4767-87cc-1cc5b30d4d3b service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:46.101847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9616b-e46c-4767-87cc-1cc5b30d4d3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:46.114006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9616b-e46c-4767-87cc-1cc5b30d4d3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:46.116261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9616b-e46c-4767-87cc-1cc5b30d4d3b service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:46.131984 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3197/6340] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:53:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:46.131984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9616b-e46c-4767-87cc-1cc5b30d4d3b service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:46.157191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9616b-e46c-4767-87cc-1cc5b30d4d3b service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:46.163495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdad28-cbdd-463f-ba57-7a3529a4577d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:46.164114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdad28-cbdd-463f-ba57-7a3529a4577d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:46.168092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdad28-cbdd-463f-ba57-7a3529a4577d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:46.168092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdad28-cbdd-463f-ba57-7a3529a4577d admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:46.168344 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3144/6341] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:45 2022] POST /identity/v3/projects => generated 333 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:46.168442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdad28-cbdd-463f-ba57-7a3529a4577d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:46.168442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdad28-cbdd-463f-ba57-7a3529a4577d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:46.171950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dfea6-f259-4508-a678-ef13c94b4f93 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:46.178506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1f5dfea6-f259-4508-a678-ef13c94b4f93 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:46.307937 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3198/6342] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:46 2022] POST /identity/v3/projects => generated 407 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:46.307937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdad28-cbdd-463f-ba57-7a3529a4577d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:46.309157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dfea6-f259-4508-a678-ef13c94b4f93 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:46.403247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859c6d9-2591-4bf6-a8e2-368bd52b9e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:46.403878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859c6d9-2591-4bf6-a8e2-368bd52b9e33 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:46.404156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859c6d9-2591-4bf6-a8e2-368bd52b9e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:46.404478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859c6d9-2591-4bf6-a8e2-368bd52b9e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:46.528060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859c6d9-2591-4bf6-a8e2-368bd52b9e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:46.533171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859c6d9-2591-4bf6-a8e2-368bd52b9e33 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:46.538381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdad28-cbdd-463f-ba57-7a3529a4577d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:46.544451 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3145/6343] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:46.550097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859c6d9-2591-4bf6-a8e2-368bd52b9e33 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:46.553547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbd951-d35d-4a5d-89db-8e8285361661 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c437ea28505426aaf3e85352215b11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1dee3b9e552418e915c2b5154567bd5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:46.553944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbd951-d35d-4a5d-89db-8e8285361661 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:46.554307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbd951-d35d-4a5d-89db-8e8285361661 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:46.554666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbd951-d35d-4a5d-89db-8e8285361661 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:46.555382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbd951-d35d-4a5d-89db-8e8285361661 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:46.557127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859c6d9-2591-4bf6-a8e2-368bd52b9e33 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:46.559782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbd951-d35d-4a5d-89db-8e8285361661 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:46.562428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105524a0-5b43-41bf-85e4-f7a2c89ecb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:46.563562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105524a0-5b43-41bf-85e4-f7a2c89ecb49 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:46.563977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105524a0-5b43-41bf-85e4-f7a2c89ecb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:46.564408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105524a0-5b43-41bf-85e4-f7a2c89ecb49 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:46.565152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105524a0-5b43-41bf-85e4-f7a2c89ecb49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:46.567369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105524a0-5b43-41bf-85e4-f7a2c89ecb49 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:46.750806 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3146/6344] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:46 2022] POST /identity/v3/users => generated 304 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:46.750806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a39ceb-1043-486f-8d3c-3909d1563b52 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:46.750806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a39ceb-1043-486f-8d3c-3909d1563b52 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:46.750806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a39ceb-1043-486f-8d3c-3909d1563b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:46.770514 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3199/6345] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:53:46 2022] POST /identity/v3/projects => generated 332 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:46.784354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbd951-d35d-4a5d-89db-8e8285361661 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:46.796096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-40a39ceb-1043-486f-8d3c-3909d1563b52 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:46.800251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-40a39ceb-1043-486f-8d3c-3909d1563b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:46.879550 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3147/6346] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:53:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:46.880947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a39ceb-1043-486f-8d3c-3909d1563b52 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:46.963745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbd951-d35d-4a5d-89db-8e8285361661 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:46.967816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a39ceb-1043-486f-8d3c-3909d1563b52 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:46.974911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9c969-9063-4944-b431-56bf2aefbc1e tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c437ea28505426aaf3e85352215b11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1dee3b9e552418e915c2b5154567bd5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:46.975921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9c969-9063-4944-b431-56bf2aefbc1e tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:46.976358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9c969-9063-4944-b431-56bf2aefbc1e tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:46.976911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9c969-9063-4944-b431-56bf2aefbc1e tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:46.977039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe3d1b-3ca8-4c47-af60-a53290f1a50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:46.977553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe3d1b-3ca8-4c47-af60-a53290f1a50b admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:46.977809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9c969-9063-4944-b431-56bf2aefbc1e tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:46.977935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe3d1b-3ca8-4c47-af60-a53290f1a50b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:46.978106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe3d1b-3ca8-4c47-af60-a53290f1a50b admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:46.978767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe3d1b-3ca8-4c47-af60-a53290f1a50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:46.980126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9c969-9063-4944-b431-56bf2aefbc1e tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:46.980598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe3d1b-3ca8-4c47-af60-a53290f1a50b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:47.002046 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3200/6347] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:47.003166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe3d1b-3ca8-4c47-af60-a53290f1a50b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:47.114489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe3d1b-3ca8-4c47-af60-a53290f1a50b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:47.122668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abceb6-833c-46fd-853a-20af32a6a31a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:47.122668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abceb6-833c-46fd-853a-20af32a6a31a service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:47.122668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abceb6-833c-46fd-853a-20af32a6a31a service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:47.122668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abceb6-833c-46fd-853a-20af32a6a31a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:47.129822 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3148/6348] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:46 2022] POST /identity/v3/projects => generated 357 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:47.129822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9c969-9063-4944-b431-56bf2aefbc1e tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:47.132445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abceb6-833c-46fd-853a-20af32a6a31a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:47.134471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abceb6-833c-46fd-853a-20af32a6a31a service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:47.166695 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3201/6349] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:53:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:47.167798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abceb6-833c-46fd-853a-20af32a6a31a service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:47.195477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abceb6-833c-46fd-853a-20af32a6a31a service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:47.292453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9c969-9063-4944-b431-56bf2aefbc1e tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:47.295870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1c903-95bb-4bdb-ad11-b049f72b0fe8 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c437ea28505426aaf3e85352215b11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1dee3b9e552418e915c2b5154567bd5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:47.296773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1c903-95bb-4bdb-ad11-b049f72b0fe8 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:47.297066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1c903-95bb-4bdb-ad11-b049f72b0fe8 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:47.297340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1c903-95bb-4bdb-ad11-b049f72b0fe8 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:47.298385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7114e-02f4-451b-9370-24941f11344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:47.298934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1c903-95bb-4bdb-ad11-b049f72b0fe8 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:47.299255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7114e-02f4-451b-9370-24941f11344b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:47.299637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7114e-02f4-451b-9370-24941f11344b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:47.300096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7114e-02f4-451b-9370-24941f11344b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:47.300889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7114e-02f4-451b-9370-24941f11344b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:47.301026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1c903-95bb-4bdb-ad11-b049f72b0fe8 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:47.303866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7114e-02f4-451b-9370-24941f11344b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:47.326925 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3202/6350] 10.222.0.76 () {58 vars in 1131 bytes} [Sat Aug 27 04:53:47 2022] GET /identity/v3/projects => generated 7169 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:47.333437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:47.343831 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3149/6351] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:47.349663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7114e-02f4-451b-9370-24941f11344b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:47.352802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1c903-95bb-4bdb-ad11-b049f72b0fe8 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:47.368859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1c903-95bb-4bdb-ad11-b049f72b0fe8 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:47.369104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7114e-02f4-451b-9370-24941f11344b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:47.378017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da8f80-6fe1-450e-8e07-87ae45bef5dc tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c437ea28505426aaf3e85352215b11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1dee3b9e552418e915c2b5154567bd5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:47.378750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da8f80-6fe1-450e-8e07-87ae45bef5dc tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:47.379038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da8f80-6fe1-450e-8e07-87ae45bef5dc tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:47.379315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da8f80-6fe1-450e-8e07-87ae45bef5dc tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:47.380210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e7b44-e305-4f07-8bc0-d78b70aa907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:47.381550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e7b44-e305-4f07-8bc0-d78b70aa907e admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:47.381918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da8f80-6fe1-450e-8e07-87ae45bef5dc tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:53:47.382217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e7b44-e305-4f07-8bc0-d78b70aa907e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:47.382343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da8f80-6fe1-450e-8e07-87ae45bef5dc tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:47.382831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e7b44-e305-4f07-8bc0-d78b70aa907e admin admin] PATH_INFO: `/v3/projects/cfebb1aea5ca4732b4122c79f7970c03/users/710ebe2be56346cc874d9d1a9dcb210b/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:47.384396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da8f80-6fe1-450e-8e07-87ae45bef5dc tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:47.410087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e7b44-e305-4f07-8bc0-d78b70aa907e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfebb1aea5ca4732b4122c79f7970c03, user_id=710ebe2be56346cc874d9d1a9dcb210b, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:47.414012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e7b44-e305-4f07-8bc0-d78b70aa907e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:47.417526 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3203/6352] 10.222.0.76 () {58 vars in 1158 bytes} [Sat Aug 27 04:53:47 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:53:47.419000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da8f80-6fe1-450e-8e07-87ae45bef5dc tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:47.449396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da8f80-6fe1-450e-8e07-87ae45bef5dc tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:47.456443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0c458-21ed-4185-b9dc-595c91c86cea tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c437ea28505426aaf3e85352215b11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1dee3b9e552418e915c2b5154567bd5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:47.457134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0c458-21ed-4185-b9dc-595c91c86cea tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:47.457414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0c458-21ed-4185-b9dc-595c91c86cea tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:47.457688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0c458-21ed-4185-b9dc-595c91c86cea tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:47.458582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0c458-21ed-4185-b9dc-595c91c86cea tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Adding query filter params (parent_id=a7ea7a6a09eb4ee48f7961d6b66a22df) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:53:47.458971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0c458-21ed-4185-b9dc-595c91c86cea tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:47.461148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0c458-21ed-4185-b9dc-595c91c86cea tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:47.495000 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3204/6353] 10.222.0.76 () {58 vars in 1216 bytes} [Sat Aug 27 04:53:47 2022] GET /identity/v3/projects?parent_id=a7ea7a6a09eb4ee48f7961d6b66a22df => generated 497 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:53:47.496011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0c458-21ed-4185-b9dc-595c91c86cea tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:47.507707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0c458-21ed-4185-b9dc-595c91c86cea tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:47.513304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad896958-7c93-4c48-9eab-2fa51050a744 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c437ea28505426aaf3e85352215b11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1dee3b9e552418e915c2b5154567bd5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:47.514626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad896958-7c93-4c48-9eab-2fa51050a744 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:47.515014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad896958-7c93-4c48-9eab-2fa51050a744 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:47.515161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad896958-7c93-4c48-9eab-2fa51050a744 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] PATH_INFO: `/v3/projects/27779b21df504d379b0ddd6d652fe6fc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:47.516399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad896958-7c93-4c48-9eab-2fa51050a744 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorizing `identity:delete_project(project_id=27779b21df504d379b0ddd6d652fe6fc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:47.518412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad896958-7c93-4c48-9eab-2fa51050a744 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:47.529896 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3150/6354] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:47 2022] PUT /identity/v3/projects/cfebb1aea5ca4732b4122c79f7970c03/users/710ebe2be56346cc874d9d1a9dcb210b/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:47.541651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a0c0d-1544-4703-9eaf-8c21f05c0eed None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:47.541927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a0c0d-1544-4703-9eaf-8c21f05c0eed None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:47.542603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a0c0d-1544-4703-9eaf-8c21f05c0eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:47.612499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-879a0c0d-1544-4703-9eaf-8c21f05c0eed None None] MFA Rules not processed for user `710ebe2be56346cc874d9d1a9dcb210b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:47.614106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-879a0c0d-1544-4703-9eaf-8c21f05c0eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:47.705700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad896958-7c93-4c48-9eab-2fa51050a744 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27779b21df504d379b0ddd6d652fe6fc', 'request_id': 'req-ad896958-7c93-4c48-9eab-2fa51050a744'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:47.719033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad896958-7c93-4c48-9eab-2fa51050a744 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27779b21df504d379b0ddd6d652fe6fc', 'request_id': 'req-ad896958-7c93-4c48-9eab-2fa51050a744'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:47.755652 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3151/6355] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:47 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:47.757393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94027-940b-4978-9dd8-d23f5c5b0d9a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:47.757688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94027-940b-4978-9dd8-d23f5c5b0d9a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:47.759124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94027-940b-4978-9dd8-d23f5c5b0d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:47.789817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bed94027-940b-4978-9dd8-d23f5c5b0d9a None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:47.795675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bed94027-940b-4978-9dd8-d23f5c5b0d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:47.815395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad896958-7c93-4c48-9eab-2fa51050a744 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27779b21df504d379b0ddd6d652fe6fc', 'request_id': 'req-ad896958-7c93-4c48-9eab-2fa51050a744'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:47.838765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad896958-7c93-4c48-9eab-2fa51050a744 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] The token cache is being invalidate because project 27779b21df504d379b0ddd6d652fe6fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:47.839061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad896958-7c93-4c48-9eab-2fa51050a744 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:47.840735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad896958-7c93-4c48-9eab-2fa51050a744 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:47.843744 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3205/6356] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:47 2022] DELETE /identity/v3/projects/27779b21df504d379b0ddd6d652fe6fc => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:47.846888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad896958-7c93-4c48-9eab-2fa51050a744 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:47.848857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ad896958-7c93-4c48-9eab-2fa51050a744 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:47.885374 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3152/6357] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:53:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:47.887259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed94027-940b-4978-9dd8-d23f5c5b0d9a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:47.888397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bed94027-940b-4978-9dd8-d23f5c5b0d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:48.014262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed94027-940b-4978-9dd8-d23f5c5b0d9a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:48.021534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a498d0-76c0-4940-99d0-70fcb9369a12 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c437ea28505426aaf3e85352215b11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1dee3b9e552418e915c2b5154567bd5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:48.022341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a498d0-76c0-4940-99d0-70fcb9369a12 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:48.022724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a498d0-76c0-4940-99d0-70fcb9369a12 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:48.023105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a498d0-76c0-4940-99d0-70fcb9369a12 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] PATH_INFO: `/v3/projects/a7ea7a6a09eb4ee48f7961d6b66a22df` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:48.024768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a498d0-76c0-4940-99d0-70fcb9369a12 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a7ea7a6a09eb4ee48f7961d6b66a22df)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:48.027525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a498d0-76c0-4940-99d0-70fcb9369a12 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:48.036610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:48.062893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad896958-7c93-4c48-9eab-2fa51050a744 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:48.069224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07acf4-5e18-47b1-a9e6-683e64e3b2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:48.069858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07acf4-5e18-47b1-a9e6-683e64e3b2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:48.070193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07acf4-5e18-47b1-a9e6-683e64e3b2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:48.070421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07acf4-5e18-47b1-a9e6-683e64e3b2e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:48.071132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07acf4-5e18-47b1-a9e6-683e64e3b2e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:48.073099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07acf4-5e18-47b1-a9e6-683e64e3b2e3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:48.178179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-33a498d0-76c0-4940-99d0-70fcb9369a12 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ea7a6a09eb4ee48f7961d6b66a22df', 'request_id': 'req-33a498d0-76c0-4940-99d0-70fcb9369a12'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:48.184409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-33a498d0-76c0-4940-99d0-70fcb9369a12 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ea7a6a09eb4ee48f7961d6b66a22df', 'request_id': 'req-33a498d0-76c0-4940-99d0-70fcb9369a12'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:48.192244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-33a498d0-76c0-4940-99d0-70fcb9369a12 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ea7a6a09eb4ee48f7961d6b66a22df', 'request_id': 'req-33a498d0-76c0-4940-99d0-70fcb9369a12'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:48.249734 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3206/6358] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:47 2022] POST /identity/v3/projects => generated 405 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:48.249734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07acf4-5e18-47b1-a9e6-683e64e3b2e3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:48.250121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ca07acf4-5e18-47b1-a9e6-683e64e3b2e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:48.358475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-33a498d0-76c0-4940-99d0-70fcb9369a12 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] The token cache is being invalidate because project a7ea7a6a09eb4ee48f7961d6b66a22df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:48.358792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-33a498d0-76c0-4940-99d0-70fcb9369a12 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:48.364634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-33a498d0-76c0-4940-99d0-70fcb9369a12 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:48.366694 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3153/6359] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:47 2022] DELETE /identity/v3/projects/a7ea7a6a09eb4ee48f7961d6b66a22df => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:48.369493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a498d0-76c0-4940-99d0-70fcb9369a12 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:48.372340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-33a498d0-76c0-4940-99d0-70fcb9369a12 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:48.386177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07acf4-5e18-47b1-a9e6-683e64e3b2e3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:48.394797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876bfb2-7e86-42c4-8bfc-555fd933cfa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:48.396175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876bfb2-7e86-42c4-8bfc-555fd933cfa6 service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:48.396557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876bfb2-7e86-42c4-8bfc-555fd933cfa6 service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:48.396934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876bfb2-7e86-42c4-8bfc-555fd933cfa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:48.399527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b876bfb2-7e86-42c4-8bfc-555fd933cfa6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:48.483968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876bfb2-7e86-42c4-8bfc-555fd933cfa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:48.486657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876bfb2-7e86-42c4-8bfc-555fd933cfa6 service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:48.499361 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3207/6360] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:53:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:48.500358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876bfb2-7e86-42c4-8bfc-555fd933cfa6 service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:48.502748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b876bfb2-7e86-42c4-8bfc-555fd933cfa6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:48.607803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a498d0-76c0-4940-99d0-70fcb9369a12 tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:48.620694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876bfb2-7e86-42c4-8bfc-555fd933cfa6 service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:48.627155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c437ea28505426aaf3e85352215b11b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1dee3b9e552418e915c2b5154567bd5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:48.628036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:48.628578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:48.629045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] PATH_INFO: `/v3/projects/98e9a1ede9c748dcaaf652f7955c82bd` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:48.631053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorizing `identity:delete_project(project_id=98e9a1ede9c748dcaaf652f7955c82bd)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:48.633534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:48.713232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51336835-4e1c-4159-b15c-ee9a1a1f0036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:48.716966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51336835-4e1c-4159-b15c-ee9a1a1f0036 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:48.716966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51336835-4e1c-4159-b15c-ee9a1a1f0036 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:48.716966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51336835-4e1c-4159-b15c-ee9a1a1f0036 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:48.716966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51336835-4e1c-4159-b15c-ee9a1a1f0036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:48.717665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51336835-4e1c-4159-b15c-ee9a1a1f0036 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:48.828903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98e9a1ede9c748dcaaf652f7955c82bd', 'request_id': 'req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:48.845598 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3154/6361] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:48 2022] POST /identity/v3/users => generated 309 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:48.849060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51336835-4e1c-4159-b15c-ee9a1a1f0036 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:48.849984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98e9a1ede9c748dcaaf652f7955c82bd', 'request_id': 'req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:48.851413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-51336835-4e1c-4159-b15c-ee9a1a1f0036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:48.866029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51336835-4e1c-4159-b15c-ee9a1a1f0036 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:48.951930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98e9a1ede9c748dcaaf652f7955c82bd', 'request_id': 'req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:48.970707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] The token cache is being invalidate because project 98e9a1ede9c748dcaaf652f7955c82bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:48.971444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:48.972383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:48.976309 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3208/6362] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:48 2022] DELETE /identity/v3/projects/98e9a1ede9c748dcaaf652f7955c82bd => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:48.976973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:48.977801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:48.979013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:48.979860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:48.980353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:48.982481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590 admin admin] PATH_INFO: `/v3/projects/f57a78d75da94621b5aecc2f5614902d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:48.987938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f57a78d75da94621b5aecc2f5614902d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:48.994254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:48.999375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8cb91-648c-4ac4-82c1-1dc2d1975dbd tempest-ListProjectsTestJSON-805215756 tempest-ListProjectsTestJSON-805215756-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:49.008500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d37514-6793-4942-916c-171c46a1073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:49.009413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d37514-6793-4942-916c-171c46a1073f admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:49.009880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d37514-6793-4942-916c-171c46a1073f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:49.010337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d37514-6793-4942-916c-171c46a1073f admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:49.011172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d37514-6793-4942-916c-171c46a1073f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:49.021517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d37514-6793-4942-916c-171c46a1073f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:49.041730 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3209/6363] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:49.042535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d37514-6793-4942-916c-171c46a1073f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:49.046394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-21d37514-6793-4942-916c-171c46a1073f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:49.062152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d37514-6793-4942-916c-171c46a1073f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:49.067943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45d3a0-797b-4081-943f-f78bf8ec0d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:49.068653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45d3a0-797b-4081-943f-f78bf8ec0d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:49.068937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45d3a0-797b-4081-943f-f78bf8ec0d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:49.069214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45d3a0-797b-4081-943f-f78bf8ec0d06 admin admin] PATH_INFO: `/v3/users/103575cc5e4a4f2c8fb5f1442f1ee9ec` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:49.070615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45d3a0-797b-4081-943f-f78bf8ec0d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=103575cc5e4a4f2c8fb5f1442f1ee9ec)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:49.076309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45d3a0-797b-4081-943f-f78bf8ec0d06 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:49.205917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f57a78d75da94621b5aecc2f5614902d', 'request_id': 'req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:49.217648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f57a78d75da94621b5aecc2f5614902d', 'request_id': 'req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:49.228677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f57a78d75da94621b5aecc2f5614902d', 'request_id': 'req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:49.374228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590 admin admin] The token cache is being invalidate because project f57a78d75da94621b5aecc2f5614902d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:49.374595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:49.378202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:49.380560 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3155/6364] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:48 2022] DELETE /identity/v3/projects/f57a78d75da94621b5aecc2f5614902d => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:49.381351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:49.385284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:49.442651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aa45d3a0-797b-4081-943f-f78bf8ec0d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '103575cc5e4a4f2c8fb5f1442f1ee9ec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:49.443812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aa45d3a0-797b-4081-943f-f78bf8ec0d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '103575cc5e4a4f2c8fb5f1442f1ee9ec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:49.554006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aa45d3a0-797b-4081-943f-f78bf8ec0d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '103575cc5e4a4f2c8fb5f1442f1ee9ec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:49.554006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aa45d3a0-797b-4081-943f-f78bf8ec0d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '103575cc5e4a4f2c8fb5f1442f1ee9ec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:49.564629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a9a4a-3ce1-410a-b0e7-96dfcf22b590 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:49.579964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe5a08-3c94-4d3a-acb0-95a7f9bbd848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:49.580809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-aa45d3a0-797b-4081-943f-f78bf8ec0d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '103575cc5e4a4f2c8fb5f1442f1ee9ec'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:49.581486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe5a08-3c94-4d3a-acb0-95a7f9bbd848 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:49.581975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe5a08-3c94-4d3a-acb0-95a7f9bbd848 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:49.582485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe5a08-3c94-4d3a-acb0-95a7f9bbd848 admin admin] PATH_INFO: `/v3/projects/f6e26629f10141cfb685028df5ac2576/users/deafd39b516a43f393cd570d24851664/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:49.629151 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3210/6365] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:49 2022] DELETE /identity/v3/users/103575cc5e4a4f2c8fb5f1442f1ee9ec => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:49.634467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe5a08-3c94-4d3a-acb0-95a7f9bbd848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e26629f10141cfb685028df5ac2576, user_id=deafd39b516a43f393cd570d24851664, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:49.634467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe5a08-3c94-4d3a-acb0-95a7f9bbd848 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:49.634798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5a74c-97f0-46ed-b2b0-84a8933acbb2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:49.635038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5a74c-97f0-46ed-b2b0-84a8933acbb2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:49.635323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5a74c-97f0-46ed-b2b0-84a8933acbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:49.704702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-dcf5a74c-97f0-46ed-b2b0-84a8933acbb2 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:49.706154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dcf5a74c-97f0-46ed-b2b0-84a8933acbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:49.783620 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3156/6366] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:49 2022] PUT /identity/v3/projects/f6e26629f10141cfb685028df5ac2576/users/deafd39b516a43f393cd570d24851664/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:49.784419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe5a08-3c94-4d3a-acb0-95a7f9bbd848 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:49.788723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-68fe5a08-3c94-4d3a-acb0-95a7f9bbd848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:49.830799 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3211/6367] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:53:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:49.832273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd951d-ab90-45f4-9309-54eecc90d9e3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:49.833153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd951d-ab90-45f4-9309-54eecc90d9e3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:49.835746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd951d-ab90-45f4-9309-54eecc90d9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:49.883608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-cacd951d-ab90-45f4-9309-54eecc90d9e3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:49.884902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cacd951d-ab90-45f4-9309-54eecc90d9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:50.012487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe5a08-3c94-4d3a-acb0-95a7f9bbd848 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:50.029457 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3212/6368] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:50.032746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd951d-ab90-45f4-9309-54eecc90d9e3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:50.032876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafe301-9f8e-4d65-8602-2173bcf00cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:50.033227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafe301-9f8e-4d65-8602-2173bcf00cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:50.033511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafe301-9f8e-4d65-8602-2173bcf00cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:50.033783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafe301-9f8e-4d65-8602-2173bcf00cdb admin admin] PATH_INFO: `/v3/users/4493964b859c45aab076db09bf269362` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:50.037633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cacd951d-ab90-45f4-9309-54eecc90d9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:50.038230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafe301-9f8e-4d65-8602-2173bcf00cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4493964b859c45aab076db09bf269362)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:50.055168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafe301-9f8e-4d65-8602-2173bcf00cdb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:50.078401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd951d-ab90-45f4-9309-54eecc90d9e3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:50.089459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc7c10-e38a-4160-ab80-d1464b09d8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:50.090112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc7c10-e38a-4160-ab80-d1464b09d8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:50.090393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc7c10-e38a-4160-ab80-d1464b09d8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:50.090667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc7c10-e38a-4160-ab80-d1464b09d8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:50.091332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc7c10-e38a-4160-ab80-d1464b09d8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:50.097042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc7c10-e38a-4160-ab80-d1464b09d8c5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:50.132312 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3213/6369] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:50.133635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc7c10-e38a-4160-ab80-d1464b09d8c5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:50.135683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c8bc7c10-e38a-4160-ab80-d1464b09d8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:50.326226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc7c10-e38a-4160-ab80-d1464b09d8c5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:50.331071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dad42-facb-46b2-bcbb-8a72279e3c13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:50.331722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dad42-facb-46b2-bcbb-8a72279e3c13 service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:50.332005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dad42-facb-46b2-bcbb-8a72279e3c13 service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:50.332366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dad42-facb-46b2-bcbb-8a72279e3c13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:50.403504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:50.425670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2dafe301-9f8e-4d65-8602-2173bcf00cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4493964b859c45aab076db09bf269362'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:50.489348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dad42-facb-46b2-bcbb-8a72279e3c13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:50.493368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dad42-facb-46b2-bcbb-8a72279e3c13 service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:50.522777 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3214/6370] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:53:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:50.526278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dad42-facb-46b2-bcbb-8a72279e3c13 service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:50.528751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-828dad42-facb-46b2-bcbb-8a72279e3c13 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:50.535914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2dafe301-9f8e-4d65-8602-2173bcf00cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4493964b859c45aab076db09bf269362'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:50.537612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2dafe301-9f8e-4d65-8602-2173bcf00cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4493964b859c45aab076db09bf269362'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:50.565896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2dafe301-9f8e-4d65-8602-2173bcf00cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4493964b859c45aab076db09bf269362'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:50.609104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2dafe301-9f8e-4d65-8602-2173bcf00cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4493964b859c45aab076db09bf269362'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:50.624606 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3157/6371] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:49 2022] DELETE /identity/v3/users/4493964b859c45aab076db09bf269362 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:50.628743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafe301-9f8e-4d65-8602-2173bcf00cdb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:50.631152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2dafe301-9f8e-4d65-8602-2173bcf00cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:50.634896 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dad42-facb-46b2-bcbb-8a72279e3c13 service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:50.767771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e1513-2a63-46fa-86e9-c2cac98bfe0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:50.769804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e1513-2a63-46fa-86e9-c2cac98bfe0b service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:50.770093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e1513-2a63-46fa-86e9-c2cac98bfe0b service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:50.770373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e1513-2a63-46fa-86e9-c2cac98bfe0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:50.774578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d64e1513-2a63-46fa-86e9-c2cac98bfe0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:50.802383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafe301-9f8e-4d65-8602-2173bcf00cdb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:50.807156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e1513-2a63-46fa-86e9-c2cac98bfe0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:50.809746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e1513-2a63-46fa-86e9-c2cac98bfe0b service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:50.817470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf820e6-13ee-424a-abba-4e645f5fa4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:50.818162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf820e6-13ee-424a-abba-4e645f5fa4de admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:50.818512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf820e6-13ee-424a-abba-4e645f5fa4de admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:50.818754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf820e6-13ee-424a-abba-4e645f5fa4de admin admin] PATH_INFO: `/v3/projects/f6e26629f10141cfb685028df5ac2576/users/deafd39b516a43f393cd570d24851664/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:50.821388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf820e6-13ee-424a-abba-4e645f5fa4de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e26629f10141cfb685028df5ac2576, user_id=deafd39b516a43f393cd570d24851664, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:50.828196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf820e6-13ee-424a-abba-4e645f5fa4de admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:50.840544 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3215/6372] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:50.851976 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3158/6373] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:50 2022] PUT /identity/v3/projects/f6e26629f10141cfb685028df5ac2576/users/deafd39b516a43f393cd570d24851664/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:50.863631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ffc69-71c7-408c-a1a2-0a969fe5b88c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:50.863921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ffc69-71c7-408c-a1a2-0a969fe5b88c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:50.865850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ffc69-71c7-408c-a1a2-0a969fe5b88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:50.972608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d91ffc69-71c7-408c-a1a2-0a969fe5b88c None None] MFA Rules not processed for user `deafd39b516a43f393cd570d24851664`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:50.974182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d91ffc69-71c7-408c-a1a2-0a969fe5b88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:51.140533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649872b6-7caa-4877-a827-3b8c7ab5a550 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:51.140533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649872b6-7caa-4877-a827-3b8c7ab5a550 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:51.141294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649872b6-7caa-4877-a827-3b8c7ab5a550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:51.162865 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3216/6374] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:50 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:51.199779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-649872b6-7caa-4877-a827-3b8c7ab5a550 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:51.201584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-649872b6-7caa-4877-a827-3b8c7ab5a550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:51.209031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ffc69-71c7-408c-a1a2-0a969fe5b88c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:51.212603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d91ffc69-71c7-408c-a1a2-0a969fe5b88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:51.349007 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3159/6375] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:53:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:51.354161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ffc69-71c7-408c-a1a2-0a969fe5b88c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:51.358442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2aac6-22f2-4a74-be99-98ade27fca98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:51.359439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2aac6-22f2-4a74-be99-98ade27fca98 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:51.359983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2aac6-22f2-4a74-be99-98ade27fca98 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:51.360781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2aac6-22f2-4a74-be99-98ade27fca98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:51.363591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649872b6-7caa-4877-a827-3b8c7ab5a550 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:51.365194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-649872b6-7caa-4877-a827-3b8c7ab5a550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:51.372437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dbe2aac6-22f2-4a74-be99-98ade27fca98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:51.487690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2aac6-22f2-4a74-be99-98ade27fca98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:51.490114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2aac6-22f2-4a74-be99-98ade27fca98 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:51.502865 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3217/6376] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:51 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:53:51.521530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649872b6-7caa-4877-a827-3b8c7ab5a550 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:51.535101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156b26c-c7d4-478c-8259-2b3542d45837 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:51.535881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156b26c-c7d4-478c-8259-2b3542d45837 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:51.536188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156b26c-c7d4-478c-8259-2b3542d45837 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:51.536474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156b26c-c7d4-478c-8259-2b3542d45837 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:51.551656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156b26c-c7d4-478c-8259-2b3542d45837 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:51.553839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156b26c-c7d4-478c-8259-2b3542d45837 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:51.585781 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3160/6377] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:53:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 04:53:51.947697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2aac6-22f2-4a74-be99-98ade27fca98 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:51.951592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dbe2aac6-22f2-4a74-be99-98ade27fca98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:52.176944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2aac6-22f2-4a74-be99-98ade27fca98 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:52.187326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f6208-fe53-42a1-9383-8f1fd3c167ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:52.188112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f6208-fe53-42a1-9383-8f1fd3c167ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:52.188607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f6208-fe53-42a1-9383-8f1fd3c167ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:52.189092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f6208-fe53-42a1-9383-8f1fd3c167ae admin admin] PATH_INFO: `/v3/projects/5dac99877c64454494fa3eed9d76330d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:52.192848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f6208-fe53-42a1-9383-8f1fd3c167ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dac99877c64454494fa3eed9d76330d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:52.194831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f6208-fe53-42a1-9383-8f1fd3c167ae admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:52.289536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7ea4e-2c50-4017-9f14-195cce9106a7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:52.289829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7ea4e-2c50-4017-9f14-195cce9106a7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:52.290107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7ea4e-2c50-4017-9f14-195cce9106a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:52.322197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4ab7ea4e-2c50-4017-9f14-195cce9106a7 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:52.324726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4ab7ea4e-2c50-4017-9f14-195cce9106a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:52.343515 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3161/6378] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 04:53:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:53:52.356910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7ea4e-2c50-4017-9f14-195cce9106a7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:52.373417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7ea4e-2c50-4017-9f14-195cce9106a7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:52.379746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf600a09-11dd-43ae-90f2-1c9e7e561706 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:52.380409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf600a09-11dd-43ae-90f2-1c9e7e561706 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:52.380852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf600a09-11dd-43ae-90f2-1c9e7e561706 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:52.381183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf600a09-11dd-43ae-90f2-1c9e7e561706 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:52.392277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf600a09-11dd-43ae-90f2-1c9e7e561706 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:52.394287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf600a09-11dd-43ae-90f2-1c9e7e561706 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:52.424041 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3162/6379] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:53:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 04:53:52.433714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-223f6208-fe53-42a1-9383-8f1fd3c167ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dac99877c64454494fa3eed9d76330d', 'request_id': 'req-223f6208-fe53-42a1-9383-8f1fd3c167ae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:52.452627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-223f6208-fe53-42a1-9383-8f1fd3c167ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dac99877c64454494fa3eed9d76330d', 'request_id': 'req-223f6208-fe53-42a1-9383-8f1fd3c167ae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:52.675710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-223f6208-fe53-42a1-9383-8f1fd3c167ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dac99877c64454494fa3eed9d76330d', 'request_id': 'req-223f6208-fe53-42a1-9383-8f1fd3c167ae'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:52.697318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-223f6208-fe53-42a1-9383-8f1fd3c167ae admin admin] The token cache is being invalidate because project 5dac99877c64454494fa3eed9d76330d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:52.698037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-223f6208-fe53-42a1-9383-8f1fd3c167ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:52.699109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-223f6208-fe53-42a1-9383-8f1fd3c167ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:52.701655 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3218/6380] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:51 2022] DELETE /identity/v3/projects/5dac99877c64454494fa3eed9d76330d => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:52.706641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a97da-915c-4772-a57a-6f293ea5b110 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:52.707592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a97da-915c-4772-a57a-6f293ea5b110 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:52.708083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a97da-915c-4772-a57a-6f293ea5b110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:52.731968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-588a97da-915c-4772-a57a-6f293ea5b110 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:52.733565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-588a97da-915c-4772-a57a-6f293ea5b110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:52.862779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:52.866135 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3163/6381] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:52.878647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b784b-d1fd-4dd4-972d-ace95078904c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:52.879139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b784b-d1fd-4dd4-972d-ace95078904c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:52.879563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b784b-d1fd-4dd4-972d-ace95078904c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:52.893277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a97da-915c-4772-a57a-6f293ea5b110 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:52.895718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-588a97da-915c-4772-a57a-6f293ea5b110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:52.916443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-915b784b-d1fd-4dd4-972d-ace95078904c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:52.919483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a97da-915c-4772-a57a-6f293ea5b110 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:52.923981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-915b784b-d1fd-4dd4-972d-ace95078904c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:52.939096 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3219/6382] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:52.943370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b784b-d1fd-4dd4-972d-ace95078904c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:52.945079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e47458-0569-4388-a858-0ecacb5ef61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:52.945745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e47458-0569-4388-a858-0ecacb5ef61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:52.946024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e47458-0569-4388-a858-0ecacb5ef61f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:52.946298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e47458-0569-4388-a858-0ecacb5ef61f admin admin] PATH_INFO: `/v3/projects/a307682bfefc416d83311652bcb2def6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:52.951898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e47458-0569-4388-a858-0ecacb5ef61f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a307682bfefc416d83311652bcb2def6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:52.954733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e47458-0569-4388-a858-0ecacb5ef61f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:52.956708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b784b-d1fd-4dd4-972d-ace95078904c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:52.967954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e34e62-84e9-4199-9bf2-6d71cad2b67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:52.967954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e34e62-84e9-4199-9bf2-6d71cad2b67c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:52.967954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e34e62-84e9-4199-9bf2-6d71cad2b67c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:52.967954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e34e62-84e9-4199-9bf2-6d71cad2b67c admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:52.968663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e34e62-84e9-4199-9bf2-6d71cad2b67c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:53:52.968663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e34e62-84e9-4199-9bf2-6d71cad2b67c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:52.968663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e34e62-84e9-4199-9bf2-6d71cad2b67c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:52.993047 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3220/6383] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:53:52.994307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e34e62-84e9-4199-9bf2-6d71cad2b67c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:52.997366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:53.018749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e34e62-84e9-4199-9bf2-6d71cad2b67c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:53.023887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e738ae-eca5-4339-a212-f266d88e05d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:53.026351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e738ae-eca5-4339-a212-f266d88e05d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:53.026829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e738ae-eca5-4339-a212-f266d88e05d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:53.027593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e738ae-eca5-4339-a212-f266d88e05d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:53.030251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e738ae-eca5-4339-a212-f266d88e05d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:53.032212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e738ae-eca5-4339-a212-f266d88e05d1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:53.170597 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3221/6384] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:52 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:53.171733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e738ae-eca5-4339-a212-f266d88e05d1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:53.175820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b7e738ae-eca5-4339-a212-f266d88e05d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:53.197000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64e47458-0569-4388-a858-0ecacb5ef61f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a307682bfefc416d83311652bcb2def6', 'request_id': 'req-64e47458-0569-4388-a858-0ecacb5ef61f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:53.203582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64e47458-0569-4388-a858-0ecacb5ef61f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a307682bfefc416d83311652bcb2def6', 'request_id': 'req-64e47458-0569-4388-a858-0ecacb5ef61f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:53.216037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64e47458-0569-4388-a858-0ecacb5ef61f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a307682bfefc416d83311652bcb2def6', 'request_id': 'req-64e47458-0569-4388-a858-0ecacb5ef61f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:53.290712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e738ae-eca5-4339-a212-f266d88e05d1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:53.295642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583847c-d5e0-4f67-8dbe-2d25d58b1d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:53.296324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583847c-d5e0-4f67-8dbe-2d25d58b1d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:53.296739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583847c-d5e0-4f67-8dbe-2d25d58b1d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:53.297020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583847c-d5e0-4f67-8dbe-2d25d58b1d47 admin admin] PATH_INFO: `/v3/users/cf2d599761924f7f8bfb7b5b4f8300f6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:53.299512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583847c-d5e0-4f67-8dbe-2d25d58b1d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2d599761924f7f8bfb7b5b4f8300f6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:53.301715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583847c-d5e0-4f67-8dbe-2d25d58b1d47 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:53.358229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64e47458-0569-4388-a858-0ecacb5ef61f admin admin] The token cache is being invalidate because project a307682bfefc416d83311652bcb2def6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:53.358643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64e47458-0569-4388-a858-0ecacb5ef61f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:53.359604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64e47458-0569-4388-a858-0ecacb5ef61f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:53.362588 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3164/6385] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:52 2022] DELETE /identity/v3/projects/a307682bfefc416d83311652bcb2def6 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:53.366431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e47458-0569-4388-a858-0ecacb5ef61f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:53.368996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-64e47458-0569-4388-a858-0ecacb5ef61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:53.503084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e47458-0569-4388-a858-0ecacb5ef61f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:53.509505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a4e10-9925-4264-ad75-09fb175ebf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:53.510286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a4e10-9925-4264-ad75-09fb175ebf41 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:53.510576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a4e10-9925-4264-ad75-09fb175ebf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:53.510904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a4e10-9925-4264-ad75-09fb175ebf41 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:53.511547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a4e10-9925-4264-ad75-09fb175ebf41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:53.513535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a4e10-9925-4264-ad75-09fb175ebf41 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:53.649313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4583847c-d5e0-4f67-8dbe-2d25d58b1d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2d599761924f7f8bfb7b5b4f8300f6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:53.650328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4583847c-d5e0-4f67-8dbe-2d25d58b1d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2d599761924f7f8bfb7b5b4f8300f6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:53.694166 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3165/6386] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:53 2022] POST /identity/v3/users => generated 293 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:53.695656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a4e10-9925-4264-ad75-09fb175ebf41 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:53.697739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b73a4e10-9925-4264-ad75-09fb175ebf41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:53.728415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a4e10-9925-4264-ad75-09fb175ebf41 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:53.741465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ca32d-2093-45b2-aac4-9766d2925764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:53.742398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ca32d-2093-45b2-aac4-9766d2925764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:53.742854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ca32d-2093-45b2-aac4-9766d2925764 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:53.746665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ca32d-2093-45b2-aac4-9766d2925764 admin admin] PATH_INFO: `/v3/users/0c437ea28505426aaf3e85352215b11b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:53.746665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ca32d-2093-45b2-aac4-9766d2925764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c437ea28505426aaf3e85352215b11b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:53.747374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ca32d-2093-45b2-aac4-9766d2925764 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:53.820226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4583847c-d5e0-4f67-8dbe-2d25d58b1d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2d599761924f7f8bfb7b5b4f8300f6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:53.820914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4583847c-d5e0-4f67-8dbe-2d25d58b1d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2d599761924f7f8bfb7b5b4f8300f6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:53.837122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4583847c-d5e0-4f67-8dbe-2d25d58b1d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2d599761924f7f8bfb7b5b4f8300f6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:53.856818 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3222/6387] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:53 2022] DELETE /identity/v3/users/cf2d599761924f7f8bfb7b5b4f8300f6 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:53.857881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583847c-d5e0-4f67-8dbe-2d25d58b1d47 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:53.859592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4583847c-d5e0-4f67-8dbe-2d25d58b1d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:53.937419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583847c-d5e0-4f67-8dbe-2d25d58b1d47 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:53.946619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e28039-5a53-4de0-88ac-7f2e86bf6259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:53.947640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e28039-5a53-4de0-88ac-7f2e86bf6259 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:53.948192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e28039-5a53-4de0-88ac-7f2e86bf6259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:53.948848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e28039-5a53-4de0-88ac-7f2e86bf6259 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:53.953534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e28039-5a53-4de0-88ac-7f2e86bf6259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:53.956257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e28039-5a53-4de0-88ac-7f2e86bf6259 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:53.967439 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3223/6388] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:53.974781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e28039-5a53-4de0-88ac-7f2e86bf6259 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:53.974781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c4e28039-5a53-4de0-88ac-7f2e86bf6259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:54.076566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e28039-5a53-4de0-88ac-7f2e86bf6259 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:54.083045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f8cd4-9dfa-44ef-a664-4069fe0dc279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:54.084000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f8cd4-9dfa-44ef-a664-4069fe0dc279 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:54.084329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f8cd4-9dfa-44ef-a664-4069fe0dc279 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:54.084607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f8cd4-9dfa-44ef-a664-4069fe0dc279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:54.086500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f45f8cd4-9dfa-44ef-a664-4069fe0dc279 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:54.131692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-812ca32d-2093-45b2-aac4-9766d2925764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c437ea28505426aaf3e85352215b11b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:54.191851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f8cd4-9dfa-44ef-a664-4069fe0dc279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:54.195115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f8cd4-9dfa-44ef-a664-4069fe0dc279 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:54.198251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-812ca32d-2093-45b2-aac4-9766d2925764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c437ea28505426aaf3e85352215b11b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:54.199481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-812ca32d-2093-45b2-aac4-9766d2925764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c437ea28505426aaf3e85352215b11b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:54.210683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-812ca32d-2093-45b2-aac4-9766d2925764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c437ea28505426aaf3e85352215b11b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:54.227270 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3224/6389] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:53 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:54.227491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-812ca32d-2093-45b2-aac4-9766d2925764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c437ea28505426aaf3e85352215b11b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:54.232707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406323-cc24-4b8b-9948-673594b0bdec None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:54.233082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406323-cc24-4b8b-9948-673594b0bdec None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:54.233423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406323-cc24-4b8b-9948-673594b0bdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:54.255343 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3166/6390] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:53 2022] DELETE /identity/v3/users/0c437ea28505426aaf3e85352215b11b => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:54.257001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ca32d-2093-45b2-aac4-9766d2925764 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:54.261100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-812ca32d-2093-45b2-aac4-9766d2925764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:54.284242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8a406323-cc24-4b8b-9948-673594b0bdec None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:54.285552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8a406323-cc24-4b8b-9948-673594b0bdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:54.402977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ca32d-2093-45b2-aac4-9766d2925764 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:54.421752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2ee72-184c-4658-a823-c03d3ec5f17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:54.422412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2ee72-184c-4658-a823-c03d3ec5f17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:54.423349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2ee72-184c-4658-a823-c03d3ec5f17a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:54.423752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2ee72-184c-4658-a823-c03d3ec5f17a admin admin] PATH_INFO: `/v3/users/46652f090c1242dfb3ba532d61c46319` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:54.426255 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3225/6391] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:54.427243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a406323-cc24-4b8b-9948-673594b0bdec None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:54.427399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2ee72-184c-4658-a823-c03d3ec5f17a admin admin] RBAC: Authorizing `identity:delete_user(user_id=46652f090c1242dfb3ba532d61c46319)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:54.428875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8a406323-cc24-4b8b-9948-673594b0bdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:54.430414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2ee72-184c-4658-a823-c03d3ec5f17a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:54.447399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a406323-cc24-4b8b-9948-673594b0bdec None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:54.453439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4d8ad-9b3d-4aeb-9d14-5c35d4a56e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:54.454122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4d8ad-9b3d-4aeb-9d14-5c35d4a56e8c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:54.455118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4d8ad-9b3d-4aeb-9d14-5c35d4a56e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:54.455118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4d8ad-9b3d-4aeb-9d14-5c35d4a56e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:54.455820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4d8ad-9b3d-4aeb-9d14-5c35d4a56e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:54.458888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4d8ad-9b3d-4aeb-9d14-5c35d4a56e8c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:54.478704 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3226/6392] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:54.479534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4d8ad-9b3d-4aeb-9d14-5c35d4a56e8c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:54.481869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-95a4d8ad-9b3d-4aeb-9d14-5c35d4a56e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:54.551737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4d8ad-9b3d-4aeb-9d14-5c35d4a56e8c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:54.585031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c4d31-9aba-4307-9035-8b433f3ca944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:54.586309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c4d31-9aba-4307-9035-8b433f3ca944 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:54.586930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c4d31-9aba-4307-9035-8b433f3ca944 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:54.587364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c4d31-9aba-4307-9035-8b433f3ca944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:54.600515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c4d31-9aba-4307-9035-8b433f3ca944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:54.603526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c4d31-9aba-4307-9035-8b433f3ca944 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:54.619880 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3227/6393] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:54.621164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c4d31-9aba-4307-9035-8b433f3ca944 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:54.634151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c4d31-9aba-4307-9035-8b433f3ca944 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:54.639098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa26d3d-9a39-4f24-a26a-ee39a774e7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:54.640957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa26d3d-9a39-4f24-a26a-ee39a774e7d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:54.641821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa26d3d-9a39-4f24-a26a-ee39a774e7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:54.642403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa26d3d-9a39-4f24-a26a-ee39a774e7d9 admin admin] PATH_INFO: `/v3/projects/b1bf1a83f81d44beb5c682d456123ffd/users/31999f4afd514bfbbdfa8308445e3f18/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:54.680234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa26d3d-9a39-4f24-a26a-ee39a774e7d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1bf1a83f81d44beb5c682d456123ffd, user_id=31999f4afd514bfbbdfa8308445e3f18, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:54.684303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa26d3d-9a39-4f24-a26a-ee39a774e7d9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:54.704628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-baa2ee72-184c-4658-a823-c03d3ec5f17a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46652f090c1242dfb3ba532d61c46319'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:54.816322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-baa2ee72-184c-4658-a823-c03d3ec5f17a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46652f090c1242dfb3ba532d61c46319'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:54.820549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-baa2ee72-184c-4658-a823-c03d3ec5f17a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46652f090c1242dfb3ba532d61c46319'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:54.837741 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3228/6394] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:54 2022] PUT /identity/v3/projects/b1bf1a83f81d44beb5c682d456123ffd/users/31999f4afd514bfbbdfa8308445e3f18/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:54.854395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b981667-e910-4908-9752-f6c9d60ac005 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:54.855014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b981667-e910-4908-9752-f6c9d60ac005 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:54.855616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b981667-e910-4908-9752-f6c9d60ac005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:54.856762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-baa2ee72-184c-4658-a823-c03d3ec5f17a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46652f090c1242dfb3ba532d61c46319'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:54.895308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-baa2ee72-184c-4658-a823-c03d3ec5f17a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46652f090c1242dfb3ba532d61c46319'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:54.903307 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3167/6395] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:54 2022] DELETE /identity/v3/users/46652f090c1242dfb3ba532d61c46319 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:54.907918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dde28-a836-4fb7-8cad-8e0e32199812 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:54.908348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dde28-a836-4fb7-8cad-8e0e32199812 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:54.908633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dde28-a836-4fb7-8cad-8e0e32199812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:54.915819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4b981667-e910-4908-9752-f6c9d60ac005 None None] MFA Rules not processed for user `31999f4afd514bfbbdfa8308445e3f18`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:54.918168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4b981667-e910-4908-9752-f6c9d60ac005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:54.930050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9b9dde28-a836-4fb7-8cad-8e0e32199812 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:54.931395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9b9dde28-a836-4fb7-8cad-8e0e32199812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:54.937509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:55.013949 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3229/6396] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:55.014801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b981667-e910-4908-9752-f6c9d60ac005 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:55.015389 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3168/6397] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:55.017656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4b981667-e910-4908-9752-f6c9d60ac005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:55.034751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b981667-e910-4908-9752-f6c9d60ac005 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:55.042002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812cd5b-a262-475b-9a0f-bd1bc464bcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:55.042375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812cd5b-a262-475b-9a0f-bd1bc464bcb5 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:55.042728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812cd5b-a262-475b-9a0f-bd1bc464bcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:55.043446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812cd5b-a262-475b-9a0f-bd1bc464bcb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:55.044606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812cd5b-a262-475b-9a0f-bd1bc464bcb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:55.049339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812cd5b-a262-475b-9a0f-bd1bc464bcb5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:55.064912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dde28-a836-4fb7-8cad-8e0e32199812 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:55.066752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9b9dde28-a836-4fb7-8cad-8e0e32199812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:55.158133 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3230/6398] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:55 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:53:55.159947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812cd5b-a262-475b-9a0f-bd1bc464bcb5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:55.278707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dde28-a836-4fb7-8cad-8e0e32199812 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:55.335678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812cd5b-a262-475b-9a0f-bd1bc464bcb5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:55.341670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca496d-d654-4311-be6d-c4b9afeac832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:55.344360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca496d-d654-4311-be6d-c4b9afeac832 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:55.346042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca496d-d654-4311-be6d-c4b9afeac832 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:55.349606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca496d-d654-4311-be6d-c4b9afeac832 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:55.349606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca496d-d654-4311-be6d-c4b9afeac832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:55.351408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca496d-d654-4311-be6d-c4b9afeac832 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:55.375204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea65d42-6a41-40e2-aa2b-c7a44d563fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:55.376045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea65d42-6a41-40e2-aa2b-c7a44d563fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:55.376455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea65d42-6a41-40e2-aa2b-c7a44d563fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:55.376922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea65d42-6a41-40e2-aa2b-c7a44d563fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:55.387236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea65d42-6a41-40e2-aa2b-c7a44d563fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:55.389190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea65d42-6a41-40e2-aa2b-c7a44d563fa8 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:55.401414 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3169/6399] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:53:55.402619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea65d42-6a41-40e2-aa2b-c7a44d563fa8 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:55.404611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9ea65d42-6a41-40e2-aa2b-c7a44d563fa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:55.438900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea65d42-6a41-40e2-aa2b-c7a44d563fa8 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:55.447132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244f42f-691b-4add-800b-585a79cd224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:55.447132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244f42f-691b-4add-800b-585a79cd224f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:55.447132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244f42f-691b-4add-800b-585a79cd224f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:55.447132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244f42f-691b-4add-800b-585a79cd224f admin admin] PATH_INFO: `/v3/users/b62acf375a104203a66043c136fb1f99` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:55.449171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244f42f-691b-4add-800b-585a79cd224f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62acf375a104203a66043c136fb1f99)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:55.452041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244f42f-691b-4add-800b-585a79cd224f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:55.514318 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3231/6400] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:55 2022] POST /identity/v3/users => generated 299 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:55.514318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca496d-d654-4311-be6d-c4b9afeac832 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:55.519532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d0ca496d-d654-4311-be6d-c4b9afeac832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:55.558847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca496d-d654-4311-be6d-c4b9afeac832 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:55.581470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d243135-a93c-4658-9fb9-7496b79a93da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:55.582713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d243135-a93c-4658-9fb9-7496b79a93da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:55.586699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d243135-a93c-4658-9fb9-7496b79a93da admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:55.586699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d243135-a93c-4658-9fb9-7496b79a93da admin admin] PATH_INFO: `/v3/projects/c1dee3b9e552418e915c2b5154567bd5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:55.586699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d243135-a93c-4658-9fb9-7496b79a93da admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1dee3b9e552418e915c2b5154567bd5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:55.587685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d243135-a93c-4658-9fb9-7496b79a93da admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:55.688811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:55.800949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3244f42f-691b-4add-800b-585a79cd224f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62acf375a104203a66043c136fb1f99'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:55.805960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3d243135-a93c-4658-9fb9-7496b79a93da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1dee3b9e552418e915c2b5154567bd5', 'request_id': 'req-3d243135-a93c-4658-9fb9-7496b79a93da'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:55.812724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3d243135-a93c-4658-9fb9-7496b79a93da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1dee3b9e552418e915c2b5154567bd5', 'request_id': 'req-3d243135-a93c-4658-9fb9-7496b79a93da'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:55.911719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3244f42f-691b-4add-800b-585a79cd224f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62acf375a104203a66043c136fb1f99'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:55.912766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3244f42f-691b-4add-800b-585a79cd224f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62acf375a104203a66043c136fb1f99'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:55.921701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3244f42f-691b-4add-800b-585a79cd224f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62acf375a104203a66043c136fb1f99'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:55.937428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3244f42f-691b-4add-800b-585a79cd224f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62acf375a104203a66043c136fb1f99'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:55.949992 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3170/6401] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:53:55 2022] DELETE /identity/v3/users/b62acf375a104203a66043c136fb1f99 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:55.954983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244f42f-691b-4add-800b-585a79cd224f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:55.954983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3244f42f-691b-4add-800b-585a79cd224f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:56.019876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3d243135-a93c-4658-9fb9-7496b79a93da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1dee3b9e552418e915c2b5154567bd5', 'request_id': 'req-3d243135-a93c-4658-9fb9-7496b79a93da'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:56.036751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3d243135-a93c-4658-9fb9-7496b79a93da admin admin] The token cache is being invalidate because project c1dee3b9e552418e915c2b5154567bd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:56.036751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3d243135-a93c-4658-9fb9-7496b79a93da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:56.037417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3d243135-a93c-4658-9fb9-7496b79a93da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:56.039415 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3232/6402] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:55 2022] DELETE /identity/v3/projects/c1dee3b9e552418e915c2b5154567bd5 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:56.040242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d243135-a93c-4658-9fb9-7496b79a93da admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:56.043583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3d243135-a93c-4658-9fb9-7496b79a93da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:56.093651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244f42f-691b-4add-800b-585a79cd224f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:56.102892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3cec8-f687-4f08-b3c1-6cd58f0ef365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:56.103517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3cec8-f687-4f08-b3c1-6cd58f0ef365 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:56.103798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3cec8-f687-4f08-b3c1-6cd58f0ef365 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:56.104111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3cec8-f687-4f08-b3c1-6cd58f0ef365 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:56.105937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3cec8-f687-4f08-b3c1-6cd58f0ef365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:56.107698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3cec8-f687-4f08-b3c1-6cd58f0ef365 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:56.120392 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3171/6403] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:56.121334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3cec8-f687-4f08-b3c1-6cd58f0ef365 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:56.127980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-07f3cec8-f687-4f08-b3c1-6cd58f0ef365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:56.144287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3cec8-f687-4f08-b3c1-6cd58f0ef365 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:56.149606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cc692-3ad2-40b4-b61a-0add4cbe4e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:56.150248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cc692-3ad2-40b4-b61a-0add4cbe4e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:56.150532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cc692-3ad2-40b4-b61a-0add4cbe4e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:56.150809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cc692-3ad2-40b4-b61a-0add4cbe4e20 admin admin] PATH_INFO: `/v3/projects/208beca2a666410c8b645838eff45ad9` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:56.152010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cc692-3ad2-40b4-b61a-0add4cbe4e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=208beca2a666410c8b645838eff45ad9)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:56.154593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cc692-3ad2-40b4-b61a-0add4cbe4e20 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:56.161411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d243135-a93c-4658-9fb9-7496b79a93da admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:56.168789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:56.169640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:56.169988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:56.170344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e admin admin] PATH_INFO: `/v3/projects/71287c23978b448cb68dd2d6feaf7f9d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:56.172933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=71287c23978b448cb68dd2d6feaf7f9d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:56.176732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:56.341382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-576cc692-3ad2-40b4-b61a-0add4cbe4e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208beca2a666410c8b645838eff45ad9', 'request_id': 'req-576cc692-3ad2-40b4-b61a-0add4cbe4e20'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:56.352080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-576cc692-3ad2-40b4-b61a-0add4cbe4e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208beca2a666410c8b645838eff45ad9', 'request_id': 'req-576cc692-3ad2-40b4-b61a-0add4cbe4e20'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:56.359744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-576cc692-3ad2-40b4-b61a-0add4cbe4e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208beca2a666410c8b645838eff45ad9', 'request_id': 'req-576cc692-3ad2-40b4-b61a-0add4cbe4e20'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:56.409909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71287c23978b448cb68dd2d6feaf7f9d', 'request_id': 'req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:56.423573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71287c23978b448cb68dd2d6feaf7f9d', 'request_id': 'req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:56.526080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-576cc692-3ad2-40b4-b61a-0add4cbe4e20 admin admin] The token cache is being invalidate because project 208beca2a666410c8b645838eff45ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:56.526378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-576cc692-3ad2-40b4-b61a-0add4cbe4e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:56.528080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-576cc692-3ad2-40b4-b61a-0add4cbe4e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:56.530104 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3172/6404] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:56 2022] DELETE /identity/v3/projects/208beca2a666410c8b645838eff45ad9 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:56.531473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b6fff-e318-48e1-9aa1-f64287da68fb None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:56.531759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b6fff-e318-48e1-9aa1-f64287da68fb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:56.532086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b6fff-e318-48e1-9aa1-f64287da68fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:56.581335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9c7b6fff-e318-48e1-9aa1-f64287da68fb None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:56.582595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9c7b6fff-e318-48e1-9aa1-f64287da68fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:56.614509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71287c23978b448cb68dd2d6feaf7f9d', 'request_id': 'req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:56.633382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e admin admin] The token cache is being invalidate because project 71287c23978b448cb68dd2d6feaf7f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:56.634795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:56.635514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:56.638085 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3233/6405] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:56 2022] DELETE /identity/v3/projects/71287c23978b448cb68dd2d6feaf7f9d => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:56.639860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:56.642877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:56.740295 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3173/6406] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:56.747889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b6fff-e318-48e1-9aa1-f64287da68fb None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:56.749639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9c7b6fff-e318-48e1-9aa1-f64287da68fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:56.760861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60b04d-6ccb-4737-8cc0-ef77e7aa2d8e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:56.772228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979c570-2fd7-475f-bf08-c08fd035a487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:56.772228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979c570-2fd7-475f-bf08-c08fd035a487 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:56.772228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979c570-2fd7-475f-bf08-c08fd035a487 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:56.772228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979c570-2fd7-475f-bf08-c08fd035a487 admin admin] PATH_INFO: `/v3/projects/a0aa07fb3d2c4c5fa7ad80b160fea2b9/users/26a9f2f321e747b4840b470c1e72a8de/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:56.781019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b6fff-e318-48e1-9aa1-f64287da68fb None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:56.789971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a38bad-a954-4d6a-bebc-6533f37d212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:56.790758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a38bad-a954-4d6a-bebc-6533f37d212d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:56.791044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a38bad-a954-4d6a-bebc-6533f37d212d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:56.791318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a38bad-a954-4d6a-bebc-6533f37d212d admin admin] PATH_INFO: `/v3/projects/648e7927634f419f8e754f76bd8a0952` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:56.792740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a38bad-a954-4d6a-bebc-6533f37d212d admin admin] RBAC: Authorizing `identity:delete_project(project_id=648e7927634f419f8e754f76bd8a0952)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:56.794812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a38bad-a954-4d6a-bebc-6533f37d212d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:56.797013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979c570-2fd7-475f-bf08-c08fd035a487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0aa07fb3d2c4c5fa7ad80b160fea2b9, user_id=26a9f2f321e747b4840b470c1e72a8de, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:56.801720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979c570-2fd7-475f-bf08-c08fd035a487 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:56.953131 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3234/6407] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:56 2022] PUT /identity/v3/projects/a0aa07fb3d2c4c5fa7ad80b160fea2b9/users/26a9f2f321e747b4840b470c1e72a8de/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:56.954646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b52cd-a4d1-4aa8-970a-0ad2f4e3ee65 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:56.955013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b52cd-a4d1-4aa8-970a-0ad2f4e3ee65 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:56.955355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b52cd-a4d1-4aa8-970a-0ad2f4e3ee65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:56.988973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5c4b52cd-a4d1-4aa8-970a-0ad2f4e3ee65 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:56.990412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5c4b52cd-a4d1-4aa8-970a-0ad2f4e3ee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:57.041558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-70a38bad-a954-4d6a-bebc-6533f37d212d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '648e7927634f419f8e754f76bd8a0952', 'request_id': 'req-70a38bad-a954-4d6a-bebc-6533f37d212d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:57.054658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-70a38bad-a954-4d6a-bebc-6533f37d212d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '648e7927634f419f8e754f76bd8a0952', 'request_id': 'req-70a38bad-a954-4d6a-bebc-6533f37d212d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:57.061817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-70a38bad-a954-4d6a-bebc-6533f37d212d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '648e7927634f419f8e754f76bd8a0952', 'request_id': 'req-70a38bad-a954-4d6a-bebc-6533f37d212d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:57.075735 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3235/6408] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:57.077973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37eb9e-8a67-48a9-87ff-16c1f9a5a969 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:57.078261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37eb9e-8a67-48a9-87ff-16c1f9a5a969 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:57.078534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37eb9e-8a67-48a9-87ff-16c1f9a5a969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:57.121278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ee37eb9e-8a67-48a9-87ff-16c1f9a5a969 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:57.123983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ee37eb9e-8a67-48a9-87ff-16c1f9a5a969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:57.194314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-70a38bad-a954-4d6a-bebc-6533f37d212d admin admin] The token cache is being invalidate because project 648e7927634f419f8e754f76bd8a0952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:53:57.194713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-70a38bad-a954-4d6a-bebc-6533f37d212d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:57.195479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-70a38bad-a954-4d6a-bebc-6533f37d212d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:53:57.197159 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3174/6409] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:53:56 2022] DELETE /identity/v3/projects/648e7927634f419f8e754f76bd8a0952 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:57.198510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06ac73-4e5d-4b8f-961f-4e259e9124ce None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:57.202054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06ac73-4e5d-4b8f-961f-4e259e9124ce None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:57.202459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06ac73-4e5d-4b8f-961f-4e259e9124ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:57.237660 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3236/6410] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:57.249031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37eb9e-8a67-48a9-87ff-16c1f9a5a969 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:57.256713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ee37eb9e-8a67-48a9-87ff-16c1f9a5a969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:57.271754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ae06ac73-4e5d-4b8f-961f-4e259e9124ce None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:57.273466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ae06ac73-4e5d-4b8f-961f-4e259e9124ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:57.287894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37eb9e-8a67-48a9-87ff-16c1f9a5a969 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:57.301953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899893fa-a0ae-4b4e-ac01-b625e5d4102f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:57.302602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899893fa-a0ae-4b4e-ac01-b625e5d4102f admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:57.302880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899893fa-a0ae-4b4e-ac01-b625e5d4102f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:57.303152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899893fa-a0ae-4b4e-ac01-b625e5d4102f admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:57.303808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899893fa-a0ae-4b4e-ac01-b625e5d4102f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:57.305500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899893fa-a0ae-4b4e-ac01-b625e5d4102f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:57.309386 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3175/6411] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:57.310984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcfc3b-1b56-4dc2-912b-38fb4e3600c6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:57.311528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcfc3b-1b56-4dc2-912b-38fb4e3600c6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:57.312095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcfc3b-1b56-4dc2-912b-38fb4e3600c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:57.352120 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3237/6412] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:57.353346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-53bcfc3b-1b56-4dc2-912b-38fb4e3600c6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:57.353554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9193a6-1b5d-4e0d-a4ff-273088cbefe4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:57.353818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9193a6-1b5d-4e0d-a4ff-273088cbefe4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:57.354093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9193a6-1b5d-4e0d-a4ff-273088cbefe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:57.356875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-53bcfc3b-1b56-4dc2-912b-38fb4e3600c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:57.367220 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3176/6413] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:57.368137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcfc3b-1b56-4dc2-912b-38fb4e3600c6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:57.381338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcfc3b-1b56-4dc2-912b-38fb4e3600c6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:57.399703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f1b86-16c6-414d-b271-63b40fa90fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:57.403562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f1b86-16c6-414d-b271-63b40fa90fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:57.403562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f1b86-16c6-414d-b271-63b40fa90fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:57.403562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f1b86-16c6-414d-b271-63b40fa90fb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:57.403562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f1b86-16c6-414d-b271-63b40fa90fb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:53:57.403562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f1b86-16c6-414d-b271-63b40fa90fb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:57.404571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4b9193a6-1b5d-4e0d-a4ff-273088cbefe4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:57.405169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f1b86-16c6-414d-b271-63b40fa90fb5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:57.405281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4b9193a6-1b5d-4e0d-a4ff-273088cbefe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:57.427001 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3177/6414] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:53:57.427001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b6734-4d32-4968-a262-1390f447254f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:57.427001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b6734-4d32-4968-a262-1390f447254f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:57.427001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b6734-4d32-4968-a262-1390f447254f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:57.436524 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3238/6415] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:57.436524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9193a6-1b5d-4e0d-a4ff-273088cbefe4 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:57.449636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9193a6-1b5d-4e0d-a4ff-273088cbefe4 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:57.457824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fe605-0180-474f-ad5b-02ce896e9236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:57.459366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fe605-0180-474f-ad5b-02ce896e9236 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:57.459823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fe605-0180-474f-ad5b-02ce896e9236 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:57.460319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fe605-0180-474f-ad5b-02ce896e9236 admin admin] PATH_INFO: `/v3/projects/a0aa07fb3d2c4c5fa7ad80b160fea2b9/users/26a9f2f321e747b4840b470c1e72a8de/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:57.462916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fe605-0180-474f-ad5b-02ce896e9236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0aa07fb3d2c4c5fa7ad80b160fea2b9, user_id=26a9f2f321e747b4840b470c1e72a8de, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:57.463787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ad5b6734-4d32-4968-a262-1390f447254f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:57.466155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fe605-0180-474f-ad5b-02ce896e9236 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:57.466353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ad5b6734-4d32-4968-a262-1390f447254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:57.479627 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3178/6416] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:57.479627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b6734-4d32-4968-a262-1390f447254f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:57.487929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b6734-4d32-4968-a262-1390f447254f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:57.497342 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3239/6417] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:57 2022] PUT /identity/v3/projects/a0aa07fb3d2c4c5fa7ad80b160fea2b9/users/26a9f2f321e747b4840b470c1e72a8de/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:57.498506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fe605-0180-474f-ad5b-02ce896e9236 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:57.603155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba99c4-d637-4dab-aa10-80da9b709ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:57.604665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba99c4-d637-4dab-aa10-80da9b709ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:57.604954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba99c4-d637-4dab-aa10-80da9b709ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:57.606071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba99c4-d637-4dab-aa10-80da9b709ed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:57.606755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba99c4-d637-4dab-aa10-80da9b709ed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:53:57.607245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba99c4-d637-4dab-aa10-80da9b709ed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:57.609465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba99c4-d637-4dab-aa10-80da9b709ed4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:57.628294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fe605-0180-474f-ad5b-02ce896e9236 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:57.638322 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3179/6418] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:53:57.647946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03e510-a037-40b5-bc45-c5ed30c8d80a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:57.657416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03e510-a037-40b5-bc45-c5ed30c8d80a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:57.657416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03e510-a037-40b5-bc45-c5ed30c8d80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:57.657703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdbd40-d248-49c5-8bf0-d0ffde505906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:57.657703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdbd40-d248-49c5-8bf0-d0ffde505906 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:57.657703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdbd40-d248-49c5-8bf0-d0ffde505906 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:57.657703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdbd40-d248-49c5-8bf0-d0ffde505906 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:57.658107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdbd40-d248-49c5-8bf0-d0ffde505906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:57.659334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdbd40-d248-49c5-8bf0-d0ffde505906 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:57.678602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5e03e510-a037-40b5-bc45-c5ed30c8d80a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:57.679857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5e03e510-a037-40b5-bc45-c5ed30c8d80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:57.692974 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3180/6419] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:57.697595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03e510-a037-40b5-bc45-c5ed30c8d80a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:57.712402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03e510-a037-40b5-bc45-c5ed30c8d80a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:57.719612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8250a25-102b-4543-a8b1-38a1ccf47190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:57.720730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8250a25-102b-4543-a8b1-38a1ccf47190 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:57.721430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8250a25-102b-4543-a8b1-38a1ccf47190 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:57.731511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8250a25-102b-4543-a8b1-38a1ccf47190 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:57.731511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8250a25-102b-4543-a8b1-38a1ccf47190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:53:57.731511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8250a25-102b-4543-a8b1-38a1ccf47190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:57.731511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8250a25-102b-4543-a8b1-38a1ccf47190 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:57.744210 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3181/6420] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:53:57.745401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ef642-d7e8-4282-a8ae-19810d1f5814 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:57.745695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ef642-d7e8-4282-a8ae-19810d1f5814 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:57.745971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ef642-d7e8-4282-a8ae-19810d1f5814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:58.092280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f15ef642-d7e8-4282-a8ae-19810d1f5814 None None] MFA Rules not processed for user `26a9f2f321e747b4840b470c1e72a8de`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:53:58.092280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f15ef642-d7e8-4282-a8ae-19810d1f5814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:58.101343 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3240/6421] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:57 2022] POST /identity/v3/projects => generated 393 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:58.102089 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3182/6422] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:53:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:53:58.102089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ef642-d7e8-4282-a8ae-19810d1f5814 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:58.102397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdbd40-d248-49c5-8bf0-d0ffde505906 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:58.102922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ef642-d7e8-4282-a8ae-19810d1f5814 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:58.102922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3337f0-96ee-4e49-ab4c-8c65d963e9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:58.102922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3337f0-96ee-4e49-ab4c-8c65d963e9fc admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:58.102922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3337f0-96ee-4e49-ab4c-8c65d963e9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:58.103555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3337f0-96ee-4e49-ab4c-8c65d963e9fc admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:58.103555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3337f0-96ee-4e49-ab4c-8c65d963e9fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:53:58.103555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3337f0-96ee-4e49-ab4c-8c65d963e9fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:58.103555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3337f0-96ee-4e49-ab4c-8c65d963e9fc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:58.103555 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3183/6423] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:53:58.103555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3337f0-96ee-4e49-ab4c-8c65d963e9fc admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:58.103902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:58.103902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3337f0-96ee-4e49-ab4c-8c65d963e9fc admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:58.103902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f6856-6404-4d5d-8c53-5d89d7f31a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:58.103902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f6856-6404-4d5d-8c53-5d89d7f31a23 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:58.104178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f6856-6404-4d5d-8c53-5d89d7f31a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:58.104178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f6856-6404-4d5d-8c53-5d89d7f31a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:58.107506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f6856-6404-4d5d-8c53-5d89d7f31a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:58.107647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdbd40-d248-49c5-8bf0-d0ffde505906 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:58.112470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f6856-6404-4d5d-8c53-5d89d7f31a23 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:58.120609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78a987-aacc-45bf-8736-c593a425a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:58.121889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78a987-aacc-45bf-8736-c593a425a022 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:58.124343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78a987-aacc-45bf-8736-c593a425a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:58.124918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78a987-aacc-45bf-8736-c593a425a022 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:58.129770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78a987-aacc-45bf-8736-c593a425a022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:58.134580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78a987-aacc-45bf-8736-c593a425a022 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:58.372784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:58.434212 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3184/6424] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:58 2022] POST /identity/v3/projects => generated 357 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:58.436027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f6856-6404-4d5d-8c53-5d89d7f31a23 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:58.478301 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3241/6425] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:57 2022] POST /identity/v3/projects => generated 375 bytes in 613 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:58.480021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78a987-aacc-45bf-8736-c593a425a022 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:58.487645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2a78a987-aacc-45bf-8736-c593a425a022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:58.519867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f6856-6404-4d5d-8c53-5d89d7f31a23 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:58.636080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04c709-f579-434f-acf0-35bac279d128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:58.641950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04c709-f579-434f-acf0-35bac279d128 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:58.641950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04c709-f579-434f-acf0-35bac279d128 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:58.641950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04c709-f579-434f-acf0-35bac279d128 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:58.642253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78a987-aacc-45bf-8736-c593a425a022 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:58.642321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04c709-f579-434f-acf0-35bac279d128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:58.642321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04c709-f579-434f-acf0-35bac279d128 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:58.643314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d815be-a57d-4d7d-ac20-a430e2909137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:58.644039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d815be-a57d-4d7d-ac20-a430e2909137 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:58.644364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d815be-a57d-4d7d-ac20-a430e2909137 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:58.644644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d815be-a57d-4d7d-ac20-a430e2909137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:58.646994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-90d815be-a57d-4d7d-ac20-a430e2909137 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:53:58.743038 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3185/6426] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:58 2022] POST /identity/v3/users => generated 297 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:58.743937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04c709-f579-434f-acf0-35bac279d128 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:58.768924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d815be-a57d-4d7d-ac20-a430e2909137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:58.770730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d815be-a57d-4d7d-ac20-a430e2909137 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:58.775022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04c709-f579-434f-acf0-35bac279d128 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:58.789083 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3242/6427] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:53:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:53:58.789801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d815be-a57d-4d7d-ac20-a430e2909137 service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:58.804256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd129d-6471-441b-8ffc-6d576d9128b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:58.804591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd129d-6471-441b-8ffc-6d576d9128b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:58.804877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd129d-6471-441b-8ffc-6d576d9128b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:58.805156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd129d-6471-441b-8ffc-6d576d9128b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:58.805804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd129d-6471-441b-8ffc-6d576d9128b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:58.808616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd129d-6471-441b-8ffc-6d576d9128b0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:58.811610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d815be-a57d-4d7d-ac20-a430e2909137 service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:58.824647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61088ab-3237-4025-af76-44f41cc0f41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:58.825270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61088ab-3237-4025-af76-44f41cc0f41c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:58.825547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61088ab-3237-4025-af76-44f41cc0f41c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:58.825819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61088ab-3237-4025-af76-44f41cc0f41c admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:58.826454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61088ab-3237-4025-af76-44f41cc0f41c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:58.828405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61088ab-3237-4025-af76-44f41cc0f41c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:59.039177 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3243/6428] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:58 2022] POST /identity/v3/users => generated 279 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:59.039906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61088ab-3237-4025-af76-44f41cc0f41c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:59.044882 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3186/6429] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:53:58 2022] POST /identity/v3/projects => generated 381 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:59.045922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd129d-6471-441b-8ffc-6d576d9128b0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:59.063013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61088ab-3237-4025-af76-44f41cc0f41c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:59.180062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd129d-6471-441b-8ffc-6d576d9128b0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:59.190435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b12c7e-7246-4748-a631-fb6ff9488a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:59.191069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b12c7e-7246-4748-a631-fb6ff9488a0e admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:59.191347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b12c7e-7246-4748-a631-fb6ff9488a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:59.191614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b12c7e-7246-4748-a631-fb6ff9488a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:59.193039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b12c7e-7246-4748-a631-fb6ff9488a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:59.198135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b12c7e-7246-4748-a631-fb6ff9488a0e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:59.201531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b17ea2-6f8e-4b4d-b167-afc59d22ea5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:59.202625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b17ea2-6f8e-4b4d-b167-afc59d22ea5b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:59.203949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b17ea2-6f8e-4b4d-b167-afc59d22ea5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:59.204872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b17ea2-6f8e-4b4d-b167-afc59d22ea5b admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:59.207700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b17ea2-6f8e-4b4d-b167-afc59d22ea5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:59.211483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b17ea2-6f8e-4b4d-b167-afc59d22ea5b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:59.225284 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3187/6430] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:59.226441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b12c7e-7246-4748-a631-fb6ff9488a0e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:59.245813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b12c7e-7246-4748-a631-fb6ff9488a0e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:59.261070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d363756-4957-4296-aa8d-2def4c4aa00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:59.262007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d363756-4957-4296-aa8d-2def4c4aa00e admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:59.263538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d363756-4957-4296-aa8d-2def4c4aa00e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:59.264403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d363756-4957-4296-aa8d-2def4c4aa00e admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:59.265233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d363756-4957-4296-aa8d-2def4c4aa00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:59.269322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d363756-4957-4296-aa8d-2def4c4aa00e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:59.286215 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3188/6431] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:59.287740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d363756-4957-4296-aa8d-2def4c4aa00e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:59.303750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d363756-4957-4296-aa8d-2def4c4aa00e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:59.311346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7fbbc-a7f4-4916-9440-04d24d23ba17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:59.312097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7fbbc-a7f4-4916-9440-04d24d23ba17 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:59.314088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7fbbc-a7f4-4916-9440-04d24d23ba17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:59.314088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7fbbc-a7f4-4916-9440-04d24d23ba17 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:59.314377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7fbbc-a7f4-4916-9440-04d24d23ba17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:59.317142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7fbbc-a7f4-4916-9440-04d24d23ba17 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:59.379131 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3244/6432] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:59 2022] POST /identity/v3/users => generated 288 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:59.379131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b17ea2-6f8e-4b4d-b167-afc59d22ea5b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:59.409158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b17ea2-6f8e-4b4d-b167-afc59d22ea5b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:59.426690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120b657-59d6-449c-9e18-f37391928f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:59.427318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120b657-59d6-449c-9e18-f37391928f73 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:59.427600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120b657-59d6-449c-9e18-f37391928f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:59.427873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120b657-59d6-449c-9e18-f37391928f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:59.428641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120b657-59d6-449c-9e18-f37391928f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:59.430203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120b657-59d6-449c-9e18-f37391928f73 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:59.435311 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3189/6433] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:53:59 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:53:59.435311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7fbbc-a7f4-4916-9440-04d24d23ba17 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:59.456712 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3245/6434] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:59.456712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120b657-59d6-449c-9e18-f37391928f73 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:59.461163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7fbbc-a7f4-4916-9440-04d24d23ba17 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:59.478823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2096ea8-3c70-4bac-964e-1883d8ca04a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:59.479458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2096ea8-3c70-4bac-964e-1883d8ca04a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:59.479777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2096ea8-3c70-4bac-964e-1883d8ca04a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:59.481209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2096ea8-3c70-4bac-964e-1883d8ca04a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:59.481209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2096ea8-3c70-4bac-964e-1883d8ca04a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:59.485684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2096ea8-3c70-4bac-964e-1883d8ca04a4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:59.490242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120b657-59d6-449c-9e18-f37391928f73 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:59.499352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97432da-c436-4c7f-8534-c31690594f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:59.499982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97432da-c436-4c7f-8534-c31690594f0c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:59.500286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97432da-c436-4c7f-8534-c31690594f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:59.500648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97432da-c436-4c7f-8534-c31690594f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:59.502217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97432da-c436-4c7f-8534-c31690594f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:59.503913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97432da-c436-4c7f-8534-c31690594f0c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:59.526066 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3190/6435] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:59.528290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2096ea8-3c70-4bac-964e-1883d8ca04a4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:59.532834 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3246/6436] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:59.534213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97432da-c436-4c7f-8534-c31690594f0c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:59.566020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97432da-c436-4c7f-8534-c31690594f0c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:59.568170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2096ea8-3c70-4bac-964e-1883d8ca04a4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:59.574072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1008b-e674-4302-97bc-542128814c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:59.575103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1008b-e674-4302-97bc-542128814c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:59.575526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1008b-e674-4302-97bc-542128814c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:59.575928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1008b-e674-4302-97bc-542128814c80 admin admin] PATH_INFO: `/v3/projects/368a4a4fbf784890af363b96d98bc1fd/users/30fa3b70482848da87653efbb15c83b5/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:59.585238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94beff8-85cc-410f-aa17-f23a9adba74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:59.585872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94beff8-85cc-410f-aa17-f23a9adba74c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:59.586157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94beff8-85cc-410f-aa17-f23a9adba74c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:59.586437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94beff8-85cc-410f-aa17-f23a9adba74c admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:59.587085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94beff8-85cc-410f-aa17-f23a9adba74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:59.588756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94beff8-85cc-410f-aa17-f23a9adba74c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:59.602788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1008b-e674-4302-97bc-542128814c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=368a4a4fbf784890af363b96d98bc1fd, user_id=30fa3b70482848da87653efbb15c83b5, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:59.613171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1008b-e674-4302-97bc-542128814c80 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:59.623346 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3191/6437] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:53:59.624246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94beff8-85cc-410f-aa17-f23a9adba74c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:59.653412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94beff8-85cc-410f-aa17-f23a9adba74c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:53:59.667414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45471a-1ccd-4cfa-8732-1e1e73f13d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:53:59.668120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45471a-1ccd-4cfa-8732-1e1e73f13d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:53:59.668437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45471a-1ccd-4cfa-8732-1e1e73f13d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:53:59.668713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45471a-1ccd-4cfa-8732-1e1e73f13d54 admin admin] PATH_INFO: `/v3/projects/30ae0882890a42f78d89c19a49596462/users/e6aa4028084e46deb24ec65014ba93a9/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:53:59.702283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45471a-1ccd-4cfa-8732-1e1e73f13d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ae0882890a42f78d89c19a49596462, user_id=e6aa4028084e46deb24ec65014ba93a9, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:53:59.706215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45471a-1ccd-4cfa-8732-1e1e73f13d54 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:53:59.777055 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3247/6438] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:59 2022] PUT /identity/v3/projects/368a4a4fbf784890af363b96d98bc1fd/users/30fa3b70482848da87653efbb15c83b5/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:59.778709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1008b-e674-4302-97bc-542128814c80 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:59.818532 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3192/6439] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:53:59 2022] PUT /identity/v3/projects/30ae0882890a42f78d89c19a49596462/users/e6aa4028084e46deb24ec65014ba93a9/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:53:59.830054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45471a-1ccd-4cfa-8732-1e1e73f13d54 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:53:59.933006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:53:59.950973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1008b-e674-4302-97bc-542128814c80 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:00.021856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45471a-1ccd-4cfa-8732-1e1e73f13d54 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:00.036561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7937b-23a5-44fc-b6c5-18aee9134363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:00.037191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7937b-23a5-44fc-b6c5-18aee9134363 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:00.037474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7937b-23a5-44fc-b6c5-18aee9134363 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:00.037917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7937b-23a5-44fc-b6c5-18aee9134363 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:00.048243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7937b-23a5-44fc-b6c5-18aee9134363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:00.048243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7937b-23a5-44fc-b6c5-18aee9134363 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:00.065809 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3193/6440] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:00.067293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4bcd-b3cf-4d7f-9e3b-cf214078c58e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:00.067678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4bcd-b3cf-4d7f-9e3b-cf214078c58e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:00.067836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4bcd-b3cf-4d7f-9e3b-cf214078c58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:00.110504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f06207-a30c-4aa6-8986-9f2a4eee8016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:00.116640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f06207-a30c-4aa6-8986-9f2a4eee8016 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:00.117016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f06207-a30c-4aa6-8986-9f2a4eee8016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:00.117382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f06207-a30c-4aa6-8986-9f2a4eee8016 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:00.118807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f06207-a30c-4aa6-8986-9f2a4eee8016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:00.119018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8e6a4bcd-b3cf-4d7f-9e3b-cf214078c58e None None] MFA Rules not processed for user `30fa3b70482848da87653efbb15c83b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:00.120444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8e6a4bcd-b3cf-4d7f-9e3b-cf214078c58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:00.120810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f06207-a30c-4aa6-8986-9f2a4eee8016 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:00.141833 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3248/6441] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:00.143526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cc6a8-074f-4a8c-8a9d-cc3d53dfa9ff None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:00.143988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cc6a8-074f-4a8c-8a9d-cc3d53dfa9ff None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:00.144419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cc6a8-074f-4a8c-8a9d-cc3d53dfa9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:00.186575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9b4cc6a8-074f-4a8c-8a9d-cc3d53dfa9ff None None] MFA Rules not processed for user `e6aa4028084e46deb24ec65014ba93a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:00.189053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9b4cc6a8-074f-4a8c-8a9d-cc3d53dfa9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:00.242045 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3194/6442] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:00.243696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a4bcd-b3cf-4d7f-9e3b-cf214078c58e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:00.258149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a4bcd-b3cf-4d7f-9e3b-cf214078c58e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:00.263331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632b1a1-d4f3-4f71-aabd-37b3601c59ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:00.268578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632b1a1-d4f3-4f71-aabd-37b3601c59ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:00.269650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632b1a1-d4f3-4f71-aabd-37b3601c59ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:00.270078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632b1a1-d4f3-4f71-aabd-37b3601c59ef admin admin] PATH_INFO: `/v3/projects/e2af233d394f49f694e77156f7f13e69/users/ab105c4505374ce0b34372797e8ae240/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:00.299529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632b1a1-d4f3-4f71-aabd-37b3601c59ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2af233d394f49f694e77156f7f13e69, user_id=ab105c4505374ce0b34372797e8ae240, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:00.303718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632b1a1-d4f3-4f71-aabd-37b3601c59ef admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:00.328340 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3249/6443] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:00.329822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cc6a8-074f-4a8c-8a9d-cc3d53dfa9ff None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:00.343894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cc6a8-074f-4a8c-8a9d-cc3d53dfa9ff None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:00.350906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c24f59-6dff-4f1e-a3d6-0d6560ea9e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:00.351742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c24f59-6dff-4f1e-a3d6-0d6560ea9e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:00.352101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c24f59-6dff-4f1e-a3d6-0d6560ea9e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:00.352607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c24f59-6dff-4f1e-a3d6-0d6560ea9e5e admin admin] PATH_INFO: `/v3/projects/194c36c3d7c644999a4f379222945931/users/eafb092d248c4bd1b00a1e3db19473c2/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:00.376700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c24f59-6dff-4f1e-a3d6-0d6560ea9e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=194c36c3d7c644999a4f379222945931, user_id=eafb092d248c4bd1b00a1e3db19473c2, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:00.379793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c24f59-6dff-4f1e-a3d6-0d6560ea9e5e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:00.481382 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3250/6444] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:00 2022] PUT /identity/v3/projects/194c36c3d7c644999a4f379222945931/users/eafb092d248c4bd1b00a1e3db19473c2/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:00.481566 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3195/6445] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:00 2022] PUT /identity/v3/projects/e2af233d394f49f694e77156f7f13e69/users/ab105c4505374ce0b34372797e8ae240/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:00.481566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632b1a1-d4f3-4f71-aabd-37b3601c59ef admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:00.481724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c24f59-6dff-4f1e-a3d6-0d6560ea9e5e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:00.546583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:00.609222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c24f59-6dff-4f1e-a3d6-0d6560ea9e5e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:00.623818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a1e05-8738-41d1-a621-9258ab961200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:00.626884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1e05-8738-41d1-a621-9258ab961200 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:00.627238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1e05-8738-41d1-a621-9258ab961200 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:00.627554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1e05-8738-41d1-a621-9258ab961200 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:00.629401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a1e05-8738-41d1-a621-9258ab961200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:00.630652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632b1a1-d4f3-4f71-aabd-37b3601c59ef admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:00.640335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a1e05-8738-41d1-a621-9258ab961200 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:00.646769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1bb93-cef2-46d7-ab3a-7e4f096ed12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:00.647411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1bb93-cef2-46d7-ab3a-7e4f096ed12a admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:00.647696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1bb93-cef2-46d7-ab3a-7e4f096ed12a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:00.648029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1bb93-cef2-46d7-ab3a-7e4f096ed12a admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:00.649492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1bb93-cef2-46d7-ab3a-7e4f096ed12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:00.651925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1bb93-cef2-46d7-ab3a-7e4f096ed12a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:00.817508 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3251/6446] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:00 2022] POST /identity/v3/projects => generated 397 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:00.817600 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3196/6447] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:00 2022] POST /identity/v3/projects => generated 355 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:00.817600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1acb7-1152-47e8-a342-922ded57414d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:00.817600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1acb7-1152-47e8-a342-922ded57414d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:00.817600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1acb7-1152-47e8-a342-922ded57414d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:00.817805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974758f-32e4-4c86-a494-886e4b789b3c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:00.817805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974758f-32e4-4c86-a494-886e4b789b3c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:00.817805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974758f-32e4-4c86-a494-886e4b789b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:00.886766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f974758f-32e4-4c86-a494-886e4b789b3c None None] MFA Rules not processed for user `ab105c4505374ce0b34372797e8ae240`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:00.888135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f974758f-32e4-4c86-a494-886e4b789b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:00.908448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c6f1acb7-1152-47e8-a342-922ded57414d None None] MFA Rules not processed for user `eafb092d248c4bd1b00a1e3db19473c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:00.910941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c6f1acb7-1152-47e8-a342-922ded57414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:01.080706 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3252/6448] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:01.081910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974758f-32e4-4c86-a494-886e4b789b3c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:01.174123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974758f-32e4-4c86-a494-886e4b789b3c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:01.177976 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3197/6449] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:01.179023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1acb7-1152-47e8-a342-922ded57414d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:01.182985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce7468-9d84-4d8d-b3fc-e82175730350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:01.183811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce7468-9d84-4d8d-b3fc-e82175730350 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:01.184462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce7468-9d84-4d8d-b3fc-e82175730350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:01.184905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce7468-9d84-4d8d-b3fc-e82175730350 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:01.186126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce7468-9d84-4d8d-b3fc-e82175730350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:01.189640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce7468-9d84-4d8d-b3fc-e82175730350 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:01.215899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1acb7-1152-47e8-a342-922ded57414d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:01.231331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5decdf0-9bd6-4f76-98c1-270accc8114f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:01.237016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5decdf0-9bd6-4f76-98c1-270accc8114f admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:01.237813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5decdf0-9bd6-4f76-98c1-270accc8114f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:01.242072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5decdf0-9bd6-4f76-98c1-270accc8114f admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:01.245226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5decdf0-9bd6-4f76-98c1-270accc8114f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:01.251252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5decdf0-9bd6-4f76-98c1-270accc8114f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:01.348037 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3253/6450] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:01 2022] POST /identity/v3/users => generated 305 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:01.349480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce7468-9d84-4d8d-b3fc-e82175730350 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:01.352961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-38ce7468-9d84-4d8d-b3fc-e82175730350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:01.388601 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3198/6451] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:01 2022] POST /identity/v3/users => generated 284 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:01.397634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5decdf0-9bd6-4f76-98c1-270accc8114f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:01.410024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e5decdf0-9bd6-4f76-98c1-270accc8114f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:01.481296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:01.495364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:01.554531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce7468-9d84-4d8d-b3fc-e82175730350 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:01.574564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911f5cf-179b-403d-8714-d4dbf3696360 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:01.575383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911f5cf-179b-403d-8714-d4dbf3696360 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:01.575661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911f5cf-179b-403d-8714-d4dbf3696360 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:01.575936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911f5cf-179b-403d-8714-d4dbf3696360 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:01.597535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911f5cf-179b-403d-8714-d4dbf3696360 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:01.599186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911f5cf-179b-403d-8714-d4dbf3696360 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:01.600276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5decdf0-9bd6-4f76-98c1-270accc8114f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:01.611640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01356d8-65bf-40b1-b0ae-e4534825ee61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:01.612690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01356d8-65bf-40b1-b0ae-e4534825ee61 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:01.614618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01356d8-65bf-40b1-b0ae-e4534825ee61 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:01.614895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01356d8-65bf-40b1-b0ae-e4534825ee61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:01.621276 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3254/6452] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:01.622198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911f5cf-179b-403d-8714-d4dbf3696360 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:01.634607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01356d8-65bf-40b1-b0ae-e4534825ee61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:01.636349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01356d8-65bf-40b1-b0ae-e4534825ee61 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:01.649076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911f5cf-179b-403d-8714-d4dbf3696360 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:01.658074 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3199/6453] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:01.659231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01356d8-65bf-40b1-b0ae-e4534825ee61 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:01.660313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c62b44-3e3f-4d18-9d8a-d84254c1c802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:01.660947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c62b44-3e3f-4d18-9d8a-d84254c1c802 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:01.661299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c62b44-3e3f-4d18-9d8a-d84254c1c802 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:01.661571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c62b44-3e3f-4d18-9d8a-d84254c1c802 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:01.662218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c62b44-3e3f-4d18-9d8a-d84254c1c802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:01.663929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c62b44-3e3f-4d18-9d8a-d84254c1c802 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:01.677787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01356d8-65bf-40b1-b0ae-e4534825ee61 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:01.691999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbe24e-b2ad-4536-a8b9-8ae4e195c8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:01.693011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbe24e-b2ad-4536-a8b9-8ae4e195c8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:01.693292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbe24e-b2ad-4536-a8b9-8ae4e195c8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:01.693565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbe24e-b2ad-4536-a8b9-8ae4e195c8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:01.694316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbe24e-b2ad-4536-a8b9-8ae4e195c8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:01.696060 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3255/6454] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:01.696992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c62b44-3e3f-4d18-9d8a-d84254c1c802 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:01.700073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbe24e-b2ad-4536-a8b9-8ae4e195c8f1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:01.741181 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3200/6455] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:01.744741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbe24e-b2ad-4536-a8b9-8ae4e195c8f1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:01.761980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbe24e-b2ad-4536-a8b9-8ae4e195c8f1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:01.769090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860caf6-5740-40eb-8b84-5f397cbdc5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:01.769941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860caf6-5740-40eb-8b84-5f397cbdc5bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:01.770456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860caf6-5740-40eb-8b84-5f397cbdc5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:01.771084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860caf6-5740-40eb-8b84-5f397cbdc5bc admin admin] PATH_INFO: `/v3/projects/2254ac9cd1284cb382da08873ef08a44/users/56852953a9b648b6905232bd30ad32eb/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:01.803454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860caf6-5740-40eb-8b84-5f397cbdc5bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2254ac9cd1284cb382da08873ef08a44, user_id=56852953a9b648b6905232bd30ad32eb, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:01.809606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860caf6-5740-40eb-8b84-5f397cbdc5bc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:01.846857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c62b44-3e3f-4d18-9d8a-d84254c1c802 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:01.852849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe1a94-0107-4edb-9d8b-192cc732fb2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:01.853756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe1a94-0107-4edb-9d8b-192cc732fb2d service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:01.855493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe1a94-0107-4edb-9d8b-192cc732fb2d service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:01.855493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe1a94-0107-4edb-9d8b-192cc732fb2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:01.863939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2bfe1a94-0107-4edb-9d8b-192cc732fb2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:01.896787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe1a94-0107-4edb-9d8b-192cc732fb2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:01.904078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe1a94-0107-4edb-9d8b-192cc732fb2d service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:01.926995 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3201/6456] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:01 2022] PUT /identity/v3/projects/2254ac9cd1284cb382da08873ef08a44/users/56852953a9b648b6905232bd30ad32eb/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:01.933668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860caf6-5740-40eb-8b84-5f397cbdc5bc admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:01.989989 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3256/6457] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:01.991427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe1a94-0107-4edb-9d8b-192cc732fb2d service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:02.036246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe1a94-0107-4edb-9d8b-192cc732fb2d service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:02.180095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8f72b-faa5-4558-b2b0-4ecdd65f8339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:02.184350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8f72b-faa5-4558-b2b0-4ecdd65f8339 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:02.184658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8f72b-faa5-4558-b2b0-4ecdd65f8339 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:02.184917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8f72b-faa5-4558-b2b0-4ecdd65f8339 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:02.185596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8f72b-faa5-4558-b2b0-4ecdd65f8339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:02.191946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8f72b-faa5-4558-b2b0-4ecdd65f8339 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:02.227488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860caf6-5740-40eb-8b84-5f397cbdc5bc admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:02.249120 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3257/6458] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:02.249253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c92f2b-a53c-4265-a246-a05b5d7eda88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:02.251069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c92f2b-a53c-4265-a246-a05b5d7eda88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:02.253479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c92f2b-a53c-4265-a246-a05b5d7eda88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:02.253772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c92f2b-a53c-4265-a246-a05b5d7eda88 admin admin] PATH_INFO: `/v3/projects/c0821527f6e5454a972c128199c57182/users/21775bd2fdc041c0914b860f7aa519ea/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:02.255655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8f72b-faa5-4558-b2b0-4ecdd65f8339 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:02.294640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c92f2b-a53c-4265-a246-a05b5d7eda88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0821527f6e5454a972c128199c57182, user_id=21775bd2fdc041c0914b860f7aa519ea, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:02.297230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8f72b-faa5-4558-b2b0-4ecdd65f8339 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:02.299471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c92f2b-a53c-4265-a246-a05b5d7eda88 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:02.317101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74bb06-503b-4903-b5d3-677d5879a851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:02.317101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74bb06-503b-4903-b5d3-677d5879a851 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:02.317101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74bb06-503b-4903-b5d3-677d5879a851 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:02.317101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74bb06-503b-4903-b5d3-677d5879a851 admin admin] PATH_INFO: `/v3/projects/2254ac9cd1284cb382da08873ef08a44/users/56852953a9b648b6905232bd30ad32eb/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:02.317422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74bb06-503b-4903-b5d3-677d5879a851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2254ac9cd1284cb382da08873ef08a44, user_id=56852953a9b648b6905232bd30ad32eb, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:02.320773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74bb06-503b-4903-b5d3-677d5879a851 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:02.350869 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3258/6459] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:02 2022] PUT /identity/v3/projects/2254ac9cd1284cb382da08873ef08a44/users/56852953a9b648b6905232bd30ad32eb/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:02.363262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6bf83-df64-4104-9add-5acf0611ec1c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:02.363601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6bf83-df64-4104-9add-5acf0611ec1c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:02.363884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6bf83-df64-4104-9add-5acf0611ec1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:02.423949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4aa6bf83-df64-4104-9add-5acf0611ec1c None None] MFA Rules not processed for user `56852953a9b648b6905232bd30ad32eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:02.425469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4aa6bf83-df64-4104-9add-5acf0611ec1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:02.429516 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3202/6460] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:01 2022] PUT /identity/v3/projects/c0821527f6e5454a972c128199c57182/users/21775bd2fdc041c0914b860f7aa519ea/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:02.430555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c92f2b-a53c-4265-a246-a05b5d7eda88 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:02.612618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c92f2b-a53c-4265-a246-a05b5d7eda88 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:02.621421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734618fb-0247-443a-9c69-6e88cae97b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:02.622782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734618fb-0247-443a-9c69-6e88cae97b05 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:02.623433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734618fb-0247-443a-9c69-6e88cae97b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:02.624098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734618fb-0247-443a-9c69-6e88cae97b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:02.625947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734618fb-0247-443a-9c69-6e88cae97b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:02.630257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734618fb-0247-443a-9c69-6e88cae97b05 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:02.651342 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3203/6461] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:02.657617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734618fb-0247-443a-9c69-6e88cae97b05 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:02.672309 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3259/6462] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:02 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:54:02.679491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6bf83-df64-4104-9add-5acf0611ec1c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:02.690829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734618fb-0247-443a-9c69-6e88cae97b05 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:02.702371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b242d-aefc-4d88-98a3-e0308b96b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:02.703221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b242d-aefc-4d88-98a3-e0308b96b5d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:02.705186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b242d-aefc-4d88-98a3-e0308b96b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:02.705186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b242d-aefc-4d88-98a3-e0308b96b5d2 admin admin] PATH_INFO: `/v3/projects/c0821527f6e5454a972c128199c57182/users/21775bd2fdc041c0914b860f7aa519ea/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:02.709186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b242d-aefc-4d88-98a3-e0308b96b5d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0821527f6e5454a972c128199c57182, user_id=21775bd2fdc041c0914b860f7aa519ea, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:02.715478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b242d-aefc-4d88-98a3-e0308b96b5d2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:02.743529 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3204/6463] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:02 2022] PUT /identity/v3/projects/c0821527f6e5454a972c128199c57182/users/21775bd2fdc041c0914b860f7aa519ea/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:02.756361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c638cf-72e1-4e87-bafb-bd1d91687c61 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:02.756868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c638cf-72e1-4e87-bafb-bd1d91687c61 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:02.757329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c638cf-72e1-4e87-bafb-bd1d91687c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:02.783219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:02.850749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-26c638cf-72e1-4e87-bafb-bd1d91687c61 None None] MFA Rules not processed for user `21775bd2fdc041c0914b860f7aa519ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:02.853431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-26c638cf-72e1-4e87-bafb-bd1d91687c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:02.854052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6bf83-df64-4104-9add-5acf0611ec1c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:03.014581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d004f46-56cd-4f5e-b2d9-c0e5e6b99f8e tempest-ProjectsNegativeStaticTestJSON-26295050 tempest-ProjectsNegativeStaticTestJSON-26295050-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30fa3b70482848da87653efbb15c83b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368a4a4fbf784890af363b96d98bc1fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:03.017507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d004f46-56cd-4f5e-b2d9-c0e5e6b99f8e tempest-ProjectsNegativeStaticTestJSON-26295050 tempest-ProjectsNegativeStaticTestJSON-26295050-project] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:03.022716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d004f46-56cd-4f5e-b2d9-c0e5e6b99f8e tempest-ProjectsNegativeStaticTestJSON-26295050 tempest-ProjectsNegativeStaticTestJSON-26295050-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:03.025037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d004f46-56cd-4f5e-b2d9-c0e5e6b99f8e tempest-ProjectsNegativeStaticTestJSON-26295050 tempest-ProjectsNegativeStaticTestJSON-26295050-project] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:03.026258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d004f46-56cd-4f5e-b2d9-c0e5e6b99f8e tempest-ProjectsNegativeStaticTestJSON-26295050 tempest-ProjectsNegativeStaticTestJSON-26295050-project] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:03.049886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-7d004f46-56cd-4f5e-b2d9-c0e5e6b99f8e tempest-ProjectsNegativeStaticTestJSON-26295050 tempest-ProjectsNegativeStaticTestJSON-26295050-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 27 04:54:03.049886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:03.049886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:54:03.049886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:54:03.049886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:54:03.049886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:54:03.049886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:54:03.049886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:54:03.049886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:54:03.049886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:54:03.049886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:54:03.049886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:54:03.049886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Aug 27 04:54:03.049886 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 27 04:54:03.051855 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 27 04:54:03.051855 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 27 04:54:03.051855 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 27 04:54:03.051855 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 27 04:54:03.051855 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:54:03.051855 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 27 04:54:03.051855 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 27 04:54:03.051855 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:03.073256 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3260/6464] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:54:02 2022] POST /identity/v3/projects => generated 136 bytes in 384 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:54:03.073256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d004f46-56cd-4f5e-b2d9-c0e5e6b99f8e tempest-ProjectsNegativeStaticTestJSON-26295050 tempest-ProjectsNegativeStaticTestJSON-26295050-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:03.103065 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3205/6465] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:03.106748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c638cf-72e1-4e87-bafb-bd1d91687c61 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:03.155972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c638cf-72e1-4e87-bafb-bd1d91687c61 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:03.182264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28442b-e410-4fb0-b9f3-a73f7bdcc723 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21775bd2fdc041c0914b860f7aa519ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0821527f6e5454a972c128199c57182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:03.183762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28442b-e410-4fb0-b9f3-a73f7bdcc723 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:03.184251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28442b-e410-4fb0-b9f3-a73f7bdcc723 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:03.202738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28442b-e410-4fb0-b9f3-a73f7bdcc723 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:03.206738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28442b-e410-4fb0-b9f3-a73f7bdcc723 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:03.207294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28442b-e410-4fb0-b9f3-a73f7bdcc723 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:03.215660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28442b-e410-4fb0-b9f3-a73f7bdcc723 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:03.254177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d004f46-56cd-4f5e-b2d9-c0e5e6b99f8e tempest-ProjectsNegativeStaticTestJSON-26295050 tempest-ProjectsNegativeStaticTestJSON-26295050-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:03.262765 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3206/6466] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:03.269427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28442b-e410-4fb0-b9f3-a73f7bdcc723 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:03.276089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e9594-a684-4770-ae84-ec9ef21f7305 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56852953a9b648b6905232bd30ad32eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2254ac9cd1284cb382da08873ef08a44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:03.276956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e9594-a684-4770-ae84-ec9ef21f7305 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:03.277253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e9594-a684-4770-ae84-ec9ef21f7305 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:03.277803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e9594-a684-4770-ae84-ec9ef21f7305 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:03.278449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e9594-a684-4770-ae84-ec9ef21f7305 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:03.288011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e9594-a684-4770-ae84-ec9ef21f7305 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:03.290958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28442b-e410-4fb0-b9f3-a73f7bdcc723 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:03.299770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155fb12-9ab5-4c60-b2f3-26cc05b164e1 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21775bd2fdc041c0914b860f7aa519ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0821527f6e5454a972c128199c57182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-eb7e9594-a684-4770-ae84-ec9ef21f7305 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Invalid input for field 'name': '' is too short Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: Failed validating 'minLength' in schema['properties']['name']: Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: On instance['name']: Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: Failed validating 'minLength' in schema['properties']['name']: Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: On instance['name']: Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: '' Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise error Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application On instance['name']: Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application '' Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:03.300805 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:54:03.303312 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:03.303312 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:03.303312 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:54:03.303312 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:54:03.303312 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:54:03.303312 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:54:03.303312 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:54:03.303312 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:54:03.303312 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:54:03.303312 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:54:03.303312 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:54:03.303312 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:54:03.303312 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 27 04:54:03.303312 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 27 04:54:03.303312 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 27 04:54:03.303312 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 27 04:54:03.303312 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 27 04:54:03.305051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 27 04:54:03.305051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 27 04:54:03.305051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:03.305051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 27 04:54:03.305051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 27 04:54:03.305051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:03.305051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application On instance['name']: Aug 27 04:54:03.305051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application '' Aug 27 04:54:03.305051 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:03.306705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155fb12-9ab5-4c60-b2f3-26cc05b164e1 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:03.307472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155fb12-9ab5-4c60-b2f3-26cc05b164e1 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:03.309654 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3261/6467] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:54:03 2022] POST /identity/v3/projects => generated 283 bytes in 246 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:54:03.316412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155fb12-9ab5-4c60-b2f3-26cc05b164e1 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:03.318213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e9594-a684-4770-ae84-ec9ef21f7305 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:03.331308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155fb12-9ab5-4c60-b2f3-26cc05b164e1 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:03.340315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155fb12-9ab5-4c60-b2f3-26cc05b164e1 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:03.356098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:03.370511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e9594-a684-4770-ae84-ec9ef21f7305 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:03.406092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b785745-625f-4b9c-a08c-914edfd6dfb0 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56852953a9b648b6905232bd30ad32eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2254ac9cd1284cb382da08873ef08a44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:03.406936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b785745-625f-4b9c-a08c-914edfd6dfb0 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:03.408196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b785745-625f-4b9c-a08c-914edfd6dfb0 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:03.408693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b785745-625f-4b9c-a08c-914edfd6dfb0 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:03.410652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b785745-625f-4b9c-a08c-914edfd6dfb0 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:03.419290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b785745-625f-4b9c-a08c-914edfd6dfb0 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-6b785745-625f-4b9c-a08c-914edfd6dfb0 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: Failed validating 'maxLength' in schema['properties']['name']: Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: On instance['name']: Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: Failed validating 'maxLength' in schema['properties']['name']: Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: On instance['name']: Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise error Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 27 04:54:03.449714 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application On instance['name']: Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:54:03.450763 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 27 04:54:03.451585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 27 04:54:03.451585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 27 04:54:03.451585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 27 04:54:03.451585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 27 04:54:03.451585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 27 04:54:03.451585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 04:54:03.451585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:03.451585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 27 04:54:03.451585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 27 04:54:03.451585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:03.451585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application On instance['name']: Aug 27 04:54:03.451585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 04:54:03.451585 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:03.460253 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3262/6468] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:54:03 2022] POST /identity/v3/projects => generated 412 bytes in 145 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 04:54:03.461243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b785745-625f-4b9c-a08c-914edfd6dfb0 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:03.474235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b785745-625f-4b9c-a08c-914edfd6dfb0 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:03.490909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97c42f-8fb1-477a-89ef-e80e98e43b60 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56852953a9b648b6905232bd30ad32eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2254ac9cd1284cb382da08873ef08a44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:03.491677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97c42f-8fb1-477a-89ef-e80e98e43b60 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:03.491967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97c42f-8fb1-477a-89ef-e80e98e43b60 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:03.492275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97c42f-8fb1-477a-89ef-e80e98e43b60 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] PATH_INFO: `/v3/projects/397aa5e18a8c4aaea4644e0ab1d03ca6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:03.502714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97c42f-8fb1-477a-89ef-e80e98e43b60 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: Authorizing `identity:delete_project(project_id=397aa5e18a8c4aaea4644e0ab1d03ca6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:03.506163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97c42f-8fb1-477a-89ef-e80e98e43b60 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:03.520880 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-0e97c42f-8fb1-477a-89ef-e80e98e43b60 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Could not find project: 397aa5e18a8c4aaea4644e0ab1d03ca6.: keystone.exception.ProjectNotFound: Could not find project: 397aa5e18a8c4aaea4644e0ab1d03ca6. Aug 27 04:54:03.520880 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:03.520880 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:54:03.520880 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:54:03.520880 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:54:03.520880 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:54:03.520880 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:54:03.520880 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:54:03.520880 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:54:03.520880 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:54:03.520880 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:54:03.520880 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:54:03.520880 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 27 04:54:03.520880 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 27 04:54:03.521772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:54:03.521772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:54:03.521772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 27 04:54:03.521772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 27 04:54:03.521772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:54:03.521772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:54:03.521772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:54:03.521772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:54:03.521772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 397aa5e18a8c4aaea4644e0ab1d03ca6. Aug 27 04:54:03.521772 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:03.527582 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3263/6469] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:03 2022] DELETE /identity/v3/projects/397aa5e18a8c4aaea4644e0ab1d03ca6 => generated 113 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:54:03.528705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97c42f-8fb1-477a-89ef-e80e98e43b60 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:03.539710 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3207/6470] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:03 2022] POST /identity/v3/projects => generated 349 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:03.543732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155fb12-9ab5-4c60-b2f3-26cc05b164e1 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:03.550750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97c42f-8fb1-477a-89ef-e80e98e43b60 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:03.689513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99e119-4b1c-498c-ae29-bc8382cccfb3 tempest-ProjectsNegativeStaticTestJSON-26295050 tempest-ProjectsNegativeStaticTestJSON-26295050-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30fa3b70482848da87653efbb15c83b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '368a4a4fbf784890af363b96d98bc1fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:03.690440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99e119-4b1c-498c-ae29-bc8382cccfb3 tempest-ProjectsNegativeStaticTestJSON-26295050 tempest-ProjectsNegativeStaticTestJSON-26295050-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:03.692527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99e119-4b1c-498c-ae29-bc8382cccfb3 tempest-ProjectsNegativeStaticTestJSON-26295050 tempest-ProjectsNegativeStaticTestJSON-26295050-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:03.692955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99e119-4b1c-498c-ae29-bc8382cccfb3 tempest-ProjectsNegativeStaticTestJSON-26295050 tempest-ProjectsNegativeStaticTestJSON-26295050-project] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:03.693779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99e119-4b1c-498c-ae29-bc8382cccfb3 tempest-ProjectsNegativeStaticTestJSON-26295050 tempest-ProjectsNegativeStaticTestJSON-26295050-project] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:03.711435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155fb12-9ab5-4c60-b2f3-26cc05b164e1 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:03.716040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-5e99e119-4b1c-498c-ae29-bc8382cccfb3 tempest-ProjectsNegativeStaticTestJSON-26295050 tempest-ProjectsNegativeStaticTestJSON-26295050-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 27 04:54:03.716040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:03.716040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:54:03.716040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:54:03.716040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:54:03.716040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:54:03.716040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:54:03.716040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:54:03.716040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:54:03.716040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:54:03.716040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:54:03.716040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:54:03.716040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Aug 27 04:54:03.716040 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._list_projects() Aug 27 04:54:03.716870 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Aug 27 04:54:03.716870 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Aug 27 04:54:03.716870 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 27 04:54:03.716870 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 27 04:54:03.716870 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 27 04:54:03.716870 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 27 04:54:03.716870 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 04:54:03.716870 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 27 04:54:03.716870 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 27 04:54:03.716870 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:03.721578 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3264/6471] 10.222.0.76 () {58 vars in 1131 bytes} [Sat Aug 27 04:54:03 2022] GET /identity/v3/projects => generated 135 bytes in 193 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:54:03.722624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99e119-4b1c-498c-ae29-bc8382cccfb3 tempest-ProjectsNegativeStaticTestJSON-26295050 tempest-ProjectsNegativeStaticTestJSON-26295050-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:03.723958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf933c28-fe64-47e6-b8c5-01aeed195f99 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21775bd2fdc041c0914b860f7aa519ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0821527f6e5454a972c128199c57182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:03.724845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf933c28-fe64-47e6-b8c5-01aeed195f99 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:03.724995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf933c28-fe64-47e6-b8c5-01aeed195f99 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:03.725137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf933c28-fe64-47e6-b8c5-01aeed195f99 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:03.725892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf933c28-fe64-47e6-b8c5-01aeed195f99 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:03.726199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf933c28-fe64-47e6-b8c5-01aeed195f99 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:03.728492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf933c28-fe64-47e6-b8c5-01aeed195f99 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:03.762533 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3208/6472] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:54:03.764258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf933c28-fe64-47e6-b8c5-01aeed195f99 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:03.846583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99e119-4b1c-498c-ae29-bc8382cccfb3 tempest-ProjectsNegativeStaticTestJSON-26295050 tempest-ProjectsNegativeStaticTestJSON-26295050-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:03.852406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b17eae-5bf3-4e86-b752-1c5624b8ea7f tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56852953a9b648b6905232bd30ad32eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2254ac9cd1284cb382da08873ef08a44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:03.853190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b17eae-5bf3-4e86-b752-1c5624b8ea7f tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:03.853801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b17eae-5bf3-4e86-b752-1c5624b8ea7f tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:03.854253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b17eae-5bf3-4e86-b752-1c5624b8ea7f tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:03.855037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b17eae-5bf3-4e86-b752-1c5624b8ea7f tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:03.856742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf933c28-fe64-47e6-b8c5-01aeed195f99 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:03.857173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b17eae-5bf3-4e86-b752-1c5624b8ea7f tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:03.865290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754610e-14d5-4ad8-82d0-05a5d4bc796b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:03.865952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754610e-14d5-4ad8-82d0-05a5d4bc796b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:03.866239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754610e-14d5-4ad8-82d0-05a5d4bc796b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:03.866561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754610e-14d5-4ad8-82d0-05a5d4bc796b admin admin] PATH_INFO: `/v3/users/eafb092d248c4bd1b00a1e3db19473c2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:03.868920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754610e-14d5-4ad8-82d0-05a5d4bc796b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eafb092d248c4bd1b00a1e3db19473c2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:03.871989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754610e-14d5-4ad8-82d0-05a5d4bc796b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:04.059493 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3265/6473] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:03 2022] POST /identity/v3/projects => generated 358 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:04.061030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b17eae-5bf3-4e86-b752-1c5624b8ea7f tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:04.062868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-28b17eae-5bf3-4e86-b752-1c5624b8ea7f tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:04.132239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f754610e-14d5-4ad8-82d0-05a5d4bc796b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eafb092d248c4bd1b00a1e3db19473c2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:04.199324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b17eae-5bf3-4e86-b752-1c5624b8ea7f tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:04.199324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d735f-782d-4f70-8e0a-ff5ef1eb80a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:04.199324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d735f-782d-4f70-8e0a-ff5ef1eb80a8 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:04.199742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d735f-782d-4f70-8e0a-ff5ef1eb80a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:04.199742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d735f-782d-4f70-8e0a-ff5ef1eb80a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:04.271305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f754610e-14d5-4ad8-82d0-05a5d4bc796b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eafb092d248c4bd1b00a1e3db19473c2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:04.272888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f754610e-14d5-4ad8-82d0-05a5d4bc796b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eafb092d248c4bd1b00a1e3db19473c2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:04.296597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f754610e-14d5-4ad8-82d0-05a5d4bc796b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eafb092d248c4bd1b00a1e3db19473c2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:04.320209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:04.336676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f754610e-14d5-4ad8-82d0-05a5d4bc796b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eafb092d248c4bd1b00a1e3db19473c2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:04.351012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d735f-782d-4f70-8e0a-ff5ef1eb80a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:04.354766 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3209/6474] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:03 2022] DELETE /identity/v3/users/eafb092d248c4bd1b00a1e3db19473c2 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:04.354766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754610e-14d5-4ad8-82d0-05a5d4bc796b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:04.355473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d735f-782d-4f70-8e0a-ff5ef1eb80a8 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:04.362255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f754610e-14d5-4ad8-82d0-05a5d4bc796b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:04.381248 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3266/6475] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:04.382708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e853e0-554d-4fa2-b279-8c62afaeb3dc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:04.382990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e853e0-554d-4fa2-b279-8c62afaeb3dc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:04.383275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e853e0-554d-4fa2-b279-8c62afaeb3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:04.436867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-09e853e0-554d-4fa2-b279-8c62afaeb3dc None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:04.444655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-09e853e0-554d-4fa2-b279-8c62afaeb3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:04.475229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754610e-14d5-4ad8-82d0-05a5d4bc796b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:04.481936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd445d-2533-459f-aa9a-fb3a6d1b1555 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56852953a9b648b6905232bd30ad32eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2254ac9cd1284cb382da08873ef08a44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:04.482792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd445d-2533-459f-aa9a-fb3a6d1b1555 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:04.483184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd445d-2533-459f-aa9a-fb3a6d1b1555 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:04.483516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd445d-2533-459f-aa9a-fb3a6d1b1555 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:04.484216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd445d-2533-459f-aa9a-fb3a6d1b1555 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:04.487466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd445d-2533-459f-aa9a-fb3a6d1b1555 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:04.552870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.sql.core [None req-56dd445d-2533-459f-aa9a-fb3a6d1b1555 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1688859078' for key 'project.ixu_project_name_domain_id'") Aug 27 04:54:04.552870 n-d-852088-5 devstack@keystone.service[82082]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 27 04:54:04.552870 n-d-852088-5 devstack@keystone.service[82082]: [parameters: {'id': '17e3b1f8c84f4692a109b6cd9ea09f5c', 'name': 'tempest-project-dup-1688859078', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 27 04:54:04.552870 n-d-852088-5 devstack@keystone.service[82082]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82082) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 04:54:04.566352 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-56dd445d-2533-459f-aa9a-fb3a6d1b1555 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1688859078, project id 17e3b1f8c84f4692a109b6cd9ea09f5c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1688859078, project id 17e3b1f8c84f4692a109b6cd9ea09f5c. Aug 27 04:54:04.566352 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:04.566352 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:54:04.566352 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 04:54:04.566352 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:54:04.566352 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 04:54:04.566352 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:54:04.566352 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 04:54:04.566352 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:54:04.566352 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application conn.query(q) Aug 27 04:54:04.566352 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:54:04.566352 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:54:04.567164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:54:04.567164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application result.read() Aug 27 04:54:04.567164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:54:04.567164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 04:54:04.567164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:54:04.567164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 04:54:04.567164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:54:04.567164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 04:54:04.567164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:54:04.567164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 04:54:04.567164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1688859078' for key 'project.ixu_project_name_domain_id'") Aug 27 04:54:04.567164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:04.567164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 27 04:54:04.567164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:04.567164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:04.567164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 27 04:54:04.567164 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application next(self.gen) Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application yield resource Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application next(self.gen) Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.session.rollback() Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.force_reraise() Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise self.value Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 27 04:54:04.567947 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application session.commit() Aug 27 04:54:04.568840 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 27 04:54:04.568840 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 27 04:54:04.568840 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 27 04:54:04.568840 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._prepare_impl() Aug 27 04:54:04.568840 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 27 04:54:04.568840 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.session.flush() Aug 27 04:54:04.568840 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 04:54:04.568840 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._flush(objects) Aug 27 04:54:04.568840 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 04:54:04.568840 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 27 04:54:04.568840 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 04:54:04.568840 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application compat.raise_( Aug 27 04:54:04.568840 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:54:04.568840 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception Aug 27 04:54:04.568840 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 04:54:04.568840 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application flush_context.execute() Aug 27 04:54:04.568840 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 04:54:04.569649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rec.execute(self) Aug 27 04:54:04.569649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 04:54:04.569649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 27 04:54:04.569649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 04:54:04.569649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 27 04:54:04.569649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 27 04:54:04.569649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 27 04:54:04.569649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 04:54:04.569649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 04:54:04.569649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 04:54:04.569649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 27 04:54:04.569649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 04:54:04.569649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 27 04:54:04.569649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 04:54:04.569649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 27 04:54:04.569649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 04:54:04.570781 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 04:54:04.570781 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:54:04.570781 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception Aug 27 04:54:04.570781 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 04:54:04.570781 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 04:54:04.570781 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 04:54:04.570781 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 04:54:04.570781 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 04:54:04.570781 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 04:54:04.570781 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 04:54:04.570781 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application conn.query(q) Aug 27 04:54:04.570781 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 04:54:04.570781 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 04:54:04.570781 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 04:54:04.570781 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application result.read() Aug 27 04:54:04.570781 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 04:54:04.570781 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 04:54:04.572649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 04:54:04.572649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 04:54:04.572649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 04:54:04.572649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 04:54:04.572649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 04:54:04.572649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 04:54:04.572649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1688859078' for key 'project.ixu_project_name_domain_id'") Aug 27 04:54:04.572649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 27 04:54:04.572649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [parameters: {'id': '17e3b1f8c84f4692a109b6cd9ea09f5c', 'name': 'tempest-project-dup-1688859078', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 27 04:54:04.572649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 04:54:04.572649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:04.572649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:54:04.572649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:04.572649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:04.572649 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 27 04:54:04.574386 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 27 04:54:04.574386 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 27 04:54:04.574386 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 27 04:54:04.574386 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1688859078 at domain ID default. Aug 27 04:54:04.574386 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:04.574386 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:54:04.574386 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:04.574386 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:04.574386 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:54:04.574386 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:54:04.574386 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:54:04.574386 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:54:04.574386 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:54:04.574386 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:54:04.574386 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:54:04.574386 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:54:04.574386 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:54:04.576033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:54:04.576033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 27 04:54:04.576033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 27 04:54:04.576033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:54:04.576033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:54:04.576033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 27 04:54:04.576033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 27 04:54:04.576033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1688859078, project id 17e3b1f8c84f4692a109b6cd9ea09f5c. Aug 27 04:54:04.576033 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:04.576033 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3210/6476] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:54:04 2022] POST /identity/v3/projects => generated 285 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:54:04.576033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd445d-2533-459f-aa9a-fb3a6d1b1555 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:04.592526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd445d-2533-459f-aa9a-fb3a6d1b1555 tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:04.599210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56852953a9b648b6905232bd30ad32eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2254ac9cd1284cb382da08873ef08a44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:04.600460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:04.601598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:04.601989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] PATH_INFO: `/v3/projects/8f37c5d39d164a6fa11211a53146127b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:04.603168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8f37c5d39d164a6fa11211a53146127b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:04.607575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:04.609551 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3267/6477] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:04.665270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e853e0-554d-4fa2-b279-8c62afaeb3dc None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:04.666544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-09e853e0-554d-4fa2-b279-8c62afaeb3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:04.765448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e853e0-554d-4fa2-b279-8c62afaeb3dc None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:04.795970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f37c5d39d164a6fa11211a53146127b', 'request_id': 'req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:04.814657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f37c5d39d164a6fa11211a53146127b', 'request_id': 'req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:04.832775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f37c5d39d164a6fa11211a53146127b', 'request_id': 'req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:04.882282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3b5f7-9455-4481-8a1e-33305f1f5eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:04.883053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3b5f7-9455-4481-8a1e-33305f1f5eed service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:04.883399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3b5f7-9455-4481-8a1e-33305f1f5eed service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:04.883739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3b5f7-9455-4481-8a1e-33305f1f5eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:04.996504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] The token cache is being invalidate because project 8f37c5d39d164a6fa11211a53146127b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:04.997437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:05.001479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:05.005360 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3211/6478] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:04 2022] DELETE /identity/v3/projects/8f37c5d39d164a6fa11211a53146127b => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:05.007148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:05.009234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3b5f7-9455-4481-8a1e-33305f1f5eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:05.013453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:05.013593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3b5f7-9455-4481-8a1e-33305f1f5eed service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:05.036812 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3268/6479] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:54:05.037832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3b5f7-9455-4481-8a1e-33305f1f5eed service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:05.039355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e4b3b5f7-9455-4481-8a1e-33305f1f5eed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:05.074665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3b5f7-9455-4481-8a1e-33305f1f5eed service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:05.093465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037bc750-34bb-4150-9b11-a7eeab1d073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:05.094876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bc750-34bb-4150-9b11-a7eeab1d073b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:05.095196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bc750-34bb-4150-9b11-a7eeab1d073b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:05.095511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bc750-34bb-4150-9b11-a7eeab1d073b admin admin] PATH_INFO: `/v3/users/30fa3b70482848da87653efbb15c83b5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:05.098118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037bc750-34bb-4150-9b11-a7eeab1d073b admin admin] RBAC: Authorizing `identity:delete_user(user_id=30fa3b70482848da87653efbb15c83b5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:05.100467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037bc750-34bb-4150-9b11-a7eeab1d073b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:05.163855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4fcdc-ca95-4e01-bffd-5dbccb0b6dbd tempest-ProjectsNegativeStaticTestJSON-2128286630 tempest-ProjectsNegativeStaticTestJSON-2128286630-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:05.171065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf366c9-fdd0-43c4-a444-4adca00b75b4 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21775bd2fdc041c0914b860f7aa519ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0821527f6e5454a972c128199c57182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:05.172017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf366c9-fdd0-43c4-a444-4adca00b75b4 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:05.172857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf366c9-fdd0-43c4-a444-4adca00b75b4 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:05.173280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf366c9-fdd0-43c4-a444-4adca00b75b4 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] PATH_INFO: `/v3/projects/d1492f18741146588f4cf4f9ced59138` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:05.174997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf366c9-fdd0-43c4-a444-4adca00b75b4 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d1492f18741146588f4cf4f9ced59138)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:05.177331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf366c9-fdd0-43c4-a444-4adca00b75b4 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:05.449770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-faf366c9-fdd0-43c4-a444-4adca00b75b4 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1492f18741146588f4cf4f9ced59138', 'request_id': 'req-faf366c9-fdd0-43c4-a444-4adca00b75b4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:05.464439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-faf366c9-fdd0-43c4-a444-4adca00b75b4 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1492f18741146588f4cf4f9ced59138', 'request_id': 'req-faf366c9-fdd0-43c4-a444-4adca00b75b4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:05.472797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-faf366c9-fdd0-43c4-a444-4adca00b75b4 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1492f18741146588f4cf4f9ced59138', 'request_id': 'req-faf366c9-fdd0-43c4-a444-4adca00b75b4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:05.496535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-037bc750-34bb-4150-9b11-a7eeab1d073b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30fa3b70482848da87653efbb15c83b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:05.501055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-037bc750-34bb-4150-9b11-a7eeab1d073b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30fa3b70482848da87653efbb15c83b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:05.579817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-faf366c9-fdd0-43c4-a444-4adca00b75b4 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] The token cache is being invalidate because project d1492f18741146588f4cf4f9ced59138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:05.580112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-faf366c9-fdd0-43c4-a444-4adca00b75b4 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:05.584456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-faf366c9-fdd0-43c4-a444-4adca00b75b4 tempest-QuotasTest-313538703 tempest-QuotasTest-313538703-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:05.587057 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3212/6480] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:05 2022] DELETE /identity/v3/projects/d1492f18741146588f4cf4f9ced59138 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:05.660220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-037bc750-34bb-4150-9b11-a7eeab1d073b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30fa3b70482848da87653efbb15c83b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:05.661335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-037bc750-34bb-4150-9b11-a7eeab1d073b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30fa3b70482848da87653efbb15c83b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:05.682605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-037bc750-34bb-4150-9b11-a7eeab1d073b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30fa3b70482848da87653efbb15c83b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:05.739561 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3269/6481] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:05 2022] DELETE /identity/v3/users/30fa3b70482848da87653efbb15c83b5 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:05.740137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc615c-8b01-4dda-8176-a2aa6272f311 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:05.740458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc615c-8b01-4dda-8176-a2aa6272f311 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:05.740733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc615c-8b01-4dda-8176-a2aa6272f311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:05.784599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-acdc615c-8b01-4dda-8176-a2aa6272f311 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:05.789289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-acdc615c-8b01-4dda-8176-a2aa6272f311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:05.887301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037bc750-34bb-4150-9b11-a7eeab1d073b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:05.891253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-037bc750-34bb-4150-9b11-a7eeab1d073b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:06.011479 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3213/6482] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:06.019058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc615c-8b01-4dda-8176-a2aa6272f311 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:06.020582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-acdc615c-8b01-4dda-8176-a2aa6272f311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:06.094756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037bc750-34bb-4150-9b11-a7eeab1d073b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:06.100275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca8b68-3fb7-4553-a017-f83fa21b8a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:06.100986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca8b68-3fb7-4553-a017-f83fa21b8a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:06.101275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca8b68-3fb7-4553-a017-f83fa21b8a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:06.101672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca8b68-3fb7-4553-a017-f83fa21b8a52 admin admin] PATH_INFO: `/v3/users/e6aa4028084e46deb24ec65014ba93a9` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:06.102951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca8b68-3fb7-4553-a017-f83fa21b8a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6aa4028084e46deb24ec65014ba93a9)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:06.105787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca8b68-3fb7-4553-a017-f83fa21b8a52 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:06.130008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc615c-8b01-4dda-8176-a2aa6272f311 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:06.133898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e79fb3-551c-459a-af9c-bfefb0311fe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:06.134527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e79fb3-551c-459a-af9c-bfefb0311fe8 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:06.134805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e79fb3-551c-459a-af9c-bfefb0311fe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:06.135080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e79fb3-551c-459a-af9c-bfefb0311fe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:06.146245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e79fb3-551c-459a-af9c-bfefb0311fe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:06.147708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e79fb3-551c-459a-af9c-bfefb0311fe8 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:06.159161 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3214/6483] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:54:06.333006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a3ca8b68-3fb7-4553-a017-f83fa21b8a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6aa4028084e46deb24ec65014ba93a9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:06.333514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a3ca8b68-3fb7-4553-a017-f83fa21b8a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6aa4028084e46deb24ec65014ba93a9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:06.414757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a3ca8b68-3fb7-4553-a017-f83fa21b8a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6aa4028084e46deb24ec65014ba93a9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:06.415658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a3ca8b68-3fb7-4553-a017-f83fa21b8a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6aa4028084e46deb24ec65014ba93a9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:06.474728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a3ca8b68-3fb7-4553-a017-f83fa21b8a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6aa4028084e46deb24ec65014ba93a9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:06.503926 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3270/6484] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:05 2022] DELETE /identity/v3/users/e6aa4028084e46deb24ec65014ba93a9 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:06.508647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304177b-e325-48f8-b9f8-f440502c970b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:06.509040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304177b-e325-48f8-b9f8-f440502c970b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:06.509255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304177b-e325-48f8-b9f8-f440502c970b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:06.569974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b304177b-e325-48f8-b9f8-f440502c970b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:06.586429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b304177b-e325-48f8-b9f8-f440502c970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:06.649827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:06.717248 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3215/6485] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:06.771119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca8b68-3fb7-4553-a017-f83fa21b8a52 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:06.771119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a3ca8b68-3fb7-4553-a017-f83fa21b8a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:06.911711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca8b68-3fb7-4553-a017-f83fa21b8a52 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:06.917045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e4571-c69f-4e54-a08a-e46e877c98c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:06.917554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e4571-c69f-4e54-a08a-e46e877c98c6 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:06.917889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e4571-c69f-4e54-a08a-e46e877c98c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:06.918166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e4571-c69f-4e54-a08a-e46e877c98c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:06.955117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e4571-c69f-4e54-a08a-e46e877c98c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:06.957332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e4571-c69f-4e54-a08a-e46e877c98c6 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:06.982028 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3271/6486] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:07.054404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304177b-e325-48f8-b9f8-f440502c970b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:07.057442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b304177b-e325-48f8-b9f8-f440502c970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:07.084987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304177b-e325-48f8-b9f8-f440502c970b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:07.095125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:07.106386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:07.106859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:07.107259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d admin admin] PATH_INFO: `/v3/projects/368a4a4fbf784890af363b96d98bc1fd` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:07.108767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d admin admin] RBAC: Authorizing `identity:delete_project(project_id=368a4a4fbf784890af363b96d98bc1fd)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:07.111901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:07.278571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '368a4a4fbf784890af363b96d98bc1fd', 'request_id': 'req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:07.289146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e4571-c69f-4e54-a08a-e46e877c98c6 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:07.290905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-632e4571-c69f-4e54-a08a-e46e877c98c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:07.336331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '368a4a4fbf784890af363b96d98bc1fd', 'request_id': 'req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:07.352803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e4571-c69f-4e54-a08a-e46e877c98c6 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:07.370044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '368a4a4fbf784890af363b96d98bc1fd', 'request_id': 'req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:07.494852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d admin admin] The token cache is being invalidate because project 368a4a4fbf784890af363b96d98bc1fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:07.495344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:07.496047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:07.498384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b378fc-e7ee-47c7-b73e-f78cd28d1fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:07.501998 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3216/6487] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:07 2022] DELETE /identity/v3/projects/368a4a4fbf784890af363b96d98bc1fd => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:07.503437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:07.504509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b378fc-e7ee-47c7-b73e-f78cd28d1fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:07.504963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b378fc-e7ee-47c7-b73e-f78cd28d1fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:07.506368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:07.509365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b378fc-e7ee-47c7-b73e-f78cd28d1fdf admin admin] PATH_INFO: `/v3/projects/194c36c3d7c644999a4f379222945931` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:07.511459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b378fc-e7ee-47c7-b73e-f78cd28d1fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=194c36c3d7c644999a4f379222945931)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:07.518910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b378fc-e7ee-47c7-b73e-f78cd28d1fdf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:07.554754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8dd7d-d41f-4f9e-be82-3c0a9b2e446d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:07.568694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ace31c-bb8e-4e5f-959b-7490a4222e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:07.569653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ace31c-bb8e-4e5f-959b-7490a4222e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:07.572048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ace31c-bb8e-4e5f-959b-7490a4222e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:07.572469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ace31c-bb8e-4e5f-959b-7490a4222e95 admin admin] PATH_INFO: `/v3/users/56852953a9b648b6905232bd30ad32eb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:07.575209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ace31c-bb8e-4e5f-959b-7490a4222e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56852953a9b648b6905232bd30ad32eb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:07.582708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ace31c-bb8e-4e5f-959b-7490a4222e95 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:07.689517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6b378fc-e7ee-47c7-b73e-f78cd28d1fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194c36c3d7c644999a4f379222945931', 'request_id': 'req-b6b378fc-e7ee-47c7-b73e-f78cd28d1fdf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:07.711528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6b378fc-e7ee-47c7-b73e-f78cd28d1fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194c36c3d7c644999a4f379222945931', 'request_id': 'req-b6b378fc-e7ee-47c7-b73e-f78cd28d1fdf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:07.831860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6b378fc-e7ee-47c7-b73e-f78cd28d1fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194c36c3d7c644999a4f379222945931', 'request_id': 'req-b6b378fc-e7ee-47c7-b73e-f78cd28d1fdf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:07.857867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6b378fc-e7ee-47c7-b73e-f78cd28d1fdf admin admin] The token cache is being invalidate because project 194c36c3d7c644999a4f379222945931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:07.858284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6b378fc-e7ee-47c7-b73e-f78cd28d1fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:07.859168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6b378fc-e7ee-47c7-b73e-f78cd28d1fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:07.865651 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3272/6488] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:07 2022] DELETE /identity/v3/projects/194c36c3d7c644999a4f379222945931 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:54:07.870942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845cdfb-62a8-4e80-967d-c3ce0ca14958 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:07.873523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845cdfb-62a8-4e80-967d-c3ce0ca14958 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:07.873942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845cdfb-62a8-4e80-967d-c3ce0ca14958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:07.921137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:07.930257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5845cdfb-62a8-4e80-967d-c3ce0ca14958 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:07.931949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5845cdfb-62a8-4e80-967d-c3ce0ca14958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:08.008141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b5ace31c-bb8e-4e5f-959b-7490a4222e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56852953a9b648b6905232bd30ad32eb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:08.042694 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3273/6489] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:08.051106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68d247-356d-4cb3-b659-f4ac685d799c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:08.051541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68d247-356d-4cb3-b659-f4ac685d799c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:08.051924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68d247-356d-4cb3-b659-f4ac685d799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:08.077993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0d68d247-356d-4cb3-b659-f4ac685d799c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:08.080151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0d68d247-356d-4cb3-b659-f4ac685d799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:08.092616 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3274/6490] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:08.094713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68d247-356d-4cb3-b659-f4ac685d799c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:08.106431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68d247-356d-4cb3-b659-f4ac685d799c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:08.113303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d0498-05ba-4100-94d6-f028a8d2e84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:08.114097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d0498-05ba-4100-94d6-f028a8d2e84a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:08.114540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d0498-05ba-4100-94d6-f028a8d2e84a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:08.114919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d0498-05ba-4100-94d6-f028a8d2e84a admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:08.115810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d0498-05ba-4100-94d6-f028a8d2e84a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:08.116257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d0498-05ba-4100-94d6-f028a8d2e84a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:08.118403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d0498-05ba-4100-94d6-f028a8d2e84a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:08.139275 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3275/6491] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:54:08.140882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d0498-05ba-4100-94d6-f028a8d2e84a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:08.154012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d0498-05ba-4100-94d6-f028a8d2e84a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:08.161000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90383df8-7496-47e9-8b22-4d7b6c45d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:08.161928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90383df8-7496-47e9-8b22-4d7b6c45d5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:08.172922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90383df8-7496-47e9-8b22-4d7b6c45d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:08.172922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90383df8-7496-47e9-8b22-4d7b6c45d5f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:08.172922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90383df8-7496-47e9-8b22-4d7b6c45d5f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:08.172922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90383df8-7496-47e9-8b22-4d7b6c45d5f9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:08.198626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b5ace31c-bb8e-4e5f-959b-7490a4222e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56852953a9b648b6905232bd30ad32eb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:08.199591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b5ace31c-bb8e-4e5f-959b-7490a4222e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56852953a9b648b6905232bd30ad32eb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:08.209861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b5ace31c-bb8e-4e5f-959b-7490a4222e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56852953a9b648b6905232bd30ad32eb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:08.226708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b5ace31c-bb8e-4e5f-959b-7490a4222e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56852953a9b648b6905232bd30ad32eb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:08.235030 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3217/6492] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:07 2022] DELETE /identity/v3/users/56852953a9b648b6905232bd30ad32eb => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:08.288321 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3276/6493] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:08 2022] POST /identity/v3/projects => generated 403 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:08.291092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ace31c-bb8e-4e5f-959b-7490a4222e95 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:08.292884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b5ace31c-bb8e-4e5f-959b-7490a4222e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:08.334474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90383df8-7496-47e9-8b22-4d7b6c45d5f9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:08.336616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-90383df8-7496-47e9-8b22-4d7b6c45d5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:08.380054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:08.449451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ace31c-bb8e-4e5f-959b-7490a4222e95 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:08.520069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90383df8-7496-47e9-8b22-4d7b6c45d5f9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:08.529644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:08.529974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:08.532651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:08.533049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3 admin admin] PATH_INFO: `/v3/projects/30ae0882890a42f78d89c19a49596462` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:08.539556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ae0882890a42f78d89c19a49596462)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:08.541594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:08.611464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f17fa-85bf-4a47-bba2-c66b375a26fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:08.616215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f17fa-85bf-4a47-bba2-c66b375a26fb admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:08.617044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f17fa-85bf-4a47-bba2-c66b375a26fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:08.617810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f17fa-85bf-4a47-bba2-c66b375a26fb admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:08.618848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f17fa-85bf-4a47-bba2-c66b375a26fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:08.626867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f17fa-85bf-4a47-bba2-c66b375a26fb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:08.711191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ae0882890a42f78d89c19a49596462', 'request_id': 'req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:08.731687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ae0882890a42f78d89c19a49596462', 'request_id': 'req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:08.808785 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3218/6494] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:08 2022] POST /identity/v3/users => generated 302 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:08.810041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f17fa-85bf-4a47-bba2-c66b375a26fb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:08.850946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ae0882890a42f78d89c19a49596462', 'request_id': 'req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:08.882692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f17fa-85bf-4a47-bba2-c66b375a26fb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:08.900814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3 admin admin] The token cache is being invalidate because project 30ae0882890a42f78d89c19a49596462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:08.901108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:08.908917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:08.917426 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3277/6495] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:08 2022] DELETE /identity/v3/projects/30ae0882890a42f78d89c19a49596462 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:08.921254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:08.926417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:09.086544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22128b6-086d-4fab-a971-b8c89d362d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:09.087696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22128b6-086d-4fab-a971-b8c89d362d53 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:09.088121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22128b6-086d-4fab-a971-b8c89d362d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:09.088849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22128b6-086d-4fab-a971-b8c89d362d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:09.089665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22128b6-086d-4fab-a971-b8c89d362d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:09.097532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22128b6-086d-4fab-a971-b8c89d362d53 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:09.113711 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3219/6496] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:09.117148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22128b6-086d-4fab-a971-b8c89d362d53 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:09.119863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e22128b6-086d-4fab-a971-b8c89d362d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:09.147849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22128b6-086d-4fab-a971-b8c89d362d53 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:09.164080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cda0f-5ce0-4002-9f85-2a4207eca657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:09.165415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cda0f-5ce0-4002-9f85-2a4207eca657 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:09.165708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cda0f-5ce0-4002-9f85-2a4207eca657 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:09.165999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cda0f-5ce0-4002-9f85-2a4207eca657 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:09.166917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cda0f-5ce0-4002-9f85-2a4207eca657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:09.173648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cda0f-5ce0-4002-9f85-2a4207eca657 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:09.177746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f9d3e-ce01-4ea3-8bcb-b77dfe1563e3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:09.191305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b9949-75cc-4002-bb65-4adff1c5e274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:09.192069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b9949-75cc-4002-bb65-4adff1c5e274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:09.192472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b9949-75cc-4002-bb65-4adff1c5e274 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:09.192840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b9949-75cc-4002-bb65-4adff1c5e274 admin admin] PATH_INFO: `/v3/users/21775bd2fdc041c0914b860f7aa519ea` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:09.194821 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3220/6497] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:09.195155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b9949-75cc-4002-bb65-4adff1c5e274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21775bd2fdc041c0914b860f7aa519ea)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:09.196466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cda0f-5ce0-4002-9f85-2a4207eca657 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:09.197585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b9949-75cc-4002-bb65-4adff1c5e274 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:09.209903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cda0f-5ce0-4002-9f85-2a4207eca657 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:09.215406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721a7a1-c125-4827-83a6-2c2dc4cf8b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:09.216440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721a7a1-c125-4827-83a6-2c2dc4cf8b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:09.216907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721a7a1-c125-4827-83a6-2c2dc4cf8b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:09.217331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721a7a1-c125-4827-83a6-2c2dc4cf8b91 admin admin] PATH_INFO: `/v3/projects/3f33afda3d45469f836e079a4c0b5fc6/users/7fb8a950bb584362b2b6f17f8013aa9f/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:09.276241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721a7a1-c125-4827-83a6-2c2dc4cf8b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f33afda3d45469f836e079a4c0b5fc6, user_id=7fb8a950bb584362b2b6f17f8013aa9f, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:09.284626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721a7a1-c125-4827-83a6-2c2dc4cf8b91 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:09.424411 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3221/6498] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:09 2022] PUT /identity/v3/projects/3f33afda3d45469f836e079a4c0b5fc6/users/7fb8a950bb584362b2b6f17f8013aa9f/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:09.430134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddaa35-24b0-441d-a231-a17f8679b628 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:09.430757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddaa35-24b0-441d-a231-a17f8679b628 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:09.431641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddaa35-24b0-441d-a231-a17f8679b628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:09.458044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-254b9949-75cc-4002-bb65-4adff1c5e274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21775bd2fdc041c0914b860f7aa519ea'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:09.459678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-254b9949-75cc-4002-bb65-4adff1c5e274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21775bd2fdc041c0914b860f7aa519ea'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:09.519707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-27ddaa35-24b0-441d-a231-a17f8679b628 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:09.525344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-27ddaa35-24b0-441d-a231-a17f8679b628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:09.614173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:09.638093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-254b9949-75cc-4002-bb65-4adff1c5e274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21775bd2fdc041c0914b860f7aa519ea'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:09.643383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:09.644427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-254b9949-75cc-4002-bb65-4adff1c5e274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21775bd2fdc041c0914b860f7aa519ea'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:09.669192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-254b9949-75cc-4002-bb65-4adff1c5e274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21775bd2fdc041c0914b860f7aa519ea'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:09.694515 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3222/6499] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:09.713407 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3278/6500] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:08 2022] DELETE /identity/v3/users/21775bd2fdc041c0914b860f7aa519ea => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:09.718741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddaa35-24b0-441d-a231-a17f8679b628 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:09.721985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-27ddaa35-24b0-441d-a231-a17f8679b628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:09.868854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddaa35-24b0-441d-a231-a17f8679b628 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:09.979123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e4805-baae-4159-a030-d7c503a98675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:09.979735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e4805-baae-4159-a030-d7c503a98675 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:09.980015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e4805-baae-4159-a030-d7c503a98675 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:09.980327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e4805-baae-4159-a030-d7c503a98675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:10.061619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e4805-baae-4159-a030-d7c503a98675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:10.064915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e4805-baae-4159-a030-d7c503a98675 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:10.084332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b9949-75cc-4002-bb65-4adff1c5e274 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:10.086010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-254b9949-75cc-4002-bb65-4adff1c5e274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:10.102463 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3223/6501] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:10.134365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b9949-75cc-4002-bb65-4adff1c5e274 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:10.153161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559ceb6-5e26-42fd-a7f7-5d13289b2390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:10.155612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559ceb6-5e26-42fd-a7f7-5d13289b2390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:10.158989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559ceb6-5e26-42fd-a7f7-5d13289b2390 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:10.158989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559ceb6-5e26-42fd-a7f7-5d13289b2390 admin admin] PATH_INFO: `/v3/projects/2254ac9cd1284cb382da08873ef08a44` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:10.158989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559ceb6-5e26-42fd-a7f7-5d13289b2390 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2254ac9cd1284cb382da08873ef08a44)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:10.161266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559ceb6-5e26-42fd-a7f7-5d13289b2390 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:10.450456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c559ceb6-5e26-42fd-a7f7-5d13289b2390 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2254ac9cd1284cb382da08873ef08a44', 'request_id': 'req-c559ceb6-5e26-42fd-a7f7-5d13289b2390'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:10.478838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c559ceb6-5e26-42fd-a7f7-5d13289b2390 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2254ac9cd1284cb382da08873ef08a44', 'request_id': 'req-c559ceb6-5e26-42fd-a7f7-5d13289b2390'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:10.591156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c559ceb6-5e26-42fd-a7f7-5d13289b2390 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2254ac9cd1284cb382da08873ef08a44', 'request_id': 'req-c559ceb6-5e26-42fd-a7f7-5d13289b2390'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:10.609124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c559ceb6-5e26-42fd-a7f7-5d13289b2390 admin admin] The token cache is being invalidate because project 2254ac9cd1284cb382da08873ef08a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:10.609317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c559ceb6-5e26-42fd-a7f7-5d13289b2390 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:10.610021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c559ceb6-5e26-42fd-a7f7-5d13289b2390 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:10.622733 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3279/6502] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:10 2022] DELETE /identity/v3/projects/2254ac9cd1284cb382da08873ef08a44 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:54:10.624811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8924fa-82f1-4eb7-81ae-eae838f0bb77 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:10.626178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8924fa-82f1-4eb7-81ae-eae838f0bb77 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:10.626684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8924fa-82f1-4eb7-81ae-eae838f0bb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:10.694335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2e8924fa-82f1-4eb7-81ae-eae838f0bb77 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:10.698267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2e8924fa-82f1-4eb7-81ae-eae838f0bb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:10.860945 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3224/6503] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:10.865876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd66153-6148-4882-b7a7-b385a5297309 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:10.866407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd66153-6148-4882-b7a7-b385a5297309 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:10.866407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd66153-6148-4882-b7a7-b385a5297309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:10.871739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8924fa-82f1-4eb7-81ae-eae838f0bb77 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:10.878545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2e8924fa-82f1-4eb7-81ae-eae838f0bb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:10.900713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2dd66153-6148-4882-b7a7-b385a5297309 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:10.902708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2dd66153-6148-4882-b7a7-b385a5297309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:10.917333 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3280/6504] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:10.918670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd66153-6148-4882-b7a7-b385a5297309 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:10.920409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2dd66153-6148-4882-b7a7-b385a5297309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:10.940986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd66153-6148-4882-b7a7-b385a5297309 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:10.952884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de8a20-c47c-4daa-bd0f-3c68ec05eb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:10.967805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de8a20-c47c-4daa-bd0f-3c68ec05eb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:10.967805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de8a20-c47c-4daa-bd0f-3c68ec05eb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:10.968229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de8a20-c47c-4daa-bd0f-3c68ec05eb2f admin admin] PATH_INFO: `/v3/projects/c0821527f6e5454a972c128199c57182` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:10.972467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de8a20-c47c-4daa-bd0f-3c68ec05eb2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0821527f6e5454a972c128199c57182)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:10.977854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de8a20-c47c-4daa-bd0f-3c68ec05eb2f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:11.034668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8924fa-82f1-4eb7-81ae-eae838f0bb77 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:11.048383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae69e5-0274-47b8-9d85-5a90356e7151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:11.049227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae69e5-0274-47b8-9d85-5a90356e7151 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:11.049508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae69e5-0274-47b8-9d85-5a90356e7151 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:11.049898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae69e5-0274-47b8-9d85-5a90356e7151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:11.058528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:11.059488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d4ae69e5-0274-47b8-9d85-5a90356e7151 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:11.194157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae69e5-0274-47b8-9d85-5a90356e7151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:11.196525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae69e5-0274-47b8-9d85-5a90356e7151 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:11.232726 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3225/6505] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:11.233557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f8de8a20-c47c-4daa-bd0f-3c68ec05eb2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0821527f6e5454a972c128199c57182', 'request_id': 'req-f8de8a20-c47c-4daa-bd0f-3c68ec05eb2f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:11.236666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae69e5-0274-47b8-9d85-5a90356e7151 service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:11.250703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f8de8a20-c47c-4daa-bd0f-3c68ec05eb2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0821527f6e5454a972c128199c57182', 'request_id': 'req-f8de8a20-c47c-4daa-bd0f-3c68ec05eb2f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:11.265919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae69e5-0274-47b8-9d85-5a90356e7151 service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:11.355891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f8de8a20-c47c-4daa-bd0f-3c68ec05eb2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0821527f6e5454a972c128199c57182', 'request_id': 'req-f8de8a20-c47c-4daa-bd0f-3c68ec05eb2f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:11.381566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f8de8a20-c47c-4daa-bd0f-3c68ec05eb2f admin admin] The token cache is being invalidate because project c0821527f6e5454a972c128199c57182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:11.385108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f8de8a20-c47c-4daa-bd0f-3c68ec05eb2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:11.389821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f8de8a20-c47c-4daa-bd0f-3c68ec05eb2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:11.394125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc48d64-6d63-450a-a2e4-36628ce89eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:11.394755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc48d64-6d63-450a-a2e4-36628ce89eea admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:11.395044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc48d64-6d63-450a-a2e4-36628ce89eea admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:11.395318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc48d64-6d63-450a-a2e4-36628ce89eea admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:11.396077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc48d64-6d63-450a-a2e4-36628ce89eea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:11.396412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc48d64-6d63-450a-a2e4-36628ce89eea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:11.402761 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3281/6506] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:10 2022] DELETE /identity/v3/projects/c0821527f6e5454a972c128199c57182 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:11.403076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc48d64-6d63-450a-a2e4-36628ce89eea admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:11.405655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e2444-f513-46eb-8c3c-3ff6da8c6f31 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:11.406101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e2444-f513-46eb-8c3c-3ff6da8c6f31 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:11.407148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e2444-f513-46eb-8c3c-3ff6da8c6f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:11.438657 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3226/6507] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:11.446634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc48d64-6d63-450a-a2e4-36628ce89eea admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:11.449983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9bc48d64-6d63-450a-a2e4-36628ce89eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:11.481070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc48d64-6d63-450a-a2e4-36628ce89eea admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:11.487553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-398e2444-f513-46eb-8c3c-3ff6da8c6f31 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:11.488831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-398e2444-f513-46eb-8c3c-3ff6da8c6f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:11.488949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e118428-9ec9-4f39-ae6b-2c5f5a8c44d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:11.489592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e118428-9ec9-4f39-ae6b-2c5f5a8c44d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:11.491143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e118428-9ec9-4f39-ae6b-2c5f5a8c44d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:11.491499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e118428-9ec9-4f39-ae6b-2c5f5a8c44d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:11.492912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e118428-9ec9-4f39-ae6b-2c5f5a8c44d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:11.496038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e118428-9ec9-4f39-ae6b-2c5f5a8c44d5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:11.533616 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3282/6508] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:54:11.543869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c6d35-9dfa-4634-aced-4152c4f888be None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:11.544157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c6d35-9dfa-4634-aced-4152c4f888be None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:11.544533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c6d35-9dfa-4634-aced-4152c4f888be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:11.573249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f12c6d35-9dfa-4634-aced-4152c4f888be None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:11.574473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f12c6d35-9dfa-4634-aced-4152c4f888be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:11.584624 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3283/6509] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:11.594859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c6d35-9dfa-4634-aced-4152c4f888be None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:11.614968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c6d35-9dfa-4634-aced-4152c4f888be None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:11.633434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715df303-9a0f-4e88-9c82-a704fc069ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:11.633434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715df303-9a0f-4e88-9c82-a704fc069ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:11.633434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715df303-9a0f-4e88-9c82-a704fc069ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:11.633434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715df303-9a0f-4e88-9c82-a704fc069ea5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:11.633831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715df303-9a0f-4e88-9c82-a704fc069ea5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:11.633831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715df303-9a0f-4e88-9c82-a704fc069ea5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:11.635190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715df303-9a0f-4e88-9c82-a704fc069ea5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:11.677540 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3227/6510] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:11 2022] POST /identity/v3/projects => generated 391 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:11.678709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e118428-9ec9-4f39-ae6b-2c5f5a8c44d5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:11.704655 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3284/6511] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:11.706412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715df303-9a0f-4e88-9c82-a704fc069ea5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:11.715134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:11.731779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715df303-9a0f-4e88-9c82-a704fc069ea5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:11.842764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e118428-9ec9-4f39-ae6b-2c5f5a8c44d5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:11.859295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221dcc9-0c68-4b0f-aa88-977dcd64944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:11.860037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221dcc9-0c68-4b0f-aa88-977dcd64944d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:11.860361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221dcc9-0c68-4b0f-aa88-977dcd64944d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:11.860645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221dcc9-0c68-4b0f-aa88-977dcd64944d admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:11.861290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221dcc9-0c68-4b0f-aa88-977dcd64944d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:11.863530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221dcc9-0c68-4b0f-aa88-977dcd64944d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:11.878885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8077dc-9ac6-4cbf-8a7d-ba79a6b57fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:11.879518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8077dc-9ac6-4cbf-8a7d-ba79a6b57fdc admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:11.879967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8077dc-9ac6-4cbf-8a7d-ba79a6b57fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:11.880425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8077dc-9ac6-4cbf-8a7d-ba79a6b57fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:11.884629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8077dc-9ac6-4cbf-8a7d-ba79a6b57fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:11.886873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8077dc-9ac6-4cbf-8a7d-ba79a6b57fdc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:12.063708 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3228/6512] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:11 2022] POST /identity/v3/users => generated 302 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:12.064343 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3285/6513] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:11 2022] POST /identity/v3/projects => generated 369 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:12.067394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8077dc-9ac6-4cbf-8a7d-ba79a6b57fdc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:12.067582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221dcc9-0c68-4b0f-aa88-977dcd64944d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:12.103457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221dcc9-0c68-4b0f-aa88-977dcd64944d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:12.161381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8077dc-9ac6-4cbf-8a7d-ba79a6b57fdc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:12.167868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e255a-613c-4e19-a1c3-0bdd3cbd8bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:12.168630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e255a-613c-4e19-a1c3-0bdd3cbd8bcf admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:12.168809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e255a-613c-4e19-a1c3-0bdd3cbd8bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:12.169088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e255a-613c-4e19-a1c3-0bdd3cbd8bcf admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:12.173934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e255a-613c-4e19-a1c3-0bdd3cbd8bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:12.173934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e255a-613c-4e19-a1c3-0bdd3cbd8bcf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:12.205294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c69b50-2d6c-42de-a029-9f7fc9a2ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:12.206292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c69b50-2d6c-42de-a029-9f7fc9a2ca66 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:12.206823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c69b50-2d6c-42de-a029-9f7fc9a2ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:12.207103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c69b50-2d6c-42de-a029-9f7fc9a2ca66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:12.207764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c69b50-2d6c-42de-a029-9f7fc9a2ca66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:12.209540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c69b50-2d6c-42de-a029-9f7fc9a2ca66 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:12.221565 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3229/6514] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:12.225245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c69b50-2d6c-42de-a029-9f7fc9a2ca66 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:12.236241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c69b50-2d6c-42de-a029-9f7fc9a2ca66 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:12.241379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30209e3e-caad-47b9-b648-6de499a6fd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:12.242180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209e3e-caad-47b9-b648-6de499a6fd27 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:12.242555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209e3e-caad-47b9-b648-6de499a6fd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:12.243073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209e3e-caad-47b9-b648-6de499a6fd27 admin admin] PATH_INFO: `/v3/projects/b7c31944d8254301bfae09581c4e30b6/users/10fe073bcc1e4b06ab5286ae316f3bc6/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:12.282604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30209e3e-caad-47b9-b648-6de499a6fd27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c31944d8254301bfae09581c4e30b6, user_id=10fe073bcc1e4b06ab5286ae316f3bc6, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:12.285952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30209e3e-caad-47b9-b648-6de499a6fd27 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:12.310243 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3286/6515] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:12 2022] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:12.314827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e255a-613c-4e19-a1c3-0bdd3cbd8bcf admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:12.347095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e255a-613c-4e19-a1c3-0bdd3cbd8bcf admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:12.358704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd6ebf-dab2-4d76-9650-a3c6ac2f1e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:12.359856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd6ebf-dab2-4d76-9650-a3c6ac2f1e8c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:12.360053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd6ebf-dab2-4d76-9650-a3c6ac2f1e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:12.360512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd6ebf-dab2-4d76-9650-a3c6ac2f1e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:12.361312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd6ebf-dab2-4d76-9650-a3c6ac2f1e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:12.368890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd6ebf-dab2-4d76-9650-a3c6ac2f1e8c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:12.414708 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3230/6516] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:12 2022] PUT /identity/v3/projects/b7c31944d8254301bfae09581c4e30b6/users/10fe073bcc1e4b06ab5286ae316f3bc6/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:54:12.418210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30209e3e-caad-47b9-b648-6de499a6fd27 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:12.429324 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3287/6517] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:12.431218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd6ebf-dab2-4d76-9650-a3c6ac2f1e8c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:12.470461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd6ebf-dab2-4d76-9650-a3c6ac2f1e8c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:12.594698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30209e3e-caad-47b9-b648-6de499a6fd27 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:12.606814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60de532-af43-488e-88be-744daaffa6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:12.609078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60de532-af43-488e-88be-744daaffa6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:12.611397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60de532-af43-488e-88be-744daaffa6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:12.611770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60de532-af43-488e-88be-744daaffa6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:12.612845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60de532-af43-488e-88be-744daaffa6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:12.615645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60de532-af43-488e-88be-744daaffa6e7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:12.622015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc232666-8bf1-4875-843b-53dc968dc07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:12.622768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232666-8bf1-4875-843b-53dc968dc07d admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:12.625830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232666-8bf1-4875-843b-53dc968dc07d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:12.626028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232666-8bf1-4875-843b-53dc968dc07d admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:12.626804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc232666-8bf1-4875-843b-53dc968dc07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:12.628574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc232666-8bf1-4875-843b-53dc968dc07d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:12.645979 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3231/6518] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:12.651332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60de532-af43-488e-88be-744daaffa6e7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:12.690843 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3288/6519] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:12.696115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc232666-8bf1-4875-843b-53dc968dc07d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:12.717552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60de532-af43-488e-88be-744daaffa6e7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:12.746788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc232666-8bf1-4875-843b-53dc968dc07d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:12.751929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f1a64-1568-4aa6-9b7f-87b28a497234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:12.756145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f1a64-1568-4aa6-9b7f-87b28a497234 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:12.757044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f1a64-1568-4aa6-9b7f-87b28a497234 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:12.757741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f1a64-1568-4aa6-9b7f-87b28a497234 admin admin] PATH_INFO: `/v3/projects/b7c31944d8254301bfae09581c4e30b6/users/10fe073bcc1e4b06ab5286ae316f3bc6/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:12.767213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f1a64-1568-4aa6-9b7f-87b28a497234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c31944d8254301bfae09581c4e30b6, user_id=10fe073bcc1e4b06ab5286ae316f3bc6, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:12.770775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f1a64-1568-4aa6-9b7f-87b28a497234 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:12.770895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e76760-d37e-4181-8c9e-db0081737883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:12.771695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e76760-d37e-4181-8c9e-db0081737883 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:12.771981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e76760-d37e-4181-8c9e-db0081737883 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:12.772615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e76760-d37e-4181-8c9e-db0081737883 admin admin] PATH_INFO: `/v3/projects/943d29bc5da84159b5212022cd4435c4/users/7d62f6a70fc2481ba05341b9937d076c/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:12.797600 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3232/6520] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:12 2022] PUT /identity/v3/projects/b7c31944d8254301bfae09581c4e30b6/users/10fe073bcc1e4b06ab5286ae316f3bc6/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:12.811155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163ed64-bf3d-494f-856b-4e16166a4b96 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:12.811454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163ed64-bf3d-494f-856b-4e16166a4b96 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:12.811806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163ed64-bf3d-494f-856b-4e16166a4b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:12.826298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e76760-d37e-4181-8c9e-db0081737883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=943d29bc5da84159b5212022cd4435c4, user_id=7d62f6a70fc2481ba05341b9937d076c, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:12.829063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e76760-d37e-4181-8c9e-db0081737883 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:12.870494 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a163ed64-bf3d-494f-856b-4e16166a4b96 None None] MFA Rules not processed for user `10fe073bcc1e4b06ab5286ae316f3bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:12.871821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a163ed64-bf3d-494f-856b-4e16166a4b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:12.952130 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3289/6521] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:12 2022] PUT /identity/v3/projects/943d29bc5da84159b5212022cd4435c4/users/7d62f6a70fc2481ba05341b9937d076c/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:12.965162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f426cbf-92b0-4207-8ad1-6dfb3bf06ff9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:12.965705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f426cbf-92b0-4207-8ad1-6dfb3bf06ff9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:12.966903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f426cbf-92b0-4207-8ad1-6dfb3bf06ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:13.024439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4f426cbf-92b0-4207-8ad1-6dfb3bf06ff9 None None] MFA Rules not processed for user `7d62f6a70fc2481ba05341b9937d076c`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:13.025851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4f426cbf-92b0-4207-8ad1-6dfb3bf06ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:13.059387 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3233/6522] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:13.059575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163ed64-bf3d-494f-856b-4e16166a4b96 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:13.160116 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3290/6523] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:13.165291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f426cbf-92b0-4207-8ad1-6dfb3bf06ff9 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:13.169426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163ed64-bf3d-494f-856b-4e16166a4b96 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:13.281406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3acca1-27c3-4846-9a96-2b718d1a57f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:13.282391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3acca1-27c3-4846-9a96-2b718d1a57f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:13.282673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3acca1-27c3-4846-9a96-2b718d1a57f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:13.282943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3acca1-27c3-4846-9a96-2b718d1a57f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:13.285139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3acca1-27c3-4846-9a96-2b718d1a57f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:13.289861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3acca1-27c3-4846-9a96-2b718d1a57f7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:13.323133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:13.324945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f426cbf-92b0-4207-8ad1-6dfb3bf06ff9 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:13.332969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115555-23fc-4ae4-8bc9-022c5e79692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:13.333807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115555-23fc-4ae4-8bc9-022c5e79692c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:13.334190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115555-23fc-4ae4-8bc9-022c5e79692c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:13.334576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115555-23fc-4ae4-8bc9-022c5e79692c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:13.335413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc115555-23fc-4ae4-8bc9-022c5e79692c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:13.337567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc115555-23fc-4ae4-8bc9-022c5e79692c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:13.417302 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3234/6524] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:13 2022] POST /identity/v3/projects => generated 391 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:13.418781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3acca1-27c3-4846-9a96-2b718d1a57f7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:13.489526 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3291/6525] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:13 2022] POST /identity/v3/projects => generated 369 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:13.495247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115555-23fc-4ae4-8bc9-022c5e79692c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:13.535515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3acca1-27c3-4846-9a96-2b718d1a57f7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:13.592804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115555-23fc-4ae4-8bc9-022c5e79692c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:13.598226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4f844-a42d-4734-b2af-023a3dee3433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:13.598859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4f844-a42d-4734-b2af-023a3dee3433 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:13.615942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4f844-a42d-4734-b2af-023a3dee3433 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:13.616350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4f844-a42d-4734-b2af-023a3dee3433 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:13.619582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4f844-a42d-4734-b2af-023a3dee3433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:13.620010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dd3ae-97ad-4581-913a-de906ac15a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:13.620761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dd3ae-97ad-4581-913a-de906ac15a4d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:13.621140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dd3ae-97ad-4581-913a-de906ac15a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:13.621572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dd3ae-97ad-4581-913a-de906ac15a4d admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:13.621667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4f844-a42d-4734-b2af-023a3dee3433 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:13.622448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87dd3ae-97ad-4581-913a-de906ac15a4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:13.626311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87dd3ae-97ad-4581-913a-de906ac15a4d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:13.790816 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3292/6527] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:13 2022] POST /identity/v3/users => generated 291 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:13.791024 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3235/6527] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:13 2022] POST /identity/v3/users => generated 296 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:13.792208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dd3ae-97ad-4581-913a-de906ac15a4d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:13.794360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4f844-a42d-4734-b2af-023a3dee3433 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:13.806869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e1f4f844-a42d-4734-b2af-023a3dee3433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:13.827483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dd3ae-97ad-4581-913a-de906ac15a4d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:13.846884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4f844-a42d-4734-b2af-023a3dee3433 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:13.853819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5ab66-ebe3-4858-b156-34d4191faf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:13.864277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ab66-ebe3-4858-b156-34d4191faf79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:13.864277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ab66-ebe3-4858-b156-34d4191faf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:13.864277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ab66-ebe3-4858-b156-34d4191faf79 admin admin] PATH_INFO: `/v3/users/710ebe2be56346cc874d9d1a9dcb210b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:13.864277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5ab66-ebe3-4858-b156-34d4191faf79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=710ebe2be56346cc874d9d1a9dcb210b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:13.864727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43e47c-017e-4fcd-9b48-00d56929ba0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:13.864842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5ab66-ebe3-4858-b156-34d4191faf79 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:13.864914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43e47c-017e-4fcd-9b48-00d56929ba0d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:13.867795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43e47c-017e-4fcd-9b48-00d56929ba0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:13.871450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43e47c-017e-4fcd-9b48-00d56929ba0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:13.875258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43e47c-017e-4fcd-9b48-00d56929ba0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:13.885751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43e47c-017e-4fcd-9b48-00d56929ba0d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:13.907146 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3236/6528] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:13.908148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43e47c-017e-4fcd-9b48-00d56929ba0d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:13.919393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43e47c-017e-4fcd-9b48-00d56929ba0d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:13.925394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ed26e-f904-4b37-8fc1-6de39f7f4a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:13.926212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ed26e-f904-4b37-8fc1-6de39f7f4a2d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:13.926499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ed26e-f904-4b37-8fc1-6de39f7f4a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:13.926772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ed26e-f904-4b37-8fc1-6de39f7f4a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:13.928196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ed26e-f904-4b37-8fc1-6de39f7f4a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:13.929876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ed26e-f904-4b37-8fc1-6de39f7f4a2d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:13.944919 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3237/6529] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:13.946528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddee17-dbdb-4621-9c92-957a7bbe6967 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:13.946827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddee17-dbdb-4621-9c92-957a7bbe6967 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:13.947108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddee17-dbdb-4621-9c92-957a7bbe6967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:13.981839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3cddee17-dbdb-4621-9c92-957a7bbe6967 None None] MFA Rules not processed for user `7fb8a950bb584362b2b6f17f8013aa9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:13.983134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3cddee17-dbdb-4621-9c92-957a7bbe6967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:14.068512 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3238/6530] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:13 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:14.075391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddee17-dbdb-4621-9c92-957a7bbe6967 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:14.116852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddee17-dbdb-4621-9c92-957a7bbe6967 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:14.126728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4dd89-59a9-4977-a3e4-999d9aea94ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:14.127475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4dd89-59a9-4977-a3e4-999d9aea94ed admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:14.127847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4dd89-59a9-4977-a3e4-999d9aea94ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:14.130236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4dd89-59a9-4977-a3e4-999d9aea94ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:14.130236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4dd89-59a9-4977-a3e4-999d9aea94ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:14.132772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4dd89-59a9-4977-a3e4-999d9aea94ed admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:14.160437 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3239/6531] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:14.160437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4dd89-59a9-4977-a3e4-999d9aea94ed admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:14.173235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4dd89-59a9-4977-a3e4-999d9aea94ed admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:14.179345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47514c6b-420c-4906-a40e-78e8e7eed250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:14.180487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47514c6b-420c-4906-a40e-78e8e7eed250 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:14.180950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47514c6b-420c-4906-a40e-78e8e7eed250 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:14.181368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47514c6b-420c-4906-a40e-78e8e7eed250 admin admin] PATH_INFO: `/v3/projects/75242710afb742d1bf54731062bd5cba/users/b6abe8e24472473db0db24442dbea5f3/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:14.213672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47514c6b-420c-4906-a40e-78e8e7eed250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75242710afb742d1bf54731062bd5cba, user_id=b6abe8e24472473db0db24442dbea5f3, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:14.220964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47514c6b-420c-4906-a40e-78e8e7eed250 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:14.296300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1da5ab66-ebe3-4858-b156-34d4191faf79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '710ebe2be56346cc874d9d1a9dcb210b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:14.297292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1da5ab66-ebe3-4858-b156-34d4191faf79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '710ebe2be56346cc874d9d1a9dcb210b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:14.336005 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3240/6532] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:14 2022] PUT /identity/v3/projects/75242710afb742d1bf54731062bd5cba/users/b6abe8e24472473db0db24442dbea5f3/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:14.336628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47514c6b-420c-4906-a40e-78e8e7eed250 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:14.343038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-47514c6b-420c-4906-a40e-78e8e7eed250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:14.430816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1da5ab66-ebe3-4858-b156-34d4191faf79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '710ebe2be56346cc874d9d1a9dcb210b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:14.435559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1da5ab66-ebe3-4858-b156-34d4191faf79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '710ebe2be56346cc874d9d1a9dcb210b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:14.442072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:14.454517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1da5ab66-ebe3-4858-b156-34d4191faf79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '710ebe2be56346cc874d9d1a9dcb210b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:14.481120 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3293/6533] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:13 2022] DELETE /identity/v3/users/710ebe2be56346cc874d9d1a9dcb210b => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:14.483031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5ab66-ebe3-4858-b156-34d4191faf79 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:14.486300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1da5ab66-ebe3-4858-b156-34d4191faf79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:14.498370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47514c6b-420c-4906-a40e-78e8e7eed250 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:14.587343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233bf4f-1c2a-4a0a-a64c-d85c85c6ef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:14.587965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233bf4f-1c2a-4a0a-a64c-d85c85c6ef07 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:14.588413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233bf4f-1c2a-4a0a-a64c-d85c85c6ef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:14.588915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233bf4f-1c2a-4a0a-a64c-d85c85c6ef07 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:14.589568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233bf4f-1c2a-4a0a-a64c-d85c85c6ef07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:14.590708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5ab66-ebe3-4858-b156-34d4191faf79 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:14.591705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233bf4f-1c2a-4a0a-a64c-d85c85c6ef07 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:14.610284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2999c6-7d05-46b8-b637-007ee205bfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:14.610965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2999c6-7d05-46b8-b637-007ee205bfb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:14.611104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2999c6-7d05-46b8-b637-007ee205bfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:14.611377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2999c6-7d05-46b8-b637-007ee205bfb9 admin admin] PATH_INFO: `/v3/projects/43786fceab1f44828181d58206de7d22/users/8e84edf87f5448e7949b4d1c2e790494/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:14.632229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2999c6-7d05-46b8-b637-007ee205bfb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43786fceab1f44828181d58206de7d22, user_id=8e84edf87f5448e7949b4d1c2e790494, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:14.635064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2999c6-7d05-46b8-b637-007ee205bfb9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:14.705423 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3241/6534] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:14 2022] POST /identity/v3/projects => generated 405 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:14.705423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233bf4f-1c2a-4a0a-a64c-d85c85c6ef07 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:14.706490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1233bf4f-1c2a-4a0a-a64c-d85c85c6ef07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:14.739567 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3294/6535] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:14 2022] PUT /identity/v3/projects/43786fceab1f44828181d58206de7d22/users/8e84edf87f5448e7949b4d1c2e790494/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:14.739567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750ae9-4f98-436b-86fa-f4b11316766d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:14.739567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750ae9-4f98-436b-86fa-f4b11316766d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:14.739567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750ae9-4f98-436b-86fa-f4b11316766d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:14.783722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-47750ae9-4f98-436b-86fa-f4b11316766d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:14.784945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-47750ae9-4f98-436b-86fa-f4b11316766d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:14.819412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233bf4f-1c2a-4a0a-a64c-d85c85c6ef07 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:14.967132 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3295/6536] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:14.967132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47750ae9-4f98-436b-86fa-f4b11316766d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:14.967132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-47750ae9-4f98-436b-86fa-f4b11316766d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:14.970976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d7e90-80b0-41ac-ae88-3887a4974f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:14.971161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d7e90-80b0-41ac-ae88-3887a4974f63 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:14.973220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d7e90-80b0-41ac-ae88-3887a4974f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:14.974548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d7e90-80b0-41ac-ae88-3887a4974f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:14.975947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d7e90-80b0-41ac-ae88-3887a4974f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:14.980277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d7e90-80b0-41ac-ae88-3887a4974f63 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:15.006545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47750ae9-4f98-436b-86fa-f4b11316766d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:15.010118 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3242/6537] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:15.013431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cdd02-4df2-4526-9615-d309980f43a3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:15.013832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cdd02-4df2-4526-9615-d309980f43a3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:15.014200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cdd02-4df2-4526-9615-d309980f43a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:15.017994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cf8b3-f292-4c82-89f7-93dc17635402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:15.018626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cf8b3-f292-4c82-89f7-93dc17635402 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:15.018906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cf8b3-f292-4c82-89f7-93dc17635402 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:15.019180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cf8b3-f292-4c82-89f7-93dc17635402 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:15.019814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79cf8b3-f292-4c82-89f7-93dc17635402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:15.021782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79cf8b3-f292-4c82-89f7-93dc17635402 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:15.098839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9e4cdd02-4df2-4526-9615-d309980f43a3 None None] MFA Rules not processed for user `8e84edf87f5448e7949b4d1c2e790494`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:15.100645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9e4cdd02-4df2-4526-9615-d309980f43a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:15.247678 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3243/6538] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:15.247678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cdd02-4df2-4526-9615-d309980f43a3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:15.268010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cdd02-4df2-4526-9615-d309980f43a3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:15.272912 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3296/6539] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:14 2022] POST /identity/v3/users => generated 309 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:15.272912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cf8b3-f292-4c82-89f7-93dc17635402 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:15.274893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c79cf8b3-f292-4c82-89f7-93dc17635402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:15.276243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f927121-ffb2-437c-a5fa-03a3f2a6c426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:15.277040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f927121-ffb2-437c-a5fa-03a3f2a6c426 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:15.277579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f927121-ffb2-437c-a5fa-03a3f2a6c426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:15.278005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f927121-ffb2-437c-a5fa-03a3f2a6c426 admin admin] PATH_INFO: `/v3/projects/75242710afb742d1bf54731062bd5cba/users/b6abe8e24472473db0db24442dbea5f3/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:15.280126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f927121-ffb2-437c-a5fa-03a3f2a6c426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75242710afb742d1bf54731062bd5cba, user_id=b6abe8e24472473db0db24442dbea5f3, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:15.283564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f927121-ffb2-437c-a5fa-03a3f2a6c426 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:15.301786 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3244/6540] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:15 2022] PUT /identity/v3/projects/75242710afb742d1bf54731062bd5cba/users/b6abe8e24472473db0db24442dbea5f3/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:15.303855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f927121-ffb2-437c-a5fa-03a3f2a6c426 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:15.304755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3f927121-ffb2-437c-a5fa-03a3f2a6c426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:15.388774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cf8b3-f292-4c82-89f7-93dc17635402 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:15.430331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f927121-ffb2-437c-a5fa-03a3f2a6c426 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:15.452766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f2d7c-e874-4a04-ac5e-9b41add8518b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:15.456683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941e3bd-60c6-413d-b75c-ca23c8f04f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:15.459148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941e3bd-60c6-413d-b75c-ca23c8f04f21 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:15.459148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941e3bd-60c6-413d-b75c-ca23c8f04f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:15.459148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941e3bd-60c6-413d-b75c-ca23c8f04f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:15.459459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f2d7c-e874-4a04-ac5e-9b41add8518b service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:15.460439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f2d7c-e874-4a04-ac5e-9b41add8518b service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:15.460991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f2d7c-e874-4a04-ac5e-9b41add8518b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:15.466929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e07f2d7c-e874-4a04-ac5e-9b41add8518b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:15.538140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941e3bd-60c6-413d-b75c-ca23c8f04f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:15.539971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941e3bd-60c6-413d-b75c-ca23c8f04f21 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:15.557452 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3297/6541] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:15.558561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941e3bd-60c6-413d-b75c-ca23c8f04f21 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:15.570797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941e3bd-60c6-413d-b75c-ca23c8f04f21 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:15.576095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a570389-33f2-4024-81c6-e2484c8f4a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:15.576952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a570389-33f2-4024-81c6-e2484c8f4a05 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:15.577380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a570389-33f2-4024-81c6-e2484c8f4a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:15.577872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a570389-33f2-4024-81c6-e2484c8f4a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:15.578822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a570389-33f2-4024-81c6-e2484c8f4a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:15.580699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a570389-33f2-4024-81c6-e2484c8f4a05 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:15.595392 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3298/6542] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:15.596456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617b069-9ccb-4017-aadd-e478b5b180e4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:15.596745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617b069-9ccb-4017-aadd-e478b5b180e4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:15.597020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617b069-9ccb-4017-aadd-e478b5b180e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:15.683441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5617b069-9ccb-4017-aadd-e478b5b180e4 None None] MFA Rules not processed for user `b6abe8e24472473db0db24442dbea5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:15.684749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5617b069-9ccb-4017-aadd-e478b5b180e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:15.730306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f2d7c-e874-4a04-ac5e-9b41add8518b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:15.733202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f2d7c-e874-4a04-ac5e-9b41add8518b service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:15.762100 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3245/6543] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:15 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:15.793555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f2d7c-e874-4a04-ac5e-9b41add8518b service glance] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:15.835624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f2d7c-e874-4a04-ac5e-9b41add8518b service glance] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:15.884979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd39acf-f10d-4394-b1bc-65af295010c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:15.884979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd39acf-f10d-4394-b1bc-65af295010c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:15.884979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd39acf-f10d-4394-b1bc-65af295010c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:15.884979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd39acf-f10d-4394-b1bc-65af295010c4 admin admin] PATH_INFO: `/v3/projects/859a18493e1843c6a3ef66c8939d25e5/users/4bc85b309b7f42d0878c38893884cdd1/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:15.945267 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3299/6544] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:15.977266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd39acf-f10d-4394-b1bc-65af295010c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859a18493e1843c6a3ef66c8939d25e5, user_id=4bc85b309b7f42d0878c38893884cdd1, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:15.994682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd39acf-f10d-4394-b1bc-65af295010c4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:16.065317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:16.075719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617b069-9ccb-4017-aadd-e478b5b180e4 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:16.110141 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3246/6545] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:15 2022] PUT /identity/v3/projects/859a18493e1843c6a3ef66c8939d25e5/users/4bc85b309b7f42d0878c38893884cdd1/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:16.114929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd39acf-f10d-4394-b1bc-65af295010c4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:16.123757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617b069-9ccb-4017-aadd-e478b5b180e4 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:16.292638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debebe05-fe1a-4922-96f9-ade201caa7dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:16.293280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debebe05-fe1a-4922-96f9-ade201caa7dd service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:16.294751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debebe05-fe1a-4922-96f9-ade201caa7dd service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:16.295275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debebe05-fe1a-4922-96f9-ade201caa7dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:16.303017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd39acf-f10d-4394-b1bc-65af295010c4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:16.320783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee00d53-63ae-4d0f-897d-e686c0461fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:16.321755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee00d53-63ae-4d0f-897d-e686c0461fbd admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:16.322085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee00d53-63ae-4d0f-897d-e686c0461fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:16.322434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee00d53-63ae-4d0f-897d-e686c0461fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:16.323167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee00d53-63ae-4d0f-897d-e686c0461fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:16.339585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee00d53-63ae-4d0f-897d-e686c0461fbd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:16.375417 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3247/6546] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:16.380429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee00d53-63ae-4d0f-897d-e686c0461fbd admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:16.416067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee00d53-63ae-4d0f-897d-e686c0461fbd admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:16.433770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657361c5-4f70-44e7-8002-1906c6b90d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:16.434632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657361c5-4f70-44e7-8002-1906c6b90d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:16.434990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657361c5-4f70-44e7-8002-1906c6b90d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:16.435345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657361c5-4f70-44e7-8002-1906c6b90d66 admin admin] PATH_INFO: `/v3/projects/859a18493e1843c6a3ef66c8939d25e5/users/4bc85b309b7f42d0878c38893884cdd1/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:16.441551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657361c5-4f70-44e7-8002-1906c6b90d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859a18493e1843c6a3ef66c8939d25e5, user_id=4bc85b309b7f42d0878c38893884cdd1, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:16.452397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657361c5-4f70-44e7-8002-1906c6b90d66 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:16.475311 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3248/6547] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:16 2022] PUT /identity/v3/projects/859a18493e1843c6a3ef66c8939d25e5/users/4bc85b309b7f42d0878c38893884cdd1/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:16.513334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debebe05-fe1a-4922-96f9-ade201caa7dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:16.515628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debebe05-fe1a-4922-96f9-ade201caa7dd service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:16.549224 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3300/6548] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:16.564290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:16.741334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657361c5-4f70-44e7-8002-1906c6b90d66 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:16.744853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-657361c5-4f70-44e7-8002-1906c6b90d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:16.913748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657361c5-4f70-44e7-8002-1906c6b90d66 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:16.926263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824da4d7-9d3b-41c6-8de5-2de833d96a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:16.926930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824da4d7-9d3b-41c6-8de5-2de833d96a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:16.927202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824da4d7-9d3b-41c6-8de5-2de833d96a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:16.927479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824da4d7-9d3b-41c6-8de5-2de833d96a79 admin admin] PATH_INFO: `/v3/projects/cfebb1aea5ca4732b4122c79f7970c03` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:16.928681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824da4d7-9d3b-41c6-8de5-2de833d96a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfebb1aea5ca4732b4122c79f7970c03)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:16.930606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824da4d7-9d3b-41c6-8de5-2de833d96a79 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:17.147582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-824da4d7-9d3b-41c6-8de5-2de833d96a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfebb1aea5ca4732b4122c79f7970c03', 'request_id': 'req-824da4d7-9d3b-41c6-8de5-2de833d96a79'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:17.164605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-824da4d7-9d3b-41c6-8de5-2de833d96a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfebb1aea5ca4732b4122c79f7970c03', 'request_id': 'req-824da4d7-9d3b-41c6-8de5-2de833d96a79'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:17.182588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-824da4d7-9d3b-41c6-8de5-2de833d96a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfebb1aea5ca4732b4122c79f7970c03', 'request_id': 'req-824da4d7-9d3b-41c6-8de5-2de833d96a79'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:17.327869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-824da4d7-9d3b-41c6-8de5-2de833d96a79 admin admin] The token cache is being invalidate because project cfebb1aea5ca4732b4122c79f7970c03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:17.328751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-824da4d7-9d3b-41c6-8de5-2de833d96a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:17.330121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-824da4d7-9d3b-41c6-8de5-2de833d96a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:17.338310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debebe05-fe1a-4922-96f9-ade201caa7dd service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:17.340081 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3249/6549] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:16 2022] DELETE /identity/v3/projects/cfebb1aea5ca4732b4122c79f7970c03 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:17.346560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:17.355076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debebe05-fe1a-4922-96f9-ade201caa7dd service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:17.626578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37aa05-3974-4ca2-9c53-4402d0430195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:17.628490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37aa05-3974-4ca2-9c53-4402d0430195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:17.630167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37aa05-3974-4ca2-9c53-4402d0430195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:17.630661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37aa05-3974-4ca2-9c53-4402d0430195 admin admin] PATH_INFO: `/v3/users/deafd39b516a43f393cd570d24851664` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:17.635023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37aa05-3974-4ca2-9c53-4402d0430195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deafd39b516a43f393cd570d24851664)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:17.639851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37aa05-3974-4ca2-9c53-4402d0430195 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:17.924795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3e37aa05-3974-4ca2-9c53-4402d0430195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deafd39b516a43f393cd570d24851664'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:17.925716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3e37aa05-3974-4ca2-9c53-4402d0430195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deafd39b516a43f393cd570d24851664'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:18.019787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3e37aa05-3974-4ca2-9c53-4402d0430195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deafd39b516a43f393cd570d24851664'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:18.021174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3e37aa05-3974-4ca2-9c53-4402d0430195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deafd39b516a43f393cd570d24851664'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:18.049633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3e37aa05-3974-4ca2-9c53-4402d0430195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deafd39b516a43f393cd570d24851664'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:18.085353 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3301/6550] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:17 2022] DELETE /identity/v3/users/deafd39b516a43f393cd570d24851664 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:18.682918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=10,keystone:SELECT=85,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:18.988544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824da4d7-9d3b-41c6-8de5-2de833d96a79 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:18.990016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-824da4d7-9d3b-41c6-8de5-2de833d96a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:19.017545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824da4d7-9d3b-41c6-8de5-2de833d96a79 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:19.142189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bdaef-3cb2-4bc3-8374-d9b7a3937d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:19.143081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bdaef-3cb2-4bc3-8374-d9b7a3937d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:19.143738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bdaef-3cb2-4bc3-8374-d9b7a3937d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:19.144190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bdaef-3cb2-4bc3-8374-d9b7a3937d75 admin admin] PATH_INFO: `/v3/users/10fe073bcc1e4b06ab5286ae316f3bc6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:19.145993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bdaef-3cb2-4bc3-8374-d9b7a3937d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10fe073bcc1e4b06ab5286ae316f3bc6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:19.148316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bdaef-3cb2-4bc3-8374-d9b7a3937d75 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:19.426435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37aa05-3974-4ca2-9c53-4402d0430195 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:19.427932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3e37aa05-3974-4ca2-9c53-4402d0430195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:19.438665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-807bdaef-3cb2-4bc3-8374-d9b7a3937d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10fe073bcc1e4b06ab5286ae316f3bc6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:19.450092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37aa05-3974-4ca2-9c53-4402d0430195 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:19.467957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7366a3-27ad-438a-a1cf-8f74bbb6a6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:19.469402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7366a3-27ad-438a-a1cf-8f74bbb6a6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:19.477221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7366a3-27ad-438a-a1cf-8f74bbb6a6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:19.477221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7366a3-27ad-438a-a1cf-8f74bbb6a6e1 admin admin] PATH_INFO: `/v3/projects/f6e26629f10141cfb685028df5ac2576` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:19.477221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7366a3-27ad-438a-a1cf-8f74bbb6a6e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e26629f10141cfb685028df5ac2576)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:19.477221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7366a3-27ad-438a-a1cf-8f74bbb6a6e1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:19.494437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:19.551535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-807bdaef-3cb2-4bc3-8374-d9b7a3937d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10fe073bcc1e4b06ab5286ae316f3bc6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:19.552728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-807bdaef-3cb2-4bc3-8374-d9b7a3937d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10fe073bcc1e4b06ab5286ae316f3bc6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:19.562050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-807bdaef-3cb2-4bc3-8374-d9b7a3937d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10fe073bcc1e4b06ab5286ae316f3bc6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:19.605016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-807bdaef-3cb2-4bc3-8374-d9b7a3937d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10fe073bcc1e4b06ab5286ae316f3bc6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:19.635859 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3250/6551] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:18 2022] DELETE /identity/v3/users/10fe073bcc1e4b06ab5286ae316f3bc6 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:19.644698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89108cf0-37c7-448a-969f-ba10615db3ac None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:19.646004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89108cf0-37c7-448a-969f-ba10615db3ac None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:19.646486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89108cf0-37c7-448a-969f-ba10615db3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:19.693725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad7366a3-27ad-438a-a1cf-8f74bbb6a6e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e26629f10141cfb685028df5ac2576', 'request_id': 'req-ad7366a3-27ad-438a-a1cf-8f74bbb6a6e1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:19.695651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-89108cf0-37c7-448a-969f-ba10615db3ac None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:19.697557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-89108cf0-37c7-448a-969f-ba10615db3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:19.715123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad7366a3-27ad-438a-a1cf-8f74bbb6a6e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e26629f10141cfb685028df5ac2576', 'request_id': 'req-ad7366a3-27ad-438a-a1cf-8f74bbb6a6e1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:19.821394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad7366a3-27ad-438a-a1cf-8f74bbb6a6e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e26629f10141cfb685028df5ac2576', 'request_id': 'req-ad7366a3-27ad-438a-a1cf-8f74bbb6a6e1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:19.856591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad7366a3-27ad-438a-a1cf-8f74bbb6a6e1 admin admin] The token cache is being invalidate because project f6e26629f10141cfb685028df5ac2576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:19.856770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad7366a3-27ad-438a-a1cf-8f74bbb6a6e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:19.864024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad7366a3-27ad-438a-a1cf-8f74bbb6a6e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:19.866005 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3302/6552] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:19 2022] DELETE /identity/v3/projects/f6e26629f10141cfb685028df5ac2576 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:19.870661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a00423-4eb8-4aaf-951a-73afd8b2d5e2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:19.870946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a00423-4eb8-4aaf-951a-73afd8b2d5e2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:19.871226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a00423-4eb8-4aaf-951a-73afd8b2d5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:19.913668 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3251/6553] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:54:19.918932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b0a00423-4eb8-4aaf-951a-73afd8b2d5e2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:19.922327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b0a00423-4eb8-4aaf-951a-73afd8b2d5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:19.946794 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3303/6554] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:19.965996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44beb88f-377e-414c-96f1-ae279127ad4d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:19.966593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44beb88f-377e-414c-96f1-ae279127ad4d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:19.967092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44beb88f-377e-414c-96f1-ae279127ad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:20.005784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a00423-4eb8-4aaf-951a-73afd8b2d5e2 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:20.011627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b0a00423-4eb8-4aaf-951a-73afd8b2d5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:20.031473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-44beb88f-377e-414c-96f1-ae279127ad4d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:20.033434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-44beb88f-377e-414c-96f1-ae279127ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:20.053842 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3252/6555] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:54:20.055951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44beb88f-377e-414c-96f1-ae279127ad4d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:20.097610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44beb88f-377e-414c-96f1-ae279127ad4d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:20.130049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78468f7-0ae3-4fbb-b56f-a1c28044708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:20.135978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78468f7-0ae3-4fbb-b56f-a1c28044708c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:20.136540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78468f7-0ae3-4fbb-b56f-a1c28044708c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:20.139326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78468f7-0ae3-4fbb-b56f-a1c28044708c admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:20.142042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78468f7-0ae3-4fbb-b56f-a1c28044708c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:20.145769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78468f7-0ae3-4fbb-b56f-a1c28044708c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:20.147953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78468f7-0ae3-4fbb-b56f-a1c28044708c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:20.202737 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3253/6556] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:20.205266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78468f7-0ae3-4fbb-b56f-a1c28044708c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:20.268366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78468f7-0ae3-4fbb-b56f-a1c28044708c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:20.271587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a00423-4eb8-4aaf-951a-73afd8b2d5e2 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:20.281693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e167979-926d-401b-a78f-69d4eb41466b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:20.282435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167979-926d-401b-a78f-69d4eb41466b service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:20.282758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167979-926d-401b-a78f-69d4eb41466b service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:20.283036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167979-926d-401b-a78f-69d4eb41466b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:20.286908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ed41d-320f-487b-9639-0025460feca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:20.287557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ed41d-320f-487b-9639-0025460feca6 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:20.287839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ed41d-320f-487b-9639-0025460feca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:20.288113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ed41d-320f-487b-9639-0025460feca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:20.297415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ed41d-320f-487b-9639-0025460feca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:20.299649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ed41d-320f-487b-9639-0025460feca6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:20.326860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e167979-926d-401b-a78f-69d4eb41466b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:20.331806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e167979-926d-401b-a78f-69d4eb41466b service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:20.399207 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3304/6557] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:20.400268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e167979-926d-401b-a78f-69d4eb41466b service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:20.408619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3e167979-926d-401b-a78f-69d4eb41466b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:20.451184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e167979-926d-401b-a78f-69d4eb41466b service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:20.471176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414b750-c2f6-4048-9975-151d0bb38fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:20.471771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414b750-c2f6-4048-9975-151d0bb38fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:20.472142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414b750-c2f6-4048-9975-151d0bb38fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:20.472456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414b750-c2f6-4048-9975-151d0bb38fb2 admin admin] PATH_INFO: `/v3/users/ab105c4505374ce0b34372797e8ae240` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:20.477422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414b750-c2f6-4048-9975-151d0bb38fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab105c4505374ce0b34372797e8ae240)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:20.486729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414b750-c2f6-4048-9975-151d0bb38fb2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:20.536822 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3254/6558] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:20 2022] POST /identity/v3/projects => generated 397 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:20.537931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ed41d-320f-487b-9639-0025460feca6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:20.676140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ed41d-320f-487b-9639-0025460feca6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:20.684425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f96d62-7a6f-42dd-be86-7c808c52248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:20.685059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f96d62-7a6f-42dd-be86-7c808c52248d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:20.685416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f96d62-7a6f-42dd-be86-7c808c52248d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:20.685612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f96d62-7a6f-42dd-be86-7c808c52248d admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:20.689797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f96d62-7a6f-42dd-be86-7c808c52248d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:20.692867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f96d62-7a6f-42dd-be86-7c808c52248d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:20.746390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:20.804984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d414b750-c2f6-4048-9975-151d0bb38fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab105c4505374ce0b34372797e8ae240'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:20.806712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d414b750-c2f6-4048-9975-151d0bb38fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab105c4505374ce0b34372797e8ae240'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:20.865689 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3255/6559] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:20 2022] POST /identity/v3/users => generated 299 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:20.871216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f96d62-7a6f-42dd-be86-7c808c52248d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:20.893698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f96d62-7a6f-42dd-be86-7c808c52248d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:20.899303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054145c-1a4a-4d5a-b718-ae53e2ec3329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:20.900704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054145c-1a4a-4d5a-b718-ae53e2ec3329 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:20.901208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054145c-1a4a-4d5a-b718-ae53e2ec3329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:20.901741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054145c-1a4a-4d5a-b718-ae53e2ec3329 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:20.902919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054145c-1a4a-4d5a-b718-ae53e2ec3329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:20.904918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054145c-1a4a-4d5a-b718-ae53e2ec3329 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:20.918211 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3256/6560] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:20.922252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054145c-1a4a-4d5a-b718-ae53e2ec3329 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:20.933863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054145c-1a4a-4d5a-b718-ae53e2ec3329 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:20.939601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d414b750-c2f6-4048-9975-151d0bb38fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab105c4505374ce0b34372797e8ae240'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:20.940486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d414b750-c2f6-4048-9975-151d0bb38fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab105c4505374ce0b34372797e8ae240'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:20.954670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd4b32-adfb-425b-b989-8bd5a1a12b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:20.962313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd4b32-adfb-425b-b989-8bd5a1a12b9f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:20.962313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd4b32-adfb-425b-b989-8bd5a1a12b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:20.962313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd4b32-adfb-425b-b989-8bd5a1a12b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:20.962313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd4b32-adfb-425b-b989-8bd5a1a12b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:20.963883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d414b750-c2f6-4048-9975-151d0bb38fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab105c4505374ce0b34372797e8ae240'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:20.965682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd4b32-adfb-425b-b989-8bd5a1a12b9f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:21.003532 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3305/6561] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:20 2022] DELETE /identity/v3/users/ab105c4505374ce0b34372797e8ae240 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:21.004745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414b750-c2f6-4048-9975-151d0bb38fb2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:21.005261 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3257/6562] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:54:21.008531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b34f12-ee1c-4cb6-abf9-abab798caa3a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:21.010769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b34f12-ee1c-4cb6-abf9-abab798caa3a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:21.011295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b34f12-ee1c-4cb6-abf9-abab798caa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:21.011537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d414b750-c2f6-4048-9975-151d0bb38fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:21.071012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-49b34f12-ee1c-4cb6-abf9-abab798caa3a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:21.073959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-49b34f12-ee1c-4cb6-abf9-abab798caa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:21.106206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:21.166686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414b750-c2f6-4048-9975-151d0bb38fb2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:21.173202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0f87a-5cc0-4bf3-b11d-a1fb1b5b51a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:21.174379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0f87a-5cc0-4bf3-b11d-a1fb1b5b51a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:21.175816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0f87a-5cc0-4bf3-b11d-a1fb1b5b51a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:21.176368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0f87a-5cc0-4bf3-b11d-a1fb1b5b51a7 admin admin] PATH_INFO: `/v3/projects/5487d3e115904527858abc7be7714782/users/e2cff95b0d444598a43aa9458b78413a/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:21.197616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0f87a-5cc0-4bf3-b11d-a1fb1b5b51a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5487d3e115904527858abc7be7714782, user_id=e2cff95b0d444598a43aa9458b78413a, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:21.202084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0f87a-5cc0-4bf3-b11d-a1fb1b5b51a7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:21.257285 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3258/6563] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:21.301614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b34f12-ee1c-4cb6-abf9-abab798caa3a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:21.303122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-49b34f12-ee1c-4cb6-abf9-abab798caa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:21.352698 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3306/6564] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:21 2022] PUT /identity/v3/projects/5487d3e115904527858abc7be7714782/users/e2cff95b0d444598a43aa9458b78413a/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:21.371072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aba15-c733-44fb-be28-4deb1bb8b3ea None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:21.371451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aba15-c733-44fb-be28-4deb1bb8b3ea None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:21.371799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aba15-c733-44fb-be28-4deb1bb8b3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:21.462811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4b1aba15-c733-44fb-be28-4deb1bb8b3ea None None] MFA Rules not processed for user `e2cff95b0d444598a43aa9458b78413a`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:21.469348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4b1aba15-c733-44fb-be28-4deb1bb8b3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:21.484866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b34f12-ee1c-4cb6-abf9-abab798caa3a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:21.642319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f6404-e0d0-40fa-9385-65a48d7413a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:21.642957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6404-e0d0-40fa-9385-65a48d7413a4 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:21.643237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6404-e0d0-40fa-9385-65a48d7413a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:21.643506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6404-e0d0-40fa-9385-65a48d7413a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:21.741577 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3307/6565] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:21 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:21.797354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f6404-e0d0-40fa-9385-65a48d7413a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:21.798933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f6404-e0d0-40fa-9385-65a48d7413a4 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:21.833907 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3259/6566] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:54:21.911422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aba15-c733-44fb-be28-4deb1bb8b3ea None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:21.931177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aba15-c733-44fb-be28-4deb1bb8b3ea None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:21.941564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443648a-3d11-426e-8527-6ed015fab6c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:21.942543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443648a-3d11-426e-8527-6ed015fab6c7 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:21.943251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443648a-3d11-426e-8527-6ed015fab6c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:21.943750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443648a-3d11-426e-8527-6ed015fab6c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:21.966932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443648a-3d11-426e-8527-6ed015fab6c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:21.975561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443648a-3d11-426e-8527-6ed015fab6c7 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:22.012708 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3308/6567] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:21 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:22.156398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b868c1-21be-457e-a9c0-3c8a9a36d105 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:22.156853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b868c1-21be-457e-a9c0-3c8a9a36d105 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:22.157141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b868c1-21be-457e-a9c0-3c8a9a36d105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:22.266258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e8b868c1-21be-457e-a9c0-3c8a9a36d105 None None] MFA Rules not processed for user `4bc85b309b7f42d0878c38893884cdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:22.267570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e8b868c1-21be-457e-a9c0-3c8a9a36d105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:22.477270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443648a-3d11-426e-8527-6ed015fab6c7 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:22.480995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5443648a-3d11-426e-8527-6ed015fab6c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:22.543177 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3260/6568] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:22 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:22.568791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443648a-3d11-426e-8527-6ed015fab6c7 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:22.612200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bf5a1-481d-404b-a6d1-35c68e944757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:22.621519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bf5a1-481d-404b-a6d1-35c68e944757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:22.621850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bf5a1-481d-404b-a6d1-35c68e944757 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:22.626359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bf5a1-481d-404b-a6d1-35c68e944757 admin admin] PATH_INFO: `/v3/projects/b7c31944d8254301bfae09581c4e30b6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:22.635586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bf5a1-481d-404b-a6d1-35c68e944757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c31944d8254301bfae09581c4e30b6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:22.646884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bf5a1-481d-404b-a6d1-35c68e944757 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:22.717006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:23.003751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-db4bf5a1-481d-404b-a6d1-35c68e944757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c31944d8254301bfae09581c4e30b6', 'request_id': 'req-db4bf5a1-481d-404b-a6d1-35c68e944757'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:23.018830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-db4bf5a1-481d-404b-a6d1-35c68e944757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c31944d8254301bfae09581c4e30b6', 'request_id': 'req-db4bf5a1-481d-404b-a6d1-35c68e944757'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:23.127672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-db4bf5a1-481d-404b-a6d1-35c68e944757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c31944d8254301bfae09581c4e30b6', 'request_id': 'req-db4bf5a1-481d-404b-a6d1-35c68e944757'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:23.165544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-db4bf5a1-481d-404b-a6d1-35c68e944757 admin admin] The token cache is being invalidate because project b7c31944d8254301bfae09581c4e30b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:23.168432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-db4bf5a1-481d-404b-a6d1-35c68e944757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:23.170835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-db4bf5a1-481d-404b-a6d1-35c68e944757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:23.177850 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3309/6569] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:22 2022] DELETE /identity/v3/projects/b7c31944d8254301bfae09581c4e30b6 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:23.182268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b868c1-21be-457e-a9c0-3c8a9a36d105 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:23.197552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b868c1-21be-457e-a9c0-3c8a9a36d105 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:23.333926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e7ca3-6361-44c6-b431-58fb463a3293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:23.334859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e7ca3-6361-44c6-b431-58fb463a3293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:23.335249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e7ca3-6361-44c6-b431-58fb463a3293 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:23.335637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e7ca3-6361-44c6-b431-58fb463a3293 admin admin] PATH_INFO: `/v3/users/8e84edf87f5448e7949b4d1c2e790494` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:23.337058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e7ca3-6361-44c6-b431-58fb463a3293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e84edf87f5448e7949b4d1c2e790494)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:23.341215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e7ca3-6361-44c6-b431-58fb463a3293 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:23.641378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-af9e7ca3-6361-44c6-b431-58fb463a3293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e84edf87f5448e7949b4d1c2e790494'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:23.737690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-af9e7ca3-6361-44c6-b431-58fb463a3293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e84edf87f5448e7949b4d1c2e790494'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:23.738441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-af9e7ca3-6361-44c6-b431-58fb463a3293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e84edf87f5448e7949b4d1c2e790494'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:23.751907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-af9e7ca3-6361-44c6-b431-58fb463a3293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e84edf87f5448e7949b4d1c2e790494'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:23.778486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-af9e7ca3-6361-44c6-b431-58fb463a3293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e84edf87f5448e7949b4d1c2e790494'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:23.800084 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3261/6570] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:23 2022] DELETE /identity/v3/users/8e84edf87f5448e7949b4d1c2e790494 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:23.836650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:23.987960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bf5a1-481d-404b-a6d1-35c68e944757 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:23.990244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-db4bf5a1-481d-404b-a6d1-35c68e944757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:24.031877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bf5a1-481d-404b-a6d1-35c68e944757 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:24.213692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee72d46-ce43-45c8-9145-282b77437dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:24.214414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee72d46-ce43-45c8-9145-282b77437dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:24.214879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee72d46-ce43-45c8-9145-282b77437dca admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:24.220966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee72d46-ce43-45c8-9145-282b77437dca admin admin] PATH_INFO: `/v3/projects/e2af233d394f49f694e77156f7f13e69` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:24.220966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee72d46-ce43-45c8-9145-282b77437dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2af233d394f49f694e77156f7f13e69)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:24.220966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee72d46-ce43-45c8-9145-282b77437dca admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:24.487903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4ee72d46-ce43-45c8-9145-282b77437dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2af233d394f49f694e77156f7f13e69', 'request_id': 'req-4ee72d46-ce43-45c8-9145-282b77437dca'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:24.507895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4ee72d46-ce43-45c8-9145-282b77437dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2af233d394f49f694e77156f7f13e69', 'request_id': 'req-4ee72d46-ce43-45c8-9145-282b77437dca'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:24.618599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4ee72d46-ce43-45c8-9145-282b77437dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2af233d394f49f694e77156f7f13e69', 'request_id': 'req-4ee72d46-ce43-45c8-9145-282b77437dca'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:24.642636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4ee72d46-ce43-45c8-9145-282b77437dca admin admin] The token cache is being invalidate because project e2af233d394f49f694e77156f7f13e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:24.643369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4ee72d46-ce43-45c8-9145-282b77437dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:24.645197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4ee72d46-ce43-45c8-9145-282b77437dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:24.652661 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3310/6571] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:23 2022] DELETE /identity/v3/projects/e2af233d394f49f694e77156f7f13e69 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:24.653682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e75da-270f-40fa-a003-4bfa71edf2ce None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:24.654138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e75da-270f-40fa-a003-4bfa71edf2ce None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:24.659786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e75da-270f-40fa-a003-4bfa71edf2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:24.695087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-641e75da-270f-40fa-a003-4bfa71edf2ce None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:24.699952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-641e75da-270f-40fa-a003-4bfa71edf2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:24.812794 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3262/6572] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:24.828452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17910ae2-734c-4b1c-83c3-f1875f7bb19b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:24.828868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17910ae2-734c-4b1c-83c3-f1875f7bb19b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:24.829278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17910ae2-734c-4b1c-83c3-f1875f7bb19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:24.864725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-17910ae2-734c-4b1c-83c3-f1875f7bb19b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:24.866281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-17910ae2-734c-4b1c-83c3-f1875f7bb19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:24.878977 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3311/6573] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:24.883072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e75da-270f-40fa-a003-4bfa71edf2ce None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:24.901843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e75da-270f-40fa-a003-4bfa71edf2ce None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:24.920520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636183ce-c30f-4c39-bfc4-a22c340f9cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:24.922154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636183ce-c30f-4c39-bfc4-a22c340f9cea admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:24.922496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636183ce-c30f-4c39-bfc4-a22c340f9cea admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:24.922864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636183ce-c30f-4c39-bfc4-a22c340f9cea admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:24.923722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636183ce-c30f-4c39-bfc4-a22c340f9cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:24.924124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636183ce-c30f-4c39-bfc4-a22c340f9cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:24.925883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636183ce-c30f-4c39-bfc4-a22c340f9cea admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:24.950686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:24.958407 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3263/6574] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:24.962665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17910ae2-734c-4b1c-83c3-f1875f7bb19b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:24.977390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17910ae2-734c-4b1c-83c3-f1875f7bb19b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:24.994837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5397fe6-1ee5-4132-a49a-5865ebcb8c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:24.995840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5397fe6-1ee5-4132-a49a-5865ebcb8c40 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:24.996568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5397fe6-1ee5-4132-a49a-5865ebcb8c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:25.000116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5397fe6-1ee5-4132-a49a-5865ebcb8c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:25.001728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5397fe6-1ee5-4132-a49a-5865ebcb8c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:25.012845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5397fe6-1ee5-4132-a49a-5865ebcb8c40 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:25.161366 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3312/6575] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:24 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:25.166359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636183ce-c30f-4c39-bfc4-a22c340f9cea admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:25.182965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636183ce-c30f-4c39-bfc4-a22c340f9cea admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:25.354360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202ab7d-f1a3-4b8a-886f-75f858dd32b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:25.355118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202ab7d-f1a3-4b8a-886f-75f858dd32b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:25.355427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202ab7d-f1a3-4b8a-886f-75f858dd32b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:25.355738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202ab7d-f1a3-4b8a-886f-75f858dd32b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:25.356469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202ab7d-f1a3-4b8a-886f-75f858dd32b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:25.361785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202ab7d-f1a3-4b8a-886f-75f858dd32b5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:25.547302 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3264/6576] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:25 2022] POST /identity/v3/users => generated 287 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:25.552538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5397fe6-1ee5-4132-a49a-5865ebcb8c40 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:25.577914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5397fe6-1ee5-4132-a49a-5865ebcb8c40 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:25.601220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890145c-0ca0-4c47-85ec-d56d9849621b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:25.601974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890145c-0ca0-4c47-85ec-d56d9849621b admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:25.602354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890145c-0ca0-4c47-85ec-d56d9849621b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:25.602735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890145c-0ca0-4c47-85ec-d56d9849621b admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:25.603627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890145c-0ca0-4c47-85ec-d56d9849621b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:25.605680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890145c-0ca0-4c47-85ec-d56d9849621b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:25.627124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202ab7d-f1a3-4b8a-886f-75f858dd32b5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:25.629263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d202ab7d-f1a3-4b8a-886f-75f858dd32b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:25.647638 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3313/6577] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:25.649672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890145c-0ca0-4c47-85ec-d56d9849621b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:25.650200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202ab7d-f1a3-4b8a-886f-75f858dd32b5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:25.663078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cda4ec-08b6-4781-adad-0cc6623fc8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:25.663846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cda4ec-08b6-4781-adad-0cc6623fc8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:25.664371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cda4ec-08b6-4781-adad-0cc6623fc8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:25.664848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cda4ec-08b6-4781-adad-0cc6623fc8a7 admin admin] PATH_INFO: `/v3/projects/43786fceab1f44828181d58206de7d22` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:25.667816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cda4ec-08b6-4781-adad-0cc6623fc8a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43786fceab1f44828181d58206de7d22)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:25.670156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cda4ec-08b6-4781-adad-0cc6623fc8a7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:25.715737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890145c-0ca0-4c47-85ec-d56d9849621b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:25.733202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80177711-b5c4-4bb4-ba8f-1a4ec2af9d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:25.734307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80177711-b5c4-4bb4-ba8f-1a4ec2af9d69 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:25.734625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80177711-b5c4-4bb4-ba8f-1a4ec2af9d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:25.736356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80177711-b5c4-4bb4-ba8f-1a4ec2af9d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:25.739001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80177711-b5c4-4bb4-ba8f-1a4ec2af9d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:25.742033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80177711-b5c4-4bb4-ba8f-1a4ec2af9d69 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:25.758492 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3314/6578] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:25.763021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80177711-b5c4-4bb4-ba8f-1a4ec2af9d69 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:25.797930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80177711-b5c4-4bb4-ba8f-1a4ec2af9d69 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:25.821304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f0fa0-a823-4ca9-a025-f98641f52b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:25.821304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f0fa0-a823-4ca9-a025-f98641f52b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:25.821304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f0fa0-a823-4ca9-a025-f98641f52b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:25.821304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f0fa0-a823-4ca9-a025-f98641f52b17 admin admin] PATH_INFO: `/v3/projects/dd9e0e664314431f9f2d69511721b0d9/users/bf444d5ea3554484afec21dff020a802/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:25.849419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f0fa0-a823-4ca9-a025-f98641f52b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd9e0e664314431f9f2d69511721b0d9, user_id=bf444d5ea3554484afec21dff020a802, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:25.850450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c9cda4ec-08b6-4781-adad-0cc6623fc8a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43786fceab1f44828181d58206de7d22', 'request_id': 'req-c9cda4ec-08b6-4781-adad-0cc6623fc8a7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:25.852555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f0fa0-a823-4ca9-a025-f98641f52b17 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:25.860351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c9cda4ec-08b6-4781-adad-0cc6623fc8a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43786fceab1f44828181d58206de7d22', 'request_id': 'req-c9cda4ec-08b6-4781-adad-0cc6623fc8a7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:25.869377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c9cda4ec-08b6-4781-adad-0cc6623fc8a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43786fceab1f44828181d58206de7d22', 'request_id': 'req-c9cda4ec-08b6-4781-adad-0cc6623fc8a7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:25.921032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:26.030368 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3315/6579] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:25 2022] PUT /identity/v3/projects/dd9e0e664314431f9f2d69511721b0d9/users/bf444d5ea3554484afec21dff020a802/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:26.079976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c9cda4ec-08b6-4781-adad-0cc6623fc8a7 admin admin] The token cache is being invalidate because project 43786fceab1f44828181d58206de7d22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:26.080774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c9cda4ec-08b6-4781-adad-0cc6623fc8a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:26.081789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c9cda4ec-08b6-4781-adad-0cc6623fc8a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:26.083731 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3265/6580] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:25 2022] DELETE /identity/v3/projects/43786fceab1f44828181d58206de7d22 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:26.083850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3af1a-2651-4536-8005-0a720dcddbcd None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:26.084096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3af1a-2651-4536-8005-0a720dcddbcd None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:26.084409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3af1a-2651-4536-8005-0a720dcddbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:26.089988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b674a-094e-4b1f-9cfa-0e4ae629fe65 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:26.090519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b674a-094e-4b1f-9cfa-0e4ae629fe65 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:26.090962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b674a-094e-4b1f-9cfa-0e4ae629fe65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:26.123816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-060b674a-094e-4b1f-9cfa-0e4ae629fe65 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:26.126011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-060b674a-094e-4b1f-9cfa-0e4ae629fe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:26.177033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-79a3af1a-2651-4536-8005-0a720dcddbcd None None] MFA Rules not processed for user `bf444d5ea3554484afec21dff020a802`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:26.178701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-79a3af1a-2651-4536-8005-0a720dcddbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:26.269997 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3266/6581] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:26.279070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e5082-1dce-4154-a642-f77baa66c7e5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:26.279722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e5082-1dce-4154-a642-f77baa66c7e5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:26.283963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e5082-1dce-4154-a642-f77baa66c7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:26.351235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-520e5082-1dce-4154-a642-f77baa66c7e5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:26.352853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-520e5082-1dce-4154-a642-f77baa66c7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:26.368545 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3267/6582] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:26.369860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:26.375186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e5082-1dce-4154-a642-f77baa66c7e5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:26.396831 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3316/6583] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:26.399266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e5082-1dce-4154-a642-f77baa66c7e5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:26.409840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4772e1-5eaf-4cb2-95c3-83fdfd985bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:26.410740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4772e1-5eaf-4cb2-95c3-83fdfd985bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:26.411248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4772e1-5eaf-4cb2-95c3-83fdfd985bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:26.412774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3af1a-2651-4536-8005-0a720dcddbcd None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:26.414748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-79a3af1a-2651-4536-8005-0a720dcddbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:26.422659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4772e1-5eaf-4cb2-95c3-83fdfd985bb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:26.425124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4772e1-5eaf-4cb2-95c3-83fdfd985bb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:26.426949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4772e1-5eaf-4cb2-95c3-83fdfd985bb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:26.433068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4772e1-5eaf-4cb2-95c3-83fdfd985bb6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:26.505004 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3268/6584] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:26.505847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4772e1-5eaf-4cb2-95c3-83fdfd985bb6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:26.537961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4772e1-5eaf-4cb2-95c3-83fdfd985bb6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:26.551108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d97d0-e086-4814-a858-7d1ea7bcd44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:26.551729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d97d0-e086-4814-a858-7d1ea7bcd44a admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:26.552000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d97d0-e086-4814-a858-7d1ea7bcd44a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:26.552312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d97d0-e086-4814-a858-7d1ea7bcd44a admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:26.552960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d97d0-e086-4814-a858-7d1ea7bcd44a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:26.555571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d97d0-e086-4814-a858-7d1ea7bcd44a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:26.649218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3af1a-2651-4536-8005-0a720dcddbcd None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:26.666203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1acbf-0e65-4c52-ae67-4d54ae18dd19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:26.667865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1acbf-0e65-4c52-ae67-4d54ae18dd19 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:26.668022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1acbf-0e65-4c52-ae67-4d54ae18dd19 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:26.668333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1acbf-0e65-4c52-ae67-4d54ae18dd19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:26.685659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1acbf-0e65-4c52-ae67-4d54ae18dd19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:26.689277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1acbf-0e65-4c52-ae67-4d54ae18dd19 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:26.707508 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3269/6585] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:26 2022] POST /identity/v3/projects => generated 369 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:26.709311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d97d0-e086-4814-a858-7d1ea7bcd44a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:26.719907 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3317/6586] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:26.915457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d97d0-e086-4814-a858-7d1ea7bcd44a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:26.926951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021af0e-fd5f-481f-a82d-5c64b1ce7549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:26.927589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021af0e-fd5f-481f-a82d-5c64b1ce7549 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:26.927943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021af0e-fd5f-481f-a82d-5c64b1ce7549 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:26.932483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021af0e-fd5f-481f-a82d-5c64b1ce7549 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:26.932483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021af0e-fd5f-481f-a82d-5c64b1ce7549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:26.932483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021af0e-fd5f-481f-a82d-5c64b1ce7549 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:27.100294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1acbf-0e65-4c52-ae67-4d54ae18dd19 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:27.102079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-42e1acbf-0e65-4c52-ae67-4d54ae18dd19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:27.107254 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3270/6587] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:26 2022] POST /identity/v3/users => generated 285 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:27.109612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021af0e-fd5f-481f-a82d-5c64b1ce7549 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:27.135494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1acbf-0e65-4c52-ae67-4d54ae18dd19 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:27.153147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160b477-088b-4c2b-b6f9-98b9971a160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:27.153887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160b477-088b-4c2b-b6f9-98b9971a160b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:27.154271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160b477-088b-4c2b-b6f9-98b9971a160b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:27.154603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021af0e-fd5f-481f-a82d-5c64b1ce7549 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:27.154733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160b477-088b-4c2b-b6f9-98b9971a160b admin admin] PATH_INFO: `/v3/users/bf444d5ea3554484afec21dff020a802` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:27.157142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160b477-088b-4c2b-b6f9-98b9971a160b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf444d5ea3554484afec21dff020a802)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:27.165096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160b477-088b-4c2b-b6f9-98b9971a160b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:27.177955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9788859-717f-42e2-803a-fd66ce3c9087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:27.181754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9788859-717f-42e2-803a-fd66ce3c9087 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:27.182062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9788859-717f-42e2-803a-fd66ce3c9087 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:27.182347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9788859-717f-42e2-803a-fd66ce3c9087 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:27.183032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9788859-717f-42e2-803a-fd66ce3c9087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:27.189613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9788859-717f-42e2-803a-fd66ce3c9087 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:27.234635 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3271/6588] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:27.237381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9788859-717f-42e2-803a-fd66ce3c9087 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:27.278730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9788859-717f-42e2-803a-fd66ce3c9087 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:27.293448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064e579-82f5-404c-9b6b-6d7099fbac3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:27.294081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064e579-82f5-404c-9b6b-6d7099fbac3a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:27.294361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064e579-82f5-404c-9b6b-6d7099fbac3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:27.294636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064e579-82f5-404c-9b6b-6d7099fbac3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:27.295296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064e579-82f5-404c-9b6b-6d7099fbac3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:27.310371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064e579-82f5-404c-9b6b-6d7099fbac3a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:27.328470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:27.343902 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3272/6589] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:27.347961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064e579-82f5-404c-9b6b-6d7099fbac3a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:27.374290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064e579-82f5-404c-9b6b-6d7099fbac3a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:27.384963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba7c13-f94e-45e8-9dc8-f8e022b4b5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:27.385652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba7c13-f94e-45e8-9dc8-f8e022b4b5cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:27.385934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba7c13-f94e-45e8-9dc8-f8e022b4b5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:27.386211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba7c13-f94e-45e8-9dc8-f8e022b4b5cf admin admin] PATH_INFO: `/v3/projects/80176ca9b46c4f1ca3432d8b0e18b710/users/651212b975f24a5e905ef3491800cc90/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:27.424882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba7c13-f94e-45e8-9dc8-f8e022b4b5cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=80176ca9b46c4f1ca3432d8b0e18b710, user_id=651212b975f24a5e905ef3491800cc90, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:27.445354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba7c13-f94e-45e8-9dc8-f8e022b4b5cf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:27.463717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1160b477-088b-4c2b-b6f9-98b9971a160b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf444d5ea3554484afec21dff020a802'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:27.465019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1160b477-088b-4c2b-b6f9-98b9971a160b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf444d5ea3554484afec21dff020a802'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:27.607480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1160b477-088b-4c2b-b6f9-98b9971a160b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf444d5ea3554484afec21dff020a802'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:27.609681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1160b477-088b-4c2b-b6f9-98b9971a160b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf444d5ea3554484afec21dff020a802'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:27.639181 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3273/6590] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:27 2022] PUT /identity/v3/projects/80176ca9b46c4f1ca3432d8b0e18b710/users/651212b975f24a5e905ef3491800cc90/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:27.640738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba7c13-f94e-45e8-9dc8-f8e022b4b5cf admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:27.644729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ffba7c13-f94e-45e8-9dc8-f8e022b4b5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:27.647450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1160b477-088b-4c2b-b6f9-98b9971a160b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf444d5ea3554484afec21dff020a802'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:27.682411 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3318/6591] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:27 2022] DELETE /identity/v3/users/bf444d5ea3554484afec21dff020a802 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:27.683923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ee129-3016-4e7d-a6ee-728588900d5b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:27.684243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ee129-3016-4e7d-a6ee-728588900d5b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:27.684526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ee129-3016-4e7d-a6ee-728588900d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:27.740654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba7c13-f94e-45e8-9dc8-f8e022b4b5cf admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:27.768473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-587ee129-3016-4e7d-a6ee-728588900d5b None None] MFA Rules not processed for user `651212b975f24a5e905ef3491800cc90`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:27.769734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-587ee129-3016-4e7d-a6ee-728588900d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:27.866722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5a6c8-6b6f-410c-b4d9-2594f7b101b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:27.870849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5a6c8-6b6f-410c-b4d9-2594f7b101b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:27.871371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5a6c8-6b6f-410c-b4d9-2594f7b101b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:27.871731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5a6c8-6b6f-410c-b4d9-2594f7b101b2 admin admin] PATH_INFO: `/v3/users/7fb8a950bb584362b2b6f17f8013aa9f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:27.876173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5a6c8-6b6f-410c-b4d9-2594f7b101b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb8a950bb584362b2b6f17f8013aa9f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:27.879961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5a6c8-6b6f-410c-b4d9-2594f7b101b2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:27.991220 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3319/6592] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:27.998564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7b8b7-4bad-419e-a0ca-137e53c6c69a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:28.002986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7b8b7-4bad-419e-a0ca-137e53c6c69a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:28.003324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7b8b7-4bad-419e-a0ca-137e53c6c69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:28.049021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9ee7b8b7-4bad-419e-a0ca-137e53c6c69a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:28.054491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9ee7b8b7-4bad-419e-a0ca-137e53c6c69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:28.107977 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3320/6593] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:28.110547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7b8b7-4bad-419e-a0ca-137e53c6c69a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:28.112263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9ee7b8b7-4bad-419e-a0ca-137e53c6c69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:28.137168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7b8b7-4bad-419e-a0ca-137e53c6c69a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:28.143414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5cf5a6c8-6b6f-410c-b4d9-2594f7b101b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb8a950bb584362b2b6f17f8013aa9f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:28.145047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15d005-72ab-4249-beae-078b4f249e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:28.146063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15d005-72ab-4249-beae-078b4f249e81 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:28.146748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15d005-72ab-4249-beae-078b4f249e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:28.147233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15d005-72ab-4249-beae-078b4f249e81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:28.148655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15d005-72ab-4249-beae-078b4f249e81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:28.151746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15d005-72ab-4249-beae-078b4f249e81 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:28.291869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5cf5a6c8-6b6f-410c-b4d9-2594f7b101b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb8a950bb584362b2b6f17f8013aa9f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:28.299727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5cf5a6c8-6b6f-410c-b4d9-2594f7b101b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb8a950bb584362b2b6f17f8013aa9f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:28.309943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5cf5a6c8-6b6f-410c-b4d9-2594f7b101b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb8a950bb584362b2b6f17f8013aa9f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:28.339826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5cf5a6c8-6b6f-410c-b4d9-2594f7b101b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb8a950bb584362b2b6f17f8013aa9f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:28.344390 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3321/6594] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:28 2022] POST /identity/v3/projects => generated 369 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:28.349834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15d005-72ab-4249-beae-078b4f249e81 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:28.353687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-de15d005-72ab-4249-beae-078b4f249e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:28.358505 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3274/6595] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:27 2022] DELETE /identity/v3/users/7fb8a950bb584362b2b6f17f8013aa9f => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:28.400976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:28.464852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15d005-72ab-4249-beae-078b4f249e81 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:28.475107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:28.526753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5a6c8-6b6f-410c-b4d9-2594f7b101b2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:28.532109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5cf5a6c8-6b6f-410c-b4d9-2594f7b101b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:28.588244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e581f-cc8f-49a9-94a6-9eb39d6ab468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:28.590356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e581f-cc8f-49a9-94a6-9eb39d6ab468 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:28.590655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e581f-cc8f-49a9-94a6-9eb39d6ab468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:28.592226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e581f-cc8f-49a9-94a6-9eb39d6ab468 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:28.592789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e581f-cc8f-49a9-94a6-9eb39d6ab468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:28.597858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e581f-cc8f-49a9-94a6-9eb39d6ab468 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:28.677355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5a6c8-6b6f-410c-b4d9-2594f7b101b2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:28.681643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a13bd1-60ed-41cb-816e-364f267099d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:28.682378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a13bd1-60ed-41cb-816e-364f267099d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:28.682770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a13bd1-60ed-41cb-816e-364f267099d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:28.683150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a13bd1-60ed-41cb-816e-364f267099d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:28.685383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-15a13bd1-60ed-41cb-816e-364f267099d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:28.704742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a13bd1-60ed-41cb-816e-364f267099d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:28.707005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a13bd1-60ed-41cb-816e-364f267099d5 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:28.729884 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3322/6596] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:28 2022] POST /identity/v3/users => generated 285 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:28.734598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e581f-cc8f-49a9-94a6-9eb39d6ab468 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:28.735843 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3275/6597] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:28.756013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e581f-cc8f-49a9-94a6-9eb39d6ab468 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:28.774974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5eb3e-bd62-410c-84e9-ff9e36db1afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:28.775852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5eb3e-bd62-410c-84e9-ff9e36db1afa admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:28.776340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5eb3e-bd62-410c-84e9-ff9e36db1afa admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:28.776765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5eb3e-bd62-410c-84e9-ff9e36db1afa admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:28.781441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5eb3e-bd62-410c-84e9-ff9e36db1afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:28.783594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5eb3e-bd62-410c-84e9-ff9e36db1afa admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:28.810694 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3323/6598] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:54:28.819497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a13bd1-60ed-41cb-816e-364f267099d5 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:28.843447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a13bd1-60ed-41cb-816e-364f267099d5 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:28.861324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616f9a1-c499-47a0-aa91-b4da88e01f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:28.862390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616f9a1-c499-47a0-aa91-b4da88e01f28 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:28.863546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616f9a1-c499-47a0-aa91-b4da88e01f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:28.864025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616f9a1-c499-47a0-aa91-b4da88e01f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:28.867185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616f9a1-c499-47a0-aa91-b4da88e01f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:28.871485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616f9a1-c499-47a0-aa91-b4da88e01f28 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:28.894437 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3276/6599] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:28.898957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5eb3e-bd62-410c-84e9-ff9e36db1afa admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:28.915289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5eb3e-bd62-410c-84e9-ff9e36db1afa admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:28.931175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6e392-6b26-4d7c-915d-8f24fd4c6498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:28.931898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6e392-6b26-4d7c-915d-8f24fd4c6498 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:28.932209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6e392-6b26-4d7c-915d-8f24fd4c6498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:28.932497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6e392-6b26-4d7c-915d-8f24fd4c6498 admin admin] PATH_INFO: `/v3/projects/0c304b6838924a08a33fd468276afa41/users/89ee03a621404c579134638a96cc7c3a/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:28.979127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6e392-6b26-4d7c-915d-8f24fd4c6498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c304b6838924a08a33fd468276afa41, user_id=89ee03a621404c579134638a96cc7c3a, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:28.982016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6e392-6b26-4d7c-915d-8f24fd4c6498 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:29.072537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616f9a1-c499-47a0-aa91-b4da88e01f28 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:29.072537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2616f9a1-c499-47a0-aa91-b4da88e01f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:29.096203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:29.102987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616f9a1-c499-47a0-aa91-b4da88e01f28 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:29.107775 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3324/6600] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:28 2022] PUT /identity/v3/projects/0c304b6838924a08a33fd468276afa41/users/89ee03a621404c579134638a96cc7c3a/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:29.118973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6658d-2ff6-43fb-ade4-886ea8df3c2e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:29.119556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6658d-2ff6-43fb-ade4-886ea8df3c2e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:29.119556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6658d-2ff6-43fb-ade4-886ea8df3c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:29.153517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1ab6658d-2ff6-43fb-ade4-886ea8df3c2e None None] MFA Rules not processed for user `89ee03a621404c579134638a96cc7c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:29.155172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1ab6658d-2ff6-43fb-ade4-886ea8df3c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:29.237558 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3325/6601] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:54:29.253132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc23cb9-d662-461f-99ad-b2f44f901c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:29.253904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc23cb9-d662-461f-99ad-b2f44f901c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:29.254070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc23cb9-d662-461f-99ad-b2f44f901c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:29.254351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc23cb9-d662-461f-99ad-b2f44f901c85 admin admin] PATH_INFO: `/v3/projects/3f33afda3d45469f836e079a4c0b5fc6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:29.255820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc23cb9-d662-461f-99ad-b2f44f901c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f33afda3d45469f836e079a4c0b5fc6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:29.257018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6658d-2ff6-43fb-ade4-886ea8df3c2e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:29.257946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc23cb9-d662-461f-99ad-b2f44f901c85 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:29.259594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1ab6658d-2ff6-43fb-ade4-886ea8df3c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:29.378841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6658d-2ff6-43fb-ade4-886ea8df3c2e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:29.385312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68964763-8569-4b42-b0f3-4a60cf11d0d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:29.386906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68964763-8569-4b42-b0f3-4a60cf11d0d2 service glance] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:29.387257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68964763-8569-4b42-b0f3-4a60cf11d0d2 service glance] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:29.388381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68964763-8569-4b42-b0f3-4a60cf11d0d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:29.390428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-68964763-8569-4b42-b0f3-4a60cf11d0d2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:29.454831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3cc23cb9-d662-461f-99ad-b2f44f901c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f33afda3d45469f836e079a4c0b5fc6', 'request_id': 'req-3cc23cb9-d662-461f-99ad-b2f44f901c85'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:29.477866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3cc23cb9-d662-461f-99ad-b2f44f901c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f33afda3d45469f836e079a4c0b5fc6', 'request_id': 'req-3cc23cb9-d662-461f-99ad-b2f44f901c85'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:29.498458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3cc23cb9-d662-461f-99ad-b2f44f901c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f33afda3d45469f836e079a4c0b5fc6', 'request_id': 'req-3cc23cb9-d662-461f-99ad-b2f44f901c85'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:29.541596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68964763-8569-4b42-b0f3-4a60cf11d0d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:29.543585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68964763-8569-4b42-b0f3-4a60cf11d0d2 service glance] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:29.586830 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3326/6602] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:29.650909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3cc23cb9-d662-461f-99ad-b2f44f901c85 admin admin] The token cache is being invalidate because project 3f33afda3d45469f836e079a4c0b5fc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:29.650909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3cc23cb9-d662-461f-99ad-b2f44f901c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:29.654302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3cc23cb9-d662-461f-99ad-b2f44f901c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:29.660925 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3277/6603] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:29 2022] DELETE /identity/v3/projects/3f33afda3d45469f836e079a4c0b5fc6 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:54:29.662736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68964763-8569-4b42-b0f3-4a60cf11d0d2 service glance] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:29.683752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68964763-8569-4b42-b0f3-4a60cf11d0d2 service glance] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:29.800849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1e311-bcce-47e2-9f5e-75f79d38344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:29.801749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1e311-bcce-47e2-9f5e-75f79d38344c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:29.831144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1e311-bcce-47e2-9f5e-75f79d38344c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:29.834175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1e311-bcce-47e2-9f5e-75f79d38344c admin admin] PATH_INFO: `/v3/users/4bc85b309b7f42d0878c38893884cdd1` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:29.857113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1e311-bcce-47e2-9f5e-75f79d38344c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc85b309b7f42d0878c38893884cdd1)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:29.864925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1e311-bcce-47e2-9f5e-75f79d38344c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:30.088383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc23cb9-d662-461f-99ad-b2f44f901c85 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:30.090584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3cc23cb9-d662-461f-99ad-b2f44f901c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:30.274498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-41f1e311-bcce-47e2-9f5e-75f79d38344c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc85b309b7f42d0878c38893884cdd1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:30.274498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-41f1e311-bcce-47e2-9f5e-75f79d38344c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc85b309b7f42d0878c38893884cdd1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:30.295155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc23cb9-d662-461f-99ad-b2f44f901c85 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:30.305615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5641a-6e17-41ea-b084-a784f58420c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:30.306368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5641a-6e17-41ea-b084-a784f58420c9 service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:30.306748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5641a-6e17-41ea-b084-a784f58420c9 service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:30.307124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5641a-6e17-41ea-b084-a784f58420c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:30.316260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-54d5641a-6e17-41ea-b084-a784f58420c9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:30.415478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-41f1e311-bcce-47e2-9f5e-75f79d38344c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc85b309b7f42d0878c38893884cdd1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:30.415478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-41f1e311-bcce-47e2-9f5e-75f79d38344c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc85b309b7f42d0878c38893884cdd1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:30.446681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-41f1e311-bcce-47e2-9f5e-75f79d38344c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc85b309b7f42d0878c38893884cdd1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:30.496502 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3327/6604] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:29 2022] DELETE /identity/v3/users/4bc85b309b7f42d0878c38893884cdd1 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:54:30.497859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5641a-6e17-41ea-b084-a784f58420c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:30.500153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1e311-bcce-47e2-9f5e-75f79d38344c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:30.501727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5641a-6e17-41ea-b084-a784f58420c9 service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:30.511173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-41f1e311-bcce-47e2-9f5e-75f79d38344c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:30.519350 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3278/6605] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:30.705887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1e311-bcce-47e2-9f5e-75f79d38344c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:30.724961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4383f-14a7-4d30-affb-ee72796895c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:30.726066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4383f-14a7-4d30-affb-ee72796895c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:30.726682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4383f-14a7-4d30-affb-ee72796895c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:30.727285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4383f-14a7-4d30-affb-ee72796895c9 admin admin] PATH_INFO: `/v3/projects/dd9e0e664314431f9f2d69511721b0d9` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:30.729804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4383f-14a7-4d30-affb-ee72796895c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd9e0e664314431f9f2d69511721b0d9)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:30.733567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4383f-14a7-4d30-affb-ee72796895c9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:30.814578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:31.081044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-98d4383f-14a7-4d30-affb-ee72796895c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd9e0e664314431f9f2d69511721b0d9', 'request_id': 'req-98d4383f-14a7-4d30-affb-ee72796895c9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:31.098712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-98d4383f-14a7-4d30-affb-ee72796895c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd9e0e664314431f9f2d69511721b0d9', 'request_id': 'req-98d4383f-14a7-4d30-affb-ee72796895c9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:31.191592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-98d4383f-14a7-4d30-affb-ee72796895c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd9e0e664314431f9f2d69511721b0d9', 'request_id': 'req-98d4383f-14a7-4d30-affb-ee72796895c9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:31.209520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-98d4383f-14a7-4d30-affb-ee72796895c9 admin admin] The token cache is being invalidate because project dd9e0e664314431f9f2d69511721b0d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:31.210006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-98d4383f-14a7-4d30-affb-ee72796895c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:31.212600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-98d4383f-14a7-4d30-affb-ee72796895c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:31.222140 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3328/6606] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:30 2022] DELETE /identity/v3/projects/dd9e0e664314431f9f2d69511721b0d9 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:31.223280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5641a-6e17-41ea-b084-a784f58420c9 service glance] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:31.225244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-54d5641a-6e17-41ea-b084-a784f58420c9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:31.237289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d64d82-e046-4a11-9064-b2adadb309dc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:31.238505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d64d82-e046-4a11-9064-b2adadb309dc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:31.238505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d64d82-e046-4a11-9064-b2adadb309dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:31.254341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5641a-6e17-41ea-b084-a784f58420c9 service glance] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:31.318136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-04d64d82-e046-4a11-9064-b2adadb309dc None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:31.318136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-04d64d82-e046-4a11-9064-b2adadb309dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:31.451102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae7743-66f2-4e68-a4c3-a029886f5928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:31.453579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae7743-66f2-4e68-a4c3-a029886f5928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:31.458210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae7743-66f2-4e68-a4c3-a029886f5928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:31.458210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae7743-66f2-4e68-a4c3-a029886f5928 admin admin] PATH_INFO: `/v3/users/31999f4afd514bfbbdfa8308445e3f18` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:31.458210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae7743-66f2-4e68-a4c3-a029886f5928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31999f4afd514bfbbdfa8308445e3f18)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:31.465202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae7743-66f2-4e68-a4c3-a029886f5928 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:31.469391 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3329/6607] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:31.470492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d64d82-e046-4a11-9064-b2adadb309dc None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:31.471941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-04d64d82-e046-4a11-9064-b2adadb309dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:31.485971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d64d82-e046-4a11-9064-b2adadb309dc None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:31.492789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fc0e0-3f93-40e0-9e2c-24dadd0ee13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:31.493496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fc0e0-3f93-40e0-9e2c-24dadd0ee13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:31.493875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fc0e0-3f93-40e0-9e2c-24dadd0ee13b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:31.494222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fc0e0-3f93-40e0-9e2c-24dadd0ee13b admin admin] PATH_INFO: `/v3/projects/859a18493e1843c6a3ef66c8939d25e5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:31.495480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fc0e0-3f93-40e0-9e2c-24dadd0ee13b admin admin] RBAC: Authorizing `identity:delete_project(project_id=859a18493e1843c6a3ef66c8939d25e5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:31.497755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fc0e0-3f93-40e0-9e2c-24dadd0ee13b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:31.705897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:31.757293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-26ae7743-66f2-4e68-a4c3-a029886f5928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31999f4afd514bfbbdfa8308445e3f18'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:31.757547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d69fc0e0-3f93-40e0-9e2c-24dadd0ee13b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859a18493e1843c6a3ef66c8939d25e5', 'request_id': 'req-d69fc0e0-3f93-40e0-9e2c-24dadd0ee13b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:31.765723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d69fc0e0-3f93-40e0-9e2c-24dadd0ee13b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859a18493e1843c6a3ef66c8939d25e5', 'request_id': 'req-d69fc0e0-3f93-40e0-9e2c-24dadd0ee13b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:31.852325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-26ae7743-66f2-4e68-a4c3-a029886f5928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31999f4afd514bfbbdfa8308445e3f18'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:31.853276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-26ae7743-66f2-4e68-a4c3-a029886f5928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31999f4afd514bfbbdfa8308445e3f18'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:31.869371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-26ae7743-66f2-4e68-a4c3-a029886f5928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31999f4afd514bfbbdfa8308445e3f18'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:31.904991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-26ae7743-66f2-4e68-a4c3-a029886f5928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31999f4afd514bfbbdfa8308445e3f18'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:31.918214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d69fc0e0-3f93-40e0-9e2c-24dadd0ee13b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859a18493e1843c6a3ef66c8939d25e5', 'request_id': 'req-d69fc0e0-3f93-40e0-9e2c-24dadd0ee13b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:31.920592 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3279/6608] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:31 2022] DELETE /identity/v3/users/31999f4afd514bfbbdfa8308445e3f18 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:31.924072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c141a-fdbb-4210-bb17-cb8bdd504bdf None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:31.924072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c141a-fdbb-4210-bb17-cb8bdd504bdf None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:31.924331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c141a-fdbb-4210-bb17-cb8bdd504bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:31.945279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d69fc0e0-3f93-40e0-9e2c-24dadd0ee13b admin admin] The token cache is being invalidate because project 859a18493e1843c6a3ef66c8939d25e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:31.948103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d69fc0e0-3f93-40e0-9e2c-24dadd0ee13b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:31.948402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d69fc0e0-3f93-40e0-9e2c-24dadd0ee13b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:31.952658 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3330/6609] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:31 2022] DELETE /identity/v3/projects/859a18493e1843c6a3ef66c8939d25e5 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:31.954065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d198d81-bfc0-4a38-ba34-cac7e6d92653 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:31.954350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d198d81-bfc0-4a38-ba34-cac7e6d92653 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:31.954624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d198d81-bfc0-4a38-ba34-cac7e6d92653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:31.973273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-427c141a-fdbb-4210-bb17-cb8bdd504bdf None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:31.974525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-427c141a-fdbb-4210-bb17-cb8bdd504bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:32.015049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1d198d81-bfc0-4a38-ba34-cac7e6d92653 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:32.018248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1d198d81-bfc0-4a38-ba34-cac7e6d92653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:32.055369 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3280/6610] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:32.056863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27af88a-0106-4934-9a9d-c5e2a8897b8e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:32.057172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27af88a-0106-4934-9a9d-c5e2a8897b8e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:32.057444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27af88a-0106-4934-9a9d-c5e2a8897b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:32.105522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e27af88a-0106-4934-9a9d-c5e2a8897b8e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:32.108326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e27af88a-0106-4934-9a9d-c5e2a8897b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:32.124031 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3331/6611] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:32.124031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d198d81-bfc0-4a38-ba34-cac7e6d92653 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:32.134806 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3281/6612] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:32.143013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d198d81-bfc0-4a38-ba34-cac7e6d92653 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:32.144461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c15655-7281-4bb5-bb4e-461cdb1139f4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:32.144757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c15655-7281-4bb5-bb4e-461cdb1139f4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:32.146036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c15655-7281-4bb5-bb4e-461cdb1139f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:32.159101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41057482-2dfa-4184-ae1e-d1d6d56efad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:32.160275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41057482-2dfa-4184-ae1e-d1d6d56efad0 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:32.160779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41057482-2dfa-4184-ae1e-d1d6d56efad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:32.162549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41057482-2dfa-4184-ae1e-d1d6d56efad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:32.163285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41057482-2dfa-4184-ae1e-d1d6d56efad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:32.163559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41057482-2dfa-4184-ae1e-d1d6d56efad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:32.169459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41057482-2dfa-4184-ae1e-d1d6d56efad0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:32.174036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-45c15655-7281-4bb5-bb4e-461cdb1139f4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:32.175991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-45c15655-7281-4bb5-bb4e-461cdb1139f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:32.192776 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3282/6613] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:54:32.194431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c15655-7281-4bb5-bb4e-461cdb1139f4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:32.196477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-45c15655-7281-4bb5-bb4e-461cdb1139f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:32.200995 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3332/6614] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:32.206582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41057482-2dfa-4184-ae1e-d1d6d56efad0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:32.222918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41057482-2dfa-4184-ae1e-d1d6d56efad0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:32.244026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937f14a-82b9-42ab-9fe7-6b521d134c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:32.244026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937f14a-82b9-42ab-9fe7-6b521d134c6a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:32.244026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937f14a-82b9-42ab-9fe7-6b521d134c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:32.244026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937f14a-82b9-42ab-9fe7-6b521d134c6a admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:32.244412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937f14a-82b9-42ab-9fe7-6b521d134c6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:32.244412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937f14a-82b9-42ab-9fe7-6b521d134c6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:32.244412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937f14a-82b9-42ab-9fe7-6b521d134c6a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:32.273588 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3333/6615] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:32.275554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937f14a-82b9-42ab-9fe7-6b521d134c6a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:32.289959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c15655-7281-4bb5-bb4e-461cdb1139f4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:32.293860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599fddd-df0a-4df7-9f1e-46af1c9e91a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:32.294081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937f14a-82b9-42ab-9fe7-6b521d134c6a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:32.294630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599fddd-df0a-4df7-9f1e-46af1c9e91a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:32.294982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599fddd-df0a-4df7-9f1e-46af1c9e91a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:32.295326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599fddd-df0a-4df7-9f1e-46af1c9e91a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:32.302676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98ffd7-9b84-427d-9a98-97b8160b4fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:32.303560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98ffd7-9b84-427d-9a98-97b8160b4fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:32.303918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98ffd7-9b84-427d-9a98-97b8160b4fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:32.304358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98ffd7-9b84-427d-9a98-97b8160b4fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:32.305145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98ffd7-9b84-427d-9a98-97b8160b4fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:32.307267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98ffd7-9b84-427d-9a98-97b8160b4fd9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:32.309116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599fddd-df0a-4df7-9f1e-46af1c9e91a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:32.312461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599fddd-df0a-4df7-9f1e-46af1c9e91a9 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:32.325246 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3283/6616] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:32.326442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599fddd-df0a-4df7-9f1e-46af1c9e91a9 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:32.338873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599fddd-df0a-4df7-9f1e-46af1c9e91a9 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:32.344594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8abdee-7c90-4705-bafe-e2f2a3beee71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:32.345403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8abdee-7c90-4705-bafe-e2f2a3beee71 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:32.345836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8abdee-7c90-4705-bafe-e2f2a3beee71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:32.346272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8abdee-7c90-4705-bafe-e2f2a3beee71 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:32.347059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8abdee-7c90-4705-bafe-e2f2a3beee71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:32.349344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8abdee-7c90-4705-bafe-e2f2a3beee71 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:32.446669 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3334/6617] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:32 2022] POST /identity/v3/projects => generated 367 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:32.453946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98ffd7-9b84-427d-9a98-97b8160b4fd9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:32.462893 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3284/6618] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:32 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:32.467154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8abdee-7c90-4705-bafe-e2f2a3beee71 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:32.613413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8abdee-7c90-4705-bafe-e2f2a3beee71 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:32.636974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bfdc4-236a-40ac-b7c1-89db0853a69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:32.637626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bfdc4-236a-40ac-b7c1-89db0853a69f admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:32.637912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bfdc4-236a-40ac-b7c1-89db0853a69f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:32.638185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bfdc4-236a-40ac-b7c1-89db0853a69f admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:32.638841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bfdc4-236a-40ac-b7c1-89db0853a69f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:32.641561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bfdc4-236a-40ac-b7c1-89db0853a69f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:32.744229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98ffd7-9b84-427d-9a98-97b8160b4fd9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:32.755489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea6901-bc48-4f08-b046-d1838daa489a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:32.759349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea6901-bc48-4f08-b046-d1838daa489a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:32.759667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea6901-bc48-4f08-b046-d1838daa489a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:32.760737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea6901-bc48-4f08-b046-d1838daa489a admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:32.761490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea6901-bc48-4f08-b046-d1838daa489a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:32.768672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea6901-bc48-4f08-b046-d1838daa489a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:32.775834 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3285/6619] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:32 2022] POST /identity/v3/users => generated 285 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:32.781909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bfdc4-236a-40ac-b7c1-89db0853a69f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:32.804777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bfdc4-236a-40ac-b7c1-89db0853a69f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:32.818381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bb8e0-eda3-4b43-a99a-f714d8b6ae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:32.818381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bb8e0-eda3-4b43-a99a-f714d8b6ae4f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:32.818381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bb8e0-eda3-4b43-a99a-f714d8b6ae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:32.818381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bb8e0-eda3-4b43-a99a-f714d8b6ae4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:32.819793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83bb8e0-eda3-4b43-a99a-f714d8b6ae4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:32.821636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83bb8e0-eda3-4b43-a99a-f714d8b6ae4f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:32.844786 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3286/6620] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:32.848819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bb8e0-eda3-4b43-a99a-f714d8b6ae4f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:32.870003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bb8e0-eda3-4b43-a99a-f714d8b6ae4f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:32.884936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ff2eb-a6c4-4b73-9826-3def53a3296c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:32.885640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ff2eb-a6c4-4b73-9826-3def53a3296c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:32.885991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ff2eb-a6c4-4b73-9826-3def53a3296c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:32.886333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ff2eb-a6c4-4b73-9826-3def53a3296c admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:32.887058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ff2eb-a6c4-4b73-9826-3def53a3296c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:32.888793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ff2eb-a6c4-4b73-9826-3def53a3296c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:32.915658 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3287/6621] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:32.919762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ff2eb-a6c4-4b73-9826-3def53a3296c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:32.939372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:32.942435 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3335/6622] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:32 2022] POST /identity/v3/users => generated 284 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:32.945179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ff2eb-a6c4-4b73-9826-3def53a3296c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:32.948562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea6901-bc48-4f08-b046-d1838daa489a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:32.959436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689bec7-046e-472e-a163-91946fe968eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:32.960668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689bec7-046e-472e-a163-91946fe968eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:32.960668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689bec7-046e-472e-a163-91946fe968eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:32.960823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689bec7-046e-472e-a163-91946fe968eb admin admin] PATH_INFO: `/v3/projects/cb83c4a0e768452eb2fff288e70944e7/users/081cbc1eb7454911aa455a3867858bbc/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:32.976050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea6901-bc48-4f08-b046-d1838daa489a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:32.987540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a39ac-316e-4f67-9363-038f428c6dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:32.988635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a39ac-316e-4f67-9363-038f428c6dcc admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:32.988997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a39ac-316e-4f67-9363-038f428c6dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:32.990032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a39ac-316e-4f67-9363-038f428c6dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:32.990892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a39ac-316e-4f67-9363-038f428c6dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:32.991639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689bec7-046e-472e-a163-91946fe968eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb83c4a0e768452eb2fff288e70944e7, user_id=081cbc1eb7454911aa455a3867858bbc, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:32.993569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a39ac-316e-4f67-9363-038f428c6dcc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:33.018262 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3336/6623] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:54:33.018500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689bec7-046e-472e-a163-91946fe968eb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:33.020719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a39ac-316e-4f67-9363-038f428c6dcc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:33.033765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a39ac-316e-4f67-9363-038f428c6dcc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:33.043117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301fe63-7c85-4e04-b88f-d709a01e6eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:33.043638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301fe63-7c85-4e04-b88f-d709a01e6eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:33.043933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301fe63-7c85-4e04-b88f-d709a01e6eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:33.044294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301fe63-7c85-4e04-b88f-d709a01e6eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:33.045073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301fe63-7c85-4e04-b88f-d709a01e6eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:33.047107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301fe63-7c85-4e04-b88f-d709a01e6eb6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:33.069816 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3337/6624] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:33.084844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301fe63-7c85-4e04-b88f-d709a01e6eb6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:33.110574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301fe63-7c85-4e04-b88f-d709a01e6eb6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:33.121313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f7c70-9906-4767-8200-7634962b7e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:33.122797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f7c70-9906-4767-8200-7634962b7e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:33.123542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f7c70-9906-4767-8200-7634962b7e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:33.124845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f7c70-9906-4767-8200-7634962b7e2f admin admin] PATH_INFO: `/v3/projects/a0ddef08f7d846ae9b3b006138c189a3/users/64e25867cb9e4298a268f769e304fb63/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:33.149852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f7c70-9906-4767-8200-7634962b7e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ddef08f7d846ae9b3b006138c189a3, user_id=64e25867cb9e4298a268f769e304fb63, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:33.156058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f7c70-9906-4767-8200-7634962b7e2f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:33.201556 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3288/6625] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:32 2022] PUT /identity/v3/projects/cb83c4a0e768452eb2fff288e70944e7/users/081cbc1eb7454911aa455a3867858bbc/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:33.211977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0078e23-6af6-44d8-bb3e-f5ab8b4696d8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:33.212909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0078e23-6af6-44d8-bb3e-f5ab8b4696d8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:33.213299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0078e23-6af6-44d8-bb3e-f5ab8b4696d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:33.271061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b0078e23-6af6-44d8-bb3e-f5ab8b4696d8 None None] MFA Rules not processed for user `081cbc1eb7454911aa455a3867858bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:33.272877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b0078e23-6af6-44d8-bb3e-f5ab8b4696d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:33.291928 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3338/6626] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:33 2022] PUT /identity/v3/projects/a0ddef08f7d846ae9b3b006138c189a3/users/64e25867cb9e4298a268f769e304fb63/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:33.294650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e3dd1-22d6-45c5-886d-609251c6bbf9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:33.294937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e3dd1-22d6-45c5-886d-609251c6bbf9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:33.295215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e3dd1-22d6-45c5-886d-609251c6bbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:33.398880 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3289/6627] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:33.400104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b08e3dd1-22d6-45c5-886d-609251c6bbf9 None None] MFA Rules not processed for user `64e25867cb9e4298a268f769e304fb63`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:33.400802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0078e23-6af6-44d8-bb3e-f5ab8b4696d8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:33.401598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b08e3dd1-22d6-45c5-886d-609251c6bbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:33.478111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:33.545505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0078e23-6af6-44d8-bb3e-f5ab8b4696d8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:33.555643 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3339/6628] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:33.559594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e3dd1-22d6-45c5-886d-609251c6bbf9 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:33.563584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6e31b-88a3-49f3-80d8-c3c5560be505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:33.564794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6e31b-88a3-49f3-80d8-c3c5560be505 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:33.565211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6e31b-88a3-49f3-80d8-c3c5560be505 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:33.565638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6e31b-88a3-49f3-80d8-c3c5560be505 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:33.567641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6e31b-88a3-49f3-80d8-c3c5560be505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:33.571644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6e31b-88a3-49f3-80d8-c3c5560be505 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:33.595065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e3dd1-22d6-45c5-886d-609251c6bbf9 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:33.610923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d83ba-2237-4690-851d-d230418b405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:33.611595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d83ba-2237-4690-851d-d230418b405a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:33.611884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d83ba-2237-4690-851d-d230418b405a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:33.612220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d83ba-2237-4690-851d-d230418b405a admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:33.612879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d83ba-2237-4690-851d-d230418b405a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:33.615829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d83ba-2237-4690-851d-d230418b405a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:33.694465 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3290/6629] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:33 2022] POST /identity/v3/projects => generated 369 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:33.695743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6e31b-88a3-49f3-80d8-c3c5560be505 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:33.743431 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3340/6630] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:33 2022] POST /identity/v3/projects => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:33.745562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d83ba-2237-4690-851d-d230418b405a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:33.867863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6e31b-88a3-49f3-80d8-c3c5560be505 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:33.877063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175cb85-b023-4088-a962-e6ea8c3f77fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:33.877924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175cb85-b023-4088-a962-e6ea8c3f77fa admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:33.878213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175cb85-b023-4088-a962-e6ea8c3f77fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:33.878486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175cb85-b023-4088-a962-e6ea8c3f77fa admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:33.879193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175cb85-b023-4088-a962-e6ea8c3f77fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:33.881495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175cb85-b023-4088-a962-e6ea8c3f77fa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:33.882368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d83ba-2237-4690-851d-d230418b405a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:33.896215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfee460-5dd9-4d64-b0d0-7e1b90676be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:33.896894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfee460-5dd9-4d64-b0d0-7e1b90676be4 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:33.897178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfee460-5dd9-4d64-b0d0-7e1b90676be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:33.897449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfee460-5dd9-4d64-b0d0-7e1b90676be4 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:33.898171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfee460-5dd9-4d64-b0d0-7e1b90676be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:33.902740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfee460-5dd9-4d64-b0d0-7e1b90676be4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:34.228921 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3341/6631] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:33 2022] POST /identity/v3/users => generated 290 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:34.230819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfee460-5dd9-4d64-b0d0-7e1b90676be4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:34.233927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5bfee460-5dd9-4d64-b0d0-7e1b90676be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:34.235046 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3291/6632] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:33 2022] POST /identity/v3/users => generated 291 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:34.238476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175cb85-b023-4088-a962-e6ea8c3f77fa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:34.253744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfee460-5dd9-4d64-b0d0-7e1b90676be4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:34.260301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:34.261883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:34.262370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:34.263045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8 admin admin] PATH_INFO: `/v3/projects/b1bf1a83f81d44beb5c682d456123ffd` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:34.265952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1bf1a83f81d44beb5c682d456123ffd)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:34.268215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:34.299272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175cb85-b023-4088-a962-e6ea8c3f77fa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:34.311062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774387e-e135-479d-9ba6-e928f5c0d03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:34.312782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774387e-e135-479d-9ba6-e928f5c0d03f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:34.313015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774387e-e135-479d-9ba6-e928f5c0d03f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:34.313294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774387e-e135-479d-9ba6-e928f5c0d03f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:34.316476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774387e-e135-479d-9ba6-e928f5c0d03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:34.319968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774387e-e135-479d-9ba6-e928f5c0d03f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:34.341382 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3292/6633] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:34.342581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774387e-e135-479d-9ba6-e928f5c0d03f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:34.371593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774387e-e135-479d-9ba6-e928f5c0d03f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:34.380193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db8276-9bd5-439b-8a5d-5129d5411d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:34.380766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8276-9bd5-439b-8a5d-5129d5411d1a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:34.381186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8276-9bd5-439b-8a5d-5129d5411d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:34.381506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8276-9bd5-439b-8a5d-5129d5411d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:34.382177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db8276-9bd5-439b-8a5d-5129d5411d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:34.383871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db8276-9bd5-439b-8a5d-5129d5411d1a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:34.397137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:34.407410 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3293/6634] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:34.412250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db8276-9bd5-439b-8a5d-5129d5411d1a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:34.433678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db8276-9bd5-439b-8a5d-5129d5411d1a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:34.438845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1bf1a83f81d44beb5c682d456123ffd', 'request_id': 'req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:34.448910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1bf1a83f81d44beb5c682d456123ffd', 'request_id': 'req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:34.539908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3036f9-1f19-4074-9bdb-02d068d38a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:34.540662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3036f9-1f19-4074-9bdb-02d068d38a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:34.541018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3036f9-1f19-4074-9bdb-02d068d38a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:34.541372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3036f9-1f19-4074-9bdb-02d068d38a52 admin admin] PATH_INFO: `/v3/projects/b750311dbfc3486e91869f5c1fcbad4f/users/8273e2cce62f43e4b78640a3a362093b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:34.558600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3036f9-1f19-4074-9bdb-02d068d38a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b750311dbfc3486e91869f5c1fcbad4f, user_id=8273e2cce62f43e4b78640a3a362093b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:34.561385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3036f9-1f19-4074-9bdb-02d068d38a52 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:34.567293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1bf1a83f81d44beb5c682d456123ffd', 'request_id': 'req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:34.581572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8 admin admin] The token cache is being invalidate because project b1bf1a83f81d44beb5c682d456123ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:34.581719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:34.582303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:34.583927 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3342/6635] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:34 2022] DELETE /identity/v3/projects/b1bf1a83f81d44beb5c682d456123ffd => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:34.584790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:34.586088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:34.599759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6949ab9-7ff2-45e1-a415-2c40d1c47db8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:34.604572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b4f77-1840-402c-a119-850273cf8d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:34.605244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b4f77-1840-402c-a119-850273cf8d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:34.605521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b4f77-1840-402c-a119-850273cf8d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:34.605790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b4f77-1840-402c-a119-850273cf8d58 admin admin] PATH_INFO: `/v3/projects/98446ef54d984224af5e322412a29a79/users/d66ccabe2b09498083e4dfcfd37a973e/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:34.625712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:34.629275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b4f77-1840-402c-a119-850273cf8d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98446ef54d984224af5e322412a29a79, user_id=d66ccabe2b09498083e4dfcfd37a973e, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:34.632589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b4f77-1840-402c-a119-850273cf8d58 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:34.660589 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3294/6636] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:34 2022] PUT /identity/v3/projects/b750311dbfc3486e91869f5c1fcbad4f/users/8273e2cce62f43e4b78640a3a362093b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:34.661669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3036f9-1f19-4074-9bdb-02d068d38a52 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:34.664896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3e3036f9-1f19-4074-9bdb-02d068d38a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:34.760398 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3343/6637] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:34 2022] PUT /identity/v3/projects/98446ef54d984224af5e322412a29a79/users/d66ccabe2b09498083e4dfcfd37a973e/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:34.762813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b4f77-1840-402c-a119-850273cf8d58 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:34.778576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7f7b4f77-1840-402c-a119-850273cf8d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:34.804457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3036f9-1f19-4074-9bdb-02d068d38a52 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:34.923293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b4f77-1840-402c-a119-850273cf8d58 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:34.943297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6f0ae-4d53-4c1a-9c76-1245fa4edb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:34.944096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6f0ae-4d53-4c1a-9c76-1245fa4edb2a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:34.951846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6f0ae-4d53-4c1a-9c76-1245fa4edb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:34.951846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6f0ae-4d53-4c1a-9c76-1245fa4edb2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:34.951846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6f0ae-4d53-4c1a-9c76-1245fa4edb2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:34.951846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6f0ae-4d53-4c1a-9c76-1245fa4edb2a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:34.973280 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3344/6638] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:34.974309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6f0ae-4d53-4c1a-9c76-1245fa4edb2a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:34.987260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793235ae-3d13-4ff5-bf39-845bac99b97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:34.992121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793235ae-3d13-4ff5-bf39-845bac99b97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:34.992121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793235ae-3d13-4ff5-bf39-845bac99b97d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:34.992121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793235ae-3d13-4ff5-bf39-845bac99b97d admin admin] PATH_INFO: `/v3/users/26a9f2f321e747b4840b470c1e72a8de` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:34.992121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793235ae-3d13-4ff5-bf39-845bac99b97d admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a9f2f321e747b4840b470c1e72a8de)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:34.994688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793235ae-3d13-4ff5-bf39-845bac99b97d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:34.998477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6f0ae-4d53-4c1a-9c76-1245fa4edb2a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:35.006636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dcec0-5266-4863-ad36-689a8817eaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:35.011061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dcec0-5266-4863-ad36-689a8817eaf7 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:35.011361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dcec0-5266-4863-ad36-689a8817eaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:35.013183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dcec0-5266-4863-ad36-689a8817eaf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:35.013883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3dcec0-5266-4863-ad36-689a8817eaf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:35.019070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3dcec0-5266-4863-ad36-689a8817eaf7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:35.096217 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3345/6639] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:35.101793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dcec0-5266-4863-ad36-689a8817eaf7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:35.123790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dcec0-5266-4863-ad36-689a8817eaf7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:35.131898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80497163-a2f0-4954-b416-71bf0c569f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:35.132673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80497163-a2f0-4954-b416-71bf0c569f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:35.132953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80497163-a2f0-4954-b416-71bf0c569f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:35.133225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80497163-a2f0-4954-b416-71bf0c569f67 admin admin] PATH_INFO: `/v3/projects/b750311dbfc3486e91869f5c1fcbad4f/users/8273e2cce62f43e4b78640a3a362093b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:35.141460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80497163-a2f0-4954-b416-71bf0c569f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b750311dbfc3486e91869f5c1fcbad4f, user_id=8273e2cce62f43e4b78640a3a362093b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:35.144782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80497163-a2f0-4954-b416-71bf0c569f67 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:35.183752 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3346/6640] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:35 2022] PUT /identity/v3/projects/b750311dbfc3486e91869f5c1fcbad4f/users/8273e2cce62f43e4b78640a3a362093b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:35.184870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80497163-a2f0-4954-b416-71bf0c569f67 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:35.285589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80497163-a2f0-4954-b416-71bf0c569f67 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:35.296681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06def360-73f4-4a91-b282-a5a078ee5686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:35.297807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06def360-73f4-4a91-b282-a5a078ee5686 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:35.298166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06def360-73f4-4a91-b282-a5a078ee5686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:35.298535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06def360-73f4-4a91-b282-a5a078ee5686 admin admin] PATH_INFO: `/v3/projects/98446ef54d984224af5e322412a29a79/users/d66ccabe2b09498083e4dfcfd37a973e/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:35.301071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06def360-73f4-4a91-b282-a5a078ee5686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98446ef54d984224af5e322412a29a79, user_id=d66ccabe2b09498083e4dfcfd37a973e, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:35.305459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06def360-73f4-4a91-b282-a5a078ee5686 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:35.324605 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3347/6641] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:35 2022] PUT /identity/v3/projects/98446ef54d984224af5e322412a29a79/users/d66ccabe2b09498083e4dfcfd37a973e/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:35.326484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef887f-f16b-48ae-a361-21aa0d17be2a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:35.327211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef887f-f16b-48ae-a361-21aa0d17be2a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:35.327655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef887f-f16b-48ae-a361-21aa0d17be2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:35.374859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-793235ae-3d13-4ff5-bf39-845bac99b97d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a9f2f321e747b4840b470c1e72a8de'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:35.407510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-16ef887f-f16b-48ae-a361-21aa0d17be2a None None] MFA Rules not processed for user `8273e2cce62f43e4b78640a3a362093b`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:35.408779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-16ef887f-f16b-48ae-a361-21aa0d17be2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:35.488008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-793235ae-3d13-4ff5-bf39-845bac99b97d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a9f2f321e747b4840b470c1e72a8de'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:35.488823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-793235ae-3d13-4ff5-bf39-845bac99b97d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a9f2f321e747b4840b470c1e72a8de'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:35.501095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-793235ae-3d13-4ff5-bf39-845bac99b97d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a9f2f321e747b4840b470c1e72a8de'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:35.531206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-793235ae-3d13-4ff5-bf39-845bac99b97d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a9f2f321e747b4840b470c1e72a8de'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:35.547272 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3295/6642] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:34 2022] DELETE /identity/v3/users/26a9f2f321e747b4840b470c1e72a8de => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:35.553105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793235ae-3d13-4ff5-bf39-845bac99b97d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:35.562066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-793235ae-3d13-4ff5-bf39-845bac99b97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:35.572919 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3348/6643] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:35.572919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e6f9-bc94-4443-abcf-7c575476d4b7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:35.572919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e6f9-bc94-4443-abcf-7c575476d4b7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:35.572919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e6f9-bc94-4443-abcf-7c575476d4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:35.628032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5b00e6f9-bc94-4443-abcf-7c575476d4b7 None None] MFA Rules not processed for user `d66ccabe2b09498083e4dfcfd37a973e`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:35.629490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5b00e6f9-bc94-4443-abcf-7c575476d4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:35.689513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793235ae-3d13-4ff5-bf39-845bac99b97d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:35.698522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b1d35-ebcc-436a-81d5-137396a56a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:35.699422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b1d35-ebcc-436a-81d5-137396a56a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:35.700047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b1d35-ebcc-436a-81d5-137396a56a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:35.701816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b1d35-ebcc-436a-81d5-137396a56a77 admin admin] PATH_INFO: `/v3/users/651212b975f24a5e905ef3491800cc90` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:35.705012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b1d35-ebcc-436a-81d5-137396a56a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=651212b975f24a5e905ef3491800cc90)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:35.707574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b1d35-ebcc-436a-81d5-137396a56a77 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:35.788340 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3349/6644] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:35.790119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00e6f9-bc94-4443-abcf-7c575476d4b7 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:35.904545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00e6f9-bc94-4443-abcf-7c575476d4b7 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:35.915656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9d3fa-8270-4981-9b26-71dcbb07adcd tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:35.916328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9d3fa-8270-4981-9b26-71dcbb07adcd tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:35.916615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9d3fa-8270-4981-9b26-71dcbb07adcd tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:35.916893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9d3fa-8270-4981-9b26-71dcbb07adcd tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:35.917584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9d3fa-8270-4981-9b26-71dcbb07adcd tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:35.919324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9d3fa-8270-4981-9b26-71dcbb07adcd tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:36.052955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b45b1d35-ebcc-436a-81d5-137396a56a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651212b975f24a5e905ef3491800cc90'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:36.068957 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3350/6645] 10.222.0.76 () {60 vars in 1150 bytes} [Sat Aug 27 04:54:35 2022] POST /identity/v3/domains => generated 276 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:36.070768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9d3fa-8270-4981-9b26-71dcbb07adcd tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:36.081074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-58f9d3fa-8270-4981-9b26-71dcbb07adcd tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:36.188045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b45b1d35-ebcc-436a-81d5-137396a56a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651212b975f24a5e905ef3491800cc90'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:36.188919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b45b1d35-ebcc-436a-81d5-137396a56a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651212b975f24a5e905ef3491800cc90'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:36.217076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b45b1d35-ebcc-436a-81d5-137396a56a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651212b975f24a5e905ef3491800cc90'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:36.217216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9d3fa-8270-4981-9b26-71dcbb07adcd tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:36.221795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:36.239555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d25079-71ee-45c6-937b-7718952acd6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:36.241442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d25079-71ee-45c6-937b-7718952acd6d service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:36.243494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d25079-71ee-45c6-937b-7718952acd6d service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:36.244455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d25079-71ee-45c6-937b-7718952acd6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:36.248769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b45b1d35-ebcc-436a-81d5-137396a56a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651212b975f24a5e905ef3491800cc90'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:36.262326 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3296/6646] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:35 2022] DELETE /identity/v3/users/651212b975f24a5e905ef3491800cc90 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:36.263184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b1d35-ebcc-436a-81d5-137396a56a77 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:36.268393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b45b1d35-ebcc-436a-81d5-137396a56a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:36.315943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:36.353497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d25079-71ee-45c6-937b-7718952acd6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:36.355482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d25079-71ee-45c6-937b-7718952acd6d service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:36.372593 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3351/6647] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:36.375111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc8456-6696-4875-9d69-480cfb4d0a2d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:36.375918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc8456-6696-4875-9d69-480cfb4d0a2d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:36.376229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc8456-6696-4875-9d69-480cfb4d0a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:36.412954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2dbc8456-6696-4875-9d69-480cfb4d0a2d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:36.415180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2dbc8456-6696-4875-9d69-480cfb4d0a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:36.425035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b1d35-ebcc-436a-81d5-137396a56a77 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:36.432016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b14aad-894b-400e-9f19-5d7a004ef608 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:36.432704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b14aad-894b-400e-9f19-5d7a004ef608 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:36.433129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b14aad-894b-400e-9f19-5d7a004ef608 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:36.433224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b14aad-894b-400e-9f19-5d7a004ef608 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:36.433968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b14aad-894b-400e-9f19-5d7a004ef608 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:36.436226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b14aad-894b-400e-9f19-5d7a004ef608 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:36.556736 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3297/6648] 10.222.0.76 () {60 vars in 1150 bytes} [Sat Aug 27 04:54:36 2022] POST /identity/v3/domains => generated 276 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:36.564102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b14aad-894b-400e-9f19-5d7a004ef608 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:36.594366 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3352/6649] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:36.596323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc8456-6696-4875-9d69-480cfb4d0a2d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:36.598806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2dbc8456-6696-4875-9d69-480cfb4d0a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:36.655984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b14aad-894b-400e-9f19-5d7a004ef608 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:36.661193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0d9e0-18dc-492b-9c96-ac2cfb049a18 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:36.662355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0d9e0-18dc-492b-9c96-ac2cfb049a18 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:36.662498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0d9e0-18dc-492b-9c96-ac2cfb049a18 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:36.671599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0d9e0-18dc-492b-9c96-ac2cfb049a18 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:36.671599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0d9e0-18dc-492b-9c96-ac2cfb049a18 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:36.671599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0d9e0-18dc-492b-9c96-ac2cfb049a18 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:36.680909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc8456-6696-4875-9d69-480cfb4d0a2d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:36.795423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6b781-b325-41a3-9b03-e778a076a066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:36.797253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6b781-b325-41a3-9b03-e778a076a066 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:36.797763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6b781-b325-41a3-9b03-e778a076a066 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:36.798224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6b781-b325-41a3-9b03-e778a076a066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:36.806120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fbe6b781-b325-41a3-9b03-e778a076a066 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:36.834608 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3298/6650] 10.222.0.76 () {60 vars in 1150 bytes} [Sat Aug 27 04:54:36 2022] POST /identity/v3/domains => generated 277 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:54:36.836496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0d9e0-18dc-492b-9c96-ac2cfb049a18 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:36.839818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4dc0d9e0-18dc-492b-9c96-ac2cfb049a18 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:36.957299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6b781-b325-41a3-9b03-e778a076a066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:36.967476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6b781-b325-41a3-9b03-e778a076a066 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:36.981313 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3353/6651] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:36.982261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6b781-b325-41a3-9b03-e778a076a066 service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:36.995691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6b781-b325-41a3-9b03-e778a076a066 service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:37.022511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0d9e0-18dc-492b-9c96-ac2cfb049a18 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:37.035822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cdeb0-1d6c-4718-9de5-d1e24aaa41b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:37.036481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cdeb0-1d6c-4718-9de5-d1e24aaa41b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:37.036762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cdeb0-1d6c-4718-9de5-d1e24aaa41b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:37.037041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cdeb0-1d6c-4718-9de5-d1e24aaa41b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:37.134379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac1afd-6412-4c9b-9f9f-1a4178e65116 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:37.135466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac1afd-6412-4c9b-9f9f-1a4178e65116 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:37.138018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac1afd-6412-4c9b-9f9f-1a4178e65116 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:37.138448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac1afd-6412-4c9b-9f9f-1a4178e65116 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:37.140856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac1afd-6412-4c9b-9f9f-1a4178e65116 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:37.144153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac1afd-6412-4c9b-9f9f-1a4178e65116 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:37.167228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1cdeb0-1d6c-4718-9de5-d1e24aaa41b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:37.169377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1cdeb0-1d6c-4718-9de5-d1e24aaa41b4 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:37.186562 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3299/6652] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:37.259025 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3354/6653] 10.222.0.76 () {60 vars in 1150 bytes} [Sat Aug 27 04:54:36 2022] POST /identity/v3/domains => generated 279 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:37.263281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cdeb0-1d6c-4718-9de5-d1e24aaa41b4 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:37.278344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cdeb0-1d6c-4718-9de5-d1e24aaa41b4 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:37.388499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:37.389063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:37.389345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:37.390210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/e66e6635e63b419e9832cce9dfec6b4f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:37.406196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e66e6635e63b419e9832cce9dfec6b4f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:37.406707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:37.442250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e66e6635e63b419e9832cce9dfec6b4f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:37.447449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e66e6635e63b419e9832cce9dfec6b4f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:37.574664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac1afd-6412-4c9b-9f9f-1a4178e65116 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:37.576707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e9ac1afd-6412-4c9b-9f9f-1a4178e65116 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:37.680502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66e6635e63b419e9832cce9dfec6b4f', 'request_id': 'req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:37.689928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66e6635e63b419e9832cce9dfec6b4f', 'request_id': 'req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:37.707700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66e6635e63b419e9832cce9dfec6b4f', 'request_id': 'req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:37.756970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac1afd-6412-4c9b-9f9f-1a4178e65116 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:37.837233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] The token cache is being invalidate because project e66e6635e63b419e9832cce9dfec6b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:37.837595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:37.839710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:37.863965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:37.878932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e66e6635e63b419e9832cce9dfec6b4f', 'request_id': 'req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:37.886755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e66e6635e63b419e9832cce9dfec6b4f', 'request_id': 'req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:37.888798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e66e6635e63b419e9832cce9dfec6b4f', 'request_id': 'req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:37.904804 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3300/6654] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:54:37 2022] DELETE /identity/v3/domains/e66e6635e63b419e9832cce9dfec6b4f => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:37.908244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7007a17-8ede-4829-aa48-d1f9e26d8b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:37.909041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7007a17-8ede-4829-aa48-d1f9e26d8b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:37.909709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7007a17-8ede-4829-aa48-d1f9e26d8b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:37.909992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7007a17-8ede-4829-aa48-d1f9e26d8b6c admin admin] PATH_INFO: `/v3/projects/a0aa07fb3d2c4c5fa7ad80b160fea2b9` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:37.911356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7007a17-8ede-4829-aa48-d1f9e26d8b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0aa07fb3d2c4c5fa7ad80b160fea2b9)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:37.911524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:37.917237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:37.917338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7007a17-8ede-4829-aa48-d1f9e26d8b6c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:38.020203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd111b-c46c-4e5e-b8e9-dcc6a3c508b8 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:38.025305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78843f-4a21-4c93-8801-4192ea6f709c tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:38.026111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78843f-4a21-4c93-8801-4192ea6f709c tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:38.026490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78843f-4a21-4c93-8801-4192ea6f709c tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:38.026771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78843f-4a21-4c93-8801-4192ea6f709c tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:38.027881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78843f-4a21-4c93-8801-4192ea6f709c tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:38.029593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78843f-4a21-4c93-8801-4192ea6f709c tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:38.163209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f7007a17-8ede-4829-aa48-d1f9e26d8b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0aa07fb3d2c4c5fa7ad80b160fea2b9', 'request_id': 'req-f7007a17-8ede-4829-aa48-d1f9e26d8b6c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:38.168456 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3301/6655] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:54:37 2022] POST /identity/v3/domains => generated 249 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:38.170429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78843f-4a21-4c93-8801-4192ea6f709c tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:38.187758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f7007a17-8ede-4829-aa48-d1f9e26d8b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0aa07fb3d2c4c5fa7ad80b160fea2b9', 'request_id': 'req-f7007a17-8ede-4829-aa48-d1f9e26d8b6c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:38.282786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f7007a17-8ede-4829-aa48-d1f9e26d8b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0aa07fb3d2c4c5fa7ad80b160fea2b9', 'request_id': 'req-f7007a17-8ede-4829-aa48-d1f9e26d8b6c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:38.314728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78843f-4a21-4c93-8801-4192ea6f709c tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:38.315607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f7007a17-8ede-4829-aa48-d1f9e26d8b6c admin admin] The token cache is being invalidate because project a0aa07fb3d2c4c5fa7ad80b160fea2b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:38.316013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f7007a17-8ede-4829-aa48-d1f9e26d8b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:38.316930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f7007a17-8ede-4829-aa48-d1f9e26d8b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:38.323875 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3355/6656] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:37 2022] DELETE /identity/v3/projects/a0aa07fb3d2c4c5fa7ad80b160fea2b9 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:54:38.325799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75cfe5-b0db-4983-9107-c9b49aaf2e4a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:38.326091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75cfe5-b0db-4983-9107-c9b49aaf2e4a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:38.326460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75cfe5-b0db-4983-9107-c9b49aaf2e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:38.328642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc1eed-25df-41c6-8930-019665f20e04 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:38.329430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc1eed-25df-41c6-8930-019665f20e04 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:38.329788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc1eed-25df-41c6-8930-019665f20e04 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:38.330462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc1eed-25df-41c6-8930-019665f20e04 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/d7bbc126b79349299a1039cdacaf39bf` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:38.361299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5a75cfe5-b0db-4983-9107-c9b49aaf2e4a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:38.361788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc1eed-25df-41c6-8930-019665f20e04 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d7bbc126b79349299a1039cdacaf39bf)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:38.362603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5a75cfe5-b0db-4983-9107-c9b49aaf2e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:38.363714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc1eed-25df-41c6-8930-019665f20e04 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:38.441420 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3356/6657] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:38.443257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d9fc1eed-25df-41c6-8930-019665f20e04 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd7bbc126b79349299a1039cdacaf39bf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:38.444273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d9fc1eed-25df-41c6-8930-019665f20e04 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd7bbc126b79349299a1039cdacaf39bf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:38.447173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e2124-8025-4fed-ab0d-95efb8d81957 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:38.447464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e2124-8025-4fed-ab0d-95efb8d81957 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:38.448031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e2124-8025-4fed-ab0d-95efb8d81957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:38.478583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c91e2124-8025-4fed-ab0d-95efb8d81957 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:38.480484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c91e2124-8025-4fed-ab0d-95efb8d81957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:38.572387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d9fc1eed-25df-41c6-8930-019665f20e04 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd7bbc126b79349299a1039cdacaf39bf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:38.575346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d9fc1eed-25df-41c6-8930-019665f20e04 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd7bbc126b79349299a1039cdacaf39bf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:38.581339 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3302/6658] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:54:38 2022] PATCH /identity/v3/domains/d7bbc126b79349299a1039cdacaf39bf => generated 250 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:54:38.586390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc1eed-25df-41c6-8930-019665f20e04 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:38.588737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d9fc1eed-25df-41c6-8930-019665f20e04 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:38.613897 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3357/6659] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:38.615176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e2124-8025-4fed-ab0d-95efb8d81957 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:38.626886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e2124-8025-4fed-ab0d-95efb8d81957 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:38.633661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32534716-8222-4526-be35-da04ac1e4eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:38.634637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32534716-8222-4526-be35-da04ac1e4eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:38.635147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32534716-8222-4526-be35-da04ac1e4eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:38.635996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32534716-8222-4526-be35-da04ac1e4eb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:38.637690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32534716-8222-4526-be35-da04ac1e4eb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:38.638213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32534716-8222-4526-be35-da04ac1e4eb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:38.641310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32534716-8222-4526-be35-da04ac1e4eb3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:38.662943 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3358/6660] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:38.662943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32534716-8222-4526-be35-da04ac1e4eb3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:38.673117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32534716-8222-4526-be35-da04ac1e4eb3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:38.679565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ac937-3677-4b6d-81ca-c2822261e200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:38.683233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ac937-3677-4b6d-81ca-c2822261e200 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:38.684070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ac937-3677-4b6d-81ca-c2822261e200 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:38.684480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ac937-3677-4b6d-81ca-c2822261e200 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:38.685340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ac937-3677-4b6d-81ca-c2822261e200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:38.687630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ac937-3677-4b6d-81ca-c2822261e200 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:38.715626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc1eed-25df-41c6-8930-019665f20e04 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:38.724469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:38.725417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:38.726326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:38.726711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/d7bbc126b79349299a1039cdacaf39bf` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:38.746061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d7bbc126b79349299a1039cdacaf39bf)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:38.746534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:38.781587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd7bbc126b79349299a1039cdacaf39bf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:38.787564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd7bbc126b79349299a1039cdacaf39bf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:38.813280 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3359/6661] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:38 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:38.817568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ac937-3677-4b6d-81ca-c2822261e200 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:38.957636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ac937-3677-4b6d-81ca-c2822261e200 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:38.973222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867e218-cee0-4507-900d-afd86a9e4d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:38.973878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867e218-cee0-4507-900d-afd86a9e4d2f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:38.974147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867e218-cee0-4507-900d-afd86a9e4d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:38.974425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867e218-cee0-4507-900d-afd86a9e4d2f admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:38.975068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867e218-cee0-4507-900d-afd86a9e4d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:38.977320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867e218-cee0-4507-900d-afd86a9e4d2f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:39.018363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7bbc126b79349299a1039cdacaf39bf', 'request_id': 'req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:39.031596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7bbc126b79349299a1039cdacaf39bf', 'request_id': 'req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:39.041317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7bbc126b79349299a1039cdacaf39bf', 'request_id': 'req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:39.084555 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3360/6662] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:38 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:39.090361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867e218-cee0-4507-900d-afd86a9e4d2f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:39.112872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867e218-cee0-4507-900d-afd86a9e4d2f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:39.199337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] The token cache is being invalidate because project d7bbc126b79349299a1039cdacaf39bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:39.199478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783a726-e1f9-4f40-a6c1-cc0360fb9408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:39.199691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:39.200454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783a726-e1f9-4f40-a6c1-cc0360fb9408 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:39.200835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783a726-e1f9-4f40-a6c1-cc0360fb9408 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:39.201277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783a726-e1f9-4f40-a6c1-cc0360fb9408 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:39.202188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783a726-e1f9-4f40-a6c1-cc0360fb9408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:39.203352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:39.204962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783a726-e1f9-4f40-a6c1-cc0360fb9408 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:39.219455 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3361/6663] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:39.219455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783a726-e1f9-4f40-a6c1-cc0360fb9408 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:39.222019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd7bbc126b79349299a1039cdacaf39bf', 'request_id': 'req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:39.226163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9783a726-e1f9-4f40-a6c1-cc0360fb9408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:39.228268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd7bbc126b79349299a1039cdacaf39bf', 'request_id': 'req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:39.233867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd7bbc126b79349299a1039cdacaf39bf', 'request_id': 'req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:39.247075 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3303/6664] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:54:38 2022] DELETE /identity/v3/domains/d7bbc126b79349299a1039cdacaf39bf => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:39.247075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:39.252790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:39.259021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783a726-e1f9-4f40-a6c1-cc0360fb9408 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:39.270794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad003bf9-84be-43cb-ba04-6e805009ae4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:39.271631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad003bf9-84be-43cb-ba04-6e805009ae4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:39.272723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad003bf9-84be-43cb-ba04-6e805009ae4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:39.273109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad003bf9-84be-43cb-ba04-6e805009ae4d admin admin] PATH_INFO: `/v3/projects/80176ca9b46c4f1ca3432d8b0e18b710` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:39.275409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad003bf9-84be-43cb-ba04-6e805009ae4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=80176ca9b46c4f1ca3432d8b0e18b710)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:39.278873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad003bf9-84be-43cb-ba04-6e805009ae4d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:39.282786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c2daf-a7d3-4e48-a070-91d5e5b61d6b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:39.296640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379d223-d10e-4e91-b976-f142a31d39ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:39.300072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379d223-d10e-4e91-b976-f142a31d39ef admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:39.300496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379d223-d10e-4e91-b976-f142a31d39ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:39.301079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379d223-d10e-4e91-b976-f142a31d39ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:39.302916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379d223-d10e-4e91-b976-f142a31d39ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:39.314277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379d223-d10e-4e91-b976-f142a31d39ef admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:39.327663 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3304/6665] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:39.329349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379d223-d10e-4e91-b976-f142a31d39ef admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:39.332214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a379d223-d10e-4e91-b976-f142a31d39ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:39.428638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379d223-d10e-4e91-b976-f142a31d39ef admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:39.434494 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19e7c9-d6d3-4e33-b01e-40e723558c4b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:39.435053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e7c9-d6d3-4e33-b01e-40e723558c4b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:39.435340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e7c9-d6d3-4e33-b01e-40e723558c4b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:39.435619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e7c9-d6d3-4e33-b01e-40e723558c4b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:39.436930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19e7c9-d6d3-4e33-b01e-40e723558c4b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:39.438713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19e7c9-d6d3-4e33-b01e-40e723558c4b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:39.468256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad003bf9-84be-43cb-ba04-6e805009ae4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80176ca9b46c4f1ca3432d8b0e18b710', 'request_id': 'req-ad003bf9-84be-43cb-ba04-6e805009ae4d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:39.475417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad003bf9-84be-43cb-ba04-6e805009ae4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80176ca9b46c4f1ca3432d8b0e18b710', 'request_id': 'req-ad003bf9-84be-43cb-ba04-6e805009ae4d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:39.569179 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3305/6666] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:54:39 2022] POST /identity/v3/domains => generated 279 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:39.570584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19e7c9-d6d3-4e33-b01e-40e723558c4b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:39.589260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad003bf9-84be-43cb-ba04-6e805009ae4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80176ca9b46c4f1ca3432d8b0e18b710', 'request_id': 'req-ad003bf9-84be-43cb-ba04-6e805009ae4d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:39.610431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad003bf9-84be-43cb-ba04-6e805009ae4d admin admin] The token cache is being invalidate because project 80176ca9b46c4f1ca3432d8b0e18b710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:39.613058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad003bf9-84be-43cb-ba04-6e805009ae4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:39.617032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad003bf9-84be-43cb-ba04-6e805009ae4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:39.620423 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3362/6667] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:39 2022] DELETE /identity/v3/projects/80176ca9b46c4f1ca3432d8b0e18b710 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:39.626911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad003bf9-84be-43cb-ba04-6e805009ae4d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:39.630018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ad003bf9-84be-43cb-ba04-6e805009ae4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:39.750201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19e7c9-d6d3-4e33-b01e-40e723558c4b tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:39.754077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad003bf9-84be-43cb-ba04-6e805009ae4d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:39.765114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb40607-472e-4ef0-9f80-c2a9efeec889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:39.765815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb40607-472e-4ef0-9f80-c2a9efeec889 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:39.770244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb40607-472e-4ef0-9f80-c2a9efeec889 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:39.770244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb40607-472e-4ef0-9f80-c2a9efeec889 admin admin] PATH_INFO: `/v3/projects/997959007c0449eba561015b0a86a394/users/4fdbdb3e5e544e098d0163029def54d2/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:39.808748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb40607-472e-4ef0-9f80-c2a9efeec889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=997959007c0449eba561015b0a86a394, user_id=4fdbdb3e5e544e098d0163029def54d2, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:39.811598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb40607-472e-4ef0-9f80-c2a9efeec889 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:39.827345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:39.837973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fafb83-27c7-48bb-bfa4-4226bb952dfe tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:39.839488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fafb83-27c7-48bb-bfa4-4226bb952dfe tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:39.840122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fafb83-27c7-48bb-bfa4-4226bb952dfe tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:39.840705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fafb83-27c7-48bb-bfa4-4226bb952dfe tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/fe43bba4eca546cb931af85840b46db6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:39.857245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fafb83-27c7-48bb-bfa4-4226bb952dfe tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=fe43bba4eca546cb931af85840b46db6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:39.860327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fafb83-27c7-48bb-bfa4-4226bb952dfe tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:39.884247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c7fafb83-27c7-48bb-bfa4-4226bb952dfe tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'fe43bba4eca546cb931af85840b46db6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:39.885003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c7fafb83-27c7-48bb-bfa4-4226bb952dfe tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'fe43bba4eca546cb931af85840b46db6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:39.930056 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3306/6668] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:39 2022] PUT /identity/v3/projects/997959007c0449eba561015b0a86a394/users/4fdbdb3e5e544e098d0163029def54d2/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:39.931336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb40607-472e-4ef0-9f80-c2a9efeec889 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:39.933266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bdb40607-472e-4ef0-9f80-c2a9efeec889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:40.033645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb40607-472e-4ef0-9f80-c2a9efeec889 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:40.042007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa0714-584c-4002-8d38-2f76ac1a3f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:40.042640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa0714-584c-4002-8d38-2f76ac1a3f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:40.042918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa0714-584c-4002-8d38-2f76ac1a3f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:40.043193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa0714-584c-4002-8d38-2f76ac1a3f0a admin admin] PATH_INFO: `/v3/users/89ee03a621404c579134638a96cc7c3a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:40.047337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa0714-584c-4002-8d38-2f76ac1a3f0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ee03a621404c579134638a96cc7c3a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:40.049381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa0714-584c-4002-8d38-2f76ac1a3f0a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:40.067179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c7fafb83-27c7-48bb-bfa4-4226bb952dfe tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'fe43bba4eca546cb931af85840b46db6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:40.072620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c7fafb83-27c7-48bb-bfa4-4226bb952dfe tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'fe43bba4eca546cb931af85840b46db6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:40.075567 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3363/6669] 10.222.0.76 () {60 vars in 1250 bytes} [Sat Aug 27 04:54:39 2022] PATCH /identity/v3/domains/fe43bba4eca546cb931af85840b46db6 => generated 278 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:40.077451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24cdda-1021-4004-a019-9a7ccf578278 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:40.077740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24cdda-1021-4004-a019-9a7ccf578278 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:40.078055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24cdda-1021-4004-a019-9a7ccf578278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:40.121576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4c24cdda-1021-4004-a019-9a7ccf578278 None None] MFA Rules not processed for user `4fdbdb3e5e544e098d0163029def54d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:40.122886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4c24cdda-1021-4004-a019-9a7ccf578278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:40.237162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:40.259289 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3364/6670] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:40.263503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24cdda-1021-4004-a019-9a7ccf578278 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:40.266504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4c24cdda-1021-4004-a019-9a7ccf578278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:40.392065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24cdda-1021-4004-a019-9a7ccf578278 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:40.394112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8cfa0714-584c-4002-8d38-2f76ac1a3f0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ee03a621404c579134638a96cc7c3a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:40.407988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e921d-1662-4e0c-9fd7-96ce1b20bcf9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:40.408825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e921d-1662-4e0c-9fd7-96ce1b20bcf9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:40.409206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e921d-1662-4e0c-9fd7-96ce1b20bcf9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:40.409579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e921d-1662-4e0c-9fd7-96ce1b20bcf9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/fe43bba4eca546cb931af85840b46db6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:40.423716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e921d-1662-4e0c-9fd7-96ce1b20bcf9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=fe43bba4eca546cb931af85840b46db6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:40.426072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e921d-1662-4e0c-9fd7-96ce1b20bcf9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:40.432130 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3365/6671] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:54:40 2022] GET /identity/v3/domains/fe43bba4eca546cb931af85840b46db6 => generated 278 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:40.433572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e921d-1662-4e0c-9fd7-96ce1b20bcf9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:40.435721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0e4e921d-1662-4e0c-9fd7-96ce1b20bcf9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:40.527692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8cfa0714-584c-4002-8d38-2f76ac1a3f0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ee03a621404c579134638a96cc7c3a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:40.528447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8cfa0714-584c-4002-8d38-2f76ac1a3f0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ee03a621404c579134638a96cc7c3a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:40.540121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8cfa0714-584c-4002-8d38-2f76ac1a3f0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ee03a621404c579134638a96cc7c3a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:40.567729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e921d-1662-4e0c-9fd7-96ce1b20bcf9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:40.567942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8cfa0714-584c-4002-8d38-2f76ac1a3f0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ee03a621404c579134638a96cc7c3a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:40.573312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db3cbe-df6f-4323-b0a4-a476d50bdd37 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6abe8e24472473db0db24442dbea5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75242710afb742d1bf54731062bd5cba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:40.573984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db3cbe-df6f-4323-b0a4-a476d50bdd37 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:40.574279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db3cbe-df6f-4323-b0a4-a476d50bdd37 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:40.574554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db3cbe-df6f-4323-b0a4-a476d50bdd37 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:40.575573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db3cbe-df6f-4323-b0a4-a476d50bdd37 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:40.576100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db3cbe-df6f-4323-b0a4-a476d50bdd37 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:40.579544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db3cbe-df6f-4323-b0a4-a476d50bdd37 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:40.582113 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3307/6672] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:39 2022] DELETE /identity/v3/users/89ee03a621404c579134638a96cc7c3a => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:40.586173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa0714-584c-4002-8d38-2f76ac1a3f0a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:40.587699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8cfa0714-584c-4002-8d38-2f76ac1a3f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:40.596864 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3366/6673] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:40.597956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db3cbe-df6f-4323-b0a4-a476d50bdd37 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:40.599663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a9db3cbe-df6f-4323-b0a4-a476d50bdd37 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:40.641573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db3cbe-df6f-4323-b0a4-a476d50bdd37 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:40.721409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa0714-584c-4002-8d38-2f76ac1a3f0a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:40.757065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6089df-47ab-485c-b81d-332499bcdf7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:40.757713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6089df-47ab-485c-b81d-332499bcdf7d service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:40.758006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6089df-47ab-485c-b81d-332499bcdf7d service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:40.758290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6089df-47ab-485c-b81d-332499bcdf7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:40.760967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3c6089df-47ab-485c-b81d-332499bcdf7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:40.791569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:40.792267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:40.792615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:40.792894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/fe43bba4eca546cb931af85840b46db6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:40.797580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fe43bba4eca546cb931af85840b46db6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:40.801189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:40.866891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fe43bba4eca546cb931af85840b46db6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:40.875492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fe43bba4eca546cb931af85840b46db6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:40.885286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6089df-47ab-485c-b81d-332499bcdf7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:40.887605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6089df-47ab-485c-b81d-332499bcdf7d service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:40.903864 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3308/6674] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:40.906924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6089df-47ab-485c-b81d-332499bcdf7d service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:40.909051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3c6089df-47ab-485c-b81d-332499bcdf7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:41.014171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6089df-47ab-485c-b81d-332499bcdf7d service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:41.022741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36b92e-274d-4435-a46a-851f011b9b35 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6abe8e24472473db0db24442dbea5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75242710afb742d1bf54731062bd5cba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:41.022741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36b92e-274d-4435-a46a-851f011b9b35 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:41.022741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36b92e-274d-4435-a46a-851f011b9b35 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:41.023058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36b92e-274d-4435-a46a-851f011b9b35 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:41.023488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36b92e-274d-4435-a46a-851f011b9b35 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:41.025488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36b92e-274d-4435-a46a-851f011b9b35 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:41.051184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe43bba4eca546cb931af85840b46db6', 'request_id': 'req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:41.058709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe43bba4eca546cb931af85840b46db6', 'request_id': 'req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:41.167980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe43bba4eca546cb931af85840b46db6', 'request_id': 'req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:41.193153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] The token cache is being invalidate because project fe43bba4eca546cb931af85840b46db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:41.193569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:41.195780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:41.197658 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3309/6675] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:40 2022] POST /identity/v3/projects => generated 347 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:41.201703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36b92e-274d-4435-a46a-851f011b9b35 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:41.208555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2f36b92e-274d-4435-a46a-851f011b9b35 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:41.210405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fe43bba4eca546cb931af85840b46db6', 'request_id': 'req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:41.212209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fe43bba4eca546cb931af85840b46db6', 'request_id': 'req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:41.212787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fe43bba4eca546cb931af85840b46db6', 'request_id': 'req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:41.227425 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3367/6676] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:54:40 2022] DELETE /identity/v3/domains/fe43bba4eca546cb931af85840b46db6 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:41.231460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:41.237373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:41.369509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36b92e-274d-4435-a46a-851f011b9b35 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:41.370338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea42c4-f56b-4352-86c8-8a47c8bb53dc tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:41.382268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c5217-1ff7-4379-986d-c64843fee13e tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6abe8e24472473db0db24442dbea5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75242710afb742d1bf54731062bd5cba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:41.382955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c5217-1ff7-4379-986d-c64843fee13e tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:41.383242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c5217-1ff7-4379-986d-c64843fee13e tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:41.383515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c5217-1ff7-4379-986d-c64843fee13e tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:41.385819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c5217-1ff7-4379-986d-c64843fee13e tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:41.386137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c5217-1ff7-4379-986d-c64843fee13e tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:41.389141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c5217-1ff7-4379-986d-c64843fee13e tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:41.442512 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3310/6677] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:41.465004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37767abf-ae24-4f5a-b8d3-df1cd1ae4664 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:41.466218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37767abf-ae24-4f5a-b8d3-df1cd1ae4664 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:41.466705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37767abf-ae24-4f5a-b8d3-df1cd1ae4664 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:41.467127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37767abf-ae24-4f5a-b8d3-df1cd1ae4664 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:41.469745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37767abf-ae24-4f5a-b8d3-df1cd1ae4664 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:41.473697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37767abf-ae24-4f5a-b8d3-df1cd1ae4664 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:41.516268 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3368/6678] 10.222.0.76 () {58 vars in 1128 bytes} [Sat Aug 27 04:54:41 2022] GET /identity/v3/domains => generated 1347 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:41.520682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c5217-1ff7-4379-986d-c64843fee13e tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:41.541252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c5217-1ff7-4379-986d-c64843fee13e tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:41.547889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dd294-1736-427b-8b4f-3404cde0825e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:41.548801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dd294-1736-427b-8b4f-3404cde0825e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:41.549144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dd294-1736-427b-8b4f-3404cde0825e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:41.549601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dd294-1736-427b-8b4f-3404cde0825e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/fe43bba4eca546cb931af85840b46db6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:41.561624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dd294-1736-427b-8b4f-3404cde0825e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:54:41.567546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-4e0dd294-1736-427b-8b4f-3404cde0825e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Could not find domain: fe43bba4eca546cb931af85840b46db6.: keystone.exception.DomainNotFound: Could not find domain: fe43bba4eca546cb931af85840b46db6. Aug 27 04:54:41.567546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:41.567546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:54:41.567546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:54:41.567546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:54:41.567546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:54:41.567546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:54:41.567546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:54:41.567546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: fe43bba4eca546cb931af85840b46db6. Aug 27 04:54:41.567546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:41.567546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:54:41.567546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:41.567546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:41.567546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:54:41.567546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:54:41.567546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:54:41.568762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:54:41.568762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:54:41.568762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:54:41.568762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:54:41.568762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:54:41.568762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:54:41.568762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:54:41.568762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 27 04:54:41.568762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 27 04:54:41.568762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:54:41.568762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:54:41.568762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:54:41.568762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:54:41.568762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:54:41.568762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:54:41.568762 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:54:41.569683 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:54:41.569683 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:54:41.569683 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:54:41.569683 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:54:41.569683 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:54:41.569683 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:54:41.569683 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:54:41.569683 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:54:41.569683 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:54:41.569683 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:54:41.569683 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:54:41.569683 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:54:41.569683 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:54:41.569683 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:54:41.569683 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:54:41.569683 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: fe43bba4eca546cb931af85840b46db6. Aug 27 04:54:41.569683 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:41.570597 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3311/6679] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:54:41 2022] PATCH /identity/v3/domains/fe43bba4eca546cb931af85840b46db6 => generated 112 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:54:41.574449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37767abf-ae24-4f5a-b8d3-df1cd1ae4664 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:41.587470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37767abf-ae24-4f5a-b8d3-df1cd1ae4664 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:41.594659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec5606-3274-4c95-bed5-8f6e7bf94099 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:41.595292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec5606-3274-4c95-bed5-8f6e7bf94099 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:41.595594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec5606-3274-4c95-bed5-8f6e7bf94099 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:41.596032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec5606-3274-4c95-bed5-8f6e7bf94099 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:41.596811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec5606-3274-4c95-bed5-8f6e7bf94099 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:41.598426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec5606-3274-4c95-bed5-8f6e7bf94099 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:41.632497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dd294-1736-427b-8b4f-3404cde0825e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:41.634823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4e0dd294-1736-427b-8b4f-3404cde0825e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:41.709964 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3369/6680] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:54:41 2022] POST /identity/v3/domains => generated 275 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:41.711124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec5606-3274-4c95-bed5-8f6e7bf94099 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:41.735379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dd294-1736-427b-8b4f-3404cde0825e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:41.865584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec5606-3274-4c95-bed5-8f6e7bf94099 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:41.881736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5a12e-20a0-4731-a486-85133e5fdcd4 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:41.883403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5a12e-20a0-4731-a486-85133e5fdcd4 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:41.883690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5a12e-20a0-4731-a486-85133e5fdcd4 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:41.883971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5a12e-20a0-4731-a486-85133e5fdcd4 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:41.884689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5a12e-20a0-4731-a486-85133e5fdcd4 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:41.899525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5a12e-20a0-4731-a486-85133e5fdcd4 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:41.908491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed99ec-ed31-41c8-8ab7-8dfe5f59fd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:41.910516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed99ec-ed31-41c8-8ab7-8dfe5f59fd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:41.910815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed99ec-ed31-41c8-8ab7-8dfe5f59fd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:41.911096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed99ec-ed31-41c8-8ab7-8dfe5f59fd34 admin admin] PATH_INFO: `/v3/projects/0c304b6838924a08a33fd468276afa41` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:41.923633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed99ec-ed31-41c8-8ab7-8dfe5f59fd34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c304b6838924a08a33fd468276afa41)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:41.925719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed99ec-ed31-41c8-8ab7-8dfe5f59fd34 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:42.092773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:42.111414 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3370/6681] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:41 2022] POST /identity/v3/users => generated 346 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:42.112412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5a12e-20a0-4731-a486-85133e5fdcd4 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:42.130640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5a12e-20a0-4731-a486-85133e5fdcd4 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:42.144340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f1ed99ec-ed31-41c8-8ab7-8dfe5f59fd34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c304b6838924a08a33fd468276afa41', 'request_id': 'req-f1ed99ec-ed31-41c8-8ab7-8dfe5f59fd34'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:42.167369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f1ed99ec-ed31-41c8-8ab7-8dfe5f59fd34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c304b6838924a08a33fd468276afa41', 'request_id': 'req-f1ed99ec-ed31-41c8-8ab7-8dfe5f59fd34'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:42.189588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f1ed99ec-ed31-41c8-8ab7-8dfe5f59fd34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c304b6838924a08a33fd468276afa41', 'request_id': 'req-f1ed99ec-ed31-41c8-8ab7-8dfe5f59fd34'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:42.272298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80759f6b-695d-4f23-b3fa-5657d4f82e2a tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:42.273783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80759f6b-695d-4f23-b3fa-5657d4f82e2a tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:42.274422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80759f6b-695d-4f23-b3fa-5657d4f82e2a tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:42.274981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80759f6b-695d-4f23-b3fa-5657d4f82e2a tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/groups` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:42.275644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80759f6b-695d-4f23-b3fa-5657d4f82e2a tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:42.278206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80759f6b-695d-4f23-b3fa-5657d4f82e2a tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:42.316628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f1ed99ec-ed31-41c8-8ab7-8dfe5f59fd34 admin admin] The token cache is being invalidate because project 0c304b6838924a08a33fd468276afa41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:42.316915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f1ed99ec-ed31-41c8-8ab7-8dfe5f59fd34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:42.320126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f1ed99ec-ed31-41c8-8ab7-8dfe5f59fd34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:42.322480 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3312/6682] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:41 2022] DELETE /identity/v3/projects/0c304b6838924a08a33fd468276afa41 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:42.328137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb8123-a229-4dd3-8f63-7a81322e19bf None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:42.328478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb8123-a229-4dd3-8f63-7a81322e19bf None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:42.328846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb8123-a229-4dd3-8f63-7a81322e19bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:42.364283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e0cb8123-a229-4dd3-8f63-7a81322e19bf None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:42.365511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e0cb8123-a229-4dd3-8f63-7a81322e19bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:42.414085 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3371/6683] 10.222.0.76 () {60 vars in 1147 bytes} [Sat Aug 27 04:54:42 2022] POST /identity/v3/groups => generated 325 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:42.415996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80759f6b-695d-4f23-b3fa-5657d4f82e2a tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:42.426943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-80759f6b-695d-4f23-b3fa-5657d4f82e2a tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:42.460377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80759f6b-695d-4f23-b3fa-5657d4f82e2a tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:42.466312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd072d-e4f8-4731-ac62-032f34192c67 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:42.467590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd072d-e4f8-4731-ac62-032f34192c67 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:42.471288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd072d-e4f8-4731-ac62-032f34192c67 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:42.472269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd072d-e4f8-4731-ac62-032f34192c67 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/0cb2d38a583c43bf967aa159d2777f6b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:42.475557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd072d-e4f8-4731-ac62-032f34192c67 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0cb2d38a583c43bf967aa159d2777f6b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:42.478541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd072d-e4f8-4731-ac62-032f34192c67 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:42.484071 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3313/6684] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:54:42.494650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faa6a0-aea1-4873-9c32-87db442d74de None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:42.495941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faa6a0-aea1-4873-9c32-87db442d74de None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:42.496498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faa6a0-aea1-4873-9c32-87db442d74de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:42.533836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f3faa6a0-aea1-4873-9c32-87db442d74de None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:42.535596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f3faa6a0-aea1-4873-9c32-87db442d74de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:42.547001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-89fd072d-e4f8-4731-ac62-032f34192c67 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0cb2d38a583c43bf967aa159d2777f6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:42.549258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-89fd072d-e4f8-4731-ac62-032f34192c67 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0cb2d38a583c43bf967aa159d2777f6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:42.565207 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3314/6685] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:54:42.570478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faa6a0-aea1-4873-9c32-87db442d74de None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:42.585887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faa6a0-aea1-4873-9c32-87db442d74de None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:42.696542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-89fd072d-e4f8-4731-ac62-032f34192c67 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0cb2d38a583c43bf967aa159d2777f6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:42.697234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-89fd072d-e4f8-4731-ac62-032f34192c67 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0cb2d38a583c43bf967aa159d2777f6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:42.700185 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3372/6686] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:54:42 2022] PATCH /identity/v3/domains/0cb2d38a583c43bf967aa159d2777f6b => generated 276 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:42.703947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd072d-e4f8-4731-ac62-032f34192c67 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:42.705569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-89fd072d-e4f8-4731-ac62-032f34192c67 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:42.716015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08159317-e899-4423-a6c3-90afb4311ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:42.719373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08159317-e899-4423-a6c3-90afb4311ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:42.720521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08159317-e899-4423-a6c3-90afb4311ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:42.724294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08159317-e899-4423-a6c3-90afb4311ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:42.725697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08159317-e899-4423-a6c3-90afb4311ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:42.728232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08159317-e899-4423-a6c3-90afb4311ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:42.730141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08159317-e899-4423-a6c3-90afb4311ee1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:42.784929 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3315/6687] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:42.789174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08159317-e899-4423-a6c3-90afb4311ee1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:42.797580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-08159317-e899-4423-a6c3-90afb4311ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:42.819257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:42.825200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08159317-e899-4423-a6c3-90afb4311ee1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:42.844495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61711ef4-d25a-4232-adb8-ddeeadaae363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:42.845614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61711ef4-d25a-4232-adb8-ddeeadaae363 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:42.846147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61711ef4-d25a-4232-adb8-ddeeadaae363 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:42.846667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61711ef4-d25a-4232-adb8-ddeeadaae363 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:42.847600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61711ef4-d25a-4232-adb8-ddeeadaae363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:42.851483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61711ef4-d25a-4232-adb8-ddeeadaae363 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:42.855320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd072d-e4f8-4731-ac62-032f34192c67 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:42.870754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:42.871750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:42.872217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:42.872648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/0cb2d38a583c43bf967aa159d2777f6b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:42.899012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0cb2d38a583c43bf967aa159d2777f6b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:42.903037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:42.965838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0cb2d38a583c43bf967aa159d2777f6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:42.966138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0cb2d38a583c43bf967aa159d2777f6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:43.076153 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3316/6688] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:42 2022] POST /identity/v3/projects => generated 391 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:43.079363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61711ef4-d25a-4232-adb8-ddeeadaae363 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:43.239031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61711ef4-d25a-4232-adb8-ddeeadaae363 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:43.312522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec61edd-8b9e-42ef-8a06-c03f7b524ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:43.321633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec61edd-8b9e-42ef-8a06-c03f7b524ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:43.322423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec61edd-8b9e-42ef-8a06-c03f7b524ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:43.322844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec61edd-8b9e-42ef-8a06-c03f7b524ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:43.324080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec61edd-8b9e-42ef-8a06-c03f7b524ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:43.328812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec61edd-8b9e-42ef-8a06-c03f7b524ad2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:43.359450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ebd0794f434d9caeef5cc3f86b60bb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:43.361190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ebd0794f434d9caeef5cc3f86b60bb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:43.431556 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3317/6689] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:43 2022] POST /identity/v3/users => generated 296 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:54:43.432909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec61edd-8b9e-42ef-8a06-c03f7b524ad2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:43.434669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2ec61edd-8b9e-42ef-8a06-c03f7b524ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:43.454996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ebd0794f434d9caeef5cc3f86b60bb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:43.456091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ebd0794f434d9caeef5cc3f86b60bb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:43.489163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ebd0794f434d9caeef5cc3f86b60bb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:43.574417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec61edd-8b9e-42ef-8a06-c03f7b524ad2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:43.692595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb2d38a583c43bf967aa159d2777f6b', 'request_id': 'req-84035bdb-7037-4647-a5fd-a07cfb104bfa'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:43.702102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb2d38a583c43bf967aa159d2777f6b', 'request_id': 'req-84035bdb-7037-4647-a5fd-a07cfb104bfa'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:43.722810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af9923-8a0a-4081-b03d-8ed977fa6179 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6abe8e24472473db0db24442dbea5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75242710afb742d1bf54731062bd5cba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:43.723689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af9923-8a0a-4081-b03d-8ed977fa6179 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:43.723975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af9923-8a0a-4081-b03d-8ed977fa6179 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:43.724306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af9923-8a0a-4081-b03d-8ed977fa6179 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] PATH_INFO: `/v3/projects/31ab7d5f20cc4d2e9dadd8c54935d862` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:43.728588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af9923-8a0a-4081-b03d-8ed977fa6179 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] RBAC: Authorizing `identity:delete_project(project_id=31ab7d5f20cc4d2e9dadd8c54935d862)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:43.738963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af9923-8a0a-4081-b03d-8ed977fa6179 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:43.790481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb2d38a583c43bf967aa159d2777f6b', 'request_id': 'req-84035bdb-7037-4647-a5fd-a07cfb104bfa'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:43.819048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] The token cache is being invalidate because project 0cb2d38a583c43bf967aa159d2777f6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:43.819548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:43.820613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:43.841775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0cb2d38a583c43bf967aa159d2777f6b', 'request_id': 'req-84035bdb-7037-4647-a5fd-a07cfb104bfa'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:43.843495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0cb2d38a583c43bf967aa159d2777f6b', 'request_id': 'req-84035bdb-7037-4647-a5fd-a07cfb104bfa'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:43.844365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0cb2d38a583c43bf967aa159d2777f6b', 'request_id': 'req-84035bdb-7037-4647-a5fd-a07cfb104bfa'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:43.864254 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3373/6690] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:54:42 2022] DELETE /identity/v3/domains/0cb2d38a583c43bf967aa159d2777f6b => generated 0 bytes in 1159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:54:43.864977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:43.867379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:43.988696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a0af9923-8a0a-4081-b03d-8ed977fa6179 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31ab7d5f20cc4d2e9dadd8c54935d862', 'request_id': 'req-a0af9923-8a0a-4081-b03d-8ed977fa6179'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:44.018749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a0af9923-8a0a-4081-b03d-8ed977fa6179 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31ab7d5f20cc4d2e9dadd8c54935d862', 'request_id': 'req-a0af9923-8a0a-4081-b03d-8ed977fa6179'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:44.028896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a0af9923-8a0a-4081-b03d-8ed977fa6179 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31ab7d5f20cc4d2e9dadd8c54935d862', 'request_id': 'req-a0af9923-8a0a-4081-b03d-8ed977fa6179'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:44.066720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84035bdb-7037-4647-a5fd-a07cfb104bfa tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:44.165763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c47487-8392-4a5b-8e7b-1bffb35bf1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:44.166447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c47487-8392-4a5b-8e7b-1bffb35bf1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:44.168992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c47487-8392-4a5b-8e7b-1bffb35bf1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:44.168992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c47487-8392-4a5b-8e7b-1bffb35bf1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:44.168992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c47487-8392-4a5b-8e7b-1bffb35bf1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:44.169322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c47487-8392-4a5b-8e7b-1bffb35bf1b4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:44.182143 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3374/6691] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:44.183958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c47487-8392-4a5b-8e7b-1bffb35bf1b4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:44.185989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-78c47487-8392-4a5b-8e7b-1bffb35bf1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:44.197800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a0af9923-8a0a-4081-b03d-8ed977fa6179 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] The token cache is being invalidate because project 31ab7d5f20cc4d2e9dadd8c54935d862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:44.197800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a0af9923-8a0a-4081-b03d-8ed977fa6179 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:44.197800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a0af9923-8a0a-4081-b03d-8ed977fa6179 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:44.203794 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3318/6692] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:43 2022] DELETE /identity/v3/projects/31ab7d5f20cc4d2e9dadd8c54935d862 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:44.204891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af9923-8a0a-4081-b03d-8ed977fa6179 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:44.206149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a0af9923-8a0a-4081-b03d-8ed977fa6179 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:44.245276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af9923-8a0a-4081-b03d-8ed977fa6179 tempest-RoutersAdminTest-1396665557 tempest-RoutersAdminTest-1396665557-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:44.256321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8970f-cb15-4a38-8bc6-9d2142cb634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:44.256983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8970f-cb15-4a38-8bc6-9d2142cb634e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:44.257260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8970f-cb15-4a38-8bc6-9d2142cb634e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:44.257546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8970f-cb15-4a38-8bc6-9d2142cb634e admin admin] PATH_INFO: `/v3/users/081cbc1eb7454911aa455a3867858bbc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:44.259225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8970f-cb15-4a38-8bc6-9d2142cb634e admin admin] RBAC: Authorizing `identity:delete_user(user_id=081cbc1eb7454911aa455a3867858bbc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:44.260013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:44.261284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8970f-cb15-4a38-8bc6-9d2142cb634e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:44.346073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c47487-8392-4a5b-8e7b-1bffb35bf1b4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:44.351873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc1ca0-ed79-47f3-a7b2-226b793c8286 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:44.353045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc1ca0-ed79-47f3-a7b2-226b793c8286 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:44.353618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc1ca0-ed79-47f3-a7b2-226b793c8286 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:44.354543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc1ca0-ed79-47f3-a7b2-226b793c8286 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/0cb2d38a583c43bf967aa159d2777f6b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:44.365023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc1ca0-ed79-47f3-a7b2-226b793c8286 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=0cb2d38a583c43bf967aa159d2777f6b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:44.367119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc1ca0-ed79-47f3-a7b2-226b793c8286 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:44.389288 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-03dc1ca0-ed79-47f3-a7b2-226b793c8286 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Could not find domain: 0cb2d38a583c43bf967aa159d2777f6b.: keystone.exception.DomainNotFound: Could not find domain: 0cb2d38a583c43bf967aa159d2777f6b. Aug 27 04:54:44.389288 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:44.389288 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:54:44.389288 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:54:44.389288 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:54:44.389288 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:54:44.389288 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:54:44.389288 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:54:44.389288 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0cb2d38a583c43bf967aa159d2777f6b. Aug 27 04:54:44.389288 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:44.389288 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:54:44.389288 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:44.389288 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:44.389288 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:54:44.389288 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:54:44.389288 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:54:44.390521 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:54:44.390521 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:54:44.390521 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:54:44.390521 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:54:44.390521 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:54:44.390521 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:54:44.390521 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:54:44.390521 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 04:54:44.390521 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 04:54:44.390521 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 04:54:44.390521 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:54:44.390521 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:54:44.390521 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:54:44.390521 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:54:44.390521 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:54:44.390521 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:54:44.390521 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:54:44.391633 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:54:44.391633 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:54:44.391633 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:54:44.391633 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:54:44.391633 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:54:44.391633 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:54:44.391633 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:54:44.391633 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:54:44.391633 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:54:44.391633 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:54:44.391633 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:54:44.391633 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:54:44.391633 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0cb2d38a583c43bf967aa159d2777f6b. Aug 27 04:54:44.391633 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:44.391633 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3375/6693] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:54:44 2022] GET /identity/v3/domains/0cb2d38a583c43bf967aa159d2777f6b => generated 112 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:54:44.392631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc1ca0-ed79-47f3-a7b2-226b793c8286 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:44.392631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-03dc1ca0-ed79-47f3-a7b2-226b793c8286 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:44.415258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc1ca0-ed79-47f3-a7b2-226b793c8286 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:44.422224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c62d4-efdd-423c-9a73-61192f37ef09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:44.422907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c62d4-efdd-423c-9a73-61192f37ef09 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:44.423269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c62d4-efdd-423c-9a73-61192f37ef09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:44.423530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c62d4-efdd-423c-9a73-61192f37ef09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:44.424333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c62d4-efdd-423c-9a73-61192f37ef09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:44.426956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c62d4-efdd-423c-9a73-61192f37ef09 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:44.450593 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3376/6694] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:44.457272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c62d4-efdd-423c-9a73-61192f37ef09 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:44.459663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c90c62d4-efdd-423c-9a73-61192f37ef09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:44.589670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c62d4-efdd-423c-9a73-61192f37ef09 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:44.602826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa6b3d-8c6e-4175-80be-095ecd072405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:44.603646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6b3d-8c6e-4175-80be-095ecd072405 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:44.604318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6b3d-8c6e-4175-80be-095ecd072405 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:44.604318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6b3d-8c6e-4175-80be-095ecd072405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:44.616415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c6d8970f-cb15-4a38-8bc6-9d2142cb634e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '081cbc1eb7454911aa455a3867858bbc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:44.618065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c6aa6b3d-8c6e-4175-80be-095ecd072405 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:44.715348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa6b3d-8c6e-4175-80be-095ecd072405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:44.717361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa6b3d-8c6e-4175-80be-095ecd072405 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:44.729702 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3377/6695] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:44.730787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa6b3d-8c6e-4175-80be-095ecd072405 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:44.732722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c6aa6b3d-8c6e-4175-80be-095ecd072405 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:44.751564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa6b3d-8c6e-4175-80be-095ecd072405 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:44.762091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c6d8970f-cb15-4a38-8bc6-9d2142cb634e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '081cbc1eb7454911aa455a3867858bbc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:44.762963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82481dec-3215-46fe-b5e7-c1193ab97b17 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:44.763265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c6d8970f-cb15-4a38-8bc6-9d2142cb634e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '081cbc1eb7454911aa455a3867858bbc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:44.765724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82481dec-3215-46fe-b5e7-c1193ab97b17 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:44.765724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82481dec-3215-46fe-b5e7-c1193ab97b17 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:44.765724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82481dec-3215-46fe-b5e7-c1193ab97b17 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/users/a2ebd0794f434d9caeef5cc3f86b60bb` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:44.774514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82481dec-3215-46fe-b5e7-c1193ab97b17 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:get_user(user_id=a2ebd0794f434d9caeef5cc3f86b60bb)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:44.775104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c6d8970f-cb15-4a38-8bc6-9d2142cb634e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '081cbc1eb7454911aa455a3867858bbc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:44.778253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82481dec-3215-46fe-b5e7-c1193ab97b17 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:44.796309 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-82481dec-3215-46fe-b5e7-c1193ab97b17 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Could not find user: a2ebd0794f434d9caeef5cc3f86b60bb.: keystone.exception.UserNotFound: Could not find user: a2ebd0794f434d9caeef5cc3f86b60bb. Aug 27 04:54:44.796309 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:44.796309 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:54:44.796309 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:54:44.796309 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:54:44.796309 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:54:44.796309 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:54:44.796309 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:54:44.796309 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:54:44.796309 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:54:44.796309 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:54:44.796309 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:54:44.796309 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 04:54:44.796309 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 04:54:44.796309 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 04:54:44.806039 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 04:54:44.806039 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:54:44.806039 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:54:44.806039 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:54:44.806039 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:54:44.806039 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:54:44.806039 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:54:44.806039 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:54:44.806039 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:54:44.806039 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:54:44.806039 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:54:44.806039 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:54:44.806039 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:54:44.806039 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:54:44.806039 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:54:44.806039 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:54:44.806039 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:54:44.806911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:54:44.806911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:54:44.806911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:54:44.806911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:54:44.806911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:54:44.806911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:54:44.806911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:54:44.806911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:54:44.806911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:54:44.806911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:54:44.806911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a2ebd0794f434d9caeef5cc3f86b60bb. Aug 27 04:54:44.806911 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:44.806911 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3378/6696] 10.222.0.76 () {58 vars in 1221 bytes} [Sat Aug 27 04:54:44 2022] GET /identity/v3/users/a2ebd0794f434d9caeef5cc3f86b60bb => generated 110 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:54:44.806911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82481dec-3215-46fe-b5e7-c1193ab97b17 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:44.815282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82481dec-3215-46fe-b5e7-c1193ab97b17 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:44.818997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c6d8970f-cb15-4a38-8bc6-9d2142cb634e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '081cbc1eb7454911aa455a3867858bbc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:44.820703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863bb44-afb7-449a-a2f5-fd1506d37881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:44.821484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863bb44-afb7-449a-a2f5-fd1506d37881 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:44.821973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863bb44-afb7-449a-a2f5-fd1506d37881 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:44.822462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863bb44-afb7-449a-a2f5-fd1506d37881 admin admin] PATH_INFO: `/v3/projects/f01d677260ad4eaa84a2e5b7cbd53e17/users/0ff47b155ab94250a048a71ff558b773/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:44.837950 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3319/6697] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:44 2022] DELETE /identity/v3/users/081cbc1eb7454911aa455a3867858bbc => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:44.841585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8970f-cb15-4a38-8bc6-9d2142cb634e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:44.843984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863bb44-afb7-449a-a2f5-fd1506d37881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01d677260ad4eaa84a2e5b7cbd53e17, user_id=0ff47b155ab94250a048a71ff558b773, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:44.845411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c6d8970f-cb15-4a38-8bc6-9d2142cb634e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:44.848630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863bb44-afb7-449a-a2f5-fd1506d37881 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:44.969533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8970f-cb15-4a38-8bc6-9d2142cb634e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:44.981006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e317914-fe12-43fb-a375-bb9fcb7a6858 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:44.981494 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e317914-fe12-43fb-a375-bb9fcb7a6858 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:44.981790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e317914-fe12-43fb-a375-bb9fcb7a6858 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:44.982075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e317914-fe12-43fb-a375-bb9fcb7a6858 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/groups/2363a5f7f7574ca082125ea5222ad291` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:44.987951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e317914-fe12-43fb-a375-bb9fcb7a6858 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:get_group(group_id=2363a5f7f7574ca082125ea5222ad291)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:44.989936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e317914-fe12-43fb-a375-bb9fcb7a6858 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:44.994419 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3379/6698] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:44 2022] PUT /identity/v3/projects/f01d677260ad4eaa84a2e5b7cbd53e17/users/0ff47b155ab94250a048a71ff558b773/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:44.999887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05872984-58b7-464e-97ee-d6e3723c0094 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:44.999887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05872984-58b7-464e-97ee-d6e3723c0094 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:44.999887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05872984-58b7-464e-97ee-d6e3723c0094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:45.027990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-0e317914-fe12-43fb-a375-bb9fcb7a6858 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Could not find group: 2363a5f7f7574ca082125ea5222ad291.: keystone.exception.GroupNotFound: Could not find group: 2363a5f7f7574ca082125ea5222ad291. Aug 27 04:54:45.027990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:45.027990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:54:45.027990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:54:45.027990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:54:45.027990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:54:45.027990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:54:45.027990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:54:45.027990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:54:45.027990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:54:45.027990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:54:45.027990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:54:45.027990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Aug 27 04:54:45.027990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_group(group_id) Aug 27 04:54:45.027990 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Aug 27 04:54:45.029065 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Aug 27 04:54:45.029065 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:54:45.029065 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:54:45.029065 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:54:45.029065 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:54:45.029065 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:54:45.029065 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:54:45.029065 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:54:45.029065 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:54:45.029065 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:54:45.029065 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:54:45.029065 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:54:45.029065 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:54:45.029065 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:54:45.029065 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:54:45.029065 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:54:45.029065 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:54:45.030204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:54:45.030204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:54:45.030204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:54:45.030204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:54:45.030204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 27 04:54:45.030204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 27 04:54:45.030204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 27 04:54:45.030204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 27 04:54:45.030204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 27 04:54:45.030204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 27 04:54:45.030204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 2363a5f7f7574ca082125ea5222ad291. Aug 27 04:54:45.030204 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:45.032101 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3320/6699] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:44 2022] GET /identity/v3/groups/2363a5f7f7574ca082125ea5222ad291 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:54:45.033579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec6f71-f8a9-46c4-84c4-e037de6c2ba4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:45.033877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec6f71-f8a9-46c4-84c4-e037de6c2ba4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:45.034226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec6f71-f8a9-46c4-84c4-e037de6c2ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:45.048748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-05872984-58b7-464e-97ee-d6e3723c0094 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:45.049997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-05872984-58b7-464e-97ee-d6e3723c0094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:45.078468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ebec6f71-f8a9-46c4-84c4-e037de6c2ba4 None None] MFA Rules not processed for user `0ff47b155ab94250a048a71ff558b773`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:45.081325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ebec6f71-f8a9-46c4-84c4-e037de6c2ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:45.177442 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3380/6700] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:45.178937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05872984-58b7-464e-97ee-d6e3723c0094 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:45.269806 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3321/6701] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:45.270725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec6f71-f8a9-46c4-84c4-e037de6c2ba4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:45.277065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ebec6f71-f8a9-46c4-84c4-e037de6c2ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:45.299357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:45.402386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05872984-58b7-464e-97ee-d6e3723c0094 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:45.409444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98a690-bc57-4709-afce-d9dff8223161 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:45.410465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98a690-bc57-4709-afce-d9dff8223161 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:45.410921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98a690-bc57-4709-afce-d9dff8223161 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:45.411379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98a690-bc57-4709-afce-d9dff8223161 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/groups/2363a5f7f7574ca082125ea5222ad291` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:45.423959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98a690-bc57-4709-afce-d9dff8223161 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:54:45.438864 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-8a98a690-bc57-4709-afce-d9dff8223161 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Could not find group: 2363a5f7f7574ca082125ea5222ad291.: keystone.exception.GroupNotFound: Could not find group: 2363a5f7f7574ca082125ea5222ad291. Aug 27 04:54:45.438864 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:45.438864 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:54:45.438864 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:54:45.438864 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:54:45.438864 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:54:45.438864 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:54:45.438864 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:54:45.438864 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:54:45.438864 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:54:45.438864 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:54:45.438864 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:54:45.438864 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Aug 27 04:54:45.438864 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Aug 27 04:54:45.439959 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:54:45.439959 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:54:45.439959 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:54:45.439959 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:54:45.439959 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:54:45.439959 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:54:45.439959 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:54:45.439959 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:54:45.439959 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:54:45.439959 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:54:45.439959 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:54:45.439959 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:54:45.439959 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:54:45.439959 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:54:45.439959 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:54:45.439959 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:54:45.439959 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:54:45.446797 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:54:45.446797 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:54:45.446797 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:54:45.446797 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:54:45.446797 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:54:45.446797 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:54:45.446797 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:54:45.446797 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 27 04:54:45.446797 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 27 04:54:45.446797 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 27 04:54:45.446797 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 27 04:54:45.446797 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 27 04:54:45.446797 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 27 04:54:45.446797 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 2363a5f7f7574ca082125ea5222ad291. Aug 27 04:54:45.446797 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:54:45.446797 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3381/6702] 10.222.0.76 () {58 vars in 1227 bytes} [Sat Aug 27 04:54:45 2022] DELETE /identity/v3/groups/2363a5f7f7574ca082125ea5222ad291 => generated 111 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:54:45.447851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98a690-bc57-4709-afce-d9dff8223161 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:45.448324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8a98a690-bc57-4709-afce-d9dff8223161 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:45.473195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98a690-bc57-4709-afce-d9dff8223161 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:45.490002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9999ed-9abb-4e9f-a469-8217f75c10e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:45.490974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9999ed-9abb-4e9f-a469-8217f75c10e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:45.491401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9999ed-9abb-4e9f-a469-8217f75c10e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:45.491820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9999ed-9abb-4e9f-a469-8217f75c10e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:45.492351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec6f71-f8a9-46c4-84c4-e037de6c2ba4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:45.493121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9999ed-9abb-4e9f-a469-8217f75c10e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:45.495986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9999ed-9abb-4e9f-a469-8217f75c10e9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:45.505705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b009fc-96bd-4f97-84d4-8a5aa4d06315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:45.506352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b009fc-96bd-4f97-84d4-8a5aa4d06315 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:45.506638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b009fc-96bd-4f97-84d4-8a5aa4d06315 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:45.506918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b009fc-96bd-4f97-84d4-8a5aa4d06315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:45.532111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b009fc-96bd-4f97-84d4-8a5aa4d06315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:45.535182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b009fc-96bd-4f97-84d4-8a5aa4d06315 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:45.551507 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3322/6703] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:45.553207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b009fc-96bd-4f97-84d4-8a5aa4d06315 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:45.567658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b009fc-96bd-4f97-84d4-8a5aa4d06315 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:45.574069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7228a-4719-4548-b8f5-099843294381 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:45.574960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7228a-4719-4548-b8f5-099843294381 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:45.575423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7228a-4719-4548-b8f5-099843294381 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:45.575855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7228a-4719-4548-b8f5-099843294381 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/users/a2ebd0794f434d9caeef5cc3f86b60bb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:45.587396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7228a-4719-4548-b8f5-099843294381 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a2ebd0794f434d9caeef5cc3f86b60bb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:45.592293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7228a-4719-4548-b8f5-099843294381 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:45.618470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-86a7228a-4719-4548-b8f5-099843294381 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Could not find user: a2ebd0794f434d9caeef5cc3f86b60bb.: keystone.exception.UserNotFound: Could not find user: a2ebd0794f434d9caeef5cc3f86b60bb. Aug 27 04:54:45.618470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:45.618470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:54:45.618470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:54:45.618470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:54:45.618470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:54:45.618470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:54:45.618470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:54:45.618470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:54:45.618470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:54:45.618470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:54:45.618470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:54:45.618470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Aug 27 04:54:45.618470 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:54:45.625358 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a2ebd0794f434d9caeef5cc3f86b60bb. Aug 27 04:54:45.626407 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:45.627493 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3323/6704] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:45 2022] DELETE /identity/v3/users/a2ebd0794f434d9caeef5cc3f86b60bb => generated 110 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:54:45.627493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7228a-4719-4548-b8f5-099843294381 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:45.637835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7228a-4719-4548-b8f5-099843294381 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:45.664366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2d90a-c13c-4eed-a956-3ae696eceea7 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:45.664366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2d90a-c13c-4eed-a956-3ae696eceea7 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:45.664366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2d90a-c13c-4eed-a956-3ae696eceea7 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:45.664712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2d90a-c13c-4eed-a956-3ae696eceea7 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/0cb2d38a583c43bf967aa159d2777f6b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:45.664788 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3382/6705] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:45 2022] POST /identity/v3/projects => generated 389 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:45.667388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2d90a-c13c-4eed-a956-3ae696eceea7 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:54:45.669481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9999ed-9abb-4e9f-a469-8217f75c10e9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:45.675378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-d9d2d90a-c13c-4eed-a956-3ae696eceea7 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Could not find domain: 0cb2d38a583c43bf967aa159d2777f6b.: keystone.exception.DomainNotFound: Could not find domain: 0cb2d38a583c43bf967aa159d2777f6b. Aug 27 04:54:45.675378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:45.675378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:54:45.675378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:54:45.675378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:54:45.675378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:54:45.675378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:54:45.675378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:54:45.675378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0cb2d38a583c43bf967aa159d2777f6b. Aug 27 04:54:45.675378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:45.675378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:54:45.675378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:45.675378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:45.675378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:54:45.675378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:54:45.675378 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:54:45.676497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:54:45.676497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:54:45.676497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:54:45.676497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:54:45.676497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:54:45.676497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:54:45.676497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:54:45.676497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 27 04:54:45.676497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 27 04:54:45.676497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:54:45.676497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:54:45.676497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:54:45.676497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:54:45.676497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:54:45.676497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:54:45.676497 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:54:45.681846 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:54:45.681846 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:54:45.681846 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:54:45.681846 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:54:45.681846 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:54:45.681846 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:54:45.681846 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:54:45.681846 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:54:45.681846 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:54:45.681846 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:54:45.681846 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:54:45.681846 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:54:45.681846 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:54:45.681846 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:54:45.681846 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:54:45.681846 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0cb2d38a583c43bf967aa159d2777f6b. Aug 27 04:54:45.681846 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:45.683036 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3324/6706] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:54:45 2022] PATCH /identity/v3/domains/0cb2d38a583c43bf967aa159d2777f6b => generated 112 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 27 04:54:45.683036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2d90a-c13c-4eed-a956-3ae696eceea7 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:45.697768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2d90a-c13c-4eed-a956-3ae696eceea7 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:45.805242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce089e-fd18-4baf-8f56-a3e3f9a85995 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:45.805871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce089e-fd18-4baf-8f56-a3e3f9a85995 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:45.806409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce089e-fd18-4baf-8f56-a3e3f9a85995 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:45.807086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce089e-fd18-4baf-8f56-a3e3f9a85995 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:45.808346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce089e-fd18-4baf-8f56-a3e3f9a85995 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:45.810006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce089e-fd18-4baf-8f56-a3e3f9a85995 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:45.815908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9999ed-9abb-4e9f-a469-8217f75c10e9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:45.831404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9732a-096a-479d-a1db-fe4628f168a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:45.834999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9732a-096a-479d-a1db-fe4628f168a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:45.835383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9732a-096a-479d-a1db-fe4628f168a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:45.835755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9732a-096a-479d-a1db-fe4628f168a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:45.837128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9732a-096a-479d-a1db-fe4628f168a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:45.851443 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3325/6707] 10.222.0.76 () {58 vars in 1128 bytes} [Sat Aug 27 04:54:45 2022] GET /identity/v3/domains => generated 1347 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:45.851595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9732a-096a-479d-a1db-fe4628f168a8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:45.851685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce089e-fd18-4baf-8f56-a3e3f9a85995 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:45.861165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce089e-fd18-4baf-8f56-a3e3f9a85995 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:45.867429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04314c5-dc5b-47b5-8b9a-2a5e5e1d8fa3 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:45.868061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04314c5-dc5b-47b5-8b9a-2a5e5e1d8fa3 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:45.868687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04314c5-dc5b-47b5-8b9a-2a5e5e1d8fa3 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:45.868975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04314c5-dc5b-47b5-8b9a-2a5e5e1d8fa3 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:45.869706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04314c5-dc5b-47b5-8b9a-2a5e5e1d8fa3 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:45.870014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04314c5-dc5b-47b5-8b9a-2a5e5e1d8fa3 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:45.872260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04314c5-dc5b-47b5-8b9a-2a5e5e1d8fa3 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:45.907135 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3326/6708] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:54:45 2022] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:45.908933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04314c5-dc5b-47b5-8b9a-2a5e5e1d8fa3 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:45.947803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04314c5-dc5b-47b5-8b9a-2a5e5e1d8fa3 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:45.966863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aa8fc-735e-43c9-8441-9008464cedec tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:45.967544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aa8fc-735e-43c9-8441-9008464cedec tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:45.969511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aa8fc-735e-43c9-8441-9008464cedec tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:45.969955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aa8fc-735e-43c9-8441-9008464cedec tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:45.970646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aa8fc-735e-43c9-8441-9008464cedec tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1986290493) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:45.970961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aa8fc-735e-43c9-8441-9008464cedec tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:45.976880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aa8fc-735e-43c9-8441-9008464cedec tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:45.979287 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3383/6709] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:45 2022] POST /identity/v3/users => generated 301 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:54:45.986705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9732a-096a-479d-a1db-fe4628f168a8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:46.000376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9732a-096a-479d-a1db-fe4628f168a8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:46.006454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82de18a-b288-455b-8515-e09aef521834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:46.007116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82de18a-b288-455b-8515-e09aef521834 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:46.007398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82de18a-b288-455b-8515-e09aef521834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:46.007675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82de18a-b288-455b-8515-e09aef521834 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:46.009525 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3327/6710] 10.222.0.76 () {58 vars in 1199 bytes} [Sat Aug 27 04:54:45 2022] GET /identity/v3/domains?name=tempest-test_domain-1986290493 => generated 408 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:46.009605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82de18a-b288-455b-8515-e09aef521834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:46.012973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82de18a-b288-455b-8515-e09aef521834 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:46.013766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aa8fc-735e-43c9-8441-9008464cedec tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:46.028223 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3384/6711] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:54:46.031847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82de18a-b288-455b-8515-e09aef521834 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:46.034452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aa8fc-735e-43c9-8441-9008464cedec tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:46.049333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82de18a-b288-455b-8515-e09aef521834 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:46.051012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b2710-1b3f-4050-84b7-298160f2be87 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:46.051764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b2710-1b3f-4050-84b7-298160f2be87 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:46.052115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b2710-1b3f-4050-84b7-298160f2be87 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:46.052544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b2710-1b3f-4050-84b7-298160f2be87 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/0cb2d38a583c43bf967aa159d2777f6b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:46.058826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fb32c-418e-4c38-be32-482e6074ad80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:46.059609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fb32c-418e-4c38-be32-482e6074ad80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:46.059966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fb32c-418e-4c38-be32-482e6074ad80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:46.071057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fb32c-418e-4c38-be32-482e6074ad80 admin admin] PATH_INFO: `/v3/projects/217ab220babf4fb19882d6aa8f8ae7dc/users/3466364a57fa49c1b8798ebb1f5d8bfa/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:46.072425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b2710-1b3f-4050-84b7-298160f2be87 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 04:54:46.096976 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-112b2710-1b3f-4050-84b7-298160f2be87 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Could not find domain: 0cb2d38a583c43bf967aa159d2777f6b.: keystone.exception.DomainNotFound: Could not find domain: 0cb2d38a583c43bf967aa159d2777f6b. Aug 27 04:54:46.096976 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:46.096976 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:54:46.096976 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:54:46.096976 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:54:46.096976 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:54:46.096976 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:54:46.096976 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:54:46.096976 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0cb2d38a583c43bf967aa159d2777f6b. Aug 27 04:54:46.096976 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:46.096976 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:54:46.096976 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:46.096976 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:54:46.096976 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:54:46.096976 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:54:46.096976 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:54:46.097991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:54:46.097991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:54:46.097991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:54:46.097991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:54:46.097991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:54:46.097991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:54:46.097991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:54:46.097991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 27 04:54:46.097991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 27 04:54:46.097991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 04:54:46.097991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 04:54:46.097991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 04:54:46.097991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 04:54:46.097991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:54:46.097991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:54:46.097991 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:54:46.098825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:54:46.098825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:54:46.098825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:54:46.098825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:54:46.098825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application with Lock( Aug 27 04:54:46.098825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:54:46.098825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:54:46.098825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:54:46.098825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:54:46.098825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:54:46.098825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:54:46.098825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:54:46.098825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:54:46.098825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:54:46.098825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:54:46.098825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0cb2d38a583c43bf967aa159d2777f6b. Aug 27 04:54:46.098825 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 04:54:46.099703 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3328/6712] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:54:46 2022] PATCH /identity/v3/domains/0cb2d38a583c43bf967aa159d2777f6b => generated 112 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 27 04:54:46.101199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b2710-1b3f-4050-84b7-298160f2be87 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:46.109137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fb32c-418e-4c38-be32-482e6074ad80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217ab220babf4fb19882d6aa8f8ae7dc, user_id=3466364a57fa49c1b8798ebb1f5d8bfa, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:46.114422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fb32c-418e-4c38-be32-482e6074ad80 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:46.124324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b2710-1b3f-4050-84b7-298160f2be87 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:46.132508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48460d8d-e636-46f0-952f-905eb9796d49 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:46.133171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48460d8d-e636-46f0-952f-905eb9796d49 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:46.133477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48460d8d-e636-46f0-952f-905eb9796d49 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:46.133743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48460d8d-e636-46f0-952f-905eb9796d49 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/683ad7f809344e0c94445912b531f04e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:46.146831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48460d8d-e636-46f0-952f-905eb9796d49 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=683ad7f809344e0c94445912b531f04e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:46.148593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48460d8d-e636-46f0-952f-905eb9796d49 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:46.225945 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3385/6713] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:46 2022] PUT /identity/v3/projects/217ab220babf4fb19882d6aa8f8ae7dc/users/3466364a57fa49c1b8798ebb1f5d8bfa/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:46.234431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fb32c-418e-4c38-be32-482e6074ad80 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:46.271470 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3329/6714] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:54:46 2022] PATCH /identity/v3/domains/683ad7f809344e0c94445912b531f04e => generated 277 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:46.275882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48460d8d-e636-46f0-952f-905eb9796d49 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:46.308933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48460d8d-e636-46f0-952f-905eb9796d49 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:46.414488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fb32c-418e-4c38-be32-482e6074ad80 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:46.433201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d8265-fa57-4843-8516-860eb7ae008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:46.434172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d8265-fa57-4843-8516-860eb7ae008a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:46.434469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d8265-fa57-4843-8516-860eb7ae008a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:46.434983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d8265-fa57-4843-8516-860eb7ae008a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:46.435632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d8265-fa57-4843-8516-860eb7ae008a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:46.441193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d8265-fa57-4843-8516-860eb7ae008a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:46.462201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:46.464654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:46.467119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:46.468149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/683ad7f809344e0c94445912b531f04e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:46.478279 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3386/6715] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:54:46.481119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d8265-fa57-4843-8516-860eb7ae008a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:46.514002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=683ad7f809344e0c94445912b531f04e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:46.518675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d8265-fa57-4843-8516-860eb7ae008a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:46.518833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:46.525538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50125467-6800-4054-b7ce-c0f2e557414b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:46.527386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50125467-6800-4054-b7ce-c0f2e557414b admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:46.529288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50125467-6800-4054-b7ce-c0f2e557414b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:46.530254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50125467-6800-4054-b7ce-c0f2e557414b admin admin] PATH_INFO: `/v3/projects/217ab220babf4fb19882d6aa8f8ae7dc/users/3466364a57fa49c1b8798ebb1f5d8bfa/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:46.535291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50125467-6800-4054-b7ce-c0f2e557414b admin admin] RBAC: Authorizing `identity:create_grant(project_id=217ab220babf4fb19882d6aa8f8ae7dc, user_id=3466364a57fa49c1b8798ebb1f5d8bfa, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:46.546087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50125467-6800-4054-b7ce-c0f2e557414b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:46.593429 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3387/6716] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:46 2022] PUT /identity/v3/projects/217ab220babf4fb19882d6aa8f8ae7dc/users/3466364a57fa49c1b8798ebb1f5d8bfa/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:46.603282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965963f-8728-49c4-8eb7-d144a6fbca7e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:46.603573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965963f-8728-49c4-8eb7-d144a6fbca7e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:46.603856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965963f-8728-49c4-8eb7-d144a6fbca7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:46.613386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '683ad7f809344e0c94445912b531f04e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:46.625416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '683ad7f809344e0c94445912b531f04e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:46.690395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9965963f-8728-49c4-8eb7-d144a6fbca7e None None] MFA Rules not processed for user `3466364a57fa49c1b8798ebb1f5d8bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:46.693082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9965963f-8728-49c4-8eb7-d144a6fbca7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:46.840896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '683ad7f809344e0c94445912b531f04e', 'request_id': 'req-df695b83-98c7-49b0-8556-bff4bc4b3db9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:46.866747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '683ad7f809344e0c94445912b531f04e', 'request_id': 'req-df695b83-98c7-49b0-8556-bff4bc4b3db9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:46.873002 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3388/6717] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:46 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:46.874546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965963f-8728-49c4-8eb7-d144a6fbca7e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:46.881190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9965963f-8728-49c4-8eb7-d144a6fbca7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:46.886575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '683ad7f809344e0c94445912b531f04e', 'request_id': 'req-df695b83-98c7-49b0-8556-bff4bc4b3db9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:46.938347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:47.008155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] The token cache is being invalidate because project 683ad7f809344e0c94445912b531f04e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:47.008560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:47.009361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:47.018639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965963f-8728-49c4-8eb7-d144a6fbca7e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:47.024082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '683ad7f809344e0c94445912b531f04e', 'request_id': 'req-df695b83-98c7-49b0-8556-bff4bc4b3db9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:47.034616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '683ad7f809344e0c94445912b531f04e', 'request_id': 'req-df695b83-98c7-49b0-8556-bff4bc4b3db9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:47.037922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '683ad7f809344e0c94445912b531f04e', 'request_id': 'req-df695b83-98c7-49b0-8556-bff4bc4b3db9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:47.047107 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3330/6718] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:54:46 2022] DELETE /identity/v3/domains/683ad7f809344e0c94445912b531f04e => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:47.052485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:47.055103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:47.166950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:47.167628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:47.167911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:47.168203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87 admin admin] PATH_INFO: `/v3/projects/cb83c4a0e768452eb2fff288e70944e7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:47.170957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb83c4a0e768452eb2fff288e70944e7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:47.175457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:47.238993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df695b83-98c7-49b0-8556-bff4bc4b3db9 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:47.256462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae7c4d-c724-4ba2-928b-63c659a32e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:47.257105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae7c4d-c724-4ba2-928b-63c659a32e0f service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:47.257388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae7c4d-c724-4ba2-928b-63c659a32e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:47.257669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae7c4d-c724-4ba2-928b-63c659a32e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:47.268664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f6ae7c4d-c724-4ba2-928b-63c659a32e0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:47.379154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae7c4d-c724-4ba2-928b-63c659a32e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:47.382347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae7c4d-c724-4ba2-928b-63c659a32e0f service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:47.399168 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3331/6719] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:47.400871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae7c4d-c724-4ba2-928b-63c659a32e0f service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:47.402923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f6ae7c4d-c724-4ba2-928b-63c659a32e0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:47.447468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb83c4a0e768452eb2fff288e70944e7', 'request_id': 'req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:47.461301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb83c4a0e768452eb2fff288e70944e7', 'request_id': 'req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:47.511766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae7c4d-c724-4ba2-928b-63c659a32e0f service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:47.594705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe92f7-1f96-4259-83e3-b000e47fc00e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:47.595415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe92f7-1f96-4259-83e3-b000e47fc00e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:47.595710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe92f7-1f96-4259-83e3-b000e47fc00e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:47.595989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe92f7-1f96-4259-83e3-b000e47fc00e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/801b861e790b4b96be33e173f4bbab49` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:47.626424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb83c4a0e768452eb2fff288e70944e7', 'request_id': 'req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:47.644759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe92f7-1f96-4259-83e3-b000e47fc00e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=801b861e790b4b96be33e173f4bbab49)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:47.647712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe92f7-1f96-4259-83e3-b000e47fc00e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:47.687168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87 admin admin] The token cache is being invalidate because project cb83c4a0e768452eb2fff288e70944e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:47.693192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:47.695794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:47.707758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5cfe92f7-1f96-4259-83e3-b000e47fc00e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '801b861e790b4b96be33e173f4bbab49'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:47.709654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5cfe92f7-1f96-4259-83e3-b000e47fc00e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '801b861e790b4b96be33e173f4bbab49'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:47.713655 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3389/6720] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:46 2022] DELETE /identity/v3/projects/cb83c4a0e768452eb2fff288e70944e7 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:47.715325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:47.729209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:47.880892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1b042-b81d-49bf-ad29-cf60dfaaca87 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:47.915452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5cfe92f7-1f96-4259-83e3-b000e47fc00e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '801b861e790b4b96be33e173f4bbab49'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:47.916172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5cfe92f7-1f96-4259-83e3-b000e47fc00e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '801b861e790b4b96be33e173f4bbab49'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:47.921155 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3332/6721] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:54:47 2022] PATCH /identity/v3/domains/801b861e790b4b96be33e173f4bbab49 => generated 277 bytes in 521 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:47.925033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe92f7-1f96-4259-83e3-b000e47fc00e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:47.926475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5cfe92f7-1f96-4259-83e3-b000e47fc00e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:48.024811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:48.042249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e098c1-ee93-4b2a-909d-ac8fe618885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:48.042912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e098c1-ee93-4b2a-909d-ac8fe618885d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:48.043284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e098c1-ee93-4b2a-909d-ac8fe618885d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:48.043461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e098c1-ee93-4b2a-909d-ac8fe618885d admin admin] PATH_INFO: `/v3/users/d66ccabe2b09498083e4dfcfd37a973e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:48.044707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e098c1-ee93-4b2a-909d-ac8fe618885d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d66ccabe2b09498083e4dfcfd37a973e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:48.047168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e098c1-ee93-4b2a-909d-ac8fe618885d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:48.085994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe92f7-1f96-4259-83e3-b000e47fc00e tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:48.091940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:48.093189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:48.093672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:48.093901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/801b861e790b4b96be33e173f4bbab49` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:48.106965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=801b861e790b4b96be33e173f4bbab49)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:48.109834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:48.135742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '801b861e790b4b96be33e173f4bbab49'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.154455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '801b861e790b4b96be33e173f4bbab49'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.288407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-70e098c1-ee93-4b2a-909d-ac8fe618885d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd66ccabe2b09498083e4dfcfd37a973e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.289751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-70e098c1-ee93-4b2a-909d-ac8fe618885d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd66ccabe2b09498083e4dfcfd37a973e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.334364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801b861e790b4b96be33e173f4bbab49', 'request_id': 'req-082549aa-89ff-4756-9b82-67343c893d58'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.344420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801b861e790b4b96be33e173f4bbab49', 'request_id': 'req-082549aa-89ff-4756-9b82-67343c893d58'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.357743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801b861e790b4b96be33e173f4bbab49', 'request_id': 'req-082549aa-89ff-4756-9b82-67343c893d58'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.367708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-70e098c1-ee93-4b2a-909d-ac8fe618885d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd66ccabe2b09498083e4dfcfd37a973e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.368347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-70e098c1-ee93-4b2a-909d-ac8fe618885d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd66ccabe2b09498083e4dfcfd37a973e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.385678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-70e098c1-ee93-4b2a-909d-ac8fe618885d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd66ccabe2b09498083e4dfcfd37a973e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.398860 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3390/6722] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:47 2022] DELETE /identity/v3/users/d66ccabe2b09498083e4dfcfd37a973e => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:48.527286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] The token cache is being invalidate because project 801b861e790b4b96be33e173f4bbab49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:48.528043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.528714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.538479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '801b861e790b4b96be33e173f4bbab49', 'request_id': 'req-082549aa-89ff-4756-9b82-67343c893d58'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.542959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '801b861e790b4b96be33e173f4bbab49', 'request_id': 'req-082549aa-89ff-4756-9b82-67343c893d58'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.543720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '801b861e790b4b96be33e173f4bbab49', 'request_id': 'req-082549aa-89ff-4756-9b82-67343c893d58'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.551353 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3333/6723] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:54:47 2022] DELETE /identity/v3/domains/801b861e790b4b96be33e173f4bbab49 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:54:48.555194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e098c1-ee93-4b2a-909d-ac8fe618885d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:48.557223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-70e098c1-ee93-4b2a-909d-ac8fe618885d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:48.663692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e098c1-ee93-4b2a-909d-ac8fe618885d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:48.677006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b076ce-15b3-4248-b5a5-cf0ec63c5837 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:48.677898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b076ce-15b3-4248-b5a5-cf0ec63c5837 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:48.678241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b076ce-15b3-4248-b5a5-cf0ec63c5837 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:48.678573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b076ce-15b3-4248-b5a5-cf0ec63c5837 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/2e482dd0522e47e6bc0317ed016e3837` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:48.695970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b076ce-15b3-4248-b5a5-cf0ec63c5837 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2e482dd0522e47e6bc0317ed016e3837)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:48.697803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b076ce-15b3-4248-b5a5-cf0ec63c5837 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:48.705356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:48.729302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-30b076ce-15b3-4248-b5a5-cf0ec63c5837 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2e482dd0522e47e6bc0317ed016e3837'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.730808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-30b076ce-15b3-4248-b5a5-cf0ec63c5837 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2e482dd0522e47e6bc0317ed016e3837'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.894853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-30b076ce-15b3-4248-b5a5-cf0ec63c5837 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2e482dd0522e47e6bc0317ed016e3837'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.895649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-30b076ce-15b3-4248-b5a5-cf0ec63c5837 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2e482dd0522e47e6bc0317ed016e3837'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:48.898349 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3391/6724] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:54:48 2022] PATCH /identity/v3/domains/2e482dd0522e47e6bc0317ed016e3837 => generated 277 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:48.902927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:48.904522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:48.993777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082549aa-89ff-4756-9b82-67343c893d58 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:49.090544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8273e2cce62f43e4b78640a3a362093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b750311dbfc3486e91869f5c1fcbad4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:49.091550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:49.091883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:49.094106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] PATH_INFO: `/v3/domains/2e482dd0522e47e6bc0317ed016e3837` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:49.108375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2e482dd0522e47e6bc0317ed016e3837)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:49.109725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:49.139393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2e482dd0522e47e6bc0317ed016e3837'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:49.156832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2e482dd0522e47e6bc0317ed016e3837'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:49.283468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b076ce-15b3-4248-b5a5-cf0ec63c5837 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:49.285593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-30b076ce-15b3-4248-b5a5-cf0ec63c5837 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:49.386679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e482dd0522e47e6bc0317ed016e3837', 'request_id': 'req-10191308-9325-42e8-86dd-73fe145f1522'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:49.406038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e482dd0522e47e6bc0317ed016e3837', 'request_id': 'req-10191308-9325-42e8-86dd-73fe145f1522'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:49.425483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e482dd0522e47e6bc0317ed016e3837', 'request_id': 'req-10191308-9325-42e8-86dd-73fe145f1522'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:49.468534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b076ce-15b3-4248-b5a5-cf0ec63c5837 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:49.532383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] The token cache is being invalidate because project 2e482dd0522e47e6bc0317ed016e3837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:49.532939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:49.533333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:49.553582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2e482dd0522e47e6bc0317ed016e3837', 'request_id': 'req-10191308-9325-42e8-86dd-73fe145f1522'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:49.558270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2e482dd0522e47e6bc0317ed016e3837', 'request_id': 'req-10191308-9325-42e8-86dd-73fe145f1522'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:49.559211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2e482dd0522e47e6bc0317ed016e3837', 'request_id': 'req-10191308-9325-42e8-86dd-73fe145f1522'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:49.577460 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3334/6725] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:54:48 2022] DELETE /identity/v3/domains/2e482dd0522e47e6bc0317ed016e3837 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:49.581695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:49.582915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cf245-8a88-44c4-8950-8f616c3a05c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:49.583583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cf245-8a88-44c4-8950-8f616c3a05c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:49.583859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cf245-8a88-44c4-8950-8f616c3a05c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:49.584130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cf245-8a88-44c4-8950-8f616c3a05c9 admin admin] PATH_INFO: `/v3/projects/98446ef54d984224af5e322412a29a79` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:49.585389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:49.585945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cf245-8a88-44c4-8950-8f616c3a05c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98446ef54d984224af5e322412a29a79)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:49.587928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cf245-8a88-44c4-8950-8f616c3a05c9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:49.609440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10191308-9325-42e8-86dd-73fe145f1522 tempest-DomainsTestJSON-1835327614 tempest-DomainsTestJSON-1835327614-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:49.626070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc572cf-196d-493a-b14c-51c6ca95e0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:49.627006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc572cf-196d-493a-b14c-51c6ca95e0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:49.637268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc572cf-196d-493a-b14c-51c6ca95e0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:49.637268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc572cf-196d-493a-b14c-51c6ca95e0e8 admin admin] PATH_INFO: `/v3/users/64e25867cb9e4298a268f769e304fb63` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:49.638781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc572cf-196d-493a-b14c-51c6ca95e0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64e25867cb9e4298a268f769e304fb63)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:49.641205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc572cf-196d-493a-b14c-51c6ca95e0e8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:49.805505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d88cf245-8a88-44c4-8950-8f616c3a05c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98446ef54d984224af5e322412a29a79', 'request_id': 'req-d88cf245-8a88-44c4-8950-8f616c3a05c9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:49.814029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d88cf245-8a88-44c4-8950-8f616c3a05c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98446ef54d984224af5e322412a29a79', 'request_id': 'req-d88cf245-8a88-44c4-8950-8f616c3a05c9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:49.907697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d88cf245-8a88-44c4-8950-8f616c3a05c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98446ef54d984224af5e322412a29a79', 'request_id': 'req-d88cf245-8a88-44c4-8950-8f616c3a05c9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:49.931442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d88cf245-8a88-44c4-8950-8f616c3a05c9 admin admin] The token cache is being invalidate because project 98446ef54d984224af5e322412a29a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:49.931796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d88cf245-8a88-44c4-8950-8f616c3a05c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:49.932312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4bc572cf-196d-493a-b14c-51c6ca95e0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64e25867cb9e4298a268f769e304fb63'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:49.932499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d88cf245-8a88-44c4-8950-8f616c3a05c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:49.940278 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3392/6726] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:49 2022] DELETE /identity/v3/projects/98446ef54d984224af5e322412a29a79 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:54:49.947916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2445646-48b9-41e0-ae6d-079ff285a29e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:49.948793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2445646-48b9-41e0-ae6d-079ff285a29e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:49.949794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2445646-48b9-41e0-ae6d-079ff285a29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:49.979582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c2445646-48b9-41e0-ae6d-079ff285a29e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:49.981423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c2445646-48b9-41e0-ae6d-079ff285a29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:50.030768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4bc572cf-196d-493a-b14c-51c6ca95e0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64e25867cb9e4298a268f769e304fb63'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:50.031659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4bc572cf-196d-493a-b14c-51c6ca95e0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64e25867cb9e4298a268f769e304fb63'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:50.051594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4bc572cf-196d-493a-b14c-51c6ca95e0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64e25867cb9e4298a268f769e304fb63'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:50.065325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:50.095050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4bc572cf-196d-493a-b14c-51c6ca95e0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64e25867cb9e4298a268f769e304fb63'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:50.102329 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3335/6727] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:49 2022] DELETE /identity/v3/users/64e25867cb9e4298a268f769e304fb63 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:50.107114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed579c3c-e523-47b0-9848-9d0c99d37615 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:50.107564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed579c3c-e523-47b0-9848-9d0c99d37615 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:50.107952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed579c3c-e523-47b0-9848-9d0c99d37615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:50.115149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:50.173789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ed579c3c-e523-47b0-9848-9d0c99d37615 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:50.175377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ed579c3c-e523-47b0-9848-9d0c99d37615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:50.184455 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3393/6728] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:50.188549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50171ece-1846-4fd9-a025-2f3254d08ad0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:50.188834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50171ece-1846-4fd9-a025-2f3254d08ad0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:50.189115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50171ece-1846-4fd9-a025-2f3254d08ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:50.249757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-50171ece-1846-4fd9-a025-2f3254d08ad0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:50.255778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-50171ece-1846-4fd9-a025-2f3254d08ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:50.311684 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3336/6729] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:54:50.329262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed579c3c-e523-47b0-9848-9d0c99d37615 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:50.331305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ed579c3c-e523-47b0-9848-9d0c99d37615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:50.386011 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3394/6730] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:50.391337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50171ece-1846-4fd9-a025-2f3254d08ad0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:50.403234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50171ece-1846-4fd9-a025-2f3254d08ad0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:50.415580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743a591-bc48-4a51-a0e8-037b48674370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:50.416322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743a591-bc48-4a51-a0e8-037b48674370 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:50.416860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743a591-bc48-4a51-a0e8-037b48674370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:50.417294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743a591-bc48-4a51-a0e8-037b48674370 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:50.418024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743a591-bc48-4a51-a0e8-037b48674370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:50.418399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743a591-bc48-4a51-a0e8-037b48674370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:50.420676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743a591-bc48-4a51-a0e8-037b48674370 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:50.438787 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3395/6731] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:50.443290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743a591-bc48-4a51-a0e8-037b48674370 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:50.455588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743a591-bc48-4a51-a0e8-037b48674370 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:50.462647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e4e99-8271-42af-a75f-0742d350457c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:50.463274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e4e99-8271-42af-a75f-0742d350457c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:50.463554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e4e99-8271-42af-a75f-0742d350457c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:50.463831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e4e99-8271-42af-a75f-0742d350457c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:50.464514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e4e99-8271-42af-a75f-0742d350457c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:50.466943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e4e99-8271-42af-a75f-0742d350457c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:50.479980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed579c3c-e523-47b0-9848-9d0c99d37615 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:50.485668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feda7d-f99d-4f1c-b72c-447261f924c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:50.486466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feda7d-f99d-4f1c-b72c-447261f924c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:50.487016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feda7d-f99d-4f1c-b72c-447261f924c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:50.487425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feda7d-f99d-4f1c-b72c-447261f924c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:50.509471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feda7d-f99d-4f1c-b72c-447261f924c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:50.511208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feda7d-f99d-4f1c-b72c-447261f924c5 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:50.523930 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3337/6732] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:50.620754 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3396/6733] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:50 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:54:50.622008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feda7d-f99d-4f1c-b72c-447261f924c5 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:50.644580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feda7d-f99d-4f1c-b72c-447261f924c5 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:50.754586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21545df3-b006-43a0-bb75-6d36ba565f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:50.755418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21545df3-b006-43a0-bb75-6d36ba565f6d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:50.755693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21545df3-b006-43a0-bb75-6d36ba565f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:50.756030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21545df3-b006-43a0-bb75-6d36ba565f6d admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:50.756815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21545df3-b006-43a0-bb75-6d36ba565f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:50.761150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21545df3-b006-43a0-bb75-6d36ba565f6d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:50.893881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e4e99-8271-42af-a75f-0742d350457c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:50.894874 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3338/6734] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:50 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:50.910800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e4e99-8271-42af-a75f-0742d350457c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:50.928426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85899b5-8125-4ca1-a733-4ae90a35dadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:50.929065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85899b5-8125-4ca1-a733-4ae90a35dadc admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:50.929502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85899b5-8125-4ca1-a733-4ae90a35dadc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:50.929942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85899b5-8125-4ca1-a733-4ae90a35dadc admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:50.930744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85899b5-8125-4ca1-a733-4ae90a35dadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:50.939558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85899b5-8125-4ca1-a733-4ae90a35dadc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:50.962789 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3397/6735] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:50.968713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21545df3-b006-43a0-bb75-6d36ba565f6d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:51.022258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21545df3-b006-43a0-bb75-6d36ba565f6d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:51.032922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4697c-ba30-4f44-afda-378ee7efc85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:51.034949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4697c-ba30-4f44-afda-378ee7efc85a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:51.036084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4697c-ba30-4f44-afda-378ee7efc85a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:51.041265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4697c-ba30-4f44-afda-378ee7efc85a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:51.045954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4697c-ba30-4f44-afda-378ee7efc85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:51.052813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4697c-ba30-4f44-afda-378ee7efc85a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:51.081759 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3339/6736] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:51.083522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85899b5-8125-4ca1-a733-4ae90a35dadc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:51.097920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85899b5-8125-4ca1-a733-4ae90a35dadc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:51.110618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b602ee-9e82-4c99-a5c8-f0ac1c853150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:51.111381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b602ee-9e82-4c99-a5c8-f0ac1c853150 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:51.111730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b602ee-9e82-4c99-a5c8-f0ac1c853150 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:51.112073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b602ee-9e82-4c99-a5c8-f0ac1c853150 admin admin] PATH_INFO: `/v3/projects/0c5a3907d5a942e7b3c2ad67a0289502/users/38b33e6f058148969446a87022a0da9b/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:51.146935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b602ee-9e82-4c99-a5c8-f0ac1c853150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5a3907d5a942e7b3c2ad67a0289502, user_id=38b33e6f058148969446a87022a0da9b, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:51.151190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b602ee-9e82-4c99-a5c8-f0ac1c853150 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:51.295876 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3398/6737] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:51 2022] PUT /identity/v3/projects/0c5a3907d5a942e7b3c2ad67a0289502/users/38b33e6f058148969446a87022a0da9b/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:51.306492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22485b55-61fa-4118-9ccc-f6d1f1be02c7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:51.306785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22485b55-61fa-4118-9ccc-f6d1f1be02c7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:51.307874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22485b55-61fa-4118-9ccc-f6d1f1be02c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:51.348454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-22485b55-61fa-4118-9ccc-f6d1f1be02c7 None None] MFA Rules not processed for user `38b33e6f058148969446a87022a0da9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:51.350159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-22485b55-61fa-4118-9ccc-f6d1f1be02c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:51.486828 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3340/6738] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:51.489829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b602ee-9e82-4c99-a5c8-f0ac1c853150 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:51.625596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b602ee-9e82-4c99-a5c8-f0ac1c853150 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:51.638742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442cf23-f70e-4198-8ae0-9bb5f5d11e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:51.639872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442cf23-f70e-4198-8ae0-9bb5f5d11e2d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:51.640131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442cf23-f70e-4198-8ae0-9bb5f5d11e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:51.641773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442cf23-f70e-4198-8ae0-9bb5f5d11e2d admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:51.642528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442cf23-f70e-4198-8ae0-9bb5f5d11e2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:51.645788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442cf23-f70e-4198-8ae0-9bb5f5d11e2d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:51.834965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22485b55-61fa-4118-9ccc-f6d1f1be02c7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:51.837962 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3399/6739] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:51 2022] POST /identity/v3/projects => generated 389 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:51.850438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22485b55-61fa-4118-9ccc-f6d1f1be02c7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:52.049051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e352fe-e274-4d27-9f22-4649ce832dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:52.049861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e352fe-e274-4d27-9f22-4649ce832dfc admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:52.050150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e352fe-e274-4d27-9f22-4649ce832dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:52.050429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e352fe-e274-4d27-9f22-4649ce832dfc admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:52.052794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e352fe-e274-4d27-9f22-4649ce832dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:52.067633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e352fe-e274-4d27-9f22-4649ce832dfc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:52.229394 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3341/6740] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:51 2022] POST /identity/v3/users => generated 301 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:54:52.236343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442cf23-f70e-4198-8ae0-9bb5f5d11e2d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:52.259663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442cf23-f70e-4198-8ae0-9bb5f5d11e2d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:52.273856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d4201-e506-4819-bea5-727c8871e963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:52.274500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d4201-e506-4819-bea5-727c8871e963 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:52.274781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d4201-e506-4819-bea5-727c8871e963 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:52.275054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d4201-e506-4819-bea5-727c8871e963 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:52.275872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d4201-e506-4819-bea5-727c8871e963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:52.277811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d4201-e506-4819-bea5-727c8871e963 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:52.314743 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3400/6741] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:52.318898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e352fe-e274-4d27-9f22-4649ce832dfc admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:52.337551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e352fe-e274-4d27-9f22-4649ce832dfc admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:52.358807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac5837-cb43-4b75-a313-28a36a2275a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:52.359780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac5837-cb43-4b75-a313-28a36a2275a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:52.359780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac5837-cb43-4b75-a313-28a36a2275a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:52.360363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac5837-cb43-4b75-a313-28a36a2275a5 admin admin] PATH_INFO: `/v3/projects/e1117ba259b94f69adee5e92f21ea22b/users/0d800e41d69347a2b6a812cdc8a9d256/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:52.381654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac5837-cb43-4b75-a313-28a36a2275a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1117ba259b94f69adee5e92f21ea22b, user_id=0d800e41d69347a2b6a812cdc8a9d256, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:52.384793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac5837-cb43-4b75-a313-28a36a2275a5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:52.480104 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3342/6742] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:52 2022] PUT /identity/v3/projects/e1117ba259b94f69adee5e92f21ea22b/users/0d800e41d69347a2b6a812cdc8a9d256/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:52.485068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d4201-e506-4819-bea5-727c8871e963 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:52.497917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d4201-e506-4819-bea5-727c8871e963 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:52.568505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:52.645291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d468c-d164-4ad4-8868-bb51f9c780f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:52.646322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d468c-d164-4ad4-8868-bb51f9c780f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:52.646611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d468c-d164-4ad4-8868-bb51f9c780f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:52.647147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d468c-d164-4ad4-8868-bb51f9c780f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:52.647807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d468c-d164-4ad4-8868-bb51f9c780f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:52.650498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d468c-d164-4ad4-8868-bb51f9c780f4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:52.671808 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3401/6743] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:52.685000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac5837-cb43-4b75-a313-28a36a2275a5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:52.699736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac5837-cb43-4b75-a313-28a36a2275a5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:52.714187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16de776-1879-4805-90e2-24550f533819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:52.715566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16de776-1879-4805-90e2-24550f533819 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:52.716556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16de776-1879-4805-90e2-24550f533819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:52.716556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16de776-1879-4805-90e2-24550f533819 admin admin] PATH_INFO: `/v3/projects/e1117ba259b94f69adee5e92f21ea22b/users/0d800e41d69347a2b6a812cdc8a9d256/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:52.719046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16de776-1879-4805-90e2-24550f533819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1117ba259b94f69adee5e92f21ea22b, user_id=0d800e41d69347a2b6a812cdc8a9d256, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:52.721925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16de776-1879-4805-90e2-24550f533819 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:52.736211 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3343/6744] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:52 2022] PUT /identity/v3/projects/e1117ba259b94f69adee5e92f21ea22b/users/0d800e41d69347a2b6a812cdc8a9d256/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:52.747632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c906225-c4c4-45f4-b821-e8e6c6be7243 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:52.748129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c906225-c4c4-45f4-b821-e8e6c6be7243 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:52.748625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c906225-c4c4-45f4-b821-e8e6c6be7243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:52.809305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4c906225-c4c4-45f4-b821-e8e6c6be7243 None None] MFA Rules not processed for user `0d800e41d69347a2b6a812cdc8a9d256`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:52.810874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4c906225-c4c4-45f4-b821-e8e6c6be7243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:52.993393 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3402/6745] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:52 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:53.000798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16de776-1879-4805-90e2-24550f533819 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:53.003148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f16de776-1879-4805-90e2-24550f533819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:53.021380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:53.116015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16de776-1879-4805-90e2-24550f533819 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:53.122653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca6e25-1364-4936-8b13-4075f8d04c3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:53.123899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca6e25-1364-4936-8b13-4075f8d04c3b service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:53.124199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca6e25-1364-4936-8b13-4075f8d04c3b service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:53.124518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca6e25-1364-4936-8b13-4075f8d04c3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:53.135976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca6e25-1364-4936-8b13-4075f8d04c3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:53.139482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca6e25-1364-4936-8b13-4075f8d04c3b service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:53.165605 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3344/6746] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:52 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:53.423578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c906225-c4c4-45f4-b821-e8e6c6be7243 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:53.423705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca6e25-1364-4936-8b13-4075f8d04c3b service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:53.425694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4c906225-c4c4-45f4-b821-e8e6c6be7243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:53.600991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c906225-c4c4-45f4-b821-e8e6c6be7243 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:53.609785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1742c32-61ad-44af-8a73-e4e2ad4548a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:53.610370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1742c32-61ad-44af-8a73-e4e2ad4548a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:53.610649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1742c32-61ad-44af-8a73-e4e2ad4548a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:53.611023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1742c32-61ad-44af-8a73-e4e2ad4548a1 admin admin] PATH_INFO: `/v3/projects/a0ddef08f7d846ae9b3b006138c189a3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:53.615057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1742c32-61ad-44af-8a73-e4e2ad4548a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0ddef08f7d846ae9b3b006138c189a3)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:53.624774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1742c32-61ad-44af-8a73-e4e2ad4548a1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:53.628479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca6e25-1364-4936-8b13-4075f8d04c3b service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:53.644112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37777a68-c4e4-431b-b96c-91f12ca9c719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:53.645291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37777a68-c4e4-431b-b96c-91f12ca9c719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:53.646381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37777a68-c4e4-431b-b96c-91f12ca9c719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:53.647150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37777a68-c4e4-431b-b96c-91f12ca9c719 admin admin] PATH_INFO: `/v3/users/38b33e6f058148969446a87022a0da9b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:53.649841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37777a68-c4e4-431b-b96c-91f12ca9c719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b33e6f058148969446a87022a0da9b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:53.658165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37777a68-c4e4-431b-b96c-91f12ca9c719 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:53.880872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:54.045862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d1742c32-61ad-44af-8a73-e4e2ad4548a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0ddef08f7d846ae9b3b006138c189a3', 'request_id': 'req-d1742c32-61ad-44af-8a73-e4e2ad4548a1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:54.048916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-37777a68-c4e4-431b-b96c-91f12ca9c719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b33e6f058148969446a87022a0da9b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:54.053765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d1742c32-61ad-44af-8a73-e4e2ad4548a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0ddef08f7d846ae9b3b006138c189a3', 'request_id': 'req-d1742c32-61ad-44af-8a73-e4e2ad4548a1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:54.245841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d1742c32-61ad-44af-8a73-e4e2ad4548a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0ddef08f7d846ae9b3b006138c189a3', 'request_id': 'req-d1742c32-61ad-44af-8a73-e4e2ad4548a1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:54.266977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d1742c32-61ad-44af-8a73-e4e2ad4548a1 admin admin] The token cache is being invalidate because project a0ddef08f7d846ae9b3b006138c189a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:54.268250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d1742c32-61ad-44af-8a73-e4e2ad4548a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:54.276774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d1742c32-61ad-44af-8a73-e4e2ad4548a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:54.281930 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3403/6747] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:53 2022] DELETE /identity/v3/projects/a0ddef08f7d846ae9b3b006138c189a3 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:54.284171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1742c32-61ad-44af-8a73-e4e2ad4548a1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:54.285799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d1742c32-61ad-44af-8a73-e4e2ad4548a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:54.361651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-37777a68-c4e4-431b-b96c-91f12ca9c719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b33e6f058148969446a87022a0da9b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:54.363120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-37777a68-c4e4-431b-b96c-91f12ca9c719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b33e6f058148969446a87022a0da9b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:54.379592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-37777a68-c4e4-431b-b96c-91f12ca9c719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b33e6f058148969446a87022a0da9b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:54.400279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-37777a68-c4e4-431b-b96c-91f12ca9c719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b33e6f058148969446a87022a0da9b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:54.411607 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3345/6748] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:53 2022] DELETE /identity/v3/users/38b33e6f058148969446a87022a0da9b => generated 0 bytes in 988 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:54.417399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f636c-23f7-4c02-8abf-e5bd154f3e3c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:54.418338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f636c-23f7-4c02-8abf-e5bd154f3e3c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:54.418629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f636c-23f7-4c02-8abf-e5bd154f3e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:54.426328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1742c32-61ad-44af-8a73-e4e2ad4548a1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:54.496578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-999f636c-23f7-4c02-8abf-e5bd154f3e3c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:54.499099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ed014-20e0-4f89-aaf8-c81c3d5dcfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:54.500113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ed014-20e0-4f89-aaf8-c81c3d5dcfd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:54.500435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ed014-20e0-4f89-aaf8-c81c3d5dcfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:54.509801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ed014-20e0-4f89-aaf8-c81c3d5dcfd9 admin admin] PATH_INFO: `/v3/users/8273e2cce62f43e4b78640a3a362093b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:54.509801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ed014-20e0-4f89-aaf8-c81c3d5dcfd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8273e2cce62f43e4b78640a3a362093b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:54.509801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ed014-20e0-4f89-aaf8-c81c3d5dcfd9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:54.510145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-999f636c-23f7-4c02-8abf-e5bd154f3e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:54.546031 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3346/6749] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:54.558627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f636c-23f7-4c02-8abf-e5bd154f3e3c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:54.564469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-999f636c-23f7-4c02-8abf-e5bd154f3e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:54.745731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f636c-23f7-4c02-8abf-e5bd154f3e3c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:54.757578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c576d-ce19-4a9c-84c3-166a498f0800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:54.758220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c576d-ce19-4a9c-84c3-166a498f0800 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:54.758505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c576d-ce19-4a9c-84c3-166a498f0800 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:54.758787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c576d-ce19-4a9c-84c3-166a498f0800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:54.776434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c576d-ce19-4a9c-84c3-166a498f0800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:54.780420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c576d-ce19-4a9c-84c3-166a498f0800 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:54.793059 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3347/6750] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:54.816953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-479ed014-20e0-4f89-aaf8-c81c3d5dcfd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8273e2cce62f43e4b78640a3a362093b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:54.818022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-479ed014-20e0-4f89-aaf8-c81c3d5dcfd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8273e2cce62f43e4b78640a3a362093b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:54.965968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-479ed014-20e0-4f89-aaf8-c81c3d5dcfd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8273e2cce62f43e4b78640a3a362093b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:54.970851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-479ed014-20e0-4f89-aaf8-c81c3d5dcfd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8273e2cce62f43e4b78640a3a362093b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:55.002438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-479ed014-20e0-4f89-aaf8-c81c3d5dcfd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8273e2cce62f43e4b78640a3a362093b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:55.021061 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3404/6751] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:54 2022] DELETE /identity/v3/users/8273e2cce62f43e4b78640a3a362093b => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:54:55.131118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:55.685865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c576d-ce19-4a9c-84c3-166a498f0800 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:55.687519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0d8c576d-ce19-4a9c-84c3-166a498f0800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:55.720776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c576d-ce19-4a9c-84c3-166a498f0800 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:55.879262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3781b75-ea36-4919-9542-75de084b105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:55.880520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781b75-ea36-4919-9542-75de084b105d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:55.880808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781b75-ea36-4919-9542-75de084b105d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:55.881087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781b75-ea36-4919-9542-75de084b105d admin admin] PATH_INFO: `/v3/projects/0c5a3907d5a942e7b3c2ad67a0289502` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:55.886124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3781b75-ea36-4919-9542-75de084b105d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5a3907d5a942e7b3c2ad67a0289502)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:55.894359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3781b75-ea36-4919-9542-75de084b105d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:56.118538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a3781b75-ea36-4919-9542-75de084b105d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5a3907d5a942e7b3c2ad67a0289502', 'request_id': 'req-a3781b75-ea36-4919-9542-75de084b105d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:56.126020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a3781b75-ea36-4919-9542-75de084b105d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5a3907d5a942e7b3c2ad67a0289502', 'request_id': 'req-a3781b75-ea36-4919-9542-75de084b105d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:56.134351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a3781b75-ea36-4919-9542-75de084b105d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5a3907d5a942e7b3c2ad67a0289502', 'request_id': 'req-a3781b75-ea36-4919-9542-75de084b105d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:56.245357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a3781b75-ea36-4919-9542-75de084b105d admin admin] The token cache is being invalidate because project 0c5a3907d5a942e7b3c2ad67a0289502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:56.246816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a3781b75-ea36-4919-9542-75de084b105d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:56.248954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a3781b75-ea36-4919-9542-75de084b105d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:56.253581 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3348/6752] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:55 2022] DELETE /identity/v3/projects/0c5a3907d5a942e7b3c2ad67a0289502 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:56.257627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ed014-20e0-4f89-aaf8-c81c3d5dcfd9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:56.260273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-479ed014-20e0-4f89-aaf8-c81c3d5dcfd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:56.280290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ed014-20e0-4f89-aaf8-c81c3d5dcfd9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:56.357164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd343f1-90a2-4a4c-a84f-593f37294701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:56.358309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd343f1-90a2-4a4c-a84f-593f37294701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:56.358773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd343f1-90a2-4a4c-a84f-593f37294701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:56.359265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd343f1-90a2-4a4c-a84f-593f37294701 admin admin] PATH_INFO: `/v3/users/0d800e41d69347a2b6a812cdc8a9d256` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:56.361628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd343f1-90a2-4a4c-a84f-593f37294701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d800e41d69347a2b6a812cdc8a9d256)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:56.363606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd343f1-90a2-4a4c-a84f-593f37294701 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:56.507509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:56.659215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0bd343f1-90a2-4a4c-a84f-593f37294701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d800e41d69347a2b6a812cdc8a9d256'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:56.660204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0bd343f1-90a2-4a4c-a84f-593f37294701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d800e41d69347a2b6a812cdc8a9d256'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:56.762518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0bd343f1-90a2-4a4c-a84f-593f37294701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d800e41d69347a2b6a812cdc8a9d256'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:56.765700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0bd343f1-90a2-4a4c-a84f-593f37294701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d800e41d69347a2b6a812cdc8a9d256'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:56.797579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0bd343f1-90a2-4a4c-a84f-593f37294701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d800e41d69347a2b6a812cdc8a9d256'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:56.818384 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3405/6753] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:56 2022] DELETE /identity/v3/users/0d800e41d69347a2b6a812cdc8a9d256 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:57.094388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:57.395701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3781b75-ea36-4919-9542-75de084b105d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:57.399119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a3781b75-ea36-4919-9542-75de084b105d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:57.427915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3781b75-ea36-4919-9542-75de084b105d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:57.568268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd343f1-90a2-4a4c-a84f-593f37294701 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:57.569888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0bd343f1-90a2-4a4c-a84f-593f37294701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:57.609580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2e338-b9fd-4647-9bf6-70e8c611b7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:57.610430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2e338-b9fd-4647-9bf6-70e8c611b7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:57.612055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2e338-b9fd-4647-9bf6-70e8c611b7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:57.612552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2e338-b9fd-4647-9bf6-70e8c611b7e8 admin admin] PATH_INFO: `/v3/projects/b750311dbfc3486e91869f5c1fcbad4f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:57.615761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2e338-b9fd-4647-9bf6-70e8c611b7e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b750311dbfc3486e91869f5c1fcbad4f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:57.619353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2e338-b9fd-4647-9bf6-70e8c611b7e8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:57.657370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:57.731682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd343f1-90a2-4a4c-a84f-593f37294701 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:57.741561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45f0df-269c-4582-9c36-ef36c81dbbcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:57.742609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45f0df-269c-4582-9c36-ef36c81dbbcd service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:57.743121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45f0df-269c-4582-9c36-ef36c81dbbcd service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:57.743685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45f0df-269c-4582-9c36-ef36c81dbbcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:57.746776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-db45f0df-269c-4582-9c36-ef36c81dbbcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:57.809112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7ad2e338-b9fd-4647-9bf6-70e8c611b7e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b750311dbfc3486e91869f5c1fcbad4f', 'request_id': 'req-7ad2e338-b9fd-4647-9bf6-70e8c611b7e8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:57.825317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7ad2e338-b9fd-4647-9bf6-70e8c611b7e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b750311dbfc3486e91869f5c1fcbad4f', 'request_id': 'req-7ad2e338-b9fd-4647-9bf6-70e8c611b7e8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:57.852938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7ad2e338-b9fd-4647-9bf6-70e8c611b7e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b750311dbfc3486e91869f5c1fcbad4f', 'request_id': 'req-7ad2e338-b9fd-4647-9bf6-70e8c611b7e8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:57.929584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45f0df-269c-4582-9c36-ef36c81dbbcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:57.931847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45f0df-269c-4582-9c36-ef36c81dbbcd service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:57.948370 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3406/6754] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:54:57 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:54:58.064772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7ad2e338-b9fd-4647-9bf6-70e8c611b7e8 admin admin] The token cache is being invalidate because project b750311dbfc3486e91869f5c1fcbad4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:58.065552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7ad2e338-b9fd-4647-9bf6-70e8c611b7e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:58.067211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7ad2e338-b9fd-4647-9bf6-70e8c611b7e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:58.069343 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3349/6755] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:57 2022] DELETE /identity/v3/projects/b750311dbfc3486e91869f5c1fcbad4f => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:58.073944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc2ce7-9dc2-456d-aae1-f8fe9efaa3d0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:58.074240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc2ce7-9dc2-456d-aae1-f8fe9efaa3d0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:58.074519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc2ce7-9dc2-456d-aae1-f8fe9efaa3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:58.122029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-cccc2ce7-9dc2-456d-aae1-f8fe9efaa3d0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:58.123733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cccc2ce7-9dc2-456d-aae1-f8fe9efaa3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:58.268518 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3407/6756] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:58.277844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08529060-4a3a-4b9b-a34a-7bc89a1d4e31 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:58.278138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08529060-4a3a-4b9b-a34a-7bc89a1d4e31 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:58.278420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08529060-4a3a-4b9b-a34a-7bc89a1d4e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:58.337730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-08529060-4a3a-4b9b-a34a-7bc89a1d4e31 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:58.339001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-08529060-4a3a-4b9b-a34a-7bc89a1d4e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:58.367385 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3350/6757] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:58.371909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc2ce7-9dc2-456d-aae1-f8fe9efaa3d0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:58.400063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc2ce7-9dc2-456d-aae1-f8fe9efaa3d0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:58.411768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239478b4-80ef-46f7-ab30-26b679d2e496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:58.412606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239478b4-80ef-46f7-ab30-26b679d2e496 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:58.412963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239478b4-80ef-46f7-ab30-26b679d2e496 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:58.413305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239478b4-80ef-46f7-ab30-26b679d2e496 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:58.414391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239478b4-80ef-46f7-ab30-26b679d2e496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:54:58.420980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239478b4-80ef-46f7-ab30-26b679d2e496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:58.423679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239478b4-80ef-46f7-ab30-26b679d2e496 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:58.476872 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3408/6758] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:54:58.480217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08529060-4a3a-4b9b-a34a-7bc89a1d4e31 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:58.498749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08529060-4a3a-4b9b-a34a-7bc89a1d4e31 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:58.515920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063b174-ef49-4b54-b2a8-8889d518f1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:58.517394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b174-ef49-4b54-b2a8-8889d518f1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:58.517946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b174-ef49-4b54-b2a8-8889d518f1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:58.518988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b174-ef49-4b54-b2a8-8889d518f1c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:58.519834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063b174-ef49-4b54-b2a8-8889d518f1c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:58.526477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063b174-ef49-4b54-b2a8-8889d518f1c3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:58.653039 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3351/6759] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:58 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:58.659708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239478b4-80ef-46f7-ab30-26b679d2e496 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:58.687983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239478b4-80ef-46f7-ab30-26b679d2e496 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:58.786543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf21f75-7443-496c-9588-d59db04470b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:58.787298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf21f75-7443-496c-9588-d59db04470b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:58.787670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf21f75-7443-496c-9588-d59db04470b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:58.787953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf21f75-7443-496c-9588-d59db04470b4 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:58.788706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf21f75-7443-496c-9588-d59db04470b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:58.790918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf21f75-7443-496c-9588-d59db04470b4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:58.930875 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3409/6760] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:54:58 2022] POST /identity/v3/users => generated 294 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:54:58.932617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063b174-ef49-4b54-b2a8-8889d518f1c3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:58.946937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063b174-ef49-4b54-b2a8-8889d518f1c3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:58.957925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fbd50-b6ed-4c36-ab73-de03614af32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:58.959101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fbd50-b6ed-4c36-ab73-de03614af32a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:58.959744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fbd50-b6ed-4c36-ab73-de03614af32a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:58.960310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fbd50-b6ed-4c36-ab73-de03614af32a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:58.961956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fbd50-b6ed-4c36-ab73-de03614af32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:58.964320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fbd50-b6ed-4c36-ab73-de03614af32a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:58.992090 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3352/6761] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:58.993372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf21f75-7443-496c-9588-d59db04470b4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:59.013810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf21f75-7443-496c-9588-d59db04470b4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:59.029055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf1da5-53bc-4328-86d4-52b8fb9e3460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:59.030075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf1da5-53bc-4328-86d4-52b8fb9e3460 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:59.030512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf1da5-53bc-4328-86d4-52b8fb9e3460 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:59.030950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf1da5-53bc-4328-86d4-52b8fb9e3460 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:59.031757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf1da5-53bc-4328-86d4-52b8fb9e3460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:59.033757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf1da5-53bc-4328-86d4-52b8fb9e3460 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:59.052144 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3410/6762] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:54:59.061962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf1da5-53bc-4328-86d4-52b8fb9e3460 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:59.062415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fbd50-b6ed-4c36-ab73-de03614af32a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:59.064104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e8cf1da5-53bc-4328-86d4-52b8fb9e3460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:59.085008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fbd50-b6ed-4c36-ab73-de03614af32a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:59.085694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf1da5-53bc-4328-86d4-52b8fb9e3460 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:59.100344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c739e05-959a-48b5-ba94-4f8e4b019159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:59.100344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c739e05-959a-48b5-ba94-4f8e4b019159 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:59.100344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c739e05-959a-48b5-ba94-4f8e4b019159 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:59.100824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273173a2-25b2-4e42-b435-92744bf22b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:59.100824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273173a2-25b2-4e42-b435-92744bf22b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:59.100824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273173a2-25b2-4e42-b435-92744bf22b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:59.100824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273173a2-25b2-4e42-b435-92744bf22b5b admin admin] PATH_INFO: `/v3/projects/e1117ba259b94f69adee5e92f21ea22b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:59.101649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273173a2-25b2-4e42-b435-92744bf22b5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1117ba259b94f69adee5e92f21ea22b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:59.108104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273173a2-25b2-4e42-b435-92744bf22b5b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:59.155551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c739e05-959a-48b5-ba94-4f8e4b019159 admin admin] PATH_INFO: `/v3/projects/c1326c90f74c4fe28c2ce95026c3404b/users/ec72d8f9aac34ed29ba671d0115b556e/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:59.198760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c739e05-959a-48b5-ba94-4f8e4b019159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1326c90f74c4fe28c2ce95026c3404b, user_id=ec72d8f9aac34ed29ba671d0115b556e, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:59.204010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c739e05-959a-48b5-ba94-4f8e4b019159 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:59.374193 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3353/6763] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:54:59 2022] PUT /identity/v3/projects/c1326c90f74c4fe28c2ce95026c3404b/users/ec72d8f9aac34ed29ba671d0115b556e/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:54:59.374193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c739e05-959a-48b5-ba94-4f8e4b019159 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:59.376915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-273173a2-25b2-4e42-b435-92744bf22b5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1117ba259b94f69adee5e92f21ea22b', 'request_id': 'req-273173a2-25b2-4e42-b435-92744bf22b5b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:59.384455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4c739e05-959a-48b5-ba94-4f8e4b019159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:59.393959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-273173a2-25b2-4e42-b435-92744bf22b5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1117ba259b94f69adee5e92f21ea22b', 'request_id': 'req-273173a2-25b2-4e42-b435-92744bf22b5b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:59.477317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c739e05-959a-48b5-ba94-4f8e4b019159 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:59.485062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89feca-1ffb-42af-b8cd-4e0173c60a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:59.486433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89feca-1ffb-42af-b8cd-4e0173c60a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:59.487790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89feca-1ffb-42af-b8cd-4e0173c60a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:59.488256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89feca-1ffb-42af-b8cd-4e0173c60a48 admin admin] PATH_INFO: `/v3/users/4fdbdb3e5e544e098d0163029def54d2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:59.489806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89feca-1ffb-42af-b8cd-4e0173c60a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fdbdb3e5e544e098d0163029def54d2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:59.494387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89feca-1ffb-42af-b8cd-4e0173c60a48 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:59.542657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-273173a2-25b2-4e42-b435-92744bf22b5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1117ba259b94f69adee5e92f21ea22b', 'request_id': 'req-273173a2-25b2-4e42-b435-92744bf22b5b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:59.562625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-273173a2-25b2-4e42-b435-92744bf22b5b admin admin] The token cache is being invalidate because project e1117ba259b94f69adee5e92f21ea22b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:54:59.562940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-273173a2-25b2-4e42-b435-92744bf22b5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:59.563626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-273173a2-25b2-4e42-b435-92744bf22b5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:59.565428 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3411/6764] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:54:59 2022] DELETE /identity/v3/projects/e1117ba259b94f69adee5e92f21ea22b => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:54:59.566335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44730e0d-45f8-43cc-9583-3a6b447c5675 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:59.566620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44730e0d-45f8-43cc-9583-3a6b447c5675 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:59.566893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44730e0d-45f8-43cc-9583-3a6b447c5675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:59.573028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:54:59.638429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-44730e0d-45f8-43cc-9583-3a6b447c5675 None None] MFA Rules not processed for user `ec72d8f9aac34ed29ba671d0115b556e`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:59.642739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-44730e0d-45f8-43cc-9583-3a6b447c5675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:59.798693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cf89feca-1ffb-42af-b8cd-4e0173c60a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fdbdb3e5e544e098d0163029def54d2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:59.809051 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3412/6765] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:59.815312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe6e7d-7bdf-484b-994d-2851479eacee None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:59.817062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe6e7d-7bdf-484b-994d-2851479eacee None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:59.818268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe6e7d-7bdf-484b-994d-2851479eacee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:59.871536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-74fe6e7d-7bdf-484b-994d-2851479eacee None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:54:59.871536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-74fe6e7d-7bdf-484b-994d-2851479eacee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:59.881155 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3413/6766] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:54:59.882274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe6e7d-7bdf-484b-994d-2851479eacee None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:54:59.883925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-74fe6e7d-7bdf-484b-994d-2851479eacee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:54:59.899360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe6e7d-7bdf-484b-994d-2851479eacee None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:54:59.906452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4325b3-d883-4005-9935-9ca6e65ac9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:54:59.907507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4325b3-d883-4005-9935-9ca6e65ac9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:54:59.907983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4325b3-d883-4005-9935-9ca6e65ac9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:54:59.908465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4325b3-d883-4005-9935-9ca6e65ac9d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:54:59.909285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4325b3-d883-4005-9935-9ca6e65ac9d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:54:59.911457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4325b3-d883-4005-9935-9ca6e65ac9d6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:54:59.933220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cf89feca-1ffb-42af-b8cd-4e0173c60a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fdbdb3e5e544e098d0163029def54d2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:59.934352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cf89feca-1ffb-42af-b8cd-4e0173c60a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fdbdb3e5e544e098d0163029def54d2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:54:59.972038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cf89feca-1ffb-42af-b8cd-4e0173c60a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fdbdb3e5e544e098d0163029def54d2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:00.001177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cf89feca-1ffb-42af-b8cd-4e0173c60a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fdbdb3e5e544e098d0163029def54d2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:00.008514 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3354/6767] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:54:59 2022] DELETE /identity/v3/users/4fdbdb3e5e544e098d0163029def54d2 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:00.011636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88616e-a74a-4731-92ff-8a97af0ad261 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:00.012602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88616e-a74a-4731-92ff-8a97af0ad261 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:00.013031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88616e-a74a-4731-92ff-8a97af0ad261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:00.024633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:00.046206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ce88616e-a74a-4731-92ff-8a97af0ad261 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:00.047671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ce88616e-a74a-4731-92ff-8a97af0ad261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:00.067110 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3414/6768] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:54:59 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:00.072477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4325b3-d883-4005-9935-9ca6e65ac9d6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:00.072704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7f4325b3-d883-4005-9935-9ca6e65ac9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:00.152422 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3355/6769] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:00.152941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4325b3-d883-4005-9935-9ca6e65ac9d6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:00.155112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b53ff-21ec-46be-9ee4-9cd98ab8a286 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:00.155424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b53ff-21ec-46be-9ee4-9cd98ab8a286 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:00.155800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b53ff-21ec-46be-9ee4-9cd98ab8a286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:00.159708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecabf29-1452-4e5f-923f-5a25570a6996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:00.160407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecabf29-1452-4e5f-923f-5a25570a6996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:00.160690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecabf29-1452-4e5f-923f-5a25570a6996 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:00.160967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecabf29-1452-4e5f-923f-5a25570a6996 admin admin] PATH_INFO: `/v3/users/e2cff95b0d444598a43aa9458b78413a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:00.162105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecabf29-1452-4e5f-923f-5a25570a6996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2cff95b0d444598a43aa9458b78413a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:00.164282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecabf29-1452-4e5f-923f-5a25570a6996 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:00.217289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-279b53ff-21ec-46be-9ee4-9cd98ab8a286 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:00.224476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-279b53ff-21ec-46be-9ee4-9cd98ab8a286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:00.248577 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3356/6770] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:00.277879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b53ff-21ec-46be-9ee4-9cd98ab8a286 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:00.281510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-279b53ff-21ec-46be-9ee4-9cd98ab8a286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:00.305808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b53ff-21ec-46be-9ee4-9cd98ab8a286 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:00.317085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee7cfe-de2f-4e89-a25d-fd8a17c6ef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:00.319808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee7cfe-de2f-4e89-a25d-fd8a17c6ef01 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:00.320386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee7cfe-de2f-4e89-a25d-fd8a17c6ef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:00.320872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee7cfe-de2f-4e89-a25d-fd8a17c6ef01 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:00.322585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee7cfe-de2f-4e89-a25d-fd8a17c6ef01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:00.326598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee7cfe-de2f-4e89-a25d-fd8a17c6ef01 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:00.413584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6ecabf29-1452-4e5f-923f-5a25570a6996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2cff95b0d444598a43aa9458b78413a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:00.414511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6ecabf29-1452-4e5f-923f-5a25570a6996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2cff95b0d444598a43aa9458b78413a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:00.434369 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3357/6771] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:00 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:00.435999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee7cfe-de2f-4e89-a25d-fd8a17c6ef01 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:00.455227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee7cfe-de2f-4e89-a25d-fd8a17c6ef01 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:00.461686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5625e31-dc8c-4e61-86bb-535f6a8104ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:00.461686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5625e31-dc8c-4e61-86bb-535f6a8104ba admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:00.462155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5625e31-dc8c-4e61-86bb-535f6a8104ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:00.462989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5625e31-dc8c-4e61-86bb-535f6a8104ba admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:00.464510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5625e31-dc8c-4e61-86bb-535f6a8104ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:00.464971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5625e31-dc8c-4e61-86bb-535f6a8104ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:00.467425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5625e31-dc8c-4e61-86bb-535f6a8104ba admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:00.503454 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3358/6772] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:00.505254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5625e31-dc8c-4e61-86bb-535f6a8104ba admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:00.508125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a5625e31-dc8c-4e61-86bb-535f6a8104ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:00.509838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6ecabf29-1452-4e5f-923f-5a25570a6996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2cff95b0d444598a43aa9458b78413a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:00.512825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6ecabf29-1452-4e5f-923f-5a25570a6996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2cff95b0d444598a43aa9458b78413a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:00.573217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6ecabf29-1452-4e5f-923f-5a25570a6996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2cff95b0d444598a43aa9458b78413a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:00.625767 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3415/6773] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:00 2022] DELETE /identity/v3/users/e2cff95b0d444598a43aa9458b78413a => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:00.630818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecabf29-1452-4e5f-923f-5a25570a6996 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:00.634880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6ecabf29-1452-4e5f-923f-5a25570a6996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:00.638939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5625e31-dc8c-4e61-86bb-535f6a8104ba admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:00.701943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb65277-cbb0-45d2-b25a-e14e0aaa999a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:00.703432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb65277-cbb0-45d2-b25a-e14e0aaa999a service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:00.704130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb65277-cbb0-45d2-b25a-e14e0aaa999a service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:00.704646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb65277-cbb0-45d2-b25a-e14e0aaa999a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:00.706761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-abb65277-cbb0-45d2-b25a-e14e0aaa999a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:00.816530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb65277-cbb0-45d2-b25a-e14e0aaa999a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:00.816530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb65277-cbb0-45d2-b25a-e14e0aaa999a service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:00.857303 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3359/6774] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:55:00.859362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb65277-cbb0-45d2-b25a-e14e0aaa999a service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:00.862439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecabf29-1452-4e5f-923f-5a25570a6996 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:00.864689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-abb65277-cbb0-45d2-b25a-e14e0aaa999a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:00.880762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bd099-d4f0-4c71-919a-d62cb99bbd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:00.881729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bd099-d4f0-4c71-919a-d62cb99bbd10 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:00.884016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bd099-d4f0-4c71-919a-d62cb99bbd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:00.884619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bd099-d4f0-4c71-919a-d62cb99bbd10 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:00.885816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bd099-d4f0-4c71-919a-d62cb99bbd10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:00.894976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bd099-d4f0-4c71-919a-d62cb99bbd10 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:00.895842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb65277-cbb0-45d2-b25a-e14e0aaa999a service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:00.906487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f036fca-5911-406b-aaa8-9e1f5a847a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:00.907617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f036fca-5911-406b-aaa8-9e1f5a847a40 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:00.908438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f036fca-5911-406b-aaa8-9e1f5a847a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:00.908726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f036fca-5911-406b-aaa8-9e1f5a847a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:00.909443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f036fca-5911-406b-aaa8-9e1f5a847a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:00.911324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f036fca-5911-406b-aaa8-9e1f5a847a40 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:00.949910 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3416/6775] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:00.953392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bdd35-c333-41e5-b6e8-ccb0160fe2af None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:00.956768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bdd35-c333-41e5-b6e8-ccb0160fe2af None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:00.958926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bdd35-c333-41e5-b6e8-ccb0160fe2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:01.011681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-070bdd35-c333-41e5-b6e8-ccb0160fe2af None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:01.014929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-070bdd35-c333-41e5-b6e8-ccb0160fe2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:01.037154 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3417/6776] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:01.046013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bdd35-c333-41e5-b6e8-ccb0160fe2af None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:01.064121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bdd35-c333-41e5-b6e8-ccb0160fe2af None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:01.078964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09152ff2-3a6f-4a2a-9fc2-a6b43e6245f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:01.082213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09152ff2-3a6f-4a2a-9fc2-a6b43e6245f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:01.082213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09152ff2-3a6f-4a2a-9fc2-a6b43e6245f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:01.082213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09152ff2-3a6f-4a2a-9fc2-a6b43e6245f0 admin admin] PATH_INFO: `/v3/projects/b3c19a4564b64c69a8e275f041f17d30/users/e2121c93b344482da7084fcf83e5288c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:01.144976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09152ff2-3a6f-4a2a-9fc2-a6b43e6245f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c19a4564b64c69a8e275f041f17d30, user_id=e2121c93b344482da7084fcf83e5288c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:01.144976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09152ff2-3a6f-4a2a-9fc2-a6b43e6245f0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:01.211464 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3360/6777] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:00 2022] POST /identity/v3/projects => generated 385 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:01.212683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f036fca-5911-406b-aaa8-9e1f5a847a40 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:01.214615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9f036fca-5911-406b-aaa8-9e1f5a847a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:01.327452 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3418/6778] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:01 2022] PUT /identity/v3/projects/b3c19a4564b64c69a8e275f041f17d30/users/e2121c93b344482da7084fcf83e5288c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:01.332261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09152ff2-3a6f-4a2a-9fc2-a6b43e6245f0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:01.439820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:UPDATE=1,keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:01.472357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f036fca-5911-406b-aaa8-9e1f5a847a40 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:01.574119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09152ff2-3a6f-4a2a-9fc2-a6b43e6245f0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:01.587768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6356d-f4d5-4278-a36c-edac139d7410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:01.590110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6356d-f4d5-4278-a36c-edac139d7410 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:01.590110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6356d-f4d5-4278-a36c-edac139d7410 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:01.590110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6356d-f4d5-4278-a36c-edac139d7410 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:01.590394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6356d-f4d5-4278-a36c-edac139d7410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:01.594065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6356d-f4d5-4278-a36c-edac139d7410 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:01.700769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f001ec-d99f-4f01-942b-7baaee2290bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:01.702060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f001ec-d99f-4f01-942b-7baaee2290bb service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:01.702206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f001ec-d99f-4f01-942b-7baaee2290bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:01.706330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f001ec-d99f-4f01-942b-7baaee2290bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:01.730848 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3419/6779] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:01 2022] POST /identity/v3/users => generated 293 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:01.737587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6356d-f4d5-4278-a36c-edac139d7410 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:01.747185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f001ec-d99f-4f01-942b-7baaee2290bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:01.753335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f001ec-d99f-4f01-942b-7baaee2290bb service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:01.776006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6356d-f4d5-4278-a36c-edac139d7410 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:01.809214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c8513-2f1c-4106-9d40-ec922ae152d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:01.809214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c8513-2f1c-4106-9d40-ec922ae152d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:01.809214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c8513-2f1c-4106-9d40-ec922ae152d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:01.811333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c8513-2f1c-4106-9d40-ec922ae152d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:01.812477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c8513-2f1c-4106-9d40-ec922ae152d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:01.818152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c8513-2f1c-4106-9d40-ec922ae152d4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:01.834371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:01.838172 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3361/6780] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:55:01.846259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f001ec-d99f-4f01-942b-7baaee2290bb service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:01.846522 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3420/6781] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:01.857695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c8513-2f1c-4106-9d40-ec922ae152d4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:01.881692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c8513-2f1c-4106-9d40-ec922ae152d4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:01.884352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f001ec-d99f-4f01-942b-7baaee2290bb service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:01.892935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de7342-f255-4fc8-bcd3-ab9e2a1d6119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:01.896237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de7342-f255-4fc8-bcd3-ab9e2a1d6119 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:01.897340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de7342-f255-4fc8-bcd3-ab9e2a1d6119 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:01.897739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de7342-f255-4fc8-bcd3-ab9e2a1d6119 admin admin] PATH_INFO: `/v3/projects/b3c19a4564b64c69a8e275f041f17d30/users/e2121c93b344482da7084fcf83e5288c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:01.901504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b80d43-3bd3-48e4-be3c-ad14a805767a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:01.904600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b80d43-3bd3-48e4-be3c-ad14a805767a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:01.905833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b80d43-3bd3-48e4-be3c-ad14a805767a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:01.906342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b80d43-3bd3-48e4-be3c-ad14a805767a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:01.907736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b80d43-3bd3-48e4-be3c-ad14a805767a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:01.911238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b80d43-3bd3-48e4-be3c-ad14a805767a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:01.915661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de7342-f255-4fc8-bcd3-ab9e2a1d6119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c19a4564b64c69a8e275f041f17d30, user_id=e2121c93b344482da7084fcf83e5288c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:01.918891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de7342-f255-4fc8-bcd3-ab9e2a1d6119 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:01.940097 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3362/6782] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:01.944254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b80d43-3bd3-48e4-be3c-ad14a805767a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:01.963259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b80d43-3bd3-48e4-be3c-ad14a805767a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:01.970243 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3421/6783] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:01 2022] PUT /identity/v3/projects/b3c19a4564b64c69a8e275f041f17d30/users/e2121c93b344482da7084fcf83e5288c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:01.987308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b4bd1-46dd-44aa-b5c4-5eef55198564 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:01.995004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b4bd1-46dd-44aa-b5c4-5eef55198564 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:01.995004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b4bd1-46dd-44aa-b5c4-5eef55198564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:02.053651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-217b4bd1-46dd-44aa-b5c4-5eef55198564 None None] MFA Rules not processed for user `e2121c93b344482da7084fcf83e5288c`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:02.055762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-217b4bd1-46dd-44aa-b5c4-5eef55198564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:02.088005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a135f7-30df-4db1-bd64-85f8b2bbed48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:02.089174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a135f7-30df-4db1-bd64-85f8b2bbed48 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:02.090925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a135f7-30df-4db1-bd64-85f8b2bbed48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:02.090925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a135f7-30df-4db1-bd64-85f8b2bbed48 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:02.090925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a135f7-30df-4db1-bd64-85f8b2bbed48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:02.095654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a135f7-30df-4db1-bd64-85f8b2bbed48 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:02.114498 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3363/6784] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:55:02.120495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a135f7-30df-4db1-bd64-85f8b2bbed48 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:02.136486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a135f7-30df-4db1-bd64-85f8b2bbed48 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:02.142213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686959d-0066-4c6b-9908-f5e8e177560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:02.143265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686959d-0066-4c6b-9908-f5e8e177560c admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:02.143843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686959d-0066-4c6b-9908-f5e8e177560c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:02.144783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686959d-0066-4c6b-9908-f5e8e177560c admin admin] PATH_INFO: `/v3/projects/62de677740544c68aadac4237f327d26/users/11f29014538c49e583bbf2bd8498ab0a/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:02.180374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686959d-0066-4c6b-9908-f5e8e177560c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62de677740544c68aadac4237f327d26, user_id=11f29014538c49e583bbf2bd8498ab0a, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:02.184085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686959d-0066-4c6b-9908-f5e8e177560c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:02.226919 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3422/6785] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:02.229135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b4bd1-46dd-44aa-b5c4-5eef55198564 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:02.246274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b4bd1-46dd-44aa-b5c4-5eef55198564 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:02.255771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9c22c-ac31-4902-93d6-3f7c3eacc9be tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2121c93b344482da7084fcf83e5288c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c19a4564b64c69a8e275f041f17d30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:02.257821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9c22c-ac31-4902-93d6-3f7c3eacc9be tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:02.269419 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3364/6786] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:02 2022] PUT /identity/v3/projects/62de677740544c68aadac4237f327d26/users/11f29014538c49e583bbf2bd8498ab0a/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:55:02.278305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9c22c-ac31-4902-93d6-3f7c3eacc9be tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:02.278682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9c22c-ac31-4902-93d6-3f7c3eacc9be tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] PATH_INFO: `/v3/projects/c1326c90f74c4fe28c2ce95026c3404b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:02.280957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9c22c-ac31-4902-93d6-3f7c3eacc9be tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorizing `identity:get_project(project_id=c1326c90f74c4fe28c2ce95026c3404b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:02.283079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9c22c-ac31-4902-93d6-3f7c3eacc9be tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:02.284835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed9f14-d4e0-4d1b-8e77-45f67cd272bf None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:02.285040 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3423/6787] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:55:02 2022] GET /identity/v3/projects/c1326c90f74c4fe28c2ce95026c3404b => generated 387 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:02.286781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed9f14-d4e0-4d1b-8e77-45f67cd272bf None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:02.287078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed9f14-d4e0-4d1b-8e77-45f67cd272bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:02.289546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9c22c-ac31-4902-93d6-3f7c3eacc9be tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:02.314164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9c22c-ac31-4902-93d6-3f7c3eacc9be tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:02.373032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f3ed9f14-d4e0-4d1b-8e77-45f67cd272bf None None] MFA Rules not processed for user `11f29014538c49e583bbf2bd8498ab0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:02.373032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f3ed9f14-d4e0-4d1b-8e77-45f67cd272bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:02.461178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba6529-8979-42fb-8c03-118edc035bb7 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2121c93b344482da7084fcf83e5288c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c19a4564b64c69a8e275f041f17d30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:02.461833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba6529-8979-42fb-8c03-118edc035bb7 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:02.462117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba6529-8979-42fb-8c03-118edc035bb7 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:02.462396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba6529-8979-42fb-8c03-118edc035bb7 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:02.464323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba6529-8979-42fb-8c03-118edc035bb7 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:02.472335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba6529-8979-42fb-8c03-118edc035bb7 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:02.520529 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3365/6788] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:02.530576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed9f14-d4e0-4d1b-8e77-45f67cd272bf None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:02.623747 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3424/6789] 10.222.0.76 () {60 vars in 1152 bytes} [Sat Aug 27 04:55:02 2022] POST /identity/v3/projects => generated 338 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:02.625636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba6529-8979-42fb-8c03-118edc035bb7 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:02.631609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8bba6529-8979-42fb-8c03-118edc035bb7 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:02.682699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed9f14-d4e0-4d1b-8e77-45f67cd272bf None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:02.791946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dd414-edb8-409b-8532-dec921d6acb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:02.800458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dd414-edb8-409b-8532-dec921d6acb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:02.800458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dd414-edb8-409b-8532-dec921d6acb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:02.800458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dd414-edb8-409b-8532-dec921d6acb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:02.800458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dd414-edb8-409b-8532-dec921d6acb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:02.800458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dd414-edb8-409b-8532-dec921d6acb6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:02.801114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba6529-8979-42fb-8c03-118edc035bb7 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:02.804968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da719a-5f51-4603-82e6-c1f62fa7f8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:02.805749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da719a-5f51-4603-82e6-c1f62fa7f8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:02.806032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da719a-5f51-4603-82e6-c1f62fa7f8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:02.806308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da719a-5f51-4603-82e6-c1f62fa7f8c4 admin admin] PATH_INFO: `/v3/projects/997959007c0449eba561015b0a86a394` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:02.812684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da719a-5f51-4603-82e6-c1f62fa7f8c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=997959007c0449eba561015b0a86a394)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:02.815188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da719a-5f51-4603-82e6-c1f62fa7f8c4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:03.006721 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3366/6790] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:02 2022] POST /identity/v3/projects => generated 387 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:03.008967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dd414-edb8-409b-8532-dec921d6acb6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:03.051600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-09da719a-5f51-4603-82e6-c1f62fa7f8c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '997959007c0449eba561015b0a86a394', 'request_id': 'req-09da719a-5f51-4603-82e6-c1f62fa7f8c4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:03.062881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-09da719a-5f51-4603-82e6-c1f62fa7f8c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '997959007c0449eba561015b0a86a394', 'request_id': 'req-09da719a-5f51-4603-82e6-c1f62fa7f8c4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:03.120865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dd414-edb8-409b-8532-dec921d6acb6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:03.157065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-09da719a-5f51-4603-82e6-c1f62fa7f8c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '997959007c0449eba561015b0a86a394', 'request_id': 'req-09da719a-5f51-4603-82e6-c1f62fa7f8c4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:03.188332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-09da719a-5f51-4603-82e6-c1f62fa7f8c4 admin admin] The token cache is being invalidate because project 997959007c0449eba561015b0a86a394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:03.188636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-09da719a-5f51-4603-82e6-c1f62fa7f8c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:03.196735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-09da719a-5f51-4603-82e6-c1f62fa7f8c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:03.201085 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3425/6791] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:02 2022] DELETE /identity/v3/projects/997959007c0449eba561015b0a86a394 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:03.206444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da719a-5f51-4603-82e6-c1f62fa7f8c4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:03.208304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-09da719a-5f51-4603-82e6-c1f62fa7f8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:03.246732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1dd60-2946-4631-8a0d-eadacca64a0c tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2121c93b344482da7084fcf83e5288c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c19a4564b64c69a8e275f041f17d30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:03.247329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1dd60-2946-4631-8a0d-eadacca64a0c tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:03.247774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1dd60-2946-4631-8a0d-eadacca64a0c tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:03.248066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1dd60-2946-4631-8a0d-eadacca64a0c tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:03.249058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1dd60-2946-4631-8a0d-eadacca64a0c tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:03.253276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1dd60-2946-4631-8a0d-eadacca64a0c tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:03.305222 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3367/6792] 10.222.0.76 () {58 vars in 1131 bytes} [Sat Aug 27 04:55:03 2022] GET /identity/v3/projects => generated 6938 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:03.306530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1dd60-2946-4631-8a0d-eadacca64a0c tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:03.309479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8dc1dd60-2946-4631-8a0d-eadacca64a0c tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:03.319362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da719a-5f51-4603-82e6-c1f62fa7f8c4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:03.319362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac2047-3dce-400a-9882-86789942ad9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:03.319362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac2047-3dce-400a-9882-86789942ad9b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:03.319362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac2047-3dce-400a-9882-86789942ad9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:03.319822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac2047-3dce-400a-9882-86789942ad9b admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:03.320554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac2047-3dce-400a-9882-86789942ad9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:03.322999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac2047-3dce-400a-9882-86789942ad9b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:03.329653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1dd60-2946-4631-8a0d-eadacca64a0c tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:03.335570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:03.336432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:03.336786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:03.337131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9 admin admin] PATH_INFO: `/v3/projects/5487d3e115904527858abc7be7714782` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:03.338781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5487d3e115904527858abc7be7714782)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:03.340841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:03.447783 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3426/6793] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:03 2022] POST /identity/v3/users => generated 300 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:03.449775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f52c9-747a-46a1-a1e1-2f6208dd1f98 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:03.450248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f52c9-747a-46a1-a1e1-2f6208dd1f98 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:03.450699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f52c9-747a-46a1-a1e1-2f6208dd1f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:03.497498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a74f52c9-747a-46a1-a1e1-2f6208dd1f98 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:03.498988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a74f52c9-747a-46a1-a1e1-2f6208dd1f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:03.507901 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3427/6794] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:03.508933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f52c9-747a-46a1-a1e1-2f6208dd1f98 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:03.517580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a74f52c9-747a-46a1-a1e1-2f6208dd1f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:03.534534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f52c9-747a-46a1-a1e1-2f6208dd1f98 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:03.541851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab456ab-8b93-46a6-ae07-74d0ea720de0 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2121c93b344482da7084fcf83e5288c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c19a4564b64c69a8e275f041f17d30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:03.542689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab456ab-8b93-46a6-ae07-74d0ea720de0 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:03.543261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab456ab-8b93-46a6-ae07-74d0ea720de0 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:03.548936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab456ab-8b93-46a6-ae07-74d0ea720de0 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] PATH_INFO: `/v3/projects/c1326c90f74c4fe28c2ce95026c3404b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:03.548936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab456ab-8b93-46a6-ae07-74d0ea720de0 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorizing `identity:get_project(project_id=c1326c90f74c4fe28c2ce95026c3404b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:03.548936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab456ab-8b93-46a6-ae07-74d0ea720de0 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:03.551776 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3428/6795] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:55:03 2022] GET /identity/v3/projects/c1326c90f74c4fe28c2ce95026c3404b => generated 387 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:03.552785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab456ab-8b93-46a6-ae07-74d0ea720de0 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:03.567486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5487d3e115904527858abc7be7714782', 'request_id': 'req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:03.570755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab456ab-8b93-46a6-ae07-74d0ea720de0 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:03.574189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5487d3e115904527858abc7be7714782', 'request_id': 'req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:03.590423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5487d3e115904527858abc7be7714782', 'request_id': 'req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:03.660635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f882f-cb37-41bc-a170-2eb11cc2b833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:03.661351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f882f-cb37-41bc-a170-2eb11cc2b833 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:03.661710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f882f-cb37-41bc-a170-2eb11cc2b833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:03.662159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f882f-cb37-41bc-a170-2eb11cc2b833 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:03.662888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f882f-cb37-41bc-a170-2eb11cc2b833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:03.665329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f882f-cb37-41bc-a170-2eb11cc2b833 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:03.684995 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3429/6796] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:03.687885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2419590-d2e3-4ae5-85f5-7a3c9b647a49 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:03.691552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2419590-d2e3-4ae5-85f5-7a3c9b647a49 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:03.691886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2419590-d2e3-4ae5-85f5-7a3c9b647a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:03.710462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9 admin admin] The token cache is being invalidate because project 5487d3e115904527858abc7be7714782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:03.711353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:03.712046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:03.718554 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3368/6797] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:03 2022] DELETE /identity/v3/projects/5487d3e115904527858abc7be7714782 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:03.718554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:03.718963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a2419590-d2e3-4ae5-85f5-7a3c9b647a49 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:03.719073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:03.719970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a2419590-d2e3-4ae5-85f5-7a3c9b647a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:03.732673 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3430/6798] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:03.733590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2419590-d2e3-4ae5-85f5-7a3c9b647a49 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:03.735102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a2419590-d2e3-4ae5-85f5-7a3c9b647a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:03.768436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2419590-d2e3-4ae5-85f5-7a3c9b647a49 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:03.792762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cdd89-c71f-463b-84c0-c641afd21e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:03.793468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cdd89-c71f-463b-84c0-c641afd21e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:03.793753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cdd89-c71f-463b-84c0-c641afd21e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:03.794028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cdd89-c71f-463b-84c0-c641afd21e6c admin admin] PATH_INFO: `/v3/projects/a83f041268e44ce1986a408559bacf56/users/cb78c7de04e0493e850b1267d98622a7/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:03.830474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbf3e2-bac0-4acc-839d-4a68b6279fc9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:03.838446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cdd89-c71f-463b-84c0-c641afd21e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83f041268e44ce1986a408559bacf56, user_id=cb78c7de04e0493e850b1267d98622a7, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:03.838835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cedeae-2d46-496d-9aa7-2b227e93e038 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2121c93b344482da7084fcf83e5288c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c19a4564b64c69a8e275f041f17d30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:03.839593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cedeae-2d46-496d-9aa7-2b227e93e038 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:03.840353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cedeae-2d46-496d-9aa7-2b227e93e038 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:03.840353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cedeae-2d46-496d-9aa7-2b227e93e038 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] PATH_INFO: `/v3/projects/5b97d21fbe7d4979bacc61cf190c8bbd` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:03.842487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cedeae-2d46-496d-9aa7-2b227e93e038 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b97d21fbe7d4979bacc61cf190c8bbd)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:03.847919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cedeae-2d46-496d-9aa7-2b227e93e038 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:03.847919 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3369/6799] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:55:03 2022] GET /identity/v3/projects/5b97d21fbe7d4979bacc61cf190c8bbd => generated 338 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:03.848398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e8fdf-2d04-4687-8d11-37b7bb5bb729 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:03.850696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e8fdf-2d04-4687-8d11-37b7bb5bb729 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:03.850989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e8fdf-2d04-4687-8d11-37b7bb5bb729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:03.851688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cdd89-c71f-463b-84c0-c641afd21e6c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:03.891829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ae1e8fdf-2d04-4687-8d11-37b7bb5bb729 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:03.893020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ae1e8fdf-2d04-4687-8d11-37b7bb5bb729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:03.910646 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3370/6800] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:03.910646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e8fdf-2d04-4687-8d11-37b7bb5bb729 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:03.919389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e8fdf-2d04-4687-8d11-37b7bb5bb729 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:03.948251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e39059-1315-43a1-a5c4-d23659dc22d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:03.949087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e39059-1315-43a1-a5c4-d23659dc22d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:03.949468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e39059-1315-43a1-a5c4-d23659dc22d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:03.949842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e39059-1315-43a1-a5c4-d23659dc22d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:03.950619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e39059-1315-43a1-a5c4-d23659dc22d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:03.951585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e39059-1315-43a1-a5c4-d23659dc22d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:03.953622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e39059-1315-43a1-a5c4-d23659dc22d1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:03.980274 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3371/6801] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:03.981291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e39059-1315-43a1-a5c4-d23659dc22d1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:03.994932 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3431/6802] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:03 2022] PUT /identity/v3/projects/a83f041268e44ce1986a408559bacf56/users/cb78c7de04e0493e850b1267d98622a7/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:03.996587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e39059-1315-43a1-a5c4-d23659dc22d1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:04.000739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b270e74-3679-494c-8aa6-faa1be8b2ab4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:04.005739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b270e74-3679-494c-8aa6-faa1be8b2ab4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:04.005739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b270e74-3679-494c-8aa6-faa1be8b2ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:04.051889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1b270e74-3679-494c-8aa6-faa1be8b2ab4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:04.053440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1b270e74-3679-494c-8aa6-faa1be8b2ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:04.117482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54724d0c-de6c-4d0d-93e1-bb593ee0c01e tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2121c93b344482da7084fcf83e5288c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c19a4564b64c69a8e275f041f17d30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:04.118111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54724d0c-de6c-4d0d-93e1-bb593ee0c01e tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:04.118398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54724d0c-de6c-4d0d-93e1-bb593ee0c01e tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:04.118677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54724d0c-de6c-4d0d-93e1-bb593ee0c01e tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:04.121554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54724d0c-de6c-4d0d-93e1-bb593ee0c01e tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:04.124584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54724d0c-de6c-4d0d-93e1-bb593ee0c01e tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:04.162515 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3432/6803] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:04.167187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b270e74-3679-494c-8aa6-faa1be8b2ab4 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:04.172322 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3372/6804] 10.222.0.76 () {58 vars in 1131 bytes} [Sat Aug 27 04:55:03 2022] GET /identity/v3/projects => generated 6553 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:04.180865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54724d0c-de6c-4d0d-93e1-bb593ee0c01e tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:04.182591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b270e74-3679-494c-8aa6-faa1be8b2ab4 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:04.189983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc43f19-1d08-4572-9fbd-39ebd12d67e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:04.190682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54724d0c-de6c-4d0d-93e1-bb593ee0c01e tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:04.190951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43f19-1d08-4572-9fbd-39ebd12d67e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:04.191361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43f19-1d08-4572-9fbd-39ebd12d67e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:04.191843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43f19-1d08-4572-9fbd-39ebd12d67e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:04.192692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc43f19-1d08-4572-9fbd-39ebd12d67e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:04.196008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc43f19-1d08-4572-9fbd-39ebd12d67e0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:04.198125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d74062-5050-4f9e-a5f7-84156df4f2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:04.198987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d74062-5050-4f9e-a5f7-84156df4f2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:04.199509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d74062-5050-4f9e-a5f7-84156df4f2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:04.199974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d74062-5050-4f9e-a5f7-84156df4f2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:04.201358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d74062-5050-4f9e-a5f7-84156df4f2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:04.203951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d74062-5050-4f9e-a5f7-84156df4f2e5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:04.220893 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3373/6805] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:04.222108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d74062-5050-4f9e-a5f7-84156df4f2e5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:04.234060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d74062-5050-4f9e-a5f7-84156df4f2e5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:04.239166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0f402-6c5a-4b97-832c-d1407ca9c797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:04.239900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0f402-6c5a-4b97-832c-d1407ca9c797 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:04.240275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0f402-6c5a-4b97-832c-d1407ca9c797 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:04.240620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0f402-6c5a-4b97-832c-d1407ca9c797 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:04.241598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0f402-6c5a-4b97-832c-d1407ca9c797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:04.241778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0f402-6c5a-4b97-832c-d1407ca9c797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:04.243525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0f402-6c5a-4b97-832c-d1407ca9c797 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:04.264060 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3374/6806] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:04.264060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0f402-6c5a-4b97-832c-d1407ca9c797 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:04.278531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0f402-6c5a-4b97-832c-d1407ca9c797 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:04.285296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ab3b3-167f-4d30-93ff-eb18a3e54287 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2121c93b344482da7084fcf83e5288c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c19a4564b64c69a8e275f041f17d30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:04.286001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ab3b3-167f-4d30-93ff-eb18a3e54287 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:04.286295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ab3b3-167f-4d30-93ff-eb18a3e54287 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:04.304449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ab3b3-167f-4d30-93ff-eb18a3e54287 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:04.304449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ab3b3-167f-4d30-93ff-eb18a3e54287 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:04.304449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ab3b3-167f-4d30-93ff-eb18a3e54287 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:04.304449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ab3b3-167f-4d30-93ff-eb18a3e54287 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:04.320293 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3375/6807] 10.222.0.76 () {58 vars in 1166 bytes} [Sat Aug 27 04:55:04 2022] GET /identity/v3/projects?domain_id=default => generated 6222 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:04.329567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ab3b3-167f-4d30-93ff-eb18a3e54287 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:04.348130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ab3b3-167f-4d30-93ff-eb18a3e54287 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:04.348675 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3433/6808] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:04 2022] POST /identity/v3/projects => generated 375 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:04.350111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc43f19-1d08-4572-9fbd-39ebd12d67e0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:04.465087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:04.471900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8c2e5-a856-47a9-ace0-770bd77cdd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:04.474271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc43f19-1d08-4572-9fbd-39ebd12d67e0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:04.474392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c2e5-a856-47a9-ace0-770bd77cdd69 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:04.474392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c2e5-a856-47a9-ace0-770bd77cdd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:04.474889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c2e5-a856-47a9-ace0-770bd77cdd69 admin admin] PATH_INFO: `/v3/projects/a83f041268e44ce1986a408559bacf56/users/cb78c7de04e0493e850b1267d98622a7/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:04.479941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8c2e5-a856-47a9-ace0-770bd77cdd69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83f041268e44ce1986a408559bacf56, user_id=cb78c7de04e0493e850b1267d98622a7, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:04.485692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd897208-0255-4e6b-9dd8-012869bb5f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:04.487795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8c2e5-a856-47a9-ace0-770bd77cdd69 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:04.488581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd897208-0255-4e6b-9dd8-012869bb5f90 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:04.488940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd897208-0255-4e6b-9dd8-012869bb5f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:04.489322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd897208-0255-4e6b-9dd8-012869bb5f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:04.490263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd897208-0255-4e6b-9dd8-012869bb5f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:04.493443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd897208-0255-4e6b-9dd8-012869bb5f90 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:04.514692 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3376/6809] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:04 2022] PUT /identity/v3/projects/a83f041268e44ce1986a408559bacf56/users/cb78c7de04e0493e850b1267d98622a7/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:04.517495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8c2e5-a856-47a9-ace0-770bd77cdd69 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:04.643585 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3434/6810] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:04 2022] POST /identity/v3/projects => generated 389 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:04.646463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd897208-0255-4e6b-9dd8-012869bb5f90 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:04.657633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:04.705123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8c2e5-a856-47a9-ace0-770bd77cdd69 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:04.792257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd897208-0255-4e6b-9dd8-012869bb5f90 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:04.795731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b344f-829a-4c3a-ad49-46b0bc2f8597 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2121c93b344482da7084fcf83e5288c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c19a4564b64c69a8e275f041f17d30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:04.796509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b344f-829a-4c3a-ad49-46b0bc2f8597 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:04.796898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b344f-829a-4c3a-ad49-46b0bc2f8597 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:04.797881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b344f-829a-4c3a-ad49-46b0bc2f8597 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:04.798653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b344f-829a-4c3a-ad49-46b0bc2f8597 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:04.799737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78b297-d519-432b-9506-5a0e35fd2b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:04.834597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78b297-d519-432b-9506-5a0e35fd2b0c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:04.834961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b344f-829a-4c3a-ad49-46b0bc2f8597 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:04.835394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78b297-d519-432b-9506-5a0e35fd2b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:04.835394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78b297-d519-432b-9506-5a0e35fd2b0c admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:04.835394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78b297-d519-432b-9506-5a0e35fd2b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:04.835394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78b297-d519-432b-9506-5a0e35fd2b0c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:04.835683 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3377/6811] 10.222.0.76 () {58 vars in 1131 bytes} [Sat Aug 27 04:55:04 2022] GET /identity/v3/projects => generated 7293 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:04.835683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451414b6-68ad-4ad7-8f50-c5d984e7aecf None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:04.835683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451414b6-68ad-4ad7-8f50-c5d984e7aecf None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:04.835683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451414b6-68ad-4ad7-8f50-c5d984e7aecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:04.856024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-451414b6-68ad-4ad7-8f50-c5d984e7aecf None None] MFA Rules not processed for user `cb78c7de04e0493e850b1267d98622a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:04.858591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-451414b6-68ad-4ad7-8f50-c5d984e7aecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:04.951972 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3378/6812] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:04.951972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451414b6-68ad-4ad7-8f50-c5d984e7aecf None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:04.972527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451414b6-68ad-4ad7-8f50-c5d984e7aecf None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:04.977849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcca592-786a-450b-b9ba-dac7607ac238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:04.978467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcca592-786a-450b-b9ba-dac7607ac238 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:04.979035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcca592-786a-450b-b9ba-dac7607ac238 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:04.979035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcca592-786a-450b-b9ba-dac7607ac238 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:04.979665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcca592-786a-450b-b9ba-dac7607ac238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:04.982384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcca592-786a-450b-b9ba-dac7607ac238 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:05.061831 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3435/6813] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:04 2022] POST /identity/v3/users => generated 288 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:05.061831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78b297-d519-432b-9506-5a0e35fd2b0c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:05.074555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78b297-d519-432b-9506-5a0e35fd2b0c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:05.080408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d61427-61c4-437f-8482-6cdbfb1b7499 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2121c93b344482da7084fcf83e5288c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c19a4564b64c69a8e275f041f17d30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:05.081457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61427-61c4-437f-8482-6cdbfb1b7499 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:05.081457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61427-61c4-437f-8482-6cdbfb1b7499 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:05.081655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61427-61c4-437f-8482-6cdbfb1b7499 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:05.082562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d61427-61c4-437f-8482-6cdbfb1b7499 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:05.082864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d61427-61c4-437f-8482-6cdbfb1b7499 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:05.084768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d61427-61c4-437f-8482-6cdbfb1b7499 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:05.109523 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3379/6814] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:04 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:05.111395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcca592-786a-450b-b9ba-dac7607ac238 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:05.113514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0bcca592-786a-450b-b9ba-dac7607ac238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:05.114025 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3436/6815] 10.222.0.76 () {58 vars in 1166 bytes} [Sat Aug 27 04:55:05 2022] GET /identity/v3/projects?domain_id=default => generated 6962 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:05.120244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d61427-61c4-437f-8482-6cdbfb1b7499 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:05.134956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d61427-61c4-437f-8482-6cdbfb1b7499 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:05.141879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c12c97-5734-4512-9503-997eb860fd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:05.142497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c12c97-5734-4512-9503-997eb860fd68 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:05.143026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c12c97-5734-4512-9503-997eb860fd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:05.143351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c12c97-5734-4512-9503-997eb860fd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:05.144006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c12c97-5734-4512-9503-997eb860fd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:05.145726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c12c97-5734-4512-9503-997eb860fd68 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:05.165879 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3437/6816] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:05.165879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c12c97-5734-4512-9503-997eb860fd68 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:05.191387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c12c97-5734-4512-9503-997eb860fd68 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:05.218500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce75428-29cf-4139-9929-c90824c4fea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:05.219754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce75428-29cf-4139-9929-c90824c4fea3 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:05.219754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce75428-29cf-4139-9929-c90824c4fea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:05.220044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce75428-29cf-4139-9929-c90824c4fea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:05.220741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce75428-29cf-4139-9929-c90824c4fea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:05.222406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce75428-29cf-4139-9929-c90824c4fea3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:05.236883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcca592-786a-450b-b9ba-dac7607ac238 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:05.242081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598a2f4-542c-4c15-8c9e-be9b904db94d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:05.243046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598a2f4-542c-4c15-8c9e-be9b904db94d service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:05.243498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598a2f4-542c-4c15-8c9e-be9b904db94d service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:05.243941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598a2f4-542c-4c15-8c9e-be9b904db94d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:05.253435 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3438/6817] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:05.254334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce75428-29cf-4139-9929-c90824c4fea3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:05.259592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598a2f4-542c-4c15-8c9e-be9b904db94d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:05.271185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598a2f4-542c-4c15-8c9e-be9b904db94d service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:05.282704 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3380/6818] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:55:05.283834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce75428-29cf-4139-9929-c90824c4fea3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:05.285119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598a2f4-542c-4c15-8c9e-be9b904db94d service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:05.289364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2273692-4d9a-4941-adaa-8d1d6ed4a18e tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2121c93b344482da7084fcf83e5288c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c19a4564b64c69a8e275f041f17d30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:05.290111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2273692-4d9a-4941-adaa-8d1d6ed4a18e tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:05.290257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2273692-4d9a-4941-adaa-8d1d6ed4a18e tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:05.290541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2273692-4d9a-4941-adaa-8d1d6ed4a18e tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:05.291194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2273692-4d9a-4941-adaa-8d1d6ed4a18e tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:05.293765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2273692-4d9a-4941-adaa-8d1d6ed4a18e tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:05.301946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598a2f4-542c-4c15-8c9e-be9b904db94d service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:05.317258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba41db-9a6d-4397-9aac-d92ffde18a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:05.317258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba41db-9a6d-4397-9aac-d92ffde18a6d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:05.317258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba41db-9a6d-4397-9aac-d92ffde18a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:05.318704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba41db-9a6d-4397-9aac-d92ffde18a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:05.319578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba41db-9a6d-4397-9aac-d92ffde18a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:05.322349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba41db-9a6d-4397-9aac-d92ffde18a6d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:05.336218 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3381/6819] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:05.337405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba41db-9a6d-4397-9aac-d92ffde18a6d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:05.354892 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3439/6820] 10.222.0.76 () {58 vars in 1131 bytes} [Sat Aug 27 04:55:05 2022] GET /identity/v3/projects => generated 7293 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:05.354892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2273692-4d9a-4941-adaa-8d1d6ed4a18e tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:05.355283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba41db-9a6d-4397-9aac-d92ffde18a6d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:05.360545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de897a4a-5066-4d74-a7dc-cbb5bf76b965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:05.360545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de897a4a-5066-4d74-a7dc-cbb5bf76b965 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:05.360941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de897a4a-5066-4d74-a7dc-cbb5bf76b965 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:05.361654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de897a4a-5066-4d74-a7dc-cbb5bf76b965 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:05.363236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de897a4a-5066-4d74-a7dc-cbb5bf76b965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:05.365255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de897a4a-5066-4d74-a7dc-cbb5bf76b965 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:05.383578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2273692-4d9a-4941-adaa-8d1d6ed4a18e tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:05.387429 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3382/6821] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:05.389450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de897a4a-5066-4d74-a7dc-cbb5bf76b965 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:05.409510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802b2ac-b482-4c8d-b621-0c8b94d3cdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:05.409510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802b2ac-b482-4c8d-b621-0c8b94d3cdec admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:05.409510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802b2ac-b482-4c8d-b621-0c8b94d3cdec admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:05.409510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802b2ac-b482-4c8d-b621-0c8b94d3cdec admin admin] PATH_INFO: `/v3/projects/34704adbdbc044248d6e89f886ff0a96/users/c7f52723046648968236d786781d2f5b/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:05.409811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de897a4a-5066-4d74-a7dc-cbb5bf76b965 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:05.412839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d543381-e1b9-4334-9503-e31bc27c9076 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2121c93b344482da7084fcf83e5288c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c19a4564b64c69a8e275f041f17d30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:05.413608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d543381-e1b9-4334-9503-e31bc27c9076 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:05.414078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d543381-e1b9-4334-9503-e31bc27c9076 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:05.414533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d543381-e1b9-4334-9503-e31bc27c9076 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:05.415319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d543381-e1b9-4334-9503-e31bc27c9076 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-514165629) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:05.415730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d543381-e1b9-4334-9503-e31bc27c9076 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:05.418371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d543381-e1b9-4334-9503-e31bc27c9076 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:05.436599 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3383/6822] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:55:05 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-514165629 => generated 534 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:05.437714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d543381-e1b9-4334-9503-e31bc27c9076 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:05.447825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802b2ac-b482-4c8d-b621-0c8b94d3cdec admin admin] RBAC: Authorizing `identity:create_grant(project_id=34704adbdbc044248d6e89f886ff0a96, user_id=c7f52723046648968236d786781d2f5b, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:05.450847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802b2ac-b482-4c8d-b621-0c8b94d3cdec admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:05.451586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d543381-e1b9-4334-9503-e31bc27c9076 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:05.459370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f95099-9477-4a66-9ddb-eb8133501d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:05.461126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f95099-9477-4a66-9ddb-eb8133501d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:05.467098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f95099-9477-4a66-9ddb-eb8133501d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:05.467733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f95099-9477-4a66-9ddb-eb8133501d23 admin admin] PATH_INFO: `/v3/projects/7aea786a98fb4d128403534dc8742871/users/b301a29d89864d6ba56c1ff7011fd1ca/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:05.492710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f95099-9477-4a66-9ddb-eb8133501d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aea786a98fb4d128403534dc8742871, user_id=b301a29d89864d6ba56c1ff7011fd1ca, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:05.498382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f95099-9477-4a66-9ddb-eb8133501d23 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:05.610451 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3440/6823] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:05 2022] PUT /identity/v3/projects/34704adbdbc044248d6e89f886ff0a96/users/c7f52723046648968236d786781d2f5b/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:05.624920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802b2ac-b482-4c8d-b621-0c8b94d3cdec admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:05.681811 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3384/6824] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:05 2022] PUT /identity/v3/projects/7aea786a98fb4d128403534dc8742871/users/b301a29d89864d6ba56c1ff7011fd1ca/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:05.681811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eb9a1-6b2f-4c1f-b793-725842d511f0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:05.681811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eb9a1-6b2f-4c1f-b793-725842d511f0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:05.681811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eb9a1-6b2f-4c1f-b793-725842d511f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:05.761696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802b2ac-b482-4c8d-b621-0c8b94d3cdec admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:05.803490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-472eb9a1-6b2f-4c1f-b793-725842d511f0 None None] MFA Rules not processed for user `c7f52723046648968236d786781d2f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:05.807025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-472eb9a1-6b2f-4c1f-b793-725842d511f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:05.847808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae62ad6-4b6f-41df-968c-81072810ad16 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2121c93b344482da7084fcf83e5288c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c19a4564b64c69a8e275f041f17d30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:05.848870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae62ad6-4b6f-41df-968c-81072810ad16 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:05.850028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae62ad6-4b6f-41df-968c-81072810ad16 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:05.850028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae62ad6-4b6f-41df-968c-81072810ad16 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] PATH_INFO: `/v3/projects/5b97d21fbe7d4979bacc61cf190c8bbd` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:05.851374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae62ad6-4b6f-41df-968c-81072810ad16 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5b97d21fbe7d4979bacc61cf190c8bbd)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:05.853853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae62ad6-4b6f-41df-968c-81072810ad16 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:05.981448 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3385/6825] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:05.983491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f0480-b4f0-417f-8f46-00b9b6948bb3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:05.984405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f0480-b4f0-417f-8f46-00b9b6948bb3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:05.985195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f0480-b4f0-417f-8f46-00b9b6948bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:06.032496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9f5f0480-b4f0-417f-8f46-00b9b6948bb3 None None] MFA Rules not processed for user `b301a29d89864d6ba56c1ff7011fd1ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:06.061077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9f5f0480-b4f0-417f-8f46-00b9b6948bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:06.095073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cae62ad6-4b6f-41df-968c-81072810ad16 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b97d21fbe7d4979bacc61cf190c8bbd', 'request_id': 'req-cae62ad6-4b6f-41df-968c-81072810ad16'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:06.114063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cae62ad6-4b6f-41df-968c-81072810ad16 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b97d21fbe7d4979bacc61cf190c8bbd', 'request_id': 'req-cae62ad6-4b6f-41df-968c-81072810ad16'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:06.206113 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3386/6826] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:06.209905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f0480-b4f0-417f-8f46-00b9b6948bb3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:06.303191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f0480-b4f0-417f-8f46-00b9b6948bb3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:06.307618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5259ad6-40c4-42ee-9964-ae0ab796cf67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:06.309744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cae62ad6-4b6f-41df-968c-81072810ad16 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b97d21fbe7d4979bacc61cf190c8bbd', 'request_id': 'req-cae62ad6-4b6f-41df-968c-81072810ad16'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:06.322535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5259ad6-40c4-42ee-9964-ae0ab796cf67 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:06.324272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5259ad6-40c4-42ee-9964-ae0ab796cf67 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:06.324926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5259ad6-40c4-42ee-9964-ae0ab796cf67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:06.334859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cae62ad6-4b6f-41df-968c-81072810ad16 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] The token cache is being invalidate because project 5b97d21fbe7d4979bacc61cf190c8bbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:06.335155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cae62ad6-4b6f-41df-968c-81072810ad16 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:06.337390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cae62ad6-4b6f-41df-968c-81072810ad16 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:06.342620 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3441/6827] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:05 2022] DELETE /identity/v3/projects/5b97d21fbe7d4979bacc61cf190c8bbd => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:06.343938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae62ad6-4b6f-41df-968c-81072810ad16 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:06.349623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cae62ad6-4b6f-41df-968c-81072810ad16 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:06.465676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5259ad6-40c4-42ee-9964-ae0ab796cf67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:06.470379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5259ad6-40c4-42ee-9964-ae0ab796cf67 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:06.492863 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3387/6828] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:55:06.493772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5259ad6-40c4-42ee-9964-ae0ab796cf67 service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:06.495541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d5259ad6-40c4-42ee-9964-ae0ab796cf67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:06.532398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae62ad6-4b6f-41df-968c-81072810ad16 tempest-ListProjectsStaticTestJSON-213920753 tempest-ListProjectsStaticTestJSON-213920753-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:06.542797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a3515-c110-4014-8c25-0d1ac0447d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:06.543540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a3515-c110-4014-8c25-0d1ac0447d7b service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:06.543890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a3515-c110-4014-8c25-0d1ac0447d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:06.546124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a3515-c110-4014-8c25-0d1ac0447d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:06.551186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2d2a3515-c110-4014-8c25-0d1ac0447d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:06.565721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a3515-c110-4014-8c25-0d1ac0447d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:06.567450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a3515-c110-4014-8c25-0d1ac0447d7b service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:06.584090 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3442/6829] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:55:06.584090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a3515-c110-4014-8c25-0d1ac0447d7b service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:06.584090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2d2a3515-c110-4014-8c25-0d1ac0447d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:06.678652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5259ad6-40c4-42ee-9964-ae0ab796cf67 service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:06.684765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cf78c-fa85-4931-ae39-9dc9ad7770f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:06.687143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cf78c-fa85-4931-ae39-9dc9ad7770f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:06.688535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cf78c-fa85-4931-ae39-9dc9ad7770f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:06.689095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cf78c-fa85-4931-ae39-9dc9ad7770f3 admin admin] PATH_INFO: `/v3/users/ec72d8f9aac34ed29ba671d0115b556e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:06.691582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cf78c-fa85-4931-ae39-9dc9ad7770f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec72d8f9aac34ed29ba671d0115b556e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:06.694170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cf78c-fa85-4931-ae39-9dc9ad7770f3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:06.750867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:06.757652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a3515-c110-4014-8c25-0d1ac0447d7b service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:06.775152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce07bc-bddf-4170-99e3-b240d2cbb3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:06.776652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce07bc-bddf-4170-99e3-b240d2cbb3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:06.777104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce07bc-bddf-4170-99e3-b240d2cbb3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:06.777799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce07bc-bddf-4170-99e3-b240d2cbb3ab admin admin] PATH_INFO: `/v3/users/0ff47b155ab94250a048a71ff558b773` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:06.782132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce07bc-bddf-4170-99e3-b240d2cbb3ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff47b155ab94250a048a71ff558b773)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:06.786912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce07bc-bddf-4170-99e3-b240d2cbb3ab admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:07.104724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-488cf78c-fa85-4931-ae39-9dc9ad7770f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec72d8f9aac34ed29ba671d0115b556e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:07.190489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-488cf78c-fa85-4931-ae39-9dc9ad7770f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec72d8f9aac34ed29ba671d0115b556e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:07.191260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-488cf78c-fa85-4931-ae39-9dc9ad7770f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec72d8f9aac34ed29ba671d0115b556e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:07.203160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-488cf78c-fa85-4931-ae39-9dc9ad7770f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec72d8f9aac34ed29ba671d0115b556e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:07.215384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-75ce07bc-bddf-4170-99e3-b240d2cbb3ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff47b155ab94250a048a71ff558b773'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:07.216195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-75ce07bc-bddf-4170-99e3-b240d2cbb3ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff47b155ab94250a048a71ff558b773'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:07.231689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-488cf78c-fa85-4931-ae39-9dc9ad7770f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec72d8f9aac34ed29ba671d0115b556e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:07.243382 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3388/6830] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:06 2022] DELETE /identity/v3/users/ec72d8f9aac34ed29ba671d0115b556e => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:07.245523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538e330-45ec-4126-a6f9-cd221acc43b5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:07.246197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538e330-45ec-4126-a6f9-cd221acc43b5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:07.246579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538e330-45ec-4126-a6f9-cd221acc43b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:07.277974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c538e330-45ec-4126-a6f9-cd221acc43b5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:07.278487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c538e330-45ec-4126-a6f9-cd221acc43b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:07.361057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-75ce07bc-bddf-4170-99e3-b240d2cbb3ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff47b155ab94250a048a71ff558b773'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:07.362525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-75ce07bc-bddf-4170-99e3-b240d2cbb3ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff47b155ab94250a048a71ff558b773'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:07.378257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-75ce07bc-bddf-4170-99e3-b240d2cbb3ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff47b155ab94250a048a71ff558b773'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:07.381367 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3389/6831] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:07.398989 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3443/6832] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:06 2022] DELETE /identity/v3/users/0ff47b155ab94250a048a71ff558b773 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:07.402216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe849a-0809-4ffd-a77c-ce87e66f96f1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:07.403653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe849a-0809-4ffd-a77c-ce87e66f96f1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:07.403653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe849a-0809-4ffd-a77c-ce87e66f96f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:07.449695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-cbbe849a-0809-4ffd-a77c-ce87e66f96f1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:07.453799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cbbe849a-0809-4ffd-a77c-ce87e66f96f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:07.485779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce07bc-bddf-4170-99e3-b240d2cbb3ab admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:07.487386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-75ce07bc-bddf-4170-99e3-b240d2cbb3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:07.596505 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3390/6833] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:07.672966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce07bc-bddf-4170-99e3-b240d2cbb3ab admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:07.703833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe849a-0809-4ffd-a77c-ce87e66f96f1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:07.705808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64c12b-32fc-4809-89ec-8ab60e6cd3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:07.706573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64c12b-32fc-4809-89ec-8ab60e6cd3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:07.706940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64c12b-32fc-4809-89ec-8ab60e6cd3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:07.709089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64c12b-32fc-4809-89ec-8ab60e6cd3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:07.726733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe849a-0809-4ffd-a77c-ce87e66f96f1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:07.739621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedc4f6-d5e4-4db7-a913-02ecca5a71a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:07.741870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedc4f6-d5e4-4db7-a913-02ecca5a71a2 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:07.742158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedc4f6-d5e4-4db7-a913-02ecca5a71a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:07.742429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedc4f6-d5e4-4db7-a913-02ecca5a71a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:07.742855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64c12b-32fc-4809-89ec-8ab60e6cd3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:07.745476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64c12b-32fc-4809-89ec-8ab60e6cd3b9 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:07.762003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedc4f6-d5e4-4db7-a913-02ecca5a71a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:07.764039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedc4f6-d5e4-4db7-a913-02ecca5a71a2 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:07.775554 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3444/6834] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:55:07.782377 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3391/6835] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:55:07.830253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64c12b-32fc-4809-89ec-8ab60e6cd3b9 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:07.831904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1c64c12b-32fc-4809-89ec-8ab60e6cd3b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:07.867693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64c12b-32fc-4809-89ec-8ab60e6cd3b9 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:07.907727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3a464-f65a-4a94-b7db-2cd6fa19ecd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:07.908817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3a464-f65a-4a94-b7db-2cd6fa19ecd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:07.909129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3a464-f65a-4a94-b7db-2cd6fa19ecd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:07.909399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3a464-f65a-4a94-b7db-2cd6fa19ecd5 admin admin] PATH_INFO: `/v3/users/11f29014538c49e583bbf2bd8498ab0a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:07.915491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3a464-f65a-4a94-b7db-2cd6fa19ecd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11f29014538c49e583bbf2bd8498ab0a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:07.921039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3a464-f65a-4a94-b7db-2cd6fa19ecd5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:08.185864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-91f3a464-f65a-4a94-b7db-2cd6fa19ecd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11f29014538c49e583bbf2bd8498ab0a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:08.187758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-91f3a464-f65a-4a94-b7db-2cd6fa19ecd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11f29014538c49e583bbf2bd8498ab0a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:08.337031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-91f3a464-f65a-4a94-b7db-2cd6fa19ecd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11f29014538c49e583bbf2bd8498ab0a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:08.339159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-91f3a464-f65a-4a94-b7db-2cd6fa19ecd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11f29014538c49e583bbf2bd8498ab0a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:08.368710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-91f3a464-f65a-4a94-b7db-2cd6fa19ecd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11f29014538c49e583bbf2bd8498ab0a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:08.391678 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3445/6836] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:07 2022] DELETE /identity/v3/users/11f29014538c49e583bbf2bd8498ab0a => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:08.398483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b029fd-16fd-468a-9ee0-51e28da3f1af None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:08.399036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b029fd-16fd-468a-9ee0-51e28da3f1af None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:08.399450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b029fd-16fd-468a-9ee0-51e28da3f1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:08.445468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:08.461489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-91b029fd-16fd-468a-9ee0-51e28da3f1af None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:08.462687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-91b029fd-16fd-468a-9ee0-51e28da3f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:08.629908 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3392/6837] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:55:08.655667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3a464-f65a-4a94-b7db-2cd6fa19ecd5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:08.657066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-91f3a464-f65a-4a94-b7db-2cd6fa19ecd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:08.783211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3a464-f65a-4a94-b7db-2cd6fa19ecd5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:08.792682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57075af4-3195-4a82-bd20-0843e5fb881a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:08.797362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57075af4-3195-4a82-bd20-0843e5fb881a service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:08.797901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57075af4-3195-4a82-bd20-0843e5fb881a service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:08.798352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57075af4-3195-4a82-bd20-0843e5fb881a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:08.819801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57075af4-3195-4a82-bd20-0843e5fb881a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:08.821529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57075af4-3195-4a82-bd20-0843e5fb881a service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:08.836684 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3446/6838] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:55:09.024475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b029fd-16fd-468a-9ee0-51e28da3f1af None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:09.026638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-91b029fd-16fd-468a-9ee0-51e28da3f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:09.049394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b029fd-16fd-468a-9ee0-51e28da3f1af None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:09.067088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d81549-f74a-43e6-9912-3081439bb4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:09.068264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d81549-f74a-43e6-9912-3081439bb4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:09.068794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d81549-f74a-43e6-9912-3081439bb4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:09.069910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d81549-f74a-43e6-9912-3081439bb4a6 admin admin] PATH_INFO: `/v3/projects/f01d677260ad4eaa84a2e5b7cbd53e17` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:09.073076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d81549-f74a-43e6-9912-3081439bb4a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f01d677260ad4eaa84a2e5b7cbd53e17)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:09.078477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d81549-f74a-43e6-9912-3081439bb4a6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:09.317287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a9d81549-f74a-43e6-9912-3081439bb4a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f01d677260ad4eaa84a2e5b7cbd53e17', 'request_id': 'req-a9d81549-f74a-43e6-9912-3081439bb4a6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:09.323496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a9d81549-f74a-43e6-9912-3081439bb4a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f01d677260ad4eaa84a2e5b7cbd53e17', 'request_id': 'req-a9d81549-f74a-43e6-9912-3081439bb4a6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:09.334541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a9d81549-f74a-43e6-9912-3081439bb4a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f01d677260ad4eaa84a2e5b7cbd53e17', 'request_id': 'req-a9d81549-f74a-43e6-9912-3081439bb4a6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:09.472556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a9d81549-f74a-43e6-9912-3081439bb4a6 admin admin] The token cache is being invalidate because project f01d677260ad4eaa84a2e5b7cbd53e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:09.473768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a9d81549-f74a-43e6-9912-3081439bb4a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:09.474819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a9d81549-f74a-43e6-9912-3081439bb4a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:09.479484 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3393/6839] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:09 2022] DELETE /identity/v3/projects/f01d677260ad4eaa84a2e5b7cbd53e17 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:09.484034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57075af4-3195-4a82-bd20-0843e5fb881a service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:09.507524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57075af4-3195-4a82-bd20-0843e5fb881a service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:09.701452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6bc53-c270-4601-b3a2-02fa8084ac30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:09.702146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6bc53-c270-4601-b3a2-02fa8084ac30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:09.702427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6bc53-c270-4601-b3a2-02fa8084ac30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:09.703299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6bc53-c270-4601-b3a2-02fa8084ac30 admin admin] PATH_INFO: `/v3/users/3466364a57fa49c1b8798ebb1f5d8bfa` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:09.706185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6bc53-c270-4601-b3a2-02fa8084ac30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3466364a57fa49c1b8798ebb1f5d8bfa)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:09.709779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6bc53-c270-4601-b3a2-02fa8084ac30 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:09.722347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d81549-f74a-43e6-9912-3081439bb4a6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:09.724647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a9d81549-f74a-43e6-9912-3081439bb4a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:09.749297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d81549-f74a-43e6-9912-3081439bb4a6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:09.756053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75a236-ce17-48e2-bd47-d34a70b77817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:09.756961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a236-ce17-48e2-bd47-d34a70b77817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:09.757305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a236-ce17-48e2-bd47-d34a70b77817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:09.757658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a236-ce17-48e2-bd47-d34a70b77817 admin admin] PATH_INFO: `/v3/projects/62de677740544c68aadac4237f327d26` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:09.759283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75a236-ce17-48e2-bd47-d34a70b77817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62de677740544c68aadac4237f327d26)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:09.761791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75a236-ce17-48e2-bd47-d34a70b77817 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:10.076676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-08c6bc53-c270-4601-b3a2-02fa8084ac30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3466364a57fa49c1b8798ebb1f5d8bfa'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:10.077502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-08c6bc53-c270-4601-b3a2-02fa8084ac30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3466364a57fa49c1b8798ebb1f5d8bfa'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:10.081187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0e75a236-ce17-48e2-bd47-d34a70b77817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62de677740544c68aadac4237f327d26', 'request_id': 'req-0e75a236-ce17-48e2-bd47-d34a70b77817'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:10.089721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0e75a236-ce17-48e2-bd47-d34a70b77817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62de677740544c68aadac4237f327d26', 'request_id': 'req-0e75a236-ce17-48e2-bd47-d34a70b77817'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:10.097227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0e75a236-ce17-48e2-bd47-d34a70b77817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62de677740544c68aadac4237f327d26', 'request_id': 'req-0e75a236-ce17-48e2-bd47-d34a70b77817'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:10.196711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-08c6bc53-c270-4601-b3a2-02fa8084ac30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3466364a57fa49c1b8798ebb1f5d8bfa'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:10.197649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-08c6bc53-c270-4601-b3a2-02fa8084ac30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3466364a57fa49c1b8798ebb1f5d8bfa'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:10.234433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-08c6bc53-c270-4601-b3a2-02fa8084ac30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3466364a57fa49c1b8798ebb1f5d8bfa'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:10.273582 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3447/6840] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:09 2022] DELETE /identity/v3/users/3466364a57fa49c1b8798ebb1f5d8bfa => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:10.275202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6bc53-c270-4601-b3a2-02fa8084ac30 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:10.277040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-08c6bc53-c270-4601-b3a2-02fa8084ac30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:10.303751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0e75a236-ce17-48e2-bd47-d34a70b77817 admin admin] The token cache is being invalidate because project 62de677740544c68aadac4237f327d26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:10.304044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0e75a236-ce17-48e2-bd47-d34a70b77817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:10.309677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0e75a236-ce17-48e2-bd47-d34a70b77817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:10.309677 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3394/6841] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:09 2022] DELETE /identity/v3/projects/62de677740544c68aadac4237f327d26 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:10.314806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75a236-ce17-48e2-bd47-d34a70b77817 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:10.322030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0e75a236-ce17-48e2-bd47-d34a70b77817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:10.340362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:10.398136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6bc53-c270-4601-b3a2-02fa8084ac30 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:10.404708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071bb56-3dec-4ddf-8f56-5ef89fecf440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:10.406070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071bb56-3dec-4ddf-8f56-5ef89fecf440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:10.407127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071bb56-3dec-4ddf-8f56-5ef89fecf440 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:10.407901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071bb56-3dec-4ddf-8f56-5ef89fecf440 admin admin] PATH_INFO: `/v3/projects/c1326c90f74c4fe28c2ce95026c3404b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:10.409311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071bb56-3dec-4ddf-8f56-5ef89fecf440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1326c90f74c4fe28c2ce95026c3404b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:10.411411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071bb56-3dec-4ddf-8f56-5ef89fecf440 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:10.489597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75a236-ce17-48e2-bd47-d34a70b77817 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:10.521068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc20e7-c5da-47f1-9b15-85ee85f12a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:10.521799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc20e7-c5da-47f1-9b15-85ee85f12a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:10.522082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc20e7-c5da-47f1-9b15-85ee85f12a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:10.522363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc20e7-c5da-47f1-9b15-85ee85f12a73 admin admin] PATH_INFO: `/v3/users/cb78c7de04e0493e850b1267d98622a7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:10.523645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc20e7-c5da-47f1-9b15-85ee85f12a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb78c7de04e0493e850b1267d98622a7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:10.530599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc20e7-c5da-47f1-9b15-85ee85f12a73 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:10.564072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d071bb56-3dec-4ddf-8f56-5ef89fecf440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1326c90f74c4fe28c2ce95026c3404b', 'request_id': 'req-d071bb56-3dec-4ddf-8f56-5ef89fecf440'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:10.574815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d071bb56-3dec-4ddf-8f56-5ef89fecf440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1326c90f74c4fe28c2ce95026c3404b', 'request_id': 'req-d071bb56-3dec-4ddf-8f56-5ef89fecf440'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:10.735457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d071bb56-3dec-4ddf-8f56-5ef89fecf440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1326c90f74c4fe28c2ce95026c3404b', 'request_id': 'req-d071bb56-3dec-4ddf-8f56-5ef89fecf440'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:10.761178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d071bb56-3dec-4ddf-8f56-5ef89fecf440 admin admin] The token cache is being invalidate because project c1326c90f74c4fe28c2ce95026c3404b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:10.761709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d071bb56-3dec-4ddf-8f56-5ef89fecf440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:10.762767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d071bb56-3dec-4ddf-8f56-5ef89fecf440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:10.766432 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3448/6842] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:10 2022] DELETE /identity/v3/projects/c1326c90f74c4fe28c2ce95026c3404b => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:10.770754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071bb56-3dec-4ddf-8f56-5ef89fecf440 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:10.773561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d071bb56-3dec-4ddf-8f56-5ef89fecf440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:10.865046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071bb56-3dec-4ddf-8f56-5ef89fecf440 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:10.869057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ec1a6-d173-4538-9f1c-addc43324879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:10.869953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ec1a6-d173-4538-9f1c-addc43324879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:10.870383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ec1a6-d173-4538-9f1c-addc43324879 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:10.870803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ec1a6-d173-4538-9f1c-addc43324879 admin admin] PATH_INFO: `/v3/users/e2121c93b344482da7084fcf83e5288c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:10.872251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ec1a6-d173-4538-9f1c-addc43324879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2121c93b344482da7084fcf83e5288c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:10.875589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ec1a6-d173-4538-9f1c-addc43324879 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:10.913512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c6dc20e7-c5da-47f1-9b15-85ee85f12a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb78c7de04e0493e850b1267d98622a7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:11.060732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c6dc20e7-c5da-47f1-9b15-85ee85f12a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb78c7de04e0493e850b1267d98622a7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:11.067063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c6dc20e7-c5da-47f1-9b15-85ee85f12a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb78c7de04e0493e850b1267d98622a7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:11.070562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c6dc20e7-c5da-47f1-9b15-85ee85f12a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb78c7de04e0493e850b1267d98622a7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:11.099167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c6dc20e7-c5da-47f1-9b15-85ee85f12a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb78c7de04e0493e850b1267d98622a7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:11.128994 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3395/6843] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:10 2022] DELETE /identity/v3/users/cb78c7de04e0493e850b1267d98622a7 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:55:11.172414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad8ec1a6-d173-4538-9f1c-addc43324879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2121c93b344482da7084fcf83e5288c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:11.174017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad8ec1a6-d173-4538-9f1c-addc43324879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2121c93b344482da7084fcf83e5288c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:11.302960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad8ec1a6-d173-4538-9f1c-addc43324879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2121c93b344482da7084fcf83e5288c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:11.303609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad8ec1a6-d173-4538-9f1c-addc43324879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2121c93b344482da7084fcf83e5288c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:11.342647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ad8ec1a6-d173-4538-9f1c-addc43324879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2121c93b344482da7084fcf83e5288c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:11.390308 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3449/6844] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:10 2022] DELETE /identity/v3/users/e2121c93b344482da7084fcf83e5288c => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:11.749844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:12.483796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc20e7-c5da-47f1-9b15-85ee85f12a73 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:12.498014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c6dc20e7-c5da-47f1-9b15-85ee85f12a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:12.500080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ec1a6-d173-4538-9f1c-addc43324879 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:12.501759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ad8ec1a6-d173-4538-9f1c-addc43324879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:12.521362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:12.738437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc20e7-c5da-47f1-9b15-85ee85f12a73 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:12.746174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ec1a6-d173-4538-9f1c-addc43324879 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:12.773596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fa091-004e-4b2f-b4f6-1e20010b7363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:12.774604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ea2aa-3c84-4e4a-b8a3-3ed0a4874a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:12.775405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ea2aa-3c84-4e4a-b8a3-3ed0a4874a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:12.776006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fa091-004e-4b2f-b4f6-1e20010b7363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:12.776579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fa091-004e-4b2f-b4f6-1e20010b7363 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:12.777164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ea2aa-3c84-4e4a-b8a3-3ed0a4874a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:12.779291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ea2aa-3c84-4e4a-b8a3-3ed0a4874a6b admin admin] PATH_INFO: `/v3/projects/217ab220babf4fb19882d6aa8f8ae7dc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:12.779878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fa091-004e-4b2f-b4f6-1e20010b7363 admin admin] PATH_INFO: `/v3/projects/a83f041268e44ce1986a408559bacf56` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:12.781215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10fa091-004e-4b2f-b4f6-1e20010b7363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83f041268e44ce1986a408559bacf56)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:12.785036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ea2aa-3c84-4e4a-b8a3-3ed0a4874a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=217ab220babf4fb19882d6aa8f8ae7dc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:12.793400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10fa091-004e-4b2f-b4f6-1e20010b7363 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:12.793939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ea2aa-3c84-4e4a-b8a3-3ed0a4874a6b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:13.029926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a10fa091-004e-4b2f-b4f6-1e20010b7363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83f041268e44ce1986a408559bacf56', 'request_id': 'req-a10fa091-004e-4b2f-b4f6-1e20010b7363'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:13.041475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b81ea2aa-3c84-4e4a-b8a3-3ed0a4874a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217ab220babf4fb19882d6aa8f8ae7dc', 'request_id': 'req-b81ea2aa-3c84-4e4a-b8a3-3ed0a4874a6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:13.053471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b81ea2aa-3c84-4e4a-b8a3-3ed0a4874a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217ab220babf4fb19882d6aa8f8ae7dc', 'request_id': 'req-b81ea2aa-3c84-4e4a-b8a3-3ed0a4874a6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:13.054990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a10fa091-004e-4b2f-b4f6-1e20010b7363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83f041268e44ce1986a408559bacf56', 'request_id': 'req-a10fa091-004e-4b2f-b4f6-1e20010b7363'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:13.065327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a10fa091-004e-4b2f-b4f6-1e20010b7363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83f041268e44ce1986a408559bacf56', 'request_id': 'req-a10fa091-004e-4b2f-b4f6-1e20010b7363'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:13.134027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b81ea2aa-3c84-4e4a-b8a3-3ed0a4874a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217ab220babf4fb19882d6aa8f8ae7dc', 'request_id': 'req-b81ea2aa-3c84-4e4a-b8a3-3ed0a4874a6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:13.155833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b81ea2aa-3c84-4e4a-b8a3-3ed0a4874a6b admin admin] The token cache is being invalidate because project 217ab220babf4fb19882d6aa8f8ae7dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:13.157005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b81ea2aa-3c84-4e4a-b8a3-3ed0a4874a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:13.160007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b81ea2aa-3c84-4e4a-b8a3-3ed0a4874a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:13.163649 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3450/6845] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:12 2022] DELETE /identity/v3/projects/217ab220babf4fb19882d6aa8f8ae7dc => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:55:13.172867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e13539-e3f1-44da-aa15-566e92413767 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:13.172867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e13539-e3f1-44da-aa15-566e92413767 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:13.172867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e13539-e3f1-44da-aa15-566e92413767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:13.178859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:13.233450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-49e13539-e3f1-44da-aa15-566e92413767 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:13.235149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-49e13539-e3f1-44da-aa15-566e92413767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:13.306430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a10fa091-004e-4b2f-b4f6-1e20010b7363 admin admin] The token cache is being invalidate because project a83f041268e44ce1986a408559bacf56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:13.306712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a10fa091-004e-4b2f-b4f6-1e20010b7363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:13.312149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a10fa091-004e-4b2f-b4f6-1e20010b7363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:13.312149 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3396/6846] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:12 2022] DELETE /identity/v3/projects/a83f041268e44ce1986a408559bacf56 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:13.316345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bfb22-d271-4a25-ae01-718bac15ef65 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:13.316887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bfb22-d271-4a25-ae01-718bac15ef65 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:13.317353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bfb22-d271-4a25-ae01-718bac15ef65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:13.350203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-cf9bfb22-d271-4a25-ae01-718bac15ef65 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:13.351877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cf9bfb22-d271-4a25-ae01-718bac15ef65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:13.451969 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3451/6847] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:13.454879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775ed58-88a4-4c4c-9ec6-d6b5894f7316 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:13.455170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775ed58-88a4-4c4c-9ec6-d6b5894f7316 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:13.455450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775ed58-88a4-4c4c-9ec6-d6b5894f7316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:13.517044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b775ed58-88a4-4c4c-9ec6-d6b5894f7316 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:13.518337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b775ed58-88a4-4c4c-9ec6-d6b5894f7316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:13.534253 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3452/6848] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:13.535992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775ed58-88a4-4c4c-9ec6-d6b5894f7316 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:13.569977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775ed58-88a4-4c4c-9ec6-d6b5894f7316 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:13.590351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516aac13-4ab8-4ef9-8136-9efb6e420e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:13.590910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516aac13-4ab8-4ef9-8136-9efb6e420e32 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:13.593056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516aac13-4ab8-4ef9-8136-9efb6e420e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:13.593341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516aac13-4ab8-4ef9-8136-9efb6e420e32 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:13.594124 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3397/6849] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:13.595201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bfb22-d271-4a25-ae01-718bac15ef65 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:13.598485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516aac13-4ab8-4ef9-8136-9efb6e420e32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:13.598855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516aac13-4ab8-4ef9-8136-9efb6e420e32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:13.599855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cf9bfb22-d271-4a25-ae01-718bac15ef65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:13.606938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516aac13-4ab8-4ef9-8136-9efb6e420e32 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:13.635149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bfb22-d271-4a25-ae01-718bac15ef65 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:13.646105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:13.647000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:13.649153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:13.649533 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3453/6850] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:13.649829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c admin admin] PATH_INFO: `/v3/projects/b3c19a4564b64c69a8e275f041f17d30` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:13.650829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acead6-010f-406d-b8de-e964015d8a2e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:13.651120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acead6-010f-406d-b8de-e964015d8a2e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:13.651399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acead6-010f-406d-b8de-e964015d8a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:13.652989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c19a4564b64c69a8e275f041f17d30)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:13.657945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:13.702624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-21acead6-010f-406d-b8de-e964015d8a2e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:13.711923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-21acead6-010f-406d-b8de-e964015d8a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:13.752480 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3454/6851] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:13.754548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21acead6-010f-406d-b8de-e964015d8a2e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:13.780468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21acead6-010f-406d-b8de-e964015d8a2e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:13.813862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff74006-0cd3-496c-9308-ade08b124891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:13.814475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff74006-0cd3-496c-9308-ade08b124891 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:13.818712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff74006-0cd3-496c-9308-ade08b124891 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:13.819740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff74006-0cd3-496c-9308-ade08b124891 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:13.831838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff74006-0cd3-496c-9308-ade08b124891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:13.831838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff74006-0cd3-496c-9308-ade08b124891 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:13.948234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c19a4564b64c69a8e275f041f17d30', 'request_id': 'req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:13.956316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c19a4564b64c69a8e275f041f17d30', 'request_id': 'req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:13.967766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c19a4564b64c69a8e275f041f17d30', 'request_id': 'req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:14.136111 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3455/6852] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:13 2022] POST /identity/v3/projects => generated 409 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:14.146713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff74006-0cd3-496c-9308-ade08b124891 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:14.165923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c admin admin] The token cache is being invalidate because project b3c19a4564b64c69a8e275f041f17d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:14.167787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:14.169518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:14.172523 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3398/6853] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:13 2022] DELETE /identity/v3/projects/b3c19a4564b64c69a8e275f041f17d30 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:14.181658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:14.186712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:14.325068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff74006-0cd3-496c-9308-ade08b124891 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:14.328287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be789ae-17f5-4a5b-bfb5-227be2e3d38c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:14.338502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfeb123-06e5-432b-bea3-7acc5bbea333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:14.339374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeb123-06e5-432b-bea3-7acc5bbea333 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:14.339802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeb123-06e5-432b-bea3-7acc5bbea333 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:14.340362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeb123-06e5-432b-bea3-7acc5bbea333 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:14.340627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d916d9d-d6b3-4129-8b78-890ca9954020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:14.341273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfeb123-06e5-432b-bea3-7acc5bbea333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:14.342952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d916d9d-d6b3-4129-8b78-890ca9954020 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:14.343433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d916d9d-d6b3-4129-8b78-890ca9954020 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:14.343539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfeb123-06e5-432b-bea3-7acc5bbea333 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:14.344604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d916d9d-d6b3-4129-8b78-890ca9954020 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:14.345313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d916d9d-d6b3-4129-8b78-890ca9954020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:14.345635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d916d9d-d6b3-4129-8b78-890ca9954020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:14.347261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d916d9d-d6b3-4129-8b78-890ca9954020 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:14.382995 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3456/6854] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:14.384673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7355f-d965-4832-9061-61213ba4682f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:14.384673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7355f-d965-4832-9061-61213ba4682f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:14.384887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7355f-d965-4832-9061-61213ba4682f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:14.442218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bfc7355f-d965-4832-9061-61213ba4682f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:14.443534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bfc7355f-d965-4832-9061-61213ba4682f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:14.477184 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3457/6855] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:14.479294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7355f-d965-4832-9061-61213ba4682f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:14.482967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bfc7355f-d965-4832-9061-61213ba4682f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:14.515678 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3399/6856] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:14 2022] POST /identity/v3/users => generated 305 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:14.515678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e7902-9f79-4fa3-b345-b1388c073179 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:14.515678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e7902-9f79-4fa3-b345-b1388c073179 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:14.515678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e7902-9f79-4fa3-b345-b1388c073179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:14.534076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7355f-d965-4832-9061-61213ba4682f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:14.566954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-950e7902-9f79-4fa3-b345-b1388c073179 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:14.568761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-950e7902-9f79-4fa3-b345-b1388c073179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:14.577542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae8d02-6af1-43b1-bd37-422f072058a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:14.578275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae8d02-6af1-43b1-bd37-422f072058a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:14.578627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae8d02-6af1-43b1-bd37-422f072058a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:14.579286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae8d02-6af1-43b1-bd37-422f072058a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:14.580118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae8d02-6af1-43b1-bd37-422f072058a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:14.580272 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3400/6857] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:14.581388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e7902-9f79-4fa3-b345-b1388c073179 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:14.592465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae8d02-6af1-43b1-bd37-422f072058a4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:14.597660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e7902-9f79-4fa3-b345-b1388c073179 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:14.602912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf6351-f9ed-43ee-92de-fd4ce984f6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:14.603532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf6351-f9ed-43ee-92de-fd4ce984f6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:14.604378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf6351-f9ed-43ee-92de-fd4ce984f6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:14.608587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf6351-f9ed-43ee-92de-fd4ce984f6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:14.609567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf6351-f9ed-43ee-92de-fd4ce984f6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:14.611845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf6351-f9ed-43ee-92de-fd4ce984f6a4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:14.623599 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3401/6858] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:14.624890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf6351-f9ed-43ee-92de-fd4ce984f6a4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:14.638667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf6351-f9ed-43ee-92de-fd4ce984f6a4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:14.644579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe8233-3131-47fd-b855-5f30d4c181c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:14.645513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe8233-3131-47fd-b855-5f30d4c181c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:14.645892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe8233-3131-47fd-b855-5f30d4c181c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:14.646272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe8233-3131-47fd-b855-5f30d4c181c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:14.647444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe8233-3131-47fd-b855-5f30d4c181c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:14.648115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe8233-3131-47fd-b855-5f30d4c181c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:14.651489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe8233-3131-47fd-b855-5f30d4c181c8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:14.672071 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3402/6859] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:14.673242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe8233-3131-47fd-b855-5f30d4c181c8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:14.686590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe8233-3131-47fd-b855-5f30d4c181c8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:14.696242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2206e-256e-429e-919f-553c8a3a6f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:14.696972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2206e-256e-429e-919f-553c8a3a6f00 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:14.697395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2206e-256e-429e-919f-553c8a3a6f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:14.697745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2206e-256e-429e-919f-553c8a3a6f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:14.700020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2206e-256e-429e-919f-553c8a3a6f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:14.702790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2206e-256e-429e-919f-553c8a3a6f00 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:14.715711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:14.738345 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3458/6860] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:14 2022] POST /identity/v3/projects => generated 371 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:14.740948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae8d02-6af1-43b1-bd37-422f072058a4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:14.754232 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3403/6861] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:14.755338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2206e-256e-429e-919f-553c8a3a6f00 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:14.816284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2206e-256e-429e-919f-553c8a3a6f00 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:14.923427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:15.014357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae8d02-6af1-43b1-bd37-422f072058a4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:15.023458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dca5d6-eaf1-4b99-81e9-55d4200171ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:15.027145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dca5d6-eaf1-4b99-81e9-55d4200171ec admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:15.029019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dca5d6-eaf1-4b99-81e9-55d4200171ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:15.029952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dca5d6-eaf1-4b99-81e9-55d4200171ec admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:15.031471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dca5d6-eaf1-4b99-81e9-55d4200171ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:15.036936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d1dae-056f-433e-ac9e-f9e50bf17d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:15.037572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d1dae-056f-433e-ac9e-f9e50bf17d42 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:15.037855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d1dae-056f-433e-ac9e-f9e50bf17d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:15.038130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d1dae-056f-433e-ac9e-f9e50bf17d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:15.038839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d1dae-056f-433e-ac9e-f9e50bf17d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:15.039979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dca5d6-eaf1-4b99-81e9-55d4200171ec admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:15.040794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d1dae-056f-433e-ac9e-f9e50bf17d42 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:15.242283 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3404/6862] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:14 2022] POST /identity/v3/users => generated 286 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:15.242283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dca5d6-eaf1-4b99-81e9-55d4200171ec admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:15.251526 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3459/6863] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:14 2022] POST /identity/v3/projects => generated 367 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:15.252608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d1dae-056f-433e-ac9e-f9e50bf17d42 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:15.285703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dca5d6-eaf1-4b99-81e9-55d4200171ec admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:15.410138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d1dae-056f-433e-ac9e-f9e50bf17d42 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:15.426751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23cca9-5fbb-43bc-88a3-64c0a123a8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:15.427400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23cca9-5fbb-43bc-88a3-64c0a123a8cf admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:15.435672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23cca9-5fbb-43bc-88a3-64c0a123a8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:15.435672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23cca9-5fbb-43bc-88a3-64c0a123a8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:15.435672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23cca9-5fbb-43bc-88a3-64c0a123a8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:15.435672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23cca9-5fbb-43bc-88a3-64c0a123a8cf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:15.451860 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3460/6864] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:15.452922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23cca9-5fbb-43bc-88a3-64c0a123a8cf admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:15.464514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23cca9-5fbb-43bc-88a3-64c0a123a8cf admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:15.478252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69028c-ceb5-4b97-bd71-c2f46d62c308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:15.478890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69028c-ceb5-4b97-bd71-c2f46d62c308 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:15.479175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69028c-ceb5-4b97-bd71-c2f46d62c308 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:15.479454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69028c-ceb5-4b97-bd71-c2f46d62c308 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:15.480099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69028c-ceb5-4b97-bd71-c2f46d62c308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:15.483455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69028c-ceb5-4b97-bd71-c2f46d62c308 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:15.487544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccc5c3-fc14-44c7-be70-22d8076f9969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:15.488330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccc5c3-fc14-44c7-be70-22d8076f9969 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:15.488617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccc5c3-fc14-44c7-be70-22d8076f9969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:15.488898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccc5c3-fc14-44c7-be70-22d8076f9969 admin admin] PATH_INFO: `/v3/projects/16146f8439264711b35dd5e7a1237991/users/1400dfc84a4e42a998755499c99f8df0/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:15.529535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccc5c3-fc14-44c7-be70-22d8076f9969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16146f8439264711b35dd5e7a1237991, user_id=1400dfc84a4e42a998755499c99f8df0, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:15.532445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccc5c3-fc14-44c7-be70-22d8076f9969 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:15.707439 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3405/6865] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:15 2022] PUT /identity/v3/projects/16146f8439264711b35dd5e7a1237991/users/1400dfc84a4e42a998755499c99f8df0/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:15.709506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccc5c3-fc14-44c7-be70-22d8076f9969 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:15.713470 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3461/6866] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:15 2022] POST /identity/v3/users => generated 284 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:15.715396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69028c-ceb5-4b97-bd71-c2f46d62c308 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:15.793693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69028c-ceb5-4b97-bd71-c2f46d62c308 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:15.930740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccc5c3-fc14-44c7-be70-22d8076f9969 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:15.938550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee594423-aa9c-42dc-8ad4-f728b093afa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:15.939193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee594423-aa9c-42dc-8ad4-f728b093afa9 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:15.939475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee594423-aa9c-42dc-8ad4-f728b093afa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:15.939756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee594423-aa9c-42dc-8ad4-f728b093afa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:15.942998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee594423-aa9c-42dc-8ad4-f728b093afa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:15.945234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee594423-aa9c-42dc-8ad4-f728b093afa9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:15.979363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de957e42-071f-4aff-b14c-0f12aa6ff933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:15.979994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de957e42-071f-4aff-b14c-0f12aa6ff933 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:15.980322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de957e42-071f-4aff-b14c-0f12aa6ff933 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:15.980603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de957e42-071f-4aff-b14c-0f12aa6ff933 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:15.981332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de957e42-071f-4aff-b14c-0f12aa6ff933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:15.983094 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3406/6867] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:15.984290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51226119-b878-4a2e-8b40-b76bf8b4f26f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:15.984581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51226119-b878-4a2e-8b40-b76bf8b4f26f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:15.984859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51226119-b878-4a2e-8b40-b76bf8b4f26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:15.988539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de957e42-071f-4aff-b14c-0f12aa6ff933 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:16.014119 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3462/6868] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:16.014119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de957e42-071f-4aff-b14c-0f12aa6ff933 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:16.030729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de957e42-071f-4aff-b14c-0f12aa6ff933 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:16.041991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-51226119-b878-4a2e-8b40-b76bf8b4f26f None None] MFA Rules not processed for user `1400dfc84a4e42a998755499c99f8df0`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:16.042896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-51226119-b878-4a2e-8b40-b76bf8b4f26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:16.045381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71ee4e-0916-4f25-a97c-c319d10c080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:16.046066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71ee4e-0916-4f25-a97c-c319d10c080b admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:16.046345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71ee4e-0916-4f25-a97c-c319d10c080b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:16.046626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71ee4e-0916-4f25-a97c-c319d10c080b admin admin] PATH_INFO: `/v3/projects/5034a717d9704e5ba0af54eda8554717/users/2abd924b377a4227b01e6f859c348a15/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:16.072592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71ee4e-0916-4f25-a97c-c319d10c080b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5034a717d9704e5ba0af54eda8554717, user_id=2abd924b377a4227b01e6f859c348a15, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:16.075762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71ee4e-0916-4f25-a97c-c319d10c080b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:16.156111 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3463/6869] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:16 2022] PUT /identity/v3/projects/5034a717d9704e5ba0af54eda8554717/users/2abd924b377a4227b01e6f859c348a15/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:16.156994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71ee4e-0916-4f25-a97c-c319d10c080b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:16.215716 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3407/6870] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:15 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:16.220045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e4ca4-7f6c-4d32-8c35-12c696c9f155 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:16.220745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e4ca4-7f6c-4d32-8c35-12c696c9f155 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:16.221225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e4ca4-7f6c-4d32-8c35-12c696c9f155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:16.289306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4f0e4ca4-7f6c-4d32-8c35-12c696c9f155 None None] MFA Rules not processed for user `2abd924b377a4227b01e6f859c348a15`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:16.290839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4f0e4ca4-7f6c-4d32-8c35-12c696c9f155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:16.353052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71ee4e-0916-4f25-a97c-c319d10c080b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:16.376689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3fd32-7297-4dd9-83c0-9a5677c4fdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:16.377335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3fd32-7297-4dd9-83c0-9a5677c4fdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:16.377618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3fd32-7297-4dd9-83c0-9a5677c4fdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:16.377892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3fd32-7297-4dd9-83c0-9a5677c4fdd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:16.378545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3fd32-7297-4dd9-83c0-9a5677c4fdd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:16.380209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3fd32-7297-4dd9-83c0-9a5677c4fdd0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:16.411890 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3464/6871] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:16.413574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3fd32-7297-4dd9-83c0-9a5677c4fdd0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:16.436082 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3408/6872] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:16.438273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e4ca4-7f6c-4d32-8c35-12c696c9f155 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:16.447179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3fd32-7297-4dd9-83c0-9a5677c4fdd0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:16.451971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046af423-52bf-4981-aa85-c6951769b9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:16.452649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046af423-52bf-4981-aa85-c6951769b9ae admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:16.452933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046af423-52bf-4981-aa85-c6951769b9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:16.453207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046af423-52bf-4981-aa85-c6951769b9ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:16.453849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046af423-52bf-4981-aa85-c6951769b9ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:16.455898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046af423-52bf-4981-aa85-c6951769b9ae admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:16.472464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e4ca4-7f6c-4d32-8c35-12c696c9f155 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:16.487362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a50db-95e7-469e-95b2-c1d03eac1a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:16.488059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a50db-95e7-469e-95b2-c1d03eac1a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:16.489117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a50db-95e7-469e-95b2-c1d03eac1a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:16.489117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a50db-95e7-469e-95b2-c1d03eac1a59 admin admin] PATH_INFO: `/v3/projects/6434e39729b048b9b079551d8fe2d092/users/3861ecd835fd432cbbda5b731f40b5bd/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:16.538320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a50db-95e7-469e-95b2-c1d03eac1a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6434e39729b048b9b079551d8fe2d092, user_id=3861ecd835fd432cbbda5b731f40b5bd, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:16.541280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a50db-95e7-469e-95b2-c1d03eac1a59 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:16.613873 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3465/6873] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:16 2022] POST /identity/v3/projects => generated 411 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:16.615046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046af423-52bf-4981-aa85-c6951769b9ae admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:16.617329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-046af423-52bf-4981-aa85-c6951769b9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:16.717775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046af423-52bf-4981-aa85-c6951769b9ae admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:16.730414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff63ed-f223-4017-a25f-ddc2ce4d5c78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:16.731280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff63ed-f223-4017-a25f-ddc2ce4d5c78 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:16.731820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff63ed-f223-4017-a25f-ddc2ce4d5c78 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:16.732392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff63ed-f223-4017-a25f-ddc2ce4d5c78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:16.761492 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3409/6874] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:16 2022] PUT /identity/v3/projects/6434e39729b048b9b079551d8fe2d092/users/3861ecd835fd432cbbda5b731f40b5bd/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:16.763382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a50db-95e7-469e-95b2-c1d03eac1a59 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:16.912421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff63ed-f223-4017-a25f-ddc2ce4d5c78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:16.914665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff63ed-f223-4017-a25f-ddc2ce4d5c78 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:16.928832 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3466/6875] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:55:16.930474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dc8e6-aef0-4823-857c-76e06539fcb0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:16.930937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dc8e6-aef0-4823-857c-76e06539fcb0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:16.931358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dc8e6-aef0-4823-857c-76e06539fcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:16.947887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a50db-95e7-469e-95b2-c1d03eac1a59 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:16.960253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72d181-8d31-44f9-9e7e-f9d47a83568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:16.960898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72d181-8d31-44f9-9e7e-f9d47a83568e admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:16.961177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72d181-8d31-44f9-9e7e-f9d47a83568e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:16.961450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72d181-8d31-44f9-9e7e-f9d47a83568e admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:16.962097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72d181-8d31-44f9-9e7e-f9d47a83568e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:16.964056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72d181-8d31-44f9-9e7e-f9d47a83568e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:16.994155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-508dc8e6-aef0-4823-857c-76e06539fcb0 None None] MFA Rules not processed for user `3861ecd835fd432cbbda5b731f40b5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:16.995987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-508dc8e6-aef0-4823-857c-76e06539fcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:17.118818 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3467/6876] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:17.123232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dc8e6-aef0-4823-857c-76e06539fcb0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:17.144383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dc8e6-aef0-4823-857c-76e06539fcb0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:17.151849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9593d-4b64-41b5-928a-a808c627c214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:17.152519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9593d-4b64-41b5-928a-a808c627c214 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:17.153096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9593d-4b64-41b5-928a-a808c627c214 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:17.154470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9593d-4b64-41b5-928a-a808c627c214 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:17.155346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9593d-4b64-41b5-928a-a808c627c214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:17.156955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9593d-4b64-41b5-928a-a808c627c214 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:17.181913 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3410/6877] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:16 2022] POST /identity/v3/users => generated 312 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:17.186915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72d181-8d31-44f9-9e7e-f9d47a83568e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:17.200527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72d181-8d31-44f9-9e7e-f9d47a83568e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:17.206192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eff4d-a635-4d1f-a04a-6457f6dca091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:17.207560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eff4d-a635-4d1f-a04a-6457f6dca091 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:17.207994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eff4d-a635-4d1f-a04a-6457f6dca091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:17.208706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eff4d-a635-4d1f-a04a-6457f6dca091 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:17.209631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275eff4d-a635-4d1f-a04a-6457f6dca091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:17.211537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275eff4d-a635-4d1f-a04a-6457f6dca091 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:17.255974 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3411/6878] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:17.261565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eff4d-a635-4d1f-a04a-6457f6dca091 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:17.284458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eff4d-a635-4d1f-a04a-6457f6dca091 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:17.293934 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3468/6879] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:17 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:55:17.302221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0bc8c-21ad-4c14-9128-66433009f34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:17.302965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9593d-4b64-41b5-928a-a808c627c214 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:17.303332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0bc8c-21ad-4c14-9128-66433009f34a admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:17.305502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0bc8c-21ad-4c14-9128-66433009f34a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:17.306035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0bc8c-21ad-4c14-9128-66433009f34a admin admin] PATH_INFO: `/v3/projects/d10883b19af84a07a4443e66a01f2394/users/786d291cc2b247d3bb1a15268d6202e7/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:17.342206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0bc8c-21ad-4c14-9128-66433009f34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10883b19af84a07a4443e66a01f2394, user_id=786d291cc2b247d3bb1a15268d6202e7, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:17.345235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0bc8c-21ad-4c14-9128-66433009f34a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:17.412379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:17.465467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9593d-4b64-41b5-928a-a808c627c214 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:17.484363 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3412/6880] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:17 2022] PUT /identity/v3/projects/d10883b19af84a07a4443e66a01f2394/users/786d291cc2b247d3bb1a15268d6202e7/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:17.488754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0bc8c-21ad-4c14-9128-66433009f34a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:17.506692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b51746-3f1d-4fcd-8226-765d6d79aa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:17.507338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b51746-3f1d-4fcd-8226-765d6d79aa94 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:17.507618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b51746-3f1d-4fcd-8226-765d6d79aa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:17.507888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b51746-3f1d-4fcd-8226-765d6d79aa94 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:17.508642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b51746-3f1d-4fcd-8226-765d6d79aa94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:17.510599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b51746-3f1d-4fcd-8226-765d6d79aa94 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:17.687397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0bc8c-21ad-4c14-9128-66433009f34a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:17.694683 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3469/6881] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:17 2022] POST /identity/v3/users => generated 289 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:17.699209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c626b2b-37d0-4b42-b18d-f3ae1ba0ae27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:17.699909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c626b2b-37d0-4b42-b18d-f3ae1ba0ae27 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:17.703830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c626b2b-37d0-4b42-b18d-f3ae1ba0ae27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:17.703830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c626b2b-37d0-4b42-b18d-f3ae1ba0ae27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:17.704211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b51746-3f1d-4fcd-8226-765d6d79aa94 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:17.704940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c626b2b-37d0-4b42-b18d-f3ae1ba0ae27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:17.712347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c626b2b-37d0-4b42-b18d-f3ae1ba0ae27 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:17.728870 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3413/6882] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:55:17.732574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c626b2b-37d0-4b42-b18d-f3ae1ba0ae27 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:17.736836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b51746-3f1d-4fcd-8226-765d6d79aa94 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:17.747673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c626b2b-37d0-4b42-b18d-f3ae1ba0ae27 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:17.755566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71186ed5-00dd-48fb-9cbc-e193c36233f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:17.756826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71186ed5-00dd-48fb-9cbc-e193c36233f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:17.758228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71186ed5-00dd-48fb-9cbc-e193c36233f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:17.759071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3bdb7-9ecf-44f4-a4e4-64e897be725b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:17.760598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71186ed5-00dd-48fb-9cbc-e193c36233f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:17.761749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3bdb7-9ecf-44f4-a4e4-64e897be725b admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:17.762245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3bdb7-9ecf-44f4-a4e4-64e897be725b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:17.763262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71186ed5-00dd-48fb-9cbc-e193c36233f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:17.764991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3bdb7-9ecf-44f4-a4e4-64e897be725b admin admin] PATH_INFO: `/v3/projects/d10883b19af84a07a4443e66a01f2394/users/786d291cc2b247d3bb1a15268d6202e7/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:17.767801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71186ed5-00dd-48fb-9cbc-e193c36233f8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:17.770917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3bdb7-9ecf-44f4-a4e4-64e897be725b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10883b19af84a07a4443e66a01f2394, user_id=786d291cc2b247d3bb1a15268d6202e7, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:17.776134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3bdb7-9ecf-44f4-a4e4-64e897be725b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:17.805461 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3470/6883] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:17.809248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71186ed5-00dd-48fb-9cbc-e193c36233f8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:17.828228 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3414/6884] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:17 2022] PUT /identity/v3/projects/d10883b19af84a07a4443e66a01f2394/users/786d291cc2b247d3bb1a15268d6202e7/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:17.830118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71186ed5-00dd-48fb-9cbc-e193c36233f8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:17.832465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f4466-7133-4241-b444-f9bbc094d5f0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:17.833018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f4466-7133-4241-b444-f9bbc094d5f0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:17.833673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f4466-7133-4241-b444-f9bbc094d5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:17.928909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b86f4466-7133-4241-b444-f9bbc094d5f0 None None] MFA Rules not processed for user `786d291cc2b247d3bb1a15268d6202e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:17.930270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b86f4466-7133-4241-b444-f9bbc094d5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:18.092477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e31a5-857f-495c-a1cc-635434efdc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:18.095135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e31a5-857f-495c-a1cc-635434efdc66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:18.095135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e31a5-857f-495c-a1cc-635434efdc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:18.095135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e31a5-857f-495c-a1cc-635434efdc66 admin admin] PATH_INFO: `/v3/projects/1a5cf68b924e47f1b16bc6e4db5fc07f/users/a64705f6b6dc4339b1d532556d1dd670/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:18.157291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e31a5-857f-495c-a1cc-635434efdc66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a5cf68b924e47f1b16bc6e4db5fc07f, user_id=a64705f6b6dc4339b1d532556d1dd670, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:18.177393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e31a5-857f-495c-a1cc-635434efdc66 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:18.263949 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3415/6885] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:17 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:18.288571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f4466-7133-4241-b444-f9bbc094d5f0 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:18.290037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b86f4466-7133-4241-b444-f9bbc094d5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:18.299466 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3471/6886] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:17 2022] PUT /identity/v3/projects/1a5cf68b924e47f1b16bc6e4db5fc07f/users/a64705f6b6dc4339b1d532556d1dd670/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:18.307026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e31a5-857f-495c-a1cc-635434efdc66 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:18.527528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f4466-7133-4241-b444-f9bbc094d5f0 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:18.577605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e31a5-857f-495c-a1cc-635434efdc66 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:18.606136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e27313-9d6c-4dc1-8a22-fa3de662aefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:18.610112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e27313-9d6c-4dc1-8a22-fa3de662aefb admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:18.610453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e27313-9d6c-4dc1-8a22-fa3de662aefb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:18.610735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e27313-9d6c-4dc1-8a22-fa3de662aefb admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:18.611419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e27313-9d6c-4dc1-8a22-fa3de662aefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:18.620809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e27313-9d6c-4dc1-8a22-fa3de662aefb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:18.670312 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3472/6887] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:55:18.671367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e27313-9d6c-4dc1-8a22-fa3de662aefb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:18.701319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e27313-9d6c-4dc1-8a22-fa3de662aefb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:18.702964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f955e-f631-4285-b155-e24832d7a082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:18.703818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f955e-f631-4285-b155-e24832d7a082 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:18.704437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f955e-f631-4285-b155-e24832d7a082 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:18.704864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f955e-f631-4285-b155-e24832d7a082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:18.727704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbf475-3f21-437c-a862-21431516402d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:18.728457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbf475-3f21-437c-a862-21431516402d admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:18.728744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbf475-3f21-437c-a862-21431516402d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:18.729020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbf475-3f21-437c-a862-21431516402d admin admin] PATH_INFO: `/v3/projects/1a5cf68b924e47f1b16bc6e4db5fc07f/users/a64705f6b6dc4339b1d532556d1dd670/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:18.735723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbf475-3f21-437c-a862-21431516402d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a5cf68b924e47f1b16bc6e4db5fc07f, user_id=a64705f6b6dc4339b1d532556d1dd670, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:18.738491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbf475-3f21-437c-a862-21431516402d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:18.759401 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3473/6888] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:18 2022] PUT /identity/v3/projects/1a5cf68b924e47f1b16bc6e4db5fc07f/users/a64705f6b6dc4339b1d532556d1dd670/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:18.770955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f348-13a6-4938-b383-15c671c70cf2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:18.773027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f348-13a6-4938-b383-15c671c70cf2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:18.773027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f348-13a6-4938-b383-15c671c70cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:18.838192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7695f348-13a6-4938-b383-15c671c70cf2 None None] MFA Rules not processed for user `a64705f6b6dc4339b1d532556d1dd670`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:18.839443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7695f348-13a6-4938-b383-15c671c70cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:18.839859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f955e-f631-4285-b155-e24832d7a082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:18.846024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f955e-f631-4285-b155-e24832d7a082 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:18.859823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:18.872483 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3416/6889] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:18 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:55:19.005721 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3474/6890] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:19.012483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f955e-f631-4285-b155-e24832d7a082 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:19.169544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f955e-f631-4285-b155-e24832d7a082 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:19.184028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999005a5-376f-4a2f-9f65-d9b1ea7f3fcc tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a64705f6b6dc4339b1d532556d1dd670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a5cf68b924e47f1b16bc6e4db5fc07f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:19.185733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999005a5-376f-4a2f-9f65-d9b1ea7f3fcc tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:19.186236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999005a5-376f-4a2f-9f65-d9b1ea7f3fcc tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:19.187214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999005a5-376f-4a2f-9f65-d9b1ea7f3fcc tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:19.190443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999005a5-376f-4a2f-9f65-d9b1ea7f3fcc tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:19.196382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999005a5-376f-4a2f-9f65-d9b1ea7f3fcc tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:19.374681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695f348-13a6-4938-b383-15c671c70cf2 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:19.385385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695f348-13a6-4938-b383-15c671c70cf2 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:19.385975 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3417/6891] 10.222.0.76 () {60 vars in 1149 bytes} [Sat Aug 27 04:55:19 2022] POST /identity/v3/domains => generated 276 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:55:19.464250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:19.545225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cfd3b-cccc-4772-b765-7875a04d98ae tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a64705f6b6dc4339b1d532556d1dd670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a5cf68b924e47f1b16bc6e4db5fc07f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:19.545783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cfd3b-cccc-4772-b765-7875a04d98ae tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:19.546072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cfd3b-cccc-4772-b765-7875a04d98ae tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:19.546346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cfd3b-cccc-4772-b765-7875a04d98ae tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:19.547002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cfd3b-cccc-4772-b765-7875a04d98ae tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:19.553903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cfd3b-cccc-4772-b765-7875a04d98ae tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:19.773167 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3475/6892] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:19 2022] POST /identity/v3/users => generated 348 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:55:19.780553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999005a5-376f-4a2f-9f65-d9b1ea7f3fcc tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:19.830537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999005a5-376f-4a2f-9f65-d9b1ea7f3fcc tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:19.857720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a30a63-39c8-485c-a718-f738a3e150ac tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a64705f6b6dc4339b1d532556d1dd670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a5cf68b924e47f1b16bc6e4db5fc07f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:19.862797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a30a63-39c8-485c-a718-f738a3e150ac tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:19.863244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a30a63-39c8-485c-a718-f738a3e150ac tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:19.863949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a30a63-39c8-485c-a718-f738a3e150ac tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:19.867501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a30a63-39c8-485c-a718-f738a3e150ac tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:19.878711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a30a63-39c8-485c-a718-f738a3e150ac tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:20.148955 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3418/6893] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:19 2022] POST /identity/v3/users => generated 323 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:20.154726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cfd3b-cccc-4772-b765-7875a04d98ae tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:20.169928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cfd3b-cccc-4772-b765-7875a04d98ae tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:20.185580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ab786-519b-4771-bd52-7073df6ccf5f tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a64705f6b6dc4339b1d532556d1dd670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a5cf68b924e47f1b16bc6e4db5fc07f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:20.186453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ab786-519b-4771-bd52-7073df6ccf5f tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:20.186743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ab786-519b-4771-bd52-7073df6ccf5f tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:20.187348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ab786-519b-4771-bd52-7073df6ccf5f tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] PATH_INFO: `/v3/users/f864a8be84d743a3904565ae6d65d61b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:20.223106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ab786-519b-4771-bd52-7073df6ccf5f tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorizing `identity:get_user(user_id=f864a8be84d743a3904565ae6d65d61b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:20.233157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ab786-519b-4771-bd52-7073df6ccf5f tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:20.241732 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3476/6894] 10.222.0.76 () {58 vars in 1221 bytes} [Sat Aug 27 04:55:20 2022] GET /identity/v3/users/f864a8be84d743a3904565ae6d65d61b => generated 348 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:20.247533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a30a63-39c8-485c-a718-f738a3e150ac tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:20.270871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a30a63-39c8-485c-a718-f738a3e150ac tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:20.294335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c69a6-de27-4835-a6ed-52374033c180 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a64705f6b6dc4339b1d532556d1dd670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a5cf68b924e47f1b16bc6e4db5fc07f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:20.295004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c69a6-de27-4835-a6ed-52374033c180 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:20.295287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c69a6-de27-4835-a6ed-52374033c180 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:20.295569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c69a6-de27-4835-a6ed-52374033c180 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:20.297298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c69a6-de27-4835-a6ed-52374033c180 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Adding query filter params (domain_id=6cc0ecddfb444fa6988fdf95f907ec60) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:20.297589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c69a6-de27-4835-a6ed-52374033c180 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:20.301409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c69a6-de27-4835-a6ed-52374033c180 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:20.355646 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3419/6895] 10.222.0.76 () {58 vars in 1207 bytes} [Sat Aug 27 04:55:20 2022] GET /identity/v3/users?domain_id=6cc0ecddfb444fa6988fdf95f907ec60 => generated 485 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:20.361407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ab786-519b-4771-bd52-7073df6ccf5f tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:20.376452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ab786-519b-4771-bd52-7073df6ccf5f tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:20.381935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d404ed6-73d8-4d3f-a85e-8088714ba8fd tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a64705f6b6dc4339b1d532556d1dd670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a5cf68b924e47f1b16bc6e4db5fc07f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:20.385128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d404ed6-73d8-4d3f-a85e-8088714ba8fd tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:20.385128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d404ed6-73d8-4d3f-a85e-8088714ba8fd tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:20.385128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d404ed6-73d8-4d3f-a85e-8088714ba8fd tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:20.385128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d404ed6-73d8-4d3f-a85e-8088714ba8fd tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:20.386848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d404ed6-73d8-4d3f-a85e-8088714ba8fd tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:20.476011 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3477/6896] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:20 2022] GET /identity/v3/users => generated 8872 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:20.480802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c69a6-de27-4835-a6ed-52374033c180 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:20.495246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c69a6-de27-4835-a6ed-52374033c180 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:20.511188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629b981-6bbb-46ca-9216-9b292f3c94f1 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a64705f6b6dc4339b1d532556d1dd670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a5cf68b924e47f1b16bc6e4db5fc07f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:20.525045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629b981-6bbb-46ca-9216-9b292f3c94f1 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:20.525045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629b981-6bbb-46ca-9216-9b292f3c94f1 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:20.525045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629b981-6bbb-46ca-9216-9b292f3c94f1 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:20.525045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629b981-6bbb-46ca-9216-9b292f3c94f1 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1222498601) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:20.525045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629b981-6bbb-46ca-9216-9b292f3c94f1 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:20.525584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629b981-6bbb-46ca-9216-9b292f3c94f1 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:20.593689 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3420/6897] 10.222.0.76 () {58 vars in 1189 bytes} [Sat Aug 27 04:55:20 2022] GET /identity/v3/users?name=tempest-test_user-1222498601 => generated 476 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:20.598688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d404ed6-73d8-4d3f-a85e-8088714ba8fd tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:20.620453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d404ed6-73d8-4d3f-a85e-8088714ba8fd tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:20.632957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9110ed-f3f2-4ac1-b67f-6fb8be7bad3c tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a64705f6b6dc4339b1d532556d1dd670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a5cf68b924e47f1b16bc6e4db5fc07f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:20.634009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9110ed-f3f2-4ac1-b67f-6fb8be7bad3c tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:20.634445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9110ed-f3f2-4ac1-b67f-6fb8be7bad3c tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:20.635639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9110ed-f3f2-4ac1-b67f-6fb8be7bad3c tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:20.636565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9110ed-f3f2-4ac1-b67f-6fb8be7bad3c tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:20.642674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9110ed-f3f2-4ac1-b67f-6fb8be7bad3c tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:20.642674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9110ed-f3f2-4ac1-b67f-6fb8be7bad3c tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:20.726944 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3478/6898] 10.222.0.76 () {58 vars in 1149 bytes} [Sat Aug 27 04:55:20 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:20.733544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629b981-6bbb-46ca-9216-9b292f3c94f1 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:20.748395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629b981-6bbb-46ca-9216-9b292f3c94f1 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:20.768687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289fa46-f155-4650-937e-f09e089fbc37 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a64705f6b6dc4339b1d532556d1dd670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a5cf68b924e47f1b16bc6e4db5fc07f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:20.769404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289fa46-f155-4650-937e-f09e089fbc37 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:20.769692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289fa46-f155-4650-937e-f09e089fbc37 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:20.769970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289fa46-f155-4650-937e-f09e089fbc37 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] PATH_INFO: `/v3/users/6b8dc65f351f4b8abe9d80daa3e2784c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:20.825367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289fa46-f155-4650-937e-f09e089fbc37 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6b8dc65f351f4b8abe9d80daa3e2784c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:20.850013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289fa46-f155-4650-937e-f09e089fbc37 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:21.047161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7289fa46-f155-4650-937e-f09e089fbc37 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8dc65f351f4b8abe9d80daa3e2784c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:21.120984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7289fa46-f155-4650-937e-f09e089fbc37 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8dc65f351f4b8abe9d80daa3e2784c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:21.123810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7289fa46-f155-4650-937e-f09e089fbc37 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8dc65f351f4b8abe9d80daa3e2784c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:21.135970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7289fa46-f155-4650-937e-f09e089fbc37 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8dc65f351f4b8abe9d80daa3e2784c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:21.168846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7289fa46-f155-4650-937e-f09e089fbc37 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8dc65f351f4b8abe9d80daa3e2784c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:21.184018 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3421/6899] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:20 2022] DELETE /identity/v3/users/6b8dc65f351f4b8abe9d80daa3e2784c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:21.189308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9110ed-f3f2-4ac1-b67f-6fb8be7bad3c tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:21.189829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0c9110ed-f3f2-4ac1-b67f-6fb8be7bad3c tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:21.211861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9110ed-f3f2-4ac1-b67f-6fb8be7bad3c tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:21.372370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb8871-9216-4573-b3ea-2a250127f357 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a64705f6b6dc4339b1d532556d1dd670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a5cf68b924e47f1b16bc6e4db5fc07f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:21.373293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb8871-9216-4573-b3ea-2a250127f357 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:21.373726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb8871-9216-4573-b3ea-2a250127f357 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:21.374165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb8871-9216-4573-b3ea-2a250127f357 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] PATH_INFO: `/v3/users/f864a8be84d743a3904565ae6d65d61b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:21.377259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb8871-9216-4573-b3ea-2a250127f357 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f864a8be84d743a3904565ae6d65d61b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:21.379454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb8871-9216-4573-b3ea-2a250127f357 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:21.432224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:21.579872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b2fb8871-9216-4573-b3ea-2a250127f357 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f864a8be84d743a3904565ae6d65d61b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:21.580625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b2fb8871-9216-4573-b3ea-2a250127f357 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f864a8be84d743a3904565ae6d65d61b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:21.719013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b2fb8871-9216-4573-b3ea-2a250127f357 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f864a8be84d743a3904565ae6d65d61b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:21.720772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b2fb8871-9216-4573-b3ea-2a250127f357 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f864a8be84d743a3904565ae6d65d61b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:21.743895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b2fb8871-9216-4573-b3ea-2a250127f357 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f864a8be84d743a3904565ae6d65d61b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:21.835327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcdcb4-f643-4832-ac03-25a336b9b509 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:21.836273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcdcb4-f643-4832-ac03-25a336b9b509 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:21.836706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcdcb4-f643-4832-ac03-25a336b9b509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:21.866763 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3479/6900] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:21 2022] DELETE /identity/v3/users/f864a8be84d743a3904565ae6d65d61b => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:21.869876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb8871-9216-4573-b3ea-2a250127f357 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:21.875656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b2fb8871-9216-4573-b3ea-2a250127f357 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:21.917340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b9fcdcb4-f643-4832-ac03-25a336b9b509 None None] MFA Rules not processed for user `2abd924b377a4227b01e6f859c348a15`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:21.920447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b9fcdcb4-f643-4832-ac03-25a336b9b509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:22.025012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:22.071224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb8871-9216-4573-b3ea-2a250127f357 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:22.076909 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3422/6901] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:22.090466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d738ab-3502-4145-ae99-33d4a8129233 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a64705f6b6dc4339b1d532556d1dd670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a5cf68b924e47f1b16bc6e4db5fc07f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:22.101458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d738ab-3502-4145-ae99-33d4a8129233 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:22.102080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d738ab-3502-4145-ae99-33d4a8129233 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:22.102547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d738ab-3502-4145-ae99-33d4a8129233 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] PATH_INFO: `/v3/domains/6cc0ecddfb444fa6988fdf95f907ec60` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:22.105360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d738ab-3502-4145-ae99-33d4a8129233 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6cc0ecddfb444fa6988fdf95f907ec60)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:22.116187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d738ab-3502-4145-ae99-33d4a8129233 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:22.171500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-41d738ab-3502-4145-ae99-33d4a8129233 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6cc0ecddfb444fa6988fdf95f907ec60'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:22.174567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-41d738ab-3502-4145-ae99-33d4a8129233 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6cc0ecddfb444fa6988fdf95f907ec60'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:22.315771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-41d738ab-3502-4145-ae99-33d4a8129233 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6cc0ecddfb444fa6988fdf95f907ec60'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:22.318496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-41d738ab-3502-4145-ae99-33d4a8129233 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6cc0ecddfb444fa6988fdf95f907ec60'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:22.323155 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3480/6902] 10.222.0.76 () {60 vars in 1249 bytes} [Sat Aug 27 04:55:21 2022] PATCH /identity/v3/domains/6cc0ecddfb444fa6988fdf95f907ec60 => generated 277 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:22.327166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcdcb4-f643-4832-ac03-25a336b9b509 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:22.343052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcdcb4-f643-4832-ac03-25a336b9b509 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:22.474902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9772c9e-f539-4330-865c-a1e95084e784 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a64705f6b6dc4339b1d532556d1dd670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a5cf68b924e47f1b16bc6e4db5fc07f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:22.475504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9772c9e-f539-4330-865c-a1e95084e784 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:22.475787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9772c9e-f539-4330-865c-a1e95084e784 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:22.476124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9772c9e-f539-4330-865c-a1e95084e784 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] PATH_INFO: `/v3/domains/6cc0ecddfb444fa6988fdf95f907ec60` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:22.491799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9772c9e-f539-4330-865c-a1e95084e784 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6cc0ecddfb444fa6988fdf95f907ec60)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:22.493619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9772c9e-f539-4330-865c-a1e95084e784 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:22.546746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e9772c9e-f539-4330-865c-a1e95084e784 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6cc0ecddfb444fa6988fdf95f907ec60'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:22.553707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e9772c9e-f539-4330-865c-a1e95084e784 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6cc0ecddfb444fa6988fdf95f907ec60'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:22.774984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e9772c9e-f539-4330-865c-a1e95084e784 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cc0ecddfb444fa6988fdf95f907ec60', 'request_id': 'req-e9772c9e-f539-4330-865c-a1e95084e784'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:22.790293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e9772c9e-f539-4330-865c-a1e95084e784 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cc0ecddfb444fa6988fdf95f907ec60', 'request_id': 'req-e9772c9e-f539-4330-865c-a1e95084e784'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:22.819785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e9772c9e-f539-4330-865c-a1e95084e784 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cc0ecddfb444fa6988fdf95f907ec60', 'request_id': 'req-e9772c9e-f539-4330-865c-a1e95084e784'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:23.015254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e9772c9e-f539-4330-865c-a1e95084e784 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] The token cache is being invalidate because project 6cc0ecddfb444fa6988fdf95f907ec60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:23.015808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e9772c9e-f539-4330-865c-a1e95084e784 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:23.016551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e9772c9e-f539-4330-865c-a1e95084e784 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:23.028895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e9772c9e-f539-4330-865c-a1e95084e784 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6cc0ecddfb444fa6988fdf95f907ec60', 'request_id': 'req-e9772c9e-f539-4330-865c-a1e95084e784'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:23.037787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e9772c9e-f539-4330-865c-a1e95084e784 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6cc0ecddfb444fa6988fdf95f907ec60', 'request_id': 'req-e9772c9e-f539-4330-865c-a1e95084e784'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:23.039779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e9772c9e-f539-4330-865c-a1e95084e784 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6cc0ecddfb444fa6988fdf95f907ec60', 'request_id': 'req-e9772c9e-f539-4330-865c-a1e95084e784'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:23.051131 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3423/6903] 10.222.0.76 () {58 vars in 1230 bytes} [Sat Aug 27 04:55:22 2022] DELETE /identity/v3/domains/6cc0ecddfb444fa6988fdf95f907ec60 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:23.055091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d738ab-3502-4145-ae99-33d4a8129233 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:23.056798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-41d738ab-3502-4145-ae99-33d4a8129233 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:23.069796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:23.206454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d738ab-3502-4145-ae99-33d4a8129233 tempest-UsersV3TestJSON-842735626 tempest-UsersV3TestJSON-842735626-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:23.298097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d9591-ffec-4ec8-a841-0c09352d9adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:23.298789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d9591-ffec-4ec8-a841-0c09352d9adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:23.299112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d9591-ffec-4ec8-a841-0c09352d9adf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:23.299390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d9591-ffec-4ec8-a841-0c09352d9adf admin admin] PATH_INFO: `/v3/users/3861ecd835fd432cbbda5b731f40b5bd` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:23.304394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d9591-ffec-4ec8-a841-0c09352d9adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3861ecd835fd432cbbda5b731f40b5bd)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:23.312607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d9591-ffec-4ec8-a841-0c09352d9adf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:23.593160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-038d9591-ffec-4ec8-a841-0c09352d9adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3861ecd835fd432cbbda5b731f40b5bd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:23.595220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-038d9591-ffec-4ec8-a841-0c09352d9adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3861ecd835fd432cbbda5b731f40b5bd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:23.709877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-038d9591-ffec-4ec8-a841-0c09352d9adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3861ecd835fd432cbbda5b731f40b5bd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:23.712256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-038d9591-ffec-4ec8-a841-0c09352d9adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3861ecd835fd432cbbda5b731f40b5bd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:23.738374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-038d9591-ffec-4ec8-a841-0c09352d9adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3861ecd835fd432cbbda5b731f40b5bd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:23.763118 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3481/6904] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:23 2022] DELETE /identity/v3/users/3861ecd835fd432cbbda5b731f40b5bd => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:23.767288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14621d42-fb5f-4bdd-80d3-1ebed398354f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:23.767986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14621d42-fb5f-4bdd-80d3-1ebed398354f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:23.768321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14621d42-fb5f-4bdd-80d3-1ebed398354f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:23.820140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-14621d42-fb5f-4bdd-80d3-1ebed398354f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:23.823685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-14621d42-fb5f-4bdd-80d3-1ebed398354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:23.954006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:23.991707 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3424/6905] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:24.003553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d9591-ffec-4ec8-a841-0c09352d9adf admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:24.006904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-038d9591-ffec-4ec8-a841-0c09352d9adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:24.151435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d9591-ffec-4ec8-a841-0c09352d9adf admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:24.166489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b41b0d-ffe8-497f-8ea1-b8758424df91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:24.167556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b41b0d-ffe8-497f-8ea1-b8758424df91 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:24.167990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b41b0d-ffe8-497f-8ea1-b8758424df91 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:24.168481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b41b0d-ffe8-497f-8ea1-b8758424df91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:24.180802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b41b0d-ffe8-497f-8ea1-b8758424df91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:24.182713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b41b0d-ffe8-497f-8ea1-b8758424df91 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:24.211998 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3482/6906] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:55:24.562120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:25.170386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14621d42-fb5f-4bdd-80d3-1ebed398354f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:25.172790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-14621d42-fb5f-4bdd-80d3-1ebed398354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:25.292558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14621d42-fb5f-4bdd-80d3-1ebed398354f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:25.299282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960bd4a-7da3-4dfa-9236-0af32acde39d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:25.299916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960bd4a-7da3-4dfa-9236-0af32acde39d service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:25.300220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960bd4a-7da3-4dfa-9236-0af32acde39d service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:25.300668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960bd4a-7da3-4dfa-9236-0af32acde39d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:25.302430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8960bd4a-7da3-4dfa-9236-0af32acde39d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:25.318042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960bd4a-7da3-4dfa-9236-0af32acde39d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:25.319855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960bd4a-7da3-4dfa-9236-0af32acde39d service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:25.336315 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3425/6907] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:55:25.354332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b41b0d-ffe8-497f-8ea1-b8758424df91 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:25.357011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e3b41b0d-ffe8-497f-8ea1-b8758424df91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:25.384657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b41b0d-ffe8-497f-8ea1-b8758424df91 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:25.398852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af338cb5-c740-4a85-ab6e-79fd7d65fa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:25.399857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af338cb5-c740-4a85-ab6e-79fd7d65fa80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:25.400410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af338cb5-c740-4a85-ab6e-79fd7d65fa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:25.400859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af338cb5-c740-4a85-ab6e-79fd7d65fa80 admin admin] PATH_INFO: `/v3/projects/6434e39729b048b9b079551d8fe2d092` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:25.402550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af338cb5-c740-4a85-ab6e-79fd7d65fa80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6434e39729b048b9b079551d8fe2d092)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:25.405689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af338cb5-c740-4a85-ab6e-79fd7d65fa80 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:25.597367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af338cb5-c740-4a85-ab6e-79fd7d65fa80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6434e39729b048b9b079551d8fe2d092', 'request_id': 'req-af338cb5-c740-4a85-ab6e-79fd7d65fa80'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:25.615054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af338cb5-c740-4a85-ab6e-79fd7d65fa80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6434e39729b048b9b079551d8fe2d092', 'request_id': 'req-af338cb5-c740-4a85-ab6e-79fd7d65fa80'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:25.761886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af338cb5-c740-4a85-ab6e-79fd7d65fa80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6434e39729b048b9b079551d8fe2d092', 'request_id': 'req-af338cb5-c740-4a85-ab6e-79fd7d65fa80'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:25.796501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af338cb5-c740-4a85-ab6e-79fd7d65fa80 admin admin] The token cache is being invalidate because project 6434e39729b048b9b079551d8fe2d092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:25.799578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af338cb5-c740-4a85-ab6e-79fd7d65fa80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:25.800462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af338cb5-c740-4a85-ab6e-79fd7d65fa80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:25.807300 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3483/6908] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:25 2022] DELETE /identity/v3/projects/6434e39729b048b9b079551d8fe2d092 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:25.815813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960bd4a-7da3-4dfa-9236-0af32acde39d service placement] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:25.836226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960bd4a-7da3-4dfa-9236-0af32acde39d service placement] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:25.992142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8d310-87f8-4951-9c9a-d6d410f2fb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:25.995303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8d310-87f8-4951-9c9a-d6d410f2fb43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:25.996453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8d310-87f8-4951-9c9a-d6d410f2fb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:25.998099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8d310-87f8-4951-9c9a-d6d410f2fb43 admin admin] PATH_INFO: `/v3/users/a64705f6b6dc4339b1d532556d1dd670` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:26.001300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8d310-87f8-4951-9c9a-d6d410f2fb43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64705f6b6dc4339b1d532556d1dd670)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:26.008546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8d310-87f8-4951-9c9a-d6d410f2fb43 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:26.398156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-40d8d310-87f8-4951-9c9a-d6d410f2fb43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64705f6b6dc4339b1d532556d1dd670'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:26.561911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:26.619890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-40d8d310-87f8-4951-9c9a-d6d410f2fb43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64705f6b6dc4339b1d532556d1dd670'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:26.619890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-40d8d310-87f8-4951-9c9a-d6d410f2fb43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64705f6b6dc4339b1d532556d1dd670'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:26.628037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-40d8d310-87f8-4951-9c9a-d6d410f2fb43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64705f6b6dc4339b1d532556d1dd670'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:26.660041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-40d8d310-87f8-4951-9c9a-d6d410f2fb43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64705f6b6dc4339b1d532556d1dd670'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:26.685028 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3426/6909] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:25 2022] DELETE /identity/v3/users/a64705f6b6dc4339b1d532556d1dd670 => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:27.213016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:28.418503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af338cb5-c740-4a85-ab6e-79fd7d65fa80 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:28.420924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-af338cb5-c740-4a85-ab6e-79fd7d65fa80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:28.446587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af338cb5-c740-4a85-ab6e-79fd7d65fa80 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:28.602622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a56ec8-f568-4812-852b-2d2e5547738a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:28.603286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a56ec8-f568-4812-852b-2d2e5547738a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:28.603564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a56ec8-f568-4812-852b-2d2e5547738a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:28.603835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a56ec8-f568-4812-852b-2d2e5547738a admin admin] PATH_INFO: `/v3/projects/1a5cf68b924e47f1b16bc6e4db5fc07f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:28.608141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a56ec8-f568-4812-852b-2d2e5547738a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a5cf68b924e47f1b16bc6e4db5fc07f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:28.610142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a56ec8-f568-4812-852b-2d2e5547738a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:28.736060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8d310-87f8-4951-9c9a-d6d410f2fb43 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:28.738106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-40d8d310-87f8-4951-9c9a-d6d410f2fb43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:28.769743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8d310-87f8-4951-9c9a-d6d410f2fb43 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:28.777366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-67a56ec8-f568-4812-852b-2d2e5547738a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a5cf68b924e47f1b16bc6e4db5fc07f', 'request_id': 'req-67a56ec8-f568-4812-852b-2d2e5547738a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:28.797366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-67a56ec8-f568-4812-852b-2d2e5547738a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a5cf68b924e47f1b16bc6e4db5fc07f', 'request_id': 'req-67a56ec8-f568-4812-852b-2d2e5547738a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:28.885133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2f636-eb10-433f-acf8-6736623842e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:28.886015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2f636-eb10-433f-acf8-6736623842e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:28.900551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2f636-eb10-433f-acf8-6736623842e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:28.900551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2f636-eb10-433f-acf8-6736623842e4 admin admin] PATH_INFO: `/v3/users/1400dfc84a4e42a998755499c99f8df0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:28.900551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2f636-eb10-433f-acf8-6736623842e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1400dfc84a4e42a998755499c99f8df0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:28.906305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2f636-eb10-433f-acf8-6736623842e4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:28.991980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-67a56ec8-f568-4812-852b-2d2e5547738a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a5cf68b924e47f1b16bc6e4db5fc07f', 'request_id': 'req-67a56ec8-f568-4812-852b-2d2e5547738a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:29.043990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-67a56ec8-f568-4812-852b-2d2e5547738a admin admin] The token cache is being invalidate because project 1a5cf68b924e47f1b16bc6e4db5fc07f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:29.046562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-67a56ec8-f568-4812-852b-2d2e5547738a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:29.051914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-67a56ec8-f568-4812-852b-2d2e5547738a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:29.065328 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3484/6910] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:28 2022] DELETE /identity/v3/projects/1a5cf68b924e47f1b16bc6e4db5fc07f => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:29.069678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7807d-3d45-42cc-b943-37aaca0ab2d4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:29.072617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7807d-3d45-42cc-b943-37aaca0ab2d4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:29.073060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7807d-3d45-42cc-b943-37aaca0ab2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:29.153507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-cce7807d-3d45-42cc-b943-37aaca0ab2d4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:29.160223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cce7807d-3d45-42cc-b943-37aaca0ab2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:29.193830 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3485/6911] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:29.195389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e02954-fcee-45ab-a6b7-2edf4fabea48 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:29.195689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e02954-fcee-45ab-a6b7-2edf4fabea48 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:29.195963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e02954-fcee-45ab-a6b7-2edf4fabea48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:29.246565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-07e02954-fcee-45ab-a6b7-2edf4fabea48 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:29.247803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-07e02954-fcee-45ab-a6b7-2edf4fabea48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:29.291190 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3486/6912] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:29.304034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e02954-fcee-45ab-a6b7-2edf4fabea48 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:29.320136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e02954-fcee-45ab-a6b7-2edf4fabea48 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:29.332763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cd7b8-a4e0-4880-897f-42931913906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:29.333696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd7b8-a4e0-4880-897f-42931913906e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:29.334156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd7b8-a4e0-4880-897f-42931913906e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:29.334580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd7b8-a4e0-4880-897f-42931913906e admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:29.335410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cd7b8-a4e0-4880-897f-42931913906e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:29.335873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cd7b8-a4e0-4880-897f-42931913906e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:29.337625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cd7b8-a4e0-4880-897f-42931913906e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:29.358529 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3487/6913] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:29.363754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cd7b8-a4e0-4880-897f-42931913906e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:29.397774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cd7b8-a4e0-4880-897f-42931913906e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:29.419333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da272530-7349-4124-aee3-2e6872670741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:29.426933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da272530-7349-4124-aee3-2e6872670741 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:29.427865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da272530-7349-4124-aee3-2e6872670741 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:29.427865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da272530-7349-4124-aee3-2e6872670741 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:29.431296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da272530-7349-4124-aee3-2e6872670741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:29.439628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da272530-7349-4124-aee3-2e6872670741 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:29.447235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0be2f636-eb10-433f-acf8-6736623842e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1400dfc84a4e42a998755499c99f8df0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:29.544678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:29.583873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0be2f636-eb10-433f-acf8-6736623842e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1400dfc84a4e42a998755499c99f8df0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:29.585379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0be2f636-eb10-433f-acf8-6736623842e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1400dfc84a4e42a998755499c99f8df0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:29.601597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0be2f636-eb10-433f-acf8-6736623842e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1400dfc84a4e42a998755499c99f8df0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:29.656466 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3488/6914] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:29 2022] POST /identity/v3/projects => generated 371 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:29.657797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da272530-7349-4124-aee3-2e6872670741 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:29.661205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0be2f636-eb10-433f-acf8-6736623842e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1400dfc84a4e42a998755499c99f8df0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:29.689890 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3427/6915] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:28 2022] DELETE /identity/v3/users/1400dfc84a4e42a998755499c99f8df0 => generated 0 bytes in 954 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:29.705137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d95526-7aa1-4346-b86b-c9eb79095e10 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:29.705693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d95526-7aa1-4346-b86b-c9eb79095e10 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:29.706183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d95526-7aa1-4346-b86b-c9eb79095e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:29.739283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-65d95526-7aa1-4346-b86b-c9eb79095e10 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:29.739283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-65d95526-7aa1-4346-b86b-c9eb79095e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:29.852589 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3428/6916] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:29.860700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da272530-7349-4124-aee3-2e6872670741 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:29.873715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574a42d-09fb-4c35-95a7-7bf308be046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:29.874412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574a42d-09fb-4c35-95a7-7bf308be046e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:29.874700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574a42d-09fb-4c35-95a7-7bf308be046e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:29.874980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574a42d-09fb-4c35-95a7-7bf308be046e admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:29.875625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574a42d-09fb-4c35-95a7-7bf308be046e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:29.877610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574a42d-09fb-4c35-95a7-7bf308be046e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:30.054548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d95526-7aa1-4346-b86b-c9eb79095e10 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:30.056095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-65d95526-7aa1-4346-b86b-c9eb79095e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:30.228664 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3489/6917] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:29 2022] POST /identity/v3/users => generated 286 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:30.231537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574a42d-09fb-4c35-95a7-7bf308be046e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:30.233963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3574a42d-09fb-4c35-95a7-7bf308be046e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:30.271170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574a42d-09fb-4c35-95a7-7bf308be046e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:30.281069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50790636-17fb-4fce-b1f2-8f22efa9cb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:30.281735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50790636-17fb-4fce-b1f2-8f22efa9cb67 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:30.282021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50790636-17fb-4fce-b1f2-8f22efa9cb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:30.282299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50790636-17fb-4fce-b1f2-8f22efa9cb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:30.282988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50790636-17fb-4fce-b1f2-8f22efa9cb67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:30.284648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50790636-17fb-4fce-b1f2-8f22efa9cb67 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:30.288513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d95526-7aa1-4346-b86b-c9eb79095e10 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:30.300914 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3490/6918] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:30.301879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50790636-17fb-4fce-b1f2-8f22efa9cb67 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:30.302751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfda90c-67dc-40a9-8d32-81fee23a432e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:30.303521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfda90c-67dc-40a9-8d32-81fee23a432e service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:30.303887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfda90c-67dc-40a9-8d32-81fee23a432e service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:30.307566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfda90c-67dc-40a9-8d32-81fee23a432e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:30.315318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50790636-17fb-4fce-b1f2-8f22efa9cb67 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:30.321291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0829a5-b458-47d2-b0b7-6b2077a0414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:30.321914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0829a5-b458-47d2-b0b7-6b2077a0414c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:30.322197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0829a5-b458-47d2-b0b7-6b2077a0414c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:30.322472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0829a5-b458-47d2-b0b7-6b2077a0414c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:30.323121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0829a5-b458-47d2-b0b7-6b2077a0414c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:30.325317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0829a5-b458-47d2-b0b7-6b2077a0414c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:30.338107 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3491/6919] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:30.340076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfda90c-67dc-40a9-8d32-81fee23a432e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:30.342266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfda90c-67dc-40a9-8d32-81fee23a432e service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:30.343202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0829a5-b458-47d2-b0b7-6b2077a0414c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:30.357964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0829a5-b458-47d2-b0b7-6b2077a0414c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:30.366346 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3429/6920] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:55:30.372922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50cdf8-4aa4-413f-93a0-fa0cec928756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:30.375102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50cdf8-4aa4-413f-93a0-fa0cec928756 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:30.375599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50cdf8-4aa4-413f-93a0-fa0cec928756 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:30.376062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50cdf8-4aa4-413f-93a0-fa0cec928756 admin admin] PATH_INFO: `/v3/projects/0efad22da6664389bc2666f4aa539f17/users/d8a1365e28a0452aafe7cc18723a9902/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:30.409067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50cdf8-4aa4-413f-93a0-fa0cec928756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0efad22da6664389bc2666f4aa539f17, user_id=d8a1365e28a0452aafe7cc18723a9902, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:30.418022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50cdf8-4aa4-413f-93a0-fa0cec928756 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:30.585600 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3492/6921] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:30 2022] PUT /identity/v3/projects/0efad22da6664389bc2666f4aa539f17/users/d8a1365e28a0452aafe7cc18723a9902/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:30.586859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ee81a-36a2-449a-8b96-27627376b4a5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:30.587304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ee81a-36a2-449a-8b96-27627376b4a5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:30.587761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ee81a-36a2-449a-8b96-27627376b4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:30.642109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:30.658625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c18ee81a-36a2-449a-8b96-27627376b4a5 None None] MFA Rules not processed for user `d8a1365e28a0452aafe7cc18723a9902`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:30.660047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c18ee81a-36a2-449a-8b96-27627376b4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:30.798542 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3430/6922] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:30.803966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50cdf8-4aa4-413f-93a0-fa0cec928756 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:30.909680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50cdf8-4aa4-413f-93a0-fa0cec928756 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:30.915959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ce1ae-31b1-4162-9d34-0a107c469533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:30.917096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ce1ae-31b1-4162-9d34-0a107c469533 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:30.917709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ce1ae-31b1-4162-9d34-0a107c469533 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:30.918143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ce1ae-31b1-4162-9d34-0a107c469533 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:30.920103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ce1ae-31b1-4162-9d34-0a107c469533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:30.923551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ce1ae-31b1-4162-9d34-0a107c469533 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:31.126922 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3493/6923] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:30 2022] POST /identity/v3/projects => generated 369 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:31.129824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ee81a-36a2-449a-8b96-27627376b4a5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:31.142543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ee81a-36a2-449a-8b96-27627376b4a5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:31.258840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cf848-ecf1-4b7b-9ada-afba9a201930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:31.259769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cf848-ecf1-4b7b-9ada-afba9a201930 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:31.260263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cf848-ecf1-4b7b-9ada-afba9a201930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:31.260966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cf848-ecf1-4b7b-9ada-afba9a201930 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:31.261823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874cf848-ecf1-4b7b-9ada-afba9a201930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:31.266898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874cf848-ecf1-4b7b-9ada-afba9a201930 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:31.412934 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3431/6924] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:31 2022] POST /identity/v3/users => generated 291 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:31.415315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ce1ae-31b1-4162-9d34-0a107c469533 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:31.431243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ce1ae-31b1-4162-9d34-0a107c469533 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:31.436475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381fb6b-52ab-40ca-a811-e46ecb5048e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:31.437118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381fb6b-52ab-40ca-a811-e46ecb5048e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:31.437405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381fb6b-52ab-40ca-a811-e46ecb5048e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:31.437681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381fb6b-52ab-40ca-a811-e46ecb5048e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:31.438336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381fb6b-52ab-40ca-a811-e46ecb5048e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:31.440125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381fb6b-52ab-40ca-a811-e46ecb5048e9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:31.461887 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3494/6925] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:31.463530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cf848-ecf1-4b7b-9ada-afba9a201930 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:31.479715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cf848-ecf1-4b7b-9ada-afba9a201930 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:31.490508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40822dd9-6f46-4d2d-a8c4-69498973e03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:31.496246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40822dd9-6f46-4d2d-a8c4-69498973e03a admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:31.496246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40822dd9-6f46-4d2d-a8c4-69498973e03a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:31.496246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40822dd9-6f46-4d2d-a8c4-69498973e03a admin admin] PATH_INFO: `/v3/projects/c4ebf69860574d1cbe604c814e6baec1/users/5773d110476e4fe48940b10238f09eb3/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:31.499111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381fb6b-52ab-40ca-a811-e46ecb5048e9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:31.501547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6381fb6b-52ab-40ca-a811-e46ecb5048e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:31.523448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381fb6b-52ab-40ca-a811-e46ecb5048e9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:31.697432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:31.697432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:31.697432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:31.697432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2 admin admin] PATH_INFO: `/v3/projects/16146f8439264711b35dd5e7a1237991` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:31.700797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16146f8439264711b35dd5e7a1237991)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:31.700797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:31.702768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40822dd9-6f46-4d2d-a8c4-69498973e03a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ebf69860574d1cbe604c814e6baec1, user_id=5773d110476e4fe48940b10238f09eb3, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:31.702768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40822dd9-6f46-4d2d-a8c4-69498973e03a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:31.845187 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3432/6926] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:31 2022] PUT /identity/v3/projects/c4ebf69860574d1cbe604c814e6baec1/users/5773d110476e4fe48940b10238f09eb3/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:31.845187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40822dd9-6f46-4d2d-a8c4-69498973e03a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:31.853032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16146f8439264711b35dd5e7a1237991', 'request_id': 'req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:31.872480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16146f8439264711b35dd5e7a1237991', 'request_id': 'req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:32.014901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40822dd9-6f46-4d2d-a8c4-69498973e03a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:32.040938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16146f8439264711b35dd5e7a1237991', 'request_id': 'req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:32.058577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2 admin admin] The token cache is being invalidate because project 16146f8439264711b35dd5e7a1237991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:32.060828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:32.062567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:32.077008 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3495/6927] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:31 2022] DELETE /identity/v3/projects/16146f8439264711b35dd5e7a1237991 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:32.078060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:32.086214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:32.255614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa5e7a-a725-40b6-8de3-f9c6210eaeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:32.262743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa5e7a-a725-40b6-8de3-f9c6210eaeee admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:32.265660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa5e7a-a725-40b6-8de3-f9c6210eaeee admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:32.268565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa5e7a-a725-40b6-8de3-f9c6210eaeee admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:32.276200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa5e7a-a725-40b6-8de3-f9c6210eaeee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:32.295929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa5e7a-a725-40b6-8de3-f9c6210eaeee admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:32.336188 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3433/6928] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 521 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:32.341581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa5e7a-a725-40b6-8de3-f9c6210eaeee admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:32.350291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9eaa5e7a-a725-40b6-8de3-f9c6210eaeee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:32.355789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d98dc-0dd1-4971-8693-2ffbd0bc6dc2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:32.373215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa5e7a-a725-40b6-8de3-f9c6210eaeee admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:32.374109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be774a5e-c967-4699-9838-23205e215ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:32.375032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be774a5e-c967-4699-9838-23205e215ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:32.375523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be774a5e-c967-4699-9838-23205e215ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:32.376056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be774a5e-c967-4699-9838-23205e215ffb admin admin] PATH_INFO: `/v3/users/786d291cc2b247d3bb1a15268d6202e7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:32.378537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be774a5e-c967-4699-9838-23205e215ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=786d291cc2b247d3bb1a15268d6202e7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:32.380918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be774a5e-c967-4699-9838-23205e215ffb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:32.392546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13980d0c-d54b-4d39-ac0a-38b25371ce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:32.406845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13980d0c-d54b-4d39-ac0a-38b25371ce67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:32.410841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13980d0c-d54b-4d39-ac0a-38b25371ce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:32.412490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13980d0c-d54b-4d39-ac0a-38b25371ce67 admin admin] PATH_INFO: `/v3/projects/c4ebf69860574d1cbe604c814e6baec1/users/5773d110476e4fe48940b10238f09eb3/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:32.424095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13980d0c-d54b-4d39-ac0a-38b25371ce67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ebf69860574d1cbe604c814e6baec1, user_id=5773d110476e4fe48940b10238f09eb3, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:32.427032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13980d0c-d54b-4d39-ac0a-38b25371ce67 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:32.450940 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3434/6929] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:32 2022] PUT /identity/v3/projects/c4ebf69860574d1cbe604c814e6baec1/users/5773d110476e4fe48940b10238f09eb3/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:32.452238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6cc99-4d45-4c13-b6a6-b2842803a87b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:32.452631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6cc99-4d45-4c13-b6a6-b2842803a87b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:32.452971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6cc99-4d45-4c13-b6a6-b2842803a87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:32.474405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:32.529532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-86a6cc99-4d45-4c13-b6a6-b2842803a87b None None] MFA Rules not processed for user `5773d110476e4fe48940b10238f09eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:32.537492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-86a6cc99-4d45-4c13-b6a6-b2842803a87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:32.688275 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3435/6930] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:32.688275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6cc99-4d45-4c13-b6a6-b2842803a87b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:32.688275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-86a6cc99-4d45-4c13-b6a6-b2842803a87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:32.827881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-be774a5e-c967-4699-9838-23205e215ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '786d291cc2b247d3bb1a15268d6202e7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:32.831005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-be774a5e-c967-4699-9838-23205e215ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '786d291cc2b247d3bb1a15268d6202e7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:32.882298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6cc99-4d45-4c13-b6a6-b2842803a87b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:32.890420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3f3fd-1223-472d-890b-4f2bcfbb1ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:32.896849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3f3fd-1223-472d-890b-4f2bcfbb1ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:32.896849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3f3fd-1223-472d-890b-4f2bcfbb1ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:32.896849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3f3fd-1223-472d-890b-4f2bcfbb1ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:32.896849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6fe3f3fd-1223-472d-890b-4f2bcfbb1ad7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:32.910561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3f3fd-1223-472d-890b-4f2bcfbb1ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:32.911786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3f3fd-1223-472d-890b-4f2bcfbb1ad7 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:32.925206 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3436/6931] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:55:32.926274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3f3fd-1223-472d-890b-4f2bcfbb1ad7 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:32.943395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3f3fd-1223-472d-890b-4f2bcfbb1ad7 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:32.947116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01432872-6f08-476f-bc26-63ce452f3156 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5773d110476e4fe48940b10238f09eb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4ebf69860574d1cbe604c814e6baec1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:32.947868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01432872-6f08-476f-bc26-63ce452f3156 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:32.948305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01432872-6f08-476f-bc26-63ce452f3156 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:32.948737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01432872-6f08-476f-bc26-63ce452f3156 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:32.949553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01432872-6f08-476f-bc26-63ce452f3156 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:32.952946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01432872-6f08-476f-bc26-63ce452f3156 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:32.977651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-be774a5e-c967-4699-9838-23205e215ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '786d291cc2b247d3bb1a15268d6202e7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:32.978309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-be774a5e-c967-4699-9838-23205e215ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '786d291cc2b247d3bb1a15268d6202e7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:32.999346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-be774a5e-c967-4699-9838-23205e215ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '786d291cc2b247d3bb1a15268d6202e7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:33.035856 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3496/6932] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:32 2022] DELETE /identity/v3/users/786d291cc2b247d3bb1a15268d6202e7 => generated 0 bytes in 958 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:33.191112 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3437/6933] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:32 2022] POST /identity/v3/projects => generated 359 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:33.196041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be774a5e-c967-4699-9838-23205e215ffb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:33.197812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-be774a5e-c967-4699-9838-23205e215ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:33.363505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be774a5e-c967-4699-9838-23205e215ffb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:33.484107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3262f-6ebf-49a2-9904-6b84be617d00 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5773d110476e4fe48940b10238f09eb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4ebf69860574d1cbe604c814e6baec1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:33.485671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3262f-6ebf-49a2-9904-6b84be617d00 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:33.494931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3262f-6ebf-49a2-9904-6b84be617d00 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:33.494931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3262f-6ebf-49a2-9904-6b84be617d00 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:33.494931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3262f-6ebf-49a2-9904-6b84be617d00 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:33.494931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3262f-6ebf-49a2-9904-6b84be617d00 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:33.681492 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3497/6934] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:33 2022] POST /identity/v3/users => generated 371 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:33.686571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01432872-6f08-476f-bc26-63ce452f3156 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:33.703837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01432872-6f08-476f-bc26-63ce452f3156 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:33.710201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e315572-ed2e-494b-93ad-3d22672d2225 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5773d110476e4fe48940b10238f09eb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4ebf69860574d1cbe604c814e6baec1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:33.711186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e315572-ed2e-494b-93ad-3d22672d2225 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:33.711696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e315572-ed2e-494b-93ad-3d22672d2225 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:33.712215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e315572-ed2e-494b-93ad-3d22672d2225 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:33.713155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e315572-ed2e-494b-93ad-3d22672d2225 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:33.713657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e315572-ed2e-494b-93ad-3d22672d2225 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:33.716407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e315572-ed2e-494b-93ad-3d22672d2225 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:33.758934 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3438/6935] 10.222.0.76 () {58 vars in 1157 bytes} [Sat Aug 27 04:55:33 2022] GET /identity/v3/users?domain_id=default => generated 7702 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:33.764522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3262f-6ebf-49a2-9904-6b84be617d00 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:33.795094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3262f-6ebf-49a2-9904-6b84be617d00 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:33.811231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7ce5c-7b4b-4eb0-a945-3d26cc79a7e5 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5773d110476e4fe48940b10238f09eb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4ebf69860574d1cbe604c814e6baec1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:33.812445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7ce5c-7b4b-4eb0-a945-3d26cc79a7e5 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:33.812967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7ce5c-7b4b-4eb0-a945-3d26cc79a7e5 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:33.813423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7ce5c-7b4b-4eb0-a945-3d26cc79a7e5 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] PATH_INFO: `/v3/users/9857efe0b1ad463191f12c96b2787006` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:33.835986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7ce5c-7b4b-4eb0-a945-3d26cc79a7e5 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: Authorizing `identity:update_user(user_id=9857efe0b1ad463191f12c96b2787006)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:33.839662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7ce5c-7b4b-4eb0-a945-3d26cc79a7e5 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:34.089457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c6a7ce5c-7b4b-4eb0-a945-3d26cc79a7e5 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9857efe0b1ad463191f12c96b2787006'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:34.292473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:34.320928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c6a7ce5c-7b4b-4eb0-a945-3d26cc79a7e5 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Invalidating the token cache because user 9857efe0b1ad463191f12c96b2787006 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:34.321332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c6a7ce5c-7b4b-4eb0-a945-3d26cc79a7e5 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:34.323125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c6a7ce5c-7b4b-4eb0-a945-3d26cc79a7e5 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:34.326039 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3498/6936] 10.222.0.76 () {60 vars in 1244 bytes} [Sat Aug 27 04:55:33 2022] PATCH /identity/v3/users/9857efe0b1ad463191f12c96b2787006 => generated 485 bytes in 564 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:34.331033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e3e3b-5add-424e-b131-f23c56aa3c1e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:34.331338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e3e3b-5add-424e-b131-f23c56aa3c1e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:34.331720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e3e3b-5add-424e-b131-f23c56aa3c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:34.364490 n-d-852088-5 devstack@keystone.service[82082]: WARNING keystone.auth.plugins.core [None req-f78e3e3b-5add-424e-b131-f23c56aa3c1e None None] User is disabled: 9857efe0b1ad463191f12c96b2787006: AssertionError: User is disabled: 9857efe0b1ad463191f12c96b2787006 Aug 27 04:55:34.377265 n-d-852088-5 devstack@keystone.service[82082]: WARNING keystone.server.flask.application [None req-f78e3e3b-5add-424e-b131-f23c56aa3c1e None None] Authorization failed. The request you have made requires authentication. from 10.222.0.76: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 27 04:55:34.381744 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3439/6937] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:34 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 50 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 27 04:55:34.383789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7ce5c-7b4b-4eb0-a945-3d26cc79a7e5 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:34.385415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c6a7ce5c-7b4b-4eb0-a945-3d26cc79a7e5 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:34.410017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7ce5c-7b4b-4eb0-a945-3d26cc79a7e5 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:34.423668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2464c42-f817-4b82-919e-71d6bfe20043 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5773d110476e4fe48940b10238f09eb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4ebf69860574d1cbe604c814e6baec1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:34.424365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2464c42-f817-4b82-919e-71d6bfe20043 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:34.424643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2464c42-f817-4b82-919e-71d6bfe20043 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:34.424921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2464c42-f817-4b82-919e-71d6bfe20043 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] PATH_INFO: `/v3/users/9857efe0b1ad463191f12c96b2787006` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:34.451923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2464c42-f817-4b82-919e-71d6bfe20043 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9857efe0b1ad463191f12c96b2787006)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:34.455127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2464c42-f817-4b82-919e-71d6bfe20043 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:34.708354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e3e3b-5add-424e-b131-f23c56aa3c1e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:34.718221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f78e3e3b-5add-424e-b131-f23c56aa3c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:34.759267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2464c42-f817-4b82-919e-71d6bfe20043 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9857efe0b1ad463191f12c96b2787006'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:34.770794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2464c42-f817-4b82-919e-71d6bfe20043 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9857efe0b1ad463191f12c96b2787006'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:34.913138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e3e3b-5add-424e-b131-f23c56aa3c1e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:34.919232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:34.919951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:34.920486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:34.920782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe admin admin] PATH_INFO: `/v3/projects/d10883b19af84a07a4443e66a01f2394` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:34.922010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d10883b19af84a07a4443e66a01f2394)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:34.925039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:34.939913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2464c42-f817-4b82-919e-71d6bfe20043 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9857efe0b1ad463191f12c96b2787006'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:34.941990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2464c42-f817-4b82-919e-71d6bfe20043 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9857efe0b1ad463191f12c96b2787006'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:34.968872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2464c42-f817-4b82-919e-71d6bfe20043 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9857efe0b1ad463191f12c96b2787006'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:35.047200 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3499/6938] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:34 2022] DELETE /identity/v3/users/9857efe0b1ad463191f12c96b2787006 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:35.052649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2464c42-f817-4b82-919e-71d6bfe20043 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:35.054535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c2464c42-f817-4b82-919e-71d6bfe20043 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:35.258423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd10883b19af84a07a4443e66a01f2394', 'request_id': 'req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:35.279706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd10883b19af84a07a4443e66a01f2394', 'request_id': 'req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:35.292949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd10883b19af84a07a4443e66a01f2394', 'request_id': 'req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:35.316485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2464c42-f817-4b82-919e-71d6bfe20043 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:35.438386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550f83c-1170-4ef9-9aae-a4d19c289df6 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5773d110476e4fe48940b10238f09eb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4ebf69860574d1cbe604c814e6baec1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:35.438386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550f83c-1170-4ef9-9aae-a4d19c289df6 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:35.438386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550f83c-1170-4ef9-9aae-a4d19c289df6 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:35.438889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550f83c-1170-4ef9-9aae-a4d19c289df6 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] PATH_INFO: `/v3/projects/89ceda5a196244039e5ff5468047198c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:35.438889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550f83c-1170-4ef9-9aae-a4d19c289df6 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: Authorizing `identity:delete_project(project_id=89ceda5a196244039e5ff5468047198c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:35.438889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550f83c-1170-4ef9-9aae-a4d19c289df6 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:35.468688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe admin admin] The token cache is being invalidate because project d10883b19af84a07a4443e66a01f2394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:35.469001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:35.470223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:35.479657 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3440/6939] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:34 2022] DELETE /identity/v3/projects/d10883b19af84a07a4443e66a01f2394 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:55:35.483852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:35.486027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:35.594679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9d716-25a6-4786-b59a-d97fdfa9cfbe admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:35.601878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75548d-e35a-4e75-9d8e-c31255fe3450 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:35.602598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75548d-e35a-4e75-9d8e-c31255fe3450 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:35.602893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75548d-e35a-4e75-9d8e-c31255fe3450 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:35.603166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75548d-e35a-4e75-9d8e-c31255fe3450 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:35.606465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0a75548d-e35a-4e75-9d8e-c31255fe3450 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:35.624663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75548d-e35a-4e75-9d8e-c31255fe3450 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:35.627026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75548d-e35a-4e75-9d8e-c31255fe3450 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:35.641878 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3441/6940] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:55:35.675288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738155a-05f6-4aaa-9748-4d5c5872e67a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:35.679253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738155a-05f6-4aaa-9748-4d5c5872e67a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:35.679253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738155a-05f6-4aaa-9748-4d5c5872e67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:35.703437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6550f83c-1170-4ef9-9aae-a4d19c289df6 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ceda5a196244039e5ff5468047198c', 'request_id': 'req-6550f83c-1170-4ef9-9aae-a4d19c289df6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:35.719812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6550f83c-1170-4ef9-9aae-a4d19c289df6 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ceda5a196244039e5ff5468047198c', 'request_id': 'req-6550f83c-1170-4ef9-9aae-a4d19c289df6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:35.733199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5738155a-05f6-4aaa-9748-4d5c5872e67a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:35.734699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5738155a-05f6-4aaa-9748-4d5c5872e67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:35.833435 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3442/6941] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:35.847978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2c914-dfec-46fc-bf53-2d6eca803df8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:35.847978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2c914-dfec-46fc-bf53-2d6eca803df8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:35.847978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2c914-dfec-46fc-bf53-2d6eca803df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:35.880457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3dd2c914-dfec-46fc-bf53-2d6eca803df8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:35.880457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3dd2c914-dfec-46fc-bf53-2d6eca803df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:35.888217 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3443/6942] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:35.891735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2c914-dfec-46fc-bf53-2d6eca803df8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:35.903767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2c914-dfec-46fc-bf53-2d6eca803df8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:35.910438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e46f0-4122-45fd-828b-a220bbf9fd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:35.911218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e46f0-4122-45fd-828b-a220bbf9fd42 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:35.911512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e46f0-4122-45fd-828b-a220bbf9fd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:35.911789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e46f0-4122-45fd-828b-a220bbf9fd42 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:35.912547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e46f0-4122-45fd-828b-a220bbf9fd42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:35.912859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e46f0-4122-45fd-828b-a220bbf9fd42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:35.914917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e46f0-4122-45fd-828b-a220bbf9fd42 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:35.945512 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3444/6943] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:55:35.946686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e46f0-4122-45fd-828b-a220bbf9fd42 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:35.967135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6550f83c-1170-4ef9-9aae-a4d19c289df6 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ceda5a196244039e5ff5468047198c', 'request_id': 'req-6550f83c-1170-4ef9-9aae-a4d19c289df6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:35.973194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e46f0-4122-45fd-828b-a220bbf9fd42 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:35.986485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198845d-2916-4250-a778-cc1d109e702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:35.987108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198845d-2916-4250-a778-cc1d109e702f admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:35.987389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198845d-2916-4250-a778-cc1d109e702f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:35.987730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198845d-2916-4250-a778-cc1d109e702f admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:35.988323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198845d-2916-4250-a778-cc1d109e702f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:35.990481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198845d-2916-4250-a778-cc1d109e702f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:35.999578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6550f83c-1170-4ef9-9aae-a4d19c289df6 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] The token cache is being invalidate because project 89ceda5a196244039e5ff5468047198c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:36.000213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6550f83c-1170-4ef9-9aae-a4d19c289df6 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:36.001325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6550f83c-1170-4ef9-9aae-a4d19c289df6 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:36.007722 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3500/6944] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:35 2022] DELETE /identity/v3/projects/89ceda5a196244039e5ff5468047198c => generated 0 bytes in 951 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:36.008967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550f83c-1170-4ef9-9aae-a4d19c289df6 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:36.012102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6550f83c-1170-4ef9-9aae-a4d19c289df6 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:36.104154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550f83c-1170-4ef9-9aae-a4d19c289df6 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:36.110349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273eb7e-d92f-4bc7-97bd-7f095f936516 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5773d110476e4fe48940b10238f09eb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4ebf69860574d1cbe604c814e6baec1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:36.111836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273eb7e-d92f-4bc7-97bd-7f095f936516 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:36.112308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273eb7e-d92f-4bc7-97bd-7f095f936516 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:36.112804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273eb7e-d92f-4bc7-97bd-7f095f936516 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:36.113720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273eb7e-d92f-4bc7-97bd-7f095f936516 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:36.116057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273eb7e-d92f-4bc7-97bd-7f095f936516 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:36.137885 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-c273eb7e-d92f-4bc7-97bd-7f095f936516 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Could not find domain: 1933a8cc9a4f40b1b2c7afa77d3df437.: keystone.exception.DomainNotFound: Could not find domain: 1933a8cc9a4f40b1b2c7afa77d3df437. Aug 27 04:55:36.137885 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:55:36.137885 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 04:55:36.137885 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 04:55:36.137885 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 04:55:36.137885 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 04:55:36.137885 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 04:55:36.137885 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 04:55:36.137885 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1933a8cc9a4f40b1b2c7afa77d3df437. Aug 27 04:55:36.137885 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:55:36.137885 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:55:36.137885 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:55:36.137885 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:55:36.137885 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:55:36.137885 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:55:36.137885 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:55:36.138977 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:55:36.138977 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:55:36.138977 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:55:36.138977 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:55:36.138977 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:55:36.138977 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:55:36.138977 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:55:36.138977 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 27 04:55:36.138977 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 27 04:55:36.138977 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:55:36.138977 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:55:36.138977 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 04:55:36.138977 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:55:36.138977 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 04:55:36.138977 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 04:55:36.138977 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Aug 27 04:55:36.138977 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Aug 27 04:55:36.140084 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:55:36.140084 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:55:36.140084 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 04:55:36.140084 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 04:55:36.140084 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 04:55:36.140084 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 04:55:36.140084 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 04:55:36.140084 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application with Lock( Aug 27 04:55:36.140084 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 04:55:36.140084 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self._enter() Aug 27 04:55:36.140084 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 04:55:36.140084 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 04:55:36.140084 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 04:55:36.140084 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.creator() Aug 27 04:55:36.140084 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 04:55:36.140084 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application created_value = creator( Aug 27 04:55:36.140084 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 04:55:36.141257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 04:55:36.141257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1933a8cc9a4f40b1b2c7afa77d3df437. Aug 27 04:55:36.141257 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:55:36.157833 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3501/6945] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:36 2022] POST /identity/v3/users => generated 112 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 27 04:55:36.165914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273eb7e-d92f-4bc7-97bd-7f095f936516 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:36.169680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c273eb7e-d92f-4bc7-97bd-7f095f936516 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:36.194768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273eb7e-d92f-4bc7-97bd-7f095f936516 tempest-UsersNegativeTest-274406827 tempest-UsersNegativeTest-274406827-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:36.200947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14087b-cdda-4725-b59d-5f271c74cec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:36.202108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14087b-cdda-4725-b59d-5f271c74cec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:36.202466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14087b-cdda-4725-b59d-5f271c74cec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:36.203055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14087b-cdda-4725-b59d-5f271c74cec7 admin admin] PATH_INFO: `/v3/users/d8a1365e28a0452aafe7cc18723a9902` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:36.204539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14087b-cdda-4725-b59d-5f271c74cec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8a1365e28a0452aafe7cc18723a9902)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:36.206600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14087b-cdda-4725-b59d-5f271c74cec7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:36.283679 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3445/6946] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:35 2022] POST /identity/v3/projects => generated 383 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:36.289596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198845d-2916-4250-a778-cc1d109e702f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:36.293752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a198845d-2916-4250-a778-cc1d109e702f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:36.419537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198845d-2916-4250-a778-cc1d109e702f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:36.434947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164557c-ac54-4a10-ae00-71039286fc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:36.436105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164557c-ac54-4a10-ae00-71039286fc98 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:36.436719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164557c-ac54-4a10-ae00-71039286fc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:36.437196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164557c-ac54-4a10-ae00-71039286fc98 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:36.439091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164557c-ac54-4a10-ae00-71039286fc98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:36.443057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164557c-ac54-4a10-ae00-71039286fc98 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:36.544285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dd14087b-cdda-4725-b59d-5f271c74cec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8a1365e28a0452aafe7cc18723a9902'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:36.546883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dd14087b-cdda-4725-b59d-5f271c74cec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8a1365e28a0452aafe7cc18723a9902'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:36.647517 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3446/6947] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:36 2022] POST /identity/v3/users => generated 292 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:36.651623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164557c-ac54-4a10-ae00-71039286fc98 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:36.667569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164557c-ac54-4a10-ae00-71039286fc98 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:36.675307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dd14087b-cdda-4725-b59d-5f271c74cec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8a1365e28a0452aafe7cc18723a9902'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:36.675942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dd14087b-cdda-4725-b59d-5f271c74cec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8a1365e28a0452aafe7cc18723a9902'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:36.677221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcc81e-fa40-423c-89fa-b161fdeb7e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:36.678361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcc81e-fa40-423c-89fa-b161fdeb7e03 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:36.679220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcc81e-fa40-423c-89fa-b161fdeb7e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:36.679687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcc81e-fa40-423c-89fa-b161fdeb7e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:36.681198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcc81e-fa40-423c-89fa-b161fdeb7e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:36.684279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcc81e-fa40-423c-89fa-b161fdeb7e03 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:36.696256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dd14087b-cdda-4725-b59d-5f271c74cec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8a1365e28a0452aafe7cc18723a9902'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:36.707820 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3447/6948] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:55:36.712070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcc81e-fa40-423c-89fa-b161fdeb7e03 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:36.715452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ecfcc81e-fa40-423c-89fa-b161fdeb7e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:36.730482 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3502/6949] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:36 2022] DELETE /identity/v3/users/d8a1365e28a0452aafe7cc18723a9902 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:55:36.732180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649587-8b9b-4a0e-a4ee-91b90ae3f922 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:36.732480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649587-8b9b-4a0e-a4ee-91b90ae3f922 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:36.732754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649587-8b9b-4a0e-a4ee-91b90ae3f922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:36.735711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcc81e-fa40-423c-89fa-b161fdeb7e03 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:36.775427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7e649587-8b9b-4a0e-a4ee-91b90ae3f922 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:36.777430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7e649587-8b9b-4a0e-a4ee-91b90ae3f922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:36.893859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013ad9f-0e73-4b59-8fbf-8fd8436802b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:36.894664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013ad9f-0e73-4b59-8fbf-8fd8436802b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:36.895018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013ad9f-0e73-4b59-8fbf-8fd8436802b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:36.895358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013ad9f-0e73-4b59-8fbf-8fd8436802b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:36.903377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013ad9f-0e73-4b59-8fbf-8fd8436802b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:36.907155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013ad9f-0e73-4b59-8fbf-8fd8436802b8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:36.941026 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3448/6950] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:55:36.948487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013ad9f-0e73-4b59-8fbf-8fd8436802b8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:36.976886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013ad9f-0e73-4b59-8fbf-8fd8436802b8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:36.990696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77cec8-6e91-41f4-b809-172f7a408858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:36.993420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77cec8-6e91-41f4-b809-172f7a408858 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:36.994617 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3503/6951] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:36.995088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77cec8-6e91-41f4-b809-172f7a408858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:36.995365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77cec8-6e91-41f4-b809-172f7a408858 admin admin] PATH_INFO: `/v3/projects/b501d9614334486889b8f2f2a8fa54bb/users/e4f3108d78ef40199c72c811d0e8dada/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:37.016521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e649587-8b9b-4a0e-a4ee-91b90ae3f922 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:37.018470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7e649587-8b9b-4a0e-a4ee-91b90ae3f922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:37.031748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77cec8-6e91-41f4-b809-172f7a408858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b501d9614334486889b8f2f2a8fa54bb, user_id=e4f3108d78ef40199c72c811d0e8dada, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:37.046407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77cec8-6e91-41f4-b809-172f7a408858 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:37.124639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e649587-8b9b-4a0e-a4ee-91b90ae3f922 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:37.129673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed7a2d-c62e-4b8e-aea2-228d6d696663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:37.130404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed7a2d-c62e-4b8e-aea2-228d6d696663 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:37.130756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed7a2d-c62e-4b8e-aea2-228d6d696663 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:37.131102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed7a2d-c62e-4b8e-aea2-228d6d696663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:37.157350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed7a2d-c62e-4b8e-aea2-228d6d696663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:37.158915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed7a2d-c62e-4b8e-aea2-228d6d696663 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:37.189997 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3449/6952] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:36 2022] PUT /identity/v3/projects/b501d9614334486889b8f2f2a8fa54bb/users/e4f3108d78ef40199c72c811d0e8dada/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:37.191814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97f5db-5d16-4dc0-ae51-1b5044a213b3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:37.192114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97f5db-5d16-4dc0-ae51-1b5044a213b3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:37.192421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97f5db-5d16-4dc0-ae51-1b5044a213b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:37.198087 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3504/6953] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:55:37.285780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bc97f5db-5d16-4dc0-ae51-1b5044a213b3 None None] MFA Rules not processed for user `e4f3108d78ef40199c72c811d0e8dada`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:37.287033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bc97f5db-5d16-4dc0-ae51-1b5044a213b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:37.431532 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3450/6954] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:37.435750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:37.453857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed7a2d-c62e-4b8e-aea2-228d6d696663 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:37.455723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e1ed7a2d-c62e-4b8e-aea2-228d6d696663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:37.505951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed7a2d-c62e-4b8e-aea2-228d6d696663 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:37.621701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8a0d5-bc53-4dd0-9429-276a6abfc427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:37.623087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a0d5-bc53-4dd0-9429-276a6abfc427 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:37.623433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a0d5-bc53-4dd0-9429-276a6abfc427 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:37.623897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a0d5-bc53-4dd0-9429-276a6abfc427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:37.634454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8a0d5-bc53-4dd0-9429-276a6abfc427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:37.636081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8a0d5-bc53-4dd0-9429-276a6abfc427 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:37.657220 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3505/6955] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:55:38.422381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:38.605355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97f5db-5d16-4dc0-ae51-1b5044a213b3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:38.609497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bc97f5db-5d16-4dc0-ae51-1b5044a213b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:38.795491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97f5db-5d16-4dc0-ae51-1b5044a213b3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:38.807970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbc3c7-c731-405d-bdae-dcd982644cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:38.807970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc3c7-c731-405d-bdae-dcd982644cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:38.807970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc3c7-c731-405d-bdae-dcd982644cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:38.812300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc3c7-c731-405d-bdae-dcd982644cbe admin admin] PATH_INFO: `/v3/projects/0efad22da6664389bc2666f4aa539f17` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:38.813949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbc3c7-c731-405d-bdae-dcd982644cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0efad22da6664389bc2666f4aa539f17)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:38.823699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbc3c7-c731-405d-bdae-dcd982644cbe admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:39.106850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6efbc3c7-c731-405d-bdae-dcd982644cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0efad22da6664389bc2666f4aa539f17', 'request_id': 'req-6efbc3c7-c731-405d-bdae-dcd982644cbe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:39.146285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6efbc3c7-c731-405d-bdae-dcd982644cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0efad22da6664389bc2666f4aa539f17', 'request_id': 'req-6efbc3c7-c731-405d-bdae-dcd982644cbe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:39.165254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6efbc3c7-c731-405d-bdae-dcd982644cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0efad22da6664389bc2666f4aa539f17', 'request_id': 'req-6efbc3c7-c731-405d-bdae-dcd982644cbe'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:39.321989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6efbc3c7-c731-405d-bdae-dcd982644cbe admin admin] The token cache is being invalidate because project 0efad22da6664389bc2666f4aa539f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:39.322643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6efbc3c7-c731-405d-bdae-dcd982644cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:39.325515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6efbc3c7-c731-405d-bdae-dcd982644cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:39.328029 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3451/6956] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:38 2022] DELETE /identity/v3/projects/0efad22da6664389bc2666f4aa539f17 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:39.332048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8a0d5-bc53-4dd0-9429-276a6abfc427 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:39.353517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8a0d5-bc53-4dd0-9429-276a6abfc427 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:39.551332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0ccad-1bab-4121-94ca-fa408c66b2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:39.552130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0ccad-1bab-4121-94ca-fa408c66b2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:39.552556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0ccad-1bab-4121-94ca-fa408c66b2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:39.552956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0ccad-1bab-4121-94ca-fa408c66b2d7 admin admin] PATH_INFO: `/v3/users/5773d110476e4fe48940b10238f09eb3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:39.557845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0ccad-1bab-4121-94ca-fa408c66b2d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5773d110476e4fe48940b10238f09eb3)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:39.561014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0ccad-1bab-4121-94ca-fa408c66b2d7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:39.892774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e0c0ccad-1bab-4121-94ca-fa408c66b2d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5773d110476e4fe48940b10238f09eb3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:39.894029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e0c0ccad-1bab-4121-94ca-fa408c66b2d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5773d110476e4fe48940b10238f09eb3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:40.050593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e0c0ccad-1bab-4121-94ca-fa408c66b2d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5773d110476e4fe48940b10238f09eb3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:40.051240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e0c0ccad-1bab-4121-94ca-fa408c66b2d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5773d110476e4fe48940b10238f09eb3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:40.077425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e0c0ccad-1bab-4121-94ca-fa408c66b2d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5773d110476e4fe48940b10238f09eb3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:40.113320 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3506/6957] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:39 2022] DELETE /identity/v3/users/5773d110476e4fe48940b10238f09eb3 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:55:40.915352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:42.042722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbc3c7-c731-405d-bdae-dcd982644cbe admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:42.045775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6efbc3c7-c731-405d-bdae-dcd982644cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:42.097529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbc3c7-c731-405d-bdae-dcd982644cbe admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:42.244895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aae3f2-7e21-4479-9ffe-b1f557d8e41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:42.245945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aae3f2-7e21-4479-9ffe-b1f557d8e41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:42.246545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aae3f2-7e21-4479-9ffe-b1f557d8e41d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:42.247363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aae3f2-7e21-4479-9ffe-b1f557d8e41d admin admin] PATH_INFO: `/v3/projects/c4ebf69860574d1cbe604c814e6baec1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:42.249617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aae3f2-7e21-4479-9ffe-b1f557d8e41d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ebf69860574d1cbe604c814e6baec1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:42.253666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aae3f2-7e21-4479-9ffe-b1f557d8e41d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:42.496823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93aae3f2-7e21-4479-9ffe-b1f557d8e41d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ebf69860574d1cbe604c814e6baec1', 'request_id': 'req-93aae3f2-7e21-4479-9ffe-b1f557d8e41d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:42.518564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93aae3f2-7e21-4479-9ffe-b1f557d8e41d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ebf69860574d1cbe604c814e6baec1', 'request_id': 'req-93aae3f2-7e21-4479-9ffe-b1f557d8e41d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:42.538919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93aae3f2-7e21-4479-9ffe-b1f557d8e41d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ebf69860574d1cbe604c814e6baec1', 'request_id': 'req-93aae3f2-7e21-4479-9ffe-b1f557d8e41d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:42.731273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93aae3f2-7e21-4479-9ffe-b1f557d8e41d admin admin] The token cache is being invalidate because project c4ebf69860574d1cbe604c814e6baec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:42.731273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93aae3f2-7e21-4479-9ffe-b1f557d8e41d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:42.731820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93aae3f2-7e21-4479-9ffe-b1f557d8e41d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:42.737073 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3452/6958] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:42 2022] DELETE /identity/v3/projects/c4ebf69860574d1cbe604c814e6baec1 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:42.742842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3619a8-dbf6-46bb-8410-15b85c5fcf8d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:42.743352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3619a8-dbf6-46bb-8410-15b85c5fcf8d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:42.743452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3619a8-dbf6-46bb-8410-15b85c5fcf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:42.815362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9e3619a8-dbf6-46bb-8410-15b85c5fcf8d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:42.816885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9e3619a8-dbf6-46bb-8410-15b85c5fcf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:42.981135 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3507/6959] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:42.987435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb4908-c2d4-44d0-9b6e-593df2afdb90 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:42.987885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb4908-c2d4-44d0-9b6e-593df2afdb90 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:42.988496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb4908-c2d4-44d0-9b6e-593df2afdb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:43.025456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c6fb4908-c2d4-44d0-9b6e-593df2afdb90 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:43.029404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c6fb4908-c2d4-44d0-9b6e-593df2afdb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:43.049552 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3453/6960] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:43.052760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3619a8-dbf6-46bb-8410-15b85c5fcf8d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:43.066650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3619a8-dbf6-46bb-8410-15b85c5fcf8d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:43.072901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783260f-6377-4db0-9304-7ef123089551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:43.073952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783260f-6377-4db0-9304-7ef123089551 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:43.075023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783260f-6377-4db0-9304-7ef123089551 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:43.075488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783260f-6377-4db0-9304-7ef123089551 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:43.076374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783260f-6377-4db0-9304-7ef123089551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:43.076905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783260f-6377-4db0-9304-7ef123089551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:43.086823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783260f-6377-4db0-9304-7ef123089551 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:43.133716 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3508/6961] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:43.138922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb4908-c2d4-44d0-9b6e-593df2afdb90 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:43.156241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb4908-c2d4-44d0-9b6e-593df2afdb90 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:43.172252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a606fa4-d437-496b-85f9-aa0256443ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:43.174236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a606fa4-d437-496b-85f9-aa0256443ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:43.174738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a606fa4-d437-496b-85f9-aa0256443ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:43.175246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a606fa4-d437-496b-85f9-aa0256443ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:43.194083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a606fa4-d437-496b-85f9-aa0256443ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:43.204449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a606fa4-d437-496b-85f9-aa0256443ec9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:43.342556 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3454/6962] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:43 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:43.346822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783260f-6377-4db0-9304-7ef123089551 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:43.361275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783260f-6377-4db0-9304-7ef123089551 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:43.446191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:43.507810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0c3a6-3ef9-444f-be11-bc3de88004de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:43.508693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0c3a6-3ef9-444f-be11-bc3de88004de admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:43.513083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0c3a6-3ef9-444f-be11-bc3de88004de admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:43.513083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0c3a6-3ef9-444f-be11-bc3de88004de admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:43.513083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0c3a6-3ef9-444f-be11-bc3de88004de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:43.514898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0c3a6-3ef9-444f-be11-bc3de88004de admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:43.666620 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3509/6963] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:43 2022] POST /identity/v3/users => generated 285 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:43.671425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a606fa4-d437-496b-85f9-aa0256443ec9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:43.688930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a606fa4-d437-496b-85f9-aa0256443ec9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:43.706403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01244b18-f80b-4bcc-b2c6-e2522864b303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:43.708879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01244b18-f80b-4bcc-b2c6-e2522864b303 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:43.708879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01244b18-f80b-4bcc-b2c6-e2522864b303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:43.708879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01244b18-f80b-4bcc-b2c6-e2522864b303 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:43.708879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01244b18-f80b-4bcc-b2c6-e2522864b303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:43.710146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01244b18-f80b-4bcc-b2c6-e2522864b303 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:43.712738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0c3a6-3ef9-444f-be11-bc3de88004de admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:43.716404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f0c0c3a6-3ef9-444f-be11-bc3de88004de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:43.739222 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3455/6964] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:43.744984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01244b18-f80b-4bcc-b2c6-e2522864b303 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:43.767070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01244b18-f80b-4bcc-b2c6-e2522864b303 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:43.782280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865df350-4ecf-482d-b607-8b807f05e0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:43.782280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865df350-4ecf-482d-b607-8b807f05e0db admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:43.782562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865df350-4ecf-482d-b607-8b807f05e0db admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:43.782793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865df350-4ecf-482d-b607-8b807f05e0db admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:43.785176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865df350-4ecf-482d-b607-8b807f05e0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:43.787196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865df350-4ecf-482d-b607-8b807f05e0db admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:43.817296 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3456/6965] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:43.819180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865df350-4ecf-482d-b607-8b807f05e0db admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:43.826806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0c3a6-3ef9-444f-be11-bc3de88004de admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:43.838133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e2527-0443-4498-8701-bdf603c775c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:43.839149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2527-0443-4498-8701-bdf603c775c9 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:43.839261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865df350-4ecf-482d-b607-8b807f05e0db admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:43.840849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2527-0443-4498-8701-bdf603c775c9 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:43.841982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2527-0443-4498-8701-bdf603c775c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:43.846095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-791e2527-0443-4498-8701-bdf603c775c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:43.847297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8bfb1-6cd7-4ed2-9124-15b9838a13d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:43.848751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8bfb1-6cd7-4ed2-9124-15b9838a13d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:43.849038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8bfb1-6cd7-4ed2-9124-15b9838a13d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:43.849316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8bfb1-6cd7-4ed2-9124-15b9838a13d1 admin admin] PATH_INFO: `/v3/projects/db8eb5cddcd14f8dada24802e961c3db/users/1f9c26bf3df643098f01f8350f576a3d/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:43.867254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8bfb1-6cd7-4ed2-9124-15b9838a13d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8eb5cddcd14f8dada24802e961c3db, user_id=1f9c26bf3df643098f01f8350f576a3d, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:43.870755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8bfb1-6cd7-4ed2-9124-15b9838a13d1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:43.878348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e2527-0443-4498-8701-bdf603c775c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:43.880700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e2527-0443-4498-8701-bdf603c775c9 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:43.921177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:43.929869 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3510/6966] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:55:44.148740 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3457/6967] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:43 2022] PUT /identity/v3/projects/db8eb5cddcd14f8dada24802e961c3db/users/1f9c26bf3df643098f01f8350f576a3d/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:44.154186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe88e1-95ea-44fd-98b8-e0055623fa32 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:44.158104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe88e1-95ea-44fd-98b8-e0055623fa32 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:44.158635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe88e1-95ea-44fd-98b8-e0055623fa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:44.236747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f9fe88e1-95ea-44fd-98b8-e0055623fa32 None None] MFA Rules not processed for user `1f9c26bf3df643098f01f8350f576a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:44.238387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f9fe88e1-95ea-44fd-98b8-e0055623fa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:44.386917 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3511/6968] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:44.388226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8bfb1-6cd7-4ed2-9124-15b9838a13d1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:44.401335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8bfb1-6cd7-4ed2-9124-15b9838a13d1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:44.420417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748a508-2a29-4f40-980a-916d56caccbc tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9c26bf3df643098f01f8350f576a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8eb5cddcd14f8dada24802e961c3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:44.421374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748a508-2a29-4f40-980a-916d56caccbc tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:44.421817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748a508-2a29-4f40-980a-916d56caccbc tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:44.422232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748a508-2a29-4f40-980a-916d56caccbc tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] PATH_INFO: `/v3/users/1f9c26bf3df643098f01f8350f576a3d/application_credentials` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:44.423060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748a508-2a29-4f40-980a-916d56caccbc tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorizing `identity:create_application_credential(user_id=1f9c26bf3df643098f01f8350f576a3d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:44.428466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748a508-2a29-4f40-980a-916d56caccbc tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:44.649540 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3458/6969] 10.222.0.76 () {60 vars in 1315 bytes} [Sat Aug 27 04:55:44 2022] POST /identity/v3/users/1f9c26bf3df643098f01f8350f576a3d/application_credentials => generated 921 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:44.655023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe88e1-95ea-44fd-98b8-e0055623fa32 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:44.669547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe88e1-95ea-44fd-98b8-e0055623fa32 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:44.689687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6e2b6-ef54-4a1f-81f7-6eaf41bc8a70 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9c26bf3df643098f01f8350f576a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8eb5cddcd14f8dada24802e961c3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:44.695191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6e2b6-ef54-4a1f-81f7-6eaf41bc8a70 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:44.696560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6e2b6-ef54-4a1f-81f7-6eaf41bc8a70 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:44.696871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6e2b6-ef54-4a1f-81f7-6eaf41bc8a70 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] PATH_INFO: `/v3/users/1f9c26bf3df643098f01f8350f576a3d/access_rules/6aba50501c744cd5a205eb4896283831` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:44.701923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6e2b6-ef54-4a1f-81f7-6eaf41bc8a70 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorizing `identity:delete_access_rule(user_id=1f9c26bf3df643098f01f8350f576a3d, access_rule_id=6aba50501c744cd5a205eb4896283831)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:44.704399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6e2b6-ef54-4a1f-81f7-6eaf41bc8a70 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:44.759546 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-6fb6e2b6-ef54-4a1f-81f7-6eaf41bc8a70 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 27 04:55:44.759546 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:55:44.759546 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Aug 27 04:55:44.759546 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application session.delete(ref) Aug 27 04:55:44.759546 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 04:55:44.759546 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application next(self.gen) Aug 27 04:55:44.759546 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 27 04:55:44.759546 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application yield resource Aug 27 04:55:44.759546 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 04:55:44.759546 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application next(self.gen) Aug 27 04:55:44.759546 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 27 04:55:44.759546 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.session.rollback() Aug 27 04:55:44.759546 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 04:55:44.759546 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.force_reraise() Aug 27 04:55:44.759546 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 04:55:44.759546 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise self.value Aug 27 04:55:44.760722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 27 04:55:44.760722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 27 04:55:44.760722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 27 04:55:44.760722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application session.commit() Aug 27 04:55:44.760722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 27 04:55:44.760722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 27 04:55:44.760722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 27 04:55:44.760722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._prepare_impl() Aug 27 04:55:44.760722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 27 04:55:44.760722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.session.flush() Aug 27 04:55:44.760722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 04:55:44.760722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._flush(objects) Aug 27 04:55:44.760722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 04:55:44.760722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 27 04:55:44.760722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 04:55:44.760722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application compat.raise_( Aug 27 04:55:44.761738 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 04:55:44.761738 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception Aug 27 04:55:44.761738 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 04:55:44.761738 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application flush_context.execute() Aug 27 04:55:44.761738 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 04:55:44.761738 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rec.execute(self) Aug 27 04:55:44.761738 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Aug 27 04:55:44.761738 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Aug 27 04:55:44.761738 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Aug 27 04:55:44.761738 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._synchronize( Aug 27 04:55:44.761738 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Aug 27 04:55:44.761738 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Aug 27 04:55:44.761738 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Aug 27 04:55:44.761738 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise AssertionError( Aug 27 04:55:44.761738 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Aug 27 04:55:44.761738 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:55:44.763059 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 04:55:44.763059 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:55:44.763059 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 04:55:44.763059 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 04:55:44.763059 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 04:55:44.763059 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 04:55:44.763059 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 04:55:44.763059 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 04:55:44.763059 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 04:55:44.763059 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 04:55:44.763059 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 04:55:44.763059 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 04:55:44.763059 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 04:55:44.763059 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Aug 27 04:55:44.763059 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Aug 27 04:55:44.763059 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 04:55:44.763059 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 04:55:44.764008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Aug 27 04:55:44.764008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Aug 27 04:55:44.764008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Aug 27 04:55:44.764008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 27 04:55:44.764008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 27 04:55:44.764008 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 04:55:44.764008 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3512/6970] 10.222.0.76 () {58 vars in 1362 bytes} [Sat Aug 27 04:55:44 2022] DELETE /identity/v3/users/1f9c26bf3df643098f01f8350f576a3d/access_rules/6aba50501c744cd5a205eb4896283831 => generated 89 bytes in 113 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Aug 27 04:55:44.766433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748a508-2a29-4f40-980a-916d56caccbc tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:44.780280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748a508-2a29-4f40-980a-916d56caccbc tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:44.796633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fb1d7-34b5-40ae-ad1c-062856462711 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9c26bf3df643098f01f8350f576a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8eb5cddcd14f8dada24802e961c3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:44.797295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fb1d7-34b5-40ae-ad1c-062856462711 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:44.797578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fb1d7-34b5-40ae-ad1c-062856462711 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:44.797853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fb1d7-34b5-40ae-ad1c-062856462711 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] PATH_INFO: `/v3/users/1f9c26bf3df643098f01f8350f576a3d/application_credentials/db023f9c6f3741b7be9a66740ef2303f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:44.818528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31fb1d7-34b5-40ae-ad1c-062856462711 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorizing `identity:delete_application_credential(user_id=1f9c26bf3df643098f01f8350f576a3d, application_credential_id=db023f9c6f3741b7be9a66740ef2303f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:44.820056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31fb1d7-34b5-40ae-ad1c-062856462711 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:45.104900 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3459/6971] 10.222.0.76 () {58 vars in 1395 bytes} [Sat Aug 27 04:55:44 2022] DELETE /identity/v3/users/1f9c26bf3df643098f01f8350f576a3d/application_credentials/db023f9c6f3741b7be9a66740ef2303f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:45.106422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6e2b6-ef54-4a1f-81f7-6eaf41bc8a70 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:45.120310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6e2b6-ef54-4a1f-81f7-6eaf41bc8a70 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:45.134210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b585da-f719-446a-b7ab-ea00e3ebc46b tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9c26bf3df643098f01f8350f576a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8eb5cddcd14f8dada24802e961c3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:45.134881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b585da-f719-446a-b7ab-ea00e3ebc46b tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:45.140772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b585da-f719-446a-b7ab-ea00e3ebc46b tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:45.140772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b585da-f719-446a-b7ab-ea00e3ebc46b tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] PATH_INFO: `/v3/users/1f9c26bf3df643098f01f8350f576a3d/access_rules` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:45.140772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b585da-f719-446a-b7ab-ea00e3ebc46b tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorizing `identity:list_access_rules(user_id=1f9c26bf3df643098f01f8350f576a3d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:45.140772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b585da-f719-446a-b7ab-ea00e3ebc46b tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:45.155511 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3513/6972] 10.222.0.76 () {58 vars in 1260 bytes} [Sat Aug 27 04:55:45 2022] GET /identity/v3/users/1f9c26bf3df643098f01f8350f576a3d/access_rules => generated 369 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:45.159739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fb1d7-34b5-40ae-ad1c-062856462711 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:45.175185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fb1d7-34b5-40ae-ad1c-062856462711 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:45.182867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cf872-8a5f-49ed-a3c5-3eb8833594f8 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9c26bf3df643098f01f8350f576a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8eb5cddcd14f8dada24802e961c3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:45.185928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf872-8a5f-49ed-a3c5-3eb8833594f8 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:45.186264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf872-8a5f-49ed-a3c5-3eb8833594f8 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:45.186549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf872-8a5f-49ed-a3c5-3eb8833594f8 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] PATH_INFO: `/v3/users/1f9c26bf3df643098f01f8350f576a3d/access_rules/6aba50501c744cd5a205eb4896283831` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:45.191209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cf872-8a5f-49ed-a3c5-3eb8833594f8 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorizing `identity:delete_access_rule(user_id=1f9c26bf3df643098f01f8350f576a3d, access_rule_id=6aba50501c744cd5a205eb4896283831)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:45.193667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cf872-8a5f-49ed-a3c5-3eb8833594f8 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:45.304400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b585da-f719-446a-b7ab-ea00e3ebc46b tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:45.314394 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3460/6973] 10.222.0.76 () {58 vars in 1362 bytes} [Sat Aug 27 04:55:45 2022] DELETE /identity/v3/users/1f9c26bf3df643098f01f8350f576a3d/access_rules/6aba50501c744cd5a205eb4896283831 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:45.319787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b585da-f719-446a-b7ab-ea00e3ebc46b tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:45.343059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9325b2-0423-4295-8307-80c3d5b0e34e tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9c26bf3df643098f01f8350f576a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8eb5cddcd14f8dada24802e961c3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:45.343950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9325b2-0423-4295-8307-80c3d5b0e34e tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:45.344416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9325b2-0423-4295-8307-80c3d5b0e34e tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:45.344943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9325b2-0423-4295-8307-80c3d5b0e34e tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] PATH_INFO: `/v3/users/1f9c26bf3df643098f01f8350f576a3d/access_rules` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:45.346674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9325b2-0423-4295-8307-80c3d5b0e34e tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorizing `identity:list_access_rules(user_id=1f9c26bf3df643098f01f8350f576a3d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:45.348870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9325b2-0423-4295-8307-80c3d5b0e34e tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:45.354712 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3514/6974] 10.222.0.76 () {58 vars in 1260 bytes} [Sat Aug 27 04:55:45 2022] GET /identity/v3/users/1f9c26bf3df643098f01f8350f576a3d/access_rules => generated 158 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:55:45.360743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cf872-8a5f-49ed-a3c5-3eb8833594f8 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:45.374349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cf872-8a5f-49ed-a3c5-3eb8833594f8 tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:45.386149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744acc38-cb09-46a7-90b1-cf0f0ccc481d tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9c26bf3df643098f01f8350f576a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8eb5cddcd14f8dada24802e961c3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:45.387267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744acc38-cb09-46a7-90b1-cf0f0ccc481d tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:45.387714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744acc38-cb09-46a7-90b1-cf0f0ccc481d tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:45.388007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744acc38-cb09-46a7-90b1-cf0f0ccc481d tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] PATH_INFO: `/v3/users/1f9c26bf3df643098f01f8350f576a3d/application_credentials` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:45.388728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744acc38-cb09-46a7-90b1-cf0f0ccc481d tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorizing `identity:create_application_credential(user_id=1f9c26bf3df643098f01f8350f576a3d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:45.392350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744acc38-cb09-46a7-90b1-cf0f0ccc481d tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:45.672907 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3461/6975] 10.222.0.76 () {60 vars in 1315 bytes} [Sat Aug 27 04:55:45 2022] POST /identity/v3/users/1f9c26bf3df643098f01f8350f576a3d/application_credentials => generated 921 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:45.676315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9325b2-0423-4295-8307-80c3d5b0e34e tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:45.687080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9325b2-0423-4295-8307-80c3d5b0e34e tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:45.691871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384f4fc-324b-48e6-92a4-063d6d5ac9cf tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9c26bf3df643098f01f8350f576a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8eb5cddcd14f8dada24802e961c3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:45.692627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384f4fc-324b-48e6-92a4-063d6d5ac9cf tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:45.692911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384f4fc-324b-48e6-92a4-063d6d5ac9cf tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:45.693187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384f4fc-324b-48e6-92a4-063d6d5ac9cf tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] PATH_INFO: `/v3/users/1f9c26bf3df643098f01f8350f576a3d/access_rules` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:45.694532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384f4fc-324b-48e6-92a4-063d6d5ac9cf tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorizing `identity:list_access_rules(user_id=1f9c26bf3df643098f01f8350f576a3d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:45.696453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384f4fc-324b-48e6-92a4-063d6d5ac9cf tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:45.702769 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3515/6976] 10.222.0.76 () {58 vars in 1260 bytes} [Sat Aug 27 04:55:45 2022] GET /identity/v3/users/1f9c26bf3df643098f01f8350f576a3d/access_rules => generated 369 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:45.707612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744acc38-cb09-46a7-90b1-cf0f0ccc481d tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:45.721233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744acc38-cb09-46a7-90b1-cf0f0ccc481d tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:45.728760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb9375-1ed5-4127-9704-9d361744be1c tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9c26bf3df643098f01f8350f576a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8eb5cddcd14f8dada24802e961c3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:45.728760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb9375-1ed5-4127-9704-9d361744be1c tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:45.728760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb9375-1ed5-4127-9704-9d361744be1c tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:45.730011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb9375-1ed5-4127-9704-9d361744be1c tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] PATH_INFO: `/v3/users/1f9c26bf3df643098f01f8350f576a3d/application_credentials` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:45.730011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb9375-1ed5-4127-9704-9d361744be1c tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorizing `identity:create_application_credential(user_id=1f9c26bf3df643098f01f8350f576a3d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:45.730011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb9375-1ed5-4127-9704-9d361744be1c tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:46.058030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:46.129305 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3462/6977] 10.222.0.76 () {60 vars in 1315 bytes} [Sat Aug 27 04:55:45 2022] POST /identity/v3/users/1f9c26bf3df643098f01f8350f576a3d/application_credentials => generated 920 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:46.133146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384f4fc-324b-48e6-92a4-063d6d5ac9cf tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:46.147466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384f4fc-324b-48e6-92a4-063d6d5ac9cf tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:46.157985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9f5db-0f68-41b5-9cdb-9c4ddaa365eb tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f9c26bf3df643098f01f8350f576a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db8eb5cddcd14f8dada24802e961c3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:46.158836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9f5db-0f68-41b5-9cdb-9c4ddaa365eb tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:46.159349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9f5db-0f68-41b5-9cdb-9c4ddaa365eb tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:46.159724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9f5db-0f68-41b5-9cdb-9c4ddaa365eb tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] PATH_INFO: `/v3/users/1f9c26bf3df643098f01f8350f576a3d/access_rules/19efc318e55a4c85bf39e036edd031fd` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:46.163211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9f5db-0f68-41b5-9cdb-9c4ddaa365eb tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorizing `identity:get_access_rule(user_id=1f9c26bf3df643098f01f8350f576a3d, access_rule_id=19efc318e55a4c85bf39e036edd031fd)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:46.165016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9f5db-0f68-41b5-9cdb-9c4ddaa365eb tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:46.178225 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3516/6978] 10.222.0.76 () {58 vars in 1359 bytes} [Sat Aug 27 04:55:46 2022] GET /identity/v3/users/1f9c26bf3df643098f01f8350f576a3d/access_rules/19efc318e55a4c85bf39e036edd031fd => generated 229 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:46.182517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb9375-1ed5-4127-9704-9d361744be1c tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:46.362060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb9375-1ed5-4127-9704-9d361744be1c tempest-AccessRulesV3Test-744005047 tempest-AccessRulesV3Test-744005047-project] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:46.368657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ca4e5-b8e9-4002-b2c6-703835b4d7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:46.369329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ca4e5-b8e9-4002-b2c6-703835b4d7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:46.369611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ca4e5-b8e9-4002-b2c6-703835b4d7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:46.369891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ca4e5-b8e9-4002-b2c6-703835b4d7a0 admin admin] PATH_INFO: `/v3/users/1f9c26bf3df643098f01f8350f576a3d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:46.371847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ca4e5-b8e9-4002-b2c6-703835b4d7a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9c26bf3df643098f01f8350f576a3d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:46.374545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ca4e5-b8e9-4002-b2c6-703835b4d7a0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:46.749936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5d3ca4e5-b8e9-4002-b2c6-703835b4d7a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9c26bf3df643098f01f8350f576a3d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:46.870595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5d3ca4e5-b8e9-4002-b2c6-703835b4d7a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9c26bf3df643098f01f8350f576a3d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:46.871380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5d3ca4e5-b8e9-4002-b2c6-703835b4d7a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9c26bf3df643098f01f8350f576a3d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:46.881111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5d3ca4e5-b8e9-4002-b2c6-703835b4d7a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9c26bf3df643098f01f8350f576a3d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:46.988762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:47.376377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5d3ca4e5-b8e9-4002-b2c6-703835b4d7a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9c26bf3df643098f01f8350f576a3d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:47.384021 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3463/6979] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:46 2022] DELETE /identity/v3/users/1f9c26bf3df643098f01f8350f576a3d => generated 0 bytes in 1202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:47.389805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97adc5-d25f-4024-b35d-1336e5f76bc3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:47.394630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97adc5-d25f-4024-b35d-1336e5f76bc3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:47.395199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97adc5-d25f-4024-b35d-1336e5f76bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:47.440567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1a97adc5-d25f-4024-b35d-1336e5f76bc3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:47.442024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1a97adc5-d25f-4024-b35d-1336e5f76bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:47.625480 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3517/6980] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:47.826901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ca4e5-b8e9-4002-b2c6-703835b4d7a0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:47.835299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5d3ca4e5-b8e9-4002-b2c6-703835b4d7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:48.021838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ca4e5-b8e9-4002-b2c6-703835b4d7a0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:48.031450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135460f-51a8-4ca7-9264-3916372818ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:48.032472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135460f-51a8-4ca7-9264-3916372818ae service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:48.032847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135460f-51a8-4ca7-9264-3916372818ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:48.033258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135460f-51a8-4ca7-9264-3916372818ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:48.066934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135460f-51a8-4ca7-9264-3916372818ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:48.068782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135460f-51a8-4ca7-9264-3916372818ae service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:48.081991 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3464/6981] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:55:49.242449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:49.390946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97adc5-d25f-4024-b35d-1336e5f76bc3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:49.393135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1a97adc5-d25f-4024-b35d-1336e5f76bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:49.419466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97adc5-d25f-4024-b35d-1336e5f76bc3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:49.436798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa10a31-0470-4c64-a7fc-5026160f56f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:49.439351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa10a31-0470-4c64-a7fc-5026160f56f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:49.446449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa10a31-0470-4c64-a7fc-5026160f56f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:49.446449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa10a31-0470-4c64-a7fc-5026160f56f7 admin admin] PATH_INFO: `/v3/projects/db8eb5cddcd14f8dada24802e961c3db` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:49.446449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa10a31-0470-4c64-a7fc-5026160f56f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db8eb5cddcd14f8dada24802e961c3db)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:49.454026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa10a31-0470-4c64-a7fc-5026160f56f7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:49.775505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-daa10a31-0470-4c64-a7fc-5026160f56f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db8eb5cddcd14f8dada24802e961c3db', 'request_id': 'req-daa10a31-0470-4c64-a7fc-5026160f56f7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:49.810936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-daa10a31-0470-4c64-a7fc-5026160f56f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db8eb5cddcd14f8dada24802e961c3db', 'request_id': 'req-daa10a31-0470-4c64-a7fc-5026160f56f7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:50.215114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-daa10a31-0470-4c64-a7fc-5026160f56f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db8eb5cddcd14f8dada24802e961c3db', 'request_id': 'req-daa10a31-0470-4c64-a7fc-5026160f56f7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:50.249838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-daa10a31-0470-4c64-a7fc-5026160f56f7 admin admin] The token cache is being invalidate because project db8eb5cddcd14f8dada24802e961c3db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:50.250138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-daa10a31-0470-4c64-a7fc-5026160f56f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:50.252475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-daa10a31-0470-4c64-a7fc-5026160f56f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:50.256431 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3518/6982] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:49 2022] DELETE /identity/v3/projects/db8eb5cddcd14f8dada24802e961c3db => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:50.268364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b29d0-4a30-4415-be40-85473cd85991 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:50.270414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b29d0-4a30-4415-be40-85473cd85991 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:50.270901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b29d0-4a30-4415-be40-85473cd85991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:50.327178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-150b29d0-4a30-4415-be40-85473cd85991 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:50.329117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-150b29d0-4a30-4415-be40-85473cd85991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:50.441361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:50.460806 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3465/6983] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:50.469535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a62c72-6e91-4070-920f-0d1cc697dafc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:50.470662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a62c72-6e91-4070-920f-0d1cc697dafc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:50.470966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a62c72-6e91-4070-920f-0d1cc697dafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:50.515968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-65a62c72-6e91-4070-920f-0d1cc697dafc None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:50.517476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-65a62c72-6e91-4070-920f-0d1cc697dafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:50.545039 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3519/6984] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:50.550659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b29d0-4a30-4415-be40-85473cd85991 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:50.572847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b29d0-4a30-4415-be40-85473cd85991 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:50.581874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912de9fe-8bd3-46d0-90d5-48de0ad68023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:50.587044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912de9fe-8bd3-46d0-90d5-48de0ad68023 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:50.587044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912de9fe-8bd3-46d0-90d5-48de0ad68023 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:50.587044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912de9fe-8bd3-46d0-90d5-48de0ad68023 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:50.587044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912de9fe-8bd3-46d0-90d5-48de0ad68023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:50.587044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912de9fe-8bd3-46d0-90d5-48de0ad68023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:50.593389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912de9fe-8bd3-46d0-90d5-48de0ad68023 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:50.610220 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3466/6985] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:50.614309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a62c72-6e91-4070-920f-0d1cc697dafc None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:50.628574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a62c72-6e91-4070-920f-0d1cc697dafc None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:50.637452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99dca5-728f-4d91-af35-4dd4d22094bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:50.638487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99dca5-728f-4d91-af35-4dd4d22094bc admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:50.638984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99dca5-728f-4d91-af35-4dd4d22094bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:50.639469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99dca5-728f-4d91-af35-4dd4d22094bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:50.640387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99dca5-728f-4d91-af35-4dd4d22094bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:50.642557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99dca5-728f-4d91-af35-4dd4d22094bc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:51.005801 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3520/6986] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:50 2022] POST /identity/v3/projects => generated 367 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:51.009488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912de9fe-8bd3-46d0-90d5-48de0ad68023 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:51.025042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912de9fe-8bd3-46d0-90d5-48de0ad68023 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:51.190125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf80a29-df56-48bb-9fc0-f5215a94a012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:51.191045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf80a29-df56-48bb-9fc0-f5215a94a012 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:51.191240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf80a29-df56-48bb-9fc0-f5215a94a012 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:51.191461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf80a29-df56-48bb-9fc0-f5215a94a012 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:51.192119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf80a29-df56-48bb-9fc0-f5215a94a012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:51.194143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf80a29-df56-48bb-9fc0-f5215a94a012 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:51.425285 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3467/6987] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:51 2022] POST /identity/v3/users => generated 284 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:51.426660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99dca5-728f-4d91-af35-4dd4d22094bc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:51.444752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99dca5-728f-4d91-af35-4dd4d22094bc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:51.459230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1263c-75da-4890-8bca-be6f7523e0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:51.459876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1263c-75da-4890-8bca-be6f7523e0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:51.460178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1263c-75da-4890-8bca-be6f7523e0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:51.460460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1263c-75da-4890-8bca-be6f7523e0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:51.461525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1263c-75da-4890-8bca-be6f7523e0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:51.463829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1263c-75da-4890-8bca-be6f7523e0d8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:51.497802 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3521/6988] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:51.499440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf80a29-df56-48bb-9fc0-f5215a94a012 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:51.513101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf80a29-df56-48bb-9fc0-f5215a94a012 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:51.518438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc47a1-128d-480c-883c-41dc59ad37bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:51.519731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc47a1-128d-480c-883c-41dc59ad37bc admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:51.520132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc47a1-128d-480c-883c-41dc59ad37bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:51.520499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc47a1-128d-480c-883c-41dc59ad37bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:51.521170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc47a1-128d-480c-883c-41dc59ad37bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:51.524785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc47a1-128d-480c-883c-41dc59ad37bc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:51.557296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1263c-75da-4890-8bca-be6f7523e0d8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:51.568149 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3468/6989] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:51.570731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1263c-75da-4890-8bca-be6f7523e0d8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:51.578016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c41935-7678-4e1d-aa6f-8b16ef2e99e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:51.579192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c41935-7678-4e1d-aa6f-8b16ef2e99e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:51.579738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c41935-7678-4e1d-aa6f-8b16ef2e99e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:51.580255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c41935-7678-4e1d-aa6f-8b16ef2e99e3 admin admin] PATH_INFO: `/v3/projects/e491dd67d75f463c983968ae74b4afbe/users/385bd0b8c2c04501ab3a3cf39d9a69c0/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:51.603471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c41935-7678-4e1d-aa6f-8b16ef2e99e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e491dd67d75f463c983968ae74b4afbe, user_id=385bd0b8c2c04501ab3a3cf39d9a69c0, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:51.609779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c41935-7678-4e1d-aa6f-8b16ef2e99e3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:51.724988 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3522/6990] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:51 2022] PUT /identity/v3/projects/e491dd67d75f463c983968ae74b4afbe/users/385bd0b8c2c04501ab3a3cf39d9a69c0/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:51.885615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e90a6-ab70-41b7-87b5-7653aa57ca7d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:51.885615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e90a6-ab70-41b7-87b5-7653aa57ca7d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:51.885615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e90a6-ab70-41b7-87b5-7653aa57ca7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:51.963359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-184e90a6-ab70-41b7-87b5-7653aa57ca7d None None] MFA Rules not processed for user `385bd0b8c2c04501ab3a3cf39d9a69c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:51.964871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-184e90a6-ab70-41b7-87b5-7653aa57ca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:52.140314 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3469/6991] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:52.140443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c41935-7678-4e1d-aa6f-8b16ef2e99e3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:52.164729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c41935-7678-4e1d-aa6f-8b16ef2e99e3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:52.175959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4af11-278c-4f8e-a119-13f8090f8171 tempest-TestApiDiscovery-537417230 tempest-TestApiDiscovery-537417230-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385bd0b8c2c04501ab3a3cf39d9a69c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e491dd67d75f463c983968ae74b4afbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:52.188195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4af11-278c-4f8e-a119-13f8090f8171 tempest-TestApiDiscovery-537417230 tempest-TestApiDiscovery-537417230-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:52.188195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4af11-278c-4f8e-a119-13f8090f8171 tempest-TestApiDiscovery-537417230 tempest-TestApiDiscovery-537417230-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:52.188195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4af11-278c-4f8e-a119-13f8090f8171 tempest-TestApiDiscovery-537417230 tempest-TestApiDiscovery-537417230-project] PATH_INFO: `/v3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:52.188195 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3523/6992] 10.222.0.76 () {58 vars in 1104 bytes} [Sat Aug 27 04:55:52 2022] GET /identity/v3 => generated 255 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:52.192458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e90a6-ab70-41b7-87b5-7653aa57ca7d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:52.205145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e90a6-ab70-41b7-87b5-7653aa57ca7d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:52.228710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c65c38-433f-4c22-8d78-8f06c6808a64 tempest-TestApiDiscovery-537417230 tempest-TestApiDiscovery-537417230-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385bd0b8c2c04501ab3a3cf39d9a69c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e491dd67d75f463c983968ae74b4afbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:52.229634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c65c38-433f-4c22-8d78-8f06c6808a64 tempest-TestApiDiscovery-537417230 tempest-TestApiDiscovery-537417230-project] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:52.230923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c65c38-433f-4c22-8d78-8f06c6808a64 tempest-TestApiDiscovery-537417230 tempest-TestApiDiscovery-537417230-project] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:52.232491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c65c38-433f-4c22-8d78-8f06c6808a64 tempest-TestApiDiscovery-537417230 tempest-TestApiDiscovery-537417230-project] PATH_INFO: `/v3` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:52.234141 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3470/6993] 10.222.0.76 () {58 vars in 1104 bytes} [Sat Aug 27 04:55:52 2022] GET /identity/v3 => generated 255 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:52.239404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4af11-278c-4f8e-a119-13f8090f8171 tempest-TestApiDiscovery-537417230 tempest-TestApiDiscovery-537417230-project] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:52.254887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4af11-278c-4f8e-a119-13f8090f8171 tempest-TestApiDiscovery-537417230 tempest-TestApiDiscovery-537417230-project] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:52.273519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abfe1b5-f7f2-4e57-bd9a-a04980f8cdc9 tempest-TestApiDiscovery-537417230 tempest-TestApiDiscovery-537417230-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385bd0b8c2c04501ab3a3cf39d9a69c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e491dd67d75f463c983968ae74b4afbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:52.275382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfe1b5-f7f2-4e57-bd9a-a04980f8cdc9 tempest-TestApiDiscovery-537417230 tempest-TestApiDiscovery-537417230-project] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:52.275743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfe1b5-f7f2-4e57-bd9a-a04980f8cdc9 tempest-TestApiDiscovery-537417230 tempest-TestApiDiscovery-537417230-project] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:52.277935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfe1b5-f7f2-4e57-bd9a-a04980f8cdc9 tempest-TestApiDiscovery-537417230 tempest-TestApiDiscovery-537417230-project] PATH_INFO: `/v3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:52.285578 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3524/6994] 10.222.0.76 () {58 vars in 1104 bytes} [Sat Aug 27 04:55:52 2022] GET /identity/v3 => generated 255 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:52.302459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aed3e-dada-4dd3-8968-97b9dbad082d None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:52.302929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aed3e-dada-4dd3-8968-97b9dbad082d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:52.303273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aed3e-dada-4dd3-8968-97b9dbad082d None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:52.305449 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3471/6995] 10.222.0.76 () {56 vars in 895 bytes} [Sat Aug 27 04:55:52 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:55:52.311553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e516d-3eff-456a-b837-25b21f09907a None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:52.311945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e516d-3eff-456a-b837-25b21f09907a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:52.312315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e516d-3eff-456a-b837-25b21f09907a None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:52.320903 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3525/6996] 10.222.0.76 () {56 vars in 895 bytes} [Sat Aug 27 04:55:52 2022] GET /identity/ => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 04:55:52.326364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aed3e-dada-4dd3-8968-97b9dbad082d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:52.331269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:52.503536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aed3e-dada-4dd3-8968-97b9dbad082d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:52.520685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2f8f4-2d6f-4bfe-b0f2-60e8f2174ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:52.521464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f8f4-2d6f-4bfe-b0f2-60e8f2174ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:52.521844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f8f4-2d6f-4bfe-b0f2-60e8f2174ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:52.522240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f8f4-2d6f-4bfe-b0f2-60e8f2174ab1 admin admin] PATH_INFO: `/v3/users/385bd0b8c2c04501ab3a3cf39d9a69c0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:52.525137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2f8f4-2d6f-4bfe-b0f2-60e8f2174ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=385bd0b8c2c04501ab3a3cf39d9a69c0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:52.533727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2f8f4-2d6f-4bfe-b0f2-60e8f2174ab1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:52.877783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-30c2f8f4-2d6f-4bfe-b0f2-60e8f2174ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '385bd0b8c2c04501ab3a3cf39d9a69c0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:53.227865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-30c2f8f4-2d6f-4bfe-b0f2-60e8f2174ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '385bd0b8c2c04501ab3a3cf39d9a69c0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:53.229090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-30c2f8f4-2d6f-4bfe-b0f2-60e8f2174ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '385bd0b8c2c04501ab3a3cf39d9a69c0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:53.242233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-30c2f8f4-2d6f-4bfe-b0f2-60e8f2174ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '385bd0b8c2c04501ab3a3cf39d9a69c0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:53.300563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-30c2f8f4-2d6f-4bfe-b0f2-60e8f2174ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '385bd0b8c2c04501ab3a3cf39d9a69c0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:53.326300 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3472/6997] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:52 2022] DELETE /identity/v3/users/385bd0b8c2c04501ab3a3cf39d9a69c0 => generated 0 bytes in 1000 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:53.330590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b1522-8cae-4bcc-a7fc-046603942699 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:53.331393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b1522-8cae-4bcc-a7fc-046603942699 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:53.331816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b1522-8cae-4bcc-a7fc-046603942699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:53.378105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a92b1522-8cae-4bcc-a7fc-046603942699 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:53.383612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a92b1522-8cae-4bcc-a7fc-046603942699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:53.508122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:53.568816 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3526/6998] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:53.640147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2f8f4-2d6f-4bfe-b0f2-60e8f2174ab1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:53.645979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-30c2f8f4-2d6f-4bfe-b0f2-60e8f2174ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:53.750865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2f8f4-2d6f-4bfe-b0f2-60e8f2174ab1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:53.755362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef7c61-ac68-40c5-bafc-2fadad973792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:53.756265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef7c61-ac68-40c5-bafc-2fadad973792 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:53.756755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef7c61-ac68-40c5-bafc-2fadad973792 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:53.757250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef7c61-ac68-40c5-bafc-2fadad973792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:53.795734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef7c61-ac68-40c5-bafc-2fadad973792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:53.795734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef7c61-ac68-40c5-bafc-2fadad973792 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:53.805412 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3473/6999] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:55:55.166697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:55.656933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b1522-8cae-4bcc-a7fc-046603942699 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:55.658048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a92b1522-8cae-4bcc-a7fc-046603942699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:55.671538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef7c61-ac68-40c5-bafc-2fadad973792 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:55.673273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-96ef7c61-ac68-40c5-bafc-2fadad973792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:55.696127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b1522-8cae-4bcc-a7fc-046603942699 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:55.721020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbaa3d-0122-41e8-90d1-9dde81d4618c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:55.722036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbaa3d-0122-41e8-90d1-9dde81d4618c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:55.722483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbaa3d-0122-41e8-90d1-9dde81d4618c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:55.723025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbaa3d-0122-41e8-90d1-9dde81d4618c admin admin] PATH_INFO: `/v3/projects/e491dd67d75f463c983968ae74b4afbe` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:55.724748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbaa3d-0122-41e8-90d1-9dde81d4618c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e491dd67d75f463c983968ae74b4afbe)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:55.727308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbaa3d-0122-41e8-90d1-9dde81d4618c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:55.925547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef7c61-ac68-40c5-bafc-2fadad973792 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:55.933400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189da30f-381d-4e6b-8fab-13a8abb1c0c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:55.946996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189da30f-381d-4e6b-8fab-13a8abb1c0c5 service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:55.947501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189da30f-381d-4e6b-8fab-13a8abb1c0c5 service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:55.947932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189da30f-381d-4e6b-8fab-13a8abb1c0c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:55.952495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-189da30f-381d-4e6b-8fab-13a8abb1c0c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:55.980726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189da30f-381d-4e6b-8fab-13a8abb1c0c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:55.982751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189da30f-381d-4e6b-8fab-13a8abb1c0c5 service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:56.001494 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3474/7000] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:55:56.007405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61fbaa3d-0122-41e8-90d1-9dde81d4618c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e491dd67d75f463c983968ae74b4afbe', 'request_id': 'req-61fbaa3d-0122-41e8-90d1-9dde81d4618c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:56.033654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61fbaa3d-0122-41e8-90d1-9dde81d4618c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e491dd67d75f463c983968ae74b4afbe', 'request_id': 'req-61fbaa3d-0122-41e8-90d1-9dde81d4618c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:56.192192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61fbaa3d-0122-41e8-90d1-9dde81d4618c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e491dd67d75f463c983968ae74b4afbe', 'request_id': 'req-61fbaa3d-0122-41e8-90d1-9dde81d4618c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:56.212650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189da30f-381d-4e6b-8fab-13a8abb1c0c5 service placement] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:56.215450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-189da30f-381d-4e6b-8fab-13a8abb1c0c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:56.220400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61fbaa3d-0122-41e8-90d1-9dde81d4618c admin admin] The token cache is being invalidate because project e491dd67d75f463c983968ae74b4afbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:56.221114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61fbaa3d-0122-41e8-90d1-9dde81d4618c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:56.222246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61fbaa3d-0122-41e8-90d1-9dde81d4618c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:56.230452 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3527/7001] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:55 2022] DELETE /identity/v3/projects/e491dd67d75f463c983968ae74b4afbe => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:56.235780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c26ee7-9f1c-4b13-8367-3f041d406841 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:56.236326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c26ee7-9f1c-4b13-8367-3f041d406841 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:56.236758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c26ee7-9f1c-4b13-8367-3f041d406841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:56.254465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189da30f-381d-4e6b-8fab-13a8abb1c0c5 service placement] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:56.274739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-64c26ee7-9f1c-4b13-8367-3f041d406841 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:56.276244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-64c26ee7-9f1c-4b13-8367-3f041d406841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:56.389401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd44ce0-97df-43d9-a0f6-d9c7d94eafa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:56.391979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd44ce0-97df-43d9-a0f6-d9c7d94eafa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:56.392474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd44ce0-97df-43d9-a0f6-d9c7d94eafa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:56.392760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd44ce0-97df-43d9-a0f6-d9c7d94eafa0 admin admin] PATH_INFO: `/v3/users/b301a29d89864d6ba56c1ff7011fd1ca` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:56.395638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd44ce0-97df-43d9-a0f6-d9c7d94eafa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b301a29d89864d6ba56c1ff7011fd1ca)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:56.397660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd44ce0-97df-43d9-a0f6-d9c7d94eafa0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:56.443480 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3528/7002] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:56.452944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6d70c-818d-42b2-bad0-37abf70a797f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:56.453456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6d70c-818d-42b2-bad0-37abf70a797f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:56.453935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6d70c-818d-42b2-bad0-37abf70a797f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:56.509181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-68e6d70c-818d-42b2-bad0-37abf70a797f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:56.510558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-68e6d70c-818d-42b2-bad0-37abf70a797f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:56.538109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:56.541463 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3529/7003] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:55:56.542685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6d70c-818d-42b2-bad0-37abf70a797f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:56.558699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6d70c-818d-42b2-bad0-37abf70a797f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:56.565100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cb482-6733-4254-aae2-11f5a03bd29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:56.565989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cb482-6733-4254-aae2-11f5a03bd29c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:56.566435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cb482-6733-4254-aae2-11f5a03bd29c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:56.566853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cb482-6733-4254-aae2-11f5a03bd29c admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:56.567661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cb482-6733-4254-aae2-11f5a03bd29c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:56.568142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cb482-6733-4254-aae2-11f5a03bd29c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:56.576736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cb482-6733-4254-aae2-11f5a03bd29c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:56.617050 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3530/7004] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:55:56.628723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cb482-6733-4254-aae2-11f5a03bd29c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:56.650636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:55:56.659507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cb482-6733-4254-aae2-11f5a03bd29c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:56.677325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f6b25-359e-4cd7-89cc-41bfe7ccb13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:56.678079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f6b25-359e-4cd7-89cc-41bfe7ccb13d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:56.678418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f6b25-359e-4cd7-89cc-41bfe7ccb13d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:56.678697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f6b25-359e-4cd7-89cc-41bfe7ccb13d admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:56.679964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f6b25-359e-4cd7-89cc-41bfe7ccb13d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:56.681965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f6b25-359e-4cd7-89cc-41bfe7ccb13d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:56.694419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3cd44ce0-97df-43d9-a0f6-d9c7d94eafa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b301a29d89864d6ba56c1ff7011fd1ca'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:56.864989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3cd44ce0-97df-43d9-a0f6-d9c7d94eafa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b301a29d89864d6ba56c1ff7011fd1ca'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:56.866145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3cd44ce0-97df-43d9-a0f6-d9c7d94eafa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b301a29d89864d6ba56c1ff7011fd1ca'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:56.891092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3cd44ce0-97df-43d9-a0f6-d9c7d94eafa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b301a29d89864d6ba56c1ff7011fd1ca'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:56.923311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3cd44ce0-97df-43d9-a0f6-d9c7d94eafa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b301a29d89864d6ba56c1ff7011fd1ca'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:56.943940 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3531/7005] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:56 2022] POST /identity/v3/projects => generated 381 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:56.945518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f6b25-359e-4cd7-89cc-41bfe7ccb13d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:56.947438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-443f6b25-359e-4cd7-89cc-41bfe7ccb13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:56.956687 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3475/7006] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:55:56 2022] DELETE /identity/v3/users/b301a29d89864d6ba56c1ff7011fd1ca => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:55:56.970164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d4238-5ed1-46d4-b60b-2763bad8c4db None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:56.970164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d4238-5ed1-46d4-b60b-2763bad8c4db None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:56.970164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d4238-5ed1-46d4-b60b-2763bad8c4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:57.030428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-319d4238-5ed1-46d4-b60b-2763bad8c4db None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:57.031917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-319d4238-5ed1-46d4-b60b-2763bad8c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:57.118450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f6b25-359e-4cd7-89cc-41bfe7ccb13d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:57.234597 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3476/7007] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:57.328730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d4238-5ed1-46d4-b60b-2763bad8c4db None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:57.330548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-319d4238-5ed1-46d4-b60b-2763bad8c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:57.379475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846f6b9-ef49-40e4-9669-d100e4b832e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:57.380588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846f6b9-ef49-40e4-9669-d100e4b832e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:57.380588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846f6b9-ef49-40e4-9669-d100e4b832e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:57.380968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846f6b9-ef49-40e4-9669-d100e4b832e6 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:57.393112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846f6b9-ef49-40e4-9669-d100e4b832e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:57.399023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846f6b9-ef49-40e4-9669-d100e4b832e6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:57.473635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d4238-5ed1-46d4-b60b-2763bad8c4db None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:57.484185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f715f-8ed7-4a51-a891-c1f5f849c594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:57.485109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f715f-8ed7-4a51-a891-c1f5f849c594 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:57.485546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f715f-8ed7-4a51-a891-c1f5f849c594 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:57.485972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f715f-8ed7-4a51-a891-c1f5f849c594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:57.530278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f715f-8ed7-4a51-a891-c1f5f849c594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:57.531863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f715f-8ed7-4a51-a891-c1f5f849c594 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:57.569240 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3477/7008] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:55:57.601728 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3532/7009] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:56 2022] POST /identity/v3/users => generated 297 bytes in 648 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:57.601836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f715f-8ed7-4a51-a891-c1f5f849c594 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:57.612123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f715f-8ed7-4a51-a891-c1f5f849c594 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:57.627532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214ccef-6e08-45f3-81a2-bd014012665a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:57.628172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214ccef-6e08-45f3-81a2-bd014012665a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:57.628471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214ccef-6e08-45f3-81a2-bd014012665a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:57.628751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214ccef-6e08-45f3-81a2-bd014012665a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:57.629408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214ccef-6e08-45f3-81a2-bd014012665a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:57.631143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214ccef-6e08-45f3-81a2-bd014012665a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:57.654343 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3478/7010] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:57.656520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846f6b9-ef49-40e4-9669-d100e4b832e6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:57.680089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846f6b9-ef49-40e4-9669-d100e4b832e6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:57.705711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfab073-e559-4e06-ad45-4ef5c46d6b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:57.707975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfab073-e559-4e06-ad45-4ef5c46d6b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:57.708296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfab073-e559-4e06-ad45-4ef5c46d6b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:57.708578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfab073-e559-4e06-ad45-4ef5c46d6b9d admin admin] PATH_INFO: `/v3/projects/85fc859acefb4e85abef86462c5a1949/users/5a8c6128d316400fb296a5c1797ba6d7/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:57.755755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfab073-e559-4e06-ad45-4ef5c46d6b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=85fc859acefb4e85abef86462c5a1949, user_id=5a8c6128d316400fb296a5c1797ba6d7, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:57.758456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfab073-e559-4e06-ad45-4ef5c46d6b9d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:57.910352 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3533/7011] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:57 2022] PUT /identity/v3/projects/85fc859acefb4e85abef86462c5a1949/users/5a8c6128d316400fb296a5c1797ba6d7/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:57.914412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214ccef-6e08-45f3-81a2-bd014012665a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:57.938144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214ccef-6e08-45f3-81a2-bd014012665a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:58.117056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c023f-f283-47ea-8bfc-fff0d40b0e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:58.118209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c023f-f283-47ea-8bfc-fff0d40b0e25 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:58.118744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c023f-f283-47ea-8bfc-fff0d40b0e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:58.119240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c023f-f283-47ea-8bfc-fff0d40b0e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:58.121686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c023f-f283-47ea-8bfc-fff0d40b0e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:58.124980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c023f-f283-47ea-8bfc-fff0d40b0e25 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:58.165989 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3479/7012] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:55:58.166504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfab073-e559-4e06-ad45-4ef5c46d6b9d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:58.184809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfab073-e559-4e06-ad45-4ef5c46d6b9d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:58.204453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f4e15-882a-4a02-9128-4dd6502f63e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:58.204453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4e15-882a-4a02-9128-4dd6502f63e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:58.204453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4e15-882a-4a02-9128-4dd6502f63e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:58.204453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f4e15-882a-4a02-9128-4dd6502f63e1 admin admin] PATH_INFO: `/v3/projects/85fc859acefb4e85abef86462c5a1949/users/5a8c6128d316400fb296a5c1797ba6d7/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:58.211716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f4e15-882a-4a02-9128-4dd6502f63e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85fc859acefb4e85abef86462c5a1949, user_id=5a8c6128d316400fb296a5c1797ba6d7, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:58.224211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f4e15-882a-4a02-9128-4dd6502f63e1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:58.270512 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3534/7013] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:55:58 2022] PUT /identity/v3/projects/85fc859acefb4e85abef86462c5a1949/users/5a8c6128d316400fb296a5c1797ba6d7/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:58.291262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea386f9-4152-4fd7-9c06-a477381c07f9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:58.293838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea386f9-4152-4fd7-9c06-a477381c07f9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:58.294270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea386f9-4152-4fd7-9c06-a477381c07f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:58.348104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f4e15-882a-4a02-9128-4dd6502f63e1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:58.350803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0f3f4e15-882a-4a02-9128-4dd6502f63e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:58.473080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5ea386f9-4152-4fd7-9c06-a477381c07f9 None None] MFA Rules not processed for user `5a8c6128d316400fb296a5c1797ba6d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:58.481610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5ea386f9-4152-4fd7-9c06-a477381c07f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:58.534206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f4e15-882a-4a02-9128-4dd6502f63e1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:58.547920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a949de-3ad7-41b4-afb5-4d70b900b5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:58.548662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a949de-3ad7-41b4-afb5-4d70b900b5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:58.549407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a949de-3ad7-41b4-afb5-4d70b900b5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:58.549693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a949de-3ad7-41b4-afb5-4d70b900b5f3 admin admin] PATH_INFO: `/v3/projects/7aea786a98fb4d128403534dc8742871` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:58.552662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a949de-3ad7-41b4-afb5-4d70b900b5f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aea786a98fb4d128403534dc8742871)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:58.554972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a949de-3ad7-41b4-afb5-4d70b900b5f3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:58.715250 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3480/7014] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:58.718843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea386f9-4152-4fd7-9c06-a477381c07f9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:58.764541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea386f9-4152-4fd7-9c06-a477381c07f9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:58.791227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-68a949de-3ad7-41b4-afb5-4d70b900b5f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aea786a98fb4d128403534dc8742871', 'request_id': 'req-68a949de-3ad7-41b4-afb5-4d70b900b5f3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:58.805764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-68a949de-3ad7-41b4-afb5-4d70b900b5f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aea786a98fb4d128403534dc8742871', 'request_id': 'req-68a949de-3ad7-41b4-afb5-4d70b900b5f3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:58.943124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-68a949de-3ad7-41b4-afb5-4d70b900b5f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aea786a98fb4d128403534dc8742871', 'request_id': 'req-68a949de-3ad7-41b4-afb5-4d70b900b5f3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:58.978134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-68a949de-3ad7-41b4-afb5-4d70b900b5f3 admin admin] The token cache is being invalidate because project 7aea786a98fb4d128403534dc8742871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:55:58.978763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-68a949de-3ad7-41b4-afb5-4d70b900b5f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:58.981436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-68a949de-3ad7-41b4-afb5-4d70b900b5f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:55:58.988490 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3535/7015] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:55:58 2022] DELETE /identity/v3/projects/7aea786a98fb4d128403534dc8742871 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:55:58.994325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341afbe4-2652-4248-a956-bbf85fd21104 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:58.994795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341afbe4-2652-4248-a956-bbf85fd21104 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:58.995817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341afbe4-2652-4248-a956-bbf85fd21104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:58.999626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c20614-36d1-4628-ba62-b413e5c19a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:59.000606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c20614-36d1-4628-ba62-b413e5c19a14 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:59.001525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c20614-36d1-4628-ba62-b413e5c19a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:59.002276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c20614-36d1-4628-ba62-b413e5c19a14 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:59.003197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c20614-36d1-4628-ba62-b413e5c19a14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:59.007675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c20614-36d1-4628-ba62-b413e5c19a14 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:59.049372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-341afbe4-2652-4248-a956-bbf85fd21104 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:59.050644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-341afbe4-2652-4248-a956-bbf85fd21104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:59.075233 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3536/7016] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:55:59.079385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e435ce5-b42a-430d-9969-f88d369065a9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:59.079885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e435ce5-b42a-430d-9969-f88d369065a9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:59.080516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e435ce5-b42a-430d-9969-f88d369065a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:59.155236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3e435ce5-b42a-430d-9969-f88d369065a9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:55:59.158052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3e435ce5-b42a-430d-9969-f88d369065a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:59.185558 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3537/7017] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:55:59.189873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e435ce5-b42a-430d-9969-f88d369065a9 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:59.227087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e435ce5-b42a-430d-9969-f88d369065a9 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:59.246627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef815d2-9389-428c-bb5e-4d1e1b553183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:59.247557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef815d2-9389-428c-bb5e-4d1e1b553183 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:59.247903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef815d2-9389-428c-bb5e-4d1e1b553183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:59.248214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef815d2-9389-428c-bb5e-4d1e1b553183 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:59.248929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef815d2-9389-428c-bb5e-4d1e1b553183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:55:59.249246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef815d2-9389-428c-bb5e-4d1e1b553183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:59.251830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef815d2-9389-428c-bb5e-4d1e1b553183 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:59.274855 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3538/7018] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:55:59.281825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef815d2-9389-428c-bb5e-4d1e1b553183 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:59.312286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef815d2-9389-428c-bb5e-4d1e1b553183 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:59.327672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268cd94-150a-4f9d-8aba-0cc81ed3c2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:59.328336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268cd94-150a-4f9d-8aba-0cc81ed3c2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:59.328623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268cd94-150a-4f9d-8aba-0cc81ed3c2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:59.328911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268cd94-150a-4f9d-8aba-0cc81ed3c2d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:59.330755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268cd94-150a-4f9d-8aba-0cc81ed3c2d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:59.337307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268cd94-150a-4f9d-8aba-0cc81ed3c2d7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:59.354473 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3481/7019] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:58 2022] POST /identity/v3/projects => generated 379 bytes in 639 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:59.369744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c20614-36d1-4628-ba62-b413e5c19a14 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:59.376233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-15c20614-36d1-4628-ba62-b413e5c19a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:55:59.484707 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3539/7020] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:55:59 2022] POST /identity/v3/projects => generated 369 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:59.494987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268cd94-150a-4f9d-8aba-0cc81ed3c2d7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:59.644885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c20614-36d1-4628-ba62-b413e5c19a14 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:59.735853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268cd94-150a-4f9d-8aba-0cc81ed3c2d7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:59.756981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922b680-3d23-4d36-bb14-2c3d9b7b103b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:59.758869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682d2ac-e79f-45e2-8dc1-cd77df6093f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:59.759757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682d2ac-e79f-45e2-8dc1-cd77df6093f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:59.760474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682d2ac-e79f-45e2-8dc1-cd77df6093f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:59.761489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922b680-3d23-4d36-bb14-2c3d9b7b103b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:59.761839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922b680-3d23-4d36-bb14-2c3d9b7b103b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:59.762135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922b680-3d23-4d36-bb14-2c3d9b7b103b admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:59.762809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922b680-3d23-4d36-bb14-2c3d9b7b103b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:59.763349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682d2ac-e79f-45e2-8dc1-cd77df6093f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:55:59.764275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682d2ac-e79f-45e2-8dc1-cd77df6093f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:55:59.764819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922b680-3d23-4d36-bb14-2c3d9b7b103b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:59.767734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682d2ac-e79f-45e2-8dc1-cd77df6093f3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:55:59.959615 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3540/7021] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:59 2022] POST /identity/v3/users => generated 285 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:59.965630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922b680-3d23-4d36-bb14-2c3d9b7b103b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:59.967184 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3482/7022] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:55:59 2022] POST /identity/v3/users => generated 290 bytes in 598 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:55:59.971104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682d2ac-e79f-45e2-8dc1-cd77df6093f3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:55:59.996024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682d2ac-e79f-45e2-8dc1-cd77df6093f3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:55:59.997027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2802b-f30c-4d36-8a00-bb06ee1ecb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:55:59.997027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2802b-f30c-4d36-8a00-bb06ee1ecb99 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:55:59.997185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2802b-f30c-4d36-8a00-bb06ee1ecb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:55:59.997863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2802b-f30c-4d36-8a00-bb06ee1ecb99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:00.001301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2802b-f30c-4d36-8a00-bb06ee1ecb99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:00.005550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2802b-f30c-4d36-8a00-bb06ee1ecb99 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:00.009176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922b680-3d23-4d36-bb14-2c3d9b7b103b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:00.022991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a1c31-4a28-49ef-88d7-08ed80a1b86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:00.024074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a1c31-4a28-49ef-88d7-08ed80a1b86c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:00.024605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a1c31-4a28-49ef-88d7-08ed80a1b86c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:00.025269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a1c31-4a28-49ef-88d7-08ed80a1b86c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:00.026137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a1c31-4a28-49ef-88d7-08ed80a1b86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:00.028988 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3483/7023] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:56:00.033367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2802b-f30c-4d36-8a00-bb06ee1ecb99 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:00.033972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a1c31-4a28-49ef-88d7-08ed80a1b86c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:00.059211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2802b-f30c-4d36-8a00-bb06ee1ecb99 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:00.071843 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3541/7024] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:56:00.077349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bd55f-d945-44b3-b482-3df2542d3616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:00.078027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bd55f-d945-44b3-b482-3df2542d3616 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:00.078318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bd55f-d945-44b3-b482-3df2542d3616 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:00.078600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bd55f-d945-44b3-b482-3df2542d3616 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:00.081196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bd55f-d945-44b3-b482-3df2542d3616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:00.089991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bd55f-d945-44b3-b482-3df2542d3616 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:00.094328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a1c31-4a28-49ef-88d7-08ed80a1b86c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:00.109547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a1c31-4a28-49ef-88d7-08ed80a1b86c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:00.115325 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3484/7025] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:56:00.119547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bd55f-d945-44b3-b482-3df2542d3616 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:00.123800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f7263-f41f-412f-b953-9f1a6589a7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:00.124850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7263-f41f-412f-b953-9f1a6589a7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:00.125263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7263-f41f-412f-b953-9f1a6589a7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:00.125652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7263-f41f-412f-b953-9f1a6589a7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:00.126412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f7263-f41f-412f-b953-9f1a6589a7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:00.130079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f7263-f41f-412f-b953-9f1a6589a7c4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:00.175756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bd55f-d945-44b3-b482-3df2542d3616 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:00.175756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8cb6b-6ce5-4c2c-8d67-fca419307a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:00.175987 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3542/7026] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:56:00.176066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8cb6b-6ce5-4c2c-8d67-fca419307a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:00.176066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8cb6b-6ce5-4c2c-8d67-fca419307a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:00.176066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8cb6b-6ce5-4c2c-8d67-fca419307a34 admin admin] PATH_INFO: `/v3/projects/79badc299eae4b8bbff306ca05fcd54d/users/0cc998b3da9a413985e098f05d8800bd/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:00.179387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f7263-f41f-412f-b953-9f1a6589a7c4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:00.214728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f7263-f41f-412f-b953-9f1a6589a7c4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:00.227607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd1ecb-7321-46a3-a2b7-3139fd5aaf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:00.228715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd1ecb-7321-46a3-a2b7-3139fd5aaf61 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:00.229222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd1ecb-7321-46a3-a2b7-3139fd5aaf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:00.229847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd1ecb-7321-46a3-a2b7-3139fd5aaf61 admin admin] PATH_INFO: `/v3/projects/be8944f580af495191f8edd06de8f901/users/71706d41af8b42289cd2f90d2ab50565/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:00.238268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8cb6b-6ce5-4c2c-8d67-fca419307a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79badc299eae4b8bbff306ca05fcd54d, user_id=0cc998b3da9a413985e098f05d8800bd, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:00.249689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8cb6b-6ce5-4c2c-8d67-fca419307a34 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:00.251680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd1ecb-7321-46a3-a2b7-3139fd5aaf61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8944f580af495191f8edd06de8f901, user_id=71706d41af8b42289cd2f90d2ab50565, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:00.267023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd1ecb-7321-46a3-a2b7-3139fd5aaf61 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:00.385407 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3485/7027] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:56:00 2022] PUT /identity/v3/projects/79badc299eae4b8bbff306ca05fcd54d/users/0cc998b3da9a413985e098f05d8800bd/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:00.398019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99f646-0a8c-4503-a334-0561c0b29c11 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:00.398305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99f646-0a8c-4503-a334-0561c0b29c11 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:00.398584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99f646-0a8c-4503-a334-0561c0b29c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:00.474783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bc99f646-0a8c-4503-a334-0561c0b29c11 None None] MFA Rules not processed for user `0cc998b3da9a413985e098f05d8800bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:00.479369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bc99f646-0a8c-4503-a334-0561c0b29c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:00.490580 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3543/7028] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:56:00 2022] PUT /identity/v3/projects/be8944f580af495191f8edd06de8f901/users/71706d41af8b42289cd2f90d2ab50565/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:00.504800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433fc56-8d94-489d-b391-704aba0bc426 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:00.505030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433fc56-8d94-489d-b391-704aba0bc426 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:00.505311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433fc56-8d94-489d-b391-704aba0bc426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:00.550081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b433fc56-8d94-489d-b391-704aba0bc426 None None] MFA Rules not processed for user `71706d41af8b42289cd2f90d2ab50565`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:00.553256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b433fc56-8d94-489d-b391-704aba0bc426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:00.657519 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3486/7029] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:56:00.667077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99f646-0a8c-4503-a334-0561c0b29c11 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:00.668968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bc99f646-0a8c-4503-a334-0561c0b29c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:00.670092 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3544/7030] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:56:00.742017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:00.803283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99f646-0a8c-4503-a334-0561c0b29c11 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:00.803930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3d490-f621-40fa-9f0e-a2b87f02b4d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:00.804694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3d490-f621-40fa-9f0e-a2b87f02b4d0 service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:00.804975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3d490-f621-40fa-9f0e-a2b87f02b4d0 service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:00.805250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3d490-f621-40fa-9f0e-a2b87f02b4d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:00.809990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-43a3d490-f621-40fa-9f0e-a2b87f02b4d0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:00.864340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433fc56-8d94-489d-b391-704aba0bc426 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:00.867041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b433fc56-8d94-489d-b391-704aba0bc426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:00.953994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3d490-f621-40fa-9f0e-a2b87f02b4d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:00.955718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3d490-f621-40fa-9f0e-a2b87f02b4d0 service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:00.974563 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3487/7031] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:56:01.002393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433fc56-8d94-489d-b391-704aba0bc426 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:01.006354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b737d8a-ba7b-4b9a-84b5-ef965bc4e7d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:01.007142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b737d8a-ba7b-4b9a-84b5-ef965bc4e7d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:01.007432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b737d8a-ba7b-4b9a-84b5-ef965bc4e7d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:01.007699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b737d8a-ba7b-4b9a-84b5-ef965bc4e7d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:01.025778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b737d8a-ba7b-4b9a-84b5-ef965bc4e7d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:01.028455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b737d8a-ba7b-4b9a-84b5-ef965bc4e7d5 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:01.050067 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3545/7032] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:56:02.497248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:03.214652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3d490-f621-40fa-9f0e-a2b87f02b4d0 service glance] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:03.305161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3d490-f621-40fa-9f0e-a2b87f02b4d0 service glance] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:03.313536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b776c2d-1af2-4816-8533-7aa882ca746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:03.314652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b776c2d-1af2-4816-8533-7aa882ca746a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:03.314948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b776c2d-1af2-4816-8533-7aa882ca746a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:03.315221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b776c2d-1af2-4816-8533-7aa882ca746a admin admin] PATH_INFO: `/v3/users/5a8c6128d316400fb296a5c1797ba6d7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:03.316940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b776c2d-1af2-4816-8533-7aa882ca746a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a8c6128d316400fb296a5c1797ba6d7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:03.319866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b776c2d-1af2-4816-8533-7aa882ca746a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:03.623988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:03.685688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8b776c2d-1af2-4816-8533-7aa882ca746a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a8c6128d316400fb296a5c1797ba6d7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:03.851826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8b776c2d-1af2-4816-8533-7aa882ca746a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a8c6128d316400fb296a5c1797ba6d7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:03.853187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8b776c2d-1af2-4816-8533-7aa882ca746a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a8c6128d316400fb296a5c1797ba6d7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:03.863552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8b776c2d-1af2-4816-8533-7aa882ca746a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a8c6128d316400fb296a5c1797ba6d7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:03.887577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8b776c2d-1af2-4816-8533-7aa882ca746a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a8c6128d316400fb296a5c1797ba6d7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:03.896233 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3488/7033] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:56:03 2022] DELETE /identity/v3/users/5a8c6128d316400fb296a5c1797ba6d7 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:03.899529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2da0e-e9af-42b5-9c85-72c69879dbf5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:03.899697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2da0e-e9af-42b5-9c85-72c69879dbf5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:03.899974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2da0e-e9af-42b5-9c85-72c69879dbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:03.930052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ade2da0e-e9af-42b5-9c85-72c69879dbf5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:03.931566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ade2da0e-e9af-42b5-9c85-72c69879dbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:04.054521 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3546/7034] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:04.071663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b776c2d-1af2-4816-8533-7aa882ca746a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:04.077149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8b776c2d-1af2-4816-8533-7aa882ca746a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:04.224383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b776c2d-1af2-4816-8533-7aa882ca746a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:04.225741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66923f2-b524-4f74-ab07-7eb3c0a175b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:04.226769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66923f2-b524-4f74-ab07-7eb3c0a175b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:04.226769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66923f2-b524-4f74-ab07-7eb3c0a175b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:04.227282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66923f2-b524-4f74-ab07-7eb3c0a175b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:04.239169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66923f2-b524-4f74-ab07-7eb3c0a175b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:04.241185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66923f2-b524-4f74-ab07-7eb3c0a175b0 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:04.260007 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3489/7035] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:56:04.938932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2da0e-e9af-42b5-9c85-72c69879dbf5 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:04.940840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ade2da0e-e9af-42b5-9c85-72c69879dbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:04.958352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2da0e-e9af-42b5-9c85-72c69879dbf5 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:04.979400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e0ae1-6c3e-45cd-85f4-8e30d641d1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:04.980433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e0ae1-6c3e-45cd-85f4-8e30d641d1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:04.980892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e0ae1-6c3e-45cd-85f4-8e30d641d1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:04.981747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e0ae1-6c3e-45cd-85f4-8e30d641d1b6 admin admin] PATH_INFO: `/v3/users/e4f3108d78ef40199c72c811d0e8dada` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:04.983133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e0ae1-6c3e-45cd-85f4-8e30d641d1b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f3108d78ef40199c72c811d0e8dada)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:04.985808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e0ae1-6c3e-45cd-85f4-8e30d641d1b6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:05.193393 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66923f2-b524-4f74-ab07-7eb3c0a175b0 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:05.195730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d66923f2-b524-4f74-ab07-7eb3c0a175b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:05.207157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:05.222795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66923f2-b524-4f74-ab07-7eb3c0a175b0 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:05.236070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802ef49-b40a-46e5-b2cb-5436241e0e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:05.237133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802ef49-b40a-46e5-b2cb-5436241e0e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:05.237942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802ef49-b40a-46e5-b2cb-5436241e0e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:05.238399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802ef49-b40a-46e5-b2cb-5436241e0e6c admin admin] PATH_INFO: `/v3/projects/85fc859acefb4e85abef86462c5a1949` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:05.259200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802ef49-b40a-46e5-b2cb-5436241e0e6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=85fc859acefb4e85abef86462c5a1949)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:05.278166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802ef49-b40a-46e5-b2cb-5436241e0e6c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:05.298653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a9e0ae1-6c3e-45cd-85f4-8e30d641d1b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f3108d78ef40199c72c811d0e8dada'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:05.322362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a9e0ae1-6c3e-45cd-85f4-8e30d641d1b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f3108d78ef40199c72c811d0e8dada'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:05.491412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3802ef49-b40a-46e5-b2cb-5436241e0e6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85fc859acefb4e85abef86462c5a1949', 'request_id': 'req-3802ef49-b40a-46e5-b2cb-5436241e0e6c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:05.500530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a9e0ae1-6c3e-45cd-85f4-8e30d641d1b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f3108d78ef40199c72c811d0e8dada'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:05.501468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a9e0ae1-6c3e-45cd-85f4-8e30d641d1b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f3108d78ef40199c72c811d0e8dada'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:05.506970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3802ef49-b40a-46e5-b2cb-5436241e0e6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85fc859acefb4e85abef86462c5a1949', 'request_id': 'req-3802ef49-b40a-46e5-b2cb-5436241e0e6c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:05.524115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3802ef49-b40a-46e5-b2cb-5436241e0e6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85fc859acefb4e85abef86462c5a1949', 'request_id': 'req-3802ef49-b40a-46e5-b2cb-5436241e0e6c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:05.534096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a9e0ae1-6c3e-45cd-85f4-8e30d641d1b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f3108d78ef40199c72c811d0e8dada'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:05.551259 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3547/7036] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:56:04 2022] DELETE /identity/v3/users/e4f3108d78ef40199c72c811d0e8dada => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:05.559765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90706611-075e-460e-8378-7274ccf1ed0e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:05.560743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90706611-075e-460e-8378-7274ccf1ed0e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:05.561195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90706611-075e-460e-8378-7274ccf1ed0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:05.622895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-90706611-075e-460e-8378-7274ccf1ed0e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:05.625564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-90706611-075e-460e-8378-7274ccf1ed0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:05.673620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3802ef49-b40a-46e5-b2cb-5436241e0e6c admin admin] The token cache is being invalidate because project 85fc859acefb4e85abef86462c5a1949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:56:05.674317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3802ef49-b40a-46e5-b2cb-5436241e0e6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:05.675162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-3802ef49-b40a-46e5-b2cb-5436241e0e6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:05.677883 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3490/7037] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:05 2022] DELETE /identity/v3/projects/85fc859acefb4e85abef86462c5a1949 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:05.688281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802ef49-b40a-46e5-b2cb-5436241e0e6c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:05.691098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3802ef49-b40a-46e5-b2cb-5436241e0e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:05.795151 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3548/7038] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:05.837773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90706611-075e-460e-8378-7274ccf1ed0e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:05.840417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-90706611-075e-460e-8378-7274ccf1ed0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:05.923626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802ef49-b40a-46e5-b2cb-5436241e0e6c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:05.934016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9e61c-0934-498f-9283-8869e3198486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:05.939763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9e61c-0934-498f-9283-8869e3198486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:05.939763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9e61c-0934-498f-9283-8869e3198486 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:05.939763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9e61c-0934-498f-9283-8869e3198486 admin admin] PATH_INFO: `/v3/users/0cc998b3da9a413985e098f05d8800bd` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:05.939763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9e61c-0934-498f-9283-8869e3198486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc998b3da9a413985e098f05d8800bd)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:05.939763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9e61c-0934-498f-9283-8869e3198486 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:05.979208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90706611-075e-460e-8378-7274ccf1ed0e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:05.984576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d1cb0-00ae-48a3-9fd2-bbb095fb18f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:05.985467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d1cb0-00ae-48a3-9fd2-bbb095fb18f3 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:05.985957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d1cb0-00ae-48a3-9fd2-bbb095fb18f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:05.987767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d1cb0-00ae-48a3-9fd2-bbb095fb18f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:06.001028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d1cb0-00ae-48a3-9fd2-bbb095fb18f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:06.002891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d1cb0-00ae-48a3-9fd2-bbb095fb18f3 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:06.015082 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3549/7039] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:56:06.131238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:06.380968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6cc9e61c-0934-498f-9283-8869e3198486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc998b3da9a413985e098f05d8800bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:06.544071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6cc9e61c-0934-498f-9283-8869e3198486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc998b3da9a413985e098f05d8800bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:06.546061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6cc9e61c-0934-498f-9283-8869e3198486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc998b3da9a413985e098f05d8800bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:06.561147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6cc9e61c-0934-498f-9283-8869e3198486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc998b3da9a413985e098f05d8800bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:06.590226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6cc9e61c-0934-498f-9283-8869e3198486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc998b3da9a413985e098f05d8800bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:06.607122 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3491/7040] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:56:05 2022] DELETE /identity/v3/users/0cc998b3da9a413985e098f05d8800bd => generated 0 bytes in 914 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:06.652027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d1cb0-00ae-48a3-9fd2-bbb095fb18f3 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:06.654003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a24d1cb0-00ae-48a3-9fd2-bbb095fb18f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:06.679025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d1cb0-00ae-48a3-9fd2-bbb095fb18f3 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:06.770784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7d425-4703-48d5-a654-5756c2215bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:06.772887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7d425-4703-48d5-a654-5756c2215bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:06.773556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7d425-4703-48d5-a654-5756c2215bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:06.773715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7d425-4703-48d5-a654-5756c2215bc9 admin admin] PATH_INFO: `/v3/projects/b501d9614334486889b8f2f2a8fa54bb` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:06.775130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7d425-4703-48d5-a654-5756c2215bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b501d9614334486889b8f2f2a8fa54bb)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:06.779989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7d425-4703-48d5-a654-5756c2215bc9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:07.044999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-42e7d425-4703-48d5-a654-5756c2215bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b501d9614334486889b8f2f2a8fa54bb', 'request_id': 'req-42e7d425-4703-48d5-a654-5756c2215bc9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:07.051870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-42e7d425-4703-48d5-a654-5756c2215bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b501d9614334486889b8f2f2a8fa54bb', 'request_id': 'req-42e7d425-4703-48d5-a654-5756c2215bc9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:07.194877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-42e7d425-4703-48d5-a654-5756c2215bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b501d9614334486889b8f2f2a8fa54bb', 'request_id': 'req-42e7d425-4703-48d5-a654-5756c2215bc9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:07.217859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-42e7d425-4703-48d5-a654-5756c2215bc9 admin admin] The token cache is being invalidate because project b501d9614334486889b8f2f2a8fa54bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:56:07.218658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-42e7d425-4703-48d5-a654-5756c2215bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:07.219558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-42e7d425-4703-48d5-a654-5756c2215bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:07.221947 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3550/7041] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:06 2022] DELETE /identity/v3/projects/b501d9614334486889b8f2f2a8fa54bb => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:07.227142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814255a-9b6e-4f24-8f69-bfffdfd26a9b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:07.227142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814255a-9b6e-4f24-8f69-bfffdfd26a9b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:07.227481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814255a-9b6e-4f24-8f69-bfffdfd26a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:07.259340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f814255a-9b6e-4f24-8f69-bfffdfd26a9b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:07.261443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f814255a-9b6e-4f24-8f69-bfffdfd26a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:07.393917 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3492/7042] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:07.394829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8c2c8-829d-46d2-885c-66f9cd143fad None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:07.395116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8c2c8-829d-46d2-885c-66f9cd143fad None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:07.395392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8c2c8-829d-46d2-885c-66f9cd143fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:07.418485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-48d8c2c8-829d-46d2-885c-66f9cd143fad None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:07.420000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-48d8c2c8-829d-46d2-885c-66f9cd143fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:07.428906 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3551/7043] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:07.436371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814255a-9b6e-4f24-8f69-bfffdfd26a9b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:07.448446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814255a-9b6e-4f24-8f69-bfffdfd26a9b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:07.453742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3cbbe-e9a1-41d2-97fd-73cb8a3edde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:07.455118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3cbbe-e9a1-41d2-97fd-73cb8a3edde9 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:07.455708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3cbbe-e9a1-41d2-97fd-73cb8a3edde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:07.456187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3cbbe-e9a1-41d2-97fd-73cb8a3edde9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:07.457019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3cbbe-e9a1-41d2-97fd-73cb8a3edde9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:56:07.457527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3cbbe-e9a1-41d2-97fd-73cb8a3edde9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:07.459518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3cbbe-e9a1-41d2-97fd-73cb8a3edde9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:07.496042 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3493/7044] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:56:07.497690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8c2c8-829d-46d2-885c-66f9cd143fad None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:07.508607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8c2c8-829d-46d2-885c-66f9cd143fad None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:07.526777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fba62-e576-4553-b2f5-0daa63028c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:07.527679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fba62-e576-4553-b2f5-0daa63028c8a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:07.528022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fba62-e576-4553-b2f5-0daa63028c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:07.531703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fba62-e576-4553-b2f5-0daa63028c8a admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:07.532630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fba62-e576-4553-b2f5-0daa63028c8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:07.535257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fba62-e576-4553-b2f5-0daa63028c8a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:07.693768 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3552/7045] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:56:07 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:56:07.695012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3cbbe-e9a1-41d2-97fd-73cb8a3edde9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:07.711402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3cbbe-e9a1-41d2-97fd-73cb8a3edde9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:07.831392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bb289-2351-47b1-93bc-278c9811bc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:07.832194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bb289-2351-47b1-93bc-278c9811bc25 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:07.832541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bb289-2351-47b1-93bc-278c9811bc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:07.832824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bb289-2351-47b1-93bc-278c9811bc25 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:07.833499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bb289-2351-47b1-93bc-278c9811bc25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:07.835502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bb289-2351-47b1-93bc-278c9811bc25 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:07.950370 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3494/7046] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:56:07 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:56:07.954232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fba62-e576-4553-b2f5-0daa63028c8a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:07.975667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fba62-e576-4553-b2f5-0daa63028c8a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:07.983493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21618d54-28da-4097-9e65-3a9e6e63753e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:07.983493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21618d54-28da-4097-9e65-3a9e6e63753e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:07.983493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21618d54-28da-4097-9e65-3a9e6e63753e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:07.984193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21618d54-28da-4097-9e65-3a9e6e63753e admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:07.985482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21618d54-28da-4097-9e65-3a9e6e63753e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:07.987297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21618d54-28da-4097-9e65-3a9e6e63753e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:08.000500 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3553/7047] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:56:08.004530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bb289-2351-47b1-93bc-278c9811bc25 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:08.018441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bb289-2351-47b1-93bc-278c9811bc25 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:08.032876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da8e11-863e-4ac0-8d83-8e1cdd917c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:08.034488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da8e11-863e-4ac0-8d83-8e1cdd917c7a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:08.035065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da8e11-863e-4ac0-8d83-8e1cdd917c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:08.035639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da8e11-863e-4ac0-8d83-8e1cdd917c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:08.036521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da8e11-863e-4ac0-8d83-8e1cdd917c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:08.038604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da8e11-863e-4ac0-8d83-8e1cdd917c7a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:08.069778 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3495/7048] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:56:08.082598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21618d54-28da-4097-9e65-3a9e6e63753e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:08.111020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da8e11-863e-4ac0-8d83-8e1cdd917c7a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:08.129795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21618d54-28da-4097-9e65-3a9e6e63753e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:08.133919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-23da8e11-863e-4ac0-8d83-8e1cdd917c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:08.159484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7807f3-fff0-4298-a83e-2f2bb60df970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:08.164580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7807f3-fff0-4298-a83e-2f2bb60df970 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:08.164861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7807f3-fff0-4298-a83e-2f2bb60df970 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:08.165367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7807f3-fff0-4298-a83e-2f2bb60df970 admin admin] PATH_INFO: `/v3/projects/2a738a12a5be4585b5b581682537e04c/users/c5ec6891d27d448992fe6634df6ed89a/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:08.183950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da8e11-863e-4ac0-8d83-8e1cdd917c7a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:08.198915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7807f3-fff0-4298-a83e-2f2bb60df970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a738a12a5be4585b5b581682537e04c, user_id=c5ec6891d27d448992fe6634df6ed89a, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:08.199480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cabc6-d7a5-4928-adcf-f0e80d2d70bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:08.200362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cabc6-d7a5-4928-adcf-f0e80d2d70bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:08.200825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cabc6-d7a5-4928-adcf-f0e80d2d70bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:08.201445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cabc6-d7a5-4928-adcf-f0e80d2d70bb admin admin] PATH_INFO: `/v3/projects/79badc299eae4b8bbff306ca05fcd54d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:08.202904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7807f3-fff0-4298-a83e-2f2bb60df970 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:08.203123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cabc6-d7a5-4928-adcf-f0e80d2d70bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=79badc299eae4b8bbff306ca05fcd54d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:08.210028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cabc6-d7a5-4928-adcf-f0e80d2d70bb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:08.320697 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3554/7049] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:56:08 2022] PUT /identity/v3/projects/2a738a12a5be4585b5b581682537e04c/users/c5ec6891d27d448992fe6634df6ed89a/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:08.428871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ab7d0-d41f-44e1-bd5c-e6b4a5ff69f6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:08.429844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ab7d0-d41f-44e1-bd5c-e6b4a5ff69f6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:08.430436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ab7d0-d41f-44e1-bd5c-e6b4a5ff69f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:08.466594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-933ab7d0-d41f-44e1-bd5c-e6b4a5ff69f6 None None] MFA Rules not processed for user `c5ec6891d27d448992fe6634df6ed89a`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:08.468343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-933ab7d0-d41f-44e1-bd5c-e6b4a5ff69f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:08.536277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-116cabc6-d7a5-4928-adcf-f0e80d2d70bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79badc299eae4b8bbff306ca05fcd54d', 'request_id': 'req-116cabc6-d7a5-4928-adcf-f0e80d2d70bb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:08.567593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-116cabc6-d7a5-4928-adcf-f0e80d2d70bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79badc299eae4b8bbff306ca05fcd54d', 'request_id': 'req-116cabc6-d7a5-4928-adcf-f0e80d2d70bb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:08.586288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-116cabc6-d7a5-4928-adcf-f0e80d2d70bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79badc299eae4b8bbff306ca05fcd54d', 'request_id': 'req-116cabc6-d7a5-4928-adcf-f0e80d2d70bb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:08.604709 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3555/7050] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:08.755761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-116cabc6-d7a5-4928-adcf-f0e80d2d70bb admin admin] The token cache is being invalidate because project 79badc299eae4b8bbff306ca05fcd54d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:56:08.756251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-116cabc6-d7a5-4928-adcf-f0e80d2d70bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:08.757108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-116cabc6-d7a5-4928-adcf-f0e80d2d70bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:08.763726 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3496/7051] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:08 2022] DELETE /identity/v3/projects/79badc299eae4b8bbff306ca05fcd54d => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:08.765290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b59500-6d42-4587-af7d-b6ccc7d55da3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:08.765587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b59500-6d42-4587-af7d-b6ccc7d55da3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:08.765868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b59500-6d42-4587-af7d-b6ccc7d55da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:08.790556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-10b59500-6d42-4587-af7d-b6ccc7d55da3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:08.793286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-10b59500-6d42-4587-af7d-b6ccc7d55da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:08.868016 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3556/7052] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:08.876034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f917f74-febc-44cb-b449-b6997502dd10 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:08.876436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f917f74-febc-44cb-b449-b6997502dd10 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:08.876783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f917f74-febc-44cb-b449-b6997502dd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:08.898931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7f917f74-febc-44cb-b449-b6997502dd10 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:08.900312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7f917f74-febc-44cb-b449-b6997502dd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:08.909417 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3497/7053] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:56:08.913521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b59500-6d42-4587-af7d-b6ccc7d55da3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:08.923951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b59500-6d42-4587-af7d-b6ccc7d55da3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:08.929070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d4931-9170-4074-9710-5b1c8211e062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:08.929796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d4931-9170-4074-9710-5b1c8211e062 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:08.930206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d4931-9170-4074-9710-5b1c8211e062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:08.930554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d4931-9170-4074-9710-5b1c8211e062 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:08.932083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d4931-9170-4074-9710-5b1c8211e062 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:56:08.932083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d4931-9170-4074-9710-5b1c8211e062 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:08.933918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d4931-9170-4074-9710-5b1c8211e062 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:08.952637 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3557/7054] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:56:08.953588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f917f74-febc-44cb-b449-b6997502dd10 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:08.971426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f917f74-febc-44cb-b449-b6997502dd10 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:08.976651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80567c81-e06e-4c7b-9db3-b08e2d263788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:08.977269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80567c81-e06e-4c7b-9db3-b08e2d263788 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:08.977671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80567c81-e06e-4c7b-9db3-b08e2d263788 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:08.978058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80567c81-e06e-4c7b-9db3-b08e2d263788 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:08.978857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80567c81-e06e-4c7b-9db3-b08e2d263788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:08.981703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80567c81-e06e-4c7b-9db3-b08e2d263788 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:08.988195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d4931-9170-4074-9710-5b1c8211e062 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:09.004390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-074d4931-9170-4074-9710-5b1c8211e062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:09.123145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d4931-9170-4074-9710-5b1c8211e062 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:09.130629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cab824-29ea-4328-8023-03f1b2073bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:09.130629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cab824-29ea-4328-8023-03f1b2073bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:09.130629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cab824-29ea-4328-8023-03f1b2073bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:09.130951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cab824-29ea-4328-8023-03f1b2073bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:09.134283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-74cab824-29ea-4328-8023-03f1b2073bb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:09.244074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cab824-29ea-4328-8023-03f1b2073bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:09.246291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cab824-29ea-4328-8023-03f1b2073bb7 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:09.259124 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3558/7055] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:56:09.289358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cab824-29ea-4328-8023-03f1b2073bb7 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:09.297018 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3498/7056] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:56:08 2022] POST /identity/v3/projects => generated 371 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:56:09.315547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cab824-29ea-4328-8023-03f1b2073bb7 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:09.336199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:09.412333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768de78d-728d-43cb-85d8-d18d719fd1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:09.413488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768de78d-728d-43cb-85d8-d18d719fd1fc admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:09.413781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768de78d-728d-43cb-85d8-d18d719fd1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:09.414299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768de78d-728d-43cb-85d8-d18d719fd1fc admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:09.415840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768de78d-728d-43cb-85d8-d18d719fd1fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:09.417767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768de78d-728d-43cb-85d8-d18d719fd1fc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:09.590000 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3559/7057] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:56:09 2022] POST /identity/v3/users => generated 286 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:56:09.596348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80567c81-e06e-4c7b-9db3-b08e2d263788 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:09.642708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80567c81-e06e-4c7b-9db3-b08e2d263788 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:09.655456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdeeb24-9c51-4a65-935b-5fbef55e0b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:09.656602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdeeb24-9c51-4a65-935b-5fbef55e0b35 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:09.657079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdeeb24-9c51-4a65-935b-5fbef55e0b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:09.657538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdeeb24-9c51-4a65-935b-5fbef55e0b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:09.658402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdeeb24-9c51-4a65-935b-5fbef55e0b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:09.660797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdeeb24-9c51-4a65-935b-5fbef55e0b35 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:09.675962 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3499/7058] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:56:09.679985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768de78d-728d-43cb-85d8-d18d719fd1fc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:09.775025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768de78d-728d-43cb-85d8-d18d719fd1fc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:09.787149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5f122-10eb-465b-bdd6-637bd8a59a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:09.788025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5f122-10eb-465b-bdd6-637bd8a59a2a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:09.788921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5f122-10eb-465b-bdd6-637bd8a59a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:09.790007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5f122-10eb-465b-bdd6-637bd8a59a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:09.791245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5f122-10eb-465b-bdd6-637bd8a59a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:09.795039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5f122-10eb-465b-bdd6-637bd8a59a2a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:09.837799 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3560/7059] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:56:09.837908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdeeb24-9c51-4a65-935b-5fbef55e0b35 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:09.889095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdeeb24-9c51-4a65-935b-5fbef55e0b35 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:09.895269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ec347-42ba-4679-bb07-854e45450453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:09.896408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ec347-42ba-4679-bb07-854e45450453 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:09.896924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ec347-42ba-4679-bb07-854e45450453 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:09.897412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ec347-42ba-4679-bb07-854e45450453 admin admin] PATH_INFO: `/v3/projects/ba8da42296ff4fee9a33d591997641e1/users/5434c93ce3f645cc85fd7287e5bb7740/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:09.934119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ec347-42ba-4679-bb07-854e45450453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba8da42296ff4fee9a33d591997641e1, user_id=5434c93ce3f645cc85fd7287e5bb7740, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:09.947072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ec347-42ba-4679-bb07-854e45450453 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:09.959855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5f122-10eb-465b-bdd6-637bd8a59a2a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:09.962392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e3a5f122-10eb-465b-bdd6-637bd8a59a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:09.998897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5f122-10eb-465b-bdd6-637bd8a59a2a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:10.005950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134c348-0364-4e68-9186-dac013857259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:10.006612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134c348-0364-4e68-9186-dac013857259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:10.006894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134c348-0364-4e68-9186-dac013857259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:10.007167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134c348-0364-4e68-9186-dac013857259 admin admin] PATH_INFO: `/v3/users/c5ec6891d27d448992fe6634df6ed89a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:10.010191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134c348-0364-4e68-9186-dac013857259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5ec6891d27d448992fe6634df6ed89a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:10.015258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134c348-0364-4e68-9186-dac013857259 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:10.117302 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3500/7060] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:56:09 2022] PUT /identity/v3/projects/ba8da42296ff4fee9a33d591997641e1/users/5434c93ce3f645cc85fd7287e5bb7740/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:56:10.128771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390780a6-fdad-4be6-b50c-1276a3036eeb None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:10.128961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390780a6-fdad-4be6-b50c-1276a3036eeb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:10.129255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390780a6-fdad-4be6-b50c-1276a3036eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:10.160937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-390780a6-fdad-4be6-b50c-1276a3036eeb None None] MFA Rules not processed for user `5434c93ce3f645cc85fd7287e5bb7740`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:10.162170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-390780a6-fdad-4be6-b50c-1276a3036eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:10.261654 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3501/7061] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:56:10.277458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390780a6-fdad-4be6-b50c-1276a3036eeb None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:10.279680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-390780a6-fdad-4be6-b50c-1276a3036eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:10.385155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390780a6-fdad-4be6-b50c-1276a3036eeb None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:10.390695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fb899-1cc5-4b84-adcd-8f481d77d2e6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:10.391326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fb899-1cc5-4b84-adcd-8f481d77d2e6 service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:10.391607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fb899-1cc5-4b84-adcd-8f481d77d2e6 service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:10.391878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fb899-1cc5-4b84-adcd-8f481d77d2e6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:10.404506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fb899-1cc5-4b84-adcd-8f481d77d2e6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:10.406000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fb899-1cc5-4b84-adcd-8f481d77d2e6 service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:10.415958 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3502/7062] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:56:10.425236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:10.457093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a134c348-0364-4e68-9186-dac013857259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5ec6891d27d448992fe6634df6ed89a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:10.461109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a134c348-0364-4e68-9186-dac013857259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5ec6891d27d448992fe6634df6ed89a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:10.566592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fb899-1cc5-4b84-adcd-8f481d77d2e6 service glance] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:10.645679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a134c348-0364-4e68-9186-dac013857259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5ec6891d27d448992fe6634df6ed89a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:10.646740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a134c348-0364-4e68-9186-dac013857259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5ec6891d27d448992fe6634df6ed89a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:10.663837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a134c348-0364-4e68-9186-dac013857259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5ec6891d27d448992fe6634df6ed89a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:10.664795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fb899-1cc5-4b84-adcd-8f481d77d2e6 service glance] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:10.671879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db55d23-7603-4b3c-a98e-91409f2c1ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:10.672943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db55d23-7603-4b3c-a98e-91409f2c1ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:10.673512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db55d23-7603-4b3c-a98e-91409f2c1ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:10.673929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db55d23-7603-4b3c-a98e-91409f2c1ed9 admin admin] PATH_INFO: `/v3/users/5434c93ce3f645cc85fd7287e5bb7740` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:10.675285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db55d23-7603-4b3c-a98e-91409f2c1ed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5434c93ce3f645cc85fd7287e5bb7740)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:10.677821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db55d23-7603-4b3c-a98e-91409f2c1ed9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:10.690870 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3561/7063] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:56:09 2022] DELETE /identity/v3/users/c5ec6891d27d448992fe6634df6ed89a => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:10.692746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04a409-c71f-4371-9f87-6005f219f48d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:10.693264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04a409-c71f-4371-9f87-6005f219f48d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:10.693749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04a409-c71f-4371-9f87-6005f219f48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:10.739653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-db04a409-c71f-4371-9f87-6005f219f48d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:10.741970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-db04a409-c71f-4371-9f87-6005f219f48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:10.841276 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3562/7064] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:10.851964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04a409-c71f-4371-9f87-6005f219f48d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:10.853425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-db04a409-c71f-4371-9f87-6005f219f48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:11.034027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04a409-c71f-4371-9f87-6005f219f48d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:11.034188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5db55d23-7603-4b3c-a98e-91409f2c1ed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5434c93ce3f645cc85fd7287e5bb7740'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:11.034329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023416c-7a0e-4e89-a797-da9aeb4814e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:11.034329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023416c-7a0e-4e89-a797-da9aeb4814e0 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:11.034329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023416c-7a0e-4e89-a797-da9aeb4814e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:11.034329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023416c-7a0e-4e89-a797-da9aeb4814e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:11.034698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023416c-7a0e-4e89-a797-da9aeb4814e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:11.034698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023416c-7a0e-4e89-a797-da9aeb4814e0 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:11.044039 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3563/7065] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:56:11.307799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5db55d23-7603-4b3c-a98e-91409f2c1ed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5434c93ce3f645cc85fd7287e5bb7740'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:11.308437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5db55d23-7603-4b3c-a98e-91409f2c1ed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5434c93ce3f645cc85fd7287e5bb7740'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:11.328640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5db55d23-7603-4b3c-a98e-91409f2c1ed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5434c93ce3f645cc85fd7287e5bb7740'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:11.368658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5db55d23-7603-4b3c-a98e-91409f2c1ed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5434c93ce3f645cc85fd7287e5bb7740'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:11.381792 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3503/7066] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:56:10 2022] DELETE /identity/v3/users/5434c93ce3f645cc85fd7287e5bb7740 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:11.386936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26904ba6-3b43-4204-a288-c794ff0ec418 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:11.387944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26904ba6-3b43-4204-a288-c794ff0ec418 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:11.403184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26904ba6-3b43-4204-a288-c794ff0ec418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:11.458505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-26904ba6-3b43-4204-a288-c794ff0ec418 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:11.459951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-26904ba6-3b43-4204-a288-c794ff0ec418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:11.563887 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3564/7067] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:11.599445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db55d23-7603-4b3c-a98e-91409f2c1ed9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:11.600840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5db55d23-7603-4b3c-a98e-91409f2c1ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:11.706596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db55d23-7603-4b3c-a98e-91409f2c1ed9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:11.712077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa870ad-2ef7-44a7-9ff5-3f96d409f1c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:11.713221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa870ad-2ef7-44a7-9ff5-3f96d409f1c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:11.714639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa870ad-2ef7-44a7-9ff5-3f96d409f1c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:11.715067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa870ad-2ef7-44a7-9ff5-3f96d409f1c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:11.725660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa870ad-2ef7-44a7-9ff5-3f96d409f1c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:11.727517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa870ad-2ef7-44a7-9ff5-3f96d409f1c3 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:11.741626 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3504/7068] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:56:12.696047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26904ba6-3b43-4204-a288-c794ff0ec418 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:12.699135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-26904ba6-3b43-4204-a288-c794ff0ec418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:12.727435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26904ba6-3b43-4204-a288-c794ff0ec418 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:12.736240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacf74b-c3ad-43ab-a2ed-eefb64bba44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:12.737895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacf74b-c3ad-43ab-a2ed-eefb64bba44e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:12.738933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacf74b-c3ad-43ab-a2ed-eefb64bba44e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:12.739557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacf74b-c3ad-43ab-a2ed-eefb64bba44e admin admin] PATH_INFO: `/v3/projects/2a738a12a5be4585b5b581682537e04c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:12.750257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacf74b-c3ad-43ab-a2ed-eefb64bba44e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a738a12a5be4585b5b581682537e04c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:12.750257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacf74b-c3ad-43ab-a2ed-eefb64bba44e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:13.044751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-eaacf74b-c3ad-43ab-a2ed-eefb64bba44e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a738a12a5be4585b5b581682537e04c', 'request_id': 'req-eaacf74b-c3ad-43ab-a2ed-eefb64bba44e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:13.060759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-eaacf74b-c3ad-43ab-a2ed-eefb64bba44e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a738a12a5be4585b5b581682537e04c', 'request_id': 'req-eaacf74b-c3ad-43ab-a2ed-eefb64bba44e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:13.181083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa870ad-2ef7-44a7-9ff5-3f96d409f1c3 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:13.183426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5aa870ad-2ef7-44a7-9ff5-3f96d409f1c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:13.248560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa870ad-2ef7-44a7-9ff5-3f96d409f1c3 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:13.302342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-eaacf74b-c3ad-43ab-a2ed-eefb64bba44e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a738a12a5be4585b5b581682537e04c', 'request_id': 'req-eaacf74b-c3ad-43ab-a2ed-eefb64bba44e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:13.331756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-eaacf74b-c3ad-43ab-a2ed-eefb64bba44e admin admin] The token cache is being invalidate because project 2a738a12a5be4585b5b581682537e04c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:56:13.332063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-eaacf74b-c3ad-43ab-a2ed-eefb64bba44e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:13.332767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-eaacf74b-c3ad-43ab-a2ed-eefb64bba44e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:13.337232 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3565/7069] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:12 2022] DELETE /identity/v3/projects/2a738a12a5be4585b5b581682537e04c => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:13.343548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660726be-714e-4a41-b95c-a01885212567 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:13.343844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660726be-714e-4a41-b95c-a01885212567 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:13.344445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660726be-714e-4a41-b95c-a01885212567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:13.414984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-660726be-714e-4a41-b95c-a01885212567 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:13.418017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-660726be-714e-4a41-b95c-a01885212567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:13.433093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b53df-25ce-4420-9bdf-722e49f12d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:13.433760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b53df-25ce-4420-9bdf-722e49f12d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:13.434217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b53df-25ce-4420-9bdf-722e49f12d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:13.434642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b53df-25ce-4420-9bdf-722e49f12d27 admin admin] PATH_INFO: `/v3/projects/ba8da42296ff4fee9a33d591997641e1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:13.445145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b53df-25ce-4420-9bdf-722e49f12d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba8da42296ff4fee9a33d591997641e1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:13.447391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b53df-25ce-4420-9bdf-722e49f12d27 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:13.520383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:13.605145 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3566/7070] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:13.612752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca8d14-2af7-4c67-b7db-a3b6fe008085 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:13.613042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca8d14-2af7-4c67-b7db-a3b6fe008085 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:13.613315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca8d14-2af7-4c67-b7db-a3b6fe008085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:13.686209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3cca8d14-2af7-4c67-b7db-a3b6fe008085 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:13.688869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3cca8d14-2af7-4c67-b7db-a3b6fe008085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:13.710120 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3567/7071] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:56:13.717600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca8d14-2af7-4c67-b7db-a3b6fe008085 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:13.734856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca8d14-2af7-4c67-b7db-a3b6fe008085 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:13.753478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032a62f-00b4-41e6-9288-7daf66319bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:13.756927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032a62f-00b4-41e6-9288-7daf66319bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:13.758113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032a62f-00b4-41e6-9288-7daf66319bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:13.758937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032a62f-00b4-41e6-9288-7daf66319bd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:13.762910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032a62f-00b4-41e6-9288-7daf66319bd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:56:13.764328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032a62f-00b4-41e6-9288-7daf66319bd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:13.767046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032a62f-00b4-41e6-9288-7daf66319bd6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:13.779510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-787b53df-25ce-4420-9bdf-722e49f12d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba8da42296ff4fee9a33d591997641e1', 'request_id': 'req-787b53df-25ce-4420-9bdf-722e49f12d27'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:13.805508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-787b53df-25ce-4420-9bdf-722e49f12d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba8da42296ff4fee9a33d591997641e1', 'request_id': 'req-787b53df-25ce-4420-9bdf-722e49f12d27'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:13.808965 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3568/7072] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:56:13.813462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032a62f-00b4-41e6-9288-7daf66319bd6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:13.818254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-787b53df-25ce-4420-9bdf-722e49f12d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba8da42296ff4fee9a33d591997641e1', 'request_id': 'req-787b53df-25ce-4420-9bdf-722e49f12d27'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:13.859511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032a62f-00b4-41e6-9288-7daf66319bd6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:13.887602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:13.972110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-787b53df-25ce-4420-9bdf-722e49f12d27 admin admin] The token cache is being invalidate because project ba8da42296ff4fee9a33d591997641e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:56:13.972646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-787b53df-25ce-4420-9bdf-722e49f12d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:13.973805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-787b53df-25ce-4420-9bdf-722e49f12d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:13.975258 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3505/7073] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:13 2022] DELETE /identity/v3/projects/ba8da42296ff4fee9a33d591997641e1 => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:13.980520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e9e69-ca04-432c-9fd3-4b68b29d7df0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:13.980828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e9e69-ca04-432c-9fd3-4b68b29d7df0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:13.981112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e9e69-ca04-432c-9fd3-4b68b29d7df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:14.023552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc749265-6d36-4696-bbc1-181282e52b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:14.024760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc749265-6d36-4696-bbc1-181282e52b21 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:14.025273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc749265-6d36-4696-bbc1-181282e52b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:14.025720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc749265-6d36-4696-bbc1-181282e52b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:14.027229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc749265-6d36-4696-bbc1-181282e52b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:14.029785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc749265-6d36-4696-bbc1-181282e52b21 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:14.036576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-be9e9e69-ca04-432c-9fd3-4b68b29d7df0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:14.040707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-be9e9e69-ca04-432c-9fd3-4b68b29d7df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:14.066918 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3506/7074] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:14.068269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c4061-ef52-49fb-a907-fbc94bb60913 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:14.068964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c4061-ef52-49fb-a907-fbc94bb60913 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:14.069788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c4061-ef52-49fb-a907-fbc94bb60913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:14.103700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9d3c4061-ef52-49fb-a907-fbc94bb60913 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:14.106048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9d3c4061-ef52-49fb-a907-fbc94bb60913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:14.118282 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3507/7075] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:14.133704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c4061-ef52-49fb-a907-fbc94bb60913 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:14.148774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c4061-ef52-49fb-a907-fbc94bb60913 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:14.159647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd822c-f1ab-45d7-8306-adfee9cbf0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:14.165089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd822c-f1ab-45d7-8306-adfee9cbf0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:14.165089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd822c-f1ab-45d7-8306-adfee9cbf0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:14.165089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd822c-f1ab-45d7-8306-adfee9cbf0a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:14.165089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd822c-f1ab-45d7-8306-adfee9cbf0a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:56:14.165089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd822c-f1ab-45d7-8306-adfee9cbf0a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:14.165089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd822c-f1ab-45d7-8306-adfee9cbf0a1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:14.184033 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3508/7076] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:56:14.185298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd822c-f1ab-45d7-8306-adfee9cbf0a1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:14.198682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd822c-f1ab-45d7-8306-adfee9cbf0a1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:14.209326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d9dd9-ff4a-436d-b666-26d68cbf4a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:14.220896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d9dd9-ff4a-436d-b666-26d68cbf4a41 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:14.220896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d9dd9-ff4a-436d-b666-26d68cbf4a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:14.220896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d9dd9-ff4a-436d-b666-26d68cbf4a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:14.220896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d9dd9-ff4a-436d-b666-26d68cbf4a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:14.220896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d9dd9-ff4a-436d-b666-26d68cbf4a41 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:14.278696 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3569/7077] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:56:13 2022] POST /identity/v3/projects => generated 367 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:56:14.283276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc749265-6d36-4696-bbc1-181282e52b21 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:14.287474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bc749265-6d36-4696-bbc1-181282e52b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:14.445984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc749265-6d36-4696-bbc1-181282e52b21 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:14.456726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f0343-dae8-44d0-844d-ced7e6b4b444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:14.458767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f0343-dae8-44d0-844d-ced7e6b4b444 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:14.459845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f0343-dae8-44d0-844d-ced7e6b4b444 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:14.460940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f0343-dae8-44d0-844d-ced7e6b4b444 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:14.461782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f0343-dae8-44d0-844d-ced7e6b4b444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:14.465978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f0343-dae8-44d0-844d-ced7e6b4b444 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:14.672280 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3509/7078] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:56:14 2022] POST /identity/v3/projects => generated 371 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:56:14.684881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d9dd9-ff4a-436d-b666-26d68cbf4a41 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:14.736235 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3570/7079] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:56:14 2022] POST /identity/v3/users => generated 284 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:56:14.738185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f0343-dae8-44d0-844d-ced7e6b4b444 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:14.775230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f0343-dae8-44d0-844d-ced7e6b4b444 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:14.831445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d9dd9-ff4a-436d-b666-26d68cbf4a41 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:14.840703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95debab7-771e-4704-a0b7-cc3b9e004f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:14.842542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95debab7-771e-4704-a0b7-cc3b9e004f4d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:14.843094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95debab7-771e-4704-a0b7-cc3b9e004f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:14.843613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95debab7-771e-4704-a0b7-cc3b9e004f4d admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:14.845312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95debab7-771e-4704-a0b7-cc3b9e004f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:14.850500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95debab7-771e-4704-a0b7-cc3b9e004f4d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:15.011681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d4116-2aa8-465f-9e30-c646ebcf5361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:15.012616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4116-2aa8-465f-9e30-c646ebcf5361 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:15.012897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4116-2aa8-465f-9e30-c646ebcf5361 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:15.013169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4116-2aa8-465f-9e30-c646ebcf5361 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:15.013833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d4116-2aa8-465f-9e30-c646ebcf5361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:15.015847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d4116-2aa8-465f-9e30-c646ebcf5361 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:15.033573 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3571/7080] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:56:15.034675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d4116-2aa8-465f-9e30-c646ebcf5361 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:15.051308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d4116-2aa8-465f-9e30-c646ebcf5361 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:15.060654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a1e5e-9530-4456-94aa-f895e6ee1bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:15.061372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a1e5e-9530-4456-94aa-f895e6ee1bfb admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:15.062106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a1e5e-9530-4456-94aa-f895e6ee1bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:15.062389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a1e5e-9530-4456-94aa-f895e6ee1bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:15.064210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a1e5e-9530-4456-94aa-f895e6ee1bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:15.065986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a1e5e-9530-4456-94aa-f895e6ee1bfb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:15.083329 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3572/7081] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:56:15.088869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a1e5e-9530-4456-94aa-f895e6ee1bfb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:15.118992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a1e5e-9530-4456-94aa-f895e6ee1bfb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:15.125173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd644a3-20fb-4be6-9b98-50e4cba1799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:15.126116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd644a3-20fb-4be6-9b98-50e4cba1799b admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:15.126604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd644a3-20fb-4be6-9b98-50e4cba1799b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:15.127081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd644a3-20fb-4be6-9b98-50e4cba1799b admin admin] PATH_INFO: `/v3/projects/f97daadf5de74bd7bc5004505037c8e3/users/ec9dd9ef099b4171a91f295bdb110581/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:15.147641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd644a3-20fb-4be6-9b98-50e4cba1799b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97daadf5de74bd7bc5004505037c8e3, user_id=ec9dd9ef099b4171a91f295bdb110581, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:15.152692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd644a3-20fb-4be6-9b98-50e4cba1799b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:15.186886 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3510/7082] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:56:14 2022] POST /identity/v3/users => generated 286 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:56:15.194029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95debab7-771e-4704-a0b7-cc3b9e004f4d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:15.215075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95debab7-771e-4704-a0b7-cc3b9e004f4d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:15.233655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581430d-4518-4404-ad3c-9e3d5fbd6e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:15.234733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581430d-4518-4404-ad3c-9e3d5fbd6e5f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:15.235025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581430d-4518-4404-ad3c-9e3d5fbd6e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:15.236848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581430d-4518-4404-ad3c-9e3d5fbd6e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:15.237529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581430d-4518-4404-ad3c-9e3d5fbd6e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:15.245239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581430d-4518-4404-ad3c-9e3d5fbd6e5f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:15.272421 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3511/7083] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:56:15.274597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581430d-4518-4404-ad3c-9e3d5fbd6e5f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:15.300543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581430d-4518-4404-ad3c-9e3d5fbd6e5f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:15.307679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0034d31-15f7-4bb6-b08b-c656cdd8fdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:15.308363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0034d31-15f7-4bb6-b08b-c656cdd8fdab admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:15.309164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0034d31-15f7-4bb6-b08b-c656cdd8fdab admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:15.309806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0034d31-15f7-4bb6-b08b-c656cdd8fdab admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:15.311355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0034d31-15f7-4bb6-b08b-c656cdd8fdab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:15.315198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0034d31-15f7-4bb6-b08b-c656cdd8fdab admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:15.323348 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3573/7084] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:56:15 2022] PUT /identity/v3/projects/f97daadf5de74bd7bc5004505037c8e3/users/ec9dd9ef099b4171a91f295bdb110581/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:15.342184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7f6be-b2f4-4811-b130-c765267fcb0d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:15.342184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7f6be-b2f4-4811-b130-c765267fcb0d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:15.342184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7f6be-b2f4-4811-b130-c765267fcb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:15.342453 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3512/7085] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:56:15.353010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0034d31-15f7-4bb6-b08b-c656cdd8fdab admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:15.371033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0034d31-15f7-4bb6-b08b-c656cdd8fdab admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:15.428370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8fe7f6be-b2f4-4811-b130-c765267fcb0d None None] MFA Rules not processed for user `ec9dd9ef099b4171a91f295bdb110581`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:15.439426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8fe7f6be-b2f4-4811-b130-c765267fcb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:15.491249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04f408-aa35-4ab7-ac1d-a40f127d633b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:15.492683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04f408-aa35-4ab7-ac1d-a40f127d633b admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:15.493140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04f408-aa35-4ab7-ac1d-a40f127d633b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:15.493566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04f408-aa35-4ab7-ac1d-a40f127d633b admin admin] PATH_INFO: `/v3/projects/485cff311d0d488a87d8199336155f99/users/fcd6da7e91fc4f6aafafe416fef8a4a8/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:15.515155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04f408-aa35-4ab7-ac1d-a40f127d633b admin admin] RBAC: Authorizing `identity:create_grant(project_id=485cff311d0d488a87d8199336155f99, user_id=fcd6da7e91fc4f6aafafe416fef8a4a8, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:15.518417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04f408-aa35-4ab7-ac1d-a40f127d633b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:15.640251 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3574/7086] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:56:15.646785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7f6be-b2f4-4811-b130-c765267fcb0d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:15.648547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8fe7f6be-b2f4-4811-b130-c765267fcb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:15.692264 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3513/7087] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:56:15 2022] PUT /identity/v3/projects/485cff311d0d488a87d8199336155f99/users/fcd6da7e91fc4f6aafafe416fef8a4a8/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:15.703643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0fc50-70f6-48ab-97a5-302d12c25885 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:15.704339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0fc50-70f6-48ab-97a5-302d12c25885 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:15.704778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0fc50-70f6-48ab-97a5-302d12c25885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:15.786857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d0b0fc50-70f6-48ab-97a5-302d12c25885 None None] MFA Rules not processed for user `fcd6da7e91fc4f6aafafe416fef8a4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:15.788493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d0b0fc50-70f6-48ab-97a5-302d12c25885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:15.804850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7f6be-b2f4-4811-b130-c765267fcb0d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:15.942446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04249c-f582-4b6d-83c2-93ff67146f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:15.943801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04249c-f582-4b6d-83c2-93ff67146f53 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:15.944073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04249c-f582-4b6d-83c2-93ff67146f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:15.945138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04249c-f582-4b6d-83c2-93ff67146f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:15.950894 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3514/7088] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:16.039964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0fc50-70f6-48ab-97a5-302d12c25885 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:16.055233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0fc50-70f6-48ab-97a5-302d12c25885 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:16.074672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970801b-9db2-46d1-af95-7b2e1e86f33c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:16.076768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970801b-9db2-46d1-af95-7b2e1e86f33c service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:16.077444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970801b-9db2-46d1-af95-7b2e1e86f33c service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:16.080262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970801b-9db2-46d1-af95-7b2e1e86f33c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:16.087985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04249c-f582-4b6d-83c2-93ff67146f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:16.093087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04249c-f582-4b6d-83c2-93ff67146f53 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:16.102739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970801b-9db2-46d1-af95-7b2e1e86f33c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:16.104837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970801b-9db2-46d1-af95-7b2e1e86f33c service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:16.116640 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3575/7089] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:56:16.124302 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3515/7090] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:56:16.208691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04249c-f582-4b6d-83c2-93ff67146f53 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:16.208691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ba04249c-f582-4b6d-83c2-93ff67146f53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:16.342715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04249c-f582-4b6d-83c2-93ff67146f53 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:16.371559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7518494-c1b7-4619-a8d1-2eb93537f82e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:16.371559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7518494-c1b7-4619-a8d1-2eb93537f82e service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:16.371559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7518494-c1b7-4619-a8d1-2eb93537f82e service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:16.371559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7518494-c1b7-4619-a8d1-2eb93537f82e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:16.371885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f7518494-c1b7-4619-a8d1-2eb93537f82e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:16.404985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7518494-c1b7-4619-a8d1-2eb93537f82e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:16.409801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7518494-c1b7-4619-a8d1-2eb93537f82e service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:16.442625 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3576/7091] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:56:18.371522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970801b-9db2-46d1-af95-7b2e1e86f33c service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:18.451537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970801b-9db2-46d1-af95-7b2e1e86f33c service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:18.458258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6d577-690c-447c-87a4-3ff8c16983f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:18.459316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6d577-690c-447c-87a4-3ff8c16983f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:18.459751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6d577-690c-447c-87a4-3ff8c16983f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:18.460212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6d577-690c-447c-87a4-3ff8c16983f4 admin admin] PATH_INFO: `/v3/users/fcd6da7e91fc4f6aafafe416fef8a4a8` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:18.462575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6d577-690c-447c-87a4-3ff8c16983f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd6da7e91fc4f6aafafe416fef8a4a8)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:18.467644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6d577-690c-447c-87a4-3ff8c16983f4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:18.548959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:18.910443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fec6d577-690c-447c-87a4-3ff8c16983f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd6da7e91fc4f6aafafe416fef8a4a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:19.049737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fec6d577-690c-447c-87a4-3ff8c16983f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd6da7e91fc4f6aafafe416fef8a4a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:19.050616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fec6d577-690c-447c-87a4-3ff8c16983f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd6da7e91fc4f6aafafe416fef8a4a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:19.060637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fec6d577-690c-447c-87a4-3ff8c16983f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd6da7e91fc4f6aafafe416fef8a4a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:19.075521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:19.080101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fec6d577-690c-447c-87a4-3ff8c16983f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd6da7e91fc4f6aafafe416fef8a4a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:19.092760 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3516/7092] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:56:18 2022] DELETE /identity/v3/users/fcd6da7e91fc4f6aafafe416fef8a4a8 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:19.096333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcd92a-2838-4504-b1b0-de0b75bbfb58 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:19.096627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcd92a-2838-4504-b1b0-de0b75bbfb58 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:19.096908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcd92a-2838-4504-b1b0-de0b75bbfb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:19.157743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-28bcd92a-2838-4504-b1b0-de0b75bbfb58 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:19.161640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-28bcd92a-2838-4504-b1b0-de0b75bbfb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:19.320396 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3577/7093] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:19.382982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6d577-690c-447c-87a4-3ff8c16983f4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:19.386325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fec6d577-690c-447c-87a4-3ff8c16983f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:19.653959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6d577-690c-447c-87a4-3ff8c16983f4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:19.675202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d0afd-c217-40cc-b40f-31158dbb1cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:19.676703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d0afd-c217-40cc-b40f-31158dbb1cae service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:19.677170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d0afd-c217-40cc-b40f-31158dbb1cae service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:19.678013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d0afd-c217-40cc-b40f-31158dbb1cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:19.701983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d0afd-c217-40cc-b40f-31158dbb1cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:19.704486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d0afd-c217-40cc-b40f-31158dbb1cae service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:19.773508 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3517/7094] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:56:20.185138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcd92a-2838-4504-b1b0-de0b75bbfb58 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:20.187132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-28bcd92a-2838-4504-b1b0-de0b75bbfb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:20.205609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcd92a-2838-4504-b1b0-de0b75bbfb58 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:20.230621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d94f9-77b5-44b1-9198-dfac2b0bff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:20.230621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d94f9-77b5-44b1-9198-dfac2b0bff7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:20.230621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d94f9-77b5-44b1-9198-dfac2b0bff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:20.230621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d94f9-77b5-44b1-9198-dfac2b0bff7a admin admin] PATH_INFO: `/v3/users/7d62f6a70fc2481ba05341b9937d076c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:20.231007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d94f9-77b5-44b1-9198-dfac2b0bff7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d62f6a70fc2481ba05341b9937d076c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:20.231007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d94f9-77b5-44b1-9198-dfac2b0bff7a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:20.649796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1b8d94f9-77b5-44b1-9198-dfac2b0bff7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d62f6a70fc2481ba05341b9937d076c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:20.651557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1b8d94f9-77b5-44b1-9198-dfac2b0bff7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d62f6a70fc2481ba05341b9937d076c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:20.799635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1b8d94f9-77b5-44b1-9198-dfac2b0bff7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d62f6a70fc2481ba05341b9937d076c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:20.800469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1b8d94f9-77b5-44b1-9198-dfac2b0bff7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d62f6a70fc2481ba05341b9937d076c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:20.827949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1b8d94f9-77b5-44b1-9198-dfac2b0bff7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d62f6a70fc2481ba05341b9937d076c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:20.856908 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3578/7095] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:56:20 2022] DELETE /identity/v3/users/7d62f6a70fc2481ba05341b9937d076c => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:20.858321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db69d7a-8c71-459e-a167-5e738c2b96de None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:20.859192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db69d7a-8c71-459e-a167-5e738c2b96de None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:20.859469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db69d7a-8c71-459e-a167-5e738c2b96de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:20.895753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3db69d7a-8c71-459e-a167-5e738c2b96de None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:20.901498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3db69d7a-8c71-459e-a167-5e738c2b96de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:21.035543 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3518/7096] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:56:21.046224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d94f9-77b5-44b1-9198-dfac2b0bff7a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:21.048104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1b8d94f9-77b5-44b1-9198-dfac2b0bff7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:21.170639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db69d7a-8c71-459e-a167-5e738c2b96de None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:21.172249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3db69d7a-8c71-459e-a167-5e738c2b96de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:21.209216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db69d7a-8c71-459e-a167-5e738c2b96de None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:21.221107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8944d-91e3-4683-ba07-f7105e0d15b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:21.229430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8944d-91e3-4683-ba07-f7105e0d15b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:21.230343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8944d-91e3-4683-ba07-f7105e0d15b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:21.230738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8944d-91e3-4683-ba07-f7105e0d15b7 admin admin] PATH_INFO: `/v3/projects/485cff311d0d488a87d8199336155f99` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:21.232810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8944d-91e3-4683-ba07-f7105e0d15b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=485cff311d0d488a87d8199336155f99)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:21.236989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8944d-91e3-4683-ba07-f7105e0d15b7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:21.241691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d94f9-77b5-44b1-9198-dfac2b0bff7a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:21.260430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868eeb66-0b93-4119-948a-4b34bf38d466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:21.261891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868eeb66-0b93-4119-948a-4b34bf38d466 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:21.262647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868eeb66-0b93-4119-948a-4b34bf38d466 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:21.263388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868eeb66-0b93-4119-948a-4b34bf38d466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:21.306200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868eeb66-0b93-4119-948a-4b34bf38d466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:21.309234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868eeb66-0b93-4119-948a-4b34bf38d466 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:21.333342 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3579/7097] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:56:21.456851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:21.474299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c3a8944d-91e3-4683-ba07-f7105e0d15b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485cff311d0d488a87d8199336155f99', 'request_id': 'req-c3a8944d-91e3-4683-ba07-f7105e0d15b7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:21.491177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c3a8944d-91e3-4683-ba07-f7105e0d15b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485cff311d0d488a87d8199336155f99', 'request_id': 'req-c3a8944d-91e3-4683-ba07-f7105e0d15b7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:21.504858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c3a8944d-91e3-4683-ba07-f7105e0d15b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485cff311d0d488a87d8199336155f99', 'request_id': 'req-c3a8944d-91e3-4683-ba07-f7105e0d15b7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:21.669940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c3a8944d-91e3-4683-ba07-f7105e0d15b7 admin admin] The token cache is being invalidate because project 485cff311d0d488a87d8199336155f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:56:21.669940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c3a8944d-91e3-4683-ba07-f7105e0d15b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:21.669940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c3a8944d-91e3-4683-ba07-f7105e0d15b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:21.669940 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3519/7098] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:21 2022] DELETE /identity/v3/projects/485cff311d0d488a87d8199336155f99 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:56:21.673833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4dc64-67d8-471b-998c-370fdefac3d1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:21.674233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4dc64-67d8-471b-998c-370fdefac3d1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:21.674601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4dc64-67d8-471b-998c-370fdefac3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:21.719690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-14b4dc64-67d8-471b-998c-370fdefac3d1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:21.721911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-14b4dc64-67d8-471b-998c-370fdefac3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:21.877796 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3580/7099] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:21.878876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b9675-f54f-4cd3-a2f3-f6401eb23f4c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:21.879325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b9675-f54f-4cd3-a2f3-f6401eb23f4c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:21.879439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b9675-f54f-4cd3-a2f3-f6401eb23f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:21.908079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d98b9675-f54f-4cd3-a2f3-f6401eb23f4c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:21.909536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d98b9675-f54f-4cd3-a2f3-f6401eb23f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:21.924653 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3520/7100] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:21.928576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4dc64-67d8-471b-998c-370fdefac3d1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:21.955302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4dc64-67d8-471b-998c-370fdefac3d1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:21.988363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043121b-95c8-4f87-87c3-8b0aa279f899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:21.988984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043121b-95c8-4f87-87c3-8b0aa279f899 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:21.989271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043121b-95c8-4f87-87c3-8b0aa279f899 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:21.989542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043121b-95c8-4f87-87c3-8b0aa279f899 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:21.990203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043121b-95c8-4f87-87c3-8b0aa279f899 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:56:21.990514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043121b-95c8-4f87-87c3-8b0aa279f899 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:21.992119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043121b-95c8-4f87-87c3-8b0aa279f899 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:22.021896 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3581/7101] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:56:22.027249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b9675-f54f-4cd3-a2f3-f6401eb23f4c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:22.045280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b9675-f54f-4cd3-a2f3-f6401eb23f4c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:22.073057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107984f5-f7de-4459-9f00-62e760ee962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:22.073057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107984f5-f7de-4459-9f00-62e760ee962c admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:22.073057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107984f5-f7de-4459-9f00-62e760ee962c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:22.073057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107984f5-f7de-4459-9f00-62e760ee962c admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:22.074762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107984f5-f7de-4459-9f00-62e760ee962c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:22.074762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107984f5-f7de-4459-9f00-62e760ee962c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:22.290431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043121b-95c8-4f87-87c3-8b0aa279f899 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:22.296198 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3521/7102] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:56:22 2022] POST /identity/v3/projects => generated 373 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:56:22.303765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043121b-95c8-4f87-87c3-8b0aa279f899 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:22.374757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad2767-24e9-408f-8484-79525a63dc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:22.375754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad2767-24e9-408f-8484-79525a63dc65 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:22.376273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad2767-24e9-408f-8484-79525a63dc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:22.376757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad2767-24e9-408f-8484-79525a63dc65 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:22.377585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad2767-24e9-408f-8484-79525a63dc65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:22.379750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad2767-24e9-408f-8484-79525a63dc65 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:22.555418 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3582/7103] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:56:22 2022] POST /identity/v3/users => generated 287 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:56:22.557759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107984f5-f7de-4459-9f00-62e760ee962c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:22.581038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107984f5-f7de-4459-9f00-62e760ee962c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:22.590137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0de565-7a9f-493d-8e82-090cbb17c1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:22.591160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de565-7a9f-493d-8e82-090cbb17c1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:22.592594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de565-7a9f-493d-8e82-090cbb17c1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:22.593184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de565-7a9f-493d-8e82-090cbb17c1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:22.596155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0de565-7a9f-493d-8e82-090cbb17c1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:22.604236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0de565-7a9f-493d-8e82-090cbb17c1c9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:22.629769 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3522/7104] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:56:22.636013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad2767-24e9-408f-8484-79525a63dc65 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:22.650911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad2767-24e9-408f-8484-79525a63dc65 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:22.665356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c442b85-e2e1-48dd-b692-38d1a7e5b4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:22.671173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c442b85-e2e1-48dd-b692-38d1a7e5b4aa admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:22.671848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c442b85-e2e1-48dd-b692-38d1a7e5b4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:22.672366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c442b85-e2e1-48dd-b692-38d1a7e5b4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:22.673270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c442b85-e2e1-48dd-b692-38d1a7e5b4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:22.675182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c442b85-e2e1-48dd-b692-38d1a7e5b4aa admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:22.707224 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3583/7105] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:56:22.712234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0de565-7a9f-493d-8e82-090cbb17c1c9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:22.768862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0de565-7a9f-493d-8e82-090cbb17c1c9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:22.777217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f96f44-e5d3-42f3-bfbd-7cb87271b235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:22.778228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f96f44-e5d3-42f3-bfbd-7cb87271b235 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:22.778514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f96f44-e5d3-42f3-bfbd-7cb87271b235 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:22.785032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f96f44-e5d3-42f3-bfbd-7cb87271b235 admin admin] PATH_INFO: `/v3/projects/a035ed243e0b4ff6a2bb61230ea5a08a/users/bd2d533eb7da43f9b4924860a6c1b8e9/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:22.814446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f96f44-e5d3-42f3-bfbd-7cb87271b235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a035ed243e0b4ff6a2bb61230ea5a08a, user_id=bd2d533eb7da43f9b4924860a6c1b8e9, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:22.825555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f96f44-e5d3-42f3-bfbd-7cb87271b235 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:22.955487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c442b85-e2e1-48dd-b692-38d1a7e5b4aa admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:22.957471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1c442b85-e2e1-48dd-b692-38d1a7e5b4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:22.958603 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3523/7106] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:56:22 2022] PUT /identity/v3/projects/a035ed243e0b4ff6a2bb61230ea5a08a/users/bd2d533eb7da43f9b4924860a6c1b8e9/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:22.973255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1927054-a81a-45d5-9c07-552e4d60d7a8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:22.973549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1927054-a81a-45d5-9c07-552e4d60d7a8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:22.973825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1927054-a81a-45d5-9c07-552e4d60d7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:23.011014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c442b85-e2e1-48dd-b692-38d1a7e5b4aa admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:23.081684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a1927054-a81a-45d5-9c07-552e4d60d7a8 None None] MFA Rules not processed for user `bd2d533eb7da43f9b4924860a6c1b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:23.084678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a1927054-a81a-45d5-9c07-552e4d60d7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:23.200605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2620656-2827-4abb-a525-daf03bc1f7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:23.201639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2620656-2827-4abb-a525-daf03bc1f7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:23.202303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2620656-2827-4abb-a525-daf03bc1f7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:23.202846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2620656-2827-4abb-a525-daf03bc1f7ce admin admin] PATH_INFO: `/v3/projects/943d29bc5da84159b5212022cd4435c4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:23.210506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2620656-2827-4abb-a525-daf03bc1f7ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=943d29bc5da84159b5212022cd4435c4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:23.217685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2620656-2827-4abb-a525-daf03bc1f7ce admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:23.234233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:23.256319 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3524/7107] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:23.285605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1927054-a81a-45d5-9c07-552e4d60d7a8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:23.287330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a1927054-a81a-45d5-9c07-552e4d60d7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:23.457272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1927054-a81a-45d5-9c07-552e4d60d7a8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:23.490976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e2620656-2827-4abb-a525-daf03bc1f7ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '943d29bc5da84159b5212022cd4435c4', 'request_id': 'req-e2620656-2827-4abb-a525-daf03bc1f7ce'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:23.520506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e2620656-2827-4abb-a525-daf03bc1f7ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '943d29bc5da84159b5212022cd4435c4', 'request_id': 'req-e2620656-2827-4abb-a525-daf03bc1f7ce'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:23.609136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591dc51-bf8f-45d7-8dfb-3943df0df3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:23.609775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591dc51-bf8f-45d7-8dfb-3943df0df3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:23.610057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591dc51-bf8f-45d7-8dfb-3943df0df3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:23.610333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591dc51-bf8f-45d7-8dfb-3943df0df3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:23.645403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e2620656-2827-4abb-a525-daf03bc1f7ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '943d29bc5da84159b5212022cd4435c4', 'request_id': 'req-e2620656-2827-4abb-a525-daf03bc1f7ce'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:23.677307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e2620656-2827-4abb-a525-daf03bc1f7ce admin admin] The token cache is being invalidate because project 943d29bc5da84159b5212022cd4435c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:56:23.677921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e2620656-2827-4abb-a525-daf03bc1f7ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:23.679285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e2620656-2827-4abb-a525-daf03bc1f7ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:23.687903 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3584/7108] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:22 2022] DELETE /identity/v3/projects/943d29bc5da84159b5212022cd4435c4 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:23.693575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2620656-2827-4abb-a525-daf03bc1f7ce admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:23.696449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e2620656-2827-4abb-a525-daf03bc1f7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:23.818079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591dc51-bf8f-45d7-8dfb-3943df0df3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:23.823475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591dc51-bf8f-45d7-8dfb-3943df0df3b9 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:23.875128 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3525/7109] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:56:23.904736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2620656-2827-4abb-a525-daf03bc1f7ce admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:23.926895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aa672-c131-4637-b9b9-ad2d9d4dbdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:23.927597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aa672-c131-4637-b9b9-ad2d9d4dbdb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:23.928494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aa672-c131-4637-b9b9-ad2d9d4dbdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:23.928783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aa672-c131-4637-b9b9-ad2d9d4dbdb3 admin admin] PATH_INFO: `/v3/users/b6abe8e24472473db0db24442dbea5f3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:23.930071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018aa672-c131-4637-b9b9-ad2d9d4dbdb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6abe8e24472473db0db24442dbea5f3)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:23.932296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018aa672-c131-4637-b9b9-ad2d9d4dbdb3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:24.094191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591dc51-bf8f-45d7-8dfb-3943df0df3b9 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:24.095734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4591dc51-bf8f-45d7-8dfb-3943df0df3b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:24.141714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591dc51-bf8f-45d7-8dfb-3943df0df3b9 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:24.160336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa978acf-3b7f-4b7a-9ded-9fb802d0803f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:24.161252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa978acf-3b7f-4b7a-9ded-9fb802d0803f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:24.161694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa978acf-3b7f-4b7a-9ded-9fb802d0803f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:24.162129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa978acf-3b7f-4b7a-9ded-9fb802d0803f admin admin] PATH_INFO: `/v3/users/c7f52723046648968236d786781d2f5b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:24.176795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa978acf-3b7f-4b7a-9ded-9fb802d0803f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7f52723046648968236d786781d2f5b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:24.185549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa978acf-3b7f-4b7a-9ded-9fb802d0803f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:24.370531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-018aa672-c131-4637-b9b9-ad2d9d4dbdb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6abe8e24472473db0db24442dbea5f3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:24.374346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-018aa672-c131-4637-b9b9-ad2d9d4dbdb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6abe8e24472473db0db24442dbea5f3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:24.702682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-018aa672-c131-4637-b9b9-ad2d9d4dbdb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6abe8e24472473db0db24442dbea5f3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:24.703807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-018aa672-c131-4637-b9b9-ad2d9d4dbdb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6abe8e24472473db0db24442dbea5f3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:24.787464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-018aa672-c131-4637-b9b9-ad2d9d4dbdb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6abe8e24472473db0db24442dbea5f3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:24.801901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fa978acf-3b7f-4b7a-9ded-9fb802d0803f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7f52723046648968236d786781d2f5b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:24.827184 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3585/7110] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:56:23 2022] DELETE /identity/v3/users/b6abe8e24472473db0db24442dbea5f3 => generated 0 bytes in 1133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:24.988277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fa978acf-3b7f-4b7a-9ded-9fb802d0803f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7f52723046648968236d786781d2f5b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:24.990055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fa978acf-3b7f-4b7a-9ded-9fb802d0803f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7f52723046648968236d786781d2f5b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:25.005898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fa978acf-3b7f-4b7a-9ded-9fb802d0803f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7f52723046648968236d786781d2f5b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:25.033394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-fa978acf-3b7f-4b7a-9ded-9fb802d0803f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7f52723046648968236d786781d2f5b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:25.050936 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3526/7111] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:56:24 2022] DELETE /identity/v3/users/c7f52723046648968236d786781d2f5b => generated 0 bytes in 957 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:25.055490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cb830-abab-4c2d-bdf8-a56d58333b45 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:25.056468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cb830-abab-4c2d-bdf8-a56d58333b45 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:25.057503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cb830-abab-4c2d-bdf8-a56d58333b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:25.097615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-876cb830-abab-4c2d-bdf8-a56d58333b45 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:25.099214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-876cb830-abab-4c2d-bdf8-a56d58333b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:25.359716 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3586/7112] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:25.932681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa978acf-3b7f-4b7a-9ded-9fb802d0803f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:25.944396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fa978acf-3b7f-4b7a-9ded-9fb802d0803f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:26.082712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa978acf-3b7f-4b7a-9ded-9fb802d0803f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:26.094955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea5dcf-85fa-42c8-a9ce-5455eb709ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:26.094955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea5dcf-85fa-42c8-a9ce-5455eb709ebb service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:26.094955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea5dcf-85fa-42c8-a9ce-5455eb709ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:26.094955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea5dcf-85fa-42c8-a9ce-5455eb709ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:26.115215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea5dcf-85fa-42c8-a9ce-5455eb709ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:26.117103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea5dcf-85fa-42c8-a9ce-5455eb709ebb service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:26.140837 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3527/7113] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:56:26.251050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cb830-abab-4c2d-bdf8-a56d58333b45 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:26.252914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-876cb830-abab-4c2d-bdf8-a56d58333b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:26.291705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cb830-abab-4c2d-bdf8-a56d58333b45 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:26.322266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dc215-f030-413b-ba15-c7d18a19d9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:26.323947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dc215-f030-413b-ba15-c7d18a19d9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:26.324247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dc215-f030-413b-ba15-c7d18a19d9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:26.325612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dc215-f030-413b-ba15-c7d18a19d9e0 admin admin] PATH_INFO: `/v3/projects/75242710afb742d1bf54731062bd5cba` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:26.327420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5dc215-f030-413b-ba15-c7d18a19d9e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75242710afb742d1bf54731062bd5cba)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:26.335830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5dc215-f030-413b-ba15-c7d18a19d9e0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:26.642289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-de5dc215-f030-413b-ba15-c7d18a19d9e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75242710afb742d1bf54731062bd5cba', 'request_id': 'req-de5dc215-f030-413b-ba15-c7d18a19d9e0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:26.662530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-de5dc215-f030-413b-ba15-c7d18a19d9e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75242710afb742d1bf54731062bd5cba', 'request_id': 'req-de5dc215-f030-413b-ba15-c7d18a19d9e0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:26.805725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-de5dc215-f030-413b-ba15-c7d18a19d9e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75242710afb742d1bf54731062bd5cba', 'request_id': 'req-de5dc215-f030-413b-ba15-c7d18a19d9e0'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:26.823480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-de5dc215-f030-413b-ba15-c7d18a19d9e0 admin admin] The token cache is being invalidate because project 75242710afb742d1bf54731062bd5cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:56:26.824761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-de5dc215-f030-413b-ba15-c7d18a19d9e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:26.825833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-de5dc215-f030-413b-ba15-c7d18a19d9e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:26.830909 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3587/7114] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:26 2022] DELETE /identity/v3/projects/75242710afb742d1bf54731062bd5cba => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:26.835736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd4996-ba72-4c69-8e02-8d4197ab98bf None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:26.836324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd4996-ba72-4c69-8e02-8d4197ab98bf None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:26.836767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd4996-ba72-4c69-8e02-8d4197ab98bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:26.902517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-babd4996-ba72-4c69-8e02-8d4197ab98bf None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:26.904415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-babd4996-ba72-4c69-8e02-8d4197ab98bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:27.044280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dc215-f030-413b-ba15-c7d18a19d9e0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:27.045976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-de5dc215-f030-413b-ba15-c7d18a19d9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:27.199482 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3528/7115] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:27.217403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a931fb-38f1-487e-bd17-fd3fd325caee None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:27.219047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a931fb-38f1-487e-bd17-fd3fd325caee None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:27.222458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a931fb-38f1-487e-bd17-fd3fd325caee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:27.277165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dc215-f030-413b-ba15-c7d18a19d9e0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:27.289499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-09a931fb-38f1-487e-bd17-fd3fd325caee None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:27.293370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b4481-2476-4457-a301-d247e3da6de9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:27.294461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b4481-2476-4457-a301-d247e3da6de9 service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:27.294917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b4481-2476-4457-a301-d247e3da6de9 service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:27.295650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-09a931fb-38f1-487e-bd17-fd3fd325caee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:27.296119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b4481-2476-4457-a301-d247e3da6de9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:27.303264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-149b4481-2476-4457-a301-d247e3da6de9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:27.320469 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3529/7116] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:27.322669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a931fb-38f1-487e-bd17-fd3fd325caee None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:27.357794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b4481-2476-4457-a301-d247e3da6de9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:27.382513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b4481-2476-4457-a301-d247e3da6de9 service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:27.385459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a931fb-38f1-487e-bd17-fd3fd325caee None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:27.393493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:27.407320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7777e-1b07-4e59-a2a2-c52190d608db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:27.408922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7777e-1b07-4e59-a2a2-c52190d608db admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:27.409326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7777e-1b07-4e59-a2a2-c52190d608db admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:27.425956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7777e-1b07-4e59-a2a2-c52190d608db admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:27.425956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7777e-1b07-4e59-a2a2-c52190d608db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:56:27.425956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7777e-1b07-4e59-a2a2-c52190d608db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:27.425956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7777e-1b07-4e59-a2a2-c52190d608db admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:27.426280 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3588/7117] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:56:27.472454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b4481-2476-4457-a301-d247e3da6de9 service placement] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:27.477386 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3530/7118] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:56:27.487851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b4481-2476-4457-a301-d247e3da6de9 service placement] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:27.515893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f368a-e28d-44f3-95f8-050378dabd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:27.516515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f368a-e28d-44f3-95f8-050378dabd28 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:27.516981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f368a-e28d-44f3-95f8-050378dabd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:27.517407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f368a-e28d-44f3-95f8-050378dabd28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:27.518308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f368a-e28d-44f3-95f8-050378dabd28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:27.520386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f368a-e28d-44f3-95f8-050378dabd28 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:27.814794 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3589/7119] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:56:27 2022] POST /identity/v3/projects => generated 389 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:56:27.819340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7777e-1b07-4e59-a2a2-c52190d608db admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:27.832371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7777e-1b07-4e59-a2a2-c52190d608db admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:28.106875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7287e-635e-4576-a6d0-43adf3aa995d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:28.107509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7287e-635e-4576-a6d0-43adf3aa995d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:28.107793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7287e-635e-4576-a6d0-43adf3aa995d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:28.108071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7287e-635e-4576-a6d0-43adf3aa995d admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:28.109463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7287e-635e-4576-a6d0-43adf3aa995d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:28.112751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7287e-635e-4576-a6d0-43adf3aa995d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:28.428771 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3531/7120] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:56:27 2022] POST /identity/v3/users => generated 295 bytes in 610 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:56:28.452867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f368a-e28d-44f3-95f8-050378dabd28 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:28.504732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f368a-e28d-44f3-95f8-050378dabd28 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:28.555208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6c4ff-b1f8-4dfa-8e75-23dfd3fb53e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:28.559227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6c4ff-b1f8-4dfa-8e75-23dfd3fb53e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:28.560560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6c4ff-b1f8-4dfa-8e75-23dfd3fb53e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:28.562180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6c4ff-b1f8-4dfa-8e75-23dfd3fb53e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:28.563382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6c4ff-b1f8-4dfa-8e75-23dfd3fb53e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:28.565284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6c4ff-b1f8-4dfa-8e75-23dfd3fb53e4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:28.636277 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3590/7121] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:56:28.637370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7287e-635e-4576-a6d0-43adf3aa995d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:28.666170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7287e-635e-4576-a6d0-43adf3aa995d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:28.697152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a0267-15a0-4743-870e-79cdccf7b397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:28.698789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a0267-15a0-4743-870e-79cdccf7b397 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:28.704981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a0267-15a0-4743-870e-79cdccf7b397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:28.706271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a0267-15a0-4743-870e-79cdccf7b397 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:28.709227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a0267-15a0-4743-870e-79cdccf7b397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:28.723457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a0267-15a0-4743-870e-79cdccf7b397 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:28.755669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6c4ff-b1f8-4dfa-8e75-23dfd3fb53e4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:28.768211 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3532/7122] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:56:28.778980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6c4ff-b1f8-4dfa-8e75-23dfd3fb53e4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:28.792082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26cc49-9c72-489f-be08-937b096cc498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:28.793092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26cc49-9c72-489f-be08-937b096cc498 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:28.793479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26cc49-9c72-489f-be08-937b096cc498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:28.793863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26cc49-9c72-489f-be08-937b096cc498 admin admin] PATH_INFO: `/v3/projects/6d90b70e229c4295aeedf24108d1620c/users/cc8ec188d047416388ea4a047e1e9f19/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:28.857077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:28.868068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26cc49-9c72-489f-be08-937b096cc498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d90b70e229c4295aeedf24108d1620c, user_id=cc8ec188d047416388ea4a047e1e9f19, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:28.871576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26cc49-9c72-489f-be08-937b096cc498 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:29.151765 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3591/7123] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:56:28 2022] PUT /identity/v3/projects/6d90b70e229c4295aeedf24108d1620c/users/cc8ec188d047416388ea4a047e1e9f19/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:29.184903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8131d9b-4c32-4967-95a0-52650b74a008 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:29.185384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8131d9b-4c32-4967-95a0-52650b74a008 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:29.185841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8131d9b-4c32-4967-95a0-52650b74a008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:29.308120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a8131d9b-4c32-4967-95a0-52650b74a008 None None] MFA Rules not processed for user `cc8ec188d047416388ea4a047e1e9f19`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:29.313586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a8131d9b-4c32-4967-95a0-52650b74a008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:29.393451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26cc49-9c72-489f-be08-937b096cc498 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:29.397221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3e26cc49-9c72-489f-be08-937b096cc498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:29.604774 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3533/7124] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:29.624002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8131d9b-4c32-4967-95a0-52650b74a008 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:29.625437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26cc49-9c72-489f-be08-937b096cc498 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:29.625946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a8131d9b-4c32-4967-95a0-52650b74a008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:29.645092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e329fc-bc53-4b80-8eb2-0c9cbfad4109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:29.651217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e329fc-bc53-4b80-8eb2-0c9cbfad4109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:29.651217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e329fc-bc53-4b80-8eb2-0c9cbfad4109 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:29.651217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e329fc-bc53-4b80-8eb2-0c9cbfad4109 admin admin] PATH_INFO: `/v3/projects/34704adbdbc044248d6e89f886ff0a96` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:29.654442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e329fc-bc53-4b80-8eb2-0c9cbfad4109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34704adbdbc044248d6e89f886ff0a96)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:29.661716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e329fc-bc53-4b80-8eb2-0c9cbfad4109 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:29.839918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8131d9b-4c32-4967-95a0-52650b74a008 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:29.844111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308850fe-826a-4201-b0e4-c47519333406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:29.845037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308850fe-826a-4201-b0e4-c47519333406 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:29.845538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308850fe-826a-4201-b0e4-c47519333406 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:29.846035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308850fe-826a-4201-b0e4-c47519333406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:29.856936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308850fe-826a-4201-b0e4-c47519333406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:29.859642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308850fe-826a-4201-b0e4-c47519333406 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:29.878990 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3534/7125] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:56:30.051972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-18e329fc-bc53-4b80-8eb2-0c9cbfad4109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34704adbdbc044248d6e89f886ff0a96', 'request_id': 'req-18e329fc-bc53-4b80-8eb2-0c9cbfad4109'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:30.078135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-18e329fc-bc53-4b80-8eb2-0c9cbfad4109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34704adbdbc044248d6e89f886ff0a96', 'request_id': 'req-18e329fc-bc53-4b80-8eb2-0c9cbfad4109'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:30.371888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-18e329fc-bc53-4b80-8eb2-0c9cbfad4109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34704adbdbc044248d6e89f886ff0a96', 'request_id': 'req-18e329fc-bc53-4b80-8eb2-0c9cbfad4109'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:30.395129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-18e329fc-bc53-4b80-8eb2-0c9cbfad4109 admin admin] The token cache is being invalidate because project 34704adbdbc044248d6e89f886ff0a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:56:30.401308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-18e329fc-bc53-4b80-8eb2-0c9cbfad4109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:30.402433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-18e329fc-bc53-4b80-8eb2-0c9cbfad4109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:30.413382 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3592/7126] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:29 2022] DELETE /identity/v3/projects/34704adbdbc044248d6e89f886ff0a96 => generated 0 bytes in 1018 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:30.414782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ae9a5-fb38-46e8-8cb9-1a872acd9511 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:30.415068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ae9a5-fb38-46e8-8cb9-1a872acd9511 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:30.415528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ae9a5-fb38-46e8-8cb9-1a872acd9511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:30.481556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-262ae9a5-fb38-46e8-8cb9-1a872acd9511 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:30.484641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-262ae9a5-fb38-46e8-8cb9-1a872acd9511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:30.733680 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3535/7127] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:30.735668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb473aba-05a9-430d-93f1-4fb824c9bb2a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:30.736114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb473aba-05a9-430d-93f1-4fb824c9bb2a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:30.736498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb473aba-05a9-430d-93f1-4fb824c9bb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:30.781512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-eb473aba-05a9-430d-93f1-4fb824c9bb2a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:30.784838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-eb473aba-05a9-430d-93f1-4fb824c9bb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:30.805225 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3593/7128] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:30.810005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ae9a5-fb38-46e8-8cb9-1a872acd9511 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:30.820490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ae9a5-fb38-46e8-8cb9-1a872acd9511 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:30.832812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95347636-fcc1-419b-a0a4-5efe47630911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:30.833447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95347636-fcc1-419b-a0a4-5efe47630911 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:30.836590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95347636-fcc1-419b-a0a4-5efe47630911 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:30.836590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95347636-fcc1-419b-a0a4-5efe47630911 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:30.836590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95347636-fcc1-419b-a0a4-5efe47630911 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:56:30.836590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95347636-fcc1-419b-a0a4-5efe47630911 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:30.845845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95347636-fcc1-419b-a0a4-5efe47630911 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:30.881837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb473aba-05a9-430d-93f1-4fb824c9bb2a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:30.890528 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3536/7129] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:56:30.896982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb473aba-05a9-430d-93f1-4fb824c9bb2a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:30.905179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68bfcd-51c4-4c31-91bb-e2f1e4f9e603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:30.905975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68bfcd-51c4-4c31-91bb-e2f1e4f9e603 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:30.906357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68bfcd-51c4-4c31-91bb-e2f1e4f9e603 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:30.906574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68bfcd-51c4-4c31-91bb-e2f1e4f9e603 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:30.907247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68bfcd-51c4-4c31-91bb-e2f1e4f9e603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:30.909314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68bfcd-51c4-4c31-91bb-e2f1e4f9e603 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:31.105341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95347636-fcc1-419b-a0a4-5efe47630911 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:31.106228 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3594/7130] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:56:30 2022] POST /identity/v3/projects => generated 363 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:56:31.123640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95347636-fcc1-419b-a0a4-5efe47630911 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:31.281630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3b28c-d4f3-4a34-9917-4f78502360f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:31.284724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3b28c-d4f3-4a34-9917-4f78502360f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:31.285269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3b28c-d4f3-4a34-9917-4f78502360f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:31.286529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3b28c-d4f3-4a34-9917-4f78502360f8 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:31.287248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3b28c-d4f3-4a34-9917-4f78502360f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:31.293553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3b28c-d4f3-4a34-9917-4f78502360f8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:31.355081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:31.429158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68bfcd-51c4-4c31-91bb-e2f1e4f9e603 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:31.435934 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3537/7131] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:56:31 2022] POST /identity/v3/users => generated 282 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:56:31.442172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68bfcd-51c4-4c31-91bb-e2f1e4f9e603 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:31.465785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25f9fa-c5a1-4b5a-aa17-284c1f5992ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:31.468018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25f9fa-c5a1-4b5a-aa17-284c1f5992ae admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:31.468338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25f9fa-c5a1-4b5a-aa17-284c1f5992ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:31.469824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25f9fa-c5a1-4b5a-aa17-284c1f5992ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:31.474218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25f9fa-c5a1-4b5a-aa17-284c1f5992ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:31.477951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25f9fa-c5a1-4b5a-aa17-284c1f5992ae admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:31.508304 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3595/7132] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:56:31.513174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3b28c-d4f3-4a34-9917-4f78502360f8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:31.531471 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3b28c-d4f3-4a34-9917-4f78502360f8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:31.542811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a424c7e-62b4-49dd-adc6-b520caec5460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:31.543441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a424c7e-62b4-49dd-adc6-b520caec5460 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:31.543716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a424c7e-62b4-49dd-adc6-b520caec5460 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:31.543989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a424c7e-62b4-49dd-adc6-b520caec5460 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:31.544745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a424c7e-62b4-49dd-adc6-b520caec5460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:31.547920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a424c7e-62b4-49dd-adc6-b520caec5460 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:31.566850 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3538/7133] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:56:31.571148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25f9fa-c5a1-4b5a-aa17-284c1f5992ae admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:31.584115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25f9fa-c5a1-4b5a-aa17-284c1f5992ae admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:31.593281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468f3f3-d1b3-429d-9246-37b9ea845b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:31.594277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468f3f3-d1b3-429d-9246-37b9ea845b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:31.594815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468f3f3-d1b3-429d-9246-37b9ea845b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:31.595303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468f3f3-d1b3-429d-9246-37b9ea845b94 admin admin] PATH_INFO: `/v3/projects/3e93e1b41b114f13ba810b308eb280be/users/f1d9a7288b4f418fae249458b2ee94bd/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:31.616523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468f3f3-d1b3-429d-9246-37b9ea845b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e93e1b41b114f13ba810b308eb280be, user_id=f1d9a7288b4f418fae249458b2ee94bd, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:31.620619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468f3f3-d1b3-429d-9246-37b9ea845b94 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:31.798044 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3596/7134] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:56:31 2022] PUT /identity/v3/projects/3e93e1b41b114f13ba810b308eb280be/users/f1d9a7288b4f418fae249458b2ee94bd/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:31.810977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71e509-37a5-417a-901d-9bbf0f38b55d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:31.810977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71e509-37a5-417a-901d-9bbf0f38b55d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:31.810977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71e509-37a5-417a-901d-9bbf0f38b55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:31.851199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5d71e509-37a5-417a-901d-9bbf0f38b55d None None] MFA Rules not processed for user `f1d9a7288b4f418fae249458b2ee94bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:31.855694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5d71e509-37a5-417a-901d-9bbf0f38b55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:31.990103 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3539/7135] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:32.002493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468f3f3-d1b3-429d-9246-37b9ea845b94 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:32.007218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c468f3f3-d1b3-429d-9246-37b9ea845b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:32.143611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468f3f3-d1b3-429d-9246-37b9ea845b94 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:32.147733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3c15d-9544-441a-9f3f-579242e87f20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:32.148474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3c15d-9544-441a-9f3f-579242e87f20 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:32.149543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3c15d-9544-441a-9f3f-579242e87f20 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:32.149830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3c15d-9544-441a-9f3f-579242e87f20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:32.182165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3c15d-9544-441a-9f3f-579242e87f20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:32.183723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3c15d-9544-441a-9f3f-579242e87f20 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:32.205712 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3597/7136] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:56:33.826789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:33.999884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:36.389363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:36.513707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:38.793708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:38.872736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=7,keystone:UPDATE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:39.789355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:42.576462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:42.705852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:43.736768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:44.388954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:45.353826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:45.902600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:46.554288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71e509-37a5-417a-901d-9bbf0f38b55d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:46.555876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5d71e509-37a5-417a-901d-9bbf0f38b55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:46.656703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71e509-37a5-417a-901d-9bbf0f38b55d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:46.664717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc5c35-0c04-4c7b-b02f-cef9466d144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:46.666391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc5c35-0c04-4c7b-b02f-cef9466d144c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:46.667041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc5c35-0c04-4c7b-b02f-cef9466d144c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:46.667514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc5c35-0c04-4c7b-b02f-cef9466d144c admin admin] PATH_INFO: `/v3/users/4f0f2cda90f64e00a465ddf272986497` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:46.669099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc5c35-0c04-4c7b-b02f-cef9466d144c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f0f2cda90f64e00a465ddf272986497)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:46.671833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc5c35-0c04-4c7b-b02f-cef9466d144c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:47.159741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-88fc5c35-0c04-4c7b-b02f-cef9466d144c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f0f2cda90f64e00a465ddf272986497'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:47.281202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-88fc5c35-0c04-4c7b-b02f-cef9466d144c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f0f2cda90f64e00a465ddf272986497'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:47.281966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-88fc5c35-0c04-4c7b-b02f-cef9466d144c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f0f2cda90f64e00a465ddf272986497'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:47.294431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-88fc5c35-0c04-4c7b-b02f-cef9466d144c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f0f2cda90f64e00a465ddf272986497'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:47.325982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-88fc5c35-0c04-4c7b-b02f-cef9466d144c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f0f2cda90f64e00a465ddf272986497'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:47.342594 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3540/7137] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:56:46 2022] DELETE /identity/v3/users/4f0f2cda90f64e00a465ddf272986497 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:47.344429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef3b3d-5dd6-4f7d-9606-a8a2ccbebec6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:47.345620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef3b3d-5dd6-4f7d-9606-a8a2ccbebec6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:47.346050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef3b3d-5dd6-4f7d-9606-a8a2ccbebec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:47.390012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-91ef3b3d-5dd6-4f7d-9606-a8a2ccbebec6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:47.394102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-91ef3b3d-5dd6-4f7d-9606-a8a2ccbebec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:47.547829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:47.570859 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3598/7138] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:47.689827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc5c35-0c04-4c7b-b02f-cef9466d144c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:47.689961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef3b3d-5dd6-4f7d-9606-a8a2ccbebec6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:47.689961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-91ef3b3d-5dd6-4f7d-9606-a8a2ccbebec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:47.690915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-88fc5c35-0c04-4c7b-b02f-cef9466d144c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:47.835934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef3b3d-5dd6-4f7d-9606-a8a2ccbebec6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:47.844741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a0a35-5b13-44f1-a569-0fc4da2e4c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:47.847667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a0a35-5b13-44f1-a569-0fc4da2e4c9d service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:47.847667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a0a35-5b13-44f1-a569-0fc4da2e4c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:47.847902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a0a35-5b13-44f1-a569-0fc4da2e4c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:47.852878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc5c35-0c04-4c7b-b02f-cef9466d144c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:47.862474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03a438-0e5a-433f-9188-331b4310694a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:47.863369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03a438-0e5a-433f-9188-331b4310694a service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:47.863803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03a438-0e5a-433f-9188-331b4310694a service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:47.864485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03a438-0e5a-433f-9188-331b4310694a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:47.869676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-af03a438-0e5a-433f-9188-331b4310694a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:47.877467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a0a35-5b13-44f1-a569-0fc4da2e4c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:47.880393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a0a35-5b13-44f1-a569-0fc4da2e4c9d service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:47.908098 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3599/7139] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:56:47.988948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03a438-0e5a-433f-9188-331b4310694a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:47.990897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03a438-0e5a-433f-9188-331b4310694a service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:48.032124 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3541/7140] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 04:56:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 04:56:48.651632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:49.428500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a0a35-5b13-44f1-a569-0fc4da2e4c9d service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:49.431280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0e0a0a35-5b13-44f1-a569-0fc4da2e4c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:49.479712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a0a35-5b13-44f1-a569-0fc4da2e4c9d service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:49.501464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fc9fa-cabf-46ad-b6ef-69324ade4a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:49.502706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fc9fa-cabf-46ad-b6ef-69324ade4a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:49.503201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fc9fa-cabf-46ad-b6ef-69324ade4a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:49.503693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fc9fa-cabf-46ad-b6ef-69324ade4a51 admin admin] PATH_INFO: `/v3/users/a8b6504d5be24d67b2f600d054a0eb0c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:49.509633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fc9fa-cabf-46ad-b6ef-69324ade4a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8b6504d5be24d67b2f600d054a0eb0c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:49.513453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fc9fa-cabf-46ad-b6ef-69324ade4a51 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:49.537785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03a438-0e5a-433f-9188-331b4310694a service swift] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:49.541682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-af03a438-0e5a-433f-9188-331b4310694a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:49.588620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03a438-0e5a-433f-9188-331b4310694a service swift] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:49.597331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75547dec-c677-41ad-8f5d-8fda48a8a76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:49.599022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75547dec-c677-41ad-8f5d-8fda48a8a76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:49.599746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75547dec-c677-41ad-8f5d-8fda48a8a76d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:49.600881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75547dec-c677-41ad-8f5d-8fda48a8a76d admin admin] PATH_INFO: `/v3/projects/f0f1eb4384394fc18f1626f3e12e04e3` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:49.604287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75547dec-c677-41ad-8f5d-8fda48a8a76d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f1eb4384394fc18f1626f3e12e04e3)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:49.607755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75547dec-c677-41ad-8f5d-8fda48a8a76d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:49.680025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:49.866463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-75547dec-c677-41ad-8f5d-8fda48a8a76d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f1eb4384394fc18f1626f3e12e04e3', 'request_id': 'req-75547dec-c677-41ad-8f5d-8fda48a8a76d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:49.870341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-404fc9fa-cabf-46ad-b6ef-69324ade4a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8b6504d5be24d67b2f600d054a0eb0c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:49.871870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-404fc9fa-cabf-46ad-b6ef-69324ade4a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8b6504d5be24d67b2f600d054a0eb0c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:49.880764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-75547dec-c677-41ad-8f5d-8fda48a8a76d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f1eb4384394fc18f1626f3e12e04e3', 'request_id': 'req-75547dec-c677-41ad-8f5d-8fda48a8a76d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:49.890884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-75547dec-c677-41ad-8f5d-8fda48a8a76d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f1eb4384394fc18f1626f3e12e04e3', 'request_id': 'req-75547dec-c677-41ad-8f5d-8fda48a8a76d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:50.044556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-404fc9fa-cabf-46ad-b6ef-69324ade4a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8b6504d5be24d67b2f600d054a0eb0c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:50.045440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-404fc9fa-cabf-46ad-b6ef-69324ade4a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8b6504d5be24d67b2f600d054a0eb0c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:50.063166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-404fc9fa-cabf-46ad-b6ef-69324ade4a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8b6504d5be24d67b2f600d054a0eb0c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:50.081099 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3600/7141] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:56:49 2022] DELETE /identity/v3/users/a8b6504d5be24d67b2f600d054a0eb0c => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:50.085506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793039e3-b324-41e9-981f-b72c9c183532 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:50.086038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793039e3-b324-41e9-981f-b72c9c183532 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:50.086473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793039e3-b324-41e9-981f-b72c9c183532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:50.124097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-793039e3-b324-41e9-981f-b72c9c183532 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:50.125716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-793039e3-b324-41e9-981f-b72c9c183532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:50.200796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-75547dec-c677-41ad-8f5d-8fda48a8a76d admin admin] The token cache is being invalidate because project f0f1eb4384394fc18f1626f3e12e04e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:56:50.201488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-75547dec-c677-41ad-8f5d-8fda48a8a76d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:50.202284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-75547dec-c677-41ad-8f5d-8fda48a8a76d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:50.205047 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3542/7142] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:49 2022] DELETE /identity/v3/projects/f0f1eb4384394fc18f1626f3e12e04e3 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:56:50.218877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1f25e-1487-4de3-8497-5e4de7c52f3a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:50.219171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1f25e-1487-4de3-8497-5e4de7c52f3a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:50.219453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1f25e-1487-4de3-8497-5e4de7c52f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:50.231133 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3601/7143] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:50.246682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-29a1f25e-1487-4de3-8497-5e4de7c52f3a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:50.248401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-29a1f25e-1487-4de3-8497-5e4de7c52f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:50.249519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793039e3-b324-41e9-981f-b72c9c183532 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:50.251057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-793039e3-b324-41e9-981f-b72c9c183532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:50.267494 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3543/7144] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:50.275674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a4e6b-9c5b-4412-8fcb-a5bbc2efd02b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:50.275966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a4e6b-9c5b-4412-8fcb-a5bbc2efd02b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:50.276285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a4e6b-9c5b-4412-8fcb-a5bbc2efd02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:50.306981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-587a4e6b-9c5b-4412-8fcb-a5bbc2efd02b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:50.308290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-587a4e6b-9c5b-4412-8fcb-a5bbc2efd02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:50.317606 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3544/7145] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:50.322960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a4e6b-9c5b-4412-8fcb-a5bbc2efd02b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:50.333219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a4e6b-9c5b-4412-8fcb-a5bbc2efd02b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:50.335056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793039e3-b324-41e9-981f-b72c9c183532 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:50.340677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fadca-33ab-4e5e-b300-0ef090c1c272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:50.340677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fadca-33ab-4e5e-b300-0ef090c1c272 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:50.340677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fadca-33ab-4e5e-b300-0ef090c1c272 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:50.341003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bced0e-3e02-4aee-966e-f71177ea536a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:50.341093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fadca-33ab-4e5e-b300-0ef090c1c272 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:50.341168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bced0e-3e02-4aee-966e-f71177ea536a service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:50.341248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fadca-33ab-4e5e-b300-0ef090c1c272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:56:50.341353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bced0e-3e02-4aee-966e-f71177ea536a service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:50.341432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fadca-33ab-4e5e-b300-0ef090c1c272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:50.341504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bced0e-3e02-4aee-966e-f71177ea536a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:50.342791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fadca-33ab-4e5e-b300-0ef090c1c272 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:50.352594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bced0e-3e02-4aee-966e-f71177ea536a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:50.354211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bced0e-3e02-4aee-966e-f71177ea536a service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:50.357653 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3545/7146] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:56:50.362181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fadca-33ab-4e5e-b300-0ef090c1c272 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:50.365666 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3602/7147] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:56:50.386417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fadca-33ab-4e5e-b300-0ef090c1c272 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:50.392981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1888004-f9bf-4dc3-b950-c0999466ed4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:50.394295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1888004-f9bf-4dc3-b950-c0999466ed4c admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:50.394593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1888004-f9bf-4dc3-b950-c0999466ed4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:50.394873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1888004-f9bf-4dc3-b950-c0999466ed4c admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:50.396262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1888004-f9bf-4dc3-b950-c0999466ed4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:50.399075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1888004-f9bf-4dc3-b950-c0999466ed4c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:50.585599 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3546/7148] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:56:50 2022] POST /identity/v3/projects => generated 391 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:56:50.589946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bced0e-3e02-4aee-966e-f71177ea536a service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:50.620860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bced0e-3e02-4aee-966e-f71177ea536a service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:50.706601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca719b78-611c-4729-ba65-ea7b98a4c5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:50.707770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca719b78-611c-4729-ba65-ea7b98a4c5ee admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:50.708277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca719b78-611c-4729-ba65-ea7b98a4c5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:50.708739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca719b78-611c-4729-ba65-ea7b98a4c5ee admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:50.709720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca719b78-611c-4729-ba65-ea7b98a4c5ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:50.712422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca719b78-611c-4729-ba65-ea7b98a4c5ee admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:50.890291 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3603/7149] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:56:50 2022] POST /identity/v3/users => generated 296 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:56:50.891587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1888004-f9bf-4dc3-b950-c0999466ed4c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:50.916909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1888004-f9bf-4dc3-b950-c0999466ed4c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:50.919582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcbd1f-6468-47b6-879c-8390b98f9d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:50.920301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcbd1f-6468-47b6-879c-8390b98f9d7d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:50.920593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcbd1f-6468-47b6-879c-8390b98f9d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:50.920978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcbd1f-6468-47b6-879c-8390b98f9d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:50.921642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcbd1f-6468-47b6-879c-8390b98f9d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:50.923295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcbd1f-6468-47b6-879c-8390b98f9d7d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:50.939039 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3547/7150] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:56:50.943150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca719b78-611c-4729-ba65-ea7b98a4c5ee admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:50.953788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca719b78-611c-4729-ba65-ea7b98a4c5ee admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:50.960723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2b1a1-16c4-4571-ba07-01e741292e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:50.962155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2b1a1-16c4-4571-ba07-01e741292e91 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:50.962588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2b1a1-16c4-4571-ba07-01e741292e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:50.963046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2b1a1-16c4-4571-ba07-01e741292e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:50.963877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2b1a1-16c4-4571-ba07-01e741292e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:50.965712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2b1a1-16c4-4571-ba07-01e741292e91 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:50.977182 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3604/7151] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:56:50.983103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcbd1f-6468-47b6-879c-8390b98f9d7d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:50.994775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcbd1f-6468-47b6-879c-8390b98f9d7d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:51.000897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e9b54-9eb7-495a-bb8f-71098b19adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:51.001875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e9b54-9eb7-495a-bb8f-71098b19adde admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:51.002456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e9b54-9eb7-495a-bb8f-71098b19adde admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:51.002795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e9b54-9eb7-495a-bb8f-71098b19adde admin admin] PATH_INFO: `/v3/projects/96d18b9be3a744e8b62a60ad57a7a783/users/2da0b39a87c043dbb7ad1636954e319c/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:51.038798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e9b54-9eb7-495a-bb8f-71098b19adde admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d18b9be3a744e8b62a60ad57a7a783, user_id=2da0b39a87c043dbb7ad1636954e319c, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:51.045405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e9b54-9eb7-495a-bb8f-71098b19adde admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:51.274857 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3548/7152] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:56:50 2022] PUT /identity/v3/projects/96d18b9be3a744e8b62a60ad57a7a783/users/2da0b39a87c043dbb7ad1636954e319c/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:51.286072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94511df-90e1-4072-8f4c-d81f6fbab6cf None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:51.286466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94511df-90e1-4072-8f4c-d81f6fbab6cf None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:51.286772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94511df-90e1-4072-8f4c-d81f6fbab6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:51.290682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e9b54-9eb7-495a-bb8f-71098b19adde admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:51.292463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-876e9b54-9eb7-495a-bb8f-71098b19adde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:51.352878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d94511df-90e1-4072-8f4c-d81f6fbab6cf None None] MFA Rules not processed for user `2da0b39a87c043dbb7ad1636954e319c`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:51.354679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d94511df-90e1-4072-8f4c-d81f6fbab6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:51.428824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e9b54-9eb7-495a-bb8f-71098b19adde admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:51.438210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98801400-a0f9-4138-80c4-be3b6eed8d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:51.438878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98801400-a0f9-4138-80c4-be3b6eed8d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:51.439164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98801400-a0f9-4138-80c4-be3b6eed8d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:51.439442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98801400-a0f9-4138-80c4-be3b6eed8d1c admin admin] PATH_INFO: `/v3/projects/8294e34ae47f4d6bbb8fc590d6939221` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:51.445497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98801400-a0f9-4138-80c4-be3b6eed8d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8294e34ae47f4d6bbb8fc590d6939221)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:51.449341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98801400-a0f9-4138-80c4-be3b6eed8d1c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:51.493258 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3605/7153] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:51.517646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94511df-90e1-4072-8f4c-d81f6fbab6cf None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:51.521294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d94511df-90e1-4072-8f4c-d81f6fbab6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:51.619229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-98801400-a0f9-4138-80c4-be3b6eed8d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8294e34ae47f4d6bbb8fc590d6939221', 'request_id': 'req-98801400-a0f9-4138-80c4-be3b6eed8d1c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:51.625523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-98801400-a0f9-4138-80c4-be3b6eed8d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8294e34ae47f4d6bbb8fc590d6939221', 'request_id': 'req-98801400-a0f9-4138-80c4-be3b6eed8d1c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:51.626382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94511df-90e1-4072-8f4c-d81f6fbab6cf None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:51.641511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-98801400-a0f9-4138-80c4-be3b6eed8d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8294e34ae47f4d6bbb8fc590d6939221', 'request_id': 'req-98801400-a0f9-4138-80c4-be3b6eed8d1c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:51.723612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341fba4-eebb-48ad-a7b8-4556895198c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:51.724450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341fba4-eebb-48ad-a7b8-4556895198c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:51.725645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341fba4-eebb-48ad-a7b8-4556895198c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:51.725645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341fba4-eebb-48ad-a7b8-4556895198c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:51.797947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341fba4-eebb-48ad-a7b8-4556895198c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:51.799675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341fba4-eebb-48ad-a7b8-4556895198c1 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:51.824172 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3606/7154] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:56:51.884787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-98801400-a0f9-4138-80c4-be3b6eed8d1c admin admin] The token cache is being invalidate because project 8294e34ae47f4d6bbb8fc590d6939221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:56:51.885087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-98801400-a0f9-4138-80c4-be3b6eed8d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:51.889041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-98801400-a0f9-4138-80c4-be3b6eed8d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:56:51.890931 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3549/7155] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:56:51 2022] DELETE /identity/v3/projects/8294e34ae47f4d6bbb8fc590d6939221 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:56:51.895869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045176e-9fcc-4fff-8dc3-69947a032f77 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:51.896410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045176e-9fcc-4fff-8dc3-69947a032f77 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:51.896503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045176e-9fcc-4fff-8dc3-69947a032f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:51.963287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1045176e-9fcc-4fff-8dc3-69947a032f77 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:51.964818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1045176e-9fcc-4fff-8dc3-69947a032f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:52.112734 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3607/7156] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:52.120570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec5188-0d06-4fd6-8b60-42f6147a1b76 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:52.120849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec5188-0d06-4fd6-8b60-42f6147a1b76 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:52.121186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec5188-0d06-4fd6-8b60-42f6147a1b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:52.185850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d0ec5188-0d06-4fd6-8b60-42f6147a1b76 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:52.187092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d0ec5188-0d06-4fd6-8b60-42f6147a1b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:52.216122 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3550/7157] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:52.217134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045176e-9fcc-4fff-8dc3-69947a032f77 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:52.251021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:52.251818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045176e-9fcc-4fff-8dc3-69947a032f77 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:52.276061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27be8b-e362-42b6-8431-60d46ffeea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:52.276729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27be8b-e362-42b6-8431-60d46ffeea67 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:52.279155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27be8b-e362-42b6-8431-60d46ffeea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:52.295555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27be8b-e362-42b6-8431-60d46ffeea67 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:52.295555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27be8b-e362-42b6-8431-60d46ffeea67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:56:52.295555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27be8b-e362-42b6-8431-60d46ffeea67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:52.299282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27be8b-e362-42b6-8431-60d46ffeea67 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:52.318456 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3608/7158] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:56:52.320710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec5188-0d06-4fd6-8b60-42f6147a1b76 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:52.331315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec5188-0d06-4fd6-8b60-42f6147a1b76 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:52.347373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10c971-9de6-4739-907c-197789daa262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:52.347373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10c971-9de6-4739-907c-197789daa262 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:52.347373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10c971-9de6-4739-907c-197789daa262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:52.347373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10c971-9de6-4739-907c-197789daa262 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:52.347741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10c971-9de6-4739-907c-197789daa262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:52.348461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10c971-9de6-4739-907c-197789daa262 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:52.520509 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3551/7159] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:56:52 2022] POST /identity/v3/projects => generated 361 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:56:52.524766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27be8b-e362-42b6-8431-60d46ffeea67 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:52.538884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27be8b-e362-42b6-8431-60d46ffeea67 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:52.701137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42aa15a-e1f7-4ddb-8c4a-fe390970d0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:52.701813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aa15a-e1f7-4ddb-8c4a-fe390970d0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:52.702097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aa15a-e1f7-4ddb-8c4a-fe390970d0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:52.702374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aa15a-e1f7-4ddb-8c4a-fe390970d0e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:52.703079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42aa15a-e1f7-4ddb-8c4a-fe390970d0e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:52.705399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42aa15a-e1f7-4ddb-8c4a-fe390970d0e7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:52.882096 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3609/7160] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:56:52 2022] POST /identity/v3/users => generated 281 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:56:52.887030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10c971-9de6-4739-907c-197789daa262 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:52.926451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10c971-9de6-4739-907c-197789daa262 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:52.945707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af785e-1dae-4a46-ace4-03b436913a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:52.947292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af785e-1dae-4a46-ace4-03b436913a7c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:52.947807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af785e-1dae-4a46-ace4-03b436913a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:52.948330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af785e-1dae-4a46-ace4-03b436913a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:52.949268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af785e-1dae-4a46-ace4-03b436913a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:52.951711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af785e-1dae-4a46-ace4-03b436913a7c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:53.006125 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3552/7161] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:56:53.011418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42aa15a-e1f7-4ddb-8c4a-fe390970d0e7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:53.025361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42aa15a-e1f7-4ddb-8c4a-fe390970d0e7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:53.032067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84778b4-b758-4716-a961-8cdc4c2737f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:53.033601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84778b4-b758-4716-a961-8cdc4c2737f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:53.033601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84778b4-b758-4716-a961-8cdc4c2737f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:53.033601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84778b4-b758-4716-a961-8cdc4c2737f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:53.034508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84778b4-b758-4716-a961-8cdc4c2737f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:53.036582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84778b4-b758-4716-a961-8cdc4c2737f4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:53.049790 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3610/7162] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:56:53.053640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af785e-1dae-4a46-ace4-03b436913a7c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:53.073826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af785e-1dae-4a46-ace4-03b436913a7c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:53.108446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97690de-76fa-42c6-975f-83b845fd2007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:53.109153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97690de-76fa-42c6-975f-83b845fd2007 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:53.109443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97690de-76fa-42c6-975f-83b845fd2007 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:53.109728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97690de-76fa-42c6-975f-83b845fd2007 admin admin] PATH_INFO: `/v3/projects/77d07d6631974f55b124bb068e670fef/users/67ddf13500c6404f81651dd7bf757a77/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:53.205278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97690de-76fa-42c6-975f-83b845fd2007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d07d6631974f55b124bb068e670fef, user_id=67ddf13500c6404f81651dd7bf757a77, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:53.209737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97690de-76fa-42c6-975f-83b845fd2007 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:53.233712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:53.339300 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3553/7163] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:56:53 2022] PUT /identity/v3/projects/77d07d6631974f55b124bb068e670fef/users/67ddf13500c6404f81651dd7bf757a77/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:56:53.341639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420d9b6-a9fc-40cc-b122-7f15465f92e1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:53.341999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420d9b6-a9fc-40cc-b122-7f15465f92e1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:53.342351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420d9b6-a9fc-40cc-b122-7f15465f92e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:53.397977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5420d9b6-a9fc-40cc-b122-7f15465f92e1 None None] MFA Rules not processed for user `67ddf13500c6404f81651dd7bf757a77`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:56:53.399574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5420d9b6-a9fc-40cc-b122-7f15465f92e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:53.702456 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3611/7164] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:56:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:56:53.804590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97690de-76fa-42c6-975f-83b845fd2007 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:56:53.807052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c97690de-76fa-42c6-975f-83b845fd2007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:56:53.933953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97690de-76fa-42c6-975f-83b845fd2007 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:56:53.951076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797b3c9-bdbc-4df7-93c4-5f3de60db8fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:56:53.951854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797b3c9-bdbc-4df7-93c4-5f3de60db8fc service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:56:53.952499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797b3c9-bdbc-4df7-93c4-5f3de60db8fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:56:53.953015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797b3c9-bdbc-4df7-93c4-5f3de60db8fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:56:53.965028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797b3c9-bdbc-4df7-93c4-5f3de60db8fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:56:53.968221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797b3c9-bdbc-4df7-93c4-5f3de60db8fc service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:56:53.982451 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3554/7165] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:56:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:56:54.028451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:INSERT=8,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:54.239950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:56.340740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:57.068434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:57.101805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:58.913588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:56:58.975887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:00.355295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:01.919176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:02.525126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:02.792899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:03.484924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:05.169700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:07.489919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:08.056813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:09.302422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:09.887282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420d9b6-a9fc-40cc-b122-7f15465f92e1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:09.887415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5420d9b6-a9fc-40cc-b122-7f15465f92e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:10.017031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420d9b6-a9fc-40cc-b122-7f15465f92e1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:10.023210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde65fb-3390-4e25-9310-71268d8b63bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:10.024747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde65fb-3390-4e25-9310-71268d8b63bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:10.025287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde65fb-3390-4e25-9310-71268d8b63bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:10.025781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde65fb-3390-4e25-9310-71268d8b63bd admin admin] PATH_INFO: `/v3/users/cc8ec188d047416388ea4a047e1e9f19` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:10.027416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde65fb-3390-4e25-9310-71268d8b63bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc8ec188d047416388ea4a047e1e9f19)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:10.030377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde65fb-3390-4e25-9310-71268d8b63bd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:10.575617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797b3c9-bdbc-4df7-93c4-5f3de60db8fc service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:10.578627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7797b3c9-bdbc-4df7-93c4-5f3de60db8fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:10.622381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797b3c9-bdbc-4df7-93c4-5f3de60db8fc service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:10.628514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005ff4e-b5a2-4a26-8878-1fb93e5fe7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:10.629196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005ff4e-b5a2-4a26-8878-1fb93e5fe7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:10.636513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005ff4e-b5a2-4a26-8878-1fb93e5fe7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:10.636513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005ff4e-b5a2-4a26-8878-1fb93e5fe7ea admin admin] PATH_INFO: `/v3/users/2da0b39a87c043dbb7ad1636954e319c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:10.636513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005ff4e-b5a2-4a26-8878-1fb93e5fe7ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=2da0b39a87c043dbb7ad1636954e319c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:10.636513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005ff4e-b5a2-4a26-8878-1fb93e5fe7ea admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:10.641937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cbde65fb-3390-4e25-9310-71268d8b63bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc8ec188d047416388ea4a047e1e9f19'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:10.644887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cbde65fb-3390-4e25-9310-71268d8b63bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc8ec188d047416388ea4a047e1e9f19'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:10.800505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cbde65fb-3390-4e25-9310-71268d8b63bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc8ec188d047416388ea4a047e1e9f19'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:10.800505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cbde65fb-3390-4e25-9310-71268d8b63bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc8ec188d047416388ea4a047e1e9f19'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:10.812561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cbde65fb-3390-4e25-9310-71268d8b63bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc8ec188d047416388ea4a047e1e9f19'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:10.840789 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3612/7166] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:57:09 2022] DELETE /identity/v3/users/cc8ec188d047416388ea4a047e1e9f19 => generated 0 bytes in 955 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:57:10.845043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b655b47-ae1a-4816-b691-ee12c44cb1cc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:10.846086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b655b47-ae1a-4816-b691-ee12c44cb1cc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:10.849422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b655b47-ae1a-4816-b691-ee12c44cb1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:10.929019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1b655b47-ae1a-4816-b691-ee12c44cb1cc None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:10.930432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1b655b47-ae1a-4816-b691-ee12c44cb1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:10.980791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0005ff4e-b5a2-4a26-8878-1fb93e5fe7ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2da0b39a87c043dbb7ad1636954e319c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:11.066666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0005ff4e-b5a2-4a26-8878-1fb93e5fe7ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2da0b39a87c043dbb7ad1636954e319c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:11.068438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0005ff4e-b5a2-4a26-8878-1fb93e5fe7ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2da0b39a87c043dbb7ad1636954e319c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:11.091687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0005ff4e-b5a2-4a26-8878-1fb93e5fe7ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2da0b39a87c043dbb7ad1636954e319c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:11.139164 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3613/7167] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:11.144466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0005ff4e-b5a2-4a26-8878-1fb93e5fe7ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2da0b39a87c043dbb7ad1636954e319c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:11.161030 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3555/7168] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:57:10 2022] DELETE /identity/v3/users/2da0b39a87c043dbb7ad1636954e319c => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:57:11.165620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb16a-e4d4-4627-b502-200b5718797f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:11.170407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb16a-e4d4-4627-b502-200b5718797f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:11.170407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb16a-e4d4-4627-b502-200b5718797f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:11.211837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005ff4e-b5a2-4a26-8878-1fb93e5fe7ea admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:11.213564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0005ff4e-b5a2-4a26-8878-1fb93e5fe7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:11.225347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-288bb16a-e4d4-4627-b502-200b5718797f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:11.231464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-288bb16a-e4d4-4627-b502-200b5718797f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:11.295004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:11.421146 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3614/7169] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:11.423367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005ff4e-b5a2-4a26-8878-1fb93e5fe7ea admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:11.427943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088225b-84af-493b-aa5e-17c9c04a811b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:11.428854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088225b-84af-493b-aa5e-17c9c04a811b service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:11.434202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088225b-84af-493b-aa5e-17c9c04a811b service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:11.434202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088225b-84af-493b-aa5e-17c9c04a811b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:11.434202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9088225b-84af-493b-aa5e-17c9c04a811b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:11.458797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088225b-84af-493b-aa5e-17c9c04a811b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:11.458797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088225b-84af-493b-aa5e-17c9c04a811b service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:11.472649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bb16a-e4d4-4627-b502-200b5718797f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:11.473676 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3556/7170] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:57:11.475366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-288bb16a-e4d4-4627-b502-200b5718797f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:11.501666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bb16a-e4d4-4627-b502-200b5718797f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:11.516252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09824ce-5a02-4d39-93a9-1cd0d5604c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:11.519421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09824ce-5a02-4d39-93a9-1cd0d5604c88 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:11.520626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09824ce-5a02-4d39-93a9-1cd0d5604c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:11.521102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09824ce-5a02-4d39-93a9-1cd0d5604c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:11.558457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09824ce-5a02-4d39-93a9-1cd0d5604c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:11.564689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09824ce-5a02-4d39-93a9-1cd0d5604c88 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:11.590228 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3615/7171] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:57:11.826763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:12.365636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088225b-84af-493b-aa5e-17c9c04a811b service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:12.373485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9088225b-84af-493b-aa5e-17c9c04a811b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:12.400750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088225b-84af-493b-aa5e-17c9c04a811b service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:12.402588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f0913-4fdc-4ac2-9404-1827815476f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:12.403516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f0913-4fdc-4ac2-9404-1827815476f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:12.403793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f0913-4fdc-4ac2-9404-1827815476f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:12.404094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f0913-4fdc-4ac2-9404-1827815476f4 admin admin] PATH_INFO: `/v3/projects/96d18b9be3a744e8b62a60ad57a7a783` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:12.405819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f0913-4fdc-4ac2-9404-1827815476f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d18b9be3a744e8b62a60ad57a7a783)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:12.407775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f0913-4fdc-4ac2-9404-1827815476f4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:12.622371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c8f0913-4fdc-4ac2-9404-1827815476f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d18b9be3a744e8b62a60ad57a7a783', 'request_id': 'req-7c8f0913-4fdc-4ac2-9404-1827815476f4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:12.635374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c8f0913-4fdc-4ac2-9404-1827815476f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d18b9be3a744e8b62a60ad57a7a783', 'request_id': 'req-7c8f0913-4fdc-4ac2-9404-1827815476f4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:12.642988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c8f0913-4fdc-4ac2-9404-1827815476f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d18b9be3a744e8b62a60ad57a7a783', 'request_id': 'req-7c8f0913-4fdc-4ac2-9404-1827815476f4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:12.711776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09824ce-5a02-4d39-93a9-1cd0d5604c88 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:12.713584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f09824ce-5a02-4d39-93a9-1cd0d5604c88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:12.737862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09824ce-5a02-4d39-93a9-1cd0d5604c88 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:12.755979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c8f0913-4fdc-4ac2-9404-1827815476f4 admin admin] The token cache is being invalidate because project 96d18b9be3a744e8b62a60ad57a7a783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:57:12.756859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c8f0913-4fdc-4ac2-9404-1827815476f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:12.758234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c8f0913-4fdc-4ac2-9404-1827815476f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:12.761393 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3557/7172] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:12 2022] DELETE /identity/v3/projects/96d18b9be3a744e8b62a60ad57a7a783 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:57:12.765622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799d7e1-e491-49b1-adae-c0d40e66a9f3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:12.766000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799d7e1-e491-49b1-adae-c0d40e66a9f3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:12.766332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799d7e1-e491-49b1-adae-c0d40e66a9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:12.906528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:12.926190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d799d7e1-e491-49b1-adae-c0d40e66a9f3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:12.927430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d799d7e1-e491-49b1-adae-c0d40e66a9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:12.943859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b694627-60d6-4b11-ba2e-21c26282f847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:12.945432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b694627-60d6-4b11-ba2e-21c26282f847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:12.946503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b694627-60d6-4b11-ba2e-21c26282f847 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:12.946993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b694627-60d6-4b11-ba2e-21c26282f847 admin admin] PATH_INFO: `/v3/projects/6d90b70e229c4295aeedf24108d1620c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:12.949432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b694627-60d6-4b11-ba2e-21c26282f847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d90b70e229c4295aeedf24108d1620c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:12.959856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b694627-60d6-4b11-ba2e-21c26282f847 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:12.981423 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3558/7173] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:12.985160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9759a-e5c9-44da-88f8-50bc6c8a5e2e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:12.985160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9759a-e5c9-44da-88f8-50bc6c8a5e2e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:12.985160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9759a-e5c9-44da-88f8-50bc6c8a5e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:13.021755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3ff9759a-e5c9-44da-88f8-50bc6c8a5e2e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:13.023628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3ff9759a-e5c9-44da-88f8-50bc6c8a5e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:13.042675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:13.057378 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3559/7174] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:13.061625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9759a-e5c9-44da-88f8-50bc6c8a5e2e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:13.074818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9759a-e5c9-44da-88f8-50bc6c8a5e2e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:13.090627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce6733-44e0-413c-a46f-6d82cea5ef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:13.091544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce6733-44e0-413c-a46f-6d82cea5ef92 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:13.091964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce6733-44e0-413c-a46f-6d82cea5ef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:13.092397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce6733-44e0-413c-a46f-6d82cea5ef92 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:13.093187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce6733-44e0-413c-a46f-6d82cea5ef92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:57:13.094394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce6733-44e0-413c-a46f-6d82cea5ef92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:13.096148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce6733-44e0-413c-a46f-6d82cea5ef92 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:13.114628 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3560/7175] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:57:13.115689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce6733-44e0-413c-a46f-6d82cea5ef92 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:13.127297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce6733-44e0-413c-a46f-6d82cea5ef92 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:13.133719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06f8b5-9856-46bf-946e-97de449e9469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:13.134712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06f8b5-9856-46bf-946e-97de449e9469 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:13.135121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06f8b5-9856-46bf-946e-97de449e9469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:13.135532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06f8b5-9856-46bf-946e-97de449e9469 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:13.136333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06f8b5-9856-46bf-946e-97de449e9469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:13.138441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06f8b5-9856-46bf-946e-97de449e9469 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:13.230126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9b694627-60d6-4b11-ba2e-21c26282f847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d90b70e229c4295aeedf24108d1620c', 'request_id': 'req-9b694627-60d6-4b11-ba2e-21c26282f847'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:13.272502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9b694627-60d6-4b11-ba2e-21c26282f847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d90b70e229c4295aeedf24108d1620c', 'request_id': 'req-9b694627-60d6-4b11-ba2e-21c26282f847'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:13.274327 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3561/7176] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:57:13 2022] POST /identity/v3/projects => generated 359 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:57:13.283220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06f8b5-9856-46bf-946e-97de449e9469 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:13.363620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9b694627-60d6-4b11-ba2e-21c26282f847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d90b70e229c4295aeedf24108d1620c', 'request_id': 'req-9b694627-60d6-4b11-ba2e-21c26282f847'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:13.389543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9b694627-60d6-4b11-ba2e-21c26282f847 admin admin] The token cache is being invalidate because project 6d90b70e229c4295aeedf24108d1620c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:57:13.390240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9b694627-60d6-4b11-ba2e-21c26282f847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:13.392003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9b694627-60d6-4b11-ba2e-21c26282f847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:13.396537 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3616/7177] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:12 2022] DELETE /identity/v3/projects/6d90b70e229c4295aeedf24108d1620c => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:57:13.402539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e3ab8-b681-4c73-b897-867bd8eea57d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:13.408947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e3ab8-b681-4c73-b897-867bd8eea57d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:13.408947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e3ab8-b681-4c73-b897-867bd8eea57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:13.489354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06f8b5-9856-46bf-946e-97de449e9469 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:13.489886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2b9e3ab8-b681-4c73-b897-867bd8eea57d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:13.495220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2b9e3ab8-b681-4c73-b897-867bd8eea57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:13.505932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b08ed-4e50-4c54-a48f-b8fe2446059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:13.507095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b08ed-4e50-4c54-a48f-b8fe2446059f admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:13.508507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b08ed-4e50-4c54-a48f-b8fe2446059f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:13.509045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b08ed-4e50-4c54-a48f-b8fe2446059f admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:13.511485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b08ed-4e50-4c54-a48f-b8fe2446059f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:13.517055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b08ed-4e50-4c54-a48f-b8fe2446059f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:13.521693 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3617/7178] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:13.530502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154753f4-3d37-4bdd-bf49-8c46e944696b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:13.531298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154753f4-3d37-4bdd-bf49-8c46e944696b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:13.531783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154753f4-3d37-4bdd-bf49-8c46e944696b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:13.645781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-154753f4-3d37-4bdd-bf49-8c46e944696b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:13.651990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-154753f4-3d37-4bdd-bf49-8c46e944696b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:13.699595 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3618/7179] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:13.700657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154753f4-3d37-4bdd-bf49-8c46e944696b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:13.719959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154753f4-3d37-4bdd-bf49-8c46e944696b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:13.731066 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3562/7180] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:57:13 2022] POST /identity/v3/users => generated 280 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:57:13.735719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b08ed-4e50-4c54-a48f-b8fe2446059f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:13.738020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f25b08ed-4e50-4c54-a48f-b8fe2446059f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:13.738872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4900e-53d6-4ab8-82fc-e7f9701ff0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:13.739662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4900e-53d6-4ab8-82fc-e7f9701ff0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:13.740054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4900e-53d6-4ab8-82fc-e7f9701ff0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:13.740456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4900e-53d6-4ab8-82fc-e7f9701ff0d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:13.741340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4900e-53d6-4ab8-82fc-e7f9701ff0d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:57:13.745397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4900e-53d6-4ab8-82fc-e7f9701ff0d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:13.747274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4900e-53d6-4ab8-82fc-e7f9701ff0d1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:13.771353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b08ed-4e50-4c54-a48f-b8fe2446059f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:13.781647 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3619/7181] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:57:13.785490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6fc18-cdd1-40a5-8e49-f07ad663921e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:13.785880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4900e-53d6-4ab8-82fc-e7f9701ff0d1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:13.786153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6fc18-cdd1-40a5-8e49-f07ad663921e admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:13.789820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6fc18-cdd1-40a5-8e49-f07ad663921e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:13.790120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6fc18-cdd1-40a5-8e49-f07ad663921e admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:13.790862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6fc18-cdd1-40a5-8e49-f07ad663921e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:13.793237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6fc18-cdd1-40a5-8e49-f07ad663921e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:13.815505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4900e-53d6-4ab8-82fc-e7f9701ff0d1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:13.823792 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3563/7182] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:57:13.825202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6fc18-cdd1-40a5-8e49-f07ad663921e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:13.833301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e6a44-f4db-4a60-9b82-c6b7f6a0c423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:13.834178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e6a44-f4db-4a60-9b82-c6b7f6a0c423 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:13.834464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e6a44-f4db-4a60-9b82-c6b7f6a0c423 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:13.834741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e6a44-f4db-4a60-9b82-c6b7f6a0c423 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:13.835477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e6a44-f4db-4a60-9b82-c6b7f6a0c423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:13.838296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e6a44-f4db-4a60-9b82-c6b7f6a0c423 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:13.862482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6fc18-cdd1-40a5-8e49-f07ad663921e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:13.881925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad9f4c-0acf-44eb-b2da-7cffe7421674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:13.883924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad9f4c-0acf-44eb-b2da-7cffe7421674 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:13.884420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad9f4c-0acf-44eb-b2da-7cffe7421674 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:13.884904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad9f4c-0acf-44eb-b2da-7cffe7421674 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:13.885739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad9f4c-0acf-44eb-b2da-7cffe7421674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:13.890330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad9f4c-0acf-44eb-b2da-7cffe7421674 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:13.919829 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3564/7183] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:57:13.920544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad9f4c-0acf-44eb-b2da-7cffe7421674 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:13.923357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:13.955870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad9f4c-0acf-44eb-b2da-7cffe7421674 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:13.979189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8ddfc-8d09-46a1-ba7a-b4dcf41a063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:13.980463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8ddfc-8d09-46a1-ba7a-b4dcf41a063f admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:13.980463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8ddfc-8d09-46a1-ba7a-b4dcf41a063f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:13.981149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8ddfc-8d09-46a1-ba7a-b4dcf41a063f admin admin] PATH_INFO: `/v3/projects/fe4b55b9429141158994d6a58059854d/users/7d1308741ac14327afc1284c8f4c8e26/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:14.007178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8ddfc-8d09-46a1-ba7a-b4dcf41a063f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4b55b9429141158994d6a58059854d, user_id=7d1308741ac14327afc1284c8f4c8e26, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:14.026298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8ddfc-8d09-46a1-ba7a-b4dcf41a063f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:14.026395 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3620/7184] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:57:13 2022] POST /identity/v3/projects => generated 369 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:57:14.029803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e6a44-f4db-4a60-9b82-c6b7f6a0c423 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:14.147657 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3565/7185] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:57:13 2022] PUT /identity/v3/projects/fe4b55b9429141158994d6a58059854d/users/7d1308741ac14327afc1284c8f4c8e26/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:57:14.159959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cda983-8cac-4aa9-b4d8-f7d557b980ec None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:14.160338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cda983-8cac-4aa9-b4d8-f7d557b980ec None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:14.160619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cda983-8cac-4aa9-b4d8-f7d557b980ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:14.207661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e6a44-f4db-4a60-9b82-c6b7f6a0c423 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:14.253648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-23cda983-8cac-4aa9-b4d8-f7d557b980ec None None] MFA Rules not processed for user `7d1308741ac14327afc1284c8f4c8e26`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:14.253648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-23cda983-8cac-4aa9-b4d8-f7d557b980ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:14.323285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10743b54-311b-4239-8526-90c2ecab40ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:14.323989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743b54-311b-4239-8526-90c2ecab40ab admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:14.324310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743b54-311b-4239-8526-90c2ecab40ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:14.324590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743b54-311b-4239-8526-90c2ecab40ab admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:14.325582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10743b54-311b-4239-8526-90c2ecab40ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:14.328331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10743b54-311b-4239-8526-90c2ecab40ab admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:14.365526 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3566/7186] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:57:14.391380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cda983-8cac-4aa9-b4d8-f7d557b980ec None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:14.393252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-23cda983-8cac-4aa9-b4d8-f7d557b980ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:14.417958 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3621/7187] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:57:14 2022] POST /identity/v3/users => generated 285 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:57:14.420478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10743b54-311b-4239-8526-90c2ecab40ab admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:14.441755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10743b54-311b-4239-8526-90c2ecab40ab admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:14.457001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1cd92-dd7e-4d5b-a62b-fd47f5ac5548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:14.457649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1cd92-dd7e-4d5b-a62b-fd47f5ac5548 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:14.458082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1cd92-dd7e-4d5b-a62b-fd47f5ac5548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:14.458289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1cd92-dd7e-4d5b-a62b-fd47f5ac5548 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:14.458954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1cd92-dd7e-4d5b-a62b-fd47f5ac5548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:14.461112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1cd92-dd7e-4d5b-a62b-fd47f5ac5548 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:14.495256 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3622/7188] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:57:14.495401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cda983-8cac-4aa9-b4d8-f7d557b980ec None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:14.496399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1cd92-dd7e-4d5b-a62b-fd47f5ac5548 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:14.499174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a4e71-9f86-42c3-a948-83f4d273359a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:14.499969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a4e71-9f86-42c3-a948-83f4d273359a service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:14.500350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a4e71-9f86-42c3-a948-83f4d273359a service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:14.500635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a4e71-9f86-42c3-a948-83f4d273359a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:14.513215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a4e71-9f86-42c3-a948-83f4d273359a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:14.513424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1cd92-dd7e-4d5b-a62b-fd47f5ac5548 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:14.516276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a4e71-9f86-42c3-a948-83f4d273359a service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:14.528786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afa476-3f49-4b16-8c53-0bec24ebfc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:14.529039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afa476-3f49-4b16-8c53-0bec24ebfc55 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:14.529332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afa476-3f49-4b16-8c53-0bec24ebfc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:14.529597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afa476-3f49-4b16-8c53-0bec24ebfc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:14.530257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afa476-3f49-4b16-8c53-0bec24ebfc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:14.532149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afa476-3f49-4b16-8c53-0bec24ebfc55 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:14.556336 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3623/7189] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:57:14.556563 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3567/7190] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:57:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:57:14.560139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a4e71-9f86-42c3-a948-83f4d273359a service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:14.579325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a4e71-9f86-42c3-a948-83f4d273359a service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:14.587843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ac629-e22a-4db1-9667-4dc9d8709e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:14.590300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ac629-e22a-4db1-9667-4dc9d8709e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:14.592929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ac629-e22a-4db1-9667-4dc9d8709e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:14.596722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ac629-e22a-4db1-9667-4dc9d8709e89 admin admin] PATH_INFO: `/v3/projects/28a3cd3a811047d6892a9e9e7b8116f4/users/75c5ce0e18e84c5bb908b7d6f4ca121e/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:14.623210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ac629-e22a-4db1-9667-4dc9d8709e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a3cd3a811047d6892a9e9e7b8116f4, user_id=75c5ce0e18e84c5bb908b7d6f4ca121e, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:14.627495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ac629-e22a-4db1-9667-4dc9d8709e89 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:14.825127 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3568/7191] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:57:14 2022] PUT /identity/v3/projects/28a3cd3a811047d6892a9e9e7b8116f4/users/75c5ce0e18e84c5bb908b7d6f4ca121e/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:57:14.835321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05e653-ae25-4001-954f-d0490b342ed2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:14.837331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05e653-ae25-4001-954f-d0490b342ed2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:14.837331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05e653-ae25-4001-954f-d0490b342ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:14.894452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8e05e653-ae25-4001-954f-d0490b342ed2 None None] MFA Rules not processed for user `75c5ce0e18e84c5bb908b7d6f4ca121e`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:14.895694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8e05e653-ae25-4001-954f-d0490b342ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:15.015128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:15.066624 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3624/7192] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:15.097410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ac629-e22a-4db1-9667-4dc9d8709e89 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:15.099636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f80ac629-e22a-4db1-9667-4dc9d8709e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:15.157795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:15.265910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ac629-e22a-4db1-9667-4dc9d8709e89 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:15.271410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5a64c-d2fe-4718-8288-393d72787601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:15.272189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5a64c-d2fe-4718-8288-393d72787601 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:15.272587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5a64c-d2fe-4718-8288-393d72787601 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:15.273142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5a64c-d2fe-4718-8288-393d72787601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:15.291014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5a64c-d2fe-4718-8288-393d72787601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:15.293030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5a64c-d2fe-4718-8288-393d72787601 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:15.315455 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3569/7193] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:57:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:57:15.768402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:16.941713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:17.317413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:18.296256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:18.575925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:20.410083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:22.354884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:23.327045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:24.432908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:24.684549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:25.267060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:25.479064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:26.416352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:26.757781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:28.074120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:28.238315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:29.466091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:29.595333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:30.753533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:31.425935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:32.070182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:34.003275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:34.089303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:35.364771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:35.523106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:36.548230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:36.743595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:37.012805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:37.216388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:37.963960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:38.559624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:38.908823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:39.049732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:39.689338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:40.072636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:40.960861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:41.657339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:42.630857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:42.986887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:43.810075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:44.005981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:45.037368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05e653-ae25-4001-954f-d0490b342ed2 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:45.041089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8e05e653-ae25-4001-954f-d0490b342ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:45.124930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:45.134117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05e653-ae25-4001-954f-d0490b342ed2 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:45.140810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5a5ab-a363-4df2-84c7-b4acc9424f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:45.141894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5a5ab-a363-4df2-84c7-b4acc9424f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:45.142631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5a5ab-a363-4df2-84c7-b4acc9424f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:45.142631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5a5ab-a363-4df2-84c7-b4acc9424f0d admin admin] PATH_INFO: `/v3/users/67ddf13500c6404f81651dd7bf757a77` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:45.144637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5a5ab-a363-4df2-84c7-b4acc9424f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ddf13500c6404f81651dd7bf757a77)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:45.146648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5a5ab-a363-4df2-84c7-b4acc9424f0d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:45.471702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-37a5a5ab-a363-4df2-84c7-b4acc9424f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ddf13500c6404f81651dd7bf757a77'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:45.475550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-37a5a5ab-a363-4df2-84c7-b4acc9424f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ddf13500c6404f81651dd7bf757a77'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:45.551327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-37a5a5ab-a363-4df2-84c7-b4acc9424f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ddf13500c6404f81651dd7bf757a77'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:45.553988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-37a5a5ab-a363-4df2-84c7-b4acc9424f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ddf13500c6404f81651dd7bf757a77'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:45.589655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-37a5a5ab-a363-4df2-84c7-b4acc9424f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ddf13500c6404f81651dd7bf757a77'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:45.625243 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3625/7194] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:57:45 2022] DELETE /identity/v3/users/67ddf13500c6404f81651dd7bf757a77 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:57:45.626073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98170546-ca3b-488c-be6a-65d36aa01c19 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:45.626555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98170546-ca3b-488c-be6a-65d36aa01c19 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:45.626650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98170546-ca3b-488c-be6a-65d36aa01c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:45.680091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-98170546-ca3b-488c-be6a-65d36aa01c19 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:45.681560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-98170546-ca3b-488c-be6a-65d36aa01c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:45.805451 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3570/7195] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:45.840195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5a5ab-a363-4df2-84c7-b4acc9424f0d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:45.841902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-37a5a5ab-a363-4df2-84c7-b4acc9424f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:45.920042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:45.958508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5a5ab-a363-4df2-84c7-b4acc9424f0d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:45.968979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a25de-c874-451e-93c2-02bf8a2b307d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:45.971878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a25de-c874-451e-93c2-02bf8a2b307d service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:45.971878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a25de-c874-451e-93c2-02bf8a2b307d service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:45.972071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a25de-c874-451e-93c2-02bf8a2b307d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:45.980481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:45.993226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a25de-c874-451e-93c2-02bf8a2b307d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:45.994871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a25de-c874-451e-93c2-02bf8a2b307d service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:46.006294 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3626/7196] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:57:46.326432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98170546-ca3b-488c-be6a-65d36aa01c19 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:46.328149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-98170546-ca3b-488c-be6a-65d36aa01c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:46.524347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a25de-c874-451e-93c2-02bf8a2b307d service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:46.526088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-379a25de-c874-451e-93c2-02bf8a2b307d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:46.538980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98170546-ca3b-488c-be6a-65d36aa01c19 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:46.546815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a25de-c874-451e-93c2-02bf8a2b307d service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:46.551212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec4adb-1f18-48cb-a8fd-ccb4f82be252 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:46.552875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec4adb-1f18-48cb-a8fd-ccb4f82be252 service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:46.554133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec4adb-1f18-48cb-a8fd-ccb4f82be252 service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:46.554514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec4adb-1f18-48cb-a8fd-ccb4f82be252 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:46.557083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dcec4adb-1f18-48cb-a8fd-ccb4f82be252 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:46.558197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a698c4-3e49-41e5-9008-c534127aa67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:46.560605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a698c4-3e49-41e5-9008-c534127aa67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:46.561537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a698c4-3e49-41e5-9008-c534127aa67b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:46.562151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a698c4-3e49-41e5-9008-c534127aa67b admin admin] PATH_INFO: `/v3/projects/77d07d6631974f55b124bb068e670fef` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:46.563698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a698c4-3e49-41e5-9008-c534127aa67b admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d07d6631974f55b124bb068e670fef)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:46.566359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a698c4-3e49-41e5-9008-c534127aa67b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:46.613299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec4adb-1f18-48cb-a8fd-ccb4f82be252 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:46.615997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec4adb-1f18-48cb-a8fd-ccb4f82be252 service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:46.637274 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3571/7197] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:57:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:57:46.716405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40a698c4-3e49-41e5-9008-c534127aa67b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d07d6631974f55b124bb068e670fef', 'request_id': 'req-40a698c4-3e49-41e5-9008-c534127aa67b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:46.735923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40a698c4-3e49-41e5-9008-c534127aa67b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d07d6631974f55b124bb068e670fef', 'request_id': 'req-40a698c4-3e49-41e5-9008-c534127aa67b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:46.832943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40a698c4-3e49-41e5-9008-c534127aa67b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d07d6631974f55b124bb068e670fef', 'request_id': 'req-40a698c4-3e49-41e5-9008-c534127aa67b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:46.855445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40a698c4-3e49-41e5-9008-c534127aa67b admin admin] The token cache is being invalidate because project 77d07d6631974f55b124bb068e670fef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:57:46.855933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40a698c4-3e49-41e5-9008-c534127aa67b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:46.858137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-40a698c4-3e49-41e5-9008-c534127aa67b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:46.862192 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3627/7198] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:46 2022] DELETE /identity/v3/projects/77d07d6631974f55b124bb068e670fef => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:57:46.871141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02b906-b65f-424d-83b9-b1100dab3f05 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:46.871141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02b906-b65f-424d-83b9-b1100dab3f05 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:46.871141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02b906-b65f-424d-83b9-b1100dab3f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:46.911185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-cc02b906-b65f-424d-83b9-b1100dab3f05 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:46.912715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cc02b906-b65f-424d-83b9-b1100dab3f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:47.032307 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3572/7199] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:57:47.035628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddf74c-59cb-42ca-ae06-404e46d89ad2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:47.035917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddf74c-59cb-42ca-ae06-404e46d89ad2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:47.036213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddf74c-59cb-42ca-ae06-404e46d89ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:47.046095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:47.066965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bfddf74c-59cb-42ca-ae06-404e46d89ad2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:47.071119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bfddf74c-59cb-42ca-ae06-404e46d89ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:47.094262 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3628/7200] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:47.098534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02b906-b65f-424d-83b9-b1100dab3f05 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:47.117921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02b906-b65f-424d-83b9-b1100dab3f05 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:47.142435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c5ef3-5423-4989-93b6-eee87ac96506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:47.143089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c5ef3-5423-4989-93b6-eee87ac96506 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:47.143638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c5ef3-5423-4989-93b6-eee87ac96506 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:47.143918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c5ef3-5423-4989-93b6-eee87ac96506 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:47.145781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c5ef3-5423-4989-93b6-eee87ac96506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:57:47.153577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c5ef3-5423-4989-93b6-eee87ac96506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:47.153577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c5ef3-5423-4989-93b6-eee87ac96506 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:47.179095 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3573/7201] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:57:47.183415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddf74c-59cb-42ca-ae06-404e46d89ad2 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:47.196075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddf74c-59cb-42ca-ae06-404e46d89ad2 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:47.212684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37145b-af14-417b-8d6d-d1ff8b91cf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:47.213623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37145b-af14-417b-8d6d-d1ff8b91cf1a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:47.213907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37145b-af14-417b-8d6d-d1ff8b91cf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:47.215689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37145b-af14-417b-8d6d-d1ff8b91cf1a admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:47.216376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37145b-af14-417b-8d6d-d1ff8b91cf1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:47.221837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37145b-af14-417b-8d6d-d1ff8b91cf1a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:47.358994 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3629/7202] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:57:47 2022] POST /identity/v3/projects => generated 405 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:57:47.362790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c5ef3-5423-4989-93b6-eee87ac96506 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:47.378189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c5ef3-5423-4989-93b6-eee87ac96506 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:47.487139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:47.555055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22af33-5360-4960-ad28-54653488622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:47.556510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22af33-5360-4960-ad28-54653488622e admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:47.556983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22af33-5360-4960-ad28-54653488622e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:47.562957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22af33-5360-4960-ad28-54653488622e admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:47.562957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22af33-5360-4960-ad28-54653488622e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:47.562957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22af33-5360-4960-ad28-54653488622e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:47.656110 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3574/7203] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:57:47 2022] POST /identity/v3/users => generated 303 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:57:47.660220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37145b-af14-417b-8d6d-d1ff8b91cf1a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:47.680788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37145b-af14-417b-8d6d-d1ff8b91cf1a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:47.690437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f3082-78f4-4f48-968f-293f9a8fe3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:47.691528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f3082-78f4-4f48-968f-293f9a8fe3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:47.692080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f3082-78f4-4f48-968f-293f9a8fe3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:47.692576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f3082-78f4-4f48-968f-293f9a8fe3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:47.693926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f3082-78f4-4f48-968f-293f9a8fe3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:47.696528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f3082-78f4-4f48-968f-293f9a8fe3a2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:47.711434 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3630/7204] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:57:47.715549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22af33-5360-4960-ad28-54653488622e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:47.735649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22af33-5360-4960-ad28-54653488622e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:47.758983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b262872-e6fc-4fc5-9afc-171c9983ea03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:47.759987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b262872-e6fc-4fc5-9afc-171c9983ea03 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:47.760660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b262872-e6fc-4fc5-9afc-171c9983ea03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:47.761038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b262872-e6fc-4fc5-9afc-171c9983ea03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:47.761803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b262872-e6fc-4fc5-9afc-171c9983ea03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:47.765277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b262872-e6fc-4fc5-9afc-171c9983ea03 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:47.812665 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3575/7205] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:57:47.812867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f3082-78f4-4f48-968f-293f9a8fe3a2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:47.832005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f3082-78f4-4f48-968f-293f9a8fe3a2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:47.845163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e52e16-3072-492b-b67f-774e74dbc0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:47.845866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e52e16-3072-492b-b67f-774e74dbc0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:47.846154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e52e16-3072-492b-b67f-774e74dbc0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:47.846426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e52e16-3072-492b-b67f-774e74dbc0b7 admin admin] PATH_INFO: `/v3/projects/22694a56cb1c4cd3a2ac84786b0e5bc7/users/f3b2518f62d44993bd2404615eec4ec7/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:47.894149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e52e16-3072-492b-b67f-774e74dbc0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22694a56cb1c4cd3a2ac84786b0e5bc7, user_id=f3b2518f62d44993bd2404615eec4ec7, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:47.902688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e52e16-3072-492b-b67f-774e74dbc0b7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:48.050301 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3631/7206] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:57:47 2022] PUT /identity/v3/projects/22694a56cb1c4cd3a2ac84786b0e5bc7/users/f3b2518f62d44993bd2404615eec4ec7/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:57:48.061151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c4269-a524-4be1-9c4e-a5e6f8173929 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:48.061430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c4269-a524-4be1-9c4e-a5e6f8173929 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:48.062444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c4269-a524-4be1-9c4e-a5e6f8173929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:48.121298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7d0c4269-a524-4be1-9c4e-a5e6f8173929 None None] MFA Rules not processed for user `f3b2518f62d44993bd2404615eec4ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:48.123509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7d0c4269-a524-4be1-9c4e-a5e6f8173929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:48.187694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:48.347578 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3576/7207] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:48 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:48.348906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e52e16-3072-492b-b67f-774e74dbc0b7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:48.445184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e52e16-3072-492b-b67f-774e74dbc0b7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:48.477108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeb2da-9386-4468-b474-e94344028f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:48.478104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeb2da-9386-4468-b474-e94344028f41 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:48.478484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeb2da-9386-4468-b474-e94344028f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:48.478823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeb2da-9386-4468-b474-e94344028f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:48.479853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aeb2da-9386-4468-b474-e94344028f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:48.488678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aeb2da-9386-4468-b474-e94344028f41 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:48.617600 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3632/7208] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:57:48 2022] POST /identity/v3/projects => generated 395 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:57:48.619219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c4269-a524-4be1-9c4e-a5e6f8173929 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:48.635835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c4269-a524-4be1-9c4e-a5e6f8173929 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:48.743590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb7572-c8f0-4c4d-9872-39ad4788fb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:48.745095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb7572-c8f0-4c4d-9872-39ad4788fb1e admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:48.745618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb7572-c8f0-4c4d-9872-39ad4788fb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:48.746076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb7572-c8f0-4c4d-9872-39ad4788fb1e admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:48.747077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb7572-c8f0-4c4d-9872-39ad4788fb1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:48.749538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb7572-c8f0-4c4d-9872-39ad4788fb1e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:48.877981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeb2da-9386-4468-b474-e94344028f41 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:48.884953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-84aeb2da-9386-4468-b474-e94344028f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:48.910016 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3577/7209] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:57:48 2022] POST /identity/v3/users => generated 304 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:57:48.913655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeb2da-9386-4468-b474-e94344028f41 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:48.913940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb7572-c8f0-4c4d-9872-39ad4788fb1e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:48.929954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344937f-f88f-4e05-9b48-47d475fd4353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:48.931730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344937f-f88f-4e05-9b48-47d475fd4353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:48.932408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344937f-f88f-4e05-9b48-47d475fd4353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:48.933229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb7572-c8f0-4c4d-9872-39ad4788fb1e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:48.934416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344937f-f88f-4e05-9b48-47d475fd4353 admin admin] PATH_INFO: `/v3/users/75c5ce0e18e84c5bb908b7d6f4ca121e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:48.935938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344937f-f88f-4e05-9b48-47d475fd4353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75c5ce0e18e84c5bb908b7d6f4ca121e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:48.938305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344937f-f88f-4e05-9b48-47d475fd4353 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:48.951970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198a7f5-62b2-49e9-8532-90b5575f5bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:48.951970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198a7f5-62b2-49e9-8532-90b5575f5bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:48.951970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198a7f5-62b2-49e9-8532-90b5575f5bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:48.951970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198a7f5-62b2-49e9-8532-90b5575f5bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:48.952396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198a7f5-62b2-49e9-8532-90b5575f5bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:48.952396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198a7f5-62b2-49e9-8532-90b5575f5bd2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:49.002575 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3578/7210] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:57:49.012335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198a7f5-62b2-49e9-8532-90b5575f5bd2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:49.032373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198a7f5-62b2-49e9-8532-90b5575f5bd2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:49.039246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceed755-c0a5-4869-92d2-dab28013d9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:49.040034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceed755-c0a5-4869-92d2-dab28013d9b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:49.040423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceed755-c0a5-4869-92d2-dab28013d9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:49.040799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceed755-c0a5-4869-92d2-dab28013d9b3 admin admin] PATH_INFO: `/v3/projects/00d628aaed4445e48d75839a66f8276a/users/77612f15cc8a422b82d07837f99b03a3/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:49.061024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceed755-c0a5-4869-92d2-dab28013d9b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d628aaed4445e48d75839a66f8276a, user_id=77612f15cc8a422b82d07837f99b03a3, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:49.064309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceed755-c0a5-4869-92d2-dab28013d9b3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:49.158432 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3579/7211] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:57:49 2022] PUT /identity/v3/projects/00d628aaed4445e48d75839a66f8276a/users/77612f15cc8a422b82d07837f99b03a3/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:57:49.162369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceed755-c0a5-4869-92d2-dab28013d9b3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:49.199773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3344937f-f88f-4e05-9b48-47d475fd4353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75c5ce0e18e84c5bb908b7d6f4ca121e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:49.202789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3344937f-f88f-4e05-9b48-47d475fd4353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75c5ce0e18e84c5bb908b7d6f4ca121e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:49.272369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceed755-c0a5-4869-92d2-dab28013d9b3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:49.277690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3344937f-f88f-4e05-9b48-47d475fd4353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75c5ce0e18e84c5bb908b7d6f4ca121e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:49.278911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3344937f-f88f-4e05-9b48-47d475fd4353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75c5ce0e18e84c5bb908b7d6f4ca121e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:49.284967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c70cae-f8b9-4685-9657-65aab2b314f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:49.285734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c70cae-f8b9-4685-9657-65aab2b314f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:49.286059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c70cae-f8b9-4685-9657-65aab2b314f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:49.286334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c70cae-f8b9-4685-9657-65aab2b314f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:49.287180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c70cae-f8b9-4685-9657-65aab2b314f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:49.289067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c70cae-f8b9-4685-9657-65aab2b314f8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:49.298816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3344937f-f88f-4e05-9b48-47d475fd4353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75c5ce0e18e84c5bb908b7d6f4ca121e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:49.301317 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3580/7212] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:57:49.305583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:49.306735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c70cae-f8b9-4685-9657-65aab2b314f8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:49.310335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-23c70cae-f8b9-4685-9657-65aab2b314f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:49.325716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c70cae-f8b9-4685-9657-65aab2b314f8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:49.326887 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3633/7213] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:57:48 2022] DELETE /identity/v3/users/75c5ce0e18e84c5bb908b7d6f4ca121e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:57:49.329740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:49.331856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d559435-8012-418c-9733-cc3af6cfd080 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:49.332145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d559435-8012-418c-9733-cc3af6cfd080 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:49.332445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d559435-8012-418c-9733-cc3af6cfd080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:49.391411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8d559435-8012-418c-9733-cc3af6cfd080 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:49.393311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8d559435-8012-418c-9733-cc3af6cfd080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:49.459278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ea86a-ef75-4788-9df9-4424715bb642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:49.460002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ea86a-ef75-4788-9df9-4424715bb642 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:49.462991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ea86a-ef75-4788-9df9-4424715bb642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:49.463277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ea86a-ef75-4788-9df9-4424715bb642 admin admin] PATH_INFO: `/v3/projects/00d628aaed4445e48d75839a66f8276a/users/77612f15cc8a422b82d07837f99b03a3/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:49.481436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ea86a-ef75-4788-9df9-4424715bb642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d628aaed4445e48d75839a66f8276a, user_id=77612f15cc8a422b82d07837f99b03a3, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:49.502521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ea86a-ef75-4788-9df9-4424715bb642 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:49.528637 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3634/7214] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:49.532670 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3581/7215] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:57:49 2022] PUT /identity/v3/projects/00d628aaed4445e48d75839a66f8276a/users/77612f15cc8a422b82d07837f99b03a3/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:57:49.554470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d559435-8012-418c-9733-cc3af6cfd080 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:49.555635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5411f-96db-4a97-a802-fd5bd3e27089 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:49.556223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5411f-96db-4a97-a802-fd5bd3e27089 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:49.556542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5411f-96db-4a97-a802-fd5bd3e27089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:49.568924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8d559435-8012-418c-9733-cc3af6cfd080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:49.650179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e1d5411f-96db-4a97-a802-fd5bd3e27089 None None] MFA Rules not processed for user `77612f15cc8a422b82d07837f99b03a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:49.658641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e1d5411f-96db-4a97-a802-fd5bd3e27089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:49.698670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d559435-8012-418c-9733-cc3af6cfd080 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:49.785731 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3582/7216] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:49 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:49.794135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5411f-96db-4a97-a802-fd5bd3e27089 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:49.796932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e1d5411f-96db-4a97-a802-fd5bd3e27089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:49.829762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a3c15-4cc1-4881-b760-6385f43551c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:49.830385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a3c15-4cc1-4881-b760-6385f43551c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:49.830858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a3c15-4cc1-4881-b760-6385f43551c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:49.831147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a3c15-4cc1-4881-b760-6385f43551c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:49.983044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a3c15-4cc1-4881-b760-6385f43551c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:49.985300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a3c15-4cc1-4881-b760-6385f43551c1 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:50.002060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5411f-96db-4a97-a802-fd5bd3e27089 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:50.012124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28676acf-492c-45d3-9c96-df49ae9f5bae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:50.014624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28676acf-492c-45d3-9c96-df49ae9f5bae service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:50.016363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28676acf-492c-45d3-9c96-df49ae9f5bae service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:50.016767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28676acf-492c-45d3-9c96-df49ae9f5bae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:50.041355 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3635/7217] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:57:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:57:50.065081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28676acf-492c-45d3-9c96-df49ae9f5bae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:50.075223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28676acf-492c-45d3-9c96-df49ae9f5bae service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:50.158981 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3583/7218] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:57:49 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:57:50.387251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a3c15-4cc1-4881-b760-6385f43551c1 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:50.401525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a3c15-4cc1-4881-b760-6385f43551c1 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:50.414487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a6913-d9bb-445c-a0f6-610402fec3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:50.415105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a6913-d9bb-445c-a0f6-610402fec3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:50.415389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a6913-d9bb-445c-a0f6-610402fec3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:50.415685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a6913-d9bb-445c-a0f6-610402fec3c3 admin admin] PATH_INFO: `/v3/users/f3b2518f62d44993bd2404615eec4ec7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:50.425152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a6913-d9bb-445c-a0f6-610402fec3c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3b2518f62d44993bd2404615eec4ec7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:50.427075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a6913-d9bb-445c-a0f6-610402fec3c3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:50.931025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28676acf-492c-45d3-9c96-df49ae9f5bae service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:50.933980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-28676acf-492c-45d3-9c96-df49ae9f5bae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:50.960465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28676acf-492c-45d3-9c96-df49ae9f5bae service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:50.987993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abe823-932e-45b5-a466-6d420aa899b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:50.992733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abe823-932e-45b5-a466-6d420aa899b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:50.993029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abe823-932e-45b5-a466-6d420aa899b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:50.993316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abe823-932e-45b5-a466-6d420aa899b1 admin admin] PATH_INFO: `/v3/projects/28a3cd3a811047d6892a9e9e7b8116f4` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:50.997398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abe823-932e-45b5-a466-6d420aa899b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a3cd3a811047d6892a9e9e7b8116f4)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:51.000366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abe823-932e-45b5-a466-6d420aa899b1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:51.079768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-240a6913-d9bb-445c-a0f6-610402fec3c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3b2518f62d44993bd2404615eec4ec7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:51.081738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-240a6913-d9bb-445c-a0f6-610402fec3c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3b2518f62d44993bd2404615eec4ec7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:51.193024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-240a6913-d9bb-445c-a0f6-610402fec3c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3b2518f62d44993bd2404615eec4ec7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:51.195519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-240a6913-d9bb-445c-a0f6-610402fec3c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3b2518f62d44993bd2404615eec4ec7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:51.234926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-240a6913-d9bb-445c-a0f6-610402fec3c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3b2518f62d44993bd2404615eec4ec7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:51.253356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-31abe823-932e-45b5-a466-6d420aa899b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a3cd3a811047d6892a9e9e7b8116f4', 'request_id': 'req-31abe823-932e-45b5-a466-6d420aa899b1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:51.268775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-31abe823-932e-45b5-a466-6d420aa899b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a3cd3a811047d6892a9e9e7b8116f4', 'request_id': 'req-31abe823-932e-45b5-a466-6d420aa899b1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:51.272365 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3636/7219] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:57:50 2022] DELETE /identity/v3/users/f3b2518f62d44993bd2404615eec4ec7 => generated 0 bytes in 885 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:57:51.280152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfdf7f-28cd-42e3-8eb8-f63da1e696b8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:51.283238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfdf7f-28cd-42e3-8eb8-f63da1e696b8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:51.283916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfdf7f-28cd-42e3-8eb8-f63da1e696b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:51.288825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-31abe823-932e-45b5-a466-6d420aa899b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a3cd3a811047d6892a9e9e7b8116f4', 'request_id': 'req-31abe823-932e-45b5-a466-6d420aa899b1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:51.335042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4acfdf7f-28cd-42e3-8eb8-f63da1e696b8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:51.336700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4acfdf7f-28cd-42e3-8eb8-f63da1e696b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:51.379980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-31abe823-932e-45b5-a466-6d420aa899b1 admin admin] The token cache is being invalidate because project 28a3cd3a811047d6892a9e9e7b8116f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:57:51.389543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-31abe823-932e-45b5-a466-6d420aa899b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:51.389543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-31abe823-932e-45b5-a466-6d420aa899b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:51.389543 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3584/7220] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:50 2022] DELETE /identity/v3/projects/28a3cd3a811047d6892a9e9e7b8116f4 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:57:51.389924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb840dd-9de0-41c2-9f75-893f611b7d27 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:51.390213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb840dd-9de0-41c2-9f75-893f611b7d27 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:51.390484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb840dd-9de0-41c2-9f75-893f611b7d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:51.433274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2bb840dd-9de0-41c2-9f75-893f611b7d27 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:51.434527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2bb840dd-9de0-41c2-9f75-893f611b7d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:51.460720 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3637/7221] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:51.576263 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3585/7222] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:51.584087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3082adb-7486-4d3a-a0af-1375a22c6f95 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:51.584400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3082adb-7486-4d3a-a0af-1375a22c6f95 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:51.584678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3082adb-7486-4d3a-a0af-1375a22c6f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:51.656677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c3082adb-7486-4d3a-a0af-1375a22c6f95 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:51.661753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c3082adb-7486-4d3a-a0af-1375a22c6f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:51.681716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb840dd-9de0-41c2-9f75-893f611b7d27 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:51.683146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2bb840dd-9de0-41c2-9f75-893f611b7d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:51.713198 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3638/7223] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:51.717569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3082adb-7486-4d3a-a0af-1375a22c6f95 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:51.744824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:51.777218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3082adb-7486-4d3a-a0af-1375a22c6f95 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:51.793317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfa490-a119-4424-bc9a-5c137842eff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:51.794198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfa490-a119-4424-bc9a-5c137842eff6 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:51.794198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfa490-a119-4424-bc9a-5c137842eff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:51.794461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfa490-a119-4424-bc9a-5c137842eff6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:51.797563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfa490-a119-4424-bc9a-5c137842eff6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:57:51.798617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfa490-a119-4424-bc9a-5c137842eff6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:51.805519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfa490-a119-4424-bc9a-5c137842eff6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:51.849072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:51.860046 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3639/7224] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:57:51.863271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfa490-a119-4424-bc9a-5c137842eff6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:51.893936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfa490-a119-4424-bc9a-5c137842eff6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:51.895647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb840dd-9de0-41c2-9f75-893f611b7d27 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:51.903552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440bd06-3113-48eb-9eb3-4554774b228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:51.904488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440bd06-3113-48eb-9eb3-4554774b228e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:51.904488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440bd06-3113-48eb-9eb3-4554774b228e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:51.904735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440bd06-3113-48eb-9eb3-4554774b228e admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:51.905370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440bd06-3113-48eb-9eb3-4554774b228e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:51.906851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607e0da-7bdf-4282-920e-eede51fc97a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:51.907481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607e0da-7bdf-4282-920e-eede51fc97a6 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:51.907765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607e0da-7bdf-4282-920e-eede51fc97a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:51.908039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607e0da-7bdf-4282-920e-eede51fc97a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:51.929014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440bd06-3113-48eb-9eb3-4554774b228e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:51.936147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607e0da-7bdf-4282-920e-eede51fc97a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:51.941298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607e0da-7bdf-4282-920e-eede51fc97a6 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:51.970697 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3586/7225] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:57:52.192468 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3640/7226] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:57:51 2022] POST /identity/v3/projects => generated 377 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:57:52.193704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607e0da-7bdf-4282-920e-eede51fc97a6 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:52.207242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607e0da-7bdf-4282-920e-eede51fc97a6 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:52.410832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a0af9-1744-4ac3-a3f2-3bf3f5953ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:52.413558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a0af9-1744-4ac3-a3f2-3bf3f5953ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:52.415473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a0af9-1744-4ac3-a3f2-3bf3f5953ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:52.416616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a0af9-1744-4ac3-a3f2-3bf3f5953ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:52.417447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a0af9-1744-4ac3-a3f2-3bf3f5953ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:52.421618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a0af9-1744-4ac3-a3f2-3bf3f5953ee1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:52.541404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440bd06-3113-48eb-9eb3-4554774b228e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:52.550816 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3587/7227] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:57:52 2022] POST /identity/v3/users => generated 289 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:57:52.565217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440bd06-3113-48eb-9eb3-4554774b228e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:52.584533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb32d6-c247-41ab-b058-2b6a47defe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:52.588561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb32d6-c247-41ab-b058-2b6a47defe23 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:52.592992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb32d6-c247-41ab-b058-2b6a47defe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:52.594064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb32d6-c247-41ab-b058-2b6a47defe23 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:52.596681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb32d6-c247-41ab-b058-2b6a47defe23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:52.605249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb32d6-c247-41ab-b058-2b6a47defe23 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:52.654979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a0af9-1744-4ac3-a3f2-3bf3f5953ee1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:52.668855 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3641/7228] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:57:52.675355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a0af9-1744-4ac3-a3f2-3bf3f5953ee1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:52.695954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4dcad-dd96-47b8-bff3-eca8a94992ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:52.697558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4dcad-dd96-47b8-bff3-eca8a94992ad admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:52.698848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4dcad-dd96-47b8-bff3-eca8a94992ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:52.700541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4dcad-dd96-47b8-bff3-eca8a94992ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:52.701541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4dcad-dd96-47b8-bff3-eca8a94992ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:52.710175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4dcad-dd96-47b8-bff3-eca8a94992ad admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:52.744394 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3588/7229] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:57:52.749100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb32d6-c247-41ab-b058-2b6a47defe23 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:52.764981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb32d6-c247-41ab-b058-2b6a47defe23 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:52.780510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa92ba-f74e-458d-b8c1-c947ebfa9fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:52.781117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa92ba-f74e-458d-b8c1-c947ebfa9fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:52.781414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa92ba-f74e-458d-b8c1-c947ebfa9fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:52.781697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa92ba-f74e-458d-b8c1-c947ebfa9fb5 admin admin] PATH_INFO: `/v3/projects/744fe6fbf4b44159ad283c8628a5b3f6/users/015862552a3d4e54ae38755ad2c928c1/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:52.825183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa92ba-f74e-458d-b8c1-c947ebfa9fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=744fe6fbf4b44159ad283c8628a5b3f6, user_id=015862552a3d4e54ae38755ad2c928c1, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:52.828447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa92ba-f74e-458d-b8c1-c947ebfa9fb5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:53.656889 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3642/7230] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:57:52 2022] PUT /identity/v3/projects/744fe6fbf4b44159ad283c8628a5b3f6/users/015862552a3d4e54ae38755ad2c928c1/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 908 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:57:53.681214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec904c-e5a2-462b-8fee-88f6bec913b6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:53.681623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec904c-e5a2-462b-8fee-88f6bec913b6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:53.681712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec904c-e5a2-462b-8fee-88f6bec913b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:53.746937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b2ec904c-e5a2-462b-8fee-88f6bec913b6 None None] MFA Rules not processed for user `015862552a3d4e54ae38755ad2c928c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:53.748746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b2ec904c-e5a2-462b-8fee-88f6bec913b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:53.827040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:53.902845 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3589/7231] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:54.133897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa92ba-f74e-458d-b8c1-c947ebfa9fb5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:54.137133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c5fa92ba-f74e-458d-b8c1-c947ebfa9fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:54.325729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa92ba-f74e-458d-b8c1-c947ebfa9fb5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:54.335028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cc9ae-6d4e-4e1e-b264-cef35499e62b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:54.335766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cc9ae-6d4e-4e1e-b264-cef35499e62b service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:54.336088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cc9ae-6d4e-4e1e-b264-cef35499e62b service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:54.337599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cc9ae-6d4e-4e1e-b264-cef35499e62b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:54.369775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cc9ae-6d4e-4e1e-b264-cef35499e62b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:54.378455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cc9ae-6d4e-4e1e-b264-cef35499e62b service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:54.410281 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3643/7232] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:57:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:57:54.472300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec904c-e5a2-462b-8fee-88f6bec913b6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:54.576117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec904c-e5a2-462b-8fee-88f6bec913b6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:54.606298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03034b9a-9f4b-4a2b-93cc-2bd0847f9485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:54.610584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034b9a-9f4b-4a2b-93cc-2bd0847f9485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:54.610584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034b9a-9f4b-4a2b-93cc-2bd0847f9485 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:54.610584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034b9a-9f4b-4a2b-93cc-2bd0847f9485 admin admin] PATH_INFO: `/v3/users/015862552a3d4e54ae38755ad2c928c1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:54.610584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03034b9a-9f4b-4a2b-93cc-2bd0847f9485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=015862552a3d4e54ae38755ad2c928c1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:54.611433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03034b9a-9f4b-4a2b-93cc-2bd0847f9485 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:54.667206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:54.881375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-03034b9a-9f4b-4a2b-93cc-2bd0847f9485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '015862552a3d4e54ae38755ad2c928c1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:54.987531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cc9ae-6d4e-4e1e-b264-cef35499e62b service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:54.989152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0a3cc9ae-6d4e-4e1e-b264-cef35499e62b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:55.014427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-03034b9a-9f4b-4a2b-93cc-2bd0847f9485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '015862552a3d4e54ae38755ad2c928c1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:55.019860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-03034b9a-9f4b-4a2b-93cc-2bd0847f9485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '015862552a3d4e54ae38755ad2c928c1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:55.022382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cc9ae-6d4e-4e1e-b264-cef35499e62b service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:55.030680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd9961-92d1-4bd9-ab03-66b2c995fa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:55.032590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd9961-92d1-4bd9-ab03-66b2c995fa4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:55.033080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd9961-92d1-4bd9-ab03-66b2c995fa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:55.033568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd9961-92d1-4bd9-ab03-66b2c995fa4e admin admin] PATH_INFO: `/v3/projects/22694a56cb1c4cd3a2ac84786b0e5bc7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:55.035096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd9961-92d1-4bd9-ab03-66b2c995fa4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=22694a56cb1c4cd3a2ac84786b0e5bc7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:55.037602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd9961-92d1-4bd9-ab03-66b2c995fa4e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:55.039793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-03034b9a-9f4b-4a2b-93cc-2bd0847f9485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '015862552a3d4e54ae38755ad2c928c1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:55.062318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:55.070099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-03034b9a-9f4b-4a2b-93cc-2bd0847f9485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '015862552a3d4e54ae38755ad2c928c1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:55.081495 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3590/7233] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:57:54 2022] DELETE /identity/v3/users/015862552a3d4e54ae38755ad2c928c1 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:57:55.083655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fd18f-5237-4c7a-87ef-348aa7fe95a6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:55.083949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fd18f-5237-4c7a-87ef-348aa7fe95a6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:55.084636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fd18f-5237-4c7a-87ef-348aa7fe95a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:55.113563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-852fd18f-5237-4c7a-87ef-348aa7fe95a6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:55.115863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-852fd18f-5237-4c7a-87ef-348aa7fe95a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:55.201970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-addd9961-92d1-4bd9-ab03-66b2c995fa4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22694a56cb1c4cd3a2ac84786b0e5bc7', 'request_id': 'req-addd9961-92d1-4bd9-ab03-66b2c995fa4e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:55.208598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-addd9961-92d1-4bd9-ab03-66b2c995fa4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22694a56cb1c4cd3a2ac84786b0e5bc7', 'request_id': 'req-addd9961-92d1-4bd9-ab03-66b2c995fa4e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:55.249182 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3591/7234] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:55.261300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fd18f-5237-4c7a-87ef-348aa7fe95a6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:55.264840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-852fd18f-5237-4c7a-87ef-348aa7fe95a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:55.334216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-addd9961-92d1-4bd9-ab03-66b2c995fa4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22694a56cb1c4cd3a2ac84786b0e5bc7', 'request_id': 'req-addd9961-92d1-4bd9-ab03-66b2c995fa4e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:55.358161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-addd9961-92d1-4bd9-ab03-66b2c995fa4e admin admin] The token cache is being invalidate because project 22694a56cb1c4cd3a2ac84786b0e5bc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:57:55.358538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-addd9961-92d1-4bd9-ab03-66b2c995fa4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:55.363713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-addd9961-92d1-4bd9-ab03-66b2c995fa4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:55.370761 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3644/7235] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:54 2022] DELETE /identity/v3/projects/22694a56cb1c4cd3a2ac84786b0e5bc7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:57:55.371902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd9961-92d1-4bd9-ab03-66b2c995fa4e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:55.375299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-addd9961-92d1-4bd9-ab03-66b2c995fa4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:55.406285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fd18f-5237-4c7a-87ef-348aa7fe95a6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:55.559995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd9961-92d1-4bd9-ab03-66b2c995fa4e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:55.566674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2ce75-aa9e-4bf6-9bb0-74f7ab757818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:55.567437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2ce75-aa9e-4bf6-9bb0-74f7ab757818 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:55.568349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2ce75-aa9e-4bf6-9bb0-74f7ab757818 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:55.568762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2ce75-aa9e-4bf6-9bb0-74f7ab757818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:55.571571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4fa2ce75-aa9e-4bf6-9bb0-74f7ab757818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:55.579508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf575ed2-ee96-46ca-bc24-d3ff1bcd8298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:55.581309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf575ed2-ee96-46ca-bc24-d3ff1bcd8298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:55.582050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf575ed2-ee96-46ca-bc24-d3ff1bcd8298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:55.582777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf575ed2-ee96-46ca-bc24-d3ff1bcd8298 admin admin] PATH_INFO: `/v3/users/77612f15cc8a422b82d07837f99b03a3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:55.584485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf575ed2-ee96-46ca-bc24-d3ff1bcd8298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77612f15cc8a422b82d07837f99b03a3)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:55.588910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2ce75-aa9e-4bf6-9bb0-74f7ab757818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:55.592333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2ce75-aa9e-4bf6-9bb0-74f7ab757818 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:55.599129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf575ed2-ee96-46ca-bc24-d3ff1bcd8298 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:55.611673 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3592/7236] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:57:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:57:55.946159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bf575ed2-ee96-46ca-bc24-d3ff1bcd8298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77612f15cc8a422b82d07837f99b03a3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:55.946159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bf575ed2-ee96-46ca-bc24-d3ff1bcd8298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77612f15cc8a422b82d07837f99b03a3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:56.059756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bf575ed2-ee96-46ca-bc24-d3ff1bcd8298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77612f15cc8a422b82d07837f99b03a3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:56.060677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bf575ed2-ee96-46ca-bc24-d3ff1bcd8298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77612f15cc8a422b82d07837f99b03a3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:56.087522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bf575ed2-ee96-46ca-bc24-d3ff1bcd8298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77612f15cc8a422b82d07837f99b03a3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:56.105539 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3645/7237] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:57:55 2022] DELETE /identity/v3/users/77612f15cc8a422b82d07837f99b03a3 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:57:56.597546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:57.015674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:57.093558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2ce75-aa9e-4bf6-9bb0-74f7ab757818 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:57.093558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4fa2ce75-aa9e-4bf6-9bb0-74f7ab757818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:57.120994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2ce75-aa9e-4bf6-9bb0-74f7ab757818 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:57.259705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733dd45-aa1b-4f11-8956-ff7c2bfa6ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:57.260473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733dd45-aa1b-4f11-8956-ff7c2bfa6ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:57.260761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733dd45-aa1b-4f11-8956-ff7c2bfa6ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:57.262024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733dd45-aa1b-4f11-8956-ff7c2bfa6ec9 admin admin] PATH_INFO: `/v3/projects/744fe6fbf4b44159ad283c8628a5b3f6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:57.264285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733dd45-aa1b-4f11-8956-ff7c2bfa6ec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=744fe6fbf4b44159ad283c8628a5b3f6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:57.266092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733dd45-aa1b-4f11-8956-ff7c2bfa6ec9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:57.523261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b733dd45-aa1b-4f11-8956-ff7c2bfa6ec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744fe6fbf4b44159ad283c8628a5b3f6', 'request_id': 'req-b733dd45-aa1b-4f11-8956-ff7c2bfa6ec9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:57.543154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b733dd45-aa1b-4f11-8956-ff7c2bfa6ec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744fe6fbf4b44159ad283c8628a5b3f6', 'request_id': 'req-b733dd45-aa1b-4f11-8956-ff7c2bfa6ec9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:57.562927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b733dd45-aa1b-4f11-8956-ff7c2bfa6ec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744fe6fbf4b44159ad283c8628a5b3f6', 'request_id': 'req-b733dd45-aa1b-4f11-8956-ff7c2bfa6ec9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:57.695175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b733dd45-aa1b-4f11-8956-ff7c2bfa6ec9 admin admin] The token cache is being invalidate because project 744fe6fbf4b44159ad283c8628a5b3f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:57:57.695175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b733dd45-aa1b-4f11-8956-ff7c2bfa6ec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:57.695175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b733dd45-aa1b-4f11-8956-ff7c2bfa6ec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:57.695175 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3593/7238] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:57 2022] DELETE /identity/v3/projects/744fe6fbf4b44159ad283c8628a5b3f6 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:57:57.698460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2b3db-d73e-493c-bcfc-02f96832a169 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:57.699375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2b3db-d73e-493c-bcfc-02f96832a169 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:57.699865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2b3db-d73e-493c-bcfc-02f96832a169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:57.766809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1ff2b3db-d73e-493c-bcfc-02f96832a169 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:57.771880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1ff2b3db-d73e-493c-bcfc-02f96832a169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:57.955120 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3646/7239] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:57.963677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e9d9e-aba8-4275-970e-b7d31d66a534 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:57.963677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e9d9e-aba8-4275-970e-b7d31d66a534 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:57.963677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e9d9e-aba8-4275-970e-b7d31d66a534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:58.017598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d24e9d9e-aba8-4275-970e-b7d31d66a534 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:58.023568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d24e9d9e-aba8-4275-970e-b7d31d66a534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:58.027240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2b3db-d73e-493c-bcfc-02f96832a169 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:58.030073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1ff2b3db-d73e-493c-bcfc-02f96832a169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:58.064483 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3594/7240] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:58.064483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e9d9e-aba8-4275-970e-b7d31d66a534 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:58.064683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2b3db-d73e-493c-bcfc-02f96832a169 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:58.079461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bdf00-a8ea-4057-b709-d90c3f7c5f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:58.081010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bdf00-a8ea-4057-b709-d90c3f7c5f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:58.081453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bdf00-a8ea-4057-b709-d90c3f7c5f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:58.081743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bdf00-a8ea-4057-b709-d90c3f7c5f77 admin admin] PATH_INFO: `/v3/projects/00d628aaed4445e48d75839a66f8276a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:58.085661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e9d9e-aba8-4275-970e-b7d31d66a534 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:58.089217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bdf00-a8ea-4057-b709-d90c3f7c5f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d628aaed4445e48d75839a66f8276a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:58.097777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bdf00-a8ea-4057-b709-d90c3f7c5f77 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:58.100475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee48a9-930f-43aa-8395-115758bd96ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:58.101316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee48a9-930f-43aa-8395-115758bd96ea admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:58.101788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee48a9-930f-43aa-8395-115758bd96ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:58.110599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee48a9-930f-43aa-8395-115758bd96ea admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:58.110599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee48a9-930f-43aa-8395-115758bd96ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:57:58.110599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee48a9-930f-43aa-8395-115758bd96ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:58.113193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee48a9-930f-43aa-8395-115758bd96ea admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:58.145243 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3595/7241] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:57:58.149326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee48a9-930f-43aa-8395-115758bd96ea admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:58.158585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:58.188018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee48a9-930f-43aa-8395-115758bd96ea admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:58.205363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c65e32-35a9-4171-b699-1a701a0eb23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:58.205941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c65e32-35a9-4171-b699-1a701a0eb23d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:58.207411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c65e32-35a9-4171-b699-1a701a0eb23d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:58.209002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c65e32-35a9-4171-b699-1a701a0eb23d admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:58.214118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c65e32-35a9-4171-b699-1a701a0eb23d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:58.221498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c65e32-35a9-4171-b699-1a701a0eb23d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:58.267600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-132bdf00-a8ea-4057-b709-d90c3f7c5f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d628aaed4445e48d75839a66f8276a', 'request_id': 'req-132bdf00-a8ea-4057-b709-d90c3f7c5f77'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:58.278608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-132bdf00-a8ea-4057-b709-d90c3f7c5f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d628aaed4445e48d75839a66f8276a', 'request_id': 'req-132bdf00-a8ea-4057-b709-d90c3f7c5f77'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:58.322785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:58.377546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-132bdf00-a8ea-4057-b709-d90c3f7c5f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d628aaed4445e48d75839a66f8276a', 'request_id': 'req-132bdf00-a8ea-4057-b709-d90c3f7c5f77'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:58.378810 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3596/7242] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:57:58 2022] POST /identity/v3/projects => generated 363 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:57:58.379607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c65e32-35a9-4171-b699-1a701a0eb23d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:58.392389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-132bdf00-a8ea-4057-b709-d90c3f7c5f77 admin admin] The token cache is being invalidate because project 00d628aaed4445e48d75839a66f8276a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:57:58.393023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-132bdf00-a8ea-4057-b709-d90c3f7c5f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:58.393974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-132bdf00-a8ea-4057-b709-d90c3f7c5f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:57:58.397703 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3647/7243] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:57:58 2022] DELETE /identity/v3/projects/00d628aaed4445e48d75839a66f8276a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:57:58.402572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c60c28-55c5-4cfd-94fe-73a2796c5207 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:58.403367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c60c28-55c5-4cfd-94fe-73a2796c5207 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:58.404194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c60c28-55c5-4cfd-94fe-73a2796c5207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:58.483260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-89c60c28-55c5-4cfd-94fe-73a2796c5207 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:58.488511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-89c60c28-55c5-4cfd-94fe-73a2796c5207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:58.527644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c65e32-35a9-4171-b699-1a701a0eb23d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:58.549374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08d372-cd0d-4cc8-8efd-ab8fca79ee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:58.550021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08d372-cd0d-4cc8-8efd-ab8fca79ee82 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:58.550307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08d372-cd0d-4cc8-8efd-ab8fca79ee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:58.550587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08d372-cd0d-4cc8-8efd-ab8fca79ee82 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:58.554059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08d372-cd0d-4cc8-8efd-ab8fca79ee82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:58.558415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08d372-cd0d-4cc8-8efd-ab8fca79ee82 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:58.678807 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3648/7244] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:58.683420 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3597/7245] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:57:58 2022] POST /identity/v3/users => generated 282 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:57:58.686081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c60c28-55c5-4cfd-94fe-73a2796c5207 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:58.687132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912c29-e3fe-4149-99ab-666652f5598c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:58.687637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912c29-e3fe-4149-99ab-666652f5598c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:58.687976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-89c60c28-55c5-4cfd-94fe-73a2796c5207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:58.688315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912c29-e3fe-4149-99ab-666652f5598c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:58.719783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c60c28-55c5-4cfd-94fe-73a2796c5207 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:58.737554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09015be8-d87b-42c9-9632-bc4ebda838fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:58.738223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09015be8-d87b-42c9-9632-bc4ebda838fa admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:58.738511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09015be8-d87b-42c9-9632-bc4ebda838fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:58.738700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e6912c29-e3fe-4149-99ab-666652f5598c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:58.738817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09015be8-d87b-42c9-9632-bc4ebda838fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:58.739427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09015be8-d87b-42c9-9632-bc4ebda838fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:58.741928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09015be8-d87b-42c9-9632-bc4ebda838fa admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:58.742338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e6912c29-e3fe-4149-99ab-666652f5598c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:58.765827 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3598/7246] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:57:58.769652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6912c29-e3fe-4149-99ab-666652f5598c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:58.777713 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3649/7247] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:57:58.779517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09015be8-d87b-42c9-9632-bc4ebda838fa admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:58.794625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6912c29-e3fe-4149-99ab-666652f5598c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:58.802881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09015be8-d87b-42c9-9632-bc4ebda838fa admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:58.809721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a615f-dcc0-4463-837a-03161c661af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:58.810649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b420b-5a5f-49fc-9408-579193431691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:58.810930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a615f-dcc0-4463-837a-03161c661af6 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:58.811290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b420b-5a5f-49fc-9408-579193431691 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:58.811568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a615f-dcc0-4463-837a-03161c661af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:58.811700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b420b-5a5f-49fc-9408-579193431691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:58.811963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b420b-5a5f-49fc-9408-579193431691 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:58.812316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a615f-dcc0-4463-837a-03161c661af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:58.812687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b420b-5a5f-49fc-9408-579193431691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:57:58.812998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b420b-5a5f-49fc-9408-579193431691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:58.813551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a615f-dcc0-4463-837a-03161c661af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:58.814671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b420b-5a5f-49fc-9408-579193431691 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:58.815745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a615f-dcc0-4463-837a-03161c661af6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:58.836318 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3650/7248] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:57:58.838498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a615f-dcc0-4463-837a-03161c661af6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:58.846358 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3599/7249] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:57:58.851195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b420b-5a5f-49fc-9408-579193431691 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:58.853118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a615f-dcc0-4463-837a-03161c661af6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:58.862685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883e354-6812-492f-81da-afa3cf2f9670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:58.864590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883e354-6812-492f-81da-afa3cf2f9670 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:58.864590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883e354-6812-492f-81da-afa3cf2f9670 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:58.865572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883e354-6812-492f-81da-afa3cf2f9670 admin admin] PATH_INFO: `/v3/projects/fdf9a781471e4ac1a350c87d48fd08c0/users/65bf79d20ee64e2f8b4d7acf37d8fde8/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:58.871942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b420b-5a5f-49fc-9408-579193431691 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:58.886436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04f6c3-cfc5-4f3e-9a2f-fc9e40178f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:58.887258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04f6c3-cfc5-4f3e-9a2f-fc9e40178f1f admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:58.887550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04f6c3-cfc5-4f3e-9a2f-fc9e40178f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:58.887828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04f6c3-cfc5-4f3e-9a2f-fc9e40178f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:58.888514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04f6c3-cfc5-4f3e-9a2f-fc9e40178f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:58.893242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04f6c3-cfc5-4f3e-9a2f-fc9e40178f1f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:58.928258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883e354-6812-492f-81da-afa3cf2f9670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf9a781471e4ac1a350c87d48fd08c0, user_id=65bf79d20ee64e2f8b4d7acf37d8fde8, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:58.934081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883e354-6812-492f-81da-afa3cf2f9670 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:59.034371 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3600/7250] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:57:58 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:57:59.035530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04f6c3-cfc5-4f3e-9a2f-fc9e40178f1f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:59.073771 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3651/7251] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:57:58 2022] PUT /identity/v3/projects/fdf9a781471e4ac1a350c87d48fd08c0/users/65bf79d20ee64e2f8b4d7acf37d8fde8/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:57:59.091923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dd3f1-8a38-4d42-8658-1080fb396ca1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:59.095355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dd3f1-8a38-4d42-8658-1080fb396ca1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:59.095355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dd3f1-8a38-4d42-8658-1080fb396ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:59.140480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:59.186140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-112dd3f1-8a38-4d42-8658-1080fb396ca1 None None] MFA Rules not processed for user `65bf79d20ee64e2f8b4d7acf37d8fde8`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:57:59.187836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-112dd3f1-8a38-4d42-8658-1080fb396ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:57:59.208672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04f6c3-cfc5-4f3e-9a2f-fc9e40178f1f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:59.300426 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3652/7252] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:57:59.301677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dd3f1-8a38-4d42-8658-1080fb396ca1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:59.419984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2263398-3072-43cf-b6b2-2fe78ba5228a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:59.420679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2263398-3072-43cf-b6b2-2fe78ba5228a admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:59.420969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2263398-3072-43cf-b6b2-2fe78ba5228a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:59.421249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2263398-3072-43cf-b6b2-2fe78ba5228a admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:59.421913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2263398-3072-43cf-b6b2-2fe78ba5228a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:59.424020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2263398-3072-43cf-b6b2-2fe78ba5228a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:59.467904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dd3f1-8a38-4d42-8658-1080fb396ca1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:59.480457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4664343-4f83-44e1-9f1a-b2e994173acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:59.481102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4664343-4f83-44e1-9f1a-b2e994173acd admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:59.481394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4664343-4f83-44e1-9f1a-b2e994173acd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:59.482386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4664343-4f83-44e1-9f1a-b2e994173acd admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:59.483041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4664343-4f83-44e1-9f1a-b2e994173acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:59.485900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4664343-4f83-44e1-9f1a-b2e994173acd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:59.551514 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3601/7253] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:57:59 2022] POST /identity/v3/users => generated 286 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:57:59.556252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2263398-3072-43cf-b6b2-2fe78ba5228a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:59.574800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2263398-3072-43cf-b6b2-2fe78ba5228a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:59.590762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea26f4-87cf-41a0-b5a5-c3753d77d581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:59.591424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea26f4-87cf-41a0-b5a5-c3753d77d581 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:59.591709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea26f4-87cf-41a0-b5a5-c3753d77d581 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:59.591989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea26f4-87cf-41a0-b5a5-c3753d77d581 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:59.592714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea26f4-87cf-41a0-b5a5-c3753d77d581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:59.594416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea26f4-87cf-41a0-b5a5-c3753d77d581 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:59.622743 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3602/7254] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:57:59.622972 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3653/7255] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:57:59 2022] POST /identity/v3/projects => generated 361 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:57:59.624581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea26f4-87cf-41a0-b5a5-c3753d77d581 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:59.628925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4664343-4f83-44e1-9f1a-b2e994173acd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:59.641839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea26f4-87cf-41a0-b5a5-c3753d77d581 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:59.749525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fc2fc-5838-4540-a068-6825aa4abdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:59.751277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fc2fc-5838-4540-a068-6825aa4abdea admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:59.751781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fc2fc-5838-4540-a068-6825aa4abdea admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:59.752917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fc2fc-5838-4540-a068-6825aa4abdea admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:59.753720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fc2fc-5838-4540-a068-6825aa4abdea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:59.757547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fc2fc-5838-4540-a068-6825aa4abdea admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:59.763444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4664343-4f83-44e1-9f1a-b2e994173acd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:59.774588 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3603/7256] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:57:59.775706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fc2fc-5838-4540-a068-6825aa4abdea admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:59.779758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60140d-f2e3-4438-be7b-d57d982678e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:59.780419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60140d-f2e3-4438-be7b-d57d982678e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:59.780705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60140d-f2e3-4438-be7b-d57d982678e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:59.780982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60140d-f2e3-4438-be7b-d57d982678e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:59.781622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60140d-f2e3-4438-be7b-d57d982678e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:59.783604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60140d-f2e3-4438-be7b-d57d982678e7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:59.796137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fc2fc-5838-4540-a068-6825aa4abdea admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:59.804025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2a95d-ad32-494c-a8e9-0820d9bd9bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:57:59.804945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2a95d-ad32-494c-a8e9-0820d9bd9bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:59.805529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2a95d-ad32-494c-a8e9-0820d9bd9bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:59.805922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2a95d-ad32-494c-a8e9-0820d9bd9bb9 admin admin] PATH_INFO: `/v3/projects/03860cdbe8584e989d57ccd817f112b5/users/f34730edf38a41eebfc589f97e273e22/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:57:59.823323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:57:59.836101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2a95d-ad32-494c-a8e9-0820d9bd9bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03860cdbe8584e989d57ccd817f112b5, user_id=f34730edf38a41eebfc589f97e273e22, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:57:59.840032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2a95d-ad32-494c-a8e9-0820d9bd9bb9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:57:59.936009 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3654/7257] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:57:59 2022] POST /identity/v3/users => generated 287 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:57:59.939827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60140d-f2e3-4438-be7b-d57d982678e7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:57:59.940010 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3604/7258] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:57:59 2022] PUT /identity/v3/projects/03860cdbe8584e989d57ccd817f112b5/users/f34730edf38a41eebfc589f97e273e22/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:57:59.953791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60140d-f2e3-4438-be7b-d57d982678e7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:57:59.965097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c66e76-20f0-4a2a-9a40-97dfb247f721 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:57:59.965097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c66e76-20f0-4a2a-9a40-97dfb247f721 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:57:59.965097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c66e76-20f0-4a2a-9a40-97dfb247f721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:00.038996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-70c66e76-20f0-4a2a-9a40-97dfb247f721 None None] MFA Rules not processed for user `f34730edf38a41eebfc589f97e273e22`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:00.039636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-70c66e76-20f0-4a2a-9a40-97dfb247f721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:00.047504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37962669-d10a-43fa-b156-d8fd8daff57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:00.051111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37962669-d10a-43fa-b156-d8fd8daff57a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:00.051427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37962669-d10a-43fa-b156-d8fd8daff57a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:00.051689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37962669-d10a-43fa-b156-d8fd8daff57a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:00.053144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37962669-d10a-43fa-b156-d8fd8daff57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:00.057600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37962669-d10a-43fa-b156-d8fd8daff57a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:00.109817 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3655/7259] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:58:00.114218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37962669-d10a-43fa-b156-d8fd8daff57a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:00.147109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37962669-d10a-43fa-b156-d8fd8daff57a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:00.162859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e7f51-1313-4772-98e3-2ca0172d2457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:00.168335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e7f51-1313-4772-98e3-2ca0172d2457 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:00.168335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e7f51-1313-4772-98e3-2ca0172d2457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:00.168335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e7f51-1313-4772-98e3-2ca0172d2457 admin admin] PATH_INFO: `/v3/projects/a86f76c1efed47328ee3687611084bc2/users/8d5db42727b24936aa3293942a3f233c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:00.203564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e7f51-1313-4772-98e3-2ca0172d2457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86f76c1efed47328ee3687611084bc2, user_id=8d5db42727b24936aa3293942a3f233c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:00.210273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e7f51-1313-4772-98e3-2ca0172d2457 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:00.223787 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3605/7260] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:57:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:58:00.226377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c66e76-20f0-4a2a-9a40-97dfb247f721 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:00.253818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c66e76-20f0-4a2a-9a40-97dfb247f721 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:00.261380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a26f3-3479-4df7-b81e-64c887dba8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:00.261560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a26f3-3479-4df7-b81e-64c887dba8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:00.261813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a26f3-3479-4df7-b81e-64c887dba8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:00.261985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a26f3-3479-4df7-b81e-64c887dba8f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:00.262674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a26f3-3479-4df7-b81e-64c887dba8f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:00.266303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a26f3-3479-4df7-b81e-64c887dba8f2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:00.316812 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3656/7261] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:00 2022] PUT /identity/v3/projects/a86f76c1efed47328ee3687611084bc2/users/8d5db42727b24936aa3293942a3f233c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:00.318863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e7f51-1313-4772-98e3-2ca0172d2457 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:00.430163 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3606/7262] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:58:00 2022] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:00.434530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a26f3-3479-4df7-b81e-64c887dba8f2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:00.481963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e7f51-1313-4772-98e3-2ca0172d2457 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:00.550600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a26f3-3479-4df7-b81e-64c887dba8f2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:00.563108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f391cdd-910d-42dc-b6d7-4ca20e878696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:00.566461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f391cdd-910d-42dc-b6d7-4ca20e878696 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:00.569371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f391cdd-910d-42dc-b6d7-4ca20e878696 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:00.569802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f391cdd-910d-42dc-b6d7-4ca20e878696 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:00.574525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f391cdd-910d-42dc-b6d7-4ca20e878696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:00.574525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f391cdd-910d-42dc-b6d7-4ca20e878696 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:00.590023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b325a-c886-43c9-8e39-770514c11e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:00.590949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b325a-c886-43c9-8e39-770514c11e16 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:00.591230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b325a-c886-43c9-8e39-770514c11e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:00.591951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b325a-c886-43c9-8e39-770514c11e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:00.592355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b325a-c886-43c9-8e39-770514c11e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:00.593969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b325a-c886-43c9-8e39-770514c11e16 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:00.610023 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3657/7263] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:00.618823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b325a-c886-43c9-8e39-770514c11e16 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:00.623359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b325a-c886-43c9-8e39-770514c11e16 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:00.628794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ae8e3-b1c7-4478-b6ab-d7733ccd492c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:00.629469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ae8e3-b1c7-4478-b6ab-d7733ccd492c admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:00.629748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ae8e3-b1c7-4478-b6ab-d7733ccd492c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:00.630355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ae8e3-b1c7-4478-b6ab-d7733ccd492c admin admin] PATH_INFO: `/v3/projects/a86f76c1efed47328ee3687611084bc2/users/8d5db42727b24936aa3293942a3f233c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:00.632652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ae8e3-b1c7-4478-b6ab-d7733ccd492c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86f76c1efed47328ee3687611084bc2, user_id=8d5db42727b24936aa3293942a3f233c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:00.635336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ae8e3-b1c7-4478-b6ab-d7733ccd492c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:00.657290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:00.667691 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3658/7264] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:00 2022] PUT /identity/v3/projects/a86f76c1efed47328ee3687611084bc2/users/8d5db42727b24936aa3293942a3f233c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:00.669946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c84825-0265-44aa-b33d-ae98cf73466d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:00.670691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c84825-0265-44aa-b33d-ae98cf73466d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:00.670691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c84825-0265-44aa-b33d-ae98cf73466d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:00.696145 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3607/7265] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:58:00 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:00.703469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f391cdd-910d-42dc-b6d7-4ca20e878696 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:00.714142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-97c84825-0265-44aa-b33d-ae98cf73466d None None] MFA Rules not processed for user `8d5db42727b24936aa3293942a3f233c`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:00.717113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-97c84825-0265-44aa-b33d-ae98cf73466d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:00.718123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f391cdd-910d-42dc-b6d7-4ca20e878696 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:00.816713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509b048-c5c8-4857-b425-150d5942f46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:00.817850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509b048-c5c8-4857-b425-150d5942f46c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:00.818348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509b048-c5c8-4857-b425-150d5942f46c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:00.818831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509b048-c5c8-4857-b425-150d5942f46c admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:00.819693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509b048-c5c8-4857-b425-150d5942f46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:00.822067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509b048-c5c8-4857-b425-150d5942f46c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:00.839531 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3608/7266] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:58:00.844499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509b048-c5c8-4857-b425-150d5942f46c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:00.850554 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3659/7267] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:58:00.863416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c84825-0265-44aa-b33d-ae98cf73466d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:00.866011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-97c84825-0265-44aa-b33d-ae98cf73466d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:00.871701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509b048-c5c8-4857-b425-150d5942f46c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:00.878125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2986a-4f13-48ad-a936-394877dfd8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:00.879293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2986a-4f13-48ad-a936-394877dfd8ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:00.881455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2986a-4f13-48ad-a936-394877dfd8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:00.882223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2986a-4f13-48ad-a936-394877dfd8ea admin admin] PATH_INFO: `/v3/projects/b5a11022b0804ab19773076b1c8b0d9d/users/8e5f1bf54eea49169dff2e13a298c46d/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:00.900334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2986a-4f13-48ad-a936-394877dfd8ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a11022b0804ab19773076b1c8b0d9d, user_id=8e5f1bf54eea49169dff2e13a298c46d, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:00.905186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2986a-4f13-48ad-a936-394877dfd8ea admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:00.996685 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3609/7268] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:00 2022] PUT /identity/v3/projects/b5a11022b0804ab19773076b1c8b0d9d/users/8e5f1bf54eea49169dff2e13a298c46d/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:01.000816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2986a-4f13-48ad-a936-394877dfd8ea admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:01.030937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c84825-0265-44aa-b33d-ae98cf73466d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:01.104302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba16084-d5db-49a7-85ea-d7d3cf25095f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:01.105031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba16084-d5db-49a7-85ea-d7d3cf25095f service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:01.105609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba16084-d5db-49a7-85ea-d7d3cf25095f service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:01.105982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba16084-d5db-49a7-85ea-d7d3cf25095f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:01.188316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba16084-d5db-49a7-85ea-d7d3cf25095f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:01.190182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba16084-d5db-49a7-85ea-d7d3cf25095f service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:01.203396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2986a-4f13-48ad-a936-394877dfd8ea admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:01.215777 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3660/7269] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:00 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:58:01.234103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e4fab-87de-4f9c-bca3-f133dfd55ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:01.234983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e4fab-87de-4f9c-bca3-f133dfd55ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:01.235507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e4fab-87de-4f9c-bca3-f133dfd55ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:01.235969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e4fab-87de-4f9c-bca3-f133dfd55ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:01.236841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e4fab-87de-4f9c-bca3-f133dfd55ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:01.238813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e4fab-87de-4f9c-bca3-f133dfd55ad4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:01.253444 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3610/7270] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:58:01.258074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba16084-d5db-49a7-85ea-d7d3cf25095f service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:01.278367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba16084-d5db-49a7-85ea-d7d3cf25095f service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:01.292708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e52d74-6895-4708-87f6-28270730e43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:01.293503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e52d74-6895-4708-87f6-28270730e43c admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:01.294837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e52d74-6895-4708-87f6-28270730e43c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:01.294837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e52d74-6895-4708-87f6-28270730e43c admin admin] PATH_INFO: `/v3/projects/b5a11022b0804ab19773076b1c8b0d9d/users/8e5f1bf54eea49169dff2e13a298c46d/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:01.301302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e52d74-6895-4708-87f6-28270730e43c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a11022b0804ab19773076b1c8b0d9d, user_id=8e5f1bf54eea49169dff2e13a298c46d, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:01.308368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e52d74-6895-4708-87f6-28270730e43c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:01.356452 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3661/7271] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:01 2022] PUT /identity/v3/projects/b5a11022b0804ab19773076b1c8b0d9d/users/8e5f1bf54eea49169dff2e13a298c46d/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:01.368218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d3a42-486d-4059-be86-57c1d3e76bde None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:01.368717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d3a42-486d-4059-be86-57c1d3e76bde None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:01.369157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d3a42-486d-4059-be86-57c1d3e76bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:01.438314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:01.439735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e52d3a42-486d-4059-be86-57c1d3e76bde None None] MFA Rules not processed for user `8e5f1bf54eea49169dff2e13a298c46d`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:01.441696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e52d3a42-486d-4059-be86-57c1d3e76bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:01.555413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e52d74-6895-4708-87f6-28270730e43c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:01.621927 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3611/7272] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:01.629695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d3a42-486d-4059-be86-57c1d3e76bde None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:01.631712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e52d3a42-486d-4059-be86-57c1d3e76bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:01.741731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e52d74-6895-4708-87f6-28270730e43c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:01.749423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b76a2-16e8-443a-acff-ca1afff76e80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:01.751161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b76a2-16e8-443a-acff-ca1afff76e80 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:01.751161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b76a2-16e8-443a-acff-ca1afff76e80 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:01.753570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b76a2-16e8-443a-acff-ca1afff76e80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:01.756221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d3a42-486d-4059-be86-57c1d3e76bde None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:01.762440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4b462-6a3b-41e3-acd7-b1f0b7d02b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:01.764698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4b462-6a3b-41e3-acd7-b1f0b7d02b5a service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:01.764987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4b462-6a3b-41e3-acd7-b1f0b7d02b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:01.767650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4b462-6a3b-41e3-acd7-b1f0b7d02b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:01.797313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4b462-6a3b-41e3-acd7-b1f0b7d02b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:01.800294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4b462-6a3b-41e3-acd7-b1f0b7d02b5a service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:01.838425 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3612/7273] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:58:01.923835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b76a2-16e8-443a-acff-ca1afff76e80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:01.932718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b76a2-16e8-443a-acff-ca1afff76e80 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:01.968616 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3662/7274] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:58:02.391942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:02.471923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:03.901587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4b462-6a3b-41e3-acd7-b1f0b7d02b5a service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:04.015202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4b462-6a3b-41e3-acd7-b1f0b7d02b5a service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:04.025946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db0e0e-b711-4cdf-a528-3e9ec53e8b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:04.027692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0e0e-b711-4cdf-a528-3e9ec53e8b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:04.028586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0e0e-b711-4cdf-a528-3e9ec53e8b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:04.029105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0e0e-b711-4cdf-a528-3e9ec53e8b7e admin admin] PATH_INFO: `/v3/users/f34730edf38a41eebfc589f97e273e22` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:04.032222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db0e0e-b711-4cdf-a528-3e9ec53e8b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f34730edf38a41eebfc589f97e273e22)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:04.035115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db0e0e-b711-4cdf-a528-3e9ec53e8b7e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:04.363214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-06db0e0e-b711-4cdf-a528-3e9ec53e8b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f34730edf38a41eebfc589f97e273e22'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:04.545523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-06db0e0e-b711-4cdf-a528-3e9ec53e8b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f34730edf38a41eebfc589f97e273e22'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:04.549065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-06db0e0e-b711-4cdf-a528-3e9ec53e8b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f34730edf38a41eebfc589f97e273e22'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:04.565690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-06db0e0e-b711-4cdf-a528-3e9ec53e8b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f34730edf38a41eebfc589f97e273e22'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:04.602022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-06db0e0e-b711-4cdf-a528-3e9ec53e8b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f34730edf38a41eebfc589f97e273e22'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:04.619312 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3613/7275] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:58:03 2022] DELETE /identity/v3/users/f34730edf38a41eebfc589f97e273e22 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:04.624765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc63663-5d77-4a02-94d9-ec42bd82ffdc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:04.625726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc63663-5d77-4a02-94d9-ec42bd82ffdc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:04.625726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc63663-5d77-4a02-94d9-ec42bd82ffdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:04.651192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8cc63663-5d77-4a02-94d9-ec42bd82ffdc None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:04.654655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8cc63663-5d77-4a02-94d9-ec42bd82ffdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:04.774510 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3663/7276] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:04.785999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db0e0e-b711-4cdf-a528-3e9ec53e8b7e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:04.789656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-06db0e0e-b711-4cdf-a528-3e9ec53e8b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:04.971497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db0e0e-b711-4cdf-a528-3e9ec53e8b7e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:04.985621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671d68c-2f46-440d-a162-6c9a00fb9b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:04.986672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671d68c-2f46-440d-a162-6c9a00fb9b30 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:04.987418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671d68c-2f46-440d-a162-6c9a00fb9b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:04.988020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671d68c-2f46-440d-a162-6c9a00fb9b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:05.016424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671d68c-2f46-440d-a162-6c9a00fb9b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:05.017919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671d68c-2f46-440d-a162-6c9a00fb9b30 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:05.085197 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3614/7277] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:58:06.411861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:07.203758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc63663-5d77-4a02-94d9-ec42bd82ffdc None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:07.205806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8cc63663-5d77-4a02-94d9-ec42bd82ffdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:07.234027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc63663-5d77-4a02-94d9-ec42bd82ffdc None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:07.242328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded1314-d7ab-4e9e-a0af-c8957a274a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:07.243007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded1314-d7ab-4e9e-a0af-c8957a274a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:07.243294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded1314-d7ab-4e9e-a0af-c8957a274a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:07.243573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded1314-d7ab-4e9e-a0af-c8957a274a25 admin admin] PATH_INFO: `/v3/projects/03860cdbe8584e989d57ccd817f112b5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:07.249885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded1314-d7ab-4e9e-a0af-c8957a274a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03860cdbe8584e989d57ccd817f112b5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:07.252266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded1314-d7ab-4e9e-a0af-c8957a274a25 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:07.389927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671d68c-2f46-440d-a162-6c9a00fb9b30 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:07.391606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8671d68c-2f46-440d-a162-6c9a00fb9b30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:07.412227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671d68c-2f46-440d-a162-6c9a00fb9b30 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:07.429047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8df330-368f-40ad-9b8d-1b6f3a331c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:07.429975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8df330-368f-40ad-9b8d-1b6f3a331c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:07.430337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8df330-368f-40ad-9b8d-1b6f3a331c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:07.430689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8df330-368f-40ad-9b8d-1b6f3a331c6c admin admin] PATH_INFO: `/v3/users/65bf79d20ee64e2f8b4d7acf37d8fde8` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:07.432996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8df330-368f-40ad-9b8d-1b6f3a331c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=65bf79d20ee64e2f8b4d7acf37d8fde8)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:07.435219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8df330-368f-40ad-9b8d-1b6f3a331c6c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:07.517742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9ded1314-d7ab-4e9e-a0af-c8957a274a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03860cdbe8584e989d57ccd817f112b5', 'request_id': 'req-9ded1314-d7ab-4e9e-a0af-c8957a274a25'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:07.545988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9ded1314-d7ab-4e9e-a0af-c8957a274a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03860cdbe8584e989d57ccd817f112b5', 'request_id': 'req-9ded1314-d7ab-4e9e-a0af-c8957a274a25'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:07.757502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9ded1314-d7ab-4e9e-a0af-c8957a274a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03860cdbe8584e989d57ccd817f112b5', 'request_id': 'req-9ded1314-d7ab-4e9e-a0af-c8957a274a25'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:07.785809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9ded1314-d7ab-4e9e-a0af-c8957a274a25 admin admin] The token cache is being invalidate because project 03860cdbe8584e989d57ccd817f112b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:58:07.785809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9ded1314-d7ab-4e9e-a0af-c8957a274a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:07.785809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9ded1314-d7ab-4e9e-a0af-c8957a274a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:07.787652 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3664/7278] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:58:07 2022] DELETE /identity/v3/projects/03860cdbe8584e989d57ccd817f112b5 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:07.791558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded1314-d7ab-4e9e-a0af-c8957a274a25 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:07.794071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9ded1314-d7ab-4e9e-a0af-c8957a274a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:07.865771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7f8df330-368f-40ad-9b8d-1b6f3a331c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65bf79d20ee64e2f8b4d7acf37d8fde8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:07.947261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded1314-d7ab-4e9e-a0af-c8957a274a25 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:07.965321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486336b-5ac1-4296-ba17-c6f845d04912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:07.966207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486336b-5ac1-4296-ba17-c6f845d04912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:07.966768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486336b-5ac1-4296-ba17-c6f845d04912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:07.968315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486336b-5ac1-4296-ba17-c6f845d04912 admin admin] PATH_INFO: `/v3/users/8e5f1bf54eea49169dff2e13a298c46d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:07.970013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486336b-5ac1-4296-ba17-c6f845d04912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e5f1bf54eea49169dff2e13a298c46d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:07.972423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486336b-5ac1-4296-ba17-c6f845d04912 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:08.236558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7f8df330-368f-40ad-9b8d-1b6f3a331c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65bf79d20ee64e2f8b4d7acf37d8fde8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:08.237275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7f8df330-368f-40ad-9b8d-1b6f3a331c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65bf79d20ee64e2f8b4d7acf37d8fde8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:08.256724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7f8df330-368f-40ad-9b8d-1b6f3a331c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65bf79d20ee64e2f8b4d7acf37d8fde8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:08.289950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7f8df330-368f-40ad-9b8d-1b6f3a331c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65bf79d20ee64e2f8b4d7acf37d8fde8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:08.303019 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3615/7279] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:58:07 2022] DELETE /identity/v3/users/65bf79d20ee64e2f8b4d7acf37d8fde8 => generated 0 bytes in 914 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:08.311508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec72eb-5d15-4780-aee7-909e627acc3c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:08.312224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec72eb-5d15-4780-aee7-909e627acc3c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:08.312818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec72eb-5d15-4780-aee7-909e627acc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:08.356340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-dbec72eb-5d15-4780-aee7-909e627acc3c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:08.358086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dbec72eb-5d15-4780-aee7-909e627acc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:08.426110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:08.506969 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3616/7280] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:08.535653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec72eb-5d15-4780-aee7-909e627acc3c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:08.536644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c486336b-5ac1-4296-ba17-c6f845d04912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e5f1bf54eea49169dff2e13a298c46d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:08.537543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c486336b-5ac1-4296-ba17-c6f845d04912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e5f1bf54eea49169dff2e13a298c46d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:08.537892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dbec72eb-5d15-4780-aee7-909e627acc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:08.557739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:08.652478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec72eb-5d15-4780-aee7-909e627acc3c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:08.660869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f05f77-97d3-47a1-b1b6-17adc98a0872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:08.661730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f05f77-97d3-47a1-b1b6-17adc98a0872 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:08.662015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f05f77-97d3-47a1-b1b6-17adc98a0872 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:08.662294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f05f77-97d3-47a1-b1b6-17adc98a0872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:08.684019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f05f77-97d3-47a1-b1b6-17adc98a0872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:08.686172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f05f77-97d3-47a1-b1b6-17adc98a0872 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:08.707279 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3617/7281] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:58:08.764086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c486336b-5ac1-4296-ba17-c6f845d04912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e5f1bf54eea49169dff2e13a298c46d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:08.764540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c486336b-5ac1-4296-ba17-c6f845d04912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e5f1bf54eea49169dff2e13a298c46d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:08.785940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c486336b-5ac1-4296-ba17-c6f845d04912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e5f1bf54eea49169dff2e13a298c46d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:08.808934 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3665/7282] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:58:07 2022] DELETE /identity/v3/users/8e5f1bf54eea49169dff2e13a298c46d => generated 0 bytes in 1015 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:10.958174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486336b-5ac1-4296-ba17-c6f845d04912 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:10.959825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f05f77-97d3-47a1-b1b6-17adc98a0872 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:10.960246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c486336b-5ac1-4296-ba17-c6f845d04912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:10.964229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-02f05f77-97d3-47a1-b1b6-17adc98a0872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:10.992547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f05f77-97d3-47a1-b1b6-17adc98a0872 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:11.088113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486336b-5ac1-4296-ba17-c6f845d04912 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:11.098107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1392e-eca1-47a9-bd64-fdf99c64e402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:11.098107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1392e-eca1-47a9-bd64-fdf99c64e402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:11.098107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1392e-eca1-47a9-bd64-fdf99c64e402 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:11.098107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1392e-eca1-47a9-bd64-fdf99c64e402 admin admin] PATH_INFO: `/v3/projects/b5a11022b0804ab19773076b1c8b0d9d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:11.099177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1392e-eca1-47a9-bd64-fdf99c64e402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a11022b0804ab19773076b1c8b0d9d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:11.103552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1392e-eca1-47a9-bd64-fdf99c64e402 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:11.167439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb2d54-df19-45fb-9172-906d159f1180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:11.169747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb2d54-df19-45fb-9172-906d159f1180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:11.170423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb2d54-df19-45fb-9172-906d159f1180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:11.172837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb2d54-df19-45fb-9172-906d159f1180 admin admin] PATH_INFO: `/v3/projects/fdf9a781471e4ac1a350c87d48fd08c0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:11.182116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb2d54-df19-45fb-9172-906d159f1180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdf9a781471e4ac1a350c87d48fd08c0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:11.182116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb2d54-df19-45fb-9172-906d159f1180 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:11.412273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f2e1392e-eca1-47a9-bd64-fdf99c64e402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a11022b0804ab19773076b1c8b0d9d', 'request_id': 'req-f2e1392e-eca1-47a9-bd64-fdf99c64e402'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:11.419492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f2e1392e-eca1-47a9-bd64-fdf99c64e402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a11022b0804ab19773076b1c8b0d9d', 'request_id': 'req-f2e1392e-eca1-47a9-bd64-fdf99c64e402'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:11.490050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9cbb2d54-df19-45fb-9172-906d159f1180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdf9a781471e4ac1a350c87d48fd08c0', 'request_id': 'req-9cbb2d54-df19-45fb-9172-906d159f1180'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:11.502144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9cbb2d54-df19-45fb-9172-906d159f1180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdf9a781471e4ac1a350c87d48fd08c0', 'request_id': 'req-9cbb2d54-df19-45fb-9172-906d159f1180'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:11.513797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9cbb2d54-df19-45fb-9172-906d159f1180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdf9a781471e4ac1a350c87d48fd08c0', 'request_id': 'req-9cbb2d54-df19-45fb-9172-906d159f1180'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:11.653789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f2e1392e-eca1-47a9-bd64-fdf99c64e402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a11022b0804ab19773076b1c8b0d9d', 'request_id': 'req-f2e1392e-eca1-47a9-bd64-fdf99c64e402'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:11.666480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f2e1392e-eca1-47a9-bd64-fdf99c64e402 admin admin] The token cache is being invalidate because project b5a11022b0804ab19773076b1c8b0d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:58:11.667241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f2e1392e-eca1-47a9-bd64-fdf99c64e402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:11.668478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f2e1392e-eca1-47a9-bd64-fdf99c64e402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:11.673957 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3666/7283] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:58:10 2022] DELETE /identity/v3/projects/b5a11022b0804ab19773076b1c8b0d9d => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:58:11.675529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7f01f-e5f7-4aec-8990-e87bea8f2c2a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:11.675918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7f01f-e5f7-4aec-8990-e87bea8f2c2a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:11.676361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7f01f-e5f7-4aec-8990-e87bea8f2c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:11.723008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5ad7f01f-e5f7-4aec-8990-e87bea8f2c2a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:11.725025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5ad7f01f-e5f7-4aec-8990-e87bea8f2c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:11.750787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:11.821103 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3667/7284] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:58:11.907350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9cbb2d54-df19-45fb-9172-906d159f1180 admin admin] The token cache is being invalidate because project fdf9a781471e4ac1a350c87d48fd08c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:58:11.907902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9cbb2d54-df19-45fb-9172-906d159f1180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:11.909282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9cbb2d54-df19-45fb-9172-906d159f1180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:11.916695 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3618/7285] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:58:10 2022] DELETE /identity/v3/projects/fdf9a781471e4ac1a350c87d48fd08c0 => generated 0 bytes in 956 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:11.918108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7f01f-e5f7-4aec-8990-e87bea8f2c2a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:11.920640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5ad7f01f-e5f7-4aec-8990-e87bea8f2c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:11.932629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6960af-f4e2-4e1c-a304-836ab4bf224f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:11.933350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6960af-f4e2-4e1c-a304-836ab4bf224f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:11.933837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6960af-f4e2-4e1c-a304-836ab4bf224f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:11.938769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7f01f-e5f7-4aec-8990-e87bea8f2c2a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:11.952887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5f104-c667-4e8b-9bfa-2f84991c0581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:11.953534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5f104-c667-4e8b-9bfa-2f84991c0581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:11.955719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5f104-c667-4e8b-9bfa-2f84991c0581 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:11.956006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5f104-c667-4e8b-9bfa-2f84991c0581 admin admin] PATH_INFO: `/v3/users/8d5db42727b24936aa3293942a3f233c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:11.962243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5f104-c667-4e8b-9bfa-2f84991c0581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d5db42727b24936aa3293942a3f233c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:11.966594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5f104-c667-4e8b-9bfa-2f84991c0581 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:11.975752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8a6960af-f4e2-4e1c-a304-836ab4bf224f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:11.980244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8a6960af-f4e2-4e1c-a304-836ab4bf224f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:12.001568 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3619/7286] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:58:12.002802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6960af-f4e2-4e1c-a304-836ab4bf224f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:12.016251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6960af-f4e2-4e1c-a304-836ab4bf224f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:12.024665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142ea94-dca8-483d-8042-ad1eb62b1bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:12.026094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142ea94-dca8-483d-8042-ad1eb62b1bee admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:12.026546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142ea94-dca8-483d-8042-ad1eb62b1bee admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:12.026981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142ea94-dca8-483d-8042-ad1eb62b1bee admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:12.027820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142ea94-dca8-483d-8042-ad1eb62b1bee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:58:12.028573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142ea94-dca8-483d-8042-ad1eb62b1bee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:12.031168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142ea94-dca8-483d-8042-ad1eb62b1bee admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:12.055185 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3620/7287] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:58:12.066861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142ea94-dca8-483d-8042-ad1eb62b1bee admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:12.081386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142ea94-dca8-483d-8042-ad1eb62b1bee admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:12.090463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642731ca-57b3-4aeb-ac7f-5378fb9e67dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:12.091300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642731ca-57b3-4aeb-ac7f-5378fb9e67dc admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:12.091688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642731ca-57b3-4aeb-ac7f-5378fb9e67dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:12.092090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642731ca-57b3-4aeb-ac7f-5378fb9e67dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:12.092864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642731ca-57b3-4aeb-ac7f-5378fb9e67dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:12.095021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642731ca-57b3-4aeb-ac7f-5378fb9e67dc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:12.373081 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3621/7288] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:58:12 2022] POST /identity/v3/projects => generated 365 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:58:12.377343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642731ca-57b3-4aeb-ac7f-5378fb9e67dc admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:12.486716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84b5f104-c667-4e8b-9bfa-2f84991c0581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d5db42727b24936aa3293942a3f233c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:12.488145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84b5f104-c667-4e8b-9bfa-2f84991c0581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d5db42727b24936aa3293942a3f233c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:12.587110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642731ca-57b3-4aeb-ac7f-5378fb9e67dc admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:12.605742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208ee41-68ab-4887-a861-31605bf8775f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:12.606748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208ee41-68ab-4887-a861-31605bf8775f admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:12.607085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208ee41-68ab-4887-a861-31605bf8775f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:12.607404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208ee41-68ab-4887-a861-31605bf8775f admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:12.608416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208ee41-68ab-4887-a861-31605bf8775f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:12.612715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208ee41-68ab-4887-a861-31605bf8775f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:12.728071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84b5f104-c667-4e8b-9bfa-2f84991c0581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d5db42727b24936aa3293942a3f233c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:12.729228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84b5f104-c667-4e8b-9bfa-2f84991c0581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d5db42727b24936aa3293942a3f233c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:12.750444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-84b5f104-c667-4e8b-9bfa-2f84991c0581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d5db42727b24936aa3293942a3f233c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:12.760887 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3668/7289] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:58:11 2022] DELETE /identity/v3/users/8d5db42727b24936aa3293942a3f233c => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:12.831906 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3622/7290] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:58:12 2022] POST /identity/v3/users => generated 283 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:12.834909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5f104-c667-4e8b-9bfa-2f84991c0581 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:12.836644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-84b5f104-c667-4e8b-9bfa-2f84991c0581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:12.918042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5f104-c667-4e8b-9bfa-2f84991c0581 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:12.922667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb9508-c4fa-49a6-81c2-96f321eb3ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:12.923286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb9508-c4fa-49a6-81c2-96f321eb3ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:12.923567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb9508-c4fa-49a6-81c2-96f321eb3ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:12.923839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb9508-c4fa-49a6-81c2-96f321eb3ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:12.924531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb9508-c4fa-49a6-81c2-96f321eb3ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:12.926153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb9508-c4fa-49a6-81c2-96f321eb3ce3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:12.940895 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3669/7291] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:12.945084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208ee41-68ab-4887-a861-31605bf8775f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:12.968622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208ee41-68ab-4887-a861-31605bf8775f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:12.974447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff60642-866c-4d90-b935-d93a06e42250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:12.975102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60642-866c-4d90-b935-d93a06e42250 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:12.975573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60642-866c-4d90-b935-d93a06e42250 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:12.979865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60642-866c-4d90-b935-d93a06e42250 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:12.979865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff60642-866c-4d90-b935-d93a06e42250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:12.979865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff60642-866c-4d90-b935-d93a06e42250 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:12.991018 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3623/7292] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:12.995109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb9508-c4fa-49a6-81c2-96f321eb3ce3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:13.007276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb9508-c4fa-49a6-81c2-96f321eb3ce3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:13.012665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc4794-6dba-47c8-9771-f9ce020e959a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:13.013548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc4794-6dba-47c8-9771-f9ce020e959a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:13.013986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc4794-6dba-47c8-9771-f9ce020e959a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:13.014553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc4794-6dba-47c8-9771-f9ce020e959a admin admin] PATH_INFO: `/v3/projects/22e1ad1552fe40f78f3ecb8be72d7f2b/users/20ab7849dd4742578fd3a19f4fafb1bc/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:13.035627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc4794-6dba-47c8-9771-f9ce020e959a admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e1ad1552fe40f78f3ecb8be72d7f2b, user_id=20ab7849dd4742578fd3a19f4fafb1bc, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:13.039521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc4794-6dba-47c8-9771-f9ce020e959a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:13.320244 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3670/7293] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:12 2022] PUT /identity/v3/projects/22e1ad1552fe40f78f3ecb8be72d7f2b/users/20ab7849dd4742578fd3a19f4fafb1bc/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:13.323747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4d756-cd4f-4d66-995a-5177517e4d4e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:13.324402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4d756-cd4f-4d66-995a-5177517e4d4e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:13.325002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4d756-cd4f-4d66-995a-5177517e4d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:13.359709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-52c4d756-cd4f-4d66-995a-5177517e4d4e None None] MFA Rules not processed for user `20ab7849dd4742578fd3a19f4fafb1bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:13.361253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-52c4d756-cd4f-4d66-995a-5177517e4d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:13.485301 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3624/7294] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:13.490687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc4794-6dba-47c8-9771-f9ce020e959a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:13.600801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:13.628937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc4794-6dba-47c8-9771-f9ce020e959a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:13.636831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353410c9-cc43-4f78-addc-9952f6fd3c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:13.638208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353410c9-cc43-4f78-addc-9952f6fd3c0c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:13.638580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353410c9-cc43-4f78-addc-9952f6fd3c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:13.639419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353410c9-cc43-4f78-addc-9952f6fd3c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:13.641048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353410c9-cc43-4f78-addc-9952f6fd3c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:13.644342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353410c9-cc43-4f78-addc-9952f6fd3c0c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:13.852156 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3671/7295] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:58:13 2022] POST /identity/v3/projects => generated 365 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:58:13.852459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4d756-cd4f-4d66-995a-5177517e4d4e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:13.871161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4d756-cd4f-4d66-995a-5177517e4d4e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:13.952869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0fe77-a8a0-4ff6-8a54-f6a027d9df54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:13.953671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0fe77-a8a0-4ff6-8a54-f6a027d9df54 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:13.953959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0fe77-a8a0-4ff6-8a54-f6a027d9df54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:13.954236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0fe77-a8a0-4ff6-8a54-f6a027d9df54 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:13.955281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0fe77-a8a0-4ff6-8a54-f6a027d9df54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:13.957316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0fe77-a8a0-4ff6-8a54-f6a027d9df54 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:14.433247 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3625/7296] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:58:13 2022] POST /identity/v3/users => generated 289 bytes in 581 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:58:14.441264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353410c9-cc43-4f78-addc-9952f6fd3c0c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:14.481074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353410c9-cc43-4f78-addc-9952f6fd3c0c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:14.503606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c982f25-7261-4721-b137-ae06165e924e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:14.506143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982f25-7261-4721-b137-ae06165e924e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:14.507284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982f25-7261-4721-b137-ae06165e924e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:14.509393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982f25-7261-4721-b137-ae06165e924e admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:14.510364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c982f25-7261-4721-b137-ae06165e924e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:14.512637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c982f25-7261-4721-b137-ae06165e924e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:14.560984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0fe77-a8a0-4ff6-8a54-f6a027d9df54 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:14.575551 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3672/7297] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:14.580400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0fe77-a8a0-4ff6-8a54-f6a027d9df54 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:14.589080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ab975-4c87-44b2-890b-a202328eb5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:14.590305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ab975-4c87-44b2-890b-a202328eb5f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:14.590590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ab975-4c87-44b2-890b-a202328eb5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:14.590862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ab975-4c87-44b2-890b-a202328eb5f0 admin admin] PATH_INFO: `/v3/projects/f6a3e56f50524001afc48330b4f5d0c1/users/3d3538a800d248d3bdbad31ec2c07dc2/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:14.610548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ab975-4c87-44b2-890b-a202328eb5f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a3e56f50524001afc48330b4f5d0c1, user_id=3d3538a800d248d3bdbad31ec2c07dc2, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:14.613612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ab975-4c87-44b2-890b-a202328eb5f0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:14.887356 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3626/7298] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:14 2022] PUT /identity/v3/projects/f6a3e56f50524001afc48330b4f5d0c1/users/3d3538a800d248d3bdbad31ec2c07dc2/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:14.888445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c982f25-7261-4721-b137-ae06165e924e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:14.904918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c982f25-7261-4721-b137-ae06165e924e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:14.913715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ab975-4c87-44b2-890b-a202328eb5f0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:14.916134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-649ab975-4c87-44b2-890b-a202328eb5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:15.021599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ad225-5753-4004-b07e-1b079b1f7c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:15.025084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ad225-5753-4004-b07e-1b079b1f7c1e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:15.025084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ad225-5753-4004-b07e-1b079b1f7c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:15.025084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ad225-5753-4004-b07e-1b079b1f7c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:15.025084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ad225-5753-4004-b07e-1b079b1f7c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:15.027036 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ad225-5753-4004-b07e-1b079b1f7c1e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:15.043586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ab975-4c87-44b2-890b-a202328eb5f0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:15.050716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698383c-118c-44da-b7a5-03eb7e48fcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:15.051762 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3673/7299] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:58:15.053163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698383c-118c-44da-b7a5-03eb7e48fcac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:15.053715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698383c-118c-44da-b7a5-03eb7e48fcac admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:15.054273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698383c-118c-44da-b7a5-03eb7e48fcac admin admin] PATH_INFO: `/v3/projects/a86f76c1efed47328ee3687611084bc2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:15.056086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698383c-118c-44da-b7a5-03eb7e48fcac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86f76c1efed47328ee3687611084bc2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:15.056420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ad225-5753-4004-b07e-1b079b1f7c1e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:15.059530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698383c-118c-44da-b7a5-03eb7e48fcac admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:15.081444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ad225-5753-4004-b07e-1b079b1f7c1e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:15.091873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ea653-015c-4657-8358-d87dd11f1db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:15.092655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ea653-015c-4657-8358-d87dd11f1db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:15.092938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ea653-015c-4657-8358-d87dd11f1db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:15.093426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ea653-015c-4657-8358-d87dd11f1db4 admin admin] PATH_INFO: `/v3/projects/f6a3e56f50524001afc48330b4f5d0c1/users/3d3538a800d248d3bdbad31ec2c07dc2/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:15.100591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ea653-015c-4657-8358-d87dd11f1db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a3e56f50524001afc48330b4f5d0c1, user_id=3d3538a800d248d3bdbad31ec2c07dc2, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:15.111741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ea653-015c-4657-8358-d87dd11f1db4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:15.124837 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3674/7300] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:15 2022] PUT /identity/v3/projects/f6a3e56f50524001afc48330b4f5d0c1/users/3d3538a800d248d3bdbad31ec2c07dc2/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:15.143397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2da8-b7d4-4d81-bd3c-4ab36890542b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:15.143687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2da8-b7d4-4d81-bd3c-4ab36890542b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:15.143964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2da8-b7d4-4d81-bd3c-4ab36890542b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:15.211832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1def2da8-b7d4-4d81-bd3c-4ab36890542b None None] MFA Rules not processed for user `3d3538a800d248d3bdbad31ec2c07dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:15.213485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1def2da8-b7d4-4d81-bd3c-4ab36890542b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:15.336885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5698383c-118c-44da-b7a5-03eb7e48fcac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86f76c1efed47328ee3687611084bc2', 'request_id': 'req-5698383c-118c-44da-b7a5-03eb7e48fcac'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:15.347611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5698383c-118c-44da-b7a5-03eb7e48fcac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86f76c1efed47328ee3687611084bc2', 'request_id': 'req-5698383c-118c-44da-b7a5-03eb7e48fcac'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:15.361592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5698383c-118c-44da-b7a5-03eb7e48fcac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86f76c1efed47328ee3687611084bc2', 'request_id': 'req-5698383c-118c-44da-b7a5-03eb7e48fcac'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:15.399367 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3675/7301] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:15.408458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def2da8-b7d4-4d81-bd3c-4ab36890542b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:15.410697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1def2da8-b7d4-4d81-bd3c-4ab36890542b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:15.497216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def2da8-b7d4-4d81-bd3c-4ab36890542b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:15.558887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5698383c-118c-44da-b7a5-03eb7e48fcac admin admin] The token cache is being invalidate because project a86f76c1efed47328ee3687611084bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:58:15.559707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5698383c-118c-44da-b7a5-03eb7e48fcac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:15.561687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5698383c-118c-44da-b7a5-03eb7e48fcac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:15.563781 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3627/7302] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:58:14 2022] DELETE /identity/v3/projects/a86f76c1efed47328ee3687611084bc2 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:15.573797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59818aac-4425-4577-aefe-44c580eab065 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:15.575163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59818aac-4425-4577-aefe-44c580eab065 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:15.575608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59818aac-4425-4577-aefe-44c580eab065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:15.648515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2be7e-866f-4413-ac8f-00c5639b9aa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:15.649195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2be7e-866f-4413-ac8f-00c5639b9aa3 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:15.649483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2be7e-866f-4413-ac8f-00c5639b9aa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:15.649804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2be7e-866f-4413-ac8f-00c5639b9aa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:15.653741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-59818aac-4425-4577-aefe-44c580eab065 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:15.656227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-59818aac-4425-4577-aefe-44c580eab065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:15.657324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7ed2be7e-866f-4413-ac8f-00c5639b9aa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:15.760936 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3628/7303] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:15.772762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd8626-475b-44c9-91d5-45039752ef52 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:15.773561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd8626-475b-44c9-91d5-45039752ef52 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:15.773848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd8626-475b-44c9-91d5-45039752ef52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:15.807274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-45bd8626-475b-44c9-91d5-45039752ef52 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:15.809286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-45bd8626-475b-44c9-91d5-45039752ef52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:15.825622 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3629/7304] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:15.826687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd8626-475b-44c9-91d5-45039752ef52 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:15.834228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2be7e-866f-4413-ac8f-00c5639b9aa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:15.839106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2be7e-866f-4413-ac8f-00c5639b9aa3 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:15.842645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd8626-475b-44c9-91d5-45039752ef52 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:15.857215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395e6d2-5dfe-42d3-bea0-ac5fe4aef3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:15.858075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395e6d2-5dfe-42d3-bea0-ac5fe4aef3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:15.858360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395e6d2-5dfe-42d3-bea0-ac5fe4aef3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:15.858631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395e6d2-5dfe-42d3-bea0-ac5fe4aef3a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:15.859293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395e6d2-5dfe-42d3-bea0-ac5fe4aef3a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:58:15.859592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395e6d2-5dfe-42d3-bea0-ac5fe4aef3a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:15.861249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395e6d2-5dfe-42d3-bea0-ac5fe4aef3a9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:15.864945 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3676/7305] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:58:15.894237 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3630/7306] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:58:15.899955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2be7e-866f-4413-ac8f-00c5639b9aa3 service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:15.921374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2be7e-866f-4413-ac8f-00c5639b9aa3 service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:15.933654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf1fb9-a95d-48d7-9765-19b2a4ba8f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:15.934612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf1fb9-a95d-48d7-9765-19b2a4ba8f5c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:15.934612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf1fb9-a95d-48d7-9765-19b2a4ba8f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:15.942626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf1fb9-a95d-48d7-9765-19b2a4ba8f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:15.943423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf1fb9-a95d-48d7-9765-19b2a4ba8f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:15.950302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf1fb9-a95d-48d7-9765-19b2a4ba8f5c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:16.187775 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3677/7307] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:58:15 2022] POST /identity/v3/projects => generated 379 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:16.190777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395e6d2-5dfe-42d3-bea0-ac5fe4aef3a9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:16.205770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395e6d2-5dfe-42d3-bea0-ac5fe4aef3a9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:16.369479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e6fdc-5689-43f3-afe3-6445619f487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:16.371396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e6fdc-5689-43f3-afe3-6445619f487f admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:16.371871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e6fdc-5689-43f3-afe3-6445619f487f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:16.373233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e6fdc-5689-43f3-afe3-6445619f487f admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:16.373982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e6fdc-5689-43f3-afe3-6445619f487f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:16.380419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e6fdc-5689-43f3-afe3-6445619f487f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:16.697597 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3631/7308] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:58:16 2022] POST /identity/v3/users => generated 290 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:16.700728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf1fb9-a95d-48d7-9765-19b2a4ba8f5c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:16.715372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf1fb9-a95d-48d7-9765-19b2a4ba8f5c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:16.728268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968898e-22c7-4b1e-8453-22e67280c859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:16.728919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968898e-22c7-4b1e-8453-22e67280c859 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:16.731648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968898e-22c7-4b1e-8453-22e67280c859 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:16.731982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968898e-22c7-4b1e-8453-22e67280c859 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:16.734806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968898e-22c7-4b1e-8453-22e67280c859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:16.736907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968898e-22c7-4b1e-8453-22e67280c859 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:16.756147 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3678/7309] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:16.758177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e6fdc-5689-43f3-afe3-6445619f487f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:16.778362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e6fdc-5689-43f3-afe3-6445619f487f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:16.800258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b89199-d3be-4d6a-a925-b03f62f154c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:16.800258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b89199-d3be-4d6a-a925-b03f62f154c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:16.800258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b89199-d3be-4d6a-a925-b03f62f154c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:16.800258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b89199-d3be-4d6a-a925-b03f62f154c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:16.803289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b89199-d3be-4d6a-a925-b03f62f154c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:16.803289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b89199-d3be-4d6a-a925-b03f62f154c9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:16.824241 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3632/7310] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:16.827059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968898e-22c7-4b1e-8453-22e67280c859 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:16.843162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968898e-22c7-4b1e-8453-22e67280c859 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:16.851310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac1837-e124-4ac9-849f-56d9791efaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:16.852386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac1837-e124-4ac9-849f-56d9791efaf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:16.852667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac1837-e124-4ac9-849f-56d9791efaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:16.852955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac1837-e124-4ac9-849f-56d9791efaf2 admin admin] PATH_INFO: `/v3/projects/43664f2f09924de98a68ff0b71d0c190/users/f99b4e7d3ff84f3ab92cd127c3a38ec8/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:16.886850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac1837-e124-4ac9-849f-56d9791efaf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43664f2f09924de98a68ff0b71d0c190, user_id=f99b4e7d3ff84f3ab92cd127c3a38ec8, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:16.889687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac1837-e124-4ac9-849f-56d9791efaf2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:17.152137 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3679/7311] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:16 2022] PUT /identity/v3/projects/43664f2f09924de98a68ff0b71d0c190/users/f99b4e7d3ff84f3ab92cd127c3a38ec8/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:17.164512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d5ee3-071d-402a-8636-d7204e0d7c17 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:17.165020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d5ee3-071d-402a-8636-d7204e0d7c17 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:17.165482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d5ee3-071d-402a-8636-d7204e0d7c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:17.216511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f42d5ee3-071d-402a-8636-d7204e0d7c17 None None] MFA Rules not processed for user `f99b4e7d3ff84f3ab92cd127c3a38ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:17.218463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f42d5ee3-071d-402a-8636-d7204e0d7c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:17.334741 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3633/7312] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:17.338916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac1837-e124-4ac9-849f-56d9791efaf2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:17.451490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac1837-e124-4ac9-849f-56d9791efaf2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:17.472142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982d460-ce12-4cb5-89ef-4404026bb42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:17.473049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982d460-ce12-4cb5-89ef-4404026bb42f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:17.474039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982d460-ce12-4cb5-89ef-4404026bb42f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:17.476105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982d460-ce12-4cb5-89ef-4404026bb42f admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:17.477583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982d460-ce12-4cb5-89ef-4404026bb42f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:17.485546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982d460-ce12-4cb5-89ef-4404026bb42f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:17.671507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:17.683464 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3680/7313] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:58:17 2022] POST /identity/v3/projects => generated 379 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:17.687123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d5ee3-071d-402a-8636-d7204e0d7c17 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:17.704846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d5ee3-071d-402a-8636-d7204e0d7c17 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:17.792932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2343445-449e-4a6c-a1ab-bbe3968e869c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:17.793563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2343445-449e-4a6c-a1ab-bbe3968e869c admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:17.793851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2343445-449e-4a6c-a1ab-bbe3968e869c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:17.794134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2343445-449e-4a6c-a1ab-bbe3968e869c admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:17.794775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2343445-449e-4a6c-a1ab-bbe3968e869c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:17.796766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2343445-449e-4a6c-a1ab-bbe3968e869c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:18.135564 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3634/7314] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:58:17 2022] POST /identity/v3/users => generated 296 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:18.138802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982d460-ce12-4cb5-89ef-4404026bb42f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:18.159618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982d460-ce12-4cb5-89ef-4404026bb42f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:18.175429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3eddf5-8800-47a0-9eec-867eb1201dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:18.176192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eddf5-8800-47a0-9eec-867eb1201dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:18.179274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eddf5-8800-47a0-9eec-867eb1201dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:18.179568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eddf5-8800-47a0-9eec-867eb1201dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:18.181257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3eddf5-8800-47a0-9eec-867eb1201dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:18.187104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3eddf5-8800-47a0-9eec-867eb1201dc9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:18.201069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2343445-449e-4a6c-a1ab-bbe3968e869c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:18.204287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b2343445-449e-4a6c-a1ab-bbe3968e869c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:18.228110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2343445-449e-4a6c-a1ab-bbe3968e869c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:18.242943 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3681/7315] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:18.245317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3eddf5-8800-47a0-9eec-867eb1201dc9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:18.257387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3eddf5-8800-47a0-9eec-867eb1201dc9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:18.258775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6d1a2-36a6-4f55-835d-058652101729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:18.259443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6d1a2-36a6-4f55-835d-058652101729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:18.260024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6d1a2-36a6-4f55-835d-058652101729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:18.260612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6d1a2-36a6-4f55-835d-058652101729 admin admin] PATH_INFO: `/v3/users/20ab7849dd4742578fd3a19f4fafb1bc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:18.262047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6d1a2-36a6-4f55-835d-058652101729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ab7849dd4742578fd3a19f4fafb1bc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:18.263191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcd0af-6e60-4daf-898e-927bb0d402a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:18.264181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcd0af-6e60-4daf-898e-927bb0d402a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:18.264404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6d1a2-36a6-4f55-835d-058652101729 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:18.264873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcd0af-6e60-4daf-898e-927bb0d402a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:18.265350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcd0af-6e60-4daf-898e-927bb0d402a3 admin admin] PATH_INFO: `/v3/projects/2199ae55019647ecbcb3c7b47c02eb19/users/10633d982a704919b3c53f2f0029d8d8/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:18.299636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcd0af-6e60-4daf-898e-927bb0d402a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2199ae55019647ecbcb3c7b47c02eb19, user_id=10633d982a704919b3c53f2f0029d8d8, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:18.306659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcd0af-6e60-4daf-898e-927bb0d402a3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:18.493217 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3682/7316] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:18 2022] PUT /identity/v3/projects/2199ae55019647ecbcb3c7b47c02eb19/users/10633d982a704919b3c53f2f0029d8d8/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:18.498125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcd0af-6e60-4daf-898e-927bb0d402a3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:18.590331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcd0af-6e60-4daf-898e-927bb0d402a3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:18.595417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56b3f4-a588-4798-833b-b4645e20b19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:18.596360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56b3f4-a588-4798-833b-b4645e20b19a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:18.596767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56b3f4-a588-4798-833b-b4645e20b19a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:18.597162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56b3f4-a588-4798-833b-b4645e20b19a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:18.597988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56b3f4-a588-4798-833b-b4645e20b19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:18.600577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56b3f4-a588-4798-833b-b4645e20b19a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:18.612473 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3683/7317] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:18.617129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56b3f4-a588-4798-833b-b4645e20b19a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:18.627672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56b3f4-a588-4798-833b-b4645e20b19a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:18.634875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a011d00-da39-4dbd-a185-41f5b5138059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:18.635685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a011d00-da39-4dbd-a185-41f5b5138059 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:18.635965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a011d00-da39-4dbd-a185-41f5b5138059 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:18.636779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a011d00-da39-4dbd-a185-41f5b5138059 admin admin] PATH_INFO: `/v3/projects/2199ae55019647ecbcb3c7b47c02eb19/users/10633d982a704919b3c53f2f0029d8d8/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:18.649725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a011d00-da39-4dbd-a185-41f5b5138059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2199ae55019647ecbcb3c7b47c02eb19, user_id=10633d982a704919b3c53f2f0029d8d8, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:18.649725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a011d00-da39-4dbd-a185-41f5b5138059 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:18.673389 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3684/7318] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:18 2022] PUT /identity/v3/projects/2199ae55019647ecbcb3c7b47c02eb19/users/10633d982a704919b3c53f2f0029d8d8/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:18.675072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd61a5d-2f29-4d92-a74f-4a326edb6c1b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:18.675364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd61a5d-2f29-4d92-a74f-4a326edb6c1b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:18.675639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd61a5d-2f29-4d92-a74f-4a326edb6c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:18.686645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-23f6d1a2-36a6-4f55-835d-058652101729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ab7849dd4742578fd3a19f4fafb1bc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:18.734925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8fd61a5d-2f29-4d92-a74f-4a326edb6c1b None None] MFA Rules not processed for user `10633d982a704919b3c53f2f0029d8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:18.736245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8fd61a5d-2f29-4d92-a74f-4a326edb6c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:18.876737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-23f6d1a2-36a6-4f55-835d-058652101729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ab7849dd4742578fd3a19f4fafb1bc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:18.877758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-23f6d1a2-36a6-4f55-835d-058652101729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ab7849dd4742578fd3a19f4fafb1bc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:18.888900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:18.890408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-23f6d1a2-36a6-4f55-835d-058652101729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ab7849dd4742578fd3a19f4fafb1bc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:18.914593 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3685/7319] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:58:18.927331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd61a5d-2f29-4d92-a74f-4a326edb6c1b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:18.927505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8fd61a5d-2f29-4d92-a74f-4a326edb6c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:18.933262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-23f6d1a2-36a6-4f55-835d-058652101729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ab7849dd4742578fd3a19f4fafb1bc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:18.970970 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3635/7320] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:58:18 2022] DELETE /identity/v3/users/20ab7849dd4742578fd3a19f4fafb1bc => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:18.985274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194776a-d02d-4319-ba74-54f47e6d837e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:18.985572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194776a-d02d-4319-ba74-54f47e6d837e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:18.985850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194776a-d02d-4319-ba74-54f47e6d837e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:19.039660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4194776a-d02d-4319-ba74-54f47e6d837e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:19.042378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4194776a-d02d-4319-ba74-54f47e6d837e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:19.070791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd61a5d-2f29-4d92-a74f-4a326edb6c1b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:19.187505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c3fc9-5544-404b-8cef-42a1f94c22ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:19.189042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c3fc9-5544-404b-8cef-42a1f94c22ec service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:19.190925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c3fc9-5544-404b-8cef-42a1f94c22ec service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:19.192191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c3fc9-5544-404b-8cef-42a1f94c22ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:19.195594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6b4c3fc9-5544-404b-8cef-42a1f94c22ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:19.208452 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3636/7321] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:19.230728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194776a-d02d-4319-ba74-54f47e6d837e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:19.234924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4194776a-d02d-4319-ba74-54f47e6d837e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:19.361991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194776a-d02d-4319-ba74-54f47e6d837e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:19.371742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa1b91-4bfc-4610-ac80-0ba2ce8713b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:19.372391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa1b91-4bfc-4610-ac80-0ba2ce8713b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:19.372871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa1b91-4bfc-4610-ac80-0ba2ce8713b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:19.373305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa1b91-4bfc-4610-ac80-0ba2ce8713b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:19.374695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c3fc9-5544-404b-8cef-42a1f94c22ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:19.376310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c3fc9-5544-404b-8cef-42a1f94c22ec service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:19.398882 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3686/7322] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:58:19.418184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa1b91-4bfc-4610-ac80-0ba2ce8713b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:19.420052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa1b91-4bfc-4610-ac80-0ba2ce8713b0 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:19.463892 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3637/7323] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:58:20.328522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:20.515750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c3fc9-5544-404b-8cef-42a1f94c22ec service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:20.517411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6b4c3fc9-5544-404b-8cef-42a1f94c22ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:20.535550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c3fc9-5544-404b-8cef-42a1f94c22ec service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:20.541050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1ef04-a90a-4138-b0e2-706338128fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:20.542046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1ef04-a90a-4138-b0e2-706338128fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:20.542343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1ef04-a90a-4138-b0e2-706338128fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:20.542738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1ef04-a90a-4138-b0e2-706338128fe4 admin admin] PATH_INFO: `/v3/users/f99b4e7d3ff84f3ab92cd127c3a38ec8` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:20.543878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1ef04-a90a-4138-b0e2-706338128fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99b4e7d3ff84f3ab92cd127c3a38ec8)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:20.546386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1ef04-a90a-4138-b0e2-706338128fe4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:20.872852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1ed1ef04-a90a-4138-b0e2-706338128fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99b4e7d3ff84f3ab92cd127c3a38ec8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:20.874100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1ed1ef04-a90a-4138-b0e2-706338128fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99b4e7d3ff84f3ab92cd127c3a38ec8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:21.110449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa1b91-4bfc-4610-ac80-0ba2ce8713b0 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:21.112310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-05aa1b91-4bfc-4610-ac80-0ba2ce8713b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:21.135187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa1b91-4bfc-4610-ac80-0ba2ce8713b0 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:21.143125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783d092-934e-4eca-9712-47e34fddc47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:21.144131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d092-934e-4eca-9712-47e34fddc47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:21.144571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d092-934e-4eca-9712-47e34fddc47d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:21.146076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d092-934e-4eca-9712-47e34fddc47d admin admin] PATH_INFO: `/v3/projects/22e1ad1552fe40f78f3ecb8be72d7f2b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:21.147828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783d092-934e-4eca-9712-47e34fddc47d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e1ad1552fe40f78f3ecb8be72d7f2b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:21.151069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783d092-934e-4eca-9712-47e34fddc47d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:21.373363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1ed1ef04-a90a-4138-b0e2-706338128fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99b4e7d3ff84f3ab92cd127c3a38ec8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:21.374661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1ed1ef04-a90a-4138-b0e2-706338128fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99b4e7d3ff84f3ab92cd127c3a38ec8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:21.390153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1ed1ef04-a90a-4138-b0e2-706338128fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99b4e7d3ff84f3ab92cd127c3a38ec8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:21.407075 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3687/7324] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:58:20 2022] DELETE /identity/v3/users/f99b4e7d3ff84f3ab92cd127c3a38ec8 => generated 0 bytes in 892 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:21.411774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af8611-d132-458e-ba90-a061fc41624e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:21.412180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af8611-d132-458e-ba90-a061fc41624e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:21.412564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af8611-d132-458e-ba90-a061fc41624e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:21.434875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b8af8611-d132-458e-ba90-a061fc41624e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:21.436748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b8af8611-d132-458e-ba90-a061fc41624e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:21.491573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b783d092-934e-4eca-9712-47e34fddc47d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e1ad1552fe40f78f3ecb8be72d7f2b', 'request_id': 'req-b783d092-934e-4eca-9712-47e34fddc47d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:21.530132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b783d092-934e-4eca-9712-47e34fddc47d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e1ad1552fe40f78f3ecb8be72d7f2b', 'request_id': 'req-b783d092-934e-4eca-9712-47e34fddc47d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:21.554918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b783d092-934e-4eca-9712-47e34fddc47d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e1ad1552fe40f78f3ecb8be72d7f2b', 'request_id': 'req-b783d092-934e-4eca-9712-47e34fddc47d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:21.557912 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3688/7325] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:21.572056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af8611-d132-458e-ba90-a061fc41624e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:21.574668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b8af8611-d132-458e-ba90-a061fc41624e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:21.667067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af8611-d132-458e-ba90-a061fc41624e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:21.744384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e388a6-d983-4448-98b7-f5df927b7d49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:21.745796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e388a6-d983-4448-98b7-f5df927b7d49 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:21.746157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e388a6-d983-4448-98b7-f5df927b7d49 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:21.746607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e388a6-d983-4448-98b7-f5df927b7d49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:21.762150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b783d092-934e-4eca-9712-47e34fddc47d admin admin] The token cache is being invalidate because project 22e1ad1552fe40f78f3ecb8be72d7f2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:58:21.762749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b783d092-934e-4eca-9712-47e34fddc47d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:21.763604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b783d092-934e-4eca-9712-47e34fddc47d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:21.765640 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3638/7326] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:58:21 2022] DELETE /identity/v3/projects/22e1ad1552fe40f78f3ecb8be72d7f2b => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:21.769870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783d092-934e-4eca-9712-47e34fddc47d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:21.773053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b783d092-934e-4eca-9712-47e34fddc47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:21.883133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e388a6-d983-4448-98b7-f5df927b7d49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:21.884999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e388a6-d983-4448-98b7-f5df927b7d49 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:21.899481 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3689/7327] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:58:21.916288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783d092-934e-4eca-9712-47e34fddc47d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:21.947717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74f174-c565-4b67-a9f0-5a3922225419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:21.947717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74f174-c565-4b67-a9f0-5a3922225419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:21.947717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74f174-c565-4b67-a9f0-5a3922225419 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:21.947717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74f174-c565-4b67-a9f0-5a3922225419 admin admin] PATH_INFO: `/v3/users/3d3538a800d248d3bdbad31ec2c07dc2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:21.948244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74f174-c565-4b67-a9f0-5a3922225419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3538a800d248d3bdbad31ec2c07dc2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:21.948244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74f174-c565-4b67-a9f0-5a3922225419 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:22.303513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0c74f174-c565-4b67-a9f0-5a3922225419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3538a800d248d3bdbad31ec2c07dc2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:22.471716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0c74f174-c565-4b67-a9f0-5a3922225419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3538a800d248d3bdbad31ec2c07dc2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:22.477556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0c74f174-c565-4b67-a9f0-5a3922225419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3538a800d248d3bdbad31ec2c07dc2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:22.482300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0c74f174-c565-4b67-a9f0-5a3922225419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3538a800d248d3bdbad31ec2c07dc2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:22.499302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0c74f174-c565-4b67-a9f0-5a3922225419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3538a800d248d3bdbad31ec2c07dc2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:22.508723 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3639/7328] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:58:21 2022] DELETE /identity/v3/users/3d3538a800d248d3bdbad31ec2c07dc2 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:23.415507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e388a6-d983-4448-98b7-f5df927b7d49 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:23.417113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-85e388a6-d983-4448-98b7-f5df927b7d49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:23.460669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e388a6-d983-4448-98b7-f5df927b7d49 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:23.599139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:23.638226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8431222-8624-46c5-89c1-32990bcb371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:23.638226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8431222-8624-46c5-89c1-32990bcb371a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:23.638226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8431222-8624-46c5-89c1-32990bcb371a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:23.638226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8431222-8624-46c5-89c1-32990bcb371a admin admin] PATH_INFO: `/v3/projects/43664f2f09924de98a68ff0b71d0c190` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:23.639493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8431222-8624-46c5-89c1-32990bcb371a admin admin] RBAC: Authorizing `identity:delete_project(project_id=43664f2f09924de98a68ff0b71d0c190)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:23.639493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8431222-8624-46c5-89c1-32990bcb371a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:23.866105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8431222-8624-46c5-89c1-32990bcb371a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43664f2f09924de98a68ff0b71d0c190', 'request_id': 'req-c8431222-8624-46c5-89c1-32990bcb371a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:23.884294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8431222-8624-46c5-89c1-32990bcb371a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43664f2f09924de98a68ff0b71d0c190', 'request_id': 'req-c8431222-8624-46c5-89c1-32990bcb371a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:24.005350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8431222-8624-46c5-89c1-32990bcb371a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43664f2f09924de98a68ff0b71d0c190', 'request_id': 'req-c8431222-8624-46c5-89c1-32990bcb371a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:24.043698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8431222-8624-46c5-89c1-32990bcb371a admin admin] The token cache is being invalidate because project 43664f2f09924de98a68ff0b71d0c190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:58:24.045341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8431222-8624-46c5-89c1-32990bcb371a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:24.047670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c8431222-8624-46c5-89c1-32990bcb371a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:24.053885 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3690/7329] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:58:23 2022] DELETE /identity/v3/projects/43664f2f09924de98a68ff0b71d0c190 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:24.057948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74f174-c565-4b67-a9f0-5a3922225419 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:24.059733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0c74f174-c565-4b67-a9f0-5a3922225419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:24.092425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74f174-c565-4b67-a9f0-5a3922225419 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:24.199899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c783f-7aeb-47ee-aa1d-03409f1135be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:24.200552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c783f-7aeb-47ee-aa1d-03409f1135be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:24.200962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c783f-7aeb-47ee-aa1d-03409f1135be admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:24.201123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c783f-7aeb-47ee-aa1d-03409f1135be admin admin] PATH_INFO: `/v3/users/10633d982a704919b3c53f2f0029d8d8` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:24.202483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c783f-7aeb-47ee-aa1d-03409f1135be admin admin] RBAC: Authorizing `identity:delete_user(user_id=10633d982a704919b3c53f2f0029d8d8)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:24.204576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c783f-7aeb-47ee-aa1d-03409f1135be admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:24.552808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-591c783f-7aeb-47ee-aa1d-03409f1135be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10633d982a704919b3c53f2f0029d8d8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:24.734109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-591c783f-7aeb-47ee-aa1d-03409f1135be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10633d982a704919b3c53f2f0029d8d8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:24.735688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-591c783f-7aeb-47ee-aa1d-03409f1135be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10633d982a704919b3c53f2f0029d8d8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:24.753291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-591c783f-7aeb-47ee-aa1d-03409f1135be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10633d982a704919b3c53f2f0029d8d8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:24.773531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-591c783f-7aeb-47ee-aa1d-03409f1135be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10633d982a704919b3c53f2f0029d8d8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:24.786060 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3640/7330] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:58:24 2022] DELETE /identity/v3/users/10633d982a704919b3c53f2f0029d8d8 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:25.175557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8431222-8624-46c5-89c1-32990bcb371a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:25.183609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c8431222-8624-46c5-89c1-32990bcb371a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:25.199806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8431222-8624-46c5-89c1-32990bcb371a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:25.310904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793142b-3a4d-4e94-a11f-54ba296c9c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:25.311624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793142b-3a4d-4e94-a11f-54ba296c9c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:25.312306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793142b-3a4d-4e94-a11f-54ba296c9c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:25.312758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793142b-3a4d-4e94-a11f-54ba296c9c68 admin admin] PATH_INFO: `/v3/projects/f6a3e56f50524001afc48330b4f5d0c1` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:25.314937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793142b-3a4d-4e94-a11f-54ba296c9c68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a3e56f50524001afc48330b4f5d0c1)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:25.318885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793142b-3a4d-4e94-a11f-54ba296c9c68 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:25.488371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:25.502400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b793142b-3a4d-4e94-a11f-54ba296c9c68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a3e56f50524001afc48330b4f5d0c1', 'request_id': 'req-b793142b-3a4d-4e94-a11f-54ba296c9c68'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:25.526060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b793142b-3a4d-4e94-a11f-54ba296c9c68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a3e56f50524001afc48330b4f5d0c1', 'request_id': 'req-b793142b-3a4d-4e94-a11f-54ba296c9c68'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:25.664965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b793142b-3a4d-4e94-a11f-54ba296c9c68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a3e56f50524001afc48330b4f5d0c1', 'request_id': 'req-b793142b-3a4d-4e94-a11f-54ba296c9c68'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:25.700631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b793142b-3a4d-4e94-a11f-54ba296c9c68 admin admin] The token cache is being invalidate because project f6a3e56f50524001afc48330b4f5d0c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:58:25.701035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b793142b-3a4d-4e94-a11f-54ba296c9c68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:25.703037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b793142b-3a4d-4e94-a11f-54ba296c9c68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:25.713648 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3691/7331] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:58:25 2022] DELETE /identity/v3/projects/f6a3e56f50524001afc48330b4f5d0c1 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:25.724083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938262f-eb21-4213-8d70-5538b17a9972 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:25.724426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938262f-eb21-4213-8d70-5538b17a9972 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:25.724879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938262f-eb21-4213-8d70-5538b17a9972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:25.790058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f938262f-eb21-4213-8d70-5538b17a9972 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:25.793525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f938262f-eb21-4213-8d70-5538b17a9972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:25.940596 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3641/7332] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:25.942140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be7b2c-e228-4a05-afe8-e00423fdb7fa None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:25.942624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be7b2c-e228-4a05-afe8-e00423fdb7fa None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:25.942994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be7b2c-e228-4a05-afe8-e00423fdb7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:25.987999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-72be7b2c-e228-4a05-afe8-e00423fdb7fa None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:25.990721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-72be7b2c-e228-4a05-afe8-e00423fdb7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:26.041883 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3692/7333] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:58:26.046392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938262f-eb21-4213-8d70-5538b17a9972 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:26.061201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938262f-eb21-4213-8d70-5538b17a9972 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:26.077198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a2274-bf29-4477-b52b-705928f2f10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:26.078136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a2274-bf29-4477-b52b-705928f2f10d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:26.078583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a2274-bf29-4477-b52b-705928f2f10d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:26.079028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a2274-bf29-4477-b52b-705928f2f10d admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:26.079989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a2274-bf29-4477-b52b-705928f2f10d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:58:26.080623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a2274-bf29-4477-b52b-705928f2f10d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:26.084993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a2274-bf29-4477-b52b-705928f2f10d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:26.119935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be7b2c-e228-4a05-afe8-e00423fdb7fa None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:26.124502 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3642/7334] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:58:26.132634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be7b2c-e228-4a05-afe8-e00423fdb7fa None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:26.145577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0eb94-fda4-45c8-9d67-6969b51ea0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:26.146524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0eb94-fda4-45c8-9d67-6969b51ea0fc admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:26.146981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0eb94-fda4-45c8-9d67-6969b51ea0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:26.147414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0eb94-fda4-45c8-9d67-6969b51ea0fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:26.148259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0eb94-fda4-45c8-9d67-6969b51ea0fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:26.150343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0eb94-fda4-45c8-9d67-6969b51ea0fc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:26.367416 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3693/7335] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:58:26 2022] POST /identity/v3/projects => generated 379 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:26.371595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a2274-bf29-4477-b52b-705928f2f10d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:26.388821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a2274-bf29-4477-b52b-705928f2f10d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:26.529173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c00288-3c7d-42a5-9130-bf5800ee7e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:26.529748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c00288-3c7d-42a5-9130-bf5800ee7e91 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:26.529869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c00288-3c7d-42a5-9130-bf5800ee7e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:26.530189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c00288-3c7d-42a5-9130-bf5800ee7e91 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:26.530838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c00288-3c7d-42a5-9130-bf5800ee7e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:26.537265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c00288-3c7d-42a5-9130-bf5800ee7e91 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:26.712427 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3643/7336] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:58:26 2022] POST /identity/v3/users => generated 290 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:26.719401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0eb94-fda4-45c8-9d67-6969b51ea0fc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:26.732292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0eb94-fda4-45c8-9d67-6969b51ea0fc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:26.748390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad28a8d-cf56-4bd3-a6be-cc674e170558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:26.749029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad28a8d-cf56-4bd3-a6be-cc674e170558 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:26.749307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad28a8d-cf56-4bd3-a6be-cc674e170558 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:26.749579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad28a8d-cf56-4bd3-a6be-cc674e170558 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:26.750246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad28a8d-cf56-4bd3-a6be-cc674e170558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:26.751831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad28a8d-cf56-4bd3-a6be-cc674e170558 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:26.790000 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3694/7337] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:26.794377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c00288-3c7d-42a5-9130-bf5800ee7e91 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:26.810607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c00288-3c7d-42a5-9130-bf5800ee7e91 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:26.821798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414fa70-0fcc-4968-b716-9f5739ba6d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:26.822542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414fa70-0fcc-4968-b716-9f5739ba6d61 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:26.822829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414fa70-0fcc-4968-b716-9f5739ba6d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:26.823160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414fa70-0fcc-4968-b716-9f5739ba6d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:26.823823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414fa70-0fcc-4968-b716-9f5739ba6d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:26.825564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414fa70-0fcc-4968-b716-9f5739ba6d61 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:26.854134 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3644/7338] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:26.858283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad28a8d-cf56-4bd3-a6be-cc674e170558 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:26.878435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad28a8d-cf56-4bd3-a6be-cc674e170558 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:26.894339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd4c75-a02e-45fa-8821-c13b01ab42c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:26.895449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd4c75-a02e-45fa-8821-c13b01ab42c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:26.895692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd4c75-a02e-45fa-8821-c13b01ab42c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:26.895962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd4c75-a02e-45fa-8821-c13b01ab42c5 admin admin] PATH_INFO: `/v3/projects/401b8b59d3fe4589b6e45c47157cb6f9/users/bb05c3ea1484456c8675f4a054284d40/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:26.928893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd4c75-a02e-45fa-8821-c13b01ab42c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=401b8b59d3fe4589b6e45c47157cb6f9, user_id=bb05c3ea1484456c8675f4a054284d40, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:26.931724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd4c75-a02e-45fa-8821-c13b01ab42c5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:27.054971 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3695/7339] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:26 2022] PUT /identity/v3/projects/401b8b59d3fe4589b6e45c47157cb6f9/users/bb05c3ea1484456c8675f4a054284d40/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:27.067227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91aa15-bee9-4806-a06e-6238353ffbe0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:27.067512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91aa15-bee9-4806-a06e-6238353ffbe0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:27.068082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91aa15-bee9-4806-a06e-6238353ffbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:27.119316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4c91aa15-bee9-4806-a06e-6238353ffbe0 None None] MFA Rules not processed for user `bb05c3ea1484456c8675f4a054284d40`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:27.121053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4c91aa15-bee9-4806-a06e-6238353ffbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:27.216426 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3645/7340] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:27.217193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd4c75-a02e-45fa-8821-c13b01ab42c5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:27.278826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:27.408628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd4c75-a02e-45fa-8821-c13b01ab42c5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:27.418024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5152003-dc13-454b-8040-02c81d36efd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:27.424292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5152003-dc13-454b-8040-02c81d36efd5 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:27.424940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5152003-dc13-454b-8040-02c81d36efd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:27.425457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5152003-dc13-454b-8040-02c81d36efd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:27.428442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5152003-dc13-454b-8040-02c81d36efd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:27.430585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5152003-dc13-454b-8040-02c81d36efd5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:27.581963 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3696/7341] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:58:27 2022] POST /identity/v3/projects => generated 379 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:58:27.585095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91aa15-bee9-4806-a06e-6238353ffbe0 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:27.598822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5152003-dc13-454b-8040-02c81d36efd5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:27.600932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d5152003-dc13-454b-8040-02c81d36efd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:27.602938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91aa15-bee9-4806-a06e-6238353ffbe0 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:27.741503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca99ca-5573-44c1-a7af-898da5d1b841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:27.742839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca99ca-5573-44c1-a7af-898da5d1b841 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:27.742989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca99ca-5573-44c1-a7af-898da5d1b841 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:27.743337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca99ca-5573-44c1-a7af-898da5d1b841 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:27.744464 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca99ca-5573-44c1-a7af-898da5d1b841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:27.746660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca99ca-5573-44c1-a7af-898da5d1b841 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:27.767060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5152003-dc13-454b-8040-02c81d36efd5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:27.777548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff824d-5d79-4b56-b53e-ca8cbdf10063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:27.778479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff824d-5d79-4b56-b53e-ca8cbdf10063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:27.781144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff824d-5d79-4b56-b53e-ca8cbdf10063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:27.781450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff824d-5d79-4b56-b53e-ca8cbdf10063 admin admin] PATH_INFO: `/v3/projects/2199ae55019647ecbcb3c7b47c02eb19` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:27.790193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff824d-5d79-4b56-b53e-ca8cbdf10063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2199ae55019647ecbcb3c7b47c02eb19)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:27.792327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff824d-5d79-4b56-b53e-ca8cbdf10063 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:27.907209 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3646/7342] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:58:27 2022] POST /identity/v3/users => generated 296 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:27.911733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca99ca-5573-44c1-a7af-898da5d1b841 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:27.946473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca99ca-5573-44c1-a7af-898da5d1b841 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:27.969655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55cd66-ea75-4d8c-9634-cb9acac616cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:27.970403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55cd66-ea75-4d8c-9634-cb9acac616cb admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:27.970921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55cd66-ea75-4d8c-9634-cb9acac616cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:27.971406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55cd66-ea75-4d8c-9634-cb9acac616cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:27.972321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55cd66-ea75-4d8c-9634-cb9acac616cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:27.974827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55cd66-ea75-4d8c-9634-cb9acac616cb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:28.015775 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3647/7343] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:58:28.020839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55cd66-ea75-4d8c-9634-cb9acac616cb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:28.033512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-86ff824d-5d79-4b56-b53e-ca8cbdf10063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2199ae55019647ecbcb3c7b47c02eb19', 'request_id': 'req-86ff824d-5d79-4b56-b53e-ca8cbdf10063'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:28.043917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55cd66-ea75-4d8c-9634-cb9acac616cb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:28.045917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-86ff824d-5d79-4b56-b53e-ca8cbdf10063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2199ae55019647ecbcb3c7b47c02eb19', 'request_id': 'req-86ff824d-5d79-4b56-b53e-ca8cbdf10063'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:28.146024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-86ff824d-5d79-4b56-b53e-ca8cbdf10063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2199ae55019647ecbcb3c7b47c02eb19', 'request_id': 'req-86ff824d-5d79-4b56-b53e-ca8cbdf10063'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:28.154914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76bcf3-bf96-4743-936a-d094e61df693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:28.162909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76bcf3-bf96-4743-936a-d094e61df693 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:28.163619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76bcf3-bf96-4743-936a-d094e61df693 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:28.164769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76bcf3-bf96-4743-936a-d094e61df693 admin admin] PATH_INFO: `/v3/projects/3c357137cfd048df9c95d806802b1ab4/users/6741035d10ff4798837340c16fc1096a/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:28.170265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-86ff824d-5d79-4b56-b53e-ca8cbdf10063 admin admin] The token cache is being invalidate because project 2199ae55019647ecbcb3c7b47c02eb19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:58:28.170585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-86ff824d-5d79-4b56-b53e-ca8cbdf10063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:28.172094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-86ff824d-5d79-4b56-b53e-ca8cbdf10063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:28.176247 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3697/7344] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:58:27 2022] DELETE /identity/v3/projects/2199ae55019647ecbcb3c7b47c02eb19 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:58:28.181271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136feda-a831-47f2-9b31-4d48d363991e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:28.181700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136feda-a831-47f2-9b31-4d48d363991e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:28.182030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136feda-a831-47f2-9b31-4d48d363991e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:28.204844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76bcf3-bf96-4743-936a-d094e61df693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c357137cfd048df9c95d806802b1ab4, user_id=6741035d10ff4798837340c16fc1096a, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:28.212701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76bcf3-bf96-4743-936a-d094e61df693 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:28.226675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4136feda-a831-47f2-9b31-4d48d363991e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:28.228176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4136feda-a831-47f2-9b31-4d48d363991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:28.238487 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3698/7345] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:28.246189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30fc15-bde5-4172-9b2d-520e0492131b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:28.246541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30fc15-bde5-4172-9b2d-520e0492131b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:28.246890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30fc15-bde5-4172-9b2d-520e0492131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:28.269015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4f30fc15-bde5-4172-9b2d-520e0492131b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:28.270872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4f30fc15-bde5-4172-9b2d-520e0492131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:28.283768 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3699/7346] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:58:28.284886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30fc15-bde5-4172-9b2d-520e0492131b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:28.300348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30fc15-bde5-4172-9b2d-520e0492131b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:28.312372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425918e-f16b-4f22-964d-4f7cb55258b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:28.313099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425918e-f16b-4f22-964d-4f7cb55258b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:28.313448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425918e-f16b-4f22-964d-4f7cb55258b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:28.313787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425918e-f16b-4f22-964d-4f7cb55258b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:28.314719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425918e-f16b-4f22-964d-4f7cb55258b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:58:28.315029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425918e-f16b-4f22-964d-4f7cb55258b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:28.317472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425918e-f16b-4f22-964d-4f7cb55258b4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:28.339097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:28.357697 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3648/7347] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:28 2022] PUT /identity/v3/projects/3c357137cfd048df9c95d806802b1ab4/users/6741035d10ff4798837340c16fc1096a/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:28.358914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76bcf3-bf96-4743-936a-d094e61df693 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:28.371372 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3700/7348] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:58:28.373266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7e76bcf3-bf96-4743-936a-d094e61df693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:28.377053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425918e-f16b-4f22-964d-4f7cb55258b4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:28.402764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425918e-f16b-4f22-964d-4f7cb55258b4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:28.571116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76bcf3-bf96-4743-936a-d094e61df693 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:28.590517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339617b0-5e9c-4eb8-a902-478f5972233e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:28.591187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339617b0-5e9c-4eb8-a902-478f5972233e admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:28.592407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339617b0-5e9c-4eb8-a902-478f5972233e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:28.593573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339617b0-5e9c-4eb8-a902-478f5972233e admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:28.596501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339617b0-5e9c-4eb8-a902-478f5972233e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:28.597321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbb754-e18a-4507-b0bb-4bfff9a792c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:28.599722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbb754-e18a-4507-b0bb-4bfff9a792c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:28.600389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbb754-e18a-4507-b0bb-4bfff9a792c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:28.600813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbb754-e18a-4507-b0bb-4bfff9a792c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:28.601882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339617b0-5e9c-4eb8-a902-478f5972233e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:28.602186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbb754-e18a-4507-b0bb-4bfff9a792c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:28.606892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbb754-e18a-4507-b0bb-4bfff9a792c3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:28.672214 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3649/7349] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:28.673237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339617b0-5e9c-4eb8-a902-478f5972233e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:28.722165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339617b0-5e9c-4eb8-a902-478f5972233e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:28.746289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8ffc6-21c2-4d0c-8dba-7572d7fadbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:28.747014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ffc6-21c2-4d0c-8dba-7572d7fadbbc admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:28.747306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ffc6-21c2-4d0c-8dba-7572d7fadbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:28.751101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ffc6-21c2-4d0c-8dba-7572d7fadbbc admin admin] PATH_INFO: `/v3/projects/3c357137cfd048df9c95d806802b1ab4/users/6741035d10ff4798837340c16fc1096a/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:28.754595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8ffc6-21c2-4d0c-8dba-7572d7fadbbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c357137cfd048df9c95d806802b1ab4, user_id=6741035d10ff4798837340c16fc1096a, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:28.767141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:28.768241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8ffc6-21c2-4d0c-8dba-7572d7fadbbc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:28.795741 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3650/7350] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:28 2022] PUT /identity/v3/projects/3c357137cfd048df9c95d806802b1ab4/users/6741035d10ff4798837340c16fc1096a/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:28.810599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d8eaf-e477-4935-8d36-f4a908c6bb52 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:28.810915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d8eaf-e477-4935-8d36-f4a908c6bb52 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:28.811451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d8eaf-e477-4935-8d36-f4a908c6bb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:28.817626 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3701/7351] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:58:28 2022] POST /identity/v3/projects => generated 385 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:28.829607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbb754-e18a-4507-b0bb-4bfff9a792c3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:28.880909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3a5d8eaf-e477-4935-8d36-f4a908c6bb52 None None] MFA Rules not processed for user `6741035d10ff4798837340c16fc1096a`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:28.882363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3a5d8eaf-e477-4935-8d36-f4a908c6bb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:28.978537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbb754-e18a-4507-b0bb-4bfff9a792c3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:28.992371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90179737-9230-4dab-9052-68898c7edc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:28.993014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90179737-9230-4dab-9052-68898c7edc6b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:28.993297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90179737-9230-4dab-9052-68898c7edc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:28.993573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90179737-9230-4dab-9052-68898c7edc6b admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:28.994385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90179737-9230-4dab-9052-68898c7edc6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:28.996400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90179737-9230-4dab-9052-68898c7edc6b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:29.050120 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3651/7352] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:29.066078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d8eaf-e477-4935-8d36-f4a908c6bb52 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:29.069741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3a5d8eaf-e477-4935-8d36-f4a908c6bb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:29.193760 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3702/7353] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:58:28 2022] POST /identity/v3/users => generated 293 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:58:29.198563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90179737-9230-4dab-9052-68898c7edc6b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:29.199251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d8eaf-e477-4935-8d36-f4a908c6bb52 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:29.204368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e92ca-4524-4f8e-abca-7347904936d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:29.205283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e92ca-4524-4f8e-abca-7347904936d6 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:29.205698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e92ca-4524-4f8e-abca-7347904936d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:29.207490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e92ca-4524-4f8e-abca-7347904936d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:29.210909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90179737-9230-4dab-9052-68898c7edc6b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:29.211927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e90e92ca-4524-4f8e-abca-7347904936d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:29.217560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d114155-eb1b-4aeb-a341-5d5231b22f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:29.218189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d114155-eb1b-4aeb-a341-5d5231b22f05 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:29.218484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d114155-eb1b-4aeb-a341-5d5231b22f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:29.218763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d114155-eb1b-4aeb-a341-5d5231b22f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:29.220072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d114155-eb1b-4aeb-a341-5d5231b22f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:29.222405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d114155-eb1b-4aeb-a341-5d5231b22f05 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:29.258933 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3703/7354] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:29.260017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d114155-eb1b-4aeb-a341-5d5231b22f05 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:29.282091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d114155-eb1b-4aeb-a341-5d5231b22f05 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:29.292784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba547584-1f53-4f69-9d92-8032c8680407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:29.294078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba547584-1f53-4f69-9d92-8032c8680407 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:29.295380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba547584-1f53-4f69-9d92-8032c8680407 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:29.296024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba547584-1f53-4f69-9d92-8032c8680407 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:29.297084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba547584-1f53-4f69-9d92-8032c8680407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:29.301718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba547584-1f53-4f69-9d92-8032c8680407 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:29.305820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e92ca-4524-4f8e-abca-7347904936d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:29.307575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e92ca-4524-4f8e-abca-7347904936d6 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:29.325195 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3652/7355] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:58:29.333054 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3704/7356] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:29.333939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e92ca-4524-4f8e-abca-7347904936d6 service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:29.387579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e92ca-4524-4f8e-abca-7347904936d6 service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:29.413035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f34d8d-70b0-400a-8670-0a648a0f85f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:29.413035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f34d8d-70b0-400a-8670-0a648a0f85f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:29.413035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f34d8d-70b0-400a-8670-0a648a0f85f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:29.413456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f34d8d-70b0-400a-8670-0a648a0f85f4 admin admin] PATH_INFO: `/v3/projects/6960e204d7ea4ecca3f4542313b79672/users/bde62334a0a04db5b1667d0efaec9e65/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:29.484603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f34d8d-70b0-400a-8670-0a648a0f85f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6960e204d7ea4ecca3f4542313b79672, user_id=bde62334a0a04db5b1667d0efaec9e65, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:29.487416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f34d8d-70b0-400a-8670-0a648a0f85f4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:29.607512 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3653/7357] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:29 2022] PUT /identity/v3/projects/6960e204d7ea4ecca3f4542313b79672/users/bde62334a0a04db5b1667d0efaec9e65/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:29.611928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75eed0-3a7b-42f8-9c50-0f8e98f6a534 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:29.614924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75eed0-3a7b-42f8-9c50-0f8e98f6a534 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:29.615390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75eed0-3a7b-42f8-9c50-0f8e98f6a534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:29.718622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ea75eed0-3a7b-42f8-9c50-0f8e98f6a534 None None] MFA Rules not processed for user `bde62334a0a04db5b1667d0efaec9e65`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:29.722199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ea75eed0-3a7b-42f8-9c50-0f8e98f6a534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:29.905211 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3705/7358] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:30.069112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:30.431063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f34d8d-70b0-400a-8670-0a648a0f85f4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:30.571502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f34d8d-70b0-400a-8670-0a648a0f85f4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:30.579962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8ad64-f4cd-469d-a8f8-9925c4e1fee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:30.581046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8ad64-f4cd-469d-a8f8-9925c4e1fee7 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:30.581570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8ad64-f4cd-469d-a8f8-9925c4e1fee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:30.582068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8ad64-f4cd-469d-a8f8-9925c4e1fee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:30.602099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8ad64-f4cd-469d-a8f8-9925c4e1fee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:30.608486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8ad64-f4cd-469d-a8f8-9925c4e1fee7 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:30.630852 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3654/7359] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:58:30.689360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75eed0-3a7b-42f8-9c50-0f8e98f6a534 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:30.869475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75eed0-3a7b-42f8-9c50-0f8e98f6a534 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:30.889305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e689826-3ffd-40e2-9bed-67988ed3c256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:30.890778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e689826-3ffd-40e2-9bed-67988ed3c256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:30.893102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e689826-3ffd-40e2-9bed-67988ed3c256 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:30.893628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e689826-3ffd-40e2-9bed-67988ed3c256 admin admin] PATH_INFO: `/v3/users/bde62334a0a04db5b1667d0efaec9e65` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:30.895229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e689826-3ffd-40e2-9bed-67988ed3c256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde62334a0a04db5b1667d0efaec9e65)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:30.898763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e689826-3ffd-40e2-9bed-67988ed3c256 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:31.253674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1e689826-3ffd-40e2-9bed-67988ed3c256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde62334a0a04db5b1667d0efaec9e65'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:31.255811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1e689826-3ffd-40e2-9bed-67988ed3c256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde62334a0a04db5b1667d0efaec9e65'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:31.414686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1e689826-3ffd-40e2-9bed-67988ed3c256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde62334a0a04db5b1667d0efaec9e65'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:31.416283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:31.416932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1e689826-3ffd-40e2-9bed-67988ed3c256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde62334a0a04db5b1667d0efaec9e65'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:31.441765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1e689826-3ffd-40e2-9bed-67988ed3c256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde62334a0a04db5b1667d0efaec9e65'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:31.497398 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3706/7360] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:58:30 2022] DELETE /identity/v3/users/bde62334a0a04db5b1667d0efaec9e65 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:31.501696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415c80c-6c0a-40ed-a344-8b2f798d3313 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:31.502310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415c80c-6c0a-40ed-a344-8b2f798d3313 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:31.502804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415c80c-6c0a-40ed-a344-8b2f798d3313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:31.568934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2415c80c-6c0a-40ed-a344-8b2f798d3313 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:31.571677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2415c80c-6c0a-40ed-a344-8b2f798d3313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:31.783728 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3655/7361] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:31.852140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e689826-3ffd-40e2-9bed-67988ed3c256 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:31.856642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1e689826-3ffd-40e2-9bed-67988ed3c256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:31.998815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e689826-3ffd-40e2-9bed-67988ed3c256 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:32.008750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c56f0c-f908-4c7d-81b1-bea837473fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:32.009754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c56f0c-f908-4c7d-81b1-bea837473fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:32.010260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c56f0c-f908-4c7d-81b1-bea837473fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:32.010751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c56f0c-f908-4c7d-81b1-bea837473fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:32.036021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c56f0c-f908-4c7d-81b1-bea837473fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:32.037841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c56f0c-f908-4c7d-81b1-bea837473fd0 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:32.058424 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3707/7362] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:58:32.272352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:32.551598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:33.212091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415c80c-6c0a-40ed-a344-8b2f798d3313 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:33.216515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2415c80c-6c0a-40ed-a344-8b2f798d3313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:33.304998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415c80c-6c0a-40ed-a344-8b2f798d3313 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:33.315116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ed4db-0cbf-4705-b7c7-8b3ec248a71a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:33.317828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ed4db-0cbf-4705-b7c7-8b3ec248a71a service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:33.318200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ed4db-0cbf-4705-b7c7-8b3ec248a71a service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:33.318481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ed4db-0cbf-4705-b7c7-8b3ec248a71a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:33.320511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c56ed4db-0cbf-4705-b7c7-8b3ec248a71a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:33.382180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:33.407748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ed4db-0cbf-4705-b7c7-8b3ec248a71a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:33.411947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ed4db-0cbf-4705-b7c7-8b3ec248a71a service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:33.435871 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3656/7363] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:58:33.665461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:INSERT=3,keystone:SELECT=86,keystone:DELETE=11 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:34.235547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c56f0c-f908-4c7d-81b1-bea837473fd0 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:34.237387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b0c56f0c-f908-4c7d-81b1-bea837473fd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:34.254757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c56f0c-f908-4c7d-81b1-bea837473fd0 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:34.260689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d88c3-0840-418f-9b9c-fa4eed807a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:34.261707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d88c3-0840-418f-9b9c-fa4eed807a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:34.262210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d88c3-0840-418f-9b9c-fa4eed807a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:34.262787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d88c3-0840-418f-9b9c-fa4eed807a58 admin admin] PATH_INFO: `/v3/projects/6960e204d7ea4ecca3f4542313b79672` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:34.264379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d88c3-0840-418f-9b9c-fa4eed807a58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6960e204d7ea4ecca3f4542313b79672)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:34.268815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d88c3-0840-418f-9b9c-fa4eed807a58 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:34.447813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-222d88c3-0840-418f-9b9c-fa4eed807a58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6960e204d7ea4ecca3f4542313b79672', 'request_id': 'req-222d88c3-0840-418f-9b9c-fa4eed807a58'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:34.462408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-222d88c3-0840-418f-9b9c-fa4eed807a58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6960e204d7ea4ecca3f4542313b79672', 'request_id': 'req-222d88c3-0840-418f-9b9c-fa4eed807a58'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:34.584818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-222d88c3-0840-418f-9b9c-fa4eed807a58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6960e204d7ea4ecca3f4542313b79672', 'request_id': 'req-222d88c3-0840-418f-9b9c-fa4eed807a58'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:34.605733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-222d88c3-0840-418f-9b9c-fa4eed807a58 admin admin] The token cache is being invalidate because project 6960e204d7ea4ecca3f4542313b79672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:58:34.607194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-222d88c3-0840-418f-9b9c-fa4eed807a58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:34.608037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-222d88c3-0840-418f-9b9c-fa4eed807a58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:34.616883 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3708/7364] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:58:34 2022] DELETE /identity/v3/projects/6960e204d7ea4ecca3f4542313b79672 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:34.619254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb036d-4cd7-45ba-807b-5e7867476fd6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:34.620896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb036d-4cd7-45ba-807b-5e7867476fd6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:34.621815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb036d-4cd7-45ba-807b-5e7867476fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:34.681833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0ccb036d-4cd7-45ba-807b-5e7867476fd6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:34.683094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0ccb036d-4cd7-45ba-807b-5e7867476fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:34.853346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25419262-e13d-4936-b2a8-6be1d590465c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:34.854040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25419262-e13d-4936-b2a8-6be1d590465c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:34.854512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25419262-e13d-4936-b2a8-6be1d590465c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:34.860284 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3657/7365] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:34.893861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-25419262-e13d-4936-b2a8-6be1d590465c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:34.896152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-25419262-e13d-4936-b2a8-6be1d590465c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:34.919306 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3709/7366] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:34.924043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb036d-4cd7-45ba-807b-5e7867476fd6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:34.939450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb036d-4cd7-45ba-807b-5e7867476fd6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:34.957575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf36744-04e8-4820-8903-594f37e91dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:34.979164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf36744-04e8-4820-8903-594f37e91dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:34.979164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf36744-04e8-4820-8903-594f37e91dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:34.979164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf36744-04e8-4820-8903-594f37e91dd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:34.979164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf36744-04e8-4820-8903-594f37e91dd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:58:34.979164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf36744-04e8-4820-8903-594f37e91dd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:34.986783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf36744-04e8-4820-8903-594f37e91dd6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:34.997657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:35.035456 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3658/7367] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:58:35.042340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25419262-e13d-4936-b2a8-6be1d590465c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:35.047070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25419262-e13d-4936-b2a8-6be1d590465c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:35.072418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81f6fc-2322-4a7b-95fb-863573f7670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:35.073291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81f6fc-2322-4a7b-95fb-863573f7670c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:35.073680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81f6fc-2322-4a7b-95fb-863573f7670c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:35.074155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81f6fc-2322-4a7b-95fb-863573f7670c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:35.074921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81f6fc-2322-4a7b-95fb-863573f7670c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:35.079599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81f6fc-2322-4a7b-95fb-863573f7670c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:35.262889 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3710/7368] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:58:35 2022] POST /identity/v3/projects => generated 361 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:58:35.269433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf36744-04e8-4820-8903-594f37e91dd6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:35.285537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf36744-04e8-4820-8903-594f37e91dd6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:35.412604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138b2d5-f7c0-4bdd-b929-47a4db61e572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:35.413527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138b2d5-f7c0-4bdd-b929-47a4db61e572 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:35.415368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138b2d5-f7c0-4bdd-b929-47a4db61e572 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:35.416691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138b2d5-f7c0-4bdd-b929-47a4db61e572 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:35.418159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138b2d5-f7c0-4bdd-b929-47a4db61e572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:35.423050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138b2d5-f7c0-4bdd-b929-47a4db61e572 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:35.578591 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3659/7369] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:58:35 2022] POST /identity/v3/users => generated 281 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:35.579328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81f6fc-2322-4a7b-95fb-863573f7670c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:35.603597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:35.611652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81f6fc-2322-4a7b-95fb-863573f7670c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:35.635731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b791ca3-9b32-4c1b-879e-a91754a045b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:35.639670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b791ca3-9b32-4c1b-879e-a91754a045b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:35.641591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b791ca3-9b32-4c1b-879e-a91754a045b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:35.642106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b791ca3-9b32-4c1b-879e-a91754a045b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:35.643018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b791ca3-9b32-4c1b-879e-a91754a045b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:35.648500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b791ca3-9b32-4c1b-879e-a91754a045b2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:35.685346 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3711/7370] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:35.688682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138b2d5-f7c0-4bdd-b929-47a4db61e572 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:35.705966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138b2d5-f7c0-4bdd-b929-47a4db61e572 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:35.731473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2d3ee-8936-4124-9147-49230e190cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:35.732155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2d3ee-8936-4124-9147-49230e190cbb admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:35.732457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2d3ee-8936-4124-9147-49230e190cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:35.735748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2d3ee-8936-4124-9147-49230e190cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:35.739290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2d3ee-8936-4124-9147-49230e190cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:35.749766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2d3ee-8936-4124-9147-49230e190cbb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:35.797956 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3660/7371] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:35.802487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b791ca3-9b32-4c1b-879e-a91754a045b2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:35.819410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b791ca3-9b32-4c1b-879e-a91754a045b2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:35.831011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35264d49-944f-42f2-b297-241cf6d32a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:35.831543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35264d49-944f-42f2-b297-241cf6d32a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:35.831995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35264d49-944f-42f2-b297-241cf6d32a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:35.833046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35264d49-944f-42f2-b297-241cf6d32a43 admin admin] PATH_INFO: `/v3/projects/2d29e1d5cf704dff8ea0273a6e578007/users/aafea8f701ab4d87a3c82c0b59c4666a/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:35.891262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35264d49-944f-42f2-b297-241cf6d32a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d29e1d5cf704dff8ea0273a6e578007, user_id=aafea8f701ab4d87a3c82c0b59c4666a, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:35.908863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35264d49-944f-42f2-b297-241cf6d32a43 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:36.093727 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3712/7372] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:35 2022] PUT /identity/v3/projects/2d29e1d5cf704dff8ea0273a6e578007/users/aafea8f701ab4d87a3c82c0b59c4666a/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:58:36.096592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517eb43-c1c4-4fd1-848c-34acdb0923fd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:36.096952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517eb43-c1c4-4fd1-848c-34acdb0923fd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:36.097345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517eb43-c1c4-4fd1-848c-34acdb0923fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:36.171660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5517eb43-c1c4-4fd1-848c-34acdb0923fd None None] MFA Rules not processed for user `aafea8f701ab4d87a3c82c0b59c4666a`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:36.174410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5517eb43-c1c4-4fd1-848c-34acdb0923fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:36.328228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:36.385606 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3661/7373] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:37.064495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35264d49-944f-42f2-b297-241cf6d32a43 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:37.066529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-35264d49-944f-42f2-b297-241cf6d32a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:37.189938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35264d49-944f-42f2-b297-241cf6d32a43 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:37.193757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f2988-0880-467c-9323-3ad528041a75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:37.194484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f2988-0880-467c-9323-3ad528041a75 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:37.194767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f2988-0880-467c-9323-3ad528041a75 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:37.195094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f2988-0880-467c-9323-3ad528041a75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:37.207222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f2988-0880-467c-9323-3ad528041a75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:37.209412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f2988-0880-467c-9323-3ad528041a75 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:37.247272 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3713/7374] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:58:37.266617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517eb43-c1c4-4fd1-848c-34acdb0923fd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:37.467537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517eb43-c1c4-4fd1-848c-34acdb0923fd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:37.493905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1955a-8b65-4df3-ab8c-0e4a3b34bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:37.494596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1955a-8b65-4df3-ab8c-0e4a3b34bdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:37.494884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1955a-8b65-4df3-ab8c-0e4a3b34bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:37.495164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1955a-8b65-4df3-ab8c-0e4a3b34bdec admin admin] PATH_INFO: `/v3/users/aafea8f701ab4d87a3c82c0b59c4666a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:37.504689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1955a-8b65-4df3-ab8c-0e4a3b34bdec admin admin] RBAC: Authorizing `identity:delete_user(user_id=aafea8f701ab4d87a3c82c0b59c4666a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:37.506857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1955a-8b65-4df3-ab8c-0e4a3b34bdec admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:37.539260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:37.873341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e2f1955a-8b65-4df3-ab8c-0e4a3b34bdec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aafea8f701ab4d87a3c82c0b59c4666a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:37.916846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:38.036643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e2f1955a-8b65-4df3-ab8c-0e4a3b34bdec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aafea8f701ab4d87a3c82c0b59c4666a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:38.038936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e2f1955a-8b65-4df3-ab8c-0e4a3b34bdec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aafea8f701ab4d87a3c82c0b59c4666a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:38.060528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e2f1955a-8b65-4df3-ab8c-0e4a3b34bdec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aafea8f701ab4d87a3c82c0b59c4666a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:38.118573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e2f1955a-8b65-4df3-ab8c-0e4a3b34bdec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aafea8f701ab4d87a3c82c0b59c4666a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:38.135500 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3662/7375] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:58:37 2022] DELETE /identity/v3/users/aafea8f701ab4d87a3c82c0b59c4666a => generated 0 bytes in 870 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:38.140033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8897e-784b-44a6-8900-e1c042fbfbc9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:38.140568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8897e-784b-44a6-8900-e1c042fbfbc9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:38.140734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8897e-784b-44a6-8900-e1c042fbfbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:38.191799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d9a8897e-784b-44a6-8900-e1c042fbfbc9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:38.192508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d9a8897e-784b-44a6-8900-e1c042fbfbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:38.427461 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3714/7376] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:38.449539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1955a-8b65-4df3-ab8c-0e4a3b34bdec admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:38.451542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e2f1955a-8b65-4df3-ab8c-0e4a3b34bdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:38.611467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1955a-8b65-4df3-ab8c-0e4a3b34bdec admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:38.621678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69491e17-55e8-4683-824b-69dca4cc304d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:38.625189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69491e17-55e8-4683-824b-69dca4cc304d service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:38.625189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69491e17-55e8-4683-824b-69dca4cc304d service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:38.625189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69491e17-55e8-4683-824b-69dca4cc304d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:38.657935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69491e17-55e8-4683-824b-69dca4cc304d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:38.662088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69491e17-55e8-4683-824b-69dca4cc304d service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:38.692877 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3663/7377] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:58:39.228769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:39.982450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8897e-784b-44a6-8900-e1c042fbfbc9 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:39.984076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d9a8897e-784b-44a6-8900-e1c042fbfbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:40.016637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8897e-784b-44a6-8900-e1c042fbfbc9 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:40.036672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a314b-a95e-4ddf-bd2a-0e9ba17688fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:40.041285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a314b-a95e-4ddf-bd2a-0e9ba17688fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:40.041285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a314b-a95e-4ddf-bd2a-0e9ba17688fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:40.041285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a314b-a95e-4ddf-bd2a-0e9ba17688fc admin admin] PATH_INFO: `/v3/projects/2d29e1d5cf704dff8ea0273a6e578007` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:40.041285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a314b-a95e-4ddf-bd2a-0e9ba17688fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d29e1d5cf704dff8ea0273a6e578007)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:40.044583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a314b-a95e-4ddf-bd2a-0e9ba17688fc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:40.151378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:40.295742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ce7a314b-a95e-4ddf-bd2a-0e9ba17688fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d29e1d5cf704dff8ea0273a6e578007', 'request_id': 'req-ce7a314b-a95e-4ddf-bd2a-0e9ba17688fc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:40.308003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ce7a314b-a95e-4ddf-bd2a-0e9ba17688fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d29e1d5cf704dff8ea0273a6e578007', 'request_id': 'req-ce7a314b-a95e-4ddf-bd2a-0e9ba17688fc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:40.407865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ce7a314b-a95e-4ddf-bd2a-0e9ba17688fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d29e1d5cf704dff8ea0273a6e578007', 'request_id': 'req-ce7a314b-a95e-4ddf-bd2a-0e9ba17688fc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:40.426937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ce7a314b-a95e-4ddf-bd2a-0e9ba17688fc admin admin] The token cache is being invalidate because project 2d29e1d5cf704dff8ea0273a6e578007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:58:40.427686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ce7a314b-a95e-4ddf-bd2a-0e9ba17688fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:40.428668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ce7a314b-a95e-4ddf-bd2a-0e9ba17688fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:40.442455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c87b41-99bb-4b26-9cf8-2460ae5e466c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:40.442962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c87b41-99bb-4b26-9cf8-2460ae5e466c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:40.443390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c87b41-99bb-4b26-9cf8-2460ae5e466c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:40.447185 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3715/7378] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:58:39 2022] DELETE /identity/v3/projects/2d29e1d5cf704dff8ea0273a6e578007 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:40.465678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-27c87b41-99bb-4b26-9cf8-2460ae5e466c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:40.467424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-27c87b41-99bb-4b26-9cf8-2460ae5e466c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:40.711250 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3664/7379] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:40.713158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e370e7-de13-456c-96fc-1df6eeb4080e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:40.713415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e370e7-de13-456c-96fc-1df6eeb4080e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:40.713685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e370e7-de13-456c-96fc-1df6eeb4080e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:40.782597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-04e370e7-de13-456c-96fc-1df6eeb4080e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:40.785230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-04e370e7-de13-456c-96fc-1df6eeb4080e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:40.786814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:40.806637 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3716/7380] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:40.807890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c87b41-99bb-4b26-9cf8-2460ae5e466c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:40.835239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c87b41-99bb-4b26-9cf8-2460ae5e466c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:40.861184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cefdd1-64cb-427c-9339-f155d3454d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:40.862895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cefdd1-64cb-427c-9339-f155d3454d58 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:40.863391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cefdd1-64cb-427c-9339-f155d3454d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:40.864049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cefdd1-64cb-427c-9339-f155d3454d58 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:40.866849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cefdd1-64cb-427c-9339-f155d3454d58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:58:40.867863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cefdd1-64cb-427c-9339-f155d3454d58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:40.870025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cefdd1-64cb-427c-9339-f155d3454d58 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:40.923542 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3665/7381] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:58:40.928631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e370e7-de13-456c-96fc-1df6eeb4080e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:40.946499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e370e7-de13-456c-96fc-1df6eeb4080e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:40.963674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e789b-50b2-434c-8287-55beefc2f1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:40.964561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e789b-50b2-434c-8287-55beefc2f1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:40.965007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e789b-50b2-434c-8287-55beefc2f1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:40.965331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e789b-50b2-434c-8287-55beefc2f1f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:40.968635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e789b-50b2-434c-8287-55beefc2f1f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:40.976626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e789b-50b2-434c-8287-55beefc2f1f5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:41.251302 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3717/7382] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:58:40 2022] POST /identity/v3/projects => generated 369 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:41.255445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cefdd1-64cb-427c-9339-f155d3454d58 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:41.269255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cefdd1-64cb-427c-9339-f155d3454d58 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:41.477012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418dba1e-5fde-46ac-a12a-be9fd7269faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:41.477652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dba1e-5fde-46ac-a12a-be9fd7269faa admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:41.479350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dba1e-5fde-46ac-a12a-be9fd7269faa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:41.479350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dba1e-5fde-46ac-a12a-be9fd7269faa admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:41.479350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dba1e-5fde-46ac-a12a-be9fd7269faa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:41.481008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dba1e-5fde-46ac-a12a-be9fd7269faa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:41.664620 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3666/7383] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:58:41 2022] POST /identity/v3/users => generated 285 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:41.668520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e789b-50b2-434c-8287-55beefc2f1f5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:41.686902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e789b-50b2-434c-8287-55beefc2f1f5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:41.712385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1997d4-9ecc-4b34-886e-0895020a36ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:41.713031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1997d4-9ecc-4b34-886e-0895020a36ac admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:41.715657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1997d4-9ecc-4b34-886e-0895020a36ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:41.715969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1997d4-9ecc-4b34-886e-0895020a36ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:41.716863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1997d4-9ecc-4b34-886e-0895020a36ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:41.724866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1997d4-9ecc-4b34-886e-0895020a36ac admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:41.756635 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3718/7384] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:41.761371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418dba1e-5fde-46ac-a12a-be9fd7269faa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:41.773865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418dba1e-5fde-46ac-a12a-be9fd7269faa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:41.780001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bd23c-b404-40a3-8c1a-a45bd5557188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:41.786968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bd23c-b404-40a3-8c1a-a45bd5557188 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:41.786968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bd23c-b404-40a3-8c1a-a45bd5557188 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:41.786968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bd23c-b404-40a3-8c1a-a45bd5557188 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:41.786968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bd23c-b404-40a3-8c1a-a45bd5557188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:41.786968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bd23c-b404-40a3-8c1a-a45bd5557188 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:41.813215 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3667/7385] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:41.819806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1997d4-9ecc-4b34-886e-0895020a36ac admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:41.833439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1997d4-9ecc-4b34-886e-0895020a36ac admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:41.843213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62086bd-38a9-437f-a5fe-5de99cf36f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:41.844309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62086bd-38a9-437f-a5fe-5de99cf36f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:41.844802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62086bd-38a9-437f-a5fe-5de99cf36f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:41.845473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62086bd-38a9-437f-a5fe-5de99cf36f7e admin admin] PATH_INFO: `/v3/projects/2d45e23181cd46c4b0afa9961c1d3eb1/users/beb571e998874031a2234acc7998c860/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:41.864545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62086bd-38a9-437f-a5fe-5de99cf36f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d45e23181cd46c4b0afa9961c1d3eb1, user_id=beb571e998874031a2234acc7998c860, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:41.868052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62086bd-38a9-437f-a5fe-5de99cf36f7e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:41.972543 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3719/7386] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:41 2022] PUT /identity/v3/projects/2d45e23181cd46c4b0afa9961c1d3eb1/users/beb571e998874031a2234acc7998c860/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:41.984660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09513e9-b64c-473e-a1bd-1e6ab5aceb22 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:41.984996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09513e9-b64c-473e-a1bd-1e6ab5aceb22 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:41.985220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09513e9-b64c-473e-a1bd-1e6ab5aceb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:42.069759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e09513e9-b64c-473e-a1bd-1e6ab5aceb22 None None] MFA Rules not processed for user `beb571e998874031a2234acc7998c860`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:42.071309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e09513e9-b64c-473e-a1bd-1e6ab5aceb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:42.273601 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3668/7387] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:42.284280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62086bd-38a9-437f-a5fe-5de99cf36f7e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:42.286252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c62086bd-38a9-437f-a5fe-5de99cf36f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:42.495673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62086bd-38a9-437f-a5fe-5de99cf36f7e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:42.509621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b116d6d-d768-4be8-851c-30b0b2c88e70 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:42.510624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b116d6d-d768-4be8-851c-30b0b2c88e70 service glance] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:42.511055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b116d6d-d768-4be8-851c-30b0b2c88e70 service glance] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:42.511489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b116d6d-d768-4be8-851c-30b0b2c88e70 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:42.526045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b116d6d-d768-4be8-851c-30b0b2c88e70 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:42.528026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b116d6d-d768-4be8-851c-30b0b2c88e70 service glance] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:42.569157 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3720/7388] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:58:42.728948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:43.476650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:44.012394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09513e9-b64c-473e-a1bd-1e6ab5aceb22 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:44.012394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e09513e9-b64c-473e-a1bd-1e6ab5aceb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:44.188807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09513e9-b64c-473e-a1bd-1e6ab5aceb22 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:44.203147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac0926-75fc-41e8-9b0c-cc3babb4bafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:44.205404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0926-75fc-41e8-9b0c-cc3babb4bafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:44.206717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0926-75fc-41e8-9b0c-cc3babb4bafa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:44.208528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0926-75fc-41e8-9b0c-cc3babb4bafa admin admin] PATH_INFO: `/v3/users/f1d9a7288b4f418fae249458b2ee94bd` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:44.215971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac0926-75fc-41e8-9b0c-cc3babb4bafa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d9a7288b4f418fae249458b2ee94bd)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:44.217552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac0926-75fc-41e8-9b0c-cc3babb4bafa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:44.663060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-21ac0926-75fc-41e8-9b0c-cc3babb4bafa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d9a7288b4f418fae249458b2ee94bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:44.786272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-21ac0926-75fc-41e8-9b0c-cc3babb4bafa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d9a7288b4f418fae249458b2ee94bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:44.788014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-21ac0926-75fc-41e8-9b0c-cc3babb4bafa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d9a7288b4f418fae249458b2ee94bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:44.808137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-21ac0926-75fc-41e8-9b0c-cc3babb4bafa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d9a7288b4f418fae249458b2ee94bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:44.858944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-21ac0926-75fc-41e8-9b0c-cc3babb4bafa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d9a7288b4f418fae249458b2ee94bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:44.873954 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3669/7389] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:58:43 2022] DELETE /identity/v3/users/f1d9a7288b4f418fae249458b2ee94bd => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:44.879587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928c975-1ac2-4a13-b272-c6e7f452571d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:44.882143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928c975-1ac2-4a13-b272-c6e7f452571d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:44.882945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928c975-1ac2-4a13-b272-c6e7f452571d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:44.930821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9928c975-1ac2-4a13-b272-c6e7f452571d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:44.933718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9928c975-1ac2-4a13-b272-c6e7f452571d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:45.104736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:45.168372 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3721/7390] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:45.383899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac0926-75fc-41e8-9b0c-cc3babb4bafa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:45.385954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-21ac0926-75fc-41e8-9b0c-cc3babb4bafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:45.599601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac0926-75fc-41e8-9b0c-cc3babb4bafa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:45.611581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bccd5f-ac5f-454a-9858-0c36ae87a89a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:45.614538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bccd5f-ac5f-454a-9858-0c36ae87a89a service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:45.614538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bccd5f-ac5f-454a-9858-0c36ae87a89a service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:45.614538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bccd5f-ac5f-454a-9858-0c36ae87a89a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:45.652836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bccd5f-ac5f-454a-9858-0c36ae87a89a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:45.654414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bccd5f-ac5f-454a-9858-0c36ae87a89a service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:45.698031 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3670/7391] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:58:46.179364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:46.602258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:46.955139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928c975-1ac2-4a13-b272-c6e7f452571d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:46.958286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9928c975-1ac2-4a13-b272-c6e7f452571d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:46.997266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928c975-1ac2-4a13-b272-c6e7f452571d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:47.011871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fce88-18ac-4266-b17e-2fbb407e5ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:47.013784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fce88-18ac-4266-b17e-2fbb407e5ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:47.015863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fce88-18ac-4266-b17e-2fbb407e5ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:47.016514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fce88-18ac-4266-b17e-2fbb407e5ca2 admin admin] PATH_INFO: `/v3/projects/3e93e1b41b114f13ba810b308eb280be` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:47.018185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fce88-18ac-4266-b17e-2fbb407e5ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e93e1b41b114f13ba810b308eb280be)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:47.026068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fce88-18ac-4266-b17e-2fbb407e5ca2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:47.244199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a0fce88-18ac-4266-b17e-2fbb407e5ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e93e1b41b114f13ba810b308eb280be', 'request_id': 'req-5a0fce88-18ac-4266-b17e-2fbb407e5ca2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:47.268110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a0fce88-18ac-4266-b17e-2fbb407e5ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e93e1b41b114f13ba810b308eb280be', 'request_id': 'req-5a0fce88-18ac-4266-b17e-2fbb407e5ca2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:47.350877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a0fce88-18ac-4266-b17e-2fbb407e5ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e93e1b41b114f13ba810b308eb280be', 'request_id': 'req-5a0fce88-18ac-4266-b17e-2fbb407e5ca2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:47.386078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a0fce88-18ac-4266-b17e-2fbb407e5ca2 admin admin] The token cache is being invalidate because project 3e93e1b41b114f13ba810b308eb280be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:58:47.386365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a0fce88-18ac-4266-b17e-2fbb407e5ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:47.387693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5a0fce88-18ac-4266-b17e-2fbb407e5ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:47.392093 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3722/7392] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:58:46 2022] DELETE /identity/v3/projects/3e93e1b41b114f13ba810b308eb280be => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:47.397753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8f2ca-dd05-4c59-9dea-171acff54c8c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:47.398039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8f2ca-dd05-4c59-9dea-171acff54c8c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:47.398313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8f2ca-dd05-4c59-9dea-171acff54c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:47.445559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-83c8f2ca-dd05-4c59-9dea-171acff54c8c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:47.449150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-83c8f2ca-dd05-4c59-9dea-171acff54c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:47.595538 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3671/7393] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:47.603851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b10c9c-e0d5-4350-ac36-aabe30e685b8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:47.604580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b10c9c-e0d5-4350-ac36-aabe30e685b8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:47.604921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b10c9c-e0d5-4350-ac36-aabe30e685b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:47.646715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-20b10c9c-e0d5-4350-ac36-aabe30e685b8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:47.647970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-20b10c9c-e0d5-4350-ac36-aabe30e685b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:47.683629 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3723/7394] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:47.688960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8f2ca-dd05-4c59-9dea-171acff54c8c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:47.711002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8f2ca-dd05-4c59-9dea-171acff54c8c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:47.734875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f06ec-b90b-4df2-9833-e9c9d5fdf759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:47.737310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f06ec-b90b-4df2-9833-e9c9d5fdf759 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:47.737703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f06ec-b90b-4df2-9833-e9c9d5fdf759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:47.745047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f06ec-b90b-4df2-9833-e9c9d5fdf759 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:47.745047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f06ec-b90b-4df2-9833-e9c9d5fdf759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:58:47.745047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f06ec-b90b-4df2-9833-e9c9d5fdf759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:47.748927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f06ec-b90b-4df2-9833-e9c9d5fdf759 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:47.792369 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3672/7395] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:58:47.794037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b10c9c-e0d5-4350-ac36-aabe30e685b8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:47.809683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b10c9c-e0d5-4350-ac36-aabe30e685b8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:47.833191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89310d8-0cf5-42c7-82a1-b4d6b73ab4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:47.834785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89310d8-0cf5-42c7-82a1-b4d6b73ab4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:47.835856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89310d8-0cf5-42c7-82a1-b4d6b73ab4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:47.836212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89310d8-0cf5-42c7-82a1-b4d6b73ab4c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:47.837865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89310d8-0cf5-42c7-82a1-b4d6b73ab4c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:47.840806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89310d8-0cf5-42c7-82a1-b4d6b73ab4c7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:48.039874 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3724/7396] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:58:47 2022] POST /identity/v3/projects => generated 371 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:48.043884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f06ec-b90b-4df2-9833-e9c9d5fdf759 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:48.058509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f06ec-b90b-4df2-9833-e9c9d5fdf759 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:48.230029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8e37f-da71-42c6-84e8-2e51ba80b7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:48.230840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8e37f-da71-42c6-84e8-2e51ba80b7ed admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:48.231227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8e37f-da71-42c6-84e8-2e51ba80b7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:48.231560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8e37f-da71-42c6-84e8-2e51ba80b7ed admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:48.245122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8e37f-da71-42c6-84e8-2e51ba80b7ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:48.245122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8e37f-da71-42c6-84e8-2e51ba80b7ed admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:48.365444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:48.424482 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3673/7397] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:58:48 2022] POST /identity/v3/users => generated 286 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:48.435430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89310d8-0cf5-42c7-82a1-b4d6b73ab4c7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:48.451938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89310d8-0cf5-42c7-82a1-b4d6b73ab4c7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:48.466657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9e740-bba8-4748-b590-0fc829191c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:48.472547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e740-bba8-4748-b590-0fc829191c97 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:48.472547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e740-bba8-4748-b590-0fc829191c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:48.472547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e740-bba8-4748-b590-0fc829191c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:48.472547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9e740-bba8-4748-b590-0fc829191c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:48.475650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9e740-bba8-4748-b590-0fc829191c97 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:48.553440 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3725/7398] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:48.558903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8e37f-da71-42c6-84e8-2e51ba80b7ed admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:48.587877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8e37f-da71-42c6-84e8-2e51ba80b7ed admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:48.612415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc067f-2dfc-4243-9f7d-81bf4865864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:48.615081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc067f-2dfc-4243-9f7d-81bf4865864a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:48.615691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc067f-2dfc-4243-9f7d-81bf4865864a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:48.618116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc067f-2dfc-4243-9f7d-81bf4865864a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:48.619077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc067f-2dfc-4243-9f7d-81bf4865864a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:48.627307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc067f-2dfc-4243-9f7d-81bf4865864a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:48.653793 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3674/7399] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:48.655625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9e740-bba8-4748-b590-0fc829191c97 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:48.671553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9e740-bba8-4748-b590-0fc829191c97 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:48.703943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfd851-bfa3-46ad-ba87-054336626afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:48.704636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfd851-bfa3-46ad-ba87-054336626afc admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:48.706556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfd851-bfa3-46ad-ba87-054336626afc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:48.707003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfd851-bfa3-46ad-ba87-054336626afc admin admin] PATH_INFO: `/v3/projects/c9b309dbc3c041dba6f3d9f1ad07f125/users/38f4333d61894adda4dc6031aae0f5f4/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:48.758283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfd851-bfa3-46ad-ba87-054336626afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b309dbc3c041dba6f3d9f1ad07f125, user_id=38f4333d61894adda4dc6031aae0f5f4, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:48.771605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfd851-bfa3-46ad-ba87-054336626afc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:48.849655 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3726/7400] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:48 2022] PUT /identity/v3/projects/c9b309dbc3c041dba6f3d9f1ad07f125/users/38f4333d61894adda4dc6031aae0f5f4/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:48.861825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a4146-4823-47cf-90a9-51774ce88cd1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:48.862481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a4146-4823-47cf-90a9-51774ce88cd1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:48.863362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a4146-4823-47cf-90a9-51774ce88cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:48.952957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ed7a4146-4823-47cf-90a9-51774ce88cd1 None None] MFA Rules not processed for user `38f4333d61894adda4dc6031aae0f5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:48.954762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ed7a4146-4823-47cf-90a9-51774ce88cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:49.173035 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3675/7401] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:49.201760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfd851-bfa3-46ad-ba87-054336626afc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:49.204203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d0cfd851-bfa3-46ad-ba87-054336626afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:49.260022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:49.345083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfd851-bfa3-46ad-ba87-054336626afc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:49.356639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6153d-5ddb-474a-857b-fb25590cfa6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:49.357956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6153d-5ddb-474a-857b-fb25590cfa6e service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:49.358439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6153d-5ddb-474a-857b-fb25590cfa6e service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:49.358880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6153d-5ddb-474a-857b-fb25590cfa6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:49.381229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6153d-5ddb-474a-857b-fb25590cfa6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:49.385570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6153d-5ddb-474a-857b-fb25590cfa6e service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:49.408491 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3727/7402] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:58:49.449653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a4146-4823-47cf-90a9-51774ce88cd1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:49.588829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a4146-4823-47cf-90a9-51774ce88cd1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:49.597232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fdb5c-ca77-4406-9c02-a8b57cbc8514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:49.598236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fdb5c-ca77-4406-9c02-a8b57cbc8514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:49.598680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fdb5c-ca77-4406-9c02-a8b57cbc8514 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:49.599105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fdb5c-ca77-4406-9c02-a8b57cbc8514 admin admin] PATH_INFO: `/v3/users/38f4333d61894adda4dc6031aae0f5f4` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:49.601870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fdb5c-ca77-4406-9c02-a8b57cbc8514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f4333d61894adda4dc6031aae0f5f4)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:49.604764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fdb5c-ca77-4406-9c02-a8b57cbc8514 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:49.933456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-112fdb5c-ca77-4406-9c02-a8b57cbc8514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f4333d61894adda4dc6031aae0f5f4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:50.121697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-112fdb5c-ca77-4406-9c02-a8b57cbc8514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f4333d61894adda4dc6031aae0f5f4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:50.122365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-112fdb5c-ca77-4406-9c02-a8b57cbc8514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f4333d61894adda4dc6031aae0f5f4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:50.144246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-112fdb5c-ca77-4406-9c02-a8b57cbc8514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f4333d61894adda4dc6031aae0f5f4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:50.162127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-112fdb5c-ca77-4406-9c02-a8b57cbc8514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f4333d61894adda4dc6031aae0f5f4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:50.169537 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3676/7403] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:58:49 2022] DELETE /identity/v3/users/38f4333d61894adda4dc6031aae0f5f4 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:50.176580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91601783-2ff6-47bf-b5b3-a5db2c08c172 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:50.177496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91601783-2ff6-47bf-b5b3-a5db2c08c172 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:50.178194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91601783-2ff6-47bf-b5b3-a5db2c08c172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:50.220493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-91601783-2ff6-47bf-b5b3-a5db2c08c172 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:50.223798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-91601783-2ff6-47bf-b5b3-a5db2c08c172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:50.405761 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3728/7404] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:50.493255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:50.564910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fdb5c-ca77-4406-9c02-a8b57cbc8514 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:50.567747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-112fdb5c-ca77-4406-9c02-a8b57cbc8514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:50.745077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fdb5c-ca77-4406-9c02-a8b57cbc8514 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:50.757339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd90564-ad72-4abe-9578-199a905f13c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:50.758196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90564-ad72-4abe-9578-199a905f13c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:50.758636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90564-ad72-4abe-9578-199a905f13c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:50.759055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90564-ad72-4abe-9578-199a905f13c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:50.788612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd90564-ad72-4abe-9578-199a905f13c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:50.790445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd90564-ad72-4abe-9578-199a905f13c3 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:50.826837 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3677/7405] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:58:51.552516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:52.339209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91601783-2ff6-47bf-b5b3-a5db2c08c172 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:52.340788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-91601783-2ff6-47bf-b5b3-a5db2c08c172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:52.433993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91601783-2ff6-47bf-b5b3-a5db2c08c172 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:52.457293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5f2a3-8837-48a2-bcac-4c8a0bd8d197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:52.457293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5f2a3-8837-48a2-bcac-4c8a0bd8d197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:52.457293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5f2a3-8837-48a2-bcac-4c8a0bd8d197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:52.457293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5f2a3-8837-48a2-bcac-4c8a0bd8d197 admin admin] PATH_INFO: `/v3/users/bb05c3ea1484456c8675f4a054284d40` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:52.457670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5f2a3-8837-48a2-bcac-4c8a0bd8d197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb05c3ea1484456c8675f4a054284d40)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:52.457670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5f2a3-8837-48a2-bcac-4c8a0bd8d197 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:52.845885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-41f5f2a3-8837-48a2-bcac-4c8a0bd8d197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb05c3ea1484456c8675f4a054284d40'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:52.851799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-41f5f2a3-8837-48a2-bcac-4c8a0bd8d197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb05c3ea1484456c8675f4a054284d40'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:53.036408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-41f5f2a3-8837-48a2-bcac-4c8a0bd8d197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb05c3ea1484456c8675f4a054284d40'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:53.038638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-41f5f2a3-8837-48a2-bcac-4c8a0bd8d197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb05c3ea1484456c8675f4a054284d40'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:53.068283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-41f5f2a3-8837-48a2-bcac-4c8a0bd8d197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb05c3ea1484456c8675f4a054284d40'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:53.110659 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3729/7406] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:58:52 2022] DELETE /identity/v3/users/bb05c3ea1484456c8675f4a054284d40 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:53.111737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb3712-534a-4487-af1f-bb8c834ff26f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:53.113034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb3712-534a-4487-af1f-bb8c834ff26f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:53.113034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb3712-534a-4487-af1f-bb8c834ff26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:53.197757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8adb3712-534a-4487-af1f-bb8c834ff26f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:53.199002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8adb3712-534a-4487-af1f-bb8c834ff26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:53.255382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:53.328931 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3678/7407] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:53.355997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5f2a3-8837-48a2-bcac-4c8a0bd8d197 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:53.365806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-41f5f2a3-8837-48a2-bcac-4c8a0bd8d197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:53.589302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5f2a3-8837-48a2-bcac-4c8a0bd8d197 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:53.608400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae26318-2b90-4f76-87e8-dcd855f7b1d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:53.611797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae26318-2b90-4f76-87e8-dcd855f7b1d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:53.614313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae26318-2b90-4f76-87e8-dcd855f7b1d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:53.614740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae26318-2b90-4f76-87e8-dcd855f7b1d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:53.644870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae26318-2b90-4f76-87e8-dcd855f7b1d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:53.650531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae26318-2b90-4f76-87e8-dcd855f7b1d2 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:53.680396 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3730/7408] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:58:54.734831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb3712-534a-4487-af1f-bb8c834ff26f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:54.737250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8adb3712-534a-4487-af1f-bb8c834ff26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:54.797053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb3712-534a-4487-af1f-bb8c834ff26f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:54.816370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec56c03-b4cf-43f9-bb1c-6c51f455d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:54.817144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec56c03-b4cf-43f9-bb1c-6c51f455d06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:54.817530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec56c03-b4cf-43f9-bb1c-6c51f455d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:54.817908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec56c03-b4cf-43f9-bb1c-6c51f455d06f admin admin] PATH_INFO: `/v3/projects/c9b309dbc3c041dba6f3d9f1ad07f125` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:54.819182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec56c03-b4cf-43f9-bb1c-6c51f455d06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b309dbc3c041dba6f3d9f1ad07f125)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:54.824725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec56c03-b4cf-43f9-bb1c-6c51f455d06f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:55.064842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5ec56c03-b4cf-43f9-bb1c-6c51f455d06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b309dbc3c041dba6f3d9f1ad07f125', 'request_id': 'req-5ec56c03-b4cf-43f9-bb1c-6c51f455d06f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:55.102281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5ec56c03-b4cf-43f9-bb1c-6c51f455d06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b309dbc3c041dba6f3d9f1ad07f125', 'request_id': 'req-5ec56c03-b4cf-43f9-bb1c-6c51f455d06f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:55.117120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5ec56c03-b4cf-43f9-bb1c-6c51f455d06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b309dbc3c041dba6f3d9f1ad07f125', 'request_id': 'req-5ec56c03-b4cf-43f9-bb1c-6c51f455d06f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:55.328992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5ec56c03-b4cf-43f9-bb1c-6c51f455d06f admin admin] The token cache is being invalidate because project c9b309dbc3c041dba6f3d9f1ad07f125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:58:55.329245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5ec56c03-b4cf-43f9-bb1c-6c51f455d06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:55.330060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5ec56c03-b4cf-43f9-bb1c-6c51f455d06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:55.332231 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3679/7409] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:58:54 2022] DELETE /identity/v3/projects/c9b309dbc3c041dba6f3d9f1ad07f125 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:55.337323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6338ad-85e3-4765-8628-24d2f565e8bf None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:55.337836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6338ad-85e3-4765-8628-24d2f565e8bf None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:55.337953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6338ad-85e3-4765-8628-24d2f565e8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:55.406136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8b6338ad-85e3-4765-8628-24d2f565e8bf None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:55.407396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8b6338ad-85e3-4765-8628-24d2f565e8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:55.553547 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3731/7410] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:58:55.560911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b29a24-09f1-42ea-bf62-a74dd38116ce None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:55.561493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b29a24-09f1-42ea-bf62-a74dd38116ce None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:55.561864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b29a24-09f1-42ea-bf62-a74dd38116ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:55.595338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-90b29a24-09f1-42ea-bf62-a74dd38116ce None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:55.598714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-90b29a24-09f1-42ea-bf62-a74dd38116ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:55.614833 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3680/7411] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:55.617327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6338ad-85e3-4765-8628-24d2f565e8bf None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:55.628917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b29a24-09f1-42ea-bf62-a74dd38116ce None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:55.630771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-90b29a24-09f1-42ea-bf62-a74dd38116ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:55.630922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6338ad-85e3-4765-8628-24d2f565e8bf None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:55.644040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518081c-4e9a-4ee9-b330-11c314e6b30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:55.647326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518081c-4e9a-4ee9-b330-11c314e6b30a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:55.648681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518081c-4e9a-4ee9-b330-11c314e6b30a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:55.649145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518081c-4e9a-4ee9-b330-11c314e6b30a admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:55.650086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518081c-4e9a-4ee9-b330-11c314e6b30a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:58:55.655949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518081c-4e9a-4ee9-b330-11c314e6b30a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:55.656997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b29a24-09f1-42ea-bf62-a74dd38116ce None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:55.661703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518081c-4e9a-4ee9-b330-11c314e6b30a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:55.680516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89b45d-c907-4bb7-b5da-57c257939636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:55.681240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89b45d-c907-4bb7-b5da-57c257939636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:55.681512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89b45d-c907-4bb7-b5da-57c257939636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:55.681789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89b45d-c907-4bb7-b5da-57c257939636 admin admin] PATH_INFO: `/v3/projects/401b8b59d3fe4589b6e45c47157cb6f9` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:55.686927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89b45d-c907-4bb7-b5da-57c257939636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=401b8b59d3fe4589b6e45c47157cb6f9)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:55.689749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89b45d-c907-4bb7-b5da-57c257939636 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:55.693965 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3732/7412] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 04:58:55.701858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518081c-4e9a-4ee9-b330-11c314e6b30a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:55.739986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518081c-4e9a-4ee9-b330-11c314e6b30a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:55.756238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8107b37-a0bb-43c6-b298-6237768b2853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:55.764699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8107b37-a0bb-43c6-b298-6237768b2853 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:55.766514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8107b37-a0bb-43c6-b298-6237768b2853 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:55.767057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8107b37-a0bb-43c6-b298-6237768b2853 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:55.770906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8107b37-a0bb-43c6-b298-6237768b2853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:55.774203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8107b37-a0bb-43c6-b298-6237768b2853 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:56.125558 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3733/7413] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:58:55 2022] POST /identity/v3/projects => generated 381 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:56.126694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8107b37-a0bb-43c6-b298-6237768b2853 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:56.192735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1d89b45d-c907-4bb7-b5da-57c257939636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '401b8b59d3fe4589b6e45c47157cb6f9', 'request_id': 'req-1d89b45d-c907-4bb7-b5da-57c257939636'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:56.207619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1d89b45d-c907-4bb7-b5da-57c257939636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '401b8b59d3fe4589b6e45c47157cb6f9', 'request_id': 'req-1d89b45d-c907-4bb7-b5da-57c257939636'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:56.227269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1d89b45d-c907-4bb7-b5da-57c257939636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '401b8b59d3fe4589b6e45c47157cb6f9', 'request_id': 'req-1d89b45d-c907-4bb7-b5da-57c257939636'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:56.279003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8107b37-a0bb-43c6-b298-6237768b2853 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:56.368457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24309604-2c14-4751-b532-1fc50b413fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:56.369800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24309604-2c14-4751-b532-1fc50b413fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:56.370172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24309604-2c14-4751-b532-1fc50b413fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:56.370743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24309604-2c14-4751-b532-1fc50b413fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:56.371519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24309604-2c14-4751-b532-1fc50b413fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:56.373608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24309604-2c14-4751-b532-1fc50b413fb0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:56.417463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:56.500980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1d89b45d-c907-4bb7-b5da-57c257939636 admin admin] The token cache is being invalidate because project 401b8b59d3fe4589b6e45c47157cb6f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:58:56.501526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1d89b45d-c907-4bb7-b5da-57c257939636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:56.504885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1d89b45d-c907-4bb7-b5da-57c257939636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:56.507054 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3681/7414] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:58:55 2022] DELETE /identity/v3/projects/401b8b59d3fe4589b6e45c47157cb6f9 => generated 0 bytes in 879 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:56.513087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89b45d-c907-4bb7-b5da-57c257939636 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:56.515479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1d89b45d-c907-4bb7-b5da-57c257939636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:56.545419 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3734/7415] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:58:56 2022] POST /identity/v3/users => generated 291 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:58:56.547112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24309604-2c14-4751-b532-1fc50b413fb0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:56.550235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-24309604-2c14-4751-b532-1fc50b413fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:56.579301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89b45d-c907-4bb7-b5da-57c257939636 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:56.593931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a574a8-5277-4237-ab9b-9750a7c64163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:56.599205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a574a8-5277-4237-ab9b-9750a7c64163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:56.600455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a574a8-5277-4237-ab9b-9750a7c64163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:56.602308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a574a8-5277-4237-ab9b-9750a7c64163 admin admin] PATH_INFO: `/v3/users/6741035d10ff4798837340c16fc1096a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:56.603289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24309604-2c14-4751-b532-1fc50b413fb0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:56.608840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a574a8-5277-4237-ab9b-9750a7c64163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6741035d10ff4798837340c16fc1096a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:56.619076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a574a8-5277-4237-ab9b-9750a7c64163 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:56.623757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c3f6c-f287-4c58-853f-259556594f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:56.635414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c3f6c-f287-4c58-853f-259556594f11 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:56.641416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c3f6c-f287-4c58-853f-259556594f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:56.642558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c3f6c-f287-4c58-853f-259556594f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:56.644302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c3f6c-f287-4c58-853f-259556594f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:56.651277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c3f6c-f287-4c58-853f-259556594f11 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:56.726566 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3735/7416] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:56.726566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c3f6c-f287-4c58-853f-259556594f11 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:56.726566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c3f6c-f287-4c58-853f-259556594f11 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:56.748521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef7b8e-3f9b-4425-8065-9d6d3dd8b67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:56.751882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef7b8e-3f9b-4425-8065-9d6d3dd8b67c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:56.752471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef7b8e-3f9b-4425-8065-9d6d3dd8b67c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:56.754198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef7b8e-3f9b-4425-8065-9d6d3dd8b67c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:56.756367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef7b8e-3f9b-4425-8065-9d6d3dd8b67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:56.764083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef7b8e-3f9b-4425-8065-9d6d3dd8b67c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:56.797383 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3736/7417] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:56.802823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef7b8e-3f9b-4425-8065-9d6d3dd8b67c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:56.824034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef7b8e-3f9b-4425-8065-9d6d3dd8b67c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:56.840058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f68d82-5a1e-4dc1-b77f-0998fbe99e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:56.841929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f68d82-5a1e-4dc1-b77f-0998fbe99e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:56.843331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f68d82-5a1e-4dc1-b77f-0998fbe99e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:56.845027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f68d82-5a1e-4dc1-b77f-0998fbe99e48 admin admin] PATH_INFO: `/v3/projects/f80531682f6947d585b6d95df180cd19/users/1379ad15b8e949c8a687776f3b727465/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:56.878381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f68d82-5a1e-4dc1-b77f-0998fbe99e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80531682f6947d585b6d95df180cd19, user_id=1379ad15b8e949c8a687776f3b727465, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:56.883045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f68d82-5a1e-4dc1-b77f-0998fbe99e48 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:56.950424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=82,keystone:DELETE=13,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:56.996736 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3737/7418] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:56 2022] PUT /identity/v3/projects/f80531682f6947d585b6d95df180cd19/users/1379ad15b8e949c8a687776f3b727465/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:57.012531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916de577-d1a1-486d-bc20-31ec78c343ec None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:57.013069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916de577-d1a1-486d-bc20-31ec78c343ec None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:57.013543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916de577-d1a1-486d-bc20-31ec78c343ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:57.028136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-67a574a8-5277-4237-ab9b-9750a7c64163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6741035d10ff4798837340c16fc1096a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:57.054007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-916de577-d1a1-486d-bc20-31ec78c343ec None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:57.059657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-916de577-d1a1-486d-bc20-31ec78c343ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:57.160905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-67a574a8-5277-4237-ab9b-9750a7c64163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6741035d10ff4798837340c16fc1096a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:57.177693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-67a574a8-5277-4237-ab9b-9750a7c64163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6741035d10ff4798837340c16fc1096a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:57.177693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-67a574a8-5277-4237-ab9b-9750a7c64163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6741035d10ff4798837340c16fc1096a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:57.217663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-67a574a8-5277-4237-ab9b-9750a7c64163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6741035d10ff4798837340c16fc1096a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:57.251744 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3682/7419] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:58:56 2022] DELETE /identity/v3/users/6741035d10ff4798837340c16fc1096a => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:57.265142 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3738/7420] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:57.305440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a574a8-5277-4237-ab9b-9750a7c64163 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:57.306932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-67a574a8-5277-4237-ab9b-9750a7c64163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:57.394833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a574a8-5277-4237-ab9b-9750a7c64163 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:57.410569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd44d1-61b1-4472-9991-7f5ef3fecc7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:57.411117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd44d1-61b1-4472-9991-7f5ef3fecc7f service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:57.413118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd44d1-61b1-4472-9991-7f5ef3fecc7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:57.413574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd44d1-61b1-4472-9991-7f5ef3fecc7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:57.613448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd44d1-61b1-4472-9991-7f5ef3fecc7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:57.615306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd44d1-61b1-4472-9991-7f5ef3fecc7f service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:57.644482 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3683/7421] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:58:58.371125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916de577-d1a1-486d-bc20-31ec78c343ec None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:58.372736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-916de577-d1a1-486d-bc20-31ec78c343ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:58.404895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916de577-d1a1-486d-bc20-31ec78c343ec None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:58.428693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436664dc-432a-40f6-a95b-76c3d76e775b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:58.430144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436664dc-432a-40f6-a95b-76c3d76e775b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:58.430781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436664dc-432a-40f6-a95b-76c3d76e775b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:58.431395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436664dc-432a-40f6-a95b-76c3d76e775b admin admin] PATH_INFO: `/v3/projects/3c357137cfd048df9c95d806802b1ab4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:58.432828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436664dc-432a-40f6-a95b-76c3d76e775b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c357137cfd048df9c95d806802b1ab4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:58.435592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436664dc-432a-40f6-a95b-76c3d76e775b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:58.618226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-436664dc-432a-40f6-a95b-76c3d76e775b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c357137cfd048df9c95d806802b1ab4', 'request_id': 'req-436664dc-432a-40f6-a95b-76c3d76e775b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:58.634347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-436664dc-432a-40f6-a95b-76c3d76e775b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c357137cfd048df9c95d806802b1ab4', 'request_id': 'req-436664dc-432a-40f6-a95b-76c3d76e775b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:58.802518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-436664dc-432a-40f6-a95b-76c3d76e775b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c357137cfd048df9c95d806802b1ab4', 'request_id': 'req-436664dc-432a-40f6-a95b-76c3d76e775b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:58.841912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-436664dc-432a-40f6-a95b-76c3d76e775b admin admin] The token cache is being invalidate because project 3c357137cfd048df9c95d806802b1ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:58:58.842486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-436664dc-432a-40f6-a95b-76c3d76e775b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:58.843516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-436664dc-432a-40f6-a95b-76c3d76e775b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:58:58.845782 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3739/7422] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:58:58 2022] DELETE /identity/v3/projects/3c357137cfd048df9c95d806802b1ab4 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:58:58.858119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade1d8f-c768-4624-a669-ec27ef701a99 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:58.858119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade1d8f-c768-4624-a669-ec27ef701a99 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:58.858119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade1d8f-c768-4624-a669-ec27ef701a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:58.902124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bade1d8f-c768-4624-a669-ec27ef701a99 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:58.913375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bade1d8f-c768-4624-a669-ec27ef701a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:59.071692 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3684/7423] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:59.073663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974a3f6-6f38-469a-9dd6-56f153bf3b48 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:59.074212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974a3f6-6f38-469a-9dd6-56f153bf3b48 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:59.074578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974a3f6-6f38-469a-9dd6-56f153bf3b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:59.087715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:59.125398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f974a3f6-6f38-469a-9dd6-56f153bf3b48 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:58:59.127017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f974a3f6-6f38-469a-9dd6-56f153bf3b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:58:59.154270 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3740/7424] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:58:59.155404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade1d8f-c768-4624-a669-ec27ef701a99 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:59.167867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade1d8f-c768-4624-a669-ec27ef701a99 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:59.196949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff329ae-2bec-48ce-b798-1572eccf4f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:59.200221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff329ae-2bec-48ce-b798-1572eccf4f97 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:59.200681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff329ae-2bec-48ce-b798-1572eccf4f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:59.203119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff329ae-2bec-48ce-b798-1572eccf4f97 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:59.203987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff329ae-2bec-48ce-b798-1572eccf4f97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:58:59.204435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff329ae-2bec-48ce-b798-1572eccf4f97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:59.224449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff329ae-2bec-48ce-b798-1572eccf4f97 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:59.256425 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3685/7425] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:58:59.258538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974a3f6-6f38-469a-9dd6-56f153bf3b48 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:59.269490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974a3f6-6f38-469a-9dd6-56f153bf3b48 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:59.275623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c278983-6c9f-4ab3-8ff3-a741b4e52a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:59.276419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c278983-6c9f-4ab3-8ff3-a741b4e52a10 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:59.276773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c278983-6c9f-4ab3-8ff3-a741b4e52a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:59.277195 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c278983-6c9f-4ab3-8ff3-a741b4e52a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:59.277955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c278983-6c9f-4ab3-8ff3-a741b4e52a10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:59.280533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c278983-6c9f-4ab3-8ff3-a741b4e52a10 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:59.450615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:58:59.462761 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3741/7426] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:58:59 2022] POST /identity/v3/projects => generated 409 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:58:59.466865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff329ae-2bec-48ce-b798-1572eccf4f97 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:59.480338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff329ae-2bec-48ce-b798-1572eccf4f97 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:59.625886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36152a4-0ac4-4d78-af3c-487de6503347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:59.627361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36152a4-0ac4-4d78-af3c-487de6503347 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:59.630714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36152a4-0ac4-4d78-af3c-487de6503347 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:59.631335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36152a4-0ac4-4d78-af3c-487de6503347 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:59.632689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36152a4-0ac4-4d78-af3c-487de6503347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:59.634980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36152a4-0ac4-4d78-af3c-487de6503347 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:59.737576 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3686/7427] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:58:59 2022] POST /identity/v3/users => generated 305 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:58:59.741630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c278983-6c9f-4ab3-8ff3-a741b4e52a10 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:59.772783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c278983-6c9f-4ab3-8ff3-a741b4e52a10 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:59.785833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812d910-ad0e-41b4-9f9b-90e698e34453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:59.786474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812d910-ad0e-41b4-9f9b-90e698e34453 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:59.786756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812d910-ad0e-41b4-9f9b-90e698e34453 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:59.787033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812d910-ad0e-41b4-9f9b-90e698e34453 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:59.787692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812d910-ad0e-41b4-9f9b-90e698e34453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:59.791058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812d910-ad0e-41b4-9f9b-90e698e34453 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:59.822998 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3742/7428] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:59.827314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36152a4-0ac4-4d78-af3c-487de6503347 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:59.846775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36152a4-0ac4-4d78-af3c-487de6503347 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:59.860239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2a920-f395-4328-bd3a-2ff99686c35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:59.860818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2a920-f395-4328-bd3a-2ff99686c35e admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:59.861097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2a920-f395-4328-bd3a-2ff99686c35e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:59.861571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2a920-f395-4328-bd3a-2ff99686c35e admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:59.862939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2a920-f395-4328-bd3a-2ff99686c35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:59.876275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2a920-f395-4328-bd3a-2ff99686c35e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:58:59.901736 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3687/7429] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:58:59.902976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812d910-ad0e-41b4-9f9b-90e698e34453 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:58:59.923466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812d910-ad0e-41b4-9f9b-90e698e34453 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:58:59.929439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020cdbc-eb3c-475b-851b-f5b9f3c9cadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:58:59.930112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020cdbc-eb3c-475b-851b-f5b9f3c9cadd admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:58:59.930392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020cdbc-eb3c-475b-851b-f5b9f3c9cadd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:58:59.930679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020cdbc-eb3c-475b-851b-f5b9f3c9cadd admin admin] PATH_INFO: `/v3/projects/d31c0d9018c944de9a81ae6c078a52aa/users/cee2a54e6efb45cab81364d6f904e3dd/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:58:59.969713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020cdbc-eb3c-475b-851b-f5b9f3c9cadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31c0d9018c944de9a81ae6c078a52aa, user_id=cee2a54e6efb45cab81364d6f904e3dd, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:58:59.975750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020cdbc-eb3c-475b-851b-f5b9f3c9cadd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:00.088038 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3743/7430] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:58:59 2022] PUT /identity/v3/projects/d31c0d9018c944de9a81ae6c078a52aa/users/cee2a54e6efb45cab81364d6f904e3dd/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:59:00.102177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bf401-93b1-4504-8f52-445feb00f637 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:00.102462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bf401-93b1-4504-8f52-445feb00f637 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:00.102939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bf401-93b1-4504-8f52-445feb00f637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:00.205063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-548bf401-93b1-4504-8f52-445feb00f637 None None] MFA Rules not processed for user `cee2a54e6efb45cab81364d6f904e3dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:59:00.207720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-548bf401-93b1-4504-8f52-445feb00f637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:00.425783 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3688/7431] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:59:00 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:59:00.429197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020cdbc-eb3c-475b-851b-f5b9f3c9cadd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:00.603954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020cdbc-eb3c-475b-851b-f5b9f3c9cadd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:00.619399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d43ec4-c2f5-4545-9221-e749bd7689c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:00.620353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d43ec4-c2f5-4545-9221-e749bd7689c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:00.620976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d43ec4-c2f5-4545-9221-e749bd7689c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:00.622177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d43ec4-c2f5-4545-9221-e749bd7689c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:00.625099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d43ec4-c2f5-4545-9221-e749bd7689c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:00.629133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d43ec4-c2f5-4545-9221-e749bd7689c6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:00.782251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bf401-93b1-4504-8f52-445feb00f637 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:00.782467 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3744/7432] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:59:00 2022] POST /identity/v3/projects => generated 407 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:59:00.806077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bf401-93b1-4504-8f52-445feb00f637 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:00.977122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c4997-f468-461d-be4f-a81316791d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:00.977786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c4997-f468-461d-be4f-a81316791d31 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:00.978045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c4997-f468-461d-be4f-a81316791d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:00.978322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c4997-f468-461d-be4f-a81316791d31 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:00.979003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c4997-f468-461d-be4f-a81316791d31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:00.981027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c4997-f468-461d-be4f-a81316791d31 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:01.482285 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3689/7433] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:59:00 2022] POST /identity/v3/users => generated 310 bytes in 701 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:59:01.489007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d43ec4-c2f5-4545-9221-e749bd7689c6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:01.510176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d43ec4-c2f5-4545-9221-e749bd7689c6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:01.524968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9aaef-c2d2-4a39-a372-5009e9075f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:01.526283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9aaef-c2d2-4a39-a372-5009e9075f55 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:01.526581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9aaef-c2d2-4a39-a372-5009e9075f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:01.526865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9aaef-c2d2-4a39-a372-5009e9075f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:01.529665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9aaef-c2d2-4a39-a372-5009e9075f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:01.534309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9aaef-c2d2-4a39-a372-5009e9075f55 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:01.572570 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3745/7434] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:59:01.575426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c4997-f468-461d-be4f-a81316791d31 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:01.596997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c4997-f468-461d-be4f-a81316791d31 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:01.614840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197bdfd-e3a8-43ef-8eb9-c039a7a29006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:01.616999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197bdfd-e3a8-43ef-8eb9-c039a7a29006 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:01.617410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197bdfd-e3a8-43ef-8eb9-c039a7a29006 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:01.617696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197bdfd-e3a8-43ef-8eb9-c039a7a29006 admin admin] PATH_INFO: `/v3/projects/66ce3b3c6d464de096ba3c684e7665e5/users/e03872861b274dcc9807a138bbef323d/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:01.677874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197bdfd-e3a8-43ef-8eb9-c039a7a29006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ce3b3c6d464de096ba3c684e7665e5, user_id=e03872861b274dcc9807a138bbef323d, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:01.687816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197bdfd-e3a8-43ef-8eb9-c039a7a29006 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:01.800019 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3690/7435] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:59:01 2022] PUT /identity/v3/projects/66ce3b3c6d464de096ba3c684e7665e5/users/e03872861b274dcc9807a138bbef323d/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:59:01.804021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9aaef-c2d2-4a39-a372-5009e9075f55 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:01.818398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9aaef-c2d2-4a39-a372-5009e9075f55 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:01.979290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487715f1-e0ce-4a7e-b2d9-654a8ad4af29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:01.982209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487715f1-e0ce-4a7e-b2d9-654a8ad4af29 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:01.982563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487715f1-e0ce-4a7e-b2d9-654a8ad4af29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:01.984789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487715f1-e0ce-4a7e-b2d9-654a8ad4af29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:01.985581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487715f1-e0ce-4a7e-b2d9-654a8ad4af29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:01.990509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487715f1-e0ce-4a7e-b2d9-654a8ad4af29 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:02.011966 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3746/7436] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:59:02.013321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197bdfd-e3a8-43ef-8eb9-c039a7a29006 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:02.031544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197bdfd-e3a8-43ef-8eb9-c039a7a29006 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:02.062016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814092-7b1a-44e2-bc59-20d4c07ed16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:02.062881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814092-7b1a-44e2-bc59-20d4c07ed16a admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:02.063401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814092-7b1a-44e2-bc59-20d4c07ed16a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:02.063901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814092-7b1a-44e2-bc59-20d4c07ed16a admin admin] PATH_INFO: `/v3/projects/66ce3b3c6d464de096ba3c684e7665e5/users/e03872861b274dcc9807a138bbef323d/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:02.070885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58814092-7b1a-44e2-bc59-20d4c07ed16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ce3b3c6d464de096ba3c684e7665e5, user_id=e03872861b274dcc9807a138bbef323d, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:02.074250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58814092-7b1a-44e2-bc59-20d4c07ed16a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:02.115695 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3691/7437] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:59:02 2022] PUT /identity/v3/projects/66ce3b3c6d464de096ba3c684e7665e5/users/e03872861b274dcc9807a138bbef323d/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:59:02.117544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e155f7b-81d5-4b01-b08b-79b8256d2c05 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:02.117808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e155f7b-81d5-4b01-b08b-79b8256d2c05 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:02.118112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e155f7b-81d5-4b01-b08b-79b8256d2c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:02.194290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1e155f7b-81d5-4b01-b08b-79b8256d2c05 None None] MFA Rules not processed for user `e03872861b274dcc9807a138bbef323d`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:59:02.196909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1e155f7b-81d5-4b01-b08b-79b8256d2c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:02.216926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=83,keystone:INSERT=10,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:02.347745 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3747/7438] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:59:02 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:59:02.356371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814092-7b1a-44e2-bc59-20d4c07ed16a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:02.358780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-58814092-7b1a-44e2-bc59-20d4c07ed16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:02.367053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:02.477254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814092-7b1a-44e2-bc59-20d4c07ed16a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:02.490727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ec8eb-44c7-4340-b5d6-c49c5b23f822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:02.490727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ec8eb-44c7-4340-b5d6-c49c5b23f822 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:02.490727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ec8eb-44c7-4340-b5d6-c49c5b23f822 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:02.490727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ec8eb-44c7-4340-b5d6-c49c5b23f822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:02.524992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ec8eb-44c7-4340-b5d6-c49c5b23f822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:02.524992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ec8eb-44c7-4340-b5d6-c49c5b23f822 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:02.541807 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3692/7439] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:59:02 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:59:03.208511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e155f7b-81d5-4b01-b08b-79b8256d2c05 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:03.229389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e155f7b-81d5-4b01-b08b-79b8256d2c05 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:03.257466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847ea74-4d53-4c00-886d-31abc810f42c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:03.259793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847ea74-4d53-4c00-886d-31abc810f42c service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:03.260085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847ea74-4d53-4c00-886d-31abc810f42c service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:03.261159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847ea74-4d53-4c00-886d-31abc810f42c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:03.428323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847ea74-4d53-4c00-886d-31abc810f42c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:03.429789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847ea74-4d53-4c00-886d-31abc810f42c service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:03.446296 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3748/7440] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:59:03 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:59:04.423549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ec8eb-44c7-4340-b5d6-c49c5b23f822 service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:04.426200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-504ec8eb-44c7-4340-b5d6-c49c5b23f822 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:04.568832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ec8eb-44c7-4340-b5d6-c49c5b23f822 service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:04.592344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1876a-d952-4a4e-b5ef-216d6d199781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:04.592344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1876a-d952-4a4e-b5ef-216d6d199781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:04.592344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1876a-d952-4a4e-b5ef-216d6d199781 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:04.592344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1876a-d952-4a4e-b5ef-216d6d199781 admin admin] PATH_INFO: `/v3/users/bd2d533eb7da43f9b4924860a6c1b8e9` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:04.592786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1876a-d952-4a4e-b5ef-216d6d199781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2d533eb7da43f9b4924860a6c1b8e9)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:04.597291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1876a-d952-4a4e-b5ef-216d6d199781 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:06.125073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-46e1876a-d952-4a4e-b5ef-216d6d199781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2d533eb7da43f9b4924860a6c1b8e9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:06.334734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-46e1876a-d952-4a4e-b5ef-216d6d199781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2d533eb7da43f9b4924860a6c1b8e9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:06.335624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-46e1876a-d952-4a4e-b5ef-216d6d199781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2d533eb7da43f9b4924860a6c1b8e9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:06.349828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-46e1876a-d952-4a4e-b5ef-216d6d199781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2d533eb7da43f9b4924860a6c1b8e9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:06.395495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-46e1876a-d952-4a4e-b5ef-216d6d199781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2d533eb7da43f9b4924860a6c1b8e9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:06.433146 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3693/7441] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:59:04 2022] DELETE /identity/v3/users/bd2d533eb7da43f9b4924860a6c1b8e9 => generated 0 bytes in 2006 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:59:06.434237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c63068-654e-4cec-a46a-5738663d7ab6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:06.434710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c63068-654e-4cec-a46a-5738663d7ab6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:06.434844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c63068-654e-4cec-a46a-5738663d7ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:06.483973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-21c63068-654e-4cec-a46a-5738663d7ab6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:59:06.485332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-21c63068-654e-4cec-a46a-5738663d7ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:06.704584 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3749/7442] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:59:06.851961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1876a-d952-4a4e-b5ef-216d6d199781 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:06.851961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-46e1876a-d952-4a4e-b5ef-216d6d199781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:06.988193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1876a-d952-4a4e-b5ef-216d6d199781 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:07.003397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bbfe9-26e6-4f56-a27e-9a5649b44459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:07.005772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bbfe9-26e6-4f56-a27e-9a5649b44459 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:07.006059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bbfe9-26e6-4f56-a27e-9a5649b44459 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:07.007858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bbfe9-26e6-4f56-a27e-9a5649b44459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:07.050667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bbfe9-26e6-4f56-a27e-9a5649b44459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:07.054377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bbfe9-26e6-4f56-a27e-9a5649b44459 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:07.087562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:07.092142 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3694/7443] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:59:07.660612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:08.099298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:08.505814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c63068-654e-4cec-a46a-5738663d7ab6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:08.507401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-21c63068-654e-4cec-a46a-5738663d7ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:08.529246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c63068-654e-4cec-a46a-5738663d7ab6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:08.551466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d7289-c4a6-4420-96c1-cd370d847fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:08.552859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7289-c4a6-4420-96c1-cd370d847fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:08.553289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7289-c4a6-4420-96c1-cd370d847fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:08.553761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7289-c4a6-4420-96c1-cd370d847fe8 admin admin] PATH_INFO: `/v3/projects/a035ed243e0b4ff6a2bb61230ea5a08a` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:08.559999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d7289-c4a6-4420-96c1-cd370d847fe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a035ed243e0b4ff6a2bb61230ea5a08a)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:08.562507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d7289-c4a6-4420-96c1-cd370d847fe8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:08.766434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b79d7289-c4a6-4420-96c1-cd370d847fe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a035ed243e0b4ff6a2bb61230ea5a08a', 'request_id': 'req-b79d7289-c4a6-4420-96c1-cd370d847fe8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:08.777769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b79d7289-c4a6-4420-96c1-cd370d847fe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a035ed243e0b4ff6a2bb61230ea5a08a', 'request_id': 'req-b79d7289-c4a6-4420-96c1-cd370d847fe8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:08.840660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b79d7289-c4a6-4420-96c1-cd370d847fe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a035ed243e0b4ff6a2bb61230ea5a08a', 'request_id': 'req-b79d7289-c4a6-4420-96c1-cd370d847fe8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:08.865234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b79d7289-c4a6-4420-96c1-cd370d847fe8 admin admin] The token cache is being invalidate because project a035ed243e0b4ff6a2bb61230ea5a08a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:59:08.865392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b79d7289-c4a6-4420-96c1-cd370d847fe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:08.866372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b79d7289-c4a6-4420-96c1-cd370d847fe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:08.870196 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3750/7444] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:59:08 2022] DELETE /identity/v3/projects/a035ed243e0b4ff6a2bb61230ea5a08a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:59:08.875678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e0e64-3010-4229-afc9-163d352a87af None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:08.877880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e0e64-3010-4229-afc9-163d352a87af None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:08.877880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e0e64-3010-4229-afc9-163d352a87af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:08.915992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0c8e0e64-3010-4229-afc9-163d352a87af None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:59:08.919989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0c8e0e64-3010-4229-afc9-163d352a87af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:09.066283 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3695/7445] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:59:09.073854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486f630-5fca-4361-9e76-ca01e420e790 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:09.074628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486f630-5fca-4361-9e76-ca01e420e790 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:09.074628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486f630-5fca-4361-9e76-ca01e420e790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:09.113225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f486f630-5fca-4361-9e76-ca01e420e790 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:59:09.115864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f486f630-5fca-4361-9e76-ca01e420e790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:09.126570 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3751/7446] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:59:09.132468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e0e64-3010-4229-afc9-163d352a87af None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:09.147670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e0e64-3010-4229-afc9-163d352a87af None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:09.154361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bb4c9-c948-486b-85c2-36c5fc112142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:09.155474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bb4c9-c948-486b-85c2-36c5fc112142 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:09.155927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bb4c9-c948-486b-85c2-36c5fc112142 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:09.157386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bb4c9-c948-486b-85c2-36c5fc112142 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:09.159244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bb4c9-c948-486b-85c2-36c5fc112142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:59:09.159711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bb4c9-c948-486b-85c2-36c5fc112142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:09.162116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bb4c9-c948-486b-85c2-36c5fc112142 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:09.182550 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3696/7447] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:59:09.186726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486f630-5fca-4361-9e76-ca01e420e790 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:09.199629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486f630-5fca-4361-9e76-ca01e420e790 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:09.206592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb9b70-6d3a-45f1-b134-5db6aa7f45ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:09.207909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb9b70-6d3a-45f1-b134-5db6aa7f45ee admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:09.208461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb9b70-6d3a-45f1-b134-5db6aa7f45ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:09.208891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb9b70-6d3a-45f1-b134-5db6aa7f45ee admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:09.210027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb9b70-6d3a-45f1-b134-5db6aa7f45ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:09.212792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb9b70-6d3a-45f1-b134-5db6aa7f45ee admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:09.325390 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3752/7448] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:59:09 2022] POST /identity/v3/projects => generated 357 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:59:09.329391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bb4c9-c948-486b-85c2-36c5fc112142 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:09.350876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bb4c9-c948-486b-85c2-36c5fc112142 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:09.547350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb517aa5-43f6-4ef9-8ff6-89c65ed7a4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:09.547994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb517aa5-43f6-4ef9-8ff6-89c65ed7a4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:09.548319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb517aa5-43f6-4ef9-8ff6-89c65ed7a4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:09.548599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb517aa5-43f6-4ef9-8ff6-89c65ed7a4a7 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:09.551056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb517aa5-43f6-4ef9-8ff6-89c65ed7a4a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:09.556120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb517aa5-43f6-4ef9-8ff6-89c65ed7a4a7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:09.607238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:09.741924 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3697/7449] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:59:09 2022] POST /identity/v3/users => generated 279 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:59:09.747918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb9b70-6d3a-45f1-b134-5db6aa7f45ee admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:09.778968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb9b70-6d3a-45f1-b134-5db6aa7f45ee admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:09.797479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0ff56-dea4-4514-b202-a59ade97554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:09.798631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0ff56-dea4-4514-b202-a59ade97554e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:09.799457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0ff56-dea4-4514-b202-a59ade97554e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:09.800357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0ff56-dea4-4514-b202-a59ade97554e admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:09.803126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0ff56-dea4-4514-b202-a59ade97554e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:09.818900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0ff56-dea4-4514-b202-a59ade97554e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:09.839100 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3753/7450] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:59:09.843042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb517aa5-43f6-4ef9-8ff6-89c65ed7a4a7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:09.860401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:09.873040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb517aa5-43f6-4ef9-8ff6-89c65ed7a4a7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:09.893490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce99865-9159-46e0-bc2d-dc958fca0d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:09.894408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce99865-9159-46e0-bc2d-dc958fca0d15 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:09.894668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce99865-9159-46e0-bc2d-dc958fca0d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:09.895055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce99865-9159-46e0-bc2d-dc958fca0d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:09.896971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce99865-9159-46e0-bc2d-dc958fca0d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:09.899538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce99865-9159-46e0-bc2d-dc958fca0d15 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:09.946554 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3698/7451] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:59:09.950360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0ff56-dea4-4514-b202-a59ade97554e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:09.973707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0ff56-dea4-4514-b202-a59ade97554e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:09.989580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1b97e-c7f4-498b-8c80-c798cac3c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:09.990276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1b97e-c7f4-498b-8c80-c798cac3c967 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:09.990563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1b97e-c7f4-498b-8c80-c798cac3c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:09.990847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1b97e-c7f4-498b-8c80-c798cac3c967 admin admin] PATH_INFO: `/v3/projects/1d0109415e794b52b25a509d7b89f6ff/users/1ba95368e9964d7685547c0792a87d30/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:10.027664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1b97e-c7f4-498b-8c80-c798cac3c967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d0109415e794b52b25a509d7b89f6ff, user_id=1ba95368e9964d7685547c0792a87d30, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:10.037318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1b97e-c7f4-498b-8c80-c798cac3c967 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:10.162673 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3754/7452] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:59:09 2022] PUT /identity/v3/projects/1d0109415e794b52b25a509d7b89f6ff/users/1ba95368e9964d7685547c0792a87d30/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:59:10.172893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9931f-d623-49c9-b4c2-dd1916c0ac3d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:10.173185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9931f-d623-49c9-b4c2-dd1916c0ac3d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:10.173492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9931f-d623-49c9-b4c2-dd1916c0ac3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:10.271603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-38c9931f-d623-49c9-b4c2-dd1916c0ac3d None None] MFA Rules not processed for user `1ba95368e9964d7685547c0792a87d30`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:59:10.281155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-38c9931f-d623-49c9-b4c2-dd1916c0ac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:10.445683 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3699/7453] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:59:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:59:10.465523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1b97e-c7f4-498b-8c80-c798cac3c967 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:10.467912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-69f1b97e-c7f4-498b-8c80-c798cac3c967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:10.622200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1b97e-c7f4-498b-8c80-c798cac3c967 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:10.628518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557d810-7fbe-4693-a229-05832676e275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:10.629711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557d810-7fbe-4693-a229-05832676e275 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:10.630261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557d810-7fbe-4693-a229-05832676e275 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:10.630689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557d810-7fbe-4693-a229-05832676e275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:10.672031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557d810-7fbe-4693-a229-05832676e275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:10.675878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557d810-7fbe-4693-a229-05832676e275 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:10.696217 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3755/7454] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:59:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:59:11.635655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:11.945648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:12.864467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:13.606462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:15.023945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:15.262656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:16.950238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:17.162018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:17.901579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9931f-d623-49c9-b4c2-dd1916c0ac3d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:17.903763 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-38c9931f-d623-49c9-b4c2-dd1916c0ac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:18.051826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9931f-d623-49c9-b4c2-dd1916c0ac3d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:18.063099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725e844-7174-4f78-b205-5dfb653bf9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:18.069587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725e844-7174-4f78-b205-5dfb653bf9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:18.069587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725e844-7174-4f78-b205-5dfb653bf9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:18.069587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725e844-7174-4f78-b205-5dfb653bf9f9 admin admin] PATH_INFO: `/v3/users/71706d41af8b42289cd2f90d2ab50565` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:18.073288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725e844-7174-4f78-b205-5dfb653bf9f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71706d41af8b42289cd2f90d2ab50565)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:18.076728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725e844-7174-4f78-b205-5dfb653bf9f9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:18.393844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5725e844-7174-4f78-b205-5dfb653bf9f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71706d41af8b42289cd2f90d2ab50565'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:18.606185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5725e844-7174-4f78-b205-5dfb653bf9f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71706d41af8b42289cd2f90d2ab50565'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:18.606829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5725e844-7174-4f78-b205-5dfb653bf9f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71706d41af8b42289cd2f90d2ab50565'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:18.628557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5725e844-7174-4f78-b205-5dfb653bf9f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71706d41af8b42289cd2f90d2ab50565'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:18.671410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5725e844-7174-4f78-b205-5dfb653bf9f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71706d41af8b42289cd2f90d2ab50565'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:18.693147 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3700/7455] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:59:17 2022] DELETE /identity/v3/users/71706d41af8b42289cd2f90d2ab50565 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:59:18.694991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571822e2-53f4-4a3b-8755-d0da96abc1b2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:18.695407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571822e2-53f4-4a3b-8755-d0da96abc1b2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:18.695536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571822e2-53f4-4a3b-8755-d0da96abc1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:18.744125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-571822e2-53f4-4a3b-8755-d0da96abc1b2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:59:18.745682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-571822e2-53f4-4a3b-8755-d0da96abc1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:18.888654 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3756/7456] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:59:18.993728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725e844-7174-4f78-b205-5dfb653bf9f9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:18.995308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5725e844-7174-4f78-b205-5dfb653bf9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:19.006475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:19.171381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725e844-7174-4f78-b205-5dfb653bf9f9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:19.186843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67234f70-eb93-4ff9-928a-54fa9a8c042d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:19.206398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67234f70-eb93-4ff9-928a-54fa9a8c042d service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:19.206398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67234f70-eb93-4ff9-928a-54fa9a8c042d service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:19.206398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67234f70-eb93-4ff9-928a-54fa9a8c042d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:19.214857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67234f70-eb93-4ff9-928a-54fa9a8c042d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:19.219436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67234f70-eb93-4ff9-928a-54fa9a8c042d service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:19.264559 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3701/7457] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:59:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:59:19.481836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dec7d-55fc-485a-9e50-51bbb57dd66d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:19.482133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dec7d-55fc-485a-9e50-51bbb57dd66d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:19.482411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dec7d-55fc-485a-9e50-51bbb57dd66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:19.545231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d58dec7d-55fc-485a-9e50-51bbb57dd66d None None] MFA Rules not processed for user `1379ad15b8e949c8a687776f3b727465`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:59:19.546784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d58dec7d-55fc-485a-9e50-51bbb57dd66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:19.730588 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3757/7458] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:59:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:59:19.734916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67234f70-eb93-4ff9-928a-54fa9a8c042d service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:19.736072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-67234f70-eb93-4ff9-928a-54fa9a8c042d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:19.763658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67234f70-eb93-4ff9-928a-54fa9a8c042d service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:19.799562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5742d5a-83a3-4ba3-adb2-61f390bbc112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:19.800422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5742d5a-83a3-4ba3-adb2-61f390bbc112 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:19.800715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5742d5a-83a3-4ba3-adb2-61f390bbc112 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:19.800993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5742d5a-83a3-4ba3-adb2-61f390bbc112 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:19.801660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5742d5a-83a3-4ba3-adb2-61f390bbc112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:19.803789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5742d5a-83a3-4ba3-adb2-61f390bbc112 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:20.013677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:20.086330 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3702/7459] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:59:19 2022] POST /identity/v3/projects => generated 381 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:59:20.090638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dec7d-55fc-485a-9e50-51bbb57dd66d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:20.113533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dec7d-55fc-485a-9e50-51bbb57dd66d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:20.370642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430a32b-7879-40e9-b068-15a4d760671f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:20.371495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430a32b-7879-40e9-b068-15a4d760671f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:20.371982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430a32b-7879-40e9-b068-15a4d760671f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:20.372517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430a32b-7879-40e9-b068-15a4d760671f admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:20.373222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430a32b-7879-40e9-b068-15a4d760671f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:20.375170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430a32b-7879-40e9-b068-15a4d760671f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:20.534669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5742d5a-83a3-4ba3-adb2-61f390bbc112 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:20.535188 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3758/7460] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:59:20 2022] POST /identity/v3/users => generated 297 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:59:20.550411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5742d5a-83a3-4ba3-adb2-61f390bbc112 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:20.574655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e84f69-a585-4901-82d0-7eaa5db4384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:20.576029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e84f69-a585-4901-82d0-7eaa5db4384d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:20.576551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e84f69-a585-4901-82d0-7eaa5db4384d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:20.577920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e84f69-a585-4901-82d0-7eaa5db4384d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:20.579086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e84f69-a585-4901-82d0-7eaa5db4384d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:20.582584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e84f69-a585-4901-82d0-7eaa5db4384d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:20.610823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430a32b-7879-40e9-b068-15a4d760671f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:20.632188 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3703/7461] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:59:20.639143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430a32b-7879-40e9-b068-15a4d760671f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:20.649027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04720b49-4b43-4fbe-8474-959c7629e6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:20.649719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04720b49-4b43-4fbe-8474-959c7629e6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:20.650098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04720b49-4b43-4fbe-8474-959c7629e6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:20.650738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04720b49-4b43-4fbe-8474-959c7629e6c1 admin admin] PATH_INFO: `/v3/projects/1d1f106eac0645259391b87d7dfbbe56/users/7f96f5e446f14ae08a43153d69d3e7b8/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:20.683254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04720b49-4b43-4fbe-8474-959c7629e6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1f106eac0645259391b87d7dfbbe56, user_id=7f96f5e446f14ae08a43153d69d3e7b8, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:20.686414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04720b49-4b43-4fbe-8474-959c7629e6c1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:20.805649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e84f69-a585-4901-82d0-7eaa5db4384d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:20.809295 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3759/7462] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:59:20 2022] PUT /identity/v3/projects/1d1f106eac0645259391b87d7dfbbe56/users/7f96f5e446f14ae08a43153d69d3e7b8/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:59:20.840553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e84f69-a585-4901-82d0-7eaa5db4384d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:20.978137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04720b49-4b43-4fbe-8474-959c7629e6c1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:20.980514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-04720b49-4b43-4fbe-8474-959c7629e6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:21.133671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3d3a6-c53d-4434-81c8-ad764bea12b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:21.134587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3d3a6-c53d-4434-81c8-ad764bea12b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:21.138700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3d3a6-c53d-4434-81c8-ad764bea12b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:21.140760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3d3a6-c53d-4434-81c8-ad764bea12b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:21.143357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3d3a6-c53d-4434-81c8-ad764bea12b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:21.150634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3d3a6-c53d-4434-81c8-ad764bea12b6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:21.243604 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3704/7463] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:59:21.257293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3d3a6-c53d-4434-81c8-ad764bea12b6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:21.289955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3d3a6-c53d-4434-81c8-ad764bea12b6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:21.338462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367032a8-b360-4877-ba50-230b130b128f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:21.339972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367032a8-b360-4877-ba50-230b130b128f admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:21.340469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367032a8-b360-4877-ba50-230b130b128f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:21.340928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367032a8-b360-4877-ba50-230b130b128f admin admin] PATH_INFO: `/v3/projects/1d1f106eac0645259391b87d7dfbbe56/users/7f96f5e446f14ae08a43153d69d3e7b8/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:21.349390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367032a8-b360-4877-ba50-230b130b128f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1f106eac0645259391b87d7dfbbe56, user_id=7f96f5e446f14ae08a43153d69d3e7b8, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:21.363592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367032a8-b360-4877-ba50-230b130b128f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:21.379193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04720b49-4b43-4fbe-8474-959c7629e6c1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:21.412272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e93da-7f62-4ad5-bf1e-c2727fe86749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:21.414884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e93da-7f62-4ad5-bf1e-c2727fe86749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:21.417492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e93da-7f62-4ad5-bf1e-c2727fe86749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:21.419758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e93da-7f62-4ad5-bf1e-c2727fe86749 admin admin] PATH_INFO: `/v3/projects/be8944f580af495191f8edd06de8f901` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:21.419885 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3705/7464] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:59:21 2022] PUT /identity/v3/projects/1d1f106eac0645259391b87d7dfbbe56/users/7f96f5e446f14ae08a43153d69d3e7b8/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:59:21.437076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e93da-7f62-4ad5-bf1e-c2727fe86749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8944f580af495191f8edd06de8f901)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:21.443627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e93da-7f62-4ad5-bf1e-c2727fe86749 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:21.771503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0c7e93da-7f62-4ad5-bf1e-c2727fe86749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8944f580af495191f8edd06de8f901', 'request_id': 'req-0c7e93da-7f62-4ad5-bf1e-c2727fe86749'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:21.788401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0c7e93da-7f62-4ad5-bf1e-c2727fe86749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8944f580af495191f8edd06de8f901', 'request_id': 'req-0c7e93da-7f62-4ad5-bf1e-c2727fe86749'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:21.831580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:21.968854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:21.970872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0c7e93da-7f62-4ad5-bf1e-c2727fe86749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8944f580af495191f8edd06de8f901', 'request_id': 'req-0c7e93da-7f62-4ad5-bf1e-c2727fe86749'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:21.992864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0c7e93da-7f62-4ad5-bf1e-c2727fe86749 admin admin] The token cache is being invalidate because project be8944f580af495191f8edd06de8f901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:59:21.993689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0c7e93da-7f62-4ad5-bf1e-c2727fe86749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:21.994625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0c7e93da-7f62-4ad5-bf1e-c2727fe86749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:21.998218 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3760/7465] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:59:20 2022] DELETE /identity/v3/projects/be8944f580af495191f8edd06de8f901 => generated 0 bytes in 1021 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 04:59:22.003266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d7288-29b0-4705-82ab-1d4e7603b3d2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:22.003556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d7288-29b0-4705-82ab-1d4e7603b3d2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:22.003862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d7288-29b0-4705-82ab-1d4e7603b3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:22.061358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a62d7288-29b0-4705-82ab-1d4e7603b3d2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:59:22.063012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a62d7288-29b0-4705-82ab-1d4e7603b3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:22.309786 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3706/7466] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:59:22.406640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68caeb-d29f-4af1-8a0e-d595e7e1d978 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:22.406997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68caeb-d29f-4af1-8a0e-d595e7e1d978 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:22.407199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68caeb-d29f-4af1-8a0e-d595e7e1d978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:22.461863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-db68caeb-d29f-4af1-8a0e-d595e7e1d978 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:59:22.463164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-db68caeb-d29f-4af1-8a0e-d595e7e1d978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:22.483696 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3761/7467] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:59:22.487242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d7288-29b0-4705-82ab-1d4e7603b3d2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:22.500747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d7288-29b0-4705-82ab-1d4e7603b3d2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:22.523164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6880e-7340-48d2-a762-eeb8e61c551c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:22.524296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6880e-7340-48d2-a762-eeb8e61c551c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:22.525213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6880e-7340-48d2-a762-eeb8e61c551c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:22.525660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6880e-7340-48d2-a762-eeb8e61c551c admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:22.526497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6880e-7340-48d2-a762-eeb8e61c551c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:59:22.526966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6880e-7340-48d2-a762-eeb8e61c551c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:22.529110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6880e-7340-48d2-a762-eeb8e61c551c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:22.550456 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3707/7468] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:59:22.555867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68caeb-d29f-4af1-8a0e-d595e7e1d978 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:22.581203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68caeb-d29f-4af1-8a0e-d595e7e1d978 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:22.597407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7046c42-19b9-4716-8d44-7968746bc8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:22.598103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046c42-19b9-4716-8d44-7968746bc8ab admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:22.598384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046c42-19b9-4716-8d44-7968746bc8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:22.598714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046c42-19b9-4716-8d44-7968746bc8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:22.599451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7046c42-19b9-4716-8d44-7968746bc8ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:22.605852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7046c42-19b9-4716-8d44-7968746bc8ab admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:22.848135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6880e-7340-48d2-a762-eeb8e61c551c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:22.855077 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3762/7469] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:59:22 2022] POST /identity/v3/projects => generated 385 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:59:22.875255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6880e-7340-48d2-a762-eeb8e61c551c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:22.881291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:23.065948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2a225-5cc9-4aa7-8d8d-68bfc018aad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:23.066791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2a225-5cc9-4aa7-8d8d-68bfc018aad9 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:23.068507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2a225-5cc9-4aa7-8d8d-68bfc018aad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:23.068974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2a225-5cc9-4aa7-8d8d-68bfc018aad9 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:23.069794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2a225-5cc9-4aa7-8d8d-68bfc018aad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:23.071994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2a225-5cc9-4aa7-8d8d-68bfc018aad9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:23.219991 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3708/7470] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:59:22 2022] POST /identity/v3/users => generated 293 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:59:23.229981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7046c42-19b9-4716-8d44-7968746bc8ab admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:23.243083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7046c42-19b9-4716-8d44-7968746bc8ab admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:23.273736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e6f85-a658-4a6b-91a8-0443ea9c3cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:23.274344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e6f85-a658-4a6b-91a8-0443ea9c3cdb admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:23.274637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e6f85-a658-4a6b-91a8-0443ea9c3cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:23.274964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e6f85-a658-4a6b-91a8-0443ea9c3cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:23.277441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e6f85-a658-4a6b-91a8-0443ea9c3cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:23.286340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e6f85-a658-4a6b-91a8-0443ea9c3cdb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:23.325760 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3763/7471] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 04:59:23.330667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2a225-5cc9-4aa7-8d8d-68bfc018aad9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:23.347953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2a225-5cc9-4aa7-8d8d-68bfc018aad9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:23.366339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0adf1-9641-4943-aa9b-df26ee58429c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:23.367328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0adf1-9641-4943-aa9b-df26ee58429c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:23.367916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0adf1-9641-4943-aa9b-df26ee58429c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:23.368285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0adf1-9641-4943-aa9b-df26ee58429c admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:23.369014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0adf1-9641-4943-aa9b-df26ee58429c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:23.373728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0adf1-9641-4943-aa9b-df26ee58429c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:23.411439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e6f85-a658-4a6b-91a8-0443ea9c3cdb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:23.412267 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3709/7472] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:59:23.427155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e6f85-a658-4a6b-91a8-0443ea9c3cdb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:23.455468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f28c1-ef53-47d9-adcf-3d5a155fba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:23.456112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f28c1-ef53-47d9-adcf-3d5a155fba62 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:23.456533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f28c1-ef53-47d9-adcf-3d5a155fba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:23.456923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f28c1-ef53-47d9-adcf-3d5a155fba62 admin admin] PATH_INFO: `/v3/projects/ece4ceb7e1e4416b8e854e3475af4d0e/users/e150e612b3de4701993c07e2aad78d58/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:23.501968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f28c1-ef53-47d9-adcf-3d5a155fba62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece4ceb7e1e4416b8e854e3475af4d0e, user_id=e150e612b3de4701993c07e2aad78d58, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:23.514918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f28c1-ef53-47d9-adcf-3d5a155fba62 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:23.677228 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3764/7473] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:59:23 2022] PUT /identity/v3/projects/ece4ceb7e1e4416b8e854e3475af4d0e/users/e150e612b3de4701993c07e2aad78d58/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:59:23.687330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747e9cb-4716-401d-b22f-14e3faba0223 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:23.687616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747e9cb-4716-401d-b22f-14e3faba0223 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:23.688086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747e9cb-4716-401d-b22f-14e3faba0223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:23.807060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1747e9cb-4716-401d-b22f-14e3faba0223 None None] MFA Rules not processed for user `e150e612b3de4701993c07e2aad78d58`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:59:23.808503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1747e9cb-4716-401d-b22f-14e3faba0223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:23.924542 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3710/7474] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:59:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:59:23.978655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f28c1-ef53-47d9-adcf-3d5a155fba62 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:23.980891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-947f28c1-ef53-47d9-adcf-3d5a155fba62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:24.099851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f28c1-ef53-47d9-adcf-3d5a155fba62 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:24.126091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b9d46-d6ca-4eb4-b75b-a6b1f2f36ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:24.127007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b9d46-d6ca-4eb4-b75b-a6b1f2f36ced service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:24.127455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b9d46-d6ca-4eb4-b75b-a6b1f2f36ced service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:24.127905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b9d46-d6ca-4eb4-b75b-a6b1f2f36ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:24.163072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b9d46-d6ca-4eb4-b75b-a6b1f2f36ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:24.166534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b9d46-d6ca-4eb4-b75b-a6b1f2f36ced service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:24.210773 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3765/7475] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:59:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:59:24.258888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:24.311224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:25.195716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:25.717644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:26.333911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:26.795546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:27.401116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:28.007976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747e9cb-4716-401d-b22f-14e3faba0223 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:28.009689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1747e9cb-4716-401d-b22f-14e3faba0223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:28.105345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747e9cb-4716-401d-b22f-14e3faba0223 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:28.122499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22728714-ced1-431e-81dc-52bc69f93eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:28.123242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22728714-ced1-431e-81dc-52bc69f93eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:28.125090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22728714-ced1-431e-81dc-52bc69f93eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:28.125090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22728714-ced1-431e-81dc-52bc69f93eb6 admin admin] PATH_INFO: `/v3/users/cee2a54e6efb45cab81364d6f904e3dd` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:28.128403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22728714-ced1-431e-81dc-52bc69f93eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee2a54e6efb45cab81364d6f904e3dd)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:28.145168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22728714-ced1-431e-81dc-52bc69f93eb6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:28.413622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:28.525488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-22728714-ced1-431e-81dc-52bc69f93eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee2a54e6efb45cab81364d6f904e3dd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:28.663745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-22728714-ced1-431e-81dc-52bc69f93eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee2a54e6efb45cab81364d6f904e3dd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:28.665286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-22728714-ced1-431e-81dc-52bc69f93eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee2a54e6efb45cab81364d6f904e3dd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:28.676031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-22728714-ced1-431e-81dc-52bc69f93eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee2a54e6efb45cab81364d6f904e3dd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:28.722903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-22728714-ced1-431e-81dc-52bc69f93eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee2a54e6efb45cab81364d6f904e3dd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:28.741469 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3711/7476] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:59:28 2022] DELETE /identity/v3/users/cee2a54e6efb45cab81364d6f904e3dd => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:59:28.746068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad2c5c-deb6-410e-91ef-56245794df76 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:28.746402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad2c5c-deb6-410e-91ef-56245794df76 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:28.746710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad2c5c-deb6-410e-91ef-56245794df76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:28.834695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-43ad2c5c-deb6-410e-91ef-56245794df76 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:59:28.841775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-43ad2c5c-deb6-410e-91ef-56245794df76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:29.103774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:UPDATE=2,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:29.116147 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3766/7477] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:59:29.168338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22728714-ced1-431e-81dc-52bc69f93eb6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:29.170373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-22728714-ced1-431e-81dc-52bc69f93eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:29.320897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22728714-ced1-431e-81dc-52bc69f93eb6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:29.333790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894539a-8bcc-4457-8d1e-1be629ffba14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:29.338654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894539a-8bcc-4457-8d1e-1be629ffba14 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:29.339144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894539a-8bcc-4457-8d1e-1be629ffba14 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:29.340576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894539a-8bcc-4457-8d1e-1be629ffba14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:29.382665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894539a-8bcc-4457-8d1e-1be629ffba14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:29.384195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894539a-8bcc-4457-8d1e-1be629ffba14 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:29.439807 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3712/7478] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:59:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:59:31.762866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad2c5c-deb6-410e-91ef-56245794df76 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:31.764390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-43ad2c5c-deb6-410e-91ef-56245794df76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:31.800366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad2c5c-deb6-410e-91ef-56245794df76 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:31.815188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915a23e-192a-499a-a9a8-89b6dc244627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:31.815188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915a23e-192a-499a-a9a8-89b6dc244627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:31.815188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915a23e-192a-499a-a9a8-89b6dc244627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:31.815188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915a23e-192a-499a-a9a8-89b6dc244627 admin admin] PATH_INFO: `/v3/projects/d31c0d9018c944de9a81ae6c078a52aa` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:31.815788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915a23e-192a-499a-a9a8-89b6dc244627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31c0d9018c944de9a81ae6c078a52aa)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:31.815788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915a23e-192a-499a-a9a8-89b6dc244627 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:32.053185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:32.115024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3915a23e-192a-499a-a9a8-89b6dc244627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31c0d9018c944de9a81ae6c078a52aa', 'request_id': 'req-3915a23e-192a-499a-a9a8-89b6dc244627'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:32.132630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3915a23e-192a-499a-a9a8-89b6dc244627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31c0d9018c944de9a81ae6c078a52aa', 'request_id': 'req-3915a23e-192a-499a-a9a8-89b6dc244627'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:32.270753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3915a23e-192a-499a-a9a8-89b6dc244627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31c0d9018c944de9a81ae6c078a52aa', 'request_id': 'req-3915a23e-192a-499a-a9a8-89b6dc244627'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:32.301897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3915a23e-192a-499a-a9a8-89b6dc244627 admin admin] The token cache is being invalidate because project d31c0d9018c944de9a81ae6c078a52aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:59:32.302445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3915a23e-192a-499a-a9a8-89b6dc244627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:32.312068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3915a23e-192a-499a-a9a8-89b6dc244627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:32.332576 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3767/7479] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:59:31 2022] DELETE /identity/v3/projects/d31c0d9018c944de9a81ae6c078a52aa => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:59:32.336972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894539a-8bcc-4457-8d1e-1be629ffba14 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:32.380588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894539a-8bcc-4457-8d1e-1be629ffba14 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:32.473891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92656895-a9e3-4608-822b-ab38d3a88537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:32.474872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656895-a9e3-4608-822b-ab38d3a88537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:32.475326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656895-a9e3-4608-822b-ab38d3a88537 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:32.475773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656895-a9e3-4608-822b-ab38d3a88537 admin admin] PATH_INFO: `/v3/users/e03872861b274dcc9807a138bbef323d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:32.477334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92656895-a9e3-4608-822b-ab38d3a88537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e03872861b274dcc9807a138bbef323d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:32.479838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92656895-a9e3-4608-822b-ab38d3a88537 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:32.787986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-92656895-a9e3-4608-822b-ab38d3a88537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e03872861b274dcc9807a138bbef323d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:32.903143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-92656895-a9e3-4608-822b-ab38d3a88537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e03872861b274dcc9807a138bbef323d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:32.904894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-92656895-a9e3-4608-822b-ab38d3a88537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e03872861b274dcc9807a138bbef323d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:32.921358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-92656895-a9e3-4608-822b-ab38d3a88537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e03872861b274dcc9807a138bbef323d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:32.954881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-92656895-a9e3-4608-822b-ab38d3a88537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e03872861b274dcc9807a138bbef323d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:32.967626 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3713/7480] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:59:32 2022] DELETE /identity/v3/users/e03872861b274dcc9807a138bbef323d => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:59:33.075021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:34.585794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915a23e-192a-499a-a9a8-89b6dc244627 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:34.587238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3915a23e-192a-499a-a9a8-89b6dc244627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:34.651880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915a23e-192a-499a-a9a8-89b6dc244627 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:34.778046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1ee54-5833-4602-8ca1-0a40f4ad4d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:34.779371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ee54-5833-4602-8ca1-0a40f4ad4d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:34.779864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ee54-5833-4602-8ca1-0a40f4ad4d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:34.780456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ee54-5833-4602-8ca1-0a40f4ad4d70 admin admin] PATH_INFO: `/v3/projects/66ce3b3c6d464de096ba3c684e7665e5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:34.782025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1ee54-5833-4602-8ca1-0a40f4ad4d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ce3b3c6d464de096ba3c684e7665e5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:34.784916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1ee54-5833-4602-8ca1-0a40f4ad4d70 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:35.019373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:35.156498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1af1ee54-5833-4602-8ca1-0a40f4ad4d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ce3b3c6d464de096ba3c684e7665e5', 'request_id': 'req-1af1ee54-5833-4602-8ca1-0a40f4ad4d70'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:35.171938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1af1ee54-5833-4602-8ca1-0a40f4ad4d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ce3b3c6d464de096ba3c684e7665e5', 'request_id': 'req-1af1ee54-5833-4602-8ca1-0a40f4ad4d70'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:35.292950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1af1ee54-5833-4602-8ca1-0a40f4ad4d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ce3b3c6d464de096ba3c684e7665e5', 'request_id': 'req-1af1ee54-5833-4602-8ca1-0a40f4ad4d70'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:35.314996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1af1ee54-5833-4602-8ca1-0a40f4ad4d70 admin admin] The token cache is being invalidate because project 66ce3b3c6d464de096ba3c684e7665e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 04:59:35.316439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1af1ee54-5833-4602-8ca1-0a40f4ad4d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:35.320048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1af1ee54-5833-4602-8ca1-0a40f4ad4d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:35.323779 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3768/7481] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 04:59:34 2022] DELETE /identity/v3/projects/66ce3b3c6d464de096ba3c684e7665e5 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:59:35.328341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09340eb6-7bfa-46aa-885f-6cd8016b76e1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:35.329822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09340eb6-7bfa-46aa-885f-6cd8016b76e1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:35.330296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09340eb6-7bfa-46aa-885f-6cd8016b76e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:35.368696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-09340eb6-7bfa-46aa-885f-6cd8016b76e1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:59:35.370060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-09340eb6-7bfa-46aa-885f-6cd8016b76e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:35.502459 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3714/7482] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 04:59:35.507499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13757959-caba-446e-aac9-217bb0febd0f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:35.508306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13757959-caba-446e-aac9-217bb0febd0f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:35.508885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13757959-caba-446e-aac9-217bb0febd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:35.544026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-13757959-caba-446e-aac9-217bb0febd0f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:59:35.544907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-13757959-caba-446e-aac9-217bb0febd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:35.565160 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3769/7483] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:59:35.567067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09340eb6-7bfa-46aa-885f-6cd8016b76e1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:35.598005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09340eb6-7bfa-46aa-885f-6cd8016b76e1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:35.614901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095610e2-a9e8-422c-bd79-04ea3582758c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:35.618083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095610e2-a9e8-422c-bd79-04ea3582758c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:35.618083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095610e2-a9e8-422c-bd79-04ea3582758c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:35.618083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095610e2-a9e8-422c-bd79-04ea3582758c admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:35.618488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095610e2-a9e8-422c-bd79-04ea3582758c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 04:59:35.618774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095610e2-a9e8-422c-bd79-04ea3582758c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:35.621931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095610e2-a9e8-422c-bd79-04ea3582758c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:35.644146 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3715/7484] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 04:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 04:59:35.651292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13757959-caba-446e-aac9-217bb0febd0f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:35.666879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13757959-caba-446e-aac9-217bb0febd0f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:35.676267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f9baa-743d-4fd8-b19f-4682426bdbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:35.677805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f9baa-743d-4fd8-b19f-4682426bdbf6 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:35.678500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f9baa-743d-4fd8-b19f-4682426bdbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:35.678807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f9baa-743d-4fd8-b19f-4682426bdbf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:35.679538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f9baa-743d-4fd8-b19f-4682426bdbf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:35.681953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f9baa-743d-4fd8-b19f-4682426bdbf6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:35.901101 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3770/7485] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 04:59:35 2022] POST /identity/v3/projects => generated 375 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 04:59:35.905248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095610e2-a9e8-422c-bd79-04ea3582758c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:35.932520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095610e2-a9e8-422c-bd79-04ea3582758c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:36.087053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82a056-0e91-45e9-b917-5665a587fca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:36.087691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82a056-0e91-45e9-b917-5665a587fca3 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:36.087976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82a056-0e91-45e9-b917-5665a587fca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:36.088333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82a056-0e91-45e9-b917-5665a587fca3 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:36.089443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82a056-0e91-45e9-b917-5665a587fca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:36.093475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82a056-0e91-45e9-b917-5665a587fca3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:36.235876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:36.318386 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3716/7486] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 04:59:35 2022] POST /identity/v3/users => generated 288 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 04:59:36.322743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f9baa-743d-4fd8-b19f-4682426bdbf6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:36.344054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f9baa-743d-4fd8-b19f-4682426bdbf6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:36.348984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c941414-9a3f-403d-8c4b-577f047b9c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:36.350120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c941414-9a3f-403d-8c4b-577f047b9c86 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:36.350741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c941414-9a3f-403d-8c4b-577f047b9c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:36.351227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c941414-9a3f-403d-8c4b-577f047b9c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:36.352109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c941414-9a3f-403d-8c4b-577f047b9c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:36.353975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c941414-9a3f-403d-8c4b-577f047b9c86 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:36.369959 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3771/7487] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:59:36.374405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82a056-0e91-45e9-b917-5665a587fca3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:36.397022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82a056-0e91-45e9-b917-5665a587fca3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:36.408317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608555d-e7ce-4b9f-b7bc-ee3a7ef38da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:36.415760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608555d-e7ce-4b9f-b7bc-ee3a7ef38da9 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:36.416478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608555d-e7ce-4b9f-b7bc-ee3a7ef38da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:36.417651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608555d-e7ce-4b9f-b7bc-ee3a7ef38da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:36.419163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608555d-e7ce-4b9f-b7bc-ee3a7ef38da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:36.428759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608555d-e7ce-4b9f-b7bc-ee3a7ef38da9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:36.443580 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3717/7488] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 04:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 04:59:36.447511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c941414-9a3f-403d-8c4b-577f047b9c86 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:36.459858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c941414-9a3f-403d-8c4b-577f047b9c86 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:36.468044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe72d5-fc59-40a5-94bc-5717b059a9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:36.468044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe72d5-fc59-40a5-94bc-5717b059a9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:36.468044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe72d5-fc59-40a5-94bc-5717b059a9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:36.468700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe72d5-fc59-40a5-94bc-5717b059a9e8 admin admin] PATH_INFO: `/v3/projects/fc35a1b9e1fc4f2baff4b75ad8ba1e4b/users/042bedf8effd4f609998d714608d46e2/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:36.488960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe72d5-fc59-40a5-94bc-5717b059a9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc35a1b9e1fc4f2baff4b75ad8ba1e4b, user_id=042bedf8effd4f609998d714608d46e2, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:36.492711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe72d5-fc59-40a5-94bc-5717b059a9e8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:36.649166 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3772/7489] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 04:59:36 2022] PUT /identity/v3/projects/fc35a1b9e1fc4f2baff4b75ad8ba1e4b/users/042bedf8effd4f609998d714608d46e2/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:59:36.661463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f86114-f070-4c97-a408-a1a4363bc275 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:36.662024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f86114-f070-4c97-a408-a1a4363bc275 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:36.662495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f86114-f070-4c97-a408-a1a4363bc275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:36.726429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-54f86114-f070-4c97-a408-a1a4363bc275 None None] MFA Rules not processed for user `042bedf8effd4f609998d714608d46e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:59:36.728909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-54f86114-f070-4c97-a408-a1a4363bc275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:36.857555 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3718/7490] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:59:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:59:36.867023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe72d5-fc59-40a5-94bc-5717b059a9e8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:36.876789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-48fe72d5-fc59-40a5-94bc-5717b059a9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:36.940940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe72d5-fc59-40a5-94bc-5717b059a9e8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:36.950128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224d860-51c5-4fce-972f-6e57ecdc98f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:36.950128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224d860-51c5-4fce-972f-6e57ecdc98f8 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:36.950128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224d860-51c5-4fce-972f-6e57ecdc98f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:36.950128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224d860-51c5-4fce-972f-6e57ecdc98f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:36.957388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224d860-51c5-4fce-972f-6e57ecdc98f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:36.959365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224d860-51c5-4fce-972f-6e57ecdc98f8 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:36.983807 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3773/7491] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:59:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:59:38.538324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:40.498123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:UPDATE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:42.670166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7d4a6-53c8-4b0c-97af-5e1ae5b1ae95 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:42.673970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7d4a6-53c8-4b0c-97af-5e1ae5b1ae95 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:42.675180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7d4a6-53c8-4b0c-97af-5e1ae5b1ae95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:42.720512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f3a7d4a6-53c8-4b0c-97af-5e1ae5b1ae95 None None] MFA Rules not processed for user `7f96f5e446f14ae08a43153d69d3e7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:59:42.720512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f3a7d4a6-53c8-4b0c-97af-5e1ae5b1ae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:42.828368 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3719/7492] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:59:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:59:42.849132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224d860-51c5-4fce-972f-6e57ecdc98f8 service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:42.851661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2224d860-51c5-4fce-972f-6e57ecdc98f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:43.040598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224d860-51c5-4fce-972f-6e57ecdc98f8 service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:43.050673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967056c1-ea89-41d2-b25b-24433e4960b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:43.051503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967056c1-ea89-41d2-b25b-24433e4960b1 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:43.051890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967056c1-ea89-41d2-b25b-24433e4960b1 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:43.053183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967056c1-ea89-41d2-b25b-24433e4960b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:43.089089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967056c1-ea89-41d2-b25b-24433e4960b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:43.089089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967056c1-ea89-41d2-b25b-24433e4960b1 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:43.099512 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3774/7493] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:59:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 04:59:43.646852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:44.065511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7d4a6-53c8-4b0c-97af-5e1ae5b1ae95 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:44.068115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f3a7d4a6-53c8-4b0c-97af-5e1ae5b1ae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:44.295522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7d4a6-53c8-4b0c-97af-5e1ae5b1ae95 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:44.309771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72231f-52b0-4e43-9642-dcd0bf792ad5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:44.310418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72231f-52b0-4e43-9642-dcd0bf792ad5 service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:44.310889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72231f-52b0-4e43-9642-dcd0bf792ad5 service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:44.317249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72231f-52b0-4e43-9642-dcd0bf792ad5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:44.323127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0c72231f-52b0-4e43-9642-dcd0bf792ad5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:44.370991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72231f-52b0-4e43-9642-dcd0bf792ad5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:44.377014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72231f-52b0-4e43-9642-dcd0bf792ad5 service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:44.406492 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3720/7494] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:59:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:59:45.534842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967056c1-ea89-41d2-b25b-24433e4960b1 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:45.536389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-967056c1-ea89-41d2-b25b-24433e4960b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:45.561903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967056c1-ea89-41d2-b25b-24433e4960b1 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:45.589938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f8abe-5861-4064-84ab-e2cc0a3eee30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:45.592738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f8abe-5861-4064-84ab-e2cc0a3eee30 service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:45.593045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f8abe-5861-4064-84ab-e2cc0a3eee30 service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:45.599192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f8abe-5861-4064-84ab-e2cc0a3eee30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:45.610286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-786f8abe-5861-4064-84ab-e2cc0a3eee30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:45.678686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f8abe-5861-4064-84ab-e2cc0a3eee30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:45.681573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f8abe-5861-4064-84ab-e2cc0a3eee30 service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:45.723949 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3775/7495] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:59:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 04:59:47.132005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:47.977795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:49.183589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:52.761633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:53.760383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:55.925815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:INSERT=6,keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:57.394552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:58.785113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72231f-52b0-4e43-9642-dcd0bf792ad5 service placement] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:58.789061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0c72231f-52b0-4e43-9642-dcd0bf792ad5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:58.974439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72231f-52b0-4e43-9642-dcd0bf792ad5 service placement] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:58.986979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ae151-1f38-494a-95d3-fe94d89da464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:58.987926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae151-1f38-494a-95d3-fe94d89da464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:58.988442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae151-1f38-494a-95d3-fe94d89da464 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:58.988880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae151-1f38-494a-95d3-fe94d89da464 admin admin] PATH_INFO: `/v3/users/ec9dd9ef099b4171a91f295bdb110581` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:58.992755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ae151-1f38-494a-95d3-fe94d89da464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec9dd9ef099b4171a91f295bdb110581)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:58.994964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ae151-1f38-494a-95d3-fe94d89da464 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:59.288630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5f1ae151-1f38-494a-95d3-fe94d89da464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec9dd9ef099b4171a91f295bdb110581'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:59.377513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5f1ae151-1f38-494a-95d3-fe94d89da464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec9dd9ef099b4171a91f295bdb110581'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:59.378322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5f1ae151-1f38-494a-95d3-fe94d89da464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec9dd9ef099b4171a91f295bdb110581'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:59.389087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5f1ae151-1f38-494a-95d3-fe94d89da464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec9dd9ef099b4171a91f295bdb110581'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:59.462345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5f1ae151-1f38-494a-95d3-fe94d89da464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec9dd9ef099b4171a91f295bdb110581'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 04:59:59.475224 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3721/7496] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 04:59:58 2022] DELETE /identity/v3/users/ec9dd9ef099b4171a91f295bdb110581 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 04:59:59.479817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b952ff-edd8-4178-bb6f-151980bd2159 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:59.480337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b952ff-edd8-4178-bb6f-151980bd2159 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:59.480978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b952ff-edd8-4178-bb6f-151980bd2159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:59.538854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-32b952ff-edd8-4178-bb6f-151980bd2159 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 04:59:59.540424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-32b952ff-edd8-4178-bb6f-151980bd2159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:59.694057 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3776/7497] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 04:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 04:59:59.711598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ae151-1f38-494a-95d3-fe94d89da464 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 04:59:59.713221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5f1ae151-1f38-494a-95d3-fe94d89da464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 04:59:59.896809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ae151-1f38-494a-95d3-fe94d89da464 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 04:59:59.900862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0adad0-dd67-422c-bc7b-8c185bfa0dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 04:59:59.901845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0adad0-dd67-422c-bc7b-8c185bfa0dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 04:59:59.902221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0adad0-dd67-422c-bc7b-8c185bfa0dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 04:59:59.902563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0adad0-dd67-422c-bc7b-8c185bfa0dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 04:59:59.914067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0adad0-dd67-422c-bc7b-8c185bfa0dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 04:59:59.917866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0adad0-dd67-422c-bc7b-8c185bfa0dc5 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 04:59:59.927011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:59:59.933927 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3722/7498] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 04:59:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:00:00.430847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:00.690144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b952ff-edd8-4178-bb6f-151980bd2159 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:00.692441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-32b952ff-edd8-4178-bb6f-151980bd2159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:00.714007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b952ff-edd8-4178-bb6f-151980bd2159 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:00.726118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f420a-af6c-456b-98b3-6bb929d6e22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:00.728422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f420a-af6c-456b-98b3-6bb929d6e22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:00.728911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f420a-af6c-456b-98b3-6bb929d6e22f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:00.732728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f420a-af6c-456b-98b3-6bb929d6e22f admin admin] PATH_INFO: `/v3/projects/f97daadf5de74bd7bc5004505037c8e3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:00.735099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f420a-af6c-456b-98b3-6bb929d6e22f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97daadf5de74bd7bc5004505037c8e3)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:00.742229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f420a-af6c-456b-98b3-6bb929d6e22f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:00.897362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:00.968544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f13f420a-af6c-456b-98b3-6bb929d6e22f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97daadf5de74bd7bc5004505037c8e3', 'request_id': 'req-f13f420a-af6c-456b-98b3-6bb929d6e22f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:00.981685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f13f420a-af6c-456b-98b3-6bb929d6e22f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97daadf5de74bd7bc5004505037c8e3', 'request_id': 'req-f13f420a-af6c-456b-98b3-6bb929d6e22f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:01.108780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f13f420a-af6c-456b-98b3-6bb929d6e22f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97daadf5de74bd7bc5004505037c8e3', 'request_id': 'req-f13f420a-af6c-456b-98b3-6bb929d6e22f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:01.133808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f13f420a-af6c-456b-98b3-6bb929d6e22f admin admin] The token cache is being invalidate because project f97daadf5de74bd7bc5004505037c8e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:00:01.134398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f13f420a-af6c-456b-98b3-6bb929d6e22f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:01.135310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f13f420a-af6c-456b-98b3-6bb929d6e22f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:01.137071 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3777/7499] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:00:00 2022] DELETE /identity/v3/projects/f97daadf5de74bd7bc5004505037c8e3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:01.142844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227648c8-19de-47bb-a5e2-5d15d3bc90d7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:01.143369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227648c8-19de-47bb-a5e2-5d15d3bc90d7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:01.143919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227648c8-19de-47bb-a5e2-5d15d3bc90d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:01.188995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-227648c8-19de-47bb-a5e2-5d15d3bc90d7 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:01.191067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-227648c8-19de-47bb-a5e2-5d15d3bc90d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:01.355096 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3723/7500] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:01.364037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c510bb3-4a53-4e7b-b149-a44f4d0b43fd None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:01.364402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c510bb3-4a53-4e7b-b149-a44f4d0b43fd None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:01.364687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c510bb3-4a53-4e7b-b149-a44f4d0b43fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:01.405516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8c510bb3-4a53-4e7b-b149-a44f4d0b43fd None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:01.406888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8c510bb3-4a53-4e7b-b149-a44f4d0b43fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:01.434201 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3778/7501] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:01.438979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227648c8-19de-47bb-a5e2-5d15d3bc90d7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:01.466625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227648c8-19de-47bb-a5e2-5d15d3bc90d7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:01.478095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7786b4-0573-4212-a7c3-cd495b8d5ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:01.481813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7786b4-0573-4212-a7c3-cd495b8d5ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:01.482336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7786b4-0573-4212-a7c3-cd495b8d5ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:01.482779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7786b4-0573-4212-a7c3-cd495b8d5ae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:01.483633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7786b4-0573-4212-a7c3-cd495b8d5ae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:00:01.486331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7786b4-0573-4212-a7c3-cd495b8d5ae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:01.490774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7786b4-0573-4212-a7c3-cd495b8d5ae1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:01.522491 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3724/7502] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:00:01.526687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c510bb3-4a53-4e7b-b149-a44f4d0b43fd None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:01.546043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c510bb3-4a53-4e7b-b149-a44f4d0b43fd None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:01.558157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90607f5-679a-4710-8337-e20e780d0e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:01.559281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90607f5-679a-4710-8337-e20e780d0e19 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:01.559729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90607f5-679a-4710-8337-e20e780d0e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:01.560254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90607f5-679a-4710-8337-e20e780d0e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:01.561151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90607f5-679a-4710-8337-e20e780d0e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:01.569552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90607f5-679a-4710-8337-e20e780d0e19 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:01.764538 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3779/7503] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:00:01 2022] POST /identity/v3/projects => generated 381 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:00:01.770084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7786b4-0573-4212-a7c3-cd495b8d5ae1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:01.795880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7786b4-0573-4212-a7c3-cd495b8d5ae1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:01.970303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18278067-4c10-45f9-ac62-4ec214632a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:01.973822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278067-4c10-45f9-ac62-4ec214632a57 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:01.973822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278067-4c10-45f9-ac62-4ec214632a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:01.973822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278067-4c10-45f9-ac62-4ec214632a57 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:01.973822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18278067-4c10-45f9-ac62-4ec214632a57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:01.977928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18278067-4c10-45f9-ac62-4ec214632a57 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:02.146260 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3725/7504] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:00:01 2022] POST /identity/v3/users => generated 291 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:00:02.149387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90607f5-679a-4710-8337-e20e780d0e19 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:02.150981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18278067-4c10-45f9-ac62-4ec214632a57 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:02.151598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c90607f5-679a-4710-8337-e20e780d0e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:02.181913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90607f5-679a-4710-8337-e20e780d0e19 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:02.186277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18278067-4c10-45f9-ac62-4ec214632a57 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:02.220807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7ccb8-f0aa-4b77-a0d7-d87544abede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:02.220807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7ccb8-f0aa-4b77-a0d7-d87544abede6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:02.220807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7ccb8-f0aa-4b77-a0d7-d87544abede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:02.220807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7ccb8-f0aa-4b77-a0d7-d87544abede6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:02.221297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7ccb8-f0aa-4b77-a0d7-d87544abede6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:02.221392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f094c-378d-4e28-9187-109406462fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:02.221392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f094c-378d-4e28-9187-109406462fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:02.221392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f094c-378d-4e28-9187-109406462fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:02.221704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7ccb8-f0aa-4b77-a0d7-d87544abede6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:02.221808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f094c-378d-4e28-9187-109406462fe1 admin admin] PATH_INFO: `/v3/users/e150e612b3de4701993c07e2aad78d58` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:02.221808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f094c-378d-4e28-9187-109406462fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e150e612b3de4701993c07e2aad78d58)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:02.221808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f094c-378d-4e28-9187-109406462fe1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:02.242231 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3726/7505] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:00:02.243185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7ccb8-f0aa-4b77-a0d7-d87544abede6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:02.288789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7ccb8-f0aa-4b77-a0d7-d87544abede6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:02.307544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5440ae-e1d1-413b-84cf-111e3b80eb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:02.308728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5440ae-e1d1-413b-84cf-111e3b80eb12 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:02.309209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5440ae-e1d1-413b-84cf-111e3b80eb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:02.309722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5440ae-e1d1-413b-84cf-111e3b80eb12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:02.310585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5440ae-e1d1-413b-84cf-111e3b80eb12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:02.314223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5440ae-e1d1-413b-84cf-111e3b80eb12 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:02.331283 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3727/7506] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:00:02.338691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5440ae-e1d1-413b-84cf-111e3b80eb12 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:02.354073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5440ae-e1d1-413b-84cf-111e3b80eb12 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:02.369887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bd8d2-acfc-4bed-a0fb-8cdde60ca406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:02.387204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd8d2-acfc-4bed-a0fb-8cdde60ca406 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:02.387204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd8d2-acfc-4bed-a0fb-8cdde60ca406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:02.387204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd8d2-acfc-4bed-a0fb-8cdde60ca406 admin admin] PATH_INFO: `/v3/projects/5534f9ed0e23462aa06ec86aae10825f/users/139b3aa4329d470f96cd67ba4425f62a/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:02.391233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bd8d2-acfc-4bed-a0fb-8cdde60ca406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5534f9ed0e23462aa06ec86aae10825f, user_id=139b3aa4329d470f96cd67ba4425f62a, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:02.394505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bd8d2-acfc-4bed-a0fb-8cdde60ca406 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:02.555675 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3728/7507] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:00:02 2022] PUT /identity/v3/projects/5534f9ed0e23462aa06ec86aae10825f/users/139b3aa4329d470f96cd67ba4425f62a/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:02.568000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265ed82-9ae2-404d-ac6d-a74984cd19a0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:02.569556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265ed82-9ae2-404d-ac6d-a74984cd19a0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:02.570186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265ed82-9ae2-404d-ac6d-a74984cd19a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:02.638334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-409f094c-378d-4e28-9187-109406462fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e150e612b3de4701993c07e2aad78d58'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:02.642030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-409f094c-378d-4e28-9187-109406462fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e150e612b3de4701993c07e2aad78d58'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:02.674340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1265ed82-9ae2-404d-ac6d-a74984cd19a0 None None] MFA Rules not processed for user `139b3aa4329d470f96cd67ba4425f62a`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:02.676035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1265ed82-9ae2-404d-ac6d-a74984cd19a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:02.805274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-409f094c-378d-4e28-9187-109406462fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e150e612b3de4701993c07e2aad78d58'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:02.806445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-409f094c-378d-4e28-9187-109406462fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e150e612b3de4701993c07e2aad78d58'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:02.813520 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3729/7508] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:00:02.841860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-409f094c-378d-4e28-9187-109406462fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e150e612b3de4701993c07e2aad78d58'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:02.866581 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3780/7509] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:00:02 2022] DELETE /identity/v3/users/e150e612b3de4701993c07e2aad78d58 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:02.866806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265ed82-9ae2-404d-ac6d-a74984cd19a0 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:02.868425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1265ed82-9ae2-404d-ac6d-a74984cd19a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:02.875911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bc16c-1483-42d4-92fd-364904bd101b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:02.877522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bc16c-1483-42d4-92fd-364904bd101b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:02.877980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bc16c-1483-42d4-92fd-364904bd101b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:02.963481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e21bc16c-1483-42d4-92fd-364904bd101b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:02.969041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e21bc16c-1483-42d4-92fd-364904bd101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:03.081031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265ed82-9ae2-404d-ac6d-a74984cd19a0 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:03.168487 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3781/7510] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:03.201247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bc16c-1483-42d4-92fd-364904bd101b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:03.204411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e21bc16c-1483-42d4-92fd-364904bd101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:03.246863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:03.249270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486572a-1f52-4fb2-a423-fa599fbb54e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:03.252931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486572a-1f52-4fb2-a423-fa599fbb54e1 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:03.254954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486572a-1f52-4fb2-a423-fa599fbb54e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:03.255346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486572a-1f52-4fb2-a423-fa599fbb54e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:03.262075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b486572a-1f52-4fb2-a423-fa599fbb54e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:03.285446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bc16c-1483-42d4-92fd-364904bd101b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:03.291475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4c6e9-2672-4828-9d24-8ea96043113d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:03.296232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4c6e9-2672-4828-9d24-8ea96043113d service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:03.296232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4c6e9-2672-4828-9d24-8ea96043113d service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:03.296232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4c6e9-2672-4828-9d24-8ea96043113d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:03.306495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4c6e9-2672-4828-9d24-8ea96043113d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:03.309017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4c6e9-2672-4828-9d24-8ea96043113d service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:03.323052 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3782/7511] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:00:03.367593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486572a-1f52-4fb2-a423-fa599fbb54e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:03.369327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486572a-1f52-4fb2-a423-fa599fbb54e1 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:03.382931 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3730/7512] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:00:03.440266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:04.588771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:04.842529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:04.876716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4c6e9-2672-4828-9d24-8ea96043113d service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:04.879921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7fe4c6e9-2672-4828-9d24-8ea96043113d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:04.912080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4c6e9-2672-4828-9d24-8ea96043113d service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:04.922216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef04500-ef3a-45fb-88ea-6e83d03dc936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:04.923077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef04500-ef3a-45fb-88ea-6e83d03dc936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:04.923288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef04500-ef3a-45fb-88ea-6e83d03dc936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:04.923682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef04500-ef3a-45fb-88ea-6e83d03dc936 admin admin] PATH_INFO: `/v3/projects/ece4ceb7e1e4416b8e854e3475af4d0e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:04.924757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef04500-ef3a-45fb-88ea-6e83d03dc936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece4ceb7e1e4416b8e854e3475af4d0e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:04.926889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef04500-ef3a-45fb-88ea-6e83d03dc936 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:05.141995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ef04500-ef3a-45fb-88ea-6e83d03dc936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece4ceb7e1e4416b8e854e3475af4d0e', 'request_id': 'req-3ef04500-ef3a-45fb-88ea-6e83d03dc936'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:05.157776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ef04500-ef3a-45fb-88ea-6e83d03dc936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece4ceb7e1e4416b8e854e3475af4d0e', 'request_id': 'req-3ef04500-ef3a-45fb-88ea-6e83d03dc936'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:05.290482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ef04500-ef3a-45fb-88ea-6e83d03dc936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece4ceb7e1e4416b8e854e3475af4d0e', 'request_id': 'req-3ef04500-ef3a-45fb-88ea-6e83d03dc936'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:05.319578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ef04500-ef3a-45fb-88ea-6e83d03dc936 admin admin] The token cache is being invalidate because project ece4ceb7e1e4416b8e854e3475af4d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:00:05.321019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ef04500-ef3a-45fb-88ea-6e83d03dc936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:05.324844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ef04500-ef3a-45fb-88ea-6e83d03dc936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:05.328242 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3783/7513] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:00:04 2022] DELETE /identity/v3/projects/ece4ceb7e1e4416b8e854e3475af4d0e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:05.333519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a03dbf-7ce8-48c5-9faa-c8e53448982e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:05.334435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a03dbf-7ce8-48c5-9faa-c8e53448982e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:05.335310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a03dbf-7ce8-48c5-9faa-c8e53448982e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:05.386664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-70a03dbf-7ce8-48c5-9faa-c8e53448982e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:05.386664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-70a03dbf-7ce8-48c5-9faa-c8e53448982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:05.610882 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3731/7514] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:00:05.619197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa88c55-9e2d-42e6-8860-2279125e7a09 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:05.620261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa88c55-9e2d-42e6-8860-2279125e7a09 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:05.620755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa88c55-9e2d-42e6-8860-2279125e7a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:05.695397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-efa88c55-9e2d-42e6-8860-2279125e7a09 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:05.703520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-efa88c55-9e2d-42e6-8860-2279125e7a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:05.791888 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3784/7515] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:00:05.883405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a03dbf-7ce8-48c5-9faa-c8e53448982e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:05.898511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a03dbf-7ce8-48c5-9faa-c8e53448982e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:05.912974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71964713-8b8f-4e3c-9e05-9cde5ffff0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:05.913690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71964713-8b8f-4e3c-9e05-9cde5ffff0da admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:05.915091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71964713-8b8f-4e3c-9e05-9cde5ffff0da admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:05.916023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71964713-8b8f-4e3c-9e05-9cde5ffff0da admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:05.918166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71964713-8b8f-4e3c-9e05-9cde5ffff0da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:00:05.919712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71964713-8b8f-4e3c-9e05-9cde5ffff0da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:05.923739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71964713-8b8f-4e3c-9e05-9cde5ffff0da admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:05.964232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa88c55-9e2d-42e6-8860-2279125e7a09 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:05.975327 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3732/7516] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:00:05.980311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa88c55-9e2d-42e6-8860-2279125e7a09 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:05.998949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5b3db-8cb1-4e45-aeef-18122220514d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:06.000715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5b3db-8cb1-4e45-aeef-18122220514d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:06.001324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5b3db-8cb1-4e45-aeef-18122220514d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:06.001772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5b3db-8cb1-4e45-aeef-18122220514d admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:06.002636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5b3db-8cb1-4e45-aeef-18122220514d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:06.004951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5b3db-8cb1-4e45-aeef-18122220514d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:06.264471 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3785/7517] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:00:05 2022] POST /identity/v3/projects => generated 351 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:00:06.266668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71964713-8b8f-4e3c-9e05-9cde5ffff0da admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:06.300279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71964713-8b8f-4e3c-9e05-9cde5ffff0da admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:06.484659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110908a-be84-4964-a07c-34be1ff34874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:06.486744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110908a-be84-4964-a07c-34be1ff34874 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:06.490289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110908a-be84-4964-a07c-34be1ff34874 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:06.490745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110908a-be84-4964-a07c-34be1ff34874 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:06.493220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110908a-be84-4964-a07c-34be1ff34874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:06.498113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110908a-be84-4964-a07c-34be1ff34874 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:06.721650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5b3db-8cb1-4e45-aeef-18122220514d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:06.723469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cde5b3db-8cb1-4e45-aeef-18122220514d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:06.750596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5b3db-8cb1-4e45-aeef-18122220514d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:06.756380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c90703-3f46-43bf-a19f-463e3bed3dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:06.757438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c90703-3f46-43bf-a19f-463e3bed3dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:06.758458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c90703-3f46-43bf-a19f-463e3bed3dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:06.758997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c90703-3f46-43bf-a19f-463e3bed3dc4 admin admin] PATH_INFO: `/v3/users/1379ad15b8e949c8a687776f3b727465` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:06.762249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c90703-3f46-43bf-a19f-463e3bed3dc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1379ad15b8e949c8a687776f3b727465)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:06.766287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c90703-3f46-43bf-a19f-463e3bed3dc4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:06.782546 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3733/7518] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:00:06 2022] POST /identity/v3/users => generated 276 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:00:06.784017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110908a-be84-4964-a07c-34be1ff34874 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:06.803292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110908a-be84-4964-a07c-34be1ff34874 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:06.808598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e925c3f-e0db-4442-8121-cf3ec69391f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:06.810478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e925c3f-e0db-4442-8121-cf3ec69391f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:06.810982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e925c3f-e0db-4442-8121-cf3ec69391f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:06.811432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e925c3f-e0db-4442-8121-cf3ec69391f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:06.812615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e925c3f-e0db-4442-8121-cf3ec69391f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:06.820198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e925c3f-e0db-4442-8121-cf3ec69391f9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:06.847625 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3734/7519] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:00:06.856505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e925c3f-e0db-4442-8121-cf3ec69391f9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:06.868635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e925c3f-e0db-4442-8121-cf3ec69391f9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:06.875222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52e53f-53cf-461f-894d-523f6cdf3086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:06.876333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52e53f-53cf-461f-894d-523f6cdf3086 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:06.876789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52e53f-53cf-461f-894d-523f6cdf3086 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:06.877898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52e53f-53cf-461f-894d-523f6cdf3086 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:06.878740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52e53f-53cf-461f-894d-523f6cdf3086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:06.881194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52e53f-53cf-461f-894d-523f6cdf3086 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:06.894575 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3735/7520] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:00:06.901862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52e53f-53cf-461f-894d-523f6cdf3086 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:06.915173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52e53f-53cf-461f-894d-523f6cdf3086 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:06.921076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaf409-d5ea-478f-8022-7f554c6f26df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:06.922035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaf409-d5ea-478f-8022-7f554c6f26df admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:06.922572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaf409-d5ea-478f-8022-7f554c6f26df admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:06.923114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaf409-d5ea-478f-8022-7f554c6f26df admin admin] PATH_INFO: `/v3/projects/ecbf5d2e0a8b4fae8e5ad7b49dd40904/users/a0475e53fdca4379b76fa21c2dd20fba/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:06.949522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaf409-d5ea-478f-8022-7f554c6f26df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbf5d2e0a8b4fae8e5ad7b49dd40904, user_id=a0475e53fdca4379b76fa21c2dd20fba, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:06.954694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaf409-d5ea-478f-8022-7f554c6f26df admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:07.004016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-26c90703-3f46-43bf-a19f-463e3bed3dc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1379ad15b8e949c8a687776f3b727465'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:07.005162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-26c90703-3f46-43bf-a19f-463e3bed3dc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1379ad15b8e949c8a687776f3b727465'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:07.132552 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3736/7521] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:00:06 2022] PUT /identity/v3/projects/ecbf5d2e0a8b4fae8e5ad7b49dd40904/users/a0475e53fdca4379b76fa21c2dd20fba/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:07.153016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7472d70-b9bf-4bbf-8e4e-f1226c3e6785 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:07.154067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7472d70-b9bf-4bbf-8e4e-f1226c3e6785 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:07.154512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7472d70-b9bf-4bbf-8e4e-f1226c3e6785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:07.235215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-26c90703-3f46-43bf-a19f-463e3bed3dc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1379ad15b8e949c8a687776f3b727465'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:07.240820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-26c90703-3f46-43bf-a19f-463e3bed3dc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1379ad15b8e949c8a687776f3b727465'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:07.243655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e7472d70-b9bf-4bbf-8e4e-f1226c3e6785 None None] MFA Rules not processed for user `a0475e53fdca4379b76fa21c2dd20fba`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:07.245253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e7472d70-b9bf-4bbf-8e4e-f1226c3e6785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:07.267949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-26c90703-3f46-43bf-a19f-463e3bed3dc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1379ad15b8e949c8a687776f3b727465'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:07.292881 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3786/7522] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:00:06 2022] DELETE /identity/v3/users/1379ad15b8e949c8a687776f3b727465 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:00:07.422539 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3737/7523] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:07.445608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:07.472751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c90703-3f46-43bf-a19f-463e3bed3dc4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:07.474218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-26c90703-3f46-43bf-a19f-463e3bed3dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:07.520115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:07.590103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c90703-3f46-43bf-a19f-463e3bed3dc4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:07.599323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71ed15-2365-45a1-9aa5-ea675efe9b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:07.601953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71ed15-2365-45a1-9aa5-ea675efe9b09 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:07.603995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71ed15-2365-45a1-9aa5-ea675efe9b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:07.605295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71ed15-2365-45a1-9aa5-ea675efe9b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:07.767544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71ed15-2365-45a1-9aa5-ea675efe9b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:07.769940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71ed15-2365-45a1-9aa5-ea675efe9b09 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:07.788035 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3787/7524] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:00:08.136733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7472d70-b9bf-4bbf-8e4e-f1226c3e6785 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:08.139475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e7472d70-b9bf-4bbf-8e4e-f1226c3e6785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:08.289552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7472d70-b9bf-4bbf-8e4e-f1226c3e6785 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:08.438484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:08.439241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:08.439738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:08.446227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860 admin admin] PATH_INFO: `/v3/projects/f80531682f6947d585b6d95df180cd19` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:08.446227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80531682f6947d585b6d95df180cd19)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:08.446227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:08.744447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80531682f6947d585b6d95df180cd19', 'request_id': 'req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:08.758238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80531682f6947d585b6d95df180cd19', 'request_id': 'req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:08.768283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80531682f6947d585b6d95df180cd19', 'request_id': 'req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:08.903339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860 admin admin] The token cache is being invalidate because project f80531682f6947d585b6d95df180cd19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:00:08.903944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:08.906419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:08.908810 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3738/7525] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:00:08 2022] DELETE /identity/v3/projects/f80531682f6947d585b6d95df180cd19 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:08.913322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71ed15-2365-45a1-9aa5-ea675efe9b09 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:08.929462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71ed15-2365-45a1-9aa5-ea675efe9b09 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:09.089289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef357f0-8fcb-40f9-ad7b-2232d4fd0286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:09.089289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef357f0-8fcb-40f9-ad7b-2232d4fd0286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:09.089289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef357f0-8fcb-40f9-ad7b-2232d4fd0286 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:09.089289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef357f0-8fcb-40f9-ad7b-2232d4fd0286 admin admin] PATH_INFO: `/v3/users/7f96f5e446f14ae08a43153d69d3e7b8` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:09.089726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef357f0-8fcb-40f9-ad7b-2232d4fd0286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f96f5e446f14ae08a43153d69d3e7b8)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:09.089888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef357f0-8fcb-40f9-ad7b-2232d4fd0286 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:09.588061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8ef357f0-8fcb-40f9-ad7b-2232d4fd0286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f96f5e446f14ae08a43153d69d3e7b8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:09.588874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8ef357f0-8fcb-40f9-ad7b-2232d4fd0286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f96f5e446f14ae08a43153d69d3e7b8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:09.739261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8ef357f0-8fcb-40f9-ad7b-2232d4fd0286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f96f5e446f14ae08a43153d69d3e7b8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:09.752950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8ef357f0-8fcb-40f9-ad7b-2232d4fd0286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f96f5e446f14ae08a43153d69d3e7b8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:09.761792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8ef357f0-8fcb-40f9-ad7b-2232d4fd0286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f96f5e446f14ae08a43153d69d3e7b8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:09.800205 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3788/7526] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:00:08 2022] DELETE /identity/v3/users/7f96f5e446f14ae08a43153d69d3e7b8 => generated 0 bytes in 884 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:10.509365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:10.512276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:10.554955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d36c4-3ec1-4ed5-b2a4-9ae0d08d9860 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:10.628034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:10.695797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315172a-fb76-4010-8a08-df4f38298d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:10.696666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315172a-fb76-4010-8a08-df4f38298d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:10.697049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315172a-fb76-4010-8a08-df4f38298d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:10.697424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315172a-fb76-4010-8a08-df4f38298d1b admin admin] PATH_INFO: `/v3/projects/1d1f106eac0645259391b87d7dfbbe56` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:10.698679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315172a-fb76-4010-8a08-df4f38298d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1f106eac0645259391b87d7dfbbe56)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:10.709211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315172a-fb76-4010-8a08-df4f38298d1b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:10.903097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d315172a-fb76-4010-8a08-df4f38298d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1f106eac0645259391b87d7dfbbe56', 'request_id': 'req-d315172a-fb76-4010-8a08-df4f38298d1b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:10.916733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d315172a-fb76-4010-8a08-df4f38298d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1f106eac0645259391b87d7dfbbe56', 'request_id': 'req-d315172a-fb76-4010-8a08-df4f38298d1b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:10.931938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d315172a-fb76-4010-8a08-df4f38298d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1f106eac0645259391b87d7dfbbe56', 'request_id': 'req-d315172a-fb76-4010-8a08-df4f38298d1b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:11.086463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d315172a-fb76-4010-8a08-df4f38298d1b admin admin] The token cache is being invalidate because project 1d1f106eac0645259391b87d7dfbbe56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:00:11.086892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d315172a-fb76-4010-8a08-df4f38298d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:11.088488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d315172a-fb76-4010-8a08-df4f38298d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:11.091410 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3739/7527] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:00:10 2022] DELETE /identity/v3/projects/1d1f106eac0645259391b87d7dfbbe56 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:11.098396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe80e7d-8cc0-47eb-9bbd-63f5e854fb73 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:11.098879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe80e7d-8cc0-47eb-9bbd-63f5e854fb73 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:11.099352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe80e7d-8cc0-47eb-9bbd-63f5e854fb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:11.131008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5fe80e7d-8cc0-47eb-9bbd-63f5e854fb73 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:11.133605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5fe80e7d-8cc0-47eb-9bbd-63f5e854fb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:11.290490 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3789/7528] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:11.299816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a64218-725c-43e5-a64f-9a3ce018cf68 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:11.300450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a64218-725c-43e5-a64f-9a3ce018cf68 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:11.306676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a64218-725c-43e5-a64f-9a3ce018cf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:11.331176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-62a64218-725c-43e5-a64f-9a3ce018cf68 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:11.332814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-62a64218-725c-43e5-a64f-9a3ce018cf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:11.347008 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3740/7529] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:11.347245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe80e7d-8cc0-47eb-9bbd-63f5e854fb73 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:11.359811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe80e7d-8cc0-47eb-9bbd-63f5e854fb73 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:11.366766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24637b-7550-40d6-989a-4ba6cb512973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:11.367498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24637b-7550-40d6-989a-4ba6cb512973 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:11.368475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24637b-7550-40d6-989a-4ba6cb512973 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:11.368830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24637b-7550-40d6-989a-4ba6cb512973 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:11.369576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24637b-7550-40d6-989a-4ba6cb512973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:00:11.370619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24637b-7550-40d6-989a-4ba6cb512973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:11.372373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24637b-7550-40d6-989a-4ba6cb512973 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:11.391967 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3790/7530] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:00:11.396768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a64218-725c-43e5-a64f-9a3ce018cf68 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:11.409794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a64218-725c-43e5-a64f-9a3ce018cf68 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:11.424837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a396b-3f23-4aac-8f57-1dcbcaab5840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:11.424837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a396b-3f23-4aac-8f57-1dcbcaab5840 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:11.424837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a396b-3f23-4aac-8f57-1dcbcaab5840 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:11.424837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a396b-3f23-4aac-8f57-1dcbcaab5840 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:11.428651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a396b-3f23-4aac-8f57-1dcbcaab5840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:11.432547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a396b-3f23-4aac-8f57-1dcbcaab5840 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:11.702105 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3741/7531] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:00:11 2022] POST /identity/v3/projects => generated 373 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:00:11.705587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24637b-7550-40d6-989a-4ba6cb512973 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:11.726278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24637b-7550-40d6-989a-4ba6cb512973 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:11.893084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:12.085069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92392bc9-fe5e-407d-8ffa-cb61ac6cc67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:12.087163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92392bc9-fe5e-407d-8ffa-cb61ac6cc67a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:12.087545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92392bc9-fe5e-407d-8ffa-cb61ac6cc67a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:12.090913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92392bc9-fe5e-407d-8ffa-cb61ac6cc67a admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:12.091891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92392bc9-fe5e-407d-8ffa-cb61ac6cc67a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:12.097308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92392bc9-fe5e-407d-8ffa-cb61ac6cc67a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:12.264393 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3791/7532] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:00:11 2022] POST /identity/v3/users => generated 287 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:00:12.269614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a396b-3f23-4aac-8f57-1dcbcaab5840 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:12.289224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a396b-3f23-4aac-8f57-1dcbcaab5840 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:12.305836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c85783-3873-4d34-8535-533529cc2136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:12.306762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c85783-3873-4d34-8535-533529cc2136 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:12.307218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c85783-3873-4d34-8535-533529cc2136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:12.307814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c85783-3873-4d34-8535-533529cc2136 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:12.308658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c85783-3873-4d34-8535-533529cc2136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:12.310491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c85783-3873-4d34-8535-533529cc2136 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:12.337347 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3742/7533] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:00:12.344136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92392bc9-fe5e-407d-8ffa-cb61ac6cc67a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:12.383757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92392bc9-fe5e-407d-8ffa-cb61ac6cc67a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:12.409237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874cc9-409b-4f0f-b0dd-b1ec1c7ab918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:12.411243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874cc9-409b-4f0f-b0dd-b1ec1c7ab918 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:12.412470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874cc9-409b-4f0f-b0dd-b1ec1c7ab918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:12.413983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874cc9-409b-4f0f-b0dd-b1ec1c7ab918 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:12.415415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47874cc9-409b-4f0f-b0dd-b1ec1c7ab918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:12.423368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47874cc9-409b-4f0f-b0dd-b1ec1c7ab918 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:12.454998 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3792/7534] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:00:12.457580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c85783-3873-4d34-8535-533529cc2136 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:12.473020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c85783-3873-4d34-8535-533529cc2136 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:12.482900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bb6f8-4e67-4e0f-92e3-18a2ee7ee1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:12.483778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bb6f8-4e67-4e0f-92e3-18a2ee7ee1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:12.484610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bb6f8-4e67-4e0f-92e3-18a2ee7ee1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:12.485002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bb6f8-4e67-4e0f-92e3-18a2ee7ee1f3 admin admin] PATH_INFO: `/v3/projects/41104bce1ef94aa4bbd703937a54d7e0/users/c9ecfdc3b09e4ea1b7b27867dd69c1ac/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:12.551247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874cc9-409b-4f0f-b0dd-b1ec1c7ab918 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:12.553718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-47874cc9-409b-4f0f-b0dd-b1ec1c7ab918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:12.569275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bb6f8-4e67-4e0f-92e3-18a2ee7ee1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41104bce1ef94aa4bbd703937a54d7e0, user_id=c9ecfdc3b09e4ea1b7b27867dd69c1ac, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:12.575247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874cc9-409b-4f0f-b0dd-b1ec1c7ab918 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:12.577091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bb6f8-4e67-4e0f-92e3-18a2ee7ee1f3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:12.592718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae3689-3f12-406d-8041-90fc02724a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:12.592718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae3689-3f12-406d-8041-90fc02724a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:12.592943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae3689-3f12-406d-8041-90fc02724a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:12.593274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae3689-3f12-406d-8041-90fc02724a9b admin admin] PATH_INFO: `/v3/users/042bedf8effd4f609998d714608d46e2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:12.594835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae3689-3f12-406d-8041-90fc02724a9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=042bedf8effd4f609998d714608d46e2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:12.597723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae3689-3f12-406d-8041-90fc02724a9b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:12.768356 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3743/7535] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:00:12 2022] PUT /identity/v3/projects/41104bce1ef94aa4bbd703937a54d7e0/users/c9ecfdc3b09e4ea1b7b27867dd69c1ac/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:12.773555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533a0ff-5056-4052-a660-e4a003da344f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:12.774107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533a0ff-5056-4052-a660-e4a003da344f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:12.774667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533a0ff-5056-4052-a660-e4a003da344f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:12.844223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f533a0ff-5056-4052-a660-e4a003da344f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:12.845715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f533a0ff-5056-4052-a660-e4a003da344f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:13.111549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-38ae3689-3f12-406d-8041-90fc02724a9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042bedf8effd4f609998d714608d46e2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:13.117968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-38ae3689-3f12-406d-8041-90fc02724a9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042bedf8effd4f609998d714608d46e2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:13.122373 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3744/7536] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:00:13.156356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533a0ff-5056-4052-a660-e4a003da344f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:13.157969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f533a0ff-5056-4052-a660-e4a003da344f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:13.237688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-38ae3689-3f12-406d-8041-90fc02724a9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042bedf8effd4f609998d714608d46e2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:13.239232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-38ae3689-3f12-406d-8041-90fc02724a9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042bedf8effd4f609998d714608d46e2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:13.352485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-38ae3689-3f12-406d-8041-90fc02724a9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042bedf8effd4f609998d714608d46e2'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:13.440258 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3793/7537] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:00:12 2022] DELETE /identity/v3/users/042bedf8effd4f609998d714608d46e2 => generated 0 bytes in 890 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:13.448250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d905543-d795-4790-a46e-0a66e96d0cf2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:13.452670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d905543-d795-4790-a46e-0a66e96d0cf2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:13.453125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d905543-d795-4790-a46e-0a66e96d0cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:13.525597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5d905543-d795-4790-a46e-0a66e96d0cf2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:13.528287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5d905543-d795-4790-a46e-0a66e96d0cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:13.529946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533a0ff-5056-4052-a660-e4a003da344f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:13.715129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dec19-97f1-4963-9f4d-a73531cbb749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:13.716030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dec19-97f1-4963-9f4d-a73531cbb749 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:13.717718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dec19-97f1-4963-9f4d-a73531cbb749 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:13.717718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dec19-97f1-4963-9f4d-a73531cbb749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:13.720408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-118dec19-97f1-4963-9f4d-a73531cbb749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:13.763291 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3794/7538] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:13.839349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d905543-d795-4790-a46e-0a66e96d0cf2 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:13.855180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5d905543-d795-4790-a46e-0a66e96d0cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:13.872795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d905543-d795-4790-a46e-0a66e96d0cf2 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:13.878105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da1cf0-0b8a-4764-8452-1836f4e27f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:13.879040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da1cf0-0b8a-4764-8452-1836f4e27f15 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:13.885206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da1cf0-0b8a-4764-8452-1836f4e27f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:13.885826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da1cf0-0b8a-4764-8452-1836f4e27f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:13.903081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da1cf0-0b8a-4764-8452-1836f4e27f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:13.906892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dec19-97f1-4963-9f4d-a73531cbb749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:13.908769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da1cf0-0b8a-4764-8452-1836f4e27f15 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:13.914040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dec19-97f1-4963-9f4d-a73531cbb749 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:13.940770 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3795/7539] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:00:13.959137 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3745/7540] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 804 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:00:14.227788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:14.954850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:16.017331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:16.501465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da1cf0-0b8a-4764-8452-1836f4e27f15 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:16.502964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a3da1cf0-0b8a-4764-8452-1836f4e27f15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:16.538103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da1cf0-0b8a-4764-8452-1836f4e27f15 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:16.547323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e52f91-642f-4731-95a4-be2e28a07b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:16.548961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e52f91-642f-4731-95a4-be2e28a07b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:16.551206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e52f91-642f-4731-95a4-be2e28a07b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:16.555035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e52f91-642f-4731-95a4-be2e28a07b70 admin admin] PATH_INFO: `/v3/projects/fc35a1b9e1fc4f2baff4b75ad8ba1e4b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:16.556605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e52f91-642f-4731-95a4-be2e28a07b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc35a1b9e1fc4f2baff4b75ad8ba1e4b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:16.563420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e52f91-642f-4731-95a4-be2e28a07b70 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:16.594101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dec19-97f1-4963-9f4d-a73531cbb749 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:16.595573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-118dec19-97f1-4963-9f4d-a73531cbb749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:16.618878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dec19-97f1-4963-9f4d-a73531cbb749 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:16.675330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3699dc-ae3c-472a-ac10-8688385e9ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:16.678452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3699dc-ae3c-472a-ac10-8688385e9ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:16.680459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3699dc-ae3c-472a-ac10-8688385e9ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:16.684701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3699dc-ae3c-472a-ac10-8688385e9ee6 admin admin] PATH_INFO: `/v3/users/a0475e53fdca4379b76fa21c2dd20fba` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:16.695318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3699dc-ae3c-472a-ac10-8688385e9ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0475e53fdca4379b76fa21c2dd20fba)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:16.698429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3699dc-ae3c-472a-ac10-8688385e9ee6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:16.846442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6e52f91-642f-4731-95a4-be2e28a07b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc35a1b9e1fc4f2baff4b75ad8ba1e4b', 'request_id': 'req-b6e52f91-642f-4731-95a4-be2e28a07b70'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:16.868265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6e52f91-642f-4731-95a4-be2e28a07b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc35a1b9e1fc4f2baff4b75ad8ba1e4b', 'request_id': 'req-b6e52f91-642f-4731-95a4-be2e28a07b70'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:17.065118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6e52f91-642f-4731-95a4-be2e28a07b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc35a1b9e1fc4f2baff4b75ad8ba1e4b', 'request_id': 'req-b6e52f91-642f-4731-95a4-be2e28a07b70'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:17.104760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6e52f91-642f-4731-95a4-be2e28a07b70 admin admin] The token cache is being invalidate because project fc35a1b9e1fc4f2baff4b75ad8ba1e4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:00:17.108687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6e52f91-642f-4731-95a4-be2e28a07b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:17.108687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6e52f91-642f-4731-95a4-be2e28a07b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:17.108687 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3796/7541] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:00:16 2022] DELETE /identity/v3/projects/fc35a1b9e1fc4f2baff4b75ad8ba1e4b => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:17.109818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e52f91-642f-4731-95a4-be2e28a07b70 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:17.113058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b6e52f91-642f-4731-95a4-be2e28a07b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:17.157626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea3699dc-ae3c-472a-ac10-8688385e9ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0475e53fdca4379b76fa21c2dd20fba'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:17.214541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e52f91-642f-4731-95a4-be2e28a07b70 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:17.219724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26171424-20ca-494a-b428-d26d3b77a35f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:17.220530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26171424-20ca-494a-b428-d26d3b77a35f service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:17.221182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26171424-20ca-494a-b428-d26d3b77a35f service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:17.221182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26171424-20ca-494a-b428-d26d3b77a35f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:17.223220 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-26171424-20ca-494a-b428-d26d3b77a35f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:17.285014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea3699dc-ae3c-472a-ac10-8688385e9ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0475e53fdca4379b76fa21c2dd20fba'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:17.286126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea3699dc-ae3c-472a-ac10-8688385e9ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0475e53fdca4379b76fa21c2dd20fba'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:17.293310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26171424-20ca-494a-b428-d26d3b77a35f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:17.295077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26171424-20ca-494a-b428-d26d3b77a35f service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:17.296368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea3699dc-ae3c-472a-ac10-8688385e9ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0475e53fdca4379b76fa21c2dd20fba'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:17.305948 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3797/7542] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:00:17.307223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23629f7a-40f3-4bca-b8bd-6bea613369a3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:17.307509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23629f7a-40f3-4bca-b8bd-6bea613369a3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:17.307785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23629f7a-40f3-4bca-b8bd-6bea613369a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:17.314856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea3699dc-ae3c-472a-ac10-8688385e9ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0475e53fdca4379b76fa21c2dd20fba'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:17.322603 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3746/7543] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:00:16 2022] DELETE /identity/v3/users/a0475e53fdca4379b76fa21c2dd20fba => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:17.335937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-23629f7a-40f3-4bca-b8bd-6bea613369a3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:17.337556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-23629f7a-40f3-4bca-b8bd-6bea613369a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:17.347233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3203e-7a0e-4790-86f8-29f648ce3aac None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:17.347787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3203e-7a0e-4790-86f8-29f648ce3aac None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:17.348378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3203e-7a0e-4790-86f8-29f648ce3aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:17.386941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-20f3203e-7a0e-4790-86f8-29f648ce3aac None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:17.388501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-20f3203e-7a0e-4790-86f8-29f648ce3aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:17.474991 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3798/7544] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:17.483379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613914a5-9a3e-4e2f-9e90-0c741f2b1c7d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:17.483893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613914a5-9a3e-4e2f-9e90-0c741f2b1c7d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:17.484191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613914a5-9a3e-4e2f-9e90-0c741f2b1c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:17.503790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:17.535614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-613914a5-9a3e-4e2f-9e90-0c741f2b1c7d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:17.537089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-613914a5-9a3e-4e2f-9e90-0c741f2b1c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:17.566939 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3799/7545] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:00:17.568892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613914a5-9a3e-4e2f-9e90-0c741f2b1c7d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:17.583586 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3747/7546] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:17.589606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613914a5-9a3e-4e2f-9e90-0c741f2b1c7d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:17.603252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850f4a9-2641-4b80-8dcf-11c20348fc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:17.603903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850f4a9-2641-4b80-8dcf-11c20348fc49 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:17.604198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850f4a9-2641-4b80-8dcf-11c20348fc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:17.604479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850f4a9-2641-4b80-8dcf-11c20348fc49 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:17.605748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850f4a9-2641-4b80-8dcf-11c20348fc49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:00:17.605748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850f4a9-2641-4b80-8dcf-11c20348fc49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:17.608060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850f4a9-2641-4b80-8dcf-11c20348fc49 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:17.671157 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3800/7547] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:00:17.675354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3203e-7a0e-4790-86f8-29f648ce3aac None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:17.683557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850f4a9-2641-4b80-8dcf-11c20348fc49 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:17.689666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a850f4a9-2641-4b80-8dcf-11c20348fc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:17.699790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3203e-7a0e-4790-86f8-29f648ce3aac None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:17.718926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7530c2-ace9-4ec3-9ce9-936396e7b0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:17.720679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7530c2-ace9-4ec3-9ce9-936396e7b0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:17.721601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7530c2-ace9-4ec3-9ce9-936396e7b0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:17.722343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7530c2-ace9-4ec3-9ce9-936396e7b0f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:17.723547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7530c2-ace9-4ec3-9ce9-936396e7b0f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:17.727217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7530c2-ace9-4ec3-9ce9-936396e7b0f0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:17.839782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850f4a9-2641-4b80-8dcf-11c20348fc49 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:17.856601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae620e8f-60c9-4a6f-9a71-832b37d10805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:17.857186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:17.857421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae620e8f-60c9-4a6f-9a71-832b37d10805 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:17.857940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae620e8f-60c9-4a6f-9a71-832b37d10805 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:17.859114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae620e8f-60c9-4a6f-9a71-832b37d10805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:17.895586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae620e8f-60c9-4a6f-9a71-832b37d10805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:17.901001 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3748/7548] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:00:17 2022] POST /identity/v3/projects => generated 393 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:00:17.901750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae620e8f-60c9-4a6f-9a71-832b37d10805 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:17.902669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7530c2-ace9-4ec3-9ce9-936396e7b0f0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:17.951539 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3801/7549] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:00:18.103895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7530c2-ace9-4ec3-9ce9-936396e7b0f0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:18.111760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994f6e-6b56-416f-a34e-a2eb670ad108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:18.112770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994f6e-6b56-416f-a34e-a2eb670ad108 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:18.113307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994f6e-6b56-416f-a34e-a2eb670ad108 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:18.113786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994f6e-6b56-416f-a34e-a2eb670ad108 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:18.114837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28994f6e-6b56-416f-a34e-a2eb670ad108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:18.117834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28994f6e-6b56-416f-a34e-a2eb670ad108 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:18.232008 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3749/7550] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:00:17 2022] POST /identity/v3/users => generated 297 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:00:18.234239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae620e8f-60c9-4a6f-9a71-832b37d10805 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:18.248400 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae620e8f-60c9-4a6f-9a71-832b37d10805 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:18.262567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd8d3f-80b3-4739-bb27-40a2a54e2c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:18.263343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd8d3f-80b3-4739-bb27-40a2a54e2c62 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:18.263718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd8d3f-80b3-4739-bb27-40a2a54e2c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:18.264093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd8d3f-80b3-4739-bb27-40a2a54e2c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:18.265301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd8d3f-80b3-4739-bb27-40a2a54e2c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:18.267303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd8d3f-80b3-4739-bb27-40a2a54e2c62 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:18.293656 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3802/7551] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:00:18.297452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994f6e-6b56-416f-a34e-a2eb670ad108 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:18.335977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994f6e-6b56-416f-a34e-a2eb670ad108 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:18.350729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d0794-8d90-48be-8c01-b5271744b7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:18.351359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d0794-8d90-48be-8c01-b5271744b7af admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:18.357492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d0794-8d90-48be-8c01-b5271744b7af admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:18.357850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d0794-8d90-48be-8c01-b5271744b7af admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:18.359147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d0794-8d90-48be-8c01-b5271744b7af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:18.371777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d0794-8d90-48be-8c01-b5271744b7af admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:18.396902 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3750/7552] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:00:18.399136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd8d3f-80b3-4739-bb27-40a2a54e2c62 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:18.416694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd8d3f-80b3-4739-bb27-40a2a54e2c62 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:18.434484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edc2e7-586f-49d0-8eb5-c1ea37a54b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:18.435515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc2e7-586f-49d0-8eb5-c1ea37a54b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:18.435904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc2e7-586f-49d0-8eb5-c1ea37a54b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:18.436354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc2e7-586f-49d0-8eb5-c1ea37a54b54 admin admin] PATH_INFO: `/v3/projects/acc20d3acbb8412595ec5e464a94b770/users/f93cfb60764b472798894864bd7ac895/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:18.457349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edc2e7-586f-49d0-8eb5-c1ea37a54b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc20d3acbb8412595ec5e464a94b770, user_id=f93cfb60764b472798894864bd7ac895, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:18.460988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edc2e7-586f-49d0-8eb5-c1ea37a54b54 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:18.641587 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3803/7553] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:00:18 2022] PUT /identity/v3/projects/acc20d3acbb8412595ec5e464a94b770/users/f93cfb60764b472798894864bd7ac895/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:00:18.658600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba45c7-bbe6-47dc-ab88-c6226857264e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:18.659119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba45c7-bbe6-47dc-ab88-c6226857264e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:18.659979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba45c7-bbe6-47dc-ab88-c6226857264e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:18.717330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-22ba45c7-bbe6-47dc-ab88-c6226857264e None None] MFA Rules not processed for user `f93cfb60764b472798894864bd7ac895`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:18.721145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-22ba45c7-bbe6-47dc-ab88-c6226857264e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:18.857962 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3751/7554] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:18.862920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edc2e7-586f-49d0-8eb5-c1ea37a54b54 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:19.100898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edc2e7-586f-49d0-8eb5-c1ea37a54b54 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:19.112795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125ee37-205d-47f1-9a47-917d050cee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:19.113889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125ee37-205d-47f1-9a47-917d050cee3c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:19.114390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125ee37-205d-47f1-9a47-917d050cee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:19.114889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125ee37-205d-47f1-9a47-917d050cee3c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:19.117475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125ee37-205d-47f1-9a47-917d050cee3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:19.121250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125ee37-205d-47f1-9a47-917d050cee3c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:19.251074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba45c7-bbe6-47dc-ab88-c6226857264e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:19.253174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-22ba45c7-bbe6-47dc-ab88-c6226857264e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:19.256564 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3804/7555] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:00:18 2022] POST /identity/v3/projects => generated 391 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:00:19.257672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125ee37-205d-47f1-9a47-917d050cee3c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:19.276602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba45c7-bbe6-47dc-ab88-c6226857264e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:19.332687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:19.390229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73881b-e672-4cde-b114-ff0e4d86a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:19.390972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73881b-e672-4cde-b114-ff0e4d86a66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:19.395016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73881b-e672-4cde-b114-ff0e4d86a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:19.395016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73881b-e672-4cde-b114-ff0e4d86a66b admin admin] PATH_INFO: `/v3/projects/ecbf5d2e0a8b4fae8e5ad7b49dd40904` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:19.396240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73881b-e672-4cde-b114-ff0e4d86a66b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbf5d2e0a8b4fae8e5ad7b49dd40904)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:19.404052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125ee37-205d-47f1-9a47-917d050cee3c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:19.405232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73881b-e672-4cde-b114-ff0e4d86a66b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:19.417381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3848d39-53f9-427e-b08e-b1a74cf97e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:19.418052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3848d39-53f9-427e-b08e-b1a74cf97e57 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:19.419172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3848d39-53f9-427e-b08e-b1a74cf97e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:19.419484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3848d39-53f9-427e-b08e-b1a74cf97e57 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:19.420242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3848d39-53f9-427e-b08e-b1a74cf97e57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:19.424772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3848d39-53f9-427e-b08e-b1a74cf97e57 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:19.538781 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3805/7556] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:00:19 2022] POST /identity/v3/users => generated 302 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:00:19.539644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3848d39-53f9-427e-b08e-b1a74cf97e57 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:19.561240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3848d39-53f9-427e-b08e-b1a74cf97e57 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:19.575937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0b444-1d4a-4bd8-87d6-ce0c2349253b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:19.578016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0b444-1d4a-4bd8-87d6-ce0c2349253b admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:19.583373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0b444-1d4a-4bd8-87d6-ce0c2349253b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:19.583373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0b444-1d4a-4bd8-87d6-ce0c2349253b admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:19.583373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0b444-1d4a-4bd8-87d6-ce0c2349253b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:19.583373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0b444-1d4a-4bd8-87d6-ce0c2349253b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:19.616363 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3806/7557] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:00:19.616933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0b444-1d4a-4bd8-87d6-ce0c2349253b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:19.636916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0b444-1d4a-4bd8-87d6-ce0c2349253b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:19.677503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:19.678029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-df73881b-e672-4cde-b114-ff0e4d86a66b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbf5d2e0a8b4fae8e5ad7b49dd40904', 'request_id': 'req-df73881b-e672-4cde-b114-ff0e4d86a66b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:19.737027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-df73881b-e672-4cde-b114-ff0e4d86a66b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbf5d2e0a8b4fae8e5ad7b49dd40904', 'request_id': 'req-df73881b-e672-4cde-b114-ff0e4d86a66b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:19.784434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-df73881b-e672-4cde-b114-ff0e4d86a66b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbf5d2e0a8b4fae8e5ad7b49dd40904', 'request_id': 'req-df73881b-e672-4cde-b114-ff0e4d86a66b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:19.875974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ae31c-7e26-437b-9355-8032ac7cc599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:19.876715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ae31c-7e26-437b-9355-8032ac7cc599 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:19.876998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ae31c-7e26-437b-9355-8032ac7cc599 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:19.877539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ae31c-7e26-437b-9355-8032ac7cc599 admin admin] PATH_INFO: `/v3/projects/9c5856282bd140b4a3eb230e7936e1eb/users/ab096298eba14dd0a810b3b39924446c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:19.901753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-df73881b-e672-4cde-b114-ff0e4d86a66b admin admin] The token cache is being invalidate because project ecbf5d2e0a8b4fae8e5ad7b49dd40904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:00:19.902134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-df73881b-e672-4cde-b114-ff0e4d86a66b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:19.906190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-df73881b-e672-4cde-b114-ff0e4d86a66b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:19.911679 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3752/7558] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:00:19 2022] DELETE /identity/v3/projects/ecbf5d2e0a8b4fae8e5ad7b49dd40904 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:19.917242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968a1c5-7607-40f2-a814-809a1bff3a58 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:19.917511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968a1c5-7607-40f2-a814-809a1bff3a58 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:19.917724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968a1c5-7607-40f2-a814-809a1bff3a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:19.964741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ae31c-7e26-437b-9355-8032ac7cc599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c5856282bd140b4a3eb230e7936e1eb, user_id=ab096298eba14dd0a810b3b39924446c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:19.970108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ae31c-7e26-437b-9355-8032ac7cc599 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:19.978329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c968a1c5-7607-40f2-a814-809a1bff3a58 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:19.981385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c968a1c5-7607-40f2-a814-809a1bff3a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:19.997314 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3753/7559] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:20.005734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13f685-cadb-45c5-97bb-4fca7fc1d0d4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:20.006159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13f685-cadb-45c5-97bb-4fca7fc1d0d4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:20.006449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13f685-cadb-45c5-97bb-4fca7fc1d0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:20.048417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2d13f685-cadb-45c5-97bb-4fca7fc1d0d4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:20.051753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2d13f685-cadb-45c5-97bb-4fca7fc1d0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:20.075295 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3807/7560] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:00:19 2022] PUT /identity/v3/projects/9c5856282bd140b4a3eb230e7936e1eb/users/ab096298eba14dd0a810b3b39924446c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:20.081074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ae31c-7e26-437b-9355-8032ac7cc599 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:20.084749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-be1ae31c-7e26-437b-9355-8032ac7cc599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:20.095524 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3754/7561] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:00:20.105636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13f685-cadb-45c5-97bb-4fca7fc1d0d4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:20.142195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13f685-cadb-45c5-97bb-4fca7fc1d0d4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:20.366471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ae31c-7e26-437b-9355-8032ac7cc599 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:20.373905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a351db4-e637-42eb-bc08-7156b8edb90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:20.375478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a351db4-e637-42eb-bc08-7156b8edb90e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:20.375867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a351db4-e637-42eb-bc08-7156b8edb90e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:20.376277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a351db4-e637-42eb-bc08-7156b8edb90e admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:20.382238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a351db4-e637-42eb-bc08-7156b8edb90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:20.391118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a351db4-e637-42eb-bc08-7156b8edb90e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:20.428602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc16fdb-e93f-4ba1-9a15-84ab5eca5fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:20.429988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc16fdb-e93f-4ba1-9a15-84ab5eca5fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:20.431566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc16fdb-e93f-4ba1-9a15-84ab5eca5fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:20.433067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc16fdb-e93f-4ba1-9a15-84ab5eca5fb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:20.434981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc16fdb-e93f-4ba1-9a15-84ab5eca5fb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:00:20.438414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc16fdb-e93f-4ba1-9a15-84ab5eca5fb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:20.443564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc16fdb-e93f-4ba1-9a15-84ab5eca5fb8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:20.475420 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3808/7562] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:00:20.476739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a351db4-e637-42eb-bc08-7156b8edb90e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:20.485763 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3755/7563] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:00:20.500890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc16fdb-e93f-4ba1-9a15-84ab5eca5fb8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:20.510589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc16fdb-e93f-4ba1-9a15-84ab5eca5fb8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:20.519162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:20.530321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b9ba5-45e2-411d-9682-5126490a8d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:20.537197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b9ba5-45e2-411d-9682-5126490a8d37 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:20.537197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b9ba5-45e2-411d-9682-5126490a8d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:20.537197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b9ba5-45e2-411d-9682-5126490a8d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:20.537197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b9ba5-45e2-411d-9682-5126490a8d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:20.543558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b9ba5-45e2-411d-9682-5126490a8d37 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:20.544194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a351db4-e637-42eb-bc08-7156b8edb90e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:20.560870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04377087-2028-424d-ae11-f3e37a0c1c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:20.562483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04377087-2028-424d-ae11-f3e37a0c1c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:20.562873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04377087-2028-424d-ae11-f3e37a0c1c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:20.563267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04377087-2028-424d-ae11-f3e37a0c1c8d admin admin] PATH_INFO: `/v3/projects/9c5856282bd140b4a3eb230e7936e1eb/users/ab096298eba14dd0a810b3b39924446c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:20.565353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04377087-2028-424d-ae11-f3e37a0c1c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c5856282bd140b4a3eb230e7936e1eb, user_id=ab096298eba14dd0a810b3b39924446c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:20.568081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04377087-2028-424d-ae11-f3e37a0c1c8d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:20.596981 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3809/7564] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:00:20 2022] PUT /identity/v3/projects/9c5856282bd140b4a3eb230e7936e1eb/users/ab096298eba14dd0a810b3b39924446c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:20.602343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8afc9-c851-46c2-ac7f-49d19d5fa127 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:20.602830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8afc9-c851-46c2-ac7f-49d19d5fa127 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:20.603106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8afc9-c851-46c2-ac7f-49d19d5fa127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:20.696528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-25a8afc9-c851-46c2-ac7f-49d19d5fa127 None None] MFA Rules not processed for user `ab096298eba14dd0a810b3b39924446c`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:20.701753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-25a8afc9-c851-46c2-ac7f-49d19d5fa127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:20.710416 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3756/7565] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:00:20 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:00:20.712951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b9ba5-45e2-411d-9682-5126490a8d37 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:20.871846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b9ba5-45e2-411d-9682-5126490a8d37 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:20.898554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b6551-a6f3-438a-b25e-2a131430dbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:20.904176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b6551-a6f3-438a-b25e-2a131430dbc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:20.904176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b6551-a6f3-438a-b25e-2a131430dbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:20.904176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b6551-a6f3-438a-b25e-2a131430dbc0 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:20.904176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b6551-a6f3-438a-b25e-2a131430dbc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:20.907487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b6551-a6f3-438a-b25e-2a131430dbc0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:20.930628 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3810/7566] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:20 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:20.977871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8afc9-c851-46c2-ac7f-49d19d5fa127 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:20.980694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-25a8afc9-c851-46c2-ac7f-49d19d5fa127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:21.056940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:21.100320 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3757/7567] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:00:20 2022] POST /identity/v3/users => generated 292 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:00:21.108811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b6551-a6f3-438a-b25e-2a131430dbc0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:21.156870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b6551-a6f3-438a-b25e-2a131430dbc0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:21.175837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523ad77-bc8a-4414-bc3b-4f3df61a505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:21.179806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523ad77-bc8a-4414-bc3b-4f3df61a505e admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:21.180674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523ad77-bc8a-4414-bc3b-4f3df61a505e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:21.181454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523ad77-bc8a-4414-bc3b-4f3df61a505e admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:21.182876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523ad77-bc8a-4414-bc3b-4f3df61a505e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:21.193312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523ad77-bc8a-4414-bc3b-4f3df61a505e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:21.240761 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3758/7568] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:00:21.246778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523ad77-bc8a-4414-bc3b-4f3df61a505e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:21.306536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8afc9-c851-46c2-ac7f-49d19d5fa127 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:21.317424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523ad77-bc8a-4414-bc3b-4f3df61a505e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:21.325671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbee868-f4aa-42d2-9daa-5a12dba9e7ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:21.330491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbee868-f4aa-42d2-9daa-5a12dba9e7ab service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:21.330969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbee868-f4aa-42d2-9daa-5a12dba9e7ab service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:21.331433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbee868-f4aa-42d2-9daa-5a12dba9e7ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:21.345387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21be77e-9464-426a-b4ce-bfc0e81e4e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:21.346512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21be77e-9464-426a-b4ce-bfc0e81e4e8d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:21.346635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cfbee868-f4aa-42d2-9daa-5a12dba9e7ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:21.347195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21be77e-9464-426a-b4ce-bfc0e81e4e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:21.347811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21be77e-9464-426a-b4ce-bfc0e81e4e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:21.349084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21be77e-9464-426a-b4ce-bfc0e81e4e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:21.368909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21be77e-9464-426a-b4ce-bfc0e81e4e8d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:21.424365 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3759/7569] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:00:21.426105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21be77e-9464-426a-b4ce-bfc0e81e4e8d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:21.472623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21be77e-9464-426a-b4ce-bfc0e81e4e8d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:21.508628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfffa3-bb21-4615-845c-9ead9f920c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:21.509845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfffa3-bb21-4615-845c-9ead9f920c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:21.510352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfffa3-bb21-4615-845c-9ead9f920c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:21.510881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfffa3-bb21-4615-845c-9ead9f920c72 admin admin] PATH_INFO: `/v3/projects/e5fbc696c2ad4069b2eb663a21db9df9/users/fc2968890df04280a717baf480f5ad91/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:21.600878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfffa3-bb21-4615-845c-9ead9f920c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5fbc696c2ad4069b2eb663a21db9df9, user_id=fc2968890df04280a717baf480f5ad91, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:21.619413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfffa3-bb21-4615-845c-9ead9f920c72 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:21.681018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbee868-f4aa-42d2-9daa-5a12dba9e7ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:21.684228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbee868-f4aa-42d2-9daa-5a12dba9e7ab service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:21.716138 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3811/7570] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:00:21.808264 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3760/7571] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:00:21 2022] PUT /identity/v3/projects/e5fbc696c2ad4069b2eb663a21db9df9/users/fc2968890df04280a717baf480f5ad91/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:21.823824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3901bf-bb9f-4138-9570-b3941ee723b8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:21.824697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3901bf-bb9f-4138-9570-b3941ee723b8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:21.825289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3901bf-bb9f-4138-9570-b3941ee723b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:21.940749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ac3901bf-bb9f-4138-9570-b3941ee723b8 None None] MFA Rules not processed for user `fc2968890df04280a717baf480f5ad91`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:21.948823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ac3901bf-bb9f-4138-9570-b3941ee723b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:22.388963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:22.583365 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3812/7572] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 762 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:22.588042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfffa3-bb21-4615-845c-9ead9f920c72 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:22.704233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:22.742558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfffa3-bb21-4615-845c-9ead9f920c72 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:22.755414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79fb10-bbd0-4307-80c4-279ca17b0cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:22.756612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79fb10-bbd0-4307-80c4-279ca17b0cee admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:22.758395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79fb10-bbd0-4307-80c4-279ca17b0cee admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:22.758779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79fb10-bbd0-4307-80c4-279ca17b0cee admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:22.760696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79fb10-bbd0-4307-80c4-279ca17b0cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:22.765615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79fb10-bbd0-4307-80c4-279ca17b0cee admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:22.929216 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3761/7573] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:00:22 2022] POST /identity/v3/projects => generated 383 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:00:22.940499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3901bf-bb9f-4138-9570-b3941ee723b8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:22.963860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3901bf-bb9f-4138-9570-b3941ee723b8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:23.068260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:23.093416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccc50e-b593-42b4-804f-442b1565e7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:23.094280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc50e-b593-42b4-804f-442b1565e7ef admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:23.094554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc50e-b593-42b4-804f-442b1565e7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:23.094821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc50e-b593-42b4-804f-442b1565e7ef admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:23.095460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccc50e-b593-42b4-804f-442b1565e7ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:23.097451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccc50e-b593-42b4-804f-442b1565e7ef admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:23.190322 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3813/7574] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:00:22 2022] POST /identity/v3/users => generated 298 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:00:23.197516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79fb10-bbd0-4307-80c4-279ca17b0cee admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:23.248368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79fb10-bbd0-4307-80c4-279ca17b0cee admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:23.284198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e57bb-724a-495b-9be9-05d119e5cbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:23.285241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e57bb-724a-495b-9be9-05d119e5cbcf admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:23.285674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e57bb-724a-495b-9be9-05d119e5cbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:23.286090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e57bb-724a-495b-9be9-05d119e5cbcf admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:23.287113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e57bb-724a-495b-9be9-05d119e5cbcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:23.308697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e57bb-724a-495b-9be9-05d119e5cbcf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:23.358773 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3762/7575] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:00:23.363064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccc50e-b593-42b4-804f-442b1565e7ef admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:23.394913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccc50e-b593-42b4-804f-442b1565e7ef admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:23.429049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b5bd0-946f-43bd-918f-9846e6128988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:23.431108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b5bd0-946f-43bd-918f-9846e6128988 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:23.431526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b5bd0-946f-43bd-918f-9846e6128988 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:23.433880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b5bd0-946f-43bd-918f-9846e6128988 admin admin] PATH_INFO: `/v3/projects/d8405c0099c8430caa2c3b456ec1d585/users/4ee2be8c3aed45cdb14f82fa1b04a699/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:23.481920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b5bd0-946f-43bd-918f-9846e6128988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8405c0099c8430caa2c3b456ec1d585, user_id=4ee2be8c3aed45cdb14f82fa1b04a699, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:23.488924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b5bd0-946f-43bd-918f-9846e6128988 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:23.617652 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3814/7576] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:00:23 2022] PUT /identity/v3/projects/d8405c0099c8430caa2c3b456ec1d585/users/4ee2be8c3aed45cdb14f82fa1b04a699/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:00:23.627285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e57bb-724a-495b-9be9-05d119e5cbcf admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:23.646217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e57bb-724a-495b-9be9-05d119e5cbcf admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:23.799039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478affd-82f7-4a1e-ba78-198635b8d85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:23.799935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478affd-82f7-4a1e-ba78-198635b8d85b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:23.800436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478affd-82f7-4a1e-ba78-198635b8d85b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:23.800877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478affd-82f7-4a1e-ba78-198635b8d85b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:23.801717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478affd-82f7-4a1e-ba78-198635b8d85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:23.804177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478affd-82f7-4a1e-ba78-198635b8d85b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:23.839867 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3763/7577] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:00:23.841480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b5bd0-946f-43bd-918f-9846e6128988 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:23.867248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b5bd0-946f-43bd-918f-9846e6128988 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:23.883791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b45a33-bfeb-456b-ae6b-6a36d25b9fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:23.890372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b45a33-bfeb-456b-ae6b-6a36d25b9fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:23.890659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b45a33-bfeb-456b-ae6b-6a36d25b9fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:23.890951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b45a33-bfeb-456b-ae6b-6a36d25b9fa8 admin admin] PATH_INFO: `/v3/projects/d8405c0099c8430caa2c3b456ec1d585/users/4ee2be8c3aed45cdb14f82fa1b04a699/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:23.896499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b45a33-bfeb-456b-ae6b-6a36d25b9fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8405c0099c8430caa2c3b456ec1d585, user_id=4ee2be8c3aed45cdb14f82fa1b04a699, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:23.901886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b45a33-bfeb-456b-ae6b-6a36d25b9fa8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:23.945570 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3815/7578] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:00:23 2022] PUT /identity/v3/projects/d8405c0099c8430caa2c3b456ec1d585/users/4ee2be8c3aed45cdb14f82fa1b04a699/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:23.947320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a08058-0995-4c96-a2ce-46f64f4827d0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:23.947715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a08058-0995-4c96-a2ce-46f64f4827d0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:23.948101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a08058-0995-4c96-a2ce-46f64f4827d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:24.026670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-65a08058-0995-4c96-a2ce-46f64f4827d0 None None] MFA Rules not processed for user `4ee2be8c3aed45cdb14f82fa1b04a699`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:24.028056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-65a08058-0995-4c96-a2ce-46f64f4827d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:24.136248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:24.215772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:24.234118 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3764/7579] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:24.244881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b45a33-bfeb-456b-ae6b-6a36d25b9fa8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:24.248302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b5b45a33-bfeb-456b-ae6b-6a36d25b9fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:24.406921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b45a33-bfeb-456b-ae6b-6a36d25b9fa8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:24.420393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8c0dc-ee1d-47fa-9b12-ca58d7639896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:24.421087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8c0dc-ee1d-47fa-9b12-ca58d7639896 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:24.421462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8c0dc-ee1d-47fa-9b12-ca58d7639896 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:24.421739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8c0dc-ee1d-47fa-9b12-ca58d7639896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:24.589409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8c0dc-ee1d-47fa-9b12-ca58d7639896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:24.591574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8c0dc-ee1d-47fa-9b12-ca58d7639896 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:24.619039 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3816/7580] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:00:24.620688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:25.478467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:26.067881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:27.262058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:27.771407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:28.585590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a08058-0995-4c96-a2ce-46f64f4827d0 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:28.587415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-65a08058-0995-4c96-a2ce-46f64f4827d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:28.719159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a08058-0995-4c96-a2ce-46f64f4827d0 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:28.728675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93819127-5746-4c5d-90e8-fc3968dd456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:28.729890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93819127-5746-4c5d-90e8-fc3968dd456d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:28.730501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93819127-5746-4c5d-90e8-fc3968dd456d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:28.730957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93819127-5746-4c5d-90e8-fc3968dd456d admin admin] PATH_INFO: `/v3/users/7d1308741ac14327afc1284c8f4c8e26` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:28.733583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93819127-5746-4c5d-90e8-fc3968dd456d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d1308741ac14327afc1284c8f4c8e26)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:28.739650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93819127-5746-4c5d-90e8-fc3968dd456d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:29.075833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93819127-5746-4c5d-90e8-fc3968dd456d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d1308741ac14327afc1284c8f4c8e26'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:29.176771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:29.228128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93819127-5746-4c5d-90e8-fc3968dd456d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d1308741ac14327afc1284c8f4c8e26'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:29.229243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93819127-5746-4c5d-90e8-fc3968dd456d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d1308741ac14327afc1284c8f4c8e26'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:29.239835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93819127-5746-4c5d-90e8-fc3968dd456d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d1308741ac14327afc1284c8f4c8e26'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:29.292099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93819127-5746-4c5d-90e8-fc3968dd456d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d1308741ac14327afc1284c8f4c8e26'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:29.313873 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3765/7581] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:00:28 2022] DELETE /identity/v3/users/7d1308741ac14327afc1284c8f4c8e26 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:29.318587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ae69e-6c83-4685-9293-96fea3e9a267 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:29.319173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ae69e-6c83-4685-9293-96fea3e9a267 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:29.319666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ae69e-6c83-4685-9293-96fea3e9a267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:29.344766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-543ae69e-6c83-4685-9293-96fea3e9a267 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:29.346028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-543ae69e-6c83-4685-9293-96fea3e9a267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:29.430586 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3817/7582] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:29.467352 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93819127-5746-4c5d-90e8-fc3968dd456d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:29.469669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-93819127-5746-4c5d-90e8-fc3968dd456d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:29.588636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93819127-5746-4c5d-90e8-fc3968dd456d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:29.595503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1129f8-6485-4944-819d-2801a7681667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:29.596559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1129f8-6485-4944-819d-2801a7681667 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:29.597032 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1129f8-6485-4944-819d-2801a7681667 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:29.598256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1129f8-6485-4944-819d-2801a7681667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:29.610683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:29.669120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1129f8-6485-4944-819d-2801a7681667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:29.674355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1129f8-6485-4944-819d-2801a7681667 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:29.708655 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3766/7583] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:00:29.964793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ae69e-6c83-4685-9293-96fea3e9a267 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:29.966461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-543ae69e-6c83-4685-9293-96fea3e9a267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:29.985377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ae69e-6c83-4685-9293-96fea3e9a267 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:29.992994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc55492-07d9-4fe5-9ac8-563a2122ab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:29.994758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc55492-07d9-4fe5-9ac8-563a2122ab2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:29.995987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc55492-07d9-4fe5-9ac8-563a2122ab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:29.996512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc55492-07d9-4fe5-9ac8-563a2122ab2e admin admin] PATH_INFO: `/v3/users/beb571e998874031a2234acc7998c860` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:29.997974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc55492-07d9-4fe5-9ac8-563a2122ab2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb571e998874031a2234acc7998c860)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:30.001584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc55492-07d9-4fe5-9ac8-563a2122ab2e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:30.321331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7dc55492-07d9-4fe5-9ac8-563a2122ab2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb571e998874031a2234acc7998c860'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:30.325788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7dc55492-07d9-4fe5-9ac8-563a2122ab2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb571e998874031a2234acc7998c860'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:30.416830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7dc55492-07d9-4fe5-9ac8-563a2122ab2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb571e998874031a2234acc7998c860'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:30.417760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7dc55492-07d9-4fe5-9ac8-563a2122ab2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb571e998874031a2234acc7998c860'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:30.485804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7dc55492-07d9-4fe5-9ac8-563a2122ab2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb571e998874031a2234acc7998c860'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:30.521192 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3818/7584] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:00:29 2022] DELETE /identity/v3/users/beb571e998874031a2234acc7998c860 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:30.526284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d218a2-8b15-403b-ae10-c7da90c895c6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:30.526769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d218a2-8b15-403b-ae10-c7da90c895c6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:30.526859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d218a2-8b15-403b-ae10-c7da90c895c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:30.565528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a9d218a2-8b15-403b-ae10-c7da90c895c6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:30.567036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a9d218a2-8b15-403b-ae10-c7da90c895c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:30.753928 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3767/7585] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:30.884962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc55492-07d9-4fe5-9ac8-563a2122ab2e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:30.886452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7dc55492-07d9-4fe5-9ac8-563a2122ab2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:31.057758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc55492-07d9-4fe5-9ac8-563a2122ab2e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:31.079667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beab886-12b8-4779-acbb-30911872fc1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:31.080658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beab886-12b8-4779-acbb-30911872fc1f service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:31.081107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beab886-12b8-4779-acbb-30911872fc1f service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:31.081566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beab886-12b8-4779-acbb-30911872fc1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:31.117515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beab886-12b8-4779-acbb-30911872fc1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:31.119249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beab886-12b8-4779-acbb-30911872fc1f service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:31.162776 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3819/7586] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:00:31.256634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:31.771846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d218a2-8b15-403b-ae10-c7da90c895c6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:31.779305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a9d218a2-8b15-403b-ae10-c7da90c895c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:31.811786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d218a2-8b15-403b-ae10-c7da90c895c6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:31.828770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421f737-5ef8-4995-83a1-b9ad268c2d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:31.830737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f737-5ef8-4995-83a1-b9ad268c2d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:31.831202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f737-5ef8-4995-83a1-b9ad268c2d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:31.834102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f737-5ef8-4995-83a1-b9ad268c2d91 admin admin] PATH_INFO: `/v3/projects/fe4b55b9429141158994d6a58059854d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:31.839237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421f737-5ef8-4995-83a1-b9ad268c2d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe4b55b9429141158994d6a58059854d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:31.844227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421f737-5ef8-4995-83a1-b9ad268c2d91 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:32.068063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2421f737-5ef8-4995-83a1-b9ad268c2d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe4b55b9429141158994d6a58059854d', 'request_id': 'req-2421f737-5ef8-4995-83a1-b9ad268c2d91'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:32.091158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2421f737-5ef8-4995-83a1-b9ad268c2d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe4b55b9429141158994d6a58059854d', 'request_id': 'req-2421f737-5ef8-4995-83a1-b9ad268c2d91'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:32.111461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2421f737-5ef8-4995-83a1-b9ad268c2d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe4b55b9429141158994d6a58059854d', 'request_id': 'req-2421f737-5ef8-4995-83a1-b9ad268c2d91'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:32.205030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2421f737-5ef8-4995-83a1-b9ad268c2d91 admin admin] The token cache is being invalidate because project fe4b55b9429141158994d6a58059854d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:00:32.205030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2421f737-5ef8-4995-83a1-b9ad268c2d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:32.205030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2421f737-5ef8-4995-83a1-b9ad268c2d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:32.205030 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3768/7587] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:00:31 2022] DELETE /identity/v3/projects/fe4b55b9429141158994d6a58059854d => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:32.209309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a974d-15ea-4f74-97c7-d63ebafbf2f1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:32.209805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a974d-15ea-4f74-97c7-d63ebafbf2f1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:32.209905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a974d-15ea-4f74-97c7-d63ebafbf2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:32.273755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-832a974d-15ea-4f74-97c7-d63ebafbf2f1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:32.298149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-832a974d-15ea-4f74-97c7-d63ebafbf2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:32.302727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:32.460584 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3820/7588] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:32.466848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb435e9-baa2-4c8c-84bd-a8a266fa0a58 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:32.467801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb435e9-baa2-4c8c-84bd-a8a266fa0a58 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:32.468247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb435e9-baa2-4c8c-84bd-a8a266fa0a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:32.502300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:32.525183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6eb435e9-baa2-4c8c-84bd-a8a266fa0a58 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:32.530683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6eb435e9-baa2-4c8c-84bd-a8a266fa0a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:32.600913 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3769/7589] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:32.606893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a974d-15ea-4f74-97c7-d63ebafbf2f1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:32.626057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a974d-15ea-4f74-97c7-d63ebafbf2f1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:32.644063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4eaa31-afb8-4845-97aa-13651ede5398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:32.645365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4eaa31-afb8-4845-97aa-13651ede5398 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:32.646963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4eaa31-afb8-4845-97aa-13651ede5398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:32.647399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4eaa31-afb8-4845-97aa-13651ede5398 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:32.648651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4eaa31-afb8-4845-97aa-13651ede5398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:00:32.650583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4eaa31-afb8-4845-97aa-13651ede5398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:32.655354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4eaa31-afb8-4845-97aa-13651ede5398 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:32.721198 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3821/7590] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:00:32.723325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb435e9-baa2-4c8c-84bd-a8a266fa0a58 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:32.737876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb435e9-baa2-4c8c-84bd-a8a266fa0a58 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:32.751253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acb14f-efb3-47c9-b9d2-2a3e9a1ec328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:32.755109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acb14f-efb3-47c9-b9d2-2a3e9a1ec328 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:32.755647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acb14f-efb3-47c9-b9d2-2a3e9a1ec328 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:32.762769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acb14f-efb3-47c9-b9d2-2a3e9a1ec328 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:32.765837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acb14f-efb3-47c9-b9d2-2a3e9a1ec328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:32.769104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acb14f-efb3-47c9-b9d2-2a3e9a1ec328 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:32.968717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4eaa31-afb8-4845-97aa-13651ede5398 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:32.977745 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3770/7591] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:00:32 2022] POST /identity/v3/projects => generated 381 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:00:32.986009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4eaa31-afb8-4845-97aa-13651ede5398 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:33.143800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0183b-ce3f-449a-bf62-40b573e64d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:33.145949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0183b-ce3f-449a-bf62-40b573e64d17 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:33.146417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0183b-ce3f-449a-bf62-40b573e64d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:33.146931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0183b-ce3f-449a-bf62-40b573e64d17 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:33.147743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0183b-ce3f-449a-bf62-40b573e64d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:33.150283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0183b-ce3f-449a-bf62-40b573e64d17 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:33.251265 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3822/7592] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:00:32 2022] POST /identity/v3/users => generated 291 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:00:33.255495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acb14f-efb3-47c9-b9d2-2a3e9a1ec328 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:33.269226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acb14f-efb3-47c9-b9d2-2a3e9a1ec328 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:33.276014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3938527-02b1-466d-9521-f1ebf49e06ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:33.276914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3938527-02b1-466d-9521-f1ebf49e06ed admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:33.277506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3938527-02b1-466d-9521-f1ebf49e06ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:33.281338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3938527-02b1-466d-9521-f1ebf49e06ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:33.296262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3938527-02b1-466d-9521-f1ebf49e06ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:33.305727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3938527-02b1-466d-9521-f1ebf49e06ed admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:33.386740 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3771/7593] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:00:33.391667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0183b-ce3f-449a-bf62-40b573e64d17 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:33.428190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0183b-ce3f-449a-bf62-40b573e64d17 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:33.438100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c698b-16dd-4e8a-a864-ca7feebcf699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:33.439046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c698b-16dd-4e8a-a864-ca7feebcf699 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:33.439548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c698b-16dd-4e8a-a864-ca7feebcf699 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:33.440019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c698b-16dd-4e8a-a864-ca7feebcf699 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:33.440966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c698b-16dd-4e8a-a864-ca7feebcf699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:33.442935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c698b-16dd-4e8a-a864-ca7feebcf699 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:33.469737 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3823/7594] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:00:33.473123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3938527-02b1-466d-9521-f1ebf49e06ed admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:33.485590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3938527-02b1-466d-9521-f1ebf49e06ed admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:33.499447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451356d-11b5-413d-8757-c570a8275929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:33.500365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451356d-11b5-413d-8757-c570a8275929 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:33.500766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451356d-11b5-413d-8757-c570a8275929 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:33.501073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451356d-11b5-413d-8757-c570a8275929 admin admin] PATH_INFO: `/v3/projects/2f2b456edb6f48c9b959bc59697493d9/users/b8532c7c3c754fe7b31b6649cb81cdda/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:33.524684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451356d-11b5-413d-8757-c570a8275929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f2b456edb6f48c9b959bc59697493d9, user_id=b8532c7c3c754fe7b31b6649cb81cdda, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:33.531468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451356d-11b5-413d-8757-c570a8275929 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:33.544819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:33.681733 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3772/7595] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:00:33 2022] PUT /identity/v3/projects/2f2b456edb6f48c9b959bc59697493d9/users/b8532c7c3c754fe7b31b6649cb81cdda/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:33.693141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9efc1f-3289-4da6-8194-7c3f4f7d12d0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:33.693458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9efc1f-3289-4da6-8194-7c3f4f7d12d0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:33.693838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9efc1f-3289-4da6-8194-7c3f4f7d12d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:33.725999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0e9efc1f-3289-4da6-8194-7c3f4f7d12d0 None None] MFA Rules not processed for user `b8532c7c3c754fe7b31b6649cb81cdda`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:33.727664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0e9efc1f-3289-4da6-8194-7c3f4f7d12d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:33.824783 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3824/7596] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:33.839968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451356d-11b5-413d-8757-c570a8275929 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:33.841760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7451356d-11b5-413d-8757-c570a8275929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:33.914511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9efc1f-3289-4da6-8194-7c3f4f7d12d0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:33.916149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0e9efc1f-3289-4da6-8194-7c3f4f7d12d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:34.061445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451356d-11b5-413d-8757-c570a8275929 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:34.073809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ad27e-61b8-4b88-a5ad-959a15c06c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:34.075067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ad27e-61b8-4b88-a5ad-959a15c06c62 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:34.075448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ad27e-61b8-4b88-a5ad-959a15c06c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:34.076666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ad27e-61b8-4b88-a5ad-959a15c06c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:34.090228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ad27e-61b8-4b88-a5ad-959a15c06c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:34.095969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ad27e-61b8-4b88-a5ad-959a15c06c62 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:34.120117 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3773/7597] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:00:34.128989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9efc1f-3289-4da6-8194-7c3f4f7d12d0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:34.139039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956e723-713b-47ea-997b-b2343e093632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:34.139705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956e723-713b-47ea-997b-b2343e093632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:34.140388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956e723-713b-47ea-997b-b2343e093632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:34.140669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956e723-713b-47ea-997b-b2343e093632 admin admin] PATH_INFO: `/v3/projects/2d45e23181cd46c4b0afa9961c1d3eb1` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:34.141935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956e723-713b-47ea-997b-b2343e093632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d45e23181cd46c4b0afa9961c1d3eb1)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:34.144061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956e723-713b-47ea-997b-b2343e093632 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:34.211212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ad27e-61b8-4b88-a5ad-959a15c06c62 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:34.211212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-605ad27e-61b8-4b88-a5ad-959a15c06c62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:34.333991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0956e723-713b-47ea-997b-b2343e093632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d45e23181cd46c4b0afa9961c1d3eb1', 'request_id': 'req-0956e723-713b-47ea-997b-b2343e093632'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:34.341735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0956e723-713b-47ea-997b-b2343e093632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d45e23181cd46c4b0afa9961c1d3eb1', 'request_id': 'req-0956e723-713b-47ea-997b-b2343e093632'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:34.344100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ad27e-61b8-4b88-a5ad-959a15c06c62 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:34.418246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d580568-eeda-433e-92a0-177a865ecd44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:34.418788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d580568-eeda-433e-92a0-177a865ecd44 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:34.419073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d580568-eeda-433e-92a0-177a865ecd44 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:34.419347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d580568-eeda-433e-92a0-177a865ecd44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:34.423379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0d580568-eeda-433e-92a0-177a865ecd44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:34.433244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0956e723-713b-47ea-997b-b2343e093632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d45e23181cd46c4b0afa9961c1d3eb1', 'request_id': 'req-0956e723-713b-47ea-997b-b2343e093632'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:34.455501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0956e723-713b-47ea-997b-b2343e093632 admin admin] The token cache is being invalidate because project 2d45e23181cd46c4b0afa9961c1d3eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:00:34.456363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0956e723-713b-47ea-997b-b2343e093632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:34.458569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0956e723-713b-47ea-997b-b2343e093632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:34.460466 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3825/7598] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:00:33 2022] DELETE /identity/v3/projects/2d45e23181cd46c4b0afa9961c1d3eb1 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:00:34.466176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956e723-713b-47ea-997b-b2343e093632 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:34.473121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0956e723-713b-47ea-997b-b2343e093632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:34.630630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d580568-eeda-433e-92a0-177a865ecd44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:34.633322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d580568-eeda-433e-92a0-177a865ecd44 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:34.633430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956e723-713b-47ea-997b-b2343e093632 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:34.642655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932ba53-bf81-418f-b15e-501990ebc77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:34.643442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932ba53-bf81-418f-b15e-501990ebc77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:34.643728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932ba53-bf81-418f-b15e-501990ebc77a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:34.644007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932ba53-bf81-418f-b15e-501990ebc77a admin admin] PATH_INFO: `/v3/users/b8532c7c3c754fe7b31b6649cb81cdda` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:34.645362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932ba53-bf81-418f-b15e-501990ebc77a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8532c7c3c754fe7b31b6649cb81cdda)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:34.649517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932ba53-bf81-418f-b15e-501990ebc77a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:34.653934 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3774/7599] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:00:34.663988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6776c-64a1-44b8-956c-48b843484957 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:34.663988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6776c-64a1-44b8-956c-48b843484957 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:34.663988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6776c-64a1-44b8-956c-48b843484957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:34.730594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-fdb6776c-64a1-44b8-956c-48b843484957 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:34.731992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fdb6776c-64a1-44b8-956c-48b843484957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:34.753573 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3775/7600] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:34.761996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5706102-1caf-46b4-bc06-ee4ee73ee4f9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:34.762542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5706102-1caf-46b4-bc06-ee4ee73ee4f9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:34.763185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5706102-1caf-46b4-bc06-ee4ee73ee4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:34.816659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e5706102-1caf-46b4-bc06-ee4ee73ee4f9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:34.820753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e5706102-1caf-46b4-bc06-ee4ee73ee4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:34.834876 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3776/7601] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:00:34.839804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5706102-1caf-46b4-bc06-ee4ee73ee4f9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:34.852624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5706102-1caf-46b4-bc06-ee4ee73ee4f9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:34.859113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f6ff5-547f-4407-ba85-bf9f18789858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:34.860628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f6ff5-547f-4407-ba85-bf9f18789858 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:34.861135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f6ff5-547f-4407-ba85-bf9f18789858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:34.861618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f6ff5-547f-4407-ba85-bf9f18789858 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:34.862560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f6ff5-547f-4407-ba85-bf9f18789858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:00:34.863075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f6ff5-547f-4407-ba85-bf9f18789858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:34.864976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f6ff5-547f-4407-ba85-bf9f18789858 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:34.882782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:34.892521 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3777/7602] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:00:34.896665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f6ff5-547f-4407-ba85-bf9f18789858 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:34.916418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f6ff5-547f-4407-ba85-bf9f18789858 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:34.926594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac947b8a-648b-47e1-a567-a3115ad1f8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:34.927623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac947b8a-648b-47e1-a567-a3115ad1f8ef admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:34.929002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac947b8a-648b-47e1-a567-a3115ad1f8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:34.929693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac947b8a-648b-47e1-a567-a3115ad1f8ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:34.930626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac947b8a-648b-47e1-a567-a3115ad1f8ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:34.934434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac947b8a-648b-47e1-a567-a3115ad1f8ef admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:34.985082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5932ba53-bf81-418f-b15e-501990ebc77a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8532c7c3c754fe7b31b6649cb81cdda'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:34.987168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5932ba53-bf81-418f-b15e-501990ebc77a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8532c7c3c754fe7b31b6649cb81cdda'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:35.113467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5932ba53-bf81-418f-b15e-501990ebc77a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8532c7c3c754fe7b31b6649cb81cdda'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:35.114383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5932ba53-bf81-418f-b15e-501990ebc77a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8532c7c3c754fe7b31b6649cb81cdda'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:35.122183 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3778/7603] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:00:34 2022] POST /identity/v3/projects => generated 375 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:00:35.128375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac947b8a-648b-47e1-a567-a3115ad1f8ef admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:35.133645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ac947b8a-648b-47e1-a567-a3115ad1f8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:35.137285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5932ba53-bf81-418f-b15e-501990ebc77a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8532c7c3c754fe7b31b6649cb81cdda'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:35.174261 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3826/7604] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:00:34 2022] DELETE /identity/v3/users/b8532c7c3c754fe7b31b6649cb81cdda => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:35.182887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a58fc-d399-4c86-811d-b4ffa8183a90 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:35.183440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a58fc-d399-4c86-811d-b4ffa8183a90 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:35.183873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a58fc-d399-4c86-811d-b4ffa8183a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:35.213119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-830a58fc-d399-4c86-811d-b4ffa8183a90 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:35.214764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-830a58fc-d399-4c86-811d-b4ffa8183a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:35.296794 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3827/7605] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:35.298121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac947b8a-648b-47e1-a567-a3115ad1f8ef admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:35.303439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a58fc-d399-4c86-811d-b4ffa8183a90 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:35.303594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e88c3-7fbc-4be0-a975-52c078b758b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:35.304326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e88c3-7fbc-4be0-a975-52c078b758b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:35.304507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e88c3-7fbc-4be0-a975-52c078b758b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:35.304899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e88c3-7fbc-4be0-a975-52c078b758b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:35.305645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e88c3-7fbc-4be0-a975-52c078b758b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:35.307483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e88c3-7fbc-4be0-a975-52c078b758b2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:35.308576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-830a58fc-d399-4c86-811d-b4ffa8183a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:35.406456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a58fc-d399-4c86-811d-b4ffa8183a90 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:35.411251 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3779/7606] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:00:35 2022] POST /identity/v3/users => generated 288 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:00:35.417443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e88c3-7fbc-4be0-a975-52c078b758b2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:35.433666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488b8c5-cafd-4c85-838d-ab2234ed649e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:35.434682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488b8c5-cafd-4c85-838d-ab2234ed649e service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:35.438785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488b8c5-cafd-4c85-838d-ab2234ed649e service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:35.439267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488b8c5-cafd-4c85-838d-ab2234ed649e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:35.439476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e88c3-7fbc-4be0-a975-52c078b758b2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:35.456875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e833188-6c36-4b6e-afc5-29335189487d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:35.456875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e833188-6c36-4b6e-afc5-29335189487d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:35.456875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e833188-6c36-4b6e-afc5-29335189487d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:35.456875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e833188-6c36-4b6e-afc5-29335189487d admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:35.457403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e833188-6c36-4b6e-afc5-29335189487d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:35.460608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e833188-6c36-4b6e-afc5-29335189487d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:35.466543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488b8c5-cafd-4c85-838d-ab2234ed649e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:35.471287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488b8c5-cafd-4c85-838d-ab2234ed649e service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:35.489122 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3828/7607] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:00:35.510579 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3780/7608] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:00:35.520542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488b8c5-cafd-4c85-838d-ab2234ed649e service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:35.539865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488b8c5-cafd-4c85-838d-ab2234ed649e service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:35.552282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42849534-0447-4ce4-a3a0-97db316e5366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:35.553172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849534-0447-4ce4-a3a0-97db316e5366 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:35.553784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849534-0447-4ce4-a3a0-97db316e5366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:35.554262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849534-0447-4ce4-a3a0-97db316e5366 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:35.555077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42849534-0447-4ce4-a3a0-97db316e5366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:35.557148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42849534-0447-4ce4-a3a0-97db316e5366 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:35.581885 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3829/7609] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:00:35.583483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e833188-6c36-4b6e-afc5-29335189487d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:35.598122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e833188-6c36-4b6e-afc5-29335189487d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:35.616482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280a79f-b185-4c57-8ebb-6c3bcaddd3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:35.619265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280a79f-b185-4c57-8ebb-6c3bcaddd3f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:35.619561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280a79f-b185-4c57-8ebb-6c3bcaddd3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:35.620948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280a79f-b185-4c57-8ebb-6c3bcaddd3f4 admin admin] PATH_INFO: `/v3/projects/c281dabc063b440aba1742cba2f97f45/users/346801cb8db44f118fcacaa356cc8ae2/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:35.666877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280a79f-b185-4c57-8ebb-6c3bcaddd3f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c281dabc063b440aba1742cba2f97f45, user_id=346801cb8db44f118fcacaa356cc8ae2, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:35.672811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280a79f-b185-4c57-8ebb-6c3bcaddd3f4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:35.817948 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3781/7610] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:00:35 2022] PUT /identity/v3/projects/c281dabc063b440aba1742cba2f97f45/users/346801cb8db44f118fcacaa356cc8ae2/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:35.820606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608331a-9a7d-454a-9755-e19abd993fc0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:35.821081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608331a-9a7d-454a-9755-e19abd993fc0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:35.821364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608331a-9a7d-454a-9755-e19abd993fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:35.833273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:35.852264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38261eab-0fde-4cbf-9db0-149866f03053 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:35.852802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38261eab-0fde-4cbf-9db0-149866f03053 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:35.853090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38261eab-0fde-4cbf-9db0-149866f03053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:35.859648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8608331a-9a7d-454a-9755-e19abd993fc0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:35.860941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8608331a-9a7d-454a-9755-e19abd993fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:35.932087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-38261eab-0fde-4cbf-9db0-149866f03053 None None] MFA Rules not processed for user `c9ecfdc3b09e4ea1b7b27867dd69c1ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:35.933356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-38261eab-0fde-4cbf-9db0-149866f03053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:36.035328 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3830/7611] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:36.046990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608331a-9a7d-454a-9755-e19abd993fc0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:36.174942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608331a-9a7d-454a-9755-e19abd993fc0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:36.180516 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3782/7612] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:00:36.184900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38261eab-0fde-4cbf-9db0-149866f03053 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:36.189519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21cf83-2dac-4dad-9149-fb5f5be2ffe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:36.191949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-38261eab-0fde-4cbf-9db0-149866f03053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:36.192382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21cf83-2dac-4dad-9149-fb5f5be2ffe2 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:36.192860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21cf83-2dac-4dad-9149-fb5f5be2ffe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:36.194747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21cf83-2dac-4dad-9149-fb5f5be2ffe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:36.230271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21cf83-2dac-4dad-9149-fb5f5be2ffe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:36.235812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21cf83-2dac-4dad-9149-fb5f5be2ffe2 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:36.240511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38261eab-0fde-4cbf-9db0-149866f03053 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:36.274285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac242851-8a8d-4d87-8c7c-d02d13b04e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:36.274285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac242851-8a8d-4d87-8c7c-d02d13b04e3a admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:36.274285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac242851-8a8d-4d87-8c7c-d02d13b04e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:36.277125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac242851-8a8d-4d87-8c7c-d02d13b04e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:36.279449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac242851-8a8d-4d87-8c7c-d02d13b04e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:36.290625 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3831/7613] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:00:36.291966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac242851-8a8d-4d87-8c7c-d02d13b04e3a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:36.518575 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3783/7614] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:00:36 2022] POST /identity/v3/projects => generated 373 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:00:36.523173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21cf83-2dac-4dad-9149-fb5f5be2ffe2 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:36.560987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21cf83-2dac-4dad-9149-fb5f5be2ffe2 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:36.753775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf700f-2f30-444c-a42c-62f5443e7b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:36.754512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf700f-2f30-444c-a42c-62f5443e7b47 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:36.754798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf700f-2f30-444c-a42c-62f5443e7b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:36.755138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf700f-2f30-444c-a42c-62f5443e7b47 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:36.755774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf700f-2f30-444c-a42c-62f5443e7b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:36.764402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf700f-2f30-444c-a42c-62f5443e7b47 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:36.966685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac242851-8a8d-4d87-8c7c-d02d13b04e3a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:36.969951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ac242851-8a8d-4d87-8c7c-d02d13b04e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:36.992390 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3832/7615] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:00:36 2022] POST /identity/v3/users => generated 293 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:00:36.992736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf700f-2f30-444c-a42c-62f5443e7b47 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:37.016877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf700f-2f30-444c-a42c-62f5443e7b47 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:37.032386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c620207-6cc4-4580-bca9-60365d9f7d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:37.035049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c620207-6cc4-4580-bca9-60365d9f7d16 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:37.035186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c620207-6cc4-4580-bca9-60365d9f7d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:37.035531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c620207-6cc4-4580-bca9-60365d9f7d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:37.036331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c620207-6cc4-4580-bca9-60365d9f7d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:37.041271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c620207-6cc4-4580-bca9-60365d9f7d16 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:37.045967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac242851-8a8d-4d87-8c7c-d02d13b04e3a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:37.065976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4a117-fed1-4a0f-abc7-ea5d0d4aabd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:37.066646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4a117-fed1-4a0f-abc7-ea5d0d4aabd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:37.066928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4a117-fed1-4a0f-abc7-ea5d0d4aabd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:37.067206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4a117-fed1-4a0f-abc7-ea5d0d4aabd0 admin admin] PATH_INFO: `/v3/projects/2f2b456edb6f48c9b959bc59697493d9` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:37.070926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4a117-fed1-4a0f-abc7-ea5d0d4aabd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f2b456edb6f48c9b959bc59697493d9)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:37.072988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4a117-fed1-4a0f-abc7-ea5d0d4aabd0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:37.087371 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3833/7616] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:00:37.092378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c620207-6cc4-4580-bca9-60365d9f7d16 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:37.115710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c620207-6cc4-4580-bca9-60365d9f7d16 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:37.129107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fa939-f9a5-4f4d-8c9e-0a14015b5798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:37.135233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fa939-f9a5-4f4d-8c9e-0a14015b5798 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:37.135233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fa939-f9a5-4f4d-8c9e-0a14015b5798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:37.135233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fa939-f9a5-4f4d-8c9e-0a14015b5798 admin admin] PATH_INFO: `/v3/projects/98af31cba78b4b1086ca9e1b753861d7/users/4277a37924e2483393c63e66e6bb37b5/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:37.171235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fa939-f9a5-4f4d-8c9e-0a14015b5798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98af31cba78b4b1086ca9e1b753861d7, user_id=4277a37924e2483393c63e66e6bb37b5, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:37.182175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fa939-f9a5-4f4d-8c9e-0a14015b5798 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:37.265049 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3834/7617] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:00:37 2022] PUT /identity/v3/projects/98af31cba78b4b1086ca9e1b753861d7/users/4277a37924e2483393c63e66e6bb37b5/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:37.270607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fa939-f9a5-4f4d-8c9e-0a14015b5798 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:37.286061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f6e4a117-fed1-4a0f-abc7-ea5d0d4aabd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f2b456edb6f48c9b959bc59697493d9', 'request_id': 'req-f6e4a117-fed1-4a0f-abc7-ea5d0d4aabd0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:37.304013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f6e4a117-fed1-4a0f-abc7-ea5d0d4aabd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f2b456edb6f48c9b959bc59697493d9', 'request_id': 'req-f6e4a117-fed1-4a0f-abc7-ea5d0d4aabd0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:37.327366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f6e4a117-fed1-4a0f-abc7-ea5d0d4aabd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f2b456edb6f48c9b959bc59697493d9', 'request_id': 'req-f6e4a117-fed1-4a0f-abc7-ea5d0d4aabd0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:37.406080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:37.413424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fa939-f9a5-4f4d-8c9e-0a14015b5798 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:37.465216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f6e4a117-fed1-4a0f-abc7-ea5d0d4aabd0 admin admin] The token cache is being invalidate because project 2f2b456edb6f48c9b959bc59697493d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:00:37.465577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f6e4a117-fed1-4a0f-abc7-ea5d0d4aabd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:37.466404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f6e4a117-fed1-4a0f-abc7-ea5d0d4aabd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:37.468095 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3784/7618] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:00:36 2022] DELETE /identity/v3/projects/2f2b456edb6f48c9b959bc59697493d9 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:37.477871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb81239-a713-455f-a979-eacb8568d0fa None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:37.478163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb81239-a713-455f-a979-eacb8568d0fa None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:37.478443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb81239-a713-455f-a979-eacb8568d0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:37.486875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f08c2-6544-4705-9675-29e636cd27c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:37.486875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f08c2-6544-4705-9675-29e636cd27c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:37.486875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f08c2-6544-4705-9675-29e636cd27c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:37.486875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f08c2-6544-4705-9675-29e636cd27c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:37.487825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f08c2-6544-4705-9675-29e636cd27c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:37.487825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f08c2-6544-4705-9675-29e636cd27c4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:37.506418 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3835/7619] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:00:37.507398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f08c2-6544-4705-9675-29e636cd27c4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:37.509551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-663f08c2-6544-4705-9675-29e636cd27c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:37.529016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f08c2-6544-4705-9675-29e636cd27c4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:37.534789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9c403-5a71-41c3-b119-ba17f8e9e3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:37.535597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9c403-5a71-41c3-b119-ba17f8e9e3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:37.535981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9c403-5a71-41c3-b119-ba17f8e9e3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:37.536801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9c403-5a71-41c3-b119-ba17f8e9e3ca admin admin] PATH_INFO: `/v3/projects/98af31cba78b4b1086ca9e1b753861d7/users/4277a37924e2483393c63e66e6bb37b5/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:37.538957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d9c403-5a71-41c3-b119-ba17f8e9e3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=98af31cba78b4b1086ca9e1b753861d7, user_id=4277a37924e2483393c63e66e6bb37b5, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:37.542371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d9c403-5a71-41c3-b119-ba17f8e9e3ca admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:37.556131 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3836/7620] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:00:37 2022] PUT /identity/v3/projects/98af31cba78b4b1086ca9e1b753861d7/users/4277a37924e2483393c63e66e6bb37b5/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:37.583001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-edb81239-a713-455f-a979-eacb8568d0fa None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:37.587803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-edb81239-a713-455f-a979-eacb8568d0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:37.783844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:37.798362 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3785/7621] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:37.809872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9776f-80a9-4d59-ac57-2049bd2b1969 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:37.810281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9776f-80a9-4d59-ac57-2049bd2b1969 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:37.810726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9776f-80a9-4d59-ac57-2049bd2b1969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:37.878948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bdc9776f-80a9-4d59-ac57-2049bd2b1969 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:37.885642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bdc9776f-80a9-4d59-ac57-2049bd2b1969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:37.924690 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3837/7622] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:00:37.930960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb81239-a713-455f-a979-eacb8568d0fa None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:37.959401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb81239-a713-455f-a979-eacb8568d0fa None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:37.984818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89465137-5945-4432-a72d-94b2f52cb9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:37.985300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89465137-5945-4432-a72d-94b2f52cb9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:37.985587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89465137-5945-4432-a72d-94b2f52cb9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:37.985866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89465137-5945-4432-a72d-94b2f52cb9e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:37.986543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89465137-5945-4432-a72d-94b2f52cb9e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:00:37.986855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89465137-5945-4432-a72d-94b2f52cb9e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:38.005278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89465137-5945-4432-a72d-94b2f52cb9e8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:38.044821 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3786/7623] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:00:38.049924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9776f-80a9-4d59-ac57-2049bd2b1969 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:38.067288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9776f-80a9-4d59-ac57-2049bd2b1969 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:38.089517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e0174-d8c9-491d-82e0-a0e876f7bd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:38.089517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e0174-d8c9-491d-82e0-a0e876f7bd07 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:38.089517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e0174-d8c9-491d-82e0-a0e876f7bd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:38.089517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e0174-d8c9-491d-82e0-a0e876f7bd07 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:38.090191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e0174-d8c9-491d-82e0-a0e876f7bd07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:38.108699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e0174-d8c9-491d-82e0-a0e876f7bd07 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:38.299680 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3838/7624] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:00:38 2022] POST /identity/v3/projects => generated 359 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:00:38.304919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89465137-5945-4432-a72d-94b2f52cb9e8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:38.322616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89465137-5945-4432-a72d-94b2f52cb9e8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:38.535461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7617ce-99ad-499f-a615-713587ce75f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:38.536092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7617ce-99ad-499f-a615-713587ce75f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:38.538444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7617ce-99ad-499f-a615-713587ce75f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:38.538797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7617ce-99ad-499f-a615-713587ce75f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:38.539480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7617ce-99ad-499f-a615-713587ce75f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:38.547482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7617ce-99ad-499f-a615-713587ce75f7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:38.651694 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3787/7625] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:00:38 2022] POST /identity/v3/users => generated 280 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:00:38.659197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e0174-d8c9-491d-82e0-a0e876f7bd07 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:38.678041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e0174-d8c9-491d-82e0-a0e876f7bd07 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:38.698985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432531d-fa39-4668-b62c-535c5d202b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:38.700136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432531d-fa39-4668-b62c-535c5d202b3a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:38.700682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432531d-fa39-4668-b62c-535c5d202b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:38.702013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432531d-fa39-4668-b62c-535c5d202b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:38.702935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432531d-fa39-4668-b62c-535c5d202b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:38.704890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432531d-fa39-4668-b62c-535c5d202b3a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:38.730278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:38.730787 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3839/7626] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:00:38.732717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7617ce-99ad-499f-a615-713587ce75f7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:38.748748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7617ce-99ad-499f-a615-713587ce75f7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:38.771247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210b653-fd27-481b-98e8-de9e3c1b8092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:38.776299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210b653-fd27-481b-98e8-de9e3c1b8092 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:38.776594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210b653-fd27-481b-98e8-de9e3c1b8092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:38.776881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210b653-fd27-481b-98e8-de9e3c1b8092 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:38.777557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210b653-fd27-481b-98e8-de9e3c1b8092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:38.788132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210b653-fd27-481b-98e8-de9e3c1b8092 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:38.814390 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3788/7627] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:00:38.815637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432531d-fa39-4668-b62c-535c5d202b3a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:38.832024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432531d-fa39-4668-b62c-535c5d202b3a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:38.846641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e824e-23ce-4105-be0f-3be9ae393278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:38.847782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e824e-23ce-4105-be0f-3be9ae393278 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:38.848456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e824e-23ce-4105-be0f-3be9ae393278 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:38.848975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e824e-23ce-4105-be0f-3be9ae393278 admin admin] PATH_INFO: `/v3/projects/c43c550ce30e42deb37ace0fd37865cf/users/499e476661254885930bb1662ce45e29/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:38.886644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e824e-23ce-4105-be0f-3be9ae393278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43c550ce30e42deb37ace0fd37865cf, user_id=499e476661254885930bb1662ce45e29, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:38.893253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e824e-23ce-4105-be0f-3be9ae393278 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:38.994865 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3840/7628] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:00:38 2022] PUT /identity/v3/projects/c43c550ce30e42deb37ace0fd37865cf/users/499e476661254885930bb1662ce45e29/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:00:39.008385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a196ccc-bcc2-4ff0-9053-077130676e51 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:39.008964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a196ccc-bcc2-4ff0-9053-077130676e51 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:39.009250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a196ccc-bcc2-4ff0-9053-077130676e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:39.047307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0a196ccc-bcc2-4ff0-9053-077130676e51 None None] MFA Rules not processed for user `499e476661254885930bb1662ce45e29`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:39.048593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0a196ccc-bcc2-4ff0-9053-077130676e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:39.118915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:39.191684 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3789/7629] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:39.857875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e824e-23ce-4105-be0f-3be9ae393278 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:39.859683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2b0e824e-23ce-4105-be0f-3be9ae393278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:39.890891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:39.953653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:40.094817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e824e-23ce-4105-be0f-3be9ae393278 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:40.099232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510109d-7410-42f1-baee-7b76c07f3969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:40.099936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510109d-7410-42f1-baee-7b76c07f3969 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:40.100312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510109d-7410-42f1-baee-7b76c07f3969 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:40.105487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510109d-7410-42f1-baee-7b76c07f3969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:40.114093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510109d-7410-42f1-baee-7b76c07f3969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:40.116666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510109d-7410-42f1-baee-7b76c07f3969 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:40.141504 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3841/7630] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:00:40.268760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:41.064112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:41.205301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:41.726463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a196ccc-bcc2-4ff0-9053-077130676e51 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:41.757259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a196ccc-bcc2-4ff0-9053-077130676e51 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:41.769190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0d56a-cdc8-4825-ac55-52877cd1d498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:41.770783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0d56a-cdc8-4825-ac55-52877cd1d498 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:41.772691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0d56a-cdc8-4825-ac55-52877cd1d498 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:41.774319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0d56a-cdc8-4825-ac55-52877cd1d498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:41.782793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c0a0d56a-cdc8-4825-ac55-52877cd1d498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:41.860613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:42.023919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0d56a-cdc8-4825-ac55-52877cd1d498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:42.025547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0d56a-cdc8-4825-ac55-52877cd1d498 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:42.053272 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3790/7631] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:41 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:00:42.593327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:43.570044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:43.860526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:44.455125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:44.748476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:45.947420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:46.278846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:46.901553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:47.011366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:47.604133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:48.107674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:48.598458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:48.982544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:49.102080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:51.107957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:51.117166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510109d-7410-42f1-baee-7b76c07f3969 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:51.118656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0510109d-7410-42f1-baee-7b76c07f3969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:51.279387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:51.445610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510109d-7410-42f1-baee-7b76c07f3969 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:51.465011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c917282-c2e7-4e38-9a25-6a38ff0b4368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:51.467791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c917282-c2e7-4e38-9a25-6a38ff0b4368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:51.467791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c917282-c2e7-4e38-9a25-6a38ff0b4368 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:51.467791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c917282-c2e7-4e38-9a25-6a38ff0b4368 admin admin] PATH_INFO: `/v3/users/fc2968890df04280a717baf480f5ad91` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:51.472391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c917282-c2e7-4e38-9a25-6a38ff0b4368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc2968890df04280a717baf480f5ad91)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:51.476802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c917282-c2e7-4e38-9a25-6a38ff0b4368 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:51.785590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9c917282-c2e7-4e38-9a25-6a38ff0b4368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc2968890df04280a717baf480f5ad91'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:51.786446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9c917282-c2e7-4e38-9a25-6a38ff0b4368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc2968890df04280a717baf480f5ad91'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:51.873436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9c917282-c2e7-4e38-9a25-6a38ff0b4368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc2968890df04280a717baf480f5ad91'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:51.874438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9c917282-c2e7-4e38-9a25-6a38ff0b4368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc2968890df04280a717baf480f5ad91'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:51.900245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9c917282-c2e7-4e38-9a25-6a38ff0b4368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc2968890df04280a717baf480f5ad91'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:51.930371 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3842/7632] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:00:51 2022] DELETE /identity/v3/users/fc2968890df04280a717baf480f5ad91 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:51.935448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b4434-9a51-4990-a5a8-853246b85ecd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:51.937036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b4434-9a51-4990-a5a8-853246b85ecd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:51.937522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b4434-9a51-4990-a5a8-853246b85ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:51.978824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bf6b4434-9a51-4990-a5a8-853246b85ecd None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:00:51.983675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bf6b4434-9a51-4990-a5a8-853246b85ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:52.240749 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3791/7633] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:00:52.278308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:52.326194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c917282-c2e7-4e38-9a25-6a38ff0b4368 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:52.328282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9c917282-c2e7-4e38-9a25-6a38ff0b4368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:52.377315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:52.546104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c917282-c2e7-4e38-9a25-6a38ff0b4368 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:52.557559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0a283-fcbc-4214-9b64-efe92be3995f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:52.558390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0a283-fcbc-4214-9b64-efe92be3995f service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:52.560467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0a283-fcbc-4214-9b64-efe92be3995f service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:52.562781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0a283-fcbc-4214-9b64-efe92be3995f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:52.585943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0a283-fcbc-4214-9b64-efe92be3995f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:52.588918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0a283-fcbc-4214-9b64-efe92be3995f service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:52.617789 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3843/7634] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:00:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:00:52.755085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:52.832742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:52.855566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:53.078850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:53.154677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:53.347408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:53.535709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:54.019857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:54.752687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:55.084234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:55.290909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:56.164031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b4434-9a51-4990-a5a8-853246b85ecd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:56.165712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bf6b4434-9a51-4990-a5a8-853246b85ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:00:56.189112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b4434-9a51-4990-a5a8-853246b85ecd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:56.193630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:56.194641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:56.195170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:56.195685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d admin admin] PATH_INFO: `/v3/projects/e5fbc696c2ad4069b2eb663a21db9df9` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:56.197307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5fbc696c2ad4069b2eb663a21db9df9)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:56.199609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:56.354922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5fbc696c2ad4069b2eb663a21db9df9', 'request_id': 'req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:56.368659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5fbc696c2ad4069b2eb663a21db9df9', 'request_id': 'req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:56.384649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5fbc696c2ad4069b2eb663a21db9df9', 'request_id': 'req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:56.523496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d admin admin] The token cache is being invalidate because project e5fbc696c2ad4069b2eb663a21db9df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:00:56.523913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:56.524696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:56.526512 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3792/7635] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:00:56 2022] DELETE /identity/v3/projects/e5fbc696c2ad4069b2eb663a21db9df9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:56.532028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0a283-fcbc-4214-9b64-efe92be3995f service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:00:56.545982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0a283-fcbc-4214-9b64-efe92be3995f service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:00:56.682408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d1176-17e2-4784-93a1-4a8319afcc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:00:56.683058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d1176-17e2-4784-93a1-4a8319afcc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:00:56.683333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d1176-17e2-4784-93a1-4a8319afcc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:00:56.683603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d1176-17e2-4784-93a1-4a8319afcc85 admin admin] PATH_INFO: `/v3/users/4ee2be8c3aed45cdb14f82fa1b04a699` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:00:56.687570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d1176-17e2-4784-93a1-4a8319afcc85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee2be8c3aed45cdb14f82fa1b04a699)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:00:56.690155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d1176-17e2-4784-93a1-4a8319afcc85 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:00:56.731180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:56.781452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:56.912649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-810d1176-17e2-4784-93a1-4a8319afcc85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee2be8c3aed45cdb14f82fa1b04a699'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:56.915056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-810d1176-17e2-4784-93a1-4a8319afcc85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee2be8c3aed45cdb14f82fa1b04a699'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:57.017929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-810d1176-17e2-4784-93a1-4a8319afcc85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee2be8c3aed45cdb14f82fa1b04a699'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:57.019960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-810d1176-17e2-4784-93a1-4a8319afcc85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee2be8c3aed45cdb14f82fa1b04a699'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:57.052861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-810d1176-17e2-4784-93a1-4a8319afcc85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee2be8c3aed45cdb14f82fa1b04a699'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:00:57.086568 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3844/7636] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:00:56 2022] DELETE /identity/v3/users/4ee2be8c3aed45cdb14f82fa1b04a699 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:00:57.095608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:57.667035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:57.936662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=16,keystone:SELECT=83,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:58.639915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:58.906794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:00:59.667324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:00.021529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:00.352127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:00.358566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:00.381749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af7935-bfe6-47cb-b2d6-76c011d6d05d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:00.561462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a7424-d249-4395-a2fa-d32b48fa154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:00.562236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a7424-d249-4395-a2fa-d32b48fa154e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:00.562521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a7424-d249-4395-a2fa-d32b48fa154e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:00.562795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a7424-d249-4395-a2fa-d32b48fa154e admin admin] PATH_INFO: `/v3/projects/d8405c0099c8430caa2c3b456ec1d585` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:00.565238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a7424-d249-4395-a2fa-d32b48fa154e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8405c0099c8430caa2c3b456ec1d585)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:00.567474 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a7424-d249-4395-a2fa-d32b48fa154e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:00.782159 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-805a7424-d249-4395-a2fa-d32b48fa154e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8405c0099c8430caa2c3b456ec1d585', 'request_id': 'req-805a7424-d249-4395-a2fa-d32b48fa154e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:00.815674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-805a7424-d249-4395-a2fa-d32b48fa154e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8405c0099c8430caa2c3b456ec1d585', 'request_id': 'req-805a7424-d249-4395-a2fa-d32b48fa154e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:00.831002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-805a7424-d249-4395-a2fa-d32b48fa154e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8405c0099c8430caa2c3b456ec1d585', 'request_id': 'req-805a7424-d249-4395-a2fa-d32b48fa154e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:00.919501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-805a7424-d249-4395-a2fa-d32b48fa154e admin admin] The token cache is being invalidate because project d8405c0099c8430caa2c3b456ec1d585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:01:00.919798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-805a7424-d249-4395-a2fa-d32b48fa154e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:00.924266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-805a7424-d249-4395-a2fa-d32b48fa154e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:00.924266 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3793/7637] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:01:00 2022] DELETE /identity/v3/projects/d8405c0099c8430caa2c3b456ec1d585 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:00.929032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12641ab3-f34b-4a31-b74e-c14f9e84eb20 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:00.929874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12641ab3-f34b-4a31-b74e-c14f9e84eb20 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:00.930311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12641ab3-f34b-4a31-b74e-c14f9e84eb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:00.982307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-12641ab3-f34b-4a31-b74e-c14f9e84eb20 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:00.985892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-12641ab3-f34b-4a31-b74e-c14f9e84eb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:01.108078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:01.189406 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3845/7638] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:01.202007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cd050-4c8f-4f9b-beeb-c0c96a00304d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:01.202007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cd050-4c8f-4f9b-beeb-c0c96a00304d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:01.202328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cd050-4c8f-4f9b-beeb-c0c96a00304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:01.252006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-680cd050-4c8f-4f9b-beeb-c0c96a00304d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:01.253692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-680cd050-4c8f-4f9b-beeb-c0c96a00304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:01.266281 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3794/7639] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:01.268710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12641ab3-f34b-4a31-b74e-c14f9e84eb20 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:01.282849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12641ab3-f34b-4a31-b74e-c14f9e84eb20 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:01.294776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee763d4-9640-4dde-be9b-eb61b4e3ca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:01.295431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee763d4-9640-4dde-be9b-eb61b4e3ca65 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:01.295702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee763d4-9640-4dde-be9b-eb61b4e3ca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:01.295976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee763d4-9640-4dde-be9b-eb61b4e3ca65 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:01.300990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee763d4-9640-4dde-be9b-eb61b4e3ca65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:01:01.302420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cd050-4c8f-4f9b-beeb-c0c96a00304d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:01.302935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee763d4-9640-4dde-be9b-eb61b4e3ca65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:01.304308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-680cd050-4c8f-4f9b-beeb-c0c96a00304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:01.307184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee763d4-9640-4dde-be9b-eb61b4e3ca65 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:01.355629 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3846/7640] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:01:01.367459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee763d4-9640-4dde-be9b-eb61b4e3ca65 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:01.384611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee763d4-9640-4dde-be9b-eb61b4e3ca65 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:01.393390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4560cc8-f8fe-41c2-9a6d-8362cfe079f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:01.394247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4560cc8-f8fe-41c2-9a6d-8362cfe079f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:01.394731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4560cc8-f8fe-41c2-9a6d-8362cfe079f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:01.395196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4560cc8-f8fe-41c2-9a6d-8362cfe079f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:01.396040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4560cc8-f8fe-41c2-9a6d-8362cfe079f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:01.403154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4560cc8-f8fe-41c2-9a6d-8362cfe079f9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:01.462896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cd050-4c8f-4f9b-beeb-c0c96a00304d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:01.472428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b13136-f800-47d5-a368-44394ccbfc7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:01.473598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b13136-f800-47d5-a368-44394ccbfc7e service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:01.474060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b13136-f800-47d5-a368-44394ccbfc7e service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:01.474481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b13136-f800-47d5-a368-44394ccbfc7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:01.477044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a0b13136-f800-47d5-a368-44394ccbfc7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:01.499255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b13136-f800-47d5-a368-44394ccbfc7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:01.501662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b13136-f800-47d5-a368-44394ccbfc7e service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:01.506581 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3847/7641] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:01 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:01.508222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646357a-5f8a-4ec9-8085-6647e0019238 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:01.511256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646357a-5f8a-4ec9-8085-6647e0019238 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:01.515131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646357a-5f8a-4ec9-8085-6647e0019238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:01.535533 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3795/7642] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:01:01.539028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62973df9-a198-4b74-937e-0fad5a23a84b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:01.541178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62973df9-a198-4b74-937e-0fad5a23a84b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:01.541638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62973df9-a198-4b74-937e-0fad5a23a84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:01.585200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-62973df9-a198-4b74-937e-0fad5a23a84b None None] MFA Rules not processed for user `f93cfb60764b472798894864bd7ac895`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:01.586988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-62973df9-a198-4b74-937e-0fad5a23a84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:01.587936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:01.617449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5646357a-5f8a-4ec9-8085-6647e0019238 None None] MFA Rules not processed for user `4277a37924e2483393c63e66e6bb37b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:01.618924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5646357a-5f8a-4ec9-8085-6647e0019238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:01.744113 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3796/7643] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:01.745361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62973df9-a198-4b74-937e-0fad5a23a84b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:01.856820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62973df9-a198-4b74-937e-0fad5a23a84b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:01.870425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bebea-c76f-4235-b58b-f1c047653773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:01.870425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bebea-c76f-4235-b58b-f1c047653773 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:01.870425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bebea-c76f-4235-b58b-f1c047653773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:01.870425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bebea-c76f-4235-b58b-f1c047653773 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:01.870931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598bebea-c76f-4235-b58b-f1c047653773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:01.874589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598bebea-c76f-4235-b58b-f1c047653773 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:01.876232 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3848/7644] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:01.878542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646357a-5f8a-4ec9-8085-6647e0019238 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:01.886713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5646357a-5f8a-4ec9-8085-6647e0019238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:02.004232 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3797/7645] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:01 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:02.004232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bebea-c76f-4235-b58b-f1c047653773 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:02.005985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-598bebea-c76f-4235-b58b-f1c047653773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:02.064450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646357a-5f8a-4ec9-8085-6647e0019238 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:02.080273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54500780-25f8-48b1-9feb-befb90c6d349 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:02.089202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54500780-25f8-48b1-9feb-befb90c6d349 service glance] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:02.089519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54500780-25f8-48b1-9feb-befb90c6d349 service glance] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:02.091818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54500780-25f8-48b1-9feb-befb90c6d349 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:02.122678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-54500780-25f8-48b1-9feb-befb90c6d349 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:02.226799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:02.312017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54500780-25f8-48b1-9feb-befb90c6d349 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:02.319968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54500780-25f8-48b1-9feb-befb90c6d349 service glance] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:02.345871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bebea-c76f-4235-b58b-f1c047653773 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:02.363503 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3849/7646] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:02.364804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54500780-25f8-48b1-9feb-befb90c6d349 service glance] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:02.373532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba7ab4-da17-46fb-af8c-b6f5e7c2d73b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:02.373807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba7ab4-da17-46fb-af8c-b6f5e7c2d73b service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:02.374093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba7ab4-da17-46fb-af8c-b6f5e7c2d73b service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:02.374369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba7ab4-da17-46fb-af8c-b6f5e7c2d73b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:02.379279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54500780-25f8-48b1-9feb-befb90c6d349 service glance] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:02.384755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5bba7ab4-da17-46fb-af8c-b6f5e7c2d73b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:02.421997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e323a-9b6f-42cb-a7e1-5a648525dabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:02.423038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e323a-9b6f-42cb-a7e1-5a648525dabb admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:02.423672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e323a-9b6f-42cb-a7e1-5a648525dabb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:02.424288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e323a-9b6f-42cb-a7e1-5a648525dabb admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:02.425524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e323a-9b6f-42cb-a7e1-5a648525dabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:02.427371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e323a-9b6f-42cb-a7e1-5a648525dabb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:02.445777 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3850/7647] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:02.455547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e323a-9b6f-42cb-a7e1-5a648525dabb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:02.494855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e323a-9b6f-42cb-a7e1-5a648525dabb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:02.509087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7199195-4392-4ad4-bdc0-2c547c578a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:02.509973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7199195-4392-4ad4-bdc0-2c547c578a50 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:02.510418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7199195-4392-4ad4-bdc0-2c547c578a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:02.510890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7199195-4392-4ad4-bdc0-2c547c578a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:02.511704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7199195-4392-4ad4-bdc0-2c547c578a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:02.513818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7199195-4392-4ad4-bdc0-2c547c578a50 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:02.541507 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3851/7648] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:02.543115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7199195-4392-4ad4-bdc0-2c547c578a50 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:02.557652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba7ab4-da17-46fb-af8c-b6f5e7c2d73b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:02.561531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba7ab4-da17-46fb-af8c-b6f5e7c2d73b service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:02.569128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7199195-4392-4ad4-bdc0-2c547c578a50 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:02.584048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07583bf-d622-413c-a852-c957d4f15b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:02.585086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07583bf-d622-413c-a852-c957d4f15b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:02.585531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07583bf-d622-413c-a852-c957d4f15b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:02.585970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07583bf-d622-413c-a852-c957d4f15b2b admin admin] PATH_INFO: `/v3/projects/e0fecfe4b04c4a77933c899660e619d3/users/25adbb2c63a143c2866259945c03352b/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:02.591363 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3798/7649] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:02.619333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07583bf-d622-413c-a852-c957d4f15b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fecfe4b04c4a77933c899660e619d3, user_id=25adbb2c63a143c2866259945c03352b, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:02.622583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07583bf-d622-413c-a852-c957d4f15b2b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:02.752476 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3852/7650] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:02 2022] PUT /identity/v3/projects/e0fecfe4b04c4a77933c899660e619d3/users/25adbb2c63a143c2866259945c03352b/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:02.753559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49365f08-2cb5-4958-9dcf-5cc0ee7fa39e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:02.753847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49365f08-2cb5-4958-9dcf-5cc0ee7fa39e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:02.754123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49365f08-2cb5-4958-9dcf-5cc0ee7fa39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:02.819883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-49365f08-2cb5-4958-9dcf-5cc0ee7fa39e None None] MFA Rules not processed for user `25adbb2c63a143c2866259945c03352b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:02.821160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-49365f08-2cb5-4958-9dcf-5cc0ee7fa39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:02.976535 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3799/7651] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:02.979947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07583bf-d622-413c-a852-c957d4f15b2b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:03.112224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07583bf-d622-413c-a852-c957d4f15b2b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:03.118809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8762f2-6b36-41d2-ae13-596124965379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:03.119448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8762f2-6b36-41d2-ae13-596124965379 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:03.119731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8762f2-6b36-41d2-ae13-596124965379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:03.120002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8762f2-6b36-41d2-ae13-596124965379 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:03.120729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8762f2-6b36-41d2-ae13-596124965379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:03.122940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8762f2-6b36-41d2-ae13-596124965379 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:03.289758 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3853/7652] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:02 2022] POST /identity/v3/projects => generated 381 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:01:03.293685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49365f08-2cb5-4958-9dcf-5cc0ee7fa39e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:03.315351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49365f08-2cb5-4958-9dcf-5cc0ee7fa39e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:03.409653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:03.427689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af6ae3-cfb7-4016-a0cc-2519fed52b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:03.428812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af6ae3-cfb7-4016-a0cc-2519fed52b76 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:03.430119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af6ae3-cfb7-4016-a0cc-2519fed52b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:03.430624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af6ae3-cfb7-4016-a0cc-2519fed52b76 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:03.433247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af6ae3-cfb7-4016-a0cc-2519fed52b76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:03.437115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af6ae3-cfb7-4016-a0cc-2519fed52b76 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:03.444432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:03.569926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ebc89-56a7-4257-abcc-c2829bcb30e4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:03.570251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ebc89-56a7-4257-abcc-c2829bcb30e4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:03.570580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ebc89-56a7-4257-abcc-c2829bcb30e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:03.630714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0d6ebc89-56a7-4257-abcc-c2829bcb30e4 None None] MFA Rules not processed for user `346801cb8db44f118fcacaa356cc8ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:03.632227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0d6ebc89-56a7-4257-abcc-c2829bcb30e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:03.645424 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3800/7653] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:03 2022] POST /identity/v3/users => generated 297 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:03.649545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af6ae3-cfb7-4016-a0cc-2519fed52b76 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:03.672621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af6ae3-cfb7-4016-a0cc-2519fed52b76 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:03.686995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f43f78-d017-4b70-983f-f95b7dfda402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:03.693170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f43f78-d017-4b70-983f-f95b7dfda402 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:03.693630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f43f78-d017-4b70-983f-f95b7dfda402 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:03.696212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f43f78-d017-4b70-983f-f95b7dfda402 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:03.697660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f43f78-d017-4b70-983f-f95b7dfda402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:03.699874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f43f78-d017-4b70-983f-f95b7dfda402 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:03.745479 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3801/7654] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:03.746508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f43f78-d017-4b70-983f-f95b7dfda402 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:03.752530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f8f43f78-d017-4b70-983f-f95b7dfda402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:03.834539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f43f78-d017-4b70-983f-f95b7dfda402 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:03.841400 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3854/7655] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:03.842410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ebc89-56a7-4257-abcc-c2829bcb30e4 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:03.846258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab60317-6c67-49cf-8b2a-a39aa2453bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:03.850589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab60317-6c67-49cf-8b2a-a39aa2453bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:03.864102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab60317-6c67-49cf-8b2a-a39aa2453bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:03.864432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab60317-6c67-49cf-8b2a-a39aa2453bf5 admin admin] PATH_INFO: `/v3/users/1ba95368e9964d7685547c0792a87d30` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:03.872961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab60317-6c67-49cf-8b2a-a39aa2453bf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ba95368e9964d7685547c0792a87d30)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:03.880678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab60317-6c67-49cf-8b2a-a39aa2453bf5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:03.891748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ebc89-56a7-4257-abcc-c2829bcb30e4 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:03.907158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146e785-7ec7-4fe6-b848-112bd3945409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:03.907814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e785-7ec7-4fe6-b848-112bd3945409 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:03.910312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e785-7ec7-4fe6-b848-112bd3945409 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:03.910783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e785-7ec7-4fe6-b848-112bd3945409 admin admin] PATH_INFO: `/v3/projects/9a15351348924323828daed3e3ad63d2/users/a5e57c37854b4ae0b2a60fd02bc3f19b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:03.990540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146e785-7ec7-4fe6-b848-112bd3945409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a15351348924323828daed3e3ad63d2, user_id=a5e57c37854b4ae0b2a60fd02bc3f19b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:03.998140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146e785-7ec7-4fe6-b848-112bd3945409 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:04.125788 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3855/7656] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:03 2022] PUT /identity/v3/projects/9a15351348924323828daed3e3ad63d2/users/a5e57c37854b4ae0b2a60fd02bc3f19b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:04.128100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0706c2-e99a-4858-8c0f-b9fce44c4e58 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:04.129383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0706c2-e99a-4858-8c0f-b9fce44c4e58 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:04.129847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0706c2-e99a-4858-8c0f-b9fce44c4e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:04.144593 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-2a0706c2-e99a-4858-8c0f-b9fce44c4e58 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:01:04.144593 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:01:04.144593 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:01:04.144593 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:01:04.144593 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:01:04.144593 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:01:04.144593 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:01:04.144593 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:01:04.144593 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:01:04.144593 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:01:04.144593 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:01:04.144593 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:01:04.144593 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:01:04.145842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:01:04.145842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:01:04.145842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:01:04.145842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:01:04.145842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:01:04.145842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:01:04.145842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:01:04.145842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:01:04.145842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:01:04.145842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:01:04.145842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:01:04.145842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:01:04.145842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:01:04.145842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:01:04.145842 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 05:01:04.150067 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3856/7657] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:01:04 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 23 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:01:04.152775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0706c2-e99a-4858-8c0f-b9fce44c4e58 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:04.167189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2a0706c2-e99a-4858-8c0f-b9fce44c4e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:04.229083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cab60317-6c67-49cf-8b2a-a39aa2453bf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ba95368e9964d7685547c0792a87d30'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:04.352342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cab60317-6c67-49cf-8b2a-a39aa2453bf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ba95368e9964d7685547c0792a87d30'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:04.353260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cab60317-6c67-49cf-8b2a-a39aa2453bf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ba95368e9964d7685547c0792a87d30'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:04.363870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cab60317-6c67-49cf-8b2a-a39aa2453bf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ba95368e9964d7685547c0792a87d30'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:04.378887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0706c2-e99a-4858-8c0f-b9fce44c4e58 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:04.386670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cdf42-2a1f-42f2-911f-c1fb83700c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:04.388044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cdf42-2a1f-42f2-911f-c1fb83700c78 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:04.388843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cdf42-2a1f-42f2-911f-c1fb83700c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:04.392706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cdf42-2a1f-42f2-911f-c1fb83700c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:04.392905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cab60317-6c67-49cf-8b2a-a39aa2453bf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ba95368e9964d7685547c0792a87d30'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:04.395940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cdf42-2a1f-42f2-911f-c1fb83700c78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:04.401144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cdf42-2a1f-42f2-911f-c1fb83700c78 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:04.415832 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3802/7658] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:01:03 2022] DELETE /identity/v3/users/1ba95368e9964d7685547c0792a87d30 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:04.422158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab60317-6c67-49cf-8b2a-a39aa2453bf5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:04.428612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cab60317-6c67-49cf-8b2a-a39aa2453bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:04.546469 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3857/7659] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:04 2022] POST /identity/v3/projects => generated 373 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:04.548794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00e4ae-b401-4ed2-8700-f61335bed94e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:04.549100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00e4ae-b401-4ed2-8700-f61335bed94e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:04.551970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00e4ae-b401-4ed2-8700-f61335bed94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:04.604395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab60317-6c67-49cf-8b2a-a39aa2453bf5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:04.614906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0e00e4ae-b401-4ed2-8700-f61335bed94e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:04.616198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0e00e4ae-b401-4ed2-8700-f61335bed94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:04.740571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2ba81-2a49-49ef-9eea-3e1f867ea1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:04.741214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2ba81-2a49-49ef-9eea-3e1f867ea1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:04.741869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2ba81-2a49-49ef-9eea-3e1f867ea1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:04.745835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2ba81-2a49-49ef-9eea-3e1f867ea1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:04.745835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2ba81-2a49-49ef-9eea-3e1f867ea1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:04.745835 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2ba81-2a49-49ef-9eea-3e1f867ea1c6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:04.757367 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3803/7660] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:04.758738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2ba81-2a49-49ef-9eea-3e1f867ea1c6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:04.761098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-85d2ba81-2a49-49ef-9eea-3e1f867ea1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:04.780742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2ba81-2a49-49ef-9eea-3e1f867ea1c6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:04.784932 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3858/7661] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:04.784932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00e4ae-b401-4ed2-8700-f61335bed94e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:04.794806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8e9fc-965a-41ee-ab28-bb297c589cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:04.794806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8e9fc-965a-41ee-ab28-bb297c589cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:04.799713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8e9fc-965a-41ee-ab28-bb297c589cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:04.799713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8e9fc-965a-41ee-ab28-bb297c589cc2 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:04.799713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8e9fc-965a-41ee-ab28-bb297c589cc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:04.806269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8e9fc-965a-41ee-ab28-bb297c589cc2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:04.815492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:04.834144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00e4ae-b401-4ed2-8700-f61335bed94e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:04.846245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506d843-0553-4ab7-a619-0e766ced512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:04.846957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506d843-0553-4ab7-a619-0e766ced512f admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:04.847221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506d843-0553-4ab7-a619-0e766ced512f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:04.851718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506d843-0553-4ab7-a619-0e766ced512f admin admin] PATH_INFO: `/v3/projects/9a15351348924323828daed3e3ad63d2/users/a5e57c37854b4ae0b2a60fd02bc3f19b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:04.856968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506d843-0553-4ab7-a619-0e766ced512f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a15351348924323828daed3e3ad63d2, user_id=a5e57c37854b4ae0b2a60fd02bc3f19b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:04.863214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506d843-0553-4ab7-a619-0e766ced512f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:04.892901 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3859/7662] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:04 2022] PUT /identity/v3/projects/9a15351348924323828daed3e3ad63d2/users/a5e57c37854b4ae0b2a60fd02bc3f19b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:04.894970 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506d843-0553-4ab7-a619-0e766ced512f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:04.900209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7506d843-0553-4ab7-a619-0e766ced512f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:04.966550 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3804/7663] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:04 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:04.967884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27742d68-9fcd-41f2-9fc3-006ecd1c4edd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:04.968183 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27742d68-9fcd-41f2-9fc3-006ecd1c4edd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:04.970879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27742d68-9fcd-41f2-9fc3-006ecd1c4edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:05.078988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-27742d68-9fcd-41f2-9fc3-006ecd1c4edd None None] MFA Rules not processed for user `a5e57c37854b4ae0b2a60fd02bc3f19b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:05.083715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-27742d68-9fcd-41f2-9fc3-006ecd1c4edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:05.126217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506d843-0553-4ab7-a619-0e766ced512f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:05.137842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02559e0-7f4b-4c73-91eb-7f69ac6aad6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:05.144390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02559e0-7f4b-4c73-91eb-7f69ac6aad6a service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:05.144684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02559e0-7f4b-4c73-91eb-7f69ac6aad6a service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:05.149098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02559e0-7f4b-4c73-91eb-7f69ac6aad6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:05.175548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:05.352385 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3805/7664] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:05.353263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27742d68-9fcd-41f2-9fc3-006ecd1c4edd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:05.383038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02559e0-7f4b-4c73-91eb-7f69ac6aad6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:05.386285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02559e0-7f4b-4c73-91eb-7f69ac6aad6a service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:05.400387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27742d68-9fcd-41f2-9fc3-006ecd1c4edd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:05.408616 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3860/7665] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:05.409529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02559e0-7f4b-4c73-91eb-7f69ac6aad6a service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:05.412866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa0002-9d3f-4f90-be24-5ffbef3e7e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:05.413589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b02559e0-7f4b-4c73-91eb-7f69ac6aad6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:05.413748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa0002-9d3f-4f90-be24-5ffbef3e7e56 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:05.413748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa0002-9d3f-4f90-be24-5ffbef3e7e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:05.413961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa0002-9d3f-4f90-be24-5ffbef3e7e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:05.418177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa0002-9d3f-4f90-be24-5ffbef3e7e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:05.423741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa0002-9d3f-4f90-be24-5ffbef3e7e56 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:05.459514 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3806/7666] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:05.461798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa0002-9d3f-4f90-be24-5ffbef3e7e56 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:05.496623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa0002-9d3f-4f90-be24-5ffbef3e7e56 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:05.513398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64810a0a-4f20-4171-81b6-7ad5dcf9b66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:05.514111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64810a0a-4f20-4171-81b6-7ad5dcf9b66d admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:05.514634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64810a0a-4f20-4171-81b6-7ad5dcf9b66d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:05.514922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64810a0a-4f20-4171-81b6-7ad5dcf9b66d admin admin] PATH_INFO: `/v3/projects/d1ee6f822ff5481caf67a8f7ac4fc5de/users/6a6f3651e3fe4f3aa2467134c1776afb/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:05.563680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64810a0a-4f20-4171-81b6-7ad5dcf9b66d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ee6f822ff5481caf67a8f7ac4fc5de, user_id=6a6f3651e3fe4f3aa2467134c1776afb, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:05.570280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64810a0a-4f20-4171-81b6-7ad5dcf9b66d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:05.581463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:05.659645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02559e0-7f4b-4c73-91eb-7f69ac6aad6a service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:05.681377 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3807/7667] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:05 2022] PUT /identity/v3/projects/d1ee6f822ff5481caf67a8f7ac4fc5de/users/6a6f3651e3fe4f3aa2467134c1776afb/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:05.683620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64810a0a-4f20-4171-81b6-7ad5dcf9b66d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:05.689352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558dfa3-fc1b-40dd-b9ad-994d0fb11c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:05.692719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558dfa3-fc1b-40dd-b9ad-994d0fb11c01 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:05.696106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558dfa3-fc1b-40dd-b9ad-994d0fb11c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:05.696666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558dfa3-fc1b-40dd-b9ad-994d0fb11c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:05.747433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558dfa3-fc1b-40dd-b9ad-994d0fb11c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:05.756594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558dfa3-fc1b-40dd-b9ad-994d0fb11c01 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:05.807880 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3861/7668] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:05.827998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:05.899197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64810a0a-4f20-4171-81b6-7ad5dcf9b66d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:05.916944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db26e1b-f6c4-4fac-a241-3bd9e3a39891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:05.916944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db26e1b-f6c4-4fac-a241-3bd9e3a39891 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:05.916944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db26e1b-f6c4-4fac-a241-3bd9e3a39891 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:05.916944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db26e1b-f6c4-4fac-a241-3bd9e3a39891 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:05.920388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db26e1b-f6c4-4fac-a241-3bd9e3a39891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:05.923424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db26e1b-f6c4-4fac-a241-3bd9e3a39891 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:05.960714 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3808/7669] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:05.969115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558dfa3-fc1b-40dd-b9ad-994d0fb11c01 service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:06.004801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558dfa3-fc1b-40dd-b9ad-994d0fb11c01 service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:06.018196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe8916-6ad0-420a-89cb-89715e2616d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:06.018894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8916-6ad0-420a-89cb-89715e2616d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:06.019172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8916-6ad0-420a-89cb-89715e2616d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:06.019443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8916-6ad0-420a-89cb-89715e2616d3 admin admin] PATH_INFO: `/v3/projects/d1ee6f822ff5481caf67a8f7ac4fc5de/users/6a6f3651e3fe4f3aa2467134c1776afb/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:06.024776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe8916-6ad0-420a-89cb-89715e2616d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ee6f822ff5481caf67a8f7ac4fc5de, user_id=6a6f3651e3fe4f3aa2467134c1776afb, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:06.028005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe8916-6ad0-420a-89cb-89715e2616d3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:06.080366 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3862/7670] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:05 2022] PUT /identity/v3/projects/d1ee6f822ff5481caf67a8f7ac4fc5de/users/6a6f3651e3fe4f3aa2467134c1776afb/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:06.667553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:07.175732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db26e1b-f6c4-4fac-a241-3bd9e3a39891 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:07.359681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db26e1b-f6c4-4fac-a241-3bd9e3a39891 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:07.454389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:07.494694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c997805-1115-47bb-8901-b0c3954cb32c tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e57c37854b4ae0b2a60fd02bc3f19b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a15351348924323828daed3e3ad63d2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:07.495325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c997805-1115-47bb-8901-b0c3954cb32c tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:07.495611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c997805-1115-47bb-8901-b0c3954cb32c tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:07.495893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c997805-1115-47bb-8901-b0c3954cb32c tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:07.497243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c997805-1115-47bb-8901-b0c3954cb32c tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:01:07.497559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c997805-1115-47bb-8901-b0c3954cb32c tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:07.499189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c997805-1115-47bb-8901-b0c3954cb32c tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:07.545819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe8916-6ad0-420a-89cb-89715e2616d3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:07.547099 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3809/7671] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:01:07.557453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe8916-6ad0-420a-89cb-89715e2616d3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:07.571786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4bdfb-dc8a-4f4e-8db0-9818c89f697d tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e57c37854b4ae0b2a60fd02bc3f19b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a15351348924323828daed3e3ad63d2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:07.572458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4bdfb-dc8a-4f4e-8db0-9818c89f697d tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:07.572738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4bdfb-dc8a-4f4e-8db0-9818c89f697d tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:07.573227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4bdfb-dc8a-4f4e-8db0-9818c89f697d tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:07.574107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4bdfb-dc8a-4f4e-8db0-9818c89f697d tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:07.576353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4bdfb-dc8a-4f4e-8db0-9818c89f697d tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:07.964328 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3863/7672] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:07 2022] POST /identity/v3/projects => generated 354 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:01:07.969639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c997805-1115-47bb-8901-b0c3954cb32c tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:07.980096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c997805-1115-47bb-8901-b0c3954cb32c tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:08.129566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d0bda-5e05-4ac9-aa66-777565b5aea8 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e57c37854b4ae0b2a60fd02bc3f19b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a15351348924323828daed3e3ad63d2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:08.132731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d0bda-5e05-4ac9-aa66-777565b5aea8 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:08.132731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d0bda-5e05-4ac9-aa66-777565b5aea8 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:08.132731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d0bda-5e05-4ac9-aa66-777565b5aea8 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:08.132731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d0bda-5e05-4ac9-aa66-777565b5aea8 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:01:08.132731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d0bda-5e05-4ac9-aa66-777565b5aea8 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:08.142071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d0bda-5e05-4ac9-aa66-777565b5aea8 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:08.173669 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3810/7673] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:01:08.269102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4bdfb-dc8a-4f4e-8db0-9818c89f697d tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:08.284243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4bdfb-dc8a-4f4e-8db0-9818c89f697d tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:08.299847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e57c37854b4ae0b2a60fd02bc3f19b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a15351348924323828daed3e3ad63d2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:08.300795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:08.301079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:08.301353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] PATH_INFO: `/v3/projects/3813ac8f5ed44c1880941305a1694b61` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:08.302681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3813ac8f5ed44c1880941305a1694b61)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:08.305053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:08.510671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3813ac8f5ed44c1880941305a1694b61', 'request_id': 'req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:08.511283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3813ac8f5ed44c1880941305a1694b61', 'request_id': 'req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:08.606777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d0bda-5e05-4ac9-aa66-777565b5aea8 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:08.614094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-251d0bda-5e05-4ac9-aa66-777565b5aea8 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:08.643457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3813ac8f5ed44c1880941305a1694b61', 'request_id': 'req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:08.668382 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] The token cache is being invalidate because project 3813ac8f5ed44c1880941305a1694b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:01:08.674582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:08.678279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:08.712393 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3864/7674] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:01:08 2022] DELETE /identity/v3/projects/3813ac8f5ed44c1880941305a1694b61 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:08.866931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d0bda-5e05-4ac9-aa66-777565b5aea8 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:09.238067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:09.318493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cdaf5-d657-41cd-aee6-4f4032c27d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:09.319170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cdaf5-d657-41cd-aee6-4f4032c27d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:09.319500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cdaf5-d657-41cd-aee6-4f4032c27d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:09.320097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cdaf5-d657-41cd-aee6-4f4032c27d2e admin admin] PATH_INFO: `/v3/projects/1d0109415e794b52b25a509d7b89f6ff` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:09.322401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cdaf5-d657-41cd-aee6-4f4032c27d2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d0109415e794b52b25a509d7b89f6ff)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:09.325684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cdaf5-d657-41cd-aee6-4f4032c27d2e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:09.604613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a66cdaf5-d657-41cd-aee6-4f4032c27d2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d0109415e794b52b25a509d7b89f6ff', 'request_id': 'req-a66cdaf5-d657-41cd-aee6-4f4032c27d2e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:09.605344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:09.607067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:09.614041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a66cdaf5-d657-41cd-aee6-4f4032c27d2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d0109415e794b52b25a509d7b89f6ff', 'request_id': 'req-a66cdaf5-d657-41cd-aee6-4f4032c27d2e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:09.621858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a66cdaf5-d657-41cd-aee6-4f4032c27d2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d0109415e794b52b25a509d7b89f6ff', 'request_id': 'req-a66cdaf5-d657-41cd-aee6-4f4032c27d2e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:09.626282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c7ecb-1fd3-4d7f-951a-3d529d8c5140 tempest-VolumeQuotaClassesTest-1276123533 tempest-VolumeQuotaClassesTest-1276123533-project-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:09.728981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a66cdaf5-d657-41cd-aee6-4f4032c27d2e admin admin] The token cache is being invalidate because project 1d0109415e794b52b25a509d7b89f6ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:01:09.728981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a66cdaf5-d657-41cd-aee6-4f4032c27d2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:09.728981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a66cdaf5-d657-41cd-aee6-4f4032c27d2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:09.729650 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3811/7675] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:01:08 2022] DELETE /identity/v3/projects/1d0109415e794b52b25a509d7b89f6ff => generated 0 bytes in 1123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:09.734626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21525dc9-b309-4206-8209-4e144a4bcaad None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:09.734908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21525dc9-b309-4206-8209-4e144a4bcaad None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:09.736035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21525dc9-b309-4206-8209-4e144a4bcaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:09.765210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82549fa3-371d-4a5e-b761-cb405a9d7cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:09.774579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82549fa3-371d-4a5e-b761-cb405a9d7cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:09.774579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82549fa3-371d-4a5e-b761-cb405a9d7cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:09.774579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82549fa3-371d-4a5e-b761-cb405a9d7cd0 admin admin] PATH_INFO: `/v3/users/25adbb2c63a143c2866259945c03352b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:09.776471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82549fa3-371d-4a5e-b761-cb405a9d7cd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25adbb2c63a143c2866259945c03352b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:09.781389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82549fa3-371d-4a5e-b761-cb405a9d7cd0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:09.810944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-21525dc9-b309-4206-8209-4e144a4bcaad None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:09.812426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-21525dc9-b309-4206-8209-4e144a4bcaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:09.842412 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3812/7676] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:09.843444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21525dc9-b309-4206-8209-4e144a4bcaad None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:09.845068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-21525dc9-b309-4206-8209-4e144a4bcaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:09.869857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21525dc9-b309-4206-8209-4e144a4bcaad None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:09.889441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d125fe-cec6-477f-829e-d26cbb700417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:09.891827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d125fe-cec6-477f-829e-d26cbb700417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:09.894046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d125fe-cec6-477f-829e-d26cbb700417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:09.895877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d125fe-cec6-477f-829e-d26cbb700417 admin admin] PATH_INFO: `/v3/users/139b3aa4329d470f96cd67ba4425f62a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:09.896775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d125fe-cec6-477f-829e-d26cbb700417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=139b3aa4329d470f96cd67ba4425f62a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:09.899965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d125fe-cec6-477f-829e-d26cbb700417 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:10.076901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-82549fa3-371d-4a5e-b761-cb405a9d7cd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25adbb2c63a143c2866259945c03352b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:10.078420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-82549fa3-371d-4a5e-b761-cb405a9d7cd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25adbb2c63a143c2866259945c03352b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:10.187044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-82549fa3-371d-4a5e-b761-cb405a9d7cd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25adbb2c63a143c2866259945c03352b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:10.194496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-82549fa3-371d-4a5e-b761-cb405a9d7cd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25adbb2c63a143c2866259945c03352b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:10.204224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-82549fa3-371d-4a5e-b761-cb405a9d7cd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25adbb2c63a143c2866259945c03352b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:10.230793 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3865/7677] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:01:09 2022] DELETE /identity/v3/users/25adbb2c63a143c2866259945c03352b => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:10.233472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05087b12-4b77-44c1-b678-b368efbbe983 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:10.234007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05087b12-4b77-44c1-b678-b368efbbe983 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:10.234448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05087b12-4b77-44c1-b678-b368efbbe983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:10.248620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:10.262752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-66d125fe-cec6-477f-829e-d26cbb700417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139b3aa4329d470f96cd67ba4425f62a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:10.266671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-05087b12-4b77-44c1-b678-b368efbbe983 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:10.268729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-05087b12-4b77-44c1-b678-b368efbbe983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:10.352179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-66d125fe-cec6-477f-829e-d26cbb700417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139b3aa4329d470f96cd67ba4425f62a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:10.354604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-66d125fe-cec6-477f-829e-d26cbb700417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139b3aa4329d470f96cd67ba4425f62a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:10.373811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-66d125fe-cec6-477f-829e-d26cbb700417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139b3aa4329d470f96cd67ba4425f62a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:10.383466 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3866/7678] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:10.384871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8844f78-ab05-4a69-ae29-58e550e11f61 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:10.385347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8844f78-ab05-4a69-ae29-58e550e11f61 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:10.385804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8844f78-ab05-4a69-ae29-58e550e11f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:10.417568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a8844f78-ab05-4a69-ae29-58e550e11f61 None None] MFA Rules not processed for user `c9ecfdc3b09e4ea1b7b27867dd69c1ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:10.420553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a8844f78-ab05-4a69-ae29-58e550e11f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:10.420917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-66d125fe-cec6-477f-829e-d26cbb700417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139b3aa4329d470f96cd67ba4425f62a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:10.440452 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3813/7679] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:01:09 2022] DELETE /identity/v3/users/139b3aa4329d470f96cd67ba4425f62a => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:10.442662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba070ee5-3c49-47f7-abdf-60f424887b33 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:10.444643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba070ee5-3c49-47f7-abdf-60f424887b33 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:10.447180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba070ee5-3c49-47f7-abdf-60f424887b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:10.502663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ba070ee5-3c49-47f7-abdf-60f424887b33 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:10.505907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ba070ee5-3c49-47f7-abdf-60f424887b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:10.567819 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3867/7680] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:10.569065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8844f78-ab05-4a69-ae29-58e550e11f61 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:10.572226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a8844f78-ab05-4a69-ae29-58e550e11f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:10.624541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8844f78-ab05-4a69-ae29-58e550e11f61 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:10.671293 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3814/7681] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:10.678934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2cb54-b721-453c-ba20-d20b7494feac None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:10.679277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2cb54-b721-453c-ba20-d20b7494feac None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:10.679554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2cb54-b721-453c-ba20-d20b7494feac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:10.709869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f4c2cb54-b721-453c-ba20-d20b7494feac None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:10.711286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f4c2cb54-b721-453c-ba20-d20b7494feac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:10.720800 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3815/7682] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:10.722034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2cb54-b721-453c-ba20-d20b7494feac None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:10.723468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f4c2cb54-b721-453c-ba20-d20b7494feac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:10.737135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a43963-cafc-49d0-a350-b692dfd0bdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:10.738334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a43963-cafc-49d0-a350-b692dfd0bdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:10.738695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a43963-cafc-49d0-a350-b692dfd0bdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:10.738996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a43963-cafc-49d0-a350-b692dfd0bdc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:10.739667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a43963-cafc-49d0-a350-b692dfd0bdc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:01:10.739973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a43963-cafc-49d0-a350-b692dfd0bdc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:10.741672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a43963-cafc-49d0-a350-b692dfd0bdc2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:10.763584 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3868/7683] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:01:10.765274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a43963-cafc-49d0-a350-b692dfd0bdc2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:10.767947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-40a43963-cafc-49d0-a350-b692dfd0bdc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:10.804957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2cb54-b721-453c-ba20-d20b7494feac None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:10.809292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923c030-c575-48e8-8198-80b20eb2408f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:10.809877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923c030-c575-48e8-8198-80b20eb2408f service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:10.810172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923c030-c575-48e8-8198-80b20eb2408f service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:10.810444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923c030-c575-48e8-8198-80b20eb2408f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:10.812297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8923c030-c575-48e8-8198-80b20eb2408f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:10.844101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a43963-cafc-49d0-a350-b692dfd0bdc2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:10.848840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787adb7d-77d2-4cb5-942a-35a433b96569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:10.851945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787adb7d-77d2-4cb5-942a-35a433b96569 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:10.852501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787adb7d-77d2-4cb5-942a-35a433b96569 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:10.853008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787adb7d-77d2-4cb5-942a-35a433b96569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:10.866427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787adb7d-77d2-4cb5-942a-35a433b96569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:10.868930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787adb7d-77d2-4cb5-942a-35a433b96569 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:10.882364 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3869/7684] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:10.883587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787adb7d-77d2-4cb5-942a-35a433b96569 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:10.901431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787adb7d-77d2-4cb5-942a-35a433b96569 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:10.908062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab04329-8f6f-4b8d-9cd4-7c1b719c357b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:10.910833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab04329-8f6f-4b8d-9cd4-7c1b719c357b service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:10.910833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab04329-8f6f-4b8d-9cd4-7c1b719c357b service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:10.910833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab04329-8f6f-4b8d-9cd4-7c1b719c357b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:10.923007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab04329-8f6f-4b8d-9cd4-7c1b719c357b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:10.925024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab04329-8f6f-4b8d-9cd4-7c1b719c357b service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:10.936318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923c030-c575-48e8-8198-80b20eb2408f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:10.940475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923c030-c575-48e8-8198-80b20eb2408f service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:10.953254 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3870/7685] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:10.954596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab04329-8f6f-4b8d-9cd4-7c1b719c357b service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:10.975179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab04329-8f6f-4b8d-9cd4-7c1b719c357b service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:10.990336 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3816/7686] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:10.997231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4c559-ef43-470b-a747-a19dd5fcfa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:10.997996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4c559-ef43-470b-a747-a19dd5fcfa20 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:10.998846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4c559-ef43-470b-a747-a19dd5fcfa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:10.999297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4c559-ef43-470b-a747-a19dd5fcfa20 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:11.000065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4c559-ef43-470b-a747-a19dd5fcfa20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:11.005192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4c559-ef43-470b-a747-a19dd5fcfa20 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:11.176776 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3871/7687] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:10 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:11.181727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923c030-c575-48e8-8198-80b20eb2408f service glance] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:11.198223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923c030-c575-48e8-8198-80b20eb2408f service glance] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:11.419387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:11.420516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae673ed0-c733-4f11-aef7-306cfe4a78f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:11.422161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae673ed0-c733-4f11-aef7-306cfe4a78f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:11.423966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae673ed0-c733-4f11-aef7-306cfe4a78f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:11.424272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae673ed0-c733-4f11-aef7-306cfe4a78f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:11.425026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae673ed0-c733-4f11-aef7-306cfe4a78f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:11.428672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae673ed0-c733-4f11-aef7-306cfe4a78f9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:11.584789 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3817/7688] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:11 2022] POST /identity/v3/users => generated 291 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:11.590324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4c559-ef43-470b-a747-a19dd5fcfa20 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:11.614253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4c559-ef43-470b-a747-a19dd5fcfa20 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:11.625973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb579c-65be-46d7-a246-2558dc321d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:11.627344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb579c-65be-46d7-a246-2558dc321d59 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:11.627810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb579c-65be-46d7-a246-2558dc321d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:11.628311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb579c-65be-46d7-a246-2558dc321d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:11.629141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb579c-65be-46d7-a246-2558dc321d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:11.631357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb579c-65be-46d7-a246-2558dc321d59 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:11.649743 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3872/7689] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:11.653974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae673ed0-c733-4f11-aef7-306cfe4a78f9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:11.667741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae673ed0-c733-4f11-aef7-306cfe4a78f9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:11.682670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fad52a-18ba-4a06-a395-97b7f80f6469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:11.683607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fad52a-18ba-4a06-a395-97b7f80f6469 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:11.684678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fad52a-18ba-4a06-a395-97b7f80f6469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:11.685138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fad52a-18ba-4a06-a395-97b7f80f6469 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:11.686184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fad52a-18ba-4a06-a395-97b7f80f6469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:11.689263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fad52a-18ba-4a06-a395-97b7f80f6469 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:11.728229 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3818/7690] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:11.729529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb579c-65be-46d7-a246-2558dc321d59 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:11.750675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb579c-65be-46d7-a246-2558dc321d59 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:11.765497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270a1d2-3563-4f8d-adc8-526fd1da6fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:11.766387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270a1d2-3563-4f8d-adc8-526fd1da6fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:11.766712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270a1d2-3563-4f8d-adc8-526fd1da6fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:11.766940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270a1d2-3563-4f8d-adc8-526fd1da6fa8 admin admin] PATH_INFO: `/v3/projects/f78e003d1f0a4743bcd0ae0880f4402c/users/b3fc0e860bcc4e1f8aa732017784b7c3/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:11.807656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270a1d2-3563-4f8d-adc8-526fd1da6fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78e003d1f0a4743bcd0ae0880f4402c, user_id=b3fc0e860bcc4e1f8aa732017784b7c3, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:11.814732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270a1d2-3563-4f8d-adc8-526fd1da6fa8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:11.955871 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3873/7691] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:11 2022] PUT /identity/v3/projects/f78e003d1f0a4743bcd0ae0880f4402c/users/b3fc0e860bcc4e1f8aa732017784b7c3/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:11.956997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd5df-b4f2-4fbc-95ac-1ace8f51675c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:11.956997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd5df-b4f2-4fbc-95ac-1ace8f51675c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:11.957336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd5df-b4f2-4fbc-95ac-1ace8f51675c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:12.040012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-364dd5df-b4f2-4fbc-95ac-1ace8f51675c None None] MFA Rules not processed for user `b3fc0e860bcc4e1f8aa732017784b7c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:12.041410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-364dd5df-b4f2-4fbc-95ac-1ace8f51675c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:12.140255 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3819/7692] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:12.144979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270a1d2-3563-4f8d-adc8-526fd1da6fa8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:12.215111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:12.296451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270a1d2-3563-4f8d-adc8-526fd1da6fa8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:12.304529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91115c6d-9155-43b4-8544-0382be1ed6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:12.305565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115c6d-9155-43b4-8544-0382be1ed6ac admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:12.305873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115c6d-9155-43b4-8544-0382be1ed6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:12.306125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115c6d-9155-43b4-8544-0382be1ed6ac admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:12.306772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91115c6d-9155-43b4-8544-0382be1ed6ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:12.312592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91115c6d-9155-43b4-8544-0382be1ed6ac admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:12.463829 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3874/7693] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:12 2022] POST /identity/v3/projects => generated 381 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:12.466817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dd5df-b4f2-4fbc-95ac-1ace8f51675c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:12.491940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dd5df-b4f2-4fbc-95ac-1ace8f51675c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:12.601952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84e250-f348-4497-8004-1dbeb22e3917 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:12.602241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84e250-f348-4497-8004-1dbeb22e3917 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:12.602519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84e250-f348-4497-8004-1dbeb22e3917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:12.621114 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-0c84e250-f348-4497-8004-1dbeb22e3917 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:01:12.621114 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:01:12.621114 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:01:12.621114 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:01:12.621114 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:01:12.621114 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:01:12.621114 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:01:12.621114 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:01:12.621114 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:01:12.621114 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:01:12.621114 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:01:12.621114 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:01:12.621114 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:01:12.626899 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:01:12.626899 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:01:12.626899 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:01:12.626899 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:01:12.626899 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:01:12.626899 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:01:12.626899 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:01:12.626899 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:01:12.626899 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:01:12.626899 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:01:12.626899 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:01:12.626899 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:01:12.626899 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:01:12.626899 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:01:12.626899 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 05:01:12.655935 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3875/7694] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:01:12 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 33 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 05:01:12.706276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef88fc-bada-483d-8d25-492841de3b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:12.707291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef88fc-bada-483d-8d25-492841de3b14 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:12.707794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef88fc-bada-483d-8d25-492841de3b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:12.708298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef88fc-bada-483d-8d25-492841de3b14 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:12.709174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef88fc-bada-483d-8d25-492841de3b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:12.711325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef88fc-bada-483d-8d25-492841de3b14 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:12.736102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:12.811442 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3820/7695] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:12 2022] POST /identity/v3/users => generated 297 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:12.816744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84e250-f348-4497-8004-1dbeb22e3917 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:12.854765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84e250-f348-4497-8004-1dbeb22e3917 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:12.870001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecf3aa-1f40-4e4d-982c-a8c5053469c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:12.870750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecf3aa-1f40-4e4d-982c-a8c5053469c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:12.871137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecf3aa-1f40-4e4d-982c-a8c5053469c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:12.872214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecf3aa-1f40-4e4d-982c-a8c5053469c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:12.873211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecf3aa-1f40-4e4d-982c-a8c5053469c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:12.875108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecf3aa-1f40-4e4d-982c-a8c5053469c6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:12.892297 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3876/7696] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:12.893018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef88fc-bada-483d-8d25-492841de3b14 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:12.906621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef88fc-bada-483d-8d25-492841de3b14 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:12.958579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563c7e6-a1e2-4ec3-8d2d-6b9ca3e58633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:12.960993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563c7e6-a1e2-4ec3-8d2d-6b9ca3e58633 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:12.962210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563c7e6-a1e2-4ec3-8d2d-6b9ca3e58633 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:12.967091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563c7e6-a1e2-4ec3-8d2d-6b9ca3e58633 admin admin] PATH_INFO: `/v3/projects/dcbb2e00658a4a89ab936dd6948e497a/users/5150cf026bef4f17bf160cfe2e1db08f/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:13.003862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563c7e6-a1e2-4ec3-8d2d-6b9ca3e58633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcbb2e00658a4a89ab936dd6948e497a, user_id=5150cf026bef4f17bf160cfe2e1db08f, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:13.006615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563c7e6-a1e2-4ec3-8d2d-6b9ca3e58633 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:13.070883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecf3aa-1f40-4e4d-982c-a8c5053469c6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:13.072906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-35ecf3aa-1f40-4e4d-982c-a8c5053469c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:13.087398 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3821/7697] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:12 2022] PUT /identity/v3/projects/dcbb2e00658a4a89ab936dd6948e497a/users/5150cf026bef4f17bf160cfe2e1db08f/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:01:13.092996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563c7e6-a1e2-4ec3-8d2d-6b9ca3e58633 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:13.114236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecf3aa-1f40-4e4d-982c-a8c5053469c6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:13.270485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:13.312384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563c7e6-a1e2-4ec3-8d2d-6b9ca3e58633 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:13.327810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2f78f-3d5f-435f-a19e-918a3ad68829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:13.328882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2f78f-3d5f-435f-a19e-918a3ad68829 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:13.329173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2f78f-3d5f-435f-a19e-918a3ad68829 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:13.330575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2f78f-3d5f-435f-a19e-918a3ad68829 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:13.331254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2f78f-3d5f-435f-a19e-918a3ad68829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:13.332116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1a29d-fe1d-4584-9895-5f6f0622b213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:13.332864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1a29d-fe1d-4584-9895-5f6f0622b213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:13.333145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1a29d-fe1d-4584-9895-5f6f0622b213 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:13.333417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1a29d-fe1d-4584-9895-5f6f0622b213 admin admin] PATH_INFO: `/v3/projects/e0fecfe4b04c4a77933c899660e619d3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:13.335228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2f78f-3d5f-435f-a19e-918a3ad68829 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:13.336591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1a29d-fe1d-4584-9895-5f6f0622b213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0fecfe4b04c4a77933c899660e619d3)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:13.338574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1a29d-fe1d-4584-9895-5f6f0622b213 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:13.364331 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3822/7698] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:13.364331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2f78f-3d5f-435f-a19e-918a3ad68829 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:13.369211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2df2f78f-3d5f-435f-a19e-918a3ad68829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:13.426081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2f78f-3d5f-435f-a19e-918a3ad68829 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:13.476069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:13.476825 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:13.477069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:13.477351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f admin admin] PATH_INFO: `/v3/projects/5534f9ed0e23462aa06ec86aae10825f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:13.480610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5534f9ed0e23462aa06ec86aae10825f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:13.485024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:13.557776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-43f1a29d-fe1d-4584-9895-5f6f0622b213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fecfe4b04c4a77933c899660e619d3', 'request_id': 'req-43f1a29d-fe1d-4584-9895-5f6f0622b213'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:13.567110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-43f1a29d-fe1d-4584-9895-5f6f0622b213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fecfe4b04c4a77933c899660e619d3', 'request_id': 'req-43f1a29d-fe1d-4584-9895-5f6f0622b213'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:13.649425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-43f1a29d-fe1d-4584-9895-5f6f0622b213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fecfe4b04c4a77933c899660e619d3', 'request_id': 'req-43f1a29d-fe1d-4584-9895-5f6f0622b213'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:13.675657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5534f9ed0e23462aa06ec86aae10825f', 'request_id': 'req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:13.685045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-43f1a29d-fe1d-4584-9895-5f6f0622b213 admin admin] The token cache is being invalidate because project e0fecfe4b04c4a77933c899660e619d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:01:13.685812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-43f1a29d-fe1d-4584-9895-5f6f0622b213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:13.686802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-43f1a29d-fe1d-4584-9895-5f6f0622b213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:13.692050 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3877/7699] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:01:13 2022] DELETE /identity/v3/projects/e0fecfe4b04c4a77933c899660e619d3 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:13.693169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1a29d-fe1d-4584-9895-5f6f0622b213 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:13.696863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5534f9ed0e23462aa06ec86aae10825f', 'request_id': 'req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:13.697834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-43f1a29d-fe1d-4584-9895-5f6f0622b213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:13.714574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5534f9ed0e23462aa06ec86aae10825f', 'request_id': 'req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:13.803303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f admin admin] The token cache is being invalidate because project 5534f9ed0e23462aa06ec86aae10825f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:01:13.806994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:13.806994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:13.807423 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3823/7700] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:01:13 2022] DELETE /identity/v3/projects/5534f9ed0e23462aa06ec86aae10825f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:13.809753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:13.816308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:13.879254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1a29d-fe1d-4584-9895-5f6f0622b213 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:13.958837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:13.998413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3c7d1-8e61-443b-a8a5-72e5ad04171f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:14.025855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fa695-3c2a-4a80-adaf-6d2ae0b51c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:14.026804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fa695-3c2a-4a80-adaf-6d2ae0b51c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:14.030320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fa695-3c2a-4a80-adaf-6d2ae0b51c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:14.031016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fa695-3c2a-4a80-adaf-6d2ae0b51c6f admin admin] PATH_INFO: `/v3/users/a5e57c37854b4ae0b2a60fd02bc3f19b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:14.036061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fa695-3c2a-4a80-adaf-6d2ae0b51c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e57c37854b4ae0b2a60fd02bc3f19b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:14.041681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fa695-3c2a-4a80-adaf-6d2ae0b51c6f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:14.060583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8baf0e1-1903-4978-a12d-329c345c4908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:14.061831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8baf0e1-1903-4978-a12d-329c345c4908 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:14.062298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8baf0e1-1903-4978-a12d-329c345c4908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:14.062750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8baf0e1-1903-4978-a12d-329c345c4908 admin admin] PATH_INFO: `/v3/projects/dcbb2e00658a4a89ab936dd6948e497a/users/5150cf026bef4f17bf160cfe2e1db08f/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:14.067333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8baf0e1-1903-4978-a12d-329c345c4908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcbb2e00658a4a89ab936dd6948e497a, user_id=5150cf026bef4f17bf160cfe2e1db08f, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:14.084031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8baf0e1-1903-4978-a12d-329c345c4908 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:14.141115 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3878/7701] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:13 2022] PUT /identity/v3/projects/dcbb2e00658a4a89ab936dd6948e497a/users/5150cf026bef4f17bf160cfe2e1db08f/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:14.144247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cff9a6-2548-4e0a-8283-6e0acd5189e6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:14.144738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cff9a6-2548-4e0a-8283-6e0acd5189e6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:14.159757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cff9a6-2548-4e0a-8283-6e0acd5189e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:14.250278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-54cff9a6-2548-4e0a-8283-6e0acd5189e6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:14.271258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-54cff9a6-2548-4e0a-8283-6e0acd5189e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:14.314143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d69fa695-3c2a-4a80-adaf-6d2ae0b51c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e57c37854b4ae0b2a60fd02bc3f19b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:14.375207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d69fa695-3c2a-4a80-adaf-6d2ae0b51c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e57c37854b4ae0b2a60fd02bc3f19b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:14.376610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d69fa695-3c2a-4a80-adaf-6d2ae0b51c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e57c37854b4ae0b2a60fd02bc3f19b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:14.386298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d69fa695-3c2a-4a80-adaf-6d2ae0b51c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e57c37854b4ae0b2a60fd02bc3f19b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:14.413361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d69fa695-3c2a-4a80-adaf-6d2ae0b51c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e57c37854b4ae0b2a60fd02bc3f19b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:14.428082 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3824/7702] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:01:13 2022] DELETE /identity/v3/users/a5e57c37854b4ae0b2a60fd02bc3f19b => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:14.430653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03737d3-9c37-43df-8cf7-3a275364840a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:14.432466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03737d3-9c37-43df-8cf7-3a275364840a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:14.435866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03737d3-9c37-43df-8cf7-3a275364840a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:14.437508 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3879/7703] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:14.445192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f453a-f43d-4630-9a69-395f10811878 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:14.464107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f453a-f43d-4630-9a69-395f10811878 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:14.464107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f453a-f43d-4630-9a69-395f10811878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:14.514473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e03737d3-9c37-43df-8cf7-3a275364840a None None] MFA Rules not processed for user `5150cf026bef4f17bf160cfe2e1db08f`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:14.519659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e03737d3-9c37-43df-8cf7-3a275364840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:14.536215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:14.545470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-df3f453a-f43d-4630-9a69-395f10811878 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:14.554636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-df3f453a-f43d-4630-9a69-395f10811878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:14.668103 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3825/7704] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:14.678281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:14.687241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03737d3-9c37-43df-8cf7-3a275364840a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:14.693660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e03737d3-9c37-43df-8cf7-3a275364840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:14.713374 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3880/7705] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:14.718328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f453a-f43d-4630-9a69-395f10811878 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:14.739997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f453a-f43d-4630-9a69-395f10811878 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:14.766728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38506512-c1b9-47fd-a29d-b403da4335c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:14.770752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38506512-c1b9-47fd-a29d-b403da4335c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:14.771164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38506512-c1b9-47fd-a29d-b403da4335c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:14.771543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38506512-c1b9-47fd-a29d-b403da4335c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:14.772390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38506512-c1b9-47fd-a29d-b403da4335c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:01:14.772939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38506512-c1b9-47fd-a29d-b403da4335c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:14.781231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38506512-c1b9-47fd-a29d-b403da4335c0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:14.822658 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3881/7706] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:01:14.825442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38506512-c1b9-47fd-a29d-b403da4335c0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:14.848922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38506512-c1b9-47fd-a29d-b403da4335c0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:14.875097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf7a72-be37-456c-aafa-e29ebaeaf10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:14.875868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf7a72-be37-456c-aafa-e29ebaeaf10e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:14.876329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf7a72-be37-456c-aafa-e29ebaeaf10e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:14.877289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf7a72-be37-456c-aafa-e29ebaeaf10e admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:14.878122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf7a72-be37-456c-aafa-e29ebaeaf10e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:14.882069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf7a72-be37-456c-aafa-e29ebaeaf10e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:14.883356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03737d3-9c37-43df-8cf7-3a275364840a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:14.894643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e2487-1543-492e-882b-15d311cfdd93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:14.895378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e2487-1543-492e-882b-15d311cfdd93 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:14.895766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e2487-1543-492e-882b-15d311cfdd93 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:14.896317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e2487-1543-492e-882b-15d311cfdd93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:14.905407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:14.938384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e2487-1543-492e-882b-15d311cfdd93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:14.942946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e2487-1543-492e-882b-15d311cfdd93 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:14.968252 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3826/7707] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:15.045028 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3882/7708] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:14 2022] POST /identity/v3/projects => generated 369 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:15.049638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e2487-1543-492e-882b-15d311cfdd93 service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:15.060816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e2487-1543-492e-882b-15d311cfdd93 service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:15.089267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:15.163623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc098bd-f68c-4aeb-b2e3-b14b6299feb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:15.164798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc098bd-f68c-4aeb-b2e3-b14b6299feb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:15.165091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc098bd-f68c-4aeb-b2e3-b14b6299feb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:15.165878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc098bd-f68c-4aeb-b2e3-b14b6299feb8 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:15.166937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc098bd-f68c-4aeb-b2e3-b14b6299feb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:15.169546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc098bd-f68c-4aeb-b2e3-b14b6299feb8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:15.266128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf7a72-be37-456c-aafa-e29ebaeaf10e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:15.304952 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3827/7709] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:15 2022] POST /identity/v3/users => generated 285 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:15.309844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc098bd-f68c-4aeb-b2e3-b14b6299feb8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:15.376213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:15.385768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc098bd-f68c-4aeb-b2e3-b14b6299feb8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:15.403239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d15953-b1b7-4b42-8043-ad96cf1ebc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:15.403925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d15953-b1b7-4b42-8043-ad96cf1ebc04 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:15.404774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d15953-b1b7-4b42-8043-ad96cf1ebc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:15.407241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d15953-b1b7-4b42-8043-ad96cf1ebc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:15.408102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d15953-b1b7-4b42-8043-ad96cf1ebc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:15.409824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf7a72-be37-456c-aafa-e29ebaeaf10e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:15.415606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79ecfb-a949-459c-8322-3dee79bf7975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:15.415999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d15953-b1b7-4b42-8043-ad96cf1ebc04 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:15.416712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79ecfb-a949-459c-8322-3dee79bf7975 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:15.417177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79ecfb-a949-459c-8322-3dee79bf7975 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:15.417678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79ecfb-a949-459c-8322-3dee79bf7975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:15.420336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3c79ecfb-a949-459c-8322-3dee79bf7975 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:15.451221 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3828/7710] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:15.456707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d15953-b1b7-4b42-8043-ad96cf1ebc04 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:15.459312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:15.488957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d15953-b1b7-4b42-8043-ad96cf1ebc04 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:15.507029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79ecfb-a949-459c-8322-3dee79bf7975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:15.508015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35b33b-7f95-4ec7-bb6c-6083ab90e682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:15.508812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35b33b-7f95-4ec7-bb6c-6083ab90e682 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:15.509164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79ecfb-a949-459c-8322-3dee79bf7975 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:15.509293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35b33b-7f95-4ec7-bb6c-6083ab90e682 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:15.509732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35b33b-7f95-4ec7-bb6c-6083ab90e682 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:15.511140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35b33b-7f95-4ec7-bb6c-6083ab90e682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:15.515020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35b33b-7f95-4ec7-bb6c-6083ab90e682 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:15.547604 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3829/7712] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:15.547870 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3883/7712] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:01:15.554010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35b33b-7f95-4ec7-bb6c-6083ab90e682 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:15.571653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35b33b-7f95-4ec7-bb6c-6083ab90e682 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:15.589774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3584971-a1f5-4740-a292-ccb286bff6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:15.589774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3584971-a1f5-4740-a292-ccb286bff6a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:15.589774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3584971-a1f5-4740-a292-ccb286bff6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:15.589774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3584971-a1f5-4740-a292-ccb286bff6a2 admin admin] PATH_INFO: `/v3/projects/29478bc90fd044b2bb31d3ce86c1f22f/users/d9c8f9ed891f4fa28421a9f09e2d0f78/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:15.624187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3584971-a1f5-4740-a292-ccb286bff6a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29478bc90fd044b2bb31d3ce86c1f22f, user_id=d9c8f9ed891f4fa28421a9f09e2d0f78, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:15.627395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3584971-a1f5-4740-a292-ccb286bff6a2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:15.760880 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3830/7713] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:15 2022] PUT /identity/v3/projects/29478bc90fd044b2bb31d3ce86c1f22f/users/d9c8f9ed891f4fa28421a9f09e2d0f78/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:15.771761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b69d6-1614-49da-9c1d-1395f087ee53 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:15.772374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b69d6-1614-49da-9c1d-1395f087ee53 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:15.772374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b69d6-1614-49da-9c1d-1395f087ee53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:15.820520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bb0b69d6-1614-49da-9c1d-1395f087ee53 None None] MFA Rules not processed for user `d9c8f9ed891f4fa28421a9f09e2d0f78`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:15.823884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bb0b69d6-1614-49da-9c1d-1395f087ee53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:15.927619 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3884/7714] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:15.928449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3584971-a1f5-4740-a292-ccb286bff6a2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:15.930998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b69d6-1614-49da-9c1d-1395f087ee53 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:15.932916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bb0b69d6-1614-49da-9c1d-1395f087ee53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:16.186133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3584971-a1f5-4740-a292-ccb286bff6a2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:16.193495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b69d6-1614-49da-9c1d-1395f087ee53 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:16.199950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7172f8-9799-4588-9640-30a85d130d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:16.200663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7172f8-9799-4588-9640-30a85d130d64 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:16.201066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7172f8-9799-4588-9640-30a85d130d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:16.201449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7172f8-9799-4588-9640-30a85d130d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:16.204350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7172f8-9799-4588-9640-30a85d130d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:16.206214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319675d-42d1-4ad9-8c66-d5c38ed1681c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:16.206893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319675d-42d1-4ad9-8c66-d5c38ed1681c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:16.207215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319675d-42d1-4ad9-8c66-d5c38ed1681c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:16.207452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319675d-42d1-4ad9-8c66-d5c38ed1681c admin admin] PATH_INFO: `/v3/projects/9a15351348924323828daed3e3ad63d2` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:16.208384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7172f8-9799-4588-9640-30a85d130d64 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:16.209959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:16.212138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319675d-42d1-4ad9-8c66-d5c38ed1681c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a15351348924323828daed3e3ad63d2)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:16.214095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319675d-42d1-4ad9-8c66-d5c38ed1681c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:16.336920 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3831/7715] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:15 2022] POST /identity/v3/projects => generated 369 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:16.342760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:16.361240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7172f8-9799-4588-9640-30a85d130d64 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:16.397128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e319675d-42d1-4ad9-8c66-d5c38ed1681c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a15351348924323828daed3e3ad63d2', 'request_id': 'req-e319675d-42d1-4ad9-8c66-d5c38ed1681c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:16.432554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e319675d-42d1-4ad9-8c66-d5c38ed1681c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a15351348924323828daed3e3ad63d2', 'request_id': 'req-e319675d-42d1-4ad9-8c66-d5c38ed1681c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:16.506455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e319675d-42d1-4ad9-8c66-d5c38ed1681c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a15351348924323828daed3e3ad63d2', 'request_id': 'req-e319675d-42d1-4ad9-8c66-d5c38ed1681c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:16.540507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e319675d-42d1-4ad9-8c66-d5c38ed1681c admin admin] The token cache is being invalidate because project 9a15351348924323828daed3e3ad63d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:01:16.540507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e319675d-42d1-4ad9-8c66-d5c38ed1681c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:16.541009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e319675d-42d1-4ad9-8c66-d5c38ed1681c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:16.545418 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3885/7716] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:01:15 2022] DELETE /identity/v3/projects/9a15351348924323828daed3e3ad63d2 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:01:16.550643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b8c53-ea5b-4b0a-88ce-a50f71de0b72 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:16.550959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b8c53-ea5b-4b0a-88ce-a50f71de0b72 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:16.551338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b8c53-ea5b-4b0a-88ce-a50f71de0b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:16.559325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7172f8-9799-4588-9640-30a85d130d64 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:16.585103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8b4b8c53-ea5b-4b0a-88ce-a50f71de0b72 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:16.587170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8b4b8c53-ea5b-4b0a-88ce-a50f71de0b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:16.643694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba25ed-23df-462b-ab63-25fbe0ab8c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:16.644552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba25ed-23df-462b-ab63-25fbe0ab8c17 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:16.644834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba25ed-23df-462b-ab63-25fbe0ab8c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:16.645108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba25ed-23df-462b-ab63-25fbe0ab8c17 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:16.645752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba25ed-23df-462b-ab63-25fbe0ab8c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:16.647792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba25ed-23df-462b-ab63-25fbe0ab8c17 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:16.714454 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3886/7717] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:01:16.726340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b216df1-362d-469a-9325-f01b0a8a550b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:16.726629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b216df1-362d-469a-9325-f01b0a8a550b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:16.726911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b216df1-362d-469a-9325-f01b0a8a550b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:16.758244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7b216df1-362d-469a-9325-f01b0a8a550b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:16.759636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7b216df1-362d-469a-9325-f01b0a8a550b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:16.772669 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3887/7718] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:16.773445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b216df1-362d-469a-9325-f01b0a8a550b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:16.790627 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3832/7719] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:16 2022] POST /identity/v3/users => generated 291 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:16.795915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b216df1-362d-469a-9325-f01b0a8a550b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:16.796060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba25ed-23df-462b-ab63-25fbe0ab8c17 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:16.797716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e3ba25ed-23df-462b-ab63-25fbe0ab8c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:16.801317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d1982-38c4-4916-aff0-1b11fbb2864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:16.802105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d1982-38c4-4916-aff0-1b11fbb2864a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:16.803071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d1982-38c4-4916-aff0-1b11fbb2864a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:16.803071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d1982-38c4-4916-aff0-1b11fbb2864a admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:16.804612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d1982-38c4-4916-aff0-1b11fbb2864a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:01:16.804974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d1982-38c4-4916-aff0-1b11fbb2864a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:16.806770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d1982-38c4-4916-aff0-1b11fbb2864a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:16.823378 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3888/7720] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:01:16.831738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d1982-38c4-4916-aff0-1b11fbb2864a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:16.835016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba25ed-23df-462b-ab63-25fbe0ab8c17 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:16.854568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd88796-749f-4041-be88-451c5faec496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:16.857015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd88796-749f-4041-be88-451c5faec496 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:16.857443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd88796-749f-4041-be88-451c5faec496 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:16.857816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd88796-749f-4041-be88-451c5faec496 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:16.858629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd88796-749f-4041-be88-451c5faec496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:16.861634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd88796-749f-4041-be88-451c5faec496 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:16.865117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d1982-38c4-4916-aff0-1b11fbb2864a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:16.888407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c68ce7-ff72-4519-a9f8-8fda5d1dbd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:16.889130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c68ce7-ff72-4519-a9f8-8fda5d1dbd1c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:16.889517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c68ce7-ff72-4519-a9f8-8fda5d1dbd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:16.890002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c68ce7-ff72-4519-a9f8-8fda5d1dbd1c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:16.890894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c68ce7-ff72-4519-a9f8-8fda5d1dbd1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:16.894123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c68ce7-ff72-4519-a9f8-8fda5d1dbd1c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:16.900076 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3833/7721] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:01:16.901428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd88796-749f-4041-be88-451c5faec496 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:16.907530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3cd88796-749f-4041-be88-451c5faec496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:16.951624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd88796-749f-4041-be88-451c5faec496 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:16.977509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365b578-4ea5-4029-adef-972bee9ef261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:16.978305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365b578-4ea5-4029-adef-972bee9ef261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:16.978697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365b578-4ea5-4029-adef-972bee9ef261 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:16.979080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365b578-4ea5-4029-adef-972bee9ef261 admin admin] PATH_INFO: `/v3/users/499e476661254885930bb1662ce45e29` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:16.980444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365b578-4ea5-4029-adef-972bee9ef261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=499e476661254885930bb1662ce45e29)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:16.983769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365b578-4ea5-4029-adef-972bee9ef261 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:17.054372 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3889/7722] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:16 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:17.058371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c68ce7-ff72-4519-a9f8-8fda5d1dbd1c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:17.196521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c68ce7-ff72-4519-a9f8-8fda5d1dbd1c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:17.206104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5bef7-6858-4a26-ac2b-09715bbb2b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:17.207541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5bef7-6858-4a26-ac2b-09715bbb2b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:17.208095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5bef7-6858-4a26-ac2b-09715bbb2b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:17.208675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5bef7-6858-4a26-ac2b-09715bbb2b96 admin admin] PATH_INFO: `/v3/projects/8c111380a0ac487e9965a9d4479d8529/users/37333df2664147949f44b8c6f6194fad/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:17.233240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5bef7-6858-4a26-ac2b-09715bbb2b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c111380a0ac487e9965a9d4479d8529, user_id=37333df2664147949f44b8c6f6194fad, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:17.244545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5bef7-6858-4a26-ac2b-09715bbb2b96 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:17.255657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f365b578-4ea5-4029-adef-972bee9ef261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '499e476661254885930bb1662ce45e29'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:17.295167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f365b578-4ea5-4029-adef-972bee9ef261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '499e476661254885930bb1662ce45e29'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:17.295926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f365b578-4ea5-4029-adef-972bee9ef261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '499e476661254885930bb1662ce45e29'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:17.306757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f365b578-4ea5-4029-adef-972bee9ef261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '499e476661254885930bb1662ce45e29'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:17.331234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f365b578-4ea5-4029-adef-972bee9ef261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '499e476661254885930bb1662ce45e29'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:17.343420 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3834/7723] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:01:16 2022] DELETE /identity/v3/users/499e476661254885930bb1662ce45e29 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:17.347127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365b578-4ea5-4029-adef-972bee9ef261 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:17.351491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f365b578-4ea5-4029-adef-972bee9ef261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:17.354509 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3890/7724] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:17 2022] PUT /identity/v3/projects/8c111380a0ac487e9965a9d4479d8529/users/37333df2664147949f44b8c6f6194fad/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:17.357196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318455e6-f543-44c9-a011-5ee68df8fee0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:17.357557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318455e6-f543-44c9-a011-5ee68df8fee0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:17.358078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318455e6-f543-44c9-a011-5ee68df8fee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:17.431072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-318455e6-f543-44c9-a011-5ee68df8fee0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:17.433503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-318455e6-f543-44c9-a011-5ee68df8fee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:17.444082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:17.489487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365b578-4ea5-4029-adef-972bee9ef261 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:17.517530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:17.583632 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3891/7725] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:17.587561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318455e6-f543-44c9-a011-5ee68df8fee0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:17.592258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-318455e6-f543-44c9-a011-5ee68df8fee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:17.609052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37291931-a04e-4447-9ed1-e2dd7089fe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:17.609694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37291931-a04e-4447-9ed1-e2dd7089fe64 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:17.609959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37291931-a04e-4447-9ed1-e2dd7089fe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:17.610220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37291931-a04e-4447-9ed1-e2dd7089fe64 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:17.610865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37291931-a04e-4447-9ed1-e2dd7089fe64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:17.614577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37291931-a04e-4447-9ed1-e2dd7089fe64 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:17.622114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318455e6-f543-44c9-a011-5ee68df8fee0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:17.631425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a51a8-d135-46fa-82bb-dcf199a3b7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:17.632269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a51a8-d135-46fa-82bb-dcf199a3b7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:17.632552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a51a8-d135-46fa-82bb-dcf199a3b7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:17.632826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a51a8-d135-46fa-82bb-dcf199a3b7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:17.633481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a51a8-d135-46fa-82bb-dcf199a3b7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:17.635113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a51a8-d135-46fa-82bb-dcf199a3b7c0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:17.650011 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3892/7726] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:17.651185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a51a8-d135-46fa-82bb-dcf199a3b7c0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:17.655124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d75a51a8-d135-46fa-82bb-dcf199a3b7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:17.755388 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3835/7727] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:17 2022] POST /identity/v3/users => generated 291 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:17.755388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37291931-a04e-4447-9ed1-e2dd7089fe64 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:17.767627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-37291931-a04e-4447-9ed1-e2dd7089fe64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:17.840791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a51a8-d135-46fa-82bb-dcf199a3b7c0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:17.854270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240348d8-5db4-4e22-ac41-f82986f3d37c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:17.855336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240348d8-5db4-4e22-ac41-f82986f3d37c service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:17.856529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240348d8-5db4-4e22-ac41-f82986f3d37c service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:17.857022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240348d8-5db4-4e22-ac41-f82986f3d37c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:17.861961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-240348d8-5db4-4e22-ac41-f82986f3d37c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:17.891391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240348d8-5db4-4e22-ac41-f82986f3d37c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:17.893878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240348d8-5db4-4e22-ac41-f82986f3d37c service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:17.916024 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3893/7728] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:17.917328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240348d8-5db4-4e22-ac41-f82986f3d37c service placement] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:17.931608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240348d8-5db4-4e22-ac41-f82986f3d37c service placement] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:17.944923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496df8e7-afcc-46aa-addd-81bf0d05f795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:17.945833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496df8e7-afcc-46aa-addd-81bf0d05f795 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:17.946062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496df8e7-afcc-46aa-addd-81bf0d05f795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:17.946416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496df8e7-afcc-46aa-addd-81bf0d05f795 admin admin] PATH_INFO: `/v3/projects/8c111380a0ac487e9965a9d4479d8529/users/37333df2664147949f44b8c6f6194fad/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:17.948496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496df8e7-afcc-46aa-addd-81bf0d05f795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c111380a0ac487e9965a9d4479d8529, user_id=37333df2664147949f44b8c6f6194fad, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:17.949856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37291931-a04e-4447-9ed1-e2dd7089fe64 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:17.953169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496df8e7-afcc-46aa-addd-81bf0d05f795 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:17.954265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb932fa3-2196-4b27-9dc9-c11a251a6a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:17.955060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb932fa3-2196-4b27-9dc9-c11a251a6a14 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:17.955543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb932fa3-2196-4b27-9dc9-c11a251a6a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:17.956379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb932fa3-2196-4b27-9dc9-c11a251a6a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:18.008834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb932fa3-2196-4b27-9dc9-c11a251a6a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:18.019610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb932fa3-2196-4b27-9dc9-c11a251a6a14 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:18.024454 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3894/7729] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:17 2022] PUT /identity/v3/projects/8c111380a0ac487e9965a9d4479d8529/users/37333df2664147949f44b8c6f6194fad/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:18.036545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496df8e7-afcc-46aa-addd-81bf0d05f795 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:18.048807 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3836/7730] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:18.057065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8225-4d0e-4959-8df5-5ad3aa33483f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:18.057635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8225-4d0e-4959-8df5-5ad3aa33483f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:18.058080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8225-4d0e-4959-8df5-5ad3aa33483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:18.132915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-74be8225-4d0e-4959-8df5-5ad3aa33483f None None] MFA Rules not processed for user `37333df2664147949f44b8c6f6194fad`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:18.134468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-74be8225-4d0e-4959-8df5-5ad3aa33483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:18.169105 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496df8e7-afcc-46aa-addd-81bf0d05f795 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:18.186258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fba99-98f9-467d-832a-72b53d75ebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:18.187927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fba99-98f9-467d-832a-72b53d75ebe5 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:18.191187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fba99-98f9-467d-832a-72b53d75ebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:18.191549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fba99-98f9-467d-832a-72b53d75ebe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:18.192281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fba99-98f9-467d-832a-72b53d75ebe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:18.197020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fba99-98f9-467d-832a-72b53d75ebe5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:18.222184 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3895/7731] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:18.229328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fba99-98f9-467d-832a-72b53d75ebe5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:18.255563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fba99-98f9-467d-832a-72b53d75ebe5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:18.271925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae06af-1ee1-4096-abfc-1d93604584ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:18.272612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae06af-1ee1-4096-abfc-1d93604584ee admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:18.272957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae06af-1ee1-4096-abfc-1d93604584ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:18.273242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae06af-1ee1-4096-abfc-1d93604584ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:18.273894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae06af-1ee1-4096-abfc-1d93604584ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:18.275529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae06af-1ee1-4096-abfc-1d93604584ee admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:18.321698 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3896/7732] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:18.327068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae06af-1ee1-4096-abfc-1d93604584ee admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:18.355014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:18.365634 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3837/7733] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:18.379854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be8225-4d0e-4959-8df5-5ad3aa33483f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:18.382497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-74be8225-4d0e-4959-8df5-5ad3aa33483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:18.403465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae06af-1ee1-4096-abfc-1d93604584ee admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:18.422735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53217f84-7026-41e9-a947-1acc6543107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:18.423369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53217f84-7026-41e9-a947-1acc6543107f admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:18.423793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53217f84-7026-41e9-a947-1acc6543107f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:18.424084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53217f84-7026-41e9-a947-1acc6543107f admin admin] PATH_INFO: `/v3/projects/e302e0a4dc73497a984110c7ba5285f1/users/1d8a36118fc34991975b6e1655cc3f2b/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:18.478366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53217f84-7026-41e9-a947-1acc6543107f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e302e0a4dc73497a984110c7ba5285f1, user_id=1d8a36118fc34991975b6e1655cc3f2b, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:18.490542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53217f84-7026-41e9-a947-1acc6543107f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:18.497644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:18.593145 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3897/7734] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:18 2022] PUT /identity/v3/projects/e302e0a4dc73497a984110c7ba5285f1/users/1d8a36118fc34991975b6e1655cc3f2b/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:18.603918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a875ac-742a-41db-be20-a6244fc59027 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:18.604309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a875ac-742a-41db-be20-a6244fc59027 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:18.604593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a875ac-742a-41db-be20-a6244fc59027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:18.649253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be8225-4d0e-4959-8df5-5ad3aa33483f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:18.707817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c5a875ac-742a-41db-be20-a6244fc59027 None None] MFA Rules not processed for user `1d8a36118fc34991975b6e1655cc3f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:18.713416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c5a875ac-742a-41db-be20-a6244fc59027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:18.759205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a72010-f7b2-4bd5-84c2-288b0def75a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:18.759671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a72010-f7b2-4bd5-84c2-288b0def75a9 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:18.759954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a72010-f7b2-4bd5-84c2-288b0def75a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:18.762030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a72010-f7b2-4bd5-84c2-288b0def75a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:18.930993 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3898/7735] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:01:18.935892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a875ac-742a-41db-be20-a6244fc59027 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:18.943665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c5a875ac-742a-41db-be20-a6244fc59027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:18.966246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a72010-f7b2-4bd5-84c2-288b0def75a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:18.968117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a72010-f7b2-4bd5-84c2-288b0def75a9 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:18.997196 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3838/7736] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:18.998255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a72010-f7b2-4bd5-84c2-288b0def75a9 service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:19.084097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a72010-f7b2-4bd5-84c2-288b0def75a9 service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:19.094689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91f156-d88f-443d-b7a4-77f605265faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:19.095325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91f156-d88f-443d-b7a4-77f605265faa admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:19.095610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91f156-d88f-443d-b7a4-77f605265faa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:19.098284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91f156-d88f-443d-b7a4-77f605265faa admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:19.106244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91f156-d88f-443d-b7a4-77f605265faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:19.106486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91f156-d88f-443d-b7a4-77f605265faa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:19.111376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a875ac-742a-41db-be20-a6244fc59027 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:19.117432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5462e6-ea66-4bf7-b4cc-0998983898eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:19.118357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5462e6-ea66-4bf7-b4cc-0998983898eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:19.118689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5462e6-ea66-4bf7-b4cc-0998983898eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:19.119089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5462e6-ea66-4bf7-b4cc-0998983898eb admin admin] PATH_INFO: `/v3/projects/c43c550ce30e42deb37ace0fd37865cf` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:19.120461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5462e6-ea66-4bf7-b4cc-0998983898eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c43c550ce30e42deb37ace0fd37865cf)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:19.122960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5462e6-ea66-4bf7-b4cc-0998983898eb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:19.239085 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3839/7737] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:18 2022] POST /identity/v3/projects => generated 383 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:19.243360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91f156-d88f-443d-b7a4-77f605265faa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:19.352369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bd5462e6-ea66-4bf7-b4cc-0998983898eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43c550ce30e42deb37ace0fd37865cf', 'request_id': 'req-bd5462e6-ea66-4bf7-b4cc-0998983898eb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:19.370225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bd5462e6-ea66-4bf7-b4cc-0998983898eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43c550ce30e42deb37ace0fd37865cf', 'request_id': 'req-bd5462e6-ea66-4bf7-b4cc-0998983898eb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:19.390439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91f156-d88f-443d-b7a4-77f605265faa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:19.449164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bd5462e6-ea66-4bf7-b4cc-0998983898eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43c550ce30e42deb37ace0fd37865cf', 'request_id': 'req-bd5462e6-ea66-4bf7-b4cc-0998983898eb'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:19.469630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bd5462e6-ea66-4bf7-b4cc-0998983898eb admin admin] The token cache is being invalidate because project c43c550ce30e42deb37ace0fd37865cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:01:19.494554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bd5462e6-ea66-4bf7-b4cc-0998983898eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:19.494554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bd5462e6-ea66-4bf7-b4cc-0998983898eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:19.494554 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3899/7738] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:01:18 2022] DELETE /identity/v3/projects/c43c550ce30e42deb37ace0fd37865cf => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:19.494554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7851a-aa95-4a41-b108-cf62bfd1d9f5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:19.494554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7851a-aa95-4a41-b108-cf62bfd1d9f5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:19.494554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7851a-aa95-4a41-b108-cf62bfd1d9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:19.531700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5fc7f-f6d2-4bcb-8ab9-b9eee6b52ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:19.532367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5fc7f-f6d2-4bcb-8ab9-b9eee6b52ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:19.532823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5fc7f-f6d2-4bcb-8ab9-b9eee6b52ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:19.532998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5fc7f-f6d2-4bcb-8ab9-b9eee6b52ed9 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:19.533669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5fc7f-f6d2-4bcb-8ab9-b9eee6b52ed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:19.533886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2cb7851a-aa95-4a41-b108-cf62bfd1d9f5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:19.538659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5fc7f-f6d2-4bcb-8ab9-b9eee6b52ed9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:19.538853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2cb7851a-aa95-4a41-b108-cf62bfd1d9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:19.565982 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3900/7739] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:19.580461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70117475-82d0-4f80-bae1-8647e5305cdf None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:19.580750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70117475-82d0-4f80-bae1-8647e5305cdf None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:19.581031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70117475-82d0-4f80-bae1-8647e5305cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:19.606113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:19.618096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-70117475-82d0-4f80-bae1-8647e5305cdf None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:19.620199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-70117475-82d0-4f80-bae1-8647e5305cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:19.633826 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3901/7740] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:19.634806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70117475-82d0-4f80-bae1-8647e5305cdf None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:19.648311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70117475-82d0-4f80-bae1-8647e5305cdf None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:19.668492 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3840/7741] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:19 2022] POST /identity/v3/users => generated 298 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:19.671192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be352e75-398e-40c6-bfa1-f641503ff648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:19.671834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be352e75-398e-40c6-bfa1-f641503ff648 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:19.672116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be352e75-398e-40c6-bfa1-f641503ff648 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:19.672420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be352e75-398e-40c6-bfa1-f641503ff648 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:19.672861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5fc7f-f6d2-4bcb-8ab9-b9eee6b52ed9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:19.673086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be352e75-398e-40c6-bfa1-f641503ff648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:01:19.673398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be352e75-398e-40c6-bfa1-f641503ff648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:19.675238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be352e75-398e-40c6-bfa1-f641503ff648 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:19.685260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aee5fc7f-f6d2-4bcb-8ab9-b9eee6b52ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:19.716306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5fc7f-f6d2-4bcb-8ab9-b9eee6b52ed9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:19.733213 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3902/7742] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:01:19.735849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be352e75-398e-40c6-bfa1-f641503ff648 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:19.748201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9c6e9-146b-4e82-99a1-97b1c8ea7009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:19.748201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c6e9-146b-4e82-99a1-97b1c8ea7009 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:19.748201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c6e9-146b-4e82-99a1-97b1c8ea7009 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:19.748201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9c6e9-146b-4e82-99a1-97b1c8ea7009 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:19.748877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9c6e9-146b-4e82-99a1-97b1c8ea7009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:19.750378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9c6e9-146b-4e82-99a1-97b1c8ea7009 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:19.780346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be352e75-398e-40c6-bfa1-f641503ff648 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:19.796256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ac6ca-89bf-4cb1-873d-017a988417e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:19.797191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ac6ca-89bf-4cb1-873d-017a988417e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:19.797689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ac6ca-89bf-4cb1-873d-017a988417e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:19.798188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ac6ca-89bf-4cb1-873d-017a988417e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:19.799070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ac6ca-89bf-4cb1-873d-017a988417e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:19.802086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ac6ca-89bf-4cb1-873d-017a988417e9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:19.825763 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3841/7743] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:19.834127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9c6e9-146b-4e82-99a1-97b1c8ea7009 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:19.868086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9c6e9-146b-4e82-99a1-97b1c8ea7009 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:19.875031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97f9ce-79de-4014-a1af-8d8b897a71e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:19.880702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97f9ce-79de-4014-a1af-8d8b897a71e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:19.881246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97f9ce-79de-4014-a1af-8d8b897a71e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:19.881787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97f9ce-79de-4014-a1af-8d8b897a71e1 admin admin] PATH_INFO: `/v3/projects/b385db5b846f4d8588a22c2580858ff7/users/71b455d10cd843098e45ed76597b4f62/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:19.917941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97f9ce-79de-4014-a1af-8d8b897a71e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b385db5b846f4d8588a22c2580858ff7, user_id=71b455d10cd843098e45ed76597b4f62, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:19.921859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97f9ce-79de-4014-a1af-8d8b897a71e1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:20.005231 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3903/7744] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:19 2022] POST /identity/v3/projects => generated 371 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:20.008102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ac6ca-89bf-4cb1-873d-017a988417e9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:20.075985 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3842/7745] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:19 2022] PUT /identity/v3/projects/b385db5b846f4d8588a22c2580858ff7/users/71b455d10cd843098e45ed76597b4f62/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:20.077687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97f9ce-79de-4014-a1af-8d8b897a71e1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:20.170109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ac6ca-89bf-4cb1-873d-017a988417e9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:20.284640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97f9ce-79de-4014-a1af-8d8b897a71e1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:20.309666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90eb562-32c0-44b2-9e45-fdda21fc61a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:20.319288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eb562-32c0-44b2-9e45-fdda21fc61a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:20.319288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eb562-32c0-44b2-9e45-fdda21fc61a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:20.319288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eb562-32c0-44b2-9e45-fdda21fc61a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:20.319288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90eb562-32c0-44b2-9e45-fdda21fc61a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:20.319288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90eb562-32c0-44b2-9e45-fdda21fc61a1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:20.351943 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3843/7746] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:20.353725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90eb562-32c0-44b2-9e45-fdda21fc61a1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:20.375995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90eb562-32c0-44b2-9e45-fdda21fc61a1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:20.382563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d3e00-6212-4c40-a464-141ca871e373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:20.383434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d3e00-6212-4c40-a464-141ca871e373 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:20.384331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d3e00-6212-4c40-a464-141ca871e373 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:20.384978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d3e00-6212-4c40-a464-141ca871e373 admin admin] PATH_INFO: `/v3/projects/b385db5b846f4d8588a22c2580858ff7/users/71b455d10cd843098e45ed76597b4f62/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:20.386752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83375f9-68ed-4d36-8ca6-2dcacad18ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:20.387600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83375f9-68ed-4d36-8ca6-2dcacad18ffd admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:20.388067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83375f9-68ed-4d36-8ca6-2dcacad18ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:20.388438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d3e00-6212-4c40-a464-141ca871e373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b385db5b846f4d8588a22c2580858ff7, user_id=71b455d10cd843098e45ed76597b4f62, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:20.388746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83375f9-68ed-4d36-8ca6-2dcacad18ffd admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:20.389602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83375f9-68ed-4d36-8ca6-2dcacad18ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:20.391684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d3e00-6212-4c40-a464-141ca871e373 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:20.391960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83375f9-68ed-4d36-8ca6-2dcacad18ffd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:20.408008 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3844/7747] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:20 2022] PUT /identity/v3/projects/b385db5b846f4d8588a22c2580858ff7/users/71b455d10cd843098e45ed76597b4f62/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:20.420606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7807f59-3566-473b-af5a-be40daa8352f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:20.424005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7807f59-3566-473b-af5a-be40daa8352f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:20.424271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7807f59-3566-473b-af5a-be40daa8352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:20.479984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d7807f59-3566-473b-af5a-be40daa8352f None None] MFA Rules not processed for user `71b455d10cd843098e45ed76597b4f62`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:20.481977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d7807f59-3566-473b-af5a-be40daa8352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:20.496820 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3904/7748] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:20 2022] POST /identity/v3/users => generated 286 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:20.500745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83375f9-68ed-4d36-8ca6-2dcacad18ffd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:20.555108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83375f9-68ed-4d36-8ca6-2dcacad18ffd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:20.688003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6fa90-10ac-4814-ae6e-fcc3f3e889f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:20.688670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6fa90-10ac-4814-ae6e-fcc3f3e889f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:20.688951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6fa90-10ac-4814-ae6e-fcc3f3e889f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:20.689223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6fa90-10ac-4814-ae6e-fcc3f3e889f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:20.689867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6fa90-10ac-4814-ae6e-fcc3f3e889f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:20.691477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6fa90-10ac-4814-ae6e-fcc3f3e889f1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:20.699816 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3845/7749] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:01:20.707445 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3905/7750] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:20.713093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7807f59-3566-473b-af5a-be40daa8352f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:20.716039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d7807f59-3566-473b-af5a-be40daa8352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:20.737317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6fa90-10ac-4814-ae6e-fcc3f3e889f1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:20.771104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6fa90-10ac-4814-ae6e-fcc3f3e889f1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:20.809268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f510bc-3997-497e-bd4e-4f09806265f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:20.810084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f510bc-3997-497e-bd4e-4f09806265f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:20.810356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f510bc-3997-497e-bd4e-4f09806265f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:20.810632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f510bc-3997-497e-bd4e-4f09806265f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:20.811285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f510bc-3997-497e-bd4e-4f09806265f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:20.813430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f510bc-3997-497e-bd4e-4f09806265f4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:20.847750 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3906/7751] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:20.858317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f510bc-3997-497e-bd4e-4f09806265f4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:20.882833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f510bc-3997-497e-bd4e-4f09806265f4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:20.904199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444a024-5a57-46b3-a1f7-4123030c3220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:20.904199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444a024-5a57-46b3-a1f7-4123030c3220 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:20.904505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444a024-5a57-46b3-a1f7-4123030c3220 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:20.904615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444a024-5a57-46b3-a1f7-4123030c3220 admin admin] PATH_INFO: `/v3/projects/dde2503c541146e99a98caf08e09e1fa/users/55d87c545d5e4b68aab6ce12650beee6/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:20.913822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:20.939001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444a024-5a57-46b3-a1f7-4123030c3220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde2503c541146e99a98caf08e09e1fa, user_id=55d87c545d5e4b68aab6ce12650beee6, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:20.942871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444a024-5a57-46b3-a1f7-4123030c3220 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:20.943390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7807f59-3566-473b-af5a-be40daa8352f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:20.976367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c574f-233d-46c9-8871-3d398a29cce5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:20.981291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c574f-233d-46c9-8871-3d398a29cce5 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:20.981868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c574f-233d-46c9-8871-3d398a29cce5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:20.982303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c574f-233d-46c9-8871-3d398a29cce5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:20.987512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4e1c574f-233d-46c9-8871-3d398a29cce5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:21.045005 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3907/7752] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:20 2022] PUT /identity/v3/projects/dde2503c541146e99a98caf08e09e1fa/users/55d87c545d5e4b68aab6ce12650beee6/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:21.055300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:21.060224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4af8a4-8eb5-43f7-b850-a8d48d594582 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:21.060588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4af8a4-8eb5-43f7-b850-a8d48d594582 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:21.060868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4af8a4-8eb5-43f7-b850-a8d48d594582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:21.116972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ad4af8a4-8eb5-43f7-b850-a8d48d594582 None None] MFA Rules not processed for user `55d87c545d5e4b68aab6ce12650beee6`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:21.116972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ad4af8a4-8eb5-43f7-b850-a8d48d594582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:21.196766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c574f-233d-46c9-8871-3d398a29cce5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:21.203888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c574f-233d-46c9-8871-3d398a29cce5 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:21.238329 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3846/7753] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:21.301676 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3908/7754] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:01:21.307219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c574f-233d-46c9-8871-3d398a29cce5 service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:21.323613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c574f-233d-46c9-8871-3d398a29cce5 service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:21.556844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524d727-4900-40da-b5e9-d368ad1d8fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:21.557783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524d727-4900-40da-b5e9-d368ad1d8fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:21.558975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524d727-4900-40da-b5e9-d368ad1d8fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:21.559111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524d727-4900-40da-b5e9-d368ad1d8fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:21.559856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524d727-4900-40da-b5e9-d368ad1d8fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:21.582225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524d727-4900-40da-b5e9-d368ad1d8fd1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:21.833216 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3847/7755] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:21 2022] POST /identity/v3/projects => generated 373 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:21.833758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4af8a4-8eb5-43f7-b850-a8d48d594582 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:21.855101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4af8a4-8eb5-43f7-b850-a8d48d594582 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:21.920974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:22.006106 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a285b71-386a-4234-b42e-13ccbb2b79d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:22.007506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a285b71-386a-4234-b42e-13ccbb2b79d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:22.007653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a285b71-386a-4234-b42e-13ccbb2b79d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:22.008078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a285b71-386a-4234-b42e-13ccbb2b79d7 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:22.008838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a285b71-386a-4234-b42e-13ccbb2b79d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:22.011028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a285b71-386a-4234-b42e-13ccbb2b79d7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:22.222872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524d727-4900-40da-b5e9-d368ad1d8fd1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:22.232117 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3909/7756] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:21 2022] POST /identity/v3/users => generated 293 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:01:22.253361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524d727-4900-40da-b5e9-d368ad1d8fd1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:22.265534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be5fd8-33ae-435e-a212-cbf94117508c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:22.269372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be5fd8-33ae-435e-a212-cbf94117508c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:22.269705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be5fd8-33ae-435e-a212-cbf94117508c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:22.270024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be5fd8-33ae-435e-a212-cbf94117508c admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:22.270861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be5fd8-33ae-435e-a212-cbf94117508c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:22.275242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be5fd8-33ae-435e-a212-cbf94117508c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:22.328348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a285b71-386a-4234-b42e-13ccbb2b79d7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:22.341685 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3848/7757] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:22.347426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a285b71-386a-4234-b42e-13ccbb2b79d7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:22.361591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fb42a-c44b-4b15-9ca2-1cc3b164b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:22.363783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fb42a-c44b-4b15-9ca2-1cc3b164b38a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:22.366028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fb42a-c44b-4b15-9ca2-1cc3b164b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:22.371260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fb42a-c44b-4b15-9ca2-1cc3b164b38a admin admin] PATH_INFO: `/v3/projects/6fcdd65876ff4057be9b48a2d4b8131b/users/5b770650f0d844b598ab1d144b5d933c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:22.455918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fb42a-c44b-4b15-9ca2-1cc3b164b38a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fcdd65876ff4057be9b48a2d4b8131b, user_id=5b770650f0d844b598ab1d144b5d933c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:22.458771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fb42a-c44b-4b15-9ca2-1cc3b164b38a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:22.545606 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3910/7758] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:22 2022] PUT /identity/v3/projects/6fcdd65876ff4057be9b48a2d4b8131b/users/5b770650f0d844b598ab1d144b5d933c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:22.553576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be5fd8-33ae-435e-a212-cbf94117508c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:22.570167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be5fd8-33ae-435e-a212-cbf94117508c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:22.741779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ddb7f-9f19-495e-be93-0bc6d9de4ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:22.743041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ddb7f-9f19-495e-be93-0bc6d9de4ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:22.749398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ddb7f-9f19-495e-be93-0bc6d9de4ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:22.749962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ddb7f-9f19-495e-be93-0bc6d9de4ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:22.750859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ddb7f-9f19-495e-be93-0bc6d9de4ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:22.757449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ddb7f-9f19-495e-be93-0bc6d9de4ea9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:22.810799 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3849/7759] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:22.811983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fb42a-c44b-4b15-9ca2-1cc3b164b38a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:22.835714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fb42a-c44b-4b15-9ca2-1cc3b164b38a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:22.845356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930f6f7-8955-4419-bef8-7bc2b36f3be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:22.846250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930f6f7-8955-4419-bef8-7bc2b36f3be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:22.846689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930f6f7-8955-4419-bef8-7bc2b36f3be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:22.847069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930f6f7-8955-4419-bef8-7bc2b36f3be5 admin admin] PATH_INFO: `/v3/projects/6fcdd65876ff4057be9b48a2d4b8131b/users/5b770650f0d844b598ab1d144b5d933c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:22.853152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930f6f7-8955-4419-bef8-7bc2b36f3be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fcdd65876ff4057be9b48a2d4b8131b, user_id=5b770650f0d844b598ab1d144b5d933c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:22.856780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930f6f7-8955-4419-bef8-7bc2b36f3be5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:22.872124 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3911/7760] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:22 2022] PUT /identity/v3/projects/6fcdd65876ff4057be9b48a2d4b8131b/users/5b770650f0d844b598ab1d144b5d933c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:22.882395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bac07f-6461-4239-9e29-cadc678659ae None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:22.883247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bac07f-6461-4239-9e29-cadc678659ae None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:22.883719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bac07f-6461-4239-9e29-cadc678659ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:22.968412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-74bac07f-6461-4239-9e29-cadc678659ae None None] MFA Rules not processed for user `5b770650f0d844b598ab1d144b5d933c`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:22.970491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-74bac07f-6461-4239-9e29-cadc678659ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:23.144290 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3850/7761] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:23.158971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930f6f7-8955-4419-bef8-7bc2b36f3be5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:23.283509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:23.330006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930f6f7-8955-4419-bef8-7bc2b36f3be5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:23.346200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c681d9-a981-4077-b0cf-3643f5e6fc30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:23.346200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c681d9-a981-4077-b0cf-3643f5e6fc30 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:23.346200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c681d9-a981-4077-b0cf-3643f5e6fc30 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:23.346200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c681d9-a981-4077-b0cf-3643f5e6fc30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:23.362017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c681d9-a981-4077-b0cf-3643f5e6fc30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:23.364433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c681d9-a981-4077-b0cf-3643f5e6fc30 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:23.393464 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3912/7762] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:23.809614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bac07f-6461-4239-9e29-cadc678659ae None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:23.811350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-74bac07f-6461-4239-9e29-cadc678659ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:23.821716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:23.867517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bac07f-6461-4239-9e29-cadc678659ae None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:23.889912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c50bc7-83cc-4411-a4c4-9df3bf33238c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:23.891669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c50bc7-83cc-4411-a4c4-9df3bf33238c service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:23.892000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c50bc7-83cc-4411-a4c4-9df3bf33238c service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:23.894066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c50bc7-83cc-4411-a4c4-9df3bf33238c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:24.136625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c50bc7-83cc-4411-a4c4-9df3bf33238c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:24.138273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c50bc7-83cc-4411-a4c4-9df3bf33238c service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:24.162713 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3851/7763] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:24.566358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fda9d-c420-4665-a626-c165516118bd None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:24.567315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fda9d-c420-4665-a626-c165516118bd None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:24.567814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fda9d-c420-4665-a626-c165516118bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:24.626959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:24.649960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-185fda9d-c420-4665-a626-c165516118bd None None] MFA Rules not processed for user `6a6f3651e3fe4f3aa2467134c1776afb`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:24.655388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-185fda9d-c420-4665-a626-c165516118bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:24.885520 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3913/7764] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:24.911357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c50bc7-83cc-4411-a4c4-9df3bf33238c service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:24.914211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-14c50bc7-83cc-4411-a4c4-9df3bf33238c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:24.953333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:DELETE=9 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:25.149453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c50bc7-83cc-4411-a4c4-9df3bf33238c service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:25.163443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee1d89-5c2a-4857-bce2-a2063691b810 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:25.164554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee1d89-5c2a-4857-bce2-a2063691b810 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:25.165044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee1d89-5c2a-4857-bce2-a2063691b810 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:25.165623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee1d89-5c2a-4857-bce2-a2063691b810 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:25.222180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee1d89-5c2a-4857-bce2-a2063691b810 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:25.226022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee1d89-5c2a-4857-bce2-a2063691b810 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:25.272641 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3852/7765] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:01:25.644887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d18702-b94b-4d19-b564-5802d50589b0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:25.645348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d18702-b94b-4d19-b564-5802d50589b0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:25.645609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d18702-b94b-4d19-b564-5802d50589b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:25.759819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b6d18702-b94b-4d19-b564-5802d50589b0 None None] MFA Rules not processed for user `346801cb8db44f118fcacaa356cc8ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:25.790340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b6d18702-b94b-4d19-b564-5802d50589b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:25.830981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:26.032858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee1d89-5c2a-4857-bce2-a2063691b810 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:26.034622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2aee1d89-5c2a-4857-bce2-a2063691b810 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:26.115356 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3914/7766] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:01:26.162199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:26.310321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee1d89-5c2a-4857-bce2-a2063691b810 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:26.326673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be130ee-4387-47f1-b637-a1209a17785e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:26.329981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be130ee-4387-47f1-b637-a1209a17785e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:26.330293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be130ee-4387-47f1-b637-a1209a17785e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:26.330580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be130ee-4387-47f1-b637-a1209a17785e admin admin] PATH_INFO: `/v3/users/d9c8f9ed891f4fa28421a9f09e2d0f78` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:26.331986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be130ee-4387-47f1-b637-a1209a17785e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c8f9ed891f4fa28421a9f09e2d0f78)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:26.333978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be130ee-4387-47f1-b637-a1209a17785e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:26.364639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:26.640760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0be130ee-4387-47f1-b637-a1209a17785e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c8f9ed891f4fa28421a9f09e2d0f78'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:26.717723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0be130ee-4387-47f1-b637-a1209a17785e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c8f9ed891f4fa28421a9f09e2d0f78'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:26.719517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0be130ee-4387-47f1-b637-a1209a17785e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c8f9ed891f4fa28421a9f09e2d0f78'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:26.729216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0be130ee-4387-47f1-b637-a1209a17785e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c8f9ed891f4fa28421a9f09e2d0f78'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:26.760496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-0be130ee-4387-47f1-b637-a1209a17785e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c8f9ed891f4fa28421a9f09e2d0f78'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:26.778494 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3853/7767] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:01:26 2022] DELETE /identity/v3/users/d9c8f9ed891f4fa28421a9f09e2d0f78 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:01:26.783097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd4472-be09-415b-a509-6e1b3a0f16be None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:26.783545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd4472-be09-415b-a509-6e1b3a0f16be None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:26.783978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd4472-be09-415b-a509-6e1b3a0f16be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:26.794689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046899-1096-4ab5-b78e-7fcbb48cf23f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:26.795286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046899-1096-4ab5-b78e-7fcbb48cf23f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:26.811806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046899-1096-4ab5-b78e-7fcbb48cf23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:26.833866 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-7c046899-1096-4ab5-b78e-7fcbb48cf23f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:01:26.833866 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:01:26.833866 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:01:26.833866 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:01:26.833866 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:01:26.833866 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:01:26.833866 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:01:26.833866 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:01:26.833866 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:01:26.833866 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:01:26.833866 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:01:26.833866 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:01:26.833866 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:01:26.835030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:01:26.835030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:01:26.835030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:01:26.835030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:01:26.835030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:01:26.835030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:01:26.835030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:01:26.835030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:01:26.835030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:01:26.835030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:01:26.835030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:01:26.835030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:01:26.835030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:01:26.835030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:01:26.835030 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:01:26.841215 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3854/7768] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:01:26 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 48 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:01:26.873707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4dcd4472-be09-415b-a509-6e1b3a0f16be None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:26.873707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4dcd4472-be09-415b-a509-6e1b3a0f16be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:27.037765 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3915/7769] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:27.057325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c046899-1096-4ab5-b78e-7fcbb48cf23f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:27.059903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7c046899-1096-4ab5-b78e-7fcbb48cf23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:27.259065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c046899-1096-4ab5-b78e-7fcbb48cf23f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:27.266911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e839710-9fb6-49a1-ace4-a01916aa6c8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:27.266911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e839710-9fb6-49a1-ace4-a01916aa6c8e service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:27.266911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e839710-9fb6-49a1-ace4-a01916aa6c8e service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:27.266911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e839710-9fb6-49a1-ace4-a01916aa6c8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:27.282124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e839710-9fb6-49a1-ace4-a01916aa6c8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:27.284218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e839710-9fb6-49a1-ace4-a01916aa6c8e service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:27.302699 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3855/7770] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:28.157570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:28.353158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:28.946111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:29.317460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd4472-be09-415b-a509-6e1b3a0f16be None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:29.320477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4dcd4472-be09-415b-a509-6e1b3a0f16be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:29.338890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd4472-be09-415b-a509-6e1b3a0f16be None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:29.373229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488e713-2dc5-4456-8d09-35a0efcfd6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:29.374044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488e713-2dc5-4456-8d09-35a0efcfd6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:29.374167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488e713-2dc5-4456-8d09-35a0efcfd6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:29.380775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488e713-2dc5-4456-8d09-35a0efcfd6ea admin admin] PATH_INFO: `/v3/projects/29478bc90fd044b2bb31d3ce86c1f22f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:29.389059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488e713-2dc5-4456-8d09-35a0efcfd6ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=29478bc90fd044b2bb31d3ce86c1f22f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:29.391132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488e713-2dc5-4456-8d09-35a0efcfd6ea admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:29.680726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3488e713-2dc5-4456-8d09-35a0efcfd6ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29478bc90fd044b2bb31d3ce86c1f22f', 'request_id': 'req-3488e713-2dc5-4456-8d09-35a0efcfd6ea'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:29.696230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3488e713-2dc5-4456-8d09-35a0efcfd6ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29478bc90fd044b2bb31d3ce86c1f22f', 'request_id': 'req-3488e713-2dc5-4456-8d09-35a0efcfd6ea'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:29.906282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3488e713-2dc5-4456-8d09-35a0efcfd6ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29478bc90fd044b2bb31d3ce86c1f22f', 'request_id': 'req-3488e713-2dc5-4456-8d09-35a0efcfd6ea'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:29.929561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3488e713-2dc5-4456-8d09-35a0efcfd6ea admin admin] The token cache is being invalidate because project 29478bc90fd044b2bb31d3ce86c1f22f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:01:29.930632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3488e713-2dc5-4456-8d09-35a0efcfd6ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:29.932062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3488e713-2dc5-4456-8d09-35a0efcfd6ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:29.943879 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3916/7771] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:01:29 2022] DELETE /identity/v3/projects/29478bc90fd044b2bb31d3ce86c1f22f => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:29.947695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e839710-9fb6-49a1-ace4-a01916aa6c8e service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:29.985037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e839710-9fb6-49a1-ace4-a01916aa6c8e service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:30.166280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:30.220034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:30.221574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cafa78-89ad-495e-a70f-3f3eaaf81fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:30.222241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cafa78-89ad-495e-a70f-3f3eaaf81fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:30.222523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cafa78-89ad-495e-a70f-3f3eaaf81fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:30.222798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cafa78-89ad-495e-a70f-3f3eaaf81fbc admin admin] PATH_INFO: `/v3/users/37333df2664147949f44b8c6f6194fad` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:30.230085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cafa78-89ad-495e-a70f-3f3eaaf81fbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=37333df2664147949f44b8c6f6194fad)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:30.239094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cafa78-89ad-495e-a70f-3f3eaaf81fbc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:30.708419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a6cafa78-89ad-495e-a70f-3f3eaaf81fbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37333df2664147949f44b8c6f6194fad'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:30.900504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a6cafa78-89ad-495e-a70f-3f3eaaf81fbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37333df2664147949f44b8c6f6194fad'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:30.901553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a6cafa78-89ad-495e-a70f-3f3eaaf81fbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37333df2664147949f44b8c6f6194fad'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:30.913347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a6cafa78-89ad-495e-a70f-3f3eaaf81fbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37333df2664147949f44b8c6f6194fad'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:30.941803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a6cafa78-89ad-495e-a70f-3f3eaaf81fbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37333df2664147949f44b8c6f6194fad'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:30.954351 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3856/7772] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:01:29 2022] DELETE /identity/v3/users/37333df2664147949f44b8c6f6194fad => generated 0 bytes in 1007 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:32.062505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:32.132911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488e713-2dc5-4456-8d09-35a0efcfd6ea admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:32.135034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3488e713-2dc5-4456-8d09-35a0efcfd6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:32.279716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:32.294381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cafa78-89ad-495e-a70f-3f3eaaf81fbc admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:32.296060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a6cafa78-89ad-495e-a70f-3f3eaaf81fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:32.393316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488e713-2dc5-4456-8d09-35a0efcfd6ea admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:32.563220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cafa78-89ad-495e-a70f-3f3eaaf81fbc admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:32.581573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b86be-a79a-47a7-894d-43242ad7dd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:32.582250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b86be-a79a-47a7-894d-43242ad7dd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:32.582545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b86be-a79a-47a7-894d-43242ad7dd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:32.582826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b86be-a79a-47a7-894d-43242ad7dd7d admin admin] PATH_INFO: `/v3/projects/8c111380a0ac487e9965a9d4479d8529` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:32.592418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b86be-a79a-47a7-894d-43242ad7dd7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c111380a0ac487e9965a9d4479d8529)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:32.597967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b86be-a79a-47a7-894d-43242ad7dd7d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:32.607987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82861b-ebe9-4076-adf6-b9d7bb90dd5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:32.608661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82861b-ebe9-4076-adf6-b9d7bb90dd5e service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:32.608944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82861b-ebe9-4076-adf6-b9d7bb90dd5e service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:32.609218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82861b-ebe9-4076-adf6-b9d7bb90dd5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:32.615345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2d82861b-ebe9-4076-adf6-b9d7bb90dd5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:32.645611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82861b-ebe9-4076-adf6-b9d7bb90dd5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:32.647500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82861b-ebe9-4076-adf6-b9d7bb90dd5e service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:32.663035 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3917/7773] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:32.924366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-499b86be-a79a-47a7-894d-43242ad7dd7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c111380a0ac487e9965a9d4479d8529', 'request_id': 'req-499b86be-a79a-47a7-894d-43242ad7dd7d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:32.943495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-499b86be-a79a-47a7-894d-43242ad7dd7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c111380a0ac487e9965a9d4479d8529', 'request_id': 'req-499b86be-a79a-47a7-894d-43242ad7dd7d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:32.954562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-499b86be-a79a-47a7-894d-43242ad7dd7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c111380a0ac487e9965a9d4479d8529', 'request_id': 'req-499b86be-a79a-47a7-894d-43242ad7dd7d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:33.070064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-499b86be-a79a-47a7-894d-43242ad7dd7d admin admin] The token cache is being invalidate because project 8c111380a0ac487e9965a9d4479d8529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:01:33.070675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-499b86be-a79a-47a7-894d-43242ad7dd7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:33.074287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-499b86be-a79a-47a7-894d-43242ad7dd7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:33.084662 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3857/7774] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:01:32 2022] DELETE /identity/v3/projects/8c111380a0ac487e9965a9d4479d8529 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:01:33.090057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcba398-923a-464e-a7f8-2ba3d64105c7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:33.090342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcba398-923a-464e-a7f8-2ba3d64105c7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:33.090815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcba398-923a-464e-a7f8-2ba3d64105c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:33.126838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7fcba398-923a-464e-a7f8-2ba3d64105c7 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:33.137519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7fcba398-923a-464e-a7f8-2ba3d64105c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:33.278235 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3918/7775] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:33.287134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72eab5-021c-4faa-85fa-094d9ab0f33c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:33.287573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72eab5-021c-4faa-85fa-094d9ab0f33c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:33.287947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72eab5-021c-4faa-85fa-094d9ab0f33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:33.341238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8f72eab5-021c-4faa-85fa-094d9ab0f33c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:33.344813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8f72eab5-021c-4faa-85fa-094d9ab0f33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:33.365559 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3858/7776] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:33.370319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcba398-923a-464e-a7f8-2ba3d64105c7 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:33.383078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcba398-923a-464e-a7f8-2ba3d64105c7 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:33.412311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946e663-de20-4114-9da2-6805c4bb276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:33.412533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e663-de20-4114-9da2-6805c4bb276e admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:33.413005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e663-de20-4114-9da2-6805c4bb276e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:33.413451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e663-de20-4114-9da2-6805c4bb276e admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:33.414298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946e663-de20-4114-9da2-6805c4bb276e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:01:33.414782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946e663-de20-4114-9da2-6805c4bb276e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:33.416599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946e663-de20-4114-9da2-6805c4bb276e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:33.469772 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3919/7777] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:01:33.470440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72eab5-021c-4faa-85fa-094d9ab0f33c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:33.485820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72eab5-021c-4faa-85fa-094d9ab0f33c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:33.517045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17a644-7f92-4c8d-8732-7cd530db7a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:33.519068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17a644-7f92-4c8d-8732-7cd530db7a71 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:33.519790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17a644-7f92-4c8d-8732-7cd530db7a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:33.522126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17a644-7f92-4c8d-8732-7cd530db7a71 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:33.527384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17a644-7f92-4c8d-8732-7cd530db7a71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:33.530023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17a644-7f92-4c8d-8732-7cd530db7a71 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:33.690397 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3859/7778] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:33 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:33.694575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946e663-de20-4114-9da2-6805c4bb276e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:33.718034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946e663-de20-4114-9da2-6805c4bb276e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:33.922645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605b864-3da6-4c59-97ea-dde9a13cd9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:33.923618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605b864-3da6-4c59-97ea-dde9a13cd9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:33.927694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605b864-3da6-4c59-97ea-dde9a13cd9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:33.927694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605b864-3da6-4c59-97ea-dde9a13cd9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:33.927694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605b864-3da6-4c59-97ea-dde9a13cd9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:33.927694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605b864-3da6-4c59-97ea-dde9a13cd9e2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:34.028004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:34.100055 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3920/7779] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:33 2022] POST /identity/v3/users => generated 293 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:34.101896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17a644-7f92-4c8d-8732-7cd530db7a71 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:34.122900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17a644-7f92-4c8d-8732-7cd530db7a71 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:34.143671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c6444-6b6f-4f0f-ab42-6052b70685c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:34.144470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c6444-6b6f-4f0f-ab42-6052b70685c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:34.144814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c6444-6b6f-4f0f-ab42-6052b70685c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:34.145152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c6444-6b6f-4f0f-ab42-6052b70685c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:34.155926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c6444-6b6f-4f0f-ab42-6052b70685c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:34.155926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c6444-6b6f-4f0f-ab42-6052b70685c4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:34.181376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605b864-3da6-4c59-97ea-dde9a13cd9e2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:34.181955 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3860/7780] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:01:34.201211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605b864-3da6-4c59-97ea-dde9a13cd9e2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:34.236935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955b012-08f0-4d06-a3e4-3d94086e9767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:34.237576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b012-08f0-4d06-a3e4-3d94086e9767 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:34.237855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b012-08f0-4d06-a3e4-3d94086e9767 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:34.238127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b012-08f0-4d06-a3e4-3d94086e9767 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:34.238785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955b012-08f0-4d06-a3e4-3d94086e9767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:34.240418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955b012-08f0-4d06-a3e4-3d94086e9767 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:34.271981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:34.280075 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3921/7781] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:34.284479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c6444-6b6f-4f0f-ab42-6052b70685c4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:34.306211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c6444-6b6f-4f0f-ab42-6052b70685c4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:34.337062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef21f2f-b1f3-4988-9cc2-e89fde42602d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:34.340031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef21f2f-b1f3-4988-9cc2-e89fde42602d admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:34.341259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef21f2f-b1f3-4988-9cc2-e89fde42602d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:34.341661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef21f2f-b1f3-4988-9cc2-e89fde42602d admin admin] PATH_INFO: `/v3/projects/6c586e88ffaa4e489cbfd6f2a712e2d0/users/c33a5cdb801747979494ceffdbb0fda3/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:34.377806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef21f2f-b1f3-4988-9cc2-e89fde42602d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c586e88ffaa4e489cbfd6f2a712e2d0, user_id=c33a5cdb801747979494ceffdbb0fda3, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:34.381565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef21f2f-b1f3-4988-9cc2-e89fde42602d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:34.507480 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3861/7782] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:34 2022] PUT /identity/v3/projects/6c586e88ffaa4e489cbfd6f2a712e2d0/users/c33a5cdb801747979494ceffdbb0fda3/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:34.521652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3933ec6-b097-4220-b036-1e1a360e0c99 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:34.522189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3933ec6-b097-4220-b036-1e1a360e0c99 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:34.522623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3933ec6-b097-4220-b036-1e1a360e0c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:34.642707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e3933ec6-b097-4220-b036-1e1a360e0c99 None None] MFA Rules not processed for user `c33a5cdb801747979494ceffdbb0fda3`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:34.643893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e3933ec6-b097-4220-b036-1e1a360e0c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:34.903269 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3922/7783] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:34.908131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef21f2f-b1f3-4988-9cc2-e89fde42602d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:35.061664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef21f2f-b1f3-4988-9cc2-e89fde42602d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:35.095557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39d69a-86eb-4631-9d61-ad4e4d8b8602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:35.096196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39d69a-86eb-4631-9d61-ad4e4d8b8602 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:35.096603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39d69a-86eb-4631-9d61-ad4e4d8b8602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:35.096886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39d69a-86eb-4631-9d61-ad4e4d8b8602 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:35.097549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39d69a-86eb-4631-9d61-ad4e4d8b8602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:35.104427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39d69a-86eb-4631-9d61-ad4e4d8b8602 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:35.221217 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3862/7784] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:34 2022] POST /identity/v3/projects => generated 387 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:35.223937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3933ec6-b097-4220-b036-1e1a360e0c99 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:35.245541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3933ec6-b097-4220-b036-1e1a360e0c99 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:35.277699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:35.479306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:35.540090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235ced-2b56-4408-be44-023c6a54d1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:35.545011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235ced-2b56-4408-be44-023c6a54d1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:35.550396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235ced-2b56-4408-be44-023c6a54d1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:35.553418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235ced-2b56-4408-be44-023c6a54d1d7 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:35.556972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e235ced-2b56-4408-be44-023c6a54d1d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:35.567514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e235ced-2b56-4408-be44-023c6a54d1d7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:35.764529 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3923/7785] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:35 2022] POST /identity/v3/users => generated 300 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:35.766142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39d69a-86eb-4631-9d61-ad4e4d8b8602 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:35.786630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39d69a-86eb-4631-9d61-ad4e4d8b8602 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:35.848119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172a8a0-6fa3-4619-887a-2ae56816c208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:35.850931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172a8a0-6fa3-4619-887a-2ae56816c208 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:35.851215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172a8a0-6fa3-4619-887a-2ae56816c208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:35.854397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172a8a0-6fa3-4619-887a-2ae56816c208 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:35.855459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172a8a0-6fa3-4619-887a-2ae56816c208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:35.858070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172a8a0-6fa3-4619-887a-2ae56816c208 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:35.884685 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3863/7786] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:35.890090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235ced-2b56-4408-be44-023c6a54d1d7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:35.905517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235ced-2b56-4408-be44-023c6a54d1d7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:35.929790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facf563-d017-4054-a58d-7b5e4e5e5750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:35.930497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facf563-d017-4054-a58d-7b5e4e5e5750 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:35.930979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facf563-d017-4054-a58d-7b5e4e5e5750 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:35.931428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facf563-d017-4054-a58d-7b5e4e5e5750 admin admin] PATH_INFO: `/v3/projects/1398b5c2e3cf425aa6744ab40cf870de/users/fc989e46129b42f189dc6e81e9cfeb0b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:36.019543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facf563-d017-4054-a58d-7b5e4e5e5750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1398b5c2e3cf425aa6744ab40cf870de, user_id=fc989e46129b42f189dc6e81e9cfeb0b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:36.022323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facf563-d017-4054-a58d-7b5e4e5e5750 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:36.059757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172a8a0-6fa3-4619-887a-2ae56816c208 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:36.066279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1172a8a0-6fa3-4619-887a-2ae56816c208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:36.104035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172a8a0-6fa3-4619-887a-2ae56816c208 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:36.119141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7bae1-aad5-4e54-bb8b-0b809929271b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:36.125111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7bae1-aad5-4e54-bb8b-0b809929271b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:36.125478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7bae1-aad5-4e54-bb8b-0b809929271b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:36.126038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7bae1-aad5-4e54-bb8b-0b809929271b admin admin] PATH_INFO: `/v3/users/c9ecfdc3b09e4ea1b7b27867dd69c1ac` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:36.127988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7bae1-aad5-4e54-bb8b-0b809929271b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ecfdc3b09e4ea1b7b27867dd69c1ac)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:36.131046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7bae1-aad5-4e54-bb8b-0b809929271b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:36.139980 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3924/7787] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:35 2022] PUT /identity/v3/projects/1398b5c2e3cf425aa6744ab40cf870de/users/fc989e46129b42f189dc6e81e9cfeb0b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:36.141027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facf563-d017-4054-a58d-7b5e4e5e5750 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:36.341127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facf563-d017-4054-a58d-7b5e4e5e5750 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:36.357907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c4365-61b9-402b-a4c5-8e4ac9e67fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:36.358835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c4365-61b9-402b-a4c5-8e4ac9e67fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:36.359347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c4365-61b9-402b-a4c5-8e4ac9e67fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:36.359809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c4365-61b9-402b-a4c5-8e4ac9e67fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:36.361952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c4365-61b9-402b-a4c5-8e4ac9e67fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:36.363814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c4365-61b9-402b-a4c5-8e4ac9e67fb2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:36.412454 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3925/7788] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:36.414103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c4365-61b9-402b-a4c5-8e4ac9e67fb2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:36.438278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c4365-61b9-402b-a4c5-8e4ac9e67fb2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:36.447247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-51c7bae1-aad5-4e54-bb8b-0b809929271b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ecfdc3b09e4ea1b7b27867dd69c1ac'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:36.451285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179aa88-f756-4447-839c-a40a2fd6160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:36.452265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179aa88-f756-4447-839c-a40a2fd6160c admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:36.452745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179aa88-f756-4447-839c-a40a2fd6160c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:36.453207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179aa88-f756-4447-839c-a40a2fd6160c admin admin] PATH_INFO: `/v3/projects/1398b5c2e3cf425aa6744ab40cf870de/users/fc989e46129b42f189dc6e81e9cfeb0b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:36.458941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179aa88-f756-4447-839c-a40a2fd6160c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1398b5c2e3cf425aa6744ab40cf870de, user_id=fc989e46129b42f189dc6e81e9cfeb0b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:36.462028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179aa88-f756-4447-839c-a40a2fd6160c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:36.486804 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3926/7789] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:36 2022] PUT /identity/v3/projects/1398b5c2e3cf425aa6744ab40cf870de/users/fc989e46129b42f189dc6e81e9cfeb0b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:36.499857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733847a-793f-4503-9845-13656cfac254 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:36.500142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733847a-793f-4503-9845-13656cfac254 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:36.500663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733847a-793f-4503-9845-13656cfac254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:36.523121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-51c7bae1-aad5-4e54-bb8b-0b809929271b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ecfdc3b09e4ea1b7b27867dd69c1ac'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:36.524241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-51c7bae1-aad5-4e54-bb8b-0b809929271b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ecfdc3b09e4ea1b7b27867dd69c1ac'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:36.536691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-51c7bae1-aad5-4e54-bb8b-0b809929271b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ecfdc3b09e4ea1b7b27867dd69c1ac'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:36.559417 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6733847a-793f-4503-9845-13656cfac254 None None] MFA Rules not processed for user `fc989e46129b42f189dc6e81e9cfeb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:36.563745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6733847a-793f-4503-9845-13656cfac254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:36.567394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-51c7bae1-aad5-4e54-bb8b-0b809929271b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ecfdc3b09e4ea1b7b27867dd69c1ac'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:36.581899 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3864/7790] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:01:36 2022] DELETE /identity/v3/users/c9ecfdc3b09e4ea1b7b27867dd69c1ac => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:36.791630 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3927/7791] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:36.834448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7bae1-aad5-4e54-bb8b-0b809929271b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:36.836367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-51c7bae1-aad5-4e54-bb8b-0b809929271b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:36.843533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:37.043426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7bae1-aad5-4e54-bb8b-0b809929271b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:37.074395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d92f94-829e-402e-8d76-bc9e57bb4830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:37.075093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d92f94-829e-402e-8d76-bc9e57bb4830 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:37.075716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d92f94-829e-402e-8d76-bc9e57bb4830 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:37.076152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d92f94-829e-402e-8d76-bc9e57bb4830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:37.278189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d92f94-829e-402e-8d76-bc9e57bb4830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:37.278189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d92f94-829e-402e-8d76-bc9e57bb4830 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:37.312341 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3865/7792] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:01:37.474536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733847a-793f-4503-9845-13656cfac254 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:37.477202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6733847a-793f-4503-9845-13656cfac254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:37.605930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733847a-793f-4503-9845-13656cfac254 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:37.763430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:37.855650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6e212-fcb8-4d0e-8d00-68b89a199258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:37.859661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6e212-fcb8-4d0e-8d00-68b89a199258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:37.861747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6e212-fcb8-4d0e-8d00-68b89a199258 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:37.861747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6e212-fcb8-4d0e-8d00-68b89a199258 admin admin] PATH_INFO: `/v3/users/c33a5cdb801747979494ceffdbb0fda3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:37.882872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6e212-fcb8-4d0e-8d00-68b89a199258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c33a5cdb801747979494ceffdbb0fda3)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:37.894496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6e212-fcb8-4d0e-8d00-68b89a199258 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:37.918403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:38.351630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2bb6e212-fcb8-4d0e-8d00-68b89a199258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c33a5cdb801747979494ceffdbb0fda3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:38.352788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2bb6e212-fcb8-4d0e-8d00-68b89a199258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c33a5cdb801747979494ceffdbb0fda3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:38.428750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2bb6e212-fcb8-4d0e-8d00-68b89a199258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c33a5cdb801747979494ceffdbb0fda3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:38.429856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2bb6e212-fcb8-4d0e-8d00-68b89a199258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c33a5cdb801747979494ceffdbb0fda3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:38.459604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:38.507785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2bb6e212-fcb8-4d0e-8d00-68b89a199258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c33a5cdb801747979494ceffdbb0fda3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:38.625696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337af95-1a41-4e50-b8b5-44c8e943fdd8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:38.626862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337af95-1a41-4e50-b8b5-44c8e943fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:38.627315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337af95-1a41-4e50-b8b5-44c8e943fdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:38.630509 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3928/7793] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:01:37 2022] DELETE /identity/v3/users/c33a5cdb801747979494ceffdbb0fda3 => generated 0 bytes in 1141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:38.702927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e337af95-1a41-4e50-b8b5-44c8e943fdd8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:38.704815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e337af95-1a41-4e50-b8b5-44c8e943fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:38.873766 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3866/7794] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:01:38.888500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6e212-fcb8-4d0e-8d00-68b89a199258 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:38.890334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2bb6e212-fcb8-4d0e-8d00-68b89a199258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:38.925804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337af95-1a41-4e50-b8b5-44c8e943fdd8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:38.927200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e337af95-1a41-4e50-b8b5-44c8e943fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:38.957266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337af95-1a41-4e50-b8b5-44c8e943fdd8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:38.987153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cb106-d562-4657-a26d-e8ff23b24379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:38.988779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cb106-d562-4657-a26d-e8ff23b24379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:38.989262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cb106-d562-4657-a26d-e8ff23b24379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:38.989721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cb106-d562-4657-a26d-e8ff23b24379 admin admin] PATH_INFO: `/v3/projects/41104bce1ef94aa4bbd703937a54d7e0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:38.991824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cb106-d562-4657-a26d-e8ff23b24379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41104bce1ef94aa4bbd703937a54d7e0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:38.997074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cb106-d562-4657-a26d-e8ff23b24379 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:39.035094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6e212-fcb8-4d0e-8d00-68b89a199258 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:39.050246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a4340-2562-4e81-9298-ff356558ca95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:39.051184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a4340-2562-4e81-9298-ff356558ca95 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:39.051658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a4340-2562-4e81-9298-ff356558ca95 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:39.052094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a4340-2562-4e81-9298-ff356558ca95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:39.097040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a4340-2562-4e81-9298-ff356558ca95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:39.098937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a4340-2562-4e81-9298-ff356558ca95 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:39.132078 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3929/7795] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:39.207316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-820cb106-d562-4657-a26d-e8ff23b24379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41104bce1ef94aa4bbd703937a54d7e0', 'request_id': 'req-820cb106-d562-4657-a26d-e8ff23b24379'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:39.237152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-820cb106-d562-4657-a26d-e8ff23b24379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41104bce1ef94aa4bbd703937a54d7e0', 'request_id': 'req-820cb106-d562-4657-a26d-e8ff23b24379'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:39.249236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-820cb106-d562-4657-a26d-e8ff23b24379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41104bce1ef94aa4bbd703937a54d7e0', 'request_id': 'req-820cb106-d562-4657-a26d-e8ff23b24379'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:39.267485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:39.384472 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-820cb106-d562-4657-a26d-e8ff23b24379 admin admin] The token cache is being invalidate because project 41104bce1ef94aa4bbd703937a54d7e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:01:39.384996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-820cb106-d562-4657-a26d-e8ff23b24379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:39.387284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-820cb106-d562-4657-a26d-e8ff23b24379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:39.401382 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3867/7796] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:01:38 2022] DELETE /identity/v3/projects/41104bce1ef94aa4bbd703937a54d7e0 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:39.403889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a4340-2562-4e81-9298-ff356558ca95 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:39.422798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a4340-2562-4e81-9298-ff356558ca95 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:39.597279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bf59e-c67f-4790-9ddd-4f173ed4f94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:39.597950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf59e-c67f-4790-9ddd-4f173ed4f94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:39.598229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf59e-c67f-4790-9ddd-4f173ed4f94a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:39.598543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf59e-c67f-4790-9ddd-4f173ed4f94a admin admin] PATH_INFO: `/v3/users/4277a37924e2483393c63e66e6bb37b5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:39.604147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bf59e-c67f-4790-9ddd-4f173ed4f94a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4277a37924e2483393c63e66e6bb37b5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:39.608434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bf59e-c67f-4790-9ddd-4f173ed4f94a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:39.887001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-786bf59e-c67f-4790-9ddd-4f173ed4f94a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4277a37924e2483393c63e66e6bb37b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:39.888013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-786bf59e-c67f-4790-9ddd-4f173ed4f94a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4277a37924e2483393c63e66e6bb37b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:39.975026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-786bf59e-c67f-4790-9ddd-4f173ed4f94a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4277a37924e2483393c63e66e6bb37b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:39.975827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-786bf59e-c67f-4790-9ddd-4f173ed4f94a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4277a37924e2483393c63e66e6bb37b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:40.017479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-786bf59e-c67f-4790-9ddd-4f173ed4f94a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4277a37924e2483393c63e66e6bb37b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:40.058307 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3930/7797] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:01:39 2022] DELETE /identity/v3/users/4277a37924e2483393c63e66e6bb37b5 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:40.260531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:40.626936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cb106-d562-4657-a26d-e8ff23b24379 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:40.628511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-820cb106-d562-4657-a26d-e8ff23b24379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:40.669165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cb106-d562-4657-a26d-e8ff23b24379 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:40.883716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdb03f-d752-4392-aad3-4d34411cb201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:40.884965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdb03f-d752-4392-aad3-4d34411cb201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:40.886331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdb03f-d752-4392-aad3-4d34411cb201 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:40.886992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdb03f-d752-4392-aad3-4d34411cb201 admin admin] PATH_INFO: `/v3/projects/98af31cba78b4b1086ca9e1b753861d7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:40.897198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdb03f-d752-4392-aad3-4d34411cb201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98af31cba78b4b1086ca9e1b753861d7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:40.904064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdb03f-d752-4392-aad3-4d34411cb201 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:41.216892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-04fdb03f-d752-4392-aad3-4d34411cb201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98af31cba78b4b1086ca9e1b753861d7', 'request_id': 'req-04fdb03f-d752-4392-aad3-4d34411cb201'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:41.240886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-04fdb03f-d752-4392-aad3-4d34411cb201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98af31cba78b4b1086ca9e1b753861d7', 'request_id': 'req-04fdb03f-d752-4392-aad3-4d34411cb201'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:41.266392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-04fdb03f-d752-4392-aad3-4d34411cb201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98af31cba78b4b1086ca9e1b753861d7', 'request_id': 'req-04fdb03f-d752-4392-aad3-4d34411cb201'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:41.415600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-04fdb03f-d752-4392-aad3-4d34411cb201 admin admin] The token cache is being invalidate because project 98af31cba78b4b1086ca9e1b753861d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:01:41.416106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-04fdb03f-d752-4392-aad3-4d34411cb201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:41.425003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-04fdb03f-d752-4392-aad3-4d34411cb201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:41.425003 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3868/7798] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:01:40 2022] DELETE /identity/v3/projects/98af31cba78b4b1086ca9e1b753861d7 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:41.426767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0263801-3d35-45f9-9a97-762d98bf0628 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:41.427251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0263801-3d35-45f9-9a97-762d98bf0628 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:41.427481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0263801-3d35-45f9-9a97-762d98bf0628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:41.504540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c0263801-3d35-45f9-9a97-762d98bf0628 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:41.513961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c0263801-3d35-45f9-9a97-762d98bf0628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:41.712030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:41.772362 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3931/7799] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:41.778279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d885-e45e-4083-b8af-f98b9ebf89ca None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:41.778573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d885-e45e-4083-b8af-f98b9ebf89ca None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:41.779111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d885-e45e-4083-b8af-f98b9ebf89ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:41.873588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-fbc1d885-e45e-4083-b8af-f98b9ebf89ca None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:41.903498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fbc1d885-e45e-4083-b8af-f98b9ebf89ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:41.921283 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3869/7800] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:41.925939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0263801-3d35-45f9-9a97-762d98bf0628 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:41.956672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0263801-3d35-45f9-9a97-762d98bf0628 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:41.971647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fee418-a482-4b03-8ea4-b48678463bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:41.973453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fee418-a482-4b03-8ea4-b48678463bdb admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:41.982720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fee418-a482-4b03-8ea4-b48678463bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:41.987184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fee418-a482-4b03-8ea4-b48678463bdb admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:42.012491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fee418-a482-4b03-8ea4-b48678463bdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:01:42.021639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fee418-a482-4b03-8ea4-b48678463bdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:42.021639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fee418-a482-4b03-8ea4-b48678463bdb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:42.078083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1d885-e45e-4083-b8af-f98b9ebf89ca None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:42.079723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fbc1d885-e45e-4083-b8af-f98b9ebf89ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:42.106263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1d885-e45e-4083-b8af-f98b9ebf89ca None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:42.121992 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3932/7801] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:01:42.125631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fee418-a482-4b03-8ea4-b48678463bdb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:42.142154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922ee1f-37d2-4f6b-a290-22a2565a412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:42.144889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922ee1f-37d2-4f6b-a290-22a2565a412f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:42.145987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922ee1f-37d2-4f6b-a290-22a2565a412f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:42.146511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922ee1f-37d2-4f6b-a290-22a2565a412f admin admin] PATH_INFO: `/v3/users/b3fc0e860bcc4e1f8aa732017784b7c3` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:42.156187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922ee1f-37d2-4f6b-a290-22a2565a412f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3fc0e860bcc4e1f8aa732017784b7c3)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:42.164485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922ee1f-37d2-4f6b-a290-22a2565a412f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:42.166822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fee418-a482-4b03-8ea4-b48678463bdb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:42.192399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:42.212128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54286ee-3c8a-448f-aff5-9e87488e5f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:42.213624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54286ee-3c8a-448f-aff5-9e87488e5f0b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:42.214658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54286ee-3c8a-448f-aff5-9e87488e5f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:42.216599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54286ee-3c8a-448f-aff5-9e87488e5f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:42.218119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54286ee-3c8a-448f-aff5-9e87488e5f0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:42.238611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54286ee-3c8a-448f-aff5-9e87488e5f0b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:42.494649 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3933/7802] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:42 2022] POST /identity/v3/projects => generated 365 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:42.497521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54286ee-3c8a-448f-aff5-9e87488e5f0b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:42.577483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9922ee1f-37d2-4f6b-a290-22a2565a412f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3fc0e860bcc4e1f8aa732017784b7c3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:42.677547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9922ee1f-37d2-4f6b-a290-22a2565a412f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3fc0e860bcc4e1f8aa732017784b7c3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:42.678380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9922ee1f-37d2-4f6b-a290-22a2565a412f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3fc0e860bcc4e1f8aa732017784b7c3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:42.693510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9922ee1f-37d2-4f6b-a290-22a2565a412f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3fc0e860bcc4e1f8aa732017784b7c3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:42.709683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54286ee-3c8a-448f-aff5-9e87488e5f0b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:42.723502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede4373-9cd1-4e17-9a2f-2d86558b7aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:42.724530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede4373-9cd1-4e17-9a2f-2d86558b7aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:42.725692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9922ee1f-37d2-4f6b-a290-22a2565a412f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3fc0e860bcc4e1f8aa732017784b7c3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:42.727217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede4373-9cd1-4e17-9a2f-2d86558b7aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:42.727808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede4373-9cd1-4e17-9a2f-2d86558b7aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:42.730568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede4373-9cd1-4e17-9a2f-2d86558b7aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:42.735516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede4373-9cd1-4e17-9a2f-2d86558b7aa7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:42.745832 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3870/7803] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:01:42 2022] DELETE /identity/v3/users/b3fc0e860bcc4e1f8aa732017784b7c3 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:42.749172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922ee1f-37d2-4f6b-a290-22a2565a412f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:42.752643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9922ee1f-37d2-4f6b-a290-22a2565a412f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:42.863054 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3934/7804] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:42 2022] POST /identity/v3/users => generated 283 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:42.869741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5b076-9f75-42ce-912f-ef8114f7ebbb None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:42.872789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5b076-9f75-42ce-912f-ef8114f7ebbb None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:42.876499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5b076-9f75-42ce-912f-ef8114f7ebbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:42.959469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f7a5b076-9f75-42ce-912f-ef8114f7ebbb None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:42.963084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f7a5b076-9f75-42ce-912f-ef8114f7ebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:42.986428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922ee1f-37d2-4f6b-a290-22a2565a412f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:43.001341 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3935/7805] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:43.003333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5b076-9f75-42ce-912f-ef8114f7ebbb None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:43.008971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f7a5b076-9f75-42ce-912f-ef8114f7ebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:43.013284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e38a1-0149-43b2-a81f-63ad99f1005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:43.015067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e38a1-0149-43b2-a81f-63ad99f1005f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:43.022688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e38a1-0149-43b2-a81f-63ad99f1005f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:43.023327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e38a1-0149-43b2-a81f-63ad99f1005f admin admin] PATH_INFO: `/v3/projects/6c586e88ffaa4e489cbfd6f2a712e2d0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:43.026669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e38a1-0149-43b2-a81f-63ad99f1005f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c586e88ffaa4e489cbfd6f2a712e2d0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:43.037814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e38a1-0149-43b2-a81f-63ad99f1005f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:43.043038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:43.056925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5b076-9f75-42ce-912f-ef8114f7ebbb None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:43.078306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475014ac-3079-4847-aa56-9b7ac9042929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:43.082187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475014ac-3079-4847-aa56-9b7ac9042929 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:43.083448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475014ac-3079-4847-aa56-9b7ac9042929 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:43.089471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475014ac-3079-4847-aa56-9b7ac9042929 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:43.089471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475014ac-3079-4847-aa56-9b7ac9042929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:43.096115 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475014ac-3079-4847-aa56-9b7ac9042929 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:43.158722 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3936/7806] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:43.172994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475014ac-3079-4847-aa56-9b7ac9042929 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:43.177011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-475014ac-3079-4847-aa56-9b7ac9042929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:43.259638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:43.281885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c06e38a1-0149-43b2-a81f-63ad99f1005f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c586e88ffaa4e489cbfd6f2a712e2d0', 'request_id': 'req-c06e38a1-0149-43b2-a81f-63ad99f1005f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:43.303878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c06e38a1-0149-43b2-a81f-63ad99f1005f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c586e88ffaa4e489cbfd6f2a712e2d0', 'request_id': 'req-c06e38a1-0149-43b2-a81f-63ad99f1005f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:43.317911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475014ac-3079-4847-aa56-9b7ac9042929 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:43.335529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c06e38a1-0149-43b2-a81f-63ad99f1005f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c586e88ffaa4e489cbfd6f2a712e2d0', 'request_id': 'req-c06e38a1-0149-43b2-a81f-63ad99f1005f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:43.455311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac26152-9325-40e8-9e9e-25026c38170e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:43.456656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac26152-9325-40e8-9e9e-25026c38170e service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:43.457335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac26152-9325-40e8-9e9e-25026c38170e service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:43.458394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac26152-9325-40e8-9e9e-25026c38170e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:43.467781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c06e38a1-0149-43b2-a81f-63ad99f1005f admin admin] The token cache is being invalidate because project 6c586e88ffaa4e489cbfd6f2a712e2d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:01:43.468081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c06e38a1-0149-43b2-a81f-63ad99f1005f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:43.469886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c06e38a1-0149-43b2-a81f-63ad99f1005f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:43.472082 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3871/7807] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:01:42 2022] DELETE /identity/v3/projects/6c586e88ffaa4e489cbfd6f2a712e2d0 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:43.475499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e38a1-0149-43b2-a81f-63ad99f1005f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:43.482782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c06e38a1-0149-43b2-a81f-63ad99f1005f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:43.583464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac26152-9325-40e8-9e9e-25026c38170e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:43.585830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac26152-9325-40e8-9e9e-25026c38170e service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:43.603610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:43.616816 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3937/7808] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:43.618808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac26152-9325-40e8-9e9e-25026c38170e service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:43.632381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:43.654954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac26152-9325-40e8-9e9e-25026c38170e service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:43.665983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c02610-f939-4a0e-aabb-898fb4ad6b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:43.667706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c02610-f939-4a0e-aabb-898fb4ad6b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:43.667706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c02610-f939-4a0e-aabb-898fb4ad6b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:43.667706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c02610-f939-4a0e-aabb-898fb4ad6b58 admin admin] PATH_INFO: `/v3/users/fc989e46129b42f189dc6e81e9cfeb0b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:43.672627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c02610-f939-4a0e-aabb-898fb4ad6b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc989e46129b42f189dc6e81e9cfeb0b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:43.674632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c02610-f939-4a0e-aabb-898fb4ad6b58 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:43.702027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e38a1-0149-43b2-a81f-63ad99f1005f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:43.703972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3819c-ed4f-41d2-b85b-8ff2ad95c7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:43.704659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3819c-ed4f-41d2-b85b-8ff2ad95c7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:43.704909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3819c-ed4f-41d2-b85b-8ff2ad95c7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:43.705335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3819c-ed4f-41d2-b85b-8ff2ad95c7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:43.706001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3819c-ed4f-41d2-b85b-8ff2ad95c7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:43.710611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3819c-ed4f-41d2-b85b-8ff2ad95c7b9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:43.732706 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3872/7809] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:43.736336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8398a-7f6e-4b57-be90-2129bff262d8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:43.736711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8398a-7f6e-4b57-be90-2129bff262d8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:43.736899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8398a-7f6e-4b57-be90-2129bff262d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:43.781292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6bf8398a-7f6e-4b57-be90-2129bff262d8 None None] MFA Rules not processed for user `f93cfb60764b472798894864bd7ac895`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:43.782898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6bf8398a-7f6e-4b57-be90-2129bff262d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:43.931558 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3873/7810] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:43.947019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8398a-7f6e-4b57-be90-2129bff262d8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:43.985263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8398a-7f6e-4b57-be90-2129bff262d8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:43.996292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecebd9-490d-46fd-a3e4-d2d14b384fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:43.996675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecebd9-490d-46fd-a3e4-d2d14b384fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:43.997115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecebd9-490d-46fd-a3e4-d2d14b384fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:43.997773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecebd9-490d-46fd-a3e4-d2d14b384fb3 admin admin] PATH_INFO: `/v3/projects/f7ef48cee13242fb995d66a4208112d0/users/0bb158de78774225a9fc6b158f90deb0/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:44.017110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecebd9-490d-46fd-a3e4-d2d14b384fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ef48cee13242fb995d66a4208112d0, user_id=0bb158de78774225a9fc6b158f90deb0, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:44.020727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecebd9-490d-46fd-a3e4-d2d14b384fb3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:44.054375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61c02610-f939-4a0e-aabb-898fb4ad6b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc989e46129b42f189dc6e81e9cfeb0b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:44.055086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61c02610-f939-4a0e-aabb-898fb4ad6b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc989e46129b42f189dc6e81e9cfeb0b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:44.152317 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3874/7811] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:43 2022] PUT /identity/v3/projects/f7ef48cee13242fb995d66a4208112d0/users/0bb158de78774225a9fc6b158f90deb0/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:44.154273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51682d-fd42-4cce-8e2a-277e3ad94570 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:44.160560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51682d-fd42-4cce-8e2a-277e3ad94570 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:44.160938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51682d-fd42-4cce-8e2a-277e3ad94570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:44.181263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61c02610-f939-4a0e-aabb-898fb4ad6b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc989e46129b42f189dc6e81e9cfeb0b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:44.181933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61c02610-f939-4a0e-aabb-898fb4ad6b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc989e46129b42f189dc6e81e9cfeb0b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:44.212647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61c02610-f939-4a0e-aabb-898fb4ad6b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc989e46129b42f189dc6e81e9cfeb0b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:44.273351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-eb51682d-fd42-4cce-8e2a-277e3ad94570 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:44.279836 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3938/7812] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:01:43 2022] DELETE /identity/v3/users/fc989e46129b42f189dc6e81e9cfeb0b => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:44.294316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-eb51682d-fd42-4cce-8e2a-277e3ad94570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:44.461079 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3875/7813] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:44.486645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c02610-f939-4a0e-aabb-898fb4ad6b58 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:44.488357 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-61c02610-f939-4a0e-aabb-898fb4ad6b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:44.673470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51682d-fd42-4cce-8e2a-277e3ad94570 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:44.674679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-eb51682d-fd42-4cce-8e2a-277e3ad94570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:44.692197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c02610-f939-4a0e-aabb-898fb4ad6b58 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:44.726399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2da7c0-7d1a-40da-961e-be835d2c3d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:44.726399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2da7c0-7d1a-40da-961e-be835d2c3d11 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:44.726399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2da7c0-7d1a-40da-961e-be835d2c3d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:44.726399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2da7c0-7d1a-40da-961e-be835d2c3d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:44.750977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2da7c0-7d1a-40da-961e-be835d2c3d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:44.753119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2da7c0-7d1a-40da-961e-be835d2c3d11 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:44.774461 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3939/7814] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:44.911824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51682d-fd42-4cce-8e2a-277e3ad94570 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:44.924992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bb1bd-8570-4b0c-98dd-2ff1593de55d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:44.925633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bb1bd-8570-4b0c-98dd-2ff1593de55d service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:44.926132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bb1bd-8570-4b0c-98dd-2ff1593de55d service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:44.926580 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bb1bd-8570-4b0c-98dd-2ff1593de55d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:44.931480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cc7bb1bd-8570-4b0c-98dd-2ff1593de55d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:45.073321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301741e5-c786-47e6-b6bd-327334012ebc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:45.073844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301741e5-c786-47e6-b6bd-327334012ebc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:45.074338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301741e5-c786-47e6-b6bd-327334012ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:45.077205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bb1bd-8570-4b0c-98dd-2ff1593de55d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:45.078842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bb1bd-8570-4b0c-98dd-2ff1593de55d service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:45.082349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-301741e5-c786-47e6-b6bd-327334012ebc None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:01:45.082349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:01:45.082349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:01:45.082349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:01:45.082349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:01:45.082349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:01:45.082349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:01:45.082349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:01:45.082349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:01:45.082349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:01:45.082349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:01:45.082349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:01:45.082349 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:01:45.083609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:01:45.083609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:01:45.083609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:01:45.083609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:01:45.083609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:01:45.083609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:01:45.083609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:01:45.083609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:01:45.083609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:01:45.083609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:01:45.083609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:01:45.083609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:01:45.083609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:01:45.083609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:01:45.083609 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 05:01:45.090813 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3940/7815] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:01:45 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 19 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 05:01:45.099755 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3876/7816] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 05:01:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 05:01:45.158042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:45.319235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:45.374451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301741e5-c786-47e6-b6bd-327334012ebc None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:45.376239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-301741e5-c786-47e6-b6bd-327334012ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:45.409132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301741e5-c786-47e6-b6bd-327334012ebc None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:45.420610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc9802-9203-4f82-a659-12404997a005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:45.423932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc9802-9203-4f82-a659-12404997a005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:45.423932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc9802-9203-4f82-a659-12404997a005 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:45.423932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc9802-9203-4f82-a659-12404997a005 admin admin] PATH_INFO: `/v3/projects/f78e003d1f0a4743bcd0ae0880f4402c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:45.426779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc9802-9203-4f82-a659-12404997a005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f78e003d1f0a4743bcd0ae0880f4402c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:45.433235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc9802-9203-4f82-a659-12404997a005 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:45.647725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-12cc9802-9203-4f82-a659-12404997a005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f78e003d1f0a4743bcd0ae0880f4402c', 'request_id': 'req-12cc9802-9203-4f82-a659-12404997a005'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:45.665761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-12cc9802-9203-4f82-a659-12404997a005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f78e003d1f0a4743bcd0ae0880f4402c', 'request_id': 'req-12cc9802-9203-4f82-a659-12404997a005'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:45.814170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-12cc9802-9203-4f82-a659-12404997a005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f78e003d1f0a4743bcd0ae0880f4402c', 'request_id': 'req-12cc9802-9203-4f82-a659-12404997a005'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:45.837913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-12cc9802-9203-4f82-a659-12404997a005 admin admin] The token cache is being invalidate because project f78e003d1f0a4743bcd0ae0880f4402c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:01:45.838517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-12cc9802-9203-4f82-a659-12404997a005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:45.840552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-12cc9802-9203-4f82-a659-12404997a005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:45.842719 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3941/7817] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:01:45 2022] DELETE /identity/v3/projects/f78e003d1f0a4743bcd0ae0880f4402c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:45.846797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bb1bd-8570-4b0c-98dd-2ff1593de55d service swift] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:45.861416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bb1bd-8570-4b0c-98dd-2ff1593de55d service swift] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:46.071600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeb11d-ab87-41d5-85c0-cd582f8171c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:46.072369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeb11d-ab87-41d5-85c0-cd582f8171c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:46.072559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeb11d-ab87-41d5-85c0-cd582f8171c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:46.073671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeb11d-ab87-41d5-85c0-cd582f8171c9 admin admin] PATH_INFO: `/v3/users/5150cf026bef4f17bf160cfe2e1db08f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:46.076692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeb11d-ab87-41d5-85c0-cd582f8171c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5150cf026bef4f17bf160cfe2e1db08f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:46.078988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeb11d-ab87-41d5-85c0-cd582f8171c9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:46.370734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-32aeb11d-ab87-41d5-85c0-cd582f8171c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5150cf026bef4f17bf160cfe2e1db08f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:46.407998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc9802-9203-4f82-a659-12404997a005 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:46.408292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-12cc9802-9203-4f82-a659-12404997a005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:46.428416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc9802-9203-4f82-a659-12404997a005 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:46.440605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7d493-7be1-449d-ac04-bb1cb8f01b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:46.441743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d493-7be1-449d-ac04-bb1cb8f01b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:46.442343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d493-7be1-449d-ac04-bb1cb8f01b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:46.442778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d493-7be1-449d-ac04-bb1cb8f01b6b admin admin] PATH_INFO: `/v3/projects/1398b5c2e3cf425aa6744ab40cf870de` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:46.454579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7d493-7be1-449d-ac04-bb1cb8f01b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1398b5c2e3cf425aa6744ab40cf870de)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:46.467322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7d493-7be1-449d-ac04-bb1cb8f01b6b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:46.479135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-32aeb11d-ab87-41d5-85c0-cd582f8171c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5150cf026bef4f17bf160cfe2e1db08f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:46.480715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-32aeb11d-ab87-41d5-85c0-cd582f8171c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5150cf026bef4f17bf160cfe2e1db08f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:46.508236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-32aeb11d-ab87-41d5-85c0-cd582f8171c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5150cf026bef4f17bf160cfe2e1db08f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:46.597130 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-32aeb11d-ab87-41d5-85c0-cd582f8171c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5150cf026bef4f17bf160cfe2e1db08f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:46.627730 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3877/7818] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:01:45 2022] DELETE /identity/v3/users/5150cf026bef4f17bf160cfe2e1db08f => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:46.654497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-98f7d493-7be1-449d-ac04-bb1cb8f01b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1398b5c2e3cf425aa6744ab40cf870de', 'request_id': 'req-98f7d493-7be1-449d-ac04-bb1cb8f01b6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:46.670147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-98f7d493-7be1-449d-ac04-bb1cb8f01b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1398b5c2e3cf425aa6744ab40cf870de', 'request_id': 'req-98f7d493-7be1-449d-ac04-bb1cb8f01b6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:46.810511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-98f7d493-7be1-449d-ac04-bb1cb8f01b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1398b5c2e3cf425aa6744ab40cf870de', 'request_id': 'req-98f7d493-7be1-449d-ac04-bb1cb8f01b6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:46.829607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-98f7d493-7be1-449d-ac04-bb1cb8f01b6b admin admin] The token cache is being invalidate because project 1398b5c2e3cf425aa6744ab40cf870de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:01:46.830740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-98f7d493-7be1-449d-ac04-bb1cb8f01b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:46.834414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-98f7d493-7be1-449d-ac04-bb1cb8f01b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:46.836276 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3942/7819] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:01:46 2022] DELETE /identity/v3/projects/1398b5c2e3cf425aa6744ab40cf870de => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:01:46.842266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9688a-d681-4ff7-97c2-09f539fb2fb7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:46.842561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9688a-d681-4ff7-97c2-09f539fb2fb7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:46.842845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9688a-d681-4ff7-97c2-09f539fb2fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:46.891404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2fb9688a-d681-4ff7-97c2-09f539fb2fb7 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:46.892085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2fb9688a-d681-4ff7-97c2-09f539fb2fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:47.016006 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3878/7820] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:47.023758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50519f-cf7b-4e3f-8466-77624ffc14fa None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:47.031152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50519f-cf7b-4e3f-8466-77624ffc14fa None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:47.031152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50519f-cf7b-4e3f-8466-77624ffc14fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:47.058689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-fc50519f-cf7b-4e3f-8466-77624ffc14fa None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:47.075748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fc50519f-cf7b-4e3f-8466-77624ffc14fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:47.084299 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3943/7821] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:47.092680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9688a-d681-4ff7-97c2-09f539fb2fb7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:47.125079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9688a-d681-4ff7-97c2-09f539fb2fb7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:47.139987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00b947-4fc0-4c98-ba92-19de2df829ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:47.141054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00b947-4fc0-4c98-ba92-19de2df829ff admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:47.146259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00b947-4fc0-4c98-ba92-19de2df829ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:47.147189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00b947-4fc0-4c98-ba92-19de2df829ff admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:47.148667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00b947-4fc0-4c98-ba92-19de2df829ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:01:47.149523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00b947-4fc0-4c98-ba92-19de2df829ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:47.152156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00b947-4fc0-4c98-ba92-19de2df829ff admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:47.232946 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3879/7822] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:01:47.237151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50519f-cf7b-4e3f-8466-77624ffc14fa None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:47.263068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50519f-cf7b-4e3f-8466-77624ffc14fa None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:47.285071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0b833-4b8a-4814-84f9-7397ca6fd125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:47.286031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0b833-4b8a-4814-84f9-7397ca6fd125 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:47.286477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0b833-4b8a-4814-84f9-7397ca6fd125 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:47.286910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0b833-4b8a-4814-84f9-7397ca6fd125 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:47.288297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0b833-4b8a-4814-84f9-7397ca6fd125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:47.290407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0b833-4b8a-4814-84f9-7397ca6fd125 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:47.471110 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3944/7823] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:47 2022] POST /identity/v3/projects => generated 399 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:01:47.475023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00b947-4fc0-4c98-ba92-19de2df829ff admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:47.492148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00b947-4fc0-4c98-ba92-19de2df829ff admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:47.639638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:47.708127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395da3b8-9ec0-4cf8-bc63-58423e7a0521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:47.708622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395da3b8-9ec0-4cf8-bc63-58423e7a0521 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:47.708949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395da3b8-9ec0-4cf8-bc63-58423e7a0521 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:47.709247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395da3b8-9ec0-4cf8-bc63-58423e7a0521 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:47.710099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395da3b8-9ec0-4cf8-bc63-58423e7a0521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:47.714631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395da3b8-9ec0-4cf8-bc63-58423e7a0521 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:47.908032 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3880/7824] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:47 2022] POST /identity/v3/users => generated 300 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:47.912940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0b833-4b8a-4814-84f9-7397ca6fd125 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:47.937792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0b833-4b8a-4814-84f9-7397ca6fd125 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:47.956614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b044ae9-cad0-4230-8bc0-7960b92cc604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:47.957263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b044ae9-cad0-4230-8bc0-7960b92cc604 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:47.957542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b044ae9-cad0-4230-8bc0-7960b92cc604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:47.957820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b044ae9-cad0-4230-8bc0-7960b92cc604 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:47.958485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b044ae9-cad0-4230-8bc0-7960b92cc604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:47.960298 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b044ae9-cad0-4230-8bc0-7960b92cc604 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:47.980506 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3945/7825] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:47.986075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395da3b8-9ec0-4cf8-bc63-58423e7a0521 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:48.008103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395da3b8-9ec0-4cf8-bc63-58423e7a0521 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:48.047674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63300e-484f-497e-986c-ac0db1df4c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:48.048368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63300e-484f-497e-986c-ac0db1df4c53 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:48.048652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63300e-484f-497e-986c-ac0db1df4c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:48.049121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63300e-484f-497e-986c-ac0db1df4c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:48.049973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63300e-484f-497e-986c-ac0db1df4c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:48.058840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63300e-484f-497e-986c-ac0db1df4c53 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:48.089353 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3881/7826] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:48.090799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b044ae9-cad0-4230-8bc0-7960b92cc604 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:48.105373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63300e-484f-497e-986c-ac0db1df4c53 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:48.109881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4a63300e-484f-497e-986c-ac0db1df4c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:48.118886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b044ae9-cad0-4230-8bc0-7960b92cc604 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:48.139289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:48.143943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ac09c-fee0-41e8-b83e-4232c9ce5e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:48.144909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ac09c-fee0-41e8-b83e-4232c9ce5e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:48.161386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63300e-484f-497e-986c-ac0db1df4c53 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:48.170926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ac09c-fee0-41e8-b83e-4232c9ce5e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:48.173641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ac09c-fee0-41e8-b83e-4232c9ce5e5e admin admin] PATH_INFO: `/v3/projects/10fb442a3f94416d85010e6fad2584a0/users/4be82482ed8d496f845127beed20f4b1/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:48.194270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f48e6c-a97e-4738-9d84-2fd60d2b237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:48.194270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f48e6c-a97e-4738-9d84-2fd60d2b237f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:48.194270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f48e6c-a97e-4738-9d84-2fd60d2b237f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:48.194270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f48e6c-a97e-4738-9d84-2fd60d2b237f admin admin] PATH_INFO: `/v3/projects/dcbb2e00658a4a89ab936dd6948e497a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:48.194854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f48e6c-a97e-4738-9d84-2fd60d2b237f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcbb2e00658a4a89ab936dd6948e497a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:48.196901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f48e6c-a97e-4738-9d84-2fd60d2b237f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:48.270343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ac09c-fee0-41e8-b83e-4232c9ce5e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=10fb442a3f94416d85010e6fad2584a0, user_id=4be82482ed8d496f845127beed20f4b1, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:48.275249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ac09c-fee0-41e8-b83e-4232c9ce5e5e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:48.469567 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3946/7827] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:48 2022] PUT /identity/v3/projects/10fb442a3f94416d85010e6fad2584a0/users/4be82482ed8d496f845127beed20f4b1/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:48.481737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4821447-9d11-4c7f-a95d-2773074f0d6b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:48.482023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4821447-9d11-4c7f-a95d-2773074f0d6b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:48.482739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4821447-9d11-4c7f-a95d-2773074f0d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:48.510221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93f48e6c-a97e-4738-9d84-2fd60d2b237f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcbb2e00658a4a89ab936dd6948e497a', 'request_id': 'req-93f48e6c-a97e-4738-9d84-2fd60d2b237f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:48.522668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93f48e6c-a97e-4738-9d84-2fd60d2b237f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcbb2e00658a4a89ab936dd6948e497a', 'request_id': 'req-93f48e6c-a97e-4738-9d84-2fd60d2b237f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:48.539646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93f48e6c-a97e-4738-9d84-2fd60d2b237f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcbb2e00658a4a89ab936dd6948e497a', 'request_id': 'req-93f48e6c-a97e-4738-9d84-2fd60d2b237f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:48.559468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a4821447-9d11-4c7f-a95d-2773074f0d6b None None] MFA Rules not processed for user `4be82482ed8d496f845127beed20f4b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:48.567651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a4821447-9d11-4c7f-a95d-2773074f0d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:48.627371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93f48e6c-a97e-4738-9d84-2fd60d2b237f admin admin] The token cache is being invalidate because project dcbb2e00658a4a89ab936dd6948e497a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:01:48.628057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93f48e6c-a97e-4738-9d84-2fd60d2b237f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:48.629035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-93f48e6c-a97e-4738-9d84-2fd60d2b237f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:48.632605 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3882/7828] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:01:48 2022] DELETE /identity/v3/projects/dcbb2e00658a4a89ab936dd6948e497a => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:48.645404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a64a71-760a-4c9d-86f5-db32cd5be19d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:48.646014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a64a71-760a-4c9d-86f5-db32cd5be19d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:48.650104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a64a71-760a-4c9d-86f5-db32cd5be19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:48.677263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:48.685111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f3a64a71-760a-4c9d-86f5-db32cd5be19d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:48.691049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f3a64a71-760a-4c9d-86f5-db32cd5be19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:48.887120 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3947/7829] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:48 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:01:48.895800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4821447-9d11-4c7f-a95d-2773074f0d6b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:48.899504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a4821447-9d11-4c7f-a95d-2773074f0d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:48.924719 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3883/7830] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:48.927037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4821447-9d11-4c7f-a95d-2773074f0d6b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:48.935308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c94fd-1ccb-4e35-9f70-d89daea1ad25 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:48.935875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c94fd-1ccb-4e35-9f70-d89daea1ad25 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:48.936411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c94fd-1ccb-4e35-9f70-d89daea1ad25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:48.941796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba52f3-87d2-4fa7-b52f-41237bca3f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:48.945558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba52f3-87d2-4fa7-b52f-41237bca3f2b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:48.946050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba52f3-87d2-4fa7-b52f-41237bca3f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:48.946639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba52f3-87d2-4fa7-b52f-41237bca3f2b admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:48.947745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba52f3-87d2-4fa7-b52f-41237bca3f2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:48.955044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba52f3-87d2-4fa7-b52f-41237bca3f2b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:49.017736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1b1c94fd-1ccb-4e35-9f70-d89daea1ad25 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:49.026806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1b1c94fd-1ccb-4e35-9f70-d89daea1ad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:49.056012 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3884/7831] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:01:49.060382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c94fd-1ccb-4e35-9f70-d89daea1ad25 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:49.077525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c94fd-1ccb-4e35-9f70-d89daea1ad25 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:49.092553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e10f2-b6ec-4dab-9256-b788e98f6a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:49.093190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e10f2-b6ec-4dab-9256-b788e98f6a9e admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:49.093462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e10f2-b6ec-4dab-9256-b788e98f6a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:49.093935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e10f2-b6ec-4dab-9256-b788e98f6a9e admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:49.094834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e10f2-b6ec-4dab-9256-b788e98f6a9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:01:49.095326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e10f2-b6ec-4dab-9256-b788e98f6a9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:49.097196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e10f2-b6ec-4dab-9256-b788e98f6a9e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:49.136301 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3885/7832] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:01:49.139020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e10f2-b6ec-4dab-9256-b788e98f6a9e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:49.158073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e10f2-b6ec-4dab-9256-b788e98f6a9e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:49.169514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:49.176645 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3948/7833] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:48 2022] POST /identity/v3/projects => generated 399 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:49.179800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36d21c-100f-49b4-b5b8-8e79e0a4bf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:49.180657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36d21c-100f-49b4-b5b8-8e79e0a4bf2f admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:49.181575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36d21c-100f-49b4-b5b8-8e79e0a4bf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:49.182042 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36d21c-100f-49b4-b5b8-8e79e0a4bf2f admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:49.183225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36d21c-100f-49b4-b5b8-8e79e0a4bf2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:49.185869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36d21c-100f-49b4-b5b8-8e79e0a4bf2f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:49.193567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba52f3-87d2-4fa7-b52f-41237bca3f2b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:49.360431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba52f3-87d2-4fa7-b52f-41237bca3f2b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:49.390406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735469b-8bb2-4088-aa79-33d6a5a239d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:49.395317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735469b-8bb2-4088-aa79-33d6a5a239d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:49.395317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735469b-8bb2-4088-aa79-33d6a5a239d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:49.395317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735469b-8bb2-4088-aa79-33d6a5a239d3 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:49.395317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735469b-8bb2-4088-aa79-33d6a5a239d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:49.398108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735469b-8bb2-4088-aa79-33d6a5a239d3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:49.441229 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3886/7834] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:49 2022] POST /identity/v3/projects => generated 357 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:49.457622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36d21c-100f-49b4-b5b8-8e79e0a4bf2f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:49.459581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8f36d21c-100f-49b4-b5b8-8e79e0a4bf2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:49.537648 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3949/7835] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:49 2022] POST /identity/v3/users => generated 306 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:49.539001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735469b-8bb2-4088-aa79-33d6a5a239d3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:49.554608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735469b-8bb2-4088-aa79-33d6a5a239d3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:49.686597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36d21c-100f-49b4-b5b8-8e79e0a4bf2f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:49.686909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7f4c3-4df6-459e-bf11-7bc1c24bae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:49.687230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7f4c3-4df6-459e-bf11-7bc1c24bae5c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:49.687704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7f4c3-4df6-459e-bf11-7bc1c24bae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:49.688147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7f4c3-4df6-459e-bf11-7bc1c24bae5c admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:49.689032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7f4c3-4df6-459e-bf11-7bc1c24bae5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:49.693439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7f4c3-4df6-459e-bf11-7bc1c24bae5c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:49.699575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7d36f-5778-4337-a283-51dc01796c5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:49.700243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7d36f-5778-4337-a283-51dc01796c5b service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:49.700551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7d36f-5778-4337-a283-51dc01796c5b service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:49.700834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7d36f-5778-4337-a283-51dc01796c5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:49.703045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a8a7d36f-5778-4337-a283-51dc01796c5b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:49.795724 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3950/7836] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:49 2022] POST /identity/v3/users => generated 279 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:49.796628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7f4c3-4df6-459e-bf11-7bc1c24bae5c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:49.809500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7f4c3-4df6-459e-bf11-7bc1c24bae5c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:49.819672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883fa58-1095-4ffb-8752-1d021259e68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:49.827347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883fa58-1095-4ffb-8752-1d021259e68a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:49.827347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883fa58-1095-4ffb-8752-1d021259e68a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:49.827347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883fa58-1095-4ffb-8752-1d021259e68a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:49.827347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883fa58-1095-4ffb-8752-1d021259e68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:49.827347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883fa58-1095-4ffb-8752-1d021259e68a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:49.845011 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3951/7837] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:49.848076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883fa58-1095-4ffb-8752-1d021259e68a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:49.865455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7d36f-5778-4337-a283-51dc01796c5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:49.867401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7d36f-5778-4337-a283-51dc01796c5b service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:49.867538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883fa58-1095-4ffb-8752-1d021259e68a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:49.877610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73db37-7396-4b8c-b12f-0420fdead1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:49.883899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73db37-7396-4b8c-b12f-0420fdead1cd admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:49.883899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73db37-7396-4b8c-b12f-0420fdead1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:49.883899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73db37-7396-4b8c-b12f-0420fdead1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:49.883899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73db37-7396-4b8c-b12f-0420fdead1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:49.884984 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3887/7838] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 05:01:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 05:01:49.884984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7d36f-5778-4337-a283-51dc01796c5b service swift] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:49.893499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73db37-7396-4b8c-b12f-0420fdead1cd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:49.911624 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3952/7839] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:49.915572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73db37-7396-4b8c-b12f-0420fdead1cd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:49.916918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7d36f-5778-4337-a283-51dc01796c5b service swift] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:49.924726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cfe87-2af5-47e1-a020-0e2edb944594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:49.925708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cfe87-2af5-47e1-a020-0e2edb944594 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:49.926261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cfe87-2af5-47e1-a020-0e2edb944594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:49.926712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cfe87-2af5-47e1-a020-0e2edb944594 admin admin] PATH_INFO: `/v3/projects/35807f1ca6e748f7bc62375991b4575e/users/47820c1b71da4dd1bda25cdbe3cb1a59/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:49.940322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73db37-7396-4b8c-b12f-0420fdead1cd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:49.956105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cfe87-2af5-47e1-a020-0e2edb944594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35807f1ca6e748f7bc62375991b4575e, user_id=47820c1b71da4dd1bda25cdbe3cb1a59, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:49.958117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253ac53-228f-4ca4-a932-02892c0bafa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:49.958881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253ac53-228f-4ca4-a932-02892c0bafa2 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:49.959433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253ac53-228f-4ca4-a932-02892c0bafa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:49.960610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253ac53-228f-4ca4-a932-02892c0bafa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:49.961541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253ac53-228f-4ca4-a932-02892c0bafa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:49.964943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253ac53-228f-4ca4-a932-02892c0bafa2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:49.980486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cfe87-2af5-47e1-a020-0e2edb944594 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:49.987628 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3953/7840] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:01:49.993196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253ac53-228f-4ca4-a932-02892c0bafa2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:50.016942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253ac53-228f-4ca4-a932-02892c0bafa2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:50.022485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab0ba4-b182-405e-9971-de02190bdc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:50.023439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab0ba4-b182-405e-9971-de02190bdc9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:50.023831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab0ba4-b182-405e-9971-de02190bdc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:50.025672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab0ba4-b182-405e-9971-de02190bdc9b admin admin] PATH_INFO: `/v3/projects/22c5aff3ef4b40ebb1bc73fcd3bcaebd/users/2bbd508183484dabb9a4b89d3f2979c6/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:50.054322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab0ba4-b182-405e-9971-de02190bdc9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c5aff3ef4b40ebb1bc73fcd3bcaebd, user_id=2bbd508183484dabb9a4b89d3f2979c6, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:50.058433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab0ba4-b182-405e-9971-de02190bdc9b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:50.103145 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3888/7841] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:49 2022] PUT /identity/v3/projects/35807f1ca6e748f7bc62375991b4575e/users/47820c1b71da4dd1bda25cdbe3cb1a59/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:50.108435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cfe87-2af5-47e1-a020-0e2edb944594 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:50.134902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:50.227094 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3954/7842] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:49 2022] PUT /identity/v3/projects/22c5aff3ef4b40ebb1bc73fcd3bcaebd/users/2bbd508183484dabb9a4b89d3f2979c6/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:50.248131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55388cee-961e-4625-873c-ff63907153d3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:50.248990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55388cee-961e-4625-873c-ff63907153d3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:50.250494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55388cee-961e-4625-873c-ff63907153d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:50.276679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cfe87-2af5-47e1-a020-0e2edb944594 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:50.408829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-55388cee-961e-4625-873c-ff63907153d3 None None] MFA Rules not processed for user `2bbd508183484dabb9a4b89d3f2979c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:50.410428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-55388cee-961e-4625-873c-ff63907153d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:50.476853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ab5f2-130d-4909-82f8-83dbfc97148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:50.477747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ab5f2-130d-4909-82f8-83dbfc97148a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:50.478036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ab5f2-130d-4909-82f8-83dbfc97148a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:50.478315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ab5f2-130d-4909-82f8-83dbfc97148a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:50.479365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ab5f2-130d-4909-82f8-83dbfc97148a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:50.487993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ab5f2-130d-4909-82f8-83dbfc97148a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:50.506860 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3889/7843] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:50.511193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ab5f2-130d-4909-82f8-83dbfc97148a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:50.534684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ab5f2-130d-4909-82f8-83dbfc97148a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:50.556072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90377ea7-cc26-49d1-ab63-f5d85b21318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:50.559224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377ea7-cc26-49d1-ab63-f5d85b21318f admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:50.559519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377ea7-cc26-49d1-ab63-f5d85b21318f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:50.559800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377ea7-cc26-49d1-ab63-f5d85b21318f admin admin] PATH_INFO: `/v3/projects/35807f1ca6e748f7bc62375991b4575e/users/47820c1b71da4dd1bda25cdbe3cb1a59/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:50.562242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90377ea7-cc26-49d1-ab63-f5d85b21318f admin admin] RBAC: Authorizing `identity:create_grant(project_id=35807f1ca6e748f7bc62375991b4575e, user_id=47820c1b71da4dd1bda25cdbe3cb1a59, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:50.565113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90377ea7-cc26-49d1-ab63-f5d85b21318f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:50.621297 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3890/7844] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:50 2022] PUT /identity/v3/projects/35807f1ca6e748f7bc62375991b4575e/users/47820c1b71da4dd1bda25cdbe3cb1a59/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:50.633005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90377ea7-cc26-49d1-ab63-f5d85b21318f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:50.638858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-90377ea7-cc26-49d1-ab63-f5d85b21318f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:50.694324 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3955/7845] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:50.711630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527380e6-3888-4868-8531-a5633c51ec68 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:50.711924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527380e6-3888-4868-8531-a5633c51ec68 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:50.712233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527380e6-3888-4868-8531-a5633c51ec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:50.768257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90377ea7-cc26-49d1-ab63-f5d85b21318f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:50.789401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d26af-85ff-45c3-a80b-15e138b5b36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:50.800349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d26af-85ff-45c3-a80b-15e138b5b36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:50.800349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d26af-85ff-45c3-a80b-15e138b5b36f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:50.800349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d26af-85ff-45c3-a80b-15e138b5b36f admin admin] PATH_INFO: `/v3/users/346801cb8db44f118fcacaa356cc8ae2` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:50.800349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d26af-85ff-45c3-a80b-15e138b5b36f admin admin] RBAC: Authorizing `identity:delete_user(user_id=346801cb8db44f118fcacaa356cc8ae2)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:50.801716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d26af-85ff-45c3-a80b-15e138b5b36f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:50.838982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-527380e6-3888-4868-8531-a5633c51ec68 None None] MFA Rules not processed for user `47820c1b71da4dd1bda25cdbe3cb1a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:50.847355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-527380e6-3888-4868-8531-a5633c51ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:51.086295 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3956/7846] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:50 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:51.088601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527380e6-3888-4868-8531-a5633c51ec68 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:51.106354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527380e6-3888-4868-8531-a5633c51ec68 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:51.114884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bb7a6-de51-4d5e-af6d-9062a22529e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:51.117673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bb7a6-de51-4d5e-af6d-9062a22529e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:51.118203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bb7a6-de51-4d5e-af6d-9062a22529e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:51.118721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bb7a6-de51-4d5e-af6d-9062a22529e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:51.120226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bb7a6-de51-4d5e-af6d-9062a22529e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:51.123514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bb7a6-de51-4d5e-af6d-9062a22529e3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:51.126996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ef8d26af-85ff-45c3-a80b-15e138b5b36f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '346801cb8db44f118fcacaa356cc8ae2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:51.237284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:51.265225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ef8d26af-85ff-45c3-a80b-15e138b5b36f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '346801cb8db44f118fcacaa356cc8ae2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:51.265889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ef8d26af-85ff-45c3-a80b-15e138b5b36f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '346801cb8db44f118fcacaa356cc8ae2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:51.275163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ef8d26af-85ff-45c3-a80b-15e138b5b36f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '346801cb8db44f118fcacaa356cc8ae2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:51.282288 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3957/7847] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:01:51 2022] POST /identity/v3/projects => generated 357 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:51.287586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bb7a6-de51-4d5e-af6d-9062a22529e3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:51.290248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-532bb7a6-de51-4d5e-af6d-9062a22529e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:51.308897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ef8d26af-85ff-45c3-a80b-15e138b5b36f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '346801cb8db44f118fcacaa356cc8ae2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:51.328695 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3891/7848] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:01:50 2022] DELETE /identity/v3/users/346801cb8db44f118fcacaa356cc8ae2 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:51.340582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d26af-85ff-45c3-a80b-15e138b5b36f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:51.347899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ef8d26af-85ff-45c3-a80b-15e138b5b36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:51.416852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bb7a6-de51-4d5e-af6d-9062a22529e3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:51.505768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:51.507690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facae384-d987-4fcf-a5f6-71c77712ec9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:51.509481 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae384-d987-4fcf-a5f6-71c77712ec9f service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:51.531282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae384-d987-4fcf-a5f6-71c77712ec9f service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:51.531282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae384-d987-4fcf-a5f6-71c77712ec9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:51.531282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-facae384-d987-4fcf-a5f6-71c77712ec9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:51.602195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d26af-85ff-45c3-a80b-15e138b5b36f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:51.619233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95c2fc-5bef-48f0-8861-0e3912f68d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:51.623171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95c2fc-5bef-48f0-8861-0e3912f68d3d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:51.623315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95c2fc-5bef-48f0-8861-0e3912f68d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:51.624197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95c2fc-5bef-48f0-8861-0e3912f68d3d admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:51.624482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95c2fc-5bef-48f0-8861-0e3912f68d3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:51.637969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95c2fc-5bef-48f0-8861-0e3912f68d3d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:51.704151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facae384-d987-4fcf-a5f6-71c77712ec9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:51.705648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facae384-d987-4fcf-a5f6-71c77712ec9f service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:51.723727 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3958/7849] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:51 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:51.936782 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3892/7850] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:01:51 2022] POST /identity/v3/users => generated 285 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:01:51.937245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facae384-d987-4fcf-a5f6-71c77712ec9f service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:51.950881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facae384-d987-4fcf-a5f6-71c77712ec9f service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:51.974197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e9a24-0ff7-4b33-933a-673ffd522f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:51.976694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e9a24-0ff7-4b33-933a-673ffd522f06 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:51.978296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e9a24-0ff7-4b33-933a-673ffd522f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:51.980608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e9a24-0ff7-4b33-933a-673ffd522f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:51.981565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e9a24-0ff7-4b33-933a-673ffd522f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:51.983151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e9a24-0ff7-4b33-933a-673ffd522f06 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:52.019501 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3959/7851] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:52.025205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95c2fc-5bef-48f0-8861-0e3912f68d3d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:52.058322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95c2fc-5bef-48f0-8861-0e3912f68d3d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:52.075909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc557-4c92-4b41-927e-5babe97696eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:52.079385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc557-4c92-4b41-927e-5babe97696eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:52.081324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc557-4c92-4b41-927e-5babe97696eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:52.081620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc557-4c92-4b41-927e-5babe97696eb admin admin] PATH_INFO: `/v3/projects/3be10537bcfa4da28e26707a77fff248/users/b34a015c49224a12a56669dcdf20d2c6/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:52.123268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e9a24-0ff7-4b33-933a-673ffd522f06 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:52.125727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-896e9a24-0ff7-4b33-933a-673ffd522f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:52.160832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadc557-4c92-4b41-927e-5babe97696eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be10537bcfa4da28e26707a77fff248, user_id=b34a015c49224a12a56669dcdf20d2c6, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:52.164719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e9a24-0ff7-4b33-933a-673ffd522f06 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:52.172879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadc557-4c92-4b41-927e-5babe97696eb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:52.181028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51413fbb-9c92-4e9f-ac2e-41fb923ab3f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:52.181946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51413fbb-9c92-4e9f-ac2e-41fb923ab3f2 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:52.182326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51413fbb-9c92-4e9f-ac2e-41fb923ab3f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:52.182714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51413fbb-9c92-4e9f-ac2e-41fb923ab3f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:52.194914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-51413fbb-9c92-4e9f-ac2e-41fb923ab3f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:52.308413 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3893/7852] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:52 2022] PUT /identity/v3/projects/3be10537bcfa4da28e26707a77fff248/users/b34a015c49224a12a56669dcdf20d2c6/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:52.309572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc557-4c92-4b41-927e-5babe97696eb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:52.364266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51413fbb-9c92-4e9f-ac2e-41fb923ab3f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:52.367991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51413fbb-9c92-4e9f-ac2e-41fb923ab3f2 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:52.389758 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3960/7853] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:52 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:01:52.459307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc557-4c92-4b41-927e-5babe97696eb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:52.466542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154cd5e-7a10-4667-ba42-e1f0ab5063d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:52.467296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154cd5e-7a10-4667-ba42-e1f0ab5063d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:52.467649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154cd5e-7a10-4667-ba42-e1f0ab5063d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:52.467984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154cd5e-7a10-4667-ba42-e1f0ab5063d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:52.468677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154cd5e-7a10-4667-ba42-e1f0ab5063d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:52.470355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154cd5e-7a10-4667-ba42-e1f0ab5063d1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:52.492995 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3894/7854] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:01:52.493210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51413fbb-9c92-4e9f-ac2e-41fb923ab3f2 service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:52.506595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51413fbb-9c92-4e9f-ac2e-41fb923ab3f2 service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:52.519980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df83a9f-3e31-4bb1-ba43-5eb254900cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:52.520628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df83a9f-3e31-4bb1-ba43-5eb254900cec admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:52.520939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df83a9f-3e31-4bb1-ba43-5eb254900cec admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:52.521332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df83a9f-3e31-4bb1-ba43-5eb254900cec admin admin] PATH_INFO: `/v3/projects/3be10537bcfa4da28e26707a77fff248/users/b34a015c49224a12a56669dcdf20d2c6/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:52.530301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df83a9f-3e31-4bb1-ba43-5eb254900cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be10537bcfa4da28e26707a77fff248, user_id=b34a015c49224a12a56669dcdf20d2c6, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:52.533406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df83a9f-3e31-4bb1-ba43-5eb254900cec admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:52.574035 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3961/7855] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:01:52 2022] PUT /identity/v3/projects/3be10537bcfa4da28e26707a77fff248/users/b34a015c49224a12a56669dcdf20d2c6/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:52.589608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec315fc-0f0b-44c5-bc32-f55592aae9ff None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:52.589608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec315fc-0f0b-44c5-bc32-f55592aae9ff None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:52.589608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec315fc-0f0b-44c5-bc32-f55592aae9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:52.670906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1ec315fc-0f0b-44c5-bc32-f55592aae9ff None None] MFA Rules not processed for user `b34a015c49224a12a56669dcdf20d2c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:01:52.672534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1ec315fc-0f0b-44c5-bc32-f55592aae9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:52.918713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df83a9f-3e31-4bb1-ba43-5eb254900cec admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:52.920549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2df83a9f-3e31-4bb1-ba43-5eb254900cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:52.971974 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3895/7856] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:01:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:01:53.050386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:53.168861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec315fc-0f0b-44c5-bc32-f55592aae9ff None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:53.168861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1ec315fc-0f0b-44c5-bc32-f55592aae9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:53.183595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df83a9f-3e31-4bb1-ba43-5eb254900cec admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:53.201325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0f553-8962-4f10-9e90-be4abdb02c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:53.201991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0f553-8962-4f10-9e90-be4abdb02c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:53.202327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0f553-8962-4f10-9e90-be4abdb02c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:53.202604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0f553-8962-4f10-9e90-be4abdb02c84 admin admin] PATH_INFO: `/v3/projects/c281dabc063b440aba1742cba2f97f45` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:53.204711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0f553-8962-4f10-9e90-be4abdb02c84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c281dabc063b440aba1742cba2f97f45)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:53.206668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0f553-8962-4f10-9e90-be4abdb02c84 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:53.293442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec315fc-0f0b-44c5-bc32-f55592aae9ff None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:53.304018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c468d8-017c-467d-87b0-c6055ebbc9af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:53.304685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c468d8-017c-467d-87b0-c6055ebbc9af service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:53.305000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c468d8-017c-467d-87b0-c6055ebbc9af service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:53.305454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c468d8-017c-467d-87b0-c6055ebbc9af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:53.317375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c468d8-017c-467d-87b0-c6055ebbc9af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:53.318369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c468d8-017c-467d-87b0-c6055ebbc9af service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:53.329970 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3896/7857] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:53 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:01:53.573336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ce0f553-8962-4f10-9e90-be4abdb02c84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c281dabc063b440aba1742cba2f97f45', 'request_id': 'req-3ce0f553-8962-4f10-9e90-be4abdb02c84'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:53.606868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ce0f553-8962-4f10-9e90-be4abdb02c84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c281dabc063b440aba1742cba2f97f45', 'request_id': 'req-3ce0f553-8962-4f10-9e90-be4abdb02c84'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:53.740632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:53.793214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ce0f553-8962-4f10-9e90-be4abdb02c84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c281dabc063b440aba1742cba2f97f45', 'request_id': 'req-3ce0f553-8962-4f10-9e90-be4abdb02c84'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:53.845091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ce0f553-8962-4f10-9e90-be4abdb02c84 admin admin] The token cache is being invalidate because project c281dabc063b440aba1742cba2f97f45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:01:53.845383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ce0f553-8962-4f10-9e90-be4abdb02c84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:53.848620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-3ce0f553-8962-4f10-9e90-be4abdb02c84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:53.860623 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3962/7858] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:01:52 2022] DELETE /identity/v3/projects/c281dabc063b440aba1742cba2f97f45 => generated 0 bytes in 942 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:01:53.867533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c468d8-017c-467d-87b0-c6055ebbc9af service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:53.924372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c468d8-017c-467d-87b0-c6055ebbc9af service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:53.942624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0f553-8962-4f10-9e90-be4abdb02c84 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:53.942624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3ce0f553-8962-4f10-9e90-be4abdb02c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:54.047773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0f553-8962-4f10-9e90-be4abdb02c84 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:54.053039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fd094-d9a2-4ce0-87e0-963a127e3fb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:54.057962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fd094-d9a2-4ce0-87e0-963a127e3fb0 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:54.058755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fd094-d9a2-4ce0-87e0-963a127e3fb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:54.059413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fd094-d9a2-4ce0-87e0-963a127e3fb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:54.061684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e21fd094-d9a2-4ce0-87e0-963a127e3fb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:54.175589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba229bdd-587e-4c12-a790-16dccab84590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:54.176269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba229bdd-587e-4c12-a790-16dccab84590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:54.176556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba229bdd-587e-4c12-a790-16dccab84590 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:54.176831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba229bdd-587e-4c12-a790-16dccab84590 admin admin] PATH_INFO: `/v3/users/6a6f3651e3fe4f3aa2467134c1776afb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:54.179585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba229bdd-587e-4c12-a790-16dccab84590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6f3651e3fe4f3aa2467134c1776afb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:54.194801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba229bdd-587e-4c12-a790-16dccab84590 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:54.340510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fd094-d9a2-4ce0-87e0-963a127e3fb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:54.342221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fd094-d9a2-4ce0-87e0-963a127e3fb0 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:54.371839 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3963/7859] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:01:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:01:54.519536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ba229bdd-587e-4c12-a790-16dccab84590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6f3651e3fe4f3aa2467134c1776afb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:54.688441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ba229bdd-587e-4c12-a790-16dccab84590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6f3651e3fe4f3aa2467134c1776afb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:54.704462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ba229bdd-587e-4c12-a790-16dccab84590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6f3651e3fe4f3aa2467134c1776afb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:54.704462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ba229bdd-587e-4c12-a790-16dccab84590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6f3651e3fe4f3aa2467134c1776afb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:54.723112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ba229bdd-587e-4c12-a790-16dccab84590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6f3651e3fe4f3aa2467134c1776afb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:54.742242 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3897/7860] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:01:53 2022] DELETE /identity/v3/users/6a6f3651e3fe4f3aa2467134c1776afb => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:55.767026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fd094-d9a2-4ce0-87e0-963a127e3fb0 service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:01:55.769076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e21fd094-d9a2-4ce0-87e0-963a127e3fb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:01:55.789041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fd094-d9a2-4ce0-87e0-963a127e3fb0 service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:01:55.876345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9e8d2-df25-4106-977d-e8af3e51a492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:01:55.876910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e8d2-df25-4106-977d-e8af3e51a492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:01:55.877194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e8d2-df25-4106-977d-e8af3e51a492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:01:55.877470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e8d2-df25-4106-977d-e8af3e51a492 admin admin] PATH_INFO: `/v3/projects/d1ee6f822ff5481caf67a8f7ac4fc5de` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:01:55.878650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9e8d2-df25-4106-977d-e8af3e51a492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ee6f822ff5481caf67a8f7ac4fc5de)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:01:55.880619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9e8d2-df25-4106-977d-e8af3e51a492 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:01:56.095899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9be9e8d2-df25-4106-977d-e8af3e51a492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ee6f822ff5481caf67a8f7ac4fc5de', 'request_id': 'req-9be9e8d2-df25-4106-977d-e8af3e51a492'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:56.150121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9be9e8d2-df25-4106-977d-e8af3e51a492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ee6f822ff5481caf67a8f7ac4fc5de', 'request_id': 'req-9be9e8d2-df25-4106-977d-e8af3e51a492'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:56.325846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9be9e8d2-df25-4106-977d-e8af3e51a492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ee6f822ff5481caf67a8f7ac4fc5de', 'request_id': 'req-9be9e8d2-df25-4106-977d-e8af3e51a492'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:56.351534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9be9e8d2-df25-4106-977d-e8af3e51a492 admin admin] The token cache is being invalidate because project d1ee6f822ff5481caf67a8f7ac4fc5de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:01:56.352092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9be9e8d2-df25-4106-977d-e8af3e51a492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:56.357310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:56.360395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9be9e8d2-df25-4106-977d-e8af3e51a492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:01:56.375660 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3964/7861] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:01:55 2022] DELETE /identity/v3/projects/d1ee6f822ff5481caf67a8f7ac4fc5de => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:01:57.220434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:01:58.794511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:00.782518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf367f5-c58b-4aeb-a911-49ba95de034e None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:00.783096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf367f5-c58b-4aeb-a911-49ba95de034e None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:00.783096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf367f5-c58b-4aeb-a911-49ba95de034e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:00.816459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:00.919767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-dcf367f5-c58b-4aeb-a911-49ba95de034e None None] MFA Rules not processed for user `0bb158de78774225a9fc6b158f90deb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:02:00.921242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dcf367f5-c58b-4aeb-a911-49ba95de034e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:01.164919 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3898/7862] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:02:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:02:01.169952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9e8d2-df25-4106-977d-e8af3e51a492 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:01.171603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9be9e8d2-df25-4106-977d-e8af3e51a492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:01.334149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9e8d2-df25-4106-977d-e8af3e51a492 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:01.350212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f07d01-86a8-4526-833b-bb9b860e04af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:01.350852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f07d01-86a8-4526-833b-bb9b860e04af admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:01.351139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f07d01-86a8-4526-833b-bb9b860e04af admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:01.351415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f07d01-86a8-4526-833b-bb9b860e04af admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:01.352064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f07d01-86a8-4526-833b-bb9b860e04af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:01.354118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f07d01-86a8-4526-833b-bb9b860e04af admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:01.550216 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3965/7863] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:02:01 2022] POST /identity/v3/users => generated 287 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:02:01.553870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf367f5-c58b-4aeb-a911-49ba95de034e None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:01.637841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf367f5-c58b-4aeb-a911-49ba95de034e None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:01.656438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a89172-d2a3-40ea-a6cc-3b99f2b0f402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:01.656438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a89172-d2a3-40ea-a6cc-3b99f2b0f402 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:01.656438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a89172-d2a3-40ea-a6cc-3b99f2b0f402 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:01.656438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a89172-d2a3-40ea-a6cc-3b99f2b0f402 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:01.656872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a89172-d2a3-40ea-a6cc-3b99f2b0f402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:01.663647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a89172-d2a3-40ea-a6cc-3b99f2b0f402 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:01.726947 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3899/7864] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:02:01.728877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f07d01-86a8-4526-833b-bb9b860e04af admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:01.748627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f07d01-86a8-4526-833b-bb9b860e04af admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:01.761838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03706ff-8d36-4515-91c5-446c87df0325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:01.763217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03706ff-8d36-4515-91c5-446c87df0325 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:01.764386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03706ff-8d36-4515-91c5-446c87df0325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:01.765566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03706ff-8d36-4515-91c5-446c87df0325 admin admin] PATH_INFO: `/v3/system/users/789ce6744e8b42beb066429398b5ab05/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:01.803995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03706ff-8d36-4515-91c5-446c87df0325 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=789ce6744e8b42beb066429398b5ab05, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:01.813531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03706ff-8d36-4515-91c5-446c87df0325 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:02.008562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:02.018119 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3966/7865] 10.222.0.76 () {60 vars in 1378 bytes} [Sat Aug 27 05:02:01 2022] PUT /identity/v3/system/users/789ce6744e8b42beb066429398b5ab05/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:02.025583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42935b45-3c75-4907-a0fc-20b796aa613d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:02.025583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42935b45-3c75-4907-a0fc-20b796aa613d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:02.025583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42935b45-3c75-4907-a0fc-20b796aa613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:02.067390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-42935b45-3c75-4907-a0fc-20b796aa613d None None] MFA Rules not processed for user `789ce6744e8b42beb066429398b5ab05`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:02:02.068981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-42935b45-3c75-4907-a0fc-20b796aa613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:02.344565 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3900/7866] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:02:02 2022] POST /identity/v3/auth/tokens => generated 2414 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 05:02:02.351797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03706ff-8d36-4515-91c5-446c87df0325 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:02.690299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03706ff-8d36-4515-91c5-446c87df0325 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:02.786117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637642ae-c196-49fe-b088-d08781580034 None tempest-ImageQuotaTest-436458898-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789ce6744e8b42beb066429398b5ab05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:02.787122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637642ae-c196-49fe-b088-d08781580034 None tempest-ImageQuotaTest-436458898-system-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:02.787839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637642ae-c196-49fe-b088-d08781580034 None tempest-ImageQuotaTest-436458898-system-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:02.788874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637642ae-c196-49fe-b088-d08781580034 None tempest-ImageQuotaTest-436458898-system-admin] PATH_INFO: `/v3/services` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:02.789671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637642ae-c196-49fe-b088-d08781580034 None tempest-ImageQuotaTest-436458898-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:02.791307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637642ae-c196-49fe-b088-d08781580034 None tempest-ImageQuotaTest-436458898-system-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:02.816269 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3967/7867] 10.222.0.76 () {58 vars in 1110 bytes} [Sat Aug 27 05:02:02 2022] GET /identity/v3/services => generated 2191 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:02:02.817566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42935b45-3c75-4907-a0fc-20b796aa613d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:03.073858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42935b45-3c75-4907-a0fc-20b796aa613d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:03.119601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:03.143357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a9bb4-e493-466d-8835-6118cdcd7ec2 None tempest-ImageQuotaTest-436458898-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789ce6744e8b42beb066429398b5ab05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:03.144426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a9bb4-e493-466d-8835-6118cdcd7ec2 None tempest-ImageQuotaTest-436458898-system-admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:03.144798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a9bb4-e493-466d-8835-6118cdcd7ec2 None tempest-ImageQuotaTest-436458898-system-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:03.145205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a9bb4-e493-466d-8835-6118cdcd7ec2 None tempest-ImageQuotaTest-436458898-system-admin] PATH_INFO: `/v3/limits` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:03.149686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a9bb4-e493-466d-8835-6118cdcd7ec2 None tempest-ImageQuotaTest-436458898-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:03.151717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a9bb4-e493-466d-8835-6118cdcd7ec2 None tempest-ImageQuotaTest-436458898-system-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:03.231617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-c28a9bb4-e493-466d-8835-6118cdcd7ec2 None tempest-ImageQuotaTest-436458898-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 27 05:02:03.231617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:02:03.231617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:02:03.231617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:02:03.231617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:02:03.231617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:02:03.231617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:02:03.231617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:02:03.231617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:02:03.231617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:02:03.231617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:02:03.231617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:02:03.231617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Aug 27 05:02:03.231617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Aug 27 05:02:03.239029 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 05:02:03.239029 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 05:02:03.239029 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Aug 27 05:02:03.239029 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Aug 27 05:02:03.239029 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 27 05:02:03.239029 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 27 05:02:03.239029 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Aug 27 05:02:03.239029 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Aug 27 05:02:03.239029 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Aug 27 05:02:03.239029 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.NoLimitReference Aug 27 05:02:03.239029 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 27 05:02:03.239029 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:02:03.239029 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3901/7868] 10.222.0.76 () {60 vars in 1126 bytes} [Sat Aug 27 05:02:02 2022] POST /identity/v3/limits => generated 124 bytes in 416 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 27 05:02:03.239959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637642ae-c196-49fe-b088-d08781580034 None tempest-ImageQuotaTest-436458898-system-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:03.372544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637642ae-c196-49fe-b088-d08781580034 None tempest-ImageQuotaTest-436458898-system-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:03.480696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255ccb4-117c-4abc-8f15-062e2d6fd942 None tempest-ImageQuotaTest-436458898-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789ce6744e8b42beb066429398b5ab05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:03.481758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255ccb4-117c-4abc-8f15-062e2d6fd942 None tempest-ImageQuotaTest-436458898-system-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:03.482107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255ccb4-117c-4abc-8f15-062e2d6fd942 None tempest-ImageQuotaTest-436458898-system-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:03.482399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255ccb4-117c-4abc-8f15-062e2d6fd942 None tempest-ImageQuotaTest-436458898-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:03.483068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255ccb4-117c-4abc-8f15-062e2d6fd942 None tempest-ImageQuotaTest-436458898-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:03.484636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255ccb4-117c-4abc-8f15-062e2d6fd942 None tempest-ImageQuotaTest-436458898-system-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:03.531337 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3968/7869] 10.222.0.76 () {58 vars in 1137 bytes} [Sat Aug 27 05:02:03 2022] GET /identity/v3/registered_limits => generated 129 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:02:03.553806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a9bb4-e493-466d-8835-6118cdcd7ec2 None tempest-ImageQuotaTest-436458898-system-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:03.814738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a9bb4-e493-466d-8835-6118cdcd7ec2 None tempest-ImageQuotaTest-436458898-system-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:03.838133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:03.921098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cec7e-0cf3-4df8-826f-dc0a659bb38a None tempest-ImageQuotaTest-436458898-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '789ce6744e8b42beb066429398b5ab05', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:03.921724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cec7e-0cf3-4df8-826f-dc0a659bb38a None tempest-ImageQuotaTest-436458898-system-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:03.922007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cec7e-0cf3-4df8-826f-dc0a659bb38a None tempest-ImageQuotaTest-436458898-system-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:03.922281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cec7e-0cf3-4df8-826f-dc0a659bb38a None tempest-ImageQuotaTest-436458898-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:03.922908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cec7e-0cf3-4df8-826f-dc0a659bb38a None tempest-ImageQuotaTest-436458898-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:03.926890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cec7e-0cf3-4df8-826f-dc0a659bb38a None tempest-ImageQuotaTest-436458898-system-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:03.952428 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3902/7870] 10.222.0.76 () {58 vars in 1137 bytes} [Sat Aug 27 05:02:03 2022] GET /identity/v3/registered_limits => generated 129 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:02:04.019742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:05.819576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:06.037339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:06.918780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255ccb4-117c-4abc-8f15-062e2d6fd942 None tempest-ImageQuotaTest-436458898-system-admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:06.921568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7255ccb4-117c-4abc-8f15-062e2d6fd942 None tempest-ImageQuotaTest-436458898-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:06.981665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255ccb4-117c-4abc-8f15-062e2d6fd942 None tempest-ImageQuotaTest-436458898-system-admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:06.993062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec89b9-a6bc-4990-8c1b-3115a0bff2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:06.997505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec89b9-a6bc-4990-8c1b-3115a0bff2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:07.001448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec89b9-a6bc-4990-8c1b-3115a0bff2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:07.001849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec89b9-a6bc-4990-8c1b-3115a0bff2ab admin admin] PATH_INFO: `/v3/users/4be82482ed8d496f845127beed20f4b1` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:07.006709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec89b9-a6bc-4990-8c1b-3115a0bff2ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be82482ed8d496f845127beed20f4b1)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:07.008888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec89b9-a6bc-4990-8c1b-3115a0bff2ab admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:07.535644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cfec89b9-a6bc-4990-8c1b-3115a0bff2ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be82482ed8d496f845127beed20f4b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:07.543921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cfec89b9-a6bc-4990-8c1b-3115a0bff2ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be82482ed8d496f845127beed20f4b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:07.676870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cfec89b9-a6bc-4990-8c1b-3115a0bff2ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be82482ed8d496f845127beed20f4b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:07.677827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cfec89b9-a6bc-4990-8c1b-3115a0bff2ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be82482ed8d496f845127beed20f4b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:07.703667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cfec89b9-a6bc-4990-8c1b-3115a0bff2ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be82482ed8d496f845127beed20f4b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:07.748446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b59b7-284a-4940-975e-51c9057ae34c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:07.749345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b59b7-284a-4940-975e-51c9057ae34c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:07.749779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b59b7-284a-4940-975e-51c9057ae34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:07.749923 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3969/7871] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:02:06 2022] DELETE /identity/v3/users/4be82482ed8d496f845127beed20f4b1 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:07.798139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3c8b59b7-284a-4940-975e-51c9057ae34c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:02:07.801595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3c8b59b7-284a-4940-975e-51c9057ae34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:07.948809 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3903/7872] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:02:08.010797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec89b9-a6bc-4990-8c1b-3115a0bff2ab admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:08.012783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cfec89b9-a6bc-4990-8c1b-3115a0bff2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:08.019642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:08.262658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec89b9-a6bc-4990-8c1b-3115a0bff2ab admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:08.278548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb1bc5-d20a-4589-a707-c7ed8b87fdbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:08.280055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb1bc5-d20a-4589-a707-c7ed8b87fdbb service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:08.282368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb1bc5-d20a-4589-a707-c7ed8b87fdbb service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:08.282905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb1bc5-d20a-4589-a707-c7ed8b87fdbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:08.313998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb1bc5-d20a-4589-a707-c7ed8b87fdbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:08.315565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb1bc5-d20a-4589-a707-c7ed8b87fdbb service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:08.345829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:08.348203 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3970/7873] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:02:08.687982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:08.889379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:09.890859 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b59b7-284a-4940-975e-51c9057ae34c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:09.898108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3c8b59b7-284a-4940-975e-51c9057ae34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:09.930969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b59b7-284a-4940-975e-51c9057ae34c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:09.941822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:09.943962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:09.945396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:09.945767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25 admin admin] PATH_INFO: `/v3/projects/10fb442a3f94416d85010e6fad2584a0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:09.963950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10fb442a3f94416d85010e6fad2584a0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:09.965531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:10.298046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10fb442a3f94416d85010e6fad2584a0', 'request_id': 'req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:10.313043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:10.313574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10fb442a3f94416d85010e6fad2584a0', 'request_id': 'req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:10.329938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10fb442a3f94416d85010e6fad2584a0', 'request_id': 'req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:10.439109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25 admin admin] The token cache is being invalidate because project 10fb442a3f94416d85010e6fad2584a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:02:10.439109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:10.439109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:10.441371 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3904/7874] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:02:09 2022] DELETE /identity/v3/projects/10fb442a3f94416d85010e6fad2584a0 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:10.445212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb1bc5-d20a-4589-a707-c7ed8b87fdbb service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:10.478452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb1bc5-d20a-4589-a707-c7ed8b87fdbb service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:10.565974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9cf85-3a8d-4020-9932-143b856dba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:10.566693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9cf85-3a8d-4020-9932-143b856dba47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:10.566973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9cf85-3a8d-4020-9932-143b856dba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:10.567248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9cf85-3a8d-4020-9932-143b856dba47 admin admin] PATH_INFO: `/v3/users/47820c1b71da4dd1bda25cdbe3cb1a59` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:10.569155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9cf85-3a8d-4020-9932-143b856dba47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47820c1b71da4dd1bda25cdbe3cb1a59)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:10.574285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9cf85-3a8d-4020-9932-143b856dba47 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:10.971556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-34e9cf85-3a8d-4020-9932-143b856dba47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47820c1b71da4dd1bda25cdbe3cb1a59'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:10.977412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-34e9cf85-3a8d-4020-9932-143b856dba47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47820c1b71da4dd1bda25cdbe3cb1a59'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:11.054894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-34e9cf85-3a8d-4020-9932-143b856dba47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47820c1b71da4dd1bda25cdbe3cb1a59'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:11.055404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-34e9cf85-3a8d-4020-9932-143b856dba47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47820c1b71da4dd1bda25cdbe3cb1a59'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:11.100702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-34e9cf85-3a8d-4020-9932-143b856dba47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47820c1b71da4dd1bda25cdbe3cb1a59'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:11.130562 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3971/7875] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:02:10 2022] DELETE /identity/v3/users/47820c1b71da4dd1bda25cdbe3cb1a59 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:02:11.554797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:11.803432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:12.260335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:12.261935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:12.286069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f7e6e-3241-4b50-890e-ae063c7b3b25 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:12.467074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b1f05-4bea-4654-91a0-d8aaa30c0e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:12.469029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b1f05-4bea-4654-91a0-d8aaa30c0e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:12.472970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b1f05-4bea-4654-91a0-d8aaa30c0e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:12.473676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b1f05-4bea-4654-91a0-d8aaa30c0e9d admin admin] PATH_INFO: `/v3/projects/35807f1ca6e748f7bc62375991b4575e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:12.475288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b1f05-4bea-4654-91a0-d8aaa30c0e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=35807f1ca6e748f7bc62375991b4575e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:12.481009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b1f05-4bea-4654-91a0-d8aaa30c0e9d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:12.771589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-722b1f05-4bea-4654-91a0-d8aaa30c0e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35807f1ca6e748f7bc62375991b4575e', 'request_id': 'req-722b1f05-4bea-4654-91a0-d8aaa30c0e9d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:12.798778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-722b1f05-4bea-4654-91a0-d8aaa30c0e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35807f1ca6e748f7bc62375991b4575e', 'request_id': 'req-722b1f05-4bea-4654-91a0-d8aaa30c0e9d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:12.838386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-722b1f05-4bea-4654-91a0-d8aaa30c0e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35807f1ca6e748f7bc62375991b4575e', 'request_id': 'req-722b1f05-4bea-4654-91a0-d8aaa30c0e9d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:13.007494 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-722b1f05-4bea-4654-91a0-d8aaa30c0e9d admin admin] The token cache is being invalidate because project 35807f1ca6e748f7bc62375991b4575e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:02:13.015981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-722b1f05-4bea-4654-91a0-d8aaa30c0e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:13.015981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-722b1f05-4bea-4654-91a0-d8aaa30c0e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:13.015981 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3905/7876] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:02:12 2022] DELETE /identity/v3/projects/35807f1ca6e748f7bc62375991b4575e => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:13.020863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfb56d-2034-43a5-aed0-b0da5d963c6e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:13.022272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfb56d-2034-43a5-aed0-b0da5d963c6e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:13.022776 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfb56d-2034-43a5-aed0-b0da5d963c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:13.078714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c2cfb56d-2034-43a5-aed0-b0da5d963c6e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:02:13.079974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c2cfb56d-2034-43a5-aed0-b0da5d963c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:13.297372 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3972/7877] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:02:13.305643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7934b6-55cc-4e19-b5cd-181ac792cf6c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:13.305643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7934b6-55cc-4e19-b5cd-181ac792cf6c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:13.306052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7934b6-55cc-4e19-b5cd-181ac792cf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:13.332563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:13.388897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0a7934b6-55cc-4e19-b5cd-181ac792cf6c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:02:13.390074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0a7934b6-55cc-4e19-b5cd-181ac792cf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:13.397414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:13.432433 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3906/7878] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:02:13.436675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfb56d-2034-43a5-aed0-b0da5d963c6e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:13.471780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfb56d-2034-43a5-aed0-b0da5d963c6e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:13.483341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cbf07-389b-4aeb-a228-3430177d8dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:13.483983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cbf07-389b-4aeb-a228-3430177d8dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:13.485341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cbf07-389b-4aeb-a228-3430177d8dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:13.485636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cbf07-389b-4aeb-a228-3430177d8dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:13.488540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cbf07-389b-4aeb-a228-3430177d8dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:02:13.488864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cbf07-389b-4aeb-a228-3430177d8dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:13.490489 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cbf07-389b-4aeb-a228-3430177d8dc2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:13.533889 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3973/7879] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:02:13.538954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7934b6-55cc-4e19-b5cd-181ac792cf6c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:13.555033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7934b6-55cc-4e19-b5cd-181ac792cf6c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:13.583775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62223c42-9be8-44b7-ae10-9219c5e24674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:13.584465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62223c42-9be8-44b7-ae10-9219c5e24674 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:13.586076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62223c42-9be8-44b7-ae10-9219c5e24674 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:13.586530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62223c42-9be8-44b7-ae10-9219c5e24674 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:13.589748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62223c42-9be8-44b7-ae10-9219c5e24674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:13.592095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62223c42-9be8-44b7-ae10-9219c5e24674 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:13.742611 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3907/7880] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:02:13 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:02:13.744603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cbf07-389b-4aeb-a228-3430177d8dc2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:13.764302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cbf07-389b-4aeb-a228-3430177d8dc2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:13.994955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7aaca-a10c-4b02-af31-eaacfabc6887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:14.004186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7aaca-a10c-4b02-af31-eaacfabc6887 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:14.004186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7aaca-a10c-4b02-af31-eaacfabc6887 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:14.004921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7aaca-a10c-4b02-af31-eaacfabc6887 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:14.005670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7aaca-a10c-4b02-af31-eaacfabc6887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:14.013202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7aaca-a10c-4b02-af31-eaacfabc6887 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:14.064390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62223c42-9be8-44b7-ae10-9219c5e24674 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:14.066644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-62223c42-9be8-44b7-ae10-9219c5e24674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:14.090787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62223c42-9be8-44b7-ae10-9219c5e24674 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:14.090787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61257818-fcb9-4f7a-a763-1138b6b75004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:14.091387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257818-fcb9-4f7a-a763-1138b6b75004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:14.091887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257818-fcb9-4f7a-a763-1138b6b75004 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:14.092367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257818-fcb9-4f7a-a763-1138b6b75004 admin admin] PATH_INFO: `/v3/users/0bb158de78774225a9fc6b158f90deb0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:14.093757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61257818-fcb9-4f7a-a763-1138b6b75004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb158de78774225a9fc6b158f90deb0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:14.096214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61257818-fcb9-4f7a-a763-1138b6b75004 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:14.199065 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3974/7881] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:02:13 2022] POST /identity/v3/users => generated 287 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:02:14.200440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7aaca-a10c-4b02-af31-eaacfabc6887 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:14.237830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7aaca-a10c-4b02-af31-eaacfabc6887 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:14.285110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403036e2-ecdb-4e7f-b554-30ba1814bbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:14.288359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403036e2-ecdb-4e7f-b554-30ba1814bbef admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:14.288642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403036e2-ecdb-4e7f-b554-30ba1814bbef admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:14.291564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403036e2-ecdb-4e7f-b554-30ba1814bbef admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:14.294441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403036e2-ecdb-4e7f-b554-30ba1814bbef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:14.301745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403036e2-ecdb-4e7f-b554-30ba1814bbef admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:14.373304 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3975/7882] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:02:14.377653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403036e2-ecdb-4e7f-b554-30ba1814bbef admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:14.399507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403036e2-ecdb-4e7f-b554-30ba1814bbef admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:14.421578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc19850-ff9e-498e-b9f2-14134665cad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:14.421578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc19850-ff9e-498e-b9f2-14134665cad1 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:14.421578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc19850-ff9e-498e-b9f2-14134665cad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:14.421578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc19850-ff9e-498e-b9f2-14134665cad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:14.423176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc19850-ff9e-498e-b9f2-14134665cad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:14.423176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc19850-ff9e-498e-b9f2-14134665cad1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:14.432478 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3976/7883] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:02:14.437004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc19850-ff9e-498e-b9f2-14134665cad1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:14.463745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc19850-ff9e-498e-b9f2-14134665cad1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:14.484715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc8514-9bb3-40ec-b5ce-a031d7dfd7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:14.488952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc8514-9bb3-40ec-b5ce-a031d7dfd7f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:14.489086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-61257818-fcb9-4f7a-a763-1138b6b75004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb158de78774225a9fc6b158f90deb0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:14.489219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc8514-9bb3-40ec-b5ce-a031d7dfd7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:14.489219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc8514-9bb3-40ec-b5ce-a031d7dfd7f5 admin admin] PATH_INFO: `/v3/projects/21e0295aae6c49ecb0e8c2d9b7a08b43/users/2cfdad422b8b435388c3112b7b7cf882/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:14.565077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc8514-9bb3-40ec-b5ce-a031d7dfd7f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e0295aae6c49ecb0e8c2d9b7a08b43, user_id=2cfdad422b8b435388c3112b7b7cf882, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:14.599274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc8514-9bb3-40ec-b5ce-a031d7dfd7f5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:14.636902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-61257818-fcb9-4f7a-a763-1138b6b75004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb158de78774225a9fc6b158f90deb0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:14.640491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-61257818-fcb9-4f7a-a763-1138b6b75004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb158de78774225a9fc6b158f90deb0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:14.648024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-61257818-fcb9-4f7a-a763-1138b6b75004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb158de78774225a9fc6b158f90deb0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:14.695734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-61257818-fcb9-4f7a-a763-1138b6b75004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb158de78774225a9fc6b158f90deb0'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:14.706416 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3977/7884] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:02:14 2022] PUT /identity/v3/projects/21e0295aae6c49ecb0e8c2d9b7a08b43/users/2cfdad422b8b435388c3112b7b7cf882/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:14.714193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02990549-64a0-4bc5-b66f-565364bb9e11 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:14.715849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02990549-64a0-4bc5-b66f-565364bb9e11 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:14.716647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02990549-64a0-4bc5-b66f-565364bb9e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:14.719948 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3908/7885] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:02:14 2022] DELETE /identity/v3/users/0bb158de78774225a9fc6b158f90deb0 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:14.837977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-02990549-64a0-4bc5-b66f-565364bb9e11 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:02:14.839389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-02990549-64a0-4bc5-b66f-565364bb9e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:15.167615 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3978/7886] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:02:15.219230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61257818-fcb9-4f7a-a763-1138b6b75004 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:15.222735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-61257818-fcb9-4f7a-a763-1138b6b75004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:15.346780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02990549-64a0-4bc5-b66f-565364bb9e11 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:15.348263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-02990549-64a0-4bc5-b66f-565364bb9e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:15.370348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02990549-64a0-4bc5-b66f-565364bb9e11 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:15.377990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a4053-713d-4e01-85bd-406c7f4749c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:15.379240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a4053-713d-4e01-85bd-406c7f4749c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:15.379734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a4053-713d-4e01-85bd-406c7f4749c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:15.380371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a4053-713d-4e01-85bd-406c7f4749c7 admin admin] PATH_INFO: `/v3/projects/f7ef48cee13242fb995d66a4208112d0` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:15.382100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a4053-713d-4e01-85bd-406c7f4749c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ef48cee13242fb995d66a4208112d0)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:15.384848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a4053-713d-4e01-85bd-406c7f4749c7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:15.398378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61257818-fcb9-4f7a-a763-1138b6b75004 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:15.442939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393df378-7148-4486-a56f-4170cecb63bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:15.447764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393df378-7148-4486-a56f-4170cecb63bf service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:15.448259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393df378-7148-4486-a56f-4170cecb63bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:15.452477 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393df378-7148-4486-a56f-4170cecb63bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:15.468554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:15.518383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:15.539122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393df378-7148-4486-a56f-4170cecb63bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:15.547616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393df378-7148-4486-a56f-4170cecb63bf service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:15.618962 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3909/7887] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:02:15.667145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af3a4053-713d-4e01-85bd-406c7f4749c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ef48cee13242fb995d66a4208112d0', 'request_id': 'req-af3a4053-713d-4e01-85bd-406c7f4749c7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:15.684613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af3a4053-713d-4e01-85bd-406c7f4749c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ef48cee13242fb995d66a4208112d0', 'request_id': 'req-af3a4053-713d-4e01-85bd-406c7f4749c7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:15.830429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af3a4053-713d-4e01-85bd-406c7f4749c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ef48cee13242fb995d66a4208112d0', 'request_id': 'req-af3a4053-713d-4e01-85bd-406c7f4749c7'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:15.851321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af3a4053-713d-4e01-85bd-406c7f4749c7 admin admin] The token cache is being invalidate because project f7ef48cee13242fb995d66a4208112d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:02:15.851674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af3a4053-713d-4e01-85bd-406c7f4749c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:15.852459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af3a4053-713d-4e01-85bd-406c7f4749c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:15.854930 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3979/7888] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:02:15 2022] DELETE /identity/v3/projects/f7ef48cee13242fb995d66a4208112d0 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:15.859469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393df378-7148-4486-a56f-4170cecb63bf service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:15.875987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393df378-7148-4486-a56f-4170cecb63bf service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:16.083710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b0e54-32f7-4509-90bd-27a95c546616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:16.085314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b0e54-32f7-4509-90bd-27a95c546616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:16.085314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b0e54-32f7-4509-90bd-27a95c546616 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:16.085314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b0e54-32f7-4509-90bd-27a95c546616 admin admin] PATH_INFO: `/v3/users/789ce6744e8b42beb066429398b5ab05` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:16.091882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b0e54-32f7-4509-90bd-27a95c546616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=789ce6744e8b42beb066429398b5ab05)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:16.098212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b0e54-32f7-4509-90bd-27a95c546616 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:16.534435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-af6b0e54-32f7-4509-90bd-27a95c546616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789ce6744e8b42beb066429398b5ab05'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:16.751418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-af6b0e54-32f7-4509-90bd-27a95c546616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789ce6744e8b42beb066429398b5ab05'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:16.756078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-af6b0e54-32f7-4509-90bd-27a95c546616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789ce6744e8b42beb066429398b5ab05'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:16.765893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-af6b0e54-32f7-4509-90bd-27a95c546616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789ce6744e8b42beb066429398b5ab05'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:16.825118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-af6b0e54-32f7-4509-90bd-27a95c546616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789ce6744e8b42beb066429398b5ab05'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:16.852153 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3910/7889] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:02:15 2022] DELETE /identity/v3/users/789ce6744e8b42beb066429398b5ab05 => generated 0 bytes in 991 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:17.090810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:17.214219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:18.224617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9370eb-fb68-4e54-a76d-6a33a7f8892d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:18.231749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9370eb-fb68-4e54-a76d-6a33a7f8892d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:18.249536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9370eb-fb68-4e54-a76d-6a33a7f8892d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:18.340576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0f9370eb-fb68-4e54-a76d-6a33a7f8892d None None] MFA Rules not processed for user `f93cfb60764b472798894864bd7ac895`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:02:18.344721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0f9370eb-fb68-4e54-a76d-6a33a7f8892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:18.454355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b0e54-32f7-4509-90bd-27a95c546616 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:18.457780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-af6b0e54-32f7-4509-90bd-27a95c546616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:18.560852 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3980/7890] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:02:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:02:18.663908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b0e54-32f7-4509-90bd-27a95c546616 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:18.681413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ab702-1228-4bc1-b3eb-a9ff3be0badb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:18.682834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ab702-1228-4bc1-b3eb-a9ff3be0badb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:18.683339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ab702-1228-4bc1-b3eb-a9ff3be0badb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:18.683860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ab702-1228-4bc1-b3eb-a9ff3be0badb admin admin] PATH_INFO: `/v3/projects/None` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:18.693909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ab702-1228-4bc1-b3eb-a9ff3be0badb admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:18.696426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ab702-1228-4bc1-b3eb-a9ff3be0badb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:18.711771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-eb7ab702-1228-4bc1-b3eb-a9ff3be0badb admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Aug 27 05:02:18.711771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:02:18.711771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:02:18.711771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:02:18.711771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:02:18.711771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:02:18.711771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:02:18.711771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:02:18.711771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:02:18.711771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:02:18.711771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:02:18.711771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:02:18.711771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 27 05:02:18.711771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 27 05:02:18.711771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 05:02:18.711771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 05:02:18.713859 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 27 05:02:18.713859 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 27 05:02:18.713859 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 05:02:18.713859 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 05:02:18.713859 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 05:02:18.713859 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 05:02:18.713859 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Aug 27 05:02:18.713859 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:02:18.716324 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3911/7891] 10.222.0.76 () {58 vars in 1149 bytes} [Sat Aug 27 05:02:18 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 05:02:18.911385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:19.026505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:19.507125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750d468-e377-42c2-9045-daab291e6fe4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:19.510962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750d468-e377-42c2-9045-daab291e6fe4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:19.510962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750d468-e377-42c2-9045-daab291e6fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:19.516081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-3750d468-e377-42c2-9045-daab291e6fe4 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:02:19.516081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:02:19.516081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:02:19.516081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:02:19.516081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:02:19.516081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:02:19.516081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:02:19.516081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:02:19.516081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:02:19.516081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:02:19.516081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:02:19.516081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:02:19.516081 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:02:19.517287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:02:19.517287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:02:19.517287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:02:19.517287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:02:19.517287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:02:19.517287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:02:19.517287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:02:19.517287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:02:19.517287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:02:19.517287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:02:19.517287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:02:19.517287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:02:19.517287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:02:19.517287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:02:19.517287 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 05:02:19.519646 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3981/7892] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:02:19 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 15 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:02:20.365450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a7532-2862-41f7-b7fc-9e74dee4531f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:20.365986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a7532-2862-41f7-b7fc-9e74dee4531f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:20.366078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a7532-2862-41f7-b7fc-9e74dee4531f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:20.444921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1c7a7532-2862-41f7-b7fc-9e74dee4531f None None] MFA Rules not processed for user `2cfdad422b8b435388c3112b7b7cf882`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:02:20.446661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1c7a7532-2862-41f7-b7fc-9e74dee4531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:20.647836 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3912/7893] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:02:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:02:20.653393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750d468-e377-42c2-9045-daab291e6fe4 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:20.655384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3750d468-e377-42c2-9045-daab291e6fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:20.689141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750d468-e377-42c2-9045-daab291e6fe4 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:20.695288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4313b65-8ecc-48d8-9a54-ba1773a8c87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:20.697559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4313b65-8ecc-48d8-9a54-ba1773a8c87d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:20.698013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4313b65-8ecc-48d8-9a54-ba1773a8c87d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:20.698408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4313b65-8ecc-48d8-9a54-ba1773a8c87d admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:20.699245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4313b65-8ecc-48d8-9a54-ba1773a8c87d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:20.701398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4313b65-8ecc-48d8-9a54-ba1773a8c87d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:20.906759 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3982/7894] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:02:20 2022] POST /identity/v3/projects => generated 373 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:02:20.908270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a7532-2862-41f7-b7fc-9e74dee4531f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:20.994224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a7532-2862-41f7-b7fc-9e74dee4531f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:21.079689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3df8b9-a72f-4f5a-ac17-37e61362af1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:21.082313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3df8b9-a72f-4f5a-ac17-37e61362af1e admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:21.082618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3df8b9-a72f-4f5a-ac17-37e61362af1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:21.083303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3df8b9-a72f-4f5a-ac17-37e61362af1e admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:21.084446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3df8b9-a72f-4f5a-ac17-37e61362af1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:21.087277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3df8b9-a72f-4f5a-ac17-37e61362af1e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:21.242307 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3913/7895] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:02:20 2022] POST /identity/v3/users => generated 293 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:02:21.244286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4313b65-8ecc-48d8-9a54-ba1773a8c87d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:21.271615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4313b65-8ecc-48d8-9a54-ba1773a8c87d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:21.283039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76648b-835f-4e35-9c95-eb504b5a3aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:21.283957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76648b-835f-4e35-9c95-eb504b5a3aec admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:21.284461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76648b-835f-4e35-9c95-eb504b5a3aec admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:21.284901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76648b-835f-4e35-9c95-eb504b5a3aec admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:21.286035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76648b-835f-4e35-9c95-eb504b5a3aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:21.287814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76648b-835f-4e35-9c95-eb504b5a3aec admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:21.334434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3df8b9-a72f-4f5a-ac17-37e61362af1e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:21.341043 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3983/7896] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:02:21.345745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3df8b9-a72f-4f5a-ac17-37e61362af1e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:21.358363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fad4e6-8689-408c-88a9-ecd238da4724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:21.359873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fad4e6-8689-408c-88a9-ecd238da4724 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:21.360649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fad4e6-8689-408c-88a9-ecd238da4724 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:21.361178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fad4e6-8689-408c-88a9-ecd238da4724 admin admin] PATH_INFO: `/v3/projects/1740a5f20db24a6e93101ca1ad23ac60/users/5adac49ea0ae42ae9e9fd92be1b804ea/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:21.396300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fad4e6-8689-408c-88a9-ecd238da4724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1740a5f20db24a6e93101ca1ad23ac60, user_id=5adac49ea0ae42ae9e9fd92be1b804ea, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:21.399322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fad4e6-8689-408c-88a9-ecd238da4724 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:21.522786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76648b-835f-4e35-9c95-eb504b5a3aec admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:21.525131 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3914/7897] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:02:21 2022] PUT /identity/v3/projects/1740a5f20db24a6e93101ca1ad23ac60/users/5adac49ea0ae42ae9e9fd92be1b804ea/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:02:21.541039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76648b-835f-4e35-9c95-eb504b5a3aec admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:21.601748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:21.671369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a780e5-4333-4883-a729-0636e87c7bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:21.672207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a780e5-4333-4883-a729-0636e87c7bdd admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:21.672967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a780e5-4333-4883-a729-0636e87c7bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:21.678157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a780e5-4333-4883-a729-0636e87c7bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:21.679264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a780e5-4333-4883-a729-0636e87c7bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:21.683171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a780e5-4333-4883-a729-0636e87c7bdd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:21.689202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:21.708034 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3984/7898] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:02:21.713313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fad4e6-8689-408c-88a9-ecd238da4724 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:21.762681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fad4e6-8689-408c-88a9-ecd238da4724 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:21.768661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64b189-6359-4c99-b300-bf6a0056c0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:21.769377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64b189-6359-4c99-b300-bf6a0056c0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:21.769657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64b189-6359-4c99-b300-bf6a0056c0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:21.769881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64b189-6359-4c99-b300-bf6a0056c0b4 admin admin] PATH_INFO: `/v3/projects/1740a5f20db24a6e93101ca1ad23ac60/users/5adac49ea0ae42ae9e9fd92be1b804ea/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:21.772857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64b189-6359-4c99-b300-bf6a0056c0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1740a5f20db24a6e93101ca1ad23ac60, user_id=5adac49ea0ae42ae9e9fd92be1b804ea, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:21.784680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64b189-6359-4c99-b300-bf6a0056c0b4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:21.855703 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3915/7899] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:02:21 2022] PUT /identity/v3/projects/1740a5f20db24a6e93101ca1ad23ac60/users/5adac49ea0ae42ae9e9fd92be1b804ea/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:22.882691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:23.629618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:23.762326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:24.813747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:24.986166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:25.064710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31df57c-7007-448d-8f5e-4a04877c579e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:25.065103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31df57c-7007-448d-8f5e-4a04877c579e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:25.065487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31df57c-7007-448d-8f5e-4a04877c579e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:25.104912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d31df57c-7007-448d-8f5e-4a04877c579e None None] MFA Rules not processed for user `5adac49ea0ae42ae9e9fd92be1b804ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:02:25.106151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d31df57c-7007-448d-8f5e-4a04877c579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:25.176812 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3985/7900] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:02:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:02:25.190546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed741c-e30c-4e66-b510-3bd1615406ce None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:25.190834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed741c-e30c-4e66-b510-3bd1615406ce None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:25.191113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed741c-e30c-4e66-b510-3bd1615406ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:25.210810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a3ed741c-e30c-4e66-b510-3bd1615406ce None None] MFA Rules not processed for user `2cfdad422b8b435388c3112b7b7cf882`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:02:25.212523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a3ed741c-e30c-4e66-b510-3bd1615406ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:25.285576 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3916/7901] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:02:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:02:25.312138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31df57c-7007-448d-8f5e-4a04877c579e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:25.313885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d31df57c-7007-448d-8f5e-4a04877c579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:25.482513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31df57c-7007-448d-8f5e-4a04877c579e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:25.489203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936290f-2575-4d25-8987-3d251c08d1f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:25.490030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936290f-2575-4d25-8987-3d251c08d1f6 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:25.490475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936290f-2575-4d25-8987-3d251c08d1f6 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:25.490914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936290f-2575-4d25-8987-3d251c08d1f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:25.504155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936290f-2575-4d25-8987-3d251c08d1f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:25.505969 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936290f-2575-4d25-8987-3d251c08d1f6 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:25.518046 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3986/7902] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:02:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:02:25.830988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e045-f5a6-46ed-bc48-8c0e44a3490f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:25.831489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e045-f5a6-46ed-bc48-8c0e44a3490f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:25.831616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e045-f5a6-46ed-bc48-8c0e44a3490f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:25.838854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-8971e045-f5a6-46ed-bc48-8c0e44a3490f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:02:25.838854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:02:25.838854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:02:25.838854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:02:25.838854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:02:25.838854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:02:25.838854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:02:25.838854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:02:25.838854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:02:25.838854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:02:25.838854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:02:25.838854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:02:25.838854 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:02:25.841038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:02:25.841038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:02:25.841038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:02:25.841038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:02:25.841038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:02:25.841038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:02:25.841038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:02:25.841038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:02:25.841038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:02:25.841038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:02:25.841038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:02:25.841038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:02:25.841038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:02:25.841038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:02:25.841038 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:02:25.842391 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3917/7903] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:02:25 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 05:02:27.119658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:27.593171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:29.143232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936290f-2575-4d25-8987-3d251c08d1f6 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:29.152805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:29.153293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0936290f-2575-4d25-8987-3d251c08d1f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:29.220058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936290f-2575-4d25-8987-3d251c08d1f6 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:29.224715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066403f-a911-4607-9d0c-0499e94a505e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:29.225600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066403f-a911-4607-9d0c-0499e94a505e service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:29.226083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066403f-a911-4607-9d0c-0499e94a505e service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:29.226566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066403f-a911-4607-9d0c-0499e94a505e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:29.237256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066403f-a911-4607-9d0c-0499e94a505e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:29.238786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066403f-a911-4607-9d0c-0499e94a505e service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:29.281177 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3987/7904] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:02:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:02:31.030899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:31.253839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:32.305682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:32.944806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:33.184581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:34.328023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:34.551127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:35.178966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:35.679066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:36.855047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:38.019129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:38.352674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971e045-f5a6-46ed-bc48-8c0e44a3490f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:38.358414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8971e045-f5a6-46ed-bc48-8c0e44a3490f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:38.641614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971e045-f5a6-46ed-bc48-8c0e44a3490f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:38.658609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f825c-13ea-485f-a27b-fdf91edfe369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:38.659540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f825c-13ea-485f-a27b-fdf91edfe369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:38.660067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f825c-13ea-485f-a27b-fdf91edfe369 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:38.661061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f825c-13ea-485f-a27b-fdf91edfe369 admin admin] PATH_INFO: `/v3/users/2bbd508183484dabb9a4b89d3f2979c6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:38.669533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f825c-13ea-485f-a27b-fdf91edfe369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bbd508183484dabb9a4b89d3f2979c6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:38.674340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f825c-13ea-485f-a27b-fdf91edfe369 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:38.965946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-218f825c-13ea-485f-a27b-fdf91edfe369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bbd508183484dabb9a4b89d3f2979c6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:38.971177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:39.093610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-218f825c-13ea-485f-a27b-fdf91edfe369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bbd508183484dabb9a4b89d3f2979c6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:39.094821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-218f825c-13ea-485f-a27b-fdf91edfe369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bbd508183484dabb9a4b89d3f2979c6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:39.106084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-218f825c-13ea-485f-a27b-fdf91edfe369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bbd508183484dabb9a4b89d3f2979c6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:39.137075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-218f825c-13ea-485f-a27b-fdf91edfe369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bbd508183484dabb9a4b89d3f2979c6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:39.152419 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3918/7905] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:02:38 2022] DELETE /identity/v3/users/2bbd508183484dabb9a4b89d3f2979c6 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:39.157314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae6808-9fb6-4dd3-8443-f0fd0c808163 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:39.158020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae6808-9fb6-4dd3-8443-f0fd0c808163 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:39.158494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae6808-9fb6-4dd3-8443-f0fd0c808163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:39.237231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1cae6808-9fb6-4dd3-8443-f0fd0c808163 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:02:39.238049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1cae6808-9fb6-4dd3-8443-f0fd0c808163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:39.476284 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3988/7906] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:02:39.489163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f825c-13ea-485f-a27b-fdf91edfe369 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:39.490647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-218f825c-13ea-485f-a27b-fdf91edfe369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:39.626584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f825c-13ea-485f-a27b-fdf91edfe369 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:39.653602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb14b4e-c363-443c-9f44-0f215bb598fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:39.654495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb14b4e-c363-443c-9f44-0f215bb598fb service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:39.654783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb14b4e-c363-443c-9f44-0f215bb598fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:39.655106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb14b4e-c363-443c-9f44-0f215bb598fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:39.692372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb14b4e-c363-443c-9f44-0f215bb598fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:39.693837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb14b4e-c363-443c-9f44-0f215bb598fb service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:39.717716 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3919/7907] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:02:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:02:40.438066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:40.944614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae6808-9fb6-4dd3-8443-f0fd0c808163 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:40.950014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1cae6808-9fb6-4dd3-8443-f0fd0c808163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:40.985256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae6808-9fb6-4dd3-8443-f0fd0c808163 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:41.000302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e6b06-1c70-4998-97a0-27b1baf5630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:41.001453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e6b06-1c70-4998-97a0-27b1baf5630b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:41.001973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e6b06-1c70-4998-97a0-27b1baf5630b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:41.002482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e6b06-1c70-4998-97a0-27b1baf5630b admin admin] PATH_INFO: `/v3/projects/22c5aff3ef4b40ebb1bc73fcd3bcaebd` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:41.008593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e6b06-1c70-4998-97a0-27b1baf5630b admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c5aff3ef4b40ebb1bc73fcd3bcaebd)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:41.012719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e6b06-1c70-4998-97a0-27b1baf5630b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:41.245664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-111e6b06-1c70-4998-97a0-27b1baf5630b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c5aff3ef4b40ebb1bc73fcd3bcaebd', 'request_id': 'req-111e6b06-1c70-4998-97a0-27b1baf5630b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:41.268823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-111e6b06-1c70-4998-97a0-27b1baf5630b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c5aff3ef4b40ebb1bc73fcd3bcaebd', 'request_id': 'req-111e6b06-1c70-4998-97a0-27b1baf5630b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:41.344466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-111e6b06-1c70-4998-97a0-27b1baf5630b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c5aff3ef4b40ebb1bc73fcd3bcaebd', 'request_id': 'req-111e6b06-1c70-4998-97a0-27b1baf5630b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:41.375055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-111e6b06-1c70-4998-97a0-27b1baf5630b admin admin] The token cache is being invalidate because project 22c5aff3ef4b40ebb1bc73fcd3bcaebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:02:41.375630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-111e6b06-1c70-4998-97a0-27b1baf5630b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:41.383539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-111e6b06-1c70-4998-97a0-27b1baf5630b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:41.388527 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3989/7908] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:02:40 2022] DELETE /identity/v3/projects/22c5aff3ef4b40ebb1bc73fcd3bcaebd => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:41.389784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb14b4e-c363-443c-9f44-0f215bb598fb service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:41.400938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb14b4e-c363-443c-9f44-0f215bb598fb service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:41.514636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a57a2-ce56-48b8-8624-acaf43c76865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:41.517539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a57a2-ce56-48b8-8624-acaf43c76865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:41.517898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a57a2-ce56-48b8-8624-acaf43c76865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:41.518973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a57a2-ce56-48b8-8624-acaf43c76865 admin admin] PATH_INFO: `/v3/users/b34a015c49224a12a56669dcdf20d2c6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:41.520495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a57a2-ce56-48b8-8624-acaf43c76865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b34a015c49224a12a56669dcdf20d2c6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:41.531791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a57a2-ce56-48b8-8624-acaf43c76865 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:41.814260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:41.841618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-550a57a2-ce56-48b8-8624-acaf43c76865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b34a015c49224a12a56669dcdf20d2c6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:41.995316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-550a57a2-ce56-48b8-8624-acaf43c76865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b34a015c49224a12a56669dcdf20d2c6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:41.998607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-550a57a2-ce56-48b8-8624-acaf43c76865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b34a015c49224a12a56669dcdf20d2c6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:41.999647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe913e-3535-4050-886d-05a198a63029 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:42.000147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe913e-3535-4050-886d-05a198a63029 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:42.000325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe913e-3535-4050-886d-05a198a63029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:42.014934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-550a57a2-ce56-48b8-8624-acaf43c76865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b34a015c49224a12a56669dcdf20d2c6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:42.031589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4cfe913e-3535-4050-886d-05a198a63029 None None] MFA Rules not processed for user `f93cfb60764b472798894864bd7ac895`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:02:42.038201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4cfe913e-3535-4050-886d-05a198a63029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:42.045288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-550a57a2-ce56-48b8-8624-acaf43c76865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b34a015c49224a12a56669dcdf20d2c6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:42.060291 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3920/7909] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:02:41 2022] DELETE /identity/v3/users/b34a015c49224a12a56669dcdf20d2c6 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:42.113777 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3990/7910] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:02:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:02:42.979158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:43.285407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842337b-4d00-430f-8712-fe94c7e81cb9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:43.289820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842337b-4d00-430f-8712-fe94c7e81cb9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:43.289820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842337b-4d00-430f-8712-fe94c7e81cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:43.297488 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-6842337b-4d00-430f-8712-fe94c7e81cb9 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:02:43.297488 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:02:43.297488 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:02:43.297488 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:02:43.297488 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:02:43.297488 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:02:43.297488 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:02:43.297488 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:02:43.297488 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:02:43.297488 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:02:43.297488 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:02:43.297488 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:02:43.297488 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:02:43.298584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:02:43.298584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:02:43.298584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:02:43.298584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:02:43.298584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:02:43.298584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:02:43.298584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:02:43.298584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:02:43.298584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:02:43.298584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:02:43.298584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:02:43.298584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:02:43.298584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:02:43.298584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:02:43.298584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:02:43.338132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe913e-3535-4050-886d-05a198a63029 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:43.340822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4cfe913e-3535-4050-886d-05a198a63029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:43.348023 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3921/7911] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:02:43 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 64 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:02:43.390835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe913e-3535-4050-886d-05a198a63029 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:43.514329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd160d-1982-474f-8e7d-a2331944137d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:43.527553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd160d-1982-474f-8e7d-a2331944137d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:43.527553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd160d-1982-474f-8e7d-a2331944137d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:43.527553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd160d-1982-474f-8e7d-a2331944137d admin admin] PATH_INFO: `/v3/projects/3be10537bcfa4da28e26707a77fff248` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:43.527553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd160d-1982-474f-8e7d-a2331944137d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3be10537bcfa4da28e26707a77fff248)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:43.527553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd160d-1982-474f-8e7d-a2331944137d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:43.824522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5dbd160d-1982-474f-8e7d-a2331944137d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3be10537bcfa4da28e26707a77fff248', 'request_id': 'req-5dbd160d-1982-474f-8e7d-a2331944137d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:43.837033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5dbd160d-1982-474f-8e7d-a2331944137d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3be10537bcfa4da28e26707a77fff248', 'request_id': 'req-5dbd160d-1982-474f-8e7d-a2331944137d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:44.012750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5dbd160d-1982-474f-8e7d-a2331944137d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3be10537bcfa4da28e26707a77fff248', 'request_id': 'req-5dbd160d-1982-474f-8e7d-a2331944137d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:44.031998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5dbd160d-1982-474f-8e7d-a2331944137d admin admin] The token cache is being invalidate because project 3be10537bcfa4da28e26707a77fff248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:02:44.032474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5dbd160d-1982-474f-8e7d-a2331944137d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:44.033686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5dbd160d-1982-474f-8e7d-a2331944137d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:44.041939 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3991/7912] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:02:43 2022] DELETE /identity/v3/projects/3be10537bcfa4da28e26707a77fff248 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:44.043731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eab618-71f3-4d7c-b295-f887bc76a8a0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:44.044227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eab618-71f3-4d7c-b295-f887bc76a8a0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:44.044338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eab618-71f3-4d7c-b295-f887bc76a8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:44.098020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c9eab618-71f3-4d7c-b295-f887bc76a8a0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:02:44.099285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c9eab618-71f3-4d7c-b295-f887bc76a8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:44.241567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:44.273095 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3922/7913] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:02:44.275565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e11b00-2bf3-4252-83d4-daec53b99d19 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:44.275853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e11b00-2bf3-4252-83d4-daec53b99d19 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:44.276128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e11b00-2bf3-4252-83d4-daec53b99d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:44.319300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b8e11b00-2bf3-4252-83d4-daec53b99d19 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:02:44.338186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b8e11b00-2bf3-4252-83d4-daec53b99d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:44.341329 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3992/7914] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:02:44.345537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eab618-71f3-4d7c-b295-f887bc76a8a0 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:44.356083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eab618-71f3-4d7c-b295-f887bc76a8a0 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:44.372533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6a3dc-7a9b-4ac0-b17b-53fa18c5afbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:44.372533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6a3dc-7a9b-4ac0-b17b-53fa18c5afbf admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:44.372533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6a3dc-7a9b-4ac0-b17b-53fa18c5afbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:44.372917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6a3dc-7a9b-4ac0-b17b-53fa18c5afbf admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:44.373313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6a3dc-7a9b-4ac0-b17b-53fa18c5afbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:02:44.373627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6a3dc-7a9b-4ac0-b17b-53fa18c5afbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:44.385294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6a3dc-7a9b-4ac0-b17b-53fa18c5afbf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:44.405515 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3923/7915] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:02:44.409955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e11b00-2bf3-4252-83d4-daec53b99d19 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:44.421783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e11b00-2bf3-4252-83d4-daec53b99d19 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:44.436892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35009538-e1b4-474e-9070-a6a844d15e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:44.437927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35009538-e1b4-474e-9070-a6a844d15e90 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:44.438457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35009538-e1b4-474e-9070-a6a844d15e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:44.438964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35009538-e1b4-474e-9070-a6a844d15e90 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:44.455405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35009538-e1b4-474e-9070-a6a844d15e90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:44.457484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35009538-e1b4-474e-9070-a6a844d15e90 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:44.621744 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3993/7916] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:02:44 2022] POST /identity/v3/projects => generated 365 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:02:44.625655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6a3dc-7a9b-4ac0-b17b-53fa18c5afbf admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:44.641341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6a3dc-7a9b-4ac0-b17b-53fa18c5afbf admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:44.810246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d425d0-c6b1-4476-ab35-e2bba9301d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:44.811187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d425d0-c6b1-4476-ab35-e2bba9301d93 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:44.811641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d425d0-c6b1-4476-ab35-e2bba9301d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:44.812089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d425d0-c6b1-4476-ab35-e2bba9301d93 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:44.812945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d425d0-c6b1-4476-ab35-e2bba9301d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:44.815113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d425d0-c6b1-4476-ab35-e2bba9301d93 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:44.836144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:45.002765 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3924/7917] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:02:44 2022] POST /identity/v3/users => generated 283 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:02:45.003335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35009538-e1b4-474e-9070-a6a844d15e90 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:45.052705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35009538-e1b4-474e-9070-a6a844d15e90 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:45.060595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddeb2e-7648-47a7-9405-5d5dc2477eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:45.061229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddeb2e-7648-47a7-9405-5d5dc2477eba admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:45.061505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddeb2e-7648-47a7-9405-5d5dc2477eba admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:45.061777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddeb2e-7648-47a7-9405-5d5dc2477eba admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:45.062422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddeb2e-7648-47a7-9405-5d5dc2477eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:45.064031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddeb2e-7648-47a7-9405-5d5dc2477eba admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:45.101946 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3994/7918] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:02:45.105934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d425d0-c6b1-4476-ab35-e2bba9301d93 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:45.122466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d425d0-c6b1-4476-ab35-e2bba9301d93 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:45.142972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24022561-ff36-434e-ac21-4fc60d7df5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:45.143878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24022561-ff36-434e-ac21-4fc60d7df5fd admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:45.144361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24022561-ff36-434e-ac21-4fc60d7df5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:45.144821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24022561-ff36-434e-ac21-4fc60d7df5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:45.145691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24022561-ff36-434e-ac21-4fc60d7df5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:45.147458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24022561-ff36-434e-ac21-4fc60d7df5fd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:45.180201 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3925/7919] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:02:45.184353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddeb2e-7648-47a7-9405-5d5dc2477eba admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:45.200001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddeb2e-7648-47a7-9405-5d5dc2477eba admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:45.234198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983f6d4-c3e2-42e1-8590-7bc068cd5cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:45.235441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983f6d4-c3e2-42e1-8590-7bc068cd5cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:45.235919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983f6d4-c3e2-42e1-8590-7bc068cd5cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:45.236218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983f6d4-c3e2-42e1-8590-7bc068cd5cbe admin admin] PATH_INFO: `/v3/projects/c0140c0de7974e20893bd0e32b93e30e/users/1111514ba59b471dbaacb9deaf70547a/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:45.279694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983f6d4-c3e2-42e1-8590-7bc068cd5cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0140c0de7974e20893bd0e32b93e30e, user_id=1111514ba59b471dbaacb9deaf70547a, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:45.282848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983f6d4-c3e2-42e1-8590-7bc068cd5cbe admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:45.473133 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3995/7920] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:02:45 2022] PUT /identity/v3/projects/c0140c0de7974e20893bd0e32b93e30e/users/1111514ba59b471dbaacb9deaf70547a/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:02:45.485743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0bdb0-f803-42a5-a8dd-fb2cba9761f1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:45.486256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0bdb0-f803-42a5-a8dd-fb2cba9761f1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:45.486710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0bdb0-f803-42a5-a8dd-fb2cba9761f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:45.539493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-18e0bdb0-f803-42a5-a8dd-fb2cba9761f1 None None] MFA Rules not processed for user `1111514ba59b471dbaacb9deaf70547a`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:02:45.541148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-18e0bdb0-f803-42a5-a8dd-fb2cba9761f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:45.729706 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3926/7921] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:02:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:02:45.740411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983f6d4-c3e2-42e1-8590-7bc068cd5cbe admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:45.978843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983f6d4-c3e2-42e1-8590-7bc068cd5cbe admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:45.992653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c80398-c73b-4f3b-a1b6-d6033dff1382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:45.993458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c80398-c73b-4f3b-a1b6-d6033dff1382 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:45.993651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c80398-c73b-4f3b-a1b6-d6033dff1382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:45.994119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c80398-c73b-4f3b-a1b6-d6033dff1382 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:45.994975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c80398-c73b-4f3b-a1b6-d6033dff1382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:45.997282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c80398-c73b-4f3b-a1b6-d6033dff1382 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:46.128676 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3996/7922] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:02:45 2022] POST /identity/v3/projects => generated 365 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:02:46.129217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0bdb0-f803-42a5-a8dd-fb2cba9761f1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:46.170147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0bdb0-f803-42a5-a8dd-fb2cba9761f1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:46.354528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afa6b8-3edc-4c68-9686-838dd2e68a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:46.355343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afa6b8-3edc-4c68-9686-838dd2e68a95 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:46.359782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afa6b8-3edc-4c68-9686-838dd2e68a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:46.359782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afa6b8-3edc-4c68-9686-838dd2e68a95 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:46.359782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afa6b8-3edc-4c68-9686-838dd2e68a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:46.359782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afa6b8-3edc-4c68-9686-838dd2e68a95 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:46.580983 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3927/7923] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:02:46 2022] POST /identity/v3/users => generated 289 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:02:46.585469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c80398-c73b-4f3b-a1b6-d6033dff1382 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:46.600229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c80398-c73b-4f3b-a1b6-d6033dff1382 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:46.615032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98111b97-76b5-4f02-a349-a438956b2120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:46.627697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98111b97-76b5-4f02-a349-a438956b2120 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:46.627697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98111b97-76b5-4f02-a349-a438956b2120 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:46.627697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98111b97-76b5-4f02-a349-a438956b2120 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:46.627697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98111b97-76b5-4f02-a349-a438956b2120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:46.627697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98111b97-76b5-4f02-a349-a438956b2120 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:46.639350 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3997/7924] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:02:46.640286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afa6b8-3edc-4c68-9686-838dd2e68a95 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:46.654427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afa6b8-3edc-4c68-9686-838dd2e68a95 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:46.667805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5316d6-5b02-49fd-a6a3-934718b81ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:46.668665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5316d6-5b02-49fd-a6a3-934718b81ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:46.668806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5316d6-5b02-49fd-a6a3-934718b81ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:46.669282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5316d6-5b02-49fd-a6a3-934718b81ca5 admin admin] PATH_INFO: `/v3/projects/0035900145f2454bac3b88a7c32f5615/users/d4162d7b442e44d18f3bf204f02ed00b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:46.705211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5316d6-5b02-49fd-a6a3-934718b81ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0035900145f2454bac3b88a7c32f5615, user_id=d4162d7b442e44d18f3bf204f02ed00b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:46.708780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5316d6-5b02-49fd-a6a3-934718b81ca5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:46.871708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:46.878415 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3928/7925] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:02:46 2022] PUT /identity/v3/projects/0035900145f2454bac3b88a7c32f5615/users/d4162d7b442e44d18f3bf204f02ed00b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:46.882484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98111b97-76b5-4f02-a349-a438956b2120 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:46.894293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98111b97-76b5-4f02-a349-a438956b2120 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:46.991616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ae9d9-66b9-41ac-b434-2414f31b958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:46.992878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ae9d9-66b9-41ac-b434-2414f31b958a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:46.993553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ae9d9-66b9-41ac-b434-2414f31b958a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:46.993995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ae9d9-66b9-41ac-b434-2414f31b958a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:46.994971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ae9d9-66b9-41ac-b434-2414f31b958a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:46.996642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ae9d9-66b9-41ac-b434-2414f31b958a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:47.021882 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3998/7926] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:02:47.026354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5316d6-5b02-49fd-a6a3-934718b81ca5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:47.066951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5316d6-5b02-49fd-a6a3-934718b81ca5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:47.072014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:47.099264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377c91d-0a28-4e07-a893-900a626762c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:47.100228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377c91d-0a28-4e07-a893-900a626762c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:47.100522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377c91d-0a28-4e07-a893-900a626762c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:47.100802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377c91d-0a28-4e07-a893-900a626762c5 admin admin] PATH_INFO: `/v3/projects/0035900145f2454bac3b88a7c32f5615/users/d4162d7b442e44d18f3bf204f02ed00b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:47.114031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377c91d-0a28-4e07-a893-900a626762c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0035900145f2454bac3b88a7c32f5615, user_id=d4162d7b442e44d18f3bf204f02ed00b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:47.121888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377c91d-0a28-4e07-a893-900a626762c5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:47.166367 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3929/7927] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:02:47 2022] PUT /identity/v3/projects/0035900145f2454bac3b88a7c32f5615/users/d4162d7b442e44d18f3bf204f02ed00b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:47.225802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab5a71-77fc-43f1-9b8c-ad23412ea8b6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:47.225802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab5a71-77fc-43f1-9b8c-ad23412ea8b6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:47.225802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab5a71-77fc-43f1-9b8c-ad23412ea8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:47.246057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c9ab5a71-77fc-43f1-9b8c-ad23412ea8b6 None None] MFA Rules not processed for user `d4162d7b442e44d18f3bf204f02ed00b`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:02:47.249360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c9ab5a71-77fc-43f1-9b8c-ad23412ea8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:47.370134 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 3999/7928] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:02:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:02:47.384423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377c91d-0a28-4e07-a893-900a626762c5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:47.392671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2377c91d-0a28-4e07-a893-900a626762c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:47.510642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377c91d-0a28-4e07-a893-900a626762c5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:47.519254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcceee-1309-4aef-8aa4-830d5388bf71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:47.519905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcceee-1309-4aef-8aa4-830d5388bf71 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:47.520889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcceee-1309-4aef-8aa4-830d5388bf71 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:47.521176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcceee-1309-4aef-8aa4-830d5388bf71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:47.530236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:47.537068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcceee-1309-4aef-8aa4-830d5388bf71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:47.539470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcceee-1309-4aef-8aa4-830d5388bf71 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:47.552957 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3930/7929] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:02:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:02:48.020143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab5a71-77fc-43f1-9b8c-ad23412ea8b6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:48.038737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab5a71-77fc-43f1-9b8c-ad23412ea8b6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:48.051578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90b9f0-8004-4425-9cd7-fc69cd238f50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:48.052326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b9f0-8004-4425-9cd7-fc69cd238f50 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:48.052504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b9f0-8004-4425-9cd7-fc69cd238f50 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:48.052956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b9f0-8004-4425-9cd7-fc69cd238f50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:48.208663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:48.248550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90b9f0-8004-4425-9cd7-fc69cd238f50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:48.250584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90b9f0-8004-4425-9cd7-fc69cd238f50 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:48.272228 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4000/7930] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:02:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:02:50.315786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:50.673405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcceee-1309-4aef-8aa4-830d5388bf71 service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:50.674899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fdfcceee-1309-4aef-8aa4-830d5388bf71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:50.755271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcceee-1309-4aef-8aa4-830d5388bf71 service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:50.762715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f080b4-fc23-4882-babd-29fbdd24f7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:50.763780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f080b4-fc23-4882-babd-29fbdd24f7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:50.764329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f080b4-fc23-4882-babd-29fbdd24f7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:50.764847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f080b4-fc23-4882-babd-29fbdd24f7ee admin admin] PATH_INFO: `/v3/users/f93cfb60764b472798894864bd7ac895` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:50.766267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f080b4-fc23-4882-babd-29fbdd24f7ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f93cfb60764b472798894864bd7ac895)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:50.768490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f080b4-fc23-4882-babd-29fbdd24f7ee admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:51.401986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7f080b4-fc23-4882-babd-29fbdd24f7ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f93cfb60764b472798894864bd7ac895'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:51.595632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7f080b4-fc23-4882-babd-29fbdd24f7ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f93cfb60764b472798894864bd7ac895'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:51.596310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7f080b4-fc23-4882-babd-29fbdd24f7ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f93cfb60764b472798894864bd7ac895'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:51.608402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7f080b4-fc23-4882-babd-29fbdd24f7ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f93cfb60764b472798894864bd7ac895'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:51.625109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90b9f0-8004-4425-9cd7-fc69cd238f50 service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:51.625592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7f080b4-fc23-4882-babd-29fbdd24f7ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f93cfb60764b472798894864bd7ac895'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:51.625693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ac90b9f0-8004-4425-9cd7-fc69cd238f50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:51.631238 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3931/7931] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:02:50 2022] DELETE /identity/v3/users/f93cfb60764b472798894864bd7ac895 => generated 0 bytes in 959 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:51.637220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d35e10-3bcf-461d-8957-4b0db48cd012 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:51.637524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d35e10-3bcf-461d-8957-4b0db48cd012 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:51.638188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d35e10-3bcf-461d-8957-4b0db48cd012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:51.671702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-77d35e10-3bcf-461d-8957-4b0db48cd012 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:02:51.671702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-77d35e10-3bcf-461d-8957-4b0db48cd012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:51.764564 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3932/7932] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:02:51.768009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90b9f0-8004-4425-9cd7-fc69cd238f50 service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:51.778404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d35e10-3bcf-461d-8957-4b0db48cd012 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:51.780619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-77d35e10-3bcf-461d-8957-4b0db48cd012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:51.955853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69098fd-5194-48ec-81da-11f323eefa7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:51.957033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69098fd-5194-48ec-81da-11f323eefa7c service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:51.957536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69098fd-5194-48ec-81da-11f323eefa7c service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:51.961949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69098fd-5194-48ec-81da-11f323eefa7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:51.961949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d69098fd-5194-48ec-81da-11f323eefa7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:51.972053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d35e10-3bcf-461d-8957-4b0db48cd012 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:51.976960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f923411-aaea-4a57-9a65-e78334341ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:51.977706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f923411-aaea-4a57-9a65-e78334341ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:51.977995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f923411-aaea-4a57-9a65-e78334341ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:51.978272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f923411-aaea-4a57-9a65-e78334341ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:51.980823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69098fd-5194-48ec-81da-11f323eefa7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:51.982769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69098fd-5194-48ec-81da-11f323eefa7c service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:51.990616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f923411-aaea-4a57-9a65-e78334341ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:51.993077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f923411-aaea-4a57-9a65-e78334341ee9 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:52.005260 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3933/7933] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:02:52.017566 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4001/7934] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:02:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:02:52.470754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:52.666338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f923411-aaea-4a57-9a65-e78334341ee9 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:52.668689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8f923411-aaea-4a57-9a65-e78334341ee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:52.703666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f923411-aaea-4a57-9a65-e78334341ee9 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:52.719422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:52.720873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:52.722833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:52.726039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12 admin admin] PATH_INFO: `/v3/projects/acc20d3acbb8412595ec5e464a94b770` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:52.727924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc20d3acbb8412595ec5e464a94b770)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:52.733710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:52.941907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc20d3acbb8412595ec5e464a94b770', 'request_id': 'req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:52.956071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc20d3acbb8412595ec5e464a94b770', 'request_id': 'req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:52.973894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc20d3acbb8412595ec5e464a94b770', 'request_id': 'req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:53.173041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12 admin admin] The token cache is being invalidate because project acc20d3acbb8412595ec5e464a94b770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:02:53.173041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:53.173041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:53.174234 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3934/7935] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:02:52 2022] DELETE /identity/v3/projects/acc20d3acbb8412595ec5e464a94b770 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:53.178498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69098fd-5194-48ec-81da-11f323eefa7c service placement] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:53.201440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69098fd-5194-48ec-81da-11f323eefa7c service placement] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:53.373358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d5c87-6cb9-4e06-9eee-8632ef08126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:53.374019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d5c87-6cb9-4e06-9eee-8632ef08126a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:53.374304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d5c87-6cb9-4e06-9eee-8632ef08126a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:53.374584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d5c87-6cb9-4e06-9eee-8632ef08126a admin admin] PATH_INFO: `/v3/users/ab096298eba14dd0a810b3b39924446c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:53.378550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d5c87-6cb9-4e06-9eee-8632ef08126a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab096298eba14dd0a810b3b39924446c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:53.383605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d5c87-6cb9-4e06-9eee-8632ef08126a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:53.708050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4a2d5c87-6cb9-4e06-9eee-8632ef08126a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab096298eba14dd0a810b3b39924446c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:53.711123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4a2d5c87-6cb9-4e06-9eee-8632ef08126a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab096298eba14dd0a810b3b39924446c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:53.829833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4a2d5c87-6cb9-4e06-9eee-8632ef08126a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab096298eba14dd0a810b3b39924446c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:53.830472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4a2d5c87-6cb9-4e06-9eee-8632ef08126a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab096298eba14dd0a810b3b39924446c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:53.857973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4a2d5c87-6cb9-4e06-9eee-8632ef08126a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab096298eba14dd0a810b3b39924446c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:53.888843 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4002/7936] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:02:53 2022] DELETE /identity/v3/users/ab096298eba14dd0a810b3b39924446c => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:53.984831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:54.724066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:02:54.725887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:02:54.744796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9ed97-a0f2-4dd2-96b0-7d0b9c672f12 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:02:54.837160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:02:54.838144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:02:54.838488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:02:54.839014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3 admin admin] PATH_INFO: `/v3/projects/9c5856282bd140b4a3eb230e7936e1eb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:02:54.840985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c5856282bd140b4a3eb230e7936e1eb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:02:54.849028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:02:55.067606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c5856282bd140b4a3eb230e7936e1eb', 'request_id': 'req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:55.083970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c5856282bd140b4a3eb230e7936e1eb', 'request_id': 'req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:55.094259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c5856282bd140b4a3eb230e7936e1eb', 'request_id': 'req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:55.250769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3 admin admin] The token cache is being invalidate because project 9c5856282bd140b4a3eb230e7936e1eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:02:55.251073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:55.251809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:02:55.263247 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3935/7937] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:02:54 2022] DELETE /identity/v3/projects/9c5856282bd140b4a3eb230e7936e1eb => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:02:55.270491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:56.001346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:57.076593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:58.836515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:02:59.099462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:00.031211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:00.254705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:01.293005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:01.436499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:02.447879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:02.835717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:02.904478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:04.024956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:04.934027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:05.382512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:06.321867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:06.497903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d5c87-6cb9-4e06-9eee-8632ef08126a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:06.499895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4a2d5c87-6cb9-4e06-9eee-8632ef08126a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:06.626312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d5c87-6cb9-4e06-9eee-8632ef08126a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:06.717453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee22eb1-6790-492b-a51c-fef3648518b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:06.718325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee22eb1-6790-492b-a51c-fef3648518b2 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:06.718754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee22eb1-6790-492b-a51c-fef3648518b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:06.719109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee22eb1-6790-492b-a51c-fef3648518b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:06.721710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9ee22eb1-6790-492b-a51c-fef3648518b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:06.805899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee22eb1-6790-492b-a51c-fef3648518b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:06.807758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee22eb1-6790-492b-a51c-fef3648518b2 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:06.820611 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4003/7938] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:03:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:03:08.133778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:09.487198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:10.946818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:10.946818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:10.946818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ae9e5-0ed1-456b-b8c6-36f7f4f769e3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:10.949171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ea21d-cff4-40e1-8477-e9f757478471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:10.949171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ea21d-cff4-40e1-8477-e9f757478471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:10.949171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ea21d-cff4-40e1-8477-e9f757478471 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:10.949171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ea21d-cff4-40e1-8477-e9f757478471 admin admin] PATH_INFO: `/v3/users/2cfdad422b8b435388c3112b7b7cf882` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:10.949784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ea21d-cff4-40e1-8477-e9f757478471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cfdad422b8b435388c3112b7b7cf882)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:10.949784 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ea21d-cff4-40e1-8477-e9f757478471 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:11.335539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-979ea21d-cff4-40e1-8477-e9f757478471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cfdad422b8b435388c3112b7b7cf882'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:11.528351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-979ea21d-cff4-40e1-8477-e9f757478471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cfdad422b8b435388c3112b7b7cf882'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:11.529714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-979ea21d-cff4-40e1-8477-e9f757478471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cfdad422b8b435388c3112b7b7cf882'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:11.548776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:INSERT=7,keystone:DELETE=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:11.552155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-979ea21d-cff4-40e1-8477-e9f757478471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cfdad422b8b435388c3112b7b7cf882'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:11.587614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-979ea21d-cff4-40e1-8477-e9f757478471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cfdad422b8b435388c3112b7b7cf882'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:11.610149 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3936/7939] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:03:10 2022] DELETE /identity/v3/users/2cfdad422b8b435388c3112b7b7cf882 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:03:11.951722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee22eb1-6790-492b-a51c-fef3648518b2 service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:11.970158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee22eb1-6790-492b-a51c-fef3648518b2 service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:12.075763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7b10c-9f68-4879-970e-37a070f4a718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:12.076615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7b10c-9f68-4879-970e-37a070f4a718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:12.076898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7b10c-9f68-4879-970e-37a070f4a718 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:12.077170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7b10c-9f68-4879-970e-37a070f4a718 admin admin] PATH_INFO: `/v3/projects/21e0295aae6c49ecb0e8c2d9b7a08b43` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:12.078709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7b10c-9f68-4879-970e-37a070f4a718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21e0295aae6c49ecb0e8c2d9b7a08b43)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:12.080669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7b10c-9f68-4879-970e-37a070f4a718 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:12.365523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c0f7b10c-9f68-4879-970e-37a070f4a718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21e0295aae6c49ecb0e8c2d9b7a08b43', 'request_id': 'req-c0f7b10c-9f68-4879-970e-37a070f4a718'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:12.373261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c0f7b10c-9f68-4879-970e-37a070f4a718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21e0295aae6c49ecb0e8c2d9b7a08b43', 'request_id': 'req-c0f7b10c-9f68-4879-970e-37a070f4a718'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:12.509438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c0f7b10c-9f68-4879-970e-37a070f4a718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21e0295aae6c49ecb0e8c2d9b7a08b43', 'request_id': 'req-c0f7b10c-9f68-4879-970e-37a070f4a718'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:12.525843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:12.548141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c0f7b10c-9f68-4879-970e-37a070f4a718 admin admin] The token cache is being invalidate because project 21e0295aae6c49ecb0e8c2d9b7a08b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:03:12.548141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c0f7b10c-9f68-4879-970e-37a070f4a718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:12.549175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c0f7b10c-9f68-4879-970e-37a070f4a718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:12.558110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ea21d-cff4-40e1-8477-e9f757478471 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:12.558748 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4004/7940] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:11 2022] DELETE /identity/v3/projects/21e0295aae6c49ecb0e8c2d9b7a08b43 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:03:12.561121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-979ea21d-cff4-40e1-8477-e9f757478471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:12.581588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ea21d-cff4-40e1-8477-e9f757478471 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:12.651986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7aa10-c019-442d-b620-ddc270df8b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:12.653017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7aa10-c019-442d-b620-ddc270df8b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:12.653518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7aa10-c019-442d-b620-ddc270df8b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:12.654216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7aa10-c019-442d-b620-ddc270df8b69 admin admin] PATH_INFO: `/v3/users/5adac49ea0ae42ae9e9fd92be1b804ea` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:12.655736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7aa10-c019-442d-b620-ddc270df8b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5adac49ea0ae42ae9e9fd92be1b804ea)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:12.665450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7aa10-c019-442d-b620-ddc270df8b69 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:13.010177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-85d7aa10-c019-442d-b620-ddc270df8b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5adac49ea0ae42ae9e9fd92be1b804ea'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:13.138650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-85d7aa10-c019-442d-b620-ddc270df8b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5adac49ea0ae42ae9e9fd92be1b804ea'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:13.139680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-85d7aa10-c019-442d-b620-ddc270df8b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5adac49ea0ae42ae9e9fd92be1b804ea'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:13.155974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-85d7aa10-c019-442d-b620-ddc270df8b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5adac49ea0ae42ae9e9fd92be1b804ea'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:13.189368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-85d7aa10-c019-442d-b620-ddc270df8b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5adac49ea0ae42ae9e9fd92be1b804ea'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:13.196787 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3937/7941] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:03:12 2022] DELETE /identity/v3/users/5adac49ea0ae42ae9e9fd92be1b804ea => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:03:13.594773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7b10c-9f68-4879-970e-37a070f4a718 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:13.601704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c0f7b10c-9f68-4879-970e-37a070f4a718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:13.629951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7b10c-9f68-4879-970e-37a070f4a718 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:13.698485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:13.706117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbb770-07df-4ce3-9840-e1559b1ae814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:13.707090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbb770-07df-4ce3-9840-e1559b1ae814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:13.710141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbb770-07df-4ce3-9840-e1559b1ae814 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:13.710141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbb770-07df-4ce3-9840-e1559b1ae814 admin admin] PATH_INFO: `/v3/projects/1740a5f20db24a6e93101ca1ad23ac60` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:13.710141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbb770-07df-4ce3-9840-e1559b1ae814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1740a5f20db24a6e93101ca1ad23ac60)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:13.713457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbb770-07df-4ce3-9840-e1559b1ae814 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:13.900955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e3dbb770-07df-4ce3-9840-e1559b1ae814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1740a5f20db24a6e93101ca1ad23ac60', 'request_id': 'req-e3dbb770-07df-4ce3-9840-e1559b1ae814'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:13.907367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e3dbb770-07df-4ce3-9840-e1559b1ae814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1740a5f20db24a6e93101ca1ad23ac60', 'request_id': 'req-e3dbb770-07df-4ce3-9840-e1559b1ae814'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:14.007594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e3dbb770-07df-4ce3-9840-e1559b1ae814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1740a5f20db24a6e93101ca1ad23ac60', 'request_id': 'req-e3dbb770-07df-4ce3-9840-e1559b1ae814'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:14.025740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e3dbb770-07df-4ce3-9840-e1559b1ae814 admin admin] The token cache is being invalidate because project 1740a5f20db24a6e93101ca1ad23ac60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:03:14.026047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e3dbb770-07df-4ce3-9840-e1559b1ae814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:14.027843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e3dbb770-07df-4ce3-9840-e1559b1ae814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:14.036247 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4005/7942] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:13 2022] DELETE /identity/v3/projects/1740a5f20db24a6e93101ca1ad23ac60 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:03:14.037448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b0f03-c88f-47fd-9526-d055694daa9b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:14.038101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b0f03-c88f-47fd-9526-d055694daa9b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:14.038686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b0f03-c88f-47fd-9526-d055694daa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:14.080765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2c3b0f03-c88f-47fd-9526-d055694daa9b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:14.082243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2c3b0f03-c88f-47fd-9526-d055694daa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:14.147405 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3938/7943] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:03:14.155136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6cd91-9ba0-4b3b-9ba3-02c7b1a9a4b0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:14.156625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6cd91-9ba0-4b3b-9ba3-02c7b1a9a4b0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:14.157003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6cd91-9ba0-4b3b-9ba3-02c7b1a9a4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:14.183791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-27e6cd91-9ba0-4b3b-9ba3-02c7b1a9a4b0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:14.189346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-27e6cd91-9ba0-4b3b-9ba3-02c7b1a9a4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:14.211682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b0f03-c88f-47fd-9526-d055694daa9b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:14.212196 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4006/7944] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:03:14.222841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b0f03-c88f-47fd-9526-d055694daa9b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:14.230245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593dc25-6039-498c-8f70-2a9a3cc7413a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:14.230873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593dc25-6039-498c-8f70-2a9a3cc7413a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:14.231157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593dc25-6039-498c-8f70-2a9a3cc7413a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:14.231438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593dc25-6039-498c-8f70-2a9a3cc7413a admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:14.232285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593dc25-6039-498c-8f70-2a9a3cc7413a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:03:14.232558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593dc25-6039-498c-8f70-2a9a3cc7413a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:14.234250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593dc25-6039-498c-8f70-2a9a3cc7413a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:14.262007 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3939/7945] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:03:14.266308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6cd91-9ba0-4b3b-9ba3-02c7b1a9a4b0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:14.279706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6cd91-9ba0-4b3b-9ba3-02c7b1a9a4b0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:14.286182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baea412-63d6-4171-9385-1d63658f234d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:14.287100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baea412-63d6-4171-9385-1d63658f234d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:14.287979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baea412-63d6-4171-9385-1d63658f234d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:14.288356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baea412-63d6-4171-9385-1d63658f234d admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:14.289072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baea412-63d6-4171-9385-1d63658f234d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:14.291658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baea412-63d6-4171-9385-1d63658f234d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:14.406844 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4007/7946] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:03:14 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:03:14.407985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593dc25-6039-498c-8f70-2a9a3cc7413a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:14.418842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593dc25-6039-498c-8f70-2a9a3cc7413a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:14.517760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0a845-f854-4610-8a53-15fba5df804e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:14.519165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0a845-f854-4610-8a53-15fba5df804e admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:14.519998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0a845-f854-4610-8a53-15fba5df804e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:14.520493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0a845-f854-4610-8a53-15fba5df804e admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:14.521814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0a845-f854-4610-8a53-15fba5df804e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:14.525143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0a845-f854-4610-8a53-15fba5df804e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:14.532835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:14.659387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baea412-63d6-4171-9385-1d63658f234d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:14.660639 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3940/7947] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:03:14 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:03:14.673823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baea412-63d6-4171-9385-1d63658f234d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:14.691367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f413914-3d8d-4af4-a490-ec298773bdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:14.691945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f413914-3d8d-4af4-a490-ec298773bdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:14.692281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f413914-3d8d-4af4-a490-ec298773bdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:14.692546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f413914-3d8d-4af4-a490-ec298773bdc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:14.693307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f413914-3d8d-4af4-a490-ec298773bdc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:14.695412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f413914-3d8d-4af4-a490-ec298773bdc1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:14.719961 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4008/7948] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:03:14.721511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0a845-f854-4610-8a53-15fba5df804e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:14.733615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0a845-f854-4610-8a53-15fba5df804e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:14.741725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa9a67-e7be-4a04-980f-fbc84f51ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:14.743231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa9a67-e7be-4a04-980f-fbc84f51ef34 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:14.744198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa9a67-e7be-4a04-980f-fbc84f51ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:14.744772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa9a67-e7be-4a04-980f-fbc84f51ef34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:14.746528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa9a67-e7be-4a04-980f-fbc84f51ef34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:14.749392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa9a67-e7be-4a04-980f-fbc84f51ef34 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:14.775033 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3941/7949] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:03:14.779319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f413914-3d8d-4af4-a490-ec298773bdc1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:14.800354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f413914-3d8d-4af4-a490-ec298773bdc1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:14.807473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafae870-356e-4279-bc5d-ee5d31a3e77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:14.808314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafae870-356e-4279-bc5d-ee5d31a3e77f admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:14.812910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafae870-356e-4279-bc5d-ee5d31a3e77f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:14.812910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafae870-356e-4279-bc5d-ee5d31a3e77f admin admin] PATH_INFO: `/v3/projects/977321b44d2f4525a21a182dda7590c0/users/3597ac8a50ea40e09592beeb8a3cfa71/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:14.838434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafae870-356e-4279-bc5d-ee5d31a3e77f admin admin] RBAC: Authorizing `identity:create_grant(project_id=977321b44d2f4525a21a182dda7590c0, user_id=3597ac8a50ea40e09592beeb8a3cfa71, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:14.842010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafae870-356e-4279-bc5d-ee5d31a3e77f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:14.970285 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4009/7950] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:03:14 2022] PUT /identity/v3/projects/977321b44d2f4525a21a182dda7590c0/users/3597ac8a50ea40e09592beeb8a3cfa71/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:03:14.982319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3caef2-d05d-4e9a-b76d-ff541193984f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:14.982865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3caef2-d05d-4e9a-b76d-ff541193984f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:14.983436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3caef2-d05d-4e9a-b76d-ff541193984f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:15.007084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2b3caef2-d05d-4e9a-b76d-ff541193984f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:15.008609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2b3caef2-d05d-4e9a-b76d-ff541193984f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:15.094889 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3942/7951] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:03:15.106045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafae870-356e-4279-bc5d-ee5d31a3e77f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:15.108307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fafae870-356e-4279-bc5d-ee5d31a3e77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:15.214679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafae870-356e-4279-bc5d-ee5d31a3e77f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:15.219209 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc9c03-95c7-4986-af66-56088f4f4d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:15.219827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc9c03-95c7-4986-af66-56088f4f4d56 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:15.220110 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc9c03-95c7-4986-af66-56088f4f4d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:15.220409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc9c03-95c7-4986-af66-56088f4f4d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:15.231564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc9c03-95c7-4986-af66-56088f4f4d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:15.233308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc9c03-95c7-4986-af66-56088f4f4d56 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:15.245140 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4010/7952] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:03:15.418671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:16.269600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:17.550657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee8950-92ef-4167-9dde-cbe6e3014f8c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:17.552151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee8950-92ef-4167-9dde-cbe6e3014f8c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:17.562524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee8950-92ef-4167-9dde-cbe6e3014f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:17.601377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a8ee8950-92ef-4167-9dde-cbe6e3014f8c None None] MFA Rules not processed for user `3597ac8a50ea40e09592beeb8a3cfa71`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:17.602534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a8ee8950-92ef-4167-9dde-cbe6e3014f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:17.685385 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3943/7953] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:03:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:03:17.697010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc9c03-95c7-4986-af66-56088f4f4d56 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:17.699501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9abc9c03-95c7-4986-af66-56088f4f4d56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:17.803241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc9c03-95c7-4986-af66-56088f4f4d56 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:17.807066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7099a7-5262-45d0-b8c6-13d15fd734e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:17.807685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7099a7-5262-45d0-b8c6-13d15fd734e5 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:17.807963 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7099a7-5262-45d0-b8c6-13d15fd734e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:17.808264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7099a7-5262-45d0-b8c6-13d15fd734e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:17.813160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:17.822929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7099a7-5262-45d0-b8c6-13d15fd734e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:17.822929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7099a7-5262-45d0-b8c6-13d15fd734e5 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:17.841631 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4011/7954] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:03:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:03:18.647646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:20.509333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:20.594913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:22.116133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a30d3c-4e77-46b4-9736-c98afada07d2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:22.117876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a30d3c-4e77-46b4-9736-c98afada07d2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:22.118609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a30d3c-4e77-46b4-9736-c98afada07d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:22.169340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c9a30d3c-4e77-46b4-9736-c98afada07d2 None None] MFA Rules not processed for user `3597ac8a50ea40e09592beeb8a3cfa71`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:22.170881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c9a30d3c-4e77-46b4-9736-c98afada07d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:22.183140 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3944/7955] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:03:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:03:22.328401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:22.585650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b81256-c7e8-41e4-b6f8-9c4f0e4d30bf None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:22.586145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b81256-c7e8-41e4-b6f8-9c4f0e4d30bf None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:22.586602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b81256-c7e8-41e4-b6f8-9c4f0e4d30bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:22.594246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-61b81256-c7e8-41e4-b6f8-9c4f0e4d30bf None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:03:22.594246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:03:22.594246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:03:22.594246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:03:22.594246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:03:22.594246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:03:22.594246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:03:22.594246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:03:22.594246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:03:22.594246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:03:22.594246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:03:22.594246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:03:22.594246 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:03:22.595111 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:03:22.595111 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:03:22.595111 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:03:22.595111 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:03:22.595111 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:03:22.595111 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:03:22.595111 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:03:22.595111 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:03:22.595111 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:03:22.595111 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:03:22.595111 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:03:22.595111 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:03:22.595111 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:03:22.595111 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:03:22.595111 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 05:03:22.598038 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4012/7956] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:03:22 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 18 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 05:03:22.626422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25f778-7cfd-4dd1-b650-744aa6aafdac None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:22.627077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25f778-7cfd-4dd1-b650-744aa6aafdac None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:22.627537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25f778-7cfd-4dd1-b650-744aa6aafdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:22.654211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ce25f778-7cfd-4dd1-b650-744aa6aafdac None None] MFA Rules not processed for user `3597ac8a50ea40e09592beeb8a3cfa71`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:22.655428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ce25f778-7cfd-4dd1-b650-744aa6aafdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:22.664198 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3945/7957] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:03:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:03:22.967156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:23.060993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97b998-4dde-48b7-8de3-d54e82bef94a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:23.061281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97b998-4dde-48b7-8de3-d54e82bef94a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:23.061561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97b998-4dde-48b7-8de3-d54e82bef94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:23.069913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-7a97b998-4dde-48b7-8de3-d54e82bef94a None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:03:23.069913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:03:23.069913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:03:23.069913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:03:23.069913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:03:23.069913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:03:23.069913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:03:23.069913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:03:23.069913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:03:23.069913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:03:23.069913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:03:23.069913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:03:23.069913 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:03:23.070722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:03:23.070722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:03:23.070722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:03:23.070722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:03:23.070722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:03:23.070722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:03:23.070722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:03:23.070722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:03:23.070722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:03:23.070722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:03:23.070722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:03:23.070722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:03:23.070722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:03:23.070722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:03:23.070722 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 05:03:23.116494 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4013/7958] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:03:23 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 42 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:03:24.006991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:24.046803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:24.926874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:25.070184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:26.064376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dc600-8e8e-44a2-8b22-f420a847214f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:26.065502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dc600-8e8e-44a2-8b22-f420a847214f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:26.065947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dc600-8e8e-44a2-8b22-f420a847214f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:26.143254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bb9dc600-8e8e-44a2-8b22-f420a847214f None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:26.144538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bb9dc600-8e8e-44a2-8b22-f420a847214f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:26.222774 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3946/7959] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:03:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:03:26.246736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:26.504128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97b998-4dde-48b7-8de3-d54e82bef94a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:26.506575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7a97b998-4dde-48b7-8de3-d54e82bef94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:26.608109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97b998-4dde-48b7-8de3-d54e82bef94a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:26.613660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6dbd3-9ed5-4d10-b3cc-a1bf3d99f43f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:26.614521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6dbd3-9ed5-4d10-b3cc-a1bf3d99f43f service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:26.614814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6dbd3-9ed5-4d10-b3cc-a1bf3d99f43f service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:26.615938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6dbd3-9ed5-4d10-b3cc-a1bf3d99f43f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:26.626183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6dbd3-9ed5-4d10-b3cc-a1bf3d99f43f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:26.628202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6dbd3-9ed5-4d10-b3cc-a1bf3d99f43f service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:26.641603 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4014/7960] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 05:03:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 05:03:27.247137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:28.137853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dc600-8e8e-44a2-8b22-f420a847214f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:28.140654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bb9dc600-8e8e-44a2-8b22-f420a847214f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:28.175655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dc600-8e8e-44a2-8b22-f420a847214f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:28.195374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d5569-b0f1-4459-b03b-d7f0fbf0eeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:28.196307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d5569-b0f1-4459-b03b-d7f0fbf0eeb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:28.196758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d5569-b0f1-4459-b03b-d7f0fbf0eeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:28.197174 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d5569-b0f1-4459-b03b-d7f0fbf0eeb5 admin admin] PATH_INFO: `/v3/users/1111514ba59b471dbaacb9deaf70547a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:28.198527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d5569-b0f1-4459-b03b-d7f0fbf0eeb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1111514ba59b471dbaacb9deaf70547a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:28.200722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d5569-b0f1-4459-b03b-d7f0fbf0eeb5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:28.315406 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6dbd3-9ed5-4d10-b3cc-a1bf3d99f43f service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:28.316900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dac6dbd3-9ed5-4d10-b3cc-a1bf3d99f43f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:28.343786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6dbd3-9ed5-4d10-b3cc-a1bf3d99f43f service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:28.352452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38cde4-374f-4cb3-b935-bd61f071fdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:28.353716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38cde4-374f-4cb3-b935-bd61f071fdf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:28.374306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38cde4-374f-4cb3-b935-bd61f071fdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:28.374670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38cde4-374f-4cb3-b935-bd61f071fdf2 admin admin] PATH_INFO: `/v3/users/55d87c545d5e4b68aab6ce12650beee6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:28.376745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38cde4-374f-4cb3-b935-bd61f071fdf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d87c545d5e4b68aab6ce12650beee6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:28.378756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38cde4-374f-4cb3-b935-bd61f071fdf2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:28.533478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-556d5569-b0f1-4459-b03b-d7f0fbf0eeb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1111514ba59b471dbaacb9deaf70547a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:28.550193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:28.651914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-556d5569-b0f1-4459-b03b-d7f0fbf0eeb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1111514ba59b471dbaacb9deaf70547a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:28.652780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-556d5569-b0f1-4459-b03b-d7f0fbf0eeb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1111514ba59b471dbaacb9deaf70547a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:28.666534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-556d5569-b0f1-4459-b03b-d7f0fbf0eeb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1111514ba59b471dbaacb9deaf70547a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:28.731990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-556d5569-b0f1-4459-b03b-d7f0fbf0eeb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1111514ba59b471dbaacb9deaf70547a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:28.732432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9e38cde4-374f-4cb3-b935-bd61f071fdf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d87c545d5e4b68aab6ce12650beee6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:28.732432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9e38cde4-374f-4cb3-b935-bd61f071fdf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d87c545d5e4b68aab6ce12650beee6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:28.732586 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3947/7961] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:03:28 2022] DELETE /identity/v3/users/1111514ba59b471dbaacb9deaf70547a => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:03:28.737064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e74d-ff45-4af2-b225-8afa96e3f81b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:28.738157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e74d-ff45-4af2-b225-8afa96e3f81b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:28.739710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e74d-ff45-4af2-b225-8afa96e3f81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:28.778513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d7c6e74d-ff45-4af2-b225-8afa96e3f81b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:28.778513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d7c6e74d-ff45-4af2-b225-8afa96e3f81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:28.863358 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3948/7962] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:03:28.876787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9e38cde4-374f-4cb3-b935-bd61f071fdf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d87c545d5e4b68aab6ce12650beee6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:28.879156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9e38cde4-374f-4cb3-b935-bd61f071fdf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d87c545d5e4b68aab6ce12650beee6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:28.888069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6e74d-ff45-4af2-b225-8afa96e3f81b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:28.892712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d7c6e74d-ff45-4af2-b225-8afa96e3f81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:28.898450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-9e38cde4-374f-4cb3-b935-bd61f071fdf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d87c545d5e4b68aab6ce12650beee6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:28.914652 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4015/7963] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:03:28 2022] DELETE /identity/v3/users/55d87c545d5e4b68aab6ce12650beee6 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:03:28.919856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a2f48-151f-4c91-9d5a-b0926749e563 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:28.920539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a2f48-151f-4c91-9d5a-b0926749e563 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:28.922619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a2f48-151f-4c91-9d5a-b0926749e563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:28.974988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-424a2f48-151f-4c91-9d5a-b0926749e563 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:28.976608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-424a2f48-151f-4c91-9d5a-b0926749e563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:29.040341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6e74d-ff45-4af2-b225-8afa96e3f81b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:29.148844 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4016/7964] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:03:29.159519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a2f48-151f-4c91-9d5a-b0926749e563 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:29.161258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-424a2f48-151f-4c91-9d5a-b0926749e563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:29.180026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc2fe3-2d4c-4642-bd06-e51009ae5287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:29.184945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc2fe3-2d4c-4642-bd06-e51009ae5287 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:29.185387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc2fe3-2d4c-4642-bd06-e51009ae5287 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:29.191850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc2fe3-2d4c-4642-bd06-e51009ae5287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:29.191850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f1dc2fe3-2d4c-4642-bd06-e51009ae5287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:29.215325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc2fe3-2d4c-4642-bd06-e51009ae5287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:29.217035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc2fe3-2d4c-4642-bd06-e51009ae5287 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:29.232220 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3949/7965] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:03:29.298204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a2f48-151f-4c91-9d5a-b0926749e563 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:29.309821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d4533-1a8d-4bf7-b3f8-af1cc7abdc51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:29.310710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d4533-1a8d-4bf7-b3f8-af1cc7abdc51 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:29.311214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d4533-1a8d-4bf7-b3f8-af1cc7abdc51 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:29.311624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d4533-1a8d-4bf7-b3f8-af1cc7abdc51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:29.334643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d4533-1a8d-4bf7-b3f8-af1cc7abdc51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:29.337067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d4533-1a8d-4bf7-b3f8-af1cc7abdc51 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:29.365439 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4017/7966] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:03:29.777668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:30.168800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc2fe3-2d4c-4642-bd06-e51009ae5287 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:30.170251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f1dc2fe3-2d4c-4642-bd06-e51009ae5287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:30.209299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc2fe3-2d4c-4642-bd06-e51009ae5287 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:30.230013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa707c93-296f-4b65-8bfe-2baab7a0b294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:30.234075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa707c93-296f-4b65-8bfe-2baab7a0b294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:30.234932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa707c93-296f-4b65-8bfe-2baab7a0b294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:30.235382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa707c93-296f-4b65-8bfe-2baab7a0b294 admin admin] PATH_INFO: `/v3/projects/dde2503c541146e99a98caf08e09e1fa` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:30.245974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa707c93-296f-4b65-8bfe-2baab7a0b294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde2503c541146e99a98caf08e09e1fa)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:30.256236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa707c93-296f-4b65-8bfe-2baab7a0b294 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:30.306193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d4533-1a8d-4bf7-b3f8-af1cc7abdc51 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:30.307836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-234d4533-1a8d-4bf7-b3f8-af1cc7abdc51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:30.334547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d4533-1a8d-4bf7-b3f8-af1cc7abdc51 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:30.339773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:30.341241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:30.341777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:30.342234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e admin admin] PATH_INFO: `/v3/projects/c0140c0de7974e20893bd0e32b93e30e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:30.344322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0140c0de7974e20893bd0e32b93e30e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:30.346683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:30.490283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:30.498832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aa707c93-296f-4b65-8bfe-2baab7a0b294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde2503c541146e99a98caf08e09e1fa', 'request_id': 'req-aa707c93-296f-4b65-8bfe-2baab7a0b294'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:30.501865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0140c0de7974e20893bd0e32b93e30e', 'request_id': 'req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:30.509299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aa707c93-296f-4b65-8bfe-2baab7a0b294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde2503c541146e99a98caf08e09e1fa', 'request_id': 'req-aa707c93-296f-4b65-8bfe-2baab7a0b294'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:30.518897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0140c0de7974e20893bd0e32b93e30e', 'request_id': 'req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:30.519949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aa707c93-296f-4b65-8bfe-2baab7a0b294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde2503c541146e99a98caf08e09e1fa', 'request_id': 'req-aa707c93-296f-4b65-8bfe-2baab7a0b294'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:30.617882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0140c0de7974e20893bd0e32b93e30e', 'request_id': 'req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:30.639217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e admin admin] The token cache is being invalidate because project c0140c0de7974e20893bd0e32b93e30e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:03:30.642949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:30.644900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:30.648452 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4018/7967] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:30 2022] DELETE /identity/v3/projects/c0140c0de7974e20893bd0e32b93e30e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:03:30.655802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:30.662783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:30.694513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aa707c93-296f-4b65-8bfe-2baab7a0b294 admin admin] The token cache is being invalidate because project dde2503c541146e99a98caf08e09e1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:03:30.695053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aa707c93-296f-4b65-8bfe-2baab7a0b294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:30.697137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-aa707c93-296f-4b65-8bfe-2baab7a0b294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:30.701401 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3950/7968] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:30 2022] DELETE /identity/v3/projects/dde2503c541146e99a98caf08e09e1fa => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:03:30.702658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa707c93-296f-4b65-8bfe-2baab7a0b294 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:30.705260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aa707c93-296f-4b65-8bfe-2baab7a0b294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:30.825480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa707c93-296f-4b65-8bfe-2baab7a0b294 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:30.845640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a98f0a-f23b-4e8a-a54e-8ea3147808a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:30.849291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbe6c4-ffed-43af-a795-79ab2bf5b53e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:30.849740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a98f0a-f23b-4e8a-a54e-8ea3147808a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:30.850547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a98f0a-f23b-4e8a-a54e-8ea3147808a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:30.852376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a98f0a-f23b-4e8a-a54e-8ea3147808a2 admin admin] PATH_INFO: `/v3/users/5b770650f0d844b598ab1d144b5d933c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:30.856593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a98f0a-f23b-4e8a-a54e-8ea3147808a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b770650f0d844b598ab1d144b5d933c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:30.861758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a98f0a-f23b-4e8a-a54e-8ea3147808a2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:30.862965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29068539-883f-4f7c-a92d-0ed4e5a86367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:30.865387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068539-883f-4f7c-a92d-0ed4e5a86367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:30.865700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068539-883f-4f7c-a92d-0ed4e5a86367 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:30.865947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068539-883f-4f7c-a92d-0ed4e5a86367 admin admin] PATH_INFO: `/v3/users/d4162d7b442e44d18f3bf204f02ed00b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:30.869148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29068539-883f-4f7c-a92d-0ed4e5a86367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4162d7b442e44d18f3bf204f02ed00b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:30.891077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29068539-883f-4f7c-a92d-0ed4e5a86367 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:31.292421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-29068539-883f-4f7c-a92d-0ed4e5a86367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4162d7b442e44d18f3bf204f02ed00b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:31.293131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-29068539-883f-4f7c-a92d-0ed4e5a86367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4162d7b442e44d18f3bf204f02ed00b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:31.307817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-89a98f0a-f23b-4e8a-a54e-8ea3147808a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b770650f0d844b598ab1d144b5d933c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:31.532410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-29068539-883f-4f7c-a92d-0ed4e5a86367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4162d7b442e44d18f3bf204f02ed00b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:31.533751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-29068539-883f-4f7c-a92d-0ed4e5a86367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4162d7b442e44d18f3bf204f02ed00b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:31.555495 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-29068539-883f-4f7c-a92d-0ed4e5a86367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4162d7b442e44d18f3bf204f02ed00b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:31.570777 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4019/7969] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:03:30 2022] DELETE /identity/v3/users/d4162d7b442e44d18f3bf204f02ed00b => generated 0 bytes in 915 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:03:31.704300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-89a98f0a-f23b-4e8a-a54e-8ea3147808a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b770650f0d844b598ab1d144b5d933c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:31.706638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-89a98f0a-f23b-4e8a-a54e-8ea3147808a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b770650f0d844b598ab1d144b5d933c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:31.748651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-89a98f0a-f23b-4e8a-a54e-8ea3147808a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b770650f0d844b598ab1d144b5d933c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:31.805064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-89a98f0a-f23b-4e8a-a54e-8ea3147808a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b770650f0d844b598ab1d144b5d933c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:31.822362 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3951/7970] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:03:30 2022] DELETE /identity/v3/users/5b770650f0d844b598ab1d144b5d933c => generated 0 bytes in 1120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:03:31.880991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:32.680051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29068539-883f-4f7c-a92d-0ed4e5a86367 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:32.682982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-29068539-883f-4f7c-a92d-0ed4e5a86367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:32.796475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29068539-883f-4f7c-a92d-0ed4e5a86367 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:32.872656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1134c5-3039-4f30-9b25-7bf693f00251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:32.873659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1134c5-3039-4f30-9b25-7bf693f00251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:32.881868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1134c5-3039-4f30-9b25-7bf693f00251 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:32.881868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1134c5-3039-4f30-9b25-7bf693f00251 admin admin] PATH_INFO: `/v3/projects/0035900145f2454bac3b88a7c32f5615` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:32.881868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1134c5-3039-4f30-9b25-7bf693f00251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0035900145f2454bac3b88a7c32f5615)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:32.881868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1134c5-3039-4f30-9b25-7bf693f00251 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:33.049246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a98f0a-f23b-4e8a-a54e-8ea3147808a2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:33.051469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-89a98f0a-f23b-4e8a-a54e-8ea3147808a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:33.116320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a98f0a-f23b-4e8a-a54e-8ea3147808a2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:33.123868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447dbd8-05b4-427d-9068-a25f74ee3829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:33.125697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447dbd8-05b4-427d-9068-a25f74ee3829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:33.126278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447dbd8-05b4-427d-9068-a25f74ee3829 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:33.126759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447dbd8-05b4-427d-9068-a25f74ee3829 admin admin] PATH_INFO: `/v3/projects/6fcdd65876ff4057be9b48a2d4b8131b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:33.129031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447dbd8-05b4-427d-9068-a25f74ee3829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fcdd65876ff4057be9b48a2d4b8131b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:33.131878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447dbd8-05b4-427d-9068-a25f74ee3829 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:33.274099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0a1134c5-3039-4f30-9b25-7bf693f00251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0035900145f2454bac3b88a7c32f5615', 'request_id': 'req-0a1134c5-3039-4f30-9b25-7bf693f00251'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:33.303554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0a1134c5-3039-4f30-9b25-7bf693f00251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0035900145f2454bac3b88a7c32f5615', 'request_id': 'req-0a1134c5-3039-4f30-9b25-7bf693f00251'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:33.359094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4447dbd8-05b4-427d-9068-a25f74ee3829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fcdd65876ff4057be9b48a2d4b8131b', 'request_id': 'req-4447dbd8-05b4-427d-9068-a25f74ee3829'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:33.365158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4447dbd8-05b4-427d-9068-a25f74ee3829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fcdd65876ff4057be9b48a2d4b8131b', 'request_id': 'req-4447dbd8-05b4-427d-9068-a25f74ee3829'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:33.372508 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4447dbd8-05b4-427d-9068-a25f74ee3829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fcdd65876ff4057be9b48a2d4b8131b', 'request_id': 'req-4447dbd8-05b4-427d-9068-a25f74ee3829'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:33.457891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0a1134c5-3039-4f30-9b25-7bf693f00251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0035900145f2454bac3b88a7c32f5615', 'request_id': 'req-0a1134c5-3039-4f30-9b25-7bf693f00251'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:33.485138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0a1134c5-3039-4f30-9b25-7bf693f00251 admin admin] The token cache is being invalidate because project 0035900145f2454bac3b88a7c32f5615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:03:33.485512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0a1134c5-3039-4f30-9b25-7bf693f00251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:33.486689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0a1134c5-3039-4f30-9b25-7bf693f00251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:33.493335 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4020/7971] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:32 2022] DELETE /identity/v3/projects/0035900145f2454bac3b88a7c32f5615 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:03:33.494938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b514df-c38b-43b2-9e63-af37d7a064cc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:33.495311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b514df-c38b-43b2-9e63-af37d7a064cc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:33.495662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b514df-c38b-43b2-9e63-af37d7a064cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:33.523973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-82b514df-c38b-43b2-9e63-af37d7a064cc None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:33.526596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-82b514df-c38b-43b2-9e63-af37d7a064cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:33.594654 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4021/7972] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:03:33.604416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ae01f-c9e8-4257-a2ff-b52a042edb6b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:33.604704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ae01f-c9e8-4257-a2ff-b52a042edb6b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:33.605011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ae01f-c9e8-4257-a2ff-b52a042edb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:33.624287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-968ae01f-c9e8-4257-a2ff-b52a042edb6b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:33.625423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-968ae01f-c9e8-4257-a2ff-b52a042edb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:33.633384 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4022/7973] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:03:33.637555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ae01f-c9e8-4257-a2ff-b52a042edb6b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:33.647821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ae01f-c9e8-4257-a2ff-b52a042edb6b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:33.652830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26cae4-7d71-4781-b18d-d1d3b5f78bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:33.667233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26cae4-7d71-4781-b18d-d1d3b5f78bda admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:33.667233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26cae4-7d71-4781-b18d-d1d3b5f78bda admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:33.667233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26cae4-7d71-4781-b18d-d1d3b5f78bda admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:33.667233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26cae4-7d71-4781-b18d-d1d3b5f78bda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:03:33.667233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26cae4-7d71-4781-b18d-d1d3b5f78bda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:33.667233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26cae4-7d71-4781-b18d-d1d3b5f78bda admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:33.673248 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4023/7974] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:03:33.677004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26cae4-7d71-4781-b18d-d1d3b5f78bda admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:33.688141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26cae4-7d71-4781-b18d-d1d3b5f78bda admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:33.698552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cba32c-a058-433c-9e6c-fcb92d780fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:33.701537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cba32c-a058-433c-9e6c-fcb92d780fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:33.704092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cba32c-a058-433c-9e6c-fcb92d780fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:33.704931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cba32c-a058-433c-9e6c-fcb92d780fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:33.706700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cba32c-a058-433c-9e6c-fcb92d780fb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:33.717389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cba32c-a058-433c-9e6c-fcb92d780fb0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:33.800671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4447dbd8-05b4-427d-9068-a25f74ee3829 admin admin] The token cache is being invalidate because project 6fcdd65876ff4057be9b48a2d4b8131b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:03:33.801210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4447dbd8-05b4-427d-9068-a25f74ee3829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:33.803141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4447dbd8-05b4-427d-9068-a25f74ee3829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:03:33.805020 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3952/7975] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:03:33 2022] DELETE /identity/v3/projects/6fcdd65876ff4057be9b48a2d4b8131b => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:03:33.811883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c169-4e22-4128-b96b-e5733444cdc8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:33.812480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c169-4e22-4128-b96b-e5733444cdc8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:33.812960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c169-4e22-4128-b96b-e5733444cdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:33.854266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2943c169-4e22-4128-b96b-e5733444cdc8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:33.855645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2943c169-4e22-4128-b96b-e5733444cdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:33.864850 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3953/7976] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:03:33.872618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a013881-ceeb-4932-ab86-588f41d584a7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:33.873056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a013881-ceeb-4932-ab86-588f41d584a7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:33.873425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a013881-ceeb-4932-ab86-588f41d584a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:33.919446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0a013881-ceeb-4932-ab86-588f41d584a7 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:33.919446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0a013881-ceeb-4932-ab86-588f41d584a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:33.919446 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3954/7977] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:03:33.922250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a013881-ceeb-4932-ab86-588f41d584a7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:33.931563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a013881-ceeb-4932-ab86-588f41d584a7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:33.937521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af635a-09fa-44ad-bb9d-a7487a1aac4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:33.938273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af635a-09fa-44ad-bb9d-a7487a1aac4d admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:33.938626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af635a-09fa-44ad-bb9d-a7487a1aac4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:33.938974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af635a-09fa-44ad-bb9d-a7487a1aac4d admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:33.939700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af635a-09fa-44ad-bb9d-a7487a1aac4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:03:33.940080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af635a-09fa-44ad-bb9d-a7487a1aac4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:33.941855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af635a-09fa-44ad-bb9d-a7487a1aac4d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:33.955409 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3955/7978] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:03:33.965326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af635a-09fa-44ad-bb9d-a7487a1aac4d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:33.983557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af635a-09fa-44ad-bb9d-a7487a1aac4d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:33.993814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c470ac-6aa6-4aa7-85a1-559e5d78b4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:33.994686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c470ac-6aa6-4aa7-85a1-559e5d78b4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:33.995081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c470ac-6aa6-4aa7-85a1-559e5d78b4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:33.995484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c470ac-6aa6-4aa7-85a1-559e5d78b4a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:33.996585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c470ac-6aa6-4aa7-85a1-559e5d78b4a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:33.998789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c470ac-6aa6-4aa7-85a1-559e5d78b4a3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:34.023850 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4024/7979] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:03:33 2022] POST /identity/v3/projects => generated 387 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:03:34.027160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cba32c-a058-433c-9e6c-fcb92d780fb0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:34.029761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-83cba32c-a058-433c-9e6c-fcb92d780fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:34.135859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cba32c-a058-433c-9e6c-fcb92d780fb0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:34.142208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd28227-df76-4fc2-9b39-45424461175f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:34.142994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd28227-df76-4fc2-9b39-45424461175f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:34.143281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd28227-df76-4fc2-9b39-45424461175f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:34.143558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd28227-df76-4fc2-9b39-45424461175f admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:34.144423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd28227-df76-4fc2-9b39-45424461175f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:34.147577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd28227-df76-4fc2-9b39-45424461175f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:34.217389 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3956/7980] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:03:33 2022] POST /identity/v3/projects => generated 377 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:03:34.220934 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c470ac-6aa6-4aa7-85a1-559e5d78b4a3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:34.370013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c470ac-6aa6-4aa7-85a1-559e5d78b4a3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:34.375482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2409bc5-b7d0-489c-99b2-53222b8971ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:34.376224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2409bc5-b7d0-489c-99b2-53222b8971ad admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:34.376642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2409bc5-b7d0-489c-99b2-53222b8971ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:34.377010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2409bc5-b7d0-489c-99b2-53222b8971ad admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:34.377755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2409bc5-b7d0-489c-99b2-53222b8971ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:34.379845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2409bc5-b7d0-489c-99b2-53222b8971ad admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:34.408219 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4025/7981] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:03:34 2022] POST /identity/v3/users => generated 294 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:03:34.410638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd28227-df76-4fc2-9b39-45424461175f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:34.421020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd28227-df76-4fc2-9b39-45424461175f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:34.425734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246b129-6430-41de-8679-546d1090fa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:34.426365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246b129-6430-41de-8679-546d1090fa61 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:34.426679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246b129-6430-41de-8679-546d1090fa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:34.426940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246b129-6430-41de-8679-546d1090fa61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:34.427621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246b129-6430-41de-8679-546d1090fa61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:34.429243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246b129-6430-41de-8679-546d1090fa61 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:34.439029 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4026/7982] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:03:34.442723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246b129-6430-41de-8679-546d1090fa61 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:34.452040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246b129-6430-41de-8679-546d1090fa61 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:34.467655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066d06d-140b-4f9f-8ebc-87e52b3529a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:34.467655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066d06d-140b-4f9f-8ebc-87e52b3529a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:34.467655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066d06d-140b-4f9f-8ebc-87e52b3529a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:34.467655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066d06d-140b-4f9f-8ebc-87e52b3529a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:34.468146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066d06d-140b-4f9f-8ebc-87e52b3529a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:34.468146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066d06d-140b-4f9f-8ebc-87e52b3529a8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:34.474101 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4027/7983] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:03:34.481487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066d06d-140b-4f9f-8ebc-87e52b3529a8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:34.492448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066d06d-140b-4f9f-8ebc-87e52b3529a8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:34.497736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099c25d-1d05-4d13-9707-5fd57f722a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:34.498290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099c25d-1d05-4d13-9707-5fd57f722a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:34.498576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099c25d-1d05-4d13-9707-5fd57f722a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:34.498854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099c25d-1d05-4d13-9707-5fd57f722a75 admin admin] PATH_INFO: `/v3/projects/b6658e2d58a8453db08d2e36fbc30d1d/users/9693349da5f341deae2657b8b01fd199/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:34.542416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099c25d-1d05-4d13-9707-5fd57f722a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6658e2d58a8453db08d2e36fbc30d1d, user_id=9693349da5f341deae2657b8b01fd199, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:34.545287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099c25d-1d05-4d13-9707-5fd57f722a75 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:34.674581 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3957/7984] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:03:34 2022] POST /identity/v3/users => generated 289 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:03:34.679077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2409bc5-b7d0-489c-99b2-53222b8971ad admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:34.689395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2409bc5-b7d0-489c-99b2-53222b8971ad admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:34.694726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e50cbd-6bcb-4c26-9413-4703136074b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:34.695443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e50cbd-6bcb-4c26-9413-4703136074b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:34.695731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e50cbd-6bcb-4c26-9413-4703136074b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:34.696007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e50cbd-6bcb-4c26-9413-4703136074b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:34.696694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e50cbd-6bcb-4c26-9413-4703136074b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:34.698407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e50cbd-6bcb-4c26-9413-4703136074b4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:34.710270 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3958/7985] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:03:34.713772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e50cbd-6bcb-4c26-9413-4703136074b4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:34.732332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e50cbd-6bcb-4c26-9413-4703136074b4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:34.735025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7c34e-2466-4bc8-ae69-ab5a435c7579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:34.735706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7c34e-2466-4bc8-ae69-ab5a435c7579 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:34.736052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7c34e-2466-4bc8-ae69-ab5a435c7579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:34.736429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7c34e-2466-4bc8-ae69-ab5a435c7579 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:34.737140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7c34e-2466-4bc8-ae69-ab5a435c7579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:34.738820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7c34e-2466-4bc8-ae69-ab5a435c7579 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:34.754279 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3959/7986] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:03:34.756004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7c34e-2466-4bc8-ae69-ab5a435c7579 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:34.775150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7c34e-2466-4bc8-ae69-ab5a435c7579 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:34.782475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1397ad-c057-49d5-9dc8-9845509e1b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:34.783249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1397ad-c057-49d5-9dc8-9845509e1b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:34.783662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1397ad-c057-49d5-9dc8-9845509e1b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:34.784033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1397ad-c057-49d5-9dc8-9845509e1b75 admin admin] PATH_INFO: `/v3/projects/a6a8c4f80a6a4466ba1342d7b8ffc2c4/users/d0e3f1091bb9467e9964ccdd60c53ee9/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:34.807502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1397ad-c057-49d5-9dc8-9845509e1b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a8c4f80a6a4466ba1342d7b8ffc2c4, user_id=d0e3f1091bb9467e9964ccdd60c53ee9, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:34.812512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1397ad-c057-49d5-9dc8-9845509e1b75 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:34.822847 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:34.829261 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4028/7987] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:03:34 2022] PUT /identity/v3/projects/b6658e2d58a8453db08d2e36fbc30d1d/users/9693349da5f341deae2657b8b01fd199/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:03:34.850574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaec7b-93cb-4dbe-955a-8d84a0eb316a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:34.850862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaec7b-93cb-4dbe-955a-8d84a0eb316a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:34.851141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaec7b-93cb-4dbe-955a-8d84a0eb316a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:34.913140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-64aaec7b-93cb-4dbe-955a-8d84a0eb316a None None] MFA Rules not processed for user `9693349da5f341deae2657b8b01fd199`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:34.914514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-64aaec7b-93cb-4dbe-955a-8d84a0eb316a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:35.065517 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4029/7988] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:03:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:03:35.072422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaec7b-93cb-4dbe-955a-8d84a0eb316a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:35.117094 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3960/7989] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:03:34 2022] PUT /identity/v3/projects/a6a8c4f80a6a4466ba1342d7b8ffc2c4/users/d0e3f1091bb9467e9964ccdd60c53ee9/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:03:35.127670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b01b5-1690-4436-bfce-e61949d20afa None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:35.127952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b01b5-1690-4436-bfce-e61949d20afa None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:35.128274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b01b5-1690-4436-bfce-e61949d20afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:35.207319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaec7b-93cb-4dbe-955a-8d84a0eb316a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:35.236879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ee5b01b5-1690-4436-bfce-e61949d20afa None None] MFA Rules not processed for user `d0e3f1091bb9467e9964ccdd60c53ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:35.238341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ee5b01b5-1690-4436-bfce-e61949d20afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:35.323490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d2420-9bd6-420f-a259-c0dc8538dba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:35.324116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d2420-9bd6-420f-a259-c0dc8538dba6 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:35.324426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d2420-9bd6-420f-a259-c0dc8538dba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:35.324700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d2420-9bd6-420f-a259-c0dc8538dba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:35.325338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d2420-9bd6-420f-a259-c0dc8538dba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:35.328055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d2420-9bd6-420f-a259-c0dc8538dba6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:35.372121 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3961/7990] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:03:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:03:35.372121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b01b5-1690-4436-bfce-e61949d20afa None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:35.372121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b01b5-1690-4436-bfce-e61949d20afa None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:35.372121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621a0e1-4757-4386-ae09-a5b8db98b487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:35.372716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621a0e1-4757-4386-ae09-a5b8db98b487 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:35.372716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621a0e1-4757-4386-ae09-a5b8db98b487 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:35.372716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621a0e1-4757-4386-ae09-a5b8db98b487 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:35.372716 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621a0e1-4757-4386-ae09-a5b8db98b487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:35.374536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621a0e1-4757-4386-ae09-a5b8db98b487 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:35.669800 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4030/7991] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:03:35 2022] POST /identity/v3/projects => generated 387 bytes in 599 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:03:35.686321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d2420-9bd6-420f-a259-c0dc8538dba6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:35.763179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d2420-9bd6-420f-a259-c0dc8538dba6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:35.769414 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3962/7992] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:03:35 2022] POST /identity/v3/projects => generated 375 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:03:35.774384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621a0e1-4757-4386-ae09-a5b8db98b487 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:35.839728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b17b32-1648-405d-85f6-ce927ae4f47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:35.840367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b17b32-1648-405d-85f6-ce927ae4f47f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:35.840678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b17b32-1648-405d-85f6-ce927ae4f47f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:35.840940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b17b32-1648-405d-85f6-ce927ae4f47f admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:35.841725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b17b32-1648-405d-85f6-ce927ae4f47f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:35.843772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b17b32-1648-405d-85f6-ce927ae4f47f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:35.856026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621a0e1-4757-4386-ae09-a5b8db98b487 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:35.865162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72263941-493d-4fa1-9557-0f3a083e2e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:35.870366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72263941-493d-4fa1-9557-0f3a083e2e72 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:35.873796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72263941-493d-4fa1-9557-0f3a083e2e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:35.875845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72263941-493d-4fa1-9557-0f3a083e2e72 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:35.877626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72263941-493d-4fa1-9557-0f3a083e2e72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:35.884271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72263941-493d-4fa1-9557-0f3a083e2e72 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:36.101957 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4031/7993] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:03:35 2022] POST /identity/v3/users => generated 294 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:03:36.103096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b17b32-1648-405d-85f6-ce927ae4f47f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:36.113803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b17b32-1648-405d-85f6-ce927ae4f47f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:36.118662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfc2c3-19a2-44d7-96d2-1d153e09fbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:36.119273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfc2c3-19a2-44d7-96d2-1d153e09fbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:36.119553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfc2c3-19a2-44d7-96d2-1d153e09fbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:36.119835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfc2c3-19a2-44d7-96d2-1d153e09fbf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:36.120520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfc2c3-19a2-44d7-96d2-1d153e09fbf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:36.122128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfc2c3-19a2-44d7-96d2-1d153e09fbf9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:36.135494 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4032/7994] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:03:36.139237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfc2c3-19a2-44d7-96d2-1d153e09fbf9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:36.149520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfc2c3-19a2-44d7-96d2-1d153e09fbf9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:36.154313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c3465-4bda-4c55-95da-787df41d13fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:36.154890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c3465-4bda-4c55-95da-787df41d13fe admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:36.155171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c3465-4bda-4c55-95da-787df41d13fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:36.155443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c3465-4bda-4c55-95da-787df41d13fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:36.156072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c3465-4bda-4c55-95da-787df41d13fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:36.157726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c3465-4bda-4c55-95da-787df41d13fe admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:36.168991 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4033/7995] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:03:36.173020 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c3465-4bda-4c55-95da-787df41d13fe admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:36.182474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c3465-4bda-4c55-95da-787df41d13fe admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:36.187075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec4b6c-dae9-410e-92bd-d34137a81bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:36.187715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec4b6c-dae9-410e-92bd-d34137a81bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:36.194272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec4b6c-dae9-410e-92bd-d34137a81bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:36.194272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec4b6c-dae9-410e-92bd-d34137a81bfc admin admin] PATH_INFO: `/v3/projects/6bd8d446faec44389f26fc9bab636bf0/users/8241ebb72f3b40b4ba9004f63d03e7b5/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:36.201721 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3963/7996] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:03:35 2022] POST /identity/v3/users => generated 294 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:03:36.204412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec4b6c-dae9-410e-92bd-d34137a81bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd8d446faec44389f26fc9bab636bf0, user_id=8241ebb72f3b40b4ba9004f63d03e7b5, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:36.205925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72263941-493d-4fa1-9557-0f3a083e2e72 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:36.207087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec4b6c-dae9-410e-92bd-d34137a81bfc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:36.217562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72263941-493d-4fa1-9557-0f3a083e2e72 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:36.222088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b07ba-4c7d-45b2-b663-4dc0ae4c2740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:36.222675 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b07ba-4c7d-45b2-b663-4dc0ae4c2740 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:36.222951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b07ba-4c7d-45b2-b663-4dc0ae4c2740 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:36.223221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b07ba-4c7d-45b2-b663-4dc0ae4c2740 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:36.223881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b07ba-4c7d-45b2-b663-4dc0ae4c2740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:36.225514 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b07ba-4c7d-45b2-b663-4dc0ae4c2740 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:36.236302 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3964/7997] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:03:36.254566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b07ba-4c7d-45b2-b663-4dc0ae4c2740 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:36.266539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b07ba-4c7d-45b2-b663-4dc0ae4c2740 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:36.274764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc391b-b515-4abd-a202-6b899f9da94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:36.275551 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc391b-b515-4abd-a202-6b899f9da94c admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:36.275905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc391b-b515-4abd-a202-6b899f9da94c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:36.276339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc391b-b515-4abd-a202-6b899f9da94c admin admin] PATH_INFO: `/v3/projects/1b91f57cf66644c080587785dc34d070/users/7dd53571a18e44a29f12ad9a1b375210/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:36.299519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc391b-b515-4abd-a202-6b899f9da94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b91f57cf66644c080587785dc34d070, user_id=7dd53571a18e44a29f12ad9a1b375210, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:36.302969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc391b-b515-4abd-a202-6b899f9da94c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:36.532698 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3965/7999] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:03:36 2022] PUT /identity/v3/projects/1b91f57cf66644c080587785dc34d070/users/7dd53571a18e44a29f12ad9a1b375210/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:03:36.532874 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4034/7999] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:03:36 2022] PUT /identity/v3/projects/6bd8d446faec44389f26fc9bab636bf0/users/8241ebb72f3b40b4ba9004f63d03e7b5/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:03:36.537942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc391b-b515-4abd-a202-6b899f9da94c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:36.543025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba03ed-3215-4b54-bb21-ebd249545495 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:36.543314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba03ed-3215-4b54-bb21-ebd249545495 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:36.543735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba03ed-3215-4b54-bb21-ebd249545495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:36.572561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ecba03ed-3215-4b54-bb21-ebd249545495 None None] MFA Rules not processed for user `8241ebb72f3b40b4ba9004f63d03e7b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:36.573909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ecba03ed-3215-4b54-bb21-ebd249545495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:36.577546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:36.657413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc391b-b515-4abd-a202-6b899f9da94c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:36.666309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80251d-e96e-4d1d-8faf-d286d7d8ba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:36.666937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80251d-e96e-4d1d-8faf-d286d7d8ba62 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:36.667222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80251d-e96e-4d1d-8faf-d286d7d8ba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:36.667535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80251d-e96e-4d1d-8faf-d286d7d8ba62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:36.669347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80251d-e96e-4d1d-8faf-d286d7d8ba62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:36.671555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80251d-e96e-4d1d-8faf-d286d7d8ba62 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:36.683196 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4035/8000] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:03:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:03:36.684208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba03ed-3215-4b54-bb21-ebd249545495 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:36.696242 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba03ed-3215-4b54-bb21-ebd249545495 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:36.699992 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3966/8001] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:03:36.703722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80251d-e96e-4d1d-8faf-d286d7d8ba62 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:36.705948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e7f5e-a66e-4f0a-b613-d03c63b8a233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:36.706561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e7f5e-a66e-4f0a-b613-d03c63b8a233 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:36.706840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e7f5e-a66e-4f0a-b613-d03c63b8a233 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:36.707114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e7f5e-a66e-4f0a-b613-d03c63b8a233 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:36.707761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e7f5e-a66e-4f0a-b613-d03c63b8a233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:36.710320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e7f5e-a66e-4f0a-b613-d03c63b8a233 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:36.717199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80251d-e96e-4d1d-8faf-d286d7d8ba62 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:36.723780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134d4cd-d7c1-482c-bd7d-03688ae29f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:36.724682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134d4cd-d7c1-482c-bd7d-03688ae29f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:36.725062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134d4cd-d7c1-482c-bd7d-03688ae29f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:36.725413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134d4cd-d7c1-482c-bd7d-03688ae29f23 admin admin] PATH_INFO: `/v3/projects/1b91f57cf66644c080587785dc34d070/users/7dd53571a18e44a29f12ad9a1b375210/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:36.727640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134d4cd-d7c1-482c-bd7d-03688ae29f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b91f57cf66644c080587785dc34d070, user_id=7dd53571a18e44a29f12ad9a1b375210, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:36.730883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134d4cd-d7c1-482c-bd7d-03688ae29f23 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:36.753717 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3967/8002] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:03:36 2022] PUT /identity/v3/projects/1b91f57cf66644c080587785dc34d070/users/7dd53571a18e44a29f12ad9a1b375210/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:03:36.775579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da03695-648e-477e-992d-afecae3ba2cd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:36.777341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da03695-648e-477e-992d-afecae3ba2cd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:36.777709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da03695-648e-477e-992d-afecae3ba2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:36.840078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9da03695-648e-477e-992d-afecae3ba2cd None None] MFA Rules not processed for user `7dd53571a18e44a29f12ad9a1b375210`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:36.845127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9da03695-648e-477e-992d-afecae3ba2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:36.958549 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4036/8003] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:03:36 2022] POST /identity/v3/projects => generated 387 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:03:36.960469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e7f5e-a66e-4f0a-b613-d03c63b8a233 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:37.016217 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3968/8004] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:03:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:03:37.026568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da03695-648e-477e-992d-afecae3ba2cd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:37.028148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9da03695-648e-477e-992d-afecae3ba2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:37.129277 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e7f5e-a66e-4f0a-b613-d03c63b8a233 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:37.136667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62434297-2e2b-436c-a136-1974c7e43d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:37.137522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62434297-2e2b-436c-a136-1974c7e43d15 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:37.138038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62434297-2e2b-436c-a136-1974c7e43d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:37.138454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62434297-2e2b-436c-a136-1974c7e43d15 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:37.139229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62434297-2e2b-436c-a136-1974c7e43d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:37.140499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da03695-648e-477e-992d-afecae3ba2cd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:37.141611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62434297-2e2b-436c-a136-1974c7e43d15 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:37.192964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9def15d-7b67-4cc5-bd2a-3a0c4b6ed15d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:37.193805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9def15d-7b67-4cc5-bd2a-3a0c4b6ed15d service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:37.194121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9def15d-7b67-4cc5-bd2a-3a0c4b6ed15d service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:37.194385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9def15d-7b67-4cc5-bd2a-3a0c4b6ed15d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:37.263439 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4037/8005] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:03:36 2022] POST /identity/v3/users => generated 300 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:03:37.267378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62434297-2e2b-436c-a136-1974c7e43d15 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:37.294787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62434297-2e2b-436c-a136-1974c7e43d15 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:37.303338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9def15d-7b67-4cc5-bd2a-3a0c4b6ed15d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:37.304979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9def15d-7b67-4cc5-bd2a-3a0c4b6ed15d service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:37.311150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e937002-7e0e-4dae-b48a-591260108448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:37.311798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e937002-7e0e-4dae-b48a-591260108448 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:37.312064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e937002-7e0e-4dae-b48a-591260108448 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:37.312428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e937002-7e0e-4dae-b48a-591260108448 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:37.315189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e937002-7e0e-4dae-b48a-591260108448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:37.316525 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3969/8006] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:03:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:03:37.329784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e937002-7e0e-4dae-b48a-591260108448 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:37.358625 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4038/8007] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:03:37.362800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9def15d-7b67-4cc5-bd2a-3a0c4b6ed15d service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:37.380895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9def15d-7b67-4cc5-bd2a-3a0c4b6ed15d service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:37.385805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44768849-cdc7-4d8c-8325-0f98a5f333c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:37.386584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44768849-cdc7-4d8c-8325-0f98a5f333c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:37.386871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44768849-cdc7-4d8c-8325-0f98a5f333c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:37.387150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44768849-cdc7-4d8c-8325-0f98a5f333c4 admin admin] PATH_INFO: `/v3/projects/4ac7bc322f93415ba48c7380e3ad7930/users/70b2480ade2d41fb99177ff54c3c761c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:37.407512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44768849-cdc7-4d8c-8325-0f98a5f333c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac7bc322f93415ba48c7380e3ad7930, user_id=70b2480ade2d41fb99177ff54c3c761c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:37.410363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44768849-cdc7-4d8c-8325-0f98a5f333c4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:37.564852 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3970/8008] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:03:37 2022] PUT /identity/v3/projects/4ac7bc322f93415ba48c7380e3ad7930/users/70b2480ade2d41fb99177ff54c3c761c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:03:37.565062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e937002-7e0e-4dae-b48a-591260108448 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:37.588227 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e937002-7e0e-4dae-b48a-591260108448 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:37.659550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78510096-0e89-413a-a6a1-8f992e763ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:37.660342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78510096-0e89-413a-a6a1-8f992e763ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:37.660652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78510096-0e89-413a-a6a1-8f992e763ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:37.661124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78510096-0e89-413a-a6a1-8f992e763ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:37.661958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78510096-0e89-413a-a6a1-8f992e763ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:37.663733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78510096-0e89-413a-a6a1-8f992e763ab2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:37.675610 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4039/8009] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:03:37.680067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44768849-cdc7-4d8c-8325-0f98a5f333c4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:37.706557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44768849-cdc7-4d8c-8325-0f98a5f333c4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:37.713541 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3c178-fff0-40da-b2d0-1bd8547cbb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:37.714249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3c178-fff0-40da-b2d0-1bd8547cbb1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:37.714667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3c178-fff0-40da-b2d0-1bd8547cbb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:37.714952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3c178-fff0-40da-b2d0-1bd8547cbb1e admin admin] PATH_INFO: `/v3/projects/4ac7bc322f93415ba48c7380e3ad7930/users/70b2480ade2d41fb99177ff54c3c761c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:37.717115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3c178-fff0-40da-b2d0-1bd8547cbb1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac7bc322f93415ba48c7380e3ad7930, user_id=70b2480ade2d41fb99177ff54c3c761c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:37.719926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3c178-fff0-40da-b2d0-1bd8547cbb1e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:37.733958 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3971/8010] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:03:37 2022] PUT /identity/v3/projects/4ac7bc322f93415ba48c7380e3ad7930/users/70b2480ade2d41fb99177ff54c3c761c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:03:37.820447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e866bd8-a081-416c-b887-65206e6a5513 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:37.820726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e866bd8-a081-416c-b887-65206e6a5513 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:37.821002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e866bd8-a081-416c-b887-65206e6a5513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:37.850274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8e866bd8-a081-416c-b887-65206e6a5513 None None] MFA Rules not processed for user `70b2480ade2d41fb99177ff54c3c761c`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:37.851300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8e866bd8-a081-416c-b887-65206e6a5513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:37.934088 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4040/8011] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:03:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:03:37.949024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3c178-fff0-40da-b2d0-1bd8547cbb1e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:37.950885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-32a3c178-fff0-40da-b2d0-1bd8547cbb1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:38.016688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3c178-fff0-40da-b2d0-1bd8547cbb1e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:38.021016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be5534-050e-4878-ab29-16a38d2323de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:38.021725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be5534-050e-4878-ab29-16a38d2323de service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:38.021725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be5534-050e-4878-ab29-16a38d2323de service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:38.022055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be5534-050e-4878-ab29-16a38d2323de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:38.031761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be5534-050e-4878-ab29-16a38d2323de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:38.033250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be5534-050e-4878-ab29-16a38d2323de service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:38.043764 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3972/8012] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:03:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:03:38.212118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:39.531573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:40.080806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e866bd8-a081-416c-b887-65206e6a5513 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:40.094200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e866bd8-a081-416c-b887-65206e6a5513 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:40.108782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97793c-160d-4e0c-a392-c7ed8248f682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:40.109670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97793c-160d-4e0c-a392-c7ed8248f682 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:40.110319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97793c-160d-4e0c-a392-c7ed8248f682 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:40.110670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97793c-160d-4e0c-a392-c7ed8248f682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:40.231953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97793c-160d-4e0c-a392-c7ed8248f682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:40.233808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97793c-160d-4e0c-a392-c7ed8248f682 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:40.264549 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4041/8013] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:03:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:03:41.439945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:42.892947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:43.262576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:44.817923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:45.108923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:45.953442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be5534-050e-4878-ab29-16a38d2323de service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:45.982707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be5534-050e-4878-ab29-16a38d2323de service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:45.982707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056f616-a87b-4855-bf61-bb2bd467b8d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:45.983380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056f616-a87b-4855-bf61-bb2bd467b8d5 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:45.983875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056f616-a87b-4855-bf61-bb2bd467b8d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:45.984480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056f616-a87b-4855-bf61-bb2bd467b8d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:46.059764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056f616-a87b-4855-bf61-bb2bd467b8d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:46.061217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056f616-a87b-4855-bf61-bb2bd467b8d5 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:46.074758 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3973/8014] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:03:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:03:46.623030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:47.057725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:48.543536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:48.751185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:49.126084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:50.446395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:50.616733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:51.823314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:52.007138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:52.635459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97793c-160d-4e0c-a392-c7ed8248f682 service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:52.650486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97793c-160d-4e0c-a392-c7ed8248f682 service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:52.656992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337090d0-5f76-4b82-8982-036e508094ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:52.657682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337090d0-5f76-4b82-8982-036e508094ec service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:52.657968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337090d0-5f76-4b82-8982-036e508094ec service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:52.658584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337090d0-5f76-4b82-8982-036e508094ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:52.804464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337090d0-5f76-4b82-8982-036e508094ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:52.807269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337090d0-5f76-4b82-8982-036e508094ec service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:52.827346 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4042/8015] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:03:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:03:53.246029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:54.461630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:56.806002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:57.522204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20989a-41a8-4228-b515-eeb6285db737 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:57.522204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20989a-41a8-4228-b515-eeb6285db737 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:57.522204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20989a-41a8-4228-b515-eeb6285db737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:57.537826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4c20989a-41a8-4228-b515-eeb6285db737 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:03:57.539175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4c20989a-41a8-4228-b515-eeb6285db737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:57.629034 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3974/8016] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 05:03:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:03:57.643420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337090d0-5f76-4b82-8982-036e508094ec service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:57.646176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-337090d0-5f76-4b82-8982-036e508094ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:57.724088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337090d0-5f76-4b82-8982-036e508094ec service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:57.729219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ba342-9411-4d11-9d16-8d25b85feca8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:57.729822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ba342-9411-4d11-9d16-8d25b85feca8 service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:57.730100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ba342-9411-4d11-9d16-8d25b85feca8 service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:57.730444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ba342-9411-4d11-9d16-8d25b85feca8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:57.743247 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ba342-9411-4d11-9d16-8d25b85feca8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:57.744600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ba342-9411-4d11-9d16-8d25b85feca8 service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:57.779200 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4043/8017] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 05:03:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 05:03:58.105111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20989a-41a8-4228-b515-eeb6285db737 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:03:58.125634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20989a-41a8-4228-b515-eeb6285db737 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:03:58.135313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f8449-d518-4b21-95b0-4f407bf0c42c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:03:58.136086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f8449-d518-4b21-95b0-4f407bf0c42c service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:03:58.136542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f8449-d518-4b21-95b0-4f407bf0c42c service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:03:58.137122 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f8449-d518-4b21-95b0-4f407bf0c42c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:03:58.138353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:03:58.161311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b43f8449-d518-4b21-95b0-4f407bf0c42c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:03:58.323725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f8449-d518-4b21-95b0-4f407bf0c42c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:03:58.324511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f8449-d518-4b21-95b0-4f407bf0c42c service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:03:58.333900 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3975/8018] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 05:03:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 05:04:00.584274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:00.898017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:01.980646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ba342-9411-4d11-9d16-8d25b85feca8 service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:02.067130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ba342-9411-4d11-9d16-8d25b85feca8 service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:02.073150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a577d4-c47f-41e0-a96d-ff7d3ec54e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:02.073926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a577d4-c47f-41e0-a96d-ff7d3ec54e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:02.074309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a577d4-c47f-41e0-a96d-ff7d3ec54e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:02.074691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a577d4-c47f-41e0-a96d-ff7d3ec54e78 admin admin] PATH_INFO: `/v3/users/9693349da5f341deae2657b8b01fd199` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:02.075927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a577d4-c47f-41e0-a96d-ff7d3ec54e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9693349da5f341deae2657b8b01fd199)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:02.078637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a577d4-c47f-41e0-a96d-ff7d3ec54e78 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:02.569137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e9a577d4-c47f-41e0-a96d-ff7d3ec54e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9693349da5f341deae2657b8b01fd199'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:02.569916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e9a577d4-c47f-41e0-a96d-ff7d3ec54e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9693349da5f341deae2657b8b01fd199'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:02.856635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e9a577d4-c47f-41e0-a96d-ff7d3ec54e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9693349da5f341deae2657b8b01fd199'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:02.857362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e9a577d4-c47f-41e0-a96d-ff7d3ec54e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9693349da5f341deae2657b8b01fd199'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:02.872870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e9a577d4-c47f-41e0-a96d-ff7d3ec54e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9693349da5f341deae2657b8b01fd199'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:02.886887 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4044/8019] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:01 2022] DELETE /identity/v3/users/9693349da5f341deae2657b8b01fd199 => generated 0 bytes in 907 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:02.891498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70498b88-2a86-47af-a1d8-9a94ac8473f6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:02.891997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70498b88-2a86-47af-a1d8-9a94ac8473f6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:02.892089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70498b88-2a86-47af-a1d8-9a94ac8473f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:02.918204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-70498b88-2a86-47af-a1d8-9a94ac8473f6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:02.919445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-70498b88-2a86-47af-a1d8-9a94ac8473f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:02.997249 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3976/8020] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:03.008524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a577d4-c47f-41e0-a96d-ff7d3ec54e78 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:03.010063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e9a577d4-c47f-41e0-a96d-ff7d3ec54e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:03.076924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a577d4-c47f-41e0-a96d-ff7d3ec54e78 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:03.085314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75896f-698e-4ae5-b85f-3334b80d2169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:03.086205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75896f-698e-4ae5-b85f-3334b80d2169 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:03.086907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75896f-698e-4ae5-b85f-3334b80d2169 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:03.087774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75896f-698e-4ae5-b85f-3334b80d2169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:03.106407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75896f-698e-4ae5-b85f-3334b80d2169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:03.108594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75896f-698e-4ae5-b85f-3334b80d2169 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:03.121347 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4045/8021] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:03.751323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70498b88-2a86-47af-a1d8-9a94ac8473f6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:03.753660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-70498b88-2a86-47af-a1d8-9a94ac8473f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:03.773589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70498b88-2a86-47af-a1d8-9a94ac8473f6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:03.773589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ee0b0-85c3-4366-8609-0554894f1464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:03.773589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ee0b0-85c3-4366-8609-0554894f1464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:03.773589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ee0b0-85c3-4366-8609-0554894f1464 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:03.773906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ee0b0-85c3-4366-8609-0554894f1464 admin admin] PATH_INFO: `/v3/projects/b6658e2d58a8453db08d2e36fbc30d1d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:03.773906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ee0b0-85c3-4366-8609-0554894f1464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6658e2d58a8453db08d2e36fbc30d1d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:03.775831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ee0b0-85c3-4366-8609-0554894f1464 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:03.943536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:04.018428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b63ee0b0-85c3-4366-8609-0554894f1464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6658e2d58a8453db08d2e36fbc30d1d', 'request_id': 'req-b63ee0b0-85c3-4366-8609-0554894f1464'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:04.024518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b63ee0b0-85c3-4366-8609-0554894f1464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6658e2d58a8453db08d2e36fbc30d1d', 'request_id': 'req-b63ee0b0-85c3-4366-8609-0554894f1464'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:04.031711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b63ee0b0-85c3-4366-8609-0554894f1464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6658e2d58a8453db08d2e36fbc30d1d', 'request_id': 'req-b63ee0b0-85c3-4366-8609-0554894f1464'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:04.160013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b63ee0b0-85c3-4366-8609-0554894f1464 admin admin] The token cache is being invalidate because project b6658e2d58a8453db08d2e36fbc30d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:04.161425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b63ee0b0-85c3-4366-8609-0554894f1464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:04.164241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b63ee0b0-85c3-4366-8609-0554894f1464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:04.166907 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3977/8022] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:03 2022] DELETE /identity/v3/projects/b6658e2d58a8453db08d2e36fbc30d1d => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:04.169479 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75896f-698e-4ae5-b85f-3334b80d2169 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:04.179990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75896f-698e-4ae5-b85f-3334b80d2169 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:04.239208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa1bd9-593a-4053-b50a-d7f37ca8dfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:04.239843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa1bd9-593a-4053-b50a-d7f37ca8dfe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:04.240125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa1bd9-593a-4053-b50a-d7f37ca8dfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:04.240477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa1bd9-593a-4053-b50a-d7f37ca8dfe9 admin admin] PATH_INFO: `/v3/users/8241ebb72f3b40b4ba9004f63d03e7b5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:04.241608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa1bd9-593a-4053-b50a-d7f37ca8dfe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8241ebb72f3b40b4ba9004f63d03e7b5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:04.243680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa1bd9-593a-4053-b50a-d7f37ca8dfe9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:04.435073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:04.569915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-abaa1bd9-593a-4053-b50a-d7f37ca8dfe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8241ebb72f3b40b4ba9004f63d03e7b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:04.571194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-abaa1bd9-593a-4053-b50a-d7f37ca8dfe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8241ebb72f3b40b4ba9004f63d03e7b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:04.697476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-abaa1bd9-593a-4053-b50a-d7f37ca8dfe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8241ebb72f3b40b4ba9004f63d03e7b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:04.698351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-abaa1bd9-593a-4053-b50a-d7f37ca8dfe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8241ebb72f3b40b4ba9004f63d03e7b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:04.723566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-abaa1bd9-593a-4053-b50a-d7f37ca8dfe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8241ebb72f3b40b4ba9004f63d03e7b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:04.739751 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4046/8023] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:04 2022] DELETE /identity/v3/users/8241ebb72f3b40b4ba9004f63d03e7b5 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:05.592287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ee0b0-85c3-4366-8609-0554894f1464 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:05.593789 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b63ee0b0-85c3-4366-8609-0554894f1464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:05.619473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ee0b0-85c3-4366-8609-0554894f1464 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:05.699926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:05.728978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa1bd9-593a-4053-b50a-d7f37ca8dfe9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:05.733402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-abaa1bd9-593a-4053-b50a-d7f37ca8dfe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:05.782509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e8efc-3872-4516-b790-03f4b6d0ad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:05.783344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e8efc-3872-4516-b790-03f4b6d0ad98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:05.783598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e8efc-3872-4516-b790-03f4b6d0ad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:05.783895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e8efc-3872-4516-b790-03f4b6d0ad98 admin admin] PATH_INFO: `/v3/projects/6bd8d446faec44389f26fc9bab636bf0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:05.785144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e8efc-3872-4516-b790-03f4b6d0ad98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd8d446faec44389f26fc9bab636bf0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:05.787572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e8efc-3872-4516-b790-03f4b6d0ad98 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:05.874517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa1bd9-593a-4053-b50a-d7f37ca8dfe9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:05.879685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e4808-d050-4a5b-a443-4116496fb947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:05.880428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e4808-d050-4a5b-a443-4116496fb947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:05.880727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e4808-d050-4a5b-a443-4116496fb947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:05.880984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e4808-d050-4a5b-a443-4116496fb947 admin admin] PATH_INFO: `/v3/users/3597ac8a50ea40e09592beeb8a3cfa71` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:05.882290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e4808-d050-4a5b-a443-4116496fb947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3597ac8a50ea40e09592beeb8a3cfa71)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:05.884150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e4808-d050-4a5b-a443-4116496fb947 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:06.007546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5a5e8efc-3872-4516-b790-03f4b6d0ad98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd8d446faec44389f26fc9bab636bf0', 'request_id': 'req-5a5e8efc-3872-4516-b790-03f4b6d0ad98'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:06.013880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5a5e8efc-3872-4516-b790-03f4b6d0ad98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd8d446faec44389f26fc9bab636bf0', 'request_id': 'req-5a5e8efc-3872-4516-b790-03f4b6d0ad98'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:06.020818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5a5e8efc-3872-4516-b790-03f4b6d0ad98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd8d446faec44389f26fc9bab636bf0', 'request_id': 'req-5a5e8efc-3872-4516-b790-03f4b6d0ad98'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:06.242639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5a5e8efc-3872-4516-b790-03f4b6d0ad98 admin admin] The token cache is being invalidate because project 6bd8d446faec44389f26fc9bab636bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:06.243069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5a5e8efc-3872-4516-b790-03f4b6d0ad98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:06.243750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5a5e8efc-3872-4516-b790-03f4b6d0ad98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:06.245422 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3978/8024] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:05 2022] DELETE /identity/v3/projects/6bd8d446faec44389f26fc9bab636bf0 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:06.249150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e8efc-3872-4516-b790-03f4b6d0ad98 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:06.250532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5a5e8efc-3872-4516-b790-03f4b6d0ad98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:06.251857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-836e4808-d050-4a5b-a443-4116496fb947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3597ac8a50ea40e09592beeb8a3cfa71'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:06.252540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-836e4808-d050-4a5b-a443-4116496fb947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3597ac8a50ea40e09592beeb8a3cfa71'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:06.314775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e8efc-3872-4516-b790-03f4b6d0ad98 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:06.319579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaeed38-909f-4308-b580-0c6481dee8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:06.320257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaeed38-909f-4308-b580-0c6481dee8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:06.320545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaeed38-909f-4308-b580-0c6481dee8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:06.320819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaeed38-909f-4308-b580-0c6481dee8ae admin admin] PATH_INFO: `/v3/users/70b2480ade2d41fb99177ff54c3c761c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:06.321968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaeed38-909f-4308-b580-0c6481dee8ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=70b2480ade2d41fb99177ff54c3c761c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:06.323923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaeed38-909f-4308-b580-0c6481dee8ae admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:06.468333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-836e4808-d050-4a5b-a443-4116496fb947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3597ac8a50ea40e09592beeb8a3cfa71'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:06.470193 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-836e4808-d050-4a5b-a443-4116496fb947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3597ac8a50ea40e09592beeb8a3cfa71'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:06.482848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-836e4808-d050-4a5b-a443-4116496fb947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3597ac8a50ea40e09592beeb8a3cfa71'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:06.495689 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4047/8025] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:05 2022] DELETE /identity/v3/users/3597ac8a50ea40e09592beeb8a3cfa71 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:06.649638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bcaeed38-909f-4308-b580-0c6481dee8ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70b2480ade2d41fb99177ff54c3c761c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:06.857552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bcaeed38-909f-4308-b580-0c6481dee8ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70b2480ade2d41fb99177ff54c3c761c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:06.857836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bcaeed38-909f-4308-b580-0c6481dee8ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70b2480ade2d41fb99177ff54c3c761c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:06.865426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e4808-d050-4a5b-a443-4116496fb947 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:06.867350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-836e4808-d050-4a5b-a443-4116496fb947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:06.867782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bcaeed38-909f-4308-b580-0c6481dee8ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70b2480ade2d41fb99177ff54c3c761c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:06.883286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bcaeed38-909f-4308-b580-0c6481dee8ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70b2480ade2d41fb99177ff54c3c761c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:06.889453 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3979/8026] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:06 2022] DELETE /identity/v3/users/70b2480ade2d41fb99177ff54c3c761c => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:06.963862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e4808-d050-4a5b-a443-4116496fb947 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:07.051276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f3fb0-58f0-476e-a821-12aa302d27f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:07.052039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f3fb0-58f0-476e-a821-12aa302d27f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:07.052344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f3fb0-58f0-476e-a821-12aa302d27f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:07.052618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f3fb0-58f0-476e-a821-12aa302d27f9 admin admin] PATH_INFO: `/v3/projects/977321b44d2f4525a21a182dda7590c0` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:07.053765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f3fb0-58f0-476e-a821-12aa302d27f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=977321b44d2f4525a21a182dda7590c0)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:07.055673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f3fb0-58f0-476e-a821-12aa302d27f9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:07.212461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-730f3fb0-58f0-476e-a821-12aa302d27f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '977321b44d2f4525a21a182dda7590c0', 'request_id': 'req-730f3fb0-58f0-476e-a821-12aa302d27f9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:07.218145 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-730f3fb0-58f0-476e-a821-12aa302d27f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '977321b44d2f4525a21a182dda7590c0', 'request_id': 'req-730f3fb0-58f0-476e-a821-12aa302d27f9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:07.389430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:07.389637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-730f3fb0-58f0-476e-a821-12aa302d27f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '977321b44d2f4525a21a182dda7590c0', 'request_id': 'req-730f3fb0-58f0-476e-a821-12aa302d27f9'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:07.406589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaeed38-909f-4308-b580-0c6481dee8ae admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:07.408734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bcaeed38-909f-4308-b580-0c6481dee8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:07.414995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-730f3fb0-58f0-476e-a821-12aa302d27f9 admin admin] The token cache is being invalidate because project 977321b44d2f4525a21a182dda7590c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:07.415099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-730f3fb0-58f0-476e-a821-12aa302d27f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:07.420659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-730f3fb0-58f0-476e-a821-12aa302d27f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:07.427187 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4048/8027] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:06 2022] DELETE /identity/v3/projects/977321b44d2f4525a21a182dda7590c0 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:07.428425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee709cca-041e-453a-8043-172cb2d84888 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:07.429074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee709cca-041e-453a-8043-172cb2d84888 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:07.429480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee709cca-041e-453a-8043-172cb2d84888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:07.430246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaeed38-909f-4308-b580-0c6481dee8ae admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:07.467507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ee709cca-041e-453a-8043-172cb2d84888 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:07.468959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ee709cca-041e-453a-8043-172cb2d84888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:07.531544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eff0da-6499-48a1-bfba-d3dcbfa382a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:07.532457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eff0da-6499-48a1-bfba-d3dcbfa382a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:07.532897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eff0da-6499-48a1-bfba-d3dcbfa382a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:07.533310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eff0da-6499-48a1-bfba-d3dcbfa382a4 admin admin] PATH_INFO: `/v3/projects/4ac7bc322f93415ba48c7380e3ad7930` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:07.534723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eff0da-6499-48a1-bfba-d3dcbfa382a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac7bc322f93415ba48c7380e3ad7930)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:07.538343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eff0da-6499-48a1-bfba-d3dcbfa382a4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:07.546184 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4049/8028] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:07.554841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7659fd4-c1d9-4a64-84c3-ed5b456c233b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:07.555217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7659fd4-c1d9-4a64-84c3-ed5b456c233b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:07.555502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7659fd4-c1d9-4a64-84c3-ed5b456c233b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:07.561264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:07.581576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a7659fd4-c1d9-4a64-84c3-ed5b456c233b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:07.584853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a7659fd4-c1d9-4a64-84c3-ed5b456c233b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:07.594233 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4050/8029] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:07.605315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7659fd4-c1d9-4a64-84c3-ed5b456c233b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:07.611159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7659fd4-c1d9-4a64-84c3-ed5b456c233b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:07.617670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339fe65-7b3b-480e-8ef9-416b1a8a0197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:07.618638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339fe65-7b3b-480e-8ef9-416b1a8a0197 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:07.619162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339fe65-7b3b-480e-8ef9-416b1a8a0197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:07.619642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339fe65-7b3b-480e-8ef9-416b1a8a0197 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:07.620605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339fe65-7b3b-480e-8ef9-416b1a8a0197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:04:07.620981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339fe65-7b3b-480e-8ef9-416b1a8a0197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:07.622853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339fe65-7b3b-480e-8ef9-416b1a8a0197 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:07.640435 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4051/8030] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:04:07.641330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339fe65-7b3b-480e-8ef9-416b1a8a0197 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:07.653016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339fe65-7b3b-480e-8ef9-416b1a8a0197 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:07.658717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad9c8d-3194-4243-90e2-3713a20fc1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:07.659385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad9c8d-3194-4243-90e2-3713a20fc1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:07.667025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad9c8d-3194-4243-90e2-3713a20fc1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:07.667025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad9c8d-3194-4243-90e2-3713a20fc1f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:07.667025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad9c8d-3194-4243-90e2-3713a20fc1f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:07.667025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad9c8d-3194-4243-90e2-3713a20fc1f3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:07.674144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-00eff0da-6499-48a1-bfba-d3dcbfa382a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac7bc322f93415ba48c7380e3ad7930', 'request_id': 'req-00eff0da-6499-48a1-bfba-d3dcbfa382a4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:07.682319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-00eff0da-6499-48a1-bfba-d3dcbfa382a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac7bc322f93415ba48c7380e3ad7930', 'request_id': 'req-00eff0da-6499-48a1-bfba-d3dcbfa382a4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:07.689718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-00eff0da-6499-48a1-bfba-d3dcbfa382a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac7bc322f93415ba48c7380e3ad7930', 'request_id': 'req-00eff0da-6499-48a1-bfba-d3dcbfa382a4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:07.822540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-00eff0da-6499-48a1-bfba-d3dcbfa382a4 admin admin] The token cache is being invalidate because project 4ac7bc322f93415ba48c7380e3ad7930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:07.823193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-00eff0da-6499-48a1-bfba-d3dcbfa382a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:07.823829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-00eff0da-6499-48a1-bfba-d3dcbfa382a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:07.828413 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4052/8031] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:07 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:07.828539 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3980/8032] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:07 2022] DELETE /identity/v3/projects/4ac7bc322f93415ba48c7380e3ad7930 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:07.829415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad9c8d-3194-4243-90e2-3713a20fc1f3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:07.831393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dcad9c8d-3194-4243-90e2-3713a20fc1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:07.831539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf3dcc-31bc-47c5-9135-b13dee7bcb4c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:07.831759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf3dcc-31bc-47c5-9135-b13dee7bcb4c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:07.832824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf3dcc-31bc-47c5-9135-b13dee7bcb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:07.857766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2fcf3dcc-31bc-47c5-9135-b13dee7bcb4c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:07.859492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2fcf3dcc-31bc-47c5-9135-b13dee7bcb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:07.907101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad9c8d-3194-4243-90e2-3713a20fc1f3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:07.913295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8c558-8093-4a0e-b5c5-d649014f9f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:07.914156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8c558-8093-4a0e-b5c5-d649014f9f5b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:07.914644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8c558-8093-4a0e-b5c5-d649014f9f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:07.914917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8c558-8093-4a0e-b5c5-d649014f9f5b admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:07.915564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8c558-8093-4a0e-b5c5-d649014f9f5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:07.917586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8c558-8093-4a0e-b5c5-d649014f9f5b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:07.940878 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3981/8033] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:04:07.945678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dcd27-88d4-43df-8e93-f07a80585f09 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:07.946082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dcd27-88d4-43df-8e93-f07a80585f09 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:07.946425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dcd27-88d4-43df-8e93-f07a80585f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:07.972137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-424dcd27-88d4-43df-8e93-f07a80585f09 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:07.973801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-424dcd27-88d4-43df-8e93-f07a80585f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:07.982305 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3982/8034] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:04:07.986685 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dcd27-88d4-43df-8e93-f07a80585f09 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:08.009328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dcd27-88d4-43df-8e93-f07a80585f09 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:08.009328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357fa1b-246e-446d-95a5-5c0f868c35d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:08.009328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357fa1b-246e-446d-95a5-5c0f868c35d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:08.009328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357fa1b-246e-446d-95a5-5c0f868c35d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:08.009772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357fa1b-246e-446d-95a5-5c0f868c35d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:08.009772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357fa1b-246e-446d-95a5-5c0f868c35d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:04:08.009772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357fa1b-246e-446d-95a5-5c0f868c35d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:08.009772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357fa1b-246e-446d-95a5-5c0f868c35d6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:08.018482 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3983/8035] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:04:08.022788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357fa1b-246e-446d-95a5-5c0f868c35d6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:08.033311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357fa1b-246e-446d-95a5-5c0f868c35d6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:08.039791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848c9d3-46c4-4de3-8faa-2ef8a6813e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:08.040669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848c9d3-46c4-4de3-8faa-2ef8a6813e37 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:08.040751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848c9d3-46c4-4de3-8faa-2ef8a6813e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:08.041118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848c9d3-46c4-4de3-8faa-2ef8a6813e37 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:08.042947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848c9d3-46c4-4de3-8faa-2ef8a6813e37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:08.045262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848c9d3-46c4-4de3-8faa-2ef8a6813e37 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:08.056001 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4053/8036] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:07 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:08.060238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8c558-8093-4a0e-b5c5-d649014f9f5b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:08.077581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8c558-8093-4a0e-b5c5-d649014f9f5b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:08.083217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec2025-5f38-4a71-9f30-30c607b61005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:08.084104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec2025-5f38-4a71-9f30-30c607b61005 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:08.084420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec2025-5f38-4a71-9f30-30c607b61005 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:08.084696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec2025-5f38-4a71-9f30-30c607b61005 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:08.085552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec2025-5f38-4a71-9f30-30c607b61005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:08.087202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec2025-5f38-4a71-9f30-30c607b61005 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:08.098863 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4054/8037] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:08.103139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec2025-5f38-4a71-9f30-30c607b61005 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:08.115768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec2025-5f38-4a71-9f30-30c607b61005 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:08.123401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcfbd6-f982-479e-a336-48273e8e9eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:08.124029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcfbd6-f982-479e-a336-48273e8e9eeb admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:08.124416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcfbd6-f982-479e-a336-48273e8e9eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:08.124686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcfbd6-f982-479e-a336-48273e8e9eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:08.125333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcfbd6-f982-479e-a336-48273e8e9eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:08.126961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcfbd6-f982-479e-a336-48273e8e9eeb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:08.153211 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3984/8038] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:08 2022] POST /identity/v3/projects => generated 393 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:08.153211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848c9d3-46c4-4de3-8faa-2ef8a6813e37 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:08.154111 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4055/8039] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:08.158215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcfbd6-f982-479e-a336-48273e8e9eeb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:08.169735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcfbd6-f982-479e-a336-48273e8e9eeb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:08.243129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848c9d3-46c4-4de3-8faa-2ef8a6813e37 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:08.248616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e91460-4d2b-4d2a-a3ed-05e70b1174df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:08.249423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e91460-4d2b-4d2a-a3ed-05e70b1174df admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:08.249799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e91460-4d2b-4d2a-a3ed-05e70b1174df admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:08.250208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e91460-4d2b-4d2a-a3ed-05e70b1174df admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:08.250924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e91460-4d2b-4d2a-a3ed-05e70b1174df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:08.253357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e91460-4d2b-4d2a-a3ed-05e70b1174df admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:08.255751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840e728-415e-4acc-a8b7-fbc58cbc1547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:08.256972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840e728-415e-4acc-a8b7-fbc58cbc1547 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:08.257257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840e728-415e-4acc-a8b7-fbc58cbc1547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:08.257532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840e728-415e-4acc-a8b7-fbc58cbc1547 admin admin] PATH_INFO: `/v3/projects/3e8dbcc027814d28986728f8f84b4439/users/0efbac4ec7f744a6a17486d2579c6882/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:08.276392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840e728-415e-4acc-a8b7-fbc58cbc1547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8dbcc027814d28986728f8f84b4439, user_id=0efbac4ec7f744a6a17486d2579c6882, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:08.281097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840e728-415e-4acc-a8b7-fbc58cbc1547 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:08.368675 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3985/8040] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:08 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:08.378126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e91460-4d2b-4d2a-a3ed-05e70b1174df admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:08.378244 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4056/8041] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:08 2022] PUT /identity/v3/projects/3e8dbcc027814d28986728f8f84b4439/users/0efbac4ec7f744a6a17486d2579c6882/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:08.380409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58ab28-5fd3-462f-9f7b-94f40966dc57 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:08.380763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58ab28-5fd3-462f-9f7b-94f40966dc57 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:08.381044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58ab28-5fd3-462f-9f7b-94f40966dc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:08.390502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e91460-4d2b-4d2a-a3ed-05e70b1174df admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:08.449626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6d58ab28-5fd3-462f-9f7b-94f40966dc57 None None] MFA Rules not processed for user `0efbac4ec7f744a6a17486d2579c6882`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:08.451156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6d58ab28-5fd3-462f-9f7b-94f40966dc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:08.468428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e5947-015d-420d-95ef-8a8823f8be27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:08.469277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e5947-015d-420d-95ef-8a8823f8be27 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:08.469636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e5947-015d-420d-95ef-8a8823f8be27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:08.470131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e5947-015d-420d-95ef-8a8823f8be27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:08.471127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e5947-015d-420d-95ef-8a8823f8be27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:08.473829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e5947-015d-420d-95ef-8a8823f8be27 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:08.486268 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3986/8042] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:08.492832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e5947-015d-420d-95ef-8a8823f8be27 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:08.504199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e5947-015d-420d-95ef-8a8823f8be27 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:08.509091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cca23d-24e7-4e4f-af12-23f70bc21cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:08.509873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cca23d-24e7-4e4f-af12-23f70bc21cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:08.509967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cca23d-24e7-4e4f-af12-23f70bc21cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:08.510234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cca23d-24e7-4e4f-af12-23f70bc21cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:08.510880 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cca23d-24e7-4e4f-af12-23f70bc21cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:08.512552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cca23d-24e7-4e4f-af12-23f70bc21cf7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:08.529708 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3987/8043] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:08.534194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cca23d-24e7-4e4f-af12-23f70bc21cf7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:08.549158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cca23d-24e7-4e4f-af12-23f70bc21cf7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:08.556137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae988706-f5e9-498c-968a-8ccce47038b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:08.557375 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae988706-f5e9-498c-968a-8ccce47038b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:08.558209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae988706-f5e9-498c-968a-8ccce47038b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:08.560481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae988706-f5e9-498c-968a-8ccce47038b0 admin admin] PATH_INFO: `/v3/projects/e7255edb35a54d59b811580cf486381c/users/c842423ae078425195a9e6eeb1dc634c/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:08.576071 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4057/8044] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:08.580731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58ab28-5fd3-462f-9f7b-94f40966dc57 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:08.583030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae988706-f5e9-498c-968a-8ccce47038b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7255edb35a54d59b811580cf486381c, user_id=c842423ae078425195a9e6eeb1dc634c, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:08.585576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae988706-f5e9-498c-968a-8ccce47038b0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:08.592482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58ab28-5fd3-462f-9f7b-94f40966dc57 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:08.599199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66497f62-6535-48cc-99c7-60138d353e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:08.599835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66497f62-6535-48cc-99c7-60138d353e34 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:08.600354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66497f62-6535-48cc-99c7-60138d353e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:08.600636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66497f62-6535-48cc-99c7-60138d353e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:08.601265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66497f62-6535-48cc-99c7-60138d353e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:08.603270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66497f62-6535-48cc-99c7-60138d353e34 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:08.670281 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3988/8045] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:08 2022] PUT /identity/v3/projects/e7255edb35a54d59b811580cf486381c/users/c842423ae078425195a9e6eeb1dc634c/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:08.747881 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4058/8046] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:08 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:08.749349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae988706-f5e9-498c-968a-8ccce47038b0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:08.783859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98653d9c-d102-4372-9497-a7025560ef4e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:08.783859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98653d9c-d102-4372-9497-a7025560ef4e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:08.783859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98653d9c-d102-4372-9497-a7025560ef4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:08.876742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:08.877722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-98653d9c-d102-4372-9497-a7025560ef4e None None] MFA Rules not processed for user `c842423ae078425195a9e6eeb1dc634c`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:08.879150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-98653d9c-d102-4372-9497-a7025560ef4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:08.923091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae988706-f5e9-498c-968a-8ccce47038b0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:08.984417 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4059/8047] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:08.989452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:08.990766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98653d9c-d102-4372-9497-a7025560ef4e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:09.010808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da9343-57a8-4f0e-a88a-4e5711dbc491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:09.014788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da9343-57a8-4f0e-a88a-4e5711dbc491 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:09.014788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da9343-57a8-4f0e-a88a-4e5711dbc491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:09.014788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da9343-57a8-4f0e-a88a-4e5711dbc491 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:09.014788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da9343-57a8-4f0e-a88a-4e5711dbc491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:09.014788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da9343-57a8-4f0e-a88a-4e5711dbc491 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:09.067926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98653d9c-d102-4372-9497-a7025560ef4e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:09.072730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0283f2a-f52f-480a-a8c9-6f6428a9105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:09.073337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0283f2a-f52f-480a-a8c9-6f6428a9105d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:09.073613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0283f2a-f52f-480a-a8c9-6f6428a9105d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:09.073883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0283f2a-f52f-480a-a8c9-6f6428a9105d admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:09.074580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0283f2a-f52f-480a-a8c9-6f6428a9105d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:09.076592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0283f2a-f52f-480a-a8c9-6f6428a9105d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:09.127266 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3989/8048] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:08 2022] POST /identity/v3/users => generated 301 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:09.132428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da9343-57a8-4f0e-a88a-4e5711dbc491 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:09.145594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da9343-57a8-4f0e-a88a-4e5711dbc491 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:09.150796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb53c28-dfd0-4938-b2aa-5d5d67b14b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:09.151422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb53c28-dfd0-4938-b2aa-5d5d67b14b19 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:09.151706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb53c28-dfd0-4938-b2aa-5d5d67b14b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:09.151982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb53c28-dfd0-4938-b2aa-5d5d67b14b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:09.152704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb53c28-dfd0-4938-b2aa-5d5d67b14b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:09.154625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb53c28-dfd0-4938-b2aa-5d5d67b14b19 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:09.169703 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3990/8049] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:04:09.170947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb53c28-dfd0-4938-b2aa-5d5d67b14b19 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:09.178171 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4060/8050] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:08 2022] POST /identity/v3/projects => generated 393 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:09.182415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0283f2a-f52f-480a-a8c9-6f6428a9105d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:09.184776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb53c28-dfd0-4938-b2aa-5d5d67b14b19 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:09.249719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cfd03-91a1-42e0-8260-67d7bccc8dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:09.250613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cfd03-91a1-42e0-8260-67d7bccc8dff admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:09.250740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cfd03-91a1-42e0-8260-67d7bccc8dff admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:09.250920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cfd03-91a1-42e0-8260-67d7bccc8dff admin admin] PATH_INFO: `/v3/projects/1969cc838e314ea193800061f72f1b2e/users/aba01791b78d429183fd5fbdf1e25f74/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:09.256068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0283f2a-f52f-480a-a8c9-6f6428a9105d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:09.261989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eee708-a591-4e6e-bfb7-6ce1e6b64cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:09.261989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eee708-a591-4e6e-bfb7-6ce1e6b64cbf admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:09.261989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eee708-a591-4e6e-bfb7-6ce1e6b64cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:09.262329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eee708-a591-4e6e-bfb7-6ce1e6b64cbf admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:09.262794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eee708-a591-4e6e-bfb7-6ce1e6b64cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:09.264779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eee708-a591-4e6e-bfb7-6ce1e6b64cbf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:09.273679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cfd03-91a1-42e0-8260-67d7bccc8dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=1969cc838e314ea193800061f72f1b2e, user_id=aba01791b78d429183fd5fbdf1e25f74, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:09.274864 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cfd03-91a1-42e0-8260-67d7bccc8dff admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:09.330743 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4061/8051] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:09 2022] POST /identity/v3/users => generated 303 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:09.331592 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3991/8052] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:09 2022] PUT /identity/v3/projects/1969cc838e314ea193800061f72f1b2e/users/aba01791b78d429183fd5fbdf1e25f74/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:09.338144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cfd03-91a1-42e0-8260-67d7bccc8dff admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:09.342981 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdd53e-4c48-4228-a379-0e55910fc961 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:09.343270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdd53e-4c48-4228-a379-0e55910fc961 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:09.343544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdd53e-4c48-4228-a379-0e55910fc961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:09.374838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:09.378191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-dfcdd53e-4c48-4228-a379-0e55910fc961 None None] MFA Rules not processed for user `aba01791b78d429183fd5fbdf1e25f74`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:09.379608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dfcdd53e-4c48-4228-a379-0e55910fc961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:09.413851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cfd03-91a1-42e0-8260-67d7bccc8dff admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:09.428721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af92cc-da4d-4ada-a3d9-e656e1434145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:09.429351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af92cc-da4d-4ada-a3d9-e656e1434145 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:09.429640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af92cc-da4d-4ada-a3d9-e656e1434145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:09.429922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af92cc-da4d-4ada-a3d9-e656e1434145 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:09.430569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af92cc-da4d-4ada-a3d9-e656e1434145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:09.432273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af92cc-da4d-4ada-a3d9-e656e1434145 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:09.446353 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3992/8053] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:09.447378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af92cc-da4d-4ada-a3d9-e656e1434145 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:09.451209 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4062/8054] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:09 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:04:09.459039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af92cc-da4d-4ada-a3d9-e656e1434145 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:09.464573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62859e94-8d68-43f6-a8fd-70f8ed350f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:09.465399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62859e94-8d68-43f6-a8fd-70f8ed350f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:09.465857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62859e94-8d68-43f6-a8fd-70f8ed350f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:09.466224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62859e94-8d68-43f6-a8fd-70f8ed350f37 admin admin] PATH_INFO: `/v3/projects/cc8caf072c8048b58591931caada8973/users/d283bf742a414c87ad49cd66388acae4/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:09.484241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdd53e-4c48-4228-a379-0e55910fc961 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:09.485659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dfcdd53e-4c48-4228-a379-0e55910fc961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:09.486762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62859e94-8d68-43f6-a8fd-70f8ed350f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8caf072c8048b58591931caada8973, user_id=d283bf742a414c87ad49cd66388acae4, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:09.490549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62859e94-8d68-43f6-a8fd-70f8ed350f37 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:09.572074 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3993/8055] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:09 2022] PUT /identity/v3/projects/cc8caf072c8048b58591931caada8973/users/d283bf742a414c87ad49cd66388acae4/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:09.575931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62859e94-8d68-43f6-a8fd-70f8ed350f37 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:09.582185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdd53e-4c48-4228-a379-0e55910fc961 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:09.647997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62859e94-8d68-43f6-a8fd-70f8ed350f37 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:09.655565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6db122-68bf-40f6-8655-56d53b4ebac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:09.655565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6db122-68bf-40f6-8655-56d53b4ebac4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:09.655883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6db122-68bf-40f6-8655-56d53b4ebac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:09.656068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6db122-68bf-40f6-8655-56d53b4ebac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:09.656855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6db122-68bf-40f6-8655-56d53b4ebac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:09.658374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6db122-68bf-40f6-8655-56d53b4ebac4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:09.671304 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3994/8056] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:09.675239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6db122-68bf-40f6-8655-56d53b4ebac4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:09.682585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cdf32-5647-4ca6-8920-57be273d674a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:09.682585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cdf32-5647-4ca6-8920-57be273d674a service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:09.682780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cdf32-5647-4ca6-8920-57be273d674a service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:09.684529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cdf32-5647-4ca6-8920-57be273d674a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:09.693505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6db122-68bf-40f6-8655-56d53b4ebac4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:09.700705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c93439-97a9-4c1f-a847-8617dcff2c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:09.706823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c93439-97a9-4c1f-a847-8617dcff2c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:09.706823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c93439-97a9-4c1f-a847-8617dcff2c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:09.706823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c93439-97a9-4c1f-a847-8617dcff2c6c admin admin] PATH_INFO: `/v3/projects/cc8caf072c8048b58591931caada8973/users/d283bf742a414c87ad49cd66388acae4/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:09.706823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c93439-97a9-4c1f-a847-8617dcff2c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8caf072c8048b58591931caada8973, user_id=d283bf742a414c87ad49cd66388acae4, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:09.710017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c93439-97a9-4c1f-a847-8617dcff2c6c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:09.734083 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3995/8057] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:09 2022] PUT /identity/v3/projects/cc8caf072c8048b58591931caada8973/users/d283bf742a414c87ad49cd66388acae4/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:09.735688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076acab7-b6c3-4a28-989c-418e8266a458 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:09.736626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076acab7-b6c3-4a28-989c-418e8266a458 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:09.736929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076acab7-b6c3-4a28-989c-418e8266a458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:09.754668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cdf32-5647-4ca6-8920-57be273d674a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:09.756295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cdf32-5647-4ca6-8920-57be273d674a service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:09.764865 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4063/8058] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 05:04:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 05:04:09.767693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-076acab7-b6c3-4a28-989c-418e8266a458 None None] MFA Rules not processed for user `d283bf742a414c87ad49cd66388acae4`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:09.768940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-076acab7-b6c3-4a28-989c-418e8266a458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:09.842855 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3996/8059] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:09 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:09.873405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:10.159507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cdf32-5647-4ca6-8920-57be273d674a service swift] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:10.162076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9c2cdf32-5647-4ca6-8920-57be273d674a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:10.227939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cdf32-5647-4ca6-8920-57be273d674a service swift] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:10.294749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16bf8e-9320-4ae8-99fb-ff073b1ed1f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:10.295491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16bf8e-9320-4ae8-99fb-ff073b1ed1f5 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:10.295798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16bf8e-9320-4ae8-99fb-ff073b1ed1f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:10.296118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16bf8e-9320-4ae8-99fb-ff073b1ed1f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:10.310789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16bf8e-9320-4ae8-99fb-ff073b1ed1f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:10.312120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16bf8e-9320-4ae8-99fb-ff073b1ed1f5 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:10.328895 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4064/8060] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:10 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:10.402545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076acab7-b6c3-4a28-989c-418e8266a458 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:10.404333 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-076acab7-b6c3-4a28-989c-418e8266a458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:10.425869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076acab7-b6c3-4a28-989c-418e8266a458 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:10.429740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c43c7d-776f-400e-bbad-54430fe87a4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:10.430385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c43c7d-776f-400e-bbad-54430fe87a4c service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:10.430660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c43c7d-776f-400e-bbad-54430fe87a4c service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:10.430919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c43c7d-776f-400e-bbad-54430fe87a4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:10.520347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c43c7d-776f-400e-bbad-54430fe87a4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:10.522830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c43c7d-776f-400e-bbad-54430fe87a4c service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:10.540603 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3997/8061] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:10 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:10.571205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:11.571895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:11.897206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:12.913808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:13.178308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:14.225991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:14.256216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16bf8e-9320-4ae8-99fb-ff073b1ed1f5 service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:14.339144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16bf8e-9320-4ae8-99fb-ff073b1ed1f5 service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:14.345569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc1ed4-8bc3-47bc-b2e8-cf5d1c11a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:14.346714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc1ed4-8bc3-47bc-b2e8-cf5d1c11a9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:14.347642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc1ed4-8bc3-47bc-b2e8-cf5d1c11a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:14.348149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc1ed4-8bc3-47bc-b2e8-cf5d1c11a9ec admin admin] PATH_INFO: `/v3/users/0efbac4ec7f744a6a17486d2579c6882` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:14.350276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc1ed4-8bc3-47bc-b2e8-cf5d1c11a9ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0efbac4ec7f744a6a17486d2579c6882)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:14.352356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc1ed4-8bc3-47bc-b2e8-cf5d1c11a9ec admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:14.439997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:14.522995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4ebc1ed4-8bc3-47bc-b2e8-cf5d1c11a9ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0efbac4ec7f744a6a17486d2579c6882'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:14.524647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4ebc1ed4-8bc3-47bc-b2e8-cf5d1c11a9ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0efbac4ec7f744a6a17486d2579c6882'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:14.594231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4ebc1ed4-8bc3-47bc-b2e8-cf5d1c11a9ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0efbac4ec7f744a6a17486d2579c6882'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:14.594571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4ebc1ed4-8bc3-47bc-b2e8-cf5d1c11a9ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0efbac4ec7f744a6a17486d2579c6882'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:14.612740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4ebc1ed4-8bc3-47bc-b2e8-cf5d1c11a9ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0efbac4ec7f744a6a17486d2579c6882'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:14.627043 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4065/8062] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:14 2022] DELETE /identity/v3/users/0efbac4ec7f744a6a17486d2579c6882 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:14.631689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b328c-759f-424c-8ac4-fe5f25b61326 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:14.632028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b328c-759f-424c-8ac4-fe5f25b61326 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:14.632341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b328c-759f-424c-8ac4-fe5f25b61326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:14.654177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-369b328c-759f-424c-8ac4-fe5f25b61326 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:14.655428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-369b328c-759f-424c-8ac4-fe5f25b61326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:14.747129 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3998/8063] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:14.757008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc1ed4-8bc3-47bc-b2e8-cf5d1c11a9ec admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:14.758648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4ebc1ed4-8bc3-47bc-b2e8-cf5d1c11a9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:14.858503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc1ed4-8bc3-47bc-b2e8-cf5d1c11a9ec admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:14.858503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480f8fa-d754-4775-bc90-ea15a2143731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:14.858503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f8fa-d754-4775-bc90-ea15a2143731 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:14.858503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f8fa-d754-4775-bc90-ea15a2143731 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:14.859802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f8fa-d754-4775-bc90-ea15a2143731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:14.859802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480f8fa-d754-4775-bc90-ea15a2143731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:14.859802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480f8fa-d754-4775-bc90-ea15a2143731 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:14.859802 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4066/8064] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:15.610489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:15.733926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b328c-759f-424c-8ac4-fe5f25b61326 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:15.735709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-369b328c-759f-424c-8ac4-fe5f25b61326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:15.755981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b328c-759f-424c-8ac4-fe5f25b61326 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:15.762299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32add7-49be-4143-b659-c4032985db7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:15.764446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32add7-49be-4143-b659-c4032985db7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:15.764446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32add7-49be-4143-b659-c4032985db7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:15.764446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32add7-49be-4143-b659-c4032985db7a admin admin] PATH_INFO: `/v3/projects/3e8dbcc027814d28986728f8f84b4439` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:15.766070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32add7-49be-4143-b659-c4032985db7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8dbcc027814d28986728f8f84b4439)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:15.771252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32add7-49be-4143-b659-c4032985db7a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:15.980268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ab32add7-49be-4143-b659-c4032985db7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8dbcc027814d28986728f8f84b4439', 'request_id': 'req-ab32add7-49be-4143-b659-c4032985db7a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:15.996886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ab32add7-49be-4143-b659-c4032985db7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8dbcc027814d28986728f8f84b4439', 'request_id': 'req-ab32add7-49be-4143-b659-c4032985db7a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:16.005329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ab32add7-49be-4143-b659-c4032985db7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8dbcc027814d28986728f8f84b4439', 'request_id': 'req-ab32add7-49be-4143-b659-c4032985db7a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:16.072423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ab32add7-49be-4143-b659-c4032985db7a admin admin] The token cache is being invalidate because project 3e8dbcc027814d28986728f8f84b4439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:16.072423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ab32add7-49be-4143-b659-c4032985db7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:16.073534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ab32add7-49be-4143-b659-c4032985db7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:16.079140 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 3999/8065] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:15 2022] DELETE /identity/v3/projects/3e8dbcc027814d28986728f8f84b4439 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:16.080155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480f8fa-d754-4775-bc90-ea15a2143731 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:16.095504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480f8fa-d754-4775-bc90-ea15a2143731 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:16.159090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fd243-5c45-4283-819f-3d968996f18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:16.160674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fd243-5c45-4283-819f-3d968996f18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:16.161098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fd243-5c45-4283-819f-3d968996f18e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:16.161557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fd243-5c45-4283-819f-3d968996f18e admin admin] PATH_INFO: `/v3/users/aba01791b78d429183fd5fbdf1e25f74` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:16.162837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fd243-5c45-4283-819f-3d968996f18e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba01791b78d429183fd5fbdf1e25f74)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:16.165512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fd243-5c45-4283-819f-3d968996f18e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:16.223628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:16.394865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6f6fd243-5c45-4283-819f-3d968996f18e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba01791b78d429183fd5fbdf1e25f74'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:16.397661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6f6fd243-5c45-4283-819f-3d968996f18e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba01791b78d429183fd5fbdf1e25f74'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:16.502283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6f6fd243-5c45-4283-819f-3d968996f18e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba01791b78d429183fd5fbdf1e25f74'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:16.504960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6f6fd243-5c45-4283-819f-3d968996f18e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba01791b78d429183fd5fbdf1e25f74'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:16.523472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6f6fd243-5c45-4283-819f-3d968996f18e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba01791b78d429183fd5fbdf1e25f74'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:16.543748 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4067/8066] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:16 2022] DELETE /identity/v3/users/aba01791b78d429183fd5fbdf1e25f74 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:17.006501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:17.057881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32add7-49be-4143-b659-c4032985db7a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:17.060062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ab32add7-49be-4143-b659-c4032985db7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:17.079969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32add7-49be-4143-b659-c4032985db7a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:17.165388 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb05df-5034-4f3f-8c8c-2088c525164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:17.166106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb05df-5034-4f3f-8c8c-2088c525164f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:17.166475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb05df-5034-4f3f-8c8c-2088c525164f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:17.166821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb05df-5034-4f3f-8c8c-2088c525164f admin admin] PATH_INFO: `/v3/projects/1969cc838e314ea193800061f72f1b2e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:17.168068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb05df-5034-4f3f-8c8c-2088c525164f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1969cc838e314ea193800061f72f1b2e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:17.170587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb05df-5034-4f3f-8c8c-2088c525164f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:17.317963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-47eb05df-5034-4f3f-8c8c-2088c525164f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1969cc838e314ea193800061f72f1b2e', 'request_id': 'req-47eb05df-5034-4f3f-8c8c-2088c525164f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:17.324475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-47eb05df-5034-4f3f-8c8c-2088c525164f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1969cc838e314ea193800061f72f1b2e', 'request_id': 'req-47eb05df-5034-4f3f-8c8c-2088c525164f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:17.331220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-47eb05df-5034-4f3f-8c8c-2088c525164f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1969cc838e314ea193800061f72f1b2e', 'request_id': 'req-47eb05df-5034-4f3f-8c8c-2088c525164f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:17.424000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-47eb05df-5034-4f3f-8c8c-2088c525164f admin admin] The token cache is being invalidate because project 1969cc838e314ea193800061f72f1b2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:17.424374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-47eb05df-5034-4f3f-8c8c-2088c525164f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:17.428657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-47eb05df-5034-4f3f-8c8c-2088c525164f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:17.430401 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4000/8067] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:17 2022] DELETE /identity/v3/projects/1969cc838e314ea193800061f72f1b2e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:17.548627 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:18.040544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:18.577375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:18.805422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:19.599080 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fd243-5c45-4283-819f-3d968996f18e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:19.600599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6f6fd243-5c45-4283-819f-3d968996f18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:19.614658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fd243-5c45-4283-819f-3d968996f18e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:19.689219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff430bc7-2371-45f1-8296-45015a6e3011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:19.691825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430bc7-2371-45f1-8296-45015a6e3011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:19.693917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430bc7-2371-45f1-8296-45015a6e3011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:19.694467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430bc7-2371-45f1-8296-45015a6e3011 admin admin] PATH_INFO: `/v3/users/c842423ae078425195a9e6eeb1dc634c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:19.696424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff430bc7-2371-45f1-8296-45015a6e3011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c842423ae078425195a9e6eeb1dc634c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:19.701431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff430bc7-2371-45f1-8296-45015a6e3011 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:19.856714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:19.899881 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ff430bc7-2371-45f1-8296-45015a6e3011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c842423ae078425195a9e6eeb1dc634c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:19.901811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ff430bc7-2371-45f1-8296-45015a6e3011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c842423ae078425195a9e6eeb1dc634c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:19.953675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ff430bc7-2371-45f1-8296-45015a6e3011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c842423ae078425195a9e6eeb1dc634c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:19.955445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ff430bc7-2371-45f1-8296-45015a6e3011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c842423ae078425195a9e6eeb1dc634c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:19.972273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:19.975172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ff430bc7-2371-45f1-8296-45015a6e3011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c842423ae078425195a9e6eeb1dc634c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:19.992917 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4068/8068] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:19 2022] DELETE /identity/v3/users/c842423ae078425195a9e6eeb1dc634c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:19.998151 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181ca02-3a60-4d13-9cac-3069635de050 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:19.998510 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181ca02-3a60-4d13-9cac-3069635de050 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:19.998903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181ca02-3a60-4d13-9cac-3069635de050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:20.032319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d181ca02-3a60-4d13-9cac-3069635de050 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:20.034048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d181ca02-3a60-4d13-9cac-3069635de050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:20.103628 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4001/8069] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:04:20.113915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff430bc7-2371-45f1-8296-45015a6e3011 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:20.115566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ff430bc7-2371-45f1-8296-45015a6e3011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:20.188278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff430bc7-2371-45f1-8296-45015a6e3011 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:20.193570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1b4ad-7de4-4f1c-bb76-3252cfe6e0ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:20.194268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1b4ad-7de4-4f1c-bb76-3252cfe6e0ce service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:20.194626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1b4ad-7de4-4f1c-bb76-3252cfe6e0ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:20.194909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1b4ad-7de4-4f1c-bb76-3252cfe6e0ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:20.205727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1b4ad-7de4-4f1c-bb76-3252cfe6e0ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:20.207264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1b4ad-7de4-4f1c-bb76-3252cfe6e0ce service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:20.217827 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4069/8070] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:20.641490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:20.778629 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181ca02-3a60-4d13-9cac-3069635de050 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:20.780742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d181ca02-3a60-4d13-9cac-3069635de050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:20.797006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181ca02-3a60-4d13-9cac-3069635de050 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:20.802643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:20.803290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:20.803568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:20.803838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd admin admin] PATH_INFO: `/v3/projects/e7255edb35a54d59b811580cf486381c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:20.805015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7255edb35a54d59b811580cf486381c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:20.806968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:20.905799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7255edb35a54d59b811580cf486381c', 'request_id': 'req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:20.913347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7255edb35a54d59b811580cf486381c', 'request_id': 'req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:20.921484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7255edb35a54d59b811580cf486381c', 'request_id': 'req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:20.999710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd admin admin] The token cache is being invalidate because project e7255edb35a54d59b811580cf486381c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:21.000009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:21.000733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:21.002212 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4002/8071] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:20 2022] DELETE /identity/v3/projects/e7255edb35a54d59b811580cf486381c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:21.006908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1b4ad-7de4-4f1c-bb76-3252cfe6e0ce service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:21.020058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1b4ad-7de4-4f1c-bb76-3252cfe6e0ce service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:21.086279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb69209-a207-486c-b220-9582d8a49a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:21.087081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb69209-a207-486c-b220-9582d8a49a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:21.087507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb69209-a207-486c-b220-9582d8a49a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:21.087882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb69209-a207-486c-b220-9582d8a49a6f admin admin] PATH_INFO: `/v3/users/d283bf742a414c87ad49cd66388acae4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:21.089771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb69209-a207-486c-b220-9582d8a49a6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d283bf742a414c87ad49cd66388acae4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:21.091845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb69209-a207-486c-b220-9582d8a49a6f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:21.314313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-afb69209-a207-486c-b220-9582d8a49a6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd283bf742a414c87ad49cd66388acae4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:21.315090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-afb69209-a207-486c-b220-9582d8a49a6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd283bf742a414c87ad49cd66388acae4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:21.365726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-afb69209-a207-486c-b220-9582d8a49a6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd283bf742a414c87ad49cd66388acae4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:21.366780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-afb69209-a207-486c-b220-9582d8a49a6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd283bf742a414c87ad49cd66388acae4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:21.381934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-afb69209-a207-486c-b220-9582d8a49a6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd283bf742a414c87ad49cd66388acae4'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:21.396199 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4070/8072] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:21 2022] DELETE /identity/v3/users/d283bf742a414c87ad49cd66388acae4 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:21.537851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:21.597606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:21.599064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:21.622893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9cadd-bcc7-4056-b6d5-156f5fd726fd admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:21.739609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54186d-f6f5-4b82-a628-d4235df54c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:21.740450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54186d-f6f5-4b82-a628-d4235df54c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:21.740875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54186d-f6f5-4b82-a628-d4235df54c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:21.741251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54186d-f6f5-4b82-a628-d4235df54c8a admin admin] PATH_INFO: `/v3/users/d0e3f1091bb9467e9964ccdd60c53ee9` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:21.743984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54186d-f6f5-4b82-a628-d4235df54c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e3f1091bb9467e9964ccdd60c53ee9)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:21.746275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54186d-f6f5-4b82-a628-d4235df54c8a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:21.836061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb69209-a207-486c-b220-9582d8a49a6f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:21.840601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-afb69209-a207-486c-b220-9582d8a49a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:21.850929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:21.857710 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb69209-a207-486c-b220-9582d8a49a6f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:21.872686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee318ea1-f94f-4cc0-9746-92194694bf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:21.873393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee318ea1-f94f-4cc0-9746-92194694bf70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:21.873678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee318ea1-f94f-4cc0-9746-92194694bf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:21.873950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee318ea1-f94f-4cc0-9746-92194694bf70 admin admin] PATH_INFO: `/v3/projects/cc8caf072c8048b58591931caada8973` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:21.875123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee318ea1-f94f-4cc0-9746-92194694bf70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc8caf072c8048b58591931caada8973)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:21.877437 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee318ea1-f94f-4cc0-9746-92194694bf70 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:22.019674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ee318ea1-f94f-4cc0-9746-92194694bf70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc8caf072c8048b58591931caada8973', 'request_id': 'req-ee318ea1-f94f-4cc0-9746-92194694bf70'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:22.027769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ee318ea1-f94f-4cc0-9746-92194694bf70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc8caf072c8048b58591931caada8973', 'request_id': 'req-ee318ea1-f94f-4cc0-9746-92194694bf70'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:22.041117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5d54186d-f6f5-4b82-a628-d4235df54c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e3f1091bb9467e9964ccdd60c53ee9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:22.160040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ee318ea1-f94f-4cc0-9746-92194694bf70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc8caf072c8048b58591931caada8973', 'request_id': 'req-ee318ea1-f94f-4cc0-9746-92194694bf70'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:22.171837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ee318ea1-f94f-4cc0-9746-92194694bf70 admin admin] The token cache is being invalidate because project cc8caf072c8048b58591931caada8973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:22.172131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ee318ea1-f94f-4cc0-9746-92194694bf70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:22.172806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ee318ea1-f94f-4cc0-9746-92194694bf70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:22.174591 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4071/8073] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:21 2022] DELETE /identity/v3/projects/cc8caf072c8048b58591931caada8973 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:22.181238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c07eb-bb1d-4a69-aea9-b399d95c7850 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:22.181622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c07eb-bb1d-4a69-aea9-b399d95c7850 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:22.181965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c07eb-bb1d-4a69-aea9-b399d95c7850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:22.213550 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0c6c07eb-bb1d-4a69-aea9-b399d95c7850 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:22.215322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0c6c07eb-bb1d-4a69-aea9-b399d95c7850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:22.311547 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4072/8074] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:22.317978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5d54186d-f6f5-4b82-a628-d4235df54c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e3f1091bb9467e9964ccdd60c53ee9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:22.319123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5d54186d-f6f5-4b82-a628-d4235df54c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e3f1091bb9467e9964ccdd60c53ee9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:22.320230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930005a9-8324-4e3a-8787-194e412e684e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:22.320524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930005a9-8324-4e3a-8787-194e412e684e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:22.320796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930005a9-8324-4e3a-8787-194e412e684e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:22.331587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5d54186d-f6f5-4b82-a628-d4235df54c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e3f1091bb9467e9964ccdd60c53ee9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:22.348127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5d54186d-f6f5-4b82-a628-d4235df54c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e3f1091bb9467e9964ccdd60c53ee9'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:22.355530 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4003/8075] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:21 2022] DELETE /identity/v3/users/d0e3f1091bb9467e9964ccdd60c53ee9 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:22.359339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-930005a9-8324-4e3a-8787-194e412e684e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:22.360935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-930005a9-8324-4e3a-8787-194e412e684e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:22.371139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0489b0f-251d-495a-8f31-c1ab90474910 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:22.371659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0489b0f-251d-495a-8f31-c1ab90474910 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:22.371941 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0489b0f-251d-495a-8f31-c1ab90474910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:22.402857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a0489b0f-251d-495a-8f31-c1ab90474910 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:22.404646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a0489b0f-251d-495a-8f31-c1ab90474910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:22.447857 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4073/8076] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:22.449254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930005a9-8324-4e3a-8787-194e412e684e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:22.459769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930005a9-8324-4e3a-8787-194e412e684e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:22.465076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6369ebe-ff7a-40a1-bb93-c1fc80ade148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:22.465689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6369ebe-ff7a-40a1-bb93-c1fc80ade148 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:22.465967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6369ebe-ff7a-40a1-bb93-c1fc80ade148 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:22.466240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6369ebe-ff7a-40a1-bb93-c1fc80ade148 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:22.466890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6369ebe-ff7a-40a1-bb93-c1fc80ade148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:04:22.467197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6369ebe-ff7a-40a1-bb93-c1fc80ade148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:22.469100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6369ebe-ff7a-40a1-bb93-c1fc80ade148 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:22.476742 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4004/8077] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:22.487681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0489b0f-251d-495a-8f31-c1ab90474910 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:22.488291 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4074/8078] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:04:22.489753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a0489b0f-251d-495a-8f31-c1ab90474910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:22.490865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6369ebe-ff7a-40a1-bb93-c1fc80ade148 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:22.501358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6369ebe-ff7a-40a1-bb93-c1fc80ade148 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:22.506631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9a2c6-c77b-435f-9b51-c76c9f6e3c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:22.507231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9a2c6-c77b-435f-9b51-c76c9f6e3c92 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:22.507538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9a2c6-c77b-435f-9b51-c76c9f6e3c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:22.507834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9a2c6-c77b-435f-9b51-c76c9f6e3c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:22.508498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9a2c6-c77b-435f-9b51-c76c9f6e3c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:22.510658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9a2c6-c77b-435f-9b51-c76c9f6e3c92 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:22.557612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0489b0f-251d-495a-8f31-c1ab90474910 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:22.561247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb7614-5ab6-4d6a-b36f-805d3a8128e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:22.561853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb7614-5ab6-4d6a-b36f-805d3a8128e1 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:22.562165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb7614-5ab6-4d6a-b36f-805d3a8128e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:22.562442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb7614-5ab6-4d6a-b36f-805d3a8128e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:22.572316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb7614-5ab6-4d6a-b36f-805d3a8128e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:22.573759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb7614-5ab6-4d6a-b36f-805d3a8128e1 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:22.584652 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4005/8079] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:22.607568 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4075/8080] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:22 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:22.611753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb7614-5ab6-4d6a-b36f-805d3a8128e1 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:22.621984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb7614-5ab6-4d6a-b36f-805d3a8128e1 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:22.689281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6091c9e-d744-4fe1-a350-b67c7b59815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:22.690087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6091c9e-d744-4fe1-a350-b67c7b59815e admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:22.690377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6091c9e-d744-4fe1-a350-b67c7b59815e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:22.691211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6091c9e-d744-4fe1-a350-b67c7b59815e admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:22.692034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6091c9e-d744-4fe1-a350-b67c7b59815e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:22.693975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6091c9e-d744-4fe1-a350-b67c7b59815e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:22.806601 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4006/8081] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:22 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:22.812487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9a2c6-c77b-435f-9b51-c76c9f6e3c92 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:22.832609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9a2c6-c77b-435f-9b51-c76c9f6e3c92 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:22.838293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628549d-902d-437f-874d-d747e8335213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:22.838967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628549d-902d-437f-874d-d747e8335213 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:22.839312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628549d-902d-437f-874d-d747e8335213 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:22.845378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628549d-902d-437f-874d-d747e8335213 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:22.845378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628549d-902d-437f-874d-d747e8335213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:22.845378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628549d-902d-437f-874d-d747e8335213 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:22.854228 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4076/8082] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:22.858486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6091c9e-d744-4fe1-a350-b67c7b59815e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:22.876420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6091c9e-d744-4fe1-a350-b67c7b59815e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:22.881937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea2816-34c1-468f-9ea4-1091dbf8196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:22.882658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea2816-34c1-468f-9ea4-1091dbf8196c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:22.885683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea2816-34c1-468f-9ea4-1091dbf8196c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:22.885683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea2816-34c1-468f-9ea4-1091dbf8196c admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:22.885683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea2816-34c1-468f-9ea4-1091dbf8196c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:22.887100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea2816-34c1-468f-9ea4-1091dbf8196c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:22.898484 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4007/8083] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:22.902761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628549d-902d-437f-874d-d747e8335213 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:22.914747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628549d-902d-437f-874d-d747e8335213 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:22.920232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79dbbf-7b8e-4bfe-8788-cfb5353c6975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:22.920919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79dbbf-7b8e-4bfe-8788-cfb5353c6975 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:22.921203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79dbbf-7b8e-4bfe-8788-cfb5353c6975 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:22.921476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79dbbf-7b8e-4bfe-8788-cfb5353c6975 admin admin] PATH_INFO: `/v3/projects/1ceb28bbdef44170a808c3edf357af4d/users/8f30260c642d458ab1b7e44dab98adec/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:22.939478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79dbbf-7b8e-4bfe-8788-cfb5353c6975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ceb28bbdef44170a808c3edf357af4d, user_id=8f30260c642d458ab1b7e44dab98adec, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:22.943016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79dbbf-7b8e-4bfe-8788-cfb5353c6975 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:23.028838 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4077/8084] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:22 2022] PUT /identity/v3/projects/1ceb28bbdef44170a808c3edf357af4d/users/8f30260c642d458ab1b7e44dab98adec/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:23.039109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8963a-9587-44c2-9c59-1ee0700a091c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:23.039394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8963a-9587-44c2-9c59-1ee0700a091c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:23.039672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8963a-9587-44c2-9c59-1ee0700a091c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:23.069604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-75d8963a-9587-44c2-9c59-1ee0700a091c None None] MFA Rules not processed for user `8f30260c642d458ab1b7e44dab98adec`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:23.073025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-75d8963a-9587-44c2-9c59-1ee0700a091c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:23.098993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79dbbf-7b8e-4bfe-8788-cfb5353c6975 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:23.102590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2c79dbbf-7b8e-4bfe-8788-cfb5353c6975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:23.148336 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4008/8085] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:23.152958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8963a-9587-44c2-9c59-1ee0700a091c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:23.184929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79dbbf-7b8e-4bfe-8788-cfb5353c6975 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:23.190518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260e660-46c9-4ffe-b9fa-540fbe8961c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:23.191652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260e660-46c9-4ffe-b9fa-540fbe8961c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:23.191929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260e660-46c9-4ffe-b9fa-540fbe8961c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:23.192307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260e660-46c9-4ffe-b9fa-540fbe8961c8 admin admin] PATH_INFO: `/v3/projects/a6a8c4f80a6a4466ba1342d7b8ffc2c4` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:23.193572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260e660-46c9-4ffe-b9fa-540fbe8961c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a8c4f80a6a4466ba1342d7b8ffc2c4)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:23.195516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260e660-46c9-4ffe-b9fa-540fbe8961c8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:23.229001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8963a-9587-44c2-9c59-1ee0700a091c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:23.233707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dd861-a039-46fc-a636-4a078af1cba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:23.234308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dd861-a039-46fc-a636-4a078af1cba9 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:23.234587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dd861-a039-46fc-a636-4a078af1cba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:23.235161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dd861-a039-46fc-a636-4a078af1cba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:23.235840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029dd861-a039-46fc-a636-4a078af1cba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:23.238618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029dd861-a039-46fc-a636-4a078af1cba9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:23.327225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0260e660-46c9-4ffe-b9fa-540fbe8961c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a8c4f80a6a4466ba1342d7b8ffc2c4', 'request_id': 'req-0260e660-46c9-4ffe-b9fa-540fbe8961c8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:23.328349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0260e660-46c9-4ffe-b9fa-540fbe8961c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a8c4f80a6a4466ba1342d7b8ffc2c4', 'request_id': 'req-0260e660-46c9-4ffe-b9fa-540fbe8961c8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:23.427684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0260e660-46c9-4ffe-b9fa-540fbe8961c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a8c4f80a6a4466ba1342d7b8ffc2c4', 'request_id': 'req-0260e660-46c9-4ffe-b9fa-540fbe8961c8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:23.436185 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4009/8086] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:23 2022] POST /identity/v3/projects => generated 383 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:23.440152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dd861-a039-46fc-a636-4a078af1cba9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:23.441781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0260e660-46c9-4ffe-b9fa-540fbe8961c8 admin admin] The token cache is being invalidate because project a6a8c4f80a6a4466ba1342d7b8ffc2c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:23.442077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0260e660-46c9-4ffe-b9fa-540fbe8961c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:23.442746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0260e660-46c9-4ffe-b9fa-540fbe8961c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:23.444669 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4078/8087] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:23 2022] DELETE /identity/v3/projects/a6a8c4f80a6a4466ba1342d7b8ffc2c4 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:23.446506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:23.448653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260e660-46c9-4ffe-b9fa-540fbe8961c8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:23.450127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0260e660-46c9-4ffe-b9fa-540fbe8961c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:23.514020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dd861-a039-46fc-a636-4a078af1cba9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:23.519988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce45d55-f93a-46b7-b6c9-dc19b1729436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:23.520533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260e660-46c9-4ffe-b9fa-540fbe8961c8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:23.520722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce45d55-f93a-46b7-b6c9-dc19b1729436 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:23.521093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce45d55-f93a-46b7-b6c9-dc19b1729436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:23.521374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce45d55-f93a-46b7-b6c9-dc19b1729436 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:23.522013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce45d55-f93a-46b7-b6c9-dc19b1729436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:23.524273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce45d55-f93a-46b7-b6c9-dc19b1729436 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:23.525669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7738f4d-93b7-4d78-814d-41f0cbd03558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:23.526392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7738f4d-93b7-4d78-814d-41f0cbd03558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:23.526735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7738f4d-93b7-4d78-814d-41f0cbd03558 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:23.527006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7738f4d-93b7-4d78-814d-41f0cbd03558 admin admin] PATH_INFO: `/v3/users/7dd53571a18e44a29f12ad9a1b375210` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:23.528179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7738f4d-93b7-4d78-814d-41f0cbd03558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd53571a18e44a29f12ad9a1b375210)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:23.530436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7738f4d-93b7-4d78-814d-41f0cbd03558 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:23.593170 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4010/8088] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:23 2022] POST /identity/v3/users => generated 298 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:23.594251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce45d55-f93a-46b7-b6c9-dc19b1729436 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:23.596104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8ce45d55-f93a-46b7-b6c9-dc19b1729436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:23.610082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce45d55-f93a-46b7-b6c9-dc19b1729436 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:23.615347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9296baa-f222-4b0b-8b7f-3ffc1753bee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:23.616031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9296baa-f222-4b0b-8b7f-3ffc1753bee5 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:23.616438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9296baa-f222-4b0b-8b7f-3ffc1753bee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:23.616838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9296baa-f222-4b0b-8b7f-3ffc1753bee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:23.617557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9296baa-f222-4b0b-8b7f-3ffc1753bee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:23.619287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9296baa-f222-4b0b-8b7f-3ffc1753bee5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:23.630347 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4011/8089] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:04:23.634575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9296baa-f222-4b0b-8b7f-3ffc1753bee5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:23.645036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9296baa-f222-4b0b-8b7f-3ffc1753bee5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:23.649786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b241b36-ad66-4988-8384-989beb855fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:23.650421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b241b36-ad66-4988-8384-989beb855fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:23.650703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b241b36-ad66-4988-8384-989beb855fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:23.650980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b241b36-ad66-4988-8384-989beb855fdf admin admin] PATH_INFO: `/v3/projects/58c508772ab841e08fad07c86b795e25/users/21a9254f7b2140a88b93da3eab7d1fd6/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:23.664762 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:23.669511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b241b36-ad66-4988-8384-989beb855fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c508772ab841e08fad07c86b795e25, user_id=21a9254f7b2140a88b93da3eab7d1fd6, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:23.672367 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b241b36-ad66-4988-8384-989beb855fdf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:23.774829 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4012/8090] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:23 2022] PUT /identity/v3/projects/58c508772ab841e08fad07c86b795e25/users/21a9254f7b2140a88b93da3eab7d1fd6/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:23.779314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b241b36-ad66-4988-8384-989beb855fdf admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:23.787692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d7738f4d-93b7-4d78-814d-41f0cbd03558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd53571a18e44a29f12ad9a1b375210'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:23.788430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d7738f4d-93b7-4d78-814d-41f0cbd03558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd53571a18e44a29f12ad9a1b375210'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:23.852093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b241b36-ad66-4988-8384-989beb855fdf admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:23.860193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d1d0f-c68f-4a53-a607-1951c0e7b685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:23.860193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d1d0f-c68f-4a53-a607-1951c0e7b685 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:23.860193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d1d0f-c68f-4a53-a607-1951c0e7b685 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:23.860193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d1d0f-c68f-4a53-a607-1951c0e7b685 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:23.860987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d1d0f-c68f-4a53-a607-1951c0e7b685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:23.860987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d1d0f-c68f-4a53-a607-1951c0e7b685 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:23.875172 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4013/8091] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:04:23.875510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d7738f4d-93b7-4d78-814d-41f0cbd03558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd53571a18e44a29f12ad9a1b375210'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:23.877761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d7738f4d-93b7-4d78-814d-41f0cbd03558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd53571a18e44a29f12ad9a1b375210'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:23.877900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d1d0f-c68f-4a53-a607-1951c0e7b685 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:23.888778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-974d1d0f-c68f-4a53-a607-1951c0e7b685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:23.896333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d7738f4d-93b7-4d78-814d-41f0cbd03558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd53571a18e44a29f12ad9a1b375210'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:23.907220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d1d0f-c68f-4a53-a607-1951c0e7b685 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:23.913239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b12c2-74b9-44ce-8ad2-33125469d4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:23.913905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b12c2-74b9-44ce-8ad2-33125469d4b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:23.926170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b12c2-74b9-44ce-8ad2-33125469d4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:23.926170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b12c2-74b9-44ce-8ad2-33125469d4b4 admin admin] PATH_INFO: `/v3/projects/58c508772ab841e08fad07c86b795e25/users/21a9254f7b2140a88b93da3eab7d1fd6/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:23.926170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b12c2-74b9-44ce-8ad2-33125469d4b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c508772ab841e08fad07c86b795e25, user_id=21a9254f7b2140a88b93da3eab7d1fd6, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:23.926441 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4079/8092] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:23 2022] DELETE /identity/v3/users/7dd53571a18e44a29f12ad9a1b375210 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:23.926528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b12c2-74b9-44ce-8ad2-33125469d4b4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:23.938751 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4014/8093] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:23 2022] PUT /identity/v3/projects/58c508772ab841e08fad07c86b795e25/users/21a9254f7b2140a88b93da3eab7d1fd6/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:23.943802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4d76e-19fc-47b9-bc28-65a9b2632349 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:23.944871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4d76e-19fc-47b9-bc28-65a9b2632349 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:23.954821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4d76e-19fc-47b9-bc28-65a9b2632349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:23.985186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c2d4d76e-19fc-47b9-bc28-65a9b2632349 None None] MFA Rules not processed for user `21a9254f7b2140a88b93da3eab7d1fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:23.986551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c2d4d76e-19fc-47b9-bc28-65a9b2632349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:24.069977 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4080/8094] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:24.080854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b12c2-74b9-44ce-8ad2-33125469d4b4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:24.083396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6d4b12c2-74b9-44ce-8ad2-33125469d4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:24.165163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b12c2-74b9-44ce-8ad2-33125469d4b4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:24.170448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20672307-6e3a-42f5-97b1-1202b6f118d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:24.171275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20672307-6e3a-42f5-97b1-1202b6f118d9 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:24.172105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20672307-6e3a-42f5-97b1-1202b6f118d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:24.179021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20672307-6e3a-42f5-97b1-1202b6f118d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:24.186142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20672307-6e3a-42f5-97b1-1202b6f118d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:24.188271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20672307-6e3a-42f5-97b1-1202b6f118d9 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:24.206979 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4015/8095] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:24.291610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:24.363178 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4d76e-19fc-47b9-bc28-65a9b2632349 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:24.377091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4d76e-19fc-47b9-bc28-65a9b2632349 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:24.383139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1256f01-8833-48f0-9c03-882a0f351af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:24.383757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1256f01-8833-48f0-9c03-882a0f351af6 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:24.384032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1256f01-8833-48f0-9c03-882a0f351af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:24.385994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1256f01-8833-48f0-9c03-882a0f351af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:24.386137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b1256f01-8833-48f0-9c03-882a0f351af6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:24.412365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20672307-6e3a-42f5-97b1-1202b6f118d9 service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:24.413946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-20672307-6e3a-42f5-97b1-1202b6f118d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:24.483880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:24.487653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1256f01-8833-48f0-9c03-882a0f351af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:24.490622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1256f01-8833-48f0-9c03-882a0f351af6 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:24.501601 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4081/8096] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:24.503212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20672307-6e3a-42f5-97b1-1202b6f118d9 service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:24.511604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beaed23-c105-4a59-ab40-82a75852a620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:24.512562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaed23-c105-4a59-ab40-82a75852a620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:24.512957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaed23-c105-4a59-ab40-82a75852a620 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:24.513342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaed23-c105-4a59-ab40-82a75852a620 admin admin] PATH_INFO: `/v3/projects/1b91f57cf66644c080587785dc34d070` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:24.514719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beaed23-c105-4a59-ab40-82a75852a620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b91f57cf66644c080587785dc34d070)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:24.517194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beaed23-c105-4a59-ab40-82a75852a620 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:24.682415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5beaed23-c105-4a59-ab40-82a75852a620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b91f57cf66644c080587785dc34d070', 'request_id': 'req-5beaed23-c105-4a59-ab40-82a75852a620'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:24.689147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5beaed23-c105-4a59-ab40-82a75852a620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b91f57cf66644c080587785dc34d070', 'request_id': 'req-5beaed23-c105-4a59-ab40-82a75852a620'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:24.697002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5beaed23-c105-4a59-ab40-82a75852a620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b91f57cf66644c080587785dc34d070', 'request_id': 'req-5beaed23-c105-4a59-ab40-82a75852a620'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:24.814858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5beaed23-c105-4a59-ab40-82a75852a620 admin admin] The token cache is being invalidate because project 1b91f57cf66644c080587785dc34d070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:24.815139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5beaed23-c105-4a59-ab40-82a75852a620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:24.815826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-5beaed23-c105-4a59-ab40-82a75852a620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:24.818048 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4016/8097] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:24 2022] DELETE /identity/v3/projects/1b91f57cf66644c080587785dc34d070 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:24.822917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8e42c-3b8d-4dde-9df1-6d72ff15b76e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:24.823424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8e42c-3b8d-4dde-9df1-6d72ff15b76e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:24.823809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8e42c-3b8d-4dde-9df1-6d72ff15b76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:24.847322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8cf8e42c-3b8d-4dde-9df1-6d72ff15b76e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:24.849342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8cf8e42c-3b8d-4dde-9df1-6d72ff15b76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:24.920664 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4082/8098] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:24.922246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b435fc-0a23-4299-8b14-c0b653d9b500 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:24.922661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b435fc-0a23-4299-8b14-c0b653d9b500 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:24.922949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b435fc-0a23-4299-8b14-c0b653d9b500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:24.958605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e3b435fc-0a23-4299-8b14-c0b653d9b500 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:24.959937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e3b435fc-0a23-4299-8b14-c0b653d9b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:24.970090 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4017/8099] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:24.974742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8e42c-3b8d-4dde-9df1-6d72ff15b76e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:24.986630 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8e42c-3b8d-4dde-9df1-6d72ff15b76e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:24.993011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2350e-0ce4-4cec-bc82-36a7f608f4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:24.993720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2350e-0ce4-4cec-bc82-36a7f608f4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:24.994049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2350e-0ce4-4cec-bc82-36a7f608f4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:24.994442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2350e-0ce4-4cec-bc82-36a7f608f4a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:24.995164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2350e-0ce4-4cec-bc82-36a7f608f4a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:04:24.995538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2350e-0ce4-4cec-bc82-36a7f608f4a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:24.997346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2350e-0ce4-4cec-bc82-36a7f608f4a4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:25.012569 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4083/8100] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:04:25.030523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b435fc-0a23-4299-8b14-c0b653d9b500 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:25.045321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b435fc-0a23-4299-8b14-c0b653d9b500 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:25.053334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3b769-1bc1-427f-998a-cd2828498adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:25.056025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3b769-1bc1-427f-998a-cd2828498adf admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:25.056025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3b769-1bc1-427f-998a-cd2828498adf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:25.056025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3b769-1bc1-427f-998a-cd2828498adf admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:25.056025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3b769-1bc1-427f-998a-cd2828498adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:25.057633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3b769-1bc1-427f-998a-cd2828498adf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:25.207067 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4018/8101] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:25 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:25.211569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2350e-0ce4-4cec-bc82-36a7f608f4a4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:25.224021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2350e-0ce4-4cec-bc82-36a7f608f4a4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:25.313483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c7e73-28e3-4de0-a1e0-c50f3330933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:25.320719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c7e73-28e3-4de0-a1e0-c50f3330933a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:25.320719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c7e73-28e3-4de0-a1e0-c50f3330933a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:25.320719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c7e73-28e3-4de0-a1e0-c50f3330933a admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:25.320719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c7e73-28e3-4de0-a1e0-c50f3330933a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:25.322572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c7e73-28e3-4de0-a1e0-c50f3330933a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:25.431691 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4084/8102] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:25 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:25.433121 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3b769-1bc1-427f-998a-cd2828498adf admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:25.448022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3b769-1bc1-427f-998a-cd2828498adf admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:25.453108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df85b66-a2c8-464d-be40-34d66ecb644a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:25.453661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df85b66-a2c8-464d-be40-34d66ecb644a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:25.453940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df85b66-a2c8-464d-be40-34d66ecb644a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:25.454213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df85b66-a2c8-464d-be40-34d66ecb644a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:25.454862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df85b66-a2c8-464d-be40-34d66ecb644a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:25.456545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df85b66-a2c8-464d-be40-34d66ecb644a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:25.467878 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4019/8103] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:25.471854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c7e73-28e3-4de0-a1e0-c50f3330933a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:25.482421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c7e73-28e3-4de0-a1e0-c50f3330933a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:25.487059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df1d75-4ade-4ca8-9f29-c35d6005dd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:25.487790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df1d75-4ade-4ca8-9f29-c35d6005dd5f admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:25.488074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df1d75-4ade-4ca8-9f29-c35d6005dd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:25.488380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df1d75-4ade-4ca8-9f29-c35d6005dd5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:25.492034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df1d75-4ade-4ca8-9f29-c35d6005dd5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:25.492034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df1d75-4ade-4ca8-9f29-c35d6005dd5f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:25.502578 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4085/8104] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:25.507380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df85b66-a2c8-464d-be40-34d66ecb644a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:25.518925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df85b66-a2c8-464d-be40-34d66ecb644a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:25.524738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3c457-8bf2-4799-b12d-8458084cc225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:25.525414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3c457-8bf2-4799-b12d-8458084cc225 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:25.525696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3c457-8bf2-4799-b12d-8458084cc225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:25.525973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3c457-8bf2-4799-b12d-8458084cc225 admin admin] PATH_INFO: `/v3/projects/25bce030e38243c2b4cd30a6e86c5e43/users/0e82b6f9d1944f489ce4ddac70a2750e/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:25.543980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3c457-8bf2-4799-b12d-8458084cc225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25bce030e38243c2b4cd30a6e86c5e43, user_id=0e82b6f9d1944f489ce4ddac70a2750e, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:25.546868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3c457-8bf2-4799-b12d-8458084cc225 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:25.641774 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4020/8105] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:25 2022] PUT /identity/v3/projects/25bce030e38243c2b4cd30a6e86c5e43/users/0e82b6f9d1944f489ce4ddac70a2750e/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:25.654413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d09215-f2c1-4cac-a593-b6df4691b797 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:25.654805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d09215-f2c1-4cac-a593-b6df4691b797 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:25.655205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d09215-f2c1-4cac-a593-b6df4691b797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:25.701262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-45d09215-f2c1-4cac-a593-b6df4691b797 None None] MFA Rules not processed for user `0e82b6f9d1944f489ce4ddac70a2750e`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:25.702829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-45d09215-f2c1-4cac-a593-b6df4691b797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:25.792206 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4086/8106] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:25.793691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3c457-8bf2-4799-b12d-8458084cc225 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:25.894253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3c457-8bf2-4799-b12d-8458084cc225 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:25.904650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279367db-7a8f-4864-877a-90f2402ba2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:25.905344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279367db-7a8f-4864-877a-90f2402ba2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:25.905761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279367db-7a8f-4864-877a-90f2402ba2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:25.906202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279367db-7a8f-4864-877a-90f2402ba2b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:25.906919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279367db-7a8f-4864-877a-90f2402ba2b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:25.908944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279367db-7a8f-4864-877a-90f2402ba2b3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:25.942952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:26.019927 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4021/8107] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:25 2022] POST /identity/v3/projects => generated 387 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:26.023926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d09215-f2c1-4cac-a593-b6df4691b797 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:26.036759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d09215-f2c1-4cac-a593-b6df4691b797 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:26.097817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:26.109501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22152b7-eacf-49a1-8a60-c3a6d2455a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:26.110773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22152b7-eacf-49a1-8a60-c3a6d2455a2e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:26.111127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22152b7-eacf-49a1-8a60-c3a6d2455a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:26.111471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22152b7-eacf-49a1-8a60-c3a6d2455a2e admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:26.112399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22152b7-eacf-49a1-8a60-c3a6d2455a2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:26.115286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22152b7-eacf-49a1-8a60-c3a6d2455a2e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:26.211890 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4087/8108] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:26 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:26.215846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279367db-7a8f-4864-877a-90f2402ba2b3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:26.230834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279367db-7a8f-4864-877a-90f2402ba2b3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:26.236966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d58e9-8e3b-4499-8fbe-0f2f16a1da80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:26.237883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d58e9-8e3b-4499-8fbe-0f2f16a1da80 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:26.239160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d58e9-8e3b-4499-8fbe-0f2f16a1da80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:26.239924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d58e9-8e3b-4499-8fbe-0f2f16a1da80 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:26.240867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d58e9-8e3b-4499-8fbe-0f2f16a1da80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:26.242810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d58e9-8e3b-4499-8fbe-0f2f16a1da80 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:26.260599 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4022/8109] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:26.264659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22152b7-eacf-49a1-8a60-c3a6d2455a2e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:26.278388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22152b7-eacf-49a1-8a60-c3a6d2455a2e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:26.284082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03671ce4-273f-4548-be03-ce67b810fa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:26.284796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03671ce4-273f-4548-be03-ce67b810fa59 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:26.286057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03671ce4-273f-4548-be03-ce67b810fa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:26.286626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03671ce4-273f-4548-be03-ce67b810fa59 admin admin] PATH_INFO: `/v3/projects/22f8c7a28b68486d96cfbd3b3cc65633/users/1ec6c01d9aa34156a136600ff126ea4c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:26.318399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03671ce4-273f-4548-be03-ce67b810fa59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f8c7a28b68486d96cfbd3b3cc65633, user_id=1ec6c01d9aa34156a136600ff126ea4c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:26.321330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03671ce4-273f-4548-be03-ce67b810fa59 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:26.429838 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4088/8110] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:26 2022] PUT /identity/v3/projects/22f8c7a28b68486d96cfbd3b3cc65633/users/1ec6c01d9aa34156a136600ff126ea4c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:26.433908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d58e9-8e3b-4499-8fbe-0f2f16a1da80 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:26.444559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d58e9-8e3b-4499-8fbe-0f2f16a1da80 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:26.497013 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:26.520760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daf914-c3ea-4065-bdda-357faedd3d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:26.521381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daf914-c3ea-4065-bdda-357faedd3d57 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:26.521665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daf914-c3ea-4065-bdda-357faedd3d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:26.524453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daf914-c3ea-4065-bdda-357faedd3d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:26.524948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daf914-c3ea-4065-bdda-357faedd3d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:26.526598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daf914-c3ea-4065-bdda-357faedd3d57 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:26.561837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03671ce4-273f-4548-be03-ce67b810fa59 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:26.563489 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4023/8111] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:26.590126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03671ce4-273f-4548-be03-ce67b810fa59 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:26.596880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc427f5c-887f-4e45-aa1f-134a0171954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:26.597638 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc427f5c-887f-4e45-aa1f-134a0171954b admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:26.598634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc427f5c-887f-4e45-aa1f-134a0171954b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:26.598928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc427f5c-887f-4e45-aa1f-134a0171954b admin admin] PATH_INFO: `/v3/projects/22f8c7a28b68486d96cfbd3b3cc65633/users/1ec6c01d9aa34156a136600ff126ea4c/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:26.617138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc427f5c-887f-4e45-aa1f-134a0171954b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f8c7a28b68486d96cfbd3b3cc65633, user_id=1ec6c01d9aa34156a136600ff126ea4c, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:26.626419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc427f5c-887f-4e45-aa1f-134a0171954b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:26.638870 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4089/8112] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:26 2022] PUT /identity/v3/projects/22f8c7a28b68486d96cfbd3b3cc65633/users/1ec6c01d9aa34156a136600ff126ea4c/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:26.650199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f85ecb-aad7-44ec-81a9-98de68b4c420 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:26.650564 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f85ecb-aad7-44ec-81a9-98de68b4c420 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:26.650915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f85ecb-aad7-44ec-81a9-98de68b4c420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:26.683817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-27f85ecb-aad7-44ec-81a9-98de68b4c420 None None] MFA Rules not processed for user `1ec6c01d9aa34156a136600ff126ea4c`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:26.685215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-27f85ecb-aad7-44ec-81a9-98de68b4c420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:26.769204 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4024/8113] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:26.781085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc427f5c-887f-4e45-aa1f-134a0171954b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:26.782861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dc427f5c-887f-4e45-aa1f-134a0171954b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:26.854034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc427f5c-887f-4e45-aa1f-134a0171954b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:26.857895 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41bd09-6bd9-4a48-a9f7-485a85e43006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:26.858575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41bd09-6bd9-4a48-a9f7-485a85e43006 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:26.858917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41bd09-6bd9-4a48-a9f7-485a85e43006 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:26.859270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41bd09-6bd9-4a48-a9f7-485a85e43006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:26.869344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41bd09-6bd9-4a48-a9f7-485a85e43006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:26.870864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41bd09-6bd9-4a48-a9f7-485a85e43006 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:26.880808 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4090/8114] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:27.112739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f85ecb-aad7-44ec-81a9-98de68b4c420 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:27.172102 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:27.185598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f85ecb-aad7-44ec-81a9-98de68b4c420 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:27.193954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d6888-90c8-4669-b691-cba15553f697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:27.194704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d6888-90c8-4669-b691-cba15553f697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:27.195554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d6888-90c8-4669-b691-cba15553f697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:27.195554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d6888-90c8-4669-b691-cba15553f697 admin admin] PATH_INFO: `/v3/users/0e82b6f9d1944f489ce4ddac70a2750e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:27.196532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d6888-90c8-4669-b691-cba15553f697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e82b6f9d1944f489ce4ddac70a2750e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:27.198602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d6888-90c8-4669-b691-cba15553f697 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:27.443217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c2d6888-90c8-4669-b691-cba15553f697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e82b6f9d1944f489ce4ddac70a2750e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:27.554324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c2d6888-90c8-4669-b691-cba15553f697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e82b6f9d1944f489ce4ddac70a2750e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:27.555219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c2d6888-90c8-4669-b691-cba15553f697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e82b6f9d1944f489ce4ddac70a2750e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:27.564395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c2d6888-90c8-4669-b691-cba15553f697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e82b6f9d1944f489ce4ddac70a2750e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:27.579089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7c2d6888-90c8-4669-b691-cba15553f697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e82b6f9d1944f489ce4ddac70a2750e'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:27.586629 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4025/8115] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:27 2022] DELETE /identity/v3/users/0e82b6f9d1944f489ce4ddac70a2750e => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:27.590907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661cc5d-ee0d-4f07-b986-cbe171b6565a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:27.591483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661cc5d-ee0d-4f07-b986-cbe171b6565a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:27.591961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661cc5d-ee0d-4f07-b986-cbe171b6565a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:27.611492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7661cc5d-ee0d-4f07-b986-cbe171b6565a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:27.612805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7661cc5d-ee0d-4f07-b986-cbe171b6565a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:27.634087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:27.697996 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4091/8116] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:27.705046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d6888-90c8-4669-b691-cba15553f697 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:27.706701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7c2d6888-90c8-4669-b691-cba15553f697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:27.776496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d6888-90c8-4669-b691-cba15553f697 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:27.780414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb58be-c7ff-42c2-ae38-05e1ed6fdc7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:27.781064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb58be-c7ff-42c2-ae38-05e1ed6fdc7d service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:27.781289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb58be-c7ff-42c2-ae38-05e1ed6fdc7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:27.781558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb58be-c7ff-42c2-ae38-05e1ed6fdc7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:27.791983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb58be-c7ff-42c2-ae38-05e1ed6fdc7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:27.793365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb58be-c7ff-42c2-ae38-05e1ed6fdc7d service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:27.804342 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4026/8117] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:27.868123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:28.342772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661cc5d-ee0d-4f07-b986-cbe171b6565a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:28.344290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7661cc5d-ee0d-4f07-b986-cbe171b6565a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:28.367930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661cc5d-ee0d-4f07-b986-cbe171b6565a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:28.389072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cab82-737a-4841-a33f-97e1b7c4257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:28.391689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cab82-737a-4841-a33f-97e1b7c4257b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:28.391689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cab82-737a-4841-a33f-97e1b7c4257b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:28.391689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cab82-737a-4841-a33f-97e1b7c4257b admin admin] PATH_INFO: `/v3/projects/25bce030e38243c2b4cd30a6e86c5e43` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:28.391689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cab82-737a-4841-a33f-97e1b7c4257b admin admin] RBAC: Authorizing `identity:delete_project(project_id=25bce030e38243c2b4cd30a6e86c5e43)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:28.394046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cab82-737a-4841-a33f-97e1b7c4257b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:28.542858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2d2cab82-737a-4841-a33f-97e1b7c4257b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25bce030e38243c2b4cd30a6e86c5e43', 'request_id': 'req-2d2cab82-737a-4841-a33f-97e1b7c4257b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:28.550007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2d2cab82-737a-4841-a33f-97e1b7c4257b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25bce030e38243c2b4cd30a6e86c5e43', 'request_id': 'req-2d2cab82-737a-4841-a33f-97e1b7c4257b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:28.570940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:28.667760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2d2cab82-737a-4841-a33f-97e1b7c4257b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25bce030e38243c2b4cd30a6e86c5e43', 'request_id': 'req-2d2cab82-737a-4841-a33f-97e1b7c4257b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:28.683899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2d2cab82-737a-4841-a33f-97e1b7c4257b admin admin] The token cache is being invalidate because project 25bce030e38243c2b4cd30a6e86c5e43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:28.684244 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2d2cab82-737a-4841-a33f-97e1b7c4257b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:28.684946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2d2cab82-737a-4841-a33f-97e1b7c4257b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:28.686738 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4092/8118] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:28 2022] DELETE /identity/v3/projects/25bce030e38243c2b4cd30a6e86c5e43 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:28.690860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb58be-c7ff-42c2-ae38-05e1ed6fdc7d service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:28.706241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb58be-c7ff-42c2-ae38-05e1ed6fdc7d service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:28.773067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d76fe-4434-42f8-bb9b-330d1d2090be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:28.773720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d76fe-4434-42f8-bb9b-330d1d2090be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:28.773992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d76fe-4434-42f8-bb9b-330d1d2090be admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:28.774444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d76fe-4434-42f8-bb9b-330d1d2090be admin admin] PATH_INFO: `/v3/users/1ec6c01d9aa34156a136600ff126ea4c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:28.775797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d76fe-4434-42f8-bb9b-330d1d2090be admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ec6c01d9aa34156a136600ff126ea4c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:28.778213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d76fe-4434-42f8-bb9b-330d1d2090be admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:28.984739 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2f7d76fe-4434-42f8-bb9b-330d1d2090be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ec6c01d9aa34156a136600ff126ea4c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:29.068574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2f7d76fe-4434-42f8-bb9b-330d1d2090be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ec6c01d9aa34156a136600ff126ea4c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:29.069399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2f7d76fe-4434-42f8-bb9b-330d1d2090be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ec6c01d9aa34156a136600ff126ea4c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:29.089883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2f7d76fe-4434-42f8-bb9b-330d1d2090be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ec6c01d9aa34156a136600ff126ea4c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:29.113538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2f7d76fe-4434-42f8-bb9b-330d1d2090be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ec6c01d9aa34156a136600ff126ea4c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:29.121507 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4027/8119] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:28 2022] DELETE /identity/v3/users/1ec6c01d9aa34156a136600ff126ea4c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:29.474424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:29.749683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cab82-737a-4841-a33f-97e1b7c4257b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:29.751192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2d2cab82-737a-4841-a33f-97e1b7c4257b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:29.790347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cab82-737a-4841-a33f-97e1b7c4257b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:29.902906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:29.907858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baca4e7-fd1b-4fe3-9ccd-6018d13bb83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:29.909004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baca4e7-fd1b-4fe3-9ccd-6018d13bb83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:29.909506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baca4e7-fd1b-4fe3-9ccd-6018d13bb83a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:29.910311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baca4e7-fd1b-4fe3-9ccd-6018d13bb83a admin admin] PATH_INFO: `/v3/projects/22f8c7a28b68486d96cfbd3b3cc65633` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:29.912147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baca4e7-fd1b-4fe3-9ccd-6018d13bb83a admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f8c7a28b68486d96cfbd3b3cc65633)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:29.914249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baca4e7-fd1b-4fe3-9ccd-6018d13bb83a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:30.061120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1baca4e7-fd1b-4fe3-9ccd-6018d13bb83a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f8c7a28b68486d96cfbd3b3cc65633', 'request_id': 'req-1baca4e7-fd1b-4fe3-9ccd-6018d13bb83a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:30.067680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1baca4e7-fd1b-4fe3-9ccd-6018d13bb83a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f8c7a28b68486d96cfbd3b3cc65633', 'request_id': 'req-1baca4e7-fd1b-4fe3-9ccd-6018d13bb83a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:30.157663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1baca4e7-fd1b-4fe3-9ccd-6018d13bb83a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f8c7a28b68486d96cfbd3b3cc65633', 'request_id': 'req-1baca4e7-fd1b-4fe3-9ccd-6018d13bb83a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:30.170436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1baca4e7-fd1b-4fe3-9ccd-6018d13bb83a admin admin] The token cache is being invalidate because project 22f8c7a28b68486d96cfbd3b3cc65633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:30.170741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1baca4e7-fd1b-4fe3-9ccd-6018d13bb83a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:30.172430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1baca4e7-fd1b-4fe3-9ccd-6018d13bb83a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:30.173025 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4093/8120] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:29 2022] DELETE /identity/v3/projects/22f8c7a28b68486d96cfbd3b3cc65633 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:30.178732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f380d-8a96-42b6-9356-a4798090545d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:30.179321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f380d-8a96-42b6-9356-a4798090545d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:30.179321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f380d-8a96-42b6-9356-a4798090545d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:30.203544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-921f380d-8a96-42b6-9356-a4798090545d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:30.204905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-921f380d-8a96-42b6-9356-a4798090545d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:30.278186 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4028/8121] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:04:30.287846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e4308-a0f2-4198-a53e-b7bcdefad024 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:30.288256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e4308-a0f2-4198-a53e-b7bcdefad024 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:30.290729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e4308-a0f2-4198-a53e-b7bcdefad024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:30.314096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7d6e4308-a0f2-4198-a53e-b7bcdefad024 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:30.315438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7d6e4308-a0f2-4198-a53e-b7bcdefad024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:30.329808 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4094/8122] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:04:30.334767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f380d-8a96-42b6-9356-a4798090545d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:30.345726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f380d-8a96-42b6-9356-a4798090545d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:30.351401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b00c7-da97-4ff1-9cfa-4a9a0c972141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:30.353819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b00c7-da97-4ff1-9cfa-4a9a0c972141 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:30.353819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b00c7-da97-4ff1-9cfa-4a9a0c972141 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:30.353819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b00c7-da97-4ff1-9cfa-4a9a0c972141 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:30.353819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b00c7-da97-4ff1-9cfa-4a9a0c972141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:04:30.353819 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b00c7-da97-4ff1-9cfa-4a9a0c972141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:30.355175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b00c7-da97-4ff1-9cfa-4a9a0c972141 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:30.367846 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4029/8123] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:04:30.372280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e4308-a0f2-4198-a53e-b7bcdefad024 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:30.382761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e4308-a0f2-4198-a53e-b7bcdefad024 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:30.387757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d506f1-b970-4a6f-98a1-7e1cba8e1fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:30.388407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d506f1-b970-4a6f-98a1-7e1cba8e1fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:30.388692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d506f1-b970-4a6f-98a1-7e1cba8e1fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:30.388965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d506f1-b970-4a6f-98a1-7e1cba8e1fe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:30.390074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d506f1-b970-4a6f-98a1-7e1cba8e1fe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:30.394066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d506f1-b970-4a6f-98a1-7e1cba8e1fe8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:30.513839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:30.519101 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4095/8124] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:30 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:30.520984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b00c7-da97-4ff1-9cfa-4a9a0c972141 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:30.532882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b00c7-da97-4ff1-9cfa-4a9a0c972141 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:30.597618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba6918-73e2-42ca-a73f-46f444cadbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:30.599578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba6918-73e2-42ca-a73f-46f444cadbd5 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:30.600020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba6918-73e2-42ca-a73f-46f444cadbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:30.600527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba6918-73e2-42ca-a73f-46f444cadbd5 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:30.601317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba6918-73e2-42ca-a73f-46f444cadbd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:30.603430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba6918-73e2-42ca-a73f-46f444cadbd5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:30.686970 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4030/8125] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:30 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:30.692055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d506f1-b970-4a6f-98a1-7e1cba8e1fe8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:30.718548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d506f1-b970-4a6f-98a1-7e1cba8e1fe8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:30.723673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f6087-c297-4c48-8a2b-e385f313d9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:30.724547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f6087-c297-4c48-8a2b-e385f313d9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:30.822845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f6087-c297-4c48-8a2b-e385f313d9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:30.822845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f6087-c297-4c48-8a2b-e385f313d9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:30.822845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f6087-c297-4c48-8a2b-e385f313d9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:30.822845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f6087-c297-4c48-8a2b-e385f313d9f6 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:30.822845 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4096/8126] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:30.823929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba6918-73e2-42ca-a73f-46f444cadbd5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:30.823929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba6918-73e2-42ca-a73f-46f444cadbd5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:30.823929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e27f6a-c919-48f7-ab9c-0adeaceca270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:30.823929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e27f6a-c919-48f7-ab9c-0adeaceca270 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:30.824328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e27f6a-c919-48f7-ab9c-0adeaceca270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:30.824328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e27f6a-c919-48f7-ab9c-0adeaceca270 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:30.824328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e27f6a-c919-48f7-ab9c-0adeaceca270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:30.824328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e27f6a-c919-48f7-ab9c-0adeaceca270 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:30.824328 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4031/8127] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:04:30.824725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f6087-c297-4c48-8a2b-e385f313d9f6 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:30.824725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f6087-c297-4c48-8a2b-e385f313d9f6 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:30.824725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d58e83-e90f-49eb-8dd7-f7f0acbf261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:30.824725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d58e83-e90f-49eb-8dd7-f7f0acbf261b admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:30.825116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d58e83-e90f-49eb-8dd7-f7f0acbf261b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:30.825116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d58e83-e90f-49eb-8dd7-f7f0acbf261b admin admin] PATH_INFO: `/v3/projects/4788f90a6a034fbc873a5d088ae79846/users/84b7f6ddd3a248599b70182019740391/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:30.825116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d58e83-e90f-49eb-8dd7-f7f0acbf261b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4788f90a6a034fbc873a5d088ae79846, user_id=84b7f6ddd3a248599b70182019740391, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:30.825116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d58e83-e90f-49eb-8dd7-f7f0acbf261b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:30.950269 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4097/8128] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:30 2022] PUT /identity/v3/projects/4788f90a6a034fbc873a5d088ae79846/users/84b7f6ddd3a248599b70182019740391/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:31.008887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba305f-2d5b-4b6d-8da7-4f6dd89eea82 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:31.008887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba305f-2d5b-4b6d-8da7-4f6dd89eea82 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:31.008887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba305f-2d5b-4b6d-8da7-4f6dd89eea82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:31.008887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c1ba305f-2d5b-4b6d-8da7-4f6dd89eea82 None None] MFA Rules not processed for user `84b7f6ddd3a248599b70182019740391`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:31.011923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c1ba305f-2d5b-4b6d-8da7-4f6dd89eea82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:31.046116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:31.104964 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4032/8129] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:31.105734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d58e83-e90f-49eb-8dd7-f7f0acbf261b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:31.173288 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba305f-2d5b-4b6d-8da7-4f6dd89eea82 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:31.174792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c1ba305f-2d5b-4b6d-8da7-4f6dd89eea82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:31.229792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d58e83-e90f-49eb-8dd7-f7f0acbf261b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:31.236588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814cf10-cf14-4be1-aeb0-a4c0a34b23f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:31.237494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814cf10-cf14-4be1-aeb0-a4c0a34b23f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:31.237976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814cf10-cf14-4be1-aeb0-a4c0a34b23f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:31.239863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814cf10-cf14-4be1-aeb0-a4c0a34b23f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:31.240760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814cf10-cf14-4be1-aeb0-a4c0a34b23f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:31.243164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814cf10-cf14-4be1-aeb0-a4c0a34b23f2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:31.265232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba305f-2d5b-4b6d-8da7-4f6dd89eea82 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:31.271137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c0ba5-f3a3-4aaf-955f-b6e85e371004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:31.271838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c0ba5-f3a3-4aaf-955f-b6e85e371004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:31.272124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c0ba5-f3a3-4aaf-955f-b6e85e371004 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:31.276180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c0ba5-f3a3-4aaf-955f-b6e85e371004 admin admin] PATH_INFO: `/v3/users/8f30260c642d458ab1b7e44dab98adec` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:31.276180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c0ba5-f3a3-4aaf-955f-b6e85e371004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f30260c642d458ab1b7e44dab98adec)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:31.276180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c0ba5-f3a3-4aaf-955f-b6e85e371004 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:31.334891 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4098/8130] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:31 2022] POST /identity/v3/projects => generated 381 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:31.338840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814cf10-cf14-4be1-aeb0-a4c0a34b23f2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:31.411870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814cf10-cf14-4be1-aeb0-a4c0a34b23f2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:31.417113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083559c-917f-4b51-a892-955f47ec884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:31.417735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083559c-917f-4b51-a892-955f47ec884a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:31.418156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083559c-917f-4b51-a892-955f47ec884a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:31.418429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083559c-917f-4b51-a892-955f47ec884a admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:31.419061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083559c-917f-4b51-a892-955f47ec884a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:31.421138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083559c-917f-4b51-a892-955f47ec884a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:31.502209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:31.547266 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4099/8131] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:31 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:31.550575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083559c-917f-4b51-a892-955f47ec884a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:31.562882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-311c0ba5-f3a3-4aaf-955f-b6e85e371004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f30260c642d458ab1b7e44dab98adec'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:31.574773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083559c-917f-4b51-a892-955f47ec884a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:31.579688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36817bdc-bc92-46bf-90e2-b6ac92146523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:31.580381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36817bdc-bc92-46bf-90e2-b6ac92146523 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:31.580631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36817bdc-bc92-46bf-90e2-b6ac92146523 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:31.580899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36817bdc-bc92-46bf-90e2-b6ac92146523 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:31.581563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36817bdc-bc92-46bf-90e2-b6ac92146523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:31.583485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36817bdc-bc92-46bf-90e2-b6ac92146523 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:31.594758 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4100/8132] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:04:31.599846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36817bdc-bc92-46bf-90e2-b6ac92146523 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:31.610119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36817bdc-bc92-46bf-90e2-b6ac92146523 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:31.616086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fefc3a-5bee-4180-8e8d-775ad0716490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:31.616832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fefc3a-5bee-4180-8e8d-775ad0716490 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:31.617117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fefc3a-5bee-4180-8e8d-775ad0716490 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:31.617389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fefc3a-5bee-4180-8e8d-775ad0716490 admin admin] PATH_INFO: `/v3/projects/7b82bb1ab10d47018a2ada8ec01bd13e/users/db65f936ac294f4bbb12f668ae523fc6/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:31.633705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fefc3a-5bee-4180-8e8d-775ad0716490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b82bb1ab10d47018a2ada8ec01bd13e, user_id=db65f936ac294f4bbb12f668ae523fc6, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:31.638800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fefc3a-5bee-4180-8e8d-775ad0716490 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:31.656083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-311c0ba5-f3a3-4aaf-955f-b6e85e371004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f30260c642d458ab1b7e44dab98adec'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:31.657798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-311c0ba5-f3a3-4aaf-955f-b6e85e371004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f30260c642d458ab1b7e44dab98adec'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:31.666274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-311c0ba5-f3a3-4aaf-955f-b6e85e371004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f30260c642d458ab1b7e44dab98adec'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:31.684451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-311c0ba5-f3a3-4aaf-955f-b6e85e371004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f30260c642d458ab1b7e44dab98adec'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:31.690726 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4033/8133] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:31 2022] DELETE /identity/v3/users/8f30260c642d458ab1b7e44dab98adec => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:31.703312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62c28-2102-45e1-a6e7-d17d05f3e001 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:31.703312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62c28-2102-45e1-a6e7-d17d05f3e001 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:31.703312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62c28-2102-45e1-a6e7-d17d05f3e001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:31.724011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-95d62c28-2102-45e1-a6e7-d17d05f3e001 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:31.725348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-95d62c28-2102-45e1-a6e7-d17d05f3e001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:31.737420 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4101/8134] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:31 2022] PUT /identity/v3/projects/7b82bb1ab10d47018a2ada8ec01bd13e/users/db65f936ac294f4bbb12f668ae523fc6/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:31.747093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fefc3a-5bee-4180-8e8d-775ad0716490 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:31.749109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-28fefc3a-5bee-4180-8e8d-775ad0716490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:31.812826 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4034/8135] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:31.821557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d62c28-2102-45e1-a6e7-d17d05f3e001 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:31.823076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-95d62c28-2102-45e1-a6e7-d17d05f3e001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:31.831068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fefc3a-5bee-4180-8e8d-775ad0716490 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:31.836767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb2a89-7641-4fd7-8338-1e112bed005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:31.837842 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb2a89-7641-4fd7-8338-1e112bed005b admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:31.838117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb2a89-7641-4fd7-8338-1e112bed005b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:31.838391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb2a89-7641-4fd7-8338-1e112bed005b admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:31.839089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb2a89-7641-4fd7-8338-1e112bed005b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:31.840779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb2a89-7641-4fd7-8338-1e112bed005b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:31.858069 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4102/8136] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:04:31.859114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb2a89-7641-4fd7-8338-1e112bed005b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:31.870398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb2a89-7641-4fd7-8338-1e112bed005b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:31.875465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b34801-bd33-4a73-ae11-2553581748b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:31.876423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b34801-bd33-4a73-ae11-2553581748b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:31.876814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b34801-bd33-4a73-ae11-2553581748b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:31.877137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b34801-bd33-4a73-ae11-2553581748b3 admin admin] PATH_INFO: `/v3/projects/7b82bb1ab10d47018a2ada8ec01bd13e/users/db65f936ac294f4bbb12f668ae523fc6/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:31.879312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b34801-bd33-4a73-ae11-2553581748b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b82bb1ab10d47018a2ada8ec01bd13e, user_id=db65f936ac294f4bbb12f668ae523fc6, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:31.882121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b34801-bd33-4a73-ae11-2553581748b3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:31.892700 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4103/8137] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:31 2022] PUT /identity/v3/projects/7b82bb1ab10d47018a2ada8ec01bd13e/users/db65f936ac294f4bbb12f668ae523fc6/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:31.895823 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d62c28-2102-45e1-a6e7-d17d05f3e001 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:31.904922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edbf13-1402-4aea-bda3-846f030dd785 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:31.905282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edbf13-1402-4aea-bda3-846f030dd785 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:31.905556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edbf13-1402-4aea-bda3-846f030dd785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:31.936385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-82edbf13-1402-4aea-bda3-846f030dd785 None None] MFA Rules not processed for user `db65f936ac294f4bbb12f668ae523fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:31.937851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-82edbf13-1402-4aea-bda3-846f030dd785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:31.947275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdf26e-94b6-48df-bb9e-132e6b5514ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:31.947986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdf26e-94b6-48df-bb9e-132e6b5514ff service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:31.948189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdf26e-94b6-48df-bb9e-132e6b5514ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:31.948475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdf26e-94b6-48df-bb9e-132e6b5514ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:32.015484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdf26e-94b6-48df-bb9e-132e6b5514ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:32.016965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdf26e-94b6-48df-bb9e-132e6b5514ff service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:32.027611 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4035/8138] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:04:32.030201 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4104/8139] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:32.045326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdf26e-94b6-48df-bb9e-132e6b5514ff service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:32.045326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-27bdf26e-94b6-48df-bb9e-132e6b5514ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:32.142295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:32.145526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdf26e-94b6-48df-bb9e-132e6b5514ff service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:32.150186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825570e-cdcc-4247-aa26-aba5e6c32a15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:32.150799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825570e-cdcc-4247-aa26-aba5e6c32a15 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:32.153217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825570e-cdcc-4247-aa26-aba5e6c32a15 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:32.153217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825570e-cdcc-4247-aa26-aba5e6c32a15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:32.164483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825570e-cdcc-4247-aa26-aba5e6c32a15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:32.165942 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825570e-cdcc-4247-aa26-aba5e6c32a15 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:32.182154 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4036/8140] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:32.388809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edbf13-1402-4aea-bda3-846f030dd785 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:32.404515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edbf13-1402-4aea-bda3-846f030dd785 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:32.416292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51396d-1bd2-4b38-8e6e-36440d4298b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:32.416292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51396d-1bd2-4b38-8e6e-36440d4298b2 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:32.416292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51396d-1bd2-4b38-8e6e-36440d4298b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:32.416292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51396d-1bd2-4b38-8e6e-36440d4298b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:32.418132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4b51396d-1bd2-4b38-8e6e-36440d4298b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:32.422424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:32.499427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51396d-1bd2-4b38-8e6e-36440d4298b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:32.501210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51396d-1bd2-4b38-8e6e-36440d4298b2 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:32.512265 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4105/8141] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:32.630790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825570e-cdcc-4247-aa26-aba5e6c32a15 service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:32.632529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9825570e-cdcc-4247-aa26-aba5e6c32a15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:32.661460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825570e-cdcc-4247-aa26-aba5e6c32a15 service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:32.665038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc20669-0e76-4a7b-b082-3c1d15551641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:32.665842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc20669-0e76-4a7b-b082-3c1d15551641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:32.666128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc20669-0e76-4a7b-b082-3c1d15551641 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:32.666407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc20669-0e76-4a7b-b082-3c1d15551641 admin admin] PATH_INFO: `/v3/projects/1ceb28bbdef44170a808c3edf357af4d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:32.667839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc20669-0e76-4a7b-b082-3c1d15551641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ceb28bbdef44170a808c3edf357af4d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:32.670620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc20669-0e76-4a7b-b082-3c1d15551641 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:32.819556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2bc20669-0e76-4a7b-b082-3c1d15551641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ceb28bbdef44170a808c3edf357af4d', 'request_id': 'req-2bc20669-0e76-4a7b-b082-3c1d15551641'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:32.826815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2bc20669-0e76-4a7b-b082-3c1d15551641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ceb28bbdef44170a808c3edf357af4d', 'request_id': 'req-2bc20669-0e76-4a7b-b082-3c1d15551641'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:32.835707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2bc20669-0e76-4a7b-b082-3c1d15551641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ceb28bbdef44170a808c3edf357af4d', 'request_id': 'req-2bc20669-0e76-4a7b-b082-3c1d15551641'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:32.907421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2bc20669-0e76-4a7b-b082-3c1d15551641 admin admin] The token cache is being invalidate because project 1ceb28bbdef44170a808c3edf357af4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:32.907797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2bc20669-0e76-4a7b-b082-3c1d15551641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:32.909000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2bc20669-0e76-4a7b-b082-3c1d15551641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:32.911630 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4037/8142] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:32 2022] DELETE /identity/v3/projects/1ceb28bbdef44170a808c3edf357af4d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:32.915815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51396d-1bd2-4b38-8e6e-36440d4298b2 service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:32.974334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51396d-1bd2-4b38-8e6e-36440d4298b2 service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:33.043548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc20669-0e76-4a7b-b082-3c1d15551641 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:33.046436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2bc20669-0e76-4a7b-b082-3c1d15551641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:33.057488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eed264-b854-444e-bc00-191a34cd2219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:33.058135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eed264-b854-444e-bc00-191a34cd2219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:33.058414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eed264-b854-444e-bc00-191a34cd2219 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:33.058688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eed264-b854-444e-bc00-191a34cd2219 admin admin] PATH_INFO: `/v3/users/21a9254f7b2140a88b93da3eab7d1fd6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:33.059875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eed264-b854-444e-bc00-191a34cd2219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a9254f7b2140a88b93da3eab7d1fd6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:33.061911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eed264-b854-444e-bc00-191a34cd2219 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:33.117733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc20669-0e76-4a7b-b082-3c1d15551641 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:33.123046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42b2b6-0c34-4a05-9515-8f8d7aa7bf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:33.123679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42b2b6-0c34-4a05-9515-8f8d7aa7bf81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:33.123962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42b2b6-0c34-4a05-9515-8f8d7aa7bf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:33.124277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42b2b6-0c34-4a05-9515-8f8d7aa7bf81 admin admin] PATH_INFO: `/v3/users/84b7f6ddd3a248599b70182019740391` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:33.125465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42b2b6-0c34-4a05-9515-8f8d7aa7bf81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b7f6ddd3a248599b70182019740391)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:33.127588 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42b2b6-0c34-4a05-9515-8f8d7aa7bf81 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:33.304718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-51eed264-b854-444e-bc00-191a34cd2219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a9254f7b2140a88b93da3eab7d1fd6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:33.305392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-51eed264-b854-444e-bc00-191a34cd2219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a9254f7b2140a88b93da3eab7d1fd6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:33.416420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-51eed264-b854-444e-bc00-191a34cd2219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a9254f7b2140a88b93da3eab7d1fd6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:33.421454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-51eed264-b854-444e-bc00-191a34cd2219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a9254f7b2140a88b93da3eab7d1fd6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:33.432113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-51eed264-b854-444e-bc00-191a34cd2219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a9254f7b2140a88b93da3eab7d1fd6'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:33.446916 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4106/8143] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:32 2022] DELETE /identity/v3/users/21a9254f7b2140a88b93da3eab7d1fd6 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:33.459924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c42b2b6-0c34-4a05-9515-8f8d7aa7bf81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b7f6ddd3a248599b70182019740391'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:33.581756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c42b2b6-0c34-4a05-9515-8f8d7aa7bf81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b7f6ddd3a248599b70182019740391'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:33.583265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c42b2b6-0c34-4a05-9515-8f8d7aa7bf81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b7f6ddd3a248599b70182019740391'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:33.592597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c42b2b6-0c34-4a05-9515-8f8d7aa7bf81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b7f6ddd3a248599b70182019740391'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:33.606980 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2c42b2b6-0c34-4a05-9515-8f8d7aa7bf81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b7f6ddd3a248599b70182019740391'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:33.614563 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4038/8144] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:33 2022] DELETE /identity/v3/users/84b7f6ddd3a248599b70182019740391 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:33.618914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7f02-d10f-40cc-a4b7-c0606915c5f0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:33.619280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7f02-d10f-40cc-a4b7-c0606915c5f0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:33.619667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7f02-d10f-40cc-a4b7-c0606915c5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:33.640372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6b2d7f02-d10f-40cc-a4b7-c0606915c5f0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:33.641739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6b2d7f02-d10f-40cc-a4b7-c0606915c5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:33.721157 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4107/8145] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:33.733991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42b2b6-0c34-4a05-9515-8f8d7aa7bf81 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:33.738701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2c42b2b6-0c34-4a05-9515-8f8d7aa7bf81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:33.755384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:33.793798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:33.827849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42b2b6-0c34-4a05-9515-8f8d7aa7bf81 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:33.832902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711fb3d-98f7-49a6-9d0d-635fb8270980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:33.833802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711fb3d-98f7-49a6-9d0d-635fb8270980 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:33.834231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711fb3d-98f7-49a6-9d0d-635fb8270980 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:33.834515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711fb3d-98f7-49a6-9d0d-635fb8270980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:33.844450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711fb3d-98f7-49a6-9d0d-635fb8270980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:33.845935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711fb3d-98f7-49a6-9d0d-635fb8270980 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:33.856101 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4039/8146] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:33.932626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d7f02-d10f-40cc-a4b7-c0606915c5f0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:33.934681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6b2d7f02-d10f-40cc-a4b7-c0606915c5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:33.948322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d7f02-d10f-40cc-a4b7-c0606915c5f0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:33.954131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fac732-9166-42be-92cc-94d054c9516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:33.955044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fac732-9166-42be-92cc-94d054c9516d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:33.955397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fac732-9166-42be-92cc-94d054c9516d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:33.955790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fac732-9166-42be-92cc-94d054c9516d admin admin] PATH_INFO: `/v3/projects/58c508772ab841e08fad07c86b795e25` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:33.957909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fac732-9166-42be-92cc-94d054c9516d admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c508772ab841e08fad07c86b795e25)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:33.963507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fac732-9166-42be-92cc-94d054c9516d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:34.109316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-88fac732-9166-42be-92cc-94d054c9516d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c508772ab841e08fad07c86b795e25', 'request_id': 'req-88fac732-9166-42be-92cc-94d054c9516d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:34.117801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-88fac732-9166-42be-92cc-94d054c9516d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c508772ab841e08fad07c86b795e25', 'request_id': 'req-88fac732-9166-42be-92cc-94d054c9516d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:34.221628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-88fac732-9166-42be-92cc-94d054c9516d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c508772ab841e08fad07c86b795e25', 'request_id': 'req-88fac732-9166-42be-92cc-94d054c9516d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:34.238849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-88fac732-9166-42be-92cc-94d054c9516d admin admin] The token cache is being invalidate because project 58c508772ab841e08fad07c86b795e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:34.239531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-88fac732-9166-42be-92cc-94d054c9516d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:34.240470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-88fac732-9166-42be-92cc-94d054c9516d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:34.242735 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4108/8147] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:33 2022] DELETE /identity/v3/projects/58c508772ab841e08fad07c86b795e25 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:34.249930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d30f25-576b-4584-80c4-507cb15ca1c2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:34.250211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d30f25-576b-4584-80c4-507cb15ca1c2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:34.250489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d30f25-576b-4584-80c4-507cb15ca1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:34.308549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-83d30f25-576b-4584-80c4-507cb15ca1c2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:34.312089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-83d30f25-576b-4584-80c4-507cb15ca1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:34.376657 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4040/8148] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:34.387102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4dec8-323e-4544-8384-269394a3418c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:34.387388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4dec8-323e-4544-8384-269394a3418c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:34.387673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4dec8-323e-4544-8384-269394a3418c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:34.408131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d9f4dec8-323e-4544-8384-269394a3418c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:34.409378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d9f4dec8-323e-4544-8384-269394a3418c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:34.417811 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4109/8149] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:34.422069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d30f25-576b-4584-80c4-507cb15ca1c2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:34.432711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d30f25-576b-4584-80c4-507cb15ca1c2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:34.437224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de01330-2c19-4d82-b5af-097a722c68bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:34.438053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de01330-2c19-4d82-b5af-097a722c68bd admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:34.438188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de01330-2c19-4d82-b5af-097a722c68bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:34.438371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de01330-2c19-4d82-b5af-097a722c68bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:34.439018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de01330-2c19-4d82-b5af-097a722c68bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:04:34.439323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de01330-2c19-4d82-b5af-097a722c68bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:34.440984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de01330-2c19-4d82-b5af-097a722c68bd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:34.456327 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4041/8150] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:04:34.458879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4dec8-323e-4544-8384-269394a3418c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:34.468964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4dec8-323e-4544-8384-269394a3418c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:34.474449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6371bb-c857-453e-9a37-3f3801ea701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:34.475058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6371bb-c857-453e-9a37-3f3801ea701a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:34.475335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6371bb-c857-453e-9a37-3f3801ea701a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:34.475609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6371bb-c857-453e-9a37-3f3801ea701a admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:34.476280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6371bb-c857-453e-9a37-3f3801ea701a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:34.478192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6371bb-c857-453e-9a37-3f3801ea701a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:34.492993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de01330-2c19-4d82-b5af-097a722c68bd admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:34.496241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5de01330-2c19-4d82-b5af-097a722c68bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:34.516068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de01330-2c19-4d82-b5af-097a722c68bd admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:34.519839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe3cca-8903-4f1f-ac87-49978229ca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:34.520703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe3cca-8903-4f1f-ac87-49978229ca49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:34.520994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe3cca-8903-4f1f-ac87-49978229ca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:34.521267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe3cca-8903-4f1f-ac87-49978229ca49 admin admin] PATH_INFO: `/v3/projects/4788f90a6a034fbc873a5d088ae79846` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:34.522579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe3cca-8903-4f1f-ac87-49978229ca49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4788f90a6a034fbc873a5d088ae79846)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:34.524601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe3cca-8903-4f1f-ac87-49978229ca49 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:34.614425 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4110/8151] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:34 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:34.619279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6371bb-c857-453e-9a37-3f3801ea701a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:34.660431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bbbe3cca-8903-4f1f-ac87-49978229ca49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4788f90a6a034fbc873a5d088ae79846', 'request_id': 'req-bbbe3cca-8903-4f1f-ac87-49978229ca49'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:34.674423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bbbe3cca-8903-4f1f-ac87-49978229ca49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4788f90a6a034fbc873a5d088ae79846', 'request_id': 'req-bbbe3cca-8903-4f1f-ac87-49978229ca49'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:34.684274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bbbe3cca-8903-4f1f-ac87-49978229ca49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4788f90a6a034fbc873a5d088ae79846', 'request_id': 'req-bbbe3cca-8903-4f1f-ac87-49978229ca49'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:34.718358 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6371bb-c857-453e-9a37-3f3801ea701a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:34.759461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:34.782300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f132db1-cd5e-4b04-8003-c0bf4c88424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:34.782920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f132db1-cd5e-4b04-8003-c0bf4c88424e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:34.785790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f132db1-cd5e-4b04-8003-c0bf4c88424e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:34.785790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f132db1-cd5e-4b04-8003-c0bf4c88424e admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:34.785790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f132db1-cd5e-4b04-8003-c0bf4c88424e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:34.787394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f132db1-cd5e-4b04-8003-c0bf4c88424e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:34.810084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bbbe3cca-8903-4f1f-ac87-49978229ca49 admin admin] The token cache is being invalidate because project 4788f90a6a034fbc873a5d088ae79846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:34.810426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bbbe3cca-8903-4f1f-ac87-49978229ca49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:34.811204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bbbe3cca-8903-4f1f-ac87-49978229ca49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:34.812808 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4042/8152] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:34 2022] DELETE /identity/v3/projects/4788f90a6a034fbc873a5d088ae79846 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:34.816743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe3cca-8903-4f1f-ac87-49978229ca49 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:34.818044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bbbe3cca-8903-4f1f-ac87-49978229ca49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:34.831497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe3cca-8903-4f1f-ac87-49978229ca49 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:34.836933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abe1d2-7cf7-40dc-886e-f922c1043ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:34.837553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abe1d2-7cf7-40dc-886e-f922c1043ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:34.837836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abe1d2-7cf7-40dc-886e-f922c1043ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:34.838113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abe1d2-7cf7-40dc-886e-f922c1043ebe admin admin] PATH_INFO: `/v3/users/db65f936ac294f4bbb12f668ae523fc6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:34.839246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abe1d2-7cf7-40dc-886e-f922c1043ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=db65f936ac294f4bbb12f668ae523fc6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:34.841241 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abe1d2-7cf7-40dc-886e-f922c1043ebe admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:34.903697 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4111/8153] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:34 2022] POST /identity/v3/users => generated 287 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:34.908972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f132db1-cd5e-4b04-8003-c0bf4c88424e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:34.911935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5f132db1-cd5e-4b04-8003-c0bf4c88424e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:34.926213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f132db1-cd5e-4b04-8003-c0bf4c88424e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:34.947906 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc1598-2cf9-4da8-82ea-62f7ede95d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:34.948610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1598-2cf9-4da8-82ea-62f7ede95d57 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:34.948854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1598-2cf9-4da8-82ea-62f7ede95d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:34.949127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1598-2cf9-4da8-82ea-62f7ede95d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:34.949792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc1598-2cf9-4da8-82ea-62f7ede95d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:34.951396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc1598-2cf9-4da8-82ea-62f7ede95d57 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:34.966328 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4112/8154] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:04:34.972039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc1598-2cf9-4da8-82ea-62f7ede95d57 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:34.983196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc1598-2cf9-4da8-82ea-62f7ede95d57 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:34.987889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa08c0d-05d3-4641-82b4-fed0bcfd3eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:34.988798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa08c0d-05d3-4641-82b4-fed0bcfd3eaa admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:34.988941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa08c0d-05d3-4641-82b4-fed0bcfd3eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:34.989139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa08c0d-05d3-4641-82b4-fed0bcfd3eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:34.989774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa08c0d-05d3-4641-82b4-fed0bcfd3eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:34.991359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa08c0d-05d3-4641-82b4-fed0bcfd3eaa admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:35.002305 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4113/8155] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:04:35.006926 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa08c0d-05d3-4641-82b4-fed0bcfd3eaa admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:35.017094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa08c0d-05d3-4641-82b4-fed0bcfd3eaa admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:35.024042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e568a8-d6cc-4fc0-8673-e77469e11807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:35.024932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e568a8-d6cc-4fc0-8673-e77469e11807 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:35.025216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e568a8-d6cc-4fc0-8673-e77469e11807 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:35.025506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e568a8-d6cc-4fc0-8673-e77469e11807 admin admin] PATH_INFO: `/v3/projects/198e1500345a4ff286b44deda27ec602/users/3d7b9aac8d124c7c8284af3257a2ad5a/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:35.043001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e568a8-d6cc-4fc0-8673-e77469e11807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=198e1500345a4ff286b44deda27ec602, user_id=3d7b9aac8d124c7c8284af3257a2ad5a, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:35.045599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e568a8-d6cc-4fc0-8673-e77469e11807 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:35.087456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e1abe1d2-7cf7-40dc-886e-f922c1043ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db65f936ac294f4bbb12f668ae523fc6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:35.120474 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4114/8156] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:35 2022] PUT /identity/v3/projects/198e1500345a4ff286b44deda27ec602/users/3d7b9aac8d124c7c8284af3257a2ad5a/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:35.131276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24b0b1-8b64-4f3b-8d44-286d629b7a6b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:35.131540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24b0b1-8b64-4f3b-8d44-286d629b7a6b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:35.131849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24b0b1-8b64-4f3b-8d44-286d629b7a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:35.136640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e1abe1d2-7cf7-40dc-886e-f922c1043ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db65f936ac294f4bbb12f668ae523fc6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:35.137433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e1abe1d2-7cf7-40dc-886e-f922c1043ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db65f936ac294f4bbb12f668ae523fc6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:35.149074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e1abe1d2-7cf7-40dc-886e-f922c1043ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db65f936ac294f4bbb12f668ae523fc6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:35.163756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e1abe1d2-7cf7-40dc-886e-f922c1043ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db65f936ac294f4bbb12f668ae523fc6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:35.169691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-fe24b0b1-8b64-4f3b-8d44-286d629b7a6b None None] MFA Rules not processed for user `3d7b9aac8d124c7c8284af3257a2ad5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:35.171003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-fe24b0b1-8b64-4f3b-8d44-286d629b7a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:35.173300 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4043/8157] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:34 2022] DELETE /identity/v3/users/db65f936ac294f4bbb12f668ae523fc6 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:35.228325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:35.246978 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4115/8158] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:35.260251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abe1d2-7cf7-40dc-886e-f922c1043ebe admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:35.260251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e1abe1d2-7cf7-40dc-886e-f922c1043ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:35.315085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:35.342002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abe1d2-7cf7-40dc-886e-f922c1043ebe admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:35.346849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc800527-e853-4153-82ae-5d6fa04f4ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:35.350194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc800527-e853-4153-82ae-5d6fa04f4ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:35.350194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc800527-e853-4153-82ae-5d6fa04f4ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:35.350194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc800527-e853-4153-82ae-5d6fa04f4ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:35.350194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc800527-e853-4153-82ae-5d6fa04f4ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:35.351020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc800527-e853-4153-82ae-5d6fa04f4ca4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:35.484117 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4044/8159] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:35 2022] POST /identity/v3/projects => generated 375 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:35.488370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24b0b1-8b64-4f3b-8d44-286d629b7a6b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:35.505182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24b0b1-8b64-4f3b-8d44-286d629b7a6b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:35.585176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb264968-ae38-4dd6-be60-88af7eb57dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:35.585916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264968-ae38-4dd6-be60-88af7eb57dba admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:35.586163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264968-ae38-4dd6-be60-88af7eb57dba admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:35.586547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264968-ae38-4dd6-be60-88af7eb57dba admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:35.587061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb264968-ae38-4dd6-be60-88af7eb57dba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:35.589177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb264968-ae38-4dd6-be60-88af7eb57dba admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:35.726318 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4116/8160] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:35 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:35.726857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc800527-e853-4153-82ae-5d6fa04f4ca4 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:35.730470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb264968-ae38-4dd6-be60-88af7eb57dba admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:35.731028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fc800527-e853-4153-82ae-5d6fa04f4ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:35.746813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb264968-ae38-4dd6-be60-88af7eb57dba admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:35.747891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc800527-e853-4153-82ae-5d6fa04f4ca4 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:35.754593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ba7ce-997d-406b-8e21-359b4bff3684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:35.755229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ba7ce-997d-406b-8e21-359b4bff3684 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:35.755515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ba7ce-997d-406b-8e21-359b4bff3684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:35.755899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ba7ce-997d-406b-8e21-359b4bff3684 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:35.756702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ba7ce-997d-406b-8e21-359b4bff3684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:35.758228 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c5b62-13af-4ec7-aa8c-4116e69e3d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:35.758488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ba7ce-997d-406b-8e21-359b4bff3684 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:35.758965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c5b62-13af-4ec7-aa8c-4116e69e3d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:35.759317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c5b62-13af-4ec7-aa8c-4116e69e3d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:35.759663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c5b62-13af-4ec7-aa8c-4116e69e3d9d admin admin] PATH_INFO: `/v3/projects/7b82bb1ab10d47018a2ada8ec01bd13e` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:35.760930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c5b62-13af-4ec7-aa8c-4116e69e3d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b82bb1ab10d47018a2ada8ec01bd13e)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:35.762947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c5b62-13af-4ec7-aa8c-4116e69e3d9d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:35.770159 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4117/8161] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:35.775286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ba7ce-997d-406b-8e21-359b4bff3684 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:35.786264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ba7ce-997d-406b-8e21-359b4bff3684 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:35.791577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520cfe6-a214-43a5-84fc-b0edb8464e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:35.792542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520cfe6-a214-43a5-84fc-b0edb8464e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:35.792977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520cfe6-a214-43a5-84fc-b0edb8464e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:35.793426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520cfe6-a214-43a5-84fc-b0edb8464e98 admin admin] PATH_INFO: `/v3/projects/99515d976ead41afb953d387f2174a33/users/53e68edda46947b78ddfbb4e4f975e98/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:35.811962 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520cfe6-a214-43a5-84fc-b0edb8464e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99515d976ead41afb953d387f2174a33, user_id=53e68edda46947b78ddfbb4e4f975e98, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:35.814856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520cfe6-a214-43a5-84fc-b0edb8464e98 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:35.914259 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4118/8162] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:35 2022] PUT /identity/v3/projects/99515d976ead41afb953d387f2174a33/users/53e68edda46947b78ddfbb4e4f975e98/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:35.918265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520cfe6-a214-43a5-84fc-b0edb8464e98 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:35.926782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-816c5b62-13af-4ec7-aa8c-4116e69e3d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b82bb1ab10d47018a2ada8ec01bd13e', 'request_id': 'req-816c5b62-13af-4ec7-aa8c-4116e69e3d9d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:35.933656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-816c5b62-13af-4ec7-aa8c-4116e69e3d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b82bb1ab10d47018a2ada8ec01bd13e', 'request_id': 'req-816c5b62-13af-4ec7-aa8c-4116e69e3d9d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:35.942678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-816c5b62-13af-4ec7-aa8c-4116e69e3d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b82bb1ab10d47018a2ada8ec01bd13e', 'request_id': 'req-816c5b62-13af-4ec7-aa8c-4116e69e3d9d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:35.986492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520cfe6-a214-43a5-84fc-b0edb8464e98 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:36.057049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-816c5b62-13af-4ec7-aa8c-4116e69e3d9d admin admin] The token cache is being invalidate because project 7b82bb1ab10d47018a2ada8ec01bd13e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:36.060990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-816c5b62-13af-4ec7-aa8c-4116e69e3d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:36.060990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-816c5b62-13af-4ec7-aa8c-4116e69e3d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:36.060990 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4045/8163] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:35 2022] DELETE /identity/v3/projects/7b82bb1ab10d47018a2ada8ec01bd13e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:36.061991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e631d-2702-4ab1-a446-8abfa4f290a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:36.062607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e631d-2702-4ab1-a446-8abfa4f290a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:36.062901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e631d-2702-4ab1-a446-8abfa4f290a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:36.063429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e631d-2702-4ab1-a446-8abfa4f290a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:36.064072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e631d-2702-4ab1-a446-8abfa4f290a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:36.064777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42774ea-202b-4442-b3b1-a39cf28b0402 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:36.065132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42774ea-202b-4442-b3b1-a39cf28b0402 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:36.065485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42774ea-202b-4442-b3b1-a39cf28b0402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:36.065683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e631d-2702-4ab1-a446-8abfa4f290a0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:36.075966 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4119/8164] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:04:36.079928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e631d-2702-4ab1-a446-8abfa4f290a0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:36.081620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2b3e631d-2702-4ab1-a446-8abfa4f290a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:36.087511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c42774ea-202b-4442-b3b1-a39cf28b0402 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:36.089044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c42774ea-202b-4442-b3b1-a39cf28b0402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:36.094614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e631d-2702-4ab1-a446-8abfa4f290a0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:36.098202 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4046/8165] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:04:36.104864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2eef8-d3cd-41f3-b184-7fd4369782a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:36.105647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2eef8-d3cd-41f3-b184-7fd4369782a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:36.106042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2eef8-d3cd-41f3-b184-7fd4369782a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:36.106422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2eef8-d3cd-41f3-b184-7fd4369782a4 admin admin] PATH_INFO: `/v3/projects/99515d976ead41afb953d387f2174a33/users/53e68edda46947b78ddfbb4e4f975e98/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:36.107357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e97b3-3654-4b63-b243-ef86c28d488a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:36.107918 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e97b3-3654-4b63-b243-ef86c28d488a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:36.108322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e97b3-3654-4b63-b243-ef86c28d488a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:36.108989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2eef8-d3cd-41f3-b184-7fd4369782a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99515d976ead41afb953d387f2174a33, user_id=53e68edda46947b78ddfbb4e4f975e98, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:36.111738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2eef8-d3cd-41f3-b184-7fd4369782a4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:36.125113 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4120/8166] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:36 2022] PUT /identity/v3/projects/99515d976ead41afb953d387f2174a33/users/53e68edda46947b78ddfbb4e4f975e98/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:36.135400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-4a2e97b3-3654-4b63-b243-ef86c28d488a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:36.135400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4a2e97b3-3654-4b63-b243-ef86c28d488a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:36.144717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc571b-d69b-469a-8033-f1f0c2c0f3f1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:36.145141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc571b-d69b-469a-8033-f1f0c2c0f3f1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:36.145425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc571b-d69b-469a-8033-f1f0c2c0f3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:36.181681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c4fc571b-d69b-469a-8033-f1f0c2c0f3f1 None None] MFA Rules not processed for user `53e68edda46947b78ddfbb4e4f975e98`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:36.183828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c4fc571b-d69b-469a-8033-f1f0c2c0f3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:36.197536 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4047/8167] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:04:36.202536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e97b3-3654-4b63-b243-ef86c28d488a None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:36.211693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e97b3-3654-4b63-b243-ef86c28d488a None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:36.216482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c5ef6-a2ea-4cfe-96c5-bdb5bc41ec54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:36.217080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c5ef6-a2ea-4cfe-96c5-bdb5bc41ec54 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:36.217360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c5ef6-a2ea-4cfe-96c5-bdb5bc41ec54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:36.217634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c5ef6-a2ea-4cfe-96c5-bdb5bc41ec54 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:36.218274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c5ef6-a2ea-4cfe-96c5-bdb5bc41ec54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:04:36.218625 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c5ef6-a2ea-4cfe-96c5-bdb5bc41ec54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:36.220191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c5ef6-a2ea-4cfe-96c5-bdb5bc41ec54 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:36.229213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:36.234339 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4048/8168] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:04:36.239412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c5ef6-a2ea-4cfe-96c5-bdb5bc41ec54 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:36.248889 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c5ef6-a2ea-4cfe-96c5-bdb5bc41ec54 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:36.253871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663d736-1143-478f-a6ca-32768a680768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:36.254507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663d736-1143-478f-a6ca-32768a680768 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:36.254804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663d736-1143-478f-a6ca-32768a680768 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:36.255062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663d736-1143-478f-a6ca-32768a680768 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:36.255692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663d736-1143-478f-a6ca-32768a680768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:36.257686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663d736-1143-478f-a6ca-32768a680768 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:36.274353 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4121/8169] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:04:36.286399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc571b-d69b-469a-8033-f1f0c2c0f3f1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:36.287973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c4fc571b-d69b-469a-8033-f1f0c2c0f3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:36.370268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc571b-d69b-469a-8033-f1f0c2c0f3f1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:36.372872 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4049/8170] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:36 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:36.376736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663d736-1143-478f-a6ca-32768a680768 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:36.377089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0c619-846a-4ce5-8b28-60c64acafc8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:36.377706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0c619-846a-4ce5-8b28-60c64acafc8a service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:36.377986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0c619-846a-4ce5-8b28-60c64acafc8a service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:36.378276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0c619-846a-4ce5-8b28-60c64acafc8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:36.380299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1ef0c619-846a-4ce5-8b28-60c64acafc8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:36.447768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0c619-846a-4ce5-8b28-60c64acafc8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:36.447768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0c619-846a-4ce5-8b28-60c64acafc8a service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:36.469856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663d736-1143-478f-a6ca-32768a680768 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:36.470423 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4122/8171] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:36.476244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f434b-2dcb-4e61-a2aa-c7e3c964a86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:36.477163 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f434b-2dcb-4e61-a2aa-c7e3c964a86f admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:36.477599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f434b-2dcb-4e61-a2aa-c7e3c964a86f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:36.478202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f434b-2dcb-4e61-a2aa-c7e3c964a86f admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:36.479000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f434b-2dcb-4e61-a2aa-c7e3c964a86f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:36.481469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f434b-2dcb-4e61-a2aa-c7e3c964a86f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:36.571630 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4050/8172] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:36 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:36.575689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0c619-846a-4ce5-8b28-60c64acafc8a service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:36.590151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0c619-846a-4ce5-8b28-60c64acafc8a service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:36.597097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4ab5e-5b62-4009-b4e3-e6d39292ea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:36.598113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4ab5e-5b62-4009-b4e3-e6d39292ea29 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:36.598488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4ab5e-5b62-4009-b4e3-e6d39292ea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:36.599532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4ab5e-5b62-4009-b4e3-e6d39292ea29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:36.600215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4ab5e-5b62-4009-b4e3-e6d39292ea29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:36.602879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4ab5e-5b62-4009-b4e3-e6d39292ea29 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:36.617695 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4123/8173] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:36.618854 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f434b-2dcb-4e61-a2aa-c7e3c964a86f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:36.629451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f434b-2dcb-4e61-a2aa-c7e3c964a86f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:36.634330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964bb2c-be39-4538-bbd4-8a5300e4a0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:36.634930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964bb2c-be39-4538-bbd4-8a5300e4a0ef admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:36.635209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964bb2c-be39-4538-bbd4-8a5300e4a0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:36.635481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964bb2c-be39-4538-bbd4-8a5300e4a0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:36.636148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964bb2c-be39-4538-bbd4-8a5300e4a0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:36.637974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964bb2c-be39-4538-bbd4-8a5300e4a0ef admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:36.648657 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4051/8174] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:36.652859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4ab5e-5b62-4009-b4e3-e6d39292ea29 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:36.665822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4ab5e-5b62-4009-b4e3-e6d39292ea29 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:36.670654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7776672-c50f-48e1-9ff4-35f9d60bd179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:36.671352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7776672-c50f-48e1-9ff4-35f9d60bd179 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:36.671641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7776672-c50f-48e1-9ff4-35f9d60bd179 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:36.671934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7776672-c50f-48e1-9ff4-35f9d60bd179 admin admin] PATH_INFO: `/v3/projects/679bb60d87974eada81da2d458bfc06b/users/91e2b78a479b4f75bd9369b022791a97/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:36.676528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:36.690485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7776672-c50f-48e1-9ff4-35f9d60bd179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=679bb60d87974eada81da2d458bfc06b, user_id=91e2b78a479b4f75bd9369b022791a97, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:36.694488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7776672-c50f-48e1-9ff4-35f9d60bd179 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:36.839977 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4124/8175] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:36 2022] PUT /identity/v3/projects/679bb60d87974eada81da2d458bfc06b/users/91e2b78a479b4f75bd9369b022791a97/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:36.850436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dc39f-1916-4975-af1d-e0a23691b4e4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:36.850949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dc39f-1916-4975-af1d-e0a23691b4e4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:36.851221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dc39f-1916-4975-af1d-e0a23691b4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:36.881071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e24dc39f-1916-4975-af1d-e0a23691b4e4 None None] MFA Rules not processed for user `91e2b78a479b4f75bd9369b022791a97`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:36.882369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e24dc39f-1916-4975-af1d-e0a23691b4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:36.979773 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4052/8176] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:36.990492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7776672-c50f-48e1-9ff4-35f9d60bd179 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:36.992695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d7776672-c50f-48e1-9ff4-35f9d60bd179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:37.062909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7776672-c50f-48e1-9ff4-35f9d60bd179 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:37.068806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae5a5d-69d7-415b-ab70-af0d54838800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:37.068911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae5a5d-69d7-415b-ab70-af0d54838800 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:37.069263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae5a5d-69d7-415b-ab70-af0d54838800 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:37.069545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae5a5d-69d7-415b-ab70-af0d54838800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:37.078809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae5a5d-69d7-415b-ab70-af0d54838800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:37.080280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae5a5d-69d7-415b-ab70-af0d54838800 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:37.090018 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4125/8177] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:37.902643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:38.592423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:38.845335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:40.038880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:40.202957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:41.290616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:41.416393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:41.890588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:42.583366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=75,keystone:DELETE=22,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:42.653084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:43.199606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:43.212153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dc39f-1916-4975-af1d-e0a23691b4e4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:43.321251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dc39f-1916-4975-af1d-e0a23691b4e4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:43.325949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dabed-dd54-4edb-a0f1-06566be20739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:43.326697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dabed-dd54-4edb-a0f1-06566be20739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:43.327076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dabed-dd54-4edb-a0f1-06566be20739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:43.327505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dabed-dd54-4edb-a0f1-06566be20739 admin admin] PATH_INFO: `/v3/users/3d7b9aac8d124c7c8284af3257a2ad5a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:43.328747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dabed-dd54-4edb-a0f1-06566be20739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d7b9aac8d124c7c8284af3257a2ad5a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:43.330811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dabed-dd54-4edb-a0f1-06566be20739 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:43.341110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:43.577839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f61dabed-dd54-4edb-a0f1-06566be20739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d7b9aac8d124c7c8284af3257a2ad5a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:43.662496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f61dabed-dd54-4edb-a0f1-06566be20739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d7b9aac8d124c7c8284af3257a2ad5a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:43.664691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f61dabed-dd54-4edb-a0f1-06566be20739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d7b9aac8d124c7c8284af3257a2ad5a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:43.677562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f61dabed-dd54-4edb-a0f1-06566be20739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d7b9aac8d124c7c8284af3257a2ad5a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:43.707295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f61dabed-dd54-4edb-a0f1-06566be20739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d7b9aac8d124c7c8284af3257a2ad5a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:43.726894 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4053/8178] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:43 2022] DELETE /identity/v3/users/3d7b9aac8d124c7c8284af3257a2ad5a => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:43.731062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d6dbf-456e-4234-a2c0-f0d02a91ccc5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:43.740196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d6dbf-456e-4234-a2c0-f0d02a91ccc5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:43.740196 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d6dbf-456e-4234-a2c0-f0d02a91ccc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:43.766310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-dc9d6dbf-456e-4234-a2c0-f0d02a91ccc5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:43.767538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dc9d6dbf-456e-4234-a2c0-f0d02a91ccc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:43.815915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:43.840314 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4126/8179] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:43.853523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dabed-dd54-4edb-a0f1-06566be20739 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:43.855607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f61dabed-dd54-4edb-a0f1-06566be20739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:43.996866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:44.018373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dabed-dd54-4edb-a0f1-06566be20739 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:44.025783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9a672-02bd-42ee-930d-1c8fa901992a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:44.026403 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9a672-02bd-42ee-930d-1c8fa901992a service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:44.026678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9a672-02bd-42ee-930d-1c8fa901992a service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:44.026950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9a672-02bd-42ee-930d-1c8fa901992a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:44.040342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac9a672-02bd-42ee-930d-1c8fa901992a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:44.042505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac9a672-02bd-42ee-930d-1c8fa901992a service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:44.053301 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4054/8180] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:44.595952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d6dbf-456e-4234-a2c0-f0d02a91ccc5 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:44.597554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dc9d6dbf-456e-4234-a2c0-f0d02a91ccc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:44.625366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d6dbf-456e-4234-a2c0-f0d02a91ccc5 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:44.644641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce074802-06ce-461a-9483-ac5e97d857dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:44.645978 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce074802-06ce-461a-9483-ac5e97d857dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:44.646558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce074802-06ce-461a-9483-ac5e97d857dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:44.647344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce074802-06ce-461a-9483-ac5e97d857dc admin admin] PATH_INFO: `/v3/projects/198e1500345a4ff286b44deda27ec602` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:44.649505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce074802-06ce-461a-9483-ac5e97d857dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=198e1500345a4ff286b44deda27ec602)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:44.651987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce074802-06ce-461a-9483-ac5e97d857dc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:44.689542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:44.783754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ce074802-06ce-461a-9483-ac5e97d857dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198e1500345a4ff286b44deda27ec602', 'request_id': 'req-ce074802-06ce-461a-9483-ac5e97d857dc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:44.789555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ce074802-06ce-461a-9483-ac5e97d857dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198e1500345a4ff286b44deda27ec602', 'request_id': 'req-ce074802-06ce-461a-9483-ac5e97d857dc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:44.895370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ce074802-06ce-461a-9483-ac5e97d857dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198e1500345a4ff286b44deda27ec602', 'request_id': 'req-ce074802-06ce-461a-9483-ac5e97d857dc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:44.914788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ce074802-06ce-461a-9483-ac5e97d857dc admin admin] The token cache is being invalidate because project 198e1500345a4ff286b44deda27ec602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:44.915082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ce074802-06ce-461a-9483-ac5e97d857dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:44.915944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ce074802-06ce-461a-9483-ac5e97d857dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:44.917490 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4127/8181] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:44 2022] DELETE /identity/v3/projects/198e1500345a4ff286b44deda27ec602 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:44.921609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9a672-02bd-42ee-930d-1c8fa901992a service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:44.932715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9a672-02bd-42ee-930d-1c8fa901992a service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:45.008350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bad98c-e602-4a63-aa74-37c7ef5a0907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:45.009260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bad98c-e602-4a63-aa74-37c7ef5a0907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:45.009990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bad98c-e602-4a63-aa74-37c7ef5a0907 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:45.010516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bad98c-e602-4a63-aa74-37c7ef5a0907 admin admin] PATH_INFO: `/v3/users/53e68edda46947b78ddfbb4e4f975e98` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:45.011944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bad98c-e602-4a63-aa74-37c7ef5a0907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53e68edda46947b78ddfbb4e4f975e98)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:45.014329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bad98c-e602-4a63-aa74-37c7ef5a0907 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:45.022731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce074802-06ce-461a-9483-ac5e97d857dc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:45.024619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ce074802-06ce-461a-9483-ac5e97d857dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:45.040908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce074802-06ce-461a-9483-ac5e97d857dc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:45.046228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153dd71-ed4a-439f-8e26-805df5b5e406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:45.047093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153dd71-ed4a-439f-8e26-805df5b5e406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:45.047555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153dd71-ed4a-439f-8e26-805df5b5e406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:45.047992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153dd71-ed4a-439f-8e26-805df5b5e406 admin admin] PATH_INFO: `/v3/users/91e2b78a479b4f75bd9369b022791a97` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:45.049628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153dd71-ed4a-439f-8e26-805df5b5e406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e2b78a479b4f75bd9369b022791a97)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:45.052857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153dd71-ed4a-439f-8e26-805df5b5e406 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:45.089623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:45.306546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b153dd71-ed4a-439f-8e26-805df5b5e406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e2b78a479b4f75bd9369b022791a97'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:45.307356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b153dd71-ed4a-439f-8e26-805df5b5e406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e2b78a479b4f75bd9369b022791a97'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:45.322993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64bad98c-e602-4a63-aa74-37c7ef5a0907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53e68edda46947b78ddfbb4e4f975e98'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:45.433094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b153dd71-ed4a-439f-8e26-805df5b5e406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e2b78a479b4f75bd9369b022791a97'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:45.433693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b153dd71-ed4a-439f-8e26-805df5b5e406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e2b78a479b4f75bd9369b022791a97'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:45.451866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b153dd71-ed4a-439f-8e26-805df5b5e406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e2b78a479b4f75bd9369b022791a97'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:45.466165 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4128/8182] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:45 2022] DELETE /identity/v3/users/91e2b78a479b4f75bd9369b022791a97 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:45.470827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e690f-6f7a-406f-9b6a-f6d7f0d12ae8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:45.471285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e690f-6f7a-406f-9b6a-f6d7f0d12ae8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:45.471660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e690f-6f7a-406f-9b6a-f6d7f0d12ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:45.499047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2c6e690f-6f7a-406f-9b6a-f6d7f0d12ae8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:45.500396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2c6e690f-6f7a-406f-9b6a-f6d7f0d12ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:45.506841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64bad98c-e602-4a63-aa74-37c7ef5a0907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53e68edda46947b78ddfbb4e4f975e98'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:45.507501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64bad98c-e602-4a63-aa74-37c7ef5a0907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53e68edda46947b78ddfbb4e4f975e98'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:45.518099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64bad98c-e602-4a63-aa74-37c7ef5a0907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53e68edda46947b78ddfbb4e4f975e98'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:45.536600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64bad98c-e602-4a63-aa74-37c7ef5a0907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53e68edda46947b78ddfbb4e4f975e98'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:45.546486 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4055/8183] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:04:44 2022] DELETE /identity/v3/users/53e68edda46947b78ddfbb4e4f975e98 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:45.611721 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4129/8184] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:04:45.632076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bad98c-e602-4a63-aa74-37c7ef5a0907 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:45.633732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-64bad98c-e602-4a63-aa74-37c7ef5a0907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:45.765193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bad98c-e602-4a63-aa74-37c7ef5a0907 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:45.771284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bb905-be55-43b9-bd6c-a4eb7e167dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:45.772013 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bb905-be55-43b9-bd6c-a4eb7e167dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:45.772577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bb905-be55-43b9-bd6c-a4eb7e167dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:45.772921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bb905-be55-43b9-bd6c-a4eb7e167dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:45.885922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bb905-be55-43b9-bd6c-a4eb7e167dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:45.887912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bb905-be55-43b9-bd6c-a4eb7e167dd2 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:45.900844 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4056/8185] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:46.357552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e690f-6f7a-406f-9b6a-f6d7f0d12ae8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:46.357552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2c6e690f-6f7a-406f-9b6a-f6d7f0d12ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:46.380897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e690f-6f7a-406f-9b6a-f6d7f0d12ae8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:46.428509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea501ca-62a7-4386-84f9-05ea13eecc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:46.428509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea501ca-62a7-4386-84f9-05ea13eecc2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:46.428509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea501ca-62a7-4386-84f9-05ea13eecc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:46.428509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea501ca-62a7-4386-84f9-05ea13eecc2f admin admin] PATH_INFO: `/v3/projects/99515d976ead41afb953d387f2174a33` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:46.429095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea501ca-62a7-4386-84f9-05ea13eecc2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=99515d976ead41afb953d387f2174a33)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:46.430273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea501ca-62a7-4386-84f9-05ea13eecc2f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:46.587331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bea501ca-62a7-4386-84f9-05ea13eecc2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99515d976ead41afb953d387f2174a33', 'request_id': 'req-bea501ca-62a7-4386-84f9-05ea13eecc2f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:46.593092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bea501ca-62a7-4386-84f9-05ea13eecc2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99515d976ead41afb953d387f2174a33', 'request_id': 'req-bea501ca-62a7-4386-84f9-05ea13eecc2f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:46.643340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:46.709185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bb905-be55-43b9-bd6c-a4eb7e167dd2 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:46.712320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3c2bb905-be55-43b9-bd6c-a4eb7e167dd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:46.719852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bea501ca-62a7-4386-84f9-05ea13eecc2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99515d976ead41afb953d387f2174a33', 'request_id': 'req-bea501ca-62a7-4386-84f9-05ea13eecc2f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:46.726905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bb905-be55-43b9-bd6c-a4eb7e167dd2 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:46.740391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bea501ca-62a7-4386-84f9-05ea13eecc2f admin admin] The token cache is being invalidate because project 99515d976ead41afb953d387f2174a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:46.740806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bea501ca-62a7-4386-84f9-05ea13eecc2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:46.741308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-bea501ca-62a7-4386-84f9-05ea13eecc2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:46.743129 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4130/8186] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:46 2022] DELETE /identity/v3/projects/99515d976ead41afb953d387f2174a33 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:46.747893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fab7e-e76a-4057-9416-61b176b06c92 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:46.752118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fab7e-e76a-4057-9416-61b176b06c92 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:46.752118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fab7e-e76a-4057-9416-61b176b06c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:46.776130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1a0fab7e-e76a-4057-9416-61b176b06c92 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:46.776130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1a0fab7e-e76a-4057-9416-61b176b06c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:46.790406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef8e03-f2ad-4bd2-8966-7cb42fe5b3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:46.791145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef8e03-f2ad-4bd2-8966-7cb42fe5b3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:46.791621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef8e03-f2ad-4bd2-8966-7cb42fe5b3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:46.791902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef8e03-f2ad-4bd2-8966-7cb42fe5b3d6 admin admin] PATH_INFO: `/v3/projects/679bb60d87974eada81da2d458bfc06b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:46.793103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef8e03-f2ad-4bd2-8966-7cb42fe5b3d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=679bb60d87974eada81da2d458bfc06b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:46.795043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef8e03-f2ad-4bd2-8966-7cb42fe5b3d6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:46.876879 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4131/8187] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:46.880760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cc45f-1151-499b-bd37-89a026864f1c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:46.881051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cc45f-1151-499b-bd37-89a026864f1c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:46.881325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cc45f-1151-499b-bd37-89a026864f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:46.912211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ec1cc45f-1151-499b-bd37-89a026864f1c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:46.914120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ec1cc45f-1151-499b-bd37-89a026864f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:46.931399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d1ef8e03-f2ad-4bd2-8966-7cb42fe5b3d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679bb60d87974eada81da2d458bfc06b', 'request_id': 'req-d1ef8e03-f2ad-4bd2-8966-7cb42fe5b3d6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:46.937892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d1ef8e03-f2ad-4bd2-8966-7cb42fe5b3d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679bb60d87974eada81da2d458bfc06b', 'request_id': 'req-d1ef8e03-f2ad-4bd2-8966-7cb42fe5b3d6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:46.946170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d1ef8e03-f2ad-4bd2-8966-7cb42fe5b3d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679bb60d87974eada81da2d458bfc06b', 'request_id': 'req-d1ef8e03-f2ad-4bd2-8966-7cb42fe5b3d6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:46.995285 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4132/8188] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:46.999744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cc45f-1151-499b-bd37-89a026864f1c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:47.010871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cc45f-1151-499b-bd37-89a026864f1c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:47.016133 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c42de-87ed-4cfe-b763-f2aa3aa92593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:47.016775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c42de-87ed-4cfe-b763-f2aa3aa92593 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:47.016894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:47.017082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c42de-87ed-4cfe-b763-f2aa3aa92593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:47.017548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c42de-87ed-4cfe-b763-f2aa3aa92593 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:47.018343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c42de-87ed-4cfe-b763-f2aa3aa92593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:04:47.019172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c42de-87ed-4cfe-b763-f2aa3aa92593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:47.021078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c42de-87ed-4cfe-b763-f2aa3aa92593 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:47.034101 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4133/8189] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:04:47.039139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c42de-87ed-4cfe-b763-f2aa3aa92593 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:47.049293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c42de-87ed-4cfe-b763-f2aa3aa92593 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:47.054308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20131566-761a-4a56-b504-4b7491deacf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:47.057202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20131566-761a-4a56-b504-4b7491deacf8 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:47.057202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20131566-761a-4a56-b504-4b7491deacf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:47.057202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20131566-761a-4a56-b504-4b7491deacf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:47.057202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20131566-761a-4a56-b504-4b7491deacf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:47.058420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20131566-761a-4a56-b504-4b7491deacf8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:47.065673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d1ef8e03-f2ad-4bd2-8966-7cb42fe5b3d6 admin admin] The token cache is being invalidate because project 679bb60d87974eada81da2d458bfc06b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:04:47.068538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d1ef8e03-f2ad-4bd2-8966-7cb42fe5b3d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:47.074043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d1ef8e03-f2ad-4bd2-8966-7cb42fe5b3d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:04:47.079832 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4057/8190] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:04:46 2022] DELETE /identity/v3/projects/679bb60d87974eada81da2d458bfc06b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:47.083528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534af79-e6d5-4bfa-881f-df8b546dff49 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:47.083528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534af79-e6d5-4bfa-881f-df8b546dff49 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:47.084300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534af79-e6d5-4bfa-881f-df8b546dff49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:47.115567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-1534af79-e6d5-4bfa-881f-df8b546dff49 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:47.117101 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1534af79-e6d5-4bfa-881f-df8b546dff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:47.125633 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4058/8191] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:47.192850 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4134/8192] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:47 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:47.194390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534af79-e6d5-4bfa-881f-df8b546dff49 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:47.195865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1534af79-e6d5-4bfa-881f-df8b546dff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:47.212429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534af79-e6d5-4bfa-881f-df8b546dff49 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:47.235252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851b1d-7234-46cf-86f3-e59c0eb15e1b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:47.235534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851b1d-7234-46cf-86f3-e59c0eb15e1b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:47.235809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851b1d-7234-46cf-86f3-e59c0eb15e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:47.266018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-96851b1d-7234-46cf-86f3-e59c0eb15e1b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:47.267248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-96851b1d-7234-46cf-86f3-e59c0eb15e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:47.277396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833a0d3-c96d-4cd6-970b-e37b26771e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:47.278470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833a0d3-c96d-4cd6-970b-e37b26771e44 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:47.280037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833a0d3-c96d-4cd6-970b-e37b26771e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:47.280037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833a0d3-c96d-4cd6-970b-e37b26771e44 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:47.280639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833a0d3-c96d-4cd6-970b-e37b26771e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:47.283206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833a0d3-c96d-4cd6-970b-e37b26771e44 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:47.358717 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4135/8193] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:47.358717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96851b1d-7234-46cf-86f3-e59c0eb15e1b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:47.366599 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4059/8194] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:47 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:47.371683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833a0d3-c96d-4cd6-970b-e37b26771e44 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:47.374526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96851b1d-7234-46cf-86f3-e59c0eb15e1b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:47.380715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51eed91-c032-4a5e-b801-32c8a59245b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:47.381682 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eed91-c032-4a5e-b801-32c8a59245b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:47.382288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eed91-c032-4a5e-b801-32c8a59245b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:47.382734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51eed91-c032-4a5e-b801-32c8a59245b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:47.383537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51eed91-c032-4a5e-b801-32c8a59245b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:04:47.384035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51eed91-c032-4a5e-b801-32c8a59245b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:47.385861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51eed91-c032-4a5e-b801-32c8a59245b4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:47.392529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833a0d3-c96d-4cd6-970b-e37b26771e44 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:47.400217 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4136/8195] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:04:47.401353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc41b1-2aec-4700-bf18-50182508d236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:47.402348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc41b1-2aec-4700-bf18-50182508d236 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:47.402798 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc41b1-2aec-4700-bf18-50182508d236 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:47.403310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc41b1-2aec-4700-bf18-50182508d236 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:47.404503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc41b1-2aec-4700-bf18-50182508d236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:47.405041 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51eed91-c032-4a5e-b801-32c8a59245b4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:47.406424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc41b1-2aec-4700-bf18-50182508d236 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:47.416473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51eed91-c032-4a5e-b801-32c8a59245b4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:47.421536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b6bff-e2ff-4ece-ad76-f1520bb85bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:47.421913 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4060/8196] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:04:47.422121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b6bff-e2ff-4ece-ad76-f1520bb85bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:47.422474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b6bff-e2ff-4ece-ad76-f1520bb85bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:47.422786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc41b1-2aec-4700-bf18-50182508d236 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:47.422888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b6bff-e2ff-4ece-ad76-f1520bb85bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:47.423588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b6bff-e2ff-4ece-ad76-f1520bb85bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:47.425619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b6bff-e2ff-4ece-ad76-f1520bb85bc8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:47.433386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc41b1-2aec-4700-bf18-50182508d236 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:47.438401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1181c1-a444-44c1-be35-2033874647c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:47.439051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1181c1-a444-44c1-be35-2033874647c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:47.439275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1181c1-a444-44c1-be35-2033874647c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:47.439550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1181c1-a444-44c1-be35-2033874647c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:47.440215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1181c1-a444-44c1-be35-2033874647c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:47.442450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1181c1-a444-44c1-be35-2033874647c5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:47.454229 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4061/8197] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:47.458826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1181c1-a444-44c1-be35-2033874647c5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:47.469862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1181c1-a444-44c1-be35-2033874647c5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:47.474907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a9190-b173-48f1-a91f-9ae444f826ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:47.475561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a9190-b173-48f1-a91f-9ae444f826ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:47.475848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a9190-b173-48f1-a91f-9ae444f826ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:47.476251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a9190-b173-48f1-a91f-9ae444f826ca admin admin] PATH_INFO: `/v3/projects/0b022ef5736f41e694728fd837b9e63a/users/f2933a6df85641cebc7cb0924c8d4016/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:47.491698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a9190-b173-48f1-a91f-9ae444f826ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b022ef5736f41e694728fd837b9e63a, user_id=f2933a6df85641cebc7cb0924c8d4016, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:47.494406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a9190-b173-48f1-a91f-9ae444f826ca admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:47.522050 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4137/8198] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:47 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:47.526154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b6bff-e2ff-4ece-ad76-f1520bb85bc8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:47.595445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b6bff-e2ff-4ece-ad76-f1520bb85bc8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:47.598096 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4062/8199] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:47 2022] PUT /identity/v3/projects/0b022ef5736f41e694728fd837b9e63a/users/f2933a6df85641cebc7cb0924c8d4016/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:47.608338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585545a-8067-455a-af76-126ea89a26cb None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:47.608700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585545a-8067-455a-af76-126ea89a26cb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:47.609089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585545a-8067-455a-af76-126ea89a26cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:47.639005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f585545a-8067-455a-af76-126ea89a26cb None None] MFA Rules not processed for user `f2933a6df85641cebc7cb0924c8d4016`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:47.640450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f585545a-8067-455a-af76-126ea89a26cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:47.660371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99416e32-ac14-455f-b12c-ff78949a3c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:47.661001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99416e32-ac14-455f-b12c-ff78949a3c69 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:47.661487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99416e32-ac14-455f-b12c-ff78949a3c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:47.661673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99416e32-ac14-455f-b12c-ff78949a3c69 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:47.662379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99416e32-ac14-455f-b12c-ff78949a3c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:47.664441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99416e32-ac14-455f-b12c-ff78949a3c69 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:47.715059 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4063/8200] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:47.719921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585545a-8067-455a-af76-126ea89a26cb None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:47.730249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585545a-8067-455a-af76-126ea89a26cb None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:47.734856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be78156-2340-43cf-ba40-633b161925b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:47.738192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be78156-2340-43cf-ba40-633b161925b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:47.738192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be78156-2340-43cf-ba40-633b161925b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:47.738192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be78156-2340-43cf-ba40-633b161925b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:47.738192 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be78156-2340-43cf-ba40-633b161925b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:47.739089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be78156-2340-43cf-ba40-633b161925b9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:47.790584 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4138/8201] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:47 2022] POST /identity/v3/users => generated 292 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:47.791705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99416e32-ac14-455f-b12c-ff78949a3c69 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:47.802179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99416e32-ac14-455f-b12c-ff78949a3c69 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:47.807009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24aa5f9-67e5-4c91-b0b5-220e7ee97086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:47.807637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24aa5f9-67e5-4c91-b0b5-220e7ee97086 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:47.807918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24aa5f9-67e5-4c91-b0b5-220e7ee97086 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:47.808225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24aa5f9-67e5-4c91-b0b5-220e7ee97086 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:47.808878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24aa5f9-67e5-4c91-b0b5-220e7ee97086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:47.810483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24aa5f9-67e5-4c91-b0b5-220e7ee97086 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:47.825833 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4139/8202] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:47.827338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24aa5f9-67e5-4c91-b0b5-220e7ee97086 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:47.838764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24aa5f9-67e5-4c91-b0b5-220e7ee97086 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:47.844183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77382f7-4b22-47f9-81ed-bb0504502af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:47.844821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77382f7-4b22-47f9-81ed-bb0504502af9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:47.845104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77382f7-4b22-47f9-81ed-bb0504502af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:47.845535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77382f7-4b22-47f9-81ed-bb0504502af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:47.846181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77382f7-4b22-47f9-81ed-bb0504502af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:47.848082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77382f7-4b22-47f9-81ed-bb0504502af9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:47.859406 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4140/8203] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:04:47.866682 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4064/8204] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:47 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:47.866843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77382f7-4b22-47f9-81ed-bb0504502af9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:47.871252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be78156-2340-43cf-ba40-633b161925b9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:47.883948 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77382f7-4b22-47f9-81ed-bb0504502af9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:47.983064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08484579-5cc5-40bc-ac57-960a3739662d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:47.991514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08484579-5cc5-40bc-ac57-960a3739662d admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:47.991514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08484579-5cc5-40bc-ac57-960a3739662d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:47.991514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08484579-5cc5-40bc-ac57-960a3739662d admin admin] PATH_INFO: `/v3/projects/13e645261bc94abd9c6f3e9bc901fba6/users/43a8911d9bee4557a6665dec3c4b4c43/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:47.993204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be78156-2340-43cf-ba40-633b161925b9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:48.000104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c948d4-42fb-4b7e-be14-f4631084b0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:48.001040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c948d4-42fb-4b7e-be14-f4631084b0ae admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:48.001469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c948d4-42fb-4b7e-be14-f4631084b0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:48.001606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08484579-5cc5-40bc-ac57-960a3739662d admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e645261bc94abd9c6f3e9bc901fba6, user_id=43a8911d9bee4557a6665dec3c4b4c43, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:48.002019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c948d4-42fb-4b7e-be14-f4631084b0ae admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:48.002837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c948d4-42fb-4b7e-be14-f4631084b0ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:48.004975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c948d4-42fb-4b7e-be14-f4631084b0ae admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:48.005779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08484579-5cc5-40bc-ac57-960a3739662d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:48.018096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:48.090452 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4141/8205] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:47 2022] PUT /identity/v3/projects/13e645261bc94abd9c6f3e9bc901fba6/users/43a8911d9bee4557a6665dec3c4b4c43/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:48.100875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8a99c-e037-4b8c-a7af-f221e91b8d13 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:48.101283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8a99c-e037-4b8c-a7af-f221e91b8d13 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:48.101623 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8a99c-e037-4b8c-a7af-f221e91b8d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:48.131198 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0cf8a99c-e037-4b8c-a7af-f221e91b8d13 None None] MFA Rules not processed for user `43a8911d9bee4557a6665dec3c4b4c43`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:48.132488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0cf8a99c-e037-4b8c-a7af-f221e91b8d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:48.147334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:48.163610 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4065/8206] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:47 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:48.163610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c948d4-42fb-4b7e-be14-f4631084b0ae admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:48.168492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c948d4-42fb-4b7e-be14-f4631084b0ae admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:48.202244 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4142/8207] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:04:48.207904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8a99c-e037-4b8c-a7af-f221e91b8d13 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:48.232445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59346188-a984-4681-84f3-c296ac87a28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:48.232973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59346188-a984-4681-84f3-c296ac87a28f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:48.233257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59346188-a984-4681-84f3-c296ac87a28f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:48.233531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59346188-a984-4681-84f3-c296ac87a28f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:48.234187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59346188-a984-4681-84f3-c296ac87a28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:48.235804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59346188-a984-4681-84f3-c296ac87a28f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:48.249458 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4066/8208] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:04:48.250529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59346188-a984-4681-84f3-c296ac87a28f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:48.261426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59346188-a984-4681-84f3-c296ac87a28f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:48.266191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c80804-1b84-48f1-acf9-d4887a27ddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:48.266793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c80804-1b84-48f1-acf9-d4887a27ddad admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:48.267074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c80804-1b84-48f1-acf9-d4887a27ddad admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:48.267350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c80804-1b84-48f1-acf9-d4887a27ddad admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:48.268014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c80804-1b84-48f1-acf9-d4887a27ddad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:48.270315 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c80804-1b84-48f1-acf9-d4887a27ddad admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:48.278808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8a99c-e037-4b8c-a7af-f221e91b8d13 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:48.281090 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4067/8209] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:48.284813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c80804-1b84-48f1-acf9-d4887a27ddad admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:48.287794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7638697-3a5d-4680-ab09-b4056f6c370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:48.288874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7638697-3a5d-4680-ab09-b4056f6c370c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:48.288874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7638697-3a5d-4680-ab09-b4056f6c370c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:48.291996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7638697-3a5d-4680-ab09-b4056f6c370c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:48.291996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7638697-3a5d-4680-ab09-b4056f6c370c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:48.291996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7638697-3a5d-4680-ab09-b4056f6c370c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:48.295127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c80804-1b84-48f1-acf9-d4887a27ddad admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:48.301283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b57c4-a73d-44f0-ab74-b64dfb1de5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:48.302050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b57c4-a73d-44f0-ab74-b64dfb1de5b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:48.302340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b57c4-a73d-44f0-ab74-b64dfb1de5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:48.303141 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b57c4-a73d-44f0-ab74-b64dfb1de5b1 admin admin] PATH_INFO: `/v3/projects/27ae1bc9a12d402ca8e834ec801627f8/users/487a7d0fdc774e29acde402623f27446/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:48.322803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b57c4-a73d-44f0-ab74-b64dfb1de5b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ae1bc9a12d402ca8e834ec801627f8, user_id=487a7d0fdc774e29acde402623f27446, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:48.325929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b57c4-a73d-44f0-ab74-b64dfb1de5b1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:48.387446 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4143/8210] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:48 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:48.391510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7638697-3a5d-4680-ab09-b4056f6c370c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:48.413788 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4068/8211] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:48 2022] PUT /identity/v3/projects/27ae1bc9a12d402ca8e834ec801627f8/users/487a7d0fdc774e29acde402623f27446/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:48.429944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18d53d-bc01-4219-bf4f-461bcdd37994 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:48.430404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18d53d-bc01-4219-bf4f-461bcdd37994 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:48.430849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18d53d-bc01-4219-bf4f-461bcdd37994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:48.491863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7638697-3a5d-4680-ab09-b4056f6c370c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:48.496125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0a18d53d-bc01-4219-bf4f-461bcdd37994 None None] MFA Rules not processed for user `487a7d0fdc774e29acde402623f27446`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:48.497688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0a18d53d-bc01-4219-bf4f-461bcdd37994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:48.562340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec15bb-1b4c-49fa-bdbf-7335d4b3c8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:48.563369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec15bb-1b4c-49fa-bdbf-7335d4b3c8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:48.563752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec15bb-1b4c-49fa-bdbf-7335d4b3c8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:48.564127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec15bb-1b4c-49fa-bdbf-7335d4b3c8f1 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:48.564886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec15bb-1b4c-49fa-bdbf-7335d4b3c8f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:48.567545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec15bb-1b4c-49fa-bdbf-7335d4b3c8f1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:48.583911 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4069/8212] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:04:48.589169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18d53d-bc01-4219-bf4f-461bcdd37994 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:48.601817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18d53d-bc01-4219-bf4f-461bcdd37994 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:48.606549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69a46b-be27-466f-a460-502266103de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:48.607147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69a46b-be27-466f-a460-502266103de5 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:48.607428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69a46b-be27-466f-a460-502266103de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:48.607700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69a46b-be27-466f-a460-502266103de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:48.608368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69a46b-be27-466f-a460-502266103de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:48.611015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69a46b-be27-466f-a460-502266103de5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:48.670869 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4144/8213] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:48 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:48.672003 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec15bb-1b4c-49fa-bdbf-7335d4b3c8f1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:48.682729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec15bb-1b4c-49fa-bdbf-7335d4b3c8f1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:48.688563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1d5d0-b9dd-453c-93e2-aab41a25ed45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:48.688563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1d5d0-b9dd-453c-93e2-aab41a25ed45 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:48.688563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1d5d0-b9dd-453c-93e2-aab41a25ed45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:48.689472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1d5d0-b9dd-453c-93e2-aab41a25ed45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:48.689472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1d5d0-b9dd-453c-93e2-aab41a25ed45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:48.694226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1d5d0-b9dd-453c-93e2-aab41a25ed45 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:48.704989 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4145/8214] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:48.709027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1d5d0-b9dd-453c-93e2-aab41a25ed45 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:48.718855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1d5d0-b9dd-453c-93e2-aab41a25ed45 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:48.724248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b980ca1-527c-4f9d-be11-f2752c6eac00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:48.724846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b980ca1-527c-4f9d-be11-f2752c6eac00 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:48.725126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b980ca1-527c-4f9d-be11-f2752c6eac00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:48.725398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b980ca1-527c-4f9d-be11-f2752c6eac00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:48.726032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b980ca1-527c-4f9d-be11-f2752c6eac00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:48.727610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b980ca1-527c-4f9d-be11-f2752c6eac00 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:48.739174 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4146/8215] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:04:48.743232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b980ca1-527c-4f9d-be11-f2752c6eac00 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:48.752628 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b980ca1-527c-4f9d-be11-f2752c6eac00 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:48.757420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdca46-29ab-4dfb-92ee-0b7c9bf88176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:48.758043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdca46-29ab-4dfb-92ee-0b7c9bf88176 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:48.758325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdca46-29ab-4dfb-92ee-0b7c9bf88176 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:48.758599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdca46-29ab-4dfb-92ee-0b7c9bf88176 admin admin] PATH_INFO: `/v3/projects/e50dd69fcb524de78d72365fd4ca2b9b/users/fb0b6635352147f7bc6f829073bfa3ed/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:48.766974 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4070/8216] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:48 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:48.772693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69a46b-be27-466f-a460-502266103de5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:48.773729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdca46-29ab-4dfb-92ee-0b7c9bf88176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50dd69fcb524de78d72365fd4ca2b9b, user_id=fb0b6635352147f7bc6f829073bfa3ed, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:48.776433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdca46-29ab-4dfb-92ee-0b7c9bf88176 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:48.837308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69a46b-be27-466f-a460-502266103de5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:48.842186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d2c94-ac11-4d4e-aa45-5d2e49547c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:48.845931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d2c94-ac11-4d4e-aa45-5d2e49547c98 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:48.845931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d2c94-ac11-4d4e-aa45-5d2e49547c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:48.845931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d2c94-ac11-4d4e-aa45-5d2e49547c98 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:48.845931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d2c94-ac11-4d4e-aa45-5d2e49547c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:48.846270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d2c94-ac11-4d4e-aa45-5d2e49547c98 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:48.860035 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4147/8217] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:48 2022] PUT /identity/v3/projects/e50dd69fcb524de78d72365fd4ca2b9b/users/fb0b6635352147f7bc6f829073bfa3ed/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:48.865464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779870f-008f-4808-99a9-e8c0a5bed4fa None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:48.865856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779870f-008f-4808-99a9-e8c0a5bed4fa None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:48.866340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779870f-008f-4808-99a9-e8c0a5bed4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:48.904586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c779870f-008f-4808-99a9-e8c0a5bed4fa None None] MFA Rules not processed for user `fb0b6635352147f7bc6f829073bfa3ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:48.905851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c779870f-008f-4808-99a9-e8c0a5bed4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:49.027274 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4071/8218] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:48 2022] POST /identity/v3/users => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:49.029365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d2c94-ac11-4d4e-aa45-5d2e49547c98 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:49.031941 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4148/8219] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:04:49.037167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779870f-008f-4808-99a9-e8c0a5bed4fa None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:49.042955 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d2c94-ac11-4d4e-aa45-5d2e49547c98 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:49.122599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779870f-008f-4808-99a9-e8c0a5bed4fa None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:49.128434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff22ac-15c5-46ec-b9de-3ce2810c3ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:49.129223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff22ac-15c5-46ec-b9de-3ce2810c3ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:49.129829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff22ac-15c5-46ec-b9de-3ce2810c3ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:49.129945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff22ac-15c5-46ec-b9de-3ce2810c3ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:49.130621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff22ac-15c5-46ec-b9de-3ce2810c3ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:49.132607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff22ac-15c5-46ec-b9de-3ce2810c3ab1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:49.140824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac87da8-b08d-45ce-bfd6-4ad332ae0caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:49.140824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac87da8-b08d-45ce-bfd6-4ad332ae0caa admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:49.140824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac87da8-b08d-45ce-bfd6-4ad332ae0caa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:49.140824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac87da8-b08d-45ce-bfd6-4ad332ae0caa admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:49.141244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac87da8-b08d-45ce-bfd6-4ad332ae0caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:49.141244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac87da8-b08d-45ce-bfd6-4ad332ae0caa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:49.151314 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4072/8220] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:49.155562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac87da8-b08d-45ce-bfd6-4ad332ae0caa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:49.165371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:49.168500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac87da8-b08d-45ce-bfd6-4ad332ae0caa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:49.173377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7e93a-39b5-40c7-b5a2-9f8aa8693fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:49.174020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e93a-39b5-40c7-b5a2-9f8aa8693fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:49.174314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e93a-39b5-40c7-b5a2-9f8aa8693fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:49.174611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e93a-39b5-40c7-b5a2-9f8aa8693fcb admin admin] PATH_INFO: `/v3/projects/fcea7376534a4402a2d011e6f5649dec/users/87c1a2ffc0914bf3bfa0101d241f9184/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:49.190092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7e93a-39b5-40c7-b5a2-9f8aa8693fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcea7376534a4402a2d011e6f5649dec, user_id=87c1a2ffc0914bf3bfa0101d241f9184, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:49.193428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7e93a-39b5-40c7-b5a2-9f8aa8693fcb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:49.288222 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4149/8221] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:04:49 2022] POST /identity/v3/projects => generated 385 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:04:49.292070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff22ac-15c5-46ec-b9de-3ce2810c3ab1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:49.302715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:49.320214 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4073/8222] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:49 2022] PUT /identity/v3/projects/fcea7376534a4402a2d011e6f5649dec/users/87c1a2ffc0914bf3bfa0101d241f9184/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:49.321187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7e93a-39b5-40c7-b5a2-9f8aa8693fcb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:49.371535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff22ac-15c5-46ec-b9de-3ce2810c3ab1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:49.420561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7e93a-39b5-40c7-b5a2-9f8aa8693fcb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:49.438571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e747b6-b8b2-413b-a7da-c517d84302cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:49.438571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e747b6-b8b2-413b-a7da-c517d84302cd admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:49.438571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e747b6-b8b2-413b-a7da-c517d84302cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:49.438571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e747b6-b8b2-413b-a7da-c517d84302cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:49.439075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e747b6-b8b2-413b-a7da-c517d84302cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:49.439075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e747b6-b8b2-413b-a7da-c517d84302cd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:49.459682 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4074/8223] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:49.461331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e747b6-b8b2-413b-a7da-c517d84302cd admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:49.470612 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab478bc2-baa2-49cd-b684-8cfa8bf5623b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:49.471250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab478bc2-baa2-49cd-b684-8cfa8bf5623b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:49.471779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab478bc2-baa2-49cd-b684-8cfa8bf5623b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:49.472068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab478bc2-baa2-49cd-b684-8cfa8bf5623b admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:49.472892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab478bc2-baa2-49cd-b684-8cfa8bf5623b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:49.474946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab478bc2-baa2-49cd-b684-8cfa8bf5623b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:49.489218 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e747b6-b8b2-413b-a7da-c517d84302cd admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:49.494292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9aa71-8fbe-4344-9085-a58e6a74acc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:49.495053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9aa71-8fbe-4344-9085-a58e6a74acc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:49.495434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9aa71-8fbe-4344-9085-a58e6a74acc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:49.495787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9aa71-8fbe-4344-9085-a58e6a74acc5 admin admin] PATH_INFO: `/v3/projects/fcea7376534a4402a2d011e6f5649dec/users/87c1a2ffc0914bf3bfa0101d241f9184/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:49.497832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9aa71-8fbe-4344-9085-a58e6a74acc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcea7376534a4402a2d011e6f5649dec, user_id=87c1a2ffc0914bf3bfa0101d241f9184, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:49.500665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9aa71-8fbe-4344-9085-a58e6a74acc5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:49.516250 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4075/8224] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:49 2022] PUT /identity/v3/projects/fcea7376534a4402a2d011e6f5649dec/users/87c1a2ffc0914bf3bfa0101d241f9184/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:49.523279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b005008-58ad-4f14-b52a-6181f9f65bd7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:49.523659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b005008-58ad-4f14-b52a-6181f9f65bd7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:49.524007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b005008-58ad-4f14-b52a-6181f9f65bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:49.553921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0b005008-58ad-4f14-b52a-6181f9f65bd7 None None] MFA Rules not processed for user `87c1a2ffc0914bf3bfa0101d241f9184`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:49.555246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0b005008-58ad-4f14-b52a-6181f9f65bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:49.568417 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4150/8225] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:04:49 2022] POST /identity/v3/users => generated 299 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:04:49.572043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab478bc2-baa2-49cd-b684-8cfa8bf5623b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:49.585053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab478bc2-baa2-49cd-b684-8cfa8bf5623b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:49.640229 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4076/8226] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:04:49.651325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbf7bf-c7a2-49bb-9f93-39db25e117ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:49.652016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbf7bf-c7a2-49bb-9f93-39db25e117ef admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:49.652185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b005008-58ad-4f14-b52a-6181f9f65bd7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:49.652457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbf7bf-c7a2-49bb-9f93-39db25e117ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:49.652799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbf7bf-c7a2-49bb-9f93-39db25e117ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:49.653450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbf7bf-c7a2-49bb-9f93-39db25e117ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:49.653599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0b005008-58ad-4f14-b52a-6181f9f65bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:49.655313 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbf7bf-c7a2-49bb-9f93-39db25e117ef admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:49.666697 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4151/8227] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:04:49.669723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbf7bf-c7a2-49bb-9f93-39db25e117ef admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:49.679865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbf7bf-c7a2-49bb-9f93-39db25e117ef admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:49.685285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9fbf1-4908-4ac0-9cf7-acd938882ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:49.685929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9fbf1-4908-4ac0-9cf7-acd938882ef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:49.686210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9fbf1-4908-4ac0-9cf7-acd938882ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:49.686484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9fbf1-4908-4ac0-9cf7-acd938882ef9 admin admin] PATH_INFO: `/v3/projects/5f6e053581ff4e5aab7ca0258d8f7088/users/7a66e8cfc8974b1fa001f900bbda2901/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:49.702792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9fbf1-4908-4ac0-9cf7-acd938882ef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6e053581ff4e5aab7ca0258d8f7088, user_id=7a66e8cfc8974b1fa001f900bbda2901, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:49.705616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9fbf1-4908-4ac0-9cf7-acd938882ef9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:49.717896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b005008-58ad-4f14-b52a-6181f9f65bd7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:49.721601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc43288-794b-494c-b0ad-2ed5bc0d511d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:49.722237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc43288-794b-494c-b0ad-2ed5bc0d511d service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:49.722520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc43288-794b-494c-b0ad-2ed5bc0d511d service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:49.722826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc43288-794b-494c-b0ad-2ed5bc0d511d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:49.730611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:49.781686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc43288-794b-494c-b0ad-2ed5bc0d511d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:49.783166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc43288-794b-494c-b0ad-2ed5bc0d511d service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:49.792470 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4077/8228] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:04:49.793182 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4152/8229] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:49 2022] PUT /identity/v3/projects/5f6e053581ff4e5aab7ca0258d8f7088/users/7a66e8cfc8974b1fa001f900bbda2901/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:04:49.797531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc43288-794b-494c-b0ad-2ed5bc0d511d service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:49.809780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc43288-794b-494c-b0ad-2ed5bc0d511d service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:49.897590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ffa6d-3e1d-4184-af6b-21c37658f013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:49.898485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ffa6d-3e1d-4184-af6b-21c37658f013 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:49.898899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ffa6d-3e1d-4184-af6b-21c37658f013 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:49.899301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ffa6d-3e1d-4184-af6b-21c37658f013 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:49.900148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ffa6d-3e1d-4184-af6b-21c37658f013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:49.902546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ffa6d-3e1d-4184-af6b-21c37658f013 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:49.915721 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4078/8230] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:04:49.920645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9fbf1-4908-4ac0-9cf7-acd938882ef9 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:49.936259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9fbf1-4908-4ac0-9cf7-acd938882ef9 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:49.942744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:49.946378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ebc0a-6e32-4628-ae14-d71ecd44fab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:49.948704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ebc0a-6e32-4628-ae14-d71ecd44fab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:49.948704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ebc0a-6e32-4628-ae14-d71ecd44fab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:49.948704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ebc0a-6e32-4628-ae14-d71ecd44fab2 admin admin] PATH_INFO: `/v3/projects/5f6e053581ff4e5aab7ca0258d8f7088/users/7a66e8cfc8974b1fa001f900bbda2901/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:49.950574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ebc0a-6e32-4628-ae14-d71ecd44fab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6e053581ff4e5aab7ca0258d8f7088, user_id=7a66e8cfc8974b1fa001f900bbda2901, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:49.953540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ebc0a-6e32-4628-ae14-d71ecd44fab2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:49.980978 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4153/8231] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:04:49 2022] PUT /identity/v3/projects/5f6e053581ff4e5aab7ca0258d8f7088/users/7a66e8cfc8974b1fa001f900bbda2901/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:04:49.983058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711d187-d66f-4962-be9f-02ef8b026553 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:49.983342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711d187-d66f-4962-be9f-02ef8b026553 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:49.983613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711d187-d66f-4962-be9f-02ef8b026553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:50.030113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9711d187-d66f-4962-be9f-02ef8b026553 None None] MFA Rules not processed for user `7a66e8cfc8974b1fa001f900bbda2901`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:04:50.032125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9711d187-d66f-4962-be9f-02ef8b026553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:50.135225 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4079/8232] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:04:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:04:50.151216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ebc0a-6e32-4628-ae14-d71ecd44fab2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:50.153727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2f6ebc0a-6e32-4628-ae14-d71ecd44fab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:04:50.217398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ebc0a-6e32-4628-ae14-d71ecd44fab2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:50.221269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bd52a-713a-4fa0-8e52-29864b12472a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:50.222252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bd52a-713a-4fa0-8e52-29864b12472a service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:50.222535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bd52a-713a-4fa0-8e52-29864b12472a service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:50.222810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bd52a-713a-4fa0-8e52-29864b12472a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:50.280149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bd52a-713a-4fa0-8e52-29864b12472a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:50.281613 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bd52a-713a-4fa0-8e52-29864b12472a service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:50.290961 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4154/8233] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:50.328455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:50.969999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:52.365280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:52.725535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:53.730348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711d187-d66f-4962-be9f-02ef8b026553 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:53.747405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711d187-d66f-4962-be9f-02ef8b026553 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:53.752261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd6549-d16f-4687-9cf8-5c80d81f8309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:53.753143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd6549-d16f-4687-9cf8-5c80d81f8309 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:53.762492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd6549-d16f-4687-9cf8-5c80d81f8309 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:53.762492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd6549-d16f-4687-9cf8-5c80d81f8309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:53.813779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bd52a-713a-4fa0-8e52-29864b12472a service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:53.825645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bd52a-713a-4fa0-8e52-29864b12472a service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:53.829713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232c533-8ae0-458f-821e-6d49b56d1a36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:53.830321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232c533-8ae0-458f-821e-6d49b56d1a36 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:53.835743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232c533-8ae0-458f-821e-6d49b56d1a36 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:53.835743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232c533-8ae0-458f-821e-6d49b56d1a36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:53.836437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd6549-d16f-4687-9cf8-5c80d81f8309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:53.837965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd6549-d16f-4687-9cf8-5c80d81f8309 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:53.853282 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4080/8234] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:53.932297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232c533-8ae0-458f-821e-6d49b56d1a36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:53.933769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232c533-8ae0-458f-821e-6d49b56d1a36 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:53.959239 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4155/8235] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:04:54.609787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:55.163117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:56.067991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:56.172871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd6549-d16f-4687-9cf8-5c80d81f8309 service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:56.178293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232c533-8ae0-458f-821e-6d49b56d1a36 service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:04:56.185606 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd6549-d16f-4687-9cf8-5c80d81f8309 service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:56.189415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f1545-e8da-4c8f-845b-8ab1b929712d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:56.189864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232c533-8ae0-458f-821e-6d49b56d1a36 service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:04:56.190017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f1545-e8da-4c8f-845b-8ab1b929712d service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:56.190884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f1545-e8da-4c8f-845b-8ab1b929712d service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:56.191638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f1545-e8da-4c8f-845b-8ab1b929712d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:56.196148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd2368-05cb-4fca-9b87-0032c5251291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:04:56.196995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd2368-05cb-4fca-9b87-0032c5251291 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:04:56.197287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd2368-05cb-4fca-9b87-0032c5251291 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:04:56.197564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd2368-05cb-4fca-9b87-0032c5251291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:04:56.210858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd2368-05cb-4fca-9b87-0032c5251291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:56.212582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd2368-05cb-4fca-9b87-0032c5251291 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:56.227609 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4156/8236] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:04:56.263967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f1545-e8da-4c8f-845b-8ab1b929712d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:04:56.265651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f1545-e8da-4c8f-845b-8ab1b929712d service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:04:56.276228 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4081/8237] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:04:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:04:56.896208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:57.724929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:57.781224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:58.524959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:58.568744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:58.844371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:59.534374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:04:59.736027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:00.987275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:01.547139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:03.753345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:04.357350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:04.838370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:05.524243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:06.324752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:06.986711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:07.118058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd2368-05cb-4fca-9b87-0032c5251291 service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:07.211601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f1545-e8da-4c8f-845b-8ab1b929712d service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:07.239669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd2368-05cb-4fca-9b87-0032c5251291 service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:07.245861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed2268-aa3c-4ca3-8d9d-89d1224039e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:07.246785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed2268-aa3c-4ca3-8d9d-89d1224039e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:07.247163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed2268-aa3c-4ca3-8d9d-89d1224039e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:07.247517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed2268-aa3c-4ca3-8d9d-89d1224039e4 admin admin] PATH_INFO: `/v3/users/43a8911d9bee4557a6665dec3c4b4c43` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:07.248812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed2268-aa3c-4ca3-8d9d-89d1224039e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a8911d9bee4557a6665dec3c4b4c43)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:07.251518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed2268-aa3c-4ca3-8d9d-89d1224039e4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:07.309848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f1545-e8da-4c8f-845b-8ab1b929712d service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:07.315664 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897659f-2f48-43a5-bb50-6a6be9dc54d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:07.316906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897659f-2f48-43a5-bb50-6a6be9dc54d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:07.317281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897659f-2f48-43a5-bb50-6a6be9dc54d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:07.317648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897659f-2f48-43a5-bb50-6a6be9dc54d8 admin admin] PATH_INFO: `/v3/users/f2933a6df85641cebc7cb0924c8d4016` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:07.319078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897659f-2f48-43a5-bb50-6a6be9dc54d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2933a6df85641cebc7cb0924c8d4016)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:07.321170 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897659f-2f48-43a5-bb50-6a6be9dc54d8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:07.552633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61ed2268-aa3c-4ca3-8d9d-89d1224039e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a8911d9bee4557a6665dec3c4b4c43'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:07.553340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61ed2268-aa3c-4ca3-8d9d-89d1224039e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a8911d9bee4557a6665dec3c4b4c43'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:07.611384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4897659f-2f48-43a5-bb50-6a6be9dc54d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2933a6df85641cebc7cb0924c8d4016'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:07.695769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61ed2268-aa3c-4ca3-8d9d-89d1224039e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a8911d9bee4557a6665dec3c4b4c43'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:07.695994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61ed2268-aa3c-4ca3-8d9d-89d1224039e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a8911d9bee4557a6665dec3c4b4c43'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:07.719173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-61ed2268-aa3c-4ca3-8d9d-89d1224039e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a8911d9bee4557a6665dec3c4b4c43'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:07.724092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:07.748917 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4157/8238] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:05:07 2022] DELETE /identity/v3/users/43a8911d9bee4557a6665dec3c4b4c43 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:05:07.750272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71b85-cf31-4c2d-85b0-1d3ccc4208c8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:07.750790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71b85-cf31-4c2d-85b0-1d3ccc4208c8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:07.751075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71b85-cf31-4c2d-85b0-1d3ccc4208c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:07.754736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4897659f-2f48-43a5-bb50-6a6be9dc54d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2933a6df85641cebc7cb0924c8d4016'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:07.756560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4897659f-2f48-43a5-bb50-6a6be9dc54d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2933a6df85641cebc7cb0924c8d4016'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:07.777381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4897659f-2f48-43a5-bb50-6a6be9dc54d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2933a6df85641cebc7cb0924c8d4016'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:07.797717 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-13c71b85-cf31-4c2d-85b0-1d3ccc4208c8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:05:07.801470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-13c71b85-cf31-4c2d-85b0-1d3ccc4208c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:07.803940 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-4897659f-2f48-43a5-bb50-6a6be9dc54d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2933a6df85641cebc7cb0924c8d4016'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:07.817839 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4082/8239] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:05:07 2022] DELETE /identity/v3/users/f2933a6df85641cebc7cb0924c8d4016 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:05:07.822064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cf134-1502-4fc7-bbc2-9d565527483c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:07.822353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cf134-1502-4fc7-bbc2-9d565527483c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:07.822638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cf134-1502-4fc7-bbc2-9d565527483c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:07.865593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-362cf134-1502-4fc7-bbc2-9d565527483c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:05:07.866829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-362cf134-1502-4fc7-bbc2-9d565527483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:07.930990 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4158/8240] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:05:07.998289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c71b85-cf31-4c2d-85b0-1d3ccc4208c8 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:07.999741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-13c71b85-cf31-4c2d-85b0-1d3ccc4208c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:08.013745 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4083/8241] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:05:08.028149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cf134-1502-4fc7-bbc2-9d565527483c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:08.030030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-362cf134-1502-4fc7-bbc2-9d565527483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:08.135785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c71b85-cf31-4c2d-85b0-1d3ccc4208c8 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:08.183584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cf134-1502-4fc7-bbc2-9d565527483c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:08.188314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cdff1-1bc2-4ed4-9610-4d6d9246caa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:08.194531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cdff1-1bc2-4ed4-9610-4d6d9246caa8 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:08.194531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cdff1-1bc2-4ed4-9610-4d6d9246caa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:08.194531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cdff1-1bc2-4ed4-9610-4d6d9246caa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:08.207263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b9c12-9cc9-4b77-be02-880d794d2dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:08.207991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b9c12-9cc9-4b77-be02-880d794d2dfe service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:08.208363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b9c12-9cc9-4b77-be02-880d794d2dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:08.208827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b9c12-9cc9-4b77-be02-880d794d2dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:08.213855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cdff1-1bc2-4ed4-9610-4d6d9246caa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:08.215376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cdff1-1bc2-4ed4-9610-4d6d9246caa8 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:08.223057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b9c12-9cc9-4b77-be02-880d794d2dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:08.224678 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b9c12-9cc9-4b77-be02-880d794d2dfe service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:08.230409 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4084/8242] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:05:08.240295 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4159/8243] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:05:08.357059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:08.428156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:08.890431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cdff1-1bc2-4ed4-9610-4d6d9246caa8 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:08.890431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-fa3cdff1-1bc2-4ed4-9610-4d6d9246caa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:08.925873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cdff1-1bc2-4ed4-9610-4d6d9246caa8 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:08.933240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74709725-09bb-4491-890f-948950bd6bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:08.933906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74709725-09bb-4491-890f-948950bd6bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:08.934354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74709725-09bb-4491-890f-948950bd6bab admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:08.935150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74709725-09bb-4491-890f-948950bd6bab admin admin] PATH_INFO: `/v3/projects/0b022ef5736f41e694728fd837b9e63a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:08.936567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74709725-09bb-4491-890f-948950bd6bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b022ef5736f41e694728fd837b9e63a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:08.959597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74709725-09bb-4491-890f-948950bd6bab admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:09.057579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b9c12-9cc9-4b77-be02-880d794d2dfe service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:09.059181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-915b9c12-9cc9-4b77-be02-880d794d2dfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:09.073764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b9c12-9cc9-4b77-be02-880d794d2dfe service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:09.081384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e4cc9-4c1f-4078-b932-dd64c7853127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:09.081384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e4cc9-4c1f-4078-b932-dd64c7853127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:09.081384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e4cc9-4c1f-4078-b932-dd64c7853127 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:09.081384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e4cc9-4c1f-4078-b932-dd64c7853127 admin admin] PATH_INFO: `/v3/projects/13e645261bc94abd9c6f3e9bc901fba6` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:09.090597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e4cc9-4c1f-4078-b932-dd64c7853127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e645261bc94abd9c6f3e9bc901fba6)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:09.090597 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e4cc9-4c1f-4078-b932-dd64c7853127 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:09.128351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-74709725-09bb-4491-890f-948950bd6bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b022ef5736f41e694728fd837b9e63a', 'request_id': 'req-74709725-09bb-4491-890f-948950bd6bab'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.130721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-74709725-09bb-4491-890f-948950bd6bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b022ef5736f41e694728fd837b9e63a', 'request_id': 'req-74709725-09bb-4491-890f-948950bd6bab'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.139175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-74709725-09bb-4491-890f-948950bd6bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b022ef5736f41e694728fd837b9e63a', 'request_id': 'req-74709725-09bb-4491-890f-948950bd6bab'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.239308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-74709725-09bb-4491-890f-948950bd6bab admin admin] The token cache is being invalidate because project 0b022ef5736f41e694728fd837b9e63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:05:09.239308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-74709725-09bb-4491-890f-948950bd6bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.239842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-74709725-09bb-4491-890f-948950bd6bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.242070 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4085/8244] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:08 2022] DELETE /identity/v3/projects/0b022ef5736f41e694728fd837b9e63a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:05:09.245672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74709725-09bb-4491-890f-948950bd6bab admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:09.247133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-74709725-09bb-4491-890f-948950bd6bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:09.297891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7c3e4cc9-4c1f-4078-b932-dd64c7853127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e645261bc94abd9c6f3e9bc901fba6', 'request_id': 'req-7c3e4cc9-4c1f-4078-b932-dd64c7853127'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.307624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7c3e4cc9-4c1f-4078-b932-dd64c7853127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e645261bc94abd9c6f3e9bc901fba6', 'request_id': 'req-7c3e4cc9-4c1f-4078-b932-dd64c7853127'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.334187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74709725-09bb-4491-890f-948950bd6bab admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:09.400406 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494211c4-0466-4821-98a7-8bb376638691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:09.401044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494211c4-0466-4821-98a7-8bb376638691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:09.401329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494211c4-0466-4821-98a7-8bb376638691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:09.401605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494211c4-0466-4821-98a7-8bb376638691 admin admin] PATH_INFO: `/v3/users/487a7d0fdc774e29acde402623f27446` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:09.403085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494211c4-0466-4821-98a7-8bb376638691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=487a7d0fdc774e29acde402623f27446)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:09.403723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7c3e4cc9-4c1f-4078-b932-dd64c7853127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e645261bc94abd9c6f3e9bc901fba6', 'request_id': 'req-7c3e4cc9-4c1f-4078-b932-dd64c7853127'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.405349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494211c4-0466-4821-98a7-8bb376638691 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:09.417960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7c3e4cc9-4c1f-4078-b932-dd64c7853127 admin admin] The token cache is being invalidate because project 13e645261bc94abd9c6f3e9bc901fba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:05:09.418251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7c3e4cc9-4c1f-4078-b932-dd64c7853127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.419096 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7c3e4cc9-4c1f-4078-b932-dd64c7853127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.421268 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4160/8245] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:09 2022] DELETE /identity/v3/projects/13e645261bc94abd9c6f3e9bc901fba6 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:05:09.425573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e4cc9-4c1f-4078-b932-dd64c7853127 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:09.426997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7c3e4cc9-4c1f-4078-b932-dd64c7853127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:09.440404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e4cc9-4c1f-4078-b932-dd64c7853127 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:09.445370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd41a5e-fb35-4b23-acb3-793bcd4fd12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:09.446018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd41a5e-fb35-4b23-acb3-793bcd4fd12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:09.446299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd41a5e-fb35-4b23-acb3-793bcd4fd12a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:09.446577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd41a5e-fb35-4b23-acb3-793bcd4fd12a admin admin] PATH_INFO: `/v3/users/fb0b6635352147f7bc6f829073bfa3ed` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:09.447853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd41a5e-fb35-4b23-acb3-793bcd4fd12a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb0b6635352147f7bc6f829073bfa3ed)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:09.449844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd41a5e-fb35-4b23-acb3-793bcd4fd12a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:09.474074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:09.774020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-494211c4-0466-4821-98a7-8bb376638691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '487a7d0fdc774e29acde402623f27446'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.801864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0fd41a5e-fb35-4b23-acb3-793bcd4fd12a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb0b6635352147f7bc6f829073bfa3ed'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.802679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0fd41a5e-fb35-4b23-acb3-793bcd4fd12a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb0b6635352147f7bc6f829073bfa3ed'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.889415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-494211c4-0466-4821-98a7-8bb376638691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '487a7d0fdc774e29acde402623f27446'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.890054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-494211c4-0466-4821-98a7-8bb376638691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '487a7d0fdc774e29acde402623f27446'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.898530 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-494211c4-0466-4821-98a7-8bb376638691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '487a7d0fdc774e29acde402623f27446'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.911220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-494211c4-0466-4821-98a7-8bb376638691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '487a7d0fdc774e29acde402623f27446'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.917960 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4086/8246] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:05:09 2022] DELETE /identity/v3/users/487a7d0fdc774e29acde402623f27446 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:05:09.962705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0fd41a5e-fb35-4b23-acb3-793bcd4fd12a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb0b6635352147f7bc6f829073bfa3ed'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.963580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0fd41a5e-fb35-4b23-acb3-793bcd4fd12a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb0b6635352147f7bc6f829073bfa3ed'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.980744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0fd41a5e-fb35-4b23-acb3-793bcd4fd12a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb0b6635352147f7bc6f829073bfa3ed'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:09.995616 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4161/8247] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:05:09 2022] DELETE /identity/v3/users/fb0b6635352147f7bc6f829073bfa3ed => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:05:10.256773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:10.747017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494211c4-0466-4821-98a7-8bb376638691 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:10.747017 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-494211c4-0466-4821-98a7-8bb376638691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:10.748304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd41a5e-fb35-4b23-acb3-793bcd4fd12a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:10.749704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0fd41a5e-fb35-4b23-acb3-793bcd4fd12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:10.836632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd41a5e-fb35-4b23-acb3-793bcd4fd12a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:10.839498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494211c4-0466-4821-98a7-8bb376638691 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:10.844078 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:10.844786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:10.845068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:10.845175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720ac83-4f94-4756-b95a-28dd6af868d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:10.845340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26 admin admin] PATH_INFO: `/v3/projects/e50dd69fcb524de78d72365fd4ca2b9b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:10.846618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720ac83-4f94-4756-b95a-28dd6af868d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:10.847002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720ac83-4f94-4756-b95a-28dd6af868d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:10.847425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720ac83-4f94-4756-b95a-28dd6af868d6 admin admin] PATH_INFO: `/v3/projects/27ae1bc9a12d402ca8e834ec801627f8` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:10.848045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e50dd69fcb524de78d72365fd4ca2b9b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:10.848751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720ac83-4f94-4756-b95a-28dd6af868d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27ae1bc9a12d402ca8e834ec801627f8)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:10.850438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:10.850818 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720ac83-4f94-4756-b95a-28dd6af868d6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:11.017313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b720ac83-4f94-4756-b95a-28dd6af868d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27ae1bc9a12d402ca8e834ec801627f8', 'request_id': 'req-b720ac83-4f94-4756-b95a-28dd6af868d6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:11.023900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b720ac83-4f94-4756-b95a-28dd6af868d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27ae1bc9a12d402ca8e834ec801627f8', 'request_id': 'req-b720ac83-4f94-4756-b95a-28dd6af868d6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:11.032777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:11.038476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b720ac83-4f94-4756-b95a-28dd6af868d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27ae1bc9a12d402ca8e834ec801627f8', 'request_id': 'req-b720ac83-4f94-4756-b95a-28dd6af868d6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:11.052882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e50dd69fcb524de78d72365fd4ca2b9b', 'request_id': 'req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:11.059158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e50dd69fcb524de78d72365fd4ca2b9b', 'request_id': 'req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:11.193146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b720ac83-4f94-4756-b95a-28dd6af868d6 admin admin] The token cache is being invalidate because project 27ae1bc9a12d402ca8e834ec801627f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:05:11.193538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b720ac83-4f94-4756-b95a-28dd6af868d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:11.194292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b720ac83-4f94-4756-b95a-28dd6af868d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:11.196272 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4087/8248] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:10 2022] DELETE /identity/v3/projects/27ae1bc9a12d402ca8e834ec801627f8 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:05:11.200215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720ac83-4f94-4756-b95a-28dd6af868d6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:11.201663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b720ac83-4f94-4756-b95a-28dd6af868d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:11.272934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e50dd69fcb524de78d72365fd4ca2b9b', 'request_id': 'req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:11.288853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26 admin admin] The token cache is being invalidate because project e50dd69fcb524de78d72365fd4ca2b9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:05:11.289147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:11.290474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:11.292699 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4162/8249] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:10 2022] DELETE /identity/v3/projects/e50dd69fcb524de78d72365fd4ca2b9b => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:05:11.297882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:11.298642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720ac83-4f94-4756-b95a-28dd6af868d6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:11.299284 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:11.417583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decf5f1-baa8-468c-b8cd-ecc6fa2436ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:11.418407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decf5f1-baa8-468c-b8cd-ecc6fa2436ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:11.418711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decf5f1-baa8-468c-b8cd-ecc6fa2436ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:11.418992 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decf5f1-baa8-468c-b8cd-ecc6fa2436ec admin admin] PATH_INFO: `/v3/users/87c1a2ffc0914bf3bfa0101d241f9184` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:11.421801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0f9b1-47ef-4ab3-9c30-2bb0b712ca26 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:11.423312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decf5f1-baa8-468c-b8cd-ecc6fa2436ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=87c1a2ffc0914bf3bfa0101d241f9184)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:11.425376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decf5f1-baa8-468c-b8cd-ecc6fa2436ec admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:11.434510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eceddd9-17a2-4f86-a128-8748fd8fd730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:11.435163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eceddd9-17a2-4f86-a128-8748fd8fd730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:11.435449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eceddd9-17a2-4f86-a128-8748fd8fd730 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:11.435726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eceddd9-17a2-4f86-a128-8748fd8fd730 admin admin] PATH_INFO: `/v3/users/7a66e8cfc8974b1fa001f900bbda2901` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:11.437189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eceddd9-17a2-4f86-a128-8748fd8fd730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a66e8cfc8974b1fa001f900bbda2901)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:11.443972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eceddd9-17a2-4f86-a128-8748fd8fd730 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:11.456021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:11.802545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9decf5f1-baa8-468c-b8cd-ecc6fa2436ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87c1a2ffc0914bf3bfa0101d241f9184'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:11.946362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9decf5f1-baa8-468c-b8cd-ecc6fa2436ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87c1a2ffc0914bf3bfa0101d241f9184'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:11.947278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9decf5f1-baa8-468c-b8cd-ecc6fa2436ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87c1a2ffc0914bf3bfa0101d241f9184'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:11.948894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8eceddd9-17a2-4f86-a128-8748fd8fd730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a66e8cfc8974b1fa001f900bbda2901'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:11.949565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8eceddd9-17a2-4f86-a128-8748fd8fd730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a66e8cfc8974b1fa001f900bbda2901'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:11.958998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9decf5f1-baa8-468c-b8cd-ecc6fa2436ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87c1a2ffc0914bf3bfa0101d241f9184'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:11.973350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9decf5f1-baa8-468c-b8cd-ecc6fa2436ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87c1a2ffc0914bf3bfa0101d241f9184'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:11.982813 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4088/8250] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:05:11 2022] DELETE /identity/v3/users/87c1a2ffc0914bf3bfa0101d241f9184 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:05:12.052221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8eceddd9-17a2-4f86-a128-8748fd8fd730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a66e8cfc8974b1fa001f900bbda2901'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:12.053664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8eceddd9-17a2-4f86-a128-8748fd8fd730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a66e8cfc8974b1fa001f900bbda2901'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:12.078626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8eceddd9-17a2-4f86-a128-8748fd8fd730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a66e8cfc8974b1fa001f900bbda2901'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:12.100323 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4163/8251] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:05:11 2022] DELETE /identity/v3/users/7a66e8cfc8974b1fa001f900bbda2901 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:05:12.433455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:12.600706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decf5f1-baa8-468c-b8cd-ecc6fa2436ec admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:12.602331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9decf5f1-baa8-468c-b8cd-ecc6fa2436ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:12.678386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decf5f1-baa8-468c-b8cd-ecc6fa2436ec admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:12.715645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eceddd9-17a2-4f86-a128-8748fd8fd730 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:12.717964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8eceddd9-17a2-4f86-a128-8748fd8fd730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:12.776249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0280ba9-193c-4323-97d5-2282a8a4bcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:12.777175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0280ba9-193c-4323-97d5-2282a8a4bcaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:12.777439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0280ba9-193c-4323-97d5-2282a8a4bcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:12.777787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0280ba9-193c-4323-97d5-2282a8a4bcaa admin admin] PATH_INFO: `/v3/projects/fcea7376534a4402a2d011e6f5649dec` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:12.779687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0280ba9-193c-4323-97d5-2282a8a4bcaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcea7376534a4402a2d011e6f5649dec)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:12.781902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0280ba9-193c-4323-97d5-2282a8a4bcaa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:12.823364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eceddd9-17a2-4f86-a128-8748fd8fd730 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:12.828557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec02915-c8c9-40ad-9b8b-971ffebd8250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:12.829213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec02915-c8c9-40ad-9b8b-971ffebd8250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:12.829494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec02915-c8c9-40ad-9b8b-971ffebd8250 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:12.829767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec02915-c8c9-40ad-9b8b-971ffebd8250 admin admin] PATH_INFO: `/v3/projects/5f6e053581ff4e5aab7ca0258d8f7088` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:12.831832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec02915-c8c9-40ad-9b8b-971ffebd8250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f6e053581ff4e5aab7ca0258d8f7088)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:12.833792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec02915-c8c9-40ad-9b8b-971ffebd8250 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:13.012989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c0280ba9-193c-4323-97d5-2282a8a4bcaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcea7376534a4402a2d011e6f5649dec', 'request_id': 'req-c0280ba9-193c-4323-97d5-2282a8a4bcaa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:13.019641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c0280ba9-193c-4323-97d5-2282a8a4bcaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcea7376534a4402a2d011e6f5649dec', 'request_id': 'req-c0280ba9-193c-4323-97d5-2282a8a4bcaa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:13.026827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c0280ba9-193c-4323-97d5-2282a8a4bcaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcea7376534a4402a2d011e6f5649dec', 'request_id': 'req-c0280ba9-193c-4323-97d5-2282a8a4bcaa'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:13.034258 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:13.055362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-eec02915-c8c9-40ad-9b8b-971ffebd8250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f6e053581ff4e5aab7ca0258d8f7088', 'request_id': 'req-eec02915-c8c9-40ad-9b8b-971ffebd8250'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:13.061920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-eec02915-c8c9-40ad-9b8b-971ffebd8250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f6e053581ff4e5aab7ca0258d8f7088', 'request_id': 'req-eec02915-c8c9-40ad-9b8b-971ffebd8250'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:13.181896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c0280ba9-193c-4323-97d5-2282a8a4bcaa admin admin] The token cache is being invalidate because project fcea7376534a4402a2d011e6f5649dec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:05:13.182204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c0280ba9-193c-4323-97d5-2282a8a4bcaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:13.182978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c0280ba9-193c-4323-97d5-2282a8a4bcaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:13.185226 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4089/8252] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:12 2022] DELETE /identity/v3/projects/fcea7376534a4402a2d011e6f5649dec => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:05:13.190203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcba8e-78fb-4f5d-9a40-dc2e246cb8b7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:13.190632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcba8e-78fb-4f5d-9a40-dc2e246cb8b7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:13.191612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcba8e-78fb-4f5d-9a40-dc2e246cb8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:13.216908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a1fcba8e-78fb-4f5d-9a40-dc2e246cb8b7 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:05:13.218332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a1fcba8e-78fb-4f5d-9a40-dc2e246cb8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:13.272102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-eec02915-c8c9-40ad-9b8b-971ffebd8250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f6e053581ff4e5aab7ca0258d8f7088', 'request_id': 'req-eec02915-c8c9-40ad-9b8b-971ffebd8250'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:13.287557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-eec02915-c8c9-40ad-9b8b-971ffebd8250 admin admin] The token cache is being invalidate because project 5f6e053581ff4e5aab7ca0258d8f7088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:05:13.288367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-eec02915-c8c9-40ad-9b8b-971ffebd8250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:13.289235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-eec02915-c8c9-40ad-9b8b-971ffebd8250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:05:13.290955 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4164/8253] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:05:12 2022] DELETE /identity/v3/projects/5f6e053581ff4e5aab7ca0258d8f7088 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:05:13.291938 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4090/8254] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:05:13.295767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e27d8c-8f2c-4264-b5a9-6d827de9bfe9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:13.296056 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e27d8c-8f2c-4264-b5a9-6d827de9bfe9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:13.296361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e27d8c-8f2c-4264-b5a9-6d827de9bfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:13.302569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f905f-0510-41b1-82cf-e2cab3518bef None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:13.302872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f905f-0510-41b1-82cf-e2cab3518bef None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:13.303127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f905f-0510-41b1-82cf-e2cab3518bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:13.318913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-28e27d8c-8f2c-4264-b5a9-6d827de9bfe9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:05:13.320366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-28e27d8c-8f2c-4264-b5a9-6d827de9bfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:13.322931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6a9f905f-0510-41b1-82cf-e2cab3518bef None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:05:13.324110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6a9f905f-0510-41b1-82cf-e2cab3518bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:13.328803 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4165/8255] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:05:13.337910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a68c9-6a95-4af9-937b-0b4e86e39ca9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:13.338203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a68c9-6a95-4af9-937b-0b4e86e39ca9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:13.338486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a68c9-6a95-4af9-937b-0b4e86e39ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:13.338878 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4091/8256] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:05:13.342724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f905f-0510-41b1-82cf-e2cab3518bef None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:13.353475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f905f-0510-41b1-82cf-e2cab3518bef None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:13.358790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139551f7-8279-44ef-8ddd-3f230adada18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:13.369994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139551f7-8279-44ef-8ddd-3f230adada18 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:13.369994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139551f7-8279-44ef-8ddd-3f230adada18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:13.369994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139551f7-8279-44ef-8ddd-3f230adada18 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:13.369994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139551f7-8279-44ef-8ddd-3f230adada18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:05:13.370854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-218a68c9-6a95-4af9-937b-0b4e86e39ca9 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:05:13.370952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139551f7-8279-44ef-8ddd-3f230adada18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:13.371027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-218a68c9-6a95-4af9-937b-0b4e86e39ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:13.371105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139551f7-8279-44ef-8ddd-3f230adada18 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:13.371198 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4166/8257] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:05:13.375067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a68c9-6a95-4af9-937b-0b4e86e39ca9 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:13.380974 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4092/8258] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:05:13.382027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139551f7-8279-44ef-8ddd-3f230adada18 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:13.385538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a68c9-6a95-4af9-937b-0b4e86e39ca9 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:13.390169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57facb55-2a60-488f-b4be-6a2716244780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:13.393157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57facb55-2a60-488f-b4be-6a2716244780 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:13.393157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57facb55-2a60-488f-b4be-6a2716244780 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:13.393157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57facb55-2a60-488f-b4be-6a2716244780 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:13.393157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57facb55-2a60-488f-b4be-6a2716244780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:05:13.393157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57facb55-2a60-488f-b4be-6a2716244780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:13.394773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57facb55-2a60-488f-b4be-6a2716244780 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:13.395740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139551f7-8279-44ef-8ddd-3f230adada18 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:13.402598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da0870-0825-4bcd-8ee8-fe7fe119493b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:13.403216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da0870-0825-4bcd-8ee8-fe7fe119493b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:13.403502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da0870-0825-4bcd-8ee8-fe7fe119493b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:13.403777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da0870-0825-4bcd-8ee8-fe7fe119493b admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:13.404856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da0870-0825-4bcd-8ee8-fe7fe119493b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:13.410676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da0870-0825-4bcd-8ee8-fe7fe119493b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:13.415418 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4167/8259] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:05:13.416407 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57facb55-2a60-488f-b4be-6a2716244780 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:13.427856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57facb55-2a60-488f-b4be-6a2716244780 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:13.434152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6c581-372c-4b48-a1b4-164bc1677393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:13.434152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6c581-372c-4b48-a1b4-164bc1677393 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:13.434152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6c581-372c-4b48-a1b4-164bc1677393 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:13.434546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6c581-372c-4b48-a1b4-164bc1677393 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:13.435180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6c581-372c-4b48-a1b4-164bc1677393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:13.437159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6c581-372c-4b48-a1b4-164bc1677393 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:13.605907 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4093/8260] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:05:13 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:05:13.610645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da0870-0825-4bcd-8ee8-fe7fe119493b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:13.621437 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4168/8261] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:05:13 2022] POST /identity/v3/projects => generated 369 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:05:13.622989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6c581-372c-4b48-a1b4-164bc1677393 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:13.683372 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da0870-0825-4bcd-8ee8-fe7fe119493b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:13.688628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c472754-5468-42b4-a884-76f528fe31b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:13.689179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c472754-5468-42b4-a884-76f528fe31b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:13.689968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c472754-5468-42b4-a884-76f528fe31b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:13.690245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c472754-5468-42b4-a884-76f528fe31b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:13.690882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c472754-5468-42b4-a884-76f528fe31b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:13.691092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6c581-372c-4b48-a1b4-164bc1677393 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:13.692945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c472754-5468-42b4-a884-76f528fe31b6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:13.697641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28257d18-67c7-47e4-8cae-1f3745bb6ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:13.699373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28257d18-67c7-47e4-8cae-1f3745bb6ccf admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:13.699868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28257d18-67c7-47e4-8cae-1f3745bb6ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:13.700585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28257d18-67c7-47e4-8cae-1f3745bb6ccf admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:13.701442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28257d18-67c7-47e4-8cae-1f3745bb6ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:13.703845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28257d18-67c7-47e4-8cae-1f3745bb6ccf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:13.806780 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4094/8262] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:05:13 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:05:13.810893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c472754-5468-42b4-a884-76f528fe31b6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:13.822227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c472754-5468-42b4-a884-76f528fe31b6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:13.828215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc2637-515d-4658-88ca-8e8f64ca77b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:13.828925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc2637-515d-4658-88ca-8e8f64ca77b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:13.829253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc2637-515d-4658-88ca-8e8f64ca77b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:13.829523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc2637-515d-4658-88ca-8e8f64ca77b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:13.830254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc2637-515d-4658-88ca-8e8f64ca77b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:13.831916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc2637-515d-4658-88ca-8e8f64ca77b8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:13.834951 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4169/8263] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:05:13 2022] POST /identity/v3/users => generated 285 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:05:13.843863 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4095/8264] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:05:13.848760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc2637-515d-4658-88ca-8e8f64ca77b8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:13.849015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28257d18-67c7-47e4-8cae-1f3745bb6ccf admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:13.860212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28257d18-67c7-47e4-8cae-1f3745bb6ccf admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:13.860400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc2637-515d-4658-88ca-8e8f64ca77b8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:13.865979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e06f4-27ec-45e3-abee-b987abab9724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:13.870141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f21aae-5f76-44d2-b1ba-4dbc6ff8a102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:13.870262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e06f4-27ec-45e3-abee-b987abab9724 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:13.870262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e06f4-27ec-45e3-abee-b987abab9724 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:13.870483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f21aae-5f76-44d2-b1ba-4dbc6ff8a102 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:13.870576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e06f4-27ec-45e3-abee-b987abab9724 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:13.870661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f21aae-5f76-44d2-b1ba-4dbc6ff8a102 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:13.870661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f21aae-5f76-44d2-b1ba-4dbc6ff8a102 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:13.870849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e06f4-27ec-45e3-abee-b987abab9724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:13.870940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f21aae-5f76-44d2-b1ba-4dbc6ff8a102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:13.871023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e06f4-27ec-45e3-abee-b987abab9724 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:13.871125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f21aae-5f76-44d2-b1ba-4dbc6ff8a102 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:13.882601 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4170/8265] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:05:13.888304 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4096/8266] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:05:13.888816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f21aae-5f76-44d2-b1ba-4dbc6ff8a102 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:13.889249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e06f4-27ec-45e3-abee-b987abab9724 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:13.900000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e06f4-27ec-45e3-abee-b987abab9724 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:13.900924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f21aae-5f76-44d2-b1ba-4dbc6ff8a102 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:13.905737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe38e4-f605-4eb8-badd-0e555ef7c56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:13.906044 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e1157-82e0-4033-8792-569426cdab34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:13.906350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe38e4-f605-4eb8-badd-0e555ef7c56c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:13.906636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe38e4-f605-4eb8-badd-0e555ef7c56c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:13.906729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1157-82e0-4033-8792-569426cdab34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:13.906939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe38e4-f605-4eb8-badd-0e555ef7c56c admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:13.907076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1157-82e0-4033-8792-569426cdab34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:13.907263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1157-82e0-4033-8792-569426cdab34 admin admin] PATH_INFO: `/v3/projects/41907d6cb4934549993ad41d2f021d0d/users/bb14e965d8c44cf89c6acdafbeb450e3/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:13.907668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe38e4-f605-4eb8-badd-0e555ef7c56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:13.909912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe38e4-f605-4eb8-badd-0e555ef7c56c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:13.923258 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4097/8267] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:05:13.923454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e1157-82e0-4033-8792-569426cdab34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41907d6cb4934549993ad41d2f021d0d, user_id=bb14e965d8c44cf89c6acdafbeb450e3, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:13.925480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe38e4-f605-4eb8-badd-0e555ef7c56c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:13.925600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e1157-82e0-4033-8792-569426cdab34 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:13.935423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe38e4-f605-4eb8-badd-0e555ef7c56c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:13.950587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf9a8c-e35c-4c94-97f3-b192940ec226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:13.950587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf9a8c-e35c-4c94-97f3-b192940ec226 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:13.950587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf9a8c-e35c-4c94-97f3-b192940ec226 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:13.950587 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf9a8c-e35c-4c94-97f3-b192940ec226 admin admin] PATH_INFO: `/v3/projects/81d2e5084d8742dbbaea5d7c0b370f6c/users/6034cfcab807407eb894c2927eacc13e/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:13.960914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf9a8c-e35c-4c94-97f3-b192940ec226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d2e5084d8742dbbaea5d7c0b370f6c, user_id=6034cfcab807407eb894c2927eacc13e, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:13.963597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf9a8c-e35c-4c94-97f3-b192940ec226 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:14.004914 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4171/8268] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:05:13 2022] PUT /identity/v3/projects/41907d6cb4934549993ad41d2f021d0d/users/bb14e965d8c44cf89c6acdafbeb450e3/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:05:14.016019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8269a7-7df3-43b6-97d1-a0c178a313fe None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:14.016341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8269a7-7df3-43b6-97d1-a0c178a313fe None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:14.016619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8269a7-7df3-43b6-97d1-a0c178a313fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:14.046329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1b8269a7-7df3-43b6-97d1-a0c178a313fe None None] MFA Rules not processed for user `bb14e965d8c44cf89c6acdafbeb450e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:05:14.047572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1b8269a7-7df3-43b6-97d1-a0c178a313fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:14.073465 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4098/8269] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:05:13 2022] PUT /identity/v3/projects/81d2e5084d8742dbbaea5d7c0b370f6c/users/6034cfcab807407eb894c2927eacc13e/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:05:14.086088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f01e1-d9f1-4d4b-9e95-271ff784d7a4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:14.086455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f01e1-d9f1-4d4b-9e95-271ff784d7a4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:14.086657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f01e1-d9f1-4d4b-9e95-271ff784d7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:14.118209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7a3f01e1-d9f1-4d4b-9e95-271ff784d7a4 None None] MFA Rules not processed for user `6034cfcab807407eb894c2927eacc13e`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:05:14.119708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7a3f01e1-d9f1-4d4b-9e95-271ff784d7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:14.124816 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4172/8270] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:05:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:05:14.137040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8269a7-7df3-43b6-97d1-a0c178a313fe None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:14.138421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1b8269a7-7df3-43b6-97d1-a0c178a313fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:14.195866 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4099/8271] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:05:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:05:14.202026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8269a7-7df3-43b6-97d1-a0c178a313fe None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:14.209264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f01e1-d9f1-4d4b-9e95-271ff784d7a4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:14.211370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:14.212689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7a3f01e1-d9f1-4d4b-9e95-271ff784d7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:14.259813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:14.271062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9718963-7cd0-4227-a9b4-133116bc266d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:14.272534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9718963-7cd0-4227-a9b4-133116bc266d service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:14.273256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9718963-7cd0-4227-a9b4-133116bc266d service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:14.273503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9718963-7cd0-4227-a9b4-133116bc266d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:14.308597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f01e1-d9f1-4d4b-9e95-271ff784d7a4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:14.312873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73154e7e-6e76-470e-8a4f-2b5dff591ad2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:14.313482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73154e7e-6e76-470e-8a4f-2b5dff591ad2 service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:14.313765 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73154e7e-6e76-470e-8a4f-2b5dff591ad2 service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:14.314041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73154e7e-6e76-470e-8a4f-2b5dff591ad2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:14.323455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73154e7e-6e76-470e-8a4f-2b5dff591ad2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:14.324913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73154e7e-6e76-470e-8a4f-2b5dff591ad2 service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:14.338359 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4100/8272] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:05:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:05:14.353470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9718963-7cd0-4227-a9b4-133116bc266d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:14.353470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9718963-7cd0-4227-a9b4-133116bc266d service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:14.363683 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4173/8273] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:05:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:05:15.239377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:15.302744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:16.469199 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:16.811347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:17.441771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:17.523834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:18.421581 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:18.446079 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73154e7e-6e76-470e-8a4f-2b5dff591ad2 service glance] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:18.447652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-73154e7e-6e76-470e-8a4f-2b5dff591ad2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:18.468404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73154e7e-6e76-470e-8a4f-2b5dff591ad2 service glance] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:18.473554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31287497-c3dd-4818-9b79-326533b7d89e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:18.474168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31287497-c3dd-4818-9b79-326533b7d89e service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:18.474563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31287497-c3dd-4818-9b79-326533b7d89e service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:18.474751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31287497-c3dd-4818-9b79-326533b7d89e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:18.477208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-31287497-c3dd-4818-9b79-326533b7d89e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:18.665672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31287497-c3dd-4818-9b79-326533b7d89e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:18.667397 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31287497-c3dd-4818-9b79-326533b7d89e service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:18.697937 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4101/8274] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:05:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:05:18.746754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:18.915916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:19.249977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:19.266567 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:19.712132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:20.010043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:20.616377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:21.032643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:21.375436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:21.800725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:21.838048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:22.535496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:22.911208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:23.461299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:23.552718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:24.192589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:24.232676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:25.044071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:25.341015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:27.419853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:27.838387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:28.163673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:28.460210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:30.066701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9718963-7cd0-4227-a9b4-133116bc266d service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:05:30.068713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f9718963-7cd0-4227-a9b4-133116bc266d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:05:30.160898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9718963-7cd0-4227-a9b4-133116bc266d service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:05:30.162745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:30.168537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef9d71-7e52-492b-81d5-1fc997c682dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:05:30.169256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef9d71-7e52-492b-81d5-1fc997c682dd service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:05:30.169617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef9d71-7e52-492b-81d5-1fc997c682dd service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:05:30.169966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef9d71-7e52-492b-81d5-1fc997c682dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:05:30.179161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef9d71-7e52-492b-81d5-1fc997c682dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:05:30.181087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef9d71-7e52-492b-81d5-1fc997c682dd service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:05:30.191006 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4174/8275] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 05:05:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 05:05:30.552336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:31.021439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:31.987390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:32.661004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:32.730800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:33.352842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:33.836857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:34.083410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:35.180630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:35.255392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:35.807476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:35.810709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:37.551015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:37.622914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:38.986998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:39.109425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:40.551823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:41.348310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:41.437676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:43.271300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:43.403480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:45.145059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:45.208912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:47.014409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:47.191333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:48.655206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:49.699397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:51.420766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:51.849152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:53.490223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:55.231836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:57.406844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:58.020875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:58.282769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:58.689064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:59.540398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:59.653201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:05:59.997544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:00.294362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:00.809716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:01.061048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:01.271895 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:01.735414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:02.425374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:03.517491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:03.825845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:04.564571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:05.293284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:07.568846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:08.270076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:08.808695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:10.517401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:10.654989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:11.534801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:12.640758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:12.694453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:14.236743 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:14.344296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:15.987430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:16.528529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:17.568688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:18.674528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:19.081709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31287497-c3dd-4818-9b79-326533b7d89e service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:19.083814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-31287497-c3dd-4818-9b79-326533b7d89e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:19.224091 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31287497-c3dd-4818-9b79-326533b7d89e service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:19.232356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a326f-35a7-450c-b7ac-e16c87ea53a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:19.233081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a326f-35a7-450c-b7ac-e16c87ea53a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:19.233441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a326f-35a7-450c-b7ac-e16c87ea53a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:19.234533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a326f-35a7-450c-b7ac-e16c87ea53a3 admin admin] PATH_INFO: `/v3/users/1d8a36118fc34991975b6e1655cc3f2b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:19.236106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a326f-35a7-450c-b7ac-e16c87ea53a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d8a36118fc34991975b6e1655cc3f2b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:19.238460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a326f-35a7-450c-b7ac-e16c87ea53a3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:19.544125 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:19.679362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7d1a326f-35a7-450c-b7ac-e16c87ea53a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d8a36118fc34991975b6e1655cc3f2b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:19.803092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:19.905120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7d1a326f-35a7-450c-b7ac-e16c87ea53a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d8a36118fc34991975b6e1655cc3f2b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:19.906244 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7d1a326f-35a7-450c-b7ac-e16c87ea53a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d8a36118fc34991975b6e1655cc3f2b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:19.914291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7d1a326f-35a7-450c-b7ac-e16c87ea53a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d8a36118fc34991975b6e1655cc3f2b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:19.927417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-7d1a326f-35a7-450c-b7ac-e16c87ea53a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d8a36118fc34991975b6e1655cc3f2b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:19.933732 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4102/8276] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:06:19 2022] DELETE /identity/v3/users/1d8a36118fc34991975b6e1655cc3f2b => generated 0 bytes in 853 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:06:19.942113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9933eb-c040-416c-8260-436d78f00493 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:19.943345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9933eb-c040-416c-8260-436d78f00493 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:19.943345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9933eb-c040-416c-8260-436d78f00493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:19.964072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bc9933eb-c040-416c-8260-436d78f00493 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:06:19.965387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bc9933eb-c040-416c-8260-436d78f00493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:20.025419 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4175/8277] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:06:20.036627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a326f-35a7-450c-b7ac-e16c87ea53a3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:20.038336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7d1a326f-35a7-450c-b7ac-e16c87ea53a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:20.118208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a326f-35a7-450c-b7ac-e16c87ea53a3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:20.129533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d8e4-369e-44e7-94c9-2cb6c4e30322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:20.129533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d8e4-369e-44e7-94c9-2cb6c4e30322 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:20.129533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d8e4-369e-44e7-94c9-2cb6c4e30322 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:20.129533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d8e4-369e-44e7-94c9-2cb6c4e30322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:20.136104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386d8e4-369e-44e7-94c9-2cb6c4e30322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:20.137586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386d8e4-369e-44e7-94c9-2cb6c4e30322 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:20.147910 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4103/8278] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:06:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:06:21.438126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9933eb-c040-416c-8260-436d78f00493 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:21.438126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bc9933eb-c040-416c-8260-436d78f00493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:21.461826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9933eb-c040-416c-8260-436d78f00493 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:21.477022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f08be6-4915-413c-8897-403427016a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:21.479720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f08be6-4915-413c-8897-403427016a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:21.480226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f08be6-4915-413c-8897-403427016a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:21.480886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f08be6-4915-413c-8897-403427016a41 admin admin] PATH_INFO: `/v3/projects/e302e0a4dc73497a984110c7ba5285f1` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:21.496191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f08be6-4915-413c-8897-403427016a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e302e0a4dc73497a984110c7ba5285f1)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:21.496191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f08be6-4915-413c-8897-403427016a41 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:21.687249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-43f08be6-4915-413c-8897-403427016a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e302e0a4dc73497a984110c7ba5285f1', 'request_id': 'req-43f08be6-4915-413c-8897-403427016a41'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:21.693349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-43f08be6-4915-413c-8897-403427016a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e302e0a4dc73497a984110c7ba5285f1', 'request_id': 'req-43f08be6-4915-413c-8897-403427016a41'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:21.836843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-43f08be6-4915-413c-8897-403427016a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e302e0a4dc73497a984110c7ba5285f1', 'request_id': 'req-43f08be6-4915-413c-8897-403427016a41'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:21.849657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-43f08be6-4915-413c-8897-403427016a41 admin admin] The token cache is being invalidate because project e302e0a4dc73497a984110c7ba5285f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:06:21.849934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-43f08be6-4915-413c-8897-403427016a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:21.850573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-43f08be6-4915-413c-8897-403427016a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:21.852114 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4176/8279] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:21 2022] DELETE /identity/v3/projects/e302e0a4dc73497a984110c7ba5285f1 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:06:21.856381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d8e4-369e-44e7-94c9-2cb6c4e30322 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:21.867196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386d8e4-369e-44e7-94c9-2cb6c4e30322 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:21.926389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352de731-7d45-435a-b0e3-695b22620b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:21.927041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352de731-7d45-435a-b0e3-695b22620b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:21.927387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352de731-7d45-435a-b0e3-695b22620b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:21.927694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352de731-7d45-435a-b0e3-695b22620b3d admin admin] PATH_INFO: `/v3/users/71b455d10cd843098e45ed76597b4f62` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:21.928841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352de731-7d45-435a-b0e3-695b22620b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b455d10cd843098e45ed76597b4f62)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:21.930834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352de731-7d45-435a-b0e3-695b22620b3d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:22.393602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-352de731-7d45-435a-b0e3-695b22620b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b455d10cd843098e45ed76597b4f62'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:22.774066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-352de731-7d45-435a-b0e3-695b22620b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b455d10cd843098e45ed76597b4f62'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:22.774620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-352de731-7d45-435a-b0e3-695b22620b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b455d10cd843098e45ed76597b4f62'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:22.783227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-352de731-7d45-435a-b0e3-695b22620b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b455d10cd843098e45ed76597b4f62'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:22.795526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-352de731-7d45-435a-b0e3-695b22620b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b455d10cd843098e45ed76597b4f62'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:22.801594 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4104/8280] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:06:21 2022] DELETE /identity/v3/users/71b455d10cd843098e45ed76597b4f62 => generated 0 bytes in 946 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:06:23.442247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:23.770675 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f08be6-4915-413c-8897-403427016a41 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:23.773322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:23.774851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-43f08be6-4915-413c-8897-403427016a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:23.790249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f08be6-4915-413c-8897-403427016a41 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:23.866952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b02bf-2483-49d8-8b3d-0aba092e2268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:23.867509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b02bf-2483-49d8-8b3d-0aba092e2268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:23.867788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b02bf-2483-49d8-8b3d-0aba092e2268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:23.868058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b02bf-2483-49d8-8b3d-0aba092e2268 admin admin] PATH_INFO: `/v3/projects/b385db5b846f4d8588a22c2580858ff7` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:23.869213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b02bf-2483-49d8-8b3d-0aba092e2268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b385db5b846f4d8588a22c2580858ff7)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:23.871183 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b02bf-2483-49d8-8b3d-0aba092e2268 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:24.277899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-768b02bf-2483-49d8-8b3d-0aba092e2268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b385db5b846f4d8588a22c2580858ff7', 'request_id': 'req-768b02bf-2483-49d8-8b3d-0aba092e2268'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:24.284610 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-768b02bf-2483-49d8-8b3d-0aba092e2268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b385db5b846f4d8588a22c2580858ff7', 'request_id': 'req-768b02bf-2483-49d8-8b3d-0aba092e2268'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:24.593240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-768b02bf-2483-49d8-8b3d-0aba092e2268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b385db5b846f4d8588a22c2580858ff7', 'request_id': 'req-768b02bf-2483-49d8-8b3d-0aba092e2268'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:24.609361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-768b02bf-2483-49d8-8b3d-0aba092e2268 admin admin] The token cache is being invalidate because project b385db5b846f4d8588a22c2580858ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:06:24.609980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-768b02bf-2483-49d8-8b3d-0aba092e2268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:24.610808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-768b02bf-2483-49d8-8b3d-0aba092e2268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:24.612645 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4177/8281] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:23 2022] DELETE /identity/v3/projects/b385db5b846f4d8588a22c2580858ff7 => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:06:24.617261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1034caf-29bd-40ec-8eb4-67fa9959c5dc None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:24.617713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1034caf-29bd-40ec-8eb4-67fa9959c5dc None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:24.617811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1034caf-29bd-40ec-8eb4-67fa9959c5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:24.651021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e1034caf-29bd-40ec-8eb4-67fa9959c5dc None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:06:24.652182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e1034caf-29bd-40ec-8eb4-67fa9959c5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:24.724740 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4105/8282] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:06:24.726887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e687a76-c53e-4d58-85c4-1bf0322adb41 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:24.727200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e687a76-c53e-4d58-85c4-1bf0322adb41 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:24.727480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e687a76-c53e-4d58-85c4-1bf0322adb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:24.760438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9e687a76-c53e-4d58-85c4-1bf0322adb41 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:06:24.761757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9e687a76-c53e-4d58-85c4-1bf0322adb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:24.770428 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4178/8283] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:06:24.774903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1034caf-29bd-40ec-8eb4-67fa9959c5dc None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:24.786021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1034caf-29bd-40ec-8eb4-67fa9959c5dc None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:24.790720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be2dcd-87c3-46a4-9254-46af608be961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:24.791325 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be2dcd-87c3-46a4-9254-46af608be961 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:24.791722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be2dcd-87c3-46a4-9254-46af608be961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:24.792002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be2dcd-87c3-46a4-9254-46af608be961 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:24.792691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be2dcd-87c3-46a4-9254-46af608be961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:06:24.792996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be2dcd-87c3-46a4-9254-46af608be961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:24.794727 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be2dcd-87c3-46a4-9254-46af608be961 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:24.810557 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4106/8284] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:06:24.813402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e687a76-c53e-4d58-85c4-1bf0322adb41 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:24.823408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e687a76-c53e-4d58-85c4-1bf0322adb41 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:24.832993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afe4fe-1e7f-4bf7-b736-ee4756f8b281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:24.833617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afe4fe-1e7f-4bf7-b736-ee4756f8b281 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:24.833898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afe4fe-1e7f-4bf7-b736-ee4756f8b281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:24.834899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afe4fe-1e7f-4bf7-b736-ee4756f8b281 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:24.835556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81afe4fe-1e7f-4bf7-b736-ee4756f8b281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:24.837510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81afe4fe-1e7f-4bf7-b736-ee4756f8b281 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:25.194267 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4179/8285] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:06:24 2022] POST /identity/v3/projects => generated 373 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:06:25.198302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be2dcd-87c3-46a4-9254-46af608be961 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:25.209824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be2dcd-87c3-46a4-9254-46af608be961 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:25.268443 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa664c6-365d-446d-b144-97e6a558b2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:25.269090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa664c6-365d-446d-b144-97e6a558b2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:25.269380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa664c6-365d-446d-b144-97e6a558b2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:25.269684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa664c6-365d-446d-b144-97e6a558b2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:25.270316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa664c6-365d-446d-b144-97e6a558b2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:25.272339 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa664c6-365d-446d-b144-97e6a558b2e8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:25.492789 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4107/8286] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:06:25 2022] POST /identity/v3/users => generated 287 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:06:25.496841 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afe4fe-1e7f-4bf7-b736-ee4756f8b281 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:25.511365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afe4fe-1e7f-4bf7-b736-ee4756f8b281 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:25.518074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdba419-be2a-4140-8d90-f5973655c873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:25.518705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdba419-be2a-4140-8d90-f5973655c873 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:25.518987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdba419-be2a-4140-8d90-f5973655c873 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:25.519261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdba419-be2a-4140-8d90-f5973655c873 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:25.519913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdba419-be2a-4140-8d90-f5973655c873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:25.521782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdba419-be2a-4140-8d90-f5973655c873 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:25.539370 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4180/8287] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:06:25.541072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa664c6-365d-446d-b144-97e6a558b2e8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:25.552741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa664c6-365d-446d-b144-97e6a558b2e8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:25.557894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8ec4d-b806-43bd-8f53-01c4ae8fb694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:25.558057 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8ec4d-b806-43bd-8f53-01c4ae8fb694 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:25.558246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8ec4d-b806-43bd-8f53-01c4ae8fb694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:25.558774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8ec4d-b806-43bd-8f53-01c4ae8fb694 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:25.558774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8ec4d-b806-43bd-8f53-01c4ae8fb694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:25.561328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8ec4d-b806-43bd-8f53-01c4ae8fb694 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:25.572755 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4108/8288] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:06:25.577815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdba419-be2a-4140-8d90-f5973655c873 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:25.588561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdba419-be2a-4140-8d90-f5973655c873 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:25.595646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c30aa1-3fcc-4c60-8c74-2452e8e45f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:25.596438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c30aa1-3fcc-4c60-8c74-2452e8e45f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:25.596438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c30aa1-3fcc-4c60-8c74-2452e8e45f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:25.596438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c30aa1-3fcc-4c60-8c74-2452e8e45f96 admin admin] PATH_INFO: `/v3/projects/3abffd4bf8e440eba2bf206be1061226/users/c17e5459738841f8b30ea1667789c1c4/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:25.617608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c30aa1-3fcc-4c60-8c74-2452e8e45f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abffd4bf8e440eba2bf206be1061226, user_id=c17e5459738841f8b30ea1667789c1c4, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:25.620410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c30aa1-3fcc-4c60-8c74-2452e8e45f96 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:25.775387 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4181/8289] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:06:25 2022] PUT /identity/v3/projects/3abffd4bf8e440eba2bf206be1061226/users/c17e5459738841f8b30ea1667789c1c4/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:06:25.804572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b67e10-2d6c-4121-8bde-409771ec6a74 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:25.805123 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b67e10-2d6c-4121-8bde-409771ec6a74 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:25.805222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b67e10-2d6c-4121-8bde-409771ec6a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:25.834982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-36b67e10-2d6c-4121-8bde-409771ec6a74 None None] MFA Rules not processed for user `c17e5459738841f8b30ea1667789c1c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:06:25.837603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-36b67e10-2d6c-4121-8bde-409771ec6a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:25.904999 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4109/8290] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:06:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:06:25.917232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c30aa1-3fcc-4c60-8c74-2452e8e45f96 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:25.919057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b1c30aa1-3fcc-4c60-8c74-2452e8e45f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:25.987679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c30aa1-3fcc-4c60-8c74-2452e8e45f96 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:25.991813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa74813-84a4-4315-84ad-d861cff5a7b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:25.992706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa74813-84a4-4315-84ad-d861cff5a7b2 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:25.992997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa74813-84a4-4315-84ad-d861cff5a7b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:25.993267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa74813-84a4-4315-84ad-d861cff5a7b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:26.002540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa74813-84a4-4315-84ad-d861cff5a7b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:26.004034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa74813-84a4-4315-84ad-d861cff5a7b2 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:26.013408 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4182/8291] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:06:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:06:26.037990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b67e10-2d6c-4121-8bde-409771ec6a74 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:26.105036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b67e10-2d6c-4121-8bde-409771ec6a74 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:26.109882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682259d-40e6-40db-bbc4-9f87661037d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:26.110569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682259d-40e6-40db-bbc4-9f87661037d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:26.110852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682259d-40e6-40db-bbc4-9f87661037d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:26.111129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682259d-40e6-40db-bbc4-9f87661037d5 admin admin] PATH_INFO: `/v3/users/c17e5459738841f8b30ea1667789c1c4` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:26.112347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682259d-40e6-40db-bbc4-9f87661037d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c17e5459738841f8b30ea1667789c1c4)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:26.114298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682259d-40e6-40db-bbc4-9f87661037d5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:26.382480 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d682259d-40e6-40db-bbc4-9f87661037d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c17e5459738841f8b30ea1667789c1c4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:26.391503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:26.527590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d682259d-40e6-40db-bbc4-9f87661037d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c17e5459738841f8b30ea1667789c1c4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:26.528268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d682259d-40e6-40db-bbc4-9f87661037d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c17e5459738841f8b30ea1667789c1c4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:26.537467 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d682259d-40e6-40db-bbc4-9f87661037d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c17e5459738841f8b30ea1667789c1c4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:26.549287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d682259d-40e6-40db-bbc4-9f87661037d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c17e5459738841f8b30ea1667789c1c4'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:26.556798 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4110/8292] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:06:26 2022] DELETE /identity/v3/users/c17e5459738841f8b30ea1667789c1c4 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:06:26.559968 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd7f29-5252-4855-974d-ce54d417a35b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:26.560285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd7f29-5252-4855-974d-ce54d417a35b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:26.560558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd7f29-5252-4855-974d-ce54d417a35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:26.580887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c9bd7f29-5252-4855-974d-ce54d417a35b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:06:26.582152 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c9bd7f29-5252-4855-974d-ce54d417a35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:26.646187 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4183/8293] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:06:26.656714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682259d-40e6-40db-bbc4-9f87661037d5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:26.658995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d682259d-40e6-40db-bbc4-9f87661037d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:26.745165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682259d-40e6-40db-bbc4-9f87661037d5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:26.750453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709762f6-64c0-43d0-b402-0da183031d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:26.750938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709762f6-64c0-43d0-b402-0da183031d9f service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:26.751362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709762f6-64c0-43d0-b402-0da183031d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:26.751645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709762f6-64c0-43d0-b402-0da183031d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:26.766169 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709762f6-64c0-43d0-b402-0da183031d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:26.766627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709762f6-64c0-43d0-b402-0da183031d9f service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:26.802859 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4111/8294] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:06:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:06:27.357041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:27.449431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd7f29-5252-4855-974d-ce54d417a35b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:27.450954 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c9bd7f29-5252-4855-974d-ce54d417a35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:27.467943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd7f29-5252-4855-974d-ce54d417a35b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:27.477580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff896b55-dbbd-4df4-90dc-e356906d5b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:27.478563 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff896b55-dbbd-4df4-90dc-e356906d5b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:27.479793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff896b55-dbbd-4df4-90dc-e356906d5b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:27.479793 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff896b55-dbbd-4df4-90dc-e356906d5b4a admin admin] PATH_INFO: `/v3/projects/3abffd4bf8e440eba2bf206be1061226` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:27.481304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff896b55-dbbd-4df4-90dc-e356906d5b4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abffd4bf8e440eba2bf206be1061226)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:27.483624 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff896b55-dbbd-4df4-90dc-e356906d5b4a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:27.683956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ff896b55-dbbd-4df4-90dc-e356906d5b4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abffd4bf8e440eba2bf206be1061226', 'request_id': 'req-ff896b55-dbbd-4df4-90dc-e356906d5b4a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:27.691042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ff896b55-dbbd-4df4-90dc-e356906d5b4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abffd4bf8e440eba2bf206be1061226', 'request_id': 'req-ff896b55-dbbd-4df4-90dc-e356906d5b4a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:27.796290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ff896b55-dbbd-4df4-90dc-e356906d5b4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abffd4bf8e440eba2bf206be1061226', 'request_id': 'req-ff896b55-dbbd-4df4-90dc-e356906d5b4a'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:27.813873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ff896b55-dbbd-4df4-90dc-e356906d5b4a admin admin] The token cache is being invalidate because project 3abffd4bf8e440eba2bf206be1061226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:06:27.813873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ff896b55-dbbd-4df4-90dc-e356906d5b4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:27.814315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-ff896b55-dbbd-4df4-90dc-e356906d5b4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:27.817467 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4184/8295] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:27 2022] DELETE /identity/v3/projects/3abffd4bf8e440eba2bf206be1061226 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:06:27.821112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a9897-e7bc-49bf-a0ff-feeaccbacbf4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:27.821394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a9897-e7bc-49bf-a0ff-feeaccbacbf4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:27.821667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a9897-e7bc-49bf-a0ff-feeaccbacbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:27.886571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-943a9897-e7bc-49bf-a0ff-feeaccbacbf4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:06:27.886571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-943a9897-e7bc-49bf-a0ff-feeaccbacbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:27.935003 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4112/8296] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:06:27.950616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ad88e-1b74-46b1-a2ef-fc95fdea7cb4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:27.950901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ad88e-1b74-46b1-a2ef-fc95fdea7cb4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:27.951177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ad88e-1b74-46b1-a2ef-fc95fdea7cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:27.980312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-291ad88e-1b74-46b1-a2ef-fc95fdea7cb4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:06:27.981611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-291ad88e-1b74-46b1-a2ef-fc95fdea7cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:27.990702 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4185/8297] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:06:27.995697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a9897-e7bc-49bf-a0ff-feeaccbacbf4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:28.012479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a9897-e7bc-49bf-a0ff-feeaccbacbf4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:28.021648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0c46f-501c-4b4c-ad4f-3f6298456c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:28.022737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0c46f-501c-4b4c-ad4f-3f6298456c00 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:28.023155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0c46f-501c-4b4c-ad4f-3f6298456c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:28.023484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0c46f-501c-4b4c-ad4f-3f6298456c00 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:28.024205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0c46f-501c-4b4c-ad4f-3f6298456c00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:06:28.024519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0c46f-501c-4b4c-ad4f-3f6298456c00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:28.026379 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0c46f-501c-4b4c-ad4f-3f6298456c00 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:28.033014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:28.047378 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4113/8298] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:06:28.048552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ad88e-1b74-46b1-a2ef-fc95fdea7cb4 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:28.058582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ad88e-1b74-46b1-a2ef-fc95fdea7cb4 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:28.061229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:28.066301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d7d59-140e-4dd7-851b-a3ebe1348a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:28.066931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d7d59-140e-4dd7-851b-a3ebe1348a4c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:28.067217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d7d59-140e-4dd7-851b-a3ebe1348a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:28.067552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d7d59-140e-4dd7-851b-a3ebe1348a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:28.068257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d7d59-140e-4dd7-851b-a3ebe1348a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:28.070099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d7d59-140e-4dd7-851b-a3ebe1348a4c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:28.255207 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4186/8299] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:06:28 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:06:28.259361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0c46f-501c-4b4c-ad4f-3f6298456c00 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:28.267380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0c46f-501c-4b4c-ad4f-3f6298456c00 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:28.324007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0e919-2b0a-4fef-87ab-89920b48a061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:28.324639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0e919-2b0a-4fef-87ab-89920b48a061 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:28.324911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0e919-2b0a-4fef-87ab-89920b48a061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:28.325181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0e919-2b0a-4fef-87ab-89920b48a061 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:28.325807 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0e919-2b0a-4fef-87ab-89920b48a061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:28.330232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0e919-2b0a-4fef-87ab-89920b48a061 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:28.478085 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4114/8300] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:06:28 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:06:28.479123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d7d59-140e-4dd7-851b-a3ebe1348a4c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:28.491158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d7d59-140e-4dd7-851b-a3ebe1348a4c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:28.496002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098be0b0-bae3-413d-a9c8-423925c21eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:28.496658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098be0b0-bae3-413d-a9c8-423925c21eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:28.496941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098be0b0-bae3-413d-a9c8-423925c21eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:28.497223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098be0b0-bae3-413d-a9c8-423925c21eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:28.497911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098be0b0-bae3-413d-a9c8-423925c21eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:28.504353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098be0b0-bae3-413d-a9c8-423925c21eb8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:28.523315 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4187/8301] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:06:28.526914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0e919-2b0a-4fef-87ab-89920b48a061 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:28.538207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0e919-2b0a-4fef-87ab-89920b48a061 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:28.542986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe70413-6c5f-4617-8c0e-3838304395f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:28.543598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe70413-6c5f-4617-8c0e-3838304395f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:28.543865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe70413-6c5f-4617-8c0e-3838304395f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:28.544144 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe70413-6c5f-4617-8c0e-3838304395f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:28.544881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe70413-6c5f-4617-8c0e-3838304395f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:28.546830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe70413-6c5f-4617-8c0e-3838304395f4 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:28.557942 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4115/8302] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:06:28.573580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098be0b0-bae3-413d-a9c8-423925c21eb8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:28.584988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098be0b0-bae3-413d-a9c8-423925c21eb8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:28.589982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912620a-30bb-4ff3-a06c-534c6246e28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:28.590766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912620a-30bb-4ff3-a06c-534c6246e28a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:28.592381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912620a-30bb-4ff3-a06c-534c6246e28a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:28.592381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912620a-30bb-4ff3-a06c-534c6246e28a admin admin] PATH_INFO: `/v3/projects/bc89f00c670b401b88af01faa8793eea/users/ce25fcc72175421bbab020180b1d7e03/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:28.621428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912620a-30bb-4ff3-a06c-534c6246e28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc89f00c670b401b88af01faa8793eea, user_id=ce25fcc72175421bbab020180b1d7e03, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:28.624727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912620a-30bb-4ff3-a06c-534c6246e28a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:28.762597 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4188/8303] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:06:28 2022] PUT /identity/v3/projects/bc89f00c670b401b88af01faa8793eea/users/ce25fcc72175421bbab020180b1d7e03/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:06:28.773979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059876c8-c619-4914-9f8f-8b482b64eaac None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:28.774215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059876c8-c619-4914-9f8f-8b482b64eaac None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:28.774545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059876c8-c619-4914-9f8f-8b482b64eaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:28.804806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-059876c8-c619-4914-9f8f-8b482b64eaac None None] MFA Rules not processed for user `ce25fcc72175421bbab020180b1d7e03`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:06:28.806090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-059876c8-c619-4914-9f8f-8b482b64eaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:28.887571 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4116/8304] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:06:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:06:28.903024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912620a-30bb-4ff3-a06c-534c6246e28a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:28.905872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f912620a-30bb-4ff3-a06c-534c6246e28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:28.994380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912620a-30bb-4ff3-a06c-534c6246e28a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:28.998709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25026f-a0e9-4cba-a4aa-507ef7c8fda7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:28.999604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25026f-a0e9-4cba-a4aa-507ef7c8fda7 service glance] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:28.999830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25026f-a0e9-4cba-a4aa-507ef7c8fda7 service glance] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:29.000074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25026f-a0e9-4cba-a4aa-507ef7c8fda7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:29.011772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25026f-a0e9-4cba-a4aa-507ef7c8fda7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:29.013532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25026f-a0e9-4cba-a4aa-507ef7c8fda7 service glance] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:29.025227 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4189/8305] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:06:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:06:30.473653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:30.636605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:33.122504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:33.190718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:34.957348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:35.413701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:36.410568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:36.681153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:37.773746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:37.848051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:37.977322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059876c8-c619-4914-9f8f-8b482b64eaac None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:37.978647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-059876c8-c619-4914-9f8f-8b482b64eaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:38.248060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059876c8-c619-4914-9f8f-8b482b64eaac None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:38.254208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfabc0b-1f22-4b3f-bb05-ff5938ed4b4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:38.254923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfabc0b-1f22-4b3f-bb05-ff5938ed4b4a service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:38.255270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfabc0b-1f22-4b3f-bb05-ff5938ed4b4a service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:38.255615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfabc0b-1f22-4b3f-bb05-ff5938ed4b4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:38.257600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-adfabc0b-1f22-4b3f-bb05-ff5938ed4b4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:38.278236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfabc0b-1f22-4b3f-bb05-ff5938ed4b4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:38.281614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfabc0b-1f22-4b3f-bb05-ff5938ed4b4a service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:38.297473 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4117/8306] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:06:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:06:38.528366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:38.614427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:38.876843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:39.254226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:40.150814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:40.302297 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:41.522023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:41.911046 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:42.590808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:42.797096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:43.230956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:43.259492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:43.771863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:43.859681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:44.602161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:44.670826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:45.527919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:47.356678 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:48.345854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:49.751120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:49.823318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:50.719063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25026f-a0e9-4cba-a4aa-507ef7c8fda7 service glance] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:50.721052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2e25026f-a0e9-4cba-a4aa-507ef7c8fda7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:50.812236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25026f-a0e9-4cba-a4aa-507ef7c8fda7 service glance] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:50.817073 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c88e1-eae3-40fa-86c9-81a285a2106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:50.817747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c88e1-eae3-40fa-86c9-81a285a2106a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:50.818055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c88e1-eae3-40fa-86c9-81a285a2106a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:50.818620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c88e1-eae3-40fa-86c9-81a285a2106a admin admin] PATH_INFO: `/v3/users/2abd924b377a4227b01e6f859c348a15` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:50.819888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c88e1-eae3-40fa-86c9-81a285a2106a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2abd924b377a4227b01e6f859c348a15)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:50.821949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c88e1-eae3-40fa-86c9-81a285a2106a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:51.295546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c35c88e1-eae3-40fa-86c9-81a285a2106a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2abd924b377a4227b01e6f859c348a15'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:51.296515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c35c88e1-eae3-40fa-86c9-81a285a2106a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2abd924b377a4227b01e6f859c348a15'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:51.428543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c35c88e1-eae3-40fa-86c9-81a285a2106a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2abd924b377a4227b01e6f859c348a15'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:51.429113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c35c88e1-eae3-40fa-86c9-81a285a2106a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2abd924b377a4227b01e6f859c348a15'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:51.448745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c35c88e1-eae3-40fa-86c9-81a285a2106a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2abd924b377a4227b01e6f859c348a15'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:51.470815 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4190/8307] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:06:50 2022] DELETE /identity/v3/users/2abd924b377a4227b01e6f859c348a15 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:06:51.472498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8b1fc-a58f-4af9-a693-a6c35281cc59 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:51.473002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8b1fc-a58f-4af9-a693-a6c35281cc59 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:51.473176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8b1fc-a58f-4af9-a693-a6c35281cc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:51.493210 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-34d8b1fc-a58f-4af9-a693-a6c35281cc59 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:06:51.494726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-34d8b1fc-a58f-4af9-a693-a6c35281cc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:51.603429 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4118/8308] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:06:51.614334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c88e1-eae3-40fa-86c9-81a285a2106a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:51.615974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c35c88e1-eae3-40fa-86c9-81a285a2106a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:51.709466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c88e1-eae3-40fa-86c9-81a285a2106a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:51.713163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2714af-7886-4d48-adc0-87d3a6ea7ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:51.713816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2714af-7886-4d48-adc0-87d3a6ea7ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:51.714090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2714af-7886-4d48-adc0-87d3a6ea7ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:51.714536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2714af-7886-4d48-adc0-87d3a6ea7ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:51.725910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2714af-7886-4d48-adc0-87d3a6ea7ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:51.727674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2714af-7886-4d48-adc0-87d3a6ea7ff9 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:51.739037 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4191/8309] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:06:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:06:51.750706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:51.836114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:52.135233 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8b1fc-a58f-4af9-a693-a6c35281cc59 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:52.136324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-34d8b1fc-a58f-4af9-a693-a6c35281cc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:52.219423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8b1fc-a58f-4af9-a693-a6c35281cc59 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:52.224725 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a84bff-f793-40be-8534-b50eba233e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:52.225494 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a84bff-f793-40be-8534-b50eba233e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:52.225878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a84bff-f793-40be-8534-b50eba233e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:52.226266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a84bff-f793-40be-8534-b50eba233e4a admin admin] PATH_INFO: `/v3/projects/5034a717d9704e5ba0af54eda8554717` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:52.227536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a84bff-f793-40be-8534-b50eba233e4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5034a717d9704e5ba0af54eda8554717)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:52.229635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a84bff-f793-40be-8534-b50eba233e4a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:52.482512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b3a84bff-f793-40be-8534-b50eba233e4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5034a717d9704e5ba0af54eda8554717', 'request_id': 'req-b3a84bff-f793-40be-8534-b50eba233e4a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:52.488945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b3a84bff-f793-40be-8534-b50eba233e4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5034a717d9704e5ba0af54eda8554717', 'request_id': 'req-b3a84bff-f793-40be-8534-b50eba233e4a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:52.496728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b3a84bff-f793-40be-8534-b50eba233e4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5034a717d9704e5ba0af54eda8554717', 'request_id': 'req-b3a84bff-f793-40be-8534-b50eba233e4a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:52.658029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b3a84bff-f793-40be-8534-b50eba233e4a admin admin] The token cache is being invalidate because project 5034a717d9704e5ba0af54eda8554717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:06:52.658029 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b3a84bff-f793-40be-8534-b50eba233e4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:52.659570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b3a84bff-f793-40be-8534-b50eba233e4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:06:52.665360 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4119/8310] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:06:52 2022] DELETE /identity/v3/projects/5034a717d9704e5ba0af54eda8554717 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:06:52.671453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c4479-dc56-4ff8-aa41-fc6ae6c634b3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:52.672009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c4479-dc56-4ff8-aa41-fc6ae6c634b3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:52.672009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c4479-dc56-4ff8-aa41-fc6ae6c634b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:52.693655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ce4c4479-dc56-4ff8-aa41-fc6ae6c634b3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:06:52.698414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ce4c4479-dc56-4ff8-aa41-fc6ae6c634b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:52.784338 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4192/8311] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:06:52.789303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fbc9c-4127-4cd9-8ccb-7b745d8da890 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:52.789735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fbc9c-4127-4cd9-8ccb-7b745d8da890 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:52.790103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fbc9c-4127-4cd9-8ccb-7b745d8da890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:52.818162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-099fbc9c-4127-4cd9-8ccb-7b745d8da890 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:06:52.818162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-099fbc9c-4127-4cd9-8ccb-7b745d8da890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:52.825167 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4120/8312] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:06:52.831281 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c4479-dc56-4ff8-aa41-fc6ae6c634b3 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:52.852212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c4479-dc56-4ff8-aa41-fc6ae6c634b3 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:52.852212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f635bc-32b1-4ab7-ab25-acd0005049dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:52.852212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f635bc-32b1-4ab7-ab25-acd0005049dd admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:52.852212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f635bc-32b1-4ab7-ab25-acd0005049dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:52.852626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f635bc-32b1-4ab7-ab25-acd0005049dd admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:52.852626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f635bc-32b1-4ab7-ab25-acd0005049dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:06:52.852626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f635bc-32b1-4ab7-ab25-acd0005049dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:52.852626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f635bc-32b1-4ab7-ab25-acd0005049dd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:52.865770 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4193/8313] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:06:52.873434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fbc9c-4127-4cd9-8ccb-7b745d8da890 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:52.883867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fbc9c-4127-4cd9-8ccb-7b745d8da890 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:52.890238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c96987-ac44-445e-8423-8e2f1c97623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:52.890917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c96987-ac44-445e-8423-8e2f1c97623e admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:52.891259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c96987-ac44-445e-8423-8e2f1c97623e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:52.904670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c96987-ac44-445e-8423-8e2f1c97623e admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:52.904670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c96987-ac44-445e-8423-8e2f1c97623e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:52.904670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c96987-ac44-445e-8423-8e2f1c97623e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:53.180789 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4121/8314] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:06:52 2022] POST /identity/v3/projects => generated 375 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:06:53.181333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f635bc-32b1-4ab7-ab25-acd0005049dd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:53.182327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:53.203442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f635bc-32b1-4ab7-ab25-acd0005049dd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:53.287571 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df7285-b05c-4630-a263-3cf3d980d634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:53.288204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df7285-b05c-4630-a263-3cf3d980d634 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:53.288491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df7285-b05c-4630-a263-3cf3d980d634 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:53.288766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df7285-b05c-4630-a263-3cf3d980d634 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:53.289393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df7285-b05c-4630-a263-3cf3d980d634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:53.291306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df7285-b05c-4630-a263-3cf3d980d634 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:53.489473 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4194/8315] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:06:53 2022] POST /identity/v3/users => generated 288 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:06:53.496513 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c96987-ac44-445e-8423-8e2f1c97623e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:53.505348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c96987-ac44-445e-8423-8e2f1c97623e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:53.510172 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806902cd-272a-46ed-9498-61c26720d0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:53.510788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806902cd-272a-46ed-9498-61c26720d0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:53.511073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806902cd-272a-46ed-9498-61c26720d0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:53.511349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806902cd-272a-46ed-9498-61c26720d0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:53.511997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806902cd-272a-46ed-9498-61c26720d0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:53.513871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806902cd-272a-46ed-9498-61c26720d0a7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:53.524832 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4122/8316] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:06:53.533232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df7285-b05c-4630-a263-3cf3d980d634 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:53.544927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df7285-b05c-4630-a263-3cf3d980d634 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:53.550081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29cd4e-f938-4da9-9152-72c165ee5d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:53.550700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29cd4e-f938-4da9-9152-72c165ee5d37 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:53.550984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29cd4e-f938-4da9-9152-72c165ee5d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:53.551259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29cd4e-f938-4da9-9152-72c165ee5d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:53.551902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29cd4e-f938-4da9-9152-72c165ee5d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:53.553569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29cd4e-f938-4da9-9152-72c165ee5d37 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:53.565748 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4195/8317] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:06:53.569779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806902cd-272a-46ed-9498-61c26720d0a7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:53.580098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806902cd-272a-46ed-9498-61c26720d0a7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:53.585118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c16675-7d09-493a-bf17-0991c7e6e987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:53.585760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c16675-7d09-493a-bf17-0991c7e6e987 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:53.586232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c16675-7d09-493a-bf17-0991c7e6e987 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:53.586695 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c16675-7d09-493a-bf17-0991c7e6e987 admin admin] PATH_INFO: `/v3/projects/6f638f3ce4da4e149f2cf7f0079f018e/users/7824e71161864723a41f4f7975ee4491/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:53.602845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c16675-7d09-493a-bf17-0991c7e6e987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f638f3ce4da4e149f2cf7f0079f018e, user_id=7824e71161864723a41f4f7975ee4491, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:53.605674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c16675-7d09-493a-bf17-0991c7e6e987 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:53.790415 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4123/8318] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:06:53 2022] PUT /identity/v3/projects/6f638f3ce4da4e149f2cf7f0079f018e/users/7824e71161864723a41f4f7975ee4491/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:06:53.802618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808453f9-8749-4c7b-a41a-d8944afcece8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:53.803142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808453f9-8749-4c7b-a41a-d8944afcece8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:53.803142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808453f9-8749-4c7b-a41a-d8944afcece8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:53.832748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-808453f9-8749-4c7b-a41a-d8944afcece8 None None] MFA Rules not processed for user `7824e71161864723a41f4f7975ee4491`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:06:53.834031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-808453f9-8749-4c7b-a41a-d8944afcece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:53.898791 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4196/8319] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:06:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:06:53.910180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c16675-7d09-493a-bf17-0991c7e6e987 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:53.912814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-04c16675-7d09-493a-bf17-0991c7e6e987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:53.983779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c16675-7d09-493a-bf17-0991c7e6e987 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:53.987677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c8e24-2559-401b-8512-32b7f134650d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:53.988318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c8e24-2559-401b-8512-32b7f134650d service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:53.988605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c8e24-2559-401b-8512-32b7f134650d service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:53.988886 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c8e24-2559-401b-8512-32b7f134650d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:53.998414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c8e24-2559-401b-8512-32b7f134650d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:53.999911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c8e24-2559-401b-8512-32b7f134650d service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:54.008836 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4124/8320] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:06:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:06:54.064585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:55.040479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:57.461765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:57.474937 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb2dea-4ece-4e3a-9cd7-ebaa90cb9a2d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:57.475230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb2dea-4ece-4e3a-9cd7-ebaa90cb9a2d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:57.475556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb2dea-4ece-4e3a-9cd7-ebaa90cb9a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:57.500521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-60fb2dea-4ece-4e3a-9cd7-ebaa90cb9a2d None None] MFA Rules not processed for user `7824e71161864723a41f4f7975ee4491`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:06:57.500521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-60fb2dea-4ece-4e3a-9cd7-ebaa90cb9a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:57.507610 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4197/8321] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:06:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:06:57.563370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c8e24-2559-401b-8512-32b7f134650d service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:57.565003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9c9c8e24-2559-401b-8512-32b7f134650d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:57.633752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c8e24-2559-401b-8512-32b7f134650d service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:57.637604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfc7a8-7c74-4c06-ae12-50515a3d20b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:57.638898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfc7a8-7c74-4c06-ae12-50515a3d20b2 service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:57.639226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfc7a8-7c74-4c06-ae12-50515a3d20b2 service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:57.639645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfc7a8-7c74-4c06-ae12-50515a3d20b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:57.641487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-34cfc7a8-7c74-4c06-ae12-50515a3d20b2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:57.719585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfc7a8-7c74-4c06-ae12-50515a3d20b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:57.721062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfc7a8-7c74-4c06-ae12-50515a3d20b2 service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:57.735775 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4125/8322] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:06:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:06:58.344491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:58.511376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb2dea-4ece-4e3a-9cd7-ebaa90cb9a2d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:58.513473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-60fb2dea-4ece-4e3a-9cd7-ebaa90cb9a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:58.581320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb2dea-4ece-4e3a-9cd7-ebaa90cb9a2d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:58.585653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c0ab6-8d27-4f73-9293-25b56b3e11c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:58.586291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c0ab6-8d27-4f73-9293-25b56b3e11c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:58.586572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c0ab6-8d27-4f73-9293-25b56b3e11c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:58.586832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c0ab6-8d27-4f73-9293-25b56b3e11c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:58.588586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6e4c0ab6-8d27-4f73-9293-25b56b3e11c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:58.605368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c0ab6-8d27-4f73-9293-25b56b3e11c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:58.607600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c0ab6-8d27-4f73-9293-25b56b3e11c5 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:58.629971 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4198/8323] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:06:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:06:59.447545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:59.484914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfc7a8-7c74-4c06-ae12-50515a3d20b2 service glance] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:06:59.495808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-34cfc7a8-7c74-4c06-ae12-50515a3d20b2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:59.583659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:06:59.589755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfc7a8-7c74-4c06-ae12-50515a3d20b2 service glance] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:06:59.613006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cbda8-1d4b-40da-90c7-eac25dc923c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:06:59.623863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cbda8-1d4b-40da-90c7-eac25dc923c8 service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:06:59.623863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cbda8-1d4b-40da-90c7-eac25dc923c8 service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:06:59.623863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cbda8-1d4b-40da-90c7-eac25dc923c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:06:59.623863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-476cbda8-1d4b-40da-90c7-eac25dc923c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:06:59.640656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cbda8-1d4b-40da-90c7-eac25dc923c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:06:59.649156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cbda8-1d4b-40da-90c7-eac25dc923c8 service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:06:59.664936 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4126/8324] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:06:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:01.127581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:01.340653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:02.401409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:03.985056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:04.725063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c0ab6-8d27-4f73-9293-25b56b3e11c5 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:04.726609 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6e4c0ab6-8d27-4f73-9293-25b56b3e11c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:04.741233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c0ab6-8d27-4f73-9293-25b56b3e11c5 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:04.745292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba058b2-aa9b-41e3-b13d-5ce9bcd54c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:04.745876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba058b2-aa9b-41e3-b13d-5ce9bcd54c3a service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:04.746158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba058b2-aa9b-41e3-b13d-5ce9bcd54c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:04.746448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba058b2-aa9b-41e3-b13d-5ce9bcd54c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:04.749351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cba058b2-aa9b-41e3-b13d-5ce9bcd54c3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:04.764010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba058b2-aa9b-41e3-b13d-5ce9bcd54c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:04.765592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba058b2-aa9b-41e3-b13d-5ce9bcd54c3a service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:04.777403 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4199/8325] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:04.933176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:05.313380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cbda8-1d4b-40da-90c7-eac25dc923c8 service placement] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:05.314933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-476cbda8-1d4b-40da-90c7-eac25dc923c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:05.418669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cbda8-1d4b-40da-90c7-eac25dc923c8 service placement] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:05.431903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05f358-f7b2-4957-b7df-d9ec76490934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:05.432842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05f358-f7b2-4957-b7df-d9ec76490934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:05.433257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05f358-f7b2-4957-b7df-d9ec76490934 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:05.433759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05f358-f7b2-4957-b7df-d9ec76490934 admin admin] PATH_INFO: `/v3/users/ce25fcc72175421bbab020180b1d7e03` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:05.435799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05f358-f7b2-4957-b7df-d9ec76490934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce25fcc72175421bbab020180b1d7e03)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:05.438414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05f358-f7b2-4957-b7df-d9ec76490934 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:05.853056 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1a05f358-f7b2-4957-b7df-d9ec76490934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce25fcc72175421bbab020180b1d7e03'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:05.931787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:05.973129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1a05f358-f7b2-4957-b7df-d9ec76490934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce25fcc72175421bbab020180b1d7e03'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:05.974439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1a05f358-f7b2-4957-b7df-d9ec76490934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce25fcc72175421bbab020180b1d7e03'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:05.986275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba058b2-aa9b-41e3-b13d-5ce9bcd54c3a service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:05.990865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-cba058b2-aa9b-41e3-b13d-5ce9bcd54c3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:06.001853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1a05f358-f7b2-4957-b7df-d9ec76490934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce25fcc72175421bbab020180b1d7e03'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:06.020772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-1a05f358-f7b2-4957-b7df-d9ec76490934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce25fcc72175421bbab020180b1d7e03'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:06.030342 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4127/8326] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:07:05 2022] DELETE /identity/v3/users/ce25fcc72175421bbab020180b1d7e03 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:06.035519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5155e54-c360-426e-bb39-17f27a722a96 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:06.035983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5155e54-c360-426e-bb39-17f27a722a96 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:06.036646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5155e54-c360-426e-bb39-17f27a722a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:06.039762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba058b2-aa9b-41e3-b13d-5ce9bcd54c3a service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:06.067608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c5155e54-c360-426e-bb39-17f27a722a96 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:06.069230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c5155e54-c360-426e-bb39-17f27a722a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:06.117061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e600fc2-48dc-42a1-b687-866e18f6c1b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:06.118129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e600fc2-48dc-42a1-b687-866e18f6c1b4 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:06.118887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e600fc2-48dc-42a1-b687-866e18f6c1b4 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:06.119336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e600fc2-48dc-42a1-b687-866e18f6c1b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:06.121777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9e600fc2-48dc-42a1-b687-866e18f6c1b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:06.146756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e600fc2-48dc-42a1-b687-866e18f6c1b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:06.150017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e600fc2-48dc-42a1-b687-866e18f6c1b4 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:06.181884 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4200/8327] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:06.182110 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4128/8328] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:06.183124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5155e54-c360-426e-bb39-17f27a722a96 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:06.189407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c5155e54-c360-426e-bb39-17f27a722a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:06.273135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5155e54-c360-426e-bb39-17f27a722a96 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:06.277967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66f478-18b9-43bd-a87d-1bbad07527ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:06.279425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f478-18b9-43bd-a87d-1bbad07527ab service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:06.279718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f478-18b9-43bd-a87d-1bbad07527ab service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:06.280003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f478-18b9-43bd-a87d-1bbad07527ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:06.306010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66f478-18b9-43bd-a87d-1bbad07527ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:06.307614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66f478-18b9-43bd-a87d-1bbad07527ab service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:06.320894 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4129/8329] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:06.326780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:06.897382 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:06.941817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e600fc2-48dc-42a1-b687-866e18f6c1b4 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:06.942886 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9e600fc2-48dc-42a1-b687-866e18f6c1b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:06.960966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e600fc2-48dc-42a1-b687-866e18f6c1b4 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:06.967633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9b60a-c125-4021-a0e8-1142ab57f0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:06.968697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9b60a-c125-4021-a0e8-1142ab57f0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:06.970263 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9b60a-c125-4021-a0e8-1142ab57f0be admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:06.970753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9b60a-c125-4021-a0e8-1142ab57f0be admin admin] PATH_INFO: `/v3/projects/bc89f00c670b401b88af01faa8793eea` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:06.972819 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9b60a-c125-4021-a0e8-1142ab57f0be admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc89f00c670b401b88af01faa8793eea)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:06.975465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9b60a-c125-4021-a0e8-1142ab57f0be admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:07.172527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6ef9b60a-c125-4021-a0e8-1142ab57f0be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc89f00c670b401b88af01faa8793eea', 'request_id': 'req-6ef9b60a-c125-4021-a0e8-1142ab57f0be'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:07.178464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6ef9b60a-c125-4021-a0e8-1142ab57f0be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc89f00c670b401b88af01faa8793eea', 'request_id': 'req-6ef9b60a-c125-4021-a0e8-1142ab57f0be'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:07.321308 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6ef9b60a-c125-4021-a0e8-1142ab57f0be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc89f00c670b401b88af01faa8793eea', 'request_id': 'req-6ef9b60a-c125-4021-a0e8-1142ab57f0be'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:07.344961 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6ef9b60a-c125-4021-a0e8-1142ab57f0be admin admin] The token cache is being invalidate because project bc89f00c670b401b88af01faa8793eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:07:07.346163 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6ef9b60a-c125-4021-a0e8-1142ab57f0be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:07.347275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6ef9b60a-c125-4021-a0e8-1142ab57f0be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:07.369854 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4201/8330] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:07:06 2022] DELETE /identity/v3/projects/bc89f00c670b401b88af01faa8793eea => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:07.370591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d6658-7825-45ba-b6cf-d69212d7a15d None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:07.370591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d6658-7825-45ba-b6cf-d69212d7a15d None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:07.370591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d6658-7825-45ba-b6cf-d69212d7a15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:07.396706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-bc3d6658-7825-45ba-b6cf-d69212d7a15d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:07.400043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bc3d6658-7825-45ba-b6cf-d69212d7a15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:07.467404 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4130/8331] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:07.475087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e44588-ca8f-4099-bd52-285abc342de4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:07.475366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e44588-ca8f-4099-bd52-285abc342de4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:07.475853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e44588-ca8f-4099-bd52-285abc342de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:07.507128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b4e44588-ca8f-4099-bd52-285abc342de4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:07.509853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b4e44588-ca8f-4099-bd52-285abc342de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:07.521076 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4202/8332] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:07.525394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d6658-7825-45ba-b6cf-d69212d7a15d None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:07.538201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d6658-7825-45ba-b6cf-d69212d7a15d None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:07.544640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2864a93-d8ad-43ef-b880-9ab9d0e945f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:07.545473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2864a93-d8ad-43ef-b880-9ab9d0e945f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:07.546020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2864a93-d8ad-43ef-b880-9ab9d0e945f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:07.546301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2864a93-d8ad-43ef-b880-9ab9d0e945f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:07.547008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2864a93-d8ad-43ef-b880-9ab9d0e945f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:07:07.547493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2864a93-d8ad-43ef-b880-9ab9d0e945f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:07.549149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2864a93-d8ad-43ef-b880-9ab9d0e945f6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:07.563704 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4131/8333] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:07:07.591691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e44588-ca8f-4099-bd52-285abc342de4 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:07.602375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e44588-ca8f-4099-bd52-285abc342de4 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:07.608150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43491d5f-9e61-466c-b08f-dd423a6905dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:07.608991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43491d5f-9e61-466c-b08f-dd423a6905dd admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:07.609368 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43491d5f-9e61-466c-b08f-dd423a6905dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:07.609735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43491d5f-9e61-466c-b08f-dd423a6905dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:07.610494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43491d5f-9e61-466c-b08f-dd423a6905dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:07.612511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43491d5f-9e61-466c-b08f-dd423a6905dd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:07.760685 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4203/8334] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:07:07 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:07:07.765323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2864a93-d8ad-43ef-b880-9ab9d0e945f6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:07.776903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2864a93-d8ad-43ef-b880-9ab9d0e945f6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:07.845814 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ddf26-eea2-4cd4-af37-d57cb9e01ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:07.847022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ddf26-eea2-4cd4-af37-d57cb9e01ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:07.847770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ddf26-eea2-4cd4-af37-d57cb9e01ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:07.848240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ddf26-eea2-4cd4-af37-d57cb9e01ef6 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:07.849045 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ddf26-eea2-4cd4-af37-d57cb9e01ef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:07.851313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ddf26-eea2-4cd4-af37-d57cb9e01ef6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:07.988007 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4132/8335] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:07:07 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:07:07.989531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43491d5f-9e61-466c-b08f-dd423a6905dd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:08.000458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43491d5f-9e61-466c-b08f-dd423a6905dd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:08.005383 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254497e-4e71-4099-a795-f49b19a07e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:08.006012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254497e-4e71-4099-a795-f49b19a07e44 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:08.006365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254497e-4e71-4099-a795-f49b19a07e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:08.006708 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254497e-4e71-4099-a795-f49b19a07e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:08.007487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254497e-4e71-4099-a795-f49b19a07e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:08.009177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254497e-4e71-4099-a795-f49b19a07e44 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:08.020551 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4204/8336] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:07:08.024752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ddf26-eea2-4cd4-af37-d57cb9e01ef6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:08.037603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ddf26-eea2-4cd4-af37-d57cb9e01ef6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:08.042657 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af7f94-6a52-47eb-ba88-6d6c669867b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:08.044380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af7f94-6a52-47eb-ba88-6d6c669867b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:08.044732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af7f94-6a52-47eb-ba88-6d6c669867b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:08.045009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af7f94-6a52-47eb-ba88-6d6c669867b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:08.045768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af7f94-6a52-47eb-ba88-6d6c669867b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:08.047378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af7f94-6a52-47eb-ba88-6d6c669867b8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:08.063169 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4133/8337] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:07:08.078278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254497e-4e71-4099-a795-f49b19a07e44 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:08.078278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254497e-4e71-4099-a795-f49b19a07e44 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:08.080023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4ee79-b49d-4ffc-aa82-fececd1980ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:08.080794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4ee79-b49d-4ffc-aa82-fececd1980ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:08.081076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4ee79-b49d-4ffc-aa82-fececd1980ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:08.081351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4ee79-b49d-4ffc-aa82-fececd1980ae admin admin] PATH_INFO: `/v3/projects/55aef4aee3e94f0d8a69707d76a64813/users/d00f009e8d954268b45a8ef28bbaed7d/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:08.103487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4ee79-b49d-4ffc-aa82-fececd1980ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=55aef4aee3e94f0d8a69707d76a64813, user_id=d00f009e8d954268b45a8ef28bbaed7d, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:08.106289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4ee79-b49d-4ffc-aa82-fececd1980ae admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:08.219971 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4205/8338] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:07:08 2022] PUT /identity/v3/projects/55aef4aee3e94f0d8a69707d76a64813/users/d00f009e8d954268b45a8ef28bbaed7d/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:08.230485 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671ea2b-1bdc-4af5-a440-186057f90f19 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:08.230777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671ea2b-1bdc-4af5-a440-186057f90f19 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:08.232583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671ea2b-1bdc-4af5-a440-186057f90f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:08.260274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6671ea2b-1bdc-4af5-a440-186057f90f19 None None] MFA Rules not processed for user `d00f009e8d954268b45a8ef28bbaed7d`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:08.261408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6671ea2b-1bdc-4af5-a440-186057f90f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:08.339432 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4134/8339] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:08.351182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4ee79-b49d-4ffc-aa82-fececd1980ae admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:08.370454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:08.419658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4ee79-b49d-4ffc-aa82-fececd1980ae admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:08.424588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e258c5-8041-49b0-812d-26fae92d1075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:08.425213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e258c5-8041-49b0-812d-26fae92d1075 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:08.425491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e258c5-8041-49b0-812d-26fae92d1075 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:08.425762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e258c5-8041-49b0-812d-26fae92d1075 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:08.426396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e258c5-8041-49b0-812d-26fae92d1075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:08.428344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e258c5-8041-49b0-812d-26fae92d1075 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:08.563016 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4206/8340] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:07:08 2022] POST /identity/v3/projects => generated 373 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:07:08.567148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671ea2b-1bdc-4af5-a440-186057f90f19 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:08.579740 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671ea2b-1bdc-4af5-a440-186057f90f19 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:08.640538 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db4ea2-2250-4e05-8446-9c37347d2bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:08.641165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db4ea2-2250-4e05-8446-9c37347d2bec admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:08.648387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db4ea2-2250-4e05-8446-9c37347d2bec admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:08.648387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db4ea2-2250-4e05-8446-9c37347d2bec admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:08.648387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db4ea2-2250-4e05-8446-9c37347d2bec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:08.648387 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db4ea2-2250-4e05-8446-9c37347d2bec admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:08.667075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:08.788790 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4135/8341] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:07:08 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:07:08.790295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e258c5-8041-49b0-812d-26fae92d1075 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:08.801485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e258c5-8041-49b0-812d-26fae92d1075 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:08.806069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363e568-399b-437f-ac48-68272b5d264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:08.806671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363e568-399b-437f-ac48-68272b5d264c admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:08.806952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363e568-399b-437f-ac48-68272b5d264c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:08.807226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363e568-399b-437f-ac48-68272b5d264c admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:08.807897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363e568-399b-437f-ac48-68272b5d264c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:08.809532 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363e568-399b-437f-ac48-68272b5d264c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:08.820677 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4207/8342] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:07:08.826212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db4ea2-2250-4e05-8446-9c37347d2bec admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:08.837000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db4ea2-2250-4e05-8446-9c37347d2bec admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:08.842833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d839d15-321e-4107-b7e9-30f8c2e4db7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:08.843439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d839d15-321e-4107-b7e9-30f8c2e4db7a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:08.843721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d839d15-321e-4107-b7e9-30f8c2e4db7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:08.844000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d839d15-321e-4107-b7e9-30f8c2e4db7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:08.844686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d839d15-321e-4107-b7e9-30f8c2e4db7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:08.846296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d839d15-321e-4107-b7e9-30f8c2e4db7a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:08.857645 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4136/8343] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:07:08.862055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363e568-399b-437f-ac48-68272b5d264c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:08.872802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363e568-399b-437f-ac48-68272b5d264c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:08.877462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7494ab-1420-49fc-a3a3-5e465cce8f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:08.878113 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7494ab-1420-49fc-a3a3-5e465cce8f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:08.878394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7494ab-1420-49fc-a3a3-5e465cce8f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:08.878665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7494ab-1420-49fc-a3a3-5e465cce8f6c admin admin] PATH_INFO: `/v3/projects/49e4c706bb554050b2969d29ac71f42f/users/c477d514b32b4ecba12dcba5b5133857/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:08.895833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7494ab-1420-49fc-a3a3-5e465cce8f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e4c706bb554050b2969d29ac71f42f, user_id=c477d514b32b4ecba12dcba5b5133857, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:08.898545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7494ab-1420-49fc-a3a3-5e465cce8f6c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:09.145248 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4208/8344] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:07:08 2022] PUT /identity/v3/projects/49e4c706bb554050b2969d29ac71f42f/users/c477d514b32b4ecba12dcba5b5133857/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:07:09.157346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d2d78-055f-464f-b459-b86ce510c898 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:09.157579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d2d78-055f-464f-b459-b86ce510c898 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:09.157861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d2d78-055f-464f-b459-b86ce510c898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:09.187306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-201d2d78-055f-464f-b459-b86ce510c898 None None] MFA Rules not processed for user `c477d514b32b4ecba12dcba5b5133857`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:09.190275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-201d2d78-055f-464f-b459-b86ce510c898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:09.261028 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4137/8345] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:09.266959 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7494ab-1420-49fc-a3a3-5e465cce8f6c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:09.339138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7494ab-1420-49fc-a3a3-5e465cce8f6c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:09.344719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de221073-f037-4570-b1d9-34771e11dc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:09.345333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de221073-f037-4570-b1d9-34771e11dc95 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:09.345647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de221073-f037-4570-b1d9-34771e11dc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:09.345930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de221073-f037-4570-b1d9-34771e11dc95 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:09.346721 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de221073-f037-4570-b1d9-34771e11dc95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:09.348670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de221073-f037-4570-b1d9-34771e11dc95 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:09.501293 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4209/8346] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:07:09 2022] POST /identity/v3/projects => generated 375 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:07:09.505848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d2d78-055f-464f-b459-b86ce510c898 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:09.518863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d2d78-055f-464f-b459-b86ce510c898 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:09.587626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8158fb-a64d-4bc1-85ab-f901e3c6f79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:09.588331 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8158fb-a64d-4bc1-85ab-f901e3c6f79d admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:09.588586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8158fb-a64d-4bc1-85ab-f901e3c6f79d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:09.588865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8158fb-a64d-4bc1-85ab-f901e3c6f79d admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:09.589575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8158fb-a64d-4bc1-85ab-f901e3c6f79d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:09.592238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8158fb-a64d-4bc1-85ab-f901e3c6f79d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:09.754765 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4138/8347] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:07:09 2022] POST /identity/v3/users => generated 294 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:07:09.759789 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de221073-f037-4570-b1d9-34771e11dc95 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:09.770799 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de221073-f037-4570-b1d9-34771e11dc95 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:09.775850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117e77f-480c-4792-8588-975201784e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:09.776667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117e77f-480c-4792-8588-975201784e1d admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:09.777104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117e77f-480c-4792-8588-975201784e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:09.777544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117e77f-480c-4792-8588-975201784e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:09.778492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117e77f-480c-4792-8588-975201784e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:09.780904 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117e77f-480c-4792-8588-975201784e1d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:09.792893 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4210/8348] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:07:09.796968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8158fb-a64d-4bc1-85ab-f901e3c6f79d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:09.807881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8158fb-a64d-4bc1-85ab-f901e3c6f79d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:09.813546 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824c04c-83ce-4d7e-839d-ac9ee3bf72b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:09.814445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824c04c-83ce-4d7e-839d-ac9ee3bf72b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:09.814879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824c04c-83ce-4d7e-839d-ac9ee3bf72b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:09.815304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824c04c-83ce-4d7e-839d-ac9ee3bf72b1 admin admin] PATH_INFO: `/v3/projects/72e13acfca234fa6a94dd942249bf7ae/users/8ded44d71fb3490abd1f391884081795/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:09.834815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824c04c-83ce-4d7e-839d-ac9ee3bf72b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e13acfca234fa6a94dd942249bf7ae, user_id=8ded44d71fb3490abd1f391884081795, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:09.837926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824c04c-83ce-4d7e-839d-ac9ee3bf72b1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:09.947537 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4139/8349] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:07:09 2022] PUT /identity/v3/projects/72e13acfca234fa6a94dd942249bf7ae/users/8ded44d71fb3490abd1f391884081795/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:09.949118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117e77f-480c-4792-8588-975201784e1d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:09.968092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117e77f-480c-4792-8588-975201784e1d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:10.046796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5b833-db0e-40cb-b17b-f336d3bdc855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:10.047636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5b833-db0e-40cb-b17b-f336d3bdc855 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:10.048104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5b833-db0e-40cb-b17b-f336d3bdc855 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:10.048436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5b833-db0e-40cb-b17b-f336d3bdc855 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:10.051150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5b833-db0e-40cb-b17b-f336d3bdc855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:10.051558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:10.053725 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5b833-db0e-40cb-b17b-f336d3bdc855 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:10.078498 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4211/8350] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:07:10.083065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824c04c-83ce-4d7e-839d-ac9ee3bf72b1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:10.095324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824c04c-83ce-4d7e-839d-ac9ee3bf72b1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:10.100350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70119c91-e0cc-44b4-a0ed-cc8dc79b0850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:10.101027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119c91-e0cc-44b4-a0ed-cc8dc79b0850 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:10.101336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119c91-e0cc-44b4-a0ed-cc8dc79b0850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:10.101612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119c91-e0cc-44b4-a0ed-cc8dc79b0850 admin admin] PATH_INFO: `/v3/projects/72e13acfca234fa6a94dd942249bf7ae/users/8ded44d71fb3490abd1f391884081795/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:10.103642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70119c91-e0cc-44b4-a0ed-cc8dc79b0850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e13acfca234fa6a94dd942249bf7ae, user_id=8ded44d71fb3490abd1f391884081795, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:10.106928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70119c91-e0cc-44b4-a0ed-cc8dc79b0850 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:10.118341 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4140/8351] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:07:10 2022] PUT /identity/v3/projects/72e13acfca234fa6a94dd942249bf7ae/users/8ded44d71fb3490abd1f391884081795/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:10.128917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbaf3c-ac04-407c-9ffd-ae0a01b01606 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:10.129322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbaf3c-ac04-407c-9ffd-ae0a01b01606 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:10.129666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbaf3c-ac04-407c-9ffd-ae0a01b01606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:10.185608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6acbaf3c-ac04-407c-9ffd-ae0a01b01606 None None] MFA Rules not processed for user `8ded44d71fb3490abd1f391884081795`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:10.185608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6acbaf3c-ac04-407c-9ffd-ae0a01b01606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:10.269408 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4212/8352] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:10.282577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70119c91-e0cc-44b4-a0ed-cc8dc79b0850 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:10.284347 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-70119c91-e0cc-44b4-a0ed-cc8dc79b0850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:10.370250 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70119c91-e0cc-44b4-a0ed-cc8dc79b0850 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:10.375469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c264652-7504-4a14-a20b-e878db533d8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:10.376291 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c264652-7504-4a14-a20b-e878db533d8a service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:10.376696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c264652-7504-4a14-a20b-e878db533d8a service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:10.377071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c264652-7504-4a14-a20b-e878db533d8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:10.453967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c264652-7504-4a14-a20b-e878db533d8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:10.456416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c264652-7504-4a14-a20b-e878db533d8a service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:10.467337 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4141/8353] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:10.703376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:11.722319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:13.260783 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbaf3c-ac04-407c-9ffd-ae0a01b01606 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:13.263045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6acbaf3c-ac04-407c-9ffd-ae0a01b01606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:13.329633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c264652-7504-4a14-a20b-e878db533d8a service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:13.331106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2c264652-7504-4a14-a20b-e878db533d8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:13.346375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbaf3c-ac04-407c-9ffd-ae0a01b01606 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:13.353275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdb1dd-7914-4da0-8b19-0d9e497a9595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:13.354202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdb1dd-7914-4da0-8b19-0d9e497a9595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:13.354637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdb1dd-7914-4da0-8b19-0d9e497a9595 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:13.355091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdb1dd-7914-4da0-8b19-0d9e497a9595 admin admin] PATH_INFO: `/v3/users/bb14e965d8c44cf89c6acdafbeb450e3` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:13.357750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdb1dd-7914-4da0-8b19-0d9e497a9595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb14e965d8c44cf89c6acdafbeb450e3)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:13.359767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdb1dd-7914-4da0-8b19-0d9e497a9595 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:13.420137 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c264652-7504-4a14-a20b-e878db533d8a service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:13.425633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c26cb2-f6eb-4a06-b89e-a39b7cc72907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:13.426238 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c26cb2-f6eb-4a06-b89e-a39b7cc72907 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:13.426515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c26cb2-f6eb-4a06-b89e-a39b7cc72907 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:13.426839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c26cb2-f6eb-4a06-b89e-a39b7cc72907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:13.428550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-02c26cb2-f6eb-4a06-b89e-a39b7cc72907 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:13.445060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c26cb2-f6eb-4a06-b89e-a39b7cc72907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:13.446846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c26cb2-f6eb-4a06-b89e-a39b7cc72907 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:13.462354 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4142/8354] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:13.846697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1bbdb1dd-7914-4da0-8b19-0d9e497a9595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb14e965d8c44cf89c6acdafbeb450e3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:13.857473 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1bbdb1dd-7914-4da0-8b19-0d9e497a9595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb14e965d8c44cf89c6acdafbeb450e3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:13.949138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c26cb2-f6eb-4a06-b89e-a39b7cc72907 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:13.973973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c26cb2-f6eb-4a06-b89e-a39b7cc72907 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:13.979533 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6807caf-8dd2-4a66-8b33-d6ddee645ade service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:13.980507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6807caf-8dd2-4a66-8b33-d6ddee645ade service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:13.981708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6807caf-8dd2-4a66-8b33-d6ddee645ade service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:13.982531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6807caf-8dd2-4a66-8b33-d6ddee645ade service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:14.001285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1bbdb1dd-7914-4da0-8b19-0d9e497a9595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb14e965d8c44cf89c6acdafbeb450e3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:14.001995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1bbdb1dd-7914-4da0-8b19-0d9e497a9595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb14e965d8c44cf89c6acdafbeb450e3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:14.023497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-1bbdb1dd-7914-4da0-8b19-0d9e497a9595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb14e965d8c44cf89c6acdafbeb450e3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:14.052567 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4213/8355] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:07:13 2022] DELETE /identity/v3/users/bb14e965d8c44cf89c6acdafbeb450e3 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:14.056908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cb58e-328e-432e-80ef-f3c88ae3281b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:14.057405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cb58e-328e-432e-80ef-f3c88ae3281b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:14.057855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cb58e-328e-432e-80ef-f3c88ae3281b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:14.067489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6807caf-8dd2-4a66-8b33-d6ddee645ade service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:14.069232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6807caf-8dd2-4a66-8b33-d6ddee645ade service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:14.081499 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4143/8356] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:07:14.104602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0c2cb58e-328e-432e-80ef-f3c88ae3281b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:14.106698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0c2cb58e-328e-432e-80ef-f3c88ae3281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:14.175821 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4214/8357] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:14.188579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6807caf-8dd2-4a66-8b33-d6ddee645ade service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:14.190431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b6807caf-8dd2-4a66-8b33-d6ddee645ade service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:14.303669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6807caf-8dd2-4a66-8b33-d6ddee645ade service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:14.366691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e191af-cf83-4e77-81c5-efea12be244d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:14.367404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e191af-cf83-4e77-81c5-efea12be244d service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:14.367724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e191af-cf83-4e77-81c5-efea12be244d service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:14.368070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e191af-cf83-4e77-81c5-efea12be244d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:14.379709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e191af-cf83-4e77-81c5-efea12be244d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:14.381451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e191af-cf83-4e77-81c5-efea12be244d service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:14.393267 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4144/8358] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:14.549981 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:14.768033 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:14.913580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cb58e-328e-432e-80ef-f3c88ae3281b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:14.915077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0c2cb58e-328e-432e-80ef-f3c88ae3281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:14.928012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cb58e-328e-432e-80ef-f3c88ae3281b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:14.932984 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9aa83-4891-4d1e-aba9-90d901a01fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:14.933632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9aa83-4891-4d1e-aba9-90d901a01fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:14.933917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9aa83-4891-4d1e-aba9-90d901a01fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:14.934743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9aa83-4891-4d1e-aba9-90d901a01fdf admin admin] PATH_INFO: `/v3/projects/41907d6cb4934549993ad41d2f021d0d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:14.936104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9aa83-4891-4d1e-aba9-90d901a01fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=41907d6cb4934549993ad41d2f021d0d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:14.938261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9aa83-4891-4d1e-aba9-90d901a01fdf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:15.187633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2ef9aa83-4891-4d1e-aba9-90d901a01fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41907d6cb4934549993ad41d2f021d0d', 'request_id': 'req-2ef9aa83-4891-4d1e-aba9-90d901a01fdf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:15.195266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2ef9aa83-4891-4d1e-aba9-90d901a01fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41907d6cb4934549993ad41d2f021d0d', 'request_id': 'req-2ef9aa83-4891-4d1e-aba9-90d901a01fdf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:15.293654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2ef9aa83-4891-4d1e-aba9-90d901a01fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41907d6cb4934549993ad41d2f021d0d', 'request_id': 'req-2ef9aa83-4891-4d1e-aba9-90d901a01fdf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:15.330884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2ef9aa83-4891-4d1e-aba9-90d901a01fdf admin admin] The token cache is being invalidate because project 41907d6cb4934549993ad41d2f021d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:07:15.331365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2ef9aa83-4891-4d1e-aba9-90d901a01fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:15.337112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2ef9aa83-4891-4d1e-aba9-90d901a01fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:15.340150 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4215/8359] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:07:14 2022] DELETE /identity/v3/projects/41907d6cb4934549993ad41d2f021d0d => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:15.347293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4dfa1-6156-4f6f-abee-460368d5157f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:15.354154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4dfa1-6156-4f6f-abee-460368d5157f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:15.354154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4dfa1-6156-4f6f-abee-460368d5157f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:15.403547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-18f4dfa1-6156-4f6f-abee-460368d5157f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:15.405240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-18f4dfa1-6156-4f6f-abee-460368d5157f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:15.475460 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4145/8360] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:15.483942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41a35e-73d9-410a-9d96-8f61839b2511 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:15.484989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41a35e-73d9-410a-9d96-8f61839b2511 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:15.484989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41a35e-73d9-410a-9d96-8f61839b2511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:15.505389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6a41a35e-73d9-410a-9d96-8f61839b2511 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:15.506592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6a41a35e-73d9-410a-9d96-8f61839b2511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:15.515560 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4216/8361] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:15.520112 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4dfa1-6156-4f6f-abee-460368d5157f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:15.531128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4dfa1-6156-4f6f-abee-460368d5157f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:15.535699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297693b-061b-4986-a528-5bdaab8772ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:15.536343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297693b-061b-4986-a528-5bdaab8772ae admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:15.536674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297693b-061b-4986-a528-5bdaab8772ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:15.536952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297693b-061b-4986-a528-5bdaab8772ae admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:15.537603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297693b-061b-4986-a528-5bdaab8772ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:07:15.537901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297693b-061b-4986-a528-5bdaab8772ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:15.539528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297693b-061b-4986-a528-5bdaab8772ae admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:15.555642 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4146/8362] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:07:15.556752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41a35e-73d9-410a-9d96-8f61839b2511 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:15.567007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41a35e-73d9-410a-9d96-8f61839b2511 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:15.573740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03024874-d7a8-435c-aff1-f3a18a7fd684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:15.573740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03024874-d7a8-435c-aff1-f3a18a7fd684 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:15.573740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03024874-d7a8-435c-aff1-f3a18a7fd684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:15.573740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03024874-d7a8-435c-aff1-f3a18a7fd684 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:15.574373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03024874-d7a8-435c-aff1-f3a18a7fd684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:15.576834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03024874-d7a8-435c-aff1-f3a18a7fd684 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:15.723716 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4217/8363] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:07:15 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:07:15.727639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297693b-061b-4986-a528-5bdaab8772ae admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:15.739100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297693b-061b-4986-a528-5bdaab8772ae admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:15.805635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7f25c-f107-4aae-a125-028086dc01fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:15.805635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7f25c-f107-4aae-a125-028086dc01fe admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:15.805635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7f25c-f107-4aae-a125-028086dc01fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:15.805635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7f25c-f107-4aae-a125-028086dc01fe admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:15.808083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7f25c-f107-4aae-a125-028086dc01fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:15.808083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7f25c-f107-4aae-a125-028086dc01fe admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:15.895835 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4147/8364] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:07:15 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:07:15.897410 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03024874-d7a8-435c-aff1-f3a18a7fd684 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:15.908990 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03024874-d7a8-435c-aff1-f3a18a7fd684 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:15.913939 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a59896-29f4-4bd9-a001-770586943b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:15.914649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59896-29f4-4bd9-a001-770586943b81 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:15.914997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59896-29f4-4bd9-a001-770586943b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:15.915338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59896-29f4-4bd9-a001-770586943b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:15.916077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a59896-29f4-4bd9-a001-770586943b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:15.918063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a59896-29f4-4bd9-a001-770586943b81 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:15.929487 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4218/8365] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:07:15.933623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7f25c-f107-4aae-a125-028086dc01fe admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:15.952730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7f25c-f107-4aae-a125-028086dc01fe admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:15.957969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35dc8d9-9d9e-41bb-ac2e-d7bf31422265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:15.958781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dc8d9-9d9e-41bb-ac2e-d7bf31422265 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:15.959217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dc8d9-9d9e-41bb-ac2e-d7bf31422265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:15.959662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dc8d9-9d9e-41bb-ac2e-d7bf31422265 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:15.960363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35dc8d9-9d9e-41bb-ac2e-d7bf31422265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:15.962021 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35dc8d9-9d9e-41bb-ac2e-d7bf31422265 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:15.974521 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4148/8366] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:07:15.978955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a59896-29f4-4bd9-a001-770586943b81 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:15.989537 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a59896-29f4-4bd9-a001-770586943b81 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:15.995700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81521f25-d13e-4cf6-beb4-42a15cf0b051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:15.995700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81521f25-d13e-4cf6-beb4-42a15cf0b051 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:15.995700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81521f25-d13e-4cf6-beb4-42a15cf0b051 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:15.995700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81521f25-d13e-4cf6-beb4-42a15cf0b051 admin admin] PATH_INFO: `/v3/projects/93c34b90d2e44ef59245cd3c1dff8cb8/users/e3617ea19cb941548db8c55368ccc941/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:16.010250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81521f25-d13e-4cf6-beb4-42a15cf0b051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c34b90d2e44ef59245cd3c1dff8cb8, user_id=e3617ea19cb941548db8c55368ccc941, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:16.013777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81521f25-d13e-4cf6-beb4-42a15cf0b051 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:16.161437 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4219/8367] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:07:15 2022] PUT /identity/v3/projects/93c34b90d2e44ef59245cd3c1dff8cb8/users/e3617ea19cb941548db8c55368ccc941/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:16.172405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b265e-b827-4ed7-ba60-806a5f1435f9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:16.172730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b265e-b827-4ed7-ba60-806a5f1435f9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:16.173073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b265e-b827-4ed7-ba60-806a5f1435f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:16.207562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-631b265e-b827-4ed7-ba60-806a5f1435f9 None None] MFA Rules not processed for user `e3617ea19cb941548db8c55368ccc941`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:16.208919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-631b265e-b827-4ed7-ba60-806a5f1435f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:16.287101 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4149/8368] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:16.303301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81521f25-d13e-4cf6-beb4-42a15cf0b051 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:16.305424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-81521f25-d13e-4cf6-beb4-42a15cf0b051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:16.341433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b265e-b827-4ed7-ba60-806a5f1435f9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:16.343132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-631b265e-b827-4ed7-ba60-806a5f1435f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:16.373755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81521f25-d13e-4cf6-beb4-42a15cf0b051 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:16.377639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32349a85-8c38-4f01-8aca-db091e22f5a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:16.378248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32349a85-8c38-4f01-8aca-db091e22f5a6 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:16.378531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32349a85-8c38-4f01-8aca-db091e22f5a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:16.378804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32349a85-8c38-4f01-8aca-db091e22f5a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:16.389891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32349a85-8c38-4f01-8aca-db091e22f5a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:16.391350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32349a85-8c38-4f01-8aca-db091e22f5a6 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:16.401979 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4220/8369] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:16.412519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b265e-b827-4ed7-ba60-806a5f1435f9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:16.416969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565a89b-c77f-4fa1-ba78-99379f1aa1b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:16.417700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565a89b-c77f-4fa1-ba78-99379f1aa1b4 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:16.417932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565a89b-c77f-4fa1-ba78-99379f1aa1b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:16.418285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565a89b-c77f-4fa1-ba78-99379f1aa1b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:16.420149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6565a89b-c77f-4fa1-ba78-99379f1aa1b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:16.501882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565a89b-c77f-4fa1-ba78-99379f1aa1b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:16.501882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565a89b-c77f-4fa1-ba78-99379f1aa1b4 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:16.511820 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4150/8370] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:17.910157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:17.928763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32349a85-8c38-4f01-8aca-db091e22f5a6 service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:17.930578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-32349a85-8c38-4f01-8aca-db091e22f5a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:18.024873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32349a85-8c38-4f01-8aca-db091e22f5a6 service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:18.031234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593d734-d9b8-4cec-bf4c-7abf232e21b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:18.032232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593d734-d9b8-4cec-bf4c-7abf232e21b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:18.032703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593d734-d9b8-4cec-bf4c-7abf232e21b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:18.033143 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593d734-d9b8-4cec-bf4c-7abf232e21b0 admin admin] PATH_INFO: `/v3/users/6034cfcab807407eb894c2927eacc13e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:18.034995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593d734-d9b8-4cec-bf4c-7abf232e21b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6034cfcab807407eb894c2927eacc13e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:18.037154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593d734-d9b8-4cec-bf4c-7abf232e21b0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:18.087034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:18.301176 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4593d734-d9b8-4cec-bf4c-7abf232e21b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6034cfcab807407eb894c2927eacc13e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:18.301942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4593d734-d9b8-4cec-bf4c-7abf232e21b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6034cfcab807407eb894c2927eacc13e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:18.422558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4593d734-d9b8-4cec-bf4c-7abf232e21b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6034cfcab807407eb894c2927eacc13e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:18.423259 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4593d734-d9b8-4cec-bf4c-7abf232e21b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6034cfcab807407eb894c2927eacc13e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:18.437808 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4593d734-d9b8-4cec-bf4c-7abf232e21b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6034cfcab807407eb894c2927eacc13e'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:18.452617 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4221/8371] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:07:17 2022] DELETE /identity/v3/users/6034cfcab807407eb894c2927eacc13e => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:18.457054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322e58a-e080-4c17-9fdb-f2284a2823c3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:18.457392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322e58a-e080-4c17-9fdb-f2284a2823c3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:18.457673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322e58a-e080-4c17-9fdb-f2284a2823c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:18.480338 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9322e58a-e080-4c17-9fdb-f2284a2823c3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:18.482219 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9322e58a-e080-4c17-9fdb-f2284a2823c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:18.565363 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4151/8372] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:18.574048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593d734-d9b8-4cec-bf4c-7abf232e21b0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:18.576336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4593d734-d9b8-4cec-bf4c-7abf232e21b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:18.671615 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593d734-d9b8-4cec-bf4c-7abf232e21b0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:18.675518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc8ec4-1ee3-4681-afe8-16b37fb539d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:18.676185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc8ec4-1ee3-4681-afe8-16b37fb539d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:18.676469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc8ec4-1ee3-4681-afe8-16b37fb539d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:18.676736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc8ec4-1ee3-4681-afe8-16b37fb539d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:18.687520 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc8ec4-1ee3-4681-afe8-16b37fb539d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:18.689008 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc8ec4-1ee3-4681-afe8-16b37fb539d3 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:18.700267 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4222/8373] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:19.270946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322e58a-e080-4c17-9fdb-f2284a2823c3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:19.275490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9322e58a-e080-4c17-9fdb-f2284a2823c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:19.285428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322e58a-e080-4c17-9fdb-f2284a2823c3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:19.301677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce1cc7-7317-4663-91c8-265951c0433f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:19.302479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce1cc7-7317-4663-91c8-265951c0433f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:19.302930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce1cc7-7317-4663-91c8-265951c0433f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:19.303341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce1cc7-7317-4663-91c8-265951c0433f admin admin] PATH_INFO: `/v3/projects/81d2e5084d8742dbbaea5d7c0b370f6c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:19.304906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce1cc7-7317-4663-91c8-265951c0433f admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d2e5084d8742dbbaea5d7c0b370f6c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:19.307136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce1cc7-7317-4663-91c8-265951c0433f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:19.526565 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17ce1cc7-7317-4663-91c8-265951c0433f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d2e5084d8742dbbaea5d7c0b370f6c', 'request_id': 'req-17ce1cc7-7317-4663-91c8-265951c0433f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:19.533919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17ce1cc7-7317-4663-91c8-265951c0433f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d2e5084d8742dbbaea5d7c0b370f6c', 'request_id': 'req-17ce1cc7-7317-4663-91c8-265951c0433f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:19.540812 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17ce1cc7-7317-4663-91c8-265951c0433f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d2e5084d8742dbbaea5d7c0b370f6c', 'request_id': 'req-17ce1cc7-7317-4663-91c8-265951c0433f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:19.706261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17ce1cc7-7317-4663-91c8-265951c0433f admin admin] The token cache is being invalidate because project 81d2e5084d8742dbbaea5d7c0b370f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:07:19.706261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17ce1cc7-7317-4663-91c8-265951c0433f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:19.706849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-17ce1cc7-7317-4663-91c8-265951c0433f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:19.712180 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4152/8374] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:07:19 2022] DELETE /identity/v3/projects/81d2e5084d8742dbbaea5d7c0b370f6c => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:19.714329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bc37a-8036-4527-8257-a5c2a3b32517 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:19.714801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bc37a-8036-4527-8257-a5c2a3b32517 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:19.716351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bc37a-8036-4527-8257-a5c2a3b32517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:19.741295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ff0bc37a-8036-4527-8257-a5c2a3b32517 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:19.742798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ff0bc37a-8036-4527-8257-a5c2a3b32517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:19.859783 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4223/8375] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:19.869129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64a5c0-b8c1-4570-82dd-6df4c2f148f6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:19.869489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64a5c0-b8c1-4570-82dd-6df4c2f148f6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:19.869869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64a5c0-b8c1-4570-82dd-6df4c2f148f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:19.870637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:19.914507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9c64a5c0-b8c1-4570-82dd-6df4c2f148f6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:19.916015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9c64a5c0-b8c1-4570-82dd-6df4c2f148f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:19.927062 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4153/8376] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:19.932709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bc37a-8036-4527-8257-a5c2a3b32517 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:19.948869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bc37a-8036-4527-8257-a5c2a3b32517 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:19.955135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7720c6-1492-4453-a9fe-c49c3e02faf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:19.955765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7720c6-1492-4453-a9fe-c49c3e02faf8 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:19.956054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7720c6-1492-4453-a9fe-c49c3e02faf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:19.956371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7720c6-1492-4453-a9fe-c49c3e02faf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:19.957039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7720c6-1492-4453-a9fe-c49c3e02faf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:07:19.957349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7720c6-1492-4453-a9fe-c49c3e02faf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:19.960884 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7720c6-1492-4453-a9fe-c49c3e02faf8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:19.983373 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64a5c0-b8c1-4570-82dd-6df4c2f148f6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:19.989585 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4224/8377] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:07:19.993874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64a5c0-b8c1-4570-82dd-6df4c2f148f6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:19.999396 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb73e4-6bb1-419e-848d-4dfc0703e637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:20.000039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb73e4-6bb1-419e-848d-4dfc0703e637 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:20.000383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb73e4-6bb1-419e-848d-4dfc0703e637 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:20.000658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb73e4-6bb1-419e-848d-4dfc0703e637 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:20.001310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb73e4-6bb1-419e-848d-4dfc0703e637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:20.003349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb73e4-6bb1-419e-848d-4dfc0703e637 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:20.218497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7720c6-1492-4453-a9fe-c49c3e02faf8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:20.219206 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4154/8378] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:07:19 2022] POST /identity/v3/projects => generated 399 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:07:20.235365 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7720c6-1492-4453-a9fe-c49c3e02faf8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:20.310942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb003dc-15fc-4463-90df-2edeed76c9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:20.312897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb003dc-15fc-4463-90df-2edeed76c9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:20.313266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb003dc-15fc-4463-90df-2edeed76c9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:20.313622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb003dc-15fc-4463-90df-2edeed76c9b4 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:20.314352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb003dc-15fc-4463-90df-2edeed76c9b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:20.316849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb003dc-15fc-4463-90df-2edeed76c9b4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:20.433639 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4225/8379] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:07:20 2022] POST /identity/v3/users => generated 300 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:07:20.435996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb73e4-6bb1-419e-848d-4dfc0703e637 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:20.451984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb73e4-6bb1-419e-848d-4dfc0703e637 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:20.459482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9f9f4-cb31-4b6f-b9f3-e2510dcfe233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:20.460804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9f9f4-cb31-4b6f-b9f3-e2510dcfe233 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:20.461282 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9f9f4-cb31-4b6f-b9f3-e2510dcfe233 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:20.461747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9f9f4-cb31-4b6f-b9f3-e2510dcfe233 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:20.463119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9f9f4-cb31-4b6f-b9f3-e2510dcfe233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:20.465030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9f9f4-cb31-4b6f-b9f3-e2510dcfe233 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:20.487203 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4155/8380] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:07:20.491019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb003dc-15fc-4463-90df-2edeed76c9b4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:20.510684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb003dc-15fc-4463-90df-2edeed76c9b4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:20.510684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d905e3b-80f5-4827-83c7-229997c1c75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:20.510684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d905e3b-80f5-4827-83c7-229997c1c75d admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:20.510684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d905e3b-80f5-4827-83c7-229997c1c75d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:20.511061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d905e3b-80f5-4827-83c7-229997c1c75d admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:20.511061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d905e3b-80f5-4827-83c7-229997c1c75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:20.511519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d905e3b-80f5-4827-83c7-229997c1c75d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:20.527515 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4226/8381] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:07:20.530227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9f9f4-cb31-4b6f-b9f3-e2510dcfe233 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:20.540893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9f9f4-cb31-4b6f-b9f3-e2510dcfe233 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:20.546885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d506e-4f0a-498f-ba9b-8b542df0dabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:20.547562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d506e-4f0a-498f-ba9b-8b542df0dabf admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:20.548048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d506e-4f0a-498f-ba9b-8b542df0dabf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:20.548370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d506e-4f0a-498f-ba9b-8b542df0dabf admin admin] PATH_INFO: `/v3/projects/e13d2a90d4f2451fb21880995ce2bc59/users/1e01b9a6c550430cae1154d473c18dc5/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:20.565152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d506e-4f0a-498f-ba9b-8b542df0dabf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e13d2a90d4f2451fb21880995ce2bc59, user_id=1e01b9a6c550430cae1154d473c18dc5, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:20.567863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d506e-4f0a-498f-ba9b-8b542df0dabf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:20.582356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:20.649234 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4156/8382] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:07:20 2022] PUT /identity/v3/projects/e13d2a90d4f2451fb21880995ce2bc59/users/1e01b9a6c550430cae1154d473c18dc5/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:20.661254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab41a87-8e0d-4129-bf93-c6e5fec1e8ef None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:20.661549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab41a87-8e0d-4129-bf93-c6e5fec1e8ef None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:20.661851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab41a87-8e0d-4129-bf93-c6e5fec1e8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:20.693546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3ab41a87-8e0d-4129-bf93-c6e5fec1e8ef None None] MFA Rules not processed for user `1e01b9a6c550430cae1154d473c18dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:20.694973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3ab41a87-8e0d-4129-bf93-c6e5fec1e8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:20.782358 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4227/8383] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:20.797028 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d506e-4f0a-498f-ba9b-8b542df0dabf admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:20.799254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c25d506e-4f0a-498f-ba9b-8b542df0dabf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:20.882200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d506e-4f0a-498f-ba9b-8b542df0dabf admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:20.887978 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7930a38-b6b6-4e81-937c-ba76c91b0482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:20.888645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7930a38-b6b6-4e81-937c-ba76c91b0482 service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:20.888933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7930a38-b6b6-4e81-937c-ba76c91b0482 service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:20.889334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7930a38-b6b6-4e81-937c-ba76c91b0482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:20.909595 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7930a38-b6b6-4e81-937c-ba76c91b0482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:20.911232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7930a38-b6b6-4e81-937c-ba76c91b0482 service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:20.922846 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4157/8384] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:20 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:22.701805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c91c61-79b3-4811-803c-1b2d05946017 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:22.702260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c91c61-79b3-4811-803c-1b2d05946017 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:22.702401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c91c61-79b3-4811-803c-1b2d05946017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:22.721513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-46c91c61-79b3-4811-803c-1b2d05946017 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:22.722723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-46c91c61-79b3-4811-803c-1b2d05946017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:22.778380 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4228/8385] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:07:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:23.028383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7930a38-b6b6-4e81-937c-ba76c91b0482 service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:23.030176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f7930a38-b6b6-4e81-937c-ba76c91b0482 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:23.106612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7930a38-b6b6-4e81-937c-ba76c91b0482 service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:23.111683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ed134-0204-40b5-9b80-991f2063def5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:23.112321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ed134-0204-40b5-9b80-991f2063def5 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:23.112599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ed134-0204-40b5-9b80-991f2063def5 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:23.112870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ed134-0204-40b5-9b80-991f2063def5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:23.123014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ed134-0204-40b5-9b80-991f2063def5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:23.124683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ed134-0204-40b5-9b80-991f2063def5 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:23.133117 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4158/8386] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 05:07:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 05:07:23.389510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:23.479803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c91c61-79b3-4811-803c-1b2d05946017 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:23.481530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-46c91c61-79b3-4811-803c-1b2d05946017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:23.558098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c91c61-79b3-4811-803c-1b2d05946017 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:23.558098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e468-e44c-4136-bf15-bf34953b5c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:23.558098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e468-e44c-4136-bf15-bf34953b5c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:23.558098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e468-e44c-4136-bf15-bf34953b5c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:23.558477 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e468-e44c-4136-bf15-bf34953b5c68 admin admin] PATH_INFO: `/v3/users/e3617ea19cb941548db8c55368ccc941` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:23.559657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4e468-e44c-4136-bf15-bf34953b5c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3617ea19cb941548db8c55368ccc941)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:23.561655 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4e468-e44c-4136-bf15-bf34953b5c68 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:24.076490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5fa4e468-e44c-4136-bf15-bf34953b5c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3617ea19cb941548db8c55368ccc941'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:24.077994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5fa4e468-e44c-4136-bf15-bf34953b5c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3617ea19cb941548db8c55368ccc941'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:24.295566 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5fa4e468-e44c-4136-bf15-bf34953b5c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3617ea19cb941548db8c55368ccc941'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:24.296560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5fa4e468-e44c-4136-bf15-bf34953b5c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3617ea19cb941548db8c55368ccc941'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:24.313815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5fa4e468-e44c-4136-bf15-bf34953b5c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3617ea19cb941548db8c55368ccc941'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:24.338187 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4229/8387] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:07:23 2022] DELETE /identity/v3/users/e3617ea19cb941548db8c55368ccc941 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:24.344019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8af27-6b12-4d01-9a65-654f39661267 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:24.345136 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8af27-6b12-4d01-9a65-654f39661267 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:24.345722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8af27-6b12-4d01-9a65-654f39661267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:24.369645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-14a8af27-6b12-4d01-9a65-654f39661267 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:24.370851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-14a8af27-6b12-4d01-9a65-654f39661267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:24.390073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:24.451428 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4159/8388] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:24.463989 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e468-e44c-4136-bf15-bf34953b5c68 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:24.466337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5fa4e468-e44c-4136-bf15-bf34953b5c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:24.555864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e468-e44c-4136-bf15-bf34953b5c68 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:24.560114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d90ae3-31cd-476a-9edb-70f89b6b3ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:24.560778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d90ae3-31cd-476a-9edb-70f89b6b3ddb service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:24.561058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d90ae3-31cd-476a-9edb-70f89b6b3ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:24.561330 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d90ae3-31cd-476a-9edb-70f89b6b3ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:24.571372 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d90ae3-31cd-476a-9edb-70f89b6b3ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:24.572861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d90ae3-31cd-476a-9edb-70f89b6b3ddb service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:24.592540 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4230/8389] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:24.634109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ace0f-7327-43a8-b306-630be1371c41 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:24.634395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ace0f-7327-43a8-b306-630be1371c41 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:24.634672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ace0f-7327-43a8-b306-630be1371c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:24.659540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7e9ace0f-7327-43a8-b306-630be1371c41 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:24.660852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7e9ace0f-7327-43a8-b306-630be1371c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:24.772358 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4160/8390] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 05:07:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:24.781832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d90ae3-31cd-476a-9edb-70f89b6b3ddb service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:24.789090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e9d90ae3-31cd-476a-9edb-70f89b6b3ddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:24.894453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d90ae3-31cd-476a-9edb-70f89b6b3ddb service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:24.911483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cac05c-fbdc-475f-8e04-f83cf10d85d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:24.912781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cac05c-fbdc-475f-8e04-f83cf10d85d7 service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:24.913278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cac05c-fbdc-475f-8e04-f83cf10d85d7 service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:24.913794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cac05c-fbdc-475f-8e04-f83cf10d85d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:24.924390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cac05c-fbdc-475f-8e04-f83cf10d85d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:24.926441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cac05c-fbdc-475f-8e04-f83cf10d85d7 service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:24.941165 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4231/8391] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 05:07:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 05:07:25.307558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ace0f-7327-43a8-b306-630be1371c41 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:25.307558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7e9ace0f-7327-43a8-b306-630be1371c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:25.326214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ace0f-7327-43a8-b306-630be1371c41 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:25.340782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbf86f-7c6e-4e1c-bf65-e46d5fc96e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:25.341398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbf86f-7c6e-4e1c-bf65-e46d5fc96e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:25.341679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbf86f-7c6e-4e1c-bf65-e46d5fc96e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:25.341956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbf86f-7c6e-4e1c-bf65-e46d5fc96e6b admin admin] PATH_INFO: `/v3/projects/93c34b90d2e44ef59245cd3c1dff8cb8` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:25.343251 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbf86f-7c6e-4e1c-bf65-e46d5fc96e6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c34b90d2e44ef59245cd3c1dff8cb8)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:25.345207 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbf86f-7c6e-4e1c-bf65-e46d5fc96e6b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:25.550193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-96cbf86f-7c6e-4e1c-bf65-e46d5fc96e6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c34b90d2e44ef59245cd3c1dff8cb8', 'request_id': 'req-96cbf86f-7c6e-4e1c-bf65-e46d5fc96e6b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:25.555483 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-96cbf86f-7c6e-4e1c-bf65-e46d5fc96e6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c34b90d2e44ef59245cd3c1dff8cb8', 'request_id': 'req-96cbf86f-7c6e-4e1c-bf65-e46d5fc96e6b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:25.562024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-96cbf86f-7c6e-4e1c-bf65-e46d5fc96e6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c34b90d2e44ef59245cd3c1dff8cb8', 'request_id': 'req-96cbf86f-7c6e-4e1c-bf65-e46d5fc96e6b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:25.738202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-96cbf86f-7c6e-4e1c-bf65-e46d5fc96e6b admin admin] The token cache is being invalidate because project 93c34b90d2e44ef59245cd3c1dff8cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:07:25.738634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-96cbf86f-7c6e-4e1c-bf65-e46d5fc96e6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:25.739322 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-96cbf86f-7c6e-4e1c-bf65-e46d5fc96e6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:25.740926 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4161/8392] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:07:25 2022] DELETE /identity/v3/projects/93c34b90d2e44ef59245cd3c1dff8cb8 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:25.747175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0b4bf-66ce-4645-bc29-6d163315b042 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:25.747823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0b4bf-66ce-4645-bc29-6d163315b042 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:25.747823 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0b4bf-66ce-4645-bc29-6d163315b042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:25.767648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b8e0b4bf-66ce-4645-bc29-6d163315b042 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:25.768891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b8e0b4bf-66ce-4645-bc29-6d163315b042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:25.829967 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4232/8393] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:07:25.839463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d6aa5-eae4-412b-aabc-b395ddb55efd None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:25.839463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d6aa5-eae4-412b-aabc-b395ddb55efd None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:25.839463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d6aa5-eae4-412b-aabc-b395ddb55efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:25.880239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-aa4d6aa5-eae4-412b-aabc-b395ddb55efd None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:25.885923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aa4d6aa5-eae4-412b-aabc-b395ddb55efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:25.890749 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4162/8394] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:25.895162 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0b4bf-66ce-4645-bc29-6d163315b042 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:25.907716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0b4bf-66ce-4645-bc29-6d163315b042 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:25.912511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe670b-cc4d-4d2f-b1dd-c24dc3e26f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:25.913122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe670b-cc4d-4d2f-b1dd-c24dc3e26f17 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:25.913402 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe670b-cc4d-4d2f-b1dd-c24dc3e26f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:25.913674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe670b-cc4d-4d2f-b1dd-c24dc3e26f17 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:25.914356 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe670b-cc4d-4d2f-b1dd-c24dc3e26f17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:07:25.914657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe670b-cc4d-4d2f-b1dd-c24dc3e26f17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:25.916262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe670b-cc4d-4d2f-b1dd-c24dc3e26f17 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:25.929216 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4233/8395] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:07:25.933787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d6aa5-eae4-412b-aabc-b395ddb55efd None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:25.943887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d6aa5-eae4-412b-aabc-b395ddb55efd None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:25.951252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389bbce-372d-446e-9b4f-28269e2c9381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:25.951875 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389bbce-372d-446e-9b4f-28269e2c9381 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:25.952138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389bbce-372d-446e-9b4f-28269e2c9381 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:25.952458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389bbce-372d-446e-9b4f-28269e2c9381 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:25.953098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389bbce-372d-446e-9b4f-28269e2c9381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:25.955040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389bbce-372d-446e-9b4f-28269e2c9381 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:26.093960 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4163/8396] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:07:25 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:07:26.098603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe670b-cc4d-4d2f-b1dd-c24dc3e26f17 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:26.111359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe670b-cc4d-4d2f-b1dd-c24dc3e26f17 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:26.191055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae8b07-e4e8-4f1c-8278-810ac24e1f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:26.191670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae8b07-e4e8-4f1c-8278-810ac24e1f29 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:26.191950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae8b07-e4e8-4f1c-8278-810ac24e1f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:26.192264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae8b07-e4e8-4f1c-8278-810ac24e1f29 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:26.192889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae8b07-e4e8-4f1c-8278-810ac24e1f29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:26.194910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae8b07-e4e8-4f1c-8278-810ac24e1f29 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:26.265693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208b08-fba9-4689-a5e0-5ad81efdf9fa None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:26.265988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208b08-fba9-4689-a5e0-5ad81efdf9fa None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:26.266269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208b08-fba9-4689-a5e0-5ad81efdf9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:26.287890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-70208b08-fba9-4689-a5e0-5ad81efdf9fa None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:26.289160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-70208b08-fba9-4689-a5e0-5ad81efdf9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:26.353599 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4164/8397] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:07:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:07:26.357032 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4234/8398] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:07:26 2022] POST /identity/v3/users => generated 291 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:07:26.361243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70208b08-fba9-4689-a5e0-5ad81efdf9fa None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:26.375329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae8b07-e4e8-4f1c-8278-810ac24e1f29 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:26.377302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-99ae8b07-e4e8-4f1c-8278-810ac24e1f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:26.388391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70208b08-fba9-4689-a5e0-5ad81efdf9fa None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:26.421019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf57ab-4c0f-4567-8556-f0940c2d38fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:26.421594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf57ab-4c0f-4567-8556-f0940c2d38fd admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:26.421874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf57ab-4c0f-4567-8556-f0940c2d38fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:26.422149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf57ab-4c0f-4567-8556-f0940c2d38fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:26.422803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf57ab-4c0f-4567-8556-f0940c2d38fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:26.424430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf57ab-4c0f-4567-8556-f0940c2d38fd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:26.435498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:26.439876 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4165/8399] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:07:26.448369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf57ab-4c0f-4567-8556-f0940c2d38fd admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:26.471648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf57ab-4c0f-4567-8556-f0940c2d38fd admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:26.477009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9c261-39ba-4c1e-af30-eb952241b599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:26.477620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9c261-39ba-4c1e-af30-eb952241b599 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:26.477904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9c261-39ba-4c1e-af30-eb952241b599 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:26.478178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9c261-39ba-4c1e-af30-eb952241b599 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:26.478826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9c261-39ba-4c1e-af30-eb952241b599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:26.480524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9c261-39ba-4c1e-af30-eb952241b599 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:26.491513 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4166/8400] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:07:26.495820 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9c261-39ba-4c1e-af30-eb952241b599 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:26.506374 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9c261-39ba-4c1e-af30-eb952241b599 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:26.511522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93330db5-7aed-4333-990f-d8e96ba93e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:26.512931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93330db5-7aed-4333-990f-d8e96ba93e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:26.513248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93330db5-7aed-4333-990f-d8e96ba93e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:26.513536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93330db5-7aed-4333-990f-d8e96ba93e0f admin admin] PATH_INFO: `/v3/projects/feec46b55e5144e3905252b290e98e83/users/27e682ca07714def9c77f6c74d20d05c/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:26.514324 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae8b07-e4e8-4f1c-8278-810ac24e1f29 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:26.519958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a1038-0d9b-4443-affc-451192e1593d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:26.520625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a1038-0d9b-4443-affc-451192e1593d service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:26.520890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a1038-0d9b-4443-affc-451192e1593d service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:26.521164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a1038-0d9b-4443-affc-451192e1593d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:26.529909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93330db5-7aed-4333-990f-d8e96ba93e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=feec46b55e5144e3905252b290e98e83, user_id=27e682ca07714def9c77f6c74d20d05c, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:26.531046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a1038-0d9b-4443-affc-451192e1593d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:26.532645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a1038-0d9b-4443-affc-451192e1593d service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:26.532764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93330db5-7aed-4333-990f-d8e96ba93e0f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:26.541202 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4235/8401] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 05:07:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 05:07:26.560770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:26.629919 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4167/8402] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:07:26 2022] PUT /identity/v3/projects/feec46b55e5144e3905252b290e98e83/users/27e682ca07714def9c77f6c74d20d05c/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:07:26.634897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c21f23-4eb9-4049-a6ab-e380872e4676 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:26.635187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c21f23-4eb9-4049-a6ab-e380872e4676 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:26.635463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c21f23-4eb9-4049-a6ab-e380872e4676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:26.656715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-50c21f23-4eb9-4049-a6ab-e380872e4676 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:26.657932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-50c21f23-4eb9-4049-a6ab-e380872e4676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:26.722571 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4236/8403] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:26.739258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93330db5-7aed-4333-990f-d8e96ba93e0f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:26.741252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-93330db5-7aed-4333-990f-d8e96ba93e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:26.805862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93330db5-7aed-4333-990f-d8e96ba93e0f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:26.809966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e2e08-6291-41c9-a1bd-d3919abc411f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:26.810623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e2e08-6291-41c9-a1bd-d3919abc411f service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:26.810990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e2e08-6291-41c9-a1bd-d3919abc411f service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:26.811326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e2e08-6291-41c9-a1bd-d3919abc411f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:26.821465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e2e08-6291-41c9-a1bd-d3919abc411f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:26.823011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e2e08-6291-41c9-a1bd-d3919abc411f service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:26.833472 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4168/8404] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:27.417323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70bb5a-534d-48e2-9123-f6df020cb149 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:27.417850 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70bb5a-534d-48e2-9123-f6df020cb149 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:27.418055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70bb5a-534d-48e2-9123-f6df020cb149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:27.453807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5c70bb5a-534d-48e2-9123-f6df020cb149 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:27.455960 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5c70bb5a-534d-48e2-9123-f6df020cb149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:27.590306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e2e08-6291-41c9-a1bd-d3919abc411f service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:27.591883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5d2e2e08-6291-41c9-a1bd-d3919abc411f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:27.606311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e2e08-6291-41c9-a1bd-d3919abc411f service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:27.614302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4bd32-bd94-489c-9652-40f571327948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:27.614302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4bd32-bd94-489c-9652-40f571327948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:27.614302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4bd32-bd94-489c-9652-40f571327948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:27.614302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4bd32-bd94-489c-9652-40f571327948 admin admin] PATH_INFO: `/v3/users/d00f009e8d954268b45a8ef28bbaed7d` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:27.614834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4bd32-bd94-489c-9652-40f571327948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d00f009e8d954268b45a8ef28bbaed7d)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:27.615558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4bd32-bd94-489c-9652-40f571327948 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:27.621090 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4237/8405] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 05:07:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:27.628052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70bb5a-534d-48e2-9123-f6df020cb149 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:27.707975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70bb5a-534d-48e2-9123-f6df020cb149 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:27.714977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb9ac8-7206-43a8-a6f4-d78c6865d19b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:27.715755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb9ac8-7206-43a8-a6f4-d78c6865d19b service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:27.716039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb9ac8-7206-43a8-a6f4-d78c6865d19b service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:27.716342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb9ac8-7206-43a8-a6f4-d78c6865d19b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:27.724883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb9ac8-7206-43a8-a6f4-d78c6865d19b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:27.726453 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb9ac8-7206-43a8-a6f4-d78c6865d19b service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:27.737602 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4238/8406] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 05:07:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 05:07:27.943656 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bab4bd32-bd94-489c-9652-40f571327948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd00f009e8d954268b45a8ef28bbaed7d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:28.052359 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bab4bd32-bd94-489c-9652-40f571327948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd00f009e8d954268b45a8ef28bbaed7d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:28.053231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bab4bd32-bd94-489c-9652-40f571327948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd00f009e8d954268b45a8ef28bbaed7d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:28.062182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bab4bd32-bd94-489c-9652-40f571327948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd00f009e8d954268b45a8ef28bbaed7d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:28.074715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-bab4bd32-bd94-489c-9652-40f571327948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd00f009e8d954268b45a8ef28bbaed7d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:28.081181 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4169/8407] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:07:27 2022] DELETE /identity/v3/users/d00f009e8d954268b45a8ef28bbaed7d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:07:28.085416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f594e81-202d-49f1-9141-a984e89c8b1d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:28.085704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f594e81-202d-49f1-9141-a984e89c8b1d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:28.085982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f594e81-202d-49f1-9141-a984e89c8b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:28.108030 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1f594e81-202d-49f1-9141-a984e89c8b1d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:28.109445 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1f594e81-202d-49f1-9141-a984e89c8b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:28.173923 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4239/8408] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:28.180890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4bd32-bd94-489c-9652-40f571327948 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:28.182492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-bab4bd32-bd94-489c-9652-40f571327948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:28.242633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4bd32-bd94-489c-9652-40f571327948 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:28.246843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd723ec7-e1f7-4680-9b0a-3917d29114ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:28.249179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd723ec7-e1f7-4680-9b0a-3917d29114ea service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:28.249179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd723ec7-e1f7-4680-9b0a-3917d29114ea service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:28.252925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd723ec7-e1f7-4680-9b0a-3917d29114ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:28.264452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd723ec7-e1f7-4680-9b0a-3917d29114ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:28.269909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd723ec7-e1f7-4680-9b0a-3917d29114ea service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:28.282523 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4170/8409] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:07:28.891909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:28.922685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f594e81-202d-49f1-9141-a984e89c8b1d None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:28.925791 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1f594e81-202d-49f1-9141-a984e89c8b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:28.953067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f594e81-202d-49f1-9141-a984e89c8b1d None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:28.960753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d1305-6b0e-49c3-b73e-092d47a9cabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:28.961636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d1305-6b0e-49c3-b73e-092d47a9cabd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:28.962312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d1305-6b0e-49c3-b73e-092d47a9cabd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:28.962730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d1305-6b0e-49c3-b73e-092d47a9cabd admin admin] PATH_INFO: `/v3/projects/55aef4aee3e94f0d8a69707d76a64813` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:28.964120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d1305-6b0e-49c3-b73e-092d47a9cabd admin admin] RBAC: Authorizing `identity:delete_project(project_id=55aef4aee3e94f0d8a69707d76a64813)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:28.967888 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d1305-6b0e-49c3-b73e-092d47a9cabd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:29.141408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:29.165190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-240d1305-6b0e-49c3-b73e-092d47a9cabd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55aef4aee3e94f0d8a69707d76a64813', 'request_id': 'req-240d1305-6b0e-49c3-b73e-092d47a9cabd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:29.181275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-240d1305-6b0e-49c3-b73e-092d47a9cabd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55aef4aee3e94f0d8a69707d76a64813', 'request_id': 'req-240d1305-6b0e-49c3-b73e-092d47a9cabd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:29.286639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-240d1305-6b0e-49c3-b73e-092d47a9cabd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55aef4aee3e94f0d8a69707d76a64813', 'request_id': 'req-240d1305-6b0e-49c3-b73e-092d47a9cabd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:29.315127 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-240d1305-6b0e-49c3-b73e-092d47a9cabd admin admin] The token cache is being invalidate because project 55aef4aee3e94f0d8a69707d76a64813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:07:29.315530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-240d1305-6b0e-49c3-b73e-092d47a9cabd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:29.318686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-240d1305-6b0e-49c3-b73e-092d47a9cabd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:29.321598 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4240/8410] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:07:28 2022] DELETE /identity/v3/projects/55aef4aee3e94f0d8a69707d76a64813 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:29.327165 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd723ec7-e1f7-4680-9b0a-3917d29114ea service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:29.343906 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd723ec7-e1f7-4680-9b0a-3917d29114ea service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:29.430090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d6c8c-b791-4556-87cf-bac7e40c414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:29.431453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d6c8c-b791-4556-87cf-bac7e40c414a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:29.431841 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d6c8c-b791-4556-87cf-bac7e40c414a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:29.432256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d6c8c-b791-4556-87cf-bac7e40c414a admin admin] PATH_INFO: `/v3/users/c477d514b32b4ecba12dcba5b5133857` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:29.434432 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d6c8c-b791-4556-87cf-bac7e40c414a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c477d514b32b4ecba12dcba5b5133857)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:29.437637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d6c8c-b791-4556-87cf-bac7e40c414a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:29.740459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-864d6c8c-b791-4556-87cf-bac7e40c414a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c477d514b32b4ecba12dcba5b5133857'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:29.824043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-864d6c8c-b791-4556-87cf-bac7e40c414a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c477d514b32b4ecba12dcba5b5133857'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:29.826395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-864d6c8c-b791-4556-87cf-bac7e40c414a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c477d514b32b4ecba12dcba5b5133857'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:29.841261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-864d6c8c-b791-4556-87cf-bac7e40c414a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c477d514b32b4ecba12dcba5b5133857'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:29.879732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-864d6c8c-b791-4556-87cf-bac7e40c414a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c477d514b32b4ecba12dcba5b5133857'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:29.890659 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4171/8411] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:07:29 2022] DELETE /identity/v3/users/c477d514b32b4ecba12dcba5b5133857 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:30.433139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:30.656316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d1305-6b0e-49c3-b73e-092d47a9cabd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:30.662905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-240d1305-6b0e-49c3-b73e-092d47a9cabd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:30.681707 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d1305-6b0e-49c3-b73e-092d47a9cabd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:30.691257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:30.788751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:30.788894 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:30.789188 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:30.789469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08 admin admin] PATH_INFO: `/v3/projects/49e4c706bb554050b2969d29ac71f42f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:30.790739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e4c706bb554050b2969d29ac71f42f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:30.792778 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:30.988688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e4c706bb554050b2969d29ac71f42f', 'request_id': 'req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:31.003540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e4c706bb554050b2969d29ac71f42f', 'request_id': 'req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:31.132752 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e4c706bb554050b2969d29ac71f42f', 'request_id': 'req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:31.160029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08 admin admin] The token cache is being invalidate because project 49e4c706bb554050b2969d29ac71f42f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:07:31.162167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:31.163140 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:31.173943 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4241/8412] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:07:30 2022] DELETE /identity/v3/projects/49e4c706bb554050b2969d29ac71f42f => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:31.174932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d6c8c-b791-4556-87cf-bac7e40c414a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:31.176744 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-864d6c8c-b791-4556-87cf-bac7e40c414a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:31.196571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d6c8c-b791-4556-87cf-bac7e40c414a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:31.270297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41341f83-f36d-473c-80d3-8ebe289bfc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:31.271384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41341f83-f36d-473c-80d3-8ebe289bfc21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:31.279874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41341f83-f36d-473c-80d3-8ebe289bfc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:31.279874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41341f83-f36d-473c-80d3-8ebe289bfc21 admin admin] PATH_INFO: `/v3/users/8ded44d71fb3490abd1f391884081795` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:31.279874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41341f83-f36d-473c-80d3-8ebe289bfc21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ded44d71fb3490abd1f391884081795)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:31.279874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41341f83-f36d-473c-80d3-8ebe289bfc21 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:31.512105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-41341f83-f36d-473c-80d3-8ebe289bfc21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ded44d71fb3490abd1f391884081795'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:31.602615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-41341f83-f36d-473c-80d3-8ebe289bfc21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ded44d71fb3490abd1f391884081795'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:31.604376 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-41341f83-f36d-473c-80d3-8ebe289bfc21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ded44d71fb3490abd1f391884081795'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:31.615773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-41341f83-f36d-473c-80d3-8ebe289bfc21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ded44d71fb3490abd1f391884081795'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:31.633873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-41341f83-f36d-473c-80d3-8ebe289bfc21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ded44d71fb3490abd1f391884081795'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:31.639279 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4172/8413] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:07:31 2022] DELETE /identity/v3/users/8ded44d71fb3490abd1f391884081795 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:07:32.338177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:32.339738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:32.365441 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:32.385944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc5553-7756-4b74-a6f2-1d31c66a7c08 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:32.451911 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543f3f2-270b-43bc-9bad-cc4e472dab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:32.452652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543f3f2-270b-43bc-9bad-cc4e472dab5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:32.452933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543f3f2-270b-43bc-9bad-cc4e472dab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:32.453211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543f3f2-270b-43bc-9bad-cc4e472dab5f admin admin] PATH_INFO: `/v3/projects/72e13acfca234fa6a94dd942249bf7ae` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:32.454587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543f3f2-270b-43bc-9bad-cc4e472dab5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e13acfca234fa6a94dd942249bf7ae)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:32.456691 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543f3f2-270b-43bc-9bad-cc4e472dab5f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:32.671621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2543f3f2-270b-43bc-9bad-cc4e472dab5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e13acfca234fa6a94dd942249bf7ae', 'request_id': 'req-2543f3f2-270b-43bc-9bad-cc4e472dab5f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:32.685218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2543f3f2-270b-43bc-9bad-cc4e472dab5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e13acfca234fa6a94dd942249bf7ae', 'request_id': 'req-2543f3f2-270b-43bc-9bad-cc4e472dab5f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:32.783315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2543f3f2-270b-43bc-9bad-cc4e472dab5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e13acfca234fa6a94dd942249bf7ae', 'request_id': 'req-2543f3f2-270b-43bc-9bad-cc4e472dab5f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:32.794983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2543f3f2-270b-43bc-9bad-cc4e472dab5f admin admin] The token cache is being invalidate because project 72e13acfca234fa6a94dd942249bf7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:07:32.795270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2543f3f2-270b-43bc-9bad-cc4e472dab5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:32.795907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2543f3f2-270b-43bc-9bad-cc4e472dab5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:32.797409 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4242/8414] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:07:32 2022] DELETE /identity/v3/projects/72e13acfca234fa6a94dd942249bf7ae => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:32.803637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a23882-ea96-4177-9809-08171798e2f8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:32.804128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a23882-ea96-4177-9809-08171798e2f8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:32.804279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a23882-ea96-4177-9809-08171798e2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:32.836321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-12a23882-ea96-4177-9809-08171798e2f8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:32.837658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-12a23882-ea96-4177-9809-08171798e2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:32.924052 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4173/8415] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:07:32.932386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ee4f2-6a74-4e2e-a5e0-662ea3178cf7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:32.932386 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ee4f2-6a74-4e2e-a5e0-662ea3178cf7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:32.932834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ee4f2-6a74-4e2e-a5e0-662ea3178cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:32.958181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-910ee4f2-6a74-4e2e-a5e0-662ea3178cf7 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:32.959533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-910ee4f2-6a74-4e2e-a5e0-662ea3178cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:32.975772 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4243/8416] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:32.977351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a23882-ea96-4177-9809-08171798e2f8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:33.004197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a23882-ea96-4177-9809-08171798e2f8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:33.021966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577402d-5259-4638-9439-2d2f8701aa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:33.021966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577402d-5259-4638-9439-2d2f8701aa38 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:33.021966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577402d-5259-4638-9439-2d2f8701aa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:33.021966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577402d-5259-4638-9439-2d2f8701aa38 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:33.022593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577402d-5259-4638-9439-2d2f8701aa38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:07:33.022593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577402d-5259-4638-9439-2d2f8701aa38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:33.022593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577402d-5259-4638-9439-2d2f8701aa38 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:33.058524 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4174/8417] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:07:33.064219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ee4f2-6a74-4e2e-a5e0-662ea3178cf7 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:33.076122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ee4f2-6a74-4e2e-a5e0-662ea3178cf7 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:33.082581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577402d-5259-4638-9439-2d2f8701aa38 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:33.084488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1577402d-5259-4638-9439-2d2f8701aa38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:33.098037 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0557211-8fbc-46ee-b483-067b5fb46733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:33.099090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0557211-8fbc-46ee-b483-067b5fb46733 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:33.099446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0557211-8fbc-46ee-b483-067b5fb46733 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:33.099932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0557211-8fbc-46ee-b483-067b5fb46733 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:33.100826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0557211-8fbc-46ee-b483-067b5fb46733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:33.102855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0557211-8fbc-46ee-b483-067b5fb46733 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:33.113289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577402d-5259-4638-9439-2d2f8701aa38 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:33.129278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2eda5-8a9f-479c-8a5b-d79135eee611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:33.130380 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2eda5-8a9f-479c-8a5b-d79135eee611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:33.131076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2eda5-8a9f-479c-8a5b-d79135eee611 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:33.131452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2eda5-8a9f-479c-8a5b-d79135eee611 admin admin] PATH_INFO: `/v3/users/7824e71161864723a41f4f7975ee4491` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:33.140944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2eda5-8a9f-479c-8a5b-d79135eee611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7824e71161864723a41f4f7975ee4491)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:33.144421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2eda5-8a9f-479c-8a5b-d79135eee611 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:33.261977 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4244/8418] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:07:33 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:07:33.267371 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0557211-8fbc-46ee-b483-067b5fb46733 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:33.400029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0557211-8fbc-46ee-b483-067b5fb46733 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:33.410428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d9e72-b04c-49d9-95c0-43f46115a488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:33.411359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d9e72-b04c-49d9-95c0-43f46115a488 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:33.411890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d9e72-b04c-49d9-95c0-43f46115a488 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:33.412430 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d9e72-b04c-49d9-95c0-43f46115a488 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:33.413830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d9e72-b04c-49d9-95c0-43f46115a488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:33.416465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d9e72-b04c-49d9-95c0-43f46115a488 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:33.443193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cbb2eda5-8a9f-479c-8a5b-d79135eee611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7824e71161864723a41f4f7975ee4491'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:33.566942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:33.593085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cbb2eda5-8a9f-479c-8a5b-d79135eee611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7824e71161864723a41f4f7975ee4491'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:33.593929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cbb2eda5-8a9f-479c-8a5b-d79135eee611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7824e71161864723a41f4f7975ee4491'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:33.602156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cbb2eda5-8a9f-479c-8a5b-d79135eee611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7824e71161864723a41f4f7975ee4491'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:33.611160 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4245/8419] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:07:33 2022] POST /identity/v3/users => generated 289 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:07:33.619472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d9e72-b04c-49d9-95c0-43f46115a488 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:33.619663 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cbb2eda5-8a9f-479c-8a5b-d79135eee611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7824e71161864723a41f4f7975ee4491'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:33.623272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-479d9e72-b04c-49d9-95c0-43f46115a488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:33.627066 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4175/8420] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:07:33 2022] DELETE /identity/v3/users/7824e71161864723a41f4f7975ee4491 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:07:33.632861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a1bb5-c844-48f8-a02f-6212056ee879 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:33.633265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a1bb5-c844-48f8-a02f-6212056ee879 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:33.633769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a1bb5-c844-48f8-a02f-6212056ee879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:33.648501 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d9e72-b04c-49d9-95c0-43f46115a488 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:33.704777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e54a1bb5-c844-48f8-a02f-6212056ee879 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:33.716211 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e54a1bb5-c844-48f8-a02f-6212056ee879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:33.806306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d737e03-c3ad-4923-9d61-e7bf8a5d89ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:33.807252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d737e03-c3ad-4923-9d61-e7bf8a5d89ea admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:33.807699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d737e03-c3ad-4923-9d61-e7bf8a5d89ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:33.808134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d737e03-c3ad-4923-9d61-e7bf8a5d89ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:33.810206 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d737e03-c3ad-4923-9d61-e7bf8a5d89ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:33.815289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d737e03-c3ad-4923-9d61-e7bf8a5d89ea admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:33.829079 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4246/8421] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:07:33.833369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d737e03-c3ad-4923-9d61-e7bf8a5d89ea admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:33.849706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d737e03-c3ad-4923-9d61-e7bf8a5d89ea admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:33.856953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd3074-b5e9-4fba-8854-a91aa8d5264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:33.857856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd3074-b5e9-4fba-8854-a91aa8d5264a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:33.858233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd3074-b5e9-4fba-8854-a91aa8d5264a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:33.858611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd3074-b5e9-4fba-8854-a91aa8d5264a admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:33.859476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd3074-b5e9-4fba-8854-a91aa8d5264a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:33.866186 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd3074-b5e9-4fba-8854-a91aa8d5264a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:33.872289 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4176/8422] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:33.882522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a1bb5-c844-48f8-a02f-6212056ee879 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:33.884757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e54a1bb5-c844-48f8-a02f-6212056ee879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:33.913555 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4247/8423] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:07:33.918806 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd3074-b5e9-4fba-8854-a91aa8d5264a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:33.940925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd3074-b5e9-4fba-8854-a91aa8d5264a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:33.950398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7f305-cbd8-40dd-9dcf-fbc9f51074fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:33.951944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7f305-cbd8-40dd-9dcf-fbc9f51074fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:33.952278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7f305-cbd8-40dd-9dcf-fbc9f51074fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:33.952574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7f305-cbd8-40dd-9dcf-fbc9f51074fb admin admin] PATH_INFO: `/v3/projects/5e8518708de246739da77b48c5a45c96/users/c5523794e64946eb8dd3611586ebeecf/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:33.987334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7f305-cbd8-40dd-9dcf-fbc9f51074fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8518708de246739da77b48c5a45c96, user_id=c5523794e64946eb8dd3611586ebeecf, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:33.991202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7f305-cbd8-40dd-9dcf-fbc9f51074fb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:34.061923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a1bb5-c844-48f8-a02f-6212056ee879 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:34.061923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e92e01-b59b-4c43-8b40-a5514bcf9c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:34.061923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e92e01-b59b-4c43-8b40-a5514bcf9c4b service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:34.061923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e92e01-b59b-4c43-8b40-a5514bcf9c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:34.062287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e92e01-b59b-4c43-8b40-a5514bcf9c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:34.084650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e92e01-b59b-4c43-8b40-a5514bcf9c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:34.086422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e92e01-b59b-4c43-8b40-a5514bcf9c4b service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:34.101207 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4248/8424] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:07:33 2022] PUT /identity/v3/projects/5e8518708de246739da77b48c5a45c96/users/c5523794e64946eb8dd3611586ebeecf/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:07:34.106971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3d196-5c6d-4e57-958b-58bfa5d5a208 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:34.107535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3d196-5c6d-4e57-958b-58bfa5d5a208 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:34.108043 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3d196-5c6d-4e57-958b-58bfa5d5a208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:34.108688 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4177/8425] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:34.164311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-13b3d196-5c6d-4e57-958b-58bfa5d5a208 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:34.167333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-13b3d196-5c6d-4e57-958b-58bfa5d5a208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:34.239706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:34.344880 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4249/8426] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:34.378728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e92e01-b59b-4c43-8b40-a5514bcf9c4b service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:34.396212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e92e01-b59b-4c43-8b40-a5514bcf9c4b service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:34.527653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94826fc3-cbfe-4eec-bdce-56848bfaccae None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:34.528379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94826fc3-cbfe-4eec-bdce-56848bfaccae None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:34.528379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94826fc3-cbfe-4eec-bdce-56848bfaccae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:34.546729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99208a8f-44cd-417b-bb90-31d311368f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:34.549155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99208a8f-44cd-417b-bb90-31d311368f7a service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:34.549686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99208a8f-44cd-417b-bb90-31d311368f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:34.550700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99208a8f-44cd-417b-bb90-31d311368f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:34.567435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99208a8f-44cd-417b-bb90-31d311368f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:34.569497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99208a8f-44cd-417b-bb90-31d311368f7a service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:34.589076 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4178/8427] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:34.608723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-94826fc3-cbfe-4eec-bdce-56848bfaccae None None] MFA Rules not processed for user `27e682ca07714def9c77f6c74d20d05c`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:34.609971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-94826fc3-cbfe-4eec-bdce-56848bfaccae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:34.737478 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4250/8428] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:34.738093 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99208a8f-44cd-417b-bb90-31d311368f7a service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:34.739665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-99208a8f-44cd-417b-bb90-31d311368f7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:34.763094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99208a8f-44cd-417b-bb90-31d311368f7a service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:34.785317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7969fce-184c-4d98-bcbb-5f7f1bbeafef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:34.785317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7969fce-184c-4d98-bcbb-5f7f1bbeafef admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:34.785317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7969fce-184c-4d98-bcbb-5f7f1bbeafef admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:34.785317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7969fce-184c-4d98-bcbb-5f7f1bbeafef admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:34.785640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7969fce-184c-4d98-bcbb-5f7f1bbeafef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:34.785640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7969fce-184c-4d98-bcbb-5f7f1bbeafef admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:34.787139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94826fc3-cbfe-4eec-bdce-56848bfaccae None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:34.788991 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-94826fc3-cbfe-4eec-bdce-56848bfaccae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:34.809754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94826fc3-cbfe-4eec-bdce-56848bfaccae None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:34.817517 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0ee62-a590-4c31-aca6-209b0360a09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:34.818599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0ee62-a590-4c31-aca6-209b0360a09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:34.819180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0ee62-a590-4c31-aca6-209b0360a09b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:34.819738 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0ee62-a590-4c31-aca6-209b0360a09b admin admin] PATH_INFO: `/v3/projects/6f638f3ce4da4e149f2cf7f0079f018e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:34.822447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0ee62-a590-4c31-aca6-209b0360a09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f638f3ce4da4e149f2cf7f0079f018e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:34.825364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0ee62-a590-4c31-aca6-209b0360a09b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:34.939933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:34.996212 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4179/8429] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:07:34 2022] POST /identity/v3/projects => generated 381 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:07:35.001891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7969fce-184c-4d98-bcbb-5f7f1bbeafef admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:35.007042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-02a0ee62-a590-4c31-aca6-209b0360a09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f638f3ce4da4e149f2cf7f0079f018e', 'request_id': 'req-02a0ee62-a590-4c31-aca6-209b0360a09b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:35.020144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-02a0ee62-a590-4c31-aca6-209b0360a09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f638f3ce4da4e149f2cf7f0079f018e', 'request_id': 'req-02a0ee62-a590-4c31-aca6-209b0360a09b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:35.091235 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7969fce-184c-4d98-bcbb-5f7f1bbeafef admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:35.097035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cd489-77cd-4479-aa17-50cd1a0a833b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:35.097683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cd489-77cd-4479-aa17-50cd1a0a833b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:35.098044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cd489-77cd-4479-aa17-50cd1a0a833b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:35.098527 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cd489-77cd-4479-aa17-50cd1a0a833b admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:35.099025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1cd489-77cd-4479-aa17-50cd1a0a833b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:35.101277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1cd489-77cd-4479-aa17-50cd1a0a833b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:35.106494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-02a0ee62-a590-4c31-aca6-209b0360a09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f638f3ce4da4e149f2cf7f0079f018e', 'request_id': 'req-02a0ee62-a590-4c31-aca6-209b0360a09b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:35.123423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-02a0ee62-a590-4c31-aca6-209b0360a09b admin admin] The token cache is being invalidate because project 6f638f3ce4da4e149f2cf7f0079f018e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:07:35.123995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-02a0ee62-a590-4c31-aca6-209b0360a09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:35.125132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-02a0ee62-a590-4c31-aca6-209b0360a09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:35.127774 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4251/8430] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:07:34 2022] DELETE /identity/v3/projects/6f638f3ce4da4e149f2cf7f0079f018e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:35.132928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c88123-efc2-4773-b849-0ebff07e2765 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:35.133670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c88123-efc2-4773-b849-0ebff07e2765 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:35.133975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c88123-efc2-4773-b849-0ebff07e2765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:35.160128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-96c88123-efc2-4773-b849-0ebff07e2765 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:35.161576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-96c88123-efc2-4773-b849-0ebff07e2765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:35.180228 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4252/8431] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:07:35.218510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:35.288661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b923adc-25ca-4d16-8575-d8199149c2d6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:35.289046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b923adc-25ca-4d16-8575-d8199149c2d6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:35.289384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b923adc-25ca-4d16-8575-d8199149c2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:35.311192 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4180/8432] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:07:35 2022] POST /identity/v3/users => generated 297 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:07:35.315746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cd489-77cd-4479-aa17-50cd1a0a833b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:35.316472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-3b923adc-25ca-4d16-8575-d8199149c2d6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:35.318545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-4b1cd489-77cd-4479-aa17-50cd1a0a833b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:35.318657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-3b923adc-25ca-4d16-8575-d8199149c2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:35.326544 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4253/8433] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:07:35.330640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b923adc-25ca-4d16-8575-d8199149c2d6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:35.331609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cd489-77cd-4479-aa17-50cd1a0a833b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:35.336561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221ed7e-5025-49f2-9b7d-c081b28a8f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:35.337097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221ed7e-5025-49f2-9b7d-c081b28a8f5b admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:35.337381 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221ed7e-5025-49f2-9b7d-c081b28a8f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:35.337658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221ed7e-5025-49f2-9b7d-c081b28a8f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:35.338307 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221ed7e-5025-49f2-9b7d-c081b28a8f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:35.340026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221ed7e-5025-49f2-9b7d-c081b28a8f5b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:35.340792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b923adc-25ca-4d16-8575-d8199149c2d6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:35.346022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87669b1-6d65-48ec-b0d6-0c93ec13d815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:35.346530 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87669b1-6d65-48ec-b0d6-0c93ec13d815 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:35.346814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87669b1-6d65-48ec-b0d6-0c93ec13d815 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:35.347091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87669b1-6d65-48ec-b0d6-0c93ec13d815 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:35.347742 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87669b1-6d65-48ec-b0d6-0c93ec13d815 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:07:35.348048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87669b1-6d65-48ec-b0d6-0c93ec13d815 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:35.349723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87669b1-6d65-48ec-b0d6-0c93ec13d815 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:35.354764 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4181/8434] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:07:35.365660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221ed7e-5025-49f2-9b7d-c081b28a8f5b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:35.366432 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4254/8435] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 05:07:35.372010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87669b1-6d65-48ec-b0d6-0c93ec13d815 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:35.384493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221ed7e-5025-49f2-9b7d-c081b28a8f5b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:35.384810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87669b1-6d65-48ec-b0d6-0c93ec13d815 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:35.390591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ded019-9112-436b-bf6e-dd8600e00fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:35.391435 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ded019-9112-436b-bf6e-dd8600e00fec admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:35.391721 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ded019-9112-436b-bf6e-dd8600e00fec admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:35.392001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ded019-9112-436b-bf6e-dd8600e00fec admin admin] PATH_INFO: `/v3/projects/e9a0885d790341928df202754a87fce1/users/00a6eb669e6a4572921bbc48182726fe/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:35.393070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b2008-49a9-4071-ae5e-3861bcf61840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:35.393920 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b2008-49a9-4071-ae5e-3861bcf61840 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:35.394374 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b2008-49a9-4071-ae5e-3861bcf61840 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:35.395009 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b2008-49a9-4071-ae5e-3861bcf61840 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:35.396587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b2008-49a9-4071-ae5e-3861bcf61840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:35.398589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b2008-49a9-4071-ae5e-3861bcf61840 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:35.427314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ded019-9112-436b-bf6e-dd8600e00fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a0885d790341928df202754a87fce1, user_id=00a6eb669e6a4572921bbc48182726fe, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:35.431399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ded019-9112-436b-bf6e-dd8600e00fec admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:35.539603 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4182/8436] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:07:35 2022] PUT /identity/v3/projects/e9a0885d790341928df202754a87fce1/users/00a6eb669e6a4572921bbc48182726fe/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:35.540804 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4255/8437] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:07:35 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:07:35.544899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ded019-9112-436b-bf6e-dd8600e00fec admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:35.550693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b2008-49a9-4071-ae5e-3861bcf61840 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:35.630284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ded019-9112-436b-bf6e-dd8600e00fec admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:35.648312 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b2008-49a9-4071-ae5e-3861bcf61840 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:35.654660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fc91e-db6b-453b-bff0-a80a74c750e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:35.655354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fc91e-db6b-453b-bff0-a80a74c750e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:35.655706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fc91e-db6b-453b-bff0-a80a74c750e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:35.656047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fc91e-db6b-453b-bff0-a80a74c750e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:35.656807 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fc91e-db6b-453b-bff0-a80a74c750e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:35.658816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fc91e-db6b-453b-bff0-a80a74c750e7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:35.699008 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db276a28-67b9-4486-b71a-5fafe9732fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:35.699935 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db276a28-67b9-4486-b71a-5fafe9732fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:35.700248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db276a28-67b9-4486-b71a-5fafe9732fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:35.700746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db276a28-67b9-4486-b71a-5fafe9732fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:35.701412 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db276a28-67b9-4486-b71a-5fafe9732fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:35.703026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db276a28-67b9-4486-b71a-5fafe9732fc1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:35.714016 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4183/8438] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:07:35.718742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db276a28-67b9-4486-b71a-5fafe9732fc1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:35.731434 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db276a28-67b9-4486-b71a-5fafe9732fc1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:35.736604 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e85943-af94-49e8-aba6-a97f1b52f92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:35.737213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e85943-af94-49e8-aba6-a97f1b52f92f admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:35.740615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e85943-af94-49e8-aba6-a97f1b52f92f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:35.740615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e85943-af94-49e8-aba6-a97f1b52f92f admin admin] PATH_INFO: `/v3/projects/e9a0885d790341928df202754a87fce1/users/00a6eb669e6a4572921bbc48182726fe/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:35.742462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e85943-af94-49e8-aba6-a97f1b52f92f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a0885d790341928df202754a87fce1, user_id=00a6eb669e6a4572921bbc48182726fe, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:35.745357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e85943-af94-49e8-aba6-a97f1b52f92f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:35.756945 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4184/8439] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:07:35 2022] PUT /identity/v3/projects/e9a0885d790341928df202754a87fce1/users/00a6eb669e6a4572921bbc48182726fe/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:07:35.772656 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4256/8440] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:07:35 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:07:35.779832 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e85943-af94-49e8-aba6-a97f1b52f92f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:35.875118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e85943-af94-49e8-aba6-a97f1b52f92f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:35.880216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222baae0-8d2c-4e91-9903-19678d44ba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:35.880767 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222baae0-8d2c-4e91-9903-19678d44ba06 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:35.881044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222baae0-8d2c-4e91-9903-19678d44ba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:35.881314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222baae0-8d2c-4e91-9903-19678d44ba06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:35.882213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222baae0-8d2c-4e91-9903-19678d44ba06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:35.883829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222baae0-8d2c-4e91-9903-19678d44ba06 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:35.899238 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4185/8441] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:07:35.904390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fc91e-db6b-453b-bff0-a80a74c750e7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:35.914921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fc91e-db6b-453b-bff0-a80a74c750e7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:35.924266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17189947-8374-484c-95b4-e16363607bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:35.924266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17189947-8374-484c-95b4-e16363607bac admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:35.924266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17189947-8374-484c-95b4-e16363607bac admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:35.924266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17189947-8374-484c-95b4-e16363607bac admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:35.926010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17189947-8374-484c-95b4-e16363607bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:35.926394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17189947-8374-484c-95b4-e16363607bac admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:35.969022 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4257/8442] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:07:35.969939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222baae0-8d2c-4e91-9903-19678d44ba06 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:35.984505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222baae0-8d2c-4e91-9903-19678d44ba06 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:35.998572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff99c8b-97f7-46d1-b491-2ec57ae6bf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:35.999572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff99c8b-97f7-46d1-b491-2ec57ae6bf8d admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:35.999898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff99c8b-97f7-46d1-b491-2ec57ae6bf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:36.000245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff99c8b-97f7-46d1-b491-2ec57ae6bf8d admin admin] PATH_INFO: `/v3/projects/5d45f1d07ee14af4852e17e7f1925287/users/dd11d3c4230f45719a7d70c7cffb3c36/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:36.022781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff99c8b-97f7-46d1-b491-2ec57ae6bf8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d45f1d07ee14af4852e17e7f1925287, user_id=dd11d3c4230f45719a7d70c7cffb3c36, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:36.026026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff99c8b-97f7-46d1-b491-2ec57ae6bf8d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:36.173148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:36.190548 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4186/8443] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:07:35 2022] PUT /identity/v3/projects/5d45f1d07ee14af4852e17e7f1925287/users/dd11d3c4230f45719a7d70c7cffb3c36/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:36.195318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8320ee-b859-44f8-bf7e-f7ad440bc36e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:36.195596 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8320ee-b859-44f8-bf7e-f7ad440bc36e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:36.195876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8320ee-b859-44f8-bf7e-f7ad440bc36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:36.223021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ec8320ee-b859-44f8-bf7e-f7ad440bc36e None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:36.224599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ec8320ee-b859-44f8-bf7e-f7ad440bc36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:36.309940 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4258/8444] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:36.316856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff99c8b-97f7-46d1-b491-2ec57ae6bf8d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:36.318997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aff99c8b-97f7-46d1-b491-2ec57ae6bf8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:36.387066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff99c8b-97f7-46d1-b491-2ec57ae6bf8d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:36.390997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd543a4b-db68-4cf7-a78b-197b2997bdbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:36.391788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd543a4b-db68-4cf7-a78b-197b2997bdbb service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:36.392071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd543a4b-db68-4cf7-a78b-197b2997bdbb service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:36.392371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd543a4b-db68-4cf7-a78b-197b2997bdbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:36.403491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd543a4b-db68-4cf7-a78b-197b2997bdbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:36.405865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd543a4b-db68-4cf7-a78b-197b2997bdbb service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:36.419813 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4187/8445] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:37.057158 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8320ee-b859-44f8-bf7e-f7ad440bc36e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:37.059759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ec8320ee-b859-44f8-bf7e-f7ad440bc36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:37.080500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8320ee-b859-44f8-bf7e-f7ad440bc36e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:37.096955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223b03d-29f1-4389-91e6-926f2f25d442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:37.098705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223b03d-29f1-4389-91e6-926f2f25d442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:37.098994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223b03d-29f1-4389-91e6-926f2f25d442 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:37.099457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223b03d-29f1-4389-91e6-926f2f25d442 admin admin] PATH_INFO: `/v3/users/1e01b9a6c550430cae1154d473c18dc5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:37.102208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223b03d-29f1-4389-91e6-926f2f25d442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e01b9a6c550430cae1154d473c18dc5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:37.107265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223b03d-29f1-4389-91e6-926f2f25d442 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:37.499273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a223b03d-29f1-4389-91e6-926f2f25d442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e01b9a6c550430cae1154d473c18dc5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:37.500351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a223b03d-29f1-4389-91e6-926f2f25d442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e01b9a6c550430cae1154d473c18dc5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:37.624107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a223b03d-29f1-4389-91e6-926f2f25d442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e01b9a6c550430cae1154d473c18dc5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:37.625181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a223b03d-29f1-4389-91e6-926f2f25d442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e01b9a6c550430cae1154d473c18dc5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:37.645541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-a223b03d-29f1-4389-91e6-926f2f25d442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e01b9a6c550430cae1154d473c18dc5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:37.660678 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4259/8446] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:07:37 2022] DELETE /identity/v3/users/1e01b9a6c550430cae1154d473c18dc5 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:37.665986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613345d1-21eb-4d54-9679-38b4118923e0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:37.668711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613345d1-21eb-4d54-9679-38b4118923e0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:37.669154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613345d1-21eb-4d54-9679-38b4118923e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:37.692677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-613345d1-21eb-4d54-9679-38b4118923e0 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:37.694217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-613345d1-21eb-4d54-9679-38b4118923e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:37.794472 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4188/8447] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:37.804792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223b03d-29f1-4389-91e6-926f2f25d442 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:37.806376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a223b03d-29f1-4389-91e6-926f2f25d442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:37.880771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223b03d-29f1-4389-91e6-926f2f25d442 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:37.891006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2c983-7970-4b36-b193-30e2d5aa790b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:37.891645 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2c983-7970-4b36-b193-30e2d5aa790b service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:37.891932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2c983-7970-4b36-b193-30e2d5aa790b service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:37.892236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2c983-7970-4b36-b193-30e2d5aa790b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:37.912818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2c983-7970-4b36-b193-30e2d5aa790b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:37.914919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2c983-7970-4b36-b193-30e2d5aa790b service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:37.956474 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4260/8448] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:38.253138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:38.813354 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613345d1-21eb-4d54-9679-38b4118923e0 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:38.814848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-613345d1-21eb-4d54-9679-38b4118923e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:38.832258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613345d1-21eb-4d54-9679-38b4118923e0 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:38.837890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e69c6-489a-4cd1-a8f5-61e8e888cbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:38.838370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e69c6-489a-4cd1-a8f5-61e8e888cbcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:38.838833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e69c6-489a-4cd1-a8f5-61e8e888cbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:38.839616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e69c6-489a-4cd1-a8f5-61e8e888cbcc admin admin] PATH_INFO: `/v3/projects/e13d2a90d4f2451fb21880995ce2bc59` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:38.841143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e69c6-489a-4cd1-a8f5-61e8e888cbcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e13d2a90d4f2451fb21880995ce2bc59)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:38.843496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e69c6-489a-4cd1-a8f5-61e8e888cbcc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:38.846317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaef427-fabb-4a0c-b06d-87ffceeb8cd2 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:38.846802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaef427-fabb-4a0c-b06d-87ffceeb8cd2 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:38.846919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaef427-fabb-4a0c-b06d-87ffceeb8cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:38.908200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-aeaef427-fabb-4a0c-b06d-87ffceeb8cd2 None None] MFA Rules not processed for user `dd11d3c4230f45719a7d70c7cffb3c36`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:38.910542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-aeaef427-fabb-4a0c-b06d-87ffceeb8cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:39.042048 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4261/8449] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:07:39.055448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaef427-fabb-4a0c-b06d-87ffceeb8cd2 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:39.057761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-aeaef427-fabb-4a0c-b06d-87ffceeb8cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:39.103631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6c0e69c6-489a-4cd1-a8f5-61e8e888cbcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e13d2a90d4f2451fb21880995ce2bc59', 'request_id': 'req-6c0e69c6-489a-4cd1-a8f5-61e8e888cbcc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:39.115865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6c0e69c6-489a-4cd1-a8f5-61e8e888cbcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e13d2a90d4f2451fb21880995ce2bc59', 'request_id': 'req-6c0e69c6-489a-4cd1-a8f5-61e8e888cbcc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:39.125257 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6c0e69c6-489a-4cd1-a8f5-61e8e888cbcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e13d2a90d4f2451fb21880995ce2bc59', 'request_id': 'req-6c0e69c6-489a-4cd1-a8f5-61e8e888cbcc'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:39.166217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaef427-fabb-4a0c-b06d-87ffceeb8cd2 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:39.232917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fa150-5705-44ce-92bd-0bbf4aa17cc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:39.233709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fa150-5705-44ce-92bd-0bbf4aa17cc0 service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:39.234848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fa150-5705-44ce-92bd-0bbf4aa17cc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:39.235408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fa150-5705-44ce-92bd-0bbf4aa17cc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:39.257262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6c0e69c6-489a-4cd1-a8f5-61e8e888cbcc admin admin] The token cache is being invalidate because project e13d2a90d4f2451fb21880995ce2bc59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:07:39.257921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6c0e69c6-489a-4cd1-a8f5-61e8e888cbcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:39.259003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-6c0e69c6-489a-4cd1-a8f5-61e8e888cbcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:07:39.264415 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4189/8450] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:07:38 2022] DELETE /identity/v3/projects/e13d2a90d4f2451fb21880995ce2bc59 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:39.454159 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fa150-5705-44ce-92bd-0bbf4aa17cc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:39.457179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fa150-5705-44ce-92bd-0bbf4aa17cc0 service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:39.473626 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4262/8451] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:07:39.847601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:41.430139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:43.483625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:44.318882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:44.620005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d35426-fd5a-4040-9bcc-2451884eedf9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:44.620667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d35426-fd5a-4040-9bcc-2451884eedf9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:44.621164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d35426-fd5a-4040-9bcc-2451884eedf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:44.664585 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-a0d35426-fd5a-4040-9bcc-2451884eedf9 None None] MFA Rules not processed for user `c5523794e64946eb8dd3611586ebeecf`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:44.666082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a0d35426-fd5a-4040-9bcc-2451884eedf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:44.762707 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4190/8452] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:44.777136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fa150-5705-44ce-92bd-0bbf4aa17cc0 service cinder] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:44.777136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c07fa150-5705-44ce-92bd-0bbf4aa17cc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:44.890956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fa150-5705-44ce-92bd-0bbf4aa17cc0 service cinder] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:44.901117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e19ad-6b4a-48ad-bf1f-75cb89c556cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:44.902828 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e19ad-6b4a-48ad-bf1f-75cb89c556cf admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:44.903285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e19ad-6b4a-48ad-bf1f-75cb89c556cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:44.903924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e19ad-6b4a-48ad-bf1f-75cb89c556cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:44.905832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e19ad-6b4a-48ad-bf1f-75cb89c556cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:44.911670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e19ad-6b4a-48ad-bf1f-75cb89c556cf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:44.922602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:45.019941 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4263/8453] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:07:44 2022] POST /identity/v3/projects => generated 377 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:07:45.025407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d35426-fd5a-4040-9bcc-2451884eedf9 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:45.028069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a0d35426-fd5a-4040-9bcc-2451884eedf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:45.060685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c1ccf-36ec-41e6-b307-00a41d2cf5fc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:45.061231 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c1ccf-36ec-41e6-b307-00a41d2cf5fc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:45.063326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c1ccf-36ec-41e6-b307-00a41d2cf5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:45.067618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d35426-fd5a-4040-9bcc-2451884eedf9 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:45.110795 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5d0c1ccf-36ec-41e6-b307-00a41d2cf5fc None None] MFA Rules not processed for user `00a6eb669e6a4572921bbc48182726fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:45.113108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5d0c1ccf-36ec-41e6-b307-00a41d2cf5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:45.140701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a2412-f42d-44da-9b1e-e4b107a22bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:45.141321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a2412-f42d-44da-9b1e-e4b107a22bcc admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:45.141659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a2412-f42d-44da-9b1e-e4b107a22bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:45.141937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a2412-f42d-44da-9b1e-e4b107a22bcc admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:45.142582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a2412-f42d-44da-9b1e-e4b107a22bcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:45.145328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a2412-f42d-44da-9b1e-e4b107a22bcc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:45.227884 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4264/8454] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:45.236156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c1ccf-36ec-41e6-b307-00a41d2cf5fc None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:45.238470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5d0c1ccf-36ec-41e6-b307-00a41d2cf5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:45.265137 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4191/8455] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:07:45 2022] POST /identity/v3/users => generated 295 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:07:45.266668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a2412-f42d-44da-9b1e-e4b107a22bcc admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:45.280407 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a2412-f42d-44da-9b1e-e4b107a22bcc admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:45.286586 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741e96f-451d-4f36-b600-a86440b70d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:45.287278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741e96f-451d-4f36-b600-a86440b70d53 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:45.287628 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741e96f-451d-4f36-b600-a86440b70d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:45.287989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741e96f-451d-4f36-b600-a86440b70d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:45.288737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741e96f-451d-4f36-b600-a86440b70d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:45.290646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741e96f-451d-4f36-b600-a86440b70d53 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:45.303421 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4192/8456] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:07:45.307843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741e96f-451d-4f36-b600-a86440b70d53 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:45.330355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741e96f-451d-4f36-b600-a86440b70d53 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:45.344651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467077ab-8dad-47f4-8f1a-ef590e8204ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:45.345737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467077ab-8dad-47f4-8f1a-ef590e8204ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:45.346273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467077ab-8dad-47f4-8f1a-ef590e8204ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:45.346556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467077ab-8dad-47f4-8f1a-ef590e8204ed admin admin] PATH_INFO: `/v3/projects/d028e08a22da4470bd00b69a08d89141/users/8f09359f6c77497684c9634af68f39ad/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:45.355545 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c1ccf-36ec-41e6-b307-00a41d2cf5fc None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:45.359640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4262a-87a5-470c-8f50-7b1ac39585dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:45.360515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4262a-87a5-470c-8f50-7b1ac39585dc service glance] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:45.360811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4262a-87a5-470c-8f50-7b1ac39585dc service glance] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:45.361083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4262a-87a5-470c-8f50-7b1ac39585dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:45.363792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-52c4262a-87a5-470c-8f50-7b1ac39585dc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:45.371659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467077ab-8dad-47f4-8f1a-ef590e8204ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d028e08a22da4470bd00b69a08d89141, user_id=8f09359f6c77497684c9634af68f39ad, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:45.374167 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467077ab-8dad-47f4-8f1a-ef590e8204ed admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:45.434444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4262a-87a5-470c-8f50-7b1ac39585dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:45.434444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4262a-87a5-470c-8f50-7b1ac39585dc service glance] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:45.448126 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4265/8457] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:07:45.486459 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4193/8458] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:07:45 2022] PUT /identity/v3/projects/d028e08a22da4470bd00b69a08d89141/users/8f09359f6c77497684c9634af68f39ad/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:45.492649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4262a-87a5-470c-8f50-7b1ac39585dc service glance] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:45.538865 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4262a-87a5-470c-8f50-7b1ac39585dc service glance] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:45.693854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aea146-872e-463d-b238-ee6337fe1fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:45.722788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aea146-872e-463d-b238-ee6337fe1fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:45.726528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aea146-872e-463d-b238-ee6337fe1fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:45.726917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aea146-872e-463d-b238-ee6337fe1fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:45.729171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aea146-872e-463d-b238-ee6337fe1fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:45.731583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aea146-872e-463d-b238-ee6337fe1fc1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:45.769733 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4266/8459] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:07:45.775821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467077ab-8dad-47f4-8f1a-ef590e8204ed admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:45.792492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467077ab-8dad-47f4-8f1a-ef590e8204ed admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:45.806463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1fcc2-692e-4604-bd1f-b83f7d725220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:45.807589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1fcc2-692e-4604-bd1f-b83f7d725220 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:45.808268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1fcc2-692e-4604-bd1f-b83f7d725220 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:45.808996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1fcc2-692e-4604-bd1f-b83f7d725220 admin admin] PATH_INFO: `/v3/projects/d028e08a22da4470bd00b69a08d89141/users/8f09359f6c77497684c9634af68f39ad/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:45.816150 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1fcc2-692e-4604-bd1f-b83f7d725220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d028e08a22da4470bd00b69a08d89141, user_id=8f09359f6c77497684c9634af68f39ad, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:45.823990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1fcc2-692e-4604-bd1f-b83f7d725220 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:45.856624 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4194/8460] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:07:45 2022] PUT /identity/v3/projects/d028e08a22da4470bd00b69a08d89141/users/8f09359f6c77497684c9634af68f39ad/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:07:46.207271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:47.028248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:49.560022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:50.052750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:50.361111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:51.592958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:52.910302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:53.509786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aea146-872e-463d-b238-ee6337fe1fc1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:53.513502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-13aea146-872e-463d-b238-ee6337fe1fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:53.654514 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aea146-872e-463d-b238-ee6337fe1fc1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:53.691088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:53.794012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd14ab-fd29-4703-a394-73cad5fc0830 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:53.794651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd14ab-fd29-4703-a394-73cad5fc0830 service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:53.794950 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd14ab-fd29-4703-a394-73cad5fc0830 service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:53.795232 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd14ab-fd29-4703-a394-73cad5fc0830 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:53.797175 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8fdd14ab-fd29-4703-a394-73cad5fc0830 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:53.818908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd14ab-fd29-4703-a394-73cad5fc0830 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:53.820831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd14ab-fd29-4703-a394-73cad5fc0830 service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:53.852832 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4267/8461] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:54.954078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ebee3-5432-4778-86e4-5305068cee99 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:54.954599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ebee3-5432-4778-86e4-5305068cee99 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:54.954708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ebee3-5432-4778-86e4-5305068cee99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:54.968439 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:55.000547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f78ebee3-5432-4778-86e4-5305068cee99 None None] MFA Rules not processed for user `8f09359f6c77497684c9634af68f39ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:55.002584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f78ebee3-5432-4778-86e4-5305068cee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:55.098552 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4195/8462] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:55.110255 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd14ab-fd29-4703-a394-73cad5fc0830 service placement] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:55.111773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8fdd14ab-fd29-4703-a394-73cad5fc0830 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:55.184072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd14ab-fd29-4703-a394-73cad5fc0830 service placement] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:55.191112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efe52c-baf9-4822-ad4f-0d35b2aea17a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:55.191740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efe52c-baf9-4822-ad4f-0d35b2aea17a service cinder] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:55.192018 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efe52c-baf9-4822-ad4f-0d35b2aea17a service cinder] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:55.192323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efe52c-baf9-4822-ad4f-0d35b2aea17a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:55.206370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efe52c-baf9-4822-ad4f-0d35b2aea17a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:55.207851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efe52c-baf9-4822-ad4f-0d35b2aea17a service cinder] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:55.219917 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4268/8463] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:55.517654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ebee3-5432-4778-86e4-5305068cee99 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:07:55.532065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ebee3-5432-4778-86e4-5305068cee99 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:07:55.535914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad940c56-769b-414d-8ff4-5ab6b2d735ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:07:55.536552 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad940c56-769b-414d-8ff4-5ab6b2d735ee service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:55.536833 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad940c56-769b-414d-8ff4-5ab6b2d735ee service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:55.537105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad940c56-769b-414d-8ff4-5ab6b2d735ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:55.601069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad940c56-769b-414d-8ff4-5ab6b2d735ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:07:55.602520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad940c56-769b-414d-8ff4-5ab6b2d735ee service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:07:55.613268 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4196/8464] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:07:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:07:57.234557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:58.824260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:07:59.131290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb450e-9dec-40aa-a0fa-134f68b221f8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:59.131856 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb450e-9dec-40aa-a0fa-134f68b221f8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:59.131955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb450e-9dec-40aa-a0fa-134f68b221f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:59.153801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4efb450e-9dec-40aa-a0fa-134f68b221f8 None None] MFA Rules not processed for user `c5523794e64946eb8dd3611586ebeecf`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:07:59.155290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4efb450e-9dec-40aa-a0fa-134f68b221f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:07:59.163085 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4269/8465] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:07:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:07:59.487967 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d36b8-2df8-45a0-8106-72eaa3dd7c80 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:07:59.488348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d36b8-2df8-45a0-8106-72eaa3dd7c80 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:07:59.488666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d36b8-2df8-45a0-8106-72eaa3dd7c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:07:59.502334 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-cf6d36b8-2df8-45a0-8106-72eaa3dd7c80 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:07:59.502334 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:07:59.502334 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:07:59.502334 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:07:59.502334 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:07:59.502334 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:07:59.502334 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:07:59.502334 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:07:59.502334 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:07:59.502334 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:07:59.502334 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:07:59.502334 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:07:59.502334 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:07:59.503317 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:07:59.503317 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:07:59.503317 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:07:59.503317 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:07:59.503317 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:07:59.503317 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:07:59.503317 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:07:59.503317 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:07:59.503317 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:07:59.503317 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:07:59.503317 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:07:59.503317 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:07:59.503317 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:07:59.503317 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:07:59.503317 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:07:59.504304 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4197/8466] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:07:59 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 17 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:08:01.291862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:02.396457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:06.513640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:07.905839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:08.819109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80a52b-8dcd-43d6-bbe0-5820b1cd10ce None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:08:08.820283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80a52b-8dcd-43d6-bbe0-5820b1cd10ce None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:08:08.820802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80a52b-8dcd-43d6-bbe0-5820b1cd10ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:08:08.840633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6d80a52b-8dcd-43d6-bbe0-5820b1cd10ce None None] MFA Rules not processed for user `c5523794e64946eb8dd3611586ebeecf`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:08:08.841833 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6d80a52b-8dcd-43d6-bbe0-5820b1cd10ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:08:08.848660 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4270/8467] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:08:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:08:09.121839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bc9b3-cb6b-4bf0-83e8-f2763958e5a1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:08:09.122324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bc9b3-cb6b-4bf0-83e8-f2763958e5a1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:08:09.122415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bc9b3-cb6b-4bf0-83e8-f2763958e5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:08:09.133185 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-370bc9b3-cb6b-4bf0-83e8-f2763958e5a1 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:08:09.133185 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:08:09.133185 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:08:09.133185 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:08:09.133185 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:08:09.133185 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:08:09.133185 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:08:09.133185 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:08:09.133185 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:08:09.133185 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:08:09.133185 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:08:09.133185 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:08:09.133185 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:08:09.134218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:08:09.134218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:08:09.134218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:08:09.134218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:08:09.134218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:08:09.134218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:08:09.134218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:08:09.134218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:08:09.134218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:08:09.134218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:08:09.134218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:08:09.134218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:08:09.134218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:08:09.134218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:08:09.134218 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:08:09.137885 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4198/8468] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:08:09 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 17 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:08:09.642481 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:10.388232 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:11.455010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:12.314248 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:12.587301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:12.805608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:13.429178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:15.358106 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:15.869516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:16.818033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:18.078154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:18.733440 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80a52b-8dcd-43d6-bbe0-5820b1cd10ce None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:08:18.734956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6d80a52b-8dcd-43d6-bbe0-5820b1cd10ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:08:18.829254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80a52b-8dcd-43d6-bbe0-5820b1cd10ce None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:08:18.834693 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6bec8-ce41-4dee-8409-919f424d9b4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:08:18.835346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6bec8-ce41-4dee-8409-919f424d9b4b service swift] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:08:18.835629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6bec8-ce41-4dee-8409-919f424d9b4b service swift] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:08:18.835903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6bec8-ce41-4dee-8409-919f424d9b4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:08:18.838459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7fa6bec8-ce41-4dee-8409-919f424d9b4b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:08:18.888072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:18.902053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6bec8-ce41-4dee-8409-919f424d9b4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:08:18.907290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6bec8-ce41-4dee-8409-919f424d9b4b service swift] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:08:18.912558 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4271/8469] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 05:08:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 663 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 05:08:19.165465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:20.714882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:21.757931 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:22.235299 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:23.279857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:29.248576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=7 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:33.214342 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bc9b3-cb6b-4bf0-83e8-f2763958e5a1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:08:33.232340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bc9b3-cb6b-4bf0-83e8-f2763958e5a1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:08:33.238433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e40df-8d2b-42c8-a7d0-74c40934851f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:08:33.239052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e40df-8d2b-42c8-a7d0-74c40934851f service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:08:33.239334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e40df-8d2b-42c8-a7d0-74c40934851f service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:08:33.239607 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e40df-8d2b-42c8-a7d0-74c40934851f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:08:33.333632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e40df-8d2b-42c8-a7d0-74c40934851f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:08:33.335176 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e40df-8d2b-42c8-a7d0-74c40934851f service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:08:33.344041 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4199/8470] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 05:08:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 05:08:43.340885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=84 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:08:44.668774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2367057-c6fd-4cf9-8326-017168efe9b9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:08:44.669348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2367057-c6fd-4cf9-8326-017168efe9b9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:08:44.669348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2367057-c6fd-4cf9-8326-017168efe9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:08:44.689049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a2367057-c6fd-4cf9-8326-017168efe9b9 None None] MFA Rules not processed for user `c5523794e64946eb8dd3611586ebeecf`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:08:44.690254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a2367057-c6fd-4cf9-8326-017168efe9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:08:44.697703 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4272/8471] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:08:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:08:45.030424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b771d-a6ea-4dfa-a8f4-c731e9d7b8ef None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:08:45.030932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b771d-a6ea-4dfa-a8f4-c731e9d7b8ef None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:08:45.031040 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b771d-a6ea-4dfa-a8f4-c731e9d7b8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:08:45.037571 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-712b771d-a6ea-4dfa-a8f4-c731e9d7b8ef None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:08:45.037571 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:08:45.037571 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:08:45.037571 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:08:45.037571 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:08:45.037571 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:08:45.037571 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:08:45.037571 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:08:45.037571 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:08:45.037571 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:08:45.037571 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:08:45.037571 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:08:45.037571 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:08:45.038475 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:08:45.038475 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:08:45.038475 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:08:45.038475 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:08:45.038475 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:08:45.038475 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:08:45.038475 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:08:45.038475 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:08:45.038475 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:08:45.038475 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:08:45.038475 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:08:45.038475 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:08:45.038475 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:08:45.038475 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:08:45.038475 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:08:45.039430 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4200/8472] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:08:45 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:08:54.683701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:18.642790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f15f8-7931-48c6-b65c-a144d400a8a0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:09:18.643465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f15f8-7931-48c6-b65c-a144d400a8a0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:09:18.643465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f15f8-7931-48c6-b65c-a144d400a8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:09:18.663616 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-813f15f8-7931-48c6-b65c-a144d400a8a0 None None] MFA Rules not processed for user `c5523794e64946eb8dd3611586ebeecf`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:09:18.665107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-813f15f8-7931-48c6-b65c-a144d400a8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:09:18.673650 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4273/8473] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:09:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:09:18.986184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ccd06-b8d6-4dcf-87a9-e0d6335bfc49 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:09:18.986704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ccd06-b8d6-4dcf-87a9-e0d6335bfc49 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:09:18.986704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ccd06-b8d6-4dcf-87a9-e0d6335bfc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:09:18.994493 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-686ccd06-b8d6-4dcf-87a9-e0d6335bfc49 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:09:18.994493 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:09:18.994493 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:09:18.994493 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:09:18.994493 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:09:18.994493 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:09:18.994493 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:09:18.994493 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:09:18.994493 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:09:18.994493 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:09:18.994493 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:09:18.994493 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:09:18.994493 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:09:18.995584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:09:18.995584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:09:18.995584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:09:18.995584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:09:18.995584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:09:18.995584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:09:18.995584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:09:18.995584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:09:18.995584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:09:18.995584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:09:18.995584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:09:18.995584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:09:18.995584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:09:18.995584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:09:18.995584 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:09:18.996749 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4201/8474] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:09:18 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 27 05:09:28.657988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:33.542058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339a84-e451-4ab2-9b40-0bb0acdac895 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:09:33.542660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339a84-e451-4ab2-9b40-0bb0acdac895 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:09:33.542660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339a84-e451-4ab2-9b40-0bb0acdac895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:09:33.565422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-85339a84-e451-4ab2-9b40-0bb0acdac895 None None] MFA Rules not processed for user `dd11d3c4230f45719a7d70c7cffb3c36`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:09:33.566910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-85339a84-e451-4ab2-9b40-0bb0acdac895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:09:33.574933 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4274/8475] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:09:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:09:33.844994 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f39c87-723f-4946-9e9e-94f3d25450df None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:09:33.845570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f39c87-723f-4946-9e9e-94f3d25450df None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:09:33.845693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f39c87-723f-4946-9e9e-94f3d25450df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:09:33.853173 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-e7f39c87-723f-4946-9e9e-94f3d25450df None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:09:33.853173 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:09:33.853173 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:09:33.853173 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:09:33.853173 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:09:33.853173 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:09:33.853173 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:09:33.853173 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:09:33.853173 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:09:33.853173 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:09:33.853173 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:09:33.853173 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:09:33.853173 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:09:33.854135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:09:33.854135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:09:33.854135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:09:33.854135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:09:33.854135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:09:33.854135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:09:33.854135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:09:33.854135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:09:33.854135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:09:33.854135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:09:33.854135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:09:33.854135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:09:33.854135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:09:33.854135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:09:33.854135 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:09:33.856613 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4202/8476] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:09:33 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 13 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:09:43.499877 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0c28e-a882-49dc-80c6-fc696fa0285d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:09:43.500476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0c28e-a882-49dc-80c6-fc696fa0285d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:09:43.500476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0c28e-a882-49dc-80c6-fc696fa0285d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:09:43.528472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-eae0c28e-a882-49dc-80c6-fc696fa0285d None None] MFA Rules not processed for user `dd11d3c4230f45719a7d70c7cffb3c36`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:09:43.530249 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-eae0c28e-a882-49dc-80c6-fc696fa0285d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:09:43.539788 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4275/8477] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:09:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:09:43.795926 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba698f1a-510c-43f4-9979-6e9f6426084b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:09:43.796484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba698f1a-510c-43f4-9979-6e9f6426084b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:09:43.796715 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba698f1a-510c-43f4-9979-6e9f6426084b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:09:43.803708 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-ba698f1a-510c-43f4-9979-6e9f6426084b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:09:43.803708 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:09:43.803708 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:09:43.803708 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:09:43.803708 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:09:43.803708 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:09:43.803708 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:09:43.803708 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:09:43.803708 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:09:43.803708 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:09:43.803708 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:09:43.803708 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:09:43.803708 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:09:43.804821 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:09:43.804821 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:09:43.804821 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:09:43.804821 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:09:43.804821 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:09:43.804821 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:09:43.804821 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:09:43.804821 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:09:43.804821 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:09:43.804821 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:09:43.804821 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:09:43.804821 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:09:43.804821 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:09:43.804821 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:09:43.804821 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:09:43.805980 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4203/8478] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:09:43 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:09:53.519474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:09:54.434747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499cdaf-d02e-4bfd-8c75-d745fdf0ad1c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:09:54.434747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499cdaf-d02e-4bfd-8c75-d745fdf0ad1c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:09:54.434747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499cdaf-d02e-4bfd-8c75-d745fdf0ad1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:09:54.445919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d499cdaf-d02e-4bfd-8c75-d745fdf0ad1c None None] MFA Rules not processed for user `c5523794e64946eb8dd3611586ebeecf`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:09:54.447173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d499cdaf-d02e-4bfd-8c75-d745fdf0ad1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:09:54.454766 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4276/8479] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:09:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:09:54.800306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931249c-22a5-48aa-bd83-b06e2ad7b675 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:09:54.800800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931249c-22a5-48aa-bd83-b06e2ad7b675 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:09:54.800915 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931249c-22a5-48aa-bd83-b06e2ad7b675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:09:54.809254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-4931249c-22a5-48aa-bd83-b06e2ad7b675 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:09:54.809254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:09:54.809254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:09:54.809254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:09:54.809254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:09:54.809254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:09:54.809254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:09:54.809254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:09:54.809254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:09:54.809254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:09:54.809254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:09:54.809254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:09:54.809254 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:09:54.810177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:09:54.810177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:09:54.810177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:09:54.810177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:09:54.810177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:09:54.810177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:09:54.810177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:09:54.810177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:09:54.810177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:09:54.810177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:09:54.810177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:09:54.810177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:09:54.810177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:09:54.810177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:09:54.810177 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:09:54.811663 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4204/8480] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:09:54 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:10:02.963340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499cdaf-d02e-4bfd-8c75-d745fdf0ad1c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:10:02.982625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499cdaf-d02e-4bfd-8c75-d745fdf0ad1c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:10:02.990736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9f9ac-6705-4045-89aa-36667a732447 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:10:02.991605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9f9ac-6705-4045-89aa-36667a732447 service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:02.991893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9f9ac-6705-4045-89aa-36667a732447 service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:02.992226 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9f9ac-6705-4045-89aa-36667a732447 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:02.994042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ffd9f9ac-6705-4045-89aa-36667a732447 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:10:03.009539 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9f9ac-6705-4045-89aa-36667a732447 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:10:03.011447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9f9ac-6705-4045-89aa-36667a732447 service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:10:03.030534 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4277/8481] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:10:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:10:07.441171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931249c-22a5-48aa-bd83-b06e2ad7b675 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:10:07.460006 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931249c-22a5-48aa-bd83-b06e2ad7b675 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:10:07.465349 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68a007-aaa0-4ffd-9169-822a012daffa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:10:07.466020 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a007-aaa0-4ffd-9169-822a012daffa service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:07.466303 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a007-aaa0-4ffd-9169-822a012daffa service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:07.466578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a007-aaa0-4ffd-9169-822a012daffa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:07.468611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0d68a007-aaa0-4ffd-9169-822a012daffa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:10:07.497999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68a007-aaa0-4ffd-9169-822a012daffa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:10:07.500043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68a007-aaa0-4ffd-9169-822a012daffa service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:10:07.514764 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4205/8482] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:10:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:10:07.678980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9f9ac-6705-4045-89aa-36667a732447 service placement] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:10:07.753890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9f9ac-6705-4045-89aa-36667a732447 service placement] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:10:07.759349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567577e2-ba75-4b35-838e-3679750a855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:10:07.759983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567577e2-ba75-4b35-838e-3679750a855a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:07.760291 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567577e2-ba75-4b35-838e-3679750a855a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:07.760565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567577e2-ba75-4b35-838e-3679750a855a admin admin] PATH_INFO: `/v3/users/c5523794e64946eb8dd3611586ebeecf` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:07.761701 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567577e2-ba75-4b35-838e-3679750a855a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5523794e64946eb8dd3611586ebeecf)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:10:07.763611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567577e2-ba75-4b35-838e-3679750a855a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:10:08.025474 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-567577e2-ba75-4b35-838e-3679750a855a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5523794e64946eb8dd3611586ebeecf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:08.026169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-567577e2-ba75-4b35-838e-3679750a855a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5523794e64946eb8dd3611586ebeecf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:08.185880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-567577e2-ba75-4b35-838e-3679750a855a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5523794e64946eb8dd3611586ebeecf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:08.185880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-567577e2-ba75-4b35-838e-3679750a855a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5523794e64946eb8dd3611586ebeecf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:08.198267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-567577e2-ba75-4b35-838e-3679750a855a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5523794e64946eb8dd3611586ebeecf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:08.212000 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4278/8483] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:10:07 2022] DELETE /identity/v3/users/c5523794e64946eb8dd3611586ebeecf => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:10:08.577496 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68a007-aaa0-4ffd-9169-822a012daffa service placement] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:10:08.601571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68a007-aaa0-4ffd-9169-822a012daffa service placement] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:10:08.700402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe074-8848-499b-a412-8bcfd214f9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:10:08.701038 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe074-8848-499b-a412-8bcfd214f9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:08.701320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe074-8848-499b-a412-8bcfd214f9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:08.701589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe074-8848-499b-a412-8bcfd214f9bd admin admin] PATH_INFO: `/v3/projects/5e8518708de246739da77b48c5a45c96` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:08.702944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fe074-8848-499b-a412-8bcfd214f9bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e8518708de246739da77b48c5a45c96)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:10:08.705084 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fe074-8848-499b-a412-8bcfd214f9bd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:10:08.847105 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-536fe074-8848-499b-a412-8bcfd214f9bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e8518708de246739da77b48c5a45c96', 'request_id': 'req-536fe074-8848-499b-a412-8bcfd214f9bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:08.859199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-536fe074-8848-499b-a412-8bcfd214f9bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e8518708de246739da77b48c5a45c96', 'request_id': 'req-536fe074-8848-499b-a412-8bcfd214f9bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:08.868309 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-536fe074-8848-499b-a412-8bcfd214f9bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e8518708de246739da77b48c5a45c96', 'request_id': 'req-536fe074-8848-499b-a412-8bcfd214f9bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:08.993054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-536fe074-8848-499b-a412-8bcfd214f9bd admin admin] The token cache is being invalidate because project 5e8518708de246739da77b48c5a45c96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:10:08.996615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-536fe074-8848-499b-a412-8bcfd214f9bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:08.996615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-536fe074-8848-499b-a412-8bcfd214f9bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:08.996615 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4206/8484] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:10:08 2022] DELETE /identity/v3/projects/5e8518708de246739da77b48c5a45c96 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:10:09.000387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567577e2-ba75-4b35-838e-3679750a855a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:10:09.001871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-567577e2-ba75-4b35-838e-3679750a855a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:10:09.016915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567577e2-ba75-4b35-838e-3679750a855a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:10:09.080629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da0482-5c4b-447e-ae3b-b0b1dfe95c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:10:09.081264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da0482-5c4b-447e-ae3b-b0b1dfe95c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:09.081541 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da0482-5c4b-447e-ae3b-b0b1dfe95c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:09.081852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da0482-5c4b-447e-ae3b-b0b1dfe95c31 admin admin] PATH_INFO: `/v3/users/8f09359f6c77497684c9634af68f39ad` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:09.082936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da0482-5c4b-447e-ae3b-b0b1dfe95c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f09359f6c77497684c9634af68f39ad)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:10:09.084923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da0482-5c4b-447e-ae3b-b0b1dfe95c31 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:10:09.086591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:09.362339 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c0da0482-5c4b-447e-ae3b-b0b1dfe95c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f09359f6c77497684c9634af68f39ad'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:09.363377 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c0da0482-5c4b-447e-ae3b-b0b1dfe95c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f09359f6c77497684c9634af68f39ad'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:09.477696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c0da0482-5c4b-447e-ae3b-b0b1dfe95c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f09359f6c77497684c9634af68f39ad'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:09.478435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c0da0482-5c4b-447e-ae3b-b0b1dfe95c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f09359f6c77497684c9634af68f39ad'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:09.493456 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c0da0482-5c4b-447e-ae3b-b0b1dfe95c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f09359f6c77497684c9634af68f39ad'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:09.510195 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4279/8485] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:10:08 2022] DELETE /identity/v3/users/8f09359f6c77497684c9634af68f39ad => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:10:09.806147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe074-8848-499b-a412-8bcfd214f9bd admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:10:09.809957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-536fe074-8848-499b-a412-8bcfd214f9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:10:09.826157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe074-8848-499b-a412-8bcfd214f9bd admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:10:09.910576 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd280b-e793-47ce-b90f-c28503ab6e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:10:09.911222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd280b-e793-47ce-b90f-c28503ab6e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:09.911507 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd280b-e793-47ce-b90f-c28503ab6e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:09.911878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd280b-e793-47ce-b90f-c28503ab6e4a admin admin] PATH_INFO: `/v3/projects/d028e08a22da4470bd00b69a08d89141` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:09.913834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd280b-e793-47ce-b90f-c28503ab6e4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d028e08a22da4470bd00b69a08d89141)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:10:09.917051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd280b-e793-47ce-b90f-c28503ab6e4a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:10:09.980779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:10.169360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-13fd280b-e793-47ce-b90f-c28503ab6e4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd028e08a22da4470bd00b69a08d89141', 'request_id': 'req-13fd280b-e793-47ce-b90f-c28503ab6e4a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:10.176457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-13fd280b-e793-47ce-b90f-c28503ab6e4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd028e08a22da4470bd00b69a08d89141', 'request_id': 'req-13fd280b-e793-47ce-b90f-c28503ab6e4a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:10.184246 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-13fd280b-e793-47ce-b90f-c28503ab6e4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd028e08a22da4470bd00b69a08d89141', 'request_id': 'req-13fd280b-e793-47ce-b90f-c28503ab6e4a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:10.305098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-13fd280b-e793-47ce-b90f-c28503ab6e4a admin admin] The token cache is being invalidate because project d028e08a22da4470bd00b69a08d89141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:10:10.305337 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-13fd280b-e793-47ce-b90f-c28503ab6e4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:10.305979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-13fd280b-e793-47ce-b90f-c28503ab6e4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:10.307471 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4207/8486] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:10:09 2022] DELETE /identity/v3/projects/d028e08a22da4470bd00b69a08d89141 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:10:19.503428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:20.301761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:46.829171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf94270-342f-4aea-ba16-b4aabfe295c0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:46.829753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf94270-342f-4aea-ba16-b4aabfe295c0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:46.829753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf94270-342f-4aea-ba16-b4aabfe295c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:46.850011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-dcf94270-342f-4aea-ba16-b4aabfe295c0 None None] MFA Rules not processed for user `27e682ca07714def9c77f6c74d20d05c`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:10:46.851135 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dcf94270-342f-4aea-ba16-b4aabfe295c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:10:46.913758 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4280/8487] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:10:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:10:47.287292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5051ba6-f6ed-45dd-8d49-8497e349bb08 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:47.287817 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5051ba6-f6ed-45dd-8d49-8497e349bb08 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:47.287939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5051ba6-f6ed-45dd-8d49-8497e349bb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:47.294371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-f5051ba6-f6ed-45dd-8d49-8497e349bb08 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:10:47.294371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:10:47.294371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:10:47.294371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:10:47.294371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:10:47.294371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:10:47.294371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:10:47.294371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:10:47.294371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:10:47.294371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:10:47.294371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:10:47.294371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:10:47.294371 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:10:47.295484 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:10:47.295484 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:10:47.295484 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:10:47.295484 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:10:47.295484 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:10:47.295484 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:10:47.295484 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:10:47.295484 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:10:47.295484 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:10:47.295484 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:10:47.295484 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:10:47.295484 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:10:47.295484 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:10:47.295484 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:10:47.295484 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:10:47.296651 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4208/8488] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:10:47 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 9 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:10:47.371234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf94270-342f-4aea-ba16-b4aabfe295c0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:10:47.372820 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-dcf94270-342f-4aea-ba16-b4aabfe295c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:10:47.451392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf94270-342f-4aea-ba16-b4aabfe295c0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:10:47.456071 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb75923-ab6b-4607-a60f-515feb278cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:10:47.456798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb75923-ab6b-4607-a60f-515feb278cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:47.457083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb75923-ab6b-4607-a60f-515feb278cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:47.457355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb75923-ab6b-4607-a60f-515feb278cd8 admin admin] PATH_INFO: `/v3/users/dd11d3c4230f45719a7d70c7cffb3c36` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:47.458862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb75923-ab6b-4607-a60f-515feb278cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd11d3c4230f45719a7d70c7cffb3c36)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:10:47.460847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb75923-ab6b-4607-a60f-515feb278cd8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:10:47.722741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fbb75923-ab6b-4607-a60f-515feb278cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd11d3c4230f45719a7d70c7cffb3c36'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:47.723434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fbb75923-ab6b-4607-a60f-515feb278cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd11d3c4230f45719a7d70c7cffb3c36'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:47.819049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fbb75923-ab6b-4607-a60f-515feb278cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd11d3c4230f45719a7d70c7cffb3c36'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:47.819748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fbb75923-ab6b-4607-a60f-515feb278cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd11d3c4230f45719a7d70c7cffb3c36'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:47.832774 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-fbb75923-ab6b-4607-a60f-515feb278cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd11d3c4230f45719a7d70c7cffb3c36'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:47.846011 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4281/8489] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:10:47 2022] DELETE /identity/v3/users/dd11d3c4230f45719a7d70c7cffb3c36 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:10:48.472090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5051ba6-f6ed-45dd-8d49-8497e349bb08 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:10:48.474068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f5051ba6-f6ed-45dd-8d49-8497e349bb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:10:48.557919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5051ba6-f6ed-45dd-8d49-8497e349bb08 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:10:48.563903 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5295e8e-1434-4117-b6b7-da5cacb14f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:10:48.564577 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5295e8e-1434-4117-b6b7-da5cacb14f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:48.564860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5295e8e-1434-4117-b6b7-da5cacb14f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:48.565258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5295e8e-1434-4117-b6b7-da5cacb14f43 admin admin] PATH_INFO: `/v3/projects/5d45f1d07ee14af4852e17e7f1925287` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:48.566451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5295e8e-1434-4117-b6b7-da5cacb14f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d45f1d07ee14af4852e17e7f1925287)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:10:48.569171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5295e8e-1434-4117-b6b7-da5cacb14f43 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:10:48.686996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d5295e8e-1434-4117-b6b7-da5cacb14f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d45f1d07ee14af4852e17e7f1925287', 'request_id': 'req-d5295e8e-1434-4117-b6b7-da5cacb14f43'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:48.692583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d5295e8e-1434-4117-b6b7-da5cacb14f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d45f1d07ee14af4852e17e7f1925287', 'request_id': 'req-d5295e8e-1434-4117-b6b7-da5cacb14f43'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:48.699444 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d5295e8e-1434-4117-b6b7-da5cacb14f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d45f1d07ee14af4852e17e7f1925287', 'request_id': 'req-d5295e8e-1434-4117-b6b7-da5cacb14f43'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:48.790983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d5295e8e-1434-4117-b6b7-da5cacb14f43 admin admin] The token cache is being invalidate because project 5d45f1d07ee14af4852e17e7f1925287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:10:48.800033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d5295e8e-1434-4117-b6b7-da5cacb14f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:48.800033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d5295e8e-1434-4117-b6b7-da5cacb14f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:10:48.800033 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4209/8490] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:10:48 2022] DELETE /identity/v3/projects/5d45f1d07ee14af4852e17e7f1925287 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:10:48.800404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60c763-c339-4af4-b37f-29e93df25be5 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:48.800404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60c763-c339-4af4-b37f-29e93df25be5 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:48.800404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60c763-c339-4af4-b37f-29e93df25be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:48.822498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-de60c763-c339-4af4-b37f-29e93df25be5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:10:48.823957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-de60c763-c339-4af4-b37f-29e93df25be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:10:48.844413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:48.895041 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4282/8491] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:10:48.901877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3a168-33a9-4883-a99f-ea07d8688730 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:48.902184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3a168-33a9-4883-a99f-ea07d8688730 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:48.902447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3a168-33a9-4883-a99f-ea07d8688730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:48.924237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b5b3a168-33a9-4883-a99f-ea07d8688730 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:10:48.925478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b5b3a168-33a9-4883-a99f-ea07d8688730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:10:48.934532 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4210/8492] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:10:48.939239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60c763-c339-4af4-b37f-29e93df25be5 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:10:48.950759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60c763-c339-4af4-b37f-29e93df25be5 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:10:48.956648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33556d-d3b9-4528-af7a-9f3d961881bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:10:48.957274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33556d-d3b9-4528-af7a-9f3d961881bb admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:48.957555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33556d-d3b9-4528-af7a-9f3d961881bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:48.957824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33556d-d3b9-4528-af7a-9f3d961881bb admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:48.959047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33556d-d3b9-4528-af7a-9f3d961881bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:10:48.959546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33556d-d3b9-4528-af7a-9f3d961881bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:10:48.962450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33556d-d3b9-4528-af7a-9f3d961881bb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:10:48.975234 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4283/8493] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:10:48.979709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3a168-33a9-4883-a99f-ea07d8688730 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:10:48.992608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3a168-33a9-4883-a99f-ea07d8688730 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:10:48.997689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4142e-dd4f-4884-b2e3-697de87f9639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:10:48.998470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4142e-dd4f-4884-b2e3-697de87f9639 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:48.998757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4142e-dd4f-4884-b2e3-697de87f9639 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:48.999030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4142e-dd4f-4884-b2e3-697de87f9639 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:48.999677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4142e-dd4f-4884-b2e3-697de87f9639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:10:49.001720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4142e-dd4f-4884-b2e3-697de87f9639 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:10:49.153628 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4211/8494] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:10:48 2022] POST /identity/v3/projects => generated 391 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:10:49.158213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33556d-d3b9-4528-af7a-9f3d961881bb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:10:49.171414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33556d-d3b9-4528-af7a-9f3d961881bb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:10:49.248576 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485608ca-b042-4b1a-b809-93c1a1448944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:10:49.249202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485608ca-b042-4b1a-b809-93c1a1448944 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:49.249483 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485608ca-b042-4b1a-b809-93c1a1448944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:49.249757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485608ca-b042-4b1a-b809-93c1a1448944 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:49.250403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485608ca-b042-4b1a-b809-93c1a1448944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:10:49.252352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485608ca-b042-4b1a-b809-93c1a1448944 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:10:49.374227 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4284/8495] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:10:49 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:10:49.378575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4142e-dd4f-4884-b2e3-697de87f9639 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:10:49.390460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4142e-dd4f-4884-b2e3-697de87f9639 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:10:49.395355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861d454-c990-4e7d-a295-c8ac65a85fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:10:49.401616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861d454-c990-4e7d-a295-c8ac65a85fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:49.401616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861d454-c990-4e7d-a295-c8ac65a85fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:49.401616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861d454-c990-4e7d-a295-c8ac65a85fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:49.401616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861d454-c990-4e7d-a295-c8ac65a85fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:10:49.401616 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861d454-c990-4e7d-a295-c8ac65a85fa2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:10:49.411293 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4212/8496] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:10:49.416652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485608ca-b042-4b1a-b809-93c1a1448944 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:10:49.432057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485608ca-b042-4b1a-b809-93c1a1448944 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:10:49.438166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fc024-9392-4731-a24d-426159c1fb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:10:49.438905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fc024-9392-4731-a24d-426159c1fb81 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:49.439351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fc024-9392-4731-a24d-426159c1fb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:49.439635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fc024-9392-4731-a24d-426159c1fb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:49.440538 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fc024-9392-4731-a24d-426159c1fb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:10:49.442475 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fc024-9392-4731-a24d-426159c1fb81 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:10:49.459690 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4285/8497] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:10:49.464015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861d454-c990-4e7d-a295-c8ac65a85fa2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:10:49.477115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861d454-c990-4e7d-a295-c8ac65a85fa2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:10:49.487018 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c00ac7-1d47-4cf1-bed2-fccf9fa37230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:10:49.487668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c00ac7-1d47-4cf1-bed2-fccf9fa37230 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:49.487958 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c00ac7-1d47-4cf1-bed2-fccf9fa37230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:49.488270 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c00ac7-1d47-4cf1-bed2-fccf9fa37230 admin admin] PATH_INFO: `/v3/projects/ba21d8f768274409b5a071066da7ebd4/users/47dacf25802a4c6a84e0428be9c43e19/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:49.506768 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c00ac7-1d47-4cf1-bed2-fccf9fa37230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba21d8f768274409b5a071066da7ebd4, user_id=47dacf25802a4c6a84e0428be9c43e19, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:10:49.509989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c00ac7-1d47-4cf1-bed2-fccf9fa37230 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:10:49.614794 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4213/8498] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:10:49 2022] PUT /identity/v3/projects/ba21d8f768274409b5a071066da7ebd4/users/47dacf25802a4c6a84e0428be9c43e19/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:10:49.625936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13975e79-f7db-4af0-94d0-17302815613c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:49.628376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13975e79-f7db-4af0-94d0-17302815613c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:49.628376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13975e79-f7db-4af0-94d0-17302815613c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:49.669379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-13975e79-f7db-4af0-94d0-17302815613c None None] MFA Rules not processed for user `47dacf25802a4c6a84e0428be9c43e19`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:10:49.670866 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-13975e79-f7db-4af0-94d0-17302815613c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:10:49.746966 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4286/8499] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:10:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:10:49.758334 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c00ac7-1d47-4cf1-bed2-fccf9fa37230 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:10:49.760353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-99c00ac7-1d47-4cf1-bed2-fccf9fa37230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:10:49.792075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:49.838925 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c00ac7-1d47-4cf1-bed2-fccf9fa37230 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:10:49.844204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bebca-7317-45e6-b9cf-528cbb18c37e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfcccc451b4b443f9b2428cc207211ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:10:49.844790 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bebca-7317-45e6-b9cf-528cbb18c37e service cinder] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:10:49.845074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bebca-7317-45e6-b9cf-528cbb18c37e service cinder] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:10:49.845351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bebca-7317-45e6-b9cf-528cbb18c37e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:10:49.855363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bebca-7317-45e6-b9cf-528cbb18c37e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:10:49.856986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bebca-7317-45e6-b9cf-528cbb18c37e service cinder] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:10:49.866484 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4214/8500] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:10:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:10:59.743379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:10:59.907939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=18 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:01.361860 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13975e79-f7db-4af0-94d0-17302815613c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:01.363644 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-13975e79-f7db-4af0-94d0-17302815613c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:01.459155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13975e79-f7db-4af0-94d0-17302815613c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:01.464210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784976eb-26ac-48a7-a442-6bc14d593869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:01.464824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784976eb-26ac-48a7-a442-6bc14d593869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:01.465168 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784976eb-26ac-48a7-a442-6bc14d593869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:01.465399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784976eb-26ac-48a7-a442-6bc14d593869 admin admin] PATH_INFO: `/v3/users/27e682ca07714def9c77f6c74d20d05c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:01.466486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784976eb-26ac-48a7-a442-6bc14d593869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e682ca07714def9c77f6c74d20d05c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:01.468448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784976eb-26ac-48a7-a442-6bc14d593869 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:01.666633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-784976eb-26ac-48a7-a442-6bc14d593869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e682ca07714def9c77f6c74d20d05c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:01.667302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-784976eb-26ac-48a7-a442-6bc14d593869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e682ca07714def9c77f6c74d20d05c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:01.807301 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-784976eb-26ac-48a7-a442-6bc14d593869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e682ca07714def9c77f6c74d20d05c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:01.808109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-784976eb-26ac-48a7-a442-6bc14d593869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e682ca07714def9c77f6c74d20d05c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:01.822846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-784976eb-26ac-48a7-a442-6bc14d593869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e682ca07714def9c77f6c74d20d05c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:01.836285 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4287/8501] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:11:01 2022] DELETE /identity/v3/users/27e682ca07714def9c77f6c74d20d05c => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:11:02.165039 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bebca-7317-45e6-b9cf-528cbb18c37e service cinder] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:02.182783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bebca-7317-45e6-b9cf-528cbb18c37e service cinder] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:02.245913 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb94f4-fb81-4872-b1bc-85c4d307acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:02.246578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb94f4-fb81-4872-b1bc-85c4d307acd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:02.246865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb94f4-fb81-4872-b1bc-85c4d307acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:02.247146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb94f4-fb81-4872-b1bc-85c4d307acd8 admin admin] PATH_INFO: `/v3/projects/feec46b55e5144e3905252b290e98e83` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:02.248323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb94f4-fb81-4872-b1bc-85c4d307acd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feec46b55e5144e3905252b290e98e83)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:02.250252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb94f4-fb81-4872-b1bc-85c4d307acd8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:02.366547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-30fb94f4-fb81-4872-b1bc-85c4d307acd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feec46b55e5144e3905252b290e98e83', 'request_id': 'req-30fb94f4-fb81-4872-b1bc-85c4d307acd8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:02.373865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-30fb94f4-fb81-4872-b1bc-85c4d307acd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feec46b55e5144e3905252b290e98e83', 'request_id': 'req-30fb94f4-fb81-4872-b1bc-85c4d307acd8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:02.380619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-30fb94f4-fb81-4872-b1bc-85c4d307acd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feec46b55e5144e3905252b290e98e83', 'request_id': 'req-30fb94f4-fb81-4872-b1bc-85c4d307acd8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:02.453447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-30fb94f4-fb81-4872-b1bc-85c4d307acd8 admin admin] The token cache is being invalidate because project feec46b55e5144e3905252b290e98e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:11:02.453742 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-30fb94f4-fb81-4872-b1bc-85c4d307acd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:02.454487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-30fb94f4-fb81-4872-b1bc-85c4d307acd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:02.456083 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4215/8502] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:11:02 2022] DELETE /identity/v3/projects/feec46b55e5144e3905252b290e98e83 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:11:02.460993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784976eb-26ac-48a7-a442-6bc14d593869 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:02.462765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-784976eb-26ac-48a7-a442-6bc14d593869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:02.479150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784976eb-26ac-48a7-a442-6bc14d593869 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:02.545803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d65768-e17e-43f3-9777-b13937b02f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:02.546455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65768-e17e-43f3-9777-b13937b02f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:02.546766 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65768-e17e-43f3-9777-b13937b02f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:02.547094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65768-e17e-43f3-9777-b13937b02f03 admin admin] PATH_INFO: `/v3/users/00a6eb669e6a4572921bbc48182726fe` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:02.548293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d65768-e17e-43f3-9777-b13937b02f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a6eb669e6a4572921bbc48182726fe)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:02.550273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d65768-e17e-43f3-9777-b13937b02f03 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:02.569499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:02.889952 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f3d65768-e17e-43f3-9777-b13937b02f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a6eb669e6a4572921bbc48182726fe'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:02.890694 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f3d65768-e17e-43f3-9777-b13937b02f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a6eb669e6a4572921bbc48182726fe'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:03.007058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f3d65768-e17e-43f3-9777-b13937b02f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a6eb669e6a4572921bbc48182726fe'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:03.007695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f3d65768-e17e-43f3-9777-b13937b02f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a6eb669e6a4572921bbc48182726fe'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:03.021048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f3d65768-e17e-43f3-9777-b13937b02f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a6eb669e6a4572921bbc48182726fe'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:03.034439 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4288/8503] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:11:02 2022] DELETE /identity/v3/users/00a6eb669e6a4572921bbc48182726fe => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:11:03.344016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb94f4-fb81-4872-b1bc-85c4d307acd8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:03.345673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-30fb94f4-fb81-4872-b1bc-85c4d307acd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:03.365948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb94f4-fb81-4872-b1bc-85c4d307acd8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:03.432682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd93823-d699-4e32-9a1b-d42be8482d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:03.433318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd93823-d699-4e32-9a1b-d42be8482d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:03.433597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd93823-d699-4e32-9a1b-d42be8482d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:03.433871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd93823-d699-4e32-9a1b-d42be8482d47 admin admin] PATH_INFO: `/v3/projects/e9a0885d790341928df202754a87fce1` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:03.435063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd93823-d699-4e32-9a1b-d42be8482d47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a0885d790341928df202754a87fce1)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:03.437164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd93823-d699-4e32-9a1b-d42be8482d47 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:03.557542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:03.571328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dcd93823-d699-4e32-9a1b-d42be8482d47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a0885d790341928df202754a87fce1', 'request_id': 'req-dcd93823-d699-4e32-9a1b-d42be8482d47'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:03.577679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dcd93823-d699-4e32-9a1b-d42be8482d47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a0885d790341928df202754a87fce1', 'request_id': 'req-dcd93823-d699-4e32-9a1b-d42be8482d47'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:03.584627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dcd93823-d699-4e32-9a1b-d42be8482d47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a0885d790341928df202754a87fce1', 'request_id': 'req-dcd93823-d699-4e32-9a1b-d42be8482d47'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:03.729661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dcd93823-d699-4e32-9a1b-d42be8482d47 admin admin] The token cache is being invalidate because project e9a0885d790341928df202754a87fce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:11:03.729661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dcd93823-d699-4e32-9a1b-d42be8482d47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:03.729661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dcd93823-d699-4e32-9a1b-d42be8482d47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:03.729661 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4216/8504] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:11:03 2022] DELETE /identity/v3/projects/e9a0885d790341928df202754a87fce1 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:11:13.030141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=22,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:13.847160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:14.133924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d65768-e17e-43f3-9777-b13937b02f03 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:14.135385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f3d65768-e17e-43f3-9777-b13937b02f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:14.149575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d65768-e17e-43f3-9777-b13937b02f03 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:14.212363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11786ae1-0f3e-4791-844b-6f8552d93e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:14.213022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11786ae1-0f3e-4791-844b-6f8552d93e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:14.213304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11786ae1-0f3e-4791-844b-6f8552d93e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:14.213575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11786ae1-0f3e-4791-844b-6f8552d93e1a admin admin] PATH_INFO: `/v3/users/47dacf25802a4c6a84e0428be9c43e19` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:14.214714 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11786ae1-0f3e-4791-844b-6f8552d93e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=47dacf25802a4c6a84e0428be9c43e19)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:14.216726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11786ae1-0f3e-4791-844b-6f8552d93e1a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:14.518757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-11786ae1-0f3e-4791-844b-6f8552d93e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47dacf25802a4c6a84e0428be9c43e19'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:14.519380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-11786ae1-0f3e-4791-844b-6f8552d93e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47dacf25802a4c6a84e0428be9c43e19'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:14.658544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-11786ae1-0f3e-4791-844b-6f8552d93e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47dacf25802a4c6a84e0428be9c43e19'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:14.659252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-11786ae1-0f3e-4791-844b-6f8552d93e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47dacf25802a4c6a84e0428be9c43e19'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:14.673640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-11786ae1-0f3e-4791-844b-6f8552d93e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47dacf25802a4c6a84e0428be9c43e19'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:14.692883 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4289/8505] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:11:14 2022] DELETE /identity/v3/users/47dacf25802a4c6a84e0428be9c43e19 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:11:14.697920 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa777c3f-5a19-4110-8594-75f7c5b62a15 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:14.698293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa777c3f-5a19-4110-8594-75f7c5b62a15 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:14.698643 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa777c3f-5a19-4110-8594-75f7c5b62a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:14.723581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-aa777c3f-5a19-4110-8594-75f7c5b62a15 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:11:14.725326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aa777c3f-5a19-4110-8594-75f7c5b62a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:14.792191 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4217/8506] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:11:14.803342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11786ae1-0f3e-4791-844b-6f8552d93e1a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:14.804844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-11786ae1-0f3e-4791-844b-6f8552d93e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:14.885251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11786ae1-0f3e-4791-844b-6f8552d93e1a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:14.889040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540140f-b926-4894-b4bf-77c00aaf2598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:14.889649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540140f-b926-4894-b4bf-77c00aaf2598 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:14.889925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540140f-b926-4894-b4bf-77c00aaf2598 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:14.890192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540140f-b926-4894-b4bf-77c00aaf2598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:14.901269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540140f-b926-4894-b4bf-77c00aaf2598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:14.902722 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540140f-b926-4894-b4bf-77c00aaf2598 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:14.914581 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4290/8507] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:11:15.431869 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa777c3f-5a19-4110-8594-75f7c5b62a15 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:15.433828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aa777c3f-5a19-4110-8594-75f7c5b62a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:15.446700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa777c3f-5a19-4110-8594-75f7c5b62a15 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:15.451411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba122700-a6f6-40f8-8903-9af062efe95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:15.452048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba122700-a6f6-40f8-8903-9af062efe95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:15.452356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba122700-a6f6-40f8-8903-9af062efe95b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:15.452652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba122700-a6f6-40f8-8903-9af062efe95b admin admin] PATH_INFO: `/v3/projects/ba21d8f768274409b5a071066da7ebd4` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:15.453785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba122700-a6f6-40f8-8903-9af062efe95b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba21d8f768274409b5a071066da7ebd4)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:15.457947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba122700-a6f6-40f8-8903-9af062efe95b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:15.599945 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ba122700-a6f6-40f8-8903-9af062efe95b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba21d8f768274409b5a071066da7ebd4', 'request_id': 'req-ba122700-a6f6-40f8-8903-9af062efe95b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:15.605465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ba122700-a6f6-40f8-8903-9af062efe95b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba21d8f768274409b5a071066da7ebd4', 'request_id': 'req-ba122700-a6f6-40f8-8903-9af062efe95b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:15.612135 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ba122700-a6f6-40f8-8903-9af062efe95b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba21d8f768274409b5a071066da7ebd4', 'request_id': 'req-ba122700-a6f6-40f8-8903-9af062efe95b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:15.730917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ba122700-a6f6-40f8-8903-9af062efe95b admin admin] The token cache is being invalidate because project ba21d8f768274409b5a071066da7ebd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:11:15.731197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ba122700-a6f6-40f8-8903-9af062efe95b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:15.731893 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ba122700-a6f6-40f8-8903-9af062efe95b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:15.733504 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4218/8508] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:11:15 2022] DELETE /identity/v3/projects/ba21d8f768274409b5a071066da7ebd4 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:11:15.742854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae374-b2c9-4ab7-8251-78d84cd45439 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:15.742854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae374-b2c9-4ab7-8251-78d84cd45439 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:15.742854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae374-b2c9-4ab7-8251-78d84cd45439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:15.765736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-23dae374-b2c9-4ab7-8251-78d84cd45439 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:11:15.766953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-23dae374-b2c9-4ab7-8251-78d84cd45439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:15.775491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:15.827249 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4291/8509] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:11:15.834986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14683b75-a0fc-4488-aac1-daf972e4dac5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:15.835273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14683b75-a0fc-4488-aac1-daf972e4dac5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:15.835574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14683b75-a0fc-4488-aac1-daf972e4dac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:15.855418 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-14683b75-a0fc-4488-aac1-daf972e4dac5 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:11:15.856671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-14683b75-a0fc-4488-aac1-daf972e4dac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:15.865817 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4219/8510] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:11:15.870305 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dae374-b2c9-4ab7-8251-78d84cd45439 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:15.880505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dae374-b2c9-4ab7-8251-78d84cd45439 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:15.885754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19056cf5-4940-454f-bef3-fc96200bda8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:15.886351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19056cf5-4940-454f-bef3-fc96200bda8a admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:15.886632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19056cf5-4940-454f-bef3-fc96200bda8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:15.886905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19056cf5-4940-454f-bef3-fc96200bda8a admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:15.887546 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19056cf5-4940-454f-bef3-fc96200bda8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:11:15.887847 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19056cf5-4940-454f-bef3-fc96200bda8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:15.889525 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19056cf5-4940-454f-bef3-fc96200bda8a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:15.901140 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4292/8511] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:11:15.905713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14683b75-a0fc-4488-aac1-daf972e4dac5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:15.915754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14683b75-a0fc-4488-aac1-daf972e4dac5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:15.920515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3e091-bfa9-4909-b9f6-c4bfd785a005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:15.921110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3e091-bfa9-4909-b9f6-c4bfd785a005 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:15.921395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3e091-bfa9-4909-b9f6-c4bfd785a005 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:15.921679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3e091-bfa9-4909-b9f6-c4bfd785a005 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:15.922312 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3e091-bfa9-4909-b9f6-c4bfd785a005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:15.924289 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3e091-bfa9-4909-b9f6-c4bfd785a005 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:16.041037 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4220/8512] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:11:15 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:11:16.045165 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19056cf5-4940-454f-bef3-fc96200bda8a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:16.056809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19056cf5-4940-454f-bef3-fc96200bda8a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:16.111676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f031339-09b5-40b3-aa8f-83c0a1574292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:16.112317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f031339-09b5-40b3-aa8f-83c0a1574292 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:16.112598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f031339-09b5-40b3-aa8f-83c0a1574292 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:16.112869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f031339-09b5-40b3-aa8f-83c0a1574292 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:16.114304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f031339-09b5-40b3-aa8f-83c0a1574292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:16.116289 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f031339-09b5-40b3-aa8f-83c0a1574292 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:16.298748 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4293/8513] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:11:16 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:11:16.304124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3e091-bfa9-4909-b9f6-c4bfd785a005 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:16.314620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3e091-bfa9-4909-b9f6-c4bfd785a005 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:16.320044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b5474-44cb-465e-b93f-8c322bd1fe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:16.320681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b5474-44cb-465e-b93f-8c322bd1fe86 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:16.325646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b5474-44cb-465e-b93f-8c322bd1fe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:16.325646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b5474-44cb-465e-b93f-8c322bd1fe86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:16.325646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b5474-44cb-465e-b93f-8c322bd1fe86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:16.325646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b5474-44cb-465e-b93f-8c322bd1fe86 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:16.333991 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4221/8514] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:11:16.338591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f031339-09b5-40b3-aa8f-83c0a1574292 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:16.350082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f031339-09b5-40b3-aa8f-83c0a1574292 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:16.354712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af8b7e-3070-4a9c-884f-14b0acc77a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:16.355309 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af8b7e-3070-4a9c-884f-14b0acc77a2b admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:16.355593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af8b7e-3070-4a9c-884f-14b0acc77a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:16.355868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af8b7e-3070-4a9c-884f-14b0acc77a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:16.356552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af8b7e-3070-4a9c-884f-14b0acc77a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:16.358150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af8b7e-3070-4a9c-884f-14b0acc77a2b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:16.371518 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4294/8515] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:11:16.375785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b5474-44cb-465e-b93f-8c322bd1fe86 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:16.386010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b5474-44cb-465e-b93f-8c322bd1fe86 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:16.390659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96de5e2-d032-44b8-9079-6b599b68c610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:16.391304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96de5e2-d032-44b8-9079-6b599b68c610 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:16.391621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96de5e2-d032-44b8-9079-6b599b68c610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:16.391899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96de5e2-d032-44b8-9079-6b599b68c610 admin admin] PATH_INFO: `/v3/projects/d9a223bc01234f719e782e240c9713cb/users/639666a0324e4f009323f1d4f4d474d6/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:16.407208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96de5e2-d032-44b8-9079-6b599b68c610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a223bc01234f719e782e240c9713cb, user_id=639666a0324e4f009323f1d4f4d474d6, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:16.409923 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96de5e2-d032-44b8-9079-6b599b68c610 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:16.507414 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4222/8516] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:11:16 2022] PUT /identity/v3/projects/d9a223bc01234f719e782e240c9713cb/users/639666a0324e4f009323f1d4f4d474d6/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:11:16.518936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a271385-4cc3-4476-8fe0-94cdc6159e5c None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:16.526150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a271385-4cc3-4476-8fe0-94cdc6159e5c None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:16.526150 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a271385-4cc3-4476-8fe0-94cdc6159e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:16.547996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-8a271385-4cc3-4476-8fe0-94cdc6159e5c None None] MFA Rules not processed for user `639666a0324e4f009323f1d4f4d474d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:11:16.549547 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8a271385-4cc3-4476-8fe0-94cdc6159e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:16.614738 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4295/8517] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:11:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:11:16.619266 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96de5e2-d032-44b8-9079-6b599b68c610 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:16.641866 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:16.691638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96de5e2-d032-44b8-9079-6b599b68c610 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:16.696324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45952630-7f87-4cfb-966d-69945121ce84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:16.696922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45952630-7f87-4cfb-966d-69945121ce84 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:16.697201 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45952630-7f87-4cfb-966d-69945121ce84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:16.697495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45952630-7f87-4cfb-966d-69945121ce84 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:16.698175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45952630-7f87-4cfb-966d-69945121ce84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:16.700098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45952630-7f87-4cfb-966d-69945121ce84 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:16.876803 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4223/8518] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:11:16 2022] POST /identity/v3/projects => generated 375 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:11:16.881434 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a271385-4cc3-4476-8fe0-94cdc6159e5c None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:16.892273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a271385-4cc3-4476-8fe0-94cdc6159e5c None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:16.897439 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:16.948322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da38bb-b667-48ec-a27f-c267af702d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:16.948936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da38bb-b667-48ec-a27f-c267af702d7d admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:16.949213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da38bb-b667-48ec-a27f-c267af702d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:16.949480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da38bb-b667-48ec-a27f-c267af702d7d admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:16.950100 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da38bb-b667-48ec-a27f-c267af702d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:16.952045 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da38bb-b667-48ec-a27f-c267af702d7d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:17.092807 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4296/8519] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:11:16 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:11:17.096949 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45952630-7f87-4cfb-966d-69945121ce84 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:17.107304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45952630-7f87-4cfb-966d-69945121ce84 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:17.111797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984f278-ccee-4518-8e9a-c6fb6e6e3f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:17.112424 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984f278-ccee-4518-8e9a-c6fb6e6e3f84 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:17.112704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984f278-ccee-4518-8e9a-c6fb6e6e3f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:17.112975 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984f278-ccee-4518-8e9a-c6fb6e6e3f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:17.113824 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984f278-ccee-4518-8e9a-c6fb6e6e3f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:17.115469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984f278-ccee-4518-8e9a-c6fb6e6e3f84 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:17.126108 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4224/8520] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:11:17.133996 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da38bb-b667-48ec-a27f-c267af702d7d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:17.144449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da38bb-b667-48ec-a27f-c267af702d7d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:17.150046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d04bb0-e75d-4caf-be3f-f0d5a2fc9a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:17.150697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d04bb0-e75d-4caf-be3f-f0d5a2fc9a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:17.150977 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d04bb0-e75d-4caf-be3f-f0d5a2fc9a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:17.151251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d04bb0-e75d-4caf-be3f-f0d5a2fc9a14 admin admin] PATH_INFO: `/v3/projects/df3b324edaad45b09b37c299e4fff37e/users/cc8d65466e2346208aa3c81465685c5b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:17.166585 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d04bb0-e75d-4caf-be3f-f0d5a2fc9a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3b324edaad45b09b37c299e4fff37e, user_id=cc8d65466e2346208aa3c81465685c5b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:17.169355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d04bb0-e75d-4caf-be3f-f0d5a2fc9a14 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:17.272447 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4297/8521] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:11:17 2022] PUT /identity/v3/projects/df3b324edaad45b09b37c299e4fff37e/users/cc8d65466e2346208aa3c81465685c5b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:11:17.276466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984f278-ccee-4518-8e9a-c6fb6e6e3f84 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:17.287557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984f278-ccee-4518-8e9a-c6fb6e6e3f84 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:17.345077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b0e4c-7995-4cec-bffd-ea05d4c65300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:17.345684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b0e4c-7995-4cec-bffd-ea05d4c65300 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:17.345965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b0e4c-7995-4cec-bffd-ea05d4c65300 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:17.346237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b0e4c-7995-4cec-bffd-ea05d4c65300 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:17.346874 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b0e4c-7995-4cec-bffd-ea05d4c65300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:17.348502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b0e4c-7995-4cec-bffd-ea05d4c65300 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:17.358208 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4225/8522] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:11:17.362594 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d04bb0-e75d-4caf-be3f-f0d5a2fc9a14 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:17.373486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d04bb0-e75d-4caf-be3f-f0d5a2fc9a14 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:17.379750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae362ef-45e8-422c-969c-02f10a0793cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:17.381012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae362ef-45e8-422c-969c-02f10a0793cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:17.381012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae362ef-45e8-422c-969c-02f10a0793cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:17.381235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae362ef-45e8-422c-969c-02f10a0793cd admin admin] PATH_INFO: `/v3/projects/df3b324edaad45b09b37c299e4fff37e/users/cc8d65466e2346208aa3c81465685c5b/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:17.383074 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae362ef-45e8-422c-969c-02f10a0793cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3b324edaad45b09b37c299e4fff37e, user_id=cc8d65466e2346208aa3c81465685c5b, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:17.385801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae362ef-45e8-422c-969c-02f10a0793cd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:17.396319 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4298/8523] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:11:17 2022] PUT /identity/v3/projects/df3b324edaad45b09b37c299e4fff37e/users/cc8d65466e2346208aa3c81465685c5b/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:11:17.406890 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89721db-b939-47d8-b8ec-99a083f0a147 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:17.407182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89721db-b939-47d8-b8ec-99a083f0a147 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:17.407466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89721db-b939-47d8-b8ec-99a083f0a147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:17.436772 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f89721db-b939-47d8-b8ec-99a083f0a147 None None] MFA Rules not processed for user `cc8d65466e2346208aa3c81465685c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:11:17.437987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f89721db-b939-47d8-b8ec-99a083f0a147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:17.508125 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4226/8524] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:11:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:11:17.519065 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae362ef-45e8-422c-969c-02f10a0793cd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:17.520893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9ae362ef-45e8-422c-969c-02f10a0793cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:17.585376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae362ef-45e8-422c-969c-02f10a0793cd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:17.589187 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f04cf-763b-4beb-9cd1-40cbf89e9b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:17.589844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f04cf-763b-4beb-9cd1-40cbf89e9b2d service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:17.590126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f04cf-763b-4beb-9cd1-40cbf89e9b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:17.590403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f04cf-763b-4beb-9cd1-40cbf89e9b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:17.648583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f04cf-763b-4beb-9cd1-40cbf89e9b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:17.649938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f04cf-763b-4beb-9cd1-40cbf89e9b2d service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:17.659068 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4299/8525] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:11:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:11:20.504694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89721db-b939-47d8-b8ec-99a083f0a147 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:20.518110 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89721db-b939-47d8-b8ec-99a083f0a147 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:20.522751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b58f9-4b89-4278-a273-d09a93b46b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:20.523425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b58f9-4b89-4278-a273-d09a93b46b61 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:20.523708 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b58f9-4b89-4278-a273-d09a93b46b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:20.523985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b58f9-4b89-4278-a273-d09a93b46b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:20.536276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b58f9-4b89-4278-a273-d09a93b46b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:20.536276 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b58f9-4b89-4278-a273-d09a93b46b61 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:20.546214 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4227/8526] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:11:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:11:27.655048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=88,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:27.973957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b21d7a-b95e-46bb-ac4a-f238070111f1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:27.976676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b21d7a-b95e-46bb-ac4a-f238070111f1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:27.976676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b21d7a-b95e-46bb-ac4a-f238070111f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:27.993574 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-93b21d7a-b95e-46bb-ac4a-f238070111f1 None None] MFA Rules not processed for user `639666a0324e4f009323f1d4f4d474d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:11:27.994771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-93b21d7a-b95e-46bb-ac4a-f238070111f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:28.001701 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4300/8527] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:11:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:11:28.323164 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdfe97-07b1-4e9b-a8be-d8b60ab7b067 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:28.323668 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdfe97-07b1-4e9b-a8be-d8b60ab7b067 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:28.323792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdfe97-07b1-4e9b-a8be-d8b60ab7b067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:28.330151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-2fbdfe97-07b1-4e9b-a8be-d8b60ab7b067 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:11:28.330151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:11:28.330151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:11:28.330151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:11:28.330151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:11:28.330151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:11:28.330151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:11:28.330151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:11:28.330151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:11:28.330151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:11:28.330151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:11:28.330151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:11:28.330151 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:11:28.331310 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:11:28.331310 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:11:28.331310 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:11:28.331310 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:11:28.331310 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:11:28.331310 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:11:28.331310 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:11:28.331310 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:11:28.331310 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:11:28.331310 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:11:28.331310 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:11:28.331310 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:11:28.331310 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:11:28.331310 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:11:28.331310 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:11:28.332696 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4228/8528] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:11:28 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 9 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:11:30.542082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:37.988657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:41.102731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b21d7a-b95e-46bb-ac4a-f238070111f1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:41.104205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-93b21d7a-b95e-46bb-ac4a-f238070111f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:41.223686 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b21d7a-b95e-46bb-ac4a-f238070111f1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:41.242618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a8a54-3558-44dd-98e3-44bbb6729968 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:41.242618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a8a54-3558-44dd-98e3-44bbb6729968 service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:41.242618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a8a54-3558-44dd-98e3-44bbb6729968 service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:41.242618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a8a54-3558-44dd-98e3-44bbb6729968 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:41.244342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6a0a8a54-3558-44dd-98e3-44bbb6729968 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:41.258983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a8a54-3558-44dd-98e3-44bbb6729968 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:41.260696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a8a54-3558-44dd-98e3-44bbb6729968 service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:41.275497 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4301/8529] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:11:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:11:42.100225 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddf348-e7e3-43ba-a986-37a50224a436 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:42.100761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddf348-e7e3-43ba-a986-37a50224a436 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:42.100761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddf348-e7e3-43ba-a986-37a50224a436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:42.119924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-7cddf348-e7e3-43ba-a986-37a50224a436 None None] MFA Rules not processed for user `639666a0324e4f009323f1d4f4d474d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:11:42.121160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-7cddf348-e7e3-43ba-a986-37a50224a436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:42.128056 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4229/8530] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:11:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:11:42.444761 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c346a8-6235-49b4-8db9-4cbbf4558fbd None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:42.445306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c346a8-6235-49b4-8db9-4cbbf4558fbd None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:42.445306 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c346a8-6235-49b4-8db9-4cbbf4558fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:42.451953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-27c346a8-6235-49b4-8db9-4cbbf4558fbd None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:11:42.451953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:11:42.451953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:11:42.451953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:11:42.451953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:11:42.451953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:11:42.451953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:11:42.451953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:11:42.451953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:11:42.451953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:11:42.451953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:11:42.451953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:11:42.451953 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:11:42.453089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:11:42.453089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:11:42.453089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:11:42.453089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:11:42.453089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:11:42.453089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:11:42.453089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:11:42.453089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:11:42.453089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:11:42.453089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:11:42.453089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:11:42.453089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:11:42.453089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:11:42.453089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:11:42.453089 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 05:11:42.454213 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4302/8531] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:11:42 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 9 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:11:46.314116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddf348-e7e3-43ba-a986-37a50224a436 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:46.380180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddf348-e7e3-43ba-a986-37a50224a436 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:46.384738 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cb11e-8045-44a8-b88c-ea23e504538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:46.385377 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cb11e-8045-44a8-b88c-ea23e504538d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:46.385661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cb11e-8045-44a8-b88c-ea23e504538d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:46.385943 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cb11e-8045-44a8-b88c-ea23e504538d admin admin] PATH_INFO: `/v3/users/639666a0324e4f009323f1d4f4d474d6` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:46.387080 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cb11e-8045-44a8-b88c-ea23e504538d admin admin] RBAC: Authorizing `identity:delete_user(user_id=639666a0324e4f009323f1d4f4d474d6)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:46.389058 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cb11e-8045-44a8-b88c-ea23e504538d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:46.580503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8f2cb11e-8045-44a8-b88c-ea23e504538d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '639666a0324e4f009323f1d4f4d474d6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:46.663491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8f2cb11e-8045-44a8-b88c-ea23e504538d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '639666a0324e4f009323f1d4f4d474d6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:46.664064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8f2cb11e-8045-44a8-b88c-ea23e504538d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '639666a0324e4f009323f1d4f4d474d6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:46.671603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8f2cb11e-8045-44a8-b88c-ea23e504538d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '639666a0324e4f009323f1d4f4d474d6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:46.683681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8f2cb11e-8045-44a8-b88c-ea23e504538d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '639666a0324e4f009323f1d4f4d474d6'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:46.689633 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4230/8532] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:11:46 2022] DELETE /identity/v3/users/639666a0324e4f009323f1d4f4d474d6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:11:46.694757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06760ed-7a77-47ab-b7ab-0070606efc34 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:46.695207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06760ed-7a77-47ab-b7ab-0070606efc34 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:46.695328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06760ed-7a77-47ab-b7ab-0070606efc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:46.716472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a06760ed-7a77-47ab-b7ab-0070606efc34 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:11:46.720345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a06760ed-7a77-47ab-b7ab-0070606efc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:46.776481 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4303/8533] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:11:46.786572 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cb11e-8045-44a8-b88c-ea23e504538d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:46.787990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8f2cb11e-8045-44a8-b88c-ea23e504538d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:46.849178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cb11e-8045-44a8-b88c-ea23e504538d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:46.852826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acf4b6-7b5a-4ca0-aa33-ea1b35f0dbb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:46.853429 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf4b6-7b5a-4ca0-aa33-ea1b35f0dbb5 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:46.853711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf4b6-7b5a-4ca0-aa33-ea1b35f0dbb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:46.853990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acf4b6-7b5a-4ca0-aa33-ea1b35f0dbb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:46.863639 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acf4b6-7b5a-4ca0-aa33-ea1b35f0dbb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:46.865113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acf4b6-7b5a-4ca0-aa33-ea1b35f0dbb5 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:46.874782 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4231/8534] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:11:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:11:47.116458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06760ed-7a77-47ab-b7ab-0070606efc34 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:47.117899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a06760ed-7a77-47ab-b7ab-0070606efc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:47.133099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06760ed-7a77-47ab-b7ab-0070606efc34 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:47.138442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:47.139463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:47.140005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:47.140326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1 admin admin] PATH_INFO: `/v3/projects/d9a223bc01234f719e782e240c9713cb` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:47.141463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a223bc01234f719e782e240c9713cb)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:47.143901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:47.249943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a223bc01234f719e782e240c9713cb', 'request_id': 'req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:47.256222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a223bc01234f719e782e240c9713cb', 'request_id': 'req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:47.346246 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a223bc01234f719e782e240c9713cb', 'request_id': 'req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:47.358097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1 admin admin] The token cache is being invalidate because project d9a223bc01234f719e782e240c9713cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:11:47.358385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:47.359017 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:47.360548 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4304/8535] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:11:47 2022] DELETE /identity/v3/projects/d9a223bc01234f719e782e240c9713cb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:11:47.364787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acf4b6-7b5a-4ca0-aa33-ea1b35f0dbb5 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:47.374666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acf4b6-7b5a-4ca0-aa33-ea1b35f0dbb5 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:47.388421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:47.434770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66708d-6664-48a4-942a-56a654d83b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:47.435398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66708d-6664-48a4-942a-56a654d83b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:47.435679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66708d-6664-48a4-942a-56a654d83b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:47.435953 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66708d-6664-48a4-942a-56a654d83b00 admin admin] PATH_INFO: `/v3/users/cc8d65466e2346208aa3c81465685c5b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:47.437147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66708d-6664-48a4-942a-56a654d83b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc8d65466e2346208aa3c81465685c5b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:47.439277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66708d-6664-48a4-942a-56a654d83b00 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:47.626710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dc66708d-6664-48a4-942a-56a654d83b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc8d65466e2346208aa3c81465685c5b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:47.692427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dc66708d-6664-48a4-942a-56a654d83b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc8d65466e2346208aa3c81465685c5b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:47.693049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dc66708d-6664-48a4-942a-56a654d83b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc8d65466e2346208aa3c81465685c5b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:47.700658 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dc66708d-6664-48a4-942a-56a654d83b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc8d65466e2346208aa3c81465685c5b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:47.712952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dc66708d-6664-48a4-942a-56a654d83b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc8d65466e2346208aa3c81465685c5b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:47.718831 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4232/8536] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:11:47 2022] DELETE /identity/v3/users/cc8d65466e2346208aa3c81465685c5b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:11:48.147801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:48.149207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:48.160142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:48.163700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5ec75-4560-4ce2-a6ca-a282697ee2e1 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:48.223392 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39e9db-f6ad-4c40-afcd-43635f4274a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:48.224055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39e9db-f6ad-4c40-afcd-43635f4274a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:48.224364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39e9db-f6ad-4c40-afcd-43635f4274a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:48.224640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39e9db-f6ad-4c40-afcd-43635f4274a1 admin admin] PATH_INFO: `/v3/projects/df3b324edaad45b09b37c299e4fff37e` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:48.225765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39e9db-f6ad-4c40-afcd-43635f4274a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df3b324edaad45b09b37c299e4fff37e)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:48.227712 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39e9db-f6ad-4c40-afcd-43635f4274a1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:48.338025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7c39e9db-f6ad-4c40-afcd-43635f4274a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df3b324edaad45b09b37c299e4fff37e', 'request_id': 'req-7c39e9db-f6ad-4c40-afcd-43635f4274a1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:48.343493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7c39e9db-f6ad-4c40-afcd-43635f4274a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df3b324edaad45b09b37c299e4fff37e', 'request_id': 'req-7c39e9db-f6ad-4c40-afcd-43635f4274a1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:48.417588 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7c39e9db-f6ad-4c40-afcd-43635f4274a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df3b324edaad45b09b37c299e4fff37e', 'request_id': 'req-7c39e9db-f6ad-4c40-afcd-43635f4274a1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:48.429782 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7c39e9db-f6ad-4c40-afcd-43635f4274a1 admin admin] The token cache is being invalidate because project df3b324edaad45b09b37c299e4fff37e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:11:48.430075 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7c39e9db-f6ad-4c40-afcd-43635f4274a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:48.430753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-7c39e9db-f6ad-4c40-afcd-43635f4274a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:11:48.432259 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4305/8537] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:11:48 2022] DELETE /identity/v3/projects/df3b324edaad45b09b37c299e4fff37e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:11:48.437463 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe87e7-da04-448f-ae97-16ab155dde9b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:48.437921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe87e7-da04-448f-ae97-16ab155dde9b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:48.438037 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe87e7-da04-448f-ae97-16ab155dde9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:48.458559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-3fbe87e7-da04-448f-ae97-16ab155dde9b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:11:48.459760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3fbe87e7-da04-448f-ae97-16ab155dde9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:48.519826 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4233/8538] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:11:48.527557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde5e77-88cb-47c5-9559-768f37f01de6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:48.528438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde5e77-88cb-47c5-9559-768f37f01de6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:48.528438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde5e77-88cb-47c5-9559-768f37f01de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:48.550104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4cde5e77-88cb-47c5-9559-768f37f01de6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:11:48.551416 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4cde5e77-88cb-47c5-9559-768f37f01de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:48.559446 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4306/8539] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:11:48.563741 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe87e7-da04-448f-ae97-16ab155dde9b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:48.574295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe87e7-da04-448f-ae97-16ab155dde9b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:48.578979 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fe7f6-3772-43db-8ddb-2149540b52c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:48.579617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fe7f6-3772-43db-8ddb-2149540b52c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:48.579899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fe7f6-3772-43db-8ddb-2149540b52c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:48.580202 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fe7f6-3772-43db-8ddb-2149540b52c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:48.581384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fe7f6-3772-43db-8ddb-2149540b52c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:11:48.582140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fe7f6-3772-43db-8ddb-2149540b52c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:48.583759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fe7f6-3772-43db-8ddb-2149540b52c3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:48.595721 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4234/8540] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:11:48.601200 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde5e77-88cb-47c5-9559-768f37f01de6 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:48.610464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde5e77-88cb-47c5-9559-768f37f01de6 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:48.615303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29df9f-3c3d-4c06-acdc-a81f8040702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:48.615899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29df9f-3c3d-4c06-acdc-a81f8040702b admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:48.616208 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29df9f-3c3d-4c06-acdc-a81f8040702b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:48.616486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29df9f-3c3d-4c06-acdc-a81f8040702b admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:48.617126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29df9f-3c3d-4c06-acdc-a81f8040702b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:48.619031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29df9f-3c3d-4c06-acdc-a81f8040702b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:48.711689 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4307/8541] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:11:48 2022] POST /identity/v3/projects => generated 389 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:11:48.715872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fe7f6-3772-43db-8ddb-2149540b52c3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:48.726404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fe7f6-3772-43db-8ddb-2149540b52c3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:48.745989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:48.784826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e95c9-29f2-467e-bde9-afee59803f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:48.785428 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e95c9-29f2-467e-bde9-afee59803f41 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:48.785710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e95c9-29f2-467e-bde9-afee59803f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:48.785985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e95c9-29f2-467e-bde9-afee59803f41 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:48.786617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e95c9-29f2-467e-bde9-afee59803f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:48.788599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e95c9-29f2-467e-bde9-afee59803f41 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:48.889412 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4235/8542] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:11:48 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:11:48.893405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29df9f-3c3d-4c06-acdc-a81f8040702b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:48.904512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29df9f-3c3d-4c06-acdc-a81f8040702b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:48.909504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e582aa-4e0c-445e-92b8-7288ab5462a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:48.910058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e582aa-4e0c-445e-92b8-7288ab5462a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:48.910340 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e582aa-4e0c-445e-92b8-7288ab5462a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:48.910608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e582aa-4e0c-445e-92b8-7288ab5462a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:48.911245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e582aa-4e0c-445e-92b8-7288ab5462a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:48.912868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e582aa-4e0c-445e-92b8-7288ab5462a5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:48.922842 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4308/8543] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:11:48.927317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e95c9-29f2-467e-bde9-afee59803f41 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:48.937534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e95c9-29f2-467e-bde9-afee59803f41 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:48.942868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c05d00-2982-48b6-8e41-e3edaf81b35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:48.943491 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c05d00-2982-48b6-8e41-e3edaf81b35a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:48.943774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c05d00-2982-48b6-8e41-e3edaf81b35a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:48.944067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c05d00-2982-48b6-8e41-e3edaf81b35a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:48.944724 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c05d00-2982-48b6-8e41-e3edaf81b35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:48.946353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c05d00-2982-48b6-8e41-e3edaf81b35a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:48.959175 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4236/8544] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:11:48.964202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e582aa-4e0c-445e-92b8-7288ab5462a5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:48.975124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e582aa-4e0c-445e-92b8-7288ab5462a5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:48.980554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21c3de-9044-4f61-9836-d0118d387c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:48.981214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21c3de-9044-4f61-9836-d0118d387c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:48.981496 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21c3de-9044-4f61-9836-d0118d387c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:48.981773 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21c3de-9044-4f61-9836-d0118d387c9a admin admin] PATH_INFO: `/v3/projects/1825132ec3784abd99c6d5ccd714ae94/users/64630fa5a2cd4540a17605f39744dc8d/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:48.997283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21c3de-9044-4f61-9836-d0118d387c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1825132ec3784abd99c6d5ccd714ae94, user_id=64630fa5a2cd4540a17605f39744dc8d, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:49.000251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21c3de-9044-4f61-9836-d0118d387c9a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:49.078307 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4309/8545] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:11:48 2022] PUT /identity/v3/projects/1825132ec3784abd99c6d5ccd714ae94/users/64630fa5a2cd4540a17605f39744dc8d/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:11:49.088748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575c3b6-d447-4329-83f2-2a86778b7376 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:49.092827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575c3b6-d447-4329-83f2-2a86778b7376 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:49.092827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575c3b6-d447-4329-83f2-2a86778b7376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:49.119306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9575c3b6-d447-4329-83f2-2a86778b7376 None None] MFA Rules not processed for user `64630fa5a2cd4540a17605f39744dc8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:11:49.120809 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9575c3b6-d447-4329-83f2-2a86778b7376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:49.185331 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4237/8546] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:11:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:11:49.189825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21c3de-9044-4f61-9836-d0118d387c9a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:49.223408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:49.251945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21c3de-9044-4f61-9836-d0118d387c9a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:49.259179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eff8c-9c5a-4757-8510-ba12ee33278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:49.259179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eff8c-9c5a-4757-8510-ba12ee33278c admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:49.259179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eff8c-9c5a-4757-8510-ba12ee33278c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:49.259179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eff8c-9c5a-4757-8510-ba12ee33278c admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:49.264903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eff8c-9c5a-4757-8510-ba12ee33278c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:49.264903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eff8c-9c5a-4757-8510-ba12ee33278c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:49.405255 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4310/8547] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:11:49 2022] POST /identity/v3/projects => generated 389 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:11:49.410128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575c3b6-d447-4329-83f2-2a86778b7376 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:49.421569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575c3b6-d447-4329-83f2-2a86778b7376 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:49.480758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e0c0d-f77e-4407-bc6d-96e0db04771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:49.481394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e0c0d-f77e-4407-bc6d-96e0db04771f admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:49.481548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e0c0d-f77e-4407-bc6d-96e0db04771f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:49.481827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e0c0d-f77e-4407-bc6d-96e0db04771f admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:49.482460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e0c0d-f77e-4407-bc6d-96e0db04771f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:49.484448 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e0c0d-f77e-4407-bc6d-96e0db04771f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:49.586475 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4238/8548] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:11:49 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:11:49.590404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eff8c-9c5a-4757-8510-ba12ee33278c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:49.601985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eff8c-9c5a-4757-8510-ba12ee33278c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:49.606805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ade98-da55-4f3a-9d54-ae42763cec61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:49.607433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ade98-da55-4f3a-9d54-ae42763cec61 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:49.607724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ade98-da55-4f3a-9d54-ae42763cec61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:49.608001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ade98-da55-4f3a-9d54-ae42763cec61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:49.608681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ade98-da55-4f3a-9d54-ae42763cec61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:49.610276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ade98-da55-4f3a-9d54-ae42763cec61 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:49.621163 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4311/8549] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:11:49.625078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e0c0d-f77e-4407-bc6d-96e0db04771f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:49.635466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e0c0d-f77e-4407-bc6d-96e0db04771f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:49.640335 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df7669-482b-48c0-92ce-f84f34c3f385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:49.640933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df7669-482b-48c0-92ce-f84f34c3f385 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:49.641216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df7669-482b-48c0-92ce-f84f34c3f385 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:49.641494 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df7669-482b-48c0-92ce-f84f34c3f385 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:49.642140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df7669-482b-48c0-92ce-f84f34c3f385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:49.643930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df7669-482b-48c0-92ce-f84f34c3f385 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:49.653947 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4239/8550] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:11:49.658370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ade98-da55-4f3a-9d54-ae42763cec61 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:49.670620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ade98-da55-4f3a-9d54-ae42763cec61 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:49.676302 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ab463-9490-4fa5-8075-d6681520cc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:49.676947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ab463-9490-4fa5-8075-d6681520cc6b admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:49.677229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ab463-9490-4fa5-8075-d6681520cc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:49.677507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ab463-9490-4fa5-8075-d6681520cc6b admin admin] PATH_INFO: `/v3/projects/027796de04c64eaf8a8f76506d16e79c/users/6af50dfc13d54bafb7314346f4614686/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:49.692419 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ab463-9490-4fa5-8075-d6681520cc6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=027796de04c64eaf8a8f76506d16e79c, user_id=6af50dfc13d54bafb7314346f4614686, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:49.695203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ab463-9490-4fa5-8075-d6681520cc6b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:49.775107 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4312/8551] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:11:49 2022] PUT /identity/v3/projects/027796de04c64eaf8a8f76506d16e79c/users/6af50dfc13d54bafb7314346f4614686/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:11:49.787069 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55f662-42ef-438c-868c-d4e8e3dccc35 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:49.791667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55f662-42ef-438c-868c-d4e8e3dccc35 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:49.791667 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55f662-42ef-438c-868c-d4e8e3dccc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:49.807917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:49.816414 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ca55f662-42ef-438c-868c-d4e8e3dccc35 None None] MFA Rules not processed for user `6af50dfc13d54bafb7314346f4614686`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:11:49.817620 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ca55f662-42ef-438c-868c-d4e8e3dccc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:49.881576 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4240/8552] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:11:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:11:49.886121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ab463-9490-4fa5-8075-d6681520cc6b admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:49.948995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ab463-9490-4fa5-8075-d6681520cc6b admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:49.954177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18a815-984b-4454-8743-3b2ed44e0d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:49.954790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18a815-984b-4454-8743-3b2ed44e0d2f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:49.955072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18a815-984b-4454-8743-3b2ed44e0d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:49.955348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18a815-984b-4454-8743-3b2ed44e0d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:49.956716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18a815-984b-4454-8743-3b2ed44e0d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:49.958654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18a815-984b-4454-8743-3b2ed44e0d2f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:50.036929 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4313/8553] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:11:49 2022] POST /identity/v3/projects => generated 389 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:11:50.040804 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55f662-42ef-438c-868c-d4e8e3dccc35 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:50.051608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55f662-42ef-438c-868c-d4e8e3dccc35 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:50.106873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c24860-b38f-4912-b534-d51ca7fad9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:50.107469 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c24860-b38f-4912-b534-d51ca7fad9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:50.107751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c24860-b38f-4912-b534-d51ca7fad9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:50.108044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c24860-b38f-4912-b534-d51ca7fad9f8 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:50.108704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c24860-b38f-4912-b534-d51ca7fad9f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:50.110697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c24860-b38f-4912-b534-d51ca7fad9f8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:50.195412 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4241/8554] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:11:50 2022] POST /identity/v3/users => generated 301 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:11:50.199583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18a815-984b-4454-8743-3b2ed44e0d2f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:50.210824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18a815-984b-4454-8743-3b2ed44e0d2f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:50.215484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938541da-36bf-4bab-aea8-5e169a510bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:50.216079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938541da-36bf-4bab-aea8-5e169a510bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:50.216469 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938541da-36bf-4bab-aea8-5e169a510bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:50.216753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938541da-36bf-4bab-aea8-5e169a510bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:50.217385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938541da-36bf-4bab-aea8-5e169a510bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:50.218976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938541da-36bf-4bab-aea8-5e169a510bc8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:50.231617 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4314/8555] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:11:50.235775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c24860-b38f-4912-b534-d51ca7fad9f8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:50.246095 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c24860-b38f-4912-b534-d51ca7fad9f8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:50.250655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8ebfb-b151-4bc1-9efe-7776f5eaf59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:50.251294 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8ebfb-b151-4bc1-9efe-7776f5eaf59d admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:50.251578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8ebfb-b151-4bc1-9efe-7776f5eaf59d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:50.251851 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8ebfb-b151-4bc1-9efe-7776f5eaf59d admin admin] PATH_INFO: `/v3/projects/cf93970b528c48cc96ec39ee91d2245f/users/35789c6b340747ea9b82435480c72060/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:50.267154 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8ebfb-b151-4bc1-9efe-7776f5eaf59d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf93970b528c48cc96ec39ee91d2245f, user_id=35789c6b340747ea9b82435480c72060, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:50.270764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8ebfb-b151-4bc1-9efe-7776f5eaf59d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:50.364178 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4242/8556] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:11:50 2022] PUT /identity/v3/projects/cf93970b528c48cc96ec39ee91d2245f/users/35789c6b340747ea9b82435480c72060/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:11:50.368040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938541da-36bf-4bab-aea8-5e169a510bc8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:50.379184 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938541da-36bf-4bab-aea8-5e169a510bc8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:50.431359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:50.439830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5f10f-e905-48d1-8770-4efc55ca6d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:50.441035 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5f10f-e905-48d1-8770-4efc55ca6d60 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:50.441348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5f10f-e905-48d1-8770-4efc55ca6d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:50.441637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5f10f-e905-48d1-8770-4efc55ca6d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:50.442433 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5f10f-e905-48d1-8770-4efc55ca6d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:50.444015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5f10f-e905-48d1-8770-4efc55ca6d60 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:50.454254 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4315/8557] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:11:50.459261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8ebfb-b151-4bc1-9efe-7776f5eaf59d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:50.469821 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8ebfb-b151-4bc1-9efe-7776f5eaf59d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:50.474563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462413a-7166-4e5c-ae3f-1cb70a31c6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:50.476369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462413a-7166-4e5c-ae3f-1cb70a31c6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:50.476369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462413a-7166-4e5c-ae3f-1cb70a31c6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:50.476369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462413a-7166-4e5c-ae3f-1cb70a31c6fd admin admin] PATH_INFO: `/v3/projects/cf93970b528c48cc96ec39ee91d2245f/users/35789c6b340747ea9b82435480c72060/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:50.477769 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462413a-7166-4e5c-ae3f-1cb70a31c6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf93970b528c48cc96ec39ee91d2245f, user_id=35789c6b340747ea9b82435480c72060, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:50.480438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462413a-7166-4e5c-ae3f-1cb70a31c6fd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:50.490599 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4243/8558] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:11:50 2022] PUT /identity/v3/projects/cf93970b528c48cc96ec39ee91d2245f/users/35789c6b340747ea9b82435480c72060/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:11:50.500770 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c6b22-c11a-4218-ad25-f20bd2adf058 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:50.501055 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c6b22-c11a-4218-ad25-f20bd2adf058 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:50.501328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c6b22-c11a-4218-ad25-f20bd2adf058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:50.534908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-984c6b22-c11a-4218-ad25-f20bd2adf058 None None] MFA Rules not processed for user `35789c6b340747ea9b82435480c72060`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:11:50.536153 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-984c6b22-c11a-4218-ad25-f20bd2adf058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:50.610277 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4316/8559] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:11:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:11:50.625118 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462413a-7166-4e5c-ae3f-1cb70a31c6fd admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:50.626849 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-a462413a-7166-4e5c-ae3f-1cb70a31c6fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:50.683951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:11:50.732813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462413a-7166-4e5c-ae3f-1cb70a31c6fd admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:50.738993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d8fb7-69e6-4f97-8608-f15bfa9e63da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:50.739590 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d8fb7-69e6-4f97-8608-f15bfa9e63da service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:50.739872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d8fb7-69e6-4f97-8608-f15bfa9e63da service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:50.740156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d8fb7-69e6-4f97-8608-f15bfa9e63da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:50.796921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d8fb7-69e6-4f97-8608-f15bfa9e63da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:50.798522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d8fb7-69e6-4f97-8608-f15bfa9e63da service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:50.808061 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4244/8560] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:11:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:11:53.511494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c6b22-c11a-4218-ad25-f20bd2adf058 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:53.512938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-984c6b22-c11a-4218-ad25-f20bd2adf058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:53.585956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c6b22-c11a-4218-ad25-f20bd2adf058 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:53.589667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09d228-9ba8-4547-a3c5-048bc2f6dc2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:53.590294 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09d228-9ba8-4547-a3c5-048bc2f6dc2c service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:53.590577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09d228-9ba8-4547-a3c5-048bc2f6dc2c service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:53.590853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09d228-9ba8-4547-a3c5-048bc2f6dc2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:53.601843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09d228-9ba8-4547-a3c5-048bc2f6dc2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:53.603320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09d228-9ba8-4547-a3c5-048bc2f6dc2c service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:53.615098 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4317/8561] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:11:53 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:11:58.416400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ff9fb-9640-401b-a86a-c03954d33a65 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:58.417470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ff9fb-9640-401b-a86a-c03954d33a65 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:58.417932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ff9fb-9640-401b-a86a-c03954d33a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:58.438567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-243ff9fb-9640-401b-a86a-c03954d33a65 None None] MFA Rules not processed for user `64630fa5a2cd4540a17605f39744dc8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:11:58.439827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-243ff9fb-9640-401b-a86a-c03954d33a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:58.448981 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4245/8562] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:11:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:11:58.487813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09d228-9ba8-4547-a3c5-048bc2f6dc2c service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:11:58.489485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9f09d228-9ba8-4547-a3c5-048bc2f6dc2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:58.566924 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09d228-9ba8-4547-a3c5-048bc2f6dc2c service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:11:58.570573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664796ac-df6d-4d0b-b05c-38e7e0caa444 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:11:58.571213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664796ac-df6d-4d0b-b05c-38e7e0caa444 service glance] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:58.571487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664796ac-df6d-4d0b-b05c-38e7e0caa444 service glance] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:58.571755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664796ac-df6d-4d0b-b05c-38e7e0caa444 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:58.573524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-664796ac-df6d-4d0b-b05c-38e7e0caa444 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:11:58.590684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664796ac-df6d-4d0b-b05c-38e7e0caa444 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:11:58.592123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664796ac-df6d-4d0b-b05c-38e7e0caa444 service glance] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:11:58.607051 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4318/8563] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:11:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:11:58.966748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ad082-59e1-4cc2-a82c-ebf597b992f9 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:11:58.967031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ad082-59e1-4cc2-a82c-ebf597b992f9 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:11:58.967684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ad082-59e1-4cc2-a82c-ebf597b992f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:11:58.974876 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-0d6ad082-59e1-4cc2-a82c-ebf597b992f9 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:11:58.974876 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:11:58.974876 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:11:58.974876 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:11:58.974876 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:11:58.974876 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:11:58.974876 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:11:58.974876 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:11:58.974876 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:11:58.974876 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:11:58.974876 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:11:58.974876 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:11:58.974876 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:11:58.976016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:11:58.976016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:11:58.976016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:11:58.976016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:11:58.976016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:11:58.976016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:11:58.976016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:11:58.976016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:11:58.976016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:11:58.976016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:11:58.976016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:11:58.976016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:11:58.976016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:11:58.976016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:11:58.976016 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:11:58.977234 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4246/8564] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:11:58 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:12:03.148801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664796ac-df6d-4d0b-b05c-38e7e0caa444 service glance] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:03.164472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:03.219066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664796ac-df6d-4d0b-b05c-38e7e0caa444 service glance] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:03.223919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d704e-27c5-4da6-9f6e-855297ab0654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:03.224580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d704e-27c5-4da6-9f6e-855297ab0654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:03.224855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d704e-27c5-4da6-9f6e-855297ab0654 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:03.225179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d704e-27c5-4da6-9f6e-855297ab0654 admin admin] PATH_INFO: `/v3/users/64630fa5a2cd4540a17605f39744dc8d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:03.226296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d704e-27c5-4da6-9f6e-855297ab0654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64630fa5a2cd4540a17605f39744dc8d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:03.228266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d704e-27c5-4da6-9f6e-855297ab0654 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:03.423142 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2e9d704e-27c5-4da6-9f6e-855297ab0654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64630fa5a2cd4540a17605f39744dc8d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:03.423713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2e9d704e-27c5-4da6-9f6e-855297ab0654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64630fa5a2cd4540a17605f39744dc8d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:03.504201 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2e9d704e-27c5-4da6-9f6e-855297ab0654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64630fa5a2cd4540a17605f39744dc8d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:03.504827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2e9d704e-27c5-4da6-9f6e-855297ab0654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64630fa5a2cd4540a17605f39744dc8d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:03.520872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-2e9d704e-27c5-4da6-9f6e-855297ab0654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64630fa5a2cd4540a17605f39744dc8d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:03.534476 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4319/8565] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:12:03 2022] DELETE /identity/v3/users/64630fa5a2cd4540a17605f39744dc8d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:03.539089 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053c78a-8232-4fe4-91c8-8018c70194a6 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:03.539579 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053c78a-8232-4fe4-91c8-8018c70194a6 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:03.539683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053c78a-8232-4fe4-91c8-8018c70194a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:03.559222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f053c78a-8232-4fe4-91c8-8018c70194a6 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:03.560446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f053c78a-8232-4fe4-91c8-8018c70194a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:03.620284 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4247/8566] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:12:03.630515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d704e-27c5-4da6-9f6e-855297ab0654 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:03.631910 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2e9d704e-27c5-4da6-9f6e-855297ab0654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:03.691625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d704e-27c5-4da6-9f6e-855297ab0654 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:03.695122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5f75f-3db0-4521-b967-de81abd38f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:03.695719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5f75f-3db0-4521-b967-de81abd38f0d service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:03.695997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5f75f-3db0-4521-b967-de81abd38f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:03.696304 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5f75f-3db0-4521-b967-de81abd38f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:03.705734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5f75f-3db0-4521-b967-de81abd38f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:03.707154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5f75f-3db0-4521-b967-de81abd38f0d service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:03.717033 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4320/8567] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:12:03.982559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053c78a-8232-4fe4-91c8-8018c70194a6 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:03.984838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f053c78a-8232-4fe4-91c8-8018c70194a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:03.997578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053c78a-8232-4fe4-91c8-8018c70194a6 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:04.002304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2da059-2023-43e2-a8fb-98fb7692e0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:04.002947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da059-2023-43e2-a8fb-98fb7692e0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:04.003277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da059-2023-43e2-a8fb-98fb7692e0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:04.003556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da059-2023-43e2-a8fb-98fb7692e0f7 admin admin] PATH_INFO: `/v3/projects/1825132ec3784abd99c6d5ccd714ae94` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:04.004720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2da059-2023-43e2-a8fb-98fb7692e0f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1825132ec3784abd99c6d5ccd714ae94)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:04.006646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2da059-2023-43e2-a8fb-98fb7692e0f7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:04.118693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea2da059-2023-43e2-a8fb-98fb7692e0f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1825132ec3784abd99c6d5ccd714ae94', 'request_id': 'req-ea2da059-2023-43e2-a8fb-98fb7692e0f7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:04.120654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:04.124646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea2da059-2023-43e2-a8fb-98fb7692e0f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1825132ec3784abd99c6d5ccd714ae94', 'request_id': 'req-ea2da059-2023-43e2-a8fb-98fb7692e0f7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:04.131103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea2da059-2023-43e2-a8fb-98fb7692e0f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1825132ec3784abd99c6d5ccd714ae94', 'request_id': 'req-ea2da059-2023-43e2-a8fb-98fb7692e0f7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:04.203566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea2da059-2023-43e2-a8fb-98fb7692e0f7 admin admin] The token cache is being invalidate because project 1825132ec3784abd99c6d5ccd714ae94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:12:04.203892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea2da059-2023-43e2-a8fb-98fb7692e0f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:04.204547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-ea2da059-2023-43e2-a8fb-98fb7692e0f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:04.206047 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4248/8568] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:12:03 2022] DELETE /identity/v3/projects/1825132ec3784abd99c6d5ccd714ae94 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:04.211256 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5f75f-3db0-4521-b967-de81abd38f0d service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:04.221179 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5f75f-3db0-4521-b967-de81abd38f0d service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:04.252565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:04.287130 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af140325-42f7-44f3-a709-4779b9c67056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:04.289446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af140325-42f7-44f3-a709-4779b9c67056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:04.289446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af140325-42f7-44f3-a709-4779b9c67056 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:04.289446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af140325-42f7-44f3-a709-4779b9c67056 admin admin] PATH_INFO: `/v3/users/6af50dfc13d54bafb7314346f4614686` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:04.289804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af140325-42f7-44f3-a709-4779b9c67056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6af50dfc13d54bafb7314346f4614686)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:04.291602 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af140325-42f7-44f3-a709-4779b9c67056 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:04.497681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af140325-42f7-44f3-a709-4779b9c67056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6af50dfc13d54bafb7314346f4614686'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:04.498276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af140325-42f7-44f3-a709-4779b9c67056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6af50dfc13d54bafb7314346f4614686'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:04.574887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af140325-42f7-44f3-a709-4779b9c67056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6af50dfc13d54bafb7314346f4614686'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:04.575589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af140325-42f7-44f3-a709-4779b9c67056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6af50dfc13d54bafb7314346f4614686'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:04.588825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-af140325-42f7-44f3-a709-4779b9c67056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6af50dfc13d54bafb7314346f4614686'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:04.601601 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4321/8569] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:12:04 2022] DELETE /identity/v3/users/6af50dfc13d54bafb7314346f4614686 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:05.008051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2da059-2023-43e2-a8fb-98fb7692e0f7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:05.009563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ea2da059-2023-43e2-a8fb-98fb7692e0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:05.024035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2da059-2023-43e2-a8fb-98fb7692e0f7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:05.082570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255c686-090c-4ba3-aa47-50bbf8509426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:05.083199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c686-090c-4ba3-aa47-50bbf8509426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:05.083478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c686-090c-4ba3-aa47-50bbf8509426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:05.083753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c686-090c-4ba3-aa47-50bbf8509426 admin admin] PATH_INFO: `/v3/projects/027796de04c64eaf8a8f76506d16e79c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:05.085460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255c686-090c-4ba3-aa47-50bbf8509426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=027796de04c64eaf8a8f76506d16e79c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:05.087399 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255c686-090c-4ba3-aa47-50bbf8509426 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:05.195795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2255c686-090c-4ba3-aa47-50bbf8509426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027796de04c64eaf8a8f76506d16e79c', 'request_id': 'req-2255c686-090c-4ba3-aa47-50bbf8509426'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:05.201195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2255c686-090c-4ba3-aa47-50bbf8509426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027796de04c64eaf8a8f76506d16e79c', 'request_id': 'req-2255c686-090c-4ba3-aa47-50bbf8509426'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:05.207234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2255c686-090c-4ba3-aa47-50bbf8509426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027796de04c64eaf8a8f76506d16e79c', 'request_id': 'req-2255c686-090c-4ba3-aa47-50bbf8509426'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:05.329330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2255c686-090c-4ba3-aa47-50bbf8509426 admin admin] The token cache is being invalidate because project 027796de04c64eaf8a8f76506d16e79c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:12:05.329550 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2255c686-090c-4ba3-aa47-50bbf8509426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:05.330156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-2255c686-090c-4ba3-aa47-50bbf8509426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:05.331730 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4249/8570] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:12:05 2022] DELETE /identity/v3/projects/027796de04c64eaf8a8f76506d16e79c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:05.336845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af140325-42f7-44f3-a709-4779b9c67056 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:05.338393 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-af140325-42f7-44f3-a709-4779b9c67056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:05.351336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af140325-42f7-44f3-a709-4779b9c67056 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:05.410131 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a22048-7b3b-4627-ad0c-7f207aa57512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:05.410765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a22048-7b3b-4627-ad0c-7f207aa57512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:05.411048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a22048-7b3b-4627-ad0c-7f207aa57512 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:05.411319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a22048-7b3b-4627-ad0c-7f207aa57512 admin admin] PATH_INFO: `/v3/users/35789c6b340747ea9b82435480c72060` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:05.412462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a22048-7b3b-4627-ad0c-7f207aa57512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35789c6b340747ea9b82435480c72060)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:05.414395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a22048-7b3b-4627-ad0c-7f207aa57512 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:05.637457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-91a22048-7b3b-4627-ad0c-7f207aa57512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35789c6b340747ea9b82435480c72060'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:05.638040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-91a22048-7b3b-4627-ad0c-7f207aa57512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35789c6b340747ea9b82435480c72060'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:05.761046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-91a22048-7b3b-4627-ad0c-7f207aa57512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35789c6b340747ea9b82435480c72060'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:05.761705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-91a22048-7b3b-4627-ad0c-7f207aa57512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35789c6b340747ea9b82435480c72060'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:05.763169 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:05.774533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-91a22048-7b3b-4627-ad0c-7f207aa57512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35789c6b340747ea9b82435480c72060'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:05.786914 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4322/8571] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:12:05 2022] DELETE /identity/v3/users/35789c6b340747ea9b82435480c72060 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:06.226560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255c686-090c-4ba3-aa47-50bbf8509426 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:06.228476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2255c686-090c-4ba3-aa47-50bbf8509426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:06.242985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255c686-090c-4ba3-aa47-50bbf8509426 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:06.309792 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d751a3-6d8f-4f16-a8c1-addbbafd105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:06.310427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d751a3-6d8f-4f16-a8c1-addbbafd105c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:06.310712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d751a3-6d8f-4f16-a8c1-addbbafd105c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:06.310991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d751a3-6d8f-4f16-a8c1-addbbafd105c admin admin] PATH_INFO: `/v3/projects/cf93970b528c48cc96ec39ee91d2245f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:06.312120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d751a3-6d8f-4f16-a8c1-addbbafd105c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf93970b528c48cc96ec39ee91d2245f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:06.314085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d751a3-6d8f-4f16-a8c1-addbbafd105c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:06.325191 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:06.435973 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7d751a3-6d8f-4f16-a8c1-addbbafd105c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf93970b528c48cc96ec39ee91d2245f', 'request_id': 'req-a7d751a3-6d8f-4f16-a8c1-addbbafd105c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:06.441568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7d751a3-6d8f-4f16-a8c1-addbbafd105c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf93970b528c48cc96ec39ee91d2245f', 'request_id': 'req-a7d751a3-6d8f-4f16-a8c1-addbbafd105c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:06.447921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7d751a3-6d8f-4f16-a8c1-addbbafd105c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf93970b528c48cc96ec39ee91d2245f', 'request_id': 'req-a7d751a3-6d8f-4f16-a8c1-addbbafd105c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:06.544770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7d751a3-6d8f-4f16-a8c1-addbbafd105c admin admin] The token cache is being invalidate because project cf93970b528c48cc96ec39ee91d2245f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:12:06.545007 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7d751a3-6d8f-4f16-a8c1-addbbafd105c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:06.545653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a7d751a3-6d8f-4f16-a8c1-addbbafd105c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:06.547219 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4250/8572] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:12:06 2022] DELETE /identity/v3/projects/cf93970b528c48cc96ec39ee91d2245f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:12:06.552296 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf489268-208e-4619-907c-ff8191ad4097 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:06.552801 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf489268-208e-4619-907c-ff8191ad4097 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:06.552922 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf489268-208e-4619-907c-ff8191ad4097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:06.573601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bf489268-208e-4619-907c-ff8191ad4097 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:06.574837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bf489268-208e-4619-907c-ff8191ad4097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:06.635628 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4323/8573] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:12:06.643544 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbf65e-2058-44a3-9702-e0bc393f8533 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:06.643837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbf65e-2058-44a3-9702-e0bc393f8533 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:06.644120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbf65e-2058-44a3-9702-e0bc393f8533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:06.665554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-b0fbf65e-2058-44a3-9702-e0bc393f8533 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:06.666805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-b0fbf65e-2058-44a3-9702-e0bc393f8533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:06.674898 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4251/8574] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:12:06.679072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf489268-208e-4619-907c-ff8191ad4097 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:06.690148 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf489268-208e-4619-907c-ff8191ad4097 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:06.694763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baca1b4-e47f-4210-b26b-11d812f75054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:06.695966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baca1b4-e47f-4210-b26b-11d812f75054 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:06.696363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baca1b4-e47f-4210-b26b-11d812f75054 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:06.696646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baca1b4-e47f-4210-b26b-11d812f75054 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:06.697293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baca1b4-e47f-4210-b26b-11d812f75054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:12:06.697598 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baca1b4-e47f-4210-b26b-11d812f75054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:06.699192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baca1b4-e47f-4210-b26b-11d812f75054 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:06.710660 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4324/8575] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:12:06.715470 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbf65e-2058-44a3-9702-e0bc393f8533 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:06.724960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbf65e-2058-44a3-9702-e0bc393f8533 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:06.729691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f36f46-825a-4835-af83-ca031b4b65aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:06.730287 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f36f46-825a-4835-af83-ca031b4b65aa admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:06.730569 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f36f46-825a-4835-af83-ca031b4b65aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:06.730846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f36f46-825a-4835-af83-ca031b4b65aa admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:06.731484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f36f46-825a-4835-af83-ca031b4b65aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:06.733426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f36f46-825a-4835-af83-ca031b4b65aa admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:06.820022 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4252/8576] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:12:06 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:12:06.825266 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baca1b4-e47f-4210-b26b-11d812f75054 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:06.837671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baca1b4-e47f-4210-b26b-11d812f75054 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:06.900398 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7096e78-37bf-4b49-8e4a-f2147ab981e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:06.900999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7096e78-37bf-4b49-8e4a-f2147ab981e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:06.901282 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7096e78-37bf-4b49-8e4a-f2147ab981e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:06.901551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7096e78-37bf-4b49-8e4a-f2147ab981e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:06.902177 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7096e78-37bf-4b49-8e4a-f2147ab981e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:06.904066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7096e78-37bf-4b49-8e4a-f2147ab981e8 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:07.010563 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4325/8577] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:12:06 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:12:07.014786 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f36f46-825a-4835-af83-ca031b4b65aa admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:07.025733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f36f46-825a-4835-af83-ca031b4b65aa admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:07.030970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064706af-b1aa-48d9-979b-b8f4966bbef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:07.031613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064706af-b1aa-48d9-979b-b8f4966bbef9 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:07.031891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064706af-b1aa-48d9-979b-b8f4966bbef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:07.032179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064706af-b1aa-48d9-979b-b8f4966bbef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:07.032831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064706af-b1aa-48d9-979b-b8f4966bbef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:07.034468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064706af-b1aa-48d9-979b-b8f4966bbef9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:07.044837 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4253/8578] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:12:07.048932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7096e78-37bf-4b49-8e4a-f2147ab981e8 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:07.059854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7096e78-37bf-4b49-8e4a-f2147ab981e8 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:07.064672 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630de3b-d60b-4485-a8d1-b0f1eec42ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:07.065270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630de3b-d60b-4485-a8d1-b0f1eec42ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:07.065552 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630de3b-d60b-4485-a8d1-b0f1eec42ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:07.065829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630de3b-d60b-4485-a8d1-b0f1eec42ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:07.066462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630de3b-d60b-4485-a8d1-b0f1eec42ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:07.068051 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630de3b-d60b-4485-a8d1-b0f1eec42ad1 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:07.079667 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4326/8579] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:12:07.083748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064706af-b1aa-48d9-979b-b8f4966bbef9 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:07.094494 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064706af-b1aa-48d9-979b-b8f4966bbef9 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:07.099175 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1f201-bba8-4cf8-83cd-67db0e132e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:07.099826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1f201-bba8-4cf8-83cd-67db0e132e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:07.100139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1f201-bba8-4cf8-83cd-67db0e132e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:07.100453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1f201-bba8-4cf8-83cd-67db0e132e6e admin admin] PATH_INFO: `/v3/projects/5e82ecb60102415888768543069927ed/users/7cdc73bdfdd34846bc9f2625ef97728a/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:07.115837 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1f201-bba8-4cf8-83cd-67db0e132e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e82ecb60102415888768543069927ed, user_id=7cdc73bdfdd34846bc9f2625ef97728a, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:07.119143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1f201-bba8-4cf8-83cd-67db0e132e6e admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:07.199211 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4254/8580] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:12:07 2022] PUT /identity/v3/projects/5e82ecb60102415888768543069927ed/users/7cdc73bdfdd34846bc9f2625ef97728a/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:07.204376 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961d756-131c-4cad-b631-32106a1afe9d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:07.204697 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961d756-131c-4cad-b631-32106a1afe9d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:07.204976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961d756-131c-4cad-b631-32106a1afe9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:07.225083 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6961d756-131c-4cad-b631-32106a1afe9d None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:07.226403 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6961d756-131c-4cad-b631-32106a1afe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:07.260762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:07.287118 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4327/8581] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:12:07.297693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1f201-bba8-4cf8-83cd-67db0e132e6e admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:07.299562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9cb1f201-bba8-4cf8-83cd-67db0e132e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:07.360139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1f201-bba8-4cf8-83cd-67db0e132e6e admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:07.363766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a1cb6-fc7d-4a8b-906f-de4e20a076d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:07.364402 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a1cb6-fc7d-4a8b-906f-de4e20a076d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:07.364705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a1cb6-fc7d-4a8b-906f-de4e20a076d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:07.364983 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a1cb6-fc7d-4a8b-906f-de4e20a076d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:07.374690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a1cb6-fc7d-4a8b-906f-de4e20a076d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:07.376157 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a1cb6-fc7d-4a8b-906f-de4e20a076d2 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:07.385881 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4255/8582] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:12:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:12:08.763468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9478b-3799-44e3-a8d7-7c40c89991ea None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:08.764049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9478b-3799-44e3-a8d7-7c40c89991ea None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:08.764049 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9478b-3799-44e3-a8d7-7c40c89991ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:08.793156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bcc9478b-3799-44e3-a8d7-7c40c89991ea None None] MFA Rules not processed for user `7cdc73bdfdd34846bc9f2625ef97728a`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:08.794378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bcc9478b-3799-44e3-a8d7-7c40c89991ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:08.861695 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4328/8583] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:12:08.866060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a1cb6-fc7d-4a8b-906f-de4e20a076d2 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:08.877066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a1cb6-fc7d-4a8b-906f-de4e20a076d2 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:08.881666 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4936f-3ca9-49d6-874b-a36d26bdfbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:08.882254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4936f-3ca9-49d6-874b-a36d26bdfbdb admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:08.882534 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4936f-3ca9-49d6-874b-a36d26bdfbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:08.882879 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4936f-3ca9-49d6-874b-a36d26bdfbdb admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:08.883696 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4936f-3ca9-49d6-874b-a36d26bdfbdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:08.885626 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4936f-3ca9-49d6-874b-a36d26bdfbdb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:08.989405 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4256/8584] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:12:08 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:12:08.994395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9478b-3799-44e3-a8d7-7c40c89991ea None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:09.005812 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9478b-3799-44e3-a8d7-7c40c89991ea None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:09.070000 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29c0a4-5f8a-4e7a-81e6-6ea6a660b576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:09.070818 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c0a4-5f8a-4e7a-81e6-6ea6a660b576 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:09.071103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c0a4-5f8a-4e7a-81e6-6ea6a660b576 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:09.071381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c0a4-5f8a-4e7a-81e6-6ea6a660b576 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:09.072019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29c0a4-5f8a-4e7a-81e6-6ea6a660b576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:09.074138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29c0a4-5f8a-4e7a-81e6-6ea6a660b576 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:09.159366 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4329/8585] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:12:08 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:12:09.161253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4936f-3ca9-49d6-874b-a36d26bdfbdb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:09.173311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4936f-3ca9-49d6-874b-a36d26bdfbdb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:09.178755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4b85b-c13b-43a5-b206-a5809400f3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:09.179356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4b85b-c13b-43a5-b206-a5809400f3ed admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:09.180401 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4b85b-c13b-43a5-b206-a5809400f3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:09.180680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4b85b-c13b-43a5-b206-a5809400f3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:09.184645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4b85b-c13b-43a5-b206-a5809400f3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:09.184645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4b85b-c13b-43a5-b206-a5809400f3ed admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:09.194847 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4257/8586] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:12:09.199299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29c0a4-5f8a-4e7a-81e6-6ea6a660b576 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:09.210027 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29c0a4-5f8a-4e7a-81e6-6ea6a660b576 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:09.216771 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd159a2-bcee-4856-9bea-3d0d2a831f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:09.217454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd159a2-bcee-4856-9bea-3d0d2a831f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:09.217767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd159a2-bcee-4856-9bea-3d0d2a831f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:09.218097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd159a2-bcee-4856-9bea-3d0d2a831f4c admin admin] PATH_INFO: `/v3/projects/890508005b814ec7a38b1073c3c21a61/users/93d8fabb860049a59c882e09b5c1e403/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:09.236651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd159a2-bcee-4856-9bea-3d0d2a831f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=890508005b814ec7a38b1073c3c21a61, user_id=93d8fabb860049a59c882e09b5c1e403, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:09.241438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd159a2-bcee-4856-9bea-3d0d2a831f4c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:09.321719 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4330/8587] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:12:09 2022] PUT /identity/v3/projects/890508005b814ec7a38b1073c3c21a61/users/93d8fabb860049a59c882e09b5c1e403/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:09.325734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4b85b-c13b-43a5-b206-a5809400f3ed admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:09.332087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:09.335952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4b85b-c13b-43a5-b206-a5809400f3ed admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:09.392213 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bea77-7027-4e0a-ad13-b3d35c447371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:09.392902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bea77-7027-4e0a-ad13-b3d35c447371 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:09.393181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bea77-7027-4e0a-ad13-b3d35c447371 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:09.393453 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bea77-7027-4e0a-ad13-b3d35c447371 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:09.394081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bea77-7027-4e0a-ad13-b3d35c447371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:09.395669 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bea77-7027-4e0a-ad13-b3d35c447371 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:09.406136 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4258/8588] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:12:09.410700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd159a2-bcee-4856-9bea-3d0d2a831f4c admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:09.421921 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd159a2-bcee-4856-9bea-3d0d2a831f4c admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:09.426669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f98cc5-1140-48be-b244-a95c4f803da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:09.431997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f98cc5-1140-48be-b244-a95c4f803da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:09.431997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f98cc5-1140-48be-b244-a95c4f803da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:09.431997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f98cc5-1140-48be-b244-a95c4f803da4 admin admin] PATH_INFO: `/v3/projects/890508005b814ec7a38b1073c3c21a61/users/93d8fabb860049a59c882e09b5c1e403/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:09.431997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f98cc5-1140-48be-b244-a95c4f803da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=890508005b814ec7a38b1073c3c21a61, user_id=93d8fabb860049a59c882e09b5c1e403, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:09.433002 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f98cc5-1140-48be-b244-a95c4f803da4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:09.443474 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4331/8589] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:12:09 2022] PUT /identity/v3/projects/890508005b814ec7a38b1073c3c21a61/users/93d8fabb860049a59c882e09b5c1e403/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:10.903450 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892756a9-8ca7-4a73-8289-0d54b0012850 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:10.903984 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892756a9-8ca7-4a73-8289-0d54b0012850 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:10.904100 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892756a9-8ca7-4a73-8289-0d54b0012850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:10.935458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-892756a9-8ca7-4a73-8289-0d54b0012850 None None] MFA Rules not processed for user `93d8fabb860049a59c882e09b5c1e403`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:10.937094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-892756a9-8ca7-4a73-8289-0d54b0012850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:11.010517 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4259/8590] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:12:11.021327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c4a3e-7914-4840-8dac-b3303a977429 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:11.021810 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c4a3e-7914-4840-8dac-b3303a977429 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:11.021912 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c4a3e-7914-4840-8dac-b3303a977429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:11.042982 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5c3c4a3e-7914-4840-8dac-b3303a977429 None None] MFA Rules not processed for user `7cdc73bdfdd34846bc9f2625ef97728a`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:11.046399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5c3c4a3e-7914-4840-8dac-b3303a977429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:11.057565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:11.101961 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4332/8591] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:12:11.129852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892756a9-8ca7-4a73-8289-0d54b0012850 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:11.129852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-892756a9-8ca7-4a73-8289-0d54b0012850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:11.218822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892756a9-8ca7-4a73-8289-0d54b0012850 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:11.218822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc029f6a-a67b-4594-89ad-e84c21665559 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:11.218822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029f6a-a67b-4594-89ad-e84c21665559 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:11.218822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029f6a-a67b-4594-89ad-e84c21665559 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:11.219247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029f6a-a67b-4594-89ad-e84c21665559 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:11.220119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc029f6a-a67b-4594-89ad-e84c21665559 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:11.221732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc029f6a-a67b-4594-89ad-e84c21665559 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:11.233019 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4260/8592] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:12:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:12:11.469757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3ac43-5f63-46cd-9644-850a8567bf3b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:11.469985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3ac43-5f63-46cd-9644-850a8567bf3b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:11.470334 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3ac43-5f63-46cd-9644-850a8567bf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:11.477434 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-45b3ac43-5f63-46cd-9644-850a8567bf3b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:12:11.477434 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:12:11.477434 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:12:11.477434 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:12:11.477434 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:12:11.477434 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:12:11.477434 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:12:11.477434 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:12:11.477434 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:12:11.477434 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:12:11.477434 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:12:11.477434 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:12:11.477434 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:12:11.478613 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:12:11.478613 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:12:11.478613 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:12:11.478613 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:12:11.478613 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:12:11.478613 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:12:11.478613 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:12:11.478613 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:12:11.478613 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:12:11.478613 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:12:11.478613 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:12:11.478613 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:12:11.478613 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:12:11.478613 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:12:11.478613 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 05:12:11.479861 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4333/8593] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:12:11 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:12:13.153591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc029f6a-a67b-4594-89ad-e84c21665559 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:13.171670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=100 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:13.219410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc029f6a-a67b-4594-89ad-e84c21665559 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:13.224026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2d9bb-4ccb-47a6-bd07-62d891a92f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:13.224703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2d9bb-4ccb-47a6-bd07-62d891a92f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:13.224985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2d9bb-4ccb-47a6-bd07-62d891a92f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:13.225260 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2d9bb-4ccb-47a6-bd07-62d891a92f2b admin admin] PATH_INFO: `/v3/users/7cdc73bdfdd34846bc9f2625ef97728a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:13.226394 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2d9bb-4ccb-47a6-bd07-62d891a92f2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cdc73bdfdd34846bc9f2625ef97728a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:13.228845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2d9bb-4ccb-47a6-bd07-62d891a92f2b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:13.469503 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e7e2d9bb-4ccb-47a6-bd07-62d891a92f2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cdc73bdfdd34846bc9f2625ef97728a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:13.555016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e7e2d9bb-4ccb-47a6-bd07-62d891a92f2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cdc73bdfdd34846bc9f2625ef97728a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:13.555651 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e7e2d9bb-4ccb-47a6-bd07-62d891a92f2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cdc73bdfdd34846bc9f2625ef97728a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:13.564155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e7e2d9bb-4ccb-47a6-bd07-62d891a92f2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cdc73bdfdd34846bc9f2625ef97728a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:13.576308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e7e2d9bb-4ccb-47a6-bd07-62d891a92f2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cdc73bdfdd34846bc9f2625ef97728a'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:13.582460 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4261/8594] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:12:13 2022] DELETE /identity/v3/users/7cdc73bdfdd34846bc9f2625ef97728a => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:13.822337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3ac43-5f63-46cd-9644-850a8567bf3b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:13.824146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-45b3ac43-5f63-46cd-9644-850a8567bf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:13.893072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3ac43-5f63-46cd-9644-850a8567bf3b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:13.897557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:13.898207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:13.898486 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:13.898755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d admin admin] PATH_INFO: `/v3/projects/5e82ecb60102415888768543069927ed` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:13.900460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e82ecb60102415888768543069927ed)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:13.902350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:14.022034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e82ecb60102415888768543069927ed', 'request_id': 'req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:14.028141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e82ecb60102415888768543069927ed', 'request_id': 'req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:14.132533 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e82ecb60102415888768543069927ed', 'request_id': 'req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:14.145329 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d admin admin] The token cache is being invalidate because project 5e82ecb60102415888768543069927ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:12:14.145635 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:14.146351 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:14.147965 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4334/8595] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:12:13 2022] DELETE /identity/v3/projects/5e82ecb60102415888768543069927ed => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:14.153111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2d9bb-4ccb-47a6-bd07-62d891a92f2b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:14.163596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2d9bb-4ccb-47a6-bd07-62d891a92f2b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:14.231733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ff399-7c37-433f-a0c3-33e24cb82f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:14.232421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ff399-7c37-433f-a0c3-33e24cb82f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:14.232706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ff399-7c37-433f-a0c3-33e24cb82f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:14.232982 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ff399-7c37-433f-a0c3-33e24cb82f42 admin admin] PATH_INFO: `/v3/users/93d8fabb860049a59c882e09b5c1e403` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:14.234206 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ff399-7c37-433f-a0c3-33e24cb82f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93d8fabb860049a59c882e09b5c1e403)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:14.236184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ff399-7c37-433f-a0c3-33e24cb82f42 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:14.452180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:14.466239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9f1ff399-7c37-433f-a0c3-33e24cb82f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93d8fabb860049a59c882e09b5c1e403'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:14.615442 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9f1ff399-7c37-433f-a0c3-33e24cb82f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93d8fabb860049a59c882e09b5c1e403'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:14.616267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9f1ff399-7c37-433f-a0c3-33e24cb82f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93d8fabb860049a59c882e09b5c1e403'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:14.627486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9f1ff399-7c37-433f-a0c3-33e24cb82f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93d8fabb860049a59c882e09b5c1e403'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:14.643519 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9f1ff399-7c37-433f-a0c3-33e24cb82f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93d8fabb860049a59c882e09b5c1e403'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:14.652557 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4262/8596] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:12:14 2022] DELETE /identity/v3/users/93d8fabb860049a59c882e09b5c1e403 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:14.979378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:14.981006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:14.998245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c5dd7-e040-4c49-bd83-cb030f24b46d admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:15.060735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:15.067654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a39021-9c6b-4bf7-a926-1380f749a0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:15.068335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a39021-9c6b-4bf7-a926-1380f749a0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:15.068611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a39021-9c6b-4bf7-a926-1380f749a0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:15.068880 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a39021-9c6b-4bf7-a926-1380f749a0ba admin admin] PATH_INFO: `/v3/projects/890508005b814ec7a38b1073c3c21a61` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:15.070139 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a39021-9c6b-4bf7-a926-1380f749a0ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=890508005b814ec7a38b1073c3c21a61)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:15.072604 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a39021-9c6b-4bf7-a926-1380f749a0ba admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:15.253389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6a39021-9c6b-4bf7-a926-1380f749a0ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890508005b814ec7a38b1073c3c21a61', 'request_id': 'req-b6a39021-9c6b-4bf7-a926-1380f749a0ba'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:15.259649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6a39021-9c6b-4bf7-a926-1380f749a0ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890508005b814ec7a38b1073c3c21a61', 'request_id': 'req-b6a39021-9c6b-4bf7-a926-1380f749a0ba'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:15.372658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6a39021-9c6b-4bf7-a926-1380f749a0ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890508005b814ec7a38b1073c3c21a61', 'request_id': 'req-b6a39021-9c6b-4bf7-a926-1380f749a0ba'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:15.385875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6a39021-9c6b-4bf7-a926-1380f749a0ba admin admin] The token cache is being invalidate because project 890508005b814ec7a38b1073c3c21a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:12:15.386167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6a39021-9c6b-4bf7-a926-1380f749a0ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:15.386813 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b6a39021-9c6b-4bf7-a926-1380f749a0ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:15.388335 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4335/8597] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:12:14 2022] DELETE /identity/v3/projects/890508005b814ec7a38b1073c3c21a61 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:23.707124 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e97d6-46c7-4d4a-8bfa-a2c9d211a205 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:23.734221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e97d6-46c7-4d4a-8bfa-a2c9d211a205 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:23.734221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e97d6-46c7-4d4a-8bfa-a2c9d211a205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:23.734221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-918e97d6-46c7-4d4a-8bfa-a2c9d211a205 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:23.734221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-918e97d6-46c7-4d4a-8bfa-a2c9d211a205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:23.791427 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4263/8598] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:12:23.800684 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dd9af-a96d-49b0-b092-185498b2bd39 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:23.802998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dd9af-a96d-49b0-b092-185498b2bd39 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:23.802998 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dd9af-a96d-49b0-b092-185498b2bd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:23.821099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-229dd9af-a96d-49b0-b092-185498b2bd39 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:23.823022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-229dd9af-a96d-49b0-b092-185498b2bd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:23.830980 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4336/8599] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:12:23.835687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e97d6-46c7-4d4a-8bfa-a2c9d211a205 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:23.846043 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e97d6-46c7-4d4a-8bfa-a2c9d211a205 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:23.850698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269d717-ca18-4673-9810-3b934c4a4782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:23.851295 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269d717-ca18-4673-9810-3b934c4a4782 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:23.851578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269d717-ca18-4673-9810-3b934c4a4782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:23.851856 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269d717-ca18-4673-9810-3b934c4a4782 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:23.852539 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269d717-ca18-4673-9810-3b934c4a4782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:12:23.852873 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269d717-ca18-4673-9810-3b934c4a4782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:23.854478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269d717-ca18-4673-9810-3b934c4a4782 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:23.866178 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4264/8600] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:12:23.900508 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dd9af-a96d-49b0-b092-185498b2bd39 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:23.910432 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dd9af-a96d-49b0-b092-185498b2bd39 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:23.915090 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c2356-dbf8-4323-abcd-1b3001144723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:23.915758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c2356-dbf8-4323-abcd-1b3001144723 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:23.916042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c2356-dbf8-4323-abcd-1b3001144723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:23.916344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c2356-dbf8-4323-abcd-1b3001144723 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:23.916988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c2356-dbf8-4323-abcd-1b3001144723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:23.918901 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c2356-dbf8-4323-abcd-1b3001144723 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:24.032362 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4337/8601] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:12:23 2022] POST /identity/v3/projects => generated 393 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:12:24.036759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269d717-ca18-4673-9810-3b934c4a4782 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:24.047222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269d717-ca18-4673-9810-3b934c4a4782 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:24.105672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be379e64-4fa3-4d3a-b0e8-a41b581c9cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:24.106280 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be379e64-4fa3-4d3a-b0e8-a41b581c9cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:24.106566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be379e64-4fa3-4d3a-b0e8-a41b581c9cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:24.106846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be379e64-4fa3-4d3a-b0e8-a41b581c9cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:24.107493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be379e64-4fa3-4d3a-b0e8-a41b581c9cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:24.109458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be379e64-4fa3-4d3a-b0e8-a41b581c9cd0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:24.192751 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4265/8602] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:12:24 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:12:24.198038 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c2356-dbf8-4323-abcd-1b3001144723 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:24.209086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c2356-dbf8-4323-abcd-1b3001144723 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:24.213909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035da96d-2bbb-44d9-8877-2adf5413cdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:24.214518 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035da96d-2bbb-44d9-8877-2adf5413cdfb admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:24.214804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035da96d-2bbb-44d9-8877-2adf5413cdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:24.215077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035da96d-2bbb-44d9-8877-2adf5413cdfb admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:24.215716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035da96d-2bbb-44d9-8877-2adf5413cdfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:24.217582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035da96d-2bbb-44d9-8877-2adf5413cdfb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:24.228048 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4338/8603] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:12:24.232245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be379e64-4fa3-4d3a-b0e8-a41b581c9cd0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:24.242599 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be379e64-4fa3-4d3a-b0e8-a41b581c9cd0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:24.248010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a9182-375e-45fd-8ff3-fbe50f7adc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:24.248652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a9182-375e-45fd-8ff3-fbe50f7adc62 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:24.248936 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a9182-375e-45fd-8ff3-fbe50f7adc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:24.249212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a9182-375e-45fd-8ff3-fbe50f7adc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:24.249858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a9182-375e-45fd-8ff3-fbe50f7adc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:24.251460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a9182-375e-45fd-8ff3-fbe50f7adc62 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:24.263014 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4266/8604] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:12:24.267254 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035da96d-2bbb-44d9-8877-2adf5413cdfb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:24.278129 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035da96d-2bbb-44d9-8877-2adf5413cdfb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:24.283132 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2d295-30ed-42da-8b58-7999fafe01c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:24.283785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2d295-30ed-42da-8b58-7999fafe01c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:24.284072 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2d295-30ed-42da-8b58-7999fafe01c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:24.284381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2d295-30ed-42da-8b58-7999fafe01c5 admin admin] PATH_INFO: `/v3/projects/b99966673c4e49d4ba447d6ba62913df/users/b120c946ed134e9f8036ecd584d1495b/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:24.299472 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2d295-30ed-42da-8b58-7999fafe01c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99966673c4e49d4ba447d6ba62913df, user_id=b120c946ed134e9f8036ecd584d1495b, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:24.307733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2d295-30ed-42da-8b58-7999fafe01c5 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:24.388677 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4339/8605] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:12:24 2022] PUT /identity/v3/projects/b99966673c4e49d4ba447d6ba62913df/users/b120c946ed134e9f8036ecd584d1495b/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:24.402363 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc757b8-6117-4965-a4bd-eb7a74206015 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:24.402653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc757b8-6117-4965-a4bd-eb7a74206015 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:24.402928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc757b8-6117-4965-a4bd-eb7a74206015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:24.432457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-2bc757b8-6117-4965-a4bd-eb7a74206015 None None] MFA Rules not processed for user `b120c946ed134e9f8036ecd584d1495b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:24.433752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2bc757b8-6117-4965-a4bd-eb7a74206015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:24.437964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:24.507184 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4267/8606] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:12:24.512677 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2d295-30ed-42da-8b58-7999fafe01c5 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:24.577643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2d295-30ed-42da-8b58-7999fafe01c5 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:24.582271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddf889-accb-4510-ab15-5fe913930079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:24.582943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddf889-accb-4510-ab15-5fe913930079 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:24.583223 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddf889-accb-4510-ab15-5fe913930079 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:24.583500 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddf889-accb-4510-ab15-5fe913930079 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:24.584136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddf889-accb-4510-ab15-5fe913930079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:24.586088 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddf889-accb-4510-ab15-5fe913930079 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:24.742939 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4340/8607] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:12:24 2022] POST /identity/v3/projects => generated 391 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:12:24.748027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc757b8-6117-4965-a4bd-eb7a74206015 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:24.820929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc757b8-6117-4965-a4bd-eb7a74206015 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:24.820929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8406b-2b08-4e00-a897-97ddaac51614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:24.820929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8406b-2b08-4e00-a897-97ddaac51614 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:24.820929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8406b-2b08-4e00-a897-97ddaac51614 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:24.822156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8406b-2b08-4e00-a897-97ddaac51614 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:24.822156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8406b-2b08-4e00-a897-97ddaac51614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:24.822156 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8406b-2b08-4e00-a897-97ddaac51614 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:25.019244 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4268/8608] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:12:24 2022] POST /identity/v3/users => generated 302 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:12:25.023261 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddf889-accb-4510-ab15-5fe913930079 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:25.035498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddf889-accb-4510-ab15-5fe913930079 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:25.041048 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330adb79-a756-4cde-949a-c34ba7236fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:25.041892 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330adb79-a756-4cde-949a-c34ba7236fbd admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:25.042171 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330adb79-a756-4cde-949a-c34ba7236fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:25.042444 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330adb79-a756-4cde-949a-c34ba7236fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:25.043089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330adb79-a756-4cde-949a-c34ba7236fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:25.044739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330adb79-a756-4cde-949a-c34ba7236fbd admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:25.046228 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:25.059594 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4341/8609] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:12:25.070348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8406b-2b08-4e00-a897-97ddaac51614 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:25.081498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8406b-2b08-4e00-a897-97ddaac51614 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:25.086488 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651328d-5306-4608-802b-7261b82b9e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:25.087673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651328d-5306-4608-802b-7261b82b9e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:25.087952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651328d-5306-4608-802b-7261b82b9e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:25.088273 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651328d-5306-4608-802b-7261b82b9e8f admin admin] PATH_INFO: `/v3/projects/446856b9f6d943c9b65754dff8a0fdef/users/582d9aac3be2494cbe6d1d633b562288/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:25.105200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651328d-5306-4608-802b-7261b82b9e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=446856b9f6d943c9b65754dff8a0fdef, user_id=582d9aac3be2494cbe6d1d633b562288, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:25.107884 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651328d-5306-4608-802b-7261b82b9e8f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:25.284810 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4269/8610] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:12:25 2022] PUT /identity/v3/projects/446856b9f6d943c9b65754dff8a0fdef/users/582d9aac3be2494cbe6d1d633b562288/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:25.289023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330adb79-a756-4cde-949a-c34ba7236fbd admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:25.303217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330adb79-a756-4cde-949a-c34ba7236fbd admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:25.375054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19a5b5-1326-407e-9f37-f8fcec70fc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:25.375054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19a5b5-1326-407e-9f37-f8fcec70fc59 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:25.375054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19a5b5-1326-407e-9f37-f8fcec70fc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:25.375054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19a5b5-1326-407e-9f37-f8fcec70fc59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:25.375938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19a5b5-1326-407e-9f37-f8fcec70fc59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:25.375938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19a5b5-1326-407e-9f37-f8fcec70fc59 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:25.375938 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4342/8611] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:12:25.376511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651328d-5306-4608-802b-7261b82b9e8f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:25.387697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651328d-5306-4608-802b-7261b82b9e8f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:25.392754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188eee9-6bf7-45d3-a4d2-bb329e2733e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:25.393415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188eee9-6bf7-45d3-a4d2-bb329e2733e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:25.393698 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188eee9-6bf7-45d3-a4d2-bb329e2733e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:25.393993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188eee9-6bf7-45d3-a4d2-bb329e2733e9 admin admin] PATH_INFO: `/v3/projects/446856b9f6d943c9b65754dff8a0fdef/users/582d9aac3be2494cbe6d1d633b562288/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:25.395948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188eee9-6bf7-45d3-a4d2-bb329e2733e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=446856b9f6d943c9b65754dff8a0fdef, user_id=582d9aac3be2494cbe6d1d633b562288, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:25.398650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188eee9-6bf7-45d3-a4d2-bb329e2733e9 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:25.410459 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4270/8612] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:12:25 2022] PUT /identity/v3/projects/446856b9f6d943c9b65754dff8a0fdef/users/582d9aac3be2494cbe6d1d633b562288/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:25.421236 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3120b2-aa4f-4c25-a2ff-673b0d611162 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:25.421524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3120b2-aa4f-4c25-a2ff-673b0d611162 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:25.421796 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3120b2-aa4f-4c25-a2ff-673b0d611162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:25.449464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-2e3120b2-aa4f-4c25-a2ff-673b0d611162 None None] MFA Rules not processed for user `582d9aac3be2494cbe6d1d633b562288`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:25.450673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2e3120b2-aa4f-4c25-a2ff-673b0d611162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:25.521726 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4343/8613] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:25 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:12:25.537468 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0a8a-3ed0-4eaa-ada7-ed7eb359ab07 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:25.537750 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0a8a-3ed0-4eaa-ada7-ed7eb359ab07 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:25.538022 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0a8a-3ed0-4eaa-ada7-ed7eb359ab07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:25.557711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c9aa0a8a-3ed0-4eaa-ada7-ed7eb359ab07 None None] MFA Rules not processed for user `b120c946ed134e9f8036ecd584d1495b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:25.558910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c9aa0a8a-3ed0-4eaa-ada7-ed7eb359ab07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:25.614202 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4271/8614] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:12:25.627270 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3120b2-aa4f-4c25-a2ff-673b0d611162 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:25.628577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2e3120b2-aa4f-4c25-a2ff-673b0d611162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:25.705665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3120b2-aa4f-4c25-a2ff-673b0d611162 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:25.711124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719b71e-b664-404f-8bd5-8950c7a5f421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:25.711723 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b71e-b664-404f-8bd5-8950c7a5f421 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:25.711999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b71e-b664-404f-8bd5-8950c7a5f421 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:25.712316 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b71e-b664-404f-8bd5-8950c7a5f421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:25.719935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719b71e-b664-404f-8bd5-8950c7a5f421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:25.721548 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719b71e-b664-404f-8bd5-8950c7a5f421 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:25.730338 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4344/8615] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:12:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:12:25.761415 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa0a8a-3ed0-4eaa-ada7-ed7eb359ab07 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:25.763010 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c9aa0a8a-3ed0-4eaa-ada7-ed7eb359ab07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:25.768274 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:25.823764 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa0a8a-3ed0-4eaa-ada7-ed7eb359ab07 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:25.827423 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951bed5-f86e-483a-80f4-2c750beae3f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:25.828030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951bed5-f86e-483a-80f4-2c750beae3f7 service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:25.828409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951bed5-f86e-483a-80f4-2c750beae3f7 service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:25.828630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951bed5-f86e-483a-80f4-2c750beae3f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:25.830357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2951bed5-f86e-483a-80f4-2c750beae3f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:25.846796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951bed5-f86e-483a-80f4-2c750beae3f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:25.848258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951bed5-f86e-483a-80f4-2c750beae3f7 service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:25.861758 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4272/8616] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:12:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:12:26.438229 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719b71e-b664-404f-8bd5-8950c7a5f421 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:26.439692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-2719b71e-b664-404f-8bd5-8950c7a5f421 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:26.445170 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=100 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:26.512359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719b71e-b664-404f-8bd5-8950c7a5f421 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:26.517323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11573d1c-1a54-4073-a123-5ca147190b30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:26.517927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11573d1c-1a54-4073-a123-5ca147190b30 service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:26.518207 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11573d1c-1a54-4073-a123-5ca147190b30 service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:26.518480 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11573d1c-1a54-4073-a123-5ca147190b30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:26.520240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-11573d1c-1a54-4073-a123-5ca147190b30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:26.535042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11573d1c-1a54-4073-a123-5ca147190b30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:26.536651 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11573d1c-1a54-4073-a123-5ca147190b30 service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:26.551678 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4345/8617] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:12:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:12:30.361009 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951bed5-f86e-483a-80f4-2c750beae3f7 service glance] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:30.362518 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2951bed5-f86e-483a-80f4-2c750beae3f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:30.428119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951bed5-f86e-483a-80f4-2c750beae3f7 service glance] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:30.432336 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ab2c5-3872-4c43-a388-a6d4b58ae064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:30.438653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ab2c5-3872-4c43-a388-a6d4b58ae064 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:30.438653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ab2c5-3872-4c43-a388-a6d4b58ae064 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:30.438653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ab2c5-3872-4c43-a388-a6d4b58ae064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:30.438653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-929ab2c5-3872-4c43-a388-a6d4b58ae064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:30.449081 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ab2c5-3872-4c43-a388-a6d4b58ae064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:30.450548 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ab2c5-3872-4c43-a388-a6d4b58ae064 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:30.461799 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4273/8618] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:12:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:12:31.278180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11573d1c-1a54-4073-a123-5ca147190b30 service placement] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:31.297762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11573d1c-1a54-4073-a123-5ca147190b30 service placement] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:31.303657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e91371-23d5-4d51-9462-65d048b6f49e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:31.304310 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e91371-23d5-4d51-9462-65d048b6f49e service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:31.304601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e91371-23d5-4d51-9462-65d048b6f49e service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:31.304873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e91371-23d5-4d51-9462-65d048b6f49e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:31.306838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-42e91371-23d5-4d51-9462-65d048b6f49e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:31.323622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e91371-23d5-4d51-9462-65d048b6f49e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:31.325111 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e91371-23d5-4d51-9462-65d048b6f49e service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:31.339687 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4346/8619] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:12:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:12:38.591082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ab2c5-3872-4c43-a388-a6d4b58ae064 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:38.592845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-929ab2c5-3872-4c43-a388-a6d4b58ae064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:38.611409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ab2c5-3872-4c43-a388-a6d4b58ae064 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:38.617051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b38e4-a5cf-4114-848c-776217a775f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:38.617646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b38e4-a5cf-4114-848c-776217a775f7 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:38.617928 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b38e4-a5cf-4114-848c-776217a775f7 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:38.618714 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b38e4-a5cf-4114-848c-776217a775f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:38.620591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c45b38e4-a5cf-4114-848c-776217a775f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:38.636216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b38e4-a5cf-4114-848c-776217a775f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:38.637797 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b38e4-a5cf-4114-848c-776217a775f7 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:38.651047 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4274/8620] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:12:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:12:41.331692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=37 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:41.595230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e91371-23d5-4d51-9462-65d048b6f49e service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:41.609650 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e91371-23d5-4d51-9462-65d048b6f49e service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:41.615314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f0ce7-a81a-4754-995d-1f0b2a4c1b6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:41.615908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f0ce7-a81a-4754-995d-1f0b2a4c1b6f service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:41.616225 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f0ce7-a81a-4754-995d-1f0b2a4c1b6f service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:41.616505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f0ce7-a81a-4754-995d-1f0b2a4c1b6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:41.625885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f0ce7-a81a-4754-995d-1f0b2a4c1b6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:41.627512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f0ce7-a81a-4754-995d-1f0b2a4c1b6f service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:41.637695 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4347/8621] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:12:41 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:12:41.653259 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd691e-e4bd-4f28-bb33-82e07dbf909a None None] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:41.653710 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd691e-e4bd-4f28-bb33-82e07dbf909a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:41.653844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd691e-e4bd-4f28-bb33-82e07dbf909a None None] PATH_INFO: `/` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:41.655200 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4275/8622] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 05:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 05:12:41.659899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f0ce7-a81a-4754-995d-1f0b2a4c1b6f service nova] Authenticating service token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 05:12:41.674107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f0ce7-a81a-4754-995d-1f0b2a4c1b6f service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:41.682698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f0ce7-a81a-4754-995d-1f0b2a4c1b6f service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:41.687442 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be521e0-1e7c-4712-8c37-7ed949dab2b3 tempest-ServersAdminNegativeTestJSON-470630045 tempest-ServersAdminNegativeTestJSON-470630045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582d9aac3be2494cbe6d1d633b562288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '446856b9f6d943c9b65754dff8a0fdef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:41.688060 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be521e0-1e7c-4712-8c37-7ed949dab2b3 tempest-ServersAdminNegativeTestJSON-470630045 tempest-ServersAdminNegativeTestJSON-470630045-project-admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:41.688373 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be521e0-1e7c-4712-8c37-7ed949dab2b3 tempest-ServersAdminNegativeTestJSON-470630045 tempest-ServersAdminNegativeTestJSON-470630045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:41.688654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be521e0-1e7c-4712-8c37-7ed949dab2b3 tempest-ServersAdminNegativeTestJSON-470630045 tempest-ServersAdminNegativeTestJSON-470630045-project-admin] PATH_INFO: `/v3/projects/446856b9f6d943c9b65754dff8a0fdef` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:41.689790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be521e0-1e7c-4712-8c37-7ed949dab2b3 tempest-ServersAdminNegativeTestJSON-470630045 tempest-ServersAdminNegativeTestJSON-470630045-project-admin] RBAC: Authorizing `identity:get_project(project_id=446856b9f6d943c9b65754dff8a0fdef)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:41.691556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be521e0-1e7c-4712-8c37-7ed949dab2b3 tempest-ServersAdminNegativeTestJSON-470630045 tempest-ServersAdminNegativeTestJSON-470630045-project-admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:41.693224 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4348/8623] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 05:12:41 2022] GET /identity/v3/projects/446856b9f6d943c9b65754dff8a0fdef => generated 391 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:12:41.926278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c634b9f-8464-4623-a4fe-5019ead7573f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:41.926559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c634b9f-8464-4623-a4fe-5019ead7573f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:41.926836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c634b9f-8464-4623-a4fe-5019ead7573f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:41.933474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-1c634b9f-8464-4623-a4fe-5019ead7573f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:12:41.933474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:12:41.933474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:12:41.933474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:12:41.933474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:12:41.933474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:12:41.933474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:12:41.933474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:12:41.933474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:12:41.933474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:12:41.933474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:12:41.933474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:12:41.933474 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:12:41.935153 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:12:41.935153 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:12:41.935153 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:12:41.935153 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:12:41.935153 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:12:41.935153 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:12:41.935153 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:12:41.935153 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:12:41.935153 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:12:41.935153 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:12:41.935153 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:12:41.935153 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:12:41.935153 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:12:41.935153 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:12:41.935153 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:12:41.936877 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4276/8624] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:12:41 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 9 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:12:42.121189 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786d13e-9db6-4d29-b2b4-3aface7ad4cb None None] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:42.121470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786d13e-9db6-4d29-b2b4-3aface7ad4cb None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:42.121769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786d13e-9db6-4d29-b2b4-3aface7ad4cb None None] PATH_INFO: `/` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:42.123099 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4349/8625] 10.222.0.76 () {54 vars in 912 bytes} [Sat Aug 27 05:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 05:12:42.128065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c634b9f-8464-4623-a4fe-5019ead7573f None None] Authenticating service token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 27 05:12:42.147947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c634b9f-8464-4623-a4fe-5019ead7573f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:42.159060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c634b9f-8464-4623-a4fe-5019ead7573f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:42.163909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8619e9-90a5-45f9-b035-2864c8c74cca tempest-ServersAdminNegativeTestJSON-470630045 tempest-ServersAdminNegativeTestJSON-470630045-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582d9aac3be2494cbe6d1d633b562288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '446856b9f6d943c9b65754dff8a0fdef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:42.164713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8619e9-90a5-45f9-b035-2864c8c74cca tempest-ServersAdminNegativeTestJSON-470630045 tempest-ServersAdminNegativeTestJSON-470630045-project-admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:42.164998 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8619e9-90a5-45f9-b035-2864c8c74cca tempest-ServersAdminNegativeTestJSON-470630045 tempest-ServersAdminNegativeTestJSON-470630045-project-admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:42.165283 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8619e9-90a5-45f9-b035-2864c8c74cca tempest-ServersAdminNegativeTestJSON-470630045 tempest-ServersAdminNegativeTestJSON-470630045-project-admin] PATH_INFO: `/v3/projects/446856b9f6d943c9b65754dff8a0fdef` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:42.166422 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8619e9-90a5-45f9-b035-2864c8c74cca tempest-ServersAdminNegativeTestJSON-470630045 tempest-ServersAdminNegativeTestJSON-470630045-project-admin] RBAC: Authorizing `identity:get_project(project_id=446856b9f6d943c9b65754dff8a0fdef)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:42.168386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8619e9-90a5-45f9-b035-2864c8c74cca tempest-ServersAdminNegativeTestJSON-470630045 tempest-ServersAdminNegativeTestJSON-470630045-project-admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:42.170094 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4277/8626] 10.222.0.76 () {58 vars in 1443 bytes} [Sat Aug 27 05:12:42 2022] GET /identity/v3/projects/446856b9f6d943c9b65754dff8a0fdef => generated 391 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:12:42.471829 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b94b22-01a4-48a5-b3e3-ef98309b1ed8 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:42.472506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b94b22-01a4-48a5-b3e3-ef98309b1ed8 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:42.472506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b94b22-01a4-48a5-b3e3-ef98309b1ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:42.479003 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-92b94b22-01a4-48a5-b3e3-ef98309b1ed8 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:12:42.479003 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:12:42.479003 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:12:42.479003 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:12:42.479003 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:12:42.479003 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:12:42.479003 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:12:42.479003 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:12:42.479003 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:12:42.479003 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:12:42.479003 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:12:42.479003 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:12:42.479003 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:12:42.480255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:12:42.480255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:12:42.480255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:12:42.480255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:12:42.480255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:12:42.480255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:12:42.480255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:12:42.480255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:12:42.480255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:12:42.480255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:12:42.480255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:12:42.480255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:12:42.480255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:12:42.480255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:12:42.480255 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 05:12:42.481615 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4350/8627] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:12:42 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 9 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:12:46.439840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8619e9-90a5-45f9-b035-2864c8c74cca tempest-ServersAdminNegativeTestJSON-470630045 tempest-ServersAdminNegativeTestJSON-470630045-project-admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:46.503070 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8619e9-90a5-45f9-b035-2864c8c74cca tempest-ServersAdminNegativeTestJSON-470630045 tempest-ServersAdminNegativeTestJSON-470630045-project-admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:46.507603 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a69da-45b6-4b6b-bad9-f23e00d59b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:46.508253 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a69da-45b6-4b6b-bad9-f23e00d59b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:46.508537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a69da-45b6-4b6b-bad9-f23e00d59b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:46.509326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a69da-45b6-4b6b-bad9-f23e00d59b33 admin admin] PATH_INFO: `/v3/users/b120c946ed134e9f8036ecd584d1495b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:46.510545 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a69da-45b6-4b6b-bad9-f23e00d59b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b120c946ed134e9f8036ecd584d1495b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:46.512529 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a69da-45b6-4b6b-bad9-f23e00d59b33 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:46.686712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:46.846634 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c31a69da-45b6-4b6b-bad9-f23e00d59b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b120c946ed134e9f8036ecd584d1495b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:46.969876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c31a69da-45b6-4b6b-bad9-f23e00d59b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b120c946ed134e9f8036ecd584d1495b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:46.970515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c31a69da-45b6-4b6b-bad9-f23e00d59b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b120c946ed134e9f8036ecd584d1495b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:46.978416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c31a69da-45b6-4b6b-bad9-f23e00d59b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b120c946ed134e9f8036ecd584d1495b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:46.990364 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c31a69da-45b6-4b6b-bad9-f23e00d59b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b120c946ed134e9f8036ecd584d1495b'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:46.996773 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4278/8628] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:12:46 2022] DELETE /identity/v3/users/b120c946ed134e9f8036ecd584d1495b => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:47.002570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a46255-301c-493d-8142-791ad153a9d7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:47.003046 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a46255-301c-493d-8142-791ad153a9d7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:47.003210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a46255-301c-493d-8142-791ad153a9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:47.023203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f4a46255-301c-493d-8142-791ad153a9d7 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:47.024529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f4a46255-301c-493d-8142-791ad153a9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:47.082346 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4351/8629] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:12:47.097077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a69da-45b6-4b6b-bad9-f23e00d59b33 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:47.098547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c31a69da-45b6-4b6b-bad9-f23e00d59b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:47.159193 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a69da-45b6-4b6b-bad9-f23e00d59b33 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:47.162782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072ae87-aaf4-4973-9f25-b4bc9a055733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:47.163497 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072ae87-aaf4-4973-9f25-b4bc9a055733 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:47.163782 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072ae87-aaf4-4973-9f25-b4bc9a055733 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:47.164052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072ae87-aaf4-4973-9f25-b4bc9a055733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:47.173968 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072ae87-aaf4-4973-9f25-b4bc9a055733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:47.175427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072ae87-aaf4-4973-9f25-b4bc9a055733 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:47.186361 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4279/8630] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:12:47.472986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a46255-301c-493d-8142-791ad153a9d7 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:47.472986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f4a46255-301c-493d-8142-791ad153a9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:47.475634 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a46255-301c-493d-8142-791ad153a9d7 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:47.481343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d498179-132c-4785-be1e-6ae29c82ad81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:47.481987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d498179-132c-4785-be1e-6ae29c82ad81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:47.482268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d498179-132c-4785-be1e-6ae29c82ad81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:47.482595 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d498179-132c-4785-be1e-6ae29c82ad81 admin admin] PATH_INFO: `/v3/projects/b99966673c4e49d4ba447d6ba62913df` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:47.483757 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d498179-132c-4785-be1e-6ae29c82ad81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b99966673c4e49d4ba447d6ba62913df)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:47.485735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d498179-132c-4785-be1e-6ae29c82ad81 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:47.627006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6d498179-132c-4785-be1e-6ae29c82ad81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b99966673c4e49d4ba447d6ba62913df', 'request_id': 'req-6d498179-132c-4785-be1e-6ae29c82ad81'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:47.632494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6d498179-132c-4785-be1e-6ae29c82ad81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b99966673c4e49d4ba447d6ba62913df', 'request_id': 'req-6d498179-132c-4785-be1e-6ae29c82ad81'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:47.713637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6d498179-132c-4785-be1e-6ae29c82ad81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b99966673c4e49d4ba447d6ba62913df', 'request_id': 'req-6d498179-132c-4785-be1e-6ae29c82ad81'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:47.725057 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6d498179-132c-4785-be1e-6ae29c82ad81 admin admin] The token cache is being invalidate because project b99966673c4e49d4ba447d6ba62913df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:12:47.726069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6d498179-132c-4785-be1e-6ae29c82ad81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:47.726069 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6d498179-132c-4785-be1e-6ae29c82ad81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:47.727491 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4352/8631] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:12:47 2022] DELETE /identity/v3/projects/b99966673c4e49d4ba447d6ba62913df => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:47.732134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072ae87-aaf4-4973-9f25-b4bc9a055733 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:47.742332 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072ae87-aaf4-4973-9f25-b4bc9a055733 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:47.800894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9991703-53f2-4336-b68a-04e9074fb730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:47.801520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9991703-53f2-4336-b68a-04e9074fb730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:47.801802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9991703-53f2-4336-b68a-04e9074fb730 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:47.802074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9991703-53f2-4336-b68a-04e9074fb730 admin admin] PATH_INFO: `/v3/users/582d9aac3be2494cbe6d1d633b562288` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:47.803189 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9991703-53f2-4336-b68a-04e9074fb730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=582d9aac3be2494cbe6d1d633b562288)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:47.805173 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9991703-53f2-4336-b68a-04e9074fb730 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:48.030537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b9991703-53f2-4336-b68a-04e9074fb730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '582d9aac3be2494cbe6d1d633b562288'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:48.033316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:48.141460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b9991703-53f2-4336-b68a-04e9074fb730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '582d9aac3be2494cbe6d1d633b562288'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:48.142107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b9991703-53f2-4336-b68a-04e9074fb730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '582d9aac3be2494cbe6d1d633b562288'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:48.150140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b9991703-53f2-4336-b68a-04e9074fb730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '582d9aac3be2494cbe6d1d633b562288'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:48.163621 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-b9991703-53f2-4336-b68a-04e9074fb730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '582d9aac3be2494cbe6d1d633b562288'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:48.172722 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4280/8632] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:12:47 2022] DELETE /identity/v3/users/582d9aac3be2494cbe6d1d633b562288 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:12:48.649344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d498179-132c-4785-be1e-6ae29c82ad81 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:48.650914 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6d498179-132c-4785-be1e-6ae29c82ad81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:48.664994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d498179-132c-4785-be1e-6ae29c82ad81 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:48.725505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22889456-3287-47f0-8e43-a7476ae5e4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:48.726182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22889456-3287-47f0-8e43-a7476ae5e4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:48.726462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22889456-3287-47f0-8e43-a7476ae5e4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:48.726736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22889456-3287-47f0-8e43-a7476ae5e4a3 admin admin] PATH_INFO: `/v3/projects/446856b9f6d943c9b65754dff8a0fdef` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:48.728447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22889456-3287-47f0-8e43-a7476ae5e4a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=446856b9f6d943c9b65754dff8a0fdef)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:48.730347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22889456-3287-47f0-8e43-a7476ae5e4a3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:48.732772 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:48.835586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-22889456-3287-47f0-8e43-a7476ae5e4a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446856b9f6d943c9b65754dff8a0fdef', 'request_id': 'req-22889456-3287-47f0-8e43-a7476ae5e4a3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:48.841415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-22889456-3287-47f0-8e43-a7476ae5e4a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446856b9f6d943c9b65754dff8a0fdef', 'request_id': 'req-22889456-3287-47f0-8e43-a7476ae5e4a3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:48.921519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-22889456-3287-47f0-8e43-a7476ae5e4a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446856b9f6d943c9b65754dff8a0fdef', 'request_id': 'req-22889456-3287-47f0-8e43-a7476ae5e4a3'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:48.933052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-22889456-3287-47f0-8e43-a7476ae5e4a3 admin admin] The token cache is being invalidate because project 446856b9f6d943c9b65754dff8a0fdef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:12:48.933343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-22889456-3287-47f0-8e43-a7476ae5e4a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:48.934011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-22889456-3287-47f0-8e43-a7476ae5e4a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:12:48.935764 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4353/8633] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:12:48 2022] DELETE /identity/v3/projects/446856b9f6d943c9b65754dff8a0fdef => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:48.941688 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770f2b3-561b-4977-9b3d-51df54b7574b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:48.942186 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770f2b3-561b-4977-9b3d-51df54b7574b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:48.942302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770f2b3-561b-4977-9b3d-51df54b7574b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:48.961697 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-5770f2b3-561b-4977-9b3d-51df54b7574b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:48.963702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5770f2b3-561b-4977-9b3d-51df54b7574b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:49.023685 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4281/8634] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:12:49.033389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be1a4e-5867-470e-8a31-c7f9f43bc978 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:49.033676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be1a4e-5867-470e-8a31-c7f9f43bc978 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:49.033955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be1a4e-5867-470e-8a31-c7f9f43bc978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:49.054205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-86be1a4e-5867-470e-8a31-c7f9f43bc978 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:49.055408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-86be1a4e-5867-470e-8a31-c7f9f43bc978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:49.063458 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4354/8635] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:12:49.067726 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770f2b3-561b-4977-9b3d-51df54b7574b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:49.077944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770f2b3-561b-4977-9b3d-51df54b7574b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:49.082573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cb3e8-dc7e-43d2-98da-70036f38b6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:49.083166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cb3e8-dc7e-43d2-98da-70036f38b6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:49.083451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cb3e8-dc7e-43d2-98da-70036f38b6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:49.083729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cb3e8-dc7e-43d2-98da-70036f38b6c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:49.084413 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cb3e8-dc7e-43d2-98da-70036f38b6c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:12:49.084722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cb3e8-dc7e-43d2-98da-70036f38b6c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:49.086329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cb3e8-dc7e-43d2-98da-70036f38b6c7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:49.098705 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4282/8636] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:12:49.103042 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be1a4e-5867-470e-8a31-c7f9f43bc978 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:49.112252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be1a4e-5867-470e-8a31-c7f9f43bc978 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:49.116923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406edf4-bdab-41d7-a9d9-32c3df47b685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:49.117515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406edf4-bdab-41d7-a9d9-32c3df47b685 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:49.117797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406edf4-bdab-41d7-a9d9-32c3df47b685 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:49.118070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406edf4-bdab-41d7-a9d9-32c3df47b685 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:49.119278 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406edf4-bdab-41d7-a9d9-32c3df47b685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:49.121126 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406edf4-bdab-41d7-a9d9-32c3df47b685 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:49.222230 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4355/8637] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:12:49 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:12:49.226437 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cb3e8-dc7e-43d2-98da-70036f38b6c7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:49.236891 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cb3e8-dc7e-43d2-98da-70036f38b6c7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:49.297298 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4046c9-cbec-4e7f-a169-97716ba9a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:49.297911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4046c9-cbec-4e7f-a169-97716ba9a61b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:49.298199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4046c9-cbec-4e7f-a169-97716ba9a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:49.298475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4046c9-cbec-4e7f-a169-97716ba9a61b admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:49.299117 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4046c9-cbec-4e7f-a169-97716ba9a61b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:49.301085 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4046c9-cbec-4e7f-a169-97716ba9a61b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:49.505889 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4283/8638] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:12:49 2022] POST /identity/v3/users => generated 290 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:12:49.509918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406edf4-bdab-41d7-a9d9-32c3df47b685 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:49.520327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406edf4-bdab-41d7-a9d9-32c3df47b685 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:49.525015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129a8b6-469d-464f-abae-0c354a78fb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:49.525617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129a8b6-469d-464f-abae-0c354a78fb96 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:49.525893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129a8b6-469d-464f-abae-0c354a78fb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:49.526216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129a8b6-469d-464f-abae-0c354a78fb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:49.526859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129a8b6-469d-464f-abae-0c354a78fb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:49.528488 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129a8b6-469d-464f-abae-0c354a78fb96 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:49.538847 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4356/8639] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:12:49.543557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4046c9-cbec-4e7f-a169-97716ba9a61b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:49.553966 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4046c9-cbec-4e7f-a169-97716ba9a61b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:49.560044 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe3a35-5209-4a6a-b094-8e442c2999dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:49.560699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe3a35-5209-4a6a-b094-8e442c2999dd admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:49.560986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe3a35-5209-4a6a-b094-8e442c2999dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:49.561265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe3a35-5209-4a6a-b094-8e442c2999dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:49.561927 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe3a35-5209-4a6a-b094-8e442c2999dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:49.565019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe3a35-5209-4a6a-b094-8e442c2999dd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:49.578313 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4284/8640] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:12:49.590747 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129a8b6-469d-464f-abae-0c354a78fb96 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:49.601121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129a8b6-469d-464f-abae-0c354a78fb96 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:49.606720 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dda958-bfd0-4d97-86d8-46f6b1ab71f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:49.607366 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dda958-bfd0-4d97-86d8-46f6b1ab71f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:49.607648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dda958-bfd0-4d97-86d8-46f6b1ab71f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:49.607923 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dda958-bfd0-4d97-86d8-46f6b1ab71f3 admin admin] PATH_INFO: `/v3/projects/d3379c8f3fc74a529758b4d9a664c40b/users/7cce89dbd71a4db19a7fecbdabcf9b20/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:49.625219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dda958-bfd0-4d97-86d8-46f6b1ab71f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3379c8f3fc74a529758b4d9a664c40b, user_id=7cce89dbd71a4db19a7fecbdabcf9b20, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:49.627883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dda958-bfd0-4d97-86d8-46f6b1ab71f3 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:49.747737 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4357/8641] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:12:49 2022] PUT /identity/v3/projects/d3379c8f3fc74a529758b4d9a664c40b/users/7cce89dbd71a4db19a7fecbdabcf9b20/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:12:49.752899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84c966-d438-48b8-b10b-b2985c1fae71 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:49.753220 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84c966-d438-48b8-b10b-b2985c1fae71 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:49.753479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84c966-d438-48b8-b10b-b2985c1fae71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:49.773026 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9f84c966-d438-48b8-b10b-b2985c1fae71 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:49.774147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9f84c966-d438-48b8-b10b-b2985c1fae71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:49.804433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:49.833596 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4285/8642] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:12:49.845234 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dda958-bfd0-4d97-86d8-46f6b1ab71f3 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:49.846180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-77dda958-bfd0-4d97-86d8-46f6b1ab71f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:49.905390 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dda958-bfd0-4d97-86d8-46f6b1ab71f3 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:49.909353 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47182d1d-a8e6-4841-909c-e82c257377b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:49.909949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47182d1d-a8e6-4841-909c-e82c257377b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:49.910224 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47182d1d-a8e6-4841-909c-e82c257377b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:49.910490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47182d1d-a8e6-4841-909c-e82c257377b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:49.920300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47182d1d-a8e6-4841-909c-e82c257377b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:49.921734 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47182d1d-a8e6-4841-909c-e82c257377b1 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:49.932076 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4358/8643] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:12:55.480736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84c966-d438-48b8-b10b-b2985c1fae71 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:55.482231 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9f84c966-d438-48b8-b10b-b2985c1fae71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:55.564706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84c966-d438-48b8-b10b-b2985c1fae71 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:55.570500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deae241-c281-45ea-9181-157245142a1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:55.571126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deae241-c281-45ea-9181-157245142a1d service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:55.571944 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deae241-c281-45ea-9181-157245142a1d service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:55.572262 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deae241-c281-45ea-9181-157245142a1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:55.574061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-2deae241-c281-45ea-9181-157245142a1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:55.590419 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deae241-c281-45ea-9181-157245142a1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:55.592051 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deae241-c281-45ea-9181-157245142a1d service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:55.606333 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4286/8644] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:12:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:12:56.300275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13929b6c-7032-4b6f-9a48-adfbeda2c35e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:56.301151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13929b6c-7032-4b6f-9a48-adfbeda2c35e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:56.301429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13929b6c-7032-4b6f-9a48-adfbeda2c35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:56.333123 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-13929b6c-7032-4b6f-9a48-adfbeda2c35e None None] MFA Rules not processed for user `7cce89dbd71a4db19a7fecbdabcf9b20`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:56.334379 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-13929b6c-7032-4b6f-9a48-adfbeda2c35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:56.356352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:12:56.428384 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4359/8645] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:12:56.430665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14848589-6320-4744-9461-6036057f1131 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:56.431153 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14848589-6320-4744-9461-6036057f1131 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:56.431655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14848589-6320-4744-9461-6036057f1131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:56.454501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-14848589-6320-4744-9461-6036057f1131 None None] MFA Rules not processed for user `7cce89dbd71a4db19a7fecbdabcf9b20`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:12:56.455718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-14848589-6320-4744-9461-6036057f1131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:56.464206 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4287/8646] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:12:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:12:56.478325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13929b6c-7032-4b6f-9a48-adfbeda2c35e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:12:56.479919 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-13929b6c-7032-4b6f-9a48-adfbeda2c35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:12:56.562192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13929b6c-7032-4b6f-9a48-adfbeda2c35e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:12:56.567731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62925e4-2515-4c5b-b48d-586049ec43b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:12:56.568575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62925e4-2515-4c5b-b48d-586049ec43b5 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:56.568928 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62925e4-2515-4c5b-b48d-586049ec43b5 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:56.569269 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62925e4-2515-4c5b-b48d-586049ec43b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:56.577666 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62925e4-2515-4c5b-b48d-586049ec43b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:12:56.579295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62925e4-2515-4c5b-b48d-586049ec43b5 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:12:56.588898 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4360/8647] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:12:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:12:56.845446 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ee82a-1863-4a31-b03e-600c77568bd1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:12:56.845970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ee82a-1863-4a31-b03e-600c77568bd1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:12:56.846063 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ee82a-1863-4a31-b03e-600c77568bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:12:56.853349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-0b8ee82a-1863-4a31-b03e-600c77568bd1 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:12:56.853349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:12:56.853349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:12:56.853349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:12:56.853349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:12:56.853349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:12:56.853349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:12:56.853349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:12:56.853349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:12:56.853349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:12:56.853349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:12:56.853349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:12:56.853349 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:12:56.857521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:12:56.857521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:12:56.857521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:12:56.857521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:12:56.857521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:12:56.857521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:12:56.857521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:12:56.857521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:12:56.857521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:12:56.857521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:12:56.857521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:12:56.857521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:12:56.857521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:12:56.857521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:12:56.857521 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:12:56.858684 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4288/8648] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:12:56 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:13:00.818511 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62925e4-2515-4c5b-b48d-586049ec43b5 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:00.829593 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62925e4-2515-4c5b-b48d-586049ec43b5 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:00.834731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10b8eb-ca3f-4471-9d4e-47f939909244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:00.835409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10b8eb-ca3f-4471-9d4e-47f939909244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:00.835685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10b8eb-ca3f-4471-9d4e-47f939909244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:00.835956 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10b8eb-ca3f-4471-9d4e-47f939909244 admin admin] PATH_INFO: `/v3/users/7cce89dbd71a4db19a7fecbdabcf9b20` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:00.837218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10b8eb-ca3f-4471-9d4e-47f939909244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cce89dbd71a4db19a7fecbdabcf9b20)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:00.839203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10b8eb-ca3f-4471-9d4e-47f939909244 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:01.105345 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4a10b8eb-ca3f-4471-9d4e-47f939909244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cce89dbd71a4db19a7fecbdabcf9b20'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:01.106047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4a10b8eb-ca3f-4471-9d4e-47f939909244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cce89dbd71a4db19a7fecbdabcf9b20'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:01.207572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4a10b8eb-ca3f-4471-9d4e-47f939909244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cce89dbd71a4db19a7fecbdabcf9b20'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:01.208243 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4a10b8eb-ca3f-4471-9d4e-47f939909244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cce89dbd71a4db19a7fecbdabcf9b20'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:01.221524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4a10b8eb-ca3f-4471-9d4e-47f939909244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cce89dbd71a4db19a7fecbdabcf9b20'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:01.234344 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4361/8649] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:13:00 2022] DELETE /identity/v3/users/7cce89dbd71a4db19a7fecbdabcf9b20 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:13:01.489498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ee82a-1863-4a31-b03e-600c77568bd1 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:01.491343 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0b8ee82a-1863-4a31-b03e-600c77568bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:01.565458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ee82a-1863-4a31-b03e-600c77568bd1 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:01.570023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc5ef6-ac70-488d-9af6-2f2575bc45bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:01.570679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc5ef6-ac70-488d-9af6-2f2575bc45bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:01.570963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc5ef6-ac70-488d-9af6-2f2575bc45bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:01.571794 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc5ef6-ac70-488d-9af6-2f2575bc45bd admin admin] PATH_INFO: `/v3/projects/d3379c8f3fc74a529758b4d9a664c40b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:01.573489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc5ef6-ac70-488d-9af6-2f2575bc45bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3379c8f3fc74a529758b4d9a664c40b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:01.575411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc5ef6-ac70-488d-9af6-2f2575bc45bd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:01.703090 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-40fc5ef6-ac70-488d-9af6-2f2575bc45bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3379c8f3fc74a529758b4d9a664c40b', 'request_id': 'req-40fc5ef6-ac70-488d-9af6-2f2575bc45bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:01.708517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-40fc5ef6-ac70-488d-9af6-2f2575bc45bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3379c8f3fc74a529758b4d9a664c40b', 'request_id': 'req-40fc5ef6-ac70-488d-9af6-2f2575bc45bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:01.711642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:01.715700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-40fc5ef6-ac70-488d-9af6-2f2575bc45bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3379c8f3fc74a529758b4d9a664c40b', 'request_id': 'req-40fc5ef6-ac70-488d-9af6-2f2575bc45bd'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:01.813858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-40fc5ef6-ac70-488d-9af6-2f2575bc45bd admin admin] The token cache is being invalidate because project d3379c8f3fc74a529758b4d9a664c40b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:13:01.814152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-40fc5ef6-ac70-488d-9af6-2f2575bc45bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:01.814838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-40fc5ef6-ac70-488d-9af6-2f2575bc45bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:01.816374 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4289/8650] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:13:01 2022] DELETE /identity/v3/projects/d3379c8f3fc74a529758b4d9a664c40b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:13:01.821584 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15de2f-64dc-43f7-a826-5fdac8fbd61a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:01.822733 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15de2f-64dc-43f7-a826-5fdac8fbd61a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:01.822857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15de2f-64dc-43f7-a826-5fdac8fbd61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:01.843128 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-de15de2f-64dc-43f7-a826-5fdac8fbd61a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:01.844523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-de15de2f-64dc-43f7-a826-5fdac8fbd61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:01.858427 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:01.906651 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4362/8651] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:13:01.914600 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f932886-a055-417e-9730-ef9e9be5524c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:01.914888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f932886-a055-417e-9730-ef9e9be5524c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:01.915168 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f932886-a055-417e-9730-ef9e9be5524c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:01.936957 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9f932886-a055-417e-9730-ef9e9be5524c None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:01.938265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9f932886-a055-417e-9730-ef9e9be5524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:01.946503 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4290/8652] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:13:01.951194 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15de2f-64dc-43f7-a826-5fdac8fbd61a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:01.961137 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15de2f-64dc-43f7-a826-5fdac8fbd61a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:01.966983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1b966-1768-400f-95ea-389c7913dfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:01.967303 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1b966-1768-400f-95ea-389c7913dfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:01.967592 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1b966-1768-400f-95ea-389c7913dfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:01.967868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1b966-1768-400f-95ea-389c7913dfc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:01.968555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1b966-1768-400f-95ea-389c7913dfc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:13:01.968863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1b966-1768-400f-95ea-389c7913dfc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:01.970470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1b966-1768-400f-95ea-389c7913dfc4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:01.984097 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4363/8653] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:13:01.988465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f932886-a055-417e-9730-ef9e9be5524c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:01.998492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f932886-a055-417e-9730-ef9e9be5524c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:02.003267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a47ab-fdbf-4874-828c-e6701dbaadde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:02.003865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a47ab-fdbf-4874-828c-e6701dbaadde admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:02.004146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a47ab-fdbf-4874-828c-e6701dbaadde admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:02.004449 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a47ab-fdbf-4874-828c-e6701dbaadde admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:02.005082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a47ab-fdbf-4874-828c-e6701dbaadde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:02.006991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a47ab-fdbf-4874-828c-e6701dbaadde admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:02.143791 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4291/8654] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:13:01 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:13:02.147974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1b966-1768-400f-95ea-389c7913dfc4 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:02.159081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1b966-1768-400f-95ea-389c7913dfc4 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:02.219898 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77a022-0431-4ad3-9f70-9e3241d8b4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:02.220620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77a022-0431-4ad3-9f70-9e3241d8b4fe admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:02.220905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77a022-0431-4ad3-9f70-9e3241d8b4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:02.221182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77a022-0431-4ad3-9f70-9e3241d8b4fe admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:02.221859 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77a022-0431-4ad3-9f70-9e3241d8b4fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:02.223790 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77a022-0431-4ad3-9f70-9e3241d8b4fe admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:02.376934 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4364/8655] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:13:02 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:13:02.381268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a47ab-fdbf-4874-828c-e6701dbaadde admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:02.392614 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a47ab-fdbf-4874-828c-e6701dbaadde admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:02.405458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91744e7-107c-4225-a2f9-bd8809a3566c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:02.405458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91744e7-107c-4225-a2f9-bd8809a3566c admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:02.405458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91744e7-107c-4225-a2f9-bd8809a3566c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:02.405458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91744e7-107c-4225-a2f9-bd8809a3566c admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:02.406328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91744e7-107c-4225-a2f9-bd8809a3566c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:02.406328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91744e7-107c-4225-a2f9-bd8809a3566c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:02.412302 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4292/8656] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:13:02.416420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77a022-0431-4ad3-9f70-9e3241d8b4fe admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:02.426987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77a022-0431-4ad3-9f70-9e3241d8b4fe admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:02.432890 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e3714-5863-41f9-9654-2fea6aa91ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:02.433484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e3714-5863-41f9-9654-2fea6aa91ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:02.433784 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e3714-5863-41f9-9654-2fea6aa91ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:02.434040 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e3714-5863-41f9-9654-2fea6aa91ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:02.434674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e3714-5863-41f9-9654-2fea6aa91ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:02.436295 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e3714-5863-41f9-9654-2fea6aa91ae7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:02.447725 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4365/8657] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:13:02.452179 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91744e7-107c-4225-a2f9-bd8809a3566c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:02.462455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91744e7-107c-4225-a2f9-bd8809a3566c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:02.466960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffb675-2d68-4086-b4bf-2adf5f88101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:02.467583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffb675-2d68-4086-b4bf-2adf5f88101d admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:02.467861 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffb675-2d68-4086-b4bf-2adf5f88101d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:02.468131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffb675-2d68-4086-b4bf-2adf5f88101d admin admin] PATH_INFO: `/v3/projects/5543ac1f4e1742e3896e92f72506ca1b/users/1d92db5d9ed84fb088e271758da4adbc/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:02.482665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffb675-2d68-4086-b4bf-2adf5f88101d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5543ac1f4e1742e3896e92f72506ca1b, user_id=1d92db5d9ed84fb088e271758da4adbc, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:02.485297 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffb675-2d68-4086-b4bf-2adf5f88101d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:02.593474 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4293/8658] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:13:02 2022] PUT /identity/v3/projects/5543ac1f4e1742e3896e92f72506ca1b/users/1d92db5d9ed84fb088e271758da4adbc/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:13:02.598946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cb3b8-3fec-4861-a7ce-5b5dd666dc2b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:02.599235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cb3b8-3fec-4861-a7ce-5b5dd666dc2b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:02.599506 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cb3b8-3fec-4861-a7ce-5b5dd666dc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:02.619388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-7c5cb3b8-3fec-4861-a7ce-5b5dd666dc2b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:02.620626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-7c5cb3b8-3fec-4861-a7ce-5b5dd666dc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:02.679170 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4366/8659] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:13:02.689502 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffb675-2d68-4086-b4bf-2adf5f88101d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:02.691197 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0cffb675-2d68-4086-b4bf-2adf5f88101d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:02.751834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffb675-2d68-4086-b4bf-2adf5f88101d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:02.755609 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e7b3f-6ca3-4371-bd9d-76977a656428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:02.756236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e7b3f-6ca3-4371-bd9d-76977a656428 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:02.756554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e7b3f-6ca3-4371-bd9d-76977a656428 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:02.756828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e7b3f-6ca3-4371-bd9d-76977a656428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:02.767155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e7b3f-6ca3-4371-bd9d-76977a656428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:02.768645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e7b3f-6ca3-4371-bd9d-76977a656428 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:02.778812 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4294/8660] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:13:08.533719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bb9b5-c6d3-4adc-8d04-a63668d1ac6e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:08.534211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bb9b5-c6d3-4adc-8d04-a63668d1ac6e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:08.534319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bb9b5-c6d3-4adc-8d04-a63668d1ac6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:08.568611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c74bb9b5-c6d3-4adc-8d04-a63668d1ac6e None None] MFA Rules not processed for user `1d92db5d9ed84fb088e271758da4adbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:08.569931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c74bb9b5-c6d3-4adc-8d04-a63668d1ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:08.583561 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:08.652219 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4367/8661] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:13:08.659939 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316eb90-4c7c-465b-b3c8-11970791708a None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:08.664187 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316eb90-4c7c-465b-b3c8-11970791708a None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:08.664670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316eb90-4c7c-465b-b3c8-11970791708a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:08.685748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e316eb90-4c7c-465b-b3c8-11970791708a None None] MFA Rules not processed for user `1d92db5d9ed84fb088e271758da4adbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:08.686985 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e316eb90-4c7c-465b-b3c8-11970791708a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:08.694007 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4295/8662] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:13:08.708025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bb9b5-c6d3-4adc-8d04-a63668d1ac6e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:08.709754 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c74bb9b5-c6d3-4adc-8d04-a63668d1ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:08.798569 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bb9b5-c6d3-4adc-8d04-a63668d1ac6e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:08.803994 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854fe31-56c9-4041-b4b7-a8321304d377 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:08.804625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854fe31-56c9-4041-b4b7-a8321304d377 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:08.806869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854fe31-56c9-4041-b4b7-a8321304d377 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:08.806869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854fe31-56c9-4041-b4b7-a8321304d377 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:08.812966 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854fe31-56c9-4041-b4b7-a8321304d377 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:08.814580 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854fe31-56c9-4041-b4b7-a8321304d377 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:08.823899 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4368/8663] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:13:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:13:09.089574 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf871162-0fe8-4a52-9521-f56719869331 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:09.089885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf871162-0fe8-4a52-9521-f56719869331 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:09.090139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf871162-0fe8-4a52-9521-f56719869331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:09.097538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-bf871162-0fe8-4a52-9521-f56719869331 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:13:09.097538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:13:09.097538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:13:09.097538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:13:09.097538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:13:09.097538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:13:09.097538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:13:09.097538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:13:09.097538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:13:09.097538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:13:09.097538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:13:09.097538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:13:09.097538 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:13:09.098617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:13:09.098617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:13:09.098617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:13:09.098617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:13:09.098617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:13:09.098617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:13:09.098617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:13:09.098617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:13:09.098617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:13:09.098617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:13:09.098617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:13:09.098617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:13:09.098617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:13:09.098617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:13:09.098617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:13:09.100220 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4296/8664] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:13:09 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:13:09.122449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9e8e8-3a36-4053-aa43-f2bea16979aa None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:09.122449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9e8e8-3a36-4053-aa43-f2bea16979aa None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:09.122656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9e8e8-3a36-4053-aa43-f2bea16979aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:09.142412 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-88a9e8e8-3a36-4053-aa43-f2bea16979aa None None] MFA Rules not processed for user `1d92db5d9ed84fb088e271758da4adbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:09.143606 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-88a9e8e8-3a36-4053-aa43-f2bea16979aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:09.150602 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4369/8665] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:13:09.413900 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eb7ad-f145-41a3-a2cc-49e863715608 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:09.414171 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eb7ad-f145-41a3-a2cc-49e863715608 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:09.414462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eb7ad-f145-41a3-a2cc-49e863715608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:09.421546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-5f7eb7ad-f145-41a3-a2cc-49e863715608 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:13:09.421546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:13:09.421546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:13:09.421546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:13:09.421546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:13:09.421546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:13:09.421546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:13:09.421546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:13:09.421546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:13:09.421546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:13:09.421546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:13:09.421546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:13:09.421546 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:13:09.422591 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:13:09.422591 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:13:09.422591 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:13:09.422591 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:13:09.422591 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:13:09.422591 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:13:09.422591 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:13:09.422591 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:13:09.422591 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:13:09.422591 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:13:09.422591 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:13:09.422591 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:13:09.422591 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:13:09.422591 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:13:09.422591 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:13:09.423589 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4297/8666] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:13:09 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:13:13.158870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9e8e8-3a36-4053-aa43-f2bea16979aa None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:13.170279 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9e8e8-3a36-4053-aa43-f2bea16979aa None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:13.174836 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b942b96-1e27-4b23-b414-23a1d2058b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:13.175466 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b942b96-1e27-4b23-b414-23a1d2058b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:13.175748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b942b96-1e27-4b23-b414-23a1d2058b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:13.176022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b942b96-1e27-4b23-b414-23a1d2058b33 admin admin] PATH_INFO: `/v3/users/1d92db5d9ed84fb088e271758da4adbc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:13.177182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b942b96-1e27-4b23-b414-23a1d2058b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d92db5d9ed84fb088e271758da4adbc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:13.179097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b942b96-1e27-4b23-b414-23a1d2058b33 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:13.381380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5b942b96-1e27-4b23-b414-23a1d2058b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d92db5d9ed84fb088e271758da4adbc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:13.381992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5b942b96-1e27-4b23-b414-23a1d2058b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d92db5d9ed84fb088e271758da4adbc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:13.519086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5b942b96-1e27-4b23-b414-23a1d2058b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d92db5d9ed84fb088e271758da4adbc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:13.519730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5b942b96-1e27-4b23-b414-23a1d2058b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d92db5d9ed84fb088e271758da4adbc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:13.532980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5b942b96-1e27-4b23-b414-23a1d2058b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d92db5d9ed84fb088e271758da4adbc'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:13.547276 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4370/8667] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:13:13 2022] DELETE /identity/v3/users/1d92db5d9ed84fb088e271758da4adbc => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:13:13.844924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eb7ad-f145-41a3-a2cc-49e863715608 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:13.846736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-5f7eb7ad-f145-41a3-a2cc-49e863715608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:13.917368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eb7ad-f145-41a3-a2cc-49e863715608 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:13.921930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1002825-051d-4f36-95fb-cd6c6f7a78f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:13.925947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1002825-051d-4f36-95fb-cd6c6f7a78f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:13.925947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1002825-051d-4f36-95fb-cd6c6f7a78f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:13.925947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1002825-051d-4f36-95fb-cd6c6f7a78f3 admin admin] PATH_INFO: `/v3/projects/5543ac1f4e1742e3896e92f72506ca1b` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:13.925947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1002825-051d-4f36-95fb-cd6c6f7a78f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5543ac1f4e1742e3896e92f72506ca1b)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:13.926356 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1002825-051d-4f36-95fb-cd6c6f7a78f3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:13.949537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:14.054254 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d1002825-051d-4f36-95fb-cd6c6f7a78f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5543ac1f4e1742e3896e92f72506ca1b', 'request_id': 'req-d1002825-051d-4f36-95fb-cd6c6f7a78f3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:14.060027 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d1002825-051d-4f36-95fb-cd6c6f7a78f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5543ac1f4e1742e3896e92f72506ca1b', 'request_id': 'req-d1002825-051d-4f36-95fb-cd6c6f7a78f3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:14.066758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d1002825-051d-4f36-95fb-cd6c6f7a78f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5543ac1f4e1742e3896e92f72506ca1b', 'request_id': 'req-d1002825-051d-4f36-95fb-cd6c6f7a78f3'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:14.223655 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d1002825-051d-4f36-95fb-cd6c6f7a78f3 admin admin] The token cache is being invalidate because project 5543ac1f4e1742e3896e92f72506ca1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:13:14.223950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d1002825-051d-4f36-95fb-cd6c6f7a78f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:14.224654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d1002825-051d-4f36-95fb-cd6c6f7a78f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:14.226463 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4298/8668] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:13:13 2022] DELETE /identity/v3/projects/5543ac1f4e1742e3896e92f72506ca1b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:13:14.232608 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8e236-b112-4ba4-9fb1-2d978b20e34a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:14.241251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8e236-b112-4ba4-9fb1-2d978b20e34a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:14.241251 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8e236-b112-4ba4-9fb1-2d978b20e34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:14.244275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:14.255619 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-61e8e236-b112-4ba4-9fb1-2d978b20e34a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:14.256891 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-61e8e236-b112-4ba4-9fb1-2d978b20e34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:14.316090 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4371/8669] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:13:14.324887 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24418d-7de9-42b9-957e-d5742691c1fe None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:14.325177 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24418d-7de9-42b9-957e-d5742691c1fe None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:14.325458 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24418d-7de9-42b9-957e-d5742691c1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:14.347267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-8b24418d-7de9-42b9-957e-d5742691c1fe None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:14.348554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-8b24418d-7de9-42b9-957e-d5742691c1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:14.356854 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4299/8670] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:13:14.361542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8e236-b112-4ba4-9fb1-2d978b20e34a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:14.373897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8e236-b112-4ba4-9fb1-2d978b20e34a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:14.380716 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a46b5-784f-4611-b4e8-b53dbed7996f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:14.381332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a46b5-784f-4611-b4e8-b53dbed7996f admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:14.381607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a46b5-784f-4611-b4e8-b53dbed7996f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:14.381876 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a46b5-784f-4611-b4e8-b53dbed7996f admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:14.382524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a46b5-784f-4611-b4e8-b53dbed7996f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:13:14.382825 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a46b5-784f-4611-b4e8-b53dbed7996f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:14.385112 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a46b5-784f-4611-b4e8-b53dbed7996f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:14.398985 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4372/8671] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:13:14.403717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24418d-7de9-42b9-957e-d5742691c1fe None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:14.414148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24418d-7de9-42b9-957e-d5742691c1fe None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:14.419650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b43d6-ed89-4bc4-9e75-7efc9155e8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:14.420316 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b43d6-ed89-4bc4-9e75-7efc9155e8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:14.420686 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b43d6-ed89-4bc4-9e75-7efc9155e8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:14.420993 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b43d6-ed89-4bc4-9e75-7efc9155e8c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:14.421694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b43d6-ed89-4bc4-9e75-7efc9155e8c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:14.423691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b43d6-ed89-4bc4-9e75-7efc9155e8c3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:14.542998 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4300/8672] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:13:14 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:13:14.547681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a46b5-784f-4611-b4e8-b53dbed7996f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:14.559185 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a46b5-784f-4611-b4e8-b53dbed7996f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:14.623786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec8818-9007-4c67-b8b8-f75bfa5a694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:14.624658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec8818-9007-4c67-b8b8-f75bfa5a694a admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:14.624944 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec8818-9007-4c67-b8b8-f75bfa5a694a admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:14.625335 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec8818-9007-4c67-b8b8-f75bfa5a694a admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:14.626164 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec8818-9007-4c67-b8b8-f75bfa5a694a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:14.628104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec8818-9007-4c67-b8b8-f75bfa5a694a admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:14.731176 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4373/8673] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:13:14 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:13:14.736050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b43d6-ed89-4bc4-9e75-7efc9155e8c3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:14.748099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b43d6-ed89-4bc4-9e75-7efc9155e8c3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:14.752964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf6666-9f48-48d0-9d25-97e0fb7b0e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:14.753571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf6666-9f48-48d0-9d25-97e0fb7b0e5f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:14.753853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf6666-9f48-48d0-9d25-97e0fb7b0e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:14.754127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf6666-9f48-48d0-9d25-97e0fb7b0e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:14.754773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf6666-9f48-48d0-9d25-97e0fb7b0e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:14.756417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf6666-9f48-48d0-9d25-97e0fb7b0e5f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:14.768613 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4301/8674] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:13:14.774311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec8818-9007-4c67-b8b8-f75bfa5a694a admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:14.784930 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec8818-9007-4c67-b8b8-f75bfa5a694a admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:14.789709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf218de-0d2b-432f-a26f-4ab2dbdcdd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:14.790318 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf218de-0d2b-432f-a26f-4ab2dbdcdd22 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:14.791160 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf218de-0d2b-432f-a26f-4ab2dbdcdd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:14.791435 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf218de-0d2b-432f-a26f-4ab2dbdcdd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:14.792241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf218de-0d2b-432f-a26f-4ab2dbdcdd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:14.793885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf218de-0d2b-432f-a26f-4ab2dbdcdd22 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:14.805044 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4374/8675] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:13:14.810838 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf6666-9f48-48d0-9d25-97e0fb7b0e5f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:14.824088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf6666-9f48-48d0-9d25-97e0fb7b0e5f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:14.830642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c594c-fc60-41d4-a18e-79d18d160099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:14.831271 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c594c-fc60-41d4-a18e-79d18d160099 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:14.831553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c594c-fc60-41d4-a18e-79d18d160099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:14.831828 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c594c-fc60-41d4-a18e-79d18d160099 admin admin] PATH_INFO: `/v3/projects/97b503acaee64ab69e13c9dd3230850a/users/28287819ad454652b35408f15f959c32/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:14.847846 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c594c-fc60-41d4-a18e-79d18d160099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b503acaee64ab69e13c9dd3230850a, user_id=28287819ad454652b35408f15f959c32, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:14.850561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c594c-fc60-41d4-a18e-79d18d160099 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:14.928956 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4302/8676] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:13:14 2022] PUT /identity/v3/projects/97b503acaee64ab69e13c9dd3230850a/users/28287819ad454652b35408f15f959c32/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:13:14.935161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dc0b9-33ab-476c-bac9-649cfba13ba7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:14.935528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dc0b9-33ab-476c-bac9-649cfba13ba7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:14.935872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dc0b9-33ab-476c-bac9-649cfba13ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:14.967097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-653dc0b9-33ab-476c-bac9-649cfba13ba7 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:14.969076 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-653dc0b9-33ab-476c-bac9-649cfba13ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:15.049918 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4375/8677] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:13:15.059773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c594c-fc60-41d4-a18e-79d18d160099 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:15.061660 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-054c594c-fc60-41d4-a18e-79d18d160099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:15.126799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c594c-fc60-41d4-a18e-79d18d160099 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:15.130525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c46dc-757c-4f94-9e98-2460ab0a3698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:15.131431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c46dc-757c-4f94-9e98-2460ab0a3698 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:15.131699 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c46dc-757c-4f94-9e98-2460ab0a3698 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:15.131969 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c46dc-757c-4f94-9e98-2460ab0a3698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:15.142226 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c46dc-757c-4f94-9e98-2460ab0a3698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:15.143677 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c46dc-757c-4f94-9e98-2460ab0a3698 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:15.153275 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4303/8678] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:13:21.127087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6059dc9-6b3a-4c70-b580-400a4e4234c9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:21.127625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6059dc9-6b3a-4c70-b580-400a4e4234c9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:21.127625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6059dc9-6b3a-4c70-b580-400a4e4234c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:21.150840 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:21.161091 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c6059dc9-6b3a-4c70-b580-400a4e4234c9 None None] MFA Rules not processed for user `28287819ad454652b35408f15f959c32`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:21.164354 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c6059dc9-6b3a-4c70-b580-400a4e4234c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:21.234279 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4376/8679] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:13:21.252391 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c46dc-757c-4f94-9e98-2460ab0a3698 service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:21.253881 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f79c46dc-757c-4f94-9e98-2460ab0a3698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:21.312830 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:21.341897 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c46dc-757c-4f94-9e98-2460ab0a3698 service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:21.347549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afff64-5de3-4dc6-8ae0-8dd37d6ae6a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:21.348178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afff64-5de3-4dc6-8ae0-8dd37d6ae6a5 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:21.348478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afff64-5de3-4dc6-8ae0-8dd37d6ae6a5 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:21.348757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afff64-5de3-4dc6-8ae0-8dd37d6ae6a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:21.357184 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afff64-5de3-4dc6-8ae0-8dd37d6ae6a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:21.358908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afff64-5de3-4dc6-8ae0-8dd37d6ae6a5 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:21.367881 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4304/8680] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:13:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:13:24.068927 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288be40-4b2b-4c49-963f-956615d2f6ed None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:24.072146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288be40-4b2b-4c49-963f-956615d2f6ed None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:24.072146 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288be40-4b2b-4c49-963f-956615d2f6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:24.089887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-6288be40-4b2b-4c49-963f-956615d2f6ed None None] MFA Rules not processed for user `28287819ad454652b35408f15f959c32`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:24.091116 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6288be40-4b2b-4c49-963f-956615d2f6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:24.098471 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4377/8681] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:13:24.447560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c5e20-b272-44c3-81fa-b590b0f07d0c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:24.449217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c5e20-b272-44c3-81fa-b590b0f07d0c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:24.449217 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c5e20-b272-44c3-81fa-b590b0f07d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:24.456661 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-6e4c5e20-b272-44c3-81fa-b590b0f07d0c None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:13:24.456661 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:13:24.456661 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:13:24.456661 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:13:24.456661 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:13:24.456661 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:13:24.456661 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:13:24.456661 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:13:24.456661 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:13:24.456661 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:13:24.456661 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:13:24.456661 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:13:24.456661 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:13:24.457610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:13:24.457610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:13:24.457610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:13:24.457610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:13:24.457610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:13:24.457610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:13:24.457610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:13:24.457610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:13:24.457610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:13:24.457610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:13:24.457610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:13:24.457610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:13:24.457610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:13:24.457610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:13:24.457610 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:13:24.459161 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4305/8682] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:13:24 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:13:28.931728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288be40-4b2b-4c49-963f-956615d2f6ed None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:28.946603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288be40-4b2b-4c49-963f-956615d2f6ed None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:28.951197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490b95e-56e4-488b-9743-d2a755913e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:28.951830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490b95e-56e4-488b-9743-d2a755913e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:28.952109 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490b95e-56e4-488b-9743-d2a755913e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:28.952447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490b95e-56e4-488b-9743-d2a755913e88 admin admin] PATH_INFO: `/v3/users/28287819ad454652b35408f15f959c32` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:28.953687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490b95e-56e4-488b-9743-d2a755913e88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28287819ad454652b35408f15f959c32)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:28.955599 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490b95e-56e4-488b-9743-d2a755913e88 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:29.144999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6490b95e-56e4-488b-9743-d2a755913e88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28287819ad454652b35408f15f959c32'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:29.145659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6490b95e-56e4-488b-9743-d2a755913e88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28287819ad454652b35408f15f959c32'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:29.221632 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6490b95e-56e4-488b-9743-d2a755913e88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28287819ad454652b35408f15f959c32'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:29.226230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6490b95e-56e4-488b-9743-d2a755913e88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28287819ad454652b35408f15f959c32'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:29.234852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6490b95e-56e4-488b-9743-d2a755913e88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28287819ad454652b35408f15f959c32'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:29.247504 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4378/8683] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:13:28 2022] DELETE /identity/v3/users/28287819ad454652b35408f15f959c32 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:13:29.529999 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c5e20-b272-44c3-81fa-b590b0f07d0c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:29.531753 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6e4c5e20-b272-44c3-81fa-b590b0f07d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:29.603815 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c5e20-b272-44c3-81fa-b590b0f07d0c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:29.608720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854577d9-6bbe-44df-b1b7-0c2c86f53b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:29.609348 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854577d9-6bbe-44df-b1b7-0c2c86f53b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:29.609631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854577d9-6bbe-44df-b1b7-0c2c86f53b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:29.609912 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854577d9-6bbe-44df-b1b7-0c2c86f53b82 admin admin] PATH_INFO: `/v3/projects/97b503acaee64ab69e13c9dd3230850a` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:29.611054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854577d9-6bbe-44df-b1b7-0c2c86f53b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b503acaee64ab69e13c9dd3230850a)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:29.613025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854577d9-6bbe-44df-b1b7-0c2c86f53b82 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:29.714679 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-854577d9-6bbe-44df-b1b7-0c2c86f53b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b503acaee64ab69e13c9dd3230850a', 'request_id': 'req-854577d9-6bbe-44df-b1b7-0c2c86f53b82'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:29.720705 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-854577d9-6bbe-44df-b1b7-0c2c86f53b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b503acaee64ab69e13c9dd3230850a', 'request_id': 'req-854577d9-6bbe-44df-b1b7-0c2c86f53b82'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:29.727305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-854577d9-6bbe-44df-b1b7-0c2c86f53b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b503acaee64ab69e13c9dd3230850a', 'request_id': 'req-854577d9-6bbe-44df-b1b7-0c2c86f53b82'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:29.793647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-854577d9-6bbe-44df-b1b7-0c2c86f53b82 admin admin] The token cache is being invalidate because project 97b503acaee64ab69e13c9dd3230850a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:13:29.793938 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-854577d9-6bbe-44df-b1b7-0c2c86f53b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:29.794597 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-854577d9-6bbe-44df-b1b7-0c2c86f53b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:29.796115 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4306/8684] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:13:29 2022] DELETE /identity/v3/projects/97b503acaee64ab69e13c9dd3230850a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:13:29.807219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e5026-f5fa-4cd8-a7ff-78a586dbbedd None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:29.808727 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e5026-f5fa-4cd8-a7ff-78a586dbbedd None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:29.809015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e5026-f5fa-4cd8-a7ff-78a586dbbedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:29.828815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4d3e5026-f5fa-4cd8-a7ff-78a586dbbedd None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:29.830047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4d3e5026-f5fa-4cd8-a7ff-78a586dbbedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:29.889483 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4379/8685] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:13:29.898222 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64290690-6bff-4c86-abdf-53174b8dc029 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:29.898512 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64290690-6bff-4c86-abdf-53174b8dc029 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:29.899145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64290690-6bff-4c86-abdf-53174b8dc029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:29.920455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-64290690-6bff-4c86-abdf-53174b8dc029 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:29.922015 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-64290690-6bff-4c86-abdf-53174b8dc029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:29.929585 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4307/8686] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:13:29.934848 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e5026-f5fa-4cd8-a7ff-78a586dbbedd None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:29.945136 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e5026-f5fa-4cd8-a7ff-78a586dbbedd None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:29.950283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d9b28-db89-4c0f-a12e-c7f549524d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:29.950887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d9b28-db89-4c0f-a12e-c7f549524d90 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:29.951167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d9b28-db89-4c0f-a12e-c7f549524d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:29.951487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d9b28-db89-4c0f-a12e-c7f549524d90 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:29.952219 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d9b28-db89-4c0f-a12e-c7f549524d90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:13:29.952543 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d9b28-db89-4c0f-a12e-c7f549524d90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:29.954156 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d9b28-db89-4c0f-a12e-c7f549524d90 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:29.955679 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:29.967908 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4380/8687] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:13:29.971065 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64290690-6bff-4c86-abdf-53174b8dc029 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:29.981635 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64290690-6bff-4c86-abdf-53174b8dc029 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:29.986400 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409f5d7-b937-4ada-ac20-54cf79e8c215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:29.987002 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409f5d7-b937-4ada-ac20-54cf79e8c215 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:29.987285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409f5d7-b937-4ada-ac20-54cf79e8c215 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:29.987562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409f5d7-b937-4ada-ac20-54cf79e8c215 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:29.988212 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409f5d7-b937-4ada-ac20-54cf79e8c215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:29.990132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409f5d7-b937-4ada-ac20-54cf79e8c215 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:30.090139 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4308/8688] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:13:29 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:13:30.091680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d9b28-db89-4c0f-a12e-c7f549524d90 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:30.102320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d9b28-db89-4c0f-a12e-c7f549524d90 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:30.157918 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fccce7-3335-4ae9-aed0-d3ba1f512828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:30.158522 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fccce7-3335-4ae9-aed0-d3ba1f512828 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:30.158797 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fccce7-3335-4ae9-aed0-d3ba1f512828 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:30.159331 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fccce7-3335-4ae9-aed0-d3ba1f512828 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:30.159946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fccce7-3335-4ae9-aed0-d3ba1f512828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:30.161903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fccce7-3335-4ae9-aed0-d3ba1f512828 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:30.279976 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4381/8689] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:13:30 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 05:13:30.284408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409f5d7-b937-4ada-ac20-54cf79e8c215 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:30.296592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409f5d7-b937-4ada-ac20-54cf79e8c215 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:30.301236 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629cdc4-5e41-4b5f-9aea-2df577f48274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:30.301877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629cdc4-5e41-4b5f-9aea-2df577f48274 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:30.302161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629cdc4-5e41-4b5f-9aea-2df577f48274 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:30.302436 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629cdc4-5e41-4b5f-9aea-2df577f48274 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:30.303097 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629cdc4-5e41-4b5f-9aea-2df577f48274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:30.306126 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629cdc4-5e41-4b5f-9aea-2df577f48274 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:30.317659 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4309/8690] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:13:30.321696 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fccce7-3335-4ae9-aed0-d3ba1f512828 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:30.332238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fccce7-3335-4ae9-aed0-d3ba1f512828 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:30.336867 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1f3e6-7efa-4acf-9762-677a8ff95c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:30.337461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1f3e6-7efa-4acf-9762-677a8ff95c64 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:30.337735 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1f3e6-7efa-4acf-9762-677a8ff95c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:30.338005 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1f3e6-7efa-4acf-9762-677a8ff95c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:30.339375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1f3e6-7efa-4acf-9762-677a8ff95c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:30.340917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1f3e6-7efa-4acf-9762-677a8ff95c64 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:30.351521 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4382/8691] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:13:30.356499 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629cdc4-5e41-4b5f-9aea-2df577f48274 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:30.366751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629cdc4-5e41-4b5f-9aea-2df577f48274 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:30.371746 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23716304-702d-4dd5-a306-b0ea76665a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:30.372447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23716304-702d-4dd5-a306-b0ea76665a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:30.373158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23716304-702d-4dd5-a306-b0ea76665a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:30.373158 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23716304-702d-4dd5-a306-b0ea76665a10 admin admin] PATH_INFO: `/v3/projects/db5b07d8deec469fb9203212887071fb/users/4b1a28b8aaac430fad0afd068d1816b1/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:30.388683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23716304-702d-4dd5-a306-b0ea76665a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db5b07d8deec469fb9203212887071fb, user_id=4b1a28b8aaac430fad0afd068d1816b1, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:30.391951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23716304-702d-4dd5-a306-b0ea76665a10 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:30.501308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:30.506163 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4310/8692] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:13:30 2022] PUT /identity/v3/projects/db5b07d8deec469fb9203212887071fb/users/4b1a28b8aaac430fad0afd068d1816b1/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:13:30.512559 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a6975-41e3-4ca7-9052-779fc417209b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:30.512849 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a6975-41e3-4ca7-9052-779fc417209b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:30.513144 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a6975-41e3-4ca7-9052-779fc417209b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:30.532646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-bb1a6975-41e3-4ca7-9052-779fc417209b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:30.533821 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-bb1a6975-41e3-4ca7-9052-779fc417209b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:30.594109 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4383/8693] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:13:30.603759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23716304-702d-4dd5-a306-b0ea76665a10 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:30.605591 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-23716304-702d-4dd5-a306-b0ea76665a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:30.666478 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23716304-702d-4dd5-a306-b0ea76665a10 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:30.671703 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd02b15-87a4-44b9-a170-9e56c7866510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:30.672365 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd02b15-87a4-44b9-a170-9e56c7866510 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:30.672647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd02b15-87a4-44b9-a170-9e56c7866510 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:30.672963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd02b15-87a4-44b9-a170-9e56c7866510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:30.682082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd02b15-87a4-44b9-a170-9e56c7866510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:30.683598 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd02b15-87a4-44b9-a170-9e56c7866510 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:30.693134 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4311/8694] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:13:36.327805 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4a1ed-79b9-4ee1-8450-1c3a3c9d0d65 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:36.328404 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4a1ed-79b9-4ee1-8450-1c3a3c9d0d65 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:36.328540 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4a1ed-79b9-4ee1-8450-1c3a3c9d0d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:36.364459 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-65f4a1ed-79b9-4ee1-8450-1c3a3c9d0d65 None None] MFA Rules not processed for user `4b1a28b8aaac430fad0afd068d1816b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:36.365700 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-65f4a1ed-79b9-4ee1-8450-1c3a3c9d0d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:36.440414 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4384/8695] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:13:36.450990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255e86b-e0c0-4522-9cca-4b8698e4e2a8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:36.451536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255e86b-e0c0-4522-9cca-4b8698e4e2a8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:36.452061 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255e86b-e0c0-4522-9cca-4b8698e4e2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:36.482877 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9255e86b-e0c0-4522-9cca-4b8698e4e2a8 None None] MFA Rules not processed for user `4b1a28b8aaac430fad0afd068d1816b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:36.484094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9255e86b-e0c0-4522-9cca-4b8698e4e2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:36.491681 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4312/8696] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:13:36.504064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4a1ed-79b9-4ee1-8450-1c3a3c9d0d65 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:36.505516 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-65f4a1ed-79b9-4ee1-8450-1c3a3c9d0d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:36.518780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:36.591744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4a1ed-79b9-4ee1-8450-1c3a3c9d0d65 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:36.597706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50976f58-c171-49d4-a4c0-49b9ba41a604 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:36.598322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50976f58-c171-49d4-a4c0-49b9ba41a604 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:36.598600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50976f58-c171-49d4-a4c0-49b9ba41a604 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:36.598870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50976f58-c171-49d4-a4c0-49b9ba41a604 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:36.607349 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50976f58-c171-49d4-a4c0-49b9ba41a604 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:36.609061 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50976f58-c171-49d4-a4c0-49b9ba41a604 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:36.618494 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4385/8697] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:13:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:13:36.866482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65652f2-9ee7-4ae6-b3c8-2883425b55d5 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:36.866773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65652f2-9ee7-4ae6-b3c8-2883425b55d5 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:36.867310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65652f2-9ee7-4ae6-b3c8-2883425b55d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:36.874617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-f65652f2-9ee7-4ae6-b3c8-2883425b55d5 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:13:36.874617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:13:36.874617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:13:36.874617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:13:36.874617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:13:36.874617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:13:36.874617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:13:36.874617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:13:36.874617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:13:36.874617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:13:36.874617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:13:36.874617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:13:36.874617 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:13:36.877892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:13:36.877892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:13:36.877892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:13:36.877892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:13:36.877892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:13:36.877892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:13:36.877892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:13:36.877892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:13:36.877892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:13:36.877892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:13:36.877892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:13:36.877892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:13:36.877892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:13:36.877892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:13:36.877892 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:13:36.878895 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4313/8698] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:13:36 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:13:40.720781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50976f58-c171-49d4-a4c0-49b9ba41a604 service nova] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:40.732947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50976f58-c171-49d4-a4c0-49b9ba41a604 service nova] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:40.737521 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c029a6-6a08-45c6-a070-42ac1de2dc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:40.738166 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c029a6-6a08-45c6-a070-42ac1de2dc6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:40.738493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c029a6-6a08-45c6-a070-42ac1de2dc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:40.738869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c029a6-6a08-45c6-a070-42ac1de2dc6b admin admin] PATH_INFO: `/v3/users/4b1a28b8aaac430fad0afd068d1816b1` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:40.740026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c029a6-6a08-45c6-a070-42ac1de2dc6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b1a28b8aaac430fad0afd068d1816b1)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:40.742066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c029a6-6a08-45c6-a070-42ac1de2dc6b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:41.004343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d9c029a6-6a08-45c6-a070-42ac1de2dc6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b1a28b8aaac430fad0afd068d1816b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:41.009280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d9c029a6-6a08-45c6-a070-42ac1de2dc6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b1a28b8aaac430fad0afd068d1816b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:41.085050 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d9c029a6-6a08-45c6-a070-42ac1de2dc6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b1a28b8aaac430fad0afd068d1816b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:41.085869 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d9c029a6-6a08-45c6-a070-42ac1de2dc6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b1a28b8aaac430fad0afd068d1816b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:41.099802 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-d9c029a6-6a08-45c6-a070-42ac1de2dc6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b1a28b8aaac430fad0afd068d1816b1'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:41.112175 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4386/8699] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:13:40 2022] DELETE /identity/v3/users/4b1a28b8aaac430fad0afd068d1816b1 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:13:41.360810 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65652f2-9ee7-4ae6-b3c8-2883425b55d5 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:41.363547 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f65652f2-9ee7-4ae6-b3c8-2883425b55d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:41.435247 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65652f2-9ee7-4ae6-b3c8-2883425b55d5 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:41.439922 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18035c38-87a2-49cc-9bbc-b589f7b29acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:41.440581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18035c38-87a2-49cc-9bbc-b589f7b29acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:41.440865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18035c38-87a2-49cc-9bbc-b589f7b29acf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:41.441139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18035c38-87a2-49cc-9bbc-b589f7b29acf admin admin] PATH_INFO: `/v3/projects/db5b07d8deec469fb9203212887071fb` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:41.442272 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18035c38-87a2-49cc-9bbc-b589f7b29acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=db5b07d8deec469fb9203212887071fb)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:41.444252 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18035c38-87a2-49cc-9bbc-b589f7b29acf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:41.553776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-18035c38-87a2-49cc-9bbc-b589f7b29acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db5b07d8deec469fb9203212887071fb', 'request_id': 'req-18035c38-87a2-49cc-9bbc-b589f7b29acf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:41.560278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-18035c38-87a2-49cc-9bbc-b589f7b29acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db5b07d8deec469fb9203212887071fb', 'request_id': 'req-18035c38-87a2-49cc-9bbc-b589f7b29acf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:41.566520 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-18035c38-87a2-49cc-9bbc-b589f7b29acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db5b07d8deec469fb9203212887071fb', 'request_id': 'req-18035c38-87a2-49cc-9bbc-b589f7b29acf'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:41.639466 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-18035c38-87a2-49cc-9bbc-b589f7b29acf admin admin] The token cache is being invalidate because project db5b07d8deec469fb9203212887071fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:13:41.639682 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-18035c38-87a2-49cc-9bbc-b589f7b29acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:41.640398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-18035c38-87a2-49cc-9bbc-b589f7b29acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:13:41.641871 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4314/8700] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:13:41 2022] DELETE /identity/v3/projects/db5b07d8deec469fb9203212887071fb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:13:41.651726 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357b7fa-a786-43c4-8924-23146f433104 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:41.657082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357b7fa-a786-43c4-8924-23146f433104 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:41.657082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357b7fa-a786-43c4-8924-23146f433104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:41.672565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-b357b7fa-a786-43c4-8924-23146f433104 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:41.673765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b357b7fa-a786-43c4-8924-23146f433104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:41.723787 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:41.732941 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4387/8701] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:13:41.741461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b511a-f7ca-4092-a6e9-2f1990a938ed None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:41.741747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b511a-f7ca-4092-a6e9-2f1990a938ed None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:41.742033 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b511a-f7ca-4092-a6e9-2f1990a938ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:41.763003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0b8b511a-f7ca-4092-a6e9-2f1990a938ed None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:41.764318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0b8b511a-f7ca-4092-a6e9-2f1990a938ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:41.772119 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4315/8702] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:13:41.776586 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357b7fa-a786-43c4-8924-23146f433104 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:41.786620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357b7fa-a786-43c4-8924-23146f433104 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:41.791307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5f85b-3842-489a-bfc2-f521847992b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:41.792507 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5f85b-3842-489a-bfc2-f521847992b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:41.792788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5f85b-3842-489a-bfc2-f521847992b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:41.793092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5f85b-3842-489a-bfc2-f521847992b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:41.793736 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5f85b-3842-489a-bfc2-f521847992b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:13:41.794063 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5f85b-3842-489a-bfc2-f521847992b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:41.795657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5f85b-3842-489a-bfc2-f521847992b0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:41.808534 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4388/8703] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:13:41.812932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b511a-f7ca-4092-a6e9-2f1990a938ed None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:41.823561 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b511a-f7ca-4092-a6e9-2f1990a938ed None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:41.828203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684e7f5-fe5c-4dd4-b202-434a2ed31011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:41.828796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684e7f5-fe5c-4dd4-b202-434a2ed31011 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:41.829072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684e7f5-fe5c-4dd4-b202-434a2ed31011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:41.829341 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684e7f5-fe5c-4dd4-b202-434a2ed31011 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:41.829961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684e7f5-fe5c-4dd4-b202-434a2ed31011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:41.831848 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684e7f5-fe5c-4dd4-b202-434a2ed31011 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:41.948392 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:41.955760 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4316/8704] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:13:41 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:13:41.959940 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5f85b-3842-489a-bfc2-f521847992b0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:41.970509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5f85b-3842-489a-bfc2-f521847992b0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:42.027311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab3bd7-b72d-4a9e-ac25-003f170cc924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:42.027915 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab3bd7-b72d-4a9e-ac25-003f170cc924 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:42.028235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab3bd7-b72d-4a9e-ac25-003f170cc924 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:42.028512 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab3bd7-b72d-4a9e-ac25-003f170cc924 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:42.029154 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab3bd7-b72d-4a9e-ac25-003f170cc924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:42.031059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab3bd7-b72d-4a9e-ac25-003f170cc924 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:42.142615 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4389/8705] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:13:41 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:13:42.146755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684e7f5-fe5c-4dd4-b202-434a2ed31011 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:42.160801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684e7f5-fe5c-4dd4-b202-434a2ed31011 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:42.165720 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbaa17-6624-46ee-9974-f57b3888cecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:42.166323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbaa17-6624-46ee-9974-f57b3888cecf admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:42.166641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbaa17-6624-46ee-9974-f57b3888cecf admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:42.168000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbaa17-6624-46ee-9974-f57b3888cecf admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:42.168756 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbaa17-6624-46ee-9974-f57b3888cecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:42.170408 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbaa17-6624-46ee-9974-f57b3888cecf admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:42.181019 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4317/8706] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:13:42.185257 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab3bd7-b72d-4a9e-ac25-003f170cc924 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:42.196218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab3bd7-b72d-4a9e-ac25-003f170cc924 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:42.202703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d8e49-daaa-4e77-a46a-6b6031d54497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:42.203202 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d8e49-daaa-4e77-a46a-6b6031d54497 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:42.203487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d8e49-daaa-4e77-a46a-6b6031d54497 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:42.203762 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d8e49-daaa-4e77-a46a-6b6031d54497 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:42.204452 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d8e49-daaa-4e77-a46a-6b6031d54497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:42.206086 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d8e49-daaa-4e77-a46a-6b6031d54497 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:42.217870 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4390/8707] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:13:42.222284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbaa17-6624-46ee-9974-f57b3888cecf admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:42.233594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbaa17-6624-46ee-9974-f57b3888cecf admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:42.238256 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abbb80-15f5-4f7c-ab38-4b5a05413554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:42.238905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abbb80-15f5-4f7c-ab38-4b5a05413554 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:42.239181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abbb80-15f5-4f7c-ab38-4b5a05413554 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:42.239456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abbb80-15f5-4f7c-ab38-4b5a05413554 admin admin] PATH_INFO: `/v3/projects/67bcc69e05534d498bd49685ac3611a8/users/71340b011abb43889c6b315ed706167d/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:42.254410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abbb80-15f5-4f7c-ab38-4b5a05413554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67bcc69e05534d498bd49685ac3611a8, user_id=71340b011abb43889c6b315ed706167d, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:42.257205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abbb80-15f5-4f7c-ab38-4b5a05413554 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:42.346267 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4318/8708] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:13:42 2022] PUT /identity/v3/projects/67bcc69e05534d498bd49685ac3611a8/users/71340b011abb43889c6b315ed706167d/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:13:42.361713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eed770-9400-4144-a046-64cc4000405f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:42.362053 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eed770-9400-4144-a046-64cc4000405f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:42.362378 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eed770-9400-4144-a046-64cc4000405f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:42.390671 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e4eed770-9400-4144-a046-64cc4000405f None None] MFA Rules not processed for user `71340b011abb43889c6b315ed706167d`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:13:42.391878 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e4eed770-9400-4144-a046-64cc4000405f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:42.456506 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4391/8709] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:13:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:13:42.467909 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abbb80-15f5-4f7c-ab38-4b5a05413554 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:13:42.469800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-58abbb80-15f5-4f7c-ab38-4b5a05413554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:13:42.531831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abbb80-15f5-4f7c-ab38-4b5a05413554 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:13:42.536630 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb592e1-f3f8-4531-9d2f-7a32be7dd9a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:13:42.537242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb592e1-f3f8-4531-9d2f-7a32be7dd9a8 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:13:42.537584 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb592e1-f3f8-4531-9d2f-7a32be7dd9a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:13:42.537862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb592e1-f3f8-4531-9d2f-7a32be7dd9a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:13:42.548350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb592e1-f3f8-4531-9d2f-7a32be7dd9a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:13:42.549805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb592e1-f3f8-4531-9d2f-7a32be7dd9a8 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:13:42.559071 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4319/8710] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:13:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:13:52.453510 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:13:52.554712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:01.827745 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eed770-9400-4144-a046-64cc4000405f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:01.893972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eed770-9400-4144-a046-64cc4000405f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:01.898622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f13846-043c-4115-a69a-2bddd5fa40e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:01.899268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f13846-043c-4115-a69a-2bddd5fa40e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:01.899582 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f13846-043c-4115-a69a-2bddd5fa40e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:01.899862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f13846-043c-4115-a69a-2bddd5fa40e0 admin admin] PATH_INFO: `/v3/users/71340b011abb43889c6b315ed706167d` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:01.901556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f13846-043c-4115-a69a-2bddd5fa40e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71340b011abb43889c6b315ed706167d)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:01.903478 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f13846-043c-4115-a69a-2bddd5fa40e0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:02.117092 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c5f13846-043c-4115-a69a-2bddd5fa40e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71340b011abb43889c6b315ed706167d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:02.117646 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c5f13846-043c-4115-a69a-2bddd5fa40e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71340b011abb43889c6b315ed706167d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:02.187676 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c5f13846-043c-4115-a69a-2bddd5fa40e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71340b011abb43889c6b315ed706167d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:02.188328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c5f13846-043c-4115-a69a-2bddd5fa40e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71340b011abb43889c6b315ed706167d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:02.201438 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c5f13846-043c-4115-a69a-2bddd5fa40e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71340b011abb43889c6b315ed706167d'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:02.214731 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4392/8711] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:14:01 2022] DELETE /identity/v3/users/71340b011abb43889c6b315ed706167d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:14:02.219149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4be00-8d56-4170-88ce-e9869fdbabf4 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:02.219652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4be00-8d56-4170-88ce-e9869fdbabf4 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:02.219771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4be00-8d56-4170-88ce-e9869fdbabf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:02.239427 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-e7b4be00-8d56-4170-88ce-e9869fdbabf4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:02.240694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e7b4be00-8d56-4170-88ce-e9869fdbabf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:02.302362 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4320/8712] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:02.312558 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f13846-043c-4115-a69a-2bddd5fa40e0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:02.313967 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c5f13846-043c-4115-a69a-2bddd5fa40e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:02.375709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f13846-043c-4115-a69a-2bddd5fa40e0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:02.379215 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e84ba-3a09-459e-b875-29b5def13716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:02.379838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e84ba-3a09-459e-b875-29b5def13716 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:02.380101 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e84ba-3a09-459e-b875-29b5def13716 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:02.380408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e84ba-3a09-459e-b875-29b5def13716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:02.389729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e84ba-3a09-459e-b875-29b5def13716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:02.391155 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e84ba-3a09-459e-b875-29b5def13716 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:02.400528 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4393/8713] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:14:02.650555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4be00-8d56-4170-88ce-e9869fdbabf4 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:02.653030 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e7b4be00-8d56-4170-88ce-e9869fdbabf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:02.668602 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4be00-8d56-4170-88ce-e9869fdbabf4 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:02.674344 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51cb82-a81e-4135-a6c1-b6119c678edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:02.675142 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51cb82-a81e-4135-a6c1-b6119c678edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:02.675426 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51cb82-a81e-4135-a6c1-b6119c678edb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:02.675827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51cb82-a81e-4135-a6c1-b6119c678edb admin admin] PATH_INFO: `/v3/projects/67bcc69e05534d498bd49685ac3611a8` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:02.676951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51cb82-a81e-4135-a6c1-b6119c678edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=67bcc69e05534d498bd49685ac3611a8)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:02.678956 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51cb82-a81e-4135-a6c1-b6119c678edb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:02.799954 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8e51cb82-a81e-4135-a6c1-b6119c678edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67bcc69e05534d498bd49685ac3611a8', 'request_id': 'req-8e51cb82-a81e-4135-a6c1-b6119c678edb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:02.805612 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8e51cb82-a81e-4135-a6c1-b6119c678edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67bcc69e05534d498bd49685ac3611a8', 'request_id': 'req-8e51cb82-a81e-4135-a6c1-b6119c678edb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:02.813129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8e51cb82-a81e-4135-a6c1-b6119c678edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67bcc69e05534d498bd49685ac3611a8', 'request_id': 'req-8e51cb82-a81e-4135-a6c1-b6119c678edb'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:02.917416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8e51cb82-a81e-4135-a6c1-b6119c678edb admin admin] The token cache is being invalidate because project 67bcc69e05534d498bd49685ac3611a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:14:02.917648 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8e51cb82-a81e-4135-a6c1-b6119c678edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:02.918243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-8e51cb82-a81e-4135-a6c1-b6119c678edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:02.919762 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4321/8714] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:14:02 2022] DELETE /identity/v3/projects/67bcc69e05534d498bd49685ac3611a8 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:14:02.925218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92216010-bfdb-4723-be49-4f546b8a17bc None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:02.925724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92216010-bfdb-4723-be49-4f546b8a17bc None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:02.925831 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92216010-bfdb-4723-be49-4f546b8a17bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:02.946463 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-92216010-bfdb-4723-be49-4f546b8a17bc None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:02.948447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-92216010-bfdb-4723-be49-4f546b8a17bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:02.966855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:03.011302 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4394/8715] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:03.019345 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68e5c9-7cbf-4d02-90d5-dac09724b07b None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:03.019638 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68e5c9-7cbf-4d02-90d5-dac09724b07b None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:03.019919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68e5c9-7cbf-4d02-90d5-dac09724b07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:03.042066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9b68e5c9-7cbf-4d02-90d5-dac09724b07b None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:03.043292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9b68e5c9-7cbf-4d02-90d5-dac09724b07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:03.051673 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4322/8716] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:03.055949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92216010-bfdb-4723-be49-4f546b8a17bc None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:03.066938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92216010-bfdb-4723-be49-4f546b8a17bc None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:03.071482 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1b187-38cd-481f-b88a-5c86ac17fc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:03.072081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1b187-38cd-481f-b88a-5c86ac17fc09 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:03.072397 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1b187-38cd-481f-b88a-5c86ac17fc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:03.073218 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1b187-38cd-481f-b88a-5c86ac17fc09 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:03.073863 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1b187-38cd-481f-b88a-5c86ac17fc09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:14:03.074167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1b187-38cd-481f-b88a-5c86ac17fc09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:03.075753 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1b187-38cd-481f-b88a-5c86ac17fc09 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:03.087143 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4395/8717] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:14:03.091637 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68e5c9-7cbf-4d02-90d5-dac09724b07b None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:03.101000 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68e5c9-7cbf-4d02-90d5-dac09724b07b None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:03.105774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5900a82-c249-406a-9c7e-ad291c3af5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:03.106386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5900a82-c249-406a-9c7e-ad291c3af5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:03.106672 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5900a82-c249-406a-9c7e-ad291c3af5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:03.106947 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5900a82-c249-406a-9c7e-ad291c3af5d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:03.107624 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5900a82-c249-406a-9c7e-ad291c3af5d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:03.109578 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5900a82-c249-406a-9c7e-ad291c3af5d5 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:03.222892 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4323/8718] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:14:03 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:14:03.227120 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1b187-38cd-481f-b88a-5c86ac17fc09 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:03.237579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1b187-38cd-481f-b88a-5c86ac17fc09 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:03.295032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b056c3-54e9-4644-b9d4-07586c071c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:03.295665 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b056c3-54e9-4644-b9d4-07586c071c73 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:03.295946 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b056c3-54e9-4644-b9d4-07586c071c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:03.296260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b056c3-54e9-4644-b9d4-07586c071c73 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:03.296885 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b056c3-54e9-4644-b9d4-07586c071c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:03.298826 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b056c3-54e9-4644-b9d4-07586c071c73 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:03.386007 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4396/8719] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:14:03 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:14:03.390296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5900a82-c249-406a-9c7e-ad291c3af5d5 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:03.400683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5900a82-c249-406a-9c7e-ad291c3af5d5 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:03.406140 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dc3e8-c7c7-4189-aa76-d6df522f1570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:03.406745 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dc3e8-c7c7-4189-aa76-d6df522f1570 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:03.407025 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dc3e8-c7c7-4189-aa76-d6df522f1570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:03.407313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dc3e8-c7c7-4189-aa76-d6df522f1570 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:03.407986 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dc3e8-c7c7-4189-aa76-d6df522f1570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:03.409921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dc3e8-c7c7-4189-aa76-d6df522f1570 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:03.421489 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4324/8720] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:14:03.425409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b056c3-54e9-4644-b9d4-07586c071c73 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:03.436871 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b056c3-54e9-4644-b9d4-07586c071c73 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:03.441551 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041810b5-df0a-4267-b226-e04a13b82bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:03.442138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041810b5-df0a-4267-b226-e04a13b82bce admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:03.442424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041810b5-df0a-4267-b226-e04a13b82bce admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:03.442695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041810b5-df0a-4267-b226-e04a13b82bce admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:03.443328 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041810b5-df0a-4267-b226-e04a13b82bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:03.445006 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041810b5-df0a-4267-b226-e04a13b82bce admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:03.456463 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4397/8721] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:14:03.460867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dc3e8-c7c7-4189-aa76-d6df522f1570 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:03.471665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dc3e8-c7c7-4189-aa76-d6df522f1570 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:03.476475 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cbdb5-d4e2-433a-906a-e609fe3c30b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:03.477083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cbdb5-d4e2-433a-906a-e609fe3c30b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:03.477370 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cbdb5-d4e2-433a-906a-e609fe3c30b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:03.477649 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cbdb5-d4e2-433a-906a-e609fe3c30b3 admin admin] PATH_INFO: `/v3/projects/c4068066f5a64b25985bef6050c16aea/users/c3258713de7746d18167e7e853256c87/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:03.494114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cbdb5-d4e2-433a-906a-e609fe3c30b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4068066f5a64b25985bef6050c16aea, user_id=c3258713de7746d18167e7e853256c87, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:03.498161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cbdb5-d4e2-433a-906a-e609fe3c30b3 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:03.594463 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4325/8722] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:14:03 2022] PUT /identity/v3/projects/c4068066f5a64b25985bef6050c16aea/users/c3258713de7746d18167e7e853256c87/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:14:03.605290 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c75b0-2744-4c11-95bb-01e38ca8142b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:03.605575 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c75b0-2744-4c11-95bb-01e38ca8142b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:03.605851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c75b0-2744-4c11-95bb-01e38ca8142b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:03.634957 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-875c75b0-2744-4c11-95bb-01e38ca8142b None None] MFA Rules not processed for user `c3258713de7746d18167e7e853256c87`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:03.636287 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-875c75b0-2744-4c11-95bb-01e38ca8142b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:03.701350 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4398/8723] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:03.711328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cbdb5-d4e2-433a-906a-e609fe3c30b3 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:03.713050 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1c2cbdb5-d4e2-433a-906a-e609fe3c30b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:03.736665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:03.774138 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cbdb5-d4e2-433a-906a-e609fe3c30b3 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:03.778383 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00d0d1-5947-42b5-9b56-4ca0c8dcadb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:03.778991 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00d0d1-5947-42b5-9b56-4ca0c8dcadb5 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:03.779486 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00d0d1-5947-42b5-9b56-4ca0c8dcadb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:03.779933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00d0d1-5947-42b5-9b56-4ca0c8dcadb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:03.789014 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00d0d1-5947-42b5-9b56-4ca0c8dcadb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:03.790511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00d0d1-5947-42b5-9b56-4ca0c8dcadb5 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:03.800085 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4326/8724] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:14:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:14:10.545173 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c75b0-2744-4c11-95bb-01e38ca8142b None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:10.576993 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:10.630212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c75b0-2744-4c11-95bb-01e38ca8142b None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:10.636768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b448257-3a8b-4b22-bb5c-7eff8e6226a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:10.637704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b448257-3a8b-4b22-bb5c-7eff8e6226a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:10.638124 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b448257-3a8b-4b22-bb5c-7eff8e6226a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:10.638536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b448257-3a8b-4b22-bb5c-7eff8e6226a0 admin admin] PATH_INFO: `/v3/users/c3258713de7746d18167e7e853256c87` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:10.640222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b448257-3a8b-4b22-bb5c-7eff8e6226a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3258713de7746d18167e7e853256c87)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:10.643222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b448257-3a8b-4b22-bb5c-7eff8e6226a0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:10.848409 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8b448257-3a8b-4b22-bb5c-7eff8e6226a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3258713de7746d18167e7e853256c87'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:10.849062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8b448257-3a8b-4b22-bb5c-7eff8e6226a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3258713de7746d18167e7e853256c87'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:10.976718 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8b448257-3a8b-4b22-bb5c-7eff8e6226a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3258713de7746d18167e7e853256c87'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:10.977355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8b448257-3a8b-4b22-bb5c-7eff8e6226a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3258713de7746d18167e7e853256c87'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:10.990059 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-8b448257-3a8b-4b22-bb5c-7eff8e6226a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3258713de7746d18167e7e853256c87'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:11.002164 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4399/8725] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:14:10 2022] DELETE /identity/v3/users/c3258713de7746d18167e7e853256c87 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:14:11.006755 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f69e1-a84b-4791-b3b0-0920d478fd33 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:11.007216 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f69e1-a84b-4791-b3b0-0920d478fd33 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:11.007319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f69e1-a84b-4791-b3b0-0920d478fd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:11.034917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ca0f69e1-a84b-4791-b3b0-0920d478fd33 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:11.034917 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ca0f69e1-a84b-4791-b3b0-0920d478fd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:11.089690 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4327/8726] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:11.099642 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b448257-3a8b-4b22-bb5c-7eff8e6226a0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:11.101089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8b448257-3a8b-4b22-bb5c-7eff8e6226a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:11.164032 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b448257-3a8b-4b22-bb5c-7eff8e6226a0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:11.168192 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afb149-6c16-45ac-8b91-140e7d021272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:11.168794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afb149-6c16-45ac-8b91-140e7d021272 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:11.169077 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afb149-6c16-45ac-8b91-140e7d021272 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:11.169347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afb149-6c16-45ac-8b91-140e7d021272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:11.178428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afb149-6c16-45ac-8b91-140e7d021272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:11.179855 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afb149-6c16-45ac-8b91-140e7d021272 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:11.190415 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4400/8727] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:14:11.450674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f69e1-a84b-4791-b3b0-0920d478fd33 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:11.452284 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ca0f69e1-a84b-4791-b3b0-0920d478fd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:11.465687 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f69e1-a84b-4791-b3b0-0920d478fd33 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:11.470581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51802af-58f4-4745-b58b-1a2ea9c71bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:11.471094 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51802af-58f4-4745-b58b-1a2ea9c71bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:11.471378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51802af-58f4-4745-b58b-1a2ea9c71bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:11.471712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51802af-58f4-4745-b58b-1a2ea9c71bf2 admin admin] PATH_INFO: `/v3/projects/c4068066f5a64b25985bef6050c16aea` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:11.472829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51802af-58f4-4745-b58b-1a2ea9c71bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4068066f5a64b25985bef6050c16aea)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:11.474752 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51802af-58f4-4745-b58b-1a2ea9c71bf2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:11.592641 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d51802af-58f4-4745-b58b-1a2ea9c71bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4068066f5a64b25985bef6050c16aea', 'request_id': 'req-d51802af-58f4-4745-b58b-1a2ea9c71bf2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:11.598296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d51802af-58f4-4745-b58b-1a2ea9c71bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4068066f5a64b25985bef6050c16aea', 'request_id': 'req-d51802af-58f4-4745-b58b-1a2ea9c71bf2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:11.605128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d51802af-58f4-4745-b58b-1a2ea9c71bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4068066f5a64b25985bef6050c16aea', 'request_id': 'req-d51802af-58f4-4745-b58b-1a2ea9c71bf2'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:11.675278 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d51802af-58f4-4745-b58b-1a2ea9c71bf2 admin admin] The token cache is being invalidate because project c4068066f5a64b25985bef6050c16aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:14:11.675573 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d51802af-58f4-4745-b58b-1a2ea9c71bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:11.676245 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-d51802af-58f4-4745-b58b-1a2ea9c71bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:11.677756 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4328/8728] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:14:11 2022] DELETE /identity/v3/projects/c4068066f5a64b25985bef6050c16aea => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:14:11.683465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda2867-18fd-4cfd-941e-ad046dcd7fee None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:11.683975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda2867-18fd-4cfd-941e-ad046dcd7fee None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:11.684085 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda2867-18fd-4cfd-941e-ad046dcd7fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:11.704004 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ddda2867-18fd-4cfd-941e-ad046dcd7fee None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:11.705276 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ddda2867-18fd-4cfd-941e-ad046dcd7fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:11.739436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:11.765741 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4401/8729] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:11.831905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac0b4-78d6-43ac-93e5-13b5e278fbd3 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:11.832269 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac0b4-78d6-43ac-93e5-13b5e278fbd3 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:11.832511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac0b4-78d6-43ac-93e5-13b5e278fbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:11.854717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-08bac0b4-78d6-43ac-93e5-13b5e278fbd3 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:11.855901 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-08bac0b4-78d6-43ac-93e5-13b5e278fbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:11.864287 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4329/8730] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:11.868554 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda2867-18fd-4cfd-941e-ad046dcd7fee None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:11.878654 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda2867-18fd-4cfd-941e-ad046dcd7fee None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:11.883138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aaf525-c137-4289-aead-6ca0b18af585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:11.883737 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaf525-c137-4289-aead-6ca0b18af585 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:11.884012 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaf525-c137-4289-aead-6ca0b18af585 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:11.884321 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaf525-c137-4289-aead-6ca0b18af585 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:11.884974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aaf525-c137-4289-aead-6ca0b18af585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:14:11.885375 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aaf525-c137-4289-aead-6ca0b18af585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:11.886964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aaf525-c137-4289-aead-6ca0b18af585 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:11.898320 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4402/8731] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:14:11.904596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bac0b4-78d6-43ac-93e5-13b5e278fbd3 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:11.914132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bac0b4-78d6-43ac-93e5-13b5e278fbd3 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:11.919970 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2af5a-b879-40b1-8399-467e223153ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:11.920589 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2af5a-b879-40b1-8399-467e223153ce admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:11.920872 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2af5a-b879-40b1-8399-467e223153ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:11.921145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2af5a-b879-40b1-8399-467e223153ce admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:11.921780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2af5a-b879-40b1-8399-467e223153ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:11.923693 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2af5a-b879-40b1-8399-467e223153ce admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:12.012904 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4330/8732] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:14:11 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:14:12.017326 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aaf525-c137-4289-aead-6ca0b18af585 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:12.028577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aaf525-c137-4289-aead-6ca0b18af585 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:12.085854 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea6010-c45e-4641-9016-9d1cf66863aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:12.086454 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea6010-c45e-4641-9016-9d1cf66863aa admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:12.086731 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea6010-c45e-4641-9016-9d1cf66863aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:12.086999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea6010-c45e-4641-9016-9d1cf66863aa admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:12.087622 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea6010-c45e-4641-9016-9d1cf66863aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:12.090562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea6010-c45e-4641-9016-9d1cf66863aa admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:12.174367 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4403/8733] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:14:12 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:14:12.178355 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2af5a-b879-40b1-8399-467e223153ce admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:12.188780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2af5a-b879-40b1-8399-467e223153ce admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:12.193933 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b24e28-fa0e-4d4b-a3a1-a7b0815a5018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:12.194489 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b24e28-fa0e-4d4b-a3a1-a7b0815a5018 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:12.194778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b24e28-fa0e-4d4b-a3a1-a7b0815a5018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:12.195055 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b24e28-fa0e-4d4b-a3a1-a7b0815a5018 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:12.195706 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b24e28-fa0e-4d4b-a3a1-a7b0815a5018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:12.198023 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b24e28-fa0e-4d4b-a3a1-a7b0815a5018 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:12.209264 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4331/8734] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:14:12.214104 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea6010-c45e-4641-9016-9d1cf66863aa admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:12.224121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea6010-c45e-4641-9016-9d1cf66863aa admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:12.228942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23346ac-eb41-4f41-8885-a7e5bb602886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:12.229620 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23346ac-eb41-4f41-8885-a7e5bb602886 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:12.229905 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23346ac-eb41-4f41-8885-a7e5bb602886 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:12.230355 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23346ac-eb41-4f41-8885-a7e5bb602886 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:12.230873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23346ac-eb41-4f41-8885-a7e5bb602886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:12.232497 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23346ac-eb41-4f41-8885-a7e5bb602886 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:12.243204 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4404/8735] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:14:12.247694 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b24e28-fa0e-4d4b-a3a1-a7b0815a5018 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:12.257778 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b24e28-fa0e-4d4b-a3a1-a7b0815a5018 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:12.262888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3633a-c192-4968-96b0-013c6f46361c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:12.270398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3633a-c192-4968-96b0-013c6f46361c admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:12.270398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3633a-c192-4968-96b0-013c6f46361c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:12.270398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3633a-c192-4968-96b0-013c6f46361c admin admin] PATH_INFO: `/v3/projects/7c42882d6b0e4528ac35da0aa56f8621/users/26853b507a814ef0b5f46713be27871c/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:12.270398 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:12.279570 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3633a-c192-4968-96b0-013c6f46361c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c42882d6b0e4528ac35da0aa56f8621, user_id=26853b507a814ef0b5f46713be27871c, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:12.282277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3633a-c192-4968-96b0-013c6f46361c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:12.382774 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4332/8736] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:14:12 2022] PUT /identity/v3/projects/7c42882d6b0e4528ac35da0aa56f8621/users/26853b507a814ef0b5f46713be27871c/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:14:12.389451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b2e9-31f7-4d69-b4bb-4b3c98f157e4 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:12.389852 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b2e9-31f7-4d69-b4bb-4b3c98f157e4 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:12.390238 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b2e9-31f7-4d69-b4bb-4b3c98f157e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:12.409903 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-1b45b2e9-31f7-4d69-b4bb-4b3c98f157e4 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:12.413519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-1b45b2e9-31f7-4d69-b4bb-4b3c98f157e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:12.473059 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4405/8737] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:12.483096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3633a-c192-4968-96b0-013c6f46361c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:12.484987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-1fd3633a-c192-4968-96b0-013c6f46361c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:12.545911 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3633a-c192-4968-96b0-013c6f46361c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:12.549623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe816b7d-3a75-4f9c-b638-80564482699e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:12.550230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816b7d-3a75-4f9c-b638-80564482699e service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:12.550511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816b7d-3a75-4f9c-b638-80564482699e service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:12.550788 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816b7d-3a75-4f9c-b638-80564482699e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:12.560410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe816b7d-3a75-4f9c-b638-80564482699e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:12.561844 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe816b7d-3a75-4f9c-b638-80564482699e service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:12.571230 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4333/8738] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:14:18.169022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc95771-ec76-4ec8-ba49-73a0d8835f70 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:18.169589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc95771-ec76-4ec8-ba49-73a0d8835f70 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:18.169589 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc95771-ec76-4ec8-ba49-73a0d8835f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:18.201011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-ddc95771-ec76-4ec8-ba49-73a0d8835f70 None None] MFA Rules not processed for user `26853b507a814ef0b5f46713be27871c`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:18.202893 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ddc95771-ec76-4ec8-ba49-73a0d8835f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:18.240781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:18.273578 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4406/8739] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:18.278977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe816b7d-3a75-4f9c-b638-80564482699e service neutron] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:18.289495 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe816b7d-3a75-4f9c-b638-80564482699e service neutron] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:18.294704 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef78776-b735-49c3-9214-638366252c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:18.295314 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef78776-b735-49c3-9214-638366252c75 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:18.295593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef78776-b735-49c3-9214-638366252c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:18.295862 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef78776-b735-49c3-9214-638366252c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:18.296632 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef78776-b735-49c3-9214-638366252c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:18.298592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef78776-b735-49c3-9214-638366252c75 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:18.434354 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4334/8740] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:14:18 2022] POST /identity/v3/projects => generated 389 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:14:18.438493 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc95771-ec76-4ec8-ba49-73a0d8835f70 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:18.450564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc95771-ec76-4ec8-ba49-73a0d8835f70 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:18.535528 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434a975-4585-4a42-9db3-1058aa83acdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:18.536509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434a975-4585-4a42-9db3-1058aa83acdb admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:18.536780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434a975-4585-4a42-9db3-1058aa83acdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:18.537058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434a975-4585-4a42-9db3-1058aa83acdb admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:18.537688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434a975-4585-4a42-9db3-1058aa83acdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:18.539633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434a975-4585-4a42-9db3-1058aa83acdb admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:18.660114 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4407/8741] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:14:18 2022] POST /identity/v3/users => generated 301 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:14:18.665195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef78776-b735-49c3-9214-638366252c75 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:18.677199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef78776-b735-49c3-9214-638366252c75 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:18.682395 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427cbbb-9e19-4145-b5c4-fa1ca52dab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:18.683012 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427cbbb-9e19-4145-b5c4-fa1ca52dab5f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:18.684511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427cbbb-9e19-4145-b5c4-fa1ca52dab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:18.684511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427cbbb-9e19-4145-b5c4-fa1ca52dab5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:18.684511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427cbbb-9e19-4145-b5c4-fa1ca52dab5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:18.685885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427cbbb-9e19-4145-b5c4-fa1ca52dab5f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:18.698463 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4335/8742] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:14:18.702767 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434a975-4585-4a42-9db3-1058aa83acdb admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:18.713360 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434a975-4585-4a42-9db3-1058aa83acdb admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:18.718470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948a0e6-a0ce-400c-b74f-a43172b02045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:18.719151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948a0e6-a0ce-400c-b74f-a43172b02045 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:18.719431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948a0e6-a0ce-400c-b74f-a43172b02045 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:18.719692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948a0e6-a0ce-400c-b74f-a43172b02045 admin admin] PATH_INFO: `/v3/projects/1f372f6b7e9142e9a9c83b6411a958cc/users/6526125f21aa43ba975fafa11ea3270f/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:18.736205 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948a0e6-a0ce-400c-b74f-a43172b02045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f372f6b7e9142e9a9c83b6411a958cc, user_id=6526125f21aa43ba975fafa11ea3270f, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:18.738816 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948a0e6-a0ce-400c-b74f-a43172b02045 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:18.830213 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4408/8743] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:14:18 2022] PUT /identity/v3/projects/1f372f6b7e9142e9a9c83b6411a958cc/users/6526125f21aa43ba975fafa11ea3270f/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:14:18.834320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427cbbb-9e19-4145-b5c4-fa1ca52dab5f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:18.844876 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427cbbb-9e19-4145-b5c4-fa1ca52dab5f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:18.907908 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dc5a1-c94f-4637-8041-33f440fa683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:18.908568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dc5a1-c94f-4637-8041-33f440fa683a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:18.908852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dc5a1-c94f-4637-8041-33f440fa683a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:18.909128 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dc5a1-c94f-4637-8041-33f440fa683a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:18.909775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33dc5a1-c94f-4637-8041-33f440fa683a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:18.911700 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33dc5a1-c94f-4637-8041-33f440fa683a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:18.923102 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4336/8744] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:14:18.927447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948a0e6-a0ce-400c-b74f-a43172b02045 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:18.939411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948a0e6-a0ce-400c-b74f-a43172b02045 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:18.944149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d24b88-dfdc-4cbd-ad36-bf69f3039a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:18.944951 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d24b88-dfdc-4cbd-ad36-bf69f3039a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:18.945235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d24b88-dfdc-4cbd-ad36-bf69f3039a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:18.945531 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d24b88-dfdc-4cbd-ad36-bf69f3039a89 admin admin] PATH_INFO: `/v3/projects/1f372f6b7e9142e9a9c83b6411a958cc/users/6526125f21aa43ba975fafa11ea3270f/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:18.948949 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d24b88-dfdc-4cbd-ad36-bf69f3039a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f372f6b7e9142e9a9c83b6411a958cc, user_id=6526125f21aa43ba975fafa11ea3270f, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:18.951997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d24b88-dfdc-4cbd-ad36-bf69f3039a89 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:18.966397 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4409/8745] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:14:18 2022] PUT /identity/v3/projects/1f372f6b7e9142e9a9c83b6411a958cc/users/6526125f21aa43ba975fafa11ea3270f/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:14:24.905351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c15cd-3cda-4ff0-80e4-190f38e19e0c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:24.905870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c15cd-3cda-4ff0-80e4-190f38e19e0c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:24.906077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c15cd-3cda-4ff0-80e4-190f38e19e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:24.943852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-d50c15cd-3cda-4ff0-80e4-190f38e19e0c None None] MFA Rules not processed for user `6526125f21aa43ba975fafa11ea3270f`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:24.945194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d50c15cd-3cda-4ff0-80e4-190f38e19e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:24.986731 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:25.018273 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4337/8746] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:24 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 05:14:25.039837 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d24b88-dfdc-4cbd-ad36-bf69f3039a89 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:25.042260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a2d24b88-dfdc-4cbd-ad36-bf69f3039a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:25.123114 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d24b88-dfdc-4cbd-ad36-bf69f3039a89 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:25.128443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c70ed-5405-4f59-bdd6-b15e90ba3688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:25.129062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c70ed-5405-4f59-bdd6-b15e90ba3688 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:25.129343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c70ed-5405-4f59-bdd6-b15e90ba3688 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:25.129618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c70ed-5405-4f59-bdd6-b15e90ba3688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:25.163669 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:25.199058 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c70ed-5405-4f59-bdd6-b15e90ba3688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:25.200719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c70ed-5405-4f59-bdd6-b15e90ba3688 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:25.211063 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4410/8747] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:14:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:14:25.370304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab3179-6ce0-4975-9605-1ecc212978c0 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:25.370652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab3179-6ce0-4975-9605-1ecc212978c0 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:25.372420 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab3179-6ce0-4975-9605-1ecc212978c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:25.394558 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-aeab3179-6ce0-4975-9605-1ecc212978c0 None None] MFA Rules not processed for user `26853b507a814ef0b5f46713be27871c`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:25.395779 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-aeab3179-6ce0-4975-9605-1ecc212978c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:25.403469 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4338/8748] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:25.692653 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68531812-a62f-4459-ac60-8b969c63a3b6 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:25.692938 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68531812-a62f-4459-ac60-8b969c63a3b6 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:25.693210 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68531812-a62f-4459-ac60-8b969c63a3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:25.700731 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-68531812-a62f-4459-ac60-8b969c63a3b6 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:14:25.700731 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:14:25.700731 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:14:25.700731 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:14:25.700731 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:14:25.700731 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:14:25.700731 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:14:25.700731 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:14:25.700731 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:14:25.700731 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:14:25.700731 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:14:25.700731 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:14:25.700731 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:14:25.702262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:14:25.702262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:14:25.702262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:14:25.702262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:14:25.702262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:14:25.702262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:14:25.702262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:14:25.702262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:14:25.702262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:14:25.702262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:14:25.702262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:14:25.702262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:14:25.702262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:14:25.702262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:14:25.702262 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 05:14:25.703836 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4411/8749] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:14:25 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 12 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:14:27.029610 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bdded-fb28-4bbb-84bd-a3d9e4a7dcc1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:27.030160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bdded-fb28-4bbb-84bd-a3d9e4a7dcc1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:27.030267 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bdded-fb28-4bbb-84bd-a3d9e4a7dcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:27.050659 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9b8bdded-fb28-4bbb-84bd-a3d9e4a7dcc1 None None] MFA Rules not processed for user `26853b507a814ef0b5f46713be27871c`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:27.051868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9b8bdded-fb28-4bbb-84bd-a3d9e4a7dcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:27.060151 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4339/8750] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:27.311779 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d03b6c-1c1b-47ce-adcc-3489dbd4cecf None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:27.312262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d03b6c-1c1b-47ce-adcc-3489dbd4cecf None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:27.312451 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d03b6c-1c1b-47ce-adcc-3489dbd4cecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:27.319734 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-99d03b6c-1c1b-47ce-adcc-3489dbd4cecf None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:14:27.319734 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:14:27.319734 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:14:27.319734 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:14:27.319734 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:14:27.319734 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:14:27.319734 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:14:27.319734 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:14:27.319734 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:14:27.319734 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:14:27.319734 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:14:27.319734 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:14:27.319734 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:14:27.320882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:14:27.320882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:14:27.320882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:14:27.320882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:14:27.320882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:14:27.320882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:14:27.320882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:14:27.320882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:14:27.320882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:14:27.320882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:14:27.320882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:14:27.320882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:14:27.320882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:14:27.320882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:14:27.320882 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 05:14:27.322302 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4412/8751] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:14:27 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:14:27.615096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ebd86-8a75-4c71-9b6a-1c454fc8cdb8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:27.615386 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ebd86-8a75-4c71-9b6a-1c454fc8cdb8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:27.615662 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ebd86-8a75-4c71-9b6a-1c454fc8cdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:27.637728 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-315ebd86-8a75-4c71-9b6a-1c454fc8cdb8 None None] MFA Rules not processed for user `26853b507a814ef0b5f46713be27871c`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:27.638290 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-315ebd86-8a75-4c71-9b6a-1c454fc8cdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:27.645439 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4340/8752] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:27.901503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e129706-ea3a-4f42-9d0d-40f50c3b5f81 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:27.902007 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e129706-ea3a-4f42-9d0d-40f50c3b5f81 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:27.902118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e129706-ea3a-4f42-9d0d-40f50c3b5f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:27.908694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-5e129706-ea3a-4f42-9d0d-40f50c3b5f81 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:14:27.908694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:14:27.908694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:14:27.908694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:14:27.908694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:14:27.908694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:14:27.908694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:14:27.908694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:14:27.908694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:14:27.908694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:14:27.908694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:14:27.908694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:14:27.908694 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:14:27.909995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:14:27.909995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:14:27.909995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:14:27.909995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:14:27.909995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:14:27.909995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:14:27.909995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:14:27.909995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:14:27.909995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:14:27.909995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:14:27.909995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:14:27.909995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:14:27.909995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:14:27.909995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:14:27.909995 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 05:14:27.911547 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4413/8753] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:14:27 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 9 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:14:35.531325 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=16 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:36.151132 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ebd86-8a75-4c71-9b6a-1c454fc8cdb8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:36.217733 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ebd86-8a75-4c71-9b6a-1c454fc8cdb8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:36.222249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e33bee-3837-4115-ba53-390ee77f5d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:36.222871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e33bee-3837-4115-ba53-390ee77f5d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:36.223149 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e33bee-3837-4115-ba53-390ee77f5d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:36.223421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e33bee-3837-4115-ba53-390ee77f5d3f admin admin] PATH_INFO: `/v3/users/26853b507a814ef0b5f46713be27871c` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:36.224559 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e33bee-3837-4115-ba53-390ee77f5d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=26853b507a814ef0b5f46713be27871c)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:36.226462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e33bee-3837-4115-ba53-390ee77f5d3f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:36.431353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64e33bee-3837-4115-ba53-390ee77f5d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26853b507a814ef0b5f46713be27871c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:36.577098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64e33bee-3837-4115-ba53-390ee77f5d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26853b507a814ef0b5f46713be27871c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:36.577842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64e33bee-3837-4115-ba53-390ee77f5d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26853b507a814ef0b5f46713be27871c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:36.586071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64e33bee-3837-4115-ba53-390ee77f5d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26853b507a814ef0b5f46713be27871c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:36.599155 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-64e33bee-3837-4115-ba53-390ee77f5d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26853b507a814ef0b5f46713be27871c'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:36.605883 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4341/8754] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:14:36 2022] DELETE /identity/v3/users/26853b507a814ef0b5f46713be27871c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:14:36.941857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e129706-ea3a-4f42-9d0d-40f50c3b5f81 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:36.943683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5e129706-ea3a-4f42-9d0d-40f50c3b5f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:37.013022 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e129706-ea3a-4f42-9d0d-40f50c3b5f81 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:37.017603 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d556dd7-9040-46c1-ae43-20b171306e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:37.018230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556dd7-9040-46c1-ae43-20b171306e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:37.018509 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556dd7-9040-46c1-ae43-20b171306e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:37.018781 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556dd7-9040-46c1-ae43-20b171306e78 admin admin] PATH_INFO: `/v3/projects/7c42882d6b0e4528ac35da0aa56f8621` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:37.019902 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d556dd7-9040-46c1-ae43-20b171306e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c42882d6b0e4528ac35da0aa56f8621)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:37.021839 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d556dd7-9040-46c1-ae43-20b171306e78 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:37.172468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4d556dd7-9040-46c1-ae43-20b171306e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c42882d6b0e4528ac35da0aa56f8621', 'request_id': 'req-4d556dd7-9040-46c1-ae43-20b171306e78'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:37.177936 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4d556dd7-9040-46c1-ae43-20b171306e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c42882d6b0e4528ac35da0aa56f8621', 'request_id': 'req-4d556dd7-9040-46c1-ae43-20b171306e78'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:37.257174 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4d556dd7-9040-46c1-ae43-20b171306e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c42882d6b0e4528ac35da0aa56f8621', 'request_id': 'req-4d556dd7-9040-46c1-ae43-20b171306e78'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:37.269299 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4d556dd7-9040-46c1-ae43-20b171306e78 admin admin] The token cache is being invalidate because project 7c42882d6b0e4528ac35da0aa56f8621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:14:37.269587 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4d556dd7-9040-46c1-ae43-20b171306e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:37.270221 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-4d556dd7-9040-46c1-ae43-20b171306e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:37.271717 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4414/8755] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:14:36 2022] DELETE /identity/v3/projects/7c42882d6b0e4528ac35da0aa56f8621 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:14:37.275771 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e33bee-3837-4115-ba53-390ee77f5d3f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:37.286929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e33bee-3837-4115-ba53-390ee77f5d3f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:37.317795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:37.344454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ece3b9-063d-464e-8aef-2212b0e3317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:37.345086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ece3b9-063d-464e-8aef-2212b0e3317f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:37.345366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ece3b9-063d-464e-8aef-2212b0e3317f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:37.345640 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ece3b9-063d-464e-8aef-2212b0e3317f admin admin] PATH_INFO: `/v3/users/6526125f21aa43ba975fafa11ea3270f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:37.346761 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ece3b9-063d-464e-8aef-2212b0e3317f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6526125f21aa43ba975fafa11ea3270f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:37.348729 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ece3b9-063d-464e-8aef-2212b0e3317f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:37.593952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-59ece3b9-063d-464e-8aef-2212b0e3317f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6526125f21aa43ba975fafa11ea3270f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:37.711650 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-59ece3b9-063d-464e-8aef-2212b0e3317f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6526125f21aa43ba975fafa11ea3270f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:37.712318 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-59ece3b9-063d-464e-8aef-2212b0e3317f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6526125f21aa43ba975fafa11ea3270f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:37.720071 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-59ece3b9-063d-464e-8aef-2212b0e3317f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6526125f21aa43ba975fafa11ea3270f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:37.732899 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-59ece3b9-063d-464e-8aef-2212b0e3317f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6526125f21aa43ba975fafa11ea3270f'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:37.738794 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4342/8756] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:14:37 2022] DELETE /identity/v3/users/6526125f21aa43ba975fafa11ea3270f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:14:38.053384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d556dd7-9040-46c1-ae43-20b171306e78 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:38.057976 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4d556dd7-9040-46c1-ae43-20b171306e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:38.068327 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d556dd7-9040-46c1-ae43-20b171306e78 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:38.127633 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c8186-5b9b-4a41-9a62-4bad95d5697c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:38.128216 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c8186-5b9b-4a41-9a62-4bad95d5697c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:38.128503 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c8186-5b9b-4a41-9a62-4bad95d5697c admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:38.128780 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c8186-5b9b-4a41-9a62-4bad95d5697c admin admin] PATH_INFO: `/v3/projects/1f372f6b7e9142e9a9c83b6411a958cc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:38.129909 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c8186-5b9b-4a41-9a62-4bad95d5697c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f372f6b7e9142e9a9c83b6411a958cc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:38.131809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c8186-5b9b-4a41-9a62-4bad95d5697c admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:38.232887 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:38.245274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-030c8186-5b9b-4a41-9a62-4bad95d5697c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f372f6b7e9142e9a9c83b6411a958cc', 'request_id': 'req-030c8186-5b9b-4a41-9a62-4bad95d5697c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:38.250647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-030c8186-5b9b-4a41-9a62-4bad95d5697c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f372f6b7e9142e9a9c83b6411a958cc', 'request_id': 'req-030c8186-5b9b-4a41-9a62-4bad95d5697c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:38.323314 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-030c8186-5b9b-4a41-9a62-4bad95d5697c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f372f6b7e9142e9a9c83b6411a958cc', 'request_id': 'req-030c8186-5b9b-4a41-9a62-4bad95d5697c'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:38.334448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-030c8186-5b9b-4a41-9a62-4bad95d5697c admin admin] The token cache is being invalidate because project 1f372f6b7e9142e9a9c83b6411a958cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:14:38.334732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-030c8186-5b9b-4a41-9a62-4bad95d5697c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:38.335361 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-030c8186-5b9b-4a41-9a62-4bad95d5697c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:14:38.337165 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4415/8757] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:14:38 2022] DELETE /identity/v3/projects/1f372f6b7e9142e9a9c83b6411a958cc => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:14:38.343127 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5890dc7-55da-423b-9faf-8acd21181e42 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:38.344433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5890dc7-55da-423b-9faf-8acd21181e42 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:38.344433 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5890dc7-55da-423b-9faf-8acd21181e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:38.364521 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-c5890dc7-55da-423b-9faf-8acd21181e42 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:38.365736 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-c5890dc7-55da-423b-9faf-8acd21181e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:38.428435 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4343/8758] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:38.436342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec83ca-33ca-4a20-b79a-ceb435c90570 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:38.436649 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec83ca-33ca-4a20-b79a-ceb435c90570 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:38.436908 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec83ca-33ca-4a20-b79a-ceb435c90570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:38.457285 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e3ec83ca-33ca-4a20-b79a-ceb435c90570 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:38.458659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e3ec83ca-33ca-4a20-b79a-ceb435c90570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:38.467322 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4416/8759] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:38.471732 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5890dc7-55da-423b-9faf-8acd21181e42 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:38.481670 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5890dc7-55da-423b-9faf-8acd21181e42 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:38.486240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40941f-7531-4494-83e0-ab6252c8f632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:38.486834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40941f-7531-4494-83e0-ab6252c8f632 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:38.487115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40941f-7531-4494-83e0-ab6252c8f632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:38.487389 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40941f-7531-4494-83e0-ab6252c8f632 admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:38.488067 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40941f-7531-4494-83e0-ab6252c8f632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:14:38.488465 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40941f-7531-4494-83e0-ab6252c8f632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:38.490078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40941f-7531-4494-83e0-ab6252c8f632 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:38.502200 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4344/8760] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:14:38.507125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec83ca-33ca-4a20-b79a-ceb435c90570 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:38.517470 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec83ca-33ca-4a20-b79a-ceb435c90570 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:38.523138 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3c4d9-002d-446a-8a23-46569f17a7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:38.523749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3c4d9-002d-446a-8a23-46569f17a7ee admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:38.524029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3c4d9-002d-446a-8a23-46569f17a7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:38.524346 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3c4d9-002d-446a-8a23-46569f17a7ee admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:38.524995 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3c4d9-002d-446a-8a23-46569f17a7ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:38.527590 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3c4d9-002d-446a-8a23-46569f17a7ee admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:38.624199 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4417/8761] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:14:38 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:14:38.628411 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40941f-7531-4494-83e0-ab6252c8f632 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:38.639148 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40941f-7531-4494-83e0-ab6252c8f632 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:38.679971 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:38.698683 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d5f75-d888-447a-9ece-98fcb3a59ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:38.699310 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d5f75-d888-447a-9ece-98fcb3a59ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:38.699592 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d5f75-d888-447a-9ece-98fcb3a59ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:38.699865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d5f75-d888-447a-9ece-98fcb3a59ff2 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:38.700555 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d5f75-d888-447a-9ece-98fcb3a59ff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:38.702473 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d5f75-d888-447a-9ece-98fcb3a59ff2 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:38.832061 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4345/8762] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:14:38 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:14:38.836260 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3c4d9-002d-446a-8a23-46569f17a7ee admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:38.846814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3c4d9-002d-446a-8a23-46569f17a7ee admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:38.851399 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4daa978-c431-4e06-bd0c-e92d2542a548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:38.851986 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daa978-c431-4e06-bd0c-e92d2542a548 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:38.852300 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daa978-c431-4e06-bd0c-e92d2542a548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:38.852573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daa978-c431-4e06-bd0c-e92d2542a548 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:38.853203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4daa978-c431-4e06-bd0c-e92d2542a548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:38.854999 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4daa978-c431-4e06-bd0c-e92d2542a548 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:38.865164 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4418/8763] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 05:14:38.869103 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d5f75-d888-447a-9ece-98fcb3a59ff2 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:38.881522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d5f75-d888-447a-9ece-98fcb3a59ff2 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:38.888951 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f098a-8459-4074-b8a0-845e85bdae0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:38.889575 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f098a-8459-4074-b8a0-845e85bdae0a admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:38.889857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f098a-8459-4074-b8a0-845e85bdae0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:38.890146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f098a-8459-4074-b8a0-845e85bdae0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:38.890791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f098a-8459-4074-b8a0-845e85bdae0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:38.892447 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f098a-8459-4074-b8a0-845e85bdae0a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:38.904654 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4346/8764] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:14:38.910755 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4daa978-c431-4e06-bd0c-e92d2542a548 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:38.919405 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4daa978-c431-4e06-bd0c-e92d2542a548 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:38.923983 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e3ad8-caac-43f6-8de0-c75d74e87628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:38.924659 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e3ad8-caac-43f6-8de0-c75d74e87628 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:38.924934 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e3ad8-caac-43f6-8de0-c75d74e87628 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:38.925203 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e3ad8-caac-43f6-8de0-c75d74e87628 admin admin] PATH_INFO: `/v3/projects/f4f7660d9be0490098a63eeed7eb3fb0/users/7114fccef0ff4ed7938d4c924a9a64b5/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:38.940788 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e3ad8-caac-43f6-8de0-c75d74e87628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f7660d9be0490098a63eeed7eb3fb0, user_id=7114fccef0ff4ed7938d4c924a9a64b5, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:38.943352 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e3ad8-caac-43f6-8de0-c75d74e87628 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:39.063648 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4419/8765] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:14:38 2022] PUT /identity/v3/projects/f4f7660d9be0490098a63eeed7eb3fb0/users/7114fccef0ff4ed7938d4c924a9a64b5/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:14:39.068800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb53e79-59ff-4ebd-8318-c62857fe31f1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:39.069086 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb53e79-59ff-4ebd-8318-c62857fe31f1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:39.069358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb53e79-59ff-4ebd-8318-c62857fe31f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:39.089916 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ffb53e79-59ff-4ebd-8318-c62857fe31f1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:39.091161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ffb53e79-59ff-4ebd-8318-c62857fe31f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:39.150512 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4347/8766] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:39.160323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e3ad8-caac-43f6-8de0-c75d74e87628 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:39.162292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-476e3ad8-caac-43f6-8de0-c75d74e87628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:39.222265 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e3ad8-caac-43f6-8de0-c75d74e87628 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:39.226081 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb987b-e537-4154-83a5-a340954fd9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:39.226685 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb987b-e537-4154-83a5-a340954fd9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:39.226964 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb987b-e537-4154-83a5-a340954fd9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:39.227237 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb987b-e537-4154-83a5-a340954fd9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:39.237107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb987b-e537-4154-83a5-a340954fd9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:39.238560 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb987b-e537-4154-83a5-a340954fd9b1 service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:39.248907 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4420/8767] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:14:44.951843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48b92e-412f-4ff4-8a87-84558311867c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:44.951843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48b92e-412f-4ff4-8a87-84558311867c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:44.951843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48b92e-412f-4ff4-8a87-84558311867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:44.988425 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-db48b92e-412f-4ff4-8a87-84558311867c None None] MFA Rules not processed for user `7114fccef0ff4ed7938d4c924a9a64b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:44.990758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-db48b92e-412f-4ff4-8a87-84558311867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:45.063878 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4348/8768] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:45.068424 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb987b-e537-4154-83a5-a340954fd9b1 service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:45.079102 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb987b-e537-4154-83a5-a340954fd9b1 service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:45.083786 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251306bc-3332-4378-a637-4f6eb6bdccea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:45.084428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251306bc-3332-4378-a637-4f6eb6bdccea admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:45.084706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251306bc-3332-4378-a637-4f6eb6bdccea admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:45.084980 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251306bc-3332-4378-a637-4f6eb6bdccea admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:45.085611 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251306bc-3332-4378-a637-4f6eb6bdccea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:45.087499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251306bc-3332-4378-a637-4f6eb6bdccea admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:45.183342 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4421/8769] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:14:45 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:14:45.187796 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48b92e-412f-4ff4-8a87-84558311867c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:45.200178 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48b92e-412f-4ff4-8a87-84558311867c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:45.249160 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:45.261892 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9b858-eee2-46de-87aa-7a727cf5eb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:45.270652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9b858-eee2-46de-87aa-7a727cf5eb3a admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:45.270652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9b858-eee2-46de-87aa-7a727cf5eb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:45.270652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9b858-eee2-46de-87aa-7a727cf5eb3a admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:45.270652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9b858-eee2-46de-87aa-7a727cf5eb3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:45.270652 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9b858-eee2-46de-87aa-7a727cf5eb3a admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:45.363948 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4349/8770] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:14:45 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:14:45.367942 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251306bc-3332-4378-a637-4f6eb6bdccea admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:45.379350 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251306bc-3332-4378-a637-4f6eb6bdccea admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:45.384422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b8386-52ad-4e72-ab9d-daaafc5423dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:45.385167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b8386-52ad-4e72-ab9d-daaafc5423dc admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:45.385441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b8386-52ad-4e72-ab9d-daaafc5423dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:45.385711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b8386-52ad-4e72-ab9d-daaafc5423dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:45.386916 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b8386-52ad-4e72-ab9d-daaafc5423dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:45.388689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b8386-52ad-4e72-ab9d-daaafc5423dc admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:45.400623 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4422/8771] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:14:45.405285 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9b858-eee2-46de-87aa-7a727cf5eb3a admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:45.416323 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9b858-eee2-46de-87aa-7a727cf5eb3a admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:45.421883 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4826dd7-aa17-4165-b53d-eb5435a825ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:45.422542 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4826dd7-aa17-4165-b53d-eb5435a825ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:45.422826 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4826dd7-aa17-4165-b53d-eb5435a825ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:45.423107 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4826dd7-aa17-4165-b53d-eb5435a825ef admin admin] PATH_INFO: `/v3/projects/ae6108ba79e94cff9cbaee7a91ca9f46/users/dc92f3b8c60446a994e10984bfea232f/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:45.438860 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4826dd7-aa17-4165-b53d-eb5435a825ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6108ba79e94cff9cbaee7a91ca9f46, user_id=dc92f3b8c60446a994e10984bfea232f, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:45.441515 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4826dd7-aa17-4165-b53d-eb5435a825ef admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:45.546500 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4350/8772] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:14:45 2022] PUT /identity/v3/projects/ae6108ba79e94cff9cbaee7a91ca9f46/users/dc92f3b8c60446a994e10984bfea232f/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:14:45.550889 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b8386-52ad-4e72-ab9d-daaafc5423dc admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:45.562016 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b8386-52ad-4e72-ab9d-daaafc5423dc admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:45.586070 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:45.618564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60aa91-2374-4092-bd82-32fd7b05ef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:45.619181 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60aa91-2374-4092-bd82-32fd7b05ef23 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:45.619471 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60aa91-2374-4092-bd82-32fd7b05ef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:45.619749 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60aa91-2374-4092-bd82-32fd7b05ef23 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:45.620425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60aa91-2374-4092-bd82-32fd7b05ef23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:45.622527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60aa91-2374-4092-bd82-32fd7b05ef23 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:45.633025 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4423/8773] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:14:45.637905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4826dd7-aa17-4165-b53d-eb5435a825ef admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:45.649194 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4826dd7-aa17-4165-b53d-eb5435a825ef admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:45.654868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92b3af-7bf8-4971-b13f-898d1d5b8813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:45.655554 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92b3af-7bf8-4971-b13f-898d1d5b8813 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:45.655839 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92b3af-7bf8-4971-b13f-898d1d5b8813 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:45.656115 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92b3af-7bf8-4971-b13f-898d1d5b8813 admin admin] PATH_INFO: `/v3/projects/ae6108ba79e94cff9cbaee7a91ca9f46/users/dc92f3b8c60446a994e10984bfea232f/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:45.658078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92b3af-7bf8-4971-b13f-898d1d5b8813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6108ba79e94cff9cbaee7a91ca9f46, user_id=dc92f3b8c60446a994e10984bfea232f, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:45.660773 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92b3af-7bf8-4971-b13f-898d1d5b8813 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:45.672601 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4351/8774] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:14:45 2022] PUT /identity/v3/projects/ae6108ba79e94cff9cbaee7a91ca9f46/users/dc92f3b8c60446a994e10984bfea232f/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:14:52.213973 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50ce0d-245e-43e6-ac03-eaf6206f49fa None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:52.214568 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50ce0d-245e-43e6-ac03-eaf6206f49fa None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:52.214687 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50ce0d-245e-43e6-ac03-eaf6206f49fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:52.252422 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4b50ce0d-245e-43e6-ac03-eaf6206f49fa None None] MFA Rules not processed for user `dc92f3b8c60446a994e10984bfea232f`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:52.257097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4b50ce0d-245e-43e6-ac03-eaf6206f49fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:52.339997 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4424/8775] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:14:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:52.352131 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92b3af-7bf8-4971-b13f-898d1d5b8813 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:52.353888 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-3e92b3af-7bf8-4971-b13f-898d1d5b8813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:52.417237 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92b3af-7bf8-4971-b13f-898d1d5b8813 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:52.422041 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a9c99-657d-40ed-8aca-ac3646274067 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:52.422653 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a9c99-657d-40ed-8aca-ac3646274067 service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:52.422930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a9c99-657d-40ed-8aca-ac3646274067 service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:52.423198 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a9c99-657d-40ed-8aca-ac3646274067 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:52.483019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a9c99-657d-40ed-8aca-ac3646274067 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:52.484523 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a9c99-657d-40ed-8aca-ac3646274067 service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:52.496110 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4352/8776] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:14:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:14:53.084732 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9d793-7ebc-45ab-bd48-2b25a1574fe7 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:53.085024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9d793-7ebc-45ab-bd48-2b25a1574fe7 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:53.085341 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9d793-7ebc-45ab-bd48-2b25a1574fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:53.158690 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-68c9d793-7ebc-45ab-bd48-2b25a1574fe7 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:14:53.159931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-68c9d793-7ebc-45ab-bd48-2b25a1574fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:53.235655 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4425/8777] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:14:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:14:53.419200 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a9c99-657d-40ed-8aca-ac3646274067 service glance] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:14:53.420689 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f99a9c99-657d-40ed-8aca-ac3646274067 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:14:53.497096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:14:53.534378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a9c99-657d-40ed-8aca-ac3646274067 service glance] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:14:53.543462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d254ceb-0c2f-43b0-876e-acb0e4e064f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:14:53.543462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d254ceb-0c2f-43b0-876e-acb0e4e064f0 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:14:53.543462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d254ceb-0c2f-43b0-876e-acb0e4e064f0 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:14:53.543462 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d254ceb-0c2f-43b0-876e-acb0e4e064f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:14:53.550932 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d254ceb-0c2f-43b0-876e-acb0e4e064f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:14:53.553326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d254ceb-0c2f-43b0-876e-acb0e4e064f0 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:14:53.566491 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4353/8778] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 05:14:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:03.232579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=95 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:03.562265 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=16 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:04.456468 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4d35-a796-4284-8a72-49690eaeb66b None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:04.457025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4d35-a796-4284-8a72-49690eaeb66b None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:04.457025 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4d35-a796-4284-8a72-49690eaeb66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:04.477248 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-466d4d35-a796-4284-8a72-49690eaeb66b None None] MFA Rules not processed for user `7114fccef0ff4ed7938d4c924a9a64b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:15:04.478414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-466d4d35-a796-4284-8a72-49690eaeb66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:04.485538 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4426/8779] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:15:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:15:04.741445 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de763583-f0ae-47ef-bb0e-fea80e115c59 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:04.742004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de763583-f0ae-47ef-bb0e-fea80e115c59 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:04.742004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de763583-f0ae-47ef-bb0e-fea80e115c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:04.749712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-de763583-f0ae-47ef-bb0e-fea80e115c59 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:15:04.749712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:15:04.749712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:15:04.749712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:15:04.749712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:15:04.749712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:15:04.749712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:15:04.749712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:15:04.749712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:15:04.749712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:15:04.749712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:15:04.749712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:15:04.749712 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:15:04.750908 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:15:04.750908 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:15:04.750908 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:15:04.750908 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:15:04.750908 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:15:04.750908 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:15:04.750908 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:15:04.750908 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:15:04.750908 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:15:04.750908 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:15:04.750908 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:15:04.750908 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:15:04.750908 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:15:04.750908 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:15:04.750908 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:15:04.752155 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4354/8780] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:15:04 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:15:04.892108 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d65b6-a38a-473e-9a83-648918bfddae None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:04.892418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d65b6-a38a-473e-9a83-648918bfddae None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:04.892695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d65b6-a38a-473e-9a83-648918bfddae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:04.911657 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-c89d65b6-a38a-473e-9a83-648918bfddae None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:15:04.913180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-c89d65b6-a38a-473e-9a83-648918bfddae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:04.920765 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4427/8781] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 05:15:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:15:04.935618 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de763583-f0ae-47ef-bb0e-fea80e115c59 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:04.953404 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de763583-f0ae-47ef-bb0e-fea80e115c59 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:04.958642 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b69867-4d45-469c-b6c2-9ebc49ae16f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:04.959240 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b69867-4d45-469c-b6c2-9ebc49ae16f6 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:04.959525 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b69867-4d45-469c-b6c2-9ebc49ae16f6 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:04.959799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b69867-4d45-469c-b6c2-9ebc49ae16f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:04.968493 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b69867-4d45-469c-b6c2-9ebc49ae16f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:04.970087 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b69867-4d45-469c-b6c2-9ebc49ae16f6 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:04.978189 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4355/8782] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 05:15:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:06.068728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687984e-17f2-455a-8be6-9605f37721c1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:06.069190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687984e-17f2-455a-8be6-9605f37721c1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:06.069292 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687984e-17f2-455a-8be6-9605f37721c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:06.090121 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-5687984e-17f2-455a-8be6-9605f37721c1 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:15:06.091336 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5687984e-17f2-455a-8be6-9605f37721c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:06.098872 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4428/8783] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:15:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:15:06.111799 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b69867-4d45-469c-b6c2-9ebc49ae16f6 service swift] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:06.125850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b69867-4d45-469c-b6c2-9ebc49ae16f6 service swift] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:06.131108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29989ec3-a3e6-4f2b-96c3-b2547aa7479b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:06.131711 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29989ec3-a3e6-4f2b-96c3-b2547aa7479b service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:06.131995 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29989ec3-a3e6-4f2b-96c3-b2547aa7479b service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:06.132305 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29989ec3-a3e6-4f2b-96c3-b2547aa7479b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:06.141430 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29989ec3-a3e6-4f2b-96c3-b2547aa7479b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:06.143004 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29989ec3-a3e6-4f2b-96c3-b2547aa7479b service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:06.151181 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4356/8784] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 05:15:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:16.084572 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=9 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:16.147803 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=12 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:16.798401 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2a2dc-ba9d-4ae4-82fb-7e46bbb06e4d None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:16.798681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2a2dc-ba9d-4ae4-82fb-7e46bbb06e4d None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:16.798953 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2a2dc-ba9d-4ae4-82fb-7e46bbb06e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:16.818241 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-9bb2a2dc-ba9d-4ae4-82fb-7e46bbb06e4d None None] MFA Rules not processed for user `7114fccef0ff4ed7938d4c924a9a64b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:15:16.819487 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9bb2a2dc-ba9d-4ae4-82fb-7e46bbb06e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:16.826717 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4429/8785] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:15:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:15:17.076690 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e9f4c-bc2b-4bb7-8ee5-fe2aeeaf685c None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:17.076972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e9f4c-bc2b-4bb7-8ee5-fe2aeeaf685c None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:17.077242 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e9f4c-bc2b-4bb7-8ee5-fe2aeeaf685c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:17.083775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-8c8e9f4c-bc2b-4bb7-8ee5-fe2aeeaf685c None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:15:17.083775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:15:17.083775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:15:17.083775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:15:17.083775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:15:17.083775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:15:17.083775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:15:17.083775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:15:17.083775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:15:17.083775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:15:17.083775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:15:17.083775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:15:17.083775 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:15:17.084978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:15:17.084978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:15:17.084978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:15:17.084978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:15:17.084978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:15:17.084978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:15:17.084978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:15:17.084978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:15:17.084978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:15:17.084978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:15:17.084978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:15:17.084978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:15:17.084978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:15:17.084978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:15:17.084978 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:15:17.086041 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4357/8786] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:15:17 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:15:17.211363 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42347e-208e-4b07-817a-505006400559 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:17.211824 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42347e-208e-4b07-817a-505006400559 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:17.211941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42347e-208e-4b07-817a-505006400559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:17.230785 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0d42347e-208e-4b07-817a-505006400559 None None] MFA Rules not processed for user `7aa8f9ba9e854c7abc4237eb72c55590`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:15:17.232010 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0d42347e-208e-4b07-817a-505006400559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:17.239136 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4430/8787] 10.222.0.76 () {58 vars in 967 bytes} [Sat Aug 27 05:15:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:15:17.251713 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e9f4c-bc2b-4bb7-8ee5-fe2aeeaf685c None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:17.269676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e9f4c-bc2b-4bb7-8ee5-fe2aeeaf685c None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:17.274722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbe486-8cfb-4881-b3c5-e1e282f110c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc067131b0d84c7c9da1a33ecb7a9d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:17.275302 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbe486-8cfb-4881-b3c5-e1e282f110c8 service swift] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:17.275582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbe486-8cfb-4881-b3c5-e1e282f110c8 service swift] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:17.275855 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbe486-8cfb-4881-b3c5-e1e282f110c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:17.284501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbe486-8cfb-4881-b3c5-e1e282f110c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:17.286076 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbe486-8cfb-4881-b3c5-e1e282f110c8 service swift] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:17.294672 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4358/8788] 10.222.0.76 () {60 vars in 1384 bytes} [Sat Aug 27 05:15:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 05:15:21.824925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42347e-208e-4b07-817a-505006400559 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:21.826384 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0d42347e-208e-4b07-817a-505006400559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:21.902467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42347e-208e-4b07-817a-505006400559 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:21.908268 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0400a8-36ff-45f2-b88b-9dd796b1ef5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:21.909380 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0400a8-36ff-45f2-b88b-9dd796b1ef5d service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:21.909673 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0400a8-36ff-45f2-b88b-9dd796b1ef5d service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:21.909945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0400a8-36ff-45f2-b88b-9dd796b1ef5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:21.911719 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4f0400a8-36ff-45f2-b88b-9dd796b1ef5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:21.926858 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0400a8-36ff-45f2-b88b-9dd796b1ef5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:21.928484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0400a8-36ff-45f2-b88b-9dd796b1ef5d service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:21.960123 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4431/8789] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:15:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:15:25.661556 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbe486-8cfb-4881-b3c5-e1e282f110c8 service swift] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:25.676671 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbe486-8cfb-4881-b3c5-e1e282f110c8 service swift] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:25.681974 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed924664-4119-4d38-ab0d-5b3157e0e39a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:25.682583 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed924664-4119-4d38-ab0d-5b3157e0e39a service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:25.682868 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed924664-4119-4d38-ab0d-5b3157e0e39a service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:25.683145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed924664-4119-4d38-ab0d-5b3157e0e39a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:25.685275 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ed924664-4119-4d38-ab0d-5b3157e0e39a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:25.701049 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed924664-4119-4d38-ab0d-5b3157e0e39a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:25.702766 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed924664-4119-4d38-ab0d-5b3157e0e39a service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:25.716779 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4359/8790] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:15:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:15:25.853862 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0400a8-36ff-45f2-b88b-9dd796b1ef5d service placement] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:25.920348 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0400a8-36ff-45f2-b88b-9dd796b1ef5d service placement] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:25.925344 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afb984-db04-4a45-b246-7bdad8262296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:25.925975 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afb984-db04-4a45-b246-7bdad8262296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:25.926253 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afb984-db04-4a45-b246-7bdad8262296 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:25.926524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afb984-db04-4a45-b246-7bdad8262296 admin admin] PATH_INFO: `/v3/users/7114fccef0ff4ed7938d4c924a9a64b5` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:25.927637 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afb984-db04-4a45-b246-7bdad8262296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7114fccef0ff4ed7938d4c924a9a64b5)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:25.929625 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afb984-db04-4a45-b246-7bdad8262296 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:26.201029 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-85afb984-db04-4a45-b246-7bdad8262296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7114fccef0ff4ed7938d4c924a9a64b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:26.201617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-85afb984-db04-4a45-b246-7bdad8262296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7114fccef0ff4ed7938d4c924a9a64b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:26.329711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-85afb984-db04-4a45-b246-7bdad8262296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7114fccef0ff4ed7938d4c924a9a64b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:26.330359 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-85afb984-db04-4a45-b246-7bdad8262296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7114fccef0ff4ed7938d4c924a9a64b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:26.343098 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-85afb984-db04-4a45-b246-7bdad8262296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7114fccef0ff4ed7938d4c924a9a64b5'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:26.348476 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:26.356461 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4432/8791] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:15:25 2022] DELETE /identity/v3/users/7114fccef0ff4ed7938d4c924a9a64b5 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:15:26.636646 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed924664-4119-4d38-ab0d-5b3157e0e39a service placement] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:26.647224 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed924664-4119-4d38-ab0d-5b3157e0e39a service placement] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:26.708180 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:26.708845 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:26.709116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:26.709390 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1 admin admin] PATH_INFO: `/v3/projects/f4f7660d9be0490098a63eeed7eb3fb0` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:26.710498 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f7660d9be0490098a63eeed7eb3fb0)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:26.712509 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:26.928048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f7660d9be0490098a63eeed7eb3fb0', 'request_id': 'req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:26.933661 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f7660d9be0490098a63eeed7eb3fb0', 'request_id': 'req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:26.940320 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f7660d9be0490098a63eeed7eb3fb0', 'request_id': 'req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:27.050805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1 admin admin] The token cache is being invalidate because project f4f7660d9be0490098a63eeed7eb3fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:15:27.051098 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:27.051749 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:27.053290 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4360/8792] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:15:26 2022] DELETE /identity/v3/projects/f4f7660d9be0490098a63eeed7eb3fb0 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:15:27.057450 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afb984-db04-4a45-b246-7bdad8262296 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:27.061681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-85afb984-db04-4a45-b246-7bdad8262296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:27.072830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afb984-db04-4a45-b246-7bdad8262296 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:27.130658 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d169573-8bef-46ee-9c7d-ed205f28b0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:27.131293 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d169573-8bef-46ee-9c7d-ed205f28b0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:27.131577 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d169573-8bef-46ee-9c7d-ed205f28b0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:27.131853 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d169573-8bef-46ee-9c7d-ed205f28b0e2 admin admin] PATH_INFO: `/v3/users/dc92f3b8c60446a994e10984bfea232f` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:27.133024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d169573-8bef-46ee-9c7d-ed205f28b0e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc92f3b8c60446a994e10984bfea232f)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:27.134945 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d169573-8bef-46ee-9c7d-ed205f28b0e2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:27.368428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d169573-8bef-46ee-9c7d-ed205f28b0e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc92f3b8c60446a994e10984bfea232f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:27.369023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d169573-8bef-46ee-9c7d-ed205f28b0e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc92f3b8c60446a994e10984bfea232f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:27.468743 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d169573-8bef-46ee-9c7d-ed205f28b0e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc92f3b8c60446a994e10984bfea232f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:27.469364 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d169573-8bef-46ee-9c7d-ed205f28b0e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc92f3b8c60446a994e10984bfea232f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:27.482815 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5d169573-8bef-46ee-9c7d-ed205f28b0e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc92f3b8c60446a994e10984bfea232f'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:27.495179 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4433/8793] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:15:27 2022] DELETE /identity/v3/users/dc92f3b8c60446a994e10984bfea232f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:15:27.744867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:27.747264 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:27.761286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacdbda-fa7b-4b4d-b597-267e5b9dd6b1 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:27.823582 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f341f8-2f82-4669-9d9a-998700576402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:27.824296 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f341f8-2f82-4669-9d9a-998700576402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:27.825109 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f341f8-2f82-4669-9d9a-998700576402 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:27.825385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f341f8-2f82-4669-9d9a-998700576402 admin admin] PATH_INFO: `/v3/projects/ae6108ba79e94cff9cbaee7a91ca9f46` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:27.826532 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f341f8-2f82-4669-9d9a-998700576402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6108ba79e94cff9cbaee7a91ca9f46)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:27.829152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f341f8-2f82-4669-9d9a-998700576402 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:27.836035 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:28.034073 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c7f341f8-2f82-4669-9d9a-998700576402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6108ba79e94cff9cbaee7a91ca9f46', 'request_id': 'req-c7f341f8-2f82-4669-9d9a-998700576402'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:28.040526 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c7f341f8-2f82-4669-9d9a-998700576402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6108ba79e94cff9cbaee7a91ca9f46', 'request_id': 'req-c7f341f8-2f82-4669-9d9a-998700576402'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:28.047717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c7f341f8-2f82-4669-9d9a-998700576402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6108ba79e94cff9cbaee7a91ca9f46', 'request_id': 'req-c7f341f8-2f82-4669-9d9a-998700576402'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:28.148560 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c7f341f8-2f82-4669-9d9a-998700576402 admin admin] The token cache is being invalidate because project ae6108ba79e94cff9cbaee7a91ca9f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:15:28.148904 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c7f341f8-2f82-4669-9d9a-998700576402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:28.149501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-c7f341f8-2f82-4669-9d9a-998700576402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:15:28.151007 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4361/8794] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:15:27 2022] DELETE /identity/v3/projects/ae6108ba79e94cff9cbaee7a91ca9f46 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 05:15:28.156362 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcfdc2-e569-4bf6-ba5c-712ca50009c1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:28.157119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcfdc2-e569-4bf6-ba5c-712ca50009c1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:28.157381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcfdc2-e569-4bf6-ba5c-712ca50009c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:28.179692 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a1fcfdc2-e569-4bf6-ba5c-712ca50009c1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:15:28.181396 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a1fcfdc2-e569-4bf6-ba5c-712ca50009c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:28.246077 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4434/8795] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:15:28.254505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5e256-dce5-4ada-9a4c-56a415797ea7 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:28.254793 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5e256-dce5-4ada-9a4c-56a415797ea7 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:28.255072 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5e256-dce5-4ada-9a4c-56a415797ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:28.274775 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-45f5e256-dce5-4ada-9a4c-56a415797ea7 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:15:28.279594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-45f5e256-dce5-4ada-9a4c-56a415797ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:28.285872 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4362/8796] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:15:28.290971 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcfdc2-e569-4bf6-ba5c-712ca50009c1 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:28.301689 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcfdc2-e569-4bf6-ba5c-712ca50009c1 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:28.306267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca14cf-9e5a-4ae8-bacd-807c9526a0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:28.311997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca14cf-9e5a-4ae8-bacd-807c9526a0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:28.311997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca14cf-9e5a-4ae8-bacd-807c9526a0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:28.311997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca14cf-9e5a-4ae8-bacd-807c9526a0f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:28.311997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca14cf-9e5a-4ae8-bacd-807c9526a0f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:15:28.311997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca14cf-9e5a-4ae8-bacd-807c9526a0f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:28.311997 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca14cf-9e5a-4ae8-bacd-807c9526a0f2 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:28.321864 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4435/8797] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:15:28.326301 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5e256-dce5-4ada-9a4c-56a415797ea7 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:28.335681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5e256-dce5-4ada-9a4c-56a415797ea7 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:28.340910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c457411-4e95-4076-847e-19e5460686a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:28.341504 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457411-4e95-4076-847e-19e5460686a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:28.341780 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457411-4e95-4076-847e-19e5460686a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:28.342054 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457411-4e95-4076-847e-19e5460686a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:28.342691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c457411-4e95-4076-847e-19e5460686a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:28.344636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c457411-4e95-4076-847e-19e5460686a6 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:28.444886 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4363/8798] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:15:28 2022] POST /identity/v3/projects => generated 393 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:15:28.449107 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca14cf-9e5a-4ae8-bacd-807c9526a0f2 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:28.454484 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:28.459763 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca14cf-9e5a-4ae8-bacd-807c9526a0f2 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:28.519925 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee9823-41da-4bbc-b1e8-e736f3396639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:28.521028 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee9823-41da-4bbc-b1e8-e736f3396639 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:28.521323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee9823-41da-4bbc-b1e8-e736f3396639 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:28.521600 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee9823-41da-4bbc-b1e8-e736f3396639 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:28.522233 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee9823-41da-4bbc-b1e8-e736f3396639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:28.524157 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee9823-41da-4bbc-b1e8-e736f3396639 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:28.680682 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4436/8799] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:15:28 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:15:28.684840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c457411-4e95-4076-847e-19e5460686a6 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:28.695362 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c457411-4e95-4076-847e-19e5460686a6 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:28.700919 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836991b-db51-4bcf-b9d3-e888236cd35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:28.701608 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836991b-db51-4bcf-b9d3-e888236cd35f admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:28.701808 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836991b-db51-4bcf-b9d3-e888236cd35f admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:28.702104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836991b-db51-4bcf-b9d3-e888236cd35f admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:28.702759 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836991b-db51-4bcf-b9d3-e888236cd35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:28.704409 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836991b-db51-4bcf-b9d3-e888236cd35f admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:28.714979 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4364/8800] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:15:28.719524 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee9823-41da-4bbc-b1e8-e736f3396639 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:28.730084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee9823-41da-4bbc-b1e8-e736f3396639 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:28.735680 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a380f65-54e5-4a60-9505-db08ea08e2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:28.736617 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a380f65-54e5-4a60-9505-db08ea08e2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:28.736929 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a380f65-54e5-4a60-9505-db08ea08e2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:28.737280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a380f65-54e5-4a60-9505-db08ea08e2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:28.738095 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a380f65-54e5-4a60-9505-db08ea08e2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:28.739741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a380f65-54e5-4a60-9505-db08ea08e2b4 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:28.750974 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4437/8801] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:15:28.755215 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836991b-db51-4bcf-b9d3-e888236cd35f admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:28.766190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836991b-db51-4bcf-b9d3-e888236cd35f admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:28.770787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873b656-5540-443b-830d-c601ff8891b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:28.771438 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873b656-5540-443b-830d-c601ff8891b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:28.771722 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873b656-5540-443b-830d-c601ff8891b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:28.771997 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873b656-5540-443b-830d-c601ff8891b7 admin admin] PATH_INFO: `/v3/projects/d6eebd600a964f4ca91de2d97e0df602/users/f902257c3a514a709e1ca235dbc0cbbd/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:28.787351 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873b656-5540-443b-830d-c601ff8891b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6eebd600a964f4ca91de2d97e0df602, user_id=f902257c3a514a709e1ca235dbc0cbbd, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:28.790326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873b656-5540-443b-830d-c601ff8891b7 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:28.897650 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4365/8802] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:15:28 2022] PUT /identity/v3/projects/d6eebd600a964f4ca91de2d97e0df602/users/f902257c3a514a709e1ca235dbc0cbbd/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:15:28.908288 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13645eb2-b1f6-478e-a79d-3f5a28e6c696 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:28.908573 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13645eb2-b1f6-478e-a79d-3f5a28e6c696 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:28.908846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13645eb2-b1f6-478e-a79d-3f5a28e6c696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:28.937332 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-13645eb2-b1f6-478e-a79d-3f5a28e6c696 None None] MFA Rules not processed for user `f902257c3a514a709e1ca235dbc0cbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:15:28.938447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-13645eb2-b1f6-478e-a79d-3f5a28e6c696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:29.003975 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4438/8803] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:15:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:15:29.008842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873b656-5540-443b-830d-c601ff8891b7 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:29.073795 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873b656-5540-443b-830d-c601ff8891b7 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:29.079119 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de880275-1e8f-4a29-8c0f-77030e8d66fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:29.079719 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de880275-1e8f-4a29-8c0f-77030e8d66fd admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:29.080001 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de880275-1e8f-4a29-8c0f-77030e8d66fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:29.080308 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de880275-1e8f-4a29-8c0f-77030e8d66fd admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:29.080946 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de880275-1e8f-4a29-8c0f-77030e8d66fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:29.082867 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de880275-1e8f-4a29-8c0f-77030e8d66fd admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:29.217661 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4366/8804] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:15:29 2022] POST /identity/v3/projects => generated 393 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:15:29.221756 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13645eb2-b1f6-478e-a79d-3f5a28e6c696 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:29.233494 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13645eb2-b1f6-478e-a79d-3f5a28e6c696 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:29.292527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590e4dc-0818-4424-b7f5-b8530459b6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:29.293705 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590e4dc-0818-4424-b7f5-b8530459b6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:29.293992 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590e4dc-0818-4424-b7f5-b8530459b6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:29.294273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590e4dc-0818-4424-b7f5-b8530459b6a0 admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:29.294917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590e4dc-0818-4424-b7f5-b8530459b6a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:29.296872 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590e4dc-0818-4424-b7f5-b8530459b6a0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:29.499846 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:29.505123 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4439/8805] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:15:29 2022] POST /identity/v3/users => generated 303 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:15:29.509292 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de880275-1e8f-4a29-8c0f-77030e8d66fd admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:29.519863 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de880275-1e8f-4a29-8c0f-77030e8d66fd admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:29.524357 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108a772-33f9-4c5a-add7-13bd61bfde50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:29.524952 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108a772-33f9-4c5a-add7-13bd61bfde50 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:29.525234 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108a772-33f9-4c5a-add7-13bd61bfde50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:29.525506 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108a772-33f9-4c5a-add7-13bd61bfde50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:29.526143 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108a772-33f9-4c5a-add7-13bd61bfde50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:29.527734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108a772-33f9-4c5a-add7-13bd61bfde50 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:29.539366 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4367/8806] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:15:29.545490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590e4dc-0818-4424-b7f5-b8530459b6a0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:29.555647 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590e4dc-0818-4424-b7f5-b8530459b6a0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:29.561134 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0a470-478a-4457-ae03-8ea999a5950f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:29.561857 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0a470-478a-4457-ae03-8ea999a5950f admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:29.562141 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0a470-478a-4457-ae03-8ea999a5950f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:29.562421 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0a470-478a-4457-ae03-8ea999a5950f admin admin] PATH_INFO: `/v3/projects/6586b51e0d4f46779dccf995b3e38713/users/2030ed4ea7df4c6987fa37ca2fac7acf/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:29.579167 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0a470-478a-4457-ae03-8ea999a5950f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6586b51e0d4f46779dccf995b3e38713, user_id=2030ed4ea7df4c6987fa37ca2fac7acf, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:29.582273 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0a470-478a-4457-ae03-8ea999a5950f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:29.707551 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4440/8807] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:15:29 2022] PUT /identity/v3/projects/6586b51e0d4f46779dccf995b3e38713/users/2030ed4ea7df4c6987fa37ca2fac7acf/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:15:29.711633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108a772-33f9-4c5a-add7-13bd61bfde50 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:29.719321 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:29.723490 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108a772-33f9-4c5a-add7-13bd61bfde50 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:29.781902 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194edd5-ced3-4e6e-9c51-116d71f62d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:29.783196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194edd5-ced3-4e6e-9c51-116d71f62d43 admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:29.783479 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194edd5-ced3-4e6e-9c51-116d71f62d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:29.783757 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194edd5-ced3-4e6e-9c51-116d71f62d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:29.784501 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194edd5-ced3-4e6e-9c51-116d71f62d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:29.786111 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194edd5-ced3-4e6e-9c51-116d71f62d43 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:29.797171 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4368/8808] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:15:29.801492 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0a470-478a-4457-ae03-8ea999a5950f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:29.812019 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0a470-478a-4457-ae03-8ea999a5950f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:29.816843 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c281c-a543-41ea-956f-cca3e99392a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:29.817542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c281c-a543-41ea-956f-cca3e99392a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:29.817845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c281c-a543-41ea-956f-cca3e99392a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:29.818122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c281c-a543-41ea-956f-cca3e99392a7 admin admin] PATH_INFO: `/v3/projects/6586b51e0d4f46779dccf995b3e38713/users/2030ed4ea7df4c6987fa37ca2fac7acf/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:29.820052 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c281c-a543-41ea-956f-cca3e99392a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6586b51e0d4f46779dccf995b3e38713, user_id=2030ed4ea7df4c6987fa37ca2fac7acf, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:29.822800 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c281c-a543-41ea-956f-cca3e99392a7 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:29.833487 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4441/8809] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:15:29 2022] PUT /identity/v3/projects/6586b51e0d4f46779dccf995b3e38713/users/2030ed4ea7df4c6987fa37ca2fac7acf/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:15:29.850384 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fc706-193f-4551-94a4-dd0941f17393 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:29.850747 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fc706-193f-4551-94a4-dd0941f17393 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:29.851146 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fc706-193f-4551-94a4-dd0941f17393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:29.881360 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-ac1fc706-193f-4551-94a4-dd0941f17393 None None] MFA Rules not processed for user `2030ed4ea7df4c6987fa37ca2fac7acf`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:15:29.882735 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ac1fc706-193f-4551-94a4-dd0941f17393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:29.957380 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4369/8810] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:15:29 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:15:29.972932 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c281c-a543-41ea-956f-cca3e99392a7 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:29.974740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-8e2c281c-a543-41ea-956f-cca3e99392a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:30.054724 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c281c-a543-41ea-956f-cca3e99392a7 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:30.060286 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbb124-2d4a-4684-9b33-95aafc781d64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:30.060972 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbb124-2d4a-4684-9b33-95aafc781d64 service nova] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:30.061252 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbb124-2d4a-4684-9b33-95aafc781d64 service nova] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:30.061523 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbb124-2d4a-4684-9b33-95aafc781d64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:30.117803 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbb124-2d4a-4684-9b33-95aafc781d64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:30.119428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbb124-2d4a-4684-9b33-95aafc781d64 service nova] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:30.128750 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4442/8811] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:15:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:15:36.913611 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fc706-193f-4551-94a4-dd0941f17393 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:15:36.915221 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-ac1fc706-193f-4551-94a4-dd0941f17393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:36.984571 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fc706-193f-4551-94a4-dd0941f17393 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:15:36.988328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406b3cd-6beb-49d1-a708-cf97800b0d25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:15:36.988977 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406b3cd-6beb-49d1-a708-cf97800b0d25 service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:36.989277 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406b3cd-6beb-49d1-a708-cf97800b0d25 service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:36.989553 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406b3cd-6beb-49d1-a708-cf97800b0d25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:37.000060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406b3cd-6beb-49d1-a708-cf97800b0d25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:15:37.001644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406b3cd-6beb-49d1-a708-cf97800b0d25 service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:15:37.013689 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4370/8812] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:15:36 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:15:40.124626 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=71,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:40.461711 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76936c1e-2431-4a10-86d7-44d46a4c464f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:40.462084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76936c1e-2431-4a10-86d7-44d46a4c464f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:40.462333 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76936c1e-2431-4a10-86d7-44d46a4c464f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:40.484062 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-76936c1e-2431-4a10-86d7-44d46a4c464f None None] MFA Rules not processed for user `f902257c3a514a709e1ca235dbc0cbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:15:40.486161 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-76936c1e-2431-4a10-86d7-44d46a4c464f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:40.499451 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4443/8813] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:15:40.921195 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96138-5830-4b46-84c1-3359aab09d07 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:40.921718 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96138-5830-4b46-84c1-3359aab09d07 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:40.921813 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96138-5830-4b46-84c1-3359aab09d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:40.929913 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-07b96138-5830-4b46-84c1-3359aab09d07 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:15:40.929913 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:15:40.929913 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:15:40.929913 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:15:40.929913 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:15:40.929913 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:15:40.929913 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:15:40.929913 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:15:40.929913 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:15:40.929913 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:15:40.929913 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:15:40.929913 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:15:40.929913 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:15:40.931163 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:15:40.931163 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:15:40.931163 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:15:40.931163 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:15:40.931163 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:15:40.931163 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:15:40.931163 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:15:40.931163 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:15:40.931163 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:15:40.931163 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:15:40.931163 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:15:40.931163 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:15:40.931163 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:15:40.931163 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:15:40.931163 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:15:40.934061 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4371/8814] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:15:40 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:15:47.008858 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=87 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:50.478191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:15:53.470491 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b23c4f-2b8b-4818-ab19-72db499e9247 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:53.471425 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b23c4f-2b8b-4818-ab19-72db499e9247 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:53.471706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b23c4f-2b8b-4818-ab19-72db499e9247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:53.495504 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d5b23c4f-2b8b-4818-ab19-72db499e9247 None None] MFA Rules not processed for user `f902257c3a514a709e1ca235dbc0cbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:15:53.496933 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d5b23c4f-2b8b-4818-ab19-72db499e9247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:15:53.514828 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4444/8815] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:15:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:15:53.863907 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a268d-ae12-4513-958a-f086ae0ed3e8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:15:53.864482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a268d-ae12-4513-958a-f086ae0ed3e8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:15:53.864482 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a268d-ae12-4513-958a-f086ae0ed3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:15:53.871495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-9c0a268d-ae12-4513-958a-f086ae0ed3e8 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:15:53.871495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:15:53.871495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:15:53.871495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:15:53.871495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:15:53.871495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:15:53.871495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:15:53.871495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:15:53.871495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:15:53.871495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:15:53.871495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:15:53.871495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:15:53.871495 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:15:53.872887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:15:53.872887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:15:53.872887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:15:53.872887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:15:53.872887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:15:53.872887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:15:53.872887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:15:53.872887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:15:53.872887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:15:53.872887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:15:53.872887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:15:53.872887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:15:53.872887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:15:53.872887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:15:53.872887 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:15:53.875911 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4372/8816] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:15:53 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 13 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:16:03.487883 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:06.348212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d0202-7e1a-4b18-8de7-af746a72d173 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:06.348804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d0202-7e1a-4b18-8de7-af746a72d173 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:06.348804 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d0202-7e1a-4b18-8de7-af746a72d173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:06.370777 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-a89d0202-7e1a-4b18-8de7-af746a72d173 None None] MFA Rules not processed for user `f902257c3a514a709e1ca235dbc0cbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:16:06.372239 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-a89d0202-7e1a-4b18-8de7-af746a72d173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:06.380013 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4445/8817] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:16:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:16:06.797829 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b0246-7b10-4cac-bae0-455bd1b62c71 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:06.800306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b0246-7b10-4cac-bae0-455bd1b62c71 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:06.800777 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b0246-7b10-4cac-bae0-455bd1b62c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:06.808389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-e01b0246-7b10-4cac-bae0-455bd1b62c71 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:16:06.808389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:16:06.808389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:16:06.808389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:16:06.808389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:16:06.808389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:16:06.808389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:16:06.808389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:16:06.808389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:16:06.808389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:16:06.808389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:16:06.808389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:16:06.808389 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:16:06.809620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:16:06.809620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:16:06.809620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:16:06.809620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:16:06.809620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:16:06.809620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:16:06.809620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:16:06.809620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:16:06.809620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:16:06.809620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:16:06.809620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:16:06.809620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:16:06.809620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:16:06.809620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:16:06.809620 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:16:06.812129 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4373/8818] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:16:06 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 15 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:16:16.364245 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:21.617534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3f43-8cf4-4e84-b926-d9fb35c084c9 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:21.618319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3f43-8cf4-4e84-b926-d9fb35c084c9 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:21.618319 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3f43-8cf4-4e84-b926-d9fb35c084c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:21.650868 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-946a3f43-8cf4-4e84-b926-d9fb35c084c9 None None] MFA Rules not processed for user `f902257c3a514a709e1ca235dbc0cbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:16:21.652280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-946a3f43-8cf4-4e84-b926-d9fb35c084c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:21.679302 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4446/8819] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:16:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:16:22.016293 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe8c82-23ed-43ff-872d-6d046405f4cb None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:22.016870 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe8c82-23ed-43ff-872d-6d046405f4cb None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:22.016987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe8c82-23ed-43ff-872d-6d046405f4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:22.023346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-b4fe8c82-23ed-43ff-872d-6d046405f4cb None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:16:22.023346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:16:22.023346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:16:22.023346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:16:22.023346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:16:22.023346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:16:22.023346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:16:22.023346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:16:22.023346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:16:22.023346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:16:22.023346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:16:22.023346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:16:22.023346 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:16:22.024518 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:16:22.024518 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:16:22.024518 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:16:22.024518 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:16:22.024518 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:16:22.024518 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:16:22.024518 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:16:22.024518 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:16:22.024518 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:16:22.024518 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:16:22.024518 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:16:22.024518 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:16:22.024518 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:16:22.024518 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:16:22.024518 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:16:22.026030 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4374/8820] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:16:22 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 12 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:16:31.677068 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=15 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:34.103420 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cf3a3-c870-4384-ab7d-d053fedaa112 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:34.104307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cf3a3-c870-4384-ab7d-d053fedaa112 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:34.104652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cf3a3-c870-4384-ab7d-d053fedaa112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:34.128648 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-e36cf3a3-c870-4384-ab7d-d053fedaa112 None None] MFA Rules not processed for user `f902257c3a514a709e1ca235dbc0cbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:16:34.129882 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e36cf3a3-c870-4384-ab7d-d053fedaa112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:34.137442 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4447/8821] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:16:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:16:34.789805 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c84f8-4aa8-47ef-969b-98aee1095016 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:34.790645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c84f8-4aa8-47ef-969b-98aee1095016 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:34.790645 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c84f8-4aa8-47ef-969b-98aee1095016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:34.799285 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-490c84f8-4aa8-47ef-969b-98aee1095016 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:16:34.799285 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:16:34.799285 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:16:34.799285 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:16:34.799285 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:16:34.799285 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:16:34.799285 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:16:34.799285 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:16:34.799285 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:16:34.799285 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:16:34.799285 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:16:34.799285 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:16:34.799285 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:16:34.800425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:16:34.800425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:16:34.800425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:16:34.800425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:16:34.800425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:16:34.800425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:16:34.800425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:16:34.800425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:16:34.800425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:16:34.800425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:16:34.800425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:16:34.800425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:16:34.800425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:16:34.800425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:16:34.800425 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:16:34.803267 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4375/8822] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:16:34 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:16:38.588191 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cf3a3-c870-4384-ab7d-d053fedaa112 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:38.676271 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cf3a3-c870-4384-ab7d-d053fedaa112 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:38.680275 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9149e12-9612-4f65-9fce-dd76f2b5339f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:38.680874 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9149e12-9612-4f65-9fce-dd76f2b5339f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:38.681149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9149e12-9612-4f65-9fce-dd76f2b5339f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:38.681447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9149e12-9612-4f65-9fce-dd76f2b5339f admin admin] PATH_INFO: `/v3/users/f902257c3a514a709e1ca235dbc0cbbd` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:38.682565 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9149e12-9612-4f65-9fce-dd76f2b5339f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f902257c3a514a709e1ca235dbc0cbbd)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:38.684527 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9149e12-9612-4f65-9fce-dd76f2b5339f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:38.883431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e9149e12-9612-4f65-9fce-dd76f2b5339f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f902257c3a514a709e1ca235dbc0cbbd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:38.884026 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e9149e12-9612-4f65-9fce-dd76f2b5339f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f902257c3a514a709e1ca235dbc0cbbd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:38.970447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e9149e12-9612-4f65-9fce-dd76f2b5339f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f902257c3a514a709e1ca235dbc0cbbd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:38.971067 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e9149e12-9612-4f65-9fce-dd76f2b5339f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f902257c3a514a709e1ca235dbc0cbbd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:38.984702 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-e9149e12-9612-4f65-9fce-dd76f2b5339f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f902257c3a514a709e1ca235dbc0cbbd'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:38.997723 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4448/8823] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:16:38 2022] DELETE /identity/v3/users/f902257c3a514a709e1ca235dbc0cbbd => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:16:39.002996 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826db4e9-e409-4485-a78e-ba3ac75855e8 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:39.008074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826db4e9-e409-4485-a78e-ba3ac75855e8 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:39.008074 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826db4e9-e409-4485-a78e-ba3ac75855e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:39.024894 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-826db4e9-e409-4485-a78e-ba3ac75855e8 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:16:39.026104 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-826db4e9-e409-4485-a78e-ba3ac75855e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:39.086342 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4376/8824] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:16:39.097118 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9149e12-9612-4f65-9fce-dd76f2b5339f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:39.098746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-e9149e12-9612-4f65-9fce-dd76f2b5339f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:39.175965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9149e12-9612-4f65-9fce-dd76f2b5339f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:39.179570 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175d9a6-689f-4c9a-8949-01578589b11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:39.180197 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175d9a6-689f-4c9a-8949-01578589b11c service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:39.180485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175d9a6-689f-4c9a-8949-01578589b11c service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:39.180758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175d9a6-689f-4c9a-8949-01578589b11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:39.186578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:39.190320 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175d9a6-689f-4c9a-8949-01578589b11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:39.191750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175d9a6-689f-4c9a-8949-01578589b11c service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:39.201253 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4449/8825] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:16:39.430190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826db4e9-e409-4485-a78e-ba3ac75855e8 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:39.430190 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-826db4e9-e409-4485-a78e-ba3ac75855e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:39.441627 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826db4e9-e409-4485-a78e-ba3ac75855e8 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:39.446306 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51427b5-09d8-42c6-a147-5feb0b1f216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:39.446937 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51427b5-09d8-42c6-a147-5feb0b1f216d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:39.447300 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51427b5-09d8-42c6-a147-5feb0b1f216d admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:39.447709 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51427b5-09d8-42c6-a147-5feb0b1f216d admin admin] PATH_INFO: `/v3/projects/d6eebd600a964f4ca91de2d97e0df602` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:39.448885 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51427b5-09d8-42c6-a147-5feb0b1f216d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6eebd600a964f4ca91de2d97e0df602)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:39.450898 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51427b5-09d8-42c6-a147-5feb0b1f216d admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:39.540748 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e51427b5-09d8-42c6-a147-5feb0b1f216d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6eebd600a964f4ca91de2d97e0df602', 'request_id': 'req-e51427b5-09d8-42c6-a147-5feb0b1f216d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:39.547066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e51427b5-09d8-42c6-a147-5feb0b1f216d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6eebd600a964f4ca91de2d97e0df602', 'request_id': 'req-e51427b5-09d8-42c6-a147-5feb0b1f216d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:39.553340 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e51427b5-09d8-42c6-a147-5feb0b1f216d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6eebd600a964f4ca91de2d97e0df602', 'request_id': 'req-e51427b5-09d8-42c6-a147-5feb0b1f216d'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:39.621684 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e51427b5-09d8-42c6-a147-5feb0b1f216d admin admin] The token cache is being invalidate because project d6eebd600a964f4ca91de2d97e0df602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:16:39.621976 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e51427b5-09d8-42c6-a147-5feb0b1f216d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:39.622605 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-e51427b5-09d8-42c6-a147-5feb0b1f216d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:39.625039 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4377/8826] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:16:39 2022] DELETE /identity/v3/projects/d6eebd600a964f4ca91de2d97e0df602 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:16:39.629448 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175d9a6-689f-4c9a-8949-01578589b11c service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:39.639370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175d9a6-689f-4c9a-8949-01578589b11c service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:39.696900 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281aa47-8e09-4338-a00b-e9778eed9664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:39.697529 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281aa47-8e09-4338-a00b-e9778eed9664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:39.697809 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281aa47-8e09-4338-a00b-e9778eed9664 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:39.698082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281aa47-8e09-4338-a00b-e9778eed9664 admin admin] PATH_INFO: `/v3/users/2030ed4ea7df4c6987fa37ca2fac7acf` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:39.699230 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281aa47-8e09-4338-a00b-e9778eed9664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2030ed4ea7df4c6987fa37ca2fac7acf)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:39.701214 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281aa47-8e09-4338-a00b-e9778eed9664 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:39.864670 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5281aa47-8e09-4338-a00b-e9778eed9664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2030ed4ea7df4c6987fa37ca2fac7acf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:39.865283 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5281aa47-8e09-4338-a00b-e9778eed9664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2030ed4ea7df4c6987fa37ca2fac7acf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:39.952965 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5281aa47-8e09-4338-a00b-e9778eed9664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2030ed4ea7df4c6987fa37ca2fac7acf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:39.953631 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5281aa47-8e09-4338-a00b-e9778eed9664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2030ed4ea7df4c6987fa37ca2fac7acf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:39.967414 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-5281aa47-8e09-4338-a00b-e9778eed9664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2030ed4ea7df4c6987fa37ca2fac7acf'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:39.979889 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4450/8827] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:16:39 2022] DELETE /identity/v3/users/2030ed4ea7df4c6987fa37ca2fac7acf => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:16:40.481787 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51427b5-09d8-42c6-a147-5feb0b1f216d admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:40.483326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e51427b5-09d8-42c6-a147-5feb0b1f216d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:40.497317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51427b5-09d8-42c6-a147-5feb0b1f216d admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:40.557593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ce913-1216-41f7-ac55-6dd6424c2382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:40.558227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ce913-1216-41f7-ac55-6dd6424c2382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:40.560324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ce913-1216-41f7-ac55-6dd6424c2382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:40.560324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ce913-1216-41f7-ac55-6dd6424c2382 admin admin] PATH_INFO: `/v3/projects/6586b51e0d4f46779dccf995b3e38713` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:40.560324 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ce913-1216-41f7-ac55-6dd6424c2382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6586b51e0d4f46779dccf995b3e38713)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:40.562068 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ce913-1216-41f7-ac55-6dd6424c2382 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:40.670566 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:40.686440 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9f7ce913-1216-41f7-ac55-6dd6424c2382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6586b51e0d4f46779dccf995b3e38713', 'request_id': 'req-9f7ce913-1216-41f7-ac55-6dd6424c2382'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:40.691921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9f7ce913-1216-41f7-ac55-6dd6424c2382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6586b51e0d4f46779dccf995b3e38713', 'request_id': 'req-9f7ce913-1216-41f7-ac55-6dd6424c2382'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:40.698053 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9f7ce913-1216-41f7-ac55-6dd6424c2382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6586b51e0d4f46779dccf995b3e38713', 'request_id': 'req-9f7ce913-1216-41f7-ac55-6dd6424c2382'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:40.772145 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9f7ce913-1216-41f7-ac55-6dd6424c2382 admin admin] The token cache is being invalidate because project 6586b51e0d4f46779dccf995b3e38713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:16:40.772454 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9f7ce913-1216-41f7-ac55-6dd6424c2382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:40.773092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-9f7ce913-1216-41f7-ac55-6dd6424c2382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:16:40.774637 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4378/8828] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:16:40 2022] DELETE /identity/v3/projects/6586b51e0d4f46779dccf995b3e38713 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:16:40.779917 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28aa5c1-2ece-48bc-bfad-898cd721fd3a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:40.781713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28aa5c1-2ece-48bc-bfad-898cd721fd3a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:40.781713 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28aa5c1-2ece-48bc-bfad-898cd721fd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:40.811467 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-f28aa5c1-2ece-48bc-bfad-898cd721fd3a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:16:40.813034 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-f28aa5c1-2ece-48bc-bfad-898cd721fd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:40.877034 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4451/8829] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:16:40.885536 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64109aa3-f9e7-4cbc-abc3-014f18438eb2 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:40.885857 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64109aa3-f9e7-4cbc-abc3-014f18438eb2 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:40.886134 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64109aa3-f9e7-4cbc-abc3-014f18438eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:40.906567 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-64109aa3-f9e7-4cbc-abc3-014f18438eb2 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:16:40.907816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-64109aa3-f9e7-4cbc-abc3-014f18438eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:40.916095 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4379/8830] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:16:40.920614 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28aa5c1-2ece-48bc-bfad-898cd721fd3a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:40.926663 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:40.930728 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28aa5c1-2ece-48bc-bfad-898cd721fd3a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:40.935740 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b80c2-421c-4e4b-9068-a395e4422abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:40.936418 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b80c2-421c-4e4b-9068-a395e4422abf admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:40.937343 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b80c2-421c-4e4b-9068-a395e4422abf admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:40.937664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b80c2-421c-4e4b-9068-a395e4422abf admin admin] PATH_INFO: `/v3/domains` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:40.938394 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b80c2-421c-4e4b-9068-a395e4422abf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:16:40.938703 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b80c2-421c-4e4b-9068-a395e4422abf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:40.940337 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b80c2-421c-4e4b-9068-a395e4422abf admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:40.953632 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4452/8831] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:16:40.958016 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64109aa3-f9e7-4cbc-abc3-014f18438eb2 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:40.967801 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64109aa3-f9e7-4cbc-abc3-014f18438eb2 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:40.972737 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743d909-04a1-4ee0-b524-913d08fa2524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:40.973492 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743d909-04a1-4ee0-b524-913d08fa2524 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:40.973776 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743d909-04a1-4ee0-b524-913d08fa2524 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:40.974047 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743d909-04a1-4ee0-b524-913d08fa2524 admin admin] PATH_INFO: `/v3/projects` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:40.974674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743d909-04a1-4ee0-b524-913d08fa2524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:40.976622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743d909-04a1-4ee0-b524-913d08fa2524 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:41.099371 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4380/8832] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:16:40 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:16:41.103526 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b80c2-421c-4e4b-9068-a395e4422abf admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:41.114342 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b80c2-421c-4e4b-9068-a395e4422abf admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:41.170741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d52fd-29f5-48fa-bfb5-ea7e2f2e2b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:41.171695 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d52fd-29f5-48fa-bfb5-ea7e2f2e2b9e admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:41.171974 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d52fd-29f5-48fa-bfb5-ea7e2f2e2b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:41.172274 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d52fd-29f5-48fa-bfb5-ea7e2f2e2b9e admin admin] PATH_INFO: `/v3/users` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:41.172899 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d52fd-29f5-48fa-bfb5-ea7e2f2e2b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:41.174844 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d52fd-29f5-48fa-bfb5-ea7e2f2e2b9e admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:41.274842 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4453/8833] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:16:41 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:16:41.279099 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743d909-04a1-4ee0-b524-913d08fa2524 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:41.290060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743d909-04a1-4ee0-b524-913d08fa2524 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:41.295500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fde1d-ed79-42a3-b335-2d1f9ec442ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:41.296831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fde1d-ed79-42a3-b335-2d1f9ec442ed admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:41.297114 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fde1d-ed79-42a3-b335-2d1f9ec442ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:41.297385 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fde1d-ed79-42a3-b335-2d1f9ec442ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:41.298024 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fde1d-ed79-42a3-b335-2d1f9ec442ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:41.299622 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fde1d-ed79-42a3-b335-2d1f9ec442ed admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:41.310059 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4381/8834] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:16:41.314661 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d52fd-29f5-48fa-bfb5-ea7e2f2e2b9e admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:41.324698 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d52fd-29f5-48fa-bfb5-ea7e2f2e2b9e admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:41.329455 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542ad04-86c7-4182-9ad2-e41118a417d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:41.330047 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542ad04-86c7-4182-9ad2-e41118a417d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:41.330322 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542ad04-86c7-4182-9ad2-e41118a417d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:41.330591 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542ad04-86c7-4182-9ad2-e41118a417d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:41.331217 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542ad04-86c7-4182-9ad2-e41118a417d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:41.332827 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542ad04-86c7-4182-9ad2-e41118a417d9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:41.343688 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4454/8835] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:16:41.347734 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fde1d-ed79-42a3-b335-2d1f9ec442ed admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:41.358161 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fde1d-ed79-42a3-b335-2d1f9ec442ed admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:41.363368 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459d3eb-2ae1-40ac-86f8-8ccb4945a699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:41.364064 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459d3eb-2ae1-40ac-86f8-8ccb4945a699 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:41.364378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459d3eb-2ae1-40ac-86f8-8ccb4945a699 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:41.364654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459d3eb-2ae1-40ac-86f8-8ccb4945a699 admin admin] PATH_INFO: `/v3/projects/8ef321de59f24630819133ed3e549695/users/c4b9f526fad0407b86962015e7f0bce5/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:41.379596 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459d3eb-2ae1-40ac-86f8-8ccb4945a699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ef321de59f24630819133ed3e549695, user_id=c4b9f526fad0407b86962015e7f0bce5, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:41.382329 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459d3eb-2ae1-40ac-86f8-8ccb4945a699 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:41.498152 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4382/8836] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:16:41 2022] PUT /identity/v3/projects/8ef321de59f24630819133ed3e549695/users/c4b9f526fad0407b86962015e7f0bce5/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:16:41.503875 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eff5cd-2454-4a1a-92af-88386064228a None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:41.504172 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eff5cd-2454-4a1a-92af-88386064228a None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:41.504457 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eff5cd-2454-4a1a-92af-88386064228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:41.524579 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-d9eff5cd-2454-4a1a-92af-88386064228a None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:16:41.525798 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d9eff5cd-2454-4a1a-92af-88386064228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:41.585909 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4455/8837] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:16:41.596358 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459d3eb-2ae1-40ac-86f8-8ccb4945a699 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:41.598129 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f459d3eb-2ae1-40ac-86f8-8ccb4945a699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:41.661328 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459d3eb-2ae1-40ac-86f8-8ccb4945a699 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:41.665031 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264b153-17c0-4d60-97c4-01d309337bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:41.665959 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264b153-17c0-4d60-97c4-01d309337bab service neutron] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:41.666239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264b153-17c0-4d60-97c4-01d309337bab service neutron] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:41.666511 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264b153-17c0-4d60-97c4-01d309337bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:41.676770 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264b153-17c0-4d60-97c4-01d309337bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:41.678203 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264b153-17c0-4d60-97c4-01d309337bab service neutron] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:41.687907 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4383/8838] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:16:43.952054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eff5cd-2454-4a1a-92af-88386064228a None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:43.954502 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-d9eff5cd-2454-4a1a-92af-88386064228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:44.033667 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:44.042607 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eff5cd-2454-4a1a-92af-88386064228a None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:44.048542 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b09e7-14bb-4a13-87c0-4a7f699078a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:44.049317 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b09e7-14bb-4a13-87c0-4a7f699078a5 service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:44.049668 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b09e7-14bb-4a13-87c0-4a7f699078a5 service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:44.050011 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b09e7-14bb-4a13-87c0-4a7f699078a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:44.052513 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-052b09e7-14bb-4a13-87c0-4a7f699078a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:44.069490 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b09e7-14bb-4a13-87c0-4a7f699078a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:44.071549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b09e7-14bb-4a13-87c0-4a7f699078a5 service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:44.085913 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4456/8839] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:16:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:16:47.423676 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ed584-1354-497a-acea-ae0852f5fd23 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:47.424261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ed584-1354-497a-acea-ae0852f5fd23 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:47.424261 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ed584-1354-497a-acea-ae0852f5fd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:47.465456 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-f11ed584-1354-497a-acea-ae0852f5fd23 None None] MFA Rules not processed for user `c4b9f526fad0407b86962015e7f0bce5`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:16:47.466484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-f11ed584-1354-497a-acea-ae0852f5fd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:47.515239 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:47.537641 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4384/8840] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:16:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:16:47.542385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b09e7-14bb-4a13-87c0-4a7f699078a5 service placement] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:47.554370 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b09e7-14bb-4a13-87c0-4a7f699078a5 service placement] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:47.558835 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469fbcf-00cc-4328-9ad3-cde38efc0dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:47.559431 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469fbcf-00cc-4328-9ad3-cde38efc0dab admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:47.559704 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469fbcf-00cc-4328-9ad3-cde38efc0dab admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:47.559979 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469fbcf-00cc-4328-9ad3-cde38efc0dab admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:47.560656 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469fbcf-00cc-4328-9ad3-cde38efc0dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:47.563323 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469fbcf-00cc-4328-9ad3-cde38efc0dab admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:47.677538 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4457/8841] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:16:47 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:16:47.681754 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ed584-1354-497a-acea-ae0852f5fd23 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:47.693460 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ed584-1354-497a-acea-ae0852f5fd23 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:47.751647 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d975b-fdcd-4191-9844-d0e15033ad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:47.752279 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d975b-fdcd-4191-9844-d0e15033ad16 admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:47.752568 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d975b-fdcd-4191-9844-d0e15033ad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:47.752834 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d975b-fdcd-4191-9844-d0e15033ad16 admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:47.753455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d975b-fdcd-4191-9844-d0e15033ad16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:47.755361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d975b-fdcd-4191-9844-d0e15033ad16 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:47.860127 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4385/8842] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:16:47 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:16:47.862730 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469fbcf-00cc-4328-9ad3-cde38efc0dab admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:47.873082 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469fbcf-00cc-4328-9ad3-cde38efc0dab admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:47.877935 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c892f-20a5-43ee-a3e6-d66d9a5cbe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:47.878534 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c892f-20a5-43ee-a3e6-d66d9a5cbe16 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:47.878814 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c892f-20a5-43ee-a3e6-d66d9a5cbe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:47.879089 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c892f-20a5-43ee-a3e6-d66d9a5cbe16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:47.879729 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c892f-20a5-43ee-a3e6-d66d9a5cbe16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:47.881395 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c892f-20a5-43ee-a3e6-d66d9a5cbe16 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:47.891866 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4458/8843] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:16:47.896461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d975b-fdcd-4191-9844-d0e15033ad16 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:47.907613 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d975b-fdcd-4191-9844-d0e15033ad16 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:47.912500 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a6634-f881-4f35-8849-47c27512106c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:47.913166 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a6634-f881-4f35-8849-47c27512106c admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:47.922062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a6634-f881-4f35-8849-47c27512106c admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:47.922062 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a6634-f881-4f35-8849-47c27512106c admin admin] PATH_INFO: `/v3/projects/b6c198926d7a4d009f99f4eedd15140c/users/bcc4ac241e664067b1d8508227e57ef7/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:47.931836 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a6634-f881-4f35-8849-47c27512106c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c198926d7a4d009f99f4eedd15140c, user_id=bcc4ac241e664067b1d8508227e57ef7, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:47.934791 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a6634-f881-4f35-8849-47c27512106c admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:48.005056 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4386/8844] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:16:47 2022] PUT /identity/v3/projects/b6c198926d7a4d009f99f4eedd15140c/users/bcc4ac241e664067b1d8508227e57ef7/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:16:48.009505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c892f-20a5-43ee-a3e6-d66d9a5cbe16 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:48.029458 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c892f-20a5-43ee-a3e6-d66d9a5cbe16 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:48.081913 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fd7e2-4e60-4dd6-a487-d85d787ae9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:48.082564 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fd7e2-4e60-4dd6-a487-d85d787ae9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:48.082845 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fd7e2-4e60-4dd6-a487-d85d787ae9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:48.083117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fd7e2-4e60-4dd6-a487-d85d787ae9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:48.083758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fd7e2-4e60-4dd6-a487-d85d787ae9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:48.085413 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fd7e2-4e60-4dd6-a487-d85d787ae9f9 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:48.097009 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4459/8845] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:16:48.101457 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a6634-f881-4f35-8849-47c27512106c admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:48.112199 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a6634-f881-4f35-8849-47c27512106c admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:48.116831 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57220a1-1448-4c0b-bbb3-6804eee43263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:48.117476 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57220a1-1448-4c0b-bbb3-6804eee43263 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:48.117758 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57220a1-1448-4c0b-bbb3-6804eee43263 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:48.118034 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57220a1-1448-4c0b-bbb3-6804eee43263 admin admin] PATH_INFO: `/v3/projects/b6c198926d7a4d009f99f4eedd15140c/users/bcc4ac241e664067b1d8508227e57ef7/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:48.119929 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57220a1-1448-4c0b-bbb3-6804eee43263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c198926d7a4d009f99f4eedd15140c, user_id=bcc4ac241e664067b1d8508227e57ef7, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:48.122692 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57220a1-1448-4c0b-bbb3-6804eee43263 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:48.132917 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4387/8846] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:16:48 2022] PUT /identity/v3/projects/b6c198926d7a4d009f99f4eedd15140c/users/bcc4ac241e664067b1d8508227e57ef7/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:16:54.307462 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e3178-19c0-4731-954d-a4f1f1d2ffe1 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:54.308498 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e3178-19c0-4731-954d-a4f1f1d2ffe1 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:54.308768 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e3178-19c0-4731-954d-a4f1f1d2ffe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:54.342636 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0a3e3178-19c0-4731-954d-a4f1f1d2ffe1 None None] MFA Rules not processed for user `bcc4ac241e664067b1d8508227e57ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:16:54.344556 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0a3e3178-19c0-4731-954d-a4f1f1d2ffe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:54.413845 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4460/8847] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:16:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:16:54.430082 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57220a1-1448-4c0b-bbb3-6804eee43263 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:54.431871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-d57220a1-1448-4c0b-bbb3-6804eee43263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:54.511133 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57220a1-1448-4c0b-bbb3-6804eee43263 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:54.517182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cc359-fdf6-44c2-8567-5a9b177fae82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:54.517850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cc359-fdf6-44c2-8567-5a9b177fae82 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:54.518139 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cc359-fdf6-44c2-8567-5a9b177fae82 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:54.518416 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cc359-fdf6-44c2-8567-5a9b177fae82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:54.551484 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:16:54.583531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191cc359-fdf6-44c2-8567-5a9b177fae82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:54.585346 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191cc359-fdf6-44c2-8567-5a9b177fae82 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:54.595514 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4388/8848] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:16:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:16:58.624660 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76908177-d584-4739-83b7-e8b399ed2cb3 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:58.625212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76908177-d584-4739-83b7-e8b399ed2cb3 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:58.625212 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76908177-d584-4739-83b7-e8b399ed2cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:58.645064 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-76908177-d584-4739-83b7-e8b399ed2cb3 None None] MFA Rules not processed for user `c4b9f526fad0407b86962015e7f0bce5`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:16:58.646311 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-76908177-d584-4739-83b7-e8b399ed2cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:58.654143 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4461/8849] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:16:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:16:58.705229 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cc359-fdf6-44c2-8567-5a9b177fae82 service nova] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:16:58.706673 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-191cc359-fdf6-44c2-8567-5a9b177fae82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:58.781802 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cc359-fdf6-44c2-8567-5a9b177fae82 service nova] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:16:58.785948 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01131a92-8f8f-4d76-8395-c05ffd261222 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cd48a297bf498e88ce722f74154354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:16:58.786557 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01131a92-8f8f-4d76-8395-c05ffd261222 service glance] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:58.786840 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01131a92-8f8f-4d76-8395-c05ffd261222 service glance] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:58.787116 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01131a92-8f8f-4d76-8395-c05ffd261222 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:58.788924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-01131a92-8f8f-4d76-8395-c05ffd261222 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:16:58.806594 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01131a92-8f8f-4d76-8395-c05ffd261222 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:16:58.807965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01131a92-8f8f-4d76-8395-c05ffd261222 service glance] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:16:58.821828 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4389/8850] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:16:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:16:59.103764 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ca608-fcab-4c93-9388-1d23e3805326 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:16:59.112031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ca608-fcab-4c93-9388-1d23e3805326 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:16:59.112031 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ca608-fcab-4c93-9388-1d23e3805326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:16:59.112031 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-8e5ca608-fcab-4c93-9388-1d23e3805326 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:16:59.112031 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:16:59.112031 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:16:59.112031 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:16:59.112031 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:16:59.112031 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:16:59.112031 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:16:59.112031 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:16:59.113049 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:16:59.113049 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:16:59.113049 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:16:59.113049 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:16:59.113049 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:16:59.113049 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:16:59.113049 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:16:59.113049 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:16:59.113049 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:16:59.113049 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:16:59.113049 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:16:59.113049 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:16:59.113049 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:16:59.113049 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:16:59.113049 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:16:59.113049 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:16:59.114435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:16:59.114435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:16:59.114435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:16:59.114435 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 05:16:59.114435 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4462/8851] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:16:59 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:17:02.949730 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13ae18-77b2-4ca3-b0e7-0bbe49a60bcc None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:02.951617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13ae18-77b2-4ca3-b0e7-0bbe49a60bcc None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:02.951617 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13ae18-77b2-4ca3-b0e7-0bbe49a60bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:02.971455 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-6e13ae18-77b2-4ca3-b0e7-0bbe49a60bcc None None] MFA Rules not processed for user `c4b9f526fad0407b86962015e7f0bce5`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:17:02.972712 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6e13ae18-77b2-4ca3-b0e7-0bbe49a60bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:17:02.979678 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4390/8852] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:17:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:17:08.638709 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=85,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:12.965451 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=46 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:25.238426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57c428-d064-4522-b488-3ba1d2f96ce0 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:25.238987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57c428-d064-4522-b488-3ba1d2f96ce0 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:25.238987 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57c428-d064-4522-b488-3ba1d2f96ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:25.246014 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application [None req-9c57c428-d064-4522-b488-3ba1d2f96ce0 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:17:25.246014 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:17:25.246014 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:17:25.246014 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:17:25.246014 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:17:25.246014 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:17:25.246014 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:17:25.246014 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:17:25.246014 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:17:25.246014 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:17:25.246014 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:17:25.246014 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:17:25.246014 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:17:25.247253 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:17:25.247253 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:17:25.247253 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:17:25.247253 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:17:25.247253 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:17:25.247253 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:17:25.247253 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:17:25.247253 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:17:25.247253 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:17:25.247253 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:17:25.247253 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:17:25.247253 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:17:25.247253 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:17:25.247253 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:17:25.247253 n-d-852088-5 devstack@keystone.service[82083]: ERROR keystone.server.flask.application Aug 27 05:17:25.248466 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4463/8853] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:17:25 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:17:33.362990 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13ae18-77b2-4ca3-b0e7-0bbe49a60bcc None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:33.437196 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13ae18-77b2-4ca3-b0e7-0bbe49a60bcc None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:33.442882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880aa8a-76d6-4e99-b31f-c694dea3c8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:33.443516 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880aa8a-76d6-4e99-b31f-c694dea3c8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:33.443800 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880aa8a-76d6-4e99-b31f-c694dea3c8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:33.444075 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880aa8a-76d6-4e99-b31f-c694dea3c8ae admin admin] PATH_INFO: `/v3/users/c4b9f526fad0407b86962015e7f0bce5` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:33.445227 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880aa8a-76d6-4e99-b31f-c694dea3c8ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b9f526fad0407b86962015e7f0bce5)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:33.447162 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880aa8a-76d6-4e99-b31f-c694dea3c8ae admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:33.654120 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f880aa8a-76d6-4e99-b31f-c694dea3c8ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b9f526fad0407b86962015e7f0bce5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:33.735843 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f880aa8a-76d6-4e99-b31f-c694dea3c8ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b9f526fad0407b86962015e7f0bce5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:33.737601 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f880aa8a-76d6-4e99-b31f-c694dea3c8ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b9f526fad0407b86962015e7f0bce5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:33.745327 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f880aa8a-76d6-4e99-b31f-c694dea3c8ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b9f526fad0407b86962015e7f0bce5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:33.757827 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-f880aa8a-76d6-4e99-b31f-c694dea3c8ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b9f526fad0407b86962015e7f0bce5'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:33.764151 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4391/8854] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:17:33 2022] DELETE /identity/v3/users/c4b9f526fad0407b86962015e7f0bce5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:17:34.093583 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57c428-d064-4522-b488-3ba1d2f96ce0 None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:34.095447 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-9c57c428-d064-4522-b488-3ba1d2f96ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:17:34.183681 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57c428-d064-4522-b488-3ba1d2f96ce0 None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:34.188423 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32de93c-62d5-40f0-bec9-98b7ad645c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:34.189087 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32de93c-62d5-40f0-bec9-98b7ad645c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:34.189389 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32de93c-62d5-40f0-bec9-98b7ad645c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:34.190151 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32de93c-62d5-40f0-bec9-98b7ad645c46 admin admin] PATH_INFO: `/v3/projects/8ef321de59f24630819133ed3e549695` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:34.190955 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32de93c-62d5-40f0-bec9-98b7ad645c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ef321de59f24630819133ed3e549695)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:34.193001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32de93c-62d5-40f0-bec9-98b7ad645c46 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:34.314446 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b32de93c-62d5-40f0-bec9-98b7ad645c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ef321de59f24630819133ed3e549695', 'request_id': 'req-b32de93c-62d5-40f0-bec9-98b7ad645c46'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:34.319748 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b32de93c-62d5-40f0-bec9-98b7ad645c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ef321de59f24630819133ed3e549695', 'request_id': 'req-b32de93c-62d5-40f0-bec9-98b7ad645c46'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:34.417683 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b32de93c-62d5-40f0-bec9-98b7ad645c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ef321de59f24630819133ed3e549695', 'request_id': 'req-b32de93c-62d5-40f0-bec9-98b7ad645c46'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:34.430262 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b32de93c-62d5-40f0-bec9-98b7ad645c46 admin admin] The token cache is being invalidate because project 8ef321de59f24630819133ed3e549695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:17:34.430555 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b32de93c-62d5-40f0-bec9-98b7ad645c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:34.431213 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-b32de93c-62d5-40f0-bec9-98b7ad645c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:34.432763 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4464/8855] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:17:34 2022] DELETE /identity/v3/projects/8ef321de59f24630819133ed3e549695 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:17:34.436760 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880aa8a-76d6-4e99-b31f-c694dea3c8ae admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:34.447537 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880aa8a-76d6-4e99-b31f-c694dea3c8ae admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:34.505405 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf1cee-7081-4da4-b45d-040f61100596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:34.506036 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf1cee-7081-4da4-b45d-040f61100596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:34.506317 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf1cee-7081-4da4-b45d-040f61100596 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:34.506593 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf1cee-7081-4da4-b45d-040f61100596 admin admin] PATH_INFO: `/v3/users/bcc4ac241e664067b1d8508227e57ef7` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:34.507707 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf1cee-7081-4da4-b45d-040f61100596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc4ac241e664067b1d8508227e57ef7)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:34.509702 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf1cee-7081-4da4-b45d-040f61100596 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:34.523096 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:34.686882 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a5bf1cee-7081-4da4-b45d-040f61100596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc4ac241e664067b1d8508227e57ef7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:34.743059 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a5bf1cee-7081-4da4-b45d-040f61100596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc4ac241e664067b1d8508227e57ef7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:34.743723 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a5bf1cee-7081-4da4-b45d-040f61100596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc4ac241e664067b1d8508227e57ef7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:34.751487 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a5bf1cee-7081-4da4-b45d-040f61100596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc4ac241e664067b1d8508227e57ef7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:34.764255 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-a5bf1cee-7081-4da4-b45d-040f61100596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc4ac241e664067b1d8508227e57ef7'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:34.770922 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4392/8856] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:17:34 2022] DELETE /identity/v3/users/bcc4ac241e664067b1d8508227e57ef7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:17:35.042838 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32de93c-62d5-40f0-bec9-98b7ad645c46 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:35.045449 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-b32de93c-62d5-40f0-bec9-98b7ad645c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:17:35.058204 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32de93c-62d5-40f0-bec9-98b7ad645c46 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:35.116715 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2027c2e-a95f-473d-b3cc-f216ecbf0958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:35.117408 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2027c2e-a95f-473d-b3cc-f216ecbf0958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:35.117601 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2027c2e-a95f-473d-b3cc-f216ecbf0958 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:35.117870 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2027c2e-a95f-473d-b3cc-f216ecbf0958 admin admin] PATH_INFO: `/v3/projects/b6c198926d7a4d009f99f4eedd15140c` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:35.119001 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2027c2e-a95f-473d-b3cc-f216ecbf0958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c198926d7a4d009f99f4eedd15140c)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:35.121024 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2027c2e-a95f-473d-b3cc-f216ecbf0958 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:35.143578 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:35.245769 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f2027c2e-a95f-473d-b3cc-f216ecbf0958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c198926d7a4d009f99f4eedd15140c', 'request_id': 'req-f2027c2e-a95f-473d-b3cc-f216ecbf0958'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:35.251190 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f2027c2e-a95f-473d-b3cc-f216ecbf0958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c198926d7a4d009f99f4eedd15140c', 'request_id': 'req-f2027c2e-a95f-473d-b3cc-f216ecbf0958'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:35.331629 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f2027c2e-a95f-473d-b3cc-f216ecbf0958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c198926d7a4d009f99f4eedd15140c', 'request_id': 'req-f2027c2e-a95f-473d-b3cc-f216ecbf0958'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:35.343079 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f2027c2e-a95f-473d-b3cc-f216ecbf0958 admin admin] The token cache is being invalidate because project b6c198926d7a4d009f99f4eedd15140c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:17:35.343367 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f2027c2e-a95f-473d-b3cc-f216ecbf0958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:35.343988 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-f2027c2e-a95f-473d-b3cc-f216ecbf0958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:35.345510 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4465/8857] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:17:35 2022] DELETE /identity/v3/projects/b6c198926d7a4d009f99f4eedd15140c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:17:35.351077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcd1f9-a1c3-4f8c-889d-9f39fe007263 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:35.351366 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcd1f9-a1c3-4f8c-889d-9f39fe007263 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:35.351644 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcd1f9-a1c3-4f8c-889d-9f39fe007263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:35.412623 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-9dbcd1f9-a1c3-4f8c-889d-9f39fe007263 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:17:35.413896 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-9dbcd1f9-a1c3-4f8c-889d-9f39fe007263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:17:35.474346 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4393/8858] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:17:35.482621 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75460f2f-f4fe-4407-a8e8-3b99a2efb31f None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:35.482907 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75460f2f-f4fe-4407-a8e8-3b99a2efb31f None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:35.483182 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75460f2f-f4fe-4407-a8e8-3b99a2efb31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:35.503411 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-75460f2f-f4fe-4407-a8e8-3b99a2efb31f None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:17:35.504652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-75460f2f-f4fe-4407-a8e8-3b99a2efb31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:17:35.512786 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4466/8859] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:17:35.516930 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcd1f9-a1c3-4f8c-889d-9f39fe007263 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:35.526751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcd1f9-a1c3-4f8c-889d-9f39fe007263 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:35.531369 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8febaf9-66d9-45de-94c5-ba2b244149fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:35.531962 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8febaf9-66d9-45de-94c5-ba2b244149fb admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:35.532286 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8febaf9-66d9-45de-94c5-ba2b244149fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:35.532563 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8febaf9-66d9-45de-94c5-ba2b244149fb admin admin] PATH_INFO: `/v3/domains` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:35.533914 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8febaf9-66d9-45de-94c5-ba2b244149fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82082) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 05:17:35.534378 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8febaf9-66d9-45de-94c5-ba2b244149fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:35.535785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8febaf9-66d9-45de-94c5-ba2b244149fb admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:35.547627 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4394/8860] 10.222.0.76 () {58 vars in 1153 bytes} [Sat Aug 27 05:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 05:17:35.552553 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75460f2f-f4fe-4407-a8e8-3b99a2efb31f None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:35.561830 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75460f2f-f4fe-4407-a8e8-3b99a2efb31f None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:35.567093 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37c374-2c69-4082-8b5b-140dee7fe1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:35.567811 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37c374-2c69-4082-8b5b-140dee7fe1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:35.568097 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37c374-2c69-4082-8b5b-140dee7fe1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:35.568426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37c374-2c69-4082-8b5b-140dee7fe1d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:35.569054 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37c374-2c69-4082-8b5b-140dee7fe1d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:35.570985 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37c374-2c69-4082-8b5b-140dee7fe1d0 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:35.680781 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4467/8861] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:17:35 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:17:35.684871 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8febaf9-66d9-45de-94c5-ba2b244149fb admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:35.695313 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8febaf9-66d9-45de-94c5-ba2b244149fb admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:35.750230 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:35.758048 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56901a10-d3b1-490f-beb7-e9322bcc341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:35.758665 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56901a10-d3b1-490f-beb7-e9322bcc341b admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:35.759092 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56901a10-d3b1-490f-beb7-e9322bcc341b admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:35.759371 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56901a10-d3b1-490f-beb7-e9322bcc341b admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:35.760011 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56901a10-d3b1-490f-beb7-e9322bcc341b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:35.761987 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56901a10-d3b1-490f-beb7-e9322bcc341b admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:35.886527 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4395/8862] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:17:35 2022] POST /identity/v3/users => generated 287 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:17:35.890741 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37c374-2c69-4082-8b5b-140dee7fe1d0 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:35.902272 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37c374-2c69-4082-8b5b-140dee7fe1d0 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:35.906792 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfe0e6-a520-4692-acc9-d727f1c28594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:35.907388 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe0e6-a520-4692-acc9-d727f1c28594 admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:35.907664 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe0e6-a520-4692-acc9-d727f1c28594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:35.907931 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe0e6-a520-4692-acc9-d727f1c28594 admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:35.909280 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfe0e6-a520-4692-acc9-d727f1c28594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:35.910861 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfe0e6-a520-4692-acc9-d727f1c28594 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:35.921296 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4468/8863] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:17:35.933452 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56901a10-d3b1-490f-beb7-e9322bcc341b admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:35.944853 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56901a10-d3b1-490f-beb7-e9322bcc341b admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:35.949781 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9c004-d165-450f-a438-e0ef544955cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:35.950410 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9c004-d165-450f-a438-e0ef544955cc admin admin] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:35.950691 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9c004-d165-450f-a438-e0ef544955cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:35.950965 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9c004-d165-450f-a438-e0ef544955cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:35.951636 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9c004-d165-450f-a438-e0ef544955cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:35.953268 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9c004-d165-450f-a438-e0ef544955cc admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:35.965339 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4396/8864] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:17:35.969369 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfe0e6-a520-4692-acc9-d727f1c28594 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:35.979428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfe0e6-a520-4692-acc9-d727f1c28594 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:35.984485 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e9055-a267-4cd2-8ee9-c607f10a23fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:35.988211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e9055-a267-4cd2-8ee9-c607f10a23fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:35.988211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e9055-a267-4cd2-8ee9-c607f10a23fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:35.988211 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e9055-a267-4cd2-8ee9-c607f10a23fa admin admin] PATH_INFO: `/v3/projects/7d3d34c74d194b728786d353bdf7dd95/users/ede8832111144b60aa1276781b3cad6b/roles/5a4c2cf9b8d849398625913504b4b172` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:36.001122 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e9055-a267-4cd2-8ee9-c607f10a23fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d3d34c74d194b728786d353bdf7dd95, user_id=ede8832111144b60aa1276781b3cad6b, role_id=5a4c2cf9b8d849398625913504b4b172)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:36.004461 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e9055-a267-4cd2-8ee9-c607f10a23fa admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:36.149551 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4469/8865] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:17:35 2022] PUT /identity/v3/projects/7d3d34c74d194b728786d353bdf7dd95/users/ede8832111144b60aa1276781b3cad6b/roles/5a4c2cf9b8d849398625913504b4b172 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:17:36.154717 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01a4bf-a4f9-43e7-9574-516835c110b1 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:36.155005 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01a4bf-a4f9-43e7-9574-516835c110b1 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:36.155281 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01a4bf-a4f9-43e7-9574-516835c110b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:36.174208 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-0a01a4bf-a4f9-43e7-9574-516835c110b1 None None] MFA Rules not processed for user `f2cd24054e9f47928421e1d9e1889453`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:17:36.175421 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0a01a4bf-a4f9-43e7-9574-516835c110b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:17:36.234977 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4397/8866] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:17:36.245023 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e9055-a267-4cd2-8ee9-c607f10a23fa admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:36.246765 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-ec5e9055-a267-4cd2-8ee9-c607f10a23fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:17:36.319391 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e9055-a267-4cd2-8ee9-c607f10a23fa admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:36.323014 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca409df-52e9-4803-8b50-7af74e0b0f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0547461f91aa423381430eda35fe6b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:36.323618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca409df-52e9-4803-8b50-7af74e0b0f1c service neutron] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:36.323897 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca409df-52e9-4803-8b50-7af74e0b0f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:36.324180 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca409df-52e9-4803-8b50-7af74e0b0f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:36.333240 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca409df-52e9-4803-8b50-7af74e0b0f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:36.334662 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca409df-52e9-4803-8b50-7af74e0b0f1c service neutron] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:36.344253 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4470/8867] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:17:41.733066 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a1267-bb9d-4b42-bc4b-b15fc3b30f94 None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:41.733531 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a1267-bb9d-4b42-bc4b-b15fc3b30f94 None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:41.733783 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a1267-bb9d-4b42-bc4b-b15fc3b30f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:41.765615 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.auth.core [None req-625a1267-bb9d-4b42-bc4b-b15fc3b30f94 None None] MFA Rules not processed for user `ede8832111144b60aa1276781b3cad6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82082) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:17:41.767052 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-625a1267-bb9d-4b42-bc4b-b15fc3b30f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:17:41.836400 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4398/8868] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:17:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:17:41.840750 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca409df-52e9-4803-8b50-7af74e0b0f1c service neutron] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:41.851739 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca409df-52e9-4803-8b50-7af74e0b0f1c service neutron] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:41.856618 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a86c9-2db0-4585-aff5-904c1f86bb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:41.857235 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a86c9-2db0-4585-aff5-904c1f86bb0f admin admin] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:41.857519 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a86c9-2db0-4585-aff5-904c1f86bb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:41.857794 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a86c9-2db0-4585-aff5-904c1f86bb0f admin admin] PATH_INFO: `/v3/projects` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:41.858441 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a86c9-2db0-4585-aff5-904c1f86bb0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:41.860381 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a86c9-2db0-4585-aff5-904c1f86bb0f admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:41.967400 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4471/8869] 10.222.0.76 () {60 vars in 1153 bytes} [Sat Aug 27 05:17:41 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:17:41.971674 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a1267-bb9d-4b42-bc4b-b15fc3b30f94 None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:41.984181 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a1267-bb9d-4b42-bc4b-b15fc3b30f94 None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:42.047535 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579b69d-97a5-459a-8ec8-6b11104ca8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:42.048263 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579b69d-97a5-459a-8ec8-6b11104ca8ac admin admin] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:42.048562 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579b69d-97a5-459a-8ec8-6b11104ca8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:42.048842 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579b69d-97a5-459a-8ec8-6b11104ca8ac admin admin] PATH_INFO: `/v3/users` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:42.049517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579b69d-97a5-459a-8ec8-6b11104ca8ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:42.051459 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579b69d-97a5-459a-8ec8-6b11104ca8ac admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:42.062147 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:42.195475 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4399/8870] 10.222.0.76 () {60 vars in 1144 bytes} [Sat Aug 27 05:17:41 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 05:17:42.199775 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a86c9-2db0-4585-aff5-904c1f86bb0f admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:42.210941 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a86c9-2db0-4585-aff5-904c1f86bb0f admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:42.215515 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02198f-2dc1-4c86-a187-0c772589eeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:42.216117 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02198f-2dc1-4c86-a187-0c772589eeaa admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:42.216429 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02198f-2dc1-4c86-a187-0c772589eeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:42.216706 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02198f-2dc1-4c86-a187-0c772589eeaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:42.217347 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02198f-2dc1-4c86-a187-0c772589eeaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:42.218943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02198f-2dc1-4c86-a187-0c772589eeaa admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:42.230029 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4472/8871] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:17:42.234330 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579b69d-97a5-459a-8ec8-6b11104ca8ac admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:42.245152 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579b69d-97a5-459a-8ec8-6b11104ca8ac admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:42.250083 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c2fa8-c868-4a82-9e01-1c7321980994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:42.250751 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c2fa8-c868-4a82-9e01-1c7321980994 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:42.251108 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c2fa8-c868-4a82-9e01-1c7321980994 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:42.251311 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c2fa8-c868-4a82-9e01-1c7321980994 admin admin] PATH_INFO: `/v3/projects/8bd5efaffdce402483417546e2080d5f/users/055abbd0232c413eb86806d9f07fc8b8/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:42.269223 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c2fa8-c868-4a82-9e01-1c7321980994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd5efaffdce402483417546e2080d5f, user_id=055abbd0232c413eb86806d9f07fc8b8, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:42.271905 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c2fa8-c868-4a82-9e01-1c7321980994 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:42.378416 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4400/8872] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:17:42 2022] PUT /identity/v3/projects/8bd5efaffdce402483417546e2080d5f/users/055abbd0232c413eb86806d9f07fc8b8/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:17:42.389094 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02198f-2dc1-4c86-a187-0c772589eeaa admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:42.395751 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:42.399428 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02198f-2dc1-4c86-a187-0c772589eeaa admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:42.458039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce612adc-2d78-4ed4-bed3-8f340224649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:42.458652 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce612adc-2d78-4ed4-bed3-8f340224649b admin admin] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:42.458943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce612adc-2d78-4ed4-bed3-8f340224649b admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:42.459222 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce612adc-2d78-4ed4-bed3-8f340224649b admin admin] PATH_INFO: `/v3/roles` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:42.459864 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce612adc-2d78-4ed4-bed3-8f340224649b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:42.461536 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce612adc-2d78-4ed4-bed3-8f340224649b admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:42.472425 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4473/8873] 10.222.0.76 () {58 vars in 1122 bytes} [Sat Aug 27 05:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 05:17:42.476806 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c2fa8-c868-4a82-9e01-1c7321980994 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:42.488524 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c2fa8-c868-4a82-9e01-1c7321980994 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:42.493961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595ade6-2d6d-440b-82f4-3f7cb5c06bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:42.494631 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595ade6-2d6d-440b-82f4-3f7cb5c06bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:42.494910 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595ade6-2d6d-440b-82f4-3f7cb5c06bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:42.495182 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595ade6-2d6d-440b-82f4-3f7cb5c06bc0 admin admin] PATH_INFO: `/v3/projects/8bd5efaffdce402483417546e2080d5f/users/055abbd0232c413eb86806d9f07fc8b8/roles/0957af53dfcc4cfc8cf7947a65ecfabc` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:42.497204 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595ade6-2d6d-440b-82f4-3f7cb5c06bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd5efaffdce402483417546e2080d5f, user_id=055abbd0232c413eb86806d9f07fc8b8, role_id=0957af53dfcc4cfc8cf7947a65ecfabc)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:42.499878 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595ade6-2d6d-440b-82f4-3f7cb5c06bc0 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:42.511499 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4401/8874] 10.222.0.76 () {60 vars in 1483 bytes} [Sat Aug 27 05:17:42 2022] PUT /identity/v3/projects/8bd5efaffdce402483417546e2080d5f/users/055abbd0232c413eb86806d9f07fc8b8/roles/0957af53dfcc4cfc8cf7947a65ecfabc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:17:48.303149 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfecfd8-e43e-44d1-9711-4def7e9f3348 None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:48.303674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfecfd8-e43e-44d1-9711-4def7e9f3348 None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:48.303674 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfecfd8-e43e-44d1-9711-4def7e9f3348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:48.333415 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-4dfecfd8-e43e-44d1-9711-4def7e9f3348 None None] MFA Rules not processed for user `055abbd0232c413eb86806d9f07fc8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:17:48.334832 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-4dfecfd8-e43e-44d1-9711-4def7e9f3348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:17:48.406254 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4474/8875] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:17:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:17:48.428528 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595ade6-2d6d-440b-82f4-3f7cb5c06bc0 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:48.430431 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-6595ade6-2d6d-440b-82f4-3f7cb5c06bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:17:48.519350 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595ade6-2d6d-440b-82f4-3f7cb5c06bc0 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:48.525353 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e1f34-e7a9-411d-b413-c5eede5a5937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5ddcf00a184aa0ac0e7194f1c72425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:48.525961 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e1f34-e7a9-411d-b413-c5eede5a5937 service nova] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:48.526243 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e1f34-e7a9-411d-b413-c5eede5a5937 service nova] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:48.526517 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e1f34-e7a9-411d-b413-c5eede5a5937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:48.590654 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e1f34-e7a9-411d-b413-c5eede5a5937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:48.592019 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e1f34-e7a9-411d-b413-c5eede5a5937 service nova] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:48.602939 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4402/8876] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:17:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:17:51.123103 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92a725-2698-49f0-8d24-1e5f96493d8e None None] REQUEST_METHOD: `POST` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:51.123562 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92a725-2698-49f0-8d24-1e5f96493d8e None None] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:51.123643 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92a725-2698-49f0-8d24-1e5f96493d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:51.146338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.auth.core [None req-0a92a725-2698-49f0-8d24-1e5f96493d8e None None] MFA Rules not processed for user `ede8832111144b60aa1276781b3cad6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 05:17:51.146338 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-0a92a725-2698-49f0-8d24-1e5f96493d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:17:51.151258 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4475/8877] 10.222.0.76 () {58 vars in 958 bytes} [Sat Aug 27 05:17:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 05:17:51.466461 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643a308-4f81-4af9-984c-caeae5b2d81f None None] REQUEST_METHOD: `POST` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:51.466963 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643a308-4f81-4af9-984c-caeae5b2d81f None None] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:51.467258 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643a308-4f81-4af9-984c-caeae5b2d81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:51.475771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application [None req-e643a308-4f81-4af9-984c-caeae5b2d81f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:17:51.475771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 05:17:51.475771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 05:17:51.475771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 05:17:51.475771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 05:17:51.475771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 05:17:51.475771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 05:17:51.475771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 05:17:51.475771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 05:17:51.475771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 05:17:51.475771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 05:17:51.475771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 05:17:51.475771 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 27 05:17:51.476604 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 27 05:17:51.476604 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 27 05:17:51.476604 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 27 05:17:51.476604 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 27 05:17:51.476604 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 27 05:17:51.476604 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 27 05:17:51.476604 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 27 05:17:51.476604 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 27 05:17:51.476604 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 27 05:17:51.476604 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 27 05:17:51.476604 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 27 05:17:51.476604 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 27 05:17:51.476604 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 27 05:17:51.476604 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 27 05:17:51.476604 n-d-852088-5 devstack@keystone.service[82082]: ERROR keystone.server.flask.application Aug 27 05:17:51.477298 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4403/8878] 10.222.0.76 () {58 vars in 1009 bytes} [Sat Aug 27 05:17:51 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 12 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 27 05:17:58.597209 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:INSERT=3,keystone:SELECT=73 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:59.020879 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92a725-2698-49f0-8d24-1e5f96493d8e None None] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:59.084460 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92a725-2698-49f0-8d24-1e5f96493d8e None None] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:59.088834 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2047188-4d05-46c9-8c11-e489b67f1f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:59.089465 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2047188-4d05-46c9-8c11-e489b67f1f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:59.089746 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2047188-4d05-46c9-8c11-e489b67f1f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:59.090021 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2047188-4d05-46c9-8c11-e489b67f1f24 admin admin] PATH_INFO: `/v3/users/ede8832111144b60aa1276781b3cad6b` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:59.091147 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2047188-4d05-46c9-8c11-e489b67f1f24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede8832111144b60aa1276781b3cad6b)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:59.093119 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2047188-4d05-46c9-8c11-e489b67f1f24 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:59.117535 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:17:59.340759 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2047188-4d05-46c9-8c11-e489b67f1f24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede8832111144b60aa1276781b3cad6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:59.341426 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2047188-4d05-46c9-8c11-e489b67f1f24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede8832111144b60aa1276781b3cad6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:59.445851 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2047188-4d05-46c9-8c11-e489b67f1f24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede8832111144b60aa1276781b3cad6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:59.446505 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2047188-4d05-46c9-8c11-e489b67f1f24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede8832111144b60aa1276781b3cad6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:59.459125 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-c2047188-4d05-46c9-8c11-e489b67f1f24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede8832111144b60aa1276781b3cad6b'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:59.471776 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4476/8879] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:17:59 2022] DELETE /identity/v3/users/ede8832111144b60aa1276781b3cad6b => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:17:59.694989 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643a308-4f81-4af9-984c-caeae5b2d81f None None] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:59.696822 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-e643a308-4f81-4af9-984c-caeae5b2d81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:17:59.774060 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643a308-4f81-4af9-984c-caeae5b2d81f None None] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:17:59.778619 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012db8dd-3db9-4f29-b16e-81e9b69516a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:17:59.779249 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012db8dd-3db9-4f29-b16e-81e9b69516a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:17:59.779540 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012db8dd-3db9-4f29-b16e-81e9b69516a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:17:59.779816 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012db8dd-3db9-4f29-b16e-81e9b69516a8 admin admin] PATH_INFO: `/v3/projects/7d3d34c74d194b728786d353bdf7dd95` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:17:59.781003 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012db8dd-3db9-4f29-b16e-81e9b69516a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d3d34c74d194b728786d353bdf7dd95)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:17:59.782924 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012db8dd-3db9-4f29-b16e-81e9b69516a8 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:17:59.891543 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-012db8dd-3db9-4f29-b16e-81e9b69516a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d3d34c74d194b728786d353bdf7dd95', 'request_id': 'req-012db8dd-3db9-4f29-b16e-81e9b69516a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:59.897774 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-012db8dd-3db9-4f29-b16e-81e9b69516a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d3d34c74d194b728786d353bdf7dd95', 'request_id': 'req-012db8dd-3db9-4f29-b16e-81e9b69516a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:59.903964 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-012db8dd-3db9-4f29-b16e-81e9b69516a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d3d34c74d194b728786d353bdf7dd95', 'request_id': 'req-012db8dd-3db9-4f29-b16e-81e9b69516a8'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:59.953972 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-012db8dd-3db9-4f29-b16e-81e9b69516a8 admin admin] The token cache is being invalidate because project 7d3d34c74d194b728786d353bdf7dd95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:17:59.954214 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-012db8dd-3db9-4f29-b16e-81e9b69516a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:59.954865 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-012db8dd-3db9-4f29-b16e-81e9b69516a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:17:59.957440 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4404/8880] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:17:59 2022] DELETE /identity/v3/projects/7d3d34c74d194b728786d353bdf7dd95 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:17:59.965758 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2047188-4d05-46c9-8c11-e489b67f1f24 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:17:59.976443 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2047188-4d05-46c9-8c11-e489b67f1f24 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:18:00.033436 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400188d-8588-4b65-8b05-cedba3a76251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:18:00.034264 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400188d-8588-4b65-8b05-cedba3a76251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:18:00.034544 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400188d-8588-4b65-8b05-cedba3a76251 admin admin] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:18:00.034817 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400188d-8588-4b65-8b05-cedba3a76251 admin admin] PATH_INFO: `/v3/users/055abbd0232c413eb86806d9f07fc8b8` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:18:00.035958 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400188d-8588-4b65-8b05-cedba3a76251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=055abbd0232c413eb86806d9f07fc8b8)` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:18:00.037947 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400188d-8588-4b65-8b05-cedba3a76251 admin admin] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:18:00.207688 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6400188d-8588-4b65-8b05-cedba3a76251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055abbd0232c413eb86806d9f07fc8b8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:18:00.208307 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6400188d-8588-4b65-8b05-cedba3a76251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055abbd0232c413eb86806d9f07fc8b8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:18:00.297099 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6400188d-8588-4b65-8b05-cedba3a76251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055abbd0232c413eb86806d9f07fc8b8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:18:00.297760 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6400188d-8588-4b65-8b05-cedba3a76251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055abbd0232c413eb86806d9f07fc8b8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:18:00.311015 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.notifications [None req-6400188d-8588-4b65-8b05-cedba3a76251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055abbd0232c413eb86806d9f07fc8b8'} {{(pid=82083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:18:00.324380 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4477/8881] 10.222.0.76 () {58 vars in 1224 bytes} [Sat Aug 27 05:17:59 2022] DELETE /identity/v3/users/055abbd0232c413eb86806d9f07fc8b8 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:18:00.574078 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012db8dd-3db9-4f29-b16e-81e9b69516a8 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:18:00.575505 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-012db8dd-3db9-4f29-b16e-81e9b69516a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:18:00.589417 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012db8dd-3db9-4f29-b16e-81e9b69516a8 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:18:00.651361 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab18205-cbb4-454c-9101-6dd489274089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2cd24054e9f47928421e1d9e1889453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4935ddf6dc2a4bbea15d24b9f9bae471', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:18:00.651988 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab18205-cbb4-454c-9101-6dd489274089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:18:00.652304 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab18205-cbb4-454c-9101-6dd489274089 admin admin] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:18:00.652581 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab18205-cbb4-454c-9101-6dd489274089 admin admin] PATH_INFO: `/v3/projects/8bd5efaffdce402483417546e2080d5f` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:18:00.653701 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab18205-cbb4-454c-9101-6dd489274089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd5efaffdce402483417546e2080d5f)` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:18:00.655633 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab18205-cbb4-454c-9101-6dd489274089 admin admin] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:18:00.743921 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:00.755852 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dab18205-cbb4-454c-9101-6dd489274089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd5efaffdce402483417546e2080d5f', 'request_id': 'req-dab18205-cbb4-454c-9101-6dd489274089'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:18:00.761681 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dab18205-cbb4-454c-9101-6dd489274089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd5efaffdce402483417546e2080d5f', 'request_id': 'req-dab18205-cbb4-454c-9101-6dd489274089'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:18:00.768522 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dab18205-cbb4-454c-9101-6dd489274089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd5efaffdce402483417546e2080d5f', 'request_id': 'req-dab18205-cbb4-454c-9101-6dd489274089'} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:18:00.817113 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dab18205-cbb4-454c-9101-6dd489274089 admin admin] The token cache is being invalidate because project 8bd5efaffdce402483417546e2080d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82082) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 05:18:00.817326 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dab18205-cbb4-454c-9101-6dd489274089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:18:00.817960 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.notifications [None req-dab18205-cbb4-454c-9101-6dd489274089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82082) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 05:18:00.819537 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4405/8882] 10.222.0.76 () {58 vars in 1233 bytes} [Sat Aug 27 05:18:00 2022] DELETE /identity/v3/projects/8bd5efaffdce402483417546e2080d5f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 05:18:02.469557 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400188d-8588-4b65-8b05-cedba3a76251 admin admin] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:18:02.471066 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-6400188d-8588-4b65-8b05-cedba3a76251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:18:02.491499 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:02.544605 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400188d-8588-4b65-8b05-cedba3a76251 admin admin] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:18:02.609084 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3b108-7d2c-4d27-a57f-d6759795f529 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:18:02.609699 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3b108-7d2c-4d27-a57f-d6759795f529 service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:18:02.610039 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3b108-7d2c-4d27-a57f-d6759795f529 service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:18:02.610315 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3b108-7d2c-4d27-a57f-d6759795f529 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:18:02.612639 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.fernet_utils [None req-5ae3b108-7d2c-4d27-a57f-d6759795f529 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:18:02.626873 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3b108-7d2c-4d27-a57f-d6759795f529 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:18:02.628640 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3b108-7d2c-4d27-a57f-d6759795f529 service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:18:02.641199 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4478/8883] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:18:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 05:18:10.886319 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:18:12.634385 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=50 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:21:47.971077 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab18205-cbb4-454c-9101-6dd489274089 admin admin] Authenticating user token {{(pid=82082) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:21:47.972549 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-dab18205-cbb4-454c-9101-6dd489274089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:21:48.000185 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab18205-cbb4-454c-9101-6dd489274089 admin admin] Validating token access rules against request {{(pid=82082) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:21:48.005188 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaeb5d-a095-4912-996b-b6e508cb58d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82082) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:21:48.005785 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaeb5d-a095-4912-996b-b6e508cb58d0 service placement] REQUEST_METHOD: `GET` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:21:48.006811 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaeb5d-a095-4912-996b-b6e508cb58d0 service placement] SCRIPT_NAME: `/identity` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:21:48.007088 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaeb5d-a095-4912-996b-b6e508cb58d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82082) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:21:48.008850 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.fernet_utils [None req-0aeaeb5d-a095-4912-996b-b6e508cb58d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82082) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 05:21:48.024950 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeaeb5d-a095-4912-996b-b6e508cb58d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:21:48.026205 n-d-852088-5 devstack@keystone.service[82082]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeaeb5d-a095-4912-996b-b6e508cb58d0 service placement] RBAC: Authorization granted {{(pid=82082) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:21:48.043312 n-d-852088-5 devstack@keystone.service[82082]: [pid: 82082|app: 0|req: 4406/8884] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:21:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:21:58.035680 n-d-852088-5 devstack@keystone.service[82082]: DEBUG dbcounter [-] [82082] Writing DB stats keystone:SELECT=10 {{(pid=82082) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 05:23:03.438744 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3b108-7d2c-4d27-a57f-d6759795f529 service placement] Authenticating user token {{(pid=82083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 05:23:03.462250 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3b108-7d2c-4d27-a57f-d6759795f529 service placement] Validating token access rules against request {{(pid=82083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 05:23:03.467641 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b85968-ea43-47a2-ad9e-8c80dc547106 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '702086569a63418685711c4c134b1482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5632b718c3aa48458247661045e99e5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 05:23:03.468267 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b85968-ea43-47a2-ad9e-8c80dc547106 service placement] REQUEST_METHOD: `GET` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 05:23:03.468549 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b85968-ea43-47a2-ad9e-8c80dc547106 service placement] SCRIPT_NAME: `/identity` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 05:23:03.468822 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b85968-ea43-47a2-ad9e-8c80dc547106 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 05:23:03.480464 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b85968-ea43-47a2-ad9e-8c80dc547106 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 05:23:03.482387 n-d-852088-5 devstack@keystone.service[82083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b85968-ea43-47a2-ad9e-8c80dc547106 service placement] RBAC: Authorization granted {{(pid=82083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 05:23:03.495706 n-d-852088-5 devstack@keystone.service[82083]: [pid: 82083|app: 0|req: 4479/8885] 10.222.0.76 () {60 vars in 1365 bytes} [Sat Aug 27 05:23:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 05:23:13.487943 n-d-852088-5 devstack@keystone.service[82083]: DEBUG dbcounter [-] [82083] Writing DB stats keystone:SELECT=10 {{(pid=82083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}